- dovecot - dovecot.org

help with t/s retrieval 'hangs' disconnect for inactivity
by voytek＠sbt.net.au 22 Jun '15

22 Jun '15

I have Dovecot 2.1.17 on Centos, all working well since yesterday one user complaining he can not retrieve emails, TBird mail client says like '1 of 9' and, doesn't go any further. that's on several of his PCs using TBird, on a LAN behind f/wall, quite physically remote to server, server in Sydney, remote client is SEAsia looking at logs I see emails access, looking at server Maildir , new emails get moved from 'new' to 'cur' what else can I do from server end ? what else should be done from user end ? Jun 19 11:28:31 pop3(it(a)aaaa.com.au): Info: Disconnected for inactivity in reading our output top=0/0, retr=1/0, del=0/56, size=6562805 Jun 19 11:29:20 pop3(it(a)aaa.com.au): Info: Connection closed top=0/0, retr=1/0, del=0/56, size=6562805

3 4

[Dovecot] question about /var/mail/xxx
by Mickael Choisnard 22 Jun '15

22 Jun '15

Hi, I need your help to use dovecot with sendmail I use a fresh debian 8 jessie and i installed sendmail and dovecot 2. Sendmail works fine. All mails go to /var/mail/xxx this is problem for dovecot. dovecot cannot get it. # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.1 auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = yes disable_plaintext_auth = no first_valid_uid = 116 last_valid_uid = 116 log_path = /var/log/dovecot.log mail_home = /srv/mail/%u mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=SHA-CRYPT /etc/dovecot/users driver = passwd-file } postmaster_address = root@arpagon protocols = " imap pop3" service auth { unix_listener auth-userdb { group = vmail user = vmail } } ssl = no userdb { args = uid=vmail gid=vmail home=/srv/vmail/%d/%n driver = static } cat /var/log/dovecot.log Jun 19 08:14:18 imap-login: Info: Login: user=<mc110771>, method=PLAIN, rip=10.11.12.30, lip=88.179.182.93, mpid=18799, session=<z46U1dgY+gAKCwwe> Jun 19 08:14:18 imap(mc110771): Info: Disconnected: Logged out in=8 out=395 Jun 19 08:14:26 imap-login: Info: Login: user=<mc110771>, method=PLAIN, rip=10.11.12.30, lip=88.179.182.93, mpid=18801, session=<bNcE1tgY+wAKCwwe> Jun 19 08:14:26 imap-login: Info: Login: user=<mc110771>, method=PLAIN, rip=10.11.12.30, lip=88.179.182.93, mpid=18803, session=<sEIP1tgY/AAKCwwe> Jun 19 08:14:26 imap(mc120771): Error: open() failed with mbox file /var/mail/mc120771: Permission denied Jun 19 08:14:57 imap(mc120771): Info: Disconnected: Logged out in=137 out=640 Jun 19 08:14:57 imap(mc120771): Info: Disconnected: Logged out in=74 out=547 Jun 19 08:18:47 imap-login: Info: Disconnected (no auth attempts in 0 secs): user=<>, rip=10.11.12.45, lip=88.179.182.93, session=<H/mV5dgYhwAKCwwt> Jun 19 08:18:47 imap-login: Info: Disconnected (no auth attempts in 0 secs): user=<>, rip=10.11.12.45, lip=88.179.182.93, session=<2gOX5dgYigAKCwwt> Jun 19 08:18:47 imap-login: Info: Disconnected (no auth attempts in 0 secs): user=<>, rip=10.11.12.45, lip=88.179.182.93, session=<ojeY5dgYjQAKCwwt>

3 5

setting quota through IMAP
by Daniel Tröder 22 Jun '15

22 Jun '15

I'd like to set the quota of a user through the IMAP protocol. I use Pythons imaplib: imap.setquota("test1m(a)uni.dtr", "(storage 8192)") ('NO', ['Quota can be changed only by admin.']) So... which user is the "admin" user in a virtual user setting (passwd: PAM, userdb: LDAP)? Greetings Daniel

2 3

how do I conceptualize system & virtual users?
by lejeczek 22 Jun '15

22 Jun '15

I guess this would be a common case, I am hoping for some final clarification. a few Linux boxes share ldap (multi-master) backend that PAM/SSSD uses to authenticated users, and these LDAPs are also is used by Samba, users start @ uid 1000. Boxes are in the same both DNS and Samba domains. Do I treat these users as system or virtual users from postfix/dovecot perspective? If it can be a matter of choice then which is better/best? many thanks.

3 4

dovecot auth using 100% CPU
by Edward Betts 21 Jun '15

21 Jun '15

Every few days I find that dovecot auth is using all my CPU. This is from dovecot 2.2.13, I've just upgraded to 2.2.18 strace -r -p 17956 output: Process 17956 attached 0.000000 lseek(19, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) 0.000057 getsockname(19, {sa_family=AF_LOCAL, NULL}, [2]) = 0 0.000043 epoll_ctl(15, EPOLL_CTL_ADD, 19, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=850618928, u64=140128453618224}}) = 0 0.000040 write(19, "VERSION\tauth-worker\t1\t0\nDBHASH\t5"..., 97) = -1 EPIPE (Broken pipe) 0.000035 --- SIGPIPE {si_signo=SIGPIPE, si_code=SI_USER, si_pid=17956, si_uid=108} --- 0.000020 epoll_wait(15, {{EPOLLIN|EPOLLHUP, {u32=850618928, u64=140128453618224}}}, 14, 12614) = 1 0.000031 read(19, "", 8192) = 0 0.000026 epoll_ctl(15, EPOLL_CTL_DEL, 19, 7fff77616870) = 0 0.000027 close(19) = 0 0.000029 socket(PF_LOCAL, SOCK_STREAM, 0) = 19 0.000027 fcntl(19, F_GETFL) = 0x2 (flags O_RDWR) 0.000028 fcntl(19, F_SETFL, O_RDWR|O_NONBLOCK) = 0 0.000029 connect(19, {sa_family=AF_LOCAL, sun_path="auth-worker"}, 110) = 0 0.000033 fstat(19, {st_mode=S_IFSOCK|0777, st_size=0, ...}) = 0 0.000033 lseek(19, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) 0.000026 getsockname(19, {sa_family=AF_LOCAL, NULL}, [2]) = 0 0.000030 epoll_ctl(15, EPOLL_CTL_ADD, 19, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=850618928, u64=140128453618224}}) = 0 0.000035 write(19, "VERSION\tauth-worker\t1\t0\nDBHASH\t5"..., 97) = -1 EPIPE (Broken pipe) 0.000029 --- SIGPIPE {si_signo=SIGPIPE, si_code=SI_USER, si_pid=17956, si_uid=108} --- 0.000015 epoll_wait(15, {{EPOLLIN|EPOLLHUP, {u32=850618928, u64=140128453618224}}}, 14, 12614) = 1 0.000031 read(19, "", 8192) = 0 0.000026 epoll_ctl(15, EPOLL_CTL_DEL, 19, 7fff77616870) = 0 0.000027 close(19) = 0 0.000028 socket(PF_LOCAL, SOCK_STREAM, 0) = 19 0.000036 fcntl(19, F_GETFL) = 0x2 (flags O_RDWR) 0.000026 fcntl(19, F_SETFL, O_RDWR|O_NONBLOCK) = 0 0.000024 connect(19, {sa_family=AF_LOCAL, sun_path="auth-worker"}, 110) = 0 0.000034 fstat(19, {st_mode=S_IFSOCK|0777, st_size=0, ...}) = 0 0.000030 lseek(19, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) 0.000025 getsockname(19, {sa_family=AF_LOCAL, NULL}, [2]) = 0 0.000031 epoll_ctl(15, EPOLL_CTL_ADD, 19, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=850618928, u64=140128453618224}}) = 0 0.000036 write(19, "VERSION\tauth-worker\t1\t0\nDBHASH\t5"..., 97) = -1 EPIPE (Broken pipe) 0.000030 --- SIGPIPE {si_signo=SIGPIPE, si_code=SI_USER, si_pid=17956, si_uid=108} --- 0.000016 epoll_wait(15, {{EPOLLIN|EPOLLHUP, {u32=850618928, u64=140128453618224}}}, 14, 12614) = 1 0.000031 read(19, "", 8192) = 0 0.000027 epoll_ctl(15, EPOLL_CTL_DEL, 19, 7fff77616870) = 0 0.000028 close(19) = 0 Any ideas what's wrong? The machine is running Debian. -- Edward.

3 2

Re: Virtual Mailboxes
by dmiller＠amfes.com 21 Jun '15

21 Jun '15

The first bonehead maneuver seems to be: location = virtual:/var/mail/%%d/%%n/mdbox/virtual I'm thinking it should be: location = virtual:/var/mail/%%d/%%n/mdbox/mailboxes/virtual But...it didn't seem to make a difference. And if I have the "virtual" folder tree under a location other than "/var/mail/domain/user/mdbox/mailboxes" no names appear - so I think I have the files in the right place. Any ideas? -- Daniel On 2015-06-20 14:34, dmiller(a)amfes.com wrote: > > Having some trouble with my first attempt at virtual mailboxes. I've > enabled the plugin in 10-mail.conf, added a virtual namespace, and > created the dovecot-virtual files in the folders. > > I see the folder names in the list when I refresh the folders > available for subscription - but the folders cannot be subscribed to > and I can't view their contents. What obvious mistake did I make? > > doveconf -n: > auth_cache_size = 4 k > auth_mechanisms = plain login > default_login_user = nobody > default_vsz_limit = 1 G > dict { > acl = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext > } > disable_plaintext_auth = no > listen = * > mail_attachment_dir = /var/mail/attachments > mail_plugins = fts fts_solr acl zlib virtual > mail_shared_explicit_inbox = yes > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date index ihave duplicate > mdbox_rotate_interval = 1 days > mdbox_rotate_size = 32 M > namespace { > hidden = no > inbox = yes > list = yes > location = > prefix = > separator = / > subscriptions = yes > type = private > } > namespace { > list = children > location = mdbox:/var/mail/%%d/%%n/mdbox > prefix = shared/%%n/ > separator = / > subscriptions = no > type = shared > } > namespace { > location = virtual:/var/mail/%%d/%%n/mdbox/virtual > prefix = virtual/ > separator = / > } > passdb { > args = /usr/local/etc/dovecot/dovecot-ldap.conf > driver = ldap > } > plugin { > acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 > acl_shared_dict = proxy::acl > fts = solr > fts_autoindex = yes > fts_solr = break-imap-search url=http://solr.amfes.lan:8983/solr/ > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > protocols = imap lmtp sieve > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = mail > mode = 0600 > user = vmail > } > } > service dict { > unix_listener dict { > group = mail > mode = 0660 > user = vmail > } > } > service imap-login { > process_limit = 200 > process_min_avail = 10 > service_count = 1 > } > service lmtp { > process_min_avail = 5 > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = mail > mode = 0666 > user = vmail > } > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > inet_listener sieve_deprecated { > port = 2000 > } > process_min_avail = 0 > service_count = 1 > } > ssl_cert = </usr/local/etc/dovecot/ssl/certs/mail.amfes.com.crt > ssl_key = </usr/local/etc/dovecot/ssl/private/mail.amfes.com.key > userdb { > driver = prefetch > } > userdb { > args = /usr/local/etc/dovecot/dovecot-ldap.conf > driver = ldap > } > verbose_proctitle = yes > protocol lmtp { > mail_plugins = fts fts_solr acl zlib virtual sieve > } > protocol lda { > mail_plugins = fts fts_solr acl zlib virtual sieve > } > protocol imap { > imap_client_workarounds = tb-extra-mailbox-sep > imap_idle_notify_interval = 29 mins > mail_max_userip_connections = 50 > mail_plugins = fts fts_solr acl zlib virtual imap_acl > } > local 192.168.0.2 { > protocol imap { > ssl_cert = </usr/local/etc/dovecot/ssl/certs/mail.amfes.com.crt > ssl_key = </usr/local/etc/dovecot/ssl/private/mail.amfes.com.key > } > } > > Given my mail storage location of /var/mail/%%d/%%n, I have created: > /var/mail/mydomain/myname/virtual/newfolder > > and within that folder created a dovecot-virtual. I created a few like > this from the wiki samples - the folder names are visible but no > contents. > > -- > Daniel

1 0

Virtual Mailboxes
by Daniel Miller 21 Jun '15

21 Jun '15

Having some trouble with my first attempt at virtual mailboxes. I've enabled the plugin in 10-mail.conf, added a virtual namespace, and created the dovecot-virtual files in the folders. I see the folder names in the list when I refresh the folders available for subscription - but the folders cannot be subscribed to and I can't view their contents. What obvious mistake did I make? doveconf -n: auth_cache_size = 4 k auth_mechanisms = plain login default_login_user = nobody default_vsz_limit = 1 G dict { acl = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no listen = * mail_attachment_dir = /var/mail/attachments mail_plugins = fts fts_solr acl zlib virtual mail_shared_explicit_inbox = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mdbox_rotate_interval = 1 days mdbox_rotate_size = 32 M namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { list = children location = mdbox:/var/mail/%%d/%%n/mdbox prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace { location = virtual:/var/mail/%%d/%%n/mdbox/virtual prefix = virtual/ separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = proxy::acl fts = solr fts_autoindex = yes fts_solr = break-imap-search url=http://solr.amfes.lan:8983/solr/ sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = mail mode = 0600 user = vmail } } service dict { unix_listener dict { group = mail mode = 0660 user = vmail } } service imap-login { process_limit = 200 process_min_avail = 10 service_count = 1 } service lmtp { process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = mail mode = 0666 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } process_min_avail = 0 service_count = 1 } ssl_cert =

1 0

Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads
by David Gessel 20 Jun '15

20 Jun '15

My Dovecot 2.2.16 server is interacting poorly with a variety of mail clients. The symptoms include disappearing messages, mismatched summaries, duplicated messages, and excessive full re-downloads. Dovecot 2.2.16 on FreeBSD 10.1-release r280247M ZFS is interacting suboptimally with various email clients. Output of "dovecot -n" further down. *Client Artifacts* Thunderbird 31.6 Win 7 Ultimate SP1: - messages disappear and reappear with checks somewhat randomly. - Sometimes full re-download of folders is triggered, also seems random - Copies of messages appear, sometimes multiplying with each mail check up to about 5-8 or so of each message. - The summary information in the list pane doesn't match the message headers in the preview pane - quit and restart always cleans it up. - sometimes changing folders cleans it up, but not always - sometimes instigating a manual mail check cleans it up but not always Mulberry 4.08 Win 7 Ultimate SP1: - messages disappear and reappear - full re-scans of entire folders triggered occasionally when changing folders, but not always - message list filled with semi-blank entries (message number, status flags, and dates are listed, but no sender, subject, or body is available). The time stamps do not appear to be correct "date received". - message list fills with duplicates - the last of the set of duplicates, which are not necessarily sequentially numbered, has load-able body text and headers, but the others do not. There may be 3-5 copies, only one of which is the real message. The inbox is sequentially numbered by "message number" (the "natural order of the mailbox") and duplicates have unique numbers. - If there's a deleted message left, the "expunge" button is enabled and this also restores normal mailbox view. - disconnecting and reconnecting usually fixes the issues - changing mailboxes while connected sometimes fixes the issues. Claws 3.10.1 Win 7 Ultimate SP1 - initial load is correct, but once claws tries to sync mail, it locks up and never releases (even after days). Claws is weird like that. Sylpheed 3.4.2 Win 7 Ultimate SP1 - mail list always looks fine, but sometimes clicking a message shows "can't display" in the preview pane - "get messages" restores access to messages. Thunderbird 31.5 Linux Mint 17 Qaina 3.13.0-24-generic - messages disappear and reappear with checks somewhat randomly. - Sometimes full redownload of folders is triggered, also seems random - Copies of messages appear, sometimes multiplying with each mail check - The summary information in the list pane doesn't match the message headers in the preview pane - wrong message total (every other client agrees on 2576 but TB-linux says 3242, perhaps counting dups) Claws 3.9.3 Linux Mint 17 Qaina 3.13.0-24-generic - Occasionally shows "this message can't be displayed" - executing a "get mail" fixes the error K-9 5.004 Android 4.3 - messages appear and then disappear on the next check - message body is occasionally blank (only subject and arrival time appear, no body preview line, clicking on the message shows "no text" *Server artifacts:* dovecot.log shows runs of this error: Apr 15 09:02:37 imap(user(a)domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306286, file=1429102024.M826331P1156.host,S=1678,W=1724:2,S) or this error: Apr 15 10:04:00 indexer-worker(user(a)domain.com): Warning: Maildir /mail/domain.com/user//.Sent: Expunged message reappeared, giving a new UID (old uid=306803, file=1428785463.M645546P27215.host,S=5389,W=5442:2,S) # grep -c "Expunged message reappeared" dovecot.log.0 8981 The first entry in dovecot.log.0 is at Apr 15 10:00:12, and the last entry at Apr 15 12:00:13; Dovecot is logging 4,490 expunged message reappeared messages per hour. Note the server has 4 accounts set up and very limited traffic, so 4,490 per hour would seem like a lot of anything to be logged. # doveadm dump -t mailboxlog /mail/domain.com/user #0: rename 000000803de108b60f00000000000000 (1969-12-31 16:00:00) #24: 00000000000000000000000000000000 (1969-12-31 16:00:00) #48: 000000000000000000000000c8272100 (1969-12-31 16:01:04) #72: 00002e61726368697665732e32303031 (2031-02-20 10:50:40) Fatal: rec read() 10 != 24 "Fatal" seems like an error. I do not see much argument with the assertion that 10 != 24. # doveadm dump -t fts-expunge-log /mail/domain.com/user Fatal: Invalid record_size=2147483648 at offset 0 dovecot-debug.log examples follow after # dovecot -n output, which follows "fixes tried:" *Fixes Tried* # doveadm purge -A # doveadm fts rescan -u user(a)domain.com # doveadm -Dv index -u user INBOX # doveadm force-resync -u user INBOX I've set mbox_dirty_syncs = no mbox_lazy_writes = no ...in an attempt to fix the problem, but none did. I tried removing most of my customizations one by one and testing, but the problem has not been improved. I strongly suspect that the index files are getting thrashed or otherwise abused. I have no idea what's triggering whatever event is resulting in the thousands of expunged messages reappearing, but the client artifacts suggest a mismatch between cache or index files and files on disk: UID, keywords, and set date appear as if from cache but the body of the message does not. It seems as if the UID doesn't match a message on disk any more, which soon gets automatically fixed and everything syncs again until something re-triggers - a false expunge perhaps? Or perhaps the transaction log is suffering some sort of ongoing abuse? *dovecot -n* # dovecot -n # 2.2.16: /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.7 # OS: FreeBSD 10.1-RELEASE amd64 auth_default_realm = blackrosetech.com auth_mechanisms = plain login auth_realms = blackrosetech.com eroticanarchy.org debug_log_path = /var/log/dovecot-debug.log deliver_log_format = msgid=%m: %f $p %$ disable_plaintext_auth = no first_valid_gid = 5000 first_valid_uid = 5000 hostname = blackrosetech.com info_log_path = /var/log/dovecot-info.log last_valid_gid = 5000 last_valid_uid = 5000 lda_mailbox_autocreate = yes listen = 10.3.69.135 log_path = /var/log/dovecot.log mail_debug = yes mail_gid = 5000 mail_location = maildir:~:CONTROL=/var/no-quota/%u mail_plugins = quota mail_log notify fts fts_lucene mail_temp_dir = /var/tmp mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate spamtest spamtestplus editheader mbox_dirty_syncs = no mbox_lazy_writes = no namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { expire = Trash fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@. mime_parts mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = maildir:User quota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_rule = *:storage=50G quota_rule2 = Trash:storage=+30%% quota_rule3 = Sent:storage=+30%% quota_warning = storage=90%% quota-warning 90 %u quota_warning2 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_before = /usr/local/etc/dovecot/sieve/ sieve_dir = ~/sieve sieve_extensions = +spamtest +spamtestplus +relational +comparator-i;ascii-numeric +editheader sieve_global_dir = /usr/local/etc/dovecot/sieve } postmaster_address = gessel(a)blackrosetech.com protocols = imap lmtp sieve sieve sendmail_path = /usr/local/sbin/sendmail service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 vsz_limit = 128 M } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl = required ssl_cert = </usr/local/etc/ca/shiofuki-cert.pem ssl_key = </usr/local/etc/ca/shiofuki-unencrypted-key.pem ssl_prefer_server_ciphers = yes userdb { driver = prefetch } userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = quota mail_log notify fts fts_lucene sieve } protocol imap { mail_max_userip_connections = 20 mail_plugins = quota mail_log notify fts fts_lucene imap_quota } protocol lmtp { mail_plugins = quota mail_log notify fts fts_lucene sieve } I appreciate any assistance or insight, -David *dovecot-debug.log excerpts* Apr 15 13:17:26 indexer-worker(user(a)domain.com): user-lookup(user(a)domain.com)Debug: auth input: user(a)domain.com home=/mail/domain.com/user/ mail=maildir:~/ uid=5000 gid=5000 quota_rule=*:bytes=0 Apr 15 13:17:26 indexer-worker(user(a)domain.com): user-lookup(user(a)domain.com)Debug: Added userdb setting: mail=maildir:~/ Apr 15 13:17:26 indexer-worker(user(a)domain.com): user-lookup(user(a)domain.com)Debug: Added userdb setting: plugin/quota_rule=*:bytes=0 Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Effective uid=5000, gid=5000, home=/mail/domain.com/user/ Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Quota root: name=User quota backend=maildir args= Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=* bytes=0 messages=0 Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Trash bytes=0 (30%) messages=0 Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Sent bytes=0 (30%) messages=0 Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Quota warning: bytes=0 (90%) messages=0 reverse=no command=quota-warning 90 user(a)domain.com Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Quota warning: bytes=0 (75%) messages=0 reverse=no command=quota-warning 75 user(a)domain.com Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Quota grace: root=User quota bytes=0 (10%) Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/ Apr 15 13:17:26 indexer-worker(user(a)domain.com): Debug: maildir++: root=/mail/domain.com/user/, index=, indexpvt=, control=, inbox=/mail/domain.com/user/, alt= Apr 15 13:17:27 indexer-worker(user(a)domain.com): Debug: Ignoring unknown cache field: pop3.order Apr 15 13:17:27 indexer-worker(user(a)domain.com): Debug: Ignoring unknown cache field: binary.parts Apr 15 13:17:27 indexer-worker(user(a)domain.com): Debug: Ignoring unknown cache field: body.snippet Apr 15 13:44:25 lda(user(a)domain.com): Debug: Quota root: name=User quota backend=maildir args= Apr 15 13:44:25 lda(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=* bytes=53687091200 messages=0 Apr 15 13:44:25 lda(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Trash bytes=+16106127360 (30%) messages=0 Apr 15 13:44:25 lda(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Sent bytes=+16106127360 (30%) messages=0 Apr 15 13:44:25 lda(user(a)domain.com): Debug: Quota warning: bytes=48318382080 (90%) messages=0 reverse=no command=quota-warning 90 raw mail user Apr 15 13:44:25 lda(user(a)domain.com): Debug: Quota warning: bytes=40265318400 (75%) messages=0 reverse=no command=quota-warning 75 raw mail user Apr 15 13:44:25 lda(user(a)domain.com): Debug: Quota grace: root=User quota bytes=5368709120 (10%) Apr 15 13:44:25 lda(user(a)domain.com): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Apr 15 13:49:32 lda(user(a)domain.com): Debug: Quota root: name=User quota backend=maildir args= Apr 15 13:49:32 lda(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=* bytes=53687091200 messages=0 Apr 15 13:49:32 lda(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Trash bytes=+16106127360 (30%) messages=0 Apr 15 13:49:32 lda(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Sent bytes=+16106127360 (30%) messages=0 Apr 15 13:49:32 lda(user(a)domain.com): Debug: Quota warning: bytes=48318382080 (90%) messages=0 reverse=no command=quota-warning 90 raw mail user Apr 15 13:49:32 lda(user(a)domain.com): Debug: Quota warning: bytes=40265318400 (75%) messages=0 reverse=no command=quota-warning 75 raw mail user Apr 15 13:49:32 lda(user(a)domain.com): Debug: Quota grace: root=User quota bytes=5368709120 (10%) Apr 15 13:49:32 lda(user(a)domain.com): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file storage: Using script storage path: /mail/domain.com/user//sieve Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `Forwards' from `/mail/domain.com/user/sieve/Forwards.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Server_Msg' from `/mail/domain.com/user/sieve/File_Server_Msg.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_SRL' from `/mail/domain.com/user/sieve/File_SRL.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_BULK' from `/mail/domain.com/user/sieve/File_BULK.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Commerce' from `/mail/domain.com/user/sieve/File_Commerce.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Impersonal' from `/mail/domain.com/user/sieve/File_Impersonal.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Travel' from `/mail/domain.com/user/sieve/File_Travel.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Tribe' from `/mail/domain.com/user/sieve/File_Tribe.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Info' from `/mail/domain.com/user/sieve/File_Info.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Lists' from `/mail/domain.com/user/sieve/File_Lists.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Trash' from `/mail/domain.com/user/sieve/File_Trash.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Security' from `/mail/domain.com/user/sieve/File_Security.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Notifications' from `/mail/domain.com/user/sieve/File_Notifications.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: file script: Opened script `File_Spam' from `/mail/domain.com/user/sieve/File_Spam.sieve' Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: Script binary /mail/domain.com/user/.dovecot.svbin successfully loaded Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: binary save: not saving binary /mail/domain.com/user/.dovecot.svbin, because it is already stored Apr 15 13:49:41 lda(user(a)domain.com): Debug: sieve: Executing script from `/mail/domain.com/user/.dovecot.svbin' Apr 15 13:49:41 lda(user(a)domain.com): Debug: Quota root: name=User quota backend=maildir args= Apr 15 13:49:41 lda(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=* bytes=53687091200 messages=0 Apr 15 13:30:31 imap(user(a)domain.com): Debug: Loading modules from directory: /usr/local/lib/dovecot Apr 15 13:30:31 imap(user(a)domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib10_quota_plugin.so Apr 15 13:30:31 imap(user(a)domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib11_imap_quota_plugin.so Apr 15 13:30:31 imap(user(a)domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib15_notify_plugin.so Apr 15 13:30:31 imap(user(a)domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.so Apr 15 13:30:31 imap(user(a)domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib20_mail_log_plugin.so Apr 15 13:30:31 imap(user(a)domain.com): Debug: Module loaded: /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so Apr 15 13:30:31 imap(user(a)domain.com): Debug: Added userdb setting: plugin/quota_rule=*:bytes=0 Apr 15 13:30:31 imap(user(a)domain.com): Debug: Effective uid=5000, gid=5000, home=/mail/domain.com/user/ Apr 15 13:30:31 imap(user(a)domain.com): Debug: Quota root: name=User quota backend=maildir args= Apr 15 13:30:31 imap(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=* bytes=0 messages=0 Apr 15 13:30:31 imap(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Trash bytes=0 (30%) messages=0 Apr 15 13:30:31 imap(user(a)domain.com): Debug: Quota rule: root=User quota mailbox=Sent bytes=0 (30%) messages=0 Apr 15 13:30:31 imap(user(a)domain.com): Debug: Quota warning: bytes=0 (90%) messages=0 reverse=no command=quota-warning 90 user(a)domain.com Apr 15 13:30:31 imap(user(a)domain.com): Debug: Quota warning: bytes=0 (75%) messages=0 reverse=no command=quota-warning 75 user(a)domain.com Apr 15 13:30:31 imap(user(a)domain.com): Debug: Quota grace: root=User quota bytes=0 (10%) Apr 15 13:30:31 imap(user(a)domain.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~:CONTROL=/var/no-quota/user@domain.com Apr 15 13:30:31 imap(user(a)domain.com): Debug: maildir++: root=/mail/domain.com/user/, index=, indexpvt=, control=/var/no-quota/user(a)domain.com, inbox=/mail/domain.com/user/, alt=

7 29

crash dovecot 2.2.18
by Hajo Locke 19 Jun '15

19 Jun '15

Hello, after upgrading from 2.1.17 to 2.2.18 i have a specific Inbox which causes a crash on dovecot: Jun 19 09:28:03 hostname dovecot: imap(username): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x7075f) [0x7f9298c4375f] -> /usr/lib/dovecot/libdovecot.so.0(+0x707be) [0x7f9298c437be] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f9298bf11aa] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x2bd9a) [0x7f9298ee2d9a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x98f8b) [0x7f9298f4ff8b] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0xb9) [0x7f9298f502c9] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_first_header+0x38) [0x7f9298ee3d18] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xabfa2) [0x7f9298f62fa2] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xac1e2) [0x7f9298f631e2] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x68) [0x7f9298c4d118] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7f9298c4da9d] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x65) [0x7f9298c33065] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header+0x38) [0x7f9298c338d8] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_headers+0x80) [0x7f9298f4f940] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x98cca) [0x7f9298f4fcca] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0xb9) [0x7f9298f502c9] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_first_header+0x38) [0x7f9298ee3d18] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9a85a) [0x7f9298f5185a] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_date+0x92) [0x7f9298f51972] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_date+0x36) [0x7f9298ee3b76] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa3113) [0x7f9298f5a113] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_sort_list_add+0x31) [0x7f9298f5a471] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x3d) [0x7f9298f5801d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x27) [0x7f9298eecd67] -> dovecot/imap [username ip.ip.ip.ip UID SORT](+0x1e7f7) [0x7f92994117f7] -> dovecot/imap [username ip.ip.ip.ip UID SORT](imap_search_start+0xf1) [0x7f9299411c41] -> dovecot/imap [username ip.ip.ip.ip UID SORT](cmd_sort+0x25b) [0x7f9299407c4b] -> dovecot/imap [username ip.ip.ip.ip UID SORT](command_exec+0x4d) [0x7f929940c40d] Mailboxformat is mbox. I think reason was a damaged Index in ~username/mail/.imap/INBOX/ I removed this folder and immediately errors are gone and Mailbox was readable again. Never noticed this kind of errors for years on 2.1.17, maybe this helps to find a Bug in Code. Thanks, Hajo

1 0

dsync selectively
by lejeczek 19 Jun '15

19 Jun '15

hi everybody I've barely started reading on dsync and I wonder.. would you know if it is possible to sync/replicate only specific domain(users)? or it's always the whole lot? many thanks P.

4 8

Dovecot 2.1.9 shared folder deletion causes fault
by JT 19 Jun '15

19 Jun '15

Hey all, I'm getting a fault in dovecot (see below) using shared folders. I have a mailbox that receives new mail (Account X/INBOX). Another account (Account A) has access to the other account (Account X/INBOX) with ACL below. The ACL directory (.DEFAULT) contains: user=AccountA lrwst I removed a test email from Account A/INBOX, which is supposed to remove the email from Account X/INBOX. A fault occurs whenever my client (Thunderbird) attempts to connect and complete the deletion. Other actions complete successfully. It only appears to happen when using Thunderbird. Mac Mail does not cause the fault. I'm not getting a core dump so all I have is what the log outputs. I can reproduce this regularly so let me know if you need any additional information. Thanks, JT === Version: 2.1.9 (Ubuntu Trustydeb package) OS: Ubuntu trusty 14.04 2015-06-18T19:17:50.518505+00:00 mail-103 dovecot: imap(XXX): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x5e271) [0x7eff3f6d1271] -> /usr/lib/dovecot/libdovecot.so.0(+0x5e34e) [0x7eff3f6d134e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7eff3f68ca9e] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa7cbc) [0x7eff3f9e2cbc] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x6c) [0x7eff3f9ac8ec] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x15) [0x7eff3f9ac985] -> dovecot/imap(+0xded5) [0x7eff3fe78ed5] -> dovecot/imap(command_exec+0x3c) [0x7eff3fe836dc] -> dovecot/imap(+0x176cf) [0x7eff3fe826cf] -> dovecot/imap(+0x17785) [0x7eff3fe82785] -> dovecot/imap(client_handle_input+0x125) [0x7eff3fe82aa5] -> dovecot/imap(client_input+0x75) [0x7eff3fe82e35] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7eff3f6e1247] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7eff3f6e1fd7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7eff3f6e0de8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7eff3f691c93] -> dovecot/imap(main+0x2c4) [0x7eff3fe772f4] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7eff3f2cfec5] -> dovecot/imap(+0xc460) [0x7eff3fe77460] 2015-06-18T19:17:50.736901+00:00 mail-103 dovecot: imap(XXX): Fatal: master: service(imap): child 4461 killed with signal 6 (core dumped) 2015-06-18T19:17:51.662157+00:00 mail-103 dovecot: imap(XXX): Panic: file mail-index.c: line 380 (mail_index_keywords_unref): assertion failed: (keywords->refcount > 0) 2015-06-18T19:17:51.662969+00:00 mail-103 dovecot: imap(XXX): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x5e271) [0x7f3fa05bb271] -> /usr/lib/dovecot/libdovecot.so.0(+0x5e34e) [0x7f3fa05bb34e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f3fa0576a9e] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa7cbc) [0x7f3fa08cccbc] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x6c) [0x7f3fa08968ec] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x15) [0x7f3fa0896985] -> dovecot/imap(+0xded5) [0x7f3fa0d62ed5] -> dovecot/imap(command_exec+0x3c) [0x7f3fa0d6d6dc] -> dovecot/imap(+0x176cf) [0x7f3fa0d6c6cf] -> dovecot/imap(+0x17785) [0x7f3fa0d6c785] -> dovecot/imap(client_handle_input+0x125) [0x7f3fa0d6caa5] -> dovecot/imap(client_input+0x75) [0x7f3fa0d6ce35] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7f3fa05cb247] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7f3fa05cbfd7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f3fa05cade8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f3fa057bc93] -> dovecot/imap(main+0x2c4) [0x7f3fa0d612f4] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f3fa01b9ec5] -> dovecot/imap(+0xc460) [0x7f3fa0d61460] 2015-06-18T19:17:51.857451+00:00 mail-103 dovecot: imap(XXX): Fatal: master: service(imap): child 4464 killed with signal 6 (core dumped) protocol imap { imap_client_workarounds = tb-extra-mailbox-sep imap_idle_notify_interval = 1 mins mail_max_userip_connections = 10 mail_plugins = acl quota acl imap_acl quota imap_quota } plugin { acl = vfile:/etc/dovecot/acl acl_defaults_from_inbox = yes acl_shared_dict = proxy::acl ... } namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { hidden = no list = children location = maildir:/var/mail/public/Maildir:INDEX=/var/mail/%d/%n/Maildir/public prefix = public/ separator = / subscriptions = yes type = public } namespace { list = yes location = maildir:%%h/Maildir:CONTROL=~/Maildir/control/%%u:INDEX=~/Maildir/shared/%%u.indx:INDEXPVT=~/Maildir/shared/%%u.pvt prefix = shared/%%u/ separator = / subscriptions = no type = shared }

2 1

centos 7 dovecot 2.2.10 segmentation fault on devcot/auth using ldap driver in userdb
by Andrea Lisci 19 Jun '15

19 Jun '15

dovecot 2.2.10 packaged by centos 7 configuring ldap driver on userdb cause imap crash during login userdb { driver = ldap args = /etc/dovecot/dovecot-ldap-userdb.conf3.ext # Default fields can be used to specify defaults that LDAP may override #default_fields = home=/home/virtual/%u } #ldap conf --------------- hosts = myDChost base = dc=company,dc=testdomain,dc=dom ldap_version = 3 auth_bind = yes auth_bind_userdn = windowsdomain\%u user_filter = (&(objectclass=person)(|(mail=%u)(sAMAccountName=%n))) user_attrs = =uid=vmail,=gid=vmail,=home=/users/vmail/maildomain.com/%n,=mail_location=maildir:/users/vmail/maildomain.com/%n/Maildir tls = yes tls_require_cert = never dovecot -n --------------- # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-229.4.2.el7.x86_64 x86_64 CentOS Linux release 7.1.1503 (Core) xfs auth_debug = yes auth_mechanisms = plain login listen = * mail_debug = yes mail_location = maildir:/users/vmail/maildomain.com/%n/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf2.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = required ssl_cert = </etc/pki/dovecot/certs/mail.maildomain.com.crt.pem ssl_key = </etc/pki/dovecot/private/mail.maildomain.com.key.pem userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf3.ext driver = ldap } protocol lmtp { mail_plugins = " quota sieve" passdb { args = password=foo driver = static } } protocol lda { mail_plugins = " sieve" } core dump ------------- gdb /usr/libexec/dovecot/auth /var/core/25122 GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-64.el7 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/libexec/dovecot/auth...Reading symbols from /usr/lib/debug/usr/libexec/dovecot/auth.debug...done. done. [New LWP 25122] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Missing separate debuginfo for /usr/lib64/libnssckbi.so Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/1e/a2171aee7143d971607597b24f2a97e9276cbb.debug Core was generated by `dovecot/auth'. Program terminated with signal 11, Segmentation fault. #0 db_ldap_handle_request_result (res=0x0, idx=<optimized out>, request=<optimized out>, conn=<optimized out>) at db-ldap.c:819 819 request->callback(conn, request, res->msg); (gdb) bt full #0 db_ldap_handle_request_result (res=0x0, idx=<optimized out>, request=<optimized out>, conn=<optimized out>) at db-ldap.c:819 _data_stack_cur_id = 3 srequest = <optimized out> ret = <optimized out> final_result = <optimized out> named_res = <optimized out> #1 db_ldap_handle_result (res=<optimized out>, conn=<optimized out>) at db-ldap.c:886 auth_request = 0x7f3704fa2620 idx = <optimized out> msgid = <optimized out> #2 ldap_input (conn=<optimized out>) at db-ldap.c:918 timeout = {tv_sec = 0, tv_usec = 0} res = 0x7f3704b1b530 msg = 0x7f370489fcb0 prev_reply_diff = <optimized out> ret = <optimized out> #3 0x00007f3702a19a47 in io_loop_call_io (io=0x7f37046dbad0) at ioloop.c:388 ioloop = 0x7f37046bd7b0 t_id = 2 #4 0x00007f3702a1a8cf in io_loop_handler_run (ioloop=ioloop@entry=0x7f37046bd7b0) at ioloop-epoll.c:220 ctx = 0x7f37046c5450 events = <optimized out> list = 0x7f3704998170 io = <optimized out> tv = {tv_sec = 0, tv_usec = 999118} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #5 0x00007f3702a19598 in io_loop_run (ioloop=0x7f37046bd7b0) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #6 0x00007f37029c69e3 in master_service_run (service=0x7f37046bd640, callback=<optimized out>) at master-service.c:571 No locals. #7 0x00007f3702ea77f1 in main (argc=1, argv=0x7f37046bd390) at main.c:393 c = <optimized out>

3 2

maildir, how to always add size tags to filename (,S=).
by Sergei Franco 19 Jun '15

19 Jun '15

Hi There, I have thoroughly read through documentation and wiki and I simply cannot find how to force dovecot to always add the size tag to the filename when using maildir format. We are using dovecot 2.2.9 (whatever comes from ubuntu 14.04 LTS). We are using dovecot in conjunction with exim with maidirsize file enabled and maildir quotas. For example exim has following configuration: maildir_tag = ,S=$message_size Which adds the size to the filename of the message. This has enormous (orders of magnitude) performance benefit as to calculate quota one does not need to stat every single file (only getents for each directory). I have wrote a script that adds the size tag retrospectively to files it didn't had it, and rebuild the dovecot index/cache if changes where made. This worked fine. Behaviour of dovecot is very peculiar: it generally adds the ,S= tag (along with ,W= tag) but occasionally it does not (I wander if it depends on the IMAP client). Is there anyway to force dovecot to add size tag to the files (like with exim example above)? Thank you very much. Sergei.

3 2

Best practices for mailbox network file storage?
by Andy Csillag 18 Jun '15

18 Jun '15

Is there a current best practice for a shared filesystem backend for mailboxes (in my case, all virtual accounts)? NFS 3/4, GFS2, GlusterFS, other? In the case of the latter ones, is the use of Director necessary? Any specific anti-recommendations? Also, if it matters, I *think* I want to use BackBlaze racks for storage. Also, I've seen recommendations for the filesystem underneath like XFS or ext4 or whatever. Is there a best practice? Thanks, Drew

3 2

Help with Namespaces
by Steve Matzura 18 Jun '15

18 Jun '15

Most of my users are virtual. Do I need defined namespaces or is the default undefined one OK?

2 2

LMTP with Postfix Problem
by Steve Matzura 18 Jun '15

18 Jun '15

Here's a maillog entry that's one of many I receive when I try sending a test message to my system. The recipient is a virtual user in /etc/virtual. The way I'm expecting it to work is that my message from me to this Postfix virtual user will be sent back to me. Every time the message delivery is attempted, Dovecot says the LMTP directory doesn't exist. I thought it was created automatically as messages arrive. Jun 18 01:48:27 <machine-name> postfix/lmtp[30644]: 4CA5B8CB6: to=<postmaster@<my-domain>>, orig_to=<postmaster>, relay=none, delay=0.02, delays=0.02/0/0/0, dsn=4.4.1, status=deferred (connect to <my-FQDN>[private/dovecot-lmtp]: No such file or directory)

2 2

Pigeonhole vacation from alias address
by Dino Blazeka 18 Jun '15

18 Jun '15

Hi everyone. I've set up my instance not to check recipient address with sieve_vacation_dont_check_recipient=yes to enable users to set up their vacation script without listing addresses (there are to many). Only problem remaining is that when they receive an e-mail sent to their alias, the vacation response comes from their original mail address. Is there a setting or workaround that would enable vacation extension to send response with from field set to whichever address the original message was addressed to. Thank you in advance, Dino P. S. This is my first message to the list so I apologize in advance if I have broken any rules. It was not done intentionally

1 0

get failed auth
by My Work 18 Jun '15

18 Jun '15

Hi, how i can write all users to my db (mysql example) if it is possible that get "unknown user", "auth failed" e.g.? dovecot 2.2.13 root@dev0:/home/fov# dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.0 ext4 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-master base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_gid = 103 first_valid_uid = 101 listen = * mail_access_groups = mail,Debian-exim,dovecot mail_debug = yes mail_full_filesystem_access = yes mail_gid = 103 mail_location = maildir:/var/vmail/%d/%n mail_uid = 101 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace inbox { inbox = yes location = prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { autocreate = Trash autocreate2 = Sent autocreate3 = Drafts autocreate4 = Junk autosubscribe = Trash autosubscribe2 = Sent autosubscribe3 = Drafts autosubscribe4 = Junk sieve = /var/vmail/%d/%n/currently-active-script.sieve sieve_dir = /var/vmail/%d/%n/sieve } protocols = imap sieve service auth { unix_listener auth-client { group = Debian-exim mode = 0666 user = Debian-exim } unix_listener auth-master { group = Debian-exim mode = 0666 user = Debian-exim } user = root } service imap-login { inet_listener imap { port = 143 } } service managesieve-login { executable = /usr/lib/dovecot/managesieve-login inet_listener sieve { port = 2074 } process_min_avail = 1 service_count = 1 vsz_limit = 64 M } service managesieve { executable = /usr/lib/dovecot/managesieve process_limit = 10 } ssl = no userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = /tmp/dovecot-deliver.log log_path = /tmp/dovecot-deliver.log mail_plugins = sieve postmaster_address = postmaster(a)horsetele.com.ua sendmail_path = /usr/sbin/exim4 } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = autocreate } protocol sieve { managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 }

2 1

privilege of process executed by extprograms plugin
by Takahiro Yakoh 18 Jun '15

18 Jun '15

Hi, I'm just a beginner of extprograms plugin of sieve. When I execute a process via execute or pipe command, the process start with "root" privilege. Why? I believe the process must be executed with recipient privilege. Give me some checkpoints, or hints, please. My setup is as follows: Ubuntu 14.04.2 LTS 64bit + dovecot-core, dovecot-sieve plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_execute_bin_dir = /some/where sieve_extensions = +vnd.dovecot.execute +vnd.dovecot.pipe sieve_pipe_bin_dir = /some/where sieve_plugins = sieve_extprograms } protocol lmtp { mail_plugins = " sieve" postmaster_address = postmaster(a)some.where } Yakoh

1 0

bug in indexer/indexer-worker
by Infoomatic 18 Jun '15

18 Jun '15

Hi, I have already mentioned this in http://www.dovecot.org/pipermail/dovecot/2014-November/098592.html I could reproduce the errors above in a self-compiled v2.2.18 and the prebuilt packages from xi.rename-it.nl (in addition to version 2.2.15 mentioned in the link) The problem occurs when enabling fts_tika in the plugins (tried tika 1.6, 1.7 and 1.8). I tried to move a folder of my mailbox with about 2000 mails to my server (no users, modern hardware). At some point I get an error and from this time on dovecot keeps repeating the last lines with every mail that comes in ... see [1] I then get kernel syslog messages like in [2]. when I try to index all users (had another testuser) mailboxes with "doveadm index" I get the errors of [3]. The mailfolder does contain mails with attachments of all sorts, videos, office documents etc. When disabling fts_tika it works. dovecot -n output is [4] Could someone of the devs please have a look? best regards, infoomatic [1] Then comes the panic which produces loads of errormessages below the "Raw backtrace" part: Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Warning: I/O leak: 0x7f40b55c39d0 (line 411, fd 20) Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Warning: Timeout leak: 0x7f40b55c3780 (line 325) Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Panic: file ioloop.c: line 39 (io_add_file): assertion failed: (callback != NULL) Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Error: Raw backtrace: /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x78320) [0x7f40b55f4320] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x783fe) [0x7f40b55f43fe] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f40b55a3b25] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x897d0) [0x7f40b56057d0] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_move_io+0x3e) [0x7f40b560643e] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(connection_switch_ioloop+0x14) [0x7f40b55f21d4] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(http_client_switch_ioloop+0x28) [0x7f40b55c8148] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x44536) [0x7f40b55c0536] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x49) [0x7f40b108d469] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(+0x3ac9) [0x7f40b1089ac9] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(+0x3b6d) [0x7f40b1089b6d] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0x86ec) [0x7f40b495c6ec] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_deinit+0x23) [0x7f40b495c723] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xe5cc) [0x7f40b49625cc] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xf451) [0x7f40b4963451] -> /opt/dovecot/lib/dovecot/lib10_quota_plugin.so(+0xb454) [0x7f40b4b97454] -> /opt/dovecot/lib/dovecot/lib01_acl_plugin.so(+0xcfea) [0x7f40b4daafea] -> /opt/dovecot/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x41) [0x7f40b58a64f1] -> /opt/dovecot/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit+0xe) [0x7f40b58a658e] -> dovecot/indexer-worker() [0x40250c] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7f40b560615c] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xbb) [0x7f40b56070ab] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f40b56061c9] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f40b5606248] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f40b55a9093] -> dovecot/indexer-worker(main+0xe3) [0x401f03] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f40b51d8ec5] -> dovecot/indexer-worker() [0x401fc2] Jun 16 10:11:08 testhost dovecot: indexer: Error: Indexer worker disconnected, discarding 2 requests for user1 Jun 16 10:11:08 testhost dovecot: indexer-worker(user1): Fatal: master: service(indexer-worker): child 2066 killed with signal 6 (core dumped) Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Warning: I/O leak: 0x7f25bc1689d0 (line 120, fd 23) Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Warning: Timeout leak: 0x7f25bc168780 (line 325) Jun 16 10:11:09 testhost dovecot: indexer: Error: Indexer worker disconnected, discarding 2 requests for user1 Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Fatal: master: service(indexer-worker): child 2124 killed with signal 11 (core dumped) Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Warning: I/O leak: 0x7f6cabb149d0 (line 120, fd 23) Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Warning: Timeout leak: 0x7f6cabb14780 (line 325) Jun 16 10:11:09 testhost dovecot: indexer: Error: Indexer worker disconnected, discarding 2 requests for user1 Jun 16 10:11:09 testhost dovecot: indexer-worker(user1): Fatal: master: service(indexer-worker): child 2125 killed with signal 11 (core dumped) [2] kernel syslog: [Tue Jun 16 09:51:15 2015] indexer-worker[7592]: segfault at 8 ip 00007f066e8c8c27 sp 00007fff36a038b0 error 4 in libdovecot.so.0.0.0[7f066e832000+e7000] [Tue Jun 16 09:51:16 2015] indexer-worker[7594]: segfault at 8 ip 00007f702671ac27 sp 00007ffc6e134840 error 4 in libdovecot.so.0.0.0[7f7026684000+e7000] [Tue Jun 16 09:51:16 2015] indexer-worker[7596]: segfault at 20 ip 00007fb8a5af2c47 sp 00007fff0a344780 error 4 in libdovecot.so.0.0.0[7fb8a5a69000+e7000] [Tue Jun 16 09:51:17 2015] indexer-worker[7598]: segfault at 20 ip 00007f5834b6ac47 sp 00007ffd54f35c00 error 4 in libdovecot.so.0.0.0[7f5834ae1000+e7000] [Tue Jun 16 09:51:18 2015] indexer-worker[7600]: segfault at 20 ip 00007f5b2f6fac47 sp 00007fff1a697690 error 4 in libdovecot.so.0.0.0[7f5b2f671000+e7000] [Tue Jun 16 09:51:19 2015] indexer-worker[7602]: segfault at 20 ip 00007fd6084ddc47 sp 00007ffdb4495af0 error 4 in libdovecot.so.0.0.0[7fd608454000+e7000] [Tue Jun 16 09:51:20 2015] indexer-worker[7604]: segfault at 20 ip 00007f7049789c47 sp 00007ffe71e4bdd0 error 4 in libdovecot.so.0.0.0[7f7049700000+e7000] [Tue Jun 16 09:51:20 2015] indexer-worker[7606]: segfault at 20 ip 00007f771d54dc47 sp 00007ffe01c6ff80 error 4 in libdovecot.so.0.0.0[7f771d4c4000+e7000] [Tue Jun 16 09:51:21 2015] indexer-worker[7608]: segfault at 20 ip 00007fc19d482c47 sp 00007ffc9a0b0280 error 4 in libdovecot.so.0.0.0[7fc19d3f9000+e7000] [Tue Jun 16 09:51:22 2015] indexer-worker[7610]: segfault at 29 ip 00007fa14df25c2b sp 00007ffeb246e5f0 error 4 in libdovecot.so.0.0.0[7fa14de8f000+e7000] [Tue Jun 16 09:51:23 2015] indexer-worker[7612]: segfault at 8 ip 00007fe8e41f2c27 sp 00007ffc700e2170 error 4 in libdovecot.so.0.0.0[7fe8e415c000+e7000] [Tue Jun 16 09:51:24 2015] indexer-worker[7614]: segfault at 8 ip 00007ff9a0c76c27 sp 00007fffecd44c90 error 4 in libdovecot.so.0.0.0[7ff9a0be0000+e7000] [Tue Jun 16 09:51:25 2015] indexer-worker[7616]: segfault at 8 ip 00007fd27867dc27 sp 00007ffedd8407f0 error 4 in libdovecot.so.0.0.0[7fd2785e7000+e7000] [Tue Jun 16 09:51:25 2015] indexer-worker[7618]: segfault at 8 ip 00007f94f8753c27 sp 00007fff56cc5ea0 error 4 in libdovecot.so.0.0.0[7f94f86bd000+e7000] [3] errors from "doveadm index": /opt/dovecot/bin/doveadm index -A '*' doveadm(user1): Warning: I/O leak: 0x7f0e072519d0 (line 120, fd 27) doveadm(user1): Warning: Timeout leak: 0x7f0e07251780 (line 325) Segmentation fault (core dumped) /opt/dovecot/bin/doveadm index -u user1 '*' doveadm(user1): Warning: I/O leak: 0x7f99b4fba9d0 (line 411, fd 14) doveadm(user1): Warning: Timeout leak: 0x7f99b4fba780 (line 325) doveadm(user1): Fatal: pool_system_realloc(17179869184): Out of memory doveadm(user1): Error: Raw backtrace: /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x78320) [0x7f99b4feb320] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f99b4feb38a] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f99b4f9ac7f] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x8f3a3) [0x7f99b50023a3] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x7472d) [0x7f99b4fe772d] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(buffer_get_space_unsafe+0x5f) [0x7f99b4fe7f5f] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handle_add+0x24) [0x7f99b4ffdd94] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x89761) [0x7f99b4ffc761] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(io_loop_move_io+0x3e) [0x7f99b4ffd43e] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(connection_switch_ioloop+0x14) [0x7f99b4fe91d4] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(http_client_switch_ioloop+0x28) [0x7f99b4fbf148] -> /opt/dovecot/lib/dovecot/libdovecot.so.0(+0x44536) [0x7f99b4fb7536] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x49) [0x7f99b0c9d469] -> /opt/dovecot/lib/dovecot/lib21_fts_solr_plugin.so(+0x373f) [0x7f99b0c9973f] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0x91e8) [0x7f99b43541e8] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0x95f0) [0x7f99b43545f0] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x714) [0x7f99b4354d34] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xf17e) [0x7f99b435a17e] -> /opt/dovecot/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x19) [0x7f99b5294e89] -> /opt/dovecot/bin/doveadm() [0x423211] -> /opt/dovecot/bin/doveadm() [0x41ecc6] -> /opt/dovecot/bin/doveadm(doveadm_mail_try_run+0x27f) [0x41fb8f] -> /opt/dovecot/bin/doveadm(main+0x38f) [0x412a9f] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f99b4bcfec5] -> /opt/dovecot/bin/doveadm() [0x412b99] [4] dovecot -n # 2.2.18: /opt/dovecot/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 3.13.0-52-generic x86_64 Ubuntu 14.04.2 LTS ext4 auth_username_format = %n auth_verbose = yes disable_plaintext_auth = no imap_idle_notify_interval = 5 mins mail_gid = vmail mail_home = /var/lib/vmail/home/%d/%u mail_location = mdbox:/var/lib/vmail/mail/%d/%u mail_plugins = fts fts_solr zlib acl quota zlib fts fts_solr acl mail_uid = vmail mailbox_idle_check_interval = 1 mins managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate imapflags notify mdbox_rotate_size = 32 M namespace { list = children location = mdbox:/var/lib/vmail/mail/%d/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /opt/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_defaults_from_inbox = yes acl_shared_dict = file:/var/lib/vmail/shared-mailboxes fts = solr fts_autoindex = yes fts_solr = url=http://localhost:8983/solr/ break-imap-search fts_tika = http://localhost:8081/tika quota = dict:Quota::file:%h/dovecot-quota quota_rule = *:storage=1G quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags zlib_save = gz zlib_save_level = 9 } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail user = vmail } } service imap-login { inet_listener imaps { port = 0 } } service managesieve-login { inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl = required ssl_cert = </etc/ssl/testhost/testhost.crt ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH:+CAMELLIA256:+AES256:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:!RC4:!SEED:!ECDSA:CAMELLIA256-SHA:AES256-SHA:CAMELLIA128-SHA:AES128-SHA ssl_key = </etc/ssl/testhost/testhost.key ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { args = /opt/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = fts fts_solr zlib sieve acl } protocol imap { mail_plugins = fts fts_solr zlib acl quota imap_acl imap_quota } protocol sieve { mail_plugins = fts fts_solr }

3 3

FTS lucene and english + german mails
by Felix Zielcke 17 Jun '15

17 Jun '15

Hi, I'm currently looking over the FTS pages to enable it in my dovecot. But I'm unsure what the best settings of the lucene plugin are, if you receive german and english mails. Wiki says: textcat_conf=<path> textcat_dir=<path>: If specified, enable guessing the stemming language for emails and search keywords. This is a little bit problematic in practice, since indexing and searching languages may differ and may not find even exact words because they stem differently. On Debian libstemmer is included in the debian-lucene package. So what settings are the best to have not the problem that exact words can't be found?

2 2

Sorry, wrong paste buffer
by Steve Matzura 17 Jun '15

17 Jun '15

Please ignore last message.

1 0

Re: Mail to nowhere
by Steve Matzura 17 Jun '15

17 Jun '15

On Wed, 17 Jun 2015 09:10:26 -0400, you wrote: >Please send the output of postconf -n to the mailing list. Paul: I purposefully obfuscated my FQDN and domain, but they both have real and good data in them. alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases, hash:/var/lib/mailman/data/aliases command_directory = /usr/sbin config_directory = /etc/postfix daemon_directory = /usr/libexec/postfix data_directory = /var/lib/postfix debug_peer_level = 2 debugger_command = PATH=/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin ddd $daemon_directory/$process_name $process_id & sleep 5 html_directory = no inet_interfaces = localhost inet_protocols = all mail_owner = postfix mailq_path = /usr/bin/mailq.postfix manpage_directory = /usr/share/man mydestination = $myhostname, localhost.$mydomain, localhost myhostname = <my-FQDN> newaliases_path = /usr/bin/newaliases.postfix queue_directory = /var/spool/postfix readme_directory = /usr/share/doc/postfix/README_FILES sample_directory = /usr/share/doc/postfix/samples sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop smtp_tls_session_cache_database = btree:${queue_directory}/smtp_scache smtpd_sasl_auth_enable = yes smtpd_tls_auth_only = yes smtpd_tls_key_file = /etc/pki/dovecot/certs/tgv2015.crt smtpd_tls_received_header = yes smtpd_tls_security_level = may smtpd_tls_session_cache_database = btree:${queue_directory}/smtpd_scache smtpd_use_tls = yes unknown_local_recipient_reject_code = 550 virtual_mailbox_base = /var/mail/vhosts virtual_mailbox_domains = <my-domain> virtual_transport = lmtp:unix:private/dovecot-lmtp

1 0

SOLR 5
by Robert Gierzinger 17 Jun '15

17 Jun '15

Hello, I just wanted to give SOLR 5 a try, however there probably have changed quite some bits in the config files, did not even manage to create a core with various solrconfig.xml and schema.xml files, but I am absolutely no expert in solr. Has anybody given it a try or are there some tips on how to get it running? regards, Robert

2 1

dsync userdb and required fields?
by lejeczek 17 Jun '15

17 Jun '15

hi, I'm fiddling with dsync and get these in the logs: auth: Error: password(ps655@): Password data is not valid for scheme SSHA: Input isn't valid base64 encoded data .. auth: Error: ldap(ns580(a),172.25.12.215): ldap_search(base=ou=,ou=mail,dc=virtual,dc=hosting filter=(&(objectclass=person) .... This is on a dovecot that I'd call second, to which I'd like to replicate, first dovecot which is already populated with users, etc. does not show these errors. and I also have seen complains about possixAccunt I think. Do these mean that there is a base minimum required from dovecot/dsync in order to deem/find a user as a valid user? Also I can tell that those users do belong to different domain (not even this RDN) than the one in which the second dovecot is trying to look. These fields/attributes are nowhere defined/mentioned in my configs thus I wonder. many thanks

1 0

Imap process crashes when search in virtual mailbox
by mihaiush 17 Jun '15

17 Jun '15

Hi, When searching in a virtual mailbox imap process crashes if the virtual mailbox has a lot of physical mailboxes behind (more than 80 - 100 mailboxes). Dovecot 2.2.18 build from sources ./configure --prefix=/opt/dovecot2 --with-mysql --with-sqlite --with-solr --with-ssl --disable-rpath --disable-static. Debian Wheezy 3.2.63-2 x86_64. Filesystem is ZFS. docecot -n : # 2.2.18: /services/dovecot1/etc/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.7 auth_master_user_separator = * auth_mechanisms = plain login base_dir = /services/dovecot1/var/run default_client_limit = 10240 default_login_user = dovecot dict { quotadict = mysql:/services/dovecot1/etc/quota.conf } disable_plaintext_auth = no log_path = login_log_format_elements = user=%u session=%{session} mpid=%e rip=%r rrip=%{real_rip} mail_location = mdbox:~/mails mail_log_prefix = "store107: %s(%u): %{session}: " mail_max_userip_connections = 0 mail_plugins = quota virtual fts fts_solr notify mail_log mailbox_list_index = yes mdbox_rotate_size = 256 k mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } namespace virtual { hidden = yes list = no location = virtual:/services/dovecot1/etc/virtual:INDEX=~/mails/virtual mailbox all { auto = create special_use = \All } mailbox unseen { auto = create } prefix = virtual/ separator = / } passdb { args = /services/dovecot1/etc/passwd.masterusers driver = passwd-file master = yes pass = yes } passdb { args = /services/dovecot1/etc/mysql.conf driver = sql } plugin { fts = solr fts_solr = break-imap-search url=http://10.78.18.127:8080/solr/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create mail_log_fields = uid box msgid flags quota = dict:user::proxy::quotadict quota_rule = *:storage=1GB quota_rule2 = Trash:storage=+152M quota_rule3 = Trash:messages=+5 } protocols = imap service auth { unix_listener auth-client { mode = 0666 } unix_listener auth-master { group = nogroup mode = 0660 } } service dict { process_limit = 400 unix_listener dict { mode = 0600 user = nobody } } service imap-login { chroot = login client_limit = 2048 inet_listener imap { address = 10.78.18.127 port = 143 } process_limit = 1024 service_count = 0 } service imap { process_limit = 10240 vsz_limit = 320 M } service indexer-worker { process_limit = 4 process_min_avail = 2 service_count = 1 vsz_limit = 1 G } shutdown_clients = no ssl = no syslog_facility = local3 userdb { args = /services/dovecot1/etc/mysql.conf driver = sql } protocol imap { mail_plugins = quota virtual fts fts_solr notify mail_log imap_quota } protocol lda { auth_socket_path = /services/dovecot1/var/run/auth-master mail_plugins = quota virtual fts fts_solr notify mail_log sieve event_broker submission_host = osmtp:8090 } /services/dovecot1/etc/virtual/all/dovecot-virtual : * -Trash -Junk all Error log: 2015-06-16T12:49:25.502864+02:00 sr-be-store07 dovecot: store107: imap( mihaiush(a)sunrise.ch) hCdxU6AY/wAKThJr: Panic: file mail-index-map.c: line 547 (mail_index_map_lookup_seq_range): assertion failed: (first_uid > 0) 2015-06-16T12:49:25.503429+02:00 sr-be-store07 dovecot: store107: imap( mihaiush(a)sunrise.ch) hCdxU6AY/wAKThJr: Error: Raw backtrace: /opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x7c13f) [0x7fe2e433713f] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x7c19e) [0x7fe2e433719e] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fe2e42e5555] -> /opt/dovecot2/lib/dovecot/libdovecot-storage.so.0(+0xc4d32) [0x7fe2e466fd32] -> /opt/dovecot2/lib/dovecot/libdovecot-storage.so.0(mail_index_lookup_seq_range+0xa) [0x7fe2e46817fa] -> /opt/dovecot2/lib/dovecot/lib20_fts_plugin.so(+0xd0b1) [0x7fe2e30c40b1] -> /opt/dovecot2/lib/dovecot/lib20_fts_plugin.so(+0xd963) [0x7fe2e30c4963] -> /opt/dovecot2/lib/dovecot/lib20_fts_plugin.so(fts_search_lookup+0xa6) [0x7fe2e30c4c36] -> /opt/dovecot2/lib/dovecot/lib20_fts_plugin.so(+0xfdef) [0x7fe2e30c6def] -> dovecot/imap(imap_search_start+0x70) [0x41dec0] -> dovecot/imap(cmd_sort+0x205) [0x414565] -> dovecot/imap(command_exec+0x4c) [0x418aec] -> dovecot/imap() [0x417ad0] -> dovecot/imap() [0x417b64] -> dovecot/imap(client_handle_input+0x115) [0x417e45] -> dovecot/imap(client_input+0x72) [0x418212] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [0x7fe2e43494fb] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xbb) [0x7fe2e434a54b] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7fe2e4349589] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fe2e4349608] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fe2e42eabc3] -> dovecot/imap(main+0x27b) [0x40c60b] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7fe2e3f4eead] -> dovecot/imap() [0x40c769] 2015-06-16T12:49:25.552150+02:00 sr-be-store07 dovecot: store107: imap( mihaiush(a)sunrise.ch) hCdxU6AY/wAKThJr: Fatal: master: service(imap): child 3923 killed with signal 6 (core dumped) IMAP session: # telnet store107 143 Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. x login mihaiush(a)sunrise.ch XXX x OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SEARCH=FUZZY NOTIFY SPECIAL-USE QUOTA] Logged in x select virtual/all * FLAGS (\Answered \Flagged \Deleted \Seen \Draft $Label3 $Label2 $Label5 $Label1 $Label4 parsed attachment) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft $Label3 $Label2 $Label5 $Label1 $Label4 parsed attachment \*)] Flags permitted. * 1963 EXISTS * 1256 RECENT * OK [UNSEEN 2] First unseen. * OK [UIDVALIDITY 1434024437] UIDs valid * OK [UIDNEXT 2677] Predicted next UID * OK [HIGHESTMODSEQ 76] Highest x OK [READ-WRITE] Select completed (0.087 secs). x sort (reverse arrival) utf-8 text vpopmail Connection closed by foreign host. GDB: # gdb /opt/dovecot2/libexec/dovecot/imap /services/dovecot1/var/data/ sunrise.ch/m/mihaiush/core GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html > This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /opt/dovecot2/libexec/dovecot/imap...done. [New LWP 3923] warning: Can't read pathname for load map: Input/output error. [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. #0 0x00007fe2e3f62165 in raise () from /lib/x86_64-linux-gnu/libc.so.6 (gdb) (gdb) bt full #0 0x00007fe2e3f62165 in raise () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #1 0x00007fe2e3f653e0 in abort () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #2 0x00007fe2e4337135 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:202 backtrace = 0x2166c38 "/opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x7c13f) [0x7fe2e433713f] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x7c19e) [0x7fe2e433719e] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x"... #3 0x00007fe2e433719e in i_internal_fatal_handler (ctx=0x7fffa5660ea0, format=<optimized out>, args=<optimized out>) at failures.c:671 status = 0 #4 0x00007fe2e42e5555 in i_panic (format=format@entry=0x7fe2e468d068 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:276 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffa5660f90, reg_save_area = 0x7fffa5660ed0}} #5 0x00007fe2e466fd32 in mail_index_map_lookup_seq_range (map=<optimized out>, first_uid=0, last_uid=<optimized out>, first_seq_r=<optimized out>, last_seq_r=<optimized out>) at mail-index-map.c:547 __FUNCTION__ = "mail_index_map_lookup_seq_range" #6 0x00007fe2e46817fa in mail_index_lookup_seq_range (view=<optimized out>, first_uid=<optimized out>, last_uid=<optimized out>, first_seq_r=first_seq_r@entry=0x7fffa5660fe8, last_seq_r=last_seq_r@entry =0x7fffa5660fec) at mail-index-view.c:513 No locals. #7 0x00007fe2e45f819c in mailbox_get_seq_range (box=<optimized out>, uid1=<optimized out>, uid2=<optimized out>, seq1_r=seq1_r@entry=0x7fffa5660fe8, seq2_r=seq2_r@entry=0x7fffa5660fec) at mailbox-get.c:11 No locals. #8 0x00007fe2e30c40b1 in uid_range_to_seqs (uid_range=uid_range@entry=0x7fffa56610b0, seq_range=seq_range@entry=0x25e4840, fctx=<error reading variable: Unhandled dwarf expression opcode 0xfa>, fctx=<error reading variable: Unhandled dwarf expression opcode 0xfa>) at fts-search.c:28 range = 0x2166738 i = <optimized out> count = <optimized out> seq1 = 41023456 seq2 = 0 #9 0x00007fe2e30c4963 in multi_add_lookup_result (args=0x2363d50, level=0x25e4840, fctx=0x23637e0, result=<optimized out>) at fts-search.c:138 br = 0x271f7e0 vuids = {arr = {buffer = 0x2166700, element_size = 8}, v = 0x2166700, v_modifiable = 0x2166700} orig_size = <optimized out> i = <optimized out> vbox = 0x2197c70 #10 fts_search_lookup_level_multi (and_args=<optimized out>, args=0x2363d50, fctx=0x23637e0) at fts-search.c:198 flags = FTS_LOOKUP_FLAG_AND_ARGS mailboxes_arr = {arr = {buffer = 0x2717670, element_size = 8}, v = 0x2717670, v_modifiable = 0x2717670} backend = <optimized out> j = 69 vbox = <optimized out> mailboxes = 0x27176a8 level = 0x25e4840 result = {pool = 0x2717650, box_results = 0x271f7a0} i = <optimized out> mailbox_count = 69 #11 fts_search_lookup_level (fctx=fctx@entry=0x23637e0, args=0x2363d50, and_args=and_args@entry=true) at fts-search.c:212 _data_stack_cur_id = 4 ret = <optimized out> #12 0x00007fe2e30c4c36 in fts_search_lookup (fctx=fctx@entry=0x23637e0) at fts-search.c:358 last_uid = 2676 seq1 = 0 seq2 = 0 __FUNCTION__ = "fts_search_lookup" #13 0x00007fe2e30c6def in fts_mailbox_search_init (t=<optimized out>, args=0x2363c90, sort_program=0x7fffa5661250, wanted_fields=<optimized out>, wanted_headers=<optimized out>) at fts-storage.c:240 ft = 0x23908a0 fbox = <optimized out> flist = <optimized out> ctx = 0x2695dc0 fctx = 0x23637e0 #14 0x000000000041dec0 in imap_search_start (ctx=ctx@entry=0x2195590, sargs=0x2363c90, sort_program=sort_program@entry=0x7fffa5661250) at imap-search.c:587 cmd = 0x2195450 __FUNCTION__ = "imap_search_start" #15 0x0000000000414565 in cmd_sort (cmd=0x2195450) at cmd-sort.c:141 ctx = 0x2195590 sargs = 0x2363c90 sort_program = {4097, MAIL_SORT_END, 56, MAIL_SORT_END, 3831136736, 32738, 35045104, MAIL_SORT_END, MAIL_SORT_ARRIVAL, MAIL_SORT_END, MAIL_SORT_ARRIVAL, MAIL_SORT_END} args = 0x216cb98 list_args = 0x216ccd0 charset = 0x216ce30 "utf-8" ret = <optimized out> #16 0x0000000000418aec in command_exec (cmd=cmd@entry=0x2195450) at imap-commands.c:167 hook = 0x216a120 diff = <optimized out> ---Type <return> to continue, or q <return> to quit--- finished = <optimized out> #17 0x0000000000417ad0 in client_command_input (cmd=cmd@entry=0x2195450) at imap-client.c:814 client = 0x2194850 command = <optimized out> __FUNCTION__ = "client_command_input" #18 0x0000000000417b64 in client_command_input (cmd=0x2195450) at imap-client.c:874 client = 0x2194850 command = <optimized out> __FUNCTION__ = "client_command_input" #19 0x0000000000417e45 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x2194850) at imap-client.c:912 No locals. #20 client_handle_input (client=client@entry=0x2194850) at imap-client.c:924 _data_stack_cur_id = 3 ret = 2 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #21 0x0000000000418212 in client_input (client=0x2194850) at imap-client.c:966 cmd = <optimized out> output = 0x2195270 bytes = 46 __FUNCTION__ = "client_input" #22 0x00007fe2e43494fb in io_loop_call_io (io=0x2195360) at ioloop.c:501 ioloop = 0x2169760 t_id = 2 __FUNCTION__ = "io_loop_call_io" #23 0x00007fe2e434a54b in io_loop_handler_run_internal (ioloop=ioloop@entry=0x2169760) at ioloop-epoll.c:220 ctx = 0x216a490 events = 0xf53 event = 0x216b300 list = 0x216bef0 io = <optimized out> tv = {tv_sec = 1799, tv_usec = 999663} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #24 0x00007fe2e4349589 in io_loop_handler_run (ioloop=ioloop@entry=0x2169760) at ioloop.c:548 No locals. #25 0x00007fe2e4349608 in io_loop_run (ioloop=0x2169760) at ioloop.c:525 __FUNCTION__ = "io_loop_run" #26 0x00007fe2e42eabc3 in master_service_run (service=0x21695f0, callback=callback@entry=0x421140 <client_connected>) at master-service.c:581 No locals. #27 0x000000000040c60b in main (argc=1, argv=0x2169390) at main.c:431 set_roots = {0x428c20, 0x0} login_set = {auth_socket_path = 0x2161060 "\210\020\026\002", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x420f80 <login_client_connected>, failure_callback = 0x4210f0 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> (gdb) If necessary I can provide the mailbox, it has 7MB.

2 1

Mail to nowhere
by Steve Matzura 17 Jun '15

17 Jun '15

The next phase of my testing procedure involves the simple act of delivering mail to my test box. When I send a message to either a valid or relayed user at my remote machine's address, it never gets there. I know this virtually for sure because I'm tailing /var/log/maillog and nothing new has been added for the past hour. I'm thinking eventually my ISP will send the message back to me as undeliverable, and in that bounced message there may be some information about why it was undeliverable, but maybe someone has a thought as to why I'm not even seeing anything attempt to connect?

5 10

Re: Mail to nowhere
by Richard 17 Jun '15

17 Jun '15

> Date: Tuesday, June 16, 2015 07:05:43 PM -0400 > From: Steve Matzura <number6(a)noisynotes.com> > > On Tue, 16 Jun 2015 17:31:07 +0000, you wrote: > >> By default, most MTAs only listen to localhost, so don't accept >> externally derived mail. Try telnetting to port 25 on the machine >> from some place off your machine's network. If you get a "hang", >> it's likely a firewall issue. If you get a "connection refused" >> message it's probably that the MTA isn't listening on the external >> interface. >> >> If the MTA responds, do a manual delivery exchange and see what >> you get. >> >> If you're not seeing anything in your maillog, this is very likely >> an issue with your MTA's configuration, not dovecot. > > Now that I think about and concentrate on what you wrote, make > perfect sense. Add to that the fact that I received bounces from > my ISP that all said the same thing: Unable to establish an SMTP > connection. The return code was 4.5.1. A 4xx indicates a transient error (i.e., within configured limits, delivery retries will be attempted), 5xx is permanent (immediate reject, no retries), otherwise the specific number isn't all that telling. >From everything you've indicated, this is an MTA issue.

2 1

replication of a big mailbox
by Tim Kuijsten 16 Jun '15

16 Jun '15

I'm running dovecots replicator successfully on 33 mailboxes. There is only one mailbox (the biggest one, 167000 mails) that is not replicating successfully. After 10 minutes the "source" starts logging these messages: dovecot: dsync-local(foo(a)example.com): Error: dsync(imap.netsend.nl): I/O has stalled, no activity for 600 seconds dovecot: dsync-local(foo(a)example.com): Error: Timeout during state=sync_mails (send=mail_requests recv=changes) dovecot: dsync-local(foo(a)example.com): Error: Remote command process isn't dying, killing it dovecot: dsync-local(foo(a)example.com): Error: kill(17459, SIGKILL) failed: Operation not permitted dovecot: doveadm: Error: Pseudo-terminal will not be allocated because stdin is not a terminal. dovecot: doveadm: Error: dsync-remote(foo(a)example.com): Error: Couldn't lock //.dovecot-sync.lock: Timed out after 30 seconds dovecot: doveadm: Error: Pseudo-terminal will not be allocated because stdin is not a terminal. dovecot: doveadm: Error: dsync-remote(foo(a)example.com): Error: Couldn't lock //.dovecot-sync.lock: Timed out after 30 seconds The 30 seconds timeout keeps repeating, while the doveadm process on the destination keeps on going for hours and hours. Destination imap.netsend.nl is creating a lot of hardlinks (at least one hardlink per message) in .temp.... files. This takes about 1,5 hour, after that the number of hardlinks decline again. But it looks like the connection with source is already lost. I've patched the source to overcome the timeout by changing it from 10 minutes to 3 hours[1] but now I'm running into a memory error: dovecot: dsync-local(foo(a)example.com): Error: dsync(imap.netsend.nl): I/O has stalled, no activity for 10800 seconds dovecot: dsync-local(foo(a)example.com): Error: Timeout during state=sync_mails (send=done recv=mails) dovecot: dsync-local(foo(a)example.com): Error: mremap_anon(211677184) failed: Cannot allocate memory The allocate memory error shows up every 10 seconds. Next I'll try to look into the memory allocation code, but maybe someone already has a better idea? Thanks. -Tim Config on source: # 2.2.15: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.7 amd64 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes dsync_remote_cmd = /usr/bin/ssh imap.netsend.nl first_valid_gid = 30000 first_valid_uid = 30000 last_valid_gid = 30100 last_valid_uid = 30100 mail_debug = yes mail_home = /srv/vmail/%d/%n mail_location = maildir:~/Maildir mail_plugins = " notify replication" passdb { args = /passwd driver = passwd-file } passdb { args = /passwd_smtponly driver = passwd-file } plugin { mail_replica = remoteprefix:imap.netsend.nl } protocols = imap lmtp service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service auth-worker { chroot = /etc/mail unix_listener /etc/mail/auth-worker { mode = 0600 user = $default_internal_user } user = $default_internal_user } service auth { chroot = /etc/mail unix_listener /var/spool/postfix/private/dovecot-auth { group = _postfix mode = 0600 user = _postfix } } service imap-login { inet_listener imap { port = 0 } process_min_avail = 1 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = _postfix mode = 0600 user = _postfix } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl = required ssl_cert = </etc/ssl/private/2015/chain.crt ssl_cipher_list = ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-CHACHA20-POLY1305:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-SHA384:DHE-RSA-AES256-SHA256:ECDHE-RSA-AES256-SHA:DHE-RSA-AES256-SHA; ssl_dh_parameters_length = 2048 ssl_key = </etc/ssl/private/the.key ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { args = /passwd default_fields = uid=30000 gid=30000 home=/srv/vmail/%d/%n/./ driver = passwd-file } valid_chroot_dirs = /srv/vmail verbose_ssl = yes protocol imap { mail_max_userip_connections = 20 } config on destination imap.netsend.nl: # 2.2.15: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.7 amd64 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes first_valid_gid = 30000 first_valid_uid = 30000 last_valid_gid = 30100 last_valid_uid = 30100 mail_debug = yes mail_home = /srv/vmail/%d/%n mail_location = sdbox:~/dbox passdb { args = /passwd driver = passwd-file } passdb { args = /passwd_smtponly driver = passwd-file } protocols = imap lmtp service auth-worker { chroot = /etc/mail unix_listener /etc/mail/auth-worker { mode = 0600 user = $default_internal_user } user = $default_internal_user } service auth { chroot = /etc/mail unix_listener /var/spool/postfix/private/dovecot-auth { group = _postfix mode = 0600 user = _postfix } } service imap-login { inet_listener imap { port = 0 } process_min_avail = 1 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = _postfix mode = 0600 user = _postfix } } ssl = required ssl_cert = </etc/ssl/private/2015/chain.crt ssl_cipher_list = ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-CHACHA20-POLY1305:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-SHA384:DHE-RSA-AES256-SHA256:ECDHE-RSA-AES256-SHA:DHE-RSA-AES256-SHA; ssl_dh_parameters_length = 2048 ssl_key = </etc/ssl/private/the.key ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { args = /passwd default_fields = uid=30000 gid=30000 home=/srv/vmail/%d/%n/./ driver = passwd-file } valid_chroot_dirs = /srv/vmail verbose_ssl = yes protocol imap { mail_max_userip_connections = 20 } [1] --- src/doveadm/dsync/dsync-ibc-stream.c 2014-09-29 13:07:07.000000000 +0200 +++ src/doveadm/dsync/dsync-ibc-stream.c2 2015-06-15 12:28:56.000000000 +0200 @@ -24,7 +24,7 @@ #include <stdlib.h> -#define DSYNC_IBC_STREAM_TIMEOUT_MSECS (60*10*1000) +#define DSYNC_IBC_STREAM_TIMEOUT_MSECS (60*180*1000) #define DSYNC_IBC_STREAM_OUTBUF_THROTTLE_SIZE (1024*128) #define DSYNC_PROTOCOL_VERSION_MAJOR 3

1 0

Problem logging in during testing
by Steve Matzura 16 Jun '15

16 Jun '15

Instructions at http://wiki2.dovecot.org/BasicConfiguration say the next thing to test after getting IMAP and Telnet working is to create a dummy user file with the following command: echo "$USER:{PLAIN}password:$UID:$GID::$HOME" > users And place it in /etc/dovecot and protect it appropriately. It was also edited to change the plain-text password from `password' to what it really is. The next section describes changes to 10-auth.conf and other things: If you used the example configuration files, switch to passwd-file by modifying conf.d/10-auth.conf: # Add '#' to comment out the system user login for now: #!include auth-system.conf.ext # Remove '#' to use passwd-file: !include auth-passwdfile.conf.ext In conf.d/auth-passwdfile.conf.ext you should have: passdb { driver = passwd-file args = scheme=CRYPT username_format=%u /etc/dovecot/users } userdb { driver = passwd-file args = username_format=%u /etc/dovecot/users } Verify with doveconf -n passdb userdb that the output looks like above (and there are no other passdbs or userdbs). All done successfully. Now, when I telnet 127.0.0.1 143 and attempt to log in with the string: a login <any username> <any password> whether it's one in my users file or not, I get: a NO [AUTHENTICATIONFAILED] Authentication failed.

4 11

Re: More about my SSL certificate problem
by Joseph Tam 16 Jun '15

16 Jun '15

Steve Matzura writes: > What is the reasoning behind that `<' anyway? It just appears so odd > that a path should have that at its front. I think this was a special syntax-hack that Timo used to mean "read into a buffer", or some different way to handle file data, probably for security reasons. Joseph Tam <jtam.home(a)gmail.com>

1 0

What became of dovecot.passwd?
by Steve Matzura 15 Jun '15

15 Jun '15

Since I've decided to go to version 2, which is a lot more difficult to set up because I have to look in a lot more places than I did with version 1.0.15, what do I do with the old dovecot/passwd or its contents? I see no references to it in any of the stuff in conf.d or doc/dovecot/wiki. As always, thanks in advance.

2 3

More about my SSL certificate problem
by Steve Matzura 15 Jun '15

15 Jun '15

Someone, I don't remember whether it was Alex or Urban, asked me to check on my private keyfile to see if it began with "Begin RSA private key". I reported that it does not. Now here's where things get strange: When I ran the command: $ openssl req -nodes -newkey rsa:2048 -sha1 -keyout myserver.key -out server.csr on an old Ubuntu system, `myserver.key' does begin with "Begin RSA private key". But when I run that same command on a Fedora 20 system, the word "RSA" isn't there. Could this have anything to do with my 0906D06C error?

4 8

Testin new installation
by Steve Matzura 15 Jun '15

15 Jun '15

The first place I went to for test advice and planning recommendations was http://wiki2.dovecot.org/TestInstallation - The very first test failed. Doc says: Next check that Dovecot is listening for connections: # telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN] Dovecot ready. If you got "connection refused", make sure that Dovecot is configured to serve the imap protocol and listening on the expected interfaces/addresses. The simplest way to do that would be using doveconf(1): # doveconf protocols listen protocols = imap pop3 lmtp sieve listen = *, :: If the protocols setting shouldn't contain imap so add it. Also make sure, that relevant !include or !try_include configuration lines are not commented. *** End doc extract *** All of the above specified settings are correct. Yet, when I telnet localhost 143, I get: Trying ::1... # this is certainly suspect Escape character is '^['. Connection closed by foreign host.

7 21

dsync replication issues with shared mailboxes
by Sergey Schwartz 15 Jun '15

15 Jun '15

Gentlemen, I've setup 2 servers with dsync replication and hit a serious issue - some messages got duplicated thousands times in some shared mailboxes(~5). There is actually no reason to replicate anything from shared name space and I've tried to limit replication scope with just 'inbox' name space but it didn't help. dovecot version ||2.2.18 (2de3c7248922) errors in the logs May 26 13:23:38 mx10 dovecot: doveadm: Error: dsync-remote(korobova@mydomain): Error: Mailbox turkey: Save commit failed: Message has been copied too many times (24498 + 8270) May 26 13:25:16 mx10 dovecot: doveadm: Error: dsync-remote(korobova@mydomain): Error: Mailbox turkey: Save commit failed: Message has been copied too many times (24498 + 8270) May 26 13:26:40 mx10 dovecot: dsync-local(zhelonkina@mydomain): Error: Mailbox booking: Save commit failed: Message has been copied too many times (0 + 32768) May 26 13:30:01 mx10 dovecot: dsync-local(kashchits@mydomain): Error: Mailbox shared/davydjanc@mydomain/russia: Save commit failed: Message has been copied too many times (17139 + 15629) May 26 13:30:01 mx10 dovecot: dsync-local(davydjanc@mydomain): Error: Mailbox russia: Save commit failed: Message has been copied too many times (17139 + 15629) May 26 13:30:01 mx10 dovecot: dsync-local(kapitanova@mydomain): Error: Mailbox shared/davydjanc@mydomain/russia: Save commit failed: Message has been copied too many times (17139 + 15629) May 26 13:30:03 mx10 dovecot: dsync-local(grinenko@mydomain): Error: Mailbox shared/davydjanc@mydomain/russia: Save commit failed: Message has been copied too many times (17139 + 15629) May 26 13:30:03 mx10 dovecot: dsync-local(maslova@mydomain): Error: Mailbox shared/davydjanc@mydomain/russia: Save commit failed: Message has been copied too many times (17139 + 15629) Data was not lost and I've been able to run deduplicate for most of mailboxes, but one mailbox got broken and I had to manually move message to another mailbox force-resync failed fot that mailbox doveadm(l.davydjanc@mydomain): Error: mdbox map /srv/vmail/current/mydomain/davydjanc/storage/dovecot.map.index corrupted: map_uid=361735 refcount too low Hope you guys have an idea how to work it around :) replication.conf dsync_remote_cmd = /usr/bin/ssh -i /home/vmail/.ssh/id_rsa -l %{login} %{host} doveadm dsync-server -u %u service aggregator { fifo_listener replication-notify-fifo { user = vmail mode = 0600 } unix_listener replication-notify { user = vmail mode = 0600 } process_min_avail = 1 } service replicator { unix_listener replicator-doveadm { user = vmail mode = 0600 } process_min_avail = 1 } service doveadm { user = vmail process_min_avail = 1 } service config { unix_listener config { user = vmail } process_min_avail = 1 } replication_max_conns = 50 replication_dsync_parameters = -d -n inbox -l 30 -U plugin { mail_replica = remote:vmail@mx20 } doveconf -n # 2.2.18 (2de3c7248922): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 # OS: Linux 3.13.0-34-generic x86_64 Ubuntu 14.04.2 LTS xfs auth_cache_negative_ttl = 0 auth_cache_size = 512 M auth_default_realm = mydomain auth_failure_delay = 5 secs auth_worker_max_count = 4096 default_client_limit = 40960 default_process_limit = 8192 default_vsz_limit = 2 G disable_plaintext_auth = no first_valid_gid = 500 mail_location = mdbox:/srv/vmail/current/%d/%n mail_plugins = acl zlib notify replication mail_shared_explicit_inbox = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mdbox_rotate_size = 32 M namespace { list = yes location = mdbox:/srv/vmail/current/%%d/%%n prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/virtual/base.conf.ext driver = sql } passdb { args = /etc/dovecot/virtual/master.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = file:/srv/vmail/current/shared.db/000-shared-mailboxes.db sieve = file:/srv/vmail/current/%d/%n/sieve;active=/srv/vmail/current/%d/%n/active.sieve sieve_max_redirects = 0 zlib_save = xz zlib_save_level = 6 } protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { process_min_avail = 24 } service imap { process_limit = 4096 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl_cert = </etc/ssl/mxbgcom/2015/mydomain.com.crt.chained ssl_key = </etc/ssl/mxbgcom/2015/mydomain.com.key syslog_facility = local0 userdb { args = /etc/dovecot/virtual/base.conf.ext driver = sql } protocol lmtp { mail_plugins = acl zlib notify replication sieve } protocol imap { mail_max_userip_connections = 15 mail_plugins = acl zlib notify replication imap_acl } -- Best regards, Sergey Schwartz Senior System Administrator Biblio Globus Tour Operator www.bgoperator.ru T: +7 495 5042500 ext 1532 E: sergey.schwartz(a)bgoperator.com

1 0

Sorry, another faq
by Martin S 14 Jun '15

14 Jun '15

I've installed a mailserver according to these instructions: http://www.server-world.info/en/note?os=CentOS_7&p=httpd&f=13 When I try to login to the server through Roundcube webmail I get Connection to storage server failed. So checking on this [12-Jun-2015 11:28:53 +0000]: <6jap13r2> IMAP Error: Login failed for martin from 83.251.209.249. Could not connect to ssl://myserver:993: Permission denied in /usr/share/roundcubemail/program/lib/Roundcube/rcube_imap.php on line 198 (POST /roundcubemail/?.... /etc/roundcubemail/config.inc.php Has the following: $config['default_host'] = 'ssl://mail.myserver.tld'; [address obfuscated] $config['default_port'] = 993; as I understand should be correct. I've been looking at various posts on the net that says the problem is a permission on dovecot, but I fail to find anything to how to fix this as it looks right to me. Any suggestions? /Martin S -- Regards, Martin S

5 5

dovecot only partially indexing ... fts
by Infoomatic 14 Jun '15

14 Jun '15

hi, I have a setup using solr as fts, however it seems that when I move messages it does not automatically index the stuff. Also, when using sieve scripts to store messages in different folders I get: dovecot: indexer-worker(user): Indexed 0 messages in testfolder If I get a mail to normal INBOX I get dovecot: indexer-worker(user): Indexed 1 messages in INBOX doveadm index -u user '*' does the trick, however, I have set "fts_autoindex = yes" ... the relevant part of doveconf -n: mail_plugins = fts fts_solr zlib acl quota zlib fts fts_solr acl plugin { fts = solr fts_autoindex = yes fts_solr = url=http://localhost:8983/solr/ break-imap-search sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags } protocol lda { mail_plugins = fts fts_solr zlib sieve acl } protocol imap { mail_plugins = fts fts_solr zlib acl quota imap_acl imap_quota } is this normal behaviour or did I screw something up? TIA, infoomatic

1 0

fts_solr Bad Request / BUG: Unknown internal error
by Nick Rosier 14 Jun '15

14 Jun '15

Hi, yesterday I created a new mailbox; ever since (and only for the new mailbox) I am getting these errors: 2015-06-12T00:00:29.808526+02:00 mail dovecot: indexer-worker(xxx(a)example.com): Error: fts_solr: Lookup failed: Bad Request 2015-06-12T00:00:29.808560+02:00 mail dovecot: indexer-worker(xxx(a)example.com): Error: Mailbox INBOX: Status lookup failed: BUG: Unknown internal error Is this a known issue? Rgds, N.

2 2

RE: Testin new installation
by edgar 13 Jun '15

13 Jun '15

Look at /etc/hosts ::1 is the ipv6 version of localhost. Sent from Samsung tablet -------- Original message -------- From Steve Matzura <number6(a)noisynotes.com> Date: 06/13/2015 6:00 AM (GMT-06:00) To dovecot <dovecot(a)dovecot.org> Subject Testin new installation The first place I went to for test advice and planning recommendations was http://wiki2.dovecot.org/TestInstallation - The very first test failed. Doc says: Next check that Dovecot is listening for connections: # telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN] Dovecot ready. If you got "connection refused", make sure that Dovecot is configured to serve the imap protocol and listening on the expected interfaces/addresses. The simplest way to do that would be using doveconf(1): # doveconf protocols listen protocols = imap pop3 lmtp sieve listen = *, :: If the protocols setting shouldn't contain imap so add it. Also make sure, that relevant !include or !try_include configuration lines are not commented. *** End doc extract *** All of the above specified settings are correct. Yet, when I telnet localhost 143, I get: Trying ::1... # this is certainly suspect Escape character is '^['. Connection closed by foreign host.

3 3

postfix/dovecot on debian jessie (url config at OVH)
by klrumpf 13 Jun '15

13 Jun '15

Hi list, could use some help with a pasword issue or ovh dns zone problem, dovecot newbie I have gone thru setting up a mailserver using the below http://www.binarytides.com/install-postfix-dovecot-debian/ when I try to set up an account from my laptop (iceweasel/t-bird) I get password problems. mail.log says Jun 13 18:36:04 www postfix/smtpd[701]: connect from unknown[xx.xx.214.75] Jun 13 18:36:04 www postfix/smtpd[688]: disconnect from unknown[xx.xx.214.75] Jun 13 18:36:04 www postfix/submission/smtpd[687]: disconnect from unknown[xx.xx.214.75] Jun 13 18:36:04 www postfix/submission/smtpd[694]: disconnect from unknown[xx.xx.214.75] Jun 13 18:36:04 www postfix/smtpd[693]: disconnect from unknown[xx.xx.214.75] Jun 13 18:36:04 www postfix/submission/smtpd[698]: disconnect from unknown[.... nstat also looks ok BWE1# netstat -lntp Active Internet connections (only servers) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 127.0.0.1:12301 0.0.0.0:* LISTEN 492/opendkim tcp 0 0 0.0.0.0:110 0.0.0.0:* LISTEN 504/dovecot tcp 0 0 0.0.0.0:143 0.0.0.0:* LISTEN 504/dovecot tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 486/nginx -g daemon tcp 0 0 0.0.0.0:465 0.0.0.0:* LISTEN 617/master tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 449/sshd tcp 0 0 0.0.0.0:25 0.0.0.0:* LISTEN 617/master tcp 0 0 127.0.0.1:4000 0.0.0.0:* LISTEN 653/ssh tcp 0 0 0.0.0.0:993 0.0.0.0:* LISTEN 504/dovecot tcp 0 0 0.0.0.0:995 0.0.0.0:* LISTEN 504/dovecot tcp 0 0 0.0.0.0:587 0.0.0.0:* LISTEN 617/master tcp 0 0 127.0.0.1:6379 0.0.0.0:* LISTEN 455/redis-server 12 tcp6 0 0 :::110 :::* LISTEN 504/dovecot tcp6 0 0 :::143 :::* LISTEN 504/dovecot tcp6 0 0 :::80 :::* LISTEN 486/nginx -g daemon tcp6 0 0 :::465 :::* LISTEN 617/master tcp6 0 0 :::21 :::* LISTEN 485/vsftpd tcp6 0 0 :::22 :::* LISTEN 449/sshd tcp6 0 0 :::25 :::* LISTEN 617/master tcp6 0 0 ::1:4000 :::* LISTEN 653/ssh tcp6 0 0 :::993 :::* LISTEN 504/dovecot tcp6 0 0 :::995 :::* LISTEN 504/dovecot tcp6 0 0 :::587 :::* LISTEN 617/master maybe someone has done it before, thanks <http://de.linkedin.com/in/klrumpf>

1 0

LDA versus LMTP
by Steve Matzura 13 Jun '15

13 Jun '15

My system has a great big four users. The Dovecot wiki says LMTP is more efficient, and someone on IRC told me I'd need it if I were ever to use sieve, which at this time I have no intention of doing. Should I stick with LDA, or just implement LMTP so I'm ready if ever I need it in the future? The bottom line is, it's unclear from the wiki how to explicitly specify use of one or the other, so that's my question.

5 7

Non-Existent Log File
by Steve Matzura 13 Jun '15

13 Jun '15

My /var/log/maillog was getting pretty big because of lots of testing and re-configuring I've been doing lately with both Dovecot and Postfix. I figured just remove /var/log/maillog and it would be re-created. It wasn't--not by Dovecot, not by Postfix. I had to manually create a new one, put one character in it, save it, properly secure it with chmod, and then Dovecot (and postfix) messages got written to it. This can't possibly be the proper procedure to clear maillog messages ... can it?

3 3

Error when starting Dovecot
by Steve Matzura 13 Jun '15

13 Jun '15

After applying some changes to 10-master.conf as detailed at http://wiki2.dovecot.org/HowTo/PostfixDovecotLMTP I receive the following when trying to start: doveconf: Fatal: Error in configuration file /etc/dovecot/conf.d/10-master.conf line 49: Expecting '{' I'm trying to enable LMTP. The instructions say: Socket configuration The actual socket is configured in /etc/dovecot/conf.d/10-master.conf. The LMTP service can be bound to both INET or Unix sockets. In this example a Unix socket is placed inside the Postfix spool with appropriate permissions set: service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } I copied this block and placed it in my copy of 10-master.conf. Line 49 is the first line of this block, and there's clearly a left-brace there. The braces match, too. Thoughts?

2 3

Orphaned email boxes...
by SH Development 13 Jun '15

13 Jun '15

What is the correct way to delete mailboxes that no longer have a database entry? Jeff

2 3

Imap Notify
by Tony Morehen 12 Jun '15

12 Jun '15

I'm trying to enable Imap Notify in Dovecot 2.2.13. I know that's a bit out of date, but that's what's provided with openSuSe 13.2. The first thing I did was add mailbox_list_index=yes to /etc/dovecot/dovecot.conf. Both doveadm -n and dovecot -n show the change. I then used doveadm reload to force dovecot to reread its config file. Despite this, NOTIFY did not show up it Dovecot's capabilities: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. I then did a systemctl restart dovecot.service and still no luck: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. I also have noticed that the Maildirs of my various accounts include a dovecot.list.index file with a current timestamp, but no dovecot.list.index. So, where do I go for here? The output of doveadm -n: # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.7-21-desktop x86_64 openSUSE 13.2 (x86_64) disable_plaintext_auth = no log_path = /var/log/dovecot/dovecot.log mail_location = maildir:~/Maildir mail_max_userip_connections = 50 mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/passwd.dovecot driver = passwd-file } postmaster_address = Tony@localhost protocols = imap lmtp service auth { unix_listener auth-master { group = mailgrp mode = 0660 user = mailuser } } service lmtp { executable = lmtp -L inet_listener lmtp { address = 127.0.0.1 port = 2525 } user = mailuser } ssl = no userdb { args = /etc/dovecot/passwd.dovecot driver = passwd-file } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep } protocol pop3 { mail_plugin_dir = /usr/lib/dovecot/modules/pop3 } protocol lda { log_path = /var/log/dovecot/deliver.log mail_plugin_dir = /usr/lib64/dovecot/modules mail_plugins = sieve } protocol lmtp { log_path = /var/log/dovecot/deliver.log mail_plugin_dir = /usr/lib64/dovecot/modules mail_plugins = sieve }

2 2

1.0.15 gone, can't start version 2
by Steve Matzura 12 Jun '15

12 Jun '15

On advice/recommendation received on this list, I removed version 1.0.15 with: rm -rf /usr/local/dovecot However, now that I have version 2 properly installed, configured, and ready to start testing with Postfix, it appears the old version is still in /usr/local/sbin, /usr/local/include, /usr/local/libexec, /usr/local/lib and /usr/local/shared/doc. Thinking that anything in /usr/local is something that was installed s a result of having built it from source (which 1.0.15 definitely was), should these also be removed?

3 7

Re: Sorry, another faq
by b-dovecot.org＠grmbl.net 12 Jun '15

12 Jun '15

On Fri, Jun 12, 2015 at 03:24:32PM +0200, Martin S wrote: > I get > > openssl s_client -connect mail.myserver.tld:993 > connect: Connection refused > connect:errno=111 > > Both from a client laptop and on the roundcube server. > Both roundcube and dovecot are installed on the same server. That should give you a good idea about what's wrong with your setup. http://lmgtfy.com/?q=dovecot+ssl+setup# B

1 0

Re: 1.0.15 gone, can't start version 2
by Muzaffer Tolga Ozses 12 Jun '15

12 Jun '15

*make clean* then? On 12 June 2015 at 15:52, Steve Matzura <number6(a)noisynotes.com> wrote: > On Fri, 12 Jun 2015 15:13:18 +0300, you wrote: > > >Have you done *make distclean* in prior? That should remove all things > >dovecot. > > I tried, but got: > > make: *** No target to make `distclean'. Stop. >

1 0

how to doveadm search from "<>" (null sender)?
by Daniel Funke 12 Jun '15

12 Jun '15

Hi, I tried to search for mailer daemon messages but can't find a syntax for the null sender. all these does not work: doveadm -u xxx from "<>" doveadm -u xxx from <> doveadm -u xxx from "" any ideas? Thank you Daniel

2 1

Replication: "cross-updates" of mail meta-data
by Andre Nathan 11 Jun '15

11 Jun '15

Hello I have a two-server dovecot setup using replication. Each server runs two dovecot instances, one for director and another for the backend. Initially I set up a single server, got it all working, then rsync'd the data and index partitions to the new one and started the clusters (I used rsync as a way to speed-up dovecot's initial replication). Both servers listen on a virtual IP addresses load-balanced by IPVS as well as their own IP addresses. When I started dovecot in the second server, users started reporting that some of their messages were missing. I noticed that while the mail data seemed to be up to date in server1, it wasn't in server2; however, the indexes were being updated in server2 but not in server1. For example, "doveadm quota get -u some-user" would report the wrong value in server1 and the right value in server2, while a "du" would show that only server1 actually had the most up-to-date data. At the moment I had to take down server2, because as soon as dovecot is running in it, users start reporting missing messages again. To solve that problem, a "doveadm force-resync" in server1 isn't enough. I either rsync the index files from server2 or remove the indexes in server1 before the force-resync, which then works. Has anyone ever saw anything similar to this? Any help would be much appreciated. I'm running Ubuntu 14.04 with dovecot 2.2.15 with the configurations below: === Backend instance === # dovecot -n # 2.2.15: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-37-generic x86_64 Ubuntu 14.04.2 LTS auth_master_user_separator = * auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@= auth_worker_max_count = 10 disable_plaintext_auth = no doveadm_password = secret doveadm_port = 12345 listen = server1.mydomain.com mail_fsync = never mail_gid = dovemail mail_plugins = " notify replication quota" mail_uid = dovemail managesieve_sieve_capability = fileinto reject envelope vacation subaddress comparator-i;ascii-numeric relational regex copy include vacation-seconds imapflags notify namespace { inbox = yes location = mailbox SPAM { auto = subscribe } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } plugin { mail_replica = tcp:192.168.0.2:12345 # server2's replication IP quota = dict:User quota::file:/var/lib/imap/user/%2.256RHn/%n/dovecot-quota quota_rule = *:storage=1GB sieve = /var/lib/imap/sieve/%2.256RHn/%n/dovecot.sieve sieve_dir = /var/lib/imap/sieve/%2.256RHn/%n sieve_extensions = comparator-i;ascii-numeric copy envelope fileinto imapflags include notify regex reject relational subaddress vacation-seconds sieve_max_redirects = 20 sieve_max_script_size = 512KB sieve_quota_max_scripts = 2 sieve_vacation_min_period = 1 sieve_vacation_send_from_recipient = yes } protocols = imap pop3 lmtp sieve replication_dsync_parameters = -f -d -N -l 30 -U service aggregator { fifo_listener replication-notify-fifo { group = dovemail mode = 0666 user = dovemail } unix_listener replication-notify { group = dovemail mode = 0666 user = dovemail } } service auth-worker { user = $default_internal_user } service auth { client_limit = 10240 process_limit = 1 process_min_avail = 1 } service doveadm { inet_listener { address = 192.168.0.1 port = 12345 } vsz_limit = 1 G } service imap { process_limit = 8192 process_min_avail = 10 } service lmtp { inet_listener { address = lmtpcluster.internal.mydomain.com, server1.internal.mydomain.com port = 1124 } process_limit = 512 process_min_avail = 10 } service managesieve-login { inet_listener sieve { address = lmtpcluster.internal.mydomain.com, server1.internal.mydomain.com port = 4190 } } service managesieve { process_limit = 20 process_min_avail = 10 } service pop3 { process_limit = 512 process_min_avail = 10 } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = dovemail mode = 0666 user = dovemail } } ssl_cert = </etc/ssl/certs/mydomain.crt ssl_key = </etc/ssl/private/mydomain.key userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { imap_client_workarounds = tb-extra-mailbox-sep delay-newmail imap_idle_notify_interval = 2 mins imap_max_line_length = 64 k mail_max_userip_connections = 50 mail_plugins = " notify replication quota imap_quota" } protocol lmtp { info_log_path = /var/log/mail/dovecot-lmtp.log mail_fsync = optimized mail_plugins = " notify replication sieve quota" } protocol sieve { mail_plugins = " notify replication sieve" managesieve_implementation_string = ManageSieve managesieve_logout_format = bytes=%i/%o managesieve_max_line_length = 65536 managesieve_sieve_capability = comparator-i;ascii-numeric copy envelope fileinto imapflags include notify regex reject relational subaddress vacation-seconds ssl = no } protocol pop3 { mail_plugins = " notify replication quota" pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } === Director instance === # dovecot -n -c /etc/dovecot_director/dovecot_director.conf # 2.2.15: /etc/dovecot_director/dovecot_director.conf # OS: Linux 3.16.0-37-generic x86_64 Ubuntu 14.04.2 LTS auth_master_user_separator = * auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@= auth_worker_max_count = 10 base_dir = /var/run/dovecot_director director_mail_servers = server1.internal.mydomain.com server2.internal.mydomain.com director_servers = A.B.C.1 A.B.C.2 # server1 and server2 external IP addresses disable_plaintext_auth = no instance_name = dovecot_director listen = lmtpcluster.mydomain.com, server1.mydomain.com lmtp_proxy = yes login_greeting = IMAP/POP3 server mail_fsync = never mail_gid = dovemail mail_plugins = " quota" mail_uid = dovemail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot_director/dovecot_director-sql.conf.ext driver = sql } passdb { args = /etc/dovecot_director/dovecot_director-sql-master.conf.ext driver = sql master = yes pass = yes } protocols = imap pop3 lmtp service auth-worker { user = $default_internal_user } service auth { client_limit = 10240 process_limit = 1 process_min_avail = 1 } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = A.B.C.1 port = 7777 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director idle_kill = 10 secs inet_listener imap { port = 143 } process_limit = 400 process_min_avail = 10 service_count = 0 vsz_limit = 512 M } service lmtp { inet_listener lmtp { address = lmtpcluster.internal.mydomain.com, server1.internal.mydomain.com port = 24 } process_limit = 512 } service pop3-login { executable = pop3-login director idle_kill = 10 secs inet_listener pop3 { port = 110 } process_limit = 256 } ssl_cert = </etc/ssl/certs/mydomain.crt ssl_key = </etc/ssl/private/mydomain.key userdb { driver = prefetch } userdb { args = /etc/dovecot_director/dovecot_director-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { auth_socket_path = director-userdb info_log_path = /var/log/mail/dovecot-director-lmtp.log passdb { args = proxy=y nopassword=y port=1124 driver = static name = } } Thanks in advance, Andre

1 0