- dovecot - dovecot.org

Re: [Dovecot] Mailbox with .broken files
by Michael Smith (DF) 19 Dec '13

19 Dec '13

Anyone have any feedback, guidance or suggestions on this? Timo? -----Original Message----- From: Michael Smith (DF) [mailto:msmith@datafoundry.com] Sent: Friday, December 13, 2013 9:49 AM To: 'dovecot(a)dovecot.org' Subject: [Dovecot] Mailbox with .broken files We're using Dovecot 2.2.4 and mdbox storage with compression. I noticed yesterday that at least one of the accounts has unusual files in it's mail/storage directory. This account has approximately 17.5G of compressed mail, across about 750 storage files (m.###) using 8G of storage. Starting on Dec 11, storage files m.409 through m.731 have not only their m.### file, but also a m.###.broken file. At the same time .temp.<unix time>.<unique id>.<hostname> files also started showing up... ... -rw--w---- 1 user123 mail 3225 Dec 12 04:38 m.708 -rw--w---- 1 user123 mail 167106 Dec 12 03:35 m.708.broken -rw--w---- 1 user123 mail 46155 Dec 12 04:38 m.709 -rw--w---- 1 user123 mail 177267 Dec 12 03:40 m.709.broken -rw--w---- 1 user123 mail 20965889 Nov 26 19:22 m.71 -rw--w---- 1 user123 mail 133248 Dec 12 04:38 m.710 -rw--w---- 1 user123 mail 264361 Dec 12 03:40 m.710.broken -rw--w---- 1 user123 mail 103407 Dec 12 04:38 m.711 -rw--w---- 1 user123 mail 627736 Dec 12 03:40 m.711.broken -rw--w---- 1 user123 mail 5132 Dec 12 04:38 m.712 -rw--w---- 1 user123 mail 136244 Dec 12 03:40 m.712.broken -rw--w---- 1 user123 mail 187224 Dec 12 04:38 m.713 -rw--w---- 1 user123 mail 351104 Dec 12 03:45 m.713.broken -rw--w---- 1 user123 mail 435793 Dec 12 04:38 m.714 -rw--w---- 1 user123 mail 566906 Dec 12 03:45 m.714.broken -rw--w---- 1 user123 mail 60916 Dec 12 04:38 m.715 -rw--w---- 1 user123 mail 192028 Dec 12 03:50 m.715.broken -rw--w---- 1 user123 mail 38051 Dec 12 04:38 m.716 -rw--w---- 1 user123 mail 169163 Dec 12 03:50 m.716.broken -rw--w---- 1 user123 mail 226067 Dec 12 04:38 m.717 -rw--w---- 1 user123 mail 389948 Dec 12 04:00 m.717.broken ... -rw--w---- 1 user123 mail 20967506 Dec 2 17:32 m.96 -rw--w---- 1 user123 mail 20967131 Dec 2 18:40 m.97 -rw--w---- 1 user123 mail 20969078 Dec 2 18:38 m.98 -rw--w---- 1 user123 mail 20963978 Dec 2 19:23 m.99 -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813944.P9142Q0M123686.myhost -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813967.P9213Q0M387733.myhost -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813970.P9231Q0M371190.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813972.P9173Q0M932070.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813972.P9239Q0M114754.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813983.P9261Q0M640646.myhost -rw--w---- 1 user123 mail 1048632 Dec 11 20:06 .temp.1386814038.P9515Q0M530600.myhost I'm not really seeing anything that stands out in the maillog during this time. What caused this problem? How concerned should I be about possible lost email? This is a production environment. Below is the dovecot -n output. -- Michael Smith # dovecot -n # 2.2.4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.19.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_debug = yes auth_debug_passwords = yes auth_default_realm = mydomain.com auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no dotlock_use_excl = no lda_mailbox_autocreate = yes lock_method = dotlock mail_access_groups = mail mail_debug = yes mail_fsync = always mail_location = mdbox:~/mail:INDEX=~/index mail_plugins = quota zlib mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_read_locks = dotlock mbox_write_locks = dotlock mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 20 M mmap_disable = yes namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = type = private } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Drafts autosubscribe4 = Sent autosubscribe5 = INBOX mail_max_userip_connections = 10 managesieve_max_line_length = 65536 quota = dict:User quota::file:%h/dovecot.quota quota2_rule = Trash:storage=+10%% quota3_rule = Junk:storage=+20%% quota_rule = *:storage=100M:messages=100000 recipient_delimiter = + sieve_before = /var/opt/mail/global.sieve/ zlib_save = gz zlib_save_level = 9 } pop3_reuse_xuidl = yes protocols = imap pop3 sieve lmtp service auth { inet_listener auth { port = 113 } unix_listener auth-userdb { user = nobody } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 service_count = 1 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } ssl = no ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = quota zlib sieve } protocol imap { mail_plugins = quota zlib imap_quota } protocol sieve { mail_max_userip_connections = 10 mail_plugins = quota zlib managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date } protocol lmtp { mail_plugins = quota zlib sieve }

1 0

[Dovecot] v2.2.9 released
by Timo Sirainen 19 Dec '13

19 Dec '13

http://dovecot.org/releases/2.2/dovecot-2.2.9.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.9.tar.gz.sig + Full text search indexing can now be done automatically after saving/copying mails by setting plugin { fts_autoindex=yes } + replicator: Added replication_dsync_parameters setting to pass "doveadm sync" parameters (for controlling what to replicate). + Added mail-filter plugin + Added liblzma/xz support (zlib_save=xz) - v2.2.8's improved cache file handling exposed several old bugs related to fetching mail headers. - v2.2.7's iostream handling changes were causing some connections to be disconnected before flushing their output (e.g. POP3 logout message wasn't being sent)

7 9

[Dovecot] zlib plugin question
by Przemysław Orzechowski 19 Dec '13

19 Dec '13

Hi Is it possible to compress incoming mails delivered via dovecots LDA when using dovecot --version 1.2.9 or do i have to compress them via cron?

2 2

[Dovecot] problem with password in a changing scenario
by Angel Luis Mateo Martinez 19 Dec '13

19 Dec '13

Hello, I'm having a problem with with password changing. According to http://wiki2.dovecot.org/Authentication/Caching, I understand "normal scenario" and "Using old cached password scenario", but I'm having a problem with the "Early change scenario". I understand that in this case, if in step 4 user tries password Y, then this password is not tried again and login fails. But if the user tries another password Z, then is it test it? Or does it directly fail? I think that it is directly failing. And here is my problem... I am using dovecot with a ldap backend and another pam backend. The first one is users connecting with an email client. The other one applies when the ldap backend fails and it is use for connections from our webmail, which is integrated in our CAS SSO environment (it has running an imap proxy too). Sometimes (the only scenari we were able to reproduce is with users that for some reason has two SSO sessions opened) dovecot receives an invalid CAS ticket, then authentication fails, and no newer tickets are tried until cache is clean. That's why I think that in this scenario another Z password is even tried. Any idea? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

1 0

[Dovecot] letters local filter duplicated
by John Smith 18 Dec '13

18 Dec '13

two servers with replicated master/master. dovecot.conf = http://pastebin.com/jVnvyWZM with this setup letters processed local filter duplicated. ie when the mail client receives a letter begins processing using rules (filters) to move the letters in a different folder. summarized in this folder is two duplicate letters. if you disable the filter, the message is not duplicated. But does not move to another location. -- Best Regards, Evgeny Senior System Administrator OOO "Vaz Service Hurley"

3 4

[Dovecot] Size detection/replair does not work with zlib
by Roland Rosenfeld 18 Dec '13

18 Dec '13

Hi! Usually dovecot auto detects or repairs the size of a maildir message. So I can place a message named "foo" in the cur directory and dovecot uses it. Now I tried the same with a zlib compressed message but here dovecot doesn't recognize/repair the size of the message. When I access this folder via IMAP the connection is diconnected and in dovecot logs I see the following error messages: Error: Cached message size smaller than expected (805 < 2666) Error: Corrupted index cache file /somedir/dovecot.index.cache: Broken physical size for mail UID 23 Error: read() failed: Input/output error (FETCH for mailbox INBOX UID 23) Disconnected: Internal error occurred. Refer to server log for more information. [2013-12-12 10:54:18] in=321 out=1977 As you can see in the first line, dovecot does know the compressed size of the file (805) as well as the uncompressed size (2666), but it isn't able to repair its index for this. If I modify the setup a little with a standard file naming but with a wrong file size in S-flag (compressed size instead of uncompressed size), the log entries become stranger: Error: Cached message size smaller than expected (805 < 2666) Error: Maildir filename has wrong S value, renamed the file from /somedir/cur/1386772057.M152553P9709.host,S=805:2, to /somedir/cur/1386772057.M152553P9709.host,S=805:2, So here dovecot detects the wrong S value, but instead of fixing it by using the uncompressed size, it renames to the same file name as before... All the above was tested with dovecot 2.1.17. We did a short cross test with 2.2.9 which gives somewhat different error messages, but also isn't able to detect/repair the (uncompressed) file size: Error: Cached message size smaller than expected (805 < 2666) Error: Corrupted index cache file /somedir/dovecot.index.cache: Broken physical size for mail UID 23 Error: read(zlib(/somedir/cur/foo)) failed: Invalid argument We also noticed that on both dovecot versions after trying to access the above file, dovecot.index.cache is always deleted and not rebuild... Is all this intended behavior? It sounds different to the standard behavior of dovecot, that repairs broken folders if possible... Ciao Roland

4 3

[Dovecot] configure lmtp to deliver to email addresses case insensitively
by Adrian Zaugg 17 Dec '13

17 Dec '13

Dear List Using dovecot 2.1.7 with LMTP and exim4 I want to accept local parts regardless of their case. Exim does all virtual alias handling and delivers the messages to dovecot LMTP addressed to the right mailbox name. This works well except for addresses which do not need to be resolved by exim and which do have the "wrong" case in the local part. For example: There is a mailbox and a user on the mailsystem "example.org" called "user". Mails to "user(a)example.org" get delivered just as they should. If an incoming message is addressed to "USER(a)example.org" with upper case local part, exim passes the message to LMTP with the case unaltered (RFC 2821 conform), but LMTP fails with: LMTP error after RCPT TO:<USER(a)example.org>: 550 5.1.1 <USER(a)example.org> User doesn't exist: USER(a)example.org How can I tell dovecot to deliver "USER" to the mailbox "user" aswell? Thank you for your help. Best regards, Adrian. (I have tried to use %Ln and %Lu in mail_location setting with no success.)

5 9

[Dovecot] Dovecot proxy and Postfix SASL
by Andreas Kasenides 17 Dec '13

17 Dec '13

Can somebody please verify that currently (v 2.2.9) SMTP AUTH using SASL from Postfix with Dovecot proxy is still not supported as discussed in these threads (especially the first one)? http://www.dovecot.org/list/dovecot/2012-August/067977.html http://www.dovecot.org/list/dovecot/2011-May/059107.html As I understand it is possible to use saslauthd to do this by using the remote imap option (rimap). Such a facility is important since I am attempting to separate the outward facing servers (dovecot proxy, postfix relay) that have no knowledge of user databases from the backends. thanx Andreas

1 1

[Dovecot] Accessing plain text password from memory
by Stanislas SABATIER 17 Dec '13

17 Dec '13

Is there a way to retrieve the client's password in plain text from memory ? I don't store the password in plain text in my postgreSQL but I need it when the client is connected to make crypto computation. If I write a plugin to do the job, how could I retrieve the plain text password from master ? Thank you for your help, Regards, Stan. --------------------------------------------------------------- Stanislas SABATIER s.sabatier(a)pobox.com ---------------------------------------------------------------

6 9

[Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem
by Sami Mäntysaari 16 Dec '13

16 Dec '13

Hello all readers of the list, I wish to get Microsoft Outlook 2010 workin with mail-stack-delivery setup. Logs when trying to setup accaunt in Microsoft Outlook 2010: ec 14 22:38:31 ip-172-31-7-147 dovecot: imap-login: Disconnected: Too many invalid commands (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:38:31 ip-172-31-7-147 dovecot: pop3-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:38:31 ip-172-31-7-147 dovecot: pop3-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS Dec 14 22:38:31 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS Dec 14 22:38:32 ip-172-31-7-147 dovecot: pop3-login: Aborted login (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:38:33 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS Dec 14 22:38:33 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:39:17 ip-172-31-7-147 dovecot: pop3-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS handshaking: Disconnected Dec 14 22:39:18 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS handshaking: Disconnected Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after UNKNOWN from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after UNKNOWN from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8239]: connect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: lost connection after STARTTLS from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: disconnect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after STARTTLS from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: connect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: lost connection after EHLO from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: disconnect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after EHLO from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:40:13 ip-172-31-7-147 dovecot: imap-login: Login: user=<sm>, method=PLAIN, rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, mpid=8243, TLS Dec 14 22:40:57 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:40:57 ip-172-31-7-147 dovecot: pop3-login: Disconnected (tried to use disabled plaintext auth): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:40:58 ip-172-31-7-147 dovecot: pop3-login: Disconnected (tried to use disabled plaintext auth): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:42:44 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:42:45 ip-172-31-7-147 postfix/anvil[8238]: statistics: max connection rate 3/60s for (submission:2001:470:28:743:4923:c01c:c89a:567a) at Dec 14 22:39:24 Dec 14 22:42:45 ip-172-31-7-147 postfix/anvil[8238]: statistics: max connection count 1 for (submission:2001:470:28:743:4923:c01c:c89a:567a) at Dec 14 22:39:22 Dec 14 22:42:45 ip-172-31-7-147 postfix/anvil[8238]: statistics: max cache size 2 at Dec 14 22:39:22 Telnet log while connected over IPV6 to port 587 on mail server: Trying 2001:470:1f08:ddd::2... Connected to 2001:470:1f08:ddd::2. Escape character is '^]'. 220 mail.sami-mantysaari.biz ESMTP Postfix ehlo samip537.tk 250-mail.sami-mantysaari.biz 250-PIPELINING 250-SIZE 10240000 250-ETRN 250-STARTTLS 250-ENHANCEDSTATUSCODES 250-8BITMIME 250 DSN quit 221 2.0.0 Bye Connection closed by foreign host. Any seggestions what to try in order to get this to work?

5 11

[Dovecot] connection Dovecot to samba4
by Pascal den Bekker 16 Dec '13

16 Dec '13

Hello, I am trying to setup samba4/openchange and dovecot. Does anyone has experiences concering dovecot connecting to samba4 ?? I tried the following: /etc/dovecot.conf: protocols = imap sieve mail_location = maildir:/data/mail/%d/%n/Maildir mail_access_groups = vmail mail_privileged_group = vmail first_valid_uid = 110 last_valid_uid = 110 first_valid_gid = 115 last_valid_gid = 115 log_path = /var/log/dovecot log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Welcome to domain.local. service imap { inet_listener { port=143 } } protocol lda { log_path = /var/log/mail/dovecot-deliver.log auth_socket_path = /var/run/dovecot/auth-master postmaster_address = postmaster(a)domain.local mail_plugins = sieve } service managesieve { inet_listener { port=12000 } } auth_verbose = yes auth_debug = yes service auth { unix_listener /var/spool/postfix/private/auth { group = vmail mode = 0660 user = postfix } } #service auth-userdb { # user = vmail # } #user = root #} passdb { args = /etc/dovecot/dovecot-ldap-passdb.conf driver = ldap } userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf driver = ldap } plugin { sieve = /data/mail/%d/%n/sieverc sieve_storage=/data/mail/%d/%n/sieve sieve_max_redirects = 20 } debug_log_path = /var/log/dovecot-debug.log dict { } /etc/dovecot/dovecot-ldap-passdb.conf hosts = localhost auth_bind = yes auth_bind_userdn = cn=%u,cn=Users,dc=domain,dc=local ldap_version = 3 base = cn=Users,dc=domain,dc=local pass_filter = (&(objectClass=person)(cn=%u)(mail=*)) /etc/dovecot/dovecot-ldap-userdb.conf: hosts = localhost dn = cn=ldap,cn=Users,DC=domain,DC=local dnpass = password ldap_version = 3 base = cn=Users,DC=domain,DC=local #user_attrs = user_attrs=uid=5000,=gid=5000,=home=/data/mail/%d/%n,mail=/data/mail/%d/%u/Maildir user_filter = (&(objectClass=person)(cn=%u)(mail=*)) iterate_attrs = cn=user iterate_filter = (objectClass=person) When I try to login with useraccountadministrator I get the following error messages: 2013-12-16 11:28:29 auth: Info: ldap(ldap,127.0.0.1,<N3HjRaTtdAB/AAAB>): unknown user 2013-12-16 11:28:29 auth: Error: userdb(ldap,127.0.0.1,<N3HjRaTtdAB/AAAB>): user not found from userdb ldap 2013-12-16 11:28:29 imap: Error: Authenticated user not found from userdb, auth lookup id=783810561 (client-pid=3809 client-id=1) 2013-12-16 11:28:29 imap-login: Info: Internal login failure (pid=3809 id=1) (internal failure, 1 succesful auths): user=<ldap>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3810, secured, session=<N3HjRaTtdAB/AAAB> Can someone tell me what I am doing wrong, or is there way to test to dovecot ldap connection string ?? Cheers, - Pascal -- Pascal den Bekker Linux System Administrator Affinitas GmbH | Kohlfurter Straße 41/43 | 10999 Berlin | Germany email: pascal_den.bekker(a)affinitas.de | tel: +49 30 868 000 140 www.edarling.de | www.shopaman.de Geschäftsführer: Lukas Brosseder, David Khalil, Michael Schrezenmaier Eingetragen beim Amtsgericht Berlin-Charlottenburg, HRB 115958

4 7

[Dovecot] Turn of mount point adding?
by Scott Galambos 16 Dec '13

16 Dec '13

I'm running dovecot 2.2.5 and would like to completely turn off all automatic adding of mount points. So var/lib/dovecot/mounts would be empty essentially. Is this possible? Somehow dovecot always adds a mount point that does not exist and was removed a long time ago. I've dove: doveadm mount add '/my custom path/*' ignore but it still will add mount points in the "mounts" file and flag them as online. for example: ignore /apps/proftp/servers/ftp.domain.ca/* ignore /mnt/* online / online /apps/proftp/servers/ftp.domain.ca/www.site1.com online /apps/proftp/servers/ftp.domain.ca/www.site2.com online /apps/proftp/servers/ftp.domain.ca/www.site3.com what does it list site1, 2 and 3 if its suppose to ignore the root path with the first line? I would to completely disable all mountpoints. Even "doveadm mount add '/*' ignore" should render a mounts file empty on reboot correct? It doesn't and keeps rebuilding it.

3 3

[Dovecot] Is mail deleted when mail-filter fails?
by martijn.list 15 Dec '13

15 Dec '13

Hi, While experimenting with the mail-filter, during some tests my filter failed with a non-zero exit code and did not write any data to the output. This seems to result in a lost email. Is this correct? Is there a way to gracefully handle error from a mail-filter out script? Kind regards, Martijn Brinkers

1 1

[Dovecot] Possible pigeonhole dealing with negative numerical values
by Sam Mulvey 14 Dec '13

14 Dec '13

Using dovecot 2.2.9 and pigeonhole 0.4.2 The system is a Xen VM running Arch Linux x86_64, presently up to date, on an XFS filesystem in an LVM2 partition. After recently updating my mail server, I found that a sieve rule I had which would check X-Spam-Score for a value over a certain number, in my case 2.5. In my most recent update, negative values would trip the rule. Here's the rule in question: # rule:[Spam Filter Subject] if anyof (header :contains "Subject" "[SPAM]", header :value "gt" :comparator "i;as cii-numeric" "X-Spam-Score" "2.5") { fileinto "Spam Box"; stop; } I have a successful work-around by checking the numerical value and also insuring that the header doesn't contain a '-', and things work as they should. Possible the bug could be in my Sieve interface, which is a RoundCube plugin. Otherwise things are working great. If there's anything I can add, please let me know. Thanks! -Sam dovecot -n output: # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.12.4-1-ARCH x86_64 xfs auth_cache_size = 512 k auth_cache_ttl = 10 mins auth_mechanisms = plain login auth_verbose = yes default_internal_user = mailstore first_valid_gid = 50 first_valid_uid = 50 hostname = tacomatelematics.com last_valid_gid = 50 last_valid_uid = 50 lda_mailbox_autocreate = yes mail_gid = 50 mail_location = maildir:/var/spool/mail/%d/%n/Maildir/ mail_privileged_group = postfix mail_uid = 50 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)tacomatelematics.com protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = mailstore mode = 01130 user = mailstore } unix_listener auth-userdb { group = mailstore mode = 0600 user = mailstore } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl_cert = </etc/certificate.pem ssl_key = </etc/certificate.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" }

2 1

[Dovecot] v2.2.8 released
by Timo Sirainen 13 Dec '13

13 Dec '13

http://dovecot.org/releases/2.2/dovecot-2.2.8.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.8.tar.gz.sig + Mail cache lookups work for the mail being saved. This improves performance by avoiding the need to parse the mail multiple times when using some plugins (e.g. mail_log). + Mail cache works for recently cached data also with in-memory indexes. + imapc: Many performance improvements, especially when working with dsync. Also added imapc_feature=fetch-headers which allows using FETCH BODY.PEEK[HEADER.FIELDS (..)] to avoid reading the entire header. + mail_location = ..:FULLDIRNAME=dbox-Mails is the same as :DIRNAME=dbox-Mails, but it will also be used for :INDEX and :CONTROL directories. (It should have worked this way from the beginning, but can't be changed anymore without breaking existing installations). - Fixed infinite loop in message parsing if message ends with "--boundary" and CR (without LF). Messages saved via SMTP/LMTP can't trigger this, because messages must end with an "LF.". A user could trigger this for him/herself though. - lmtp: Client was sometimes disconnected before all the output was sent to it. - imap_zlib plugin caused crashes during client disconnection in v2.2.7 - replicator: Database wasn't being exported to disk every 15 minutes as it should have. Instead it was being imported, causing "doveadm replicator remove" commands to not work very well.

5 9

Re: [Dovecot] Dsync error: Couldn't drop privileges: getgrnam
by Joseph Tam 13 Dec '13

13 Dec '13

Alan McGinlay wrote: > Can't believe I'm the only one with this error, googled it and there is > nothing. Sorry to whine but I am getting desperate here! I googled "safe_mkstemp permission denied" and first hit is this thread dovecot.org/list/dovecot/2010-August/052319.html which mentions this error coming about from chrooting users. Looking back on your post, I see http://www.dovecot.org/list/dovecot/2013-December/093900.html mail_chroot = /var/vmail As long as your desperate, maybe try leaving this setting empty? (This doesn't explain why it's not deterministic though.) Try process traces -- I do when I'm stumped. Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] dovecot-imapd eating 100% cpu every once in a while
by Nikolaus Rath 13 Dec '13

13 Dec '13

Hello, About once or twice a week, dovecot's imap-login process on my system seems gets out of control, eating 100% CPU for about 2 hours. Afterwards everything seems to go back to normal. I am using Dovecot 2.1.7 on a 64 bit Debian wheezy system. When running gdb on the process in this stage, I get the following traceback: #0 0x00007fcba50c5a90 in read () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007fcba4aa01aa in ?? () from /usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0 #2 0x00007fcba4a9df09 in BIO_read () from /usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0 #3 0x00007fcba4dbac8c in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #4 0x00007fcba4dbbe75 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #5 0x00007fcba4dbd8d0 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #6 0x00007fcba4dad07a in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #7 0x00007fcba4db143b in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #8 0x00007fcba5622b61 in ssl_handshake (proxy=0x7fcba7870bb0) at ssl-proxy-openssl.c:465 #9 ssl_step (proxy=0x7fcba7870bb0) at ssl-proxy-openssl.c:528 #10 0x00007fcba53d2016 in io_loop_call_io (io=0x7fcba786fc80) at ioloop.c:379 #11 0x00007fcba53d2cc7 in io_loop_handler_run (ioloop=ioloop@entry=0x7fcba778c6e0) at ioloop-epoll.c:213 #12 0x00007fcba53d1a28 in io_loop_run (ioloop=0x7fcba778c6e0) at ioloop.c:398 #13 0x00007fcba53be483 in master_service_run (service=0x7fcba778c590, callback=callback@entry=0x7fcba5620100 <client_connected>) at master-service.c:544 #14 0x00007fcba562079e in login_binary_run (binary=<optimized out>, argc=1, argv=0x7fcba778c370) at main.c:406 #15 0x00007fcba5015ead in __libc_start_main () from /lib/x86_64-linux-gnu/libc.so.6 #16 0x00007fcba5a52b2d in _start () strace -tt says: 16:14:19.693378 gettimeofday({1381421659, 693415}, NULL) = 0 16:14:19.693490 time(NULL) = 1381421659 16:14:19.693588 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.693688 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 16:14:19.693796 gettimeofday({1381421659, 693823}, NULL) = 0 16:14:19.693890 time(NULL) = 1381421659 16:14:19.693984 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.694084 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 16:14:19.694177 gettimeofday({1381421659, 694203}, NULL) = 0 16:14:19.694269 time(NULL) = 1381421659 16:14:19.694399 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.694563 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 16:14:19.694706 gettimeofday({1381421659, 694757}, NULL) = 0 16:14:19.694849 time(NULL) = 1381421659 16:14:19.694976 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.695091 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 16:14:19.695201 gettimeofday({1381421659, 695230}, NULL) = 0 16:14:19.695300 time(NULL) = 1381421659 16:14:19.695420 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.695555 epoll_wait(14, <unfinished ...> dovecot -n output is: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 ext3 first_valid_uid = 8 last_valid_uid = 8 mail_access_groups = spamd-clients mail_gid = mail mail_location = mdbox:/var/spool/mail/%n/mdbox mail_plugins = fts quota fts_lucene mail_uid = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=SHA512-CRYPT username_format=%n /etc/dovecot/users driver = passwd-file } plugin { antispam_backend = pipe antispam_pipe_program = /usr/local/bin/spamc_wrapper antispam_pipe_program_notspam_args = -L;ham antispam_pipe_program_spam_args = -L;spam antispam_spam = Spam antispam_trash = Trash;Papierkorb fts = lucene fts_lucene = whitespace_chars=@. quota = dict:User quota::file:%h/quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve" service auth { unix_listener auth-client { mode = 0600 user = Debian-exim } } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 2003 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 } ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { args = username_format=%n /etc/dovecot/users driver = passwd-file override_fields = home=/var/spool/mail/%n } protocol lmtp { mail_plugins = fts quota fts_lucene sieve } protocol lda { mail_plugins = fts quota fts_lucene sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = fts quota fts_lucene imap_quota antispam } Is this a bug in dovecot, or am I doing something wrong? Is there something I can do to debug this further? Best, Nikolaus -- Encrypted emails preferred. PGP fingerprint: 5B93 61F8 4EA2 E279 ABF6 02CF A9AD B7F8 AE4E 425C »Time flies like an arrow, fruit flies like a Banana.«

3 6

[Dovecot] Locking down master user to certain domains through passwd-file auth
by Andrew Obertas 12 Dec '13

12 Dec '13

Hello, I know it is possible to lock down a master user to only have access to certain domains through SQL login but I was wondering if the same was possible with a passwd-based system. I currently have a master-passwd file residing in the /etc/virtual/domain.com/ directories I want the master user to be able to log in to. Is there a way to tell passdb to only allow the master user login to proceed if they can auth to the master-passwd file in the same folder as the user? Alternatively, is there a better way to go about this? What I assumed would be the easy approach, where the domain from the user's e-mail is fetched, doesn't seem to work as %d fetches the master user's domain and, unless I'm doing something wrong, the login_domain variable cannot be used as this is outside Dovecot-auth. Any assistance with this would be appreciated. -- Best regards, Andrew Obertas Technical Support Representative Infinet Communications Group

2 2

[Dovecot] error with xz compression
by Michael Cramer 12 Dec '13

12 Dec '13

i have enabled the zlib plugin with xz compression but on some new mails i got now a segfault and the following lines in dovecot error.log Dec 12 08:51:23 imap(tester(a)domain.com): Error: lzma.read(/srv/vmail/mail/domain.com/root/storage/m.3): unexpected EOF at 136004 Dec 12 08:51:23 imap(tester(a)domain.com): Error: read(zlib(/srv/vmail/mail/domain.com/root/storage/m.3)) failed: Invalid argument (uid=2985) Dec 12 08:51:23 imap(tester(a)domain.com): Error: mail parser: read(zlib(/srv/vmail/mail/domain.com/root/storage/m.3), box=Shared/root(a)domain.com) failed: Invalid argument Dec 12 08:52:33 indexer-worker(tester(a)domain.com): Error: lzma.read(/srv/vmail/mail/domain.com/tester/storage/m.41): unexpected EOF at 4913758 the problem is that the mails can't be shown. this happens not with every mail i also got new mails that can be shown without any problem. i was not able to produce a coredump

2 1

[Dovecot] Dsync error: Couldn't drop privileges: getgrnam
by Alan McGinlay - SICS 12 Dec '13

12 Dec '13

Hi, I upgraded (in place upgrade, preserving my dovecot configs) to a newer release of ubuntu in order to gain access to slightly newer Dovecot release and be able to use Dsync for migration from Cyrus, here is my doveconf -n output: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.5.0-44-generic x86_64 Ubuntu 12.10 auth_debug = yes auth_default_realm = whatever.com auth_master_user_separator = * auth_socket_path = /var/run/dovecot/auth-master imapc_features = rfc822.size imapc_host = oldmail.whatever.com imapc_master_user = cyradmin imapc_password = <password hidden> mail_chroot = /var/vmail mail_debug = yes mail_gid = 5000 mail_location = maildir:~/Maildir mail_prefetch_count = 20 mail_privileged_group = vmail mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve pop3" service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = dovecot mode = 0600 user = dovecot } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = <cert ssl_key = <cert userdb { args = uid=vmail gid=vmail home=/domain/%1d/%d/%1n/%n allow_all_users=yes driver = static } protocol lmtp { postmaster_address = post(a)whatever.com } protocol imap { mail_max_userip_connections = 10 } protocol pop3 { pop3_uidl_format = %v.%u } And the command I am using to (attempt) a mailbox sync: doveadm -o mail_fsync=never backup -R -u alantestuser(a)whatever.com imapc: Produces this output: dsync(alantestuser(a)whatever.com): Error: user alantestuser(a)whatever.com: Couldn't drop privileges: getgrnam(vmail) failed: No such file or directory (in mail_privileged_group setting) dsync(alantestuser(a)whatever.com): Fatal: User init failed mail.log shows this: Dec 5 21:10:54 newmailserver dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Dec 5 21:10:54 newmailserver dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Dec 5 21:10:54 newmailserver dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so Dec 5 21:10:54 newmailserver dovecot: auth: Debug: passwd-file /etc/dovecot/master-users: Read 1 users in 0 secs Dec 5 21:10:54 newmailserver dovecot: auth: Debug: master in: USER#0111#011alantestuser(a)whatever.com#011service=doveadm Dec 5 21:10:54 newmailserver dovecot: auth: Debug: master out: USER#0111#011alantestuser@whatever.com#011uid=5000#011gid=5000#011home=/domain/w/whatever.com/a/alantestuser I followed this doc (which could use a little fleshing out, I will be happy to do it once I get a grasp on this!): http://wiki2.dovecot.org/Migration/Dsync Thanks in advance! /Alan

3 9

[Dovecot] managesieve error with dovecot
by saurabh 12 Dec '13

12 Dec '13

Hi All, I am using Dovecot version 2.0.9 on Centos 6.4. I have installed dovecot-pegionhole version 2.0.9 and Roundcube version 0.9.5 . After doing all the configurations. I am able to see the filters icon in roundcube setting. But whem I click it I get the error "could not connect to server" please help. Below are the error logs. ########### log from /var/log/maillog ########## Dec 11 21:41:06 eximtest dovecot: managesieve: Debug: Unknown userdb setting: plugin//mail/%d/%n/=/home/test Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Debug: Effective uid=6006, gid=6000, home= Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Debug: quota: No quota setting - plugin disabled Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/mail/ayurve.co.uk/test/Maildir Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Debug: maildir++: root=/mail/ayurve.co.uk/test/Maildir, index=, control=, inbox=/mail/ayurve.co.uk/test/Maildir Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Debug: sieve-storage: using active sieve script path: (null) Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Debug: sieve-storage: using sieve script storage directory: (null) Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Error: sieve-storage: stat((null)) failed: Bad address Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Error: sieve-storage: stat((null)) failed: Bad address Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Fatal: Failed to open Sieve storage. ############## log from /var/www/html/roundcube/logs/errors ############## [11-Dec-2013 16:11:06 +0000]: PHP Error: Unable to connect to managesieve on eximtest.techblue.co.uk:4190 in /var/www/html/roundcube/plugins/managesieve/managesieve.php on line 308 (GET /roundcube/?_task=settings&_action=plugin.managesieve) [11-Dec-2013 16:11:06] Not currently in AUTHORISATION state (1): [11-Dec-2013 16:11:06] Failed to write to socket: connection lost (): ################### log from /var/www/html/roundcube/logs/sieve ################### [11-Dec-2013 16:11:06 +0000]: S: "IMPLEMENTATION" "dovecot" [11-Dec-2013 16:11:06 +0000]: S: "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date" [11-Dec-2013 16:11:06 +0000]: S: "NOTIFY" "mailto" [11-Dec-2013 16:11:06 +0000]: S: "SASL" "PLAIN" [11-Dec-2013 16:11:06 +0000]: S: "VERSION" "1.0" [11-Dec-2013 16:11:06 +0000]: S: OK "Capability completed." [11-Dec-2013 16:11:06 +0000]: C: AUTHENTICATE "PLAIN" "AHRlc3RAYXl1cnZlLmNvLnVrADRRUG9vZFdvMGQ=" [11-Dec-2013 16:11:06 +0000]: S: Thanks, Saurabh -- Saurabh Kumar (RHCSA,RHCE,RHCVA)

2 6

[Dovecot] what's wrong with this config file?
by Jim Reid 12 Dec '13

12 Dec '13

Hi. I'm setting up a new IMAPS server. Mail users don't have login access to the box but will each have unique UNIX-style UIDs: no back-end database or LDAP thing. So far. Their mail will get delivered to UNIX-style mailboxes in /var/mail/%u (where %u is the UNIX username obviously). Their IMAP folders will go in /var/imap/%u. These will contain subfolders once everyone migrates to the new set-up and some folders will contain messages and subfolders. I think this is what I configured in dovecot. However when I try to set up a test account, dovecot reports the following error: Dec 12 02:22:00 shaun dovecot: imap-login: Login: user=<jim>, method=CRAM-MD5, rip=10.0.0.1, lip=10.1.1.1, mpid=14874, TLS, session=<8Hy1Ak3t+gDDNulD> Dec 12 02:22:00 shaun dovecot: imap(jim): Error: user jim: Initialization failed: namespace configuration error: Duplicate namespace prefix: "" Dec 12 02:22:00 shaun dovecot: imap(jim): Error: Invalid user settings. Refer to server log for more information. I've checked and re-checked the wiki. google was unable to suggest any explanation either. Any ideas what's wrong? There is no duplicate namespace (and/or prefix) that I can see below. # 2.2.9: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 9.2-RELEASE amd64 auth_mechanisms = cram-md5 auth_verbose = yes base_dir = /var/run/dovecot/ default_client_limit = 120 director_username_hash = %Lu import_environment = TZ listen = *, [::] mail_debug = yes mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail mbox_write_locks = fcntl namespace { disabled = no hidden = yes ignore_on_failure = no inbox = yes list = yes location = mbox:~/mail:INBOX=/var/mail/%u prefix = "#mbox/" separator = / subscriptions = yes type = private } namespace imapstuff { disabled = no hidden = no ignore_on_failure = no inbox = no list = yes location = maildir:/var/imap/%u:LAYOUT=fs prefix = separator = / subscriptions = yes type = private } namespace inbox { disabled = no hidden = no ignore_on_failure = no inbox = yes list = yes location = mailbox Drafts { auto = no driver = special_use = \Drafts } mailbox Junk { auto = no driver = special_use = \Junk } mailbox Sent { auto = no driver = special_use = \Sent } mailbox "Sent Messages" { auto = no driver = special_use = \Sent } mailbox Trash { auto = no driver = special_use = \Trash } prefix = separator = subscriptions = yes type = private } passdb { driver = pam } passdb { driver = pam } passdb { args = /usr/local/etc/dovecot-md5 driver = passwd-file } protocols = imap service aggregator { chroot = . client_limit = 0 drop_priv_before_exec = no executable = aggregator extra_groups = fifo_listener replication-notify-fifo { group = mode = 0600 user = } group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replication-notify { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 0 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-client { group = mode = 0600 user = } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = mode = 0666 user = $default_internal_user } unix_listener login/login { group = mode = 0666 user = } unix_listener token-login/tokenlogin { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = . client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs inet_listener { address = port = 0 ssl = no } privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener director-userdb { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns_client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 32 drop_priv_before_exec = no executable = /usr/local/libexec/dovecot/imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = port = 0 ssl = no } inet_listener imaps { address = port = 993 ssl = yes } privileged_group = process_limit = 8 process_min_avail = 3 protocol = imap service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service imap-urlauth-login { chroot = token-login client_limit = 0 drop_priv_before_exec = no executable = imap-urlauth-login extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login unix_listener imap-urlauth { group = mode = 0666 user = } user = $default_login_user vsz_limit = 18446744073709551615 B } service imap-urlauth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth-worker extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener imap-urlauth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service imap-urlauth { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener token-login/imap-urlauth { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = /usr/local/libexec/dovecot/imap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 32 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service indexer-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = indexer-worker extra_groups = group = idle_kill = 0 privileged_group = process_limit = 10 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service indexer { chroot = client_limit = 0 drop_priv_before_exec = no executable = indexer extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service ipc { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = ipc extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener ipc { group = mode = 0600 user = } unix_listener login/ipc-proxy { group = mode = 0600 user = $default_login_user } user = $default_internal_user vsz_limit = 18446744073709551615 B } service lmtp { chroot = client_limit = 1 drop_priv_before_exec = no executable = lmtp extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log unix_listener log-errors { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 32 drop_priv_before_exec = no executable = pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = port = 110 ssl = no } inet_listener pop3s { address = port = 995 ssl = yes } privileged_group = process_limit = 8 process_min_avail = 3 protocol = pop3 service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = pop3 extra_groups = group = idle_kill = 0 privileged_group = process_limit = 32 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service replicator { chroot = client_limit = 0 drop_priv_before_exec = no executable = replicator extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replicator-doveadm { group = mode = 00 user = $default_internal_user } unix_listener replicator { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service ssl-params { chroot = client_limit = 0 drop_priv_before_exec = no executable = ssl-params extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = startup unix_listener login/ssl-params { group = mode = 0666 user = } unix_listener ssl-params { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = stats extra_groups = fifo_listener stats-mail { group = mode = 0600 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener stats { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } ssl_cert = </usr/local/etc/ssl/certs/dovecot.pem ssl_cipher_list = ALL:!LOW:!SSLv2 ssl_key = </usr/local/etc/ssl/private/dovecot.pem ssl_parameters_regenerate = 1 weeks state_dir = /var/lib/dovecot syslog_facility = local4 userdb { driver = passwd } userdb { driver = passwd } protocol lda { postmaster_address = postmaster(a)example.com } protocol imap { mail_max_userip_connections = 10 mail_plugin_dir = /usr/local/lib/dovecot/imap }

3 2

[Dovecot] warning from managesieve
by Michael Cramer 12 Dec '13

12 Dec '13

when .dovecot.sieve is a symlink (which it is in my case) a warning is written to the error log file, but it still works. Dec 12 10:02:33 managesieve(tester(a)domain.com): Warning: sieve-storage: Active sieve script symlink /srv/vmail/sieve/domain.com/tester/.dovecot.sieve is broken: invalid/unknown path to storage (points to ingo.sieve). root@i920:/srv/vmail/sieve/domain.com/tester# ll insgesamt 20 drwx------ 3 mail mail 4096 Dez 12 10:03 ./ drwx------ 15 mail mail 4096 Dez 12 10:02 ../ lrwxrwxrwx 1 mail mail 10 Dez 12 10:02 .dovecot.sieve -> ingo.sieve -rw------- 1 mail mail 1575 Dez 12 10:03 .dovecot.svbin -rw------- 1 mail mail 2457 Dez 12 10:02 ingo.sieve drwx------ 2 mail mail 4096 Dez 12 10:02 tmp/

4 7

[Dovecot] Panic: file buffer.c: assertion failed: (used_size <= buf->alloc)
by giom87＠libero.it 12 Dec '13

12 Dec '13

Hi, We have a crash in dovecot 2.2.7 2013-12-11 10:38:44 imap(xxx(a)example.com): Panic: file buffer.c: line 307 (buffer_set_used_size): assertion failed: (used_size <= buf->alloc) 2013-12-11 10:38:44 imap(xxx(a)example.com): Error: Raw backtrace: /opt/dovecot- 2.2.7/lib/dovecot/libdovecot.so.0(+0x672a2) [0x7f576b9742a2] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot.so.0(+0x67306) [0x7f576b974306] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f576b92eb4f] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot.so.0(+0x62d89) [0x7f576b96fd89] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_file_open+0x228) [0x7f576bc85488] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0 (mail_transaction_log_open+0xba) [0x7f576bc8229a] -> /opt/dovecot-2.2.7 /lib/dovecot/libdovecot-storage.so.0(+0x8dc94) [0x7f576bc69c94] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot-storage.so.0(mail_index_open+0xf0) [0x7f576bc69ee0] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0 (index_storage_mailbox_open+0xad) [0x7f576bc5d0dd] -> /opt/dovecot-2.2.7 /lib/dovecot/libdovecot-storage.so.0(+0x4432a) [0x7f576bc2032a] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot-storage.so.0(+0x443ff) [0x7f576bc203ff] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0(+0x564e4) [0x7f576bc324e4] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0 (mailbox_open+0xf) [0x7f576bc3269f] -> /opt/dovecot-2.2.7 /lib/dovecot/libdovecot-storage.so.0(mailbox_delete+0x1d) [0x7f576bc3287d] -> dovecot/imap(cmd_delete+0xb4) [0x40cc24] -> dovecot/imap(command_exec+0x3d) [0x416d0d] -> dovecot/imap() [0x415e30] -> dovecot/imap() [0x415f1d] -> dovecot/imap(client_handle_input+0x11d) [0x41619d] -> dovecot/imap (client_input+0x6f) [0x41650f] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot.so.0 (io_loop_call_io+0x36) [0x7f576b983b96] -> /opt/dovecot-2.2.7 /lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f576b984bf7] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f576b983b08] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot.so.0 (master_service_run+0x13) [0x7f576b9338f3] -> dovecot/imap(main+0x2a7) [0x41fa27] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f576b598cdd] -> dovecot/imap() [0x40ab79] 2013-12-11 10:38:44 imap(xx(a)example.com): Fatal: master: service(imap): child 6214 killed with signal 6 (core dumped) We use CentOS 6.4: # cat /etc/issue CentOS release 6.4 (Final) The output of dovecot -n: # 2.2.7: /opt/dovecot-2.2.7/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 CentOS release 6.4 (Final) auth_debug = yes auth_master_user_separator = * auth_username_format = disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 101 first_valid_uid = 102 imap_id_send = import_environment = TZ info_log_path = /var/log/dovecot.log log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = always mail_gid = 101 mail_location = maildir:%h/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota expire fts fts_lucene mail_uid = 102 maildir_broken_filename_sizes = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = /opt/dovecot-2.2.7/etc/dovecot/passwd.masterusers driver = passwd-file master = yes } passdb { args = /opt/dovecot-2.2.7/etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /opt/dovecot-2.2.7/etc/dovecot/dovecot-ldap-multiuser.conf driver = ldap master = yes } plugin { fts = lucene fts_lucene = quota = maildir quota_rule2 = INBOX.Trash:storage=+100M } protocols = imap pop3 service anvil { client_limit = 3000 } service auth { client_limit = 4096 unix_listener auth-userdb { mode = 0600 } } service imap-login { inet_listener imap { address = xxx.xxx.xxx.xxx port = 143 } inet_listener imaps { address = xxx.xxx.xxx.xxx port = 993 ssl = yes } process_limit = 2500 process_min_avail = 5 } service imap { drop_priv_before_exec = yes process_limit = 2500 process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { drop_priv_before_exec = yes process_limit = 1024 } service pop3-login { inet_listener pop3 { address = xxx.xxx.xxx.xxx port = 110 } inet_listener pop3s { address = xxx.xxx.xxx.xxx port = 995 ssl = yes } process_limit = 300 process_min_avail = 5 } service pop3 { drop_priv_before_exec = yes process_limit = 300 process_min_avail = 5 } ssl_cert = </opt/dovecot-2.2.7/certs/imapd.pem ssl_key = </opt/dovecot-2.2.7/certs/imapd.pem userdb { args = /opt/dovecot-2.2.7/etc/dovecot/dovecot-ldap.conf driver = ldap } protocol lmtp { mail_plugins = quota expire fts fts_lucene sieve } protocol lda { mail_plugins = quota expire fts fts_lucene sieve } protocol imap { mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota pop3_uidl_format = UID%u-%v } Thanks

2 1

[Dovecot] ot: tracking messages- luser troubleshooting
by voytek＠sbt.net.au 12 Dec '13

12 Dec '13

I had a user complaining of 'not getting emails' I've searched for sender in maillog, got two messages, both showed up as; Dec 12 15:51:29 emu postfix/pipe[9607]: 3F21C5E750: to=<xxx>, relay=dovecot, delay=6.4, delays=6.3/0.01/0/0.12, dsn=2.0.0, status=sent (delivered via dovecot service) Dec 12 15:51:29 emu postfix/qmgr[20178]: 3F21C5E750: removed yes the user claimed the message was not received, eventually, after traversing through severl directories, I found the message in '../Maildir/.Deleted Messages' it turns out it was inadvertenltly deleted on iphone. there has to be a better way to try to find / resolve such issues ? what's an optimal way of trying to trace such? I greped for the 3F21C5E750 string through several Maildirs tia,

2 1