February 2014 - dovecot

[Dovecot] Feature request about Info: Internal login failure (pid=2296 id=17278) (internal failure, 1 successful auths)
by Steffen Kaiser 14 Feb '14

14 Feb '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, since some time I'm plagued by internal login failures. With v2.2.10 I got the some additional error, that I should raise the process_limit for the imap service, then I got the hint to raise vsz_limit for the lmtp and imap serverices. These hints are very helpful and are some sort of unique feature of Dovecot - descriptive error messages. Now I have upgraded a Webfrontend behind imapproxy -> Dovecot and get this during a phase in the day, several of messages go to large internal mailing lists and lots of users are connecting/disconnecting via IMAP, POP,& Web: <login success> imap: Error: Disconnected from auth server, aborting (client-pid=2296 client-id=17278) imap-login: Info: Internal login failure (pid=2296 id=17278) (internal failure, 1 successful auths) .... . doveadm and to query the userdb [I have some processes that use Dovecot UserDB to query user data, which do not cache its information], & login into IMAP fail as well. Even connecting to the auth-userdb socket reveals no reaction - usually the VERSION prompts immediately. I now suppose that the deault auth_worker_max_count=30 is the culprit, because I query LDAP for passdb and userdb and client_count, but client_limit=0. Would it be possible to add a warning to all limits "that max out"? Or, if such "generic error" occurs, could Dovecot be enabled to dump a list of which limit is used up to which level? Or something like that. Also, I'm surprised to find that the "Internal login failure" is at "Info" level only. Also note: It is very possible that the problem is caused by a client that goes havoc. ====== Just to no trigger the "post your config" reply I give now and then myself: # 2.2.10 (5432b55a2b87): /usr/local/dovecot-2.2.10/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.8 auth_cache_size = 10 M auth_debug = yes auth_mechanisms = plain login auth_verbose = yes base_dir = /var/run/dovecot2.2/ default_vsz_limit = 512 M deliver_log_format = msgid=%m: %$ %p/%w "%f" "%s" dict { acl = pgsql:/usr/local/dovecot-2.2.10/etc/dovecot/dovecot-dict-sql.conf.ext quota = pgsql:/usr/local/dovecot-2.2.10/etc/dovecot/dovecot-dict-sql.conf.ext } instance_name = dovecot2.2 lda_mailbox_autocreate = yes lmtp_save_to_detail_mailbox = yes log_path = /var/log/dovecot/dovecot2.2.log log_timestamp = "%F %H:%M:%S " mail_debug = yes mail_gid = vmail mail_log_prefix = "%Us(%u) [%p]: " mail_max_userip_connections = 0 mail_plugins = " quota notify mail_log zlib acl" mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = users.%%u. separator = . type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = proxy::acl antispam_allow_append_to_spam = yes antispam_backend = spool2dir antispam_spam = SPAM+ReportAsSPAM antispam_spool2dir_notspam = /tmp/spamspool/%%020lu-%%05lu-%u-H antispam_spool2dir_spam = /tmp/spamspool/%%020lu-%%05lu-%u-S antispam_trash = trash;TRASH;Trash;spam;SPAM;Spam;junk;JUNK;Junk;Deleted Items;Deleted Messages;Gel&APY-schte Elemente;Gel&APY-schte Objekte;Junk E-mail;Junk-E-Mail;INBOX.Trash;INBOX.TRASH;INBOX.trash mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size vsize from subject quota = dict:User quota::proxy::quota quota_rule = *:storage=300MB quota_rule2 = Trash:storage=+30M recipient_delimiter = + sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_actions = 0 sieve_quota_max_storage = 3M } protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { unix_listener auth-client { mode = 0766 } unix_listener auth-userdb { mode = 0766 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service doveadm { unix_listener doveadm-server { mode = 0666 } } service imap-login { process_min_avail = 4 service_count = 0 vsz_limit = 768 M } service imap { process_limit = 10000 vsz_limit = 768 M } service lmtp { vsz_limit = 768 M } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { process_min_avail = 5 service_count = 0 vsz_limit = 512 M } ssl_ca = </etc/ssl/certs/ca.crt ssl_cert = </etc/ssl/certs/imap.pem ssl_key = </etc/ssl/private/imap.key userdb { driver = prefetch } userdb { args = /usr/local/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf.ext default_fields = home=/home/%u uid=vmail gid=vmail driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = " quota notify mail_log zlib acl quota sieve" } protocol lda { mail_plugins = " quota notify mail_log zlib acl quota sieve" } protocol imap { mail_plugins = " quota notify mail_log zlib acl imap_quota imap_zlib imap_acl antispam" } - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUvjzZnD1/YhP6VMHAQKElQgAoBU3v5JD9kFNzan06UFG88sucvf6HZru gLF6l7IZSWiY/IwouTBoseJcrXmgVG9sCk12gxvonO3iT0KVu1PyJZeTMaKtY3hS I37J4iS88pmY3cGQNguYMSidrIvNOt6SW+Jv/9QxuYTJKYCqoEZRdP8yJ+dvrmQw zpZEzKqcV+x4ofDLcpRxLZtXwb+Bl5AA9hoe/Md/UqzUEa9CYyvANoX63/zY7WS5 1VpK+a80/L6ukJUt9tPQTWSe0ALYmL6Cd4tAdC2Bsq7rN+6SQIcjxxr/9v8Byj8Q BdtwUhpTazVm7CLOjnFiWxfXmHCL9BNrQUBBAd5docSydNDEUMmQng== =r9QR -----END PGP SIGNATURE-----

2 3

[Dovecot] No Access to public folder
by vupibi 14 Feb '14

14 Feb '14

Hello, I have some Issues with Dovecots public folder. I only see the folder in users Mailbox but I cannot subscribe it or copy mails in it. My public file structure (folder: "/var/vmail/public/") looks like this: -rw-rw-rw- 1 ebox ebox 0 Feb 12 01:21 dovecot-acl-list drwxrwsrwx 2 ebox ebox 4096 Feb 12 00:31 test (Wierd thing is that "dovecot-acl-list" is empty, why?) content of "test" public folder is: -rw-r--r-- 1 root ebox 10 Feb 12 01:21 dovecot-acl I can see the folder in my mail accounts but I dont have access to it. I activated ACL and the log sais the plugin is loaded successfully Feb 12 12:54:19 mailand dovecot: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib02_imap_acl_plugin.so Feb 12 12:54:19 mailand dovecot: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so And the dovecot-acl file is loaded too Feb 12 12:54:19 mailand dovecot: imap(test(a)sxps.eu): Debug: acl vfile: reading file /var/vmail/public/test/dovecot-acl content of "/var/vmail/public/test/dovecot-acl" file is: anyone lr So i think everything is set up the right way but i'm still not able to access the public mal folder. Any suggestions? My Dovecot -n output # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-58-generic x86_64 Ubuntu 12.04.4 LTS auth_gssapi_hostname = mailand.sxps.int auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_mechanisms = gssapi plain first_valid_gid = 116 first_valid_uid = 108 log_timestamp = "%Y-%m-%d %H:%M:%S " mail_debug = yes mail_gid = 116 mail_home = /var/vmail/sieve/%d/%u mail_location = maildir:~/Maildir:LAYOUT=fs mail_uid = 108 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = no inbox = no list = yes location = maildir:/var/vmail/public:LAYOUT=fs prefix = public/ separator = / subscriptions = no type = public } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile autocreate = Trash autocreate2 = Spam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Spam autosubscribe3 = Sent autosubscribe4 = Drafts listescape_char = \ quota = maildir:User quota quota_rule = *:storage=0 sieve = /var/vmail/sieve/%d/%u/sieve-script sieve_dir = /var/vmail/sieve/%d/%u sieve_global_path = /var/vmail/sieve/default.sieve sieve_storage = /var/vmail/sieve/%d/%u } protocols = imap sieve service auth { executable = /usr/lib/dovecot/auth unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = ebox mode = 0600 user = ebox } user = dovecot } service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/dovecot/ssl/dovecot.pem ssl_key = </etc/dovecot/ssl/dovecot.pem userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocol imap { mail_plugins = listescape acl imap_acl } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = sieve quota postmaster_address = admin(a)XX.eu } -- View this message in context: http://dovecot.2317879.n4.nabble.com/No-Access-to-public-folder-tp46696.html Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] Status
by Timo Sirainen 14 Feb '14

14 Feb '14

So, just some quick notes: - dovecot.org server was down a couple of days again, need to find time to move it to a VM.. - my tss(a)iki.fi emails were also broken for some hours at least and it was bouncing back all mails to it during the time - I fixed some bugs reported by people, but I did it in airplane so couldn't reply back with links to the fixes in hg repo. I'll probably do that tomorrow. But you can already check if your reported bug has been fixed in http://hg.dovecot.org/dovecot-2.2 - I'm planning on going through Dovecot list's mails this week and make v2.2.11 release - although it looks like I've a flu, so lets see how far I can get.. - hopefully by the beginning of March I'll have more time again

5 7

[Dovecot] Sieve is not getting the propper RCPT from the LMTP daemon
by klondike 14 Feb '14

14 Feb '14

Hi! Since the setup I use is a bit strange let's go for it first: * The system uses postfix as MTA and dovecot as LDA after alias translation by local via LMTP * The dovecot version is 2.2.5 and the pigeonhole version is 0.4.1 * The SMTP server at gentoo.org is configured to send me a backup of my emails to klondike+gentoo (at) xiscosoft.es using sendmail * The email is received by the server and then (hopefully filtered). * The email comes with two Delivered-To: headers, the first one has the correct address, the second one has the gentoo address. The interesting part of the filter is this: if envelope :detail "to" "gentoo" { addflag "\\Seen"; fileinto "gentoo"; stop; } But this doesn't seem to work, I enable debugging with the following lines: require "vnd.dovecot.debug"; require "envelope"; require "variables"; if envelope :matches "to" "*" { debug_log "envelope to `${1}'"; } if envelope :matches "from" "*" { debug_log "envelope from `${1}'"; } The relevant lines for the test e-mail I sent are these: sieve: info: started log at Dec 24 13:37:23. main script: line 9: info: DEBUG: envelope to `klondike (at) gentoo.org'. main script: line 10: info: DEBUG: envelope from `klondike (at) gentoo.org'. info: msgid=<52B97FF7.6050109(a)gentoo.org>: stored mail into mailbox 'INBOX'. The thing is that the to envelope should be instead klondike+gentoo (at) xiscosoft.es as show by the lmtp logs: Dec 24 13:37:23 localhost dovecot: lmtp(26249): Connect from local Dec 24 13:37:23 localhost dovecot: lmtp(26249, klondike): Cd6YHwOAuVKJZgAA0J78UA: sieve: msgid=<52B97FF7.6050109(a)gentoo.org>: stored mail into mailbox 'INBOX' Dec 24 13:37:23 localhost dovecot: lmtp(26249): Disconnect from local: Successful quit Dec 24 13:37:23 localhost postfix/lmtp[26248]: 657D9101E5E: to=<klondike+gentoo (at) xiscosoft.es>, relay=xiscosoft.net[private/dovecot-lmtp], delay=0.29, delays=0.05/0.03/0.03/0.18, dsn=2.0.0, status=sent (250 2.0.0 <klondike+gentoo (at) xiscosoft.es> Cd6YHwOAuVKJZgAA0J78UA Saved) I really have no idea of why sieve is behaving like this as the evelope address is sent properly by postfix's lmtp according to the logs. Any ideas? klondike PS: please do CC me when answering this e-mail as I'm not subscribed to the list yet

4 4

[Dovecot] master user and ACL's
by Peter Mogensen 14 Feb '14

14 Feb '14

Hi, Quick question...I read in the docs that: "Master user is still subject to ACLs just like any other user, which means that by default the master user has no access to any mailboxes of the user." ... and that the standard workaround is to return master_user=%u from the userdb. But why is the master_user authn-id used in the ACLs and not the authz-id (requested-login-user) ? Isn't the whole point of SASL authz-id semantics to have authorization resolved based on the authz-id? /Peter

2 4

[Dovecot] Public folder doesn't work
by vupibi 14 Feb '14

14 Feb '14

Hey, I have some issues with dovecot, because the public folder won't show up in Mail accounts. Dovecot is installed via zentyal 3.3. I tried several settings, but I dont get it running. What I tried is adding this to my dovecot.conf file # User's private mail location mail_location = maildir:~/Maildir # When creating any namespaces, you must also have a private namespace: namespace { type = private separator = / prefix = #location defaults to mail_location. inbox = yes } namespace { type = public separator = / prefix = Public/ location = maildir:/var/vmail/public subscriptions = no } But nothing happened. I tried it with # Umask for shared folders umask = 0007 with subscriptions = yes tried creating the folder first like this touch /var/vmail/public/dovecot-shared chown -R ebox /var/vmail/public find /var/vmail/public -type d -print0 | xargs -0 chmod 2770 find /var/vmail/public -type f -print0 | xargs -0 chmod 660 But i had no success. Any Ideas how to get it running? Here is my dovecot -n output # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-58-generic x86_64 Ubuntu 12.04.4 LTS ext4 auth_gssapi_hostname = mailand.sxps.int auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_mechanisms = gssapi plain first_valid_gid = 116 first_valid_uid = 108 log_timestamp = "%Y-%m-%d %H:%M:%S " mail_gid = 116 mail_home = /var/vmail/sieve/%d/%u mail_location = maildir:/var/vmail/%$ mail_uid = 108 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { autocreate = Trash autocreate2 = Spam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Spam autosubscribe3 = Sent autosubscribe4 = Drafts quota = maildir:User quota quota_rule = *:storage=0 sieve = /var/vmail/sieve/%d/%u/sieve-script sieve_dir = /var/vmail/sieve/%d/%u sieve_global_path = /var/vmail/sieve/default.sieve sieve_storage = /var/vmail/sieve/%d/%u } protocols = imap sieve service auth { executable = /usr/lib/dovecot/auth unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = ebox mode = 0600 user = ebox } user = dovecot } service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/dovecot/ssl/dovecot.pem ssl_key = </etc/dovecot/ssl/dovecot.pem userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocol imap { mail_plugins = quota imap_quota autocreate } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = sieve quota postmaster_address = admin(a)XX.eu } Modify message -- View this message in context: http://dovecot.2317879.n4.nabble.com/Public-folder-doesn-t-work-tp46671.html Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] Some LDA questions!
by Фадеев Виталий Львович 14 Feb '14

14 Feb '14

Hi there! I have been setuped exim and dovecot. Exim uses dovecot-lda to deliver mails to mailbox. Some configurations of exim: dovecot_virtual_delivery: driver = pipe command = /usr/libexec/dovecot/dovecot-lda -d $local_part@$domain -f $sender_address message_prefix = message_suffix = delivery_date_add envelope_to_add return_path_add log_output user = vmail group = vmail #mode = 0660 temp_errors = 64 : 69 : 70: 71 : 72 : 73 : 74 : 75 : 78 dovecot does mysql lookups of users, passwords. All works, but in headers of example message: Return-path: <"vitalyf(a)bbb.com"@host.aaa.com> Envelope-to: vitalyf(a)bbb.com Delivery-date: Tue, 11 Feb 2014 03:59:17 -0600 Received: from xxx.net ([11.22.33.44] helo=[192.168.1.77]) by host.aaa.com with esmtpsa (TLS1.0:ECDHE_RSA_AES_128_CBC_SHA1:128) (Exim 4.82) (envelope-from <"vitalyf(a)bbb.com"@host.aaa.com>) id 1WDA7Y-0007GS-VR for vitalyf(a)bbb.com; Tue, 11 Feb 2014 03:59:17 -0600 Message-ID: <52F9F468.9030001(a)bbb.com> Date: Tue, 11 Feb 2014 16:59:04 +0700 From: =?UTF-8?B?0KTQsNC00LXQtdCyINCS0LjRgtCw0LvQuNC5INCb0YzQstC+0LLQuNGH?= <vitalyf(a)bbb.com> User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.3.0 MIME-Version: 1.0 To: vitalyf(a)bbb.com Subject: adfasdf Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Sender: "vitalyf(a)bbb.com"@host.aaa.com Test headers host.aaa.com is a hostname that run dovecot and exim. bbb.com is a virtual domain located in mysql db. I do not want to show host.aaa.com in headers. How can i disable this so headers looks like this: Return-path: <vitalyf(a)bbb.com> Which configuration i need to show you?

2 1

[Dovecot] Cached message size larger than expected
by Steven Haigh 14 Feb '14

14 Feb '14

Hi guys, I recently turned on IMAP zlib compression for Maildir and noticed that I've started getting these errors in the maillog. Error: Cached message size larger than expected (1627 > 1548) Error: Maildir filename has wrong S value, renamed the file from /home/crc.id.au/netwiz/.System Generated.Cron Jobs/cur/1392224150.M52270P1073.mail.crc.id.au,S=1627:2,S,Z to /home/crc. id.au/netwiz/.System Generated.Cron Jobs/cur/1392224150.M52270P1073.mail.crc.id.au,S=1627:2,S,Z Error: Corrupted index cache file /home/crc.id.au/netwiz/.System Generated.Cron Jobs/dovecot.index.cache: Broken physical size for mail UID 10916 Error: read(zlib(/home/crc.id.au/netwiz/.System Generated.Cron Jobs/cur/1392224150.M52270P1073.mail.crc.id.au,S=1627:2,S,Z)) failed: Invalid argument Disconnected: Internal error occurred. Refer to server log for more information. [2014-02-14 15:08:20] For these emails, I can no longer retrieve the contents of those messages in my mail client. I noticed a thread similar to this for Dovecot 2.1.3 (or so) - however I'm getting the same on 2.2.12. Has there been any solutions for this? -- Steven Haigh Email: netwiz(a)crc.id.au Web: https://www.crc.id.au Phone: (03) 9001 6090 - 0412 935 897 Fax: (03) 8338 0299

2 4

[Dovecot] Exclude Users from replication/sync
by Daniel Stoye 14 Feb '14

14 Feb '14

Hi All, i'm searching for a way to exclude certain users from dovecots replication mechanism. I can't use the first_valid_uid setting, because the uid of my pam (ldap) users und my system users are mixed up. So, is there a way to limit my users i currently have in my userdb or somehow exclude specific uids from replication? Thanks, Daniel

2 3

[Dovecot] v2.2.12 released
by Timo Sirainen 14 Feb '14

14 Feb '14

http://dovecot.org/releases/2.2/dovecot-2.2.12.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.12.tar.gz.sig POP3 server code changes rarely, so I haven't spent time adding automated testing for it. So of course now that it changed in v2.1.11 there was a bug that caused it to crash most of the time (except for the test case I was using while developing it). This release fixes it, no other changes.

2 2