June 2013 - dovecot - dovecot.org

[Dovecot] dovecot segfaults after upgrade
by Thomas Blomenkamp 14 Jun '13

14 Jun '13

Using dovecot on debian oldstable (squeeze) with daily builded repository, after an upgrade this morning, dovecot always shows the following error: 2013 Jun 10 11:07:22 mailstore imap(tblomenk): Fatal: master: service(imap): child 3016 killed with signal 11 (core dumps disabled) Jun 10 11:07:22 mailstore kernel: [ 1589.400741] imap[3016]: segfault at 7fffd9048ff8 ip 00007f91417e2c3b sp 00007fffd9049000 error 6 in libdovecot.so.0.0.0[7f9141796000+bc000] Please notice: I can reproduce the error by trying to access my mailbox with alpine or mutt, while alpine only can access my inbox. If I try to access my other folders, the error happens. Mutt always closes the connection after trying to login. It is a little bit strange because with a newer client like roundcube I can access all my folders successfully. In all kernel error messages it seems that error 6 in libdovecot.so.0.0.0[7f9141796000+bc000] is always the same. Also notice that dovecot is still running, it is just that you cannot access other folders than your inbox with pine. mailstore:~# dovecot --version 2.2.2 (45399357008a) mailstore:~# dovecot -n # 2.2.2 (45399357008a): /etc/dovecot/dovecot.conf doveconf: Warning: service auth { client_limit=1000 } is lower than required under max. load (1324) doveconf: Warning: service anvil { client_limit=1000 } is lower than required under max. load (1227) # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.7 auth_debug = yes auth_gssapi_hostname = mailstore.math.uni-bielefeld.de auth_mechanisms = plain login auth_username_format = %n auth_verbose = yes lmtp_save_to_detail_mailbox = yes log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Hi, the IMAP Mail-System on mailstore.math.uni-bielefeld.de is ready. login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c mail_location = mdbox:~/mdbox mail_plugins = acl mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave spamtest spamtestplus imapflags notify namespace { list = children location = mdbox:%%h/mdbox prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes.db mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_log_group_events = no quota = maildir:User quota quota_rule = *:storage=0 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags +notify +spamtest +spamtestplus sieve_spamtest_max_value = 100 sieve_spamtest_status_header = X-PMX-Spam: \.*Probability=([[:digit:]]+)%+\.* sieve_spamtest_status_type = score } protocols = imap lmtp sieve service auth { unix_listener auth-master { mode = 0600 user = vmail } unix_listener auth-userdb { user = vmail } user = root } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 0 } process_limit = 1024 process_min_avail = 10 service_count = 1 } service imap { process_limit = 1024 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 vsz_limit = 64 M } ssl_cert = </etc/dovecot/mailstore_cert_chain.pem ssl_key = </etc/ssl/private/mcl_key.pem userdb { args = uid=vmail gid=vmail home=/var/vmail_san2/dovecot/%1Lu/%Lu driver = static } protocol imap { mail_plugins = acl imap_acl } protocol lmtp { mail_plugins = acl sieve } protocol sieve { mail_max_userip_connections = 50 managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } Regards, Thomas

2 3

[Dovecot] IMAPC feature description
by Yonatan Broza 13 Jun '13

13 Jun '13

Hi, I couldn't find any decent documentation about the IMAPC feature. Could someone please explain the purpose of this feature? In particular, what are the differences between IMAPC and reverse proxying? Thanks.

2 1

[Dovecot] crash/mem violation in auth_worker + 50G logs in 2.1.7
by Mrten 13 Jun '13

13 Jun '13

Hi, This morning I discovered what seemed to be a deliberate crash in auth_worker: Jun 7 23:02:09 localhost dovecot: auth-worker: Error: #007Can't read dir of '/etc/mysql/conf.d/' (Errcode: 2) Jun 7 23:02:09 localhost dovecot: auth-worker: Error: Fatal error in defaults handling. Program aborted Jun 7 23:02:09 localhost dovecot: auth-worker: Error: *** glibc detected *** dovecot/auth worker: waiting for connection: free(): invalid pointer: 0x00007fffa0863160 *** Jun 7 23:02:09 localhost dovecot: auth-worker: Error: ======= Backtrace: ========= Jun 7 23:02:09 localhost dovecot: auth-worker: Error: /lib/x86_64-linux-gnu/libc.so.6(+0x7eb96)[0x7f22d42f9b96] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: /usr/lib/libmysqlclient.so.18(free_root+0x90)[0x7f22d37988c0] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: /usr/lib/libmysqlclient.so.18(free_defaults+0x4b)[0x7f22d3796e6b] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: /usr/lib/libmysqlclient.so.18(mysql_read_default_options+0x13c)[0x7f22d377d00c] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: /usr/lib/libmysqlclient.so.18(mysql_real_connect+0x8e)[0x7f22d377eb4e] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: /usr/lib/dovecot/modules/auth/libdriver_mysql.so(+0x1fc6)[0x7f22d3c52fc6] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: dovecot/auth worker: waiting for connection(+0x2be1d)[0x7f22d515be1d] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: dovecot/auth worker: waiting for connection(db_sql_connect+0xd)[0x7f22d514aedd] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: dovecot/auth worker: waiting for connection(+0x23d70)[0x7f22d5153d70] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: dovecot/auth worker: waiting for connection(passdb_init+0x2a)[0x7f22d515158a] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: dovecot/auth worker: waiting for connection(auths_init+0x59)[0x7f22d513dfe9] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: dovecot/auth worker: waiting for connection(main+0x345)[0x7f22d513d5f5] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xed)[0x7f22d429c76d] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: dovecot/auth worker: waiting for connection(+0xd7d9)[0x7f22d513d7d9] There follows a memory map but I snipped that. This repeated until I killed dovecot (12 hours later), by then 54GB of logs had accumulated. Besides leaving me impressed with the logserver :), I was wondering if this is a known problem. I don't know what triggered this at 23:02 (shown above is the first set of problem logentries). Can't really have been an upgrade, since I backported the raring dovecot Ubuntu package for my precise server, no automated upgrades there. I did go look for the /etc/mysql/conf.d directory mentioned, it wasn't there, but there was a /etc/mysql/my.cnf trying to !includedir it. Since there is no mysql on the server besides libmysqlclient I removed the directory and haven't seen the problem return yet. Sounds like the reason for happening, however, the memory error after that probably warrants research? If it is in libmysqlclient, that's another non-default snag because that's the lib I get from Percona, not the Ubuntu default one. Shouldn't dovecot recognize that the auth worker is crashing? One more thing, this is (one line from many) from audit.log (I have auditd logging audit records) type=ANOM_ABEND msg=audit(1370682566.377:3499876): auid=4294967295 uid=108 gid=115 ses=4294967295 pid=23187 comm="auth" reason="memory violation" sig=6 108 is the dovecot user, so it probably is related. I realise I'm way off defaults here but I wanted to report anyway. (dovecot -n attached) thanks for any insight, Maarten.

2 2

[Dovecot] CATENATE/literal8 issue
by Michael M Slusarz 13 Jun '13

13 Jun '13

Using 2.2.2, I see this: C: 6 APPEND "INBOX" (\seen) "16-May-2013 22:05:14 -0600" CATENATE (URL "/INBOX;UIDVALIDITY=1255685337/;UID=48812/;SECTION=HEADER" TEXT ~{40} S: 6 NO [UNKNOWN-CTE] Binary input allowed only when the first part is binary. Why is there this limitation? It seems to me that CATENATE is confusing the content-type encoding of the data/part itself with the encoding of the IMAP literal. A literal 8 is nothing more than a series of OCTET's that *may* contain nulls, but not necessarily. i.e., in the above example the 40 octets of data are US-ASCII text, which is perfectly acceptable to send as a literal8. (Client rationale: If BINARY exists on the server, we don't bother to scan IMAP literal's for null data -- we just send them as literal8's. It's an optimization that I would hate to get rid of.) michael

2 8

[Dovecot] Replication and LAYOUT=fs
by Simon Fraser 13 Jun '13

13 Jun '13

Hello folks, I have a problem with replication and mail_location with LAYOUT=fs set. If I set "mail_location = maildir:~/mail" (leaving out the :LAYOUT=fs), create and populate some mailboxes and subfolders, they all get replicated. If I start with a clean mail spool and LAYOUT=fs, I can create some new mailboxes and subfolders but only the inbox is replicated. Subfolders are ignored. The users are all in LDAP, and virtual, hence the generic mail_home format and mail_location being set. The userdb lookup has been told to return no attributes ("user_attrs = "), but I have also tried it with requesting 'home' and specifying a default of /mail/spool/%u in the userdb config. The service is perfectly functional as far as a mail client is concerned: it can access all the folders and messages it expects on the server that had them added. It's only the replication using LAYOUT=fs that seems to be troublesome. Here is `doveconf -n` for the first of the pair of servers (dcot1a and dcot1b). The configuration on the other is identical except for the hostname differences. Simon # 2.2.2: /mail/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-27-virtual x86_64 Ubuntu 12.04.2 LTS disable_plaintext_auth = no doveadm_password = secret first_valid_uid = 100 mail_gid = dovecot mail_home = /mail/spool/%u mail_location = maildir:~/mail:LAYOUT=fs mail_plugins = notify replication mail_uid = dovecot namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /mail/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_replica = tcp:dcot1b:12345 } protocols = imap lmtp service aggregator { fifo_listener replication-notify-fifo { mode = 0600 user = dovecot } unix_listener replication-notify { mode = 0600 user = dovecot } } service config { unix_listener config { user = dovecot } } service doveadm { inet_listener { port = 12345 } user = dovecot } service replicator { process_min_avail = 1 } shutdown_clients = no ssl_cert = </etc/ssl/certs/dcot1a-cert.pem ssl_key = </etc/ssl/private/dcot1a-key.pem userdb { args = /mail/etc/dovecot/dovecot-ldap.userdb.conf.ext driver = ldap } -- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.

2 2

Re: [Dovecot] Dovecot 2 + IMAP
by Alex Dubinin 13 Jun '13

13 Jun '13

12.06.2013 22:34, Michael Kliewe пишет: > Hello Alex, > you asked exactly the same question 5 days ago and already got the > answer (from 2 people). Why did you ask again, didn't you receive the > answers? Thank you for your answer. Yes, i didn't receive answer ((((

1 0

[Dovecot] post-login script and original remote ip in proxy mode
by Ibrahim Harrani 13 Jun '13

13 Jun '13

Hi, I am running dovecot on 3 qmail-ldap server backend. dovecot configured to use auth_pop3 wrapper for authentication. Users logins to the qmail-ldap pop3&imap pools randomly. If a user is mailhost is not the connected server, dovecot proxies the connection to the user mailhost. In this case, I can not get the original client IP address via post-logins script on user host. I see only the first connected server IP as $IP environment. Any idea to get original client IP in this setup with postlogin scripts? Thanks

2 1

[Dovecot] Question about directory hash function.
by Evgeny Basov 13 Jun '13

13 Jun '13

Hello, Timo. I have a question about %H in http://wiki2.dovecot.org/Variables : what the hash function uses for calculations and how to get this value manually? This is need for bypass way getting home directory. With best regards, Evgeny Basov.

2 1

[Dovecot] Permissions for mail_temp_dir directory
by Henrik Larsson 13 Jun '13

13 Jun '13

I recently upgraded from 2.1.16 to 2.2.2 and started to receive the following errors: imap(henrik(a)example.com): Error: stat(/var/db/dovecot/dovecot.imap.mail.example.com.16128.3209d13f842955c2) failed: Permission denied imap(henrik(a)example.com): Error: Temp file creation to /var/db/dovecot/dovecot.imap.mail.example.com.16128. failed: Permission denied imap(henrik(a)example.com): Error: stat(/var/db/dovecot/dovecot.imap.mail.example.com.16501.0ddff1dc93cdbe6a) failed: Permission denied imap(henrik(a)example.com): Error: Temp file creation to /var/db/dovecot/dovecot.imap.mail.example.com.16501. failed: Permission denied I didn't have these before the upgrade. The current permissions for the /var/db/dovecot directory is root:wheel 755. What would be the correct permissions for the mail_temp_dir directory? doveconf -n output --cut-- # 2.2.2: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.3-RELEASE-p3 amd64 auth_mechanisms = plain login digest-md5 cram-md5 first_valid_uid = 125 hostname = mail.example.com listen = * log_path = /var/log/dovecot mail_plugins = zlib mail_privileged_group = postfix mail_temp_dir = /var/db/dovecot managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = . type = private } namespace { hidden = yes inbox = no list = no location = prefix = INBOX. separator = . type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { fts = squat fts_squat = partial=4 full=10 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)example.com protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { unix_listener /home/mail/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } service lmtp { executable = lmtp -L unix_listener /home/mail/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/mail.example.com-chained.crt ssl_key = </etc/ssl/mail.example.com.key userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { log_path = /var/log/dovecot-deliver mail_plugins = zlib sieve } protocol lda { mail_plugins = zlib sieve } protocol imap { mail_plugins = zlib imap_zlib } --cut-- Best regards Henrik Larsson

2 1

[Dovecot] THREAD REFERENCES bug
by A.L.E.C 13 Jun '13

13 Jun '13

I found it on an ancient dovecot version, so it might be already fixed. Let's say I have a folder with 3 messages UID Subject Date 12 One 2013-06-09 11 Testmail 2013-06-10 14 Subject 2013-06-11 C: A0003 UID THREAD REFERENCES US-ASCII ALL S: * THREAD (12)(11)(14) Now I received a message with today's date (2013-06-12) with subject "Testmail" (the same as message with uid=11. The new message has uid=16. C: A0003 UID THREAD REFERENCES US-ASCII ALL S: * THREAD (12)((11)(16))(14) I expected 16 (or more likely 11 and 16) to be at the end of the result, after 14, i.e. (12)(14)((11)(16)). The problem for a user is when he has more messages in a folder. When user receives a new message sometimes (on subject duplicate) he will not see it because it will be somewhere in the middle of the result, but should be on top. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl

2 2