- dovecot - dovecot.org

[Dovecot] crash/mem violation in auth_worker + 50G logs in 2.1.7
by Mrten 13 Jun '13

13 Jun '13

Hi, This morning I discovered what seemed to be a deliberate crash in auth_worker: Jun 7 23:02:09 localhost dovecot: auth-worker: Error: #007Can't read dir of '/etc/mysql/conf.d/' (Errcode: 2) Jun 7 23:02:09 localhost dovecot: auth-worker: Error: Fatal error in defaults handling. Program aborted Jun 7 23:02:09 localhost dovecot: auth-worker: Error: *** glibc detected *** dovecot/auth worker: waiting for connection: free(): invalid pointer: 0x00007fffa0863160 *** Jun 7 23:02:09 localhost dovecot: auth-worker: Error: ======= Backtrace: ========= Jun 7 23:02:09 localhost dovecot: auth-worker: Error: /lib/x86_64-linux-gnu/libc.so.6(+0x7eb96)[0x7f22d42f9b96] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: /usr/lib/libmysqlclient.so.18(free_root+0x90)[0x7f22d37988c0] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: /usr/lib/libmysqlclient.so.18(free_defaults+0x4b)[0x7f22d3796e6b] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: /usr/lib/libmysqlclient.so.18(mysql_read_default_options+0x13c)[0x7f22d377d00c] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: /usr/lib/libmysqlclient.so.18(mysql_real_connect+0x8e)[0x7f22d377eb4e] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: /usr/lib/dovecot/modules/auth/libdriver_mysql.so(+0x1fc6)[0x7f22d3c52fc6] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: dovecot/auth worker: waiting for connection(+0x2be1d)[0x7f22d515be1d] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: dovecot/auth worker: waiting for connection(db_sql_connect+0xd)[0x7f22d514aedd] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: dovecot/auth worker: waiting for connection(+0x23d70)[0x7f22d5153d70] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: dovecot/auth worker: waiting for connection(passdb_init+0x2a)[0x7f22d515158a] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: dovecot/auth worker: waiting for connection(auths_init+0x59)[0x7f22d513dfe9] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: dovecot/auth worker: waiting for connection(main+0x345)[0x7f22d513d5f5] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xed)[0x7f22d429c76d] Jun 7 23:02:09 localhost dovecot: auth-worker: Error: dovecot/auth worker: waiting for connection(+0xd7d9)[0x7f22d513d7d9] There follows a memory map but I snipped that. This repeated until I killed dovecot (12 hours later), by then 54GB of logs had accumulated. Besides leaving me impressed with the logserver :), I was wondering if this is a known problem. I don't know what triggered this at 23:02 (shown above is the first set of problem logentries). Can't really have been an upgrade, since I backported the raring dovecot Ubuntu package for my precise server, no automated upgrades there. I did go look for the /etc/mysql/conf.d directory mentioned, it wasn't there, but there was a /etc/mysql/my.cnf trying to !includedir it. Since there is no mysql on the server besides libmysqlclient I removed the directory and haven't seen the problem return yet. Sounds like the reason for happening, however, the memory error after that probably warrants research? If it is in libmysqlclient, that's another non-default snag because that's the lib I get from Percona, not the Ubuntu default one. Shouldn't dovecot recognize that the auth worker is crashing? One more thing, this is (one line from many) from audit.log (I have auditd logging audit records) type=ANOM_ABEND msg=audit(1370682566.377:3499876): auid=4294967295 uid=108 gid=115 ses=4294967295 pid=23187 comm="auth" reason="memory violation" sig=6 108 is the dovecot user, so it probably is related. I realise I'm way off defaults here but I wanted to report anyway. (dovecot -n attached) thanks for any insight, Maarten.

2 2

[Dovecot] CATENATE/literal8 issue
by Michael M Slusarz 13 Jun '13

13 Jun '13

Using 2.2.2, I see this: C: 6 APPEND "INBOX" (\seen) "16-May-2013 22:05:14 -0600" CATENATE (URL "/INBOX;UIDVALIDITY=1255685337/;UID=48812/;SECTION=HEADER" TEXT ~{40} S: 6 NO [UNKNOWN-CTE] Binary input allowed only when the first part is binary. Why is there this limitation? It seems to me that CATENATE is confusing the content-type encoding of the data/part itself with the encoding of the IMAP literal. A literal 8 is nothing more than a series of OCTET's that *may* contain nulls, but not necessarily. i.e., in the above example the 40 octets of data are US-ASCII text, which is perfectly acceptable to send as a literal8. (Client rationale: If BINARY exists on the server, we don't bother to scan IMAP literal's for null data -- we just send them as literal8's. It's an optimization that I would hate to get rid of.) michael

2 8

[Dovecot] Replication and LAYOUT=fs
by Simon Fraser 13 Jun '13

13 Jun '13

Hello folks, I have a problem with replication and mail_location with LAYOUT=fs set. If I set "mail_location = maildir:~/mail" (leaving out the :LAYOUT=fs), create and populate some mailboxes and subfolders, they all get replicated. If I start with a clean mail spool and LAYOUT=fs, I can create some new mailboxes and subfolders but only the inbox is replicated. Subfolders are ignored. The users are all in LDAP, and virtual, hence the generic mail_home format and mail_location being set. The userdb lookup has been told to return no attributes ("user_attrs = "), but I have also tried it with requesting 'home' and specifying a default of /mail/spool/%u in the userdb config. The service is perfectly functional as far as a mail client is concerned: it can access all the folders and messages it expects on the server that had them added. It's only the replication using LAYOUT=fs that seems to be troublesome. Here is `doveconf -n` for the first of the pair of servers (dcot1a and dcot1b). The configuration on the other is identical except for the hostname differences. Simon # 2.2.2: /mail/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-27-virtual x86_64 Ubuntu 12.04.2 LTS disable_plaintext_auth = no doveadm_password = secret first_valid_uid = 100 mail_gid = dovecot mail_home = /mail/spool/%u mail_location = maildir:~/mail:LAYOUT=fs mail_plugins = notify replication mail_uid = dovecot namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /mail/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_replica = tcp:dcot1b:12345 } protocols = imap lmtp service aggregator { fifo_listener replication-notify-fifo { mode = 0600 user = dovecot } unix_listener replication-notify { mode = 0600 user = dovecot } } service config { unix_listener config { user = dovecot } } service doveadm { inet_listener { port = 12345 } user = dovecot } service replicator { process_min_avail = 1 } shutdown_clients = no ssl_cert = </etc/ssl/certs/dcot1a-cert.pem ssl_key = </etc/ssl/private/dcot1a-key.pem userdb { args = /mail/etc/dovecot/dovecot-ldap.userdb.conf.ext driver = ldap } -- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.

2 2

Re: [Dovecot] Dovecot 2 + IMAP
by Alex Dubinin 13 Jun '13

13 Jun '13

12.06.2013 22:34, Michael Kliewe пишет: > Hello Alex, > you asked exactly the same question 5 days ago and already got the > answer (from 2 people). Why did you ask again, didn't you receive the > answers? Thank you for your answer. Yes, i didn't receive answer ((((

1 0

[Dovecot] post-login script and original remote ip in proxy mode
by Ibrahim Harrani 13 Jun '13

13 Jun '13

Hi, I am running dovecot on 3 qmail-ldap server backend. dovecot configured to use auth_pop3 wrapper for authentication. Users logins to the qmail-ldap pop3&imap pools randomly. If a user is mailhost is not the connected server, dovecot proxies the connection to the user mailhost. In this case, I can not get the original client IP address via post-logins script on user host. I see only the first connected server IP as $IP environment. Any idea to get original client IP in this setup with postlogin scripts? Thanks

2 1

[Dovecot] Question about directory hash function.
by Evgeny Basov 13 Jun '13

13 Jun '13

Hello, Timo. I have a question about %H in http://wiki2.dovecot.org/Variables : what the hash function uses for calculations and how to get this value manually? This is need for bypass way getting home directory. With best regards, Evgeny Basov.

2 1

[Dovecot] Permissions for mail_temp_dir directory
by Henrik Larsson 13 Jun '13

13 Jun '13

I recently upgraded from 2.1.16 to 2.2.2 and started to receive the following errors: imap(henrik(a)example.com): Error: stat(/var/db/dovecot/dovecot.imap.mail.example.com.16128.3209d13f842955c2) failed: Permission denied imap(henrik(a)example.com): Error: Temp file creation to /var/db/dovecot/dovecot.imap.mail.example.com.16128. failed: Permission denied imap(henrik(a)example.com): Error: stat(/var/db/dovecot/dovecot.imap.mail.example.com.16501.0ddff1dc93cdbe6a) failed: Permission denied imap(henrik(a)example.com): Error: Temp file creation to /var/db/dovecot/dovecot.imap.mail.example.com.16501. failed: Permission denied I didn't have these before the upgrade. The current permissions for the /var/db/dovecot directory is root:wheel 755. What would be the correct permissions for the mail_temp_dir directory? doveconf -n output --cut-- # 2.2.2: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.3-RELEASE-p3 amd64 auth_mechanisms = plain login digest-md5 cram-md5 first_valid_uid = 125 hostname = mail.example.com listen = * log_path = /var/log/dovecot mail_plugins = zlib mail_privileged_group = postfix mail_temp_dir = /var/db/dovecot managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = . type = private } namespace { hidden = yes inbox = no list = no location = prefix = INBOX. separator = . type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { fts = squat fts_squat = partial=4 full=10 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)example.com protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { unix_listener /home/mail/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } service lmtp { executable = lmtp -L unix_listener /home/mail/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/mail.example.com-chained.crt ssl_key = </etc/ssl/mail.example.com.key userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { log_path = /var/log/dovecot-deliver mail_plugins = zlib sieve } protocol lda { mail_plugins = zlib sieve } protocol imap { mail_plugins = zlib imap_zlib } --cut-- Best regards Henrik Larsson

2 1

[Dovecot] THREAD REFERENCES bug
by A.L.E.C 13 Jun '13

13 Jun '13

I found it on an ancient dovecot version, so it might be already fixed. Let's say I have a folder with 3 messages UID Subject Date 12 One 2013-06-09 11 Testmail 2013-06-10 14 Subject 2013-06-11 C: A0003 UID THREAD REFERENCES US-ASCII ALL S: * THREAD (12)(11)(14) Now I received a message with today's date (2013-06-12) with subject "Testmail" (the same as message with uid=11. The new message has uid=16. C: A0003 UID THREAD REFERENCES US-ASCII ALL S: * THREAD (12)((11)(16))(14) I expected 16 (or more likely 11 and 16) to be at the end of the result, after 14, i.e. (12)(14)((11)(16)). The problem for a user is when he has more messages in a folder. When user receives a new message sometimes (on subject duplicate) he will not see it because it will be somewhere in the middle of the result, but should be on top. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl

2 2

[Dovecot] Dovecot 2 + IMAP
by Alex Dubinin 12 Jun '13

12 Jun '13

This is my first experience of the mail server. Set up a mail server from Postfix + Dovecot with the MySQL authorization. When you create a new user dovecot makes strange folder structure: the 'inbox' contains 'juncus', 'tash', 'sent' etc. ie 'sent' and other folders are subdir to the 'inbox'. How to make the imap folders 'sent', 'trash' and others were not affiliated? I have IMAP answer: . list "" "*" * LIST (\HasChildren) "." "INBOX" . OK List completed. No trash, no drafts, no other folder. All this folder included in INBOX (((( But I want (my clients wants): * LIST (\HasNoChildren) "." "Drafts" * LIST (\HasNoChildren) "." "INBOX" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "Sent" * LIST (\HasNoChildren) "." "spam" P.S. Sorry for my english. P.P.S. # dovecot --version 2.1.7 # dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.0 ext4 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain base_dir = /run/dovecot/ debug_log_path = /var/vmail/dovecot.log disable_plaintext_auth = no info_log_path = /var/vmail/dovecot.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 213.7.204.34 log_path = /var/vmail/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = MAIL_DOMAIN_NAME IMAP server ready. mail_debug = yes mail_location = maildir:/var/vmail/%d/%n/Maildir mail_plugins = " quota" namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Trash { special_use = \Trash } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = maildir:User quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+10%% quota_rule3 = Junk:storage=+10%% quota_rule4 = Drafts:storage=+10%% quota_warning = storage=95%% quota-warning 95 %u } postmaster_address = admin@ MAIL_DOMAIN_NAME protocols = " imap pop3" service auth-worker { executable = auth -w unix_listener auth-worker { group = mode = 0600 } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } unix_listener auth-userdb { group = mode = 0600 user = } user = root } service dict { unix_listener dict { group = mode = 0600 user = } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 0 service_count = 1 } service imap { unix_listener login/imap { group = mode = 0666 user = } } service lmtp { unix_listener lmtp { group = mode = 0666 user = } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 ssl = yes } } service pop3 { unix_listener login/pop3 { group = mode = 0666 user = } } ssl = required ssl_ca = </etc/dovecot/MAIL_SERVER_NAME-ca.crt ssl_cert = </etc/dovecot/MAIL_SERVER_NAME .crt ssl_key = </etc/dovecot/private/MAIL_SERVER_NAME .key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_ssl = yes protocol lda { auth_socket_path = /var/run/dovecot/auth-master log_path = /var/vmail/dovecot-deliver.log postmaster_address = admin@ MAIL_DOMAIN_NAME } protocol imap { mail_plugins = " quota autocreate imap_quota" }

2 1

[Dovecot] Permission denied / missing +r perm
by Andrew Crawford 12 Jun '13

12 Jun '13

I have postfix configured to deliver mail to dovecot over lmtp into a mailbox that then is accessed over imap. The imap server is running as the user "mail". Whenever I run "postfix flush" I get in mail.log: > Jun 12 05:37:45 li212-205 dovecot: lmtp(21288): Connect from local > Jun 12 05:37:45 li212-205 spamd[18173]: prefork: child states: II > Jun 12 05:37:45 li212-205 dovecot: auth-worker(21289): mysql(127.0.0.1): Connected to database mailserver > Jun 12 05:37:45 li212-205 dovecot: lmtp(21288, drew@REDACTED): zXAqF2lBuFEoUwAA5SnFYQ: msgid=<064C5BC7-357B-4366-9A80-5001DBA21F62@REDACTED>: saved mail to INBOX > Jun 12 05:37:45 li212-205 postfix/lmtp[21287]: 57BDA1CC932: to=<drew@REDACTED>, relay=li212-205.members.linode.com[private/dovecot-lmtp], delay=0.06, delays=0.01/0.01/0.01/0.03, dsn=2.0.0, status=sent (250 2.0.0 <drew@REDACTED> zXAqF2lBuFEoUwAA5SnFYQ Saved) > Jun 12 05:37:45 li212-205 dovecot: lmtp(21288): Disconnect from local: Client quit (in reset) > Jun 12 05:37:45 li212-205 postfix/qmgr[21244]: 57BDA1CC932: removed > Jun 12 05:37:45 li212-205 dovecot: imap(drew@REDACTED): Error: open(/decrypted-mail/awesomebox.sealedabstract.com/drew/cur/1371029865.M411… failed: Permission denied (euid=8(mail) egid=8(mail) missing +r perm: /decrypted-mail/awesomebox.sealedabstract.com/drew/cur/1371029865.M411903P21288.li212-205,S=2626,W=2673:2,, we're not in group 0(root)) > Jun 12 05:37:45 li212-205 dovecot: imap(drew@REDACTED): Disconnected: Internal error occurred. Refer to server log for more information. [2013-06-12 05:37:45] in=349 out=1084 Indeed, the file in question is owned by root and would not be accessible to the mail user: > ls -la /decrypted-mail/awesomebox.sealedabstract.com/drew/cur/ > total 24 > drwxrw---- 2 mail mail 4096 Jun 12 05:37 . > drwxrw---- 7 mail mail 4096 Jun 12 05:37 .. > -rw-rw---- 1 mail mail 2616 Jun 12 05:26 1371029196.M462737P20302.li212-205,S=2616,W=2662:2, > -rw-rw---- 1 mail mail 2635 Jun 12 05:32 1371029564.M454251P20747.li212-205,S=2635,W=2682:2, > -rw-rw---- 1 root root 2626 Jun 12 05:37 1371029865.M411903P21288.li212-205,S=2626,W=2673:2, So dutifully, I chown / chgrp to the mail user. But as soon as i receive a new mail, dovecot again creates files owned by root:root. How do I convince it to create files as mail:mail ? Diagnostic info: > $ dovecot --version > 2.1.7 > $ ps -aux | grep dovecot > root 20810 0.0 0.0 2892 984 ? Ss 05:34 0:00 /usr/sbin/dovecot -c /etc/dovecot/dovecot.conf > dovecot 20813 0.0 0.0 2620 940 ? S 05:34 0:00 dovecot/anvil > root 20814 0.0 0.1 2752 1072 ? S 05:34 0:00 dovecot/log > root 20818 0.0 0.2 4348 2524 ? S 05:34 0:00 dovecot/config > dovenull 21046 0.0 0.2 5248 2500 ? S 05:35 0:00 dovecot/imap-login > mail 21047 0.0 0.2 6392 2088 ? S 05:35 0:00 dovecot/imap > dovenull 21056 0.0 0.2 5248 2500 ? S 05:35 0:00 dovecot/imap-login > mail 21057 0.0 0.2 6752 2576 ? S 05:35 0:00 dovecot/imap > dovenull 21292 0.0 0.2 5248 2500 ? S 05:37 0:00 dovecot/imap-login > root 21293 0.0 0.1 4508 1044 ? S 05:37 0:00 dovecot/ssl-params > mail 21294 0.0 0.2 6540 2624 ? S 05:37 0:00 dovecot/imap > root 21400 0.0 0.0 4104 788 pts/0 S+ 05:51 0:00 grep dovecot > $ doveconf -n > # 2.1.7: /etc/dovecot/dovecot.conf > # OS: Linux 3.8.4-linode50 i686 Debian 7.0 fuse.encfs > auth_mechanisms = plain login > first_valid_uid = 0 > mail_location = maildir:/decrypted-mail/%d/%n > mail_privileged_group = mail > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > protocols = " imap lmtp" > service auth-worker { > user = mail > } > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0600 > user = postfix > } > unix_listener auth-userdb { > mode = 0600 > user = mail > } > user = dovecot > } > service imap-login { > inet_listener imap { > port = 0 > } > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0666 > user = postfix > } > user = mail > } > service pop3-login { > inet_listener pop3 { > port = 0 > } > } > ssl = required > ssl_cert = </etc/ssl/certs/dovecot.pem > ssl_key = </etc/ssl/private/dovecot.pem > userdb { > args = uid=mail gid=mail home=/decrypted-mail/%d/%n > driver = static > } >

1 1