February 2013 - dovecot

[Dovecot] virtual folder - crash while searching
by Matthias Rieber 10 Mar '13

10 Mar '13

Hi, I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in a virtual folder dovecot crashes. Here's the stacktrace: http://pastebin.com/urSDDzku Regards, Matthias

4 11

Re: [Dovecot] Changin password in LDAP
by Steffen Kaiser 07 Mar '13

07 Mar '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 20 Feb 2013, Arto Saraniva wrote: > We are using now dovecot 2.0.21 with open-ldap, but this situations has > already taken a quite long time. When user changes the password, we have > to reload dovecot every time, otherwise the change is ignored and > dovecot sees only the old password. Any ideas where the problem might > exist? does this help? http://wiki2.dovecot.org/Authentication/Caching?highlight=(auth_cache_ttl) - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUSTb2l3r2wJMiz2NAQLp3gf8DM2xCn03yWoVrCjbYNZeflBNRLbD67gE zqvrKUOqkyyDbUl1lgNcJOG39MI2eZpbDXzyWZ8nzzCnPKGOF2mNN76vPGmf6ZrR AQ0EaiJaYRoE14BQykQGvBSnoXgcyW0Ue4Z2RcmIS0iILfGN+VODDKc9PitC99Rc RJb6dQPft3FLM3oWca6BI1OkUuIF9EJcK3M4ROwr84s+OAs/6rkxIDgCCIdh5JZ5 svOkUxVE38zod+Det3yBuoWo5HOXYiE9Qi9jKn8xjQl8a06snXRuw1QktsyLKLjc 64T7KFa5IfXaVzOXCIWiiPiN7T0BVJzJ8G1YbHMzFqYkiPNa4NIO2Q== =NDhf -----END PGP SIGNATURE-----

2 1

[Dovecot] Broken physical size caching in Dovecot 2.1.10
by Rob Redpath 06 Mar '13

06 Mar '13

Hi, I'm encountering two, probably related, errors in my Dovecot 2.1.10 install. The issue relates to compressed email stored in Maildir format directories. In some cases, a mailbox will become inaccessible, and the following will be logged from a doveadm fetch:- doveadm(info(a)example.com): Error: Corrupted index cache file /var/spool/virtual_mail/info_example.com_d/dovecot.index.cache: Broken physical size for mail UID 2777 doveadm(info(a)example.com): Error: Cached message size smaller than expected (18996 < 64624) doveadm(info(a)example.com): Error: Maildir filename has wrong S value, renamed the file from /var/spool/virtual_mail/info_example.com_d/cur/1277451630.H877760P14612.mailserver.example.com,S=18996:2,Z to /var/spool/virtual_mail/info_example.com_d/cur/1277451630.H877760P14612.mailserver.example.com,S=18996:2,Z Interestingly, the file mentioned in the error ( /var/spool/virtual_mail/info_example.com_d/dovecot.index.cache ) doesn't exist. The uncompressed size of the file is 64624 bytes, the compressed size is 18996. My attempts to debug the issue myself didn't get very far - the function that appears to return the wrong value is in /src/lib-storage/index/maildir/maildir-mail.c in the 2.1.13 source; it's do_fix_size() and appears to not consider whether a file is compressed or not when reporting it's size for S= value purposes. Can anyone help? I'm happy to provide parts of dovecot -n output if required, but I'd rather not post configuration in a public forum if it's not required. -- Rob Redpath Systems Administrator Heart Internet Ltd E: rob.redpath(a)heartinternet.co.uk DDI: 0115 845 6643 www.heartinternet.co.uk<http://www.heartinternet.co.uk> ****************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you are not the intended recipient you are not authorised to and must not disclose, copy, distribute, or retain this message or any part of it. Heart Internet Ltd accepts no responsibility for information, errors or omissions in this email. ******************************************************************

3 13

[Dovecot] Suggestions for upgrading dovecot 1.0.7 Redhat EL 5.x
by Götz Reinicke - IT Koordinator 06 Mar '13

06 Mar '13

Hi, we still have our solid rock dovecot 1.0.7 Redhat el 5.x up and running. We don't need much magic or special setups. However we'd like to think what might be the next step in upgrading our setup. Each user one mbox mailbox. About 500 imap/pop3 accounts, 400GB data. First of all: to what version is a good step from 1.0? Can we get a rpm from e.g. atrpms repository? Dose anyone has any experiences in doing such a "big" step forward? Or should we think of migrating to a total updated Redhat EL 6.x / Dovecot 2.0.x system? Any suggestions and comments are welcome. Regards . G. Reinicke -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82 420 Fax +49 7141 969 55 420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt

4 7

[Dovecot] lmtp problem with wrong index path
by Dimos Alevizos 05 Mar '13

05 Mar '13

Hello, we've been using dovecot for pop3 and imap for some time now and we're in the middle of deploying lmtp as well, however we're run into a problem we can't solve. Specifically for some reason it seems that dovecot tries to write to the wrong index file during some, but not all, lmtp deliveries. If lmtp tries to deliver to person user_a@domain, sometimes it'll try to write to index directory user_b@domain using user_a euid. We haven't found and pattern in the problem. A user may receive multiple mails with only 1 in 20 or more deliveries having problems. The only things that we know is that user_b (the wrong one) is always from the same domain as the correct user and always (so far) also a recipient in the same mail. Feb 25 09:07:01 pop02 dovecot: lmtp(20931, sub1ika(a)ika.gr): Error: stat(/indexes/2/b/0/diefecon.log(a)ika.gr/.imap/INBOX/dovecot.index.log) failed: Permission denied (euid=10054601(<unknown>) egid=165(<unknown>) missing +x perm: /indexes/2/b/0/diefecon.log(a)ika.gr, dir owned by 10107819:165 mode=0700) Feb 25 09:07:01 pop02 dovecot: lmtp(20931, sub1ika(a)ika.gr): Error: nfs_flush_chown_uid: stat(/indexes/2/b/0/diefecon.log(a)ika.gr/.imap/INBOX) failed: Permission denied Feb 25 09:07:01 pop02 dovecot: lmtp(20931, sub1ika(a)ika.gr): Error: stat(/indexes/2/b/0/diefecon.log(a)ika.gr/.imap/INBOX/dovecot.index) failed: Permission denied (euid=10054601(<unknown>) egid=165(<unknown>) missing +x perm: /indexes/2/b/0/diefecon.log(a)ika.gr, dir owned by 10107819:165 mode=0700) Feb 25 09:07:01 pop02 dovecot: lmtp(20931, sub1ika(a)ika.gr): T8WxCGwHK1HDUQAAB7uMaw: msgid=<542C6CCE00F7433B9F5E0860C32F87FE@sofia>: save failed to INBOX: Timeout while waiting for lock As you can see below it seems that failure to write to the index doesn't stop the mail being delivered. Feb 25 10:47:36 pop08 dovecot: lmtp(19139, d.lefkona(a)kep.gov.gr): Error: stat(/var/index/dovecot/4/c/6/d.irakleias-serron(a)kep.gov.gr/.imap/INBOX/dovecot.index.log) failed: Permission denied (euid=10096573(<unknown>) egid=165(<unknown>) missing +x perm: /var/index/dovecot/4/c/6/d.irakleias-serron(a)kep.gov.gr, dir owned by 10096925:165 mode=0700) Feb 25 10:47:36 pop08 dovecot: lmtp(19139, d.lefkona(a)kep.gov.gr): Error: stat(/var/index/dovecot/4/c/6/d.irakleias-serron(a)kep.gov.gr/.imap/INBOX/dovecot.index) failed: Permission denied (euid=10096573(<unknown>) egid=165(<unknown>) missing +x perm: /var/index/dovecot/4/c/6/d.irakleias-serron(a)kep.gov.gr, dir owned by 10096925:165 mode=0700) Feb 25 10:47:36 pop08 dovecot: lmtp(19139, d.lefkona(a)kep.gov.gr): ua0ANmIeK1HDSgAADehEhg: sieve: msgid=<E299E69CBA0EFA4C9870A944ACBC4DCC03AA9C3F(a)SYZ3MAIL01.exchange.n3.syzefxis.gov.gr>: stored mail into mailbox 'INBOX' Our current setup is 3 directors (dovecot 2.1.12) proxying pop3/imap and lmtp to a farm of 8 dovecot servers (all of them 2.1.15). All of our mailboxes are stored in NFS. A seperate farm of postfix MX servers will be responsible to send mails via lmtp to our directors. Currently we're keeping dovecot indexes locally but we're beginning to move them to NFS as well (we've changed 2 of the 8 servers and hopefully today the 6 remaining) Our configuration is : # 2.1.15: /opt/dovecot-2.1.15/etc/dovecot/dovecot.conf # OS: Linux 2.6.18-92.1.22.el5 x86_64 CentOS release 5.9 (Final) auth_cache_negative_ttl = 10 mins auth_cache_size = 5 M auth_cache_ttl = 10 mins auth_verbose = yes default_client_limit = 5000 default_process_limit = 500 disable_plaintext_auth = no first_valid_uid = 20 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = OTENET ready login_trusted_networks = 83.235.66.0/24 mail_access_groups = mail otemail disk root mail_fsync = always mail_location = mbox:INDEX=/var/index/dovecot/%1Mu/%2.1Mu/%3.1Mu/%u mail_nfs_index = yes mail_nfs_storage = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify mbox_lock_timeout = 3 secs mbox_read_locks = dotlock fcntl mmap_disable = yes passdb { args = /opt/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { quota = dirsize:User quota quota_warning = storage=95%% quota-warning 95 %u sieve = ~/.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags } postmaster_address = postmaster(a)otenet.gr quota_full_tempfail = yes service auth-worker { user = dovenull } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { client_limit = 1 inet_listener lmtp { port = 24 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service quota-warning { executable = script /opt/dovecot/etc/dovecot/quota-warning.sh user = dovecot } ssl = no userdb { args = /opt/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve quota" } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 100 } protocol pop3 { mail_max_userip_connections = 100 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_lock_session = yes pop3_reuse_xuidl = yes pop3_uidl_format = %08Xu%08Xv } [root@pop02 ~]# egrep -v "^#|^$" /opt/dovecot/etc/dovecot/dovecot-ldap.conf.ext hosts = 62.103.147.203 dn = "cn=*****,ou=people,dc=otenet,dc=gr" dnpass = ***** base = ou=people,dc=otenet,dc=gr scope = onelevel user_attrs = folderPath=home,mailQuota=quota_rule=*:storage=%$M,uidNumber=uid,gidNumber=gid,mailPath=mail=mbox:~/:INBOX=%$:INDEX=/indexes/%1Mu/%2.1Mu/%3.1Mu/%u user_filter = (&(|(objectClass=otenetMailAccount)(objectClass=otenetservices))(|(uid=%u)(mail=%u)(mailAlternateAddress=%u))) pass_attrs = mail=user,userpassword=password pass_filter = (&(|(objectClass=otenetMailAccount)(objectClass=otenetservices))(|(uid=%u)(mail=%u)(mailAlternateAddress=%u))) default_pass_scheme = CRYPT Dimos Alevizos

4 7

[Dovecot] Migration from v1 to v2 with hashed directory structure
by Pavel Dimow 05 Mar '13

05 Mar '13

Hi, I want to upgrade to version 2 but I would like to solve a long standing problem with 'flat' directory structure ie we have /var/spool/vmail/mydomain.com/user(a)mydomain.com and I want a new server with version 2 to have hashed directory structure like /var/spool/vmail/mydomain.com/u/s/user I was wondering it f there is some better solution then dir hashing or a way to hash a dir other then first two letters. Also any suggestion how to perform this migration from old to new server with hashing on the fly? Thanks in advance.

4 5

[Dovecot] v2.2.rc2 released
by Timo Sirainen 02 Mar '13

02 Mar '13

http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc2.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc2.tar.gz.sig Looks like the last changes I did today just before rc1 release made it just about unusable. This one is actually running on my servers. :)

5 8

[Dovecot] how to talk with doveadmin unix socket
by Piotr Rotter 01 Mar '13

01 Mar '13

Hello, I would like to get mailbox quota by doveadm unix socket (/var/run/dovecor/doveadm-server). I get from strace syntax of comunication: write(9, "VERSION\t1\t0\nUSER\t1\tpiotr.rotter(a)active24.pl\tservice=doveadm\n", 60) = 60 read(9, "VERSION\t1\t1\nSPID\t20805\n", 8192) = 23 read(9, "USER\t1\tpiotr.rotter@active24.pl\temail=piotr.rotter@active24.pl\tclear=7T33z456\thome=/vm/08/A/active24.pl/piotr.rotter/\tuid=502\tgid=502\tquota_rule=*:storage=2097152000B\tquota_rule2=*:messages=50000\n", 8169) = 196 and I wrote super simple client in php: <?php $sock = stream_socket_client('unix:///var/run/dovecot/doveadm-server', $errno, $errstr); fwrite($sock, "VERSION\t1\t0\nUSER\t1\tpiotr.rotter(a)active24.pl\tservice=doveadm\n"); echo fread($sock, 4096)."\n"; echo fread($sock, 4096)."\n"; fclose($sock); ?> But i get only "+" sign and line in errorlog as below: 2013-02-28T00:39:56.377437+01:00 kurier9 dovecot: doveadm: Error: doveadm client not compatible with this server (mixed old and new binaries?) I would be very grateful for your help with this problem, what I doing wrong. My current dovecot version is 2.1.13

4 7

[Dovecot] postfix, dovecot, samba, winbind
by Denis Witt 01 Mar '13

01 Mar '13

Hello List, we're currently working on the migration of our LDAP/Samba3-Domain to Samba4-Active-Directory. So far everything works fine. Postfix can deliver Mails using ProxyAddresses-Information from the AD and Dovecot delivers the mail. Unfortunately when Postfix tells Dovecot to deliver the mail he submit the username without the AD-Domain part: Feb 28 17:17:59 tpdc postfix/pickup[30396]: 5DDAE2C0C2B: uid=0 from=<root> Feb 28 17:17:59 tpdc postfix/cleanup[30402]: 5DDAE2C0C2B: message-id=<20130228161759.5DDAE2C0C2B(a)mx0.concepts-and-training.de> Feb 28 17:17:59 tpdc postfix/qmgr[30395]: 5DDAE2C0C2B: from=<root(a)concepts-and-training.de>, size=463, nrcpt=1 (queue active) Feb 28 17:17:59 tpdc dovecot: lda(dwitt): msgid=<20130228161759.5DDAE2C0C2B(a)mx0.concepts-and-training.de>: saved mail to INBOX Feb 28 17:17:59 tpdc postfix/local[30404]: 5DDAE2C0C2B: to=<dwitt(a)concepts-and-training.de>, orig_to=<denis.witt(a)cat06.de>, relay=local, delay=0.24, delays=0.1/0.01/0/0.13, dsn=2.0.0, status=sent (delivered to command: /usr/lib/dovecot/deliver) Feb 28 17:17:59 tpdc postfix/qmgr[30395]: 5DDAE2C0C2B: removed So Dovecot saves the Mail to "/var/mail/dwitt/", which is fine for me. The Problem kicks in when I try to read my Mail. Dovecot uses "TESTDOM\dwitt" as username and so he didn't find the Mailbox and create a new one in "/var/mail/TESTDOM\dwitt". I tried to fix it with auth_username_translation and auth_username_format but it doesn't work. Any ideas? Thanks!

2 2

[Dovecot] help needed with dovecot authentication
by peter lawrie 01 Mar '13

01 Mar '13

Hi I have been asked to configure an dedicated rhel6 server for a customer. I did not realise when I took this on how complicated it was going to be! The purpose of the server is to host a group of websites for small businesses. It came with postfix-2.6.6-2.2 dovecot-2.0.9 and mysql-2.1.67-1 I have installed virtualmin 3.98, usermin1.540-1 and horde 5 About a dozen currently inactive websites have been set up, mail is in /home/<domain>/Maildir My problem is that I can telnet to postfix to send and receive emails and can see these within postfix in webmin I have been having many problems getting dovecot to connect successfully to postfix. I have also installed horde 5 which requires to authenticate to an imap server - that is dovecot. This one server is intended to provide all services, so plain authentication is fine. But I can't use /etc/passwd as the users are in virtualmin I tried configuring ssl, with self-certification so the browser interface is https: At the moment I've restored dovecot.conf and conf.d/10-master.conf, 10-auth.conf and 10-mail.conf to their original settings. So an attempt to login through usermin gives me this Feb 28 19:44:19 scotz1 dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Feb 28 19:44:19 scotz1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Feb 28 19:44:19 scotz1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Feb 28 19:44:19 scotz1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Feb 28 19:44:19 scotz1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Feb 28 19:44:19 scotz1 dovecot: auth: Fatal: sql: Configuration file path not given Feb 28 19:44:19 scotz1 dovecot: master: Error: service(auth): command startup failed, throttling Previous to restoring the conf files I was getting this from horde Feb 28 17:55:02 scotz1 dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Feb 28 17:55:02 scotz1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Feb 28 17:55:02 scotz1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Feb 28 17:55:02 scotz1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Feb 28 17:55:02 scotz1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Feb 28 17:55:02 scotz1 dovecot: auth: Debug: auth client connected (pid=25627) Feb 28 17:55:02 scotz1 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011lip=127.0.0.1#011rip=127.0.0.1#011lport=143#011rport=439 54#011resp=dGVzdHNjb3R6LmNvLnVrAHRlc3RzY290ei5jby51awBwYXNzd29yZA== Feb 28 17:55:02 scotz1 dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Feb 28 17:55:02 scotz1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Feb 28 17:55:02 scotz1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Feb 28 17:55:02 scotz1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Feb 28 17:55:02 scotz1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Feb 28 17:55:02 scotz1 dovecot: auth: Debug: passwd(testscotz.co.uk,127.0.0.1): lookup Feb 28 17:55:02 scotz1 dovecot: auth: passwd(testscotz.co.uk,127.0.0.1): unknown user Horde is using mysql for its database, but I don't particularly care what dovecot uses, although it seems sensible to do the same I have created and removed several mysql databases during my attempts to get this to work. I would greatly appreciate some assistance with this as every 'howto' I have found by googling describes different setups and just gets me deeper in the mire! I want an authentication mechanism on this one server that virtualmin users and horde users (same people!) can use for imap mail. I thought I knew what I was doing before I took this one on (I have configured and manage a dozen centos servers), but this one is making my head spin. Yours in hope! Peter Lawrie

6 7