- dovecot - dovecot.org

[Dovecot] v2.1.11 released
by Timo Sirainen 30 Nov '12

30 Nov '12

http://dovecot.org/releases/2.1/dovecot-2.1.11.tar.gz http://dovecot.org/releases/2.1/dovecot-2.1.11.tar.gz.sig * lmtp/lda: dovecot.index.cache file is no longer fully mapped to memory, allowing mail deliveries to work even if the file is huge. * auth: userdb passwd lookups are now done by auth worker processes instead of auth master process (as it was documented, but accidentally didn't work that way). + lmtp: lmtp_rcpt_check_quota=yes setting checks quota on RCPT TO. - lmtp: After successful proxying RCPT TO, the next one to a nonexistent user gave tempfail error instead of "user not found". - lmtp proxy: Fixed hanging if remote server was down. - imap: Fixed crash when SEARCH contained multiple KEYWORD parameters. - doveadm: Various fixes to handling doveadm-server connections. - -i <instance name> parameter for Dovecot tools didn't work correctly. - director was somewhat broken in v2.1.10. This version also includes various reliability enhancements. - auth: passdb imap was broken in v2.1.10.

2 1

Re: [Dovecot] Tcpflow capture
by Daniel L. Miller 30 Nov '12

30 Nov '12

On 11/29/2012 9:32 PM, Daniel L. Miller wrote: > > I (hopefully) fixed my config - put 'zlib' into 10-mail.conf and > removed it from the others. Re-indexing is now good on some mailboxes > that were broken before - but I still have a fault on others. > Using the tcpflow dump, I found a couple bad messages that I didn't care about storing - so I deleted them. Then, after no change - I remembered to do a "compact" in my MUA. That cleared up one mailbox - then dovecot complained about various errors & corruption on another mailbox. So I'll start a new thread for that as it looks like the solr interface is now good! -- Daniel

2 2

[Dovecot] mdbox corruption
by Daniel L. Miller 30 Nov '12

30 Nov '12

Trying to clean up the last of the corruption caused by my own stupidity. I now have two mailboxes for one user that give errors such as: doveadm(fax(a)amfes.com): Error: zlib.read(/var/mail/amfes.com/fax/mdbox/storage/m.9): gz trailer has wrong CRC value at 20065618 doveadm(fax(a)amfes.com): Error: read(/var/mail/amfes.com/fax/mdbox/storage/m.9) failed: Invalid argument (uid=238) doveadm(fax(a)amfes.com): Error: zlib.read(/var/mail/amfes.com/fax/mdbox/storage/m.9): corrupted data at 20145217 [...] doveadm(fax(a)amfes.com): Error: read(/var/mail/amfes.com/fax/mdbox/storage/m.20) failed: Invalid argument (uid=5155) doveadm(fax(a)amfes.com): Error: zlib.read(/var/mail/amfes.com/fax/mdbox/storage/m.20): corrupted data at 24779604 doveadm(fax(a)amfes.com): Error: Cached message size smaller than expected (1259 < 1260) doveadm(fax(a)amfes.com): Error: Corrupted index cache file /var/mail/amfes.com/fax/mdbox/mailboxes/INBOX/2010/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 5158 'doveadm force-resync' does not appear to fix these. There appear to be only the two mdbox files affected and I see about 40 errors. I would prefer to salvage as much as possible of these. What options do I have? Do a dsync to another location and take whatever I get? -- Daniel

2 1

Re: [Dovecot] Tcpflow capture
by Daniel L. Miller 30 Nov '12

30 Nov '12

On 11/29/2012 12:49 PM, Timo Sirainen wrote: > On 29.11.2012, at 18.06, Daniel L. Miller wrote: > >> On 11/28/2012 10:37 PM, Timo Sirainen wrote: >>> On 29.11.2012, at 7.47, Daniel L. Miller wrote: >>> >>>>> doveadm fetch text -u amiller(a)amfes.com mailbox-guid a47e4e264aa1c94cc35100003bc41c5f uid 12891 >>>>> >>>> The result of that, when adding a "> test", generates a 11 byte file. >>>> >>>> Hexedit shows me that as: >>>> 74 65 78 74 3A 0A 1F 8B 08 0C 0A >>>> >>>> Otherwise a simple 'less' give me: >>>> text: >>>> ^_<8B>^H^L >>>> >>>> Does this tell you anything? >>> First of all it tells me that you either have some very corrupted messages in your mailbox, or you have some compressed messages but without zlib plugin enabled. >> 10-mail.conf - mail_plugins = fts fts_solr acl >> 15-lda.conf - mail_plugins = $mail_plugins sieve >> 20-imap.conf - mail_plugins = $mail_plugins zlib imap_acl >> 20-lmtp.conf - mail_plugins = $mail_plugins sieve > OK, so all of the compressed mails will be indexed as garbage. > >> My intent was to be able to read zlib mails, but not write new ones. I may change this to just have zlib in 10-mail and start writing compressed. Unless this is/will cause corruption. > Enabling zlib plugin doesn't enable compression on writing. plugin { zlib_save=yes } is required for that. > I (hopefully) fixed my config - put 'zlib' into 10-mail.conf and removed it from the others. Re-indexing is now good on some mailboxes that were broken before - but I still have a fault on others. -- Daniel

1 0

[Dovecot] cmd-vacation.c:4:17: fatal error: lib.h: No such file or directory && ./configure: line 11410: -lssl: command not found
by Tobias Hachmer 29 Nov '12

29 Nov '12

Hello Timo, Building 2.1.11 was ok, but rebuilding pigeonhole 0.3.3 for dovecot 2.1.11 show up the following errors: checking for dovecot-config in "/usr/lib/dovecot"... /usr/lib/dovecot/dovecot- config ./configure: line 11410: -lssl: command not found checking whether OS supports plugin dependencies... yes configure: creating ./config.status config.status: creating Makefile config.status: creating doc/Makefile config.status: creating doc/man/Makefile config.status: creating doc/example-config/Makefile config.status: creating doc/example-config/conf.d/Makefile config.status: creating doc/rfc/Makefile config.status: creating src/Makefile config.status: creating src/lib-sieve/Makefile config.status: creating src/lib-sieve/plugins/Makefile config.status: creating src/lib-sieve/plugins/vacation/Makefile config.status: creating src/lib-sieve/plugins/subaddress/Makefile config.status: creating src/lib-sieve/plugins/comparator-i-ascii- numeric/Makefile config.status: creating src/lib-sieve/plugins/relational/Makefile config.status: creating src/lib-sieve/plugins/regex/Makefile config.status: creating src/lib-sieve/plugins/imap4flags/Makefile config.status: creating src/lib-sieve/plugins/copy/Makefile config.status: creating src/lib-sieve/plugins/include/Makefile config.status: creating src/lib-sieve/plugins/body/Makefile config.status: creating src/lib-sieve/plugins/variables/Makefile config.status: creating src/lib-sieve/plugins/enotify/Makefile config.status: creating src/lib-sieve/plugins/enotify/mailto/Makefile config.status: creating src/lib-sieve/plugins/notify/Makefile config.status: creating src/lib-sieve/plugins/environment/Makefile config.status: creating src/lib-sieve/plugins/mailbox/Makefile config.status: creating src/lib-sieve/plugins/date/Makefile config.status: creating src/lib-sieve/plugins/spamvirustest/Makefile config.status: creating src/lib-sieve/plugins/ihave/Makefile config.status: creating src/lib-sieve/plugins/editheader/Makefile config.status: creating src/lib-sieve/plugins/vnd.dovecot/Makefile config.status: creating src/lib-sieve/plugins/vnd.dovecot/debug/Makefile config.status: creating src/lib-sieve/plugins/vnd.dovecot/duplicate/Makefile config.status: creating src/lib-sieve-tool/Makefile config.status: creating src/lib-sievestorage/Makefile config.status: creating src/lib-managesieve/Makefile config.status: creating src/plugins/Makefile config.status: creating src/plugins/lda-sieve/Makefile config.status: creating src/sieve-tools/Makefile config.status: creating src/managesieve/Makefile config.status: creating src/managesieve-login/Makefile config.status: creating src/testsuite/Makefile config.status: creating stamp.h config.status: creating dummy-config.h config.status: creating pigeonhole-config.h config.status: executing depfiles commands config.status: executing libtool commands dh_testdir # Add here commands to compile the package. /usr/bin/make make[1]: Entering directory `/home/tobias/pighole_test/dovecot-2.1- pigeonhole-0.3.3' /usr/bin/make all-recursive make[2]: Entering directory `/home/tobias/pighole_test/dovecot-2.1- pigeonhole-0.3.3' Making all in src make[3]: Entering directory `/home/tobias/pighole_test/dovecot-2.1- pigeonhole-0.3.3/src' Making all in lib-sieve make[4]: Entering directory `/home/tobias/pighole_test/dovecot-2.1- pigeonhole-0.3.3/src/lib-sieve' Making all in plugins make[5]: Entering directory `/home/tobias/pighole_test/dovecot-2.1- pigeonhole-0.3.3/src/lib-sieve/plugins' Making all in vacation make[6]: Entering directory `/home/tobias/pighole_test/dovecot-2.1- pigeonhole-0.3.3/src/lib-sieve/plugins/vacation' /bin/bash ../../../../libtool --tag=CC --mode=compile x86_64-linux-gnu-gcc - DHAVE_CONFIG_H -I. -I../../../.. -I./../../ -D_FORTIFY_SOURCE=2 -std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security - Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict- aliasing=2 -MT cmd-vacation.lo -MD -MP -MF .deps/cmd-vacation.Tpo -c -o cmd- vacation.lo cmd-vacation.c libtool: compile: x86_64-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../../../.. - I./../../ -D_FORTIFY_SOURCE=2 -std=gnu99 -g -O2 -fstack-protector --param=ssp- buffer-size=4 -Wformat -Wformat-security -Wall -W -Wmissing-prototypes - Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad- function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -MT cmd-vacation.lo - MD -MP -MF .deps/cmd-vacation.Tpo -c cmd-vacation.c -fPIC -DPIC -o .libs/cmd- vacation.o cmd-vacation.c:4:17: fatal error: lib.h: No such file or directory compilation terminated. make[6]: *** [cmd-vacation.lo] Error 1 make[6]: Leaving directory `/home/tobias/pighole_test/dovecot-2.1- pigeonhole-0.3.3/src/lib-sieve/plugins/vacation' make[5]: *** [all-recursive] Error 1 make[5]: Leaving directory `/home/tobias/pighole_test/dovecot-2.1- pigeonhole-0.3.3/src/lib-sieve/plugins' make[4]: *** [all-recursive] Error 1 make[4]: Leaving directory `/home/tobias/pighole_test/dovecot-2.1- pigeonhole-0.3.3/src/lib-sieve' make[3]: *** [all-recursive] Error 1 make[3]: Leaving directory `/home/tobias/pighole_test/dovecot-2.1- pigeonhole-0.3.3/src' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/home/tobias/pighole_test/dovecot-2.1- pigeonhole-0.3.3' make[1]: *** [all] Error 2 make[1]: Leaving directory `/home/tobias/pighole_test/dovecot-2.1- pigeonhole-0.3.3' make: *** [build-stamp] Error 2 my configure options: ./configure --with-dovecot=/usr/lib/dovecot --prefix=/usr --sysconfdir=/etc -- libexecdir=/usr/lib --localstatedir=/var --mandir=/usr/share/man -- infodir=/usr/share/info --with-moduledir=/usr/lib/dovecot/modules Regards, Tobias Hachmer

2 4

[Dovecot] Missing Messages on IOS device
by David Morsberger 29 Nov '12

29 Nov '12

Resending because I didn't get any responses from my first post: I just converted my old server running UW/Panda to a Mac Mini Server running Mountain Lion (ML) Server. I'm using the postfix / dovecot setup provided by Apple. My IMAP clients are not showing all my emails. The Mail App on my iPhone and iPad is behaving the worse. I can see the emails that are not showing up in the cur directory. The ML Mail App is stating there are 3854 emails in my INBOX. There are 3948 files in the 'cur' directory ('ls cur | wc -l' returns 3948). Other mailboxes and directories have the same behavior. I'm not sure what to expect here. My method of conversion was to bulk copy (drag and drop) all the messages from one the UW server to the Dovecot server using the Apple Desktop Mail App in Mountain Lion. Any idea why these messages are not showing up on my devices and how I can get them to show up? bash-3.2# /Applications/Server.app/Contents/ServerRoot/usr/sbin/dovecotd --version 2.0.19apple1 bash-3.2# /Applications/Server.app/Contents/ServerRoot/usr/sbin/dovecotd -n # 2.0.19apple1: /Library/Server/Mail/Config/dovecot/dovecot.conf # OS: Darwin 12.2.1 x86_64 hfs aps_topic = com.apple.mail.XServer.fc3bb7c3-c8ef-4fe2-aff3-95ecd927fb11 auth_mechanisms = cram-md5 x-plain-submit plain login apop digest-md5 auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %n default_internal_user = _dovecot default_login_user = _dovenull disable_plaintext_auth = no first_valid_gid = 6 first_valid_uid = 6 mail_access_groups = mail mail_location = maildir:/Library/Server/Mail/Data/mail/%u mail_log_prefix = "%s(pid %p user %u): " mail_plugins = quota zlib fts fts_sk managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_size = 200 M passdb { args = /Library/Server/Mail/Config/dovecot/submit.passdb driver = passwd-file pass = yes submit = yes } passdb { driver = od } plugin { fts = sk quota = maildir:User quota quota_warning = storage=100%% quota-exceeded %u sieve = /Library/Server/Mail/Data/rules/%u/dovecot.sieve sieve_dir = /Library/Server/Mail/Data/rules/%u } postmaster_address = postmaster(a)mini.mmpcrofton.com protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { extra_groups = _keytabusers idle_kill = 15 mins unix_listener auth-userdb { user = _dovecot } } service dns_client { unix_listener dns-client { mode = 0600 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } service_count = 0 } service imap { client_limit = 5 process_limit = 200 service_count = 0 } service lmtp { unix_listener lmtp { mode = 0600 } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { client_limit = 5 process_limit = 200 service_count = 0 } service quota-exceeded { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-exceeded.sh unix_listener quota-exceeded { group = mail mode = 0660 user = _dovecot } user = _dovecot } service quota-warning { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-warning.sh unix_listener quota-warning { group = mail mode = 0660 user = _dovecot } user = _dovecot } ssl_ca = </etc/certificates/*.chain.pem ssl_cert = </etc/certificates/*.cert.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!ADH:!eNULL ssl_key = </etc/certificates/*.key.pem ssl_key_path = /etc/certificates/*.key.pem syslog_facility = local6 userdb { args = partition=/Library/Server/Mail/Config/dovecot/partition_map.conf enforce_quotas=no driver = od } verbose_proctitle = yes protocol lmtp { mail_plugins = quota zlib fts fts_sk sieve push_notify } protocol lda { mail_plugins = quota zlib fts fts_sk sieve push_notify } protocol imap { imap_id_log = * imap_id_send = "name" * "version" * mail_max_userip_connections = 20 mail_plugins = quota zlib fts fts_sk imap_quota imap_zlib imap_fts urlauth } protocol pop3 { mail_max_userip_connections = 6 }

3 3

[Dovecot] Problem with mail_location and INDEX location
by Matt Jones 29 Nov '12

29 Nov '12

HI, I'm pulling my hair out a little trying to get dovecot to save it's index locally rather than in the NFS mount. No matter what I do it seems to save the indices in the Maildir on the NFS. I'm using dovecot 2.0.18 on CentOS 6.3. The relevant config I'm using: mmap_disable = no dotlock_use_excl = no # only needed with NFSv2, NFSv3+ supports O_EXCL and it's faster mail_fsync = always mail_nfs_storage = yes mail_nfs_index = no lock_method = dotlock # Mail location and mailbox format. mail_location = maildir:/%Lh/Maildir/:INDEX=/var/indexes/%Ld/%Lu/ Dovecot runs under the user:group vmail:vmail, and the user has write access to those directories. [root@tay var]# ls -al total 96 drwxr-xr-x. 24 root root 4096 Nov 29 09:36 . dr-xr-xr-x. 23 root root 4096 Nov 28 15:26 .. drwxr-x--- 5 amavis amavis 4096 Nov 29 09:21 amavis drwxr-xr-x. 10 root root 4096 Nov 28 15:14 cache drwxr-xr-x. 2 clamav clamav 4096 Nov 29 03:49 clamav drwxr-xr-x. 3 root root 4096 Nov 28 14:21 db drwxr-xr-x. 3 root root 4096 Nov 28 13:35 empty drwxr-xr-x. 2 root root 4096 Sep 23 2011 games drwx------ 2 vmail vmail 4096 Nov 29 10:42 indexes drwxr-xr-x. 25 root root 4096 Nov 28 15:15 lib drwxr-xr-x. 2 root root 4096 Sep 23 2011 local drwxrwxr-x. 5 root lock 4096 Nov 29 03:49 lock drwxr-xr-x. 5 root root 4096 Nov 29 04:10 log lrwxrwxrwx. 1 root root 10 Nov 28 13:34 mail -> spool/mail drwxr-xr-x. 2 root root 4096 Sep 23 2011 nis drwxr-xr-x. 2 root root 4096 Sep 23 2011 opt drwxr-xr-x. 2 root root 4096 Sep 23 2011 preserve drwxr-xr-x. 20 root root 4096 Nov 29 09:51 run drwxr-xr-x. 9 root root 4096 Nov 28 15:14 spool drwxrwxrwt. 3 root root 4096 Nov 29 09:22 tmp drwxr-x--- 2 amavis amavis 4096 Jun 8 15:39 virusmails drwx------. 5 vmail vmail 4096 Nov 29 09:35 vmail drwx------. 3 root bin 4096 Nov 29 09:22 webmin drwxr-xr-x. 12 root root 4096 Nov 28 15:17 www drwxr-xr-x. 2 root root 4096 Sep 23 2011 yp After restarting dovecot, and logging in via imap, I see the following under the Maildir: [root@tay Maildir]# ls -al /var/vmail/vmail1/orphans.co.uk/m/a/t/matt-2011.07.06.09.41.05/Maildir total 56 drwx------ 9 vmail vmail 4096 Nov 29 10:57 . drwx------ 3 vmail vmail 4096 Nov 29 10:17 .. drwx------ 2 vmail vmail 4096 Nov 29 10:41 cur -rw------- 1 vmail vmail 248 Nov 29 10:41 dovecot.index.log -rw------- 1 vmail vmail 120 Nov 29 10:41 dovecot.mailbox.log -rw------- 1 vmail vmail 51 Nov 29 10:41 dovecot-uidlist -rw------- 1 vmail vmail 8 Nov 29 10:41 dovecot-uidvalidity -r--r--r-- 1 vmail vmail 0 Nov 29 10:41 dovecot-uidvalidity.50b73be3 drwx------ 5 vmail vmail 4096 Nov 29 10:41 .Drafts drwx------ 5 vmail vmail 4096 Nov 29 10:41 .Junk drwx------ 2 vmail vmail 4096 Nov 29 10:41 new drwx------ 5 vmail vmail 4096 Nov 29 10:41 .Sent -rw------- 1 vmail vmail 29 Nov 29 10:41 subscriptions drwx------ 2 vmail vmail 4096 Nov 29 10:41 tmp drwx------ 5 vmail vmail 4096 Nov 29 10:41 .Trash [root@tay Maildir]# ls -al /var/indexes/ total 8 drwx------ 2 vmail vmail 4096 Nov 29 10:42 . drwxr-xr-x. 24 root root 4096 Nov 29 09:36 .. Any ideas? Matt

2 1

[Dovecot] Missing quotes in dovecot-config causes pigeonhole to failed.
by nanashi 29 Nov '12

29 Nov '12

I had to manually quote in dovecot-config LIBDOVECOT_LOGIN='-ldovecot-login -lssl -lcrypto ' by default was LIBDOVECOT_LOGIN=-ldovecot-login -lssl -lcrypto That cause pigeonhole to failed. Regards nanashi

2 1

[Dovecot] Shutting down my Dovecot server?
by Bjørn T Johansen 29 Nov '12

29 Nov '12

I am planning to shut down my own Dovecot server and start using the other Dovecot server I am administering together with a friend.. And I was thinking that I don't want to copy the emails I have on my server so I want to start from scratch on the other server.. But I would like to be able to look at the old emails if I need to, so was wondering if there is a way to do this without using an imap server? Can I convert my mails stored in the maildir format to mbox or is there a better way to solve my problem? Regards, BTJ -- ----------------------------------------------------------------------------------------------- Bjørn T Johansen btj(a)havleik.no ----------------------------------------------------------------------------------------------- Someone wrote: "I understand that if you play a Windows CD backwards you hear strange Satanic messages" To which someone replied: "It's even worse than that; play it forwards and it installs Windows" ----------------------------------------------------------------------------------------------- -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.

5 10

Re: [Dovecot] Umask of Homedir
by sobotka karel 29 Nov '12

29 Nov '12

Hi, I know it's a while since you've had this issue, but still do you remember by any chance how you solved this? I'm having the same problems, when all the directories are created with 700 and I need a group permissions to be at least 750. Thanks! regards,

1 0