- dovecot - dovecot.org

[Dovecot] prevent dovecot from modifying maildirs
by Felix Rubio Dalmau 11 Aug '13

11 Aug '13

Hi all, Is there any possibility to ask dovecot to write nothing to disk, something like a "read only" state, without shutting it down? I have set up a ZFS+postfix+dovecot mail server, and I need both postfix (postsuper -h ALL) and dovecot (¿?) to stop modifying the disk to create the snapshot to be saved. Does anybody has any idea on how to achieve this? Regards! Felix

5 10

[Dovecot] constant Log synchronization error's
by Kim Bisgaard 10 Aug '13

10 Aug '13

Hi, I am seeing constant "Log synchronization error"s in my logs. See later for an example. This is dovecot 2.2.4, pigeonhole 0.4.1, and postfix 2.10.1 (with mailbox_command = /usr/libexec/dovecot/deliver) on a Fedora 19 system. I am using packages from Atrpms so there are some patches applied - ask for details. The mailboxes have resently been moved from a i386 system. I have tried to manually do "doveadm force-resync" for all users, but the problem persists :-( Here are an example from a user which does not use sieve: 11:45:48 Y dovecot: imap-login: Login: user=<X>, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21531, TLS, session=<XxDNm3XhdAA+xz17> 11:45:52 Y dovecot: imap-login: Login: user=<X>, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21541, TLS, session=<UewQnHXhAwA+xz17> 11:45:54 Y dovecot: imap(X): Error: mdbox /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails: map uidvalidity mismatch (0 vs 1283330954) 11:45:54 Y dovecot: imap(X): Disconnected: Internal error occurred. Refer to server log for more information. [2013-07-14 11:45:54] in=353 out=115680 11:45:54 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/storage/dovecot.map.index 11:45:54 Y dovecot: imap(X): Warning: mdbox /var/mail/X/mdbox/storage: rebuilding indexes 11:45:54 Y dovecot: imap(X): Disconnected: Disconnected in IDLE in=707 out=437806 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/INBOX/Kvitteringer/dbox-Mails/dovecot.index: Ex tension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/INBOX/Kvitteringer/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=9,offset=156 for /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails/dovecot.index: Extensi on header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=13,offset=156 for /var/mail/X/mdbox/mailboxes/Facebook/dbox-Mails/dovecot.index: Extension h eader update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Facebook/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Junk/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Junk/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Drafts/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Drafts/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Archives/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Archives/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap-login: Disconnected (no auth attempts in 1 secs): user=<>, rip=62.199.61.123, lip=192.168.0.5, TLS, session=<dz05nHXh9wA+xz17> 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Archives/2012/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Archives/2012/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap-login: Login: user=<X>, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21548, TLS, session=<bAs5nHXhfgA+xz17> 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Trash/Spam/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Trash/Spam/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap-login: Login: user=<X>, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21552, TLS, session=<zCw7nHXh2AA+xz17> 11:45:55 Y dovecot: imap(X): Connection closed: Connection reset by peer in=118 out=111246 11:45:56 Y dovecot: imap-login: Disconnected (no auth attempts in 1 secs): user=<>, rip=62.199.61.123, lip=192.168.0.5, TLS, session=<Ov9MnHXhgwA+xz17> 11:45:56 Y dovecot: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=62.199.61.123, lip=192.168.0.5, TLS, session=<OK5RnHXhiAA+xz17> 11:45:56 Y dovecot: imap(X): Error: mdbox /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails: map uidvalidity mismatch (0 vs 1283330954) 11:45:56 Y dovecot: imap(X): Disconnected: Internal error occurred. Refer to server log for more information. [2013-07-14 11:45:56] in=353 out=115647 11:45:56 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/storage/dovecot.map.index 11:45:56 Y dovecot: imap(X): Warning: mdbox /var/mail/X/mdbox/storage: rebuilding indexes 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/INBOX/Kvitteringer/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/INBOX/Kvitteringer/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=10,offset=156 for /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=14,offset=156 for /var/mail/X/mdbox/mailboxes/Facebook/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Facebook/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=6,offset=156 for /var/mail/X/mdbox/mailboxes/Junk/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Junk/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=6,offset=156 for /var/mail/X/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Drafts/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Drafts/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Archives/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Archives/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Archives/2012/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Archives/2012/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=6,offset=156 for /var/mail/X/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Trash/Spam/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Trash/Spam/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap-login: Login: user=<X>, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21563, TLS, session=<gs9WnHXhcwA+xz17> 11:45:57 Y dovecot: imap(X): Connection closed: Connection reset by peer in=150 out=111316 11:45:57 Y dovecot: imap-login: Login: user=<X>, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21568, TLS, session=<4y1hnHXhkQA+xz17> 11:46:05 Y dovecot: imap-login: Login: user=<X>, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21574, TLS, session=<+zbNnHXhBAA+xz17> My config is: # dovecot -n # 2.2.4: /etc/dovecot/dovecot.conf # OS: Linux 3.9.9-301.fc19.x86_64 x86_64 Fedora release 19 (Schrödinger’s Cat) ext4 mail_location = mdbox:/var/mail/%u/mdbox mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_subaddress_sep = - } postmaster_address = postmaster(a)alleroedderne.adsl.dk protocols = imap recipient_delimiter = - ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } protocol lda { mail_plugins = " sieve" } Regards, Kim

3 3

[Dovecot] Mailbox Format
by Vijay Rajah 10 Aug '13

10 Aug '13

Hello List, I'm in the process of implementing a new mail server environment from scratch. I was wondering, what mailbox format is recommended? I have been using maildir format for my other projects. I would like to use some format that provides Single Instance Storage. I'm using postfix 2.11 and will use lmtp. I will be using dovecot 2.2.5 (Latest) version. I'm not planning on using NFS (if that matters) and will use dsync to backup mails to another server. Thanks in Advance Vijay Rajah

1 0

Re: [Dovecot] prevent dovecot from modifying maildirs
by Joseph Tam 10 Aug '13

10 Aug '13

> In order to save space I prefer no to have such half-files (mails) , > and it is for this reason that I am asking if there is any way to > prevent this. > > I'm not an expert in field of file systems, so I can be asking very > naive questions... but I appreciate your comments on this topic. Filesystem consistency is different than, for lack of a better term, dovecot consistency. The latter places additional constraints on the content of files, rather than treating them as sequences of disk blocks. I don't think you can ensure the latter without stopping all dovecot processes (and maybe the MTA/LDA as well), which will be much more difficult and disruptive than just taking a snapshot. (I think some snapshot aware application like databases and hypervisors allows the operator to put the application in a state of acquiesence, long enough to take a snapshot, then unblock all processes after the snapshot.) I'd take the suggestion of the previous poster: take snapshots, don't worry, be happy. The small amount of inconsistencies is trivial compared with quickly recovering a mail store after disaster. Joseph Tam <jtam.home(a)gmail.com>

1 0

Re: [Dovecot] How to troubleshoot LDA or LMTP?
by Joseph Tam 10 Aug '13

10 Aug '13

John Williams writes: > *What doesn't work* I thought the next step would be to execute > dovecot-lda manually (as is suggested on the wiki and in numerous > newsgroup posts), but I can't figure out how to do this. When I execute > it as root and provide my non-root username via the -u option, it > hangs. I can see that it spawns a child process that executes as the > non-root user (specified with the -u option). So, could someone tell > how to execute dovecot-lda manually please? Maybe use "-d"? I had no trouble invoking dovecot-lda -c config-file -d user < mailfile If it doesn't work for you, I suggest process tracing it. > Also, when does LMTP process messages? When sending mail via SMTP, or > when reading mail via IMAP? I would prefer to use LMTP rather than > LDA. The former. Joseph Tam <jtam.home(a)gmail.com>

4 6

[Dovecot] execvp /usr/local/libexec/dovecot/dovecot-lda: Permission denied
by Edward Carraro 09 Aug '13

09 Aug '13

I'm trying to follow the instructions for configuring Dovecot LMTP with postfix for virtual domains but whenever mail arrives, in /var/log/maillog, I see Sep 23 16:01:20 mybox postfix/pipe[572]: 999C83206C6: to=< user(a)mytest.domain.com>, relay=dovecot, delay=0.08, delays=0.04/0.01/0/0.03, dsn=4.3.0, status=deferred (temporary failure. Command output: pipe: fatal: pipe_command: execvp /usr/local/libexec/dovecot/dovecot-lda: Permission denied ) ls -lh for /usr/local/libexec/dovecot/dovecot-lda -rwxr-xr-x 1 root staff 62K Sep 20 15:15 dovecot-lda It will deliver mail when I do the sudo invocation of dovecot-lda, but I thought LMTP was suppose to be an alternative to that postfix/main.cf: virtual_transport = dovecot virtual_mailbox_domains = mytest.domain.com dovecot_destination_recipient_limit = 1 /etc/postfix/master.cf: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/local/libexec/dovecot/dovecot-lda -f ${sender} -d ${recipient} /usr/local/etc/dovecot/conf.d/10-master.conf: service auth { unix_listener auth-userdb { mode = 0600 user = vmail #group = vmail } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } inet_listener lmtp { port = 24 } user = vmail } Did I miss something in my config?

7 9

[Dovecot] Getting default uid/gid of users via socket for virtual user support for sendmail
by Steffen Kaiser 09 Aug '13

09 Aug '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I'm trying to make my life easier with sendmail and virtual users. For that I'd like to pass sendmail the home directory and uid/gid for each user. The user data is storred in a LDAP,& I retrieve it from the auth-userdb socket fine. If I add uid / gid to each user, I get them via that socket as well, but is there a way I get the default uid/gid? I mean, without calling an external program, such as doveadm. There is an "initialize" phase, so the default information is retrieved just once per lifetime of the demon, but each time the sendmail binary is invoked. Kind regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUfp2JF3r2wJMiz2NAQL61Af+MuF1BTwaX+Tm+rOWe+smcVUzRmMYZdtL J08wDGNB2EyQ9a0zXwZleO/X3Jvaqr8HSHaC6oTzliS25yqPT4AYG0VVswZoyDTg hggyS9kVse2R1koLZKPAM1EatTmpTsKfUKDjsB3cxbYsBU5NYMJY+u4YATPTl7ui 46K4YmeL4xkKirRXc7j0fIMxdXttuD9zPq20qJ0p41HK2W0ECVHeQpUahozWY45h DREbwdZBZe9PeZNbfOYTLWnxPi1/FK/AX20QH3y3uxEhgMDfYAUHNwAleSCpack5 JEuVYwTPchxsH6uibk62qIsK/uWO3vZM0Zj18S0BBWDNvPhg0Nz92w== =abqh -----END PGP SIGNATURE-----

2 3

[Dovecot] Override master service settigs with spaces
by Ulrich Zehl 08 Aug '13

08 Aug '13

I'd like to override one setting for a master service in conf.d/10-master.conf. Unfortunately, said setting contains spaces, and I do not know how to escape them properly. Here's what I've tried so far. (Note: This is just the easiest/silliest test case I could come up with; not the actual setting or service I want to overwrite.) conf.d/10-master.conf: service quota-status { executable = quota-status -p postfix -o plugin/quota_status_success=Testing 1 2 3 inet_listener { port = 12340 } } Reaction: $ printf "recipient=test(a)example.org\nsize=0\n\n" | nc 127.0.0.1 12340 action=Testing conf.d/10-master.conf: service quota-status { executable = quota-status -p postfix -o "plugin/quota_status_success=Testing 1 2 3" inet_listener { port = 12340 } } Reaction: $ printf "recipient=test(a)example.org\nsize=0\n\n" | nc 127.0.0.1 12340 action=DUNNO [<-- This is the default setting] conf.d/10-master.conf: service quota-status { executable = quota-status -p postfix -o 'plugin/quota_status_success=Testing 1 2 3' inet_listener { port = 12340 } } Reaction: $ printf "recipient=test(a)example.org\nsize=0\n\n" | nc 127.0.0.1 12340 action=DUNNO [<-- This is the default setting] conf.d/10-master.conf: service quota-status { executable = quota-status -p postfix -o plugin/quota_status_success="Testing 1 2 3" inet_listener { port = 12340 } } Reaction: $ printf "recipient=test(a)example.org\nsize=0\n\n" | nc 127.0.0.1 12340 action="Testing [<-- Note the " after = ] conf.d/10-master.conf: service quota-status { executable = quota-status -p postfix -o plugin/quota_status_success=Testing\ 1\ 2\ 3 inet_listener { port = 12340 } } Reaction: $ printf "recipient=test(a)example.org\nsize=0\n\n" | nc 127.0.0.1 12340 action=Testing\ [<-- Note the \ ] I'm out of ideas now. What's the correct way to quote / escape these options?

3 4

[Dovecot] 2.2.5 fails to compile - SSL_OP_SINGLE_ECDH_USE : Solaris 10 + Sunstudio 12.3
by Tomi Vainio 07 Aug '13

07 Aug '13

Hi, Compile fails in these two files src/lib-ssl-iostream/iostream-openssl-context.c src/login-common/ssl-proxy-openssl.c due to missing SSL_OP_SINGLE_ECDH_USE In these there is only #if !defined(OPENSSL_NO_ECDH) when all the other places it always compares also SSL version #if !defined(OPENSSL_NO_ECDH) && OPENSSL_VERSION_NUMBER >= 0x10002000L Tomppa

3 4

[Dovecot] keywords leak in cmd_append_handle_args()
by Mike Abbott 07 Aug '13

07 Aug '13

In 2.2.5 and earlier it appears that mailbox_keywords_unref(&keywords) is not called in some return paths from cmd_append_handle_args(). Should it be?

2 1

[Dovecot] Postfix aliases with quota-status service
by Thomas Leuxner 07 Aug '13

07 Aug '13

The latest HG commits seem to have fixed some underlying problems with the 'quota-status' service. Now doing some quick tests I wonder if this can be used with aliases on the Postfix side. Appears the 'check_policy_service' used in the example below will query existing users via Dovecot's Auth Backend: http://sys4.de/en/blog/2013/04/05/dovecot-quota-mit-postfix-abfragen/ http://www.postfix.org/SMTPD_POLICY_README.html This works fine for Dovecot user 'philo' where the mail is rejected upfront before it enters the queue: ==> /var/log/mail.log <== Jul 30 13:41:18 spectre postfix/smtpd[31072]: NOQUEUE: reject: RCPT from host.example.com[1.2.3.4]: 554 5.2.2 <philo(a)trashheap.net>: Recipient address rejected: Quota exceeded (mailbox for use r is full); from=<user(a)example.com> to=<philo(a)trashheap.net> proto=ESMTP helo=<host.example.com> Now user 'gunge' is an alias for 'philo' in Postfix, thus the quota check will not recognize the user, will queue the message and reject it at the MDA stage: ==> /var/log/mail.log <== Jul 30 14:41:02 spectre postfix/lmtp[31460]: 3c4HSD5ZkBzBP: to=<philo(a)trashheap.net>, orig_to=<gunge(a)trashheap.net>, relay=spectre.leuxner.net[private/dovecot-lmtp], delay=1.2, delays=1.1/0.01/0/0.13, dsn=4.2.2, status=deferred (host spectre.leuxner.net[private/dovecot-lmtp] said: 452 4.2.2 <philo(a)trashheap.net> Quota exceeded (mailbox for user is full) (in reply to end of DATA command)) This is probably intended behaviour, just want to make sure that I'm not missing a point here. For now the only fix that comes to my mind to create "quota aware" aliases - is creating 'dummy' users in Dovecot which point to the same mailbox rather than performing aliasing on the Postfix end. Open to suggestions... Regards Thomas

7 15

Re: [Dovecot] Please HELP: how to delete all messages older than X days from the server?
by Răzvan Sandu 07 Aug '13

07 Aug '13

On Tue, 06 Aug 2013 19:18:15 +0200, Pascal Volk a scris: > There is also the -A option, see > http://wiki2.dovecot.org/Tools/Doveadm/Expunge#section_options Thank you, but doveadm expunge will ask for the mailbox name: [root@mail1 ~]# doveadm expunge -u john.doe(a)example.com ON 2013-08-07 doveadm(root): Fatal: expunge: To avoid accidents, search query must contain MAILBOX in all search branches What I need is to traverse *all* directories under /var/spool/mail/vhosts/domainname/ (which are /var/spool/mail/vhosts/domainname/username, with further variable subdirectories, name never known in advance...) and to delete all messages older than X days (incoming, sent, drafts, trash, etc.) This must be done without manual confirmation ("are you sure...?") (if I do it via a script run from cron). >From the examples given in the wiki page, the expire plugin presents the same problem: one must know in advance the *name of the mailbox* he has to empty. Also for the correct search criteria: should I use SAVEDBEFORE or SENTBEFORE ? Thanks again, Răzvan

2 1

[Dovecot] v2.2.5 released
by Timo Sirainen 06 Aug '13

06 Aug '13

http://dovecot.org/releases/2.2/dovecot-2.2.5.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.5.tar.gz.sig So, I'm back from the first vacation I've had in about 10 years. (Well, maybe there were a few short ones.) I was planning on coding it the whole time, but looks like I didn't manage to get anything at all done. Maybe that's a good vacation?.. Anyway, I've still a few more pending things to look into, but it's been too long since v2.2.4 so here are the fixes so far. + SSL: Added support for ECDH/ECDHE cipher suites (by David Hicks) + Added some missing man pages (by Pascal Volk) + quota-status: Added quota_status_toolarge setting (by Ulrich Zehl) - director: Users near expiration could have been redirected to different servers at the same time. - pop3: Avoid assert-crash if client disconnects during LIST. - mdbox: Corrupted index header still wasn't automatically fixed. - dsync: Various fixes to work better with imapc and pop3c storages. - ldap: sasl_bind=yes caused crashes, because Dovecot's lib-sasl symbols conflicted with Cyrus SASL library. - imap: Various error handling fixes to CATENATE. (Found using Apple's stress test script.)

4 5

[Dovecot] Please HELP: how to delete all messages older than X days from the server?
by Răzvan Sandu 06 Aug '13

06 Aug '13

Hello, Would you please help me solve the following case? My (CentOS) server runs dovecot and allows both POP3 and IMAP service. Users are virtual users (no home directories), with messages stored in Maildir directories under /var/spool/mail/vhosts/example.com/username Some of them use mobile devices (without local storage space), so I must allow IMAP access, not just POP3. But the storage on the server must be for a strictly *limited* period of time. As an admin, I'm trying to force each user to: - download *locally* received messages when they arrive at the office - don't let copies of messages on the server (incoming, sent, trash, drafts, etc.) For various reasons, e-mail client configuration is not under my control (I can't rely on client configuration for implementing this). Implementing filesystem quotas is not an option because a. presently, all virtual users share same UID/GID on the server and b. administrative reasons (the "full quota" situation may occur unexpectedly and this is not tolerable in corporate policy). So I need EITHER: 1. a method of downloading locally *all* messages from the server (incoming, sent, trash, drafts, etc.) to the workstation, when the user consults his/her mailbox from a POP3 desktop client, thus completely *emptying* the user's mailbox on the server OR 2. an automatic, elegant but forceful method of deleting all messages older than X days (incoming, sent, trash, drafts, etc.) I've tried to use a line such as: doveadm expunge -u john.doe(a)example.com before 4w run as root, from a script in crontab, but for "expunge" doveadm won't let me skip the "-u" parameter (to perform the expunge for *all* users). Could you please help? Any sugestion is welcomed. Thanks a lot, Răzvan

2 1

[Dovecot] Using ldap and pam
by Bo Lynch 06 Aug '13

06 Aug '13

Having some issues with ldap logins. I am using Centos 5,dovecot-1.0.13-1.el5.rfx and openldap-servers-2.3.43-25.el5_8.1 Trying to get this to work with the SoGo interface. First I converted all my standard system users to ldap using the openldap-tools. This worked fine, however when a user changes there password they can no longer see there email. If they change it back to the original password mail can be seen. This has stumped me for a day or so so I was hoping someone could shed some light. /etc/dovecot.conf protocols = imap imaps disable_plaintext_auth = no mbox_read_locks = fcntl mbox_write_locks = fcntl protocol imap { } protocol pop3 { } protocol lda { postmaster_address = postmaster(a)example.com } auth default { mechanisms = plain login passdb pam { } passdb ldap { args = /etc/dovecot-ldap.pass } userdb passwd { } user = root user = root socket listen { client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } } dict { } plugin { } /etc/dovecot-ldap.conf hosts = 127.0.0.1:389 sasl_bind = no auth_bind = yes auth_bind = no ldap_version = 3 deref = never dn = cn=sogo,dc=ameliaschools,dc=com dnpass=password base = dc=ameliaschools,dc=com scope = subtree pass_attrs = uid=user, userPassword=password pass_filter = (uid=%u)

3 5

[Dovecot] How to troubleshoot LDA or LMTP?
by John Williams 06 Aug '13

06 Aug '13

Please forgive me if these are silly questions. I am a normal user, not a system administrator. I am using Dovecot as a kind of IMAP caching proxy, i.e. reading IMAP mail via Gnus + Dovecot + Offlineimap. I am trying to enable sieve functionality. *Desired behaviour* When Gnus (or whatever MUA) asks for new mail from Dovecot, that before Dovecot returns and answer, the sieve rules are executed. Please tell me if I completely misunderstand how the mail system works in this instance. *Actual behaviour* As far as I can tell, not only are the sieve rules not executed, but also neither LDA or LMTP is invoked. *What works* Running the scripts manually via `sieve-filter` works fine. The next time I read from my local dovecot server the mail is all in the desired place. Also, the LMTP service is running, listening on port 24. *What doesn't work* I thought the next step would be to execute dovecot-lda manually (as is suggested on the wiki and in numerous newsgroup posts), but I can't figure out how to do this. When I execute it as root and provide my non-root username via the -u option, it hangs. I can see that it spawns a child process that executes as the non-root user (specified with the -u option). So, could someone tell how to execute dovecot-lda manually please? Also, when does LMTP process messages? When sending mail via SMTP, or when reading mail via IMAP? I would prefer to use LMTP rather than LDA. *My environment* Fedora 19 & sendmail. Is any other information relevant, apart from the dovecot configuration? Thank you, John .2.4: /etc/dovecot/dovecot.conf # OS: Linux 3.10.4-300.fc19.x86_64 x86_64 Fedora release 19 (Schrödinger’s Cat) auth_socket_path = /var/run/dovecot/auth-userdb debug_log_path = /var/log/dovecot-debug.log disable_plaintext_auth = no hostname = falcon.novoalexandrovsk.ru info_log_path = /var/log/dovecot-info.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_greeting = Dovecot ready, folks! mail_access_groups = mail mail_debug = yes mail_location = mbox:~/mail/mailboxes:DIRNAME=mBoX-MeSsAgEs:INDEX=~/mail/index:CONTROL=~/mail/control:INBOX=/var/spool/mail/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/lib/dovecot/sieve/global/ sieve_global_path = /var/lib/dovecot/sieve/default.sieve } postmaster_address = johnfrombluff(a)gmail.com protocols = imap lmtp sieve service auth { unix_listener auth-userdb { mode = 0600 user = mail } } service lmtp { executable = lmtp -L inet_listener lmtp { address = 192.168.0.101 127.0.0.1 ::1 port = 24 } user = mail } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 10 } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } protocol lmtp { info_log_path = /var/log/dovecot-lmtp-info.log log_path = /var/log/dovecot-lmtp-debug.log mail_plugins = " sieve" } protocol lda { info_log_path = /var/log/dovecot-lda-info.log log_path = /var/log/dovecot-lda-errors.log mail_plugins = " sieve" } protocol sieve { mail_max_userip_connections = 10 managesieve_implementation_string = Dovecot Pigeonhole, Asshole! managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 }

3 2

[Dovecot] The "<" sign in config files
by Frank Elsner 06 Aug '13

06 Aug '13

Hallo experts, what is the meaning of the "<" sign in config files as in ssl_key = </etc/pki/tls/private/dovecot.key ^ | ? --Frank Elsner

2 1

[Dovecot] dovecot, spamassasin and lmtp
by alfdc 06 Aug '13

06 Aug '13

Hi, Ok, so I got rid of my procmail in favor of dovecot lmtp as my MDA. However, I lost the ability to tag the emails as SPAM or not. Before, this is done by procmail. Filtering is done by the Evolution client. Is there a way to do something similar now? I still want my filtering to be done by the Evolution. So I need something similar what procmail is doing i.e. altering the email header and putting some tag on it if it is a SPAM. Thanks. -- View this message in context: http://dovecot.2317879.n4.nabble.com/dovecot-spamassasin-and-lmtp-tp43709.h… Sent from the Dovecot mailing list archive at Nabble.com.

3 5

[Dovecot] script to test CATENATE
by Mike Abbott 06 Aug '13

06 Aug '13

Attached please find a perl script which tests the CATENATE support in dovecot. I used this to test my CATENATE implementation a few years ago and it runs fine against dovecot in OS X Server. When run against dovecot-2.2.4 though it always fails or hangs, which in some cases means we interpreted RFCs differently and in other cases means it's finding bugs; both conditions are worthy of scrutiny. (It's random-number driven so every run is different.) A couple months ago I reported a few simple bugs which this script found and you fixed them; thanks. Then it started finding problems for which it's harder to isolate simple reproducible test cases. Vacations and other work interceded but now Apple is pleased to give you the script itself to allow you to iterate faster. Here are some examples of it running. One time only, pass the --init argument to store some template messages used by the real tests: $ ./catenate.pl --host your.test.server --user testuser --password 1234 --init connecting (imaps)... capability... logging in... deleting old templates mailbox... creating templates mailbox... append1... Append succeeded append2... Append succeeded logout... success $ ./catenate.pl --host your.test.server --user testuser --password 1234 connecting (imaps)... capability... logging in... append1... Append failed as it should have (bad url): <append1 NO [BADURL ;invalid;] Invalid IMAP URL: Unexpected IMAP URL path segment: `;invalid;'.> append2... Append failed as it should have (bad url): <append2 NO [BADURL /inbox/;uid=99999999] Message not found.> append3... Append succeeded [...] All tests passed. $ If it concludes with anything other than "All tests passed" or hangs then it found something that it didn't expect and that should be examined. Use the --verbose option to see the entire client-server conversation. We hope that you find this script helpful to harden your CATENATE code. I will be happy to answer any questions.

3 5

[Dovecot] problems with expire plugin
by Felix Rubio Dalmau 06 Aug '13

06 Aug '13

Hi all, I'm experiencing problems to set-up the expire plugin in dovecot. This is the relevant part of my dovecot configuration dict { expire = mysql:/etc/dovecot/dovecot-dict-expire.conf.ext } plugin { expire = Trash 15 Junk 15 expire_dict = proxy::expire } protocol imap { mail_plugins = quota zlib expire imap_quota } File dovecot-dict-expire.conf.ext looks like: connect = host=127.0.0.1 dbname=virtual_email user=<user> password=<passw> map { pattern = shared/expire/$user/$mailbox table = virtual_expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } } and the mysql schema for table virtual_expires is: +--------------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +--------------+--------------+------+-----+---------+-------+ | username | varchar(75) | NO | PRI | NULL | | | mailbox | varchar(255) | NO | PRI | NULL | | | expire_stamp | int(11) | NO | | NULL | | +--------------+--------------+------+-----+---------+-------+ However, when I delete any mail from the Inbox, the table is not updated, and there are no messages in the log, although mail_debug is set to "yes" Does anybody has any idea on how to solve this issue? Regards! Felix

3 9

[Dovecot] Corrupted mboxes with v2.2.4, posix_fallocate and GFS2
by Francesco Prelz 05 Aug '13

05 Aug '13

Hi, on a clustered Dovecot server installation that was recently moved from a shared GPFS filesystem to GFS2, occasional corruptions in the users' INBOXes started appearing, where a new incoming message would be appended directly after a block of NUL bytes, and be scanned by dovecot as being glued to the preceding message. I traced this to the file extension operation performed in mbox_sync_handle_eof_updates, where the 'file_set_size' call is used. If available, file_set_size will use the posix_fallocate call. In GFS2 posix_fallocate increases the file size in 4 kB chunks (there seems to be no guarantee anyway that posix_allocate will extend a file by the exact size requested). After a successful posix_fallocate call, mbox_sync_handle_eof_updates currently proceeds in rewriting the mailbox starting from the originally intended 'file_size': 1306 if (file_set_size(sync_ctx->write_fd, 1307 file_size + -sync_ctx->space_diff) < 0) { 1308 mbox_set_syscall_error(sync_ctx->mbox, 1309 "file_set_size()"); 1310 if (ftruncate(sync_ctx->write_fd, file_size) < 0) { 1311 mbox_set_syscall_error(sync_ctx->mbox, 1312 "ftruncate()"); 1313 } 1314 return -1; 1315 } 1316 mbox_sync_file_updated(sync_ctx, FALSE); 1317 1318 if (mbox_sync_rewrite(sync_ctx, mail_ctx, file_size, 1319 -sync_ctx->space_diff, padding, 1320 sync_ctx->need_space_seq, 1321 sync_ctx->seq) < 0) 1322 return -1; When posix_fallocate extends the mailbox beyond the requested 'file_size', a variable size block of NUL bytes is left behind at the tail of the mailbox, with the side effects described above. I successfully worked around this issue by undefining HAVE_POSIX_FALLOCATE, as the performance penalty with falling back to direct block appends seems small. At least a size check (and possible truncation) after the mbox_sync_file_updated call above should probably be added. I thought that the issue would be anyway worth bringing to your attention. Thanks. Francesco Prelz INFN - Sezione di Milano

2 2

[Dovecot] problems with doveadm
by listserv 05 Aug '13

05 Aug '13

Hello, since few weeks i have problems with the command: doveadm expunge -A mailbox Trash savedbefore 7d => kernel: doveadm[11609]: segfault at 10 ip b75f146a sp bf856ad0 error 4 in libdovecot.so.0.0.0[b7585000+c8000] but for a single user it's works fine: doveadm expunge -u test(a)vtlx.de mailbox Trash savedbefore 30h doveconf -n # 2.2.4 (f16816a69130): /etc/dovecot/dovecot.conf # OS: Linux 3.2.45.stk32 i686 Debian jessie/sid ext3 I hope there is a solution for this. with regards Mario -- 中華人民共和國

3 8

[Dovecot] attachments not with email causing FETCH BODY[] failed
by Anand Kumria 05 Aug '13

05 Aug '13

Hi, Anyone else experiencing this (Dovecot 2.2.4, attachments stored separately): dovecot: imap(user(a)kamdha.com): Error: file_istream.open(/home/ example.com/user/attachments/f5/f0/f5f0f2c08c4311fa404d090a703c3b492f2ea718…) failed: No such file or directory dovecot: imap(user(a)example.com): Error: read(BODY[]) failed: No such file or directory (FETCH for mailbox INBOX UID 42501) dovecot: imap(user(a)example.com): Disconnected: FETCH failed in=186 out=86389 My dovecot.conf attachment related config is: mail_attachment_dir = /home/%d/%n/attachments mail_attachment_min_size = 128k mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} So, questions: - anyone else experiencing this? - how might this occurred? - what is the best way to find the corrupted message? - how should I go about fixing this? Any help or pointers would be appreciated. Thanks, Anand

3 4

[Dovecot] Passing data safely in password_key?
by Attila Nagy 05 Aug '13

05 Aug '13

Hi, I would like to convert my custom POP/IMAP proxy to Dovecot's. In this proxy I do more than giving back user name, password and the host and I need extra information. Luckily all of them are available as variables, but more than one comes as user input (like user name and cleartext password) and I'm not sure how to pass them safely. Obviously I would need a separator, which is guaranteed not to show up either in user name and the cleartext password. Should I use escape (%E) here, or is there a better way?

2 4

[Dovecot] ACL not copied to new mailboxes
by Markus Weippert 05 Aug '13

05 Aug '13

Hi, I had some trouble with ACLs not being copied to new child mailboxes in dovecot 2.2.4. It doesn't matter whether it's a private, shared or public mailbox I create the folder in, the ACLs just seems to be ignored. Anyway, I debugged the executable and came up with the attached patch. Since I'm not a developer, I'm not 100% sure about this but it works for me now. Regards, Markus # dovecot --build-options Build options: ioloop=epoll notify=inotify ipv6 openssl io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail SQL drivers: mysql Passdb: checkpassword ldap pam passwd passwd-file shadow sql Userdb: checkpassword ldap nss passwd prefetch passwd-file sql # doveconf -n # 2.2.4: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-48-generic x86_64 Ubuntu 12.04.2 LTS auth_cache_negative_ttl = 5 mins auth_cache_size = 10 M auth_cache_ttl = 1 mins auth_debug = yes auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes first_valid_gid = 122 first_valid_uid = 114 imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags last_valid_gid = 122 last_valid_uid = 114 mail_debug = yes mail_gid = vmail mail_plugins = acl mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { alias_for = hidden = yes inbox = no list = no location = prefix = INBOX. separator = . type = private } namespace { list = children location = maildir:/var/vmail/public/%d:LAYOUT=fs prefix = Public/ separator = / subscriptions = no type = public } namespace { list = children location = maildir:/var/vmail/mail/%%d/%%n:INDEX=~/shared/%%d/%%n prefix = Shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/auth/%s.master driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/var/vmail/acls:cache_secs=300 acl_shared_dict = file:/var/vmail/mail/shared-mailboxes.db sieve = ~/dovecot.sieve sieve_after = /var/vmail/sieve/after sieve_before = /var/vmail/sieve/before sieve_default = /var/vmail/sieve/default.sieve sieve_dir = ~/sieve sieve_global_dir = /var/vmail/sieve/global } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0777 } } service imap-login { process_min_avail = 10 service_count = 0 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/dovecot.pem ssl_cipher_list = HIGH:!MD5:!eNULL ssl_key = </etc/ssl/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = acl sieve } protocol lda { mail_plugins = acl sieve } protocol imap { mail_plugins = acl imap_acl }

2 1