- dovecot - dovecot.org

[Dovecot] Patch to log the cipher suite used for TLS
by Matthias Scheler 14 Aug '13

14 Aug '13

Hello, the attached patch for Dovecot 2.2.4 improves the logging to include information about the cipher suite used for a TLS connection. Here is an example log line: Aug 13 21:49:55 colwyn dovecot: imap-login: Login: user=<tron>, method=CRAM-MD5, rip=2001:8b0:114:1::2, lip=2001:8b0:114:1::2, mpid=10567, TLS=<TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)>, session=<ZkEhYtrjSgAgAQiwARQAAQAAAAAAAAAC> This will e.g. allow you to find out that mobile phones use rather week cipher suites (128bit keys, no PFS). There is also something else I noticed. If I switch "mutt" (which generated the above log line) from using IMAP on port 143 and "STARTTLS" to use IMAPS on port 993 I get TLS 1.2: Aug 14 07:44:59 colwyn dovecot: imap-login: Login: user=<tron>, method=CRAM-MD5, rip=2001:8b0:114:1::2, lip=2001:8b0:114:1::2, mpid=1156, TLS=<TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)>, session=<0js/suLj9gAgAQiwARQAAQAAAAAAAAAC> Not sure why TLS 1.2 is only used in this case. It might be "mutt" doing that. Kind regards -- Matthias Scheler http://zhadum.org.uk/

2 2

[Dovecot] SA54438
by Timo Sirainen 14 Aug '13

14 Aug '13

http://secunia.com/advisories/54438/ Since I already got 3 private mails about this, here's the same reply for everyone (actually updated, now that I looked at the code): This was a v2.2-only bug. And it isn't really a DoS.. It only caused the one pop3 process to crash in assert, which was handling only the connection that had already disconnected. (Unless you were running a non-recommended configuration with multiple clients per process.) So the only problem it caused was that Dovecot logged an assert error and maybe wrote a core dump.

3 2

[Dovecot] Dovecot security
by Jay Khashan 14 Aug '13

14 Aug '13

Hi, THIS IS URGENT I have Debian Linux machine which I installed as a mail server with postfix, and dovecot. my mail server is setup to use SMTP relay. I currently have ports 143, 995, 25 & SSMTP ports open. in the last few days I have been under attack where email is being sent to fake email address for example xxx(a)evg-mail.org which does not exist in the mysql db. I need to figure out and lock down dovecot, because I believe the attack is some kind of virus /spyware. I need to know what statement in dovecot.conf or main.cf (postfix) I can modify to lock it down. Also open to install software to combat this kind of attack. Let me know what configuration files, info do you need to help out Many Thanks ~Jay

4 3

[Dovecot] HG changes affecting received headers
by Thomas Leuxner 13 Aug '13

13 Aug '13

Let me say this is a rather cosmetic issue, but it appears with the latest commits (around 2.2.5 release) the scheme of 'Received' headers has changed for LMTP: 1) Inet socket: Return-Path: <dfn-adv-bounces(a)dfn-cert.de> Delivered-To: <tlx(a)leuxner.net> Received: from spectre.leuxner.net ([188.138.0.199]) by spectre.leuxner.net (Dovecot) with LMTP id 8AkXDF5cA1LvDgAAZ53dLw for <tlx(a)leuxner.net>; Thu, 08 Aug 2013 10:52:46 +0200 2) UNIX socket: Return-Path: <dfn-adv-bounces(a)dfn-cert.de> Delivered-To: <tlx(a)leuxner.net> Received: from spectre.leuxner.net ([]) by spectre.leuxner.net (Dovecot) with LMTP id q8WuGflcA1I3DwAAZ53dLw for <tlx(a)leuxner.net>; Thu, 08 Aug 2013 10:55:21 +0200 3) Old (Pre 2.2.5) build, UNIX socket: Return-Path: <dfn-adv-bounces(a)dfn-cert.de> Delivered-To: <tlx(a)leuxner.net> Received: from spectre.leuxner.net by spectre.leuxner.net (Dovecot) with LMTP id 8NiKKX0h+lFRIAAAZ53dLw for <tlx(a)leuxner.net>; Thu, 01 Aug 2013 10:51:09 +0200 While it probably should resolve the FQDN in 1) (Postfix does), not sure what it should do with a UNIX socket in 2). Previously as shown in 3) it had none of it... Thomas

2 5

[Dovecot] fail2ban
by Aldo Reset 13 Aug '13

13 Aug '13

hi dovecot filter for fail2ban do not match: dovecot: pop3-login: Aborted login (tried to use disallowed plaintext auth): user=<>, rip=67 dovecot filter: failregex = (?: pop3-login|imap-login): (?:Authentication failure|Aborted login \(auth failed|Aborted login \(tried to use disabled|Disconnected \(auth failed).*rip=(?P<host>\S*),.* bst regards.

2 2

[Dovecot] Can't take user info from an alternate file
by dave＠661.org 13 Aug '13

13 Aug '13

I'm positive I did everything right to get Dovecot to take usernames and passwords from /etc/dovecot/users, but it still goes for /etc/passwd and /etc/shadow. The format of /etc/dovecot/users is "alice:{PLAIN}plaintextpassword" Here's my "doveconf -n": # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-51-virtual x86_64 Ubuntu 12.04.2 LTS auth_debug = yes auth_verbose = yes auth_verbose_passwords = plain hostname = papasmurf.foobar.com listen = * mbox_write_locks = fcntl passdb { args = scheme=PLAIN-MD5 username_format=%n /etc/dovecot/users driver = passwd-file } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0664 user = postfix } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = username_format=%n /etc/dovecot/users driver = passwd-file } I'm using Ubuntu Precise and version 2.0.19 of Dovecot. -- David Griffith dave(a)661.org

2 5

[Dovecot] Disconnected (no auth attempts)
by Eric Broch 12 Aug '13

12 Aug '13

Hello list, I have a user who is not able to 'get' email using the 'Get Mail' option in his Thunderbird Client. The error on the server is the following: [Dovecot] dovecot: imap-login: Disconnected (no auth attempts) : rip 192.168.7.7, lip 192.168.7.12, TLS This user is able to receive mail on his phone, however. What does this error mean? Eric <http://www.dovecot.org/list/dovecot/2012-January/062988.html>

2 1

Re: [Dovecot] Please HELP: how to delete all messages older than X days
by Răzvan Sandu 12 Aug '13

12 Aug '13

Pe 7 Aug 2013 11:35, Timo Sirainen a scris: >> Thank you, but doveadm expunge will ask for the mailbox name: >> >> [root@mail1 ~]# doveadm expunge -u john.doe(a)example.com ON >> 2013-08-07 doveadm(root): Fatal: expunge: To avoid accidents, >> search query must contain MAILBOX in all search branches > > Add: mailbox '*' Thank you, it works! May I use the same wildcard syntax ('*') when configuring the expire plugin? Something like: mail_plugins = $mail_plugins expire plugin { expire = * } or plugin { expire = '*' } ? Best regards, Răzvan

3 2

[Dovecot] Unlock non existent locks
by Thomas Hummel 12 Aug '13

12 Aug '13

Hello Timo, I'm running a single instance of dovecot-2.1.15 on a single host running 8.3-RELEASE-p3 FreeBSD amd64 mailboxes (Maildir), control files and indexes are on NFS (v3,tcp) mail_nfs_storage = yes lock_method = fcntl [didn't touch the following] # Mail index files also exist in NFS. Setting this to yes requires # mmap_disable=yes and fsync_disable=no. mail_nfs_index = yes served by an Isilon s200 node (OneFS 6.5.5.22) procmail delivers in the same location through postfix-2.8.7 The filer shows *a lot* of such messages : 2013-08-02T14:12:29+02:00 <0.5> XXXX-10(id10) /boot/kernel.amd64/kernel: [lkf_delegate.c:2752](pid 46390="kt: dwt3")(tid=101282) dev_local_lkf_unlock(): no lock entry present to unlock for resource: 1:19d5:fdbe ;client: 0xa51cc3f444107 Corresponding file may be a message, a maildir, an index, ... I can experience the same message with a simple fcntl C program which tries to unlock an NFS file without prior locking of it. However, the problem occurs only on a FreeBSD client (I tried the old nfs client and the new (mount_newnfs), not on a 2.6.32-358.11.1.el6.x86_64 CentOS release 6.4 (Final) Linux release. So my guess is that dovecot has some safety mechanism which tries to unlock locked files, maybe after some timeout and that, in the case of a an already unlocked file, the FreeBSD client sends the unlock RPC request to the server anyway whereas the linux client does not, noticing there isn't anything to unlock. Can you help me explaining such a behavior ? Are those "unlock a file with no prior lock" made on purpose or is it a bug ? Would it be an application or a RPC bug ? Can you think of another reason ? Thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Groupe Exploitation et Infrastructure

2 5

[Dovecot] Error: Threading lost Message ID?
by Ralf Hildebrandt 12 Aug '13

12 Aug '13

QUERY: THREAD REFERENCES ISO-8859-1 ALL RESPONSE: [SERVERBUG] Internal error occurred. Refer to server log for more information. [2013-08-09 15:42:34] Aug 9 15:41:48 postamt dovecot: imap(username) tTbs7oPjfACNKs4m: Error: Threading lost Message ID Aug 9 15:42:34 postamt dovecot: imap(username) tTbs7oPjfACNKs4m: Error: Threading lost Message ID What does that mean? WHY has the Message-Id been lost? How can I find out WHICH MAIL caused this? This is the most recent dovecot 2.2.x -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

3 6

[Dovecot] GUID Mismatch Issue
by Jeff Geiger 12 Aug '13

12 Aug '13

Dovecot 2.1.7 While migrating mail from one server (Maildir) to another (mdbox), a config issue caused my dsync to fail on a few accounts. Those accounts received mail on the new server over night and it autocreated new inboxes with new GUIDs. Now dsync wants nothing to do with mirroring between the two (diff GUIDs). Is there a way to fix this? dsync(jeff(a)foo.bar): Error: Mailbox INBOX changed its GUID (0eee4b021dcadd5158550000eed085a1 -> 43f87412a8f00352ac340000be821591) dsync(jeff(a)foo.bar): Error: msg iteration failed: Couldn't open mailbox 0eee4b021dcadd5158550000eed085a1 dsync(jeff(a)foo.bar): Error: Mailbox INBOX changed its GUID (0eee4b021dcadd5158550000eed085a1 -> 43f87412a8f00352ac340000be821591) dsync(jeff(a)foo.bar): Error: Mailbox Trash changed its GUID (0fee4b021dcadd5158550000eed085a1 -> 6300df050ef10352e9350000be821591) dsync(jeff(a)foo.bar): Error: Mailbox Sent changed its GUID (832d1e3663cadd515f5d0000eed085a1 -> 855ef505c0f00352fc340000be821591) I need a way to merge the mailboxes, in either direction, so I can clear out one side and successfully migrate the mail accounts. Any tips or pointers are greatly appreciated.

2 1

[Dovecot] multiple passdbs and auth sockets
by md＠Linux.IT 12 Aug '13

12 Aug '13

I have a few systems which run dovecot 1.x as the authentication backend for Postfix, with multiple auth { } sections like this one, each one with a different passdb and its own socket: auth ldap-10 { passdb ldap { args = /etc/dovecot/dovecot-ldap-10.conf } socket listen { client { path = /var/spool/postfix/private/auth-10 mode = 0666 } } } I need multiple sockets tied to multiple dbs because there are duplicated accounts, but after switching to dovecot 2.1.7 apparently *all* passdbs are checked and dovecot reports this message: Warning: Obsolete setting in /etc/dovecot/conf.d/auth-local.conf.ext:91: add auth_ prefix to all settings inside auth {} and remove the auth {} section completely doveconf shows that all my custom sockets are now part of a single "service auth { }" section, while all the passdbs appear at the top level. How can I update my configuration for dovecot 2.x? -- ciao, Marco

2 1

[Dovecot] Errors in SASL authentication ("attempted master login")
by Grzegorz Staniak 12 Aug '13

12 Aug '13

Hi, I'm using dovecot 2.2.4 (with Postfix 2.8.4) as both the SASL authentication backend and the delivery agent, and I keep getting lines like the following in the dovecot.log from the authentication subsystem: auth: passdb(toshiba1(a)domain,8.8.8.8,master): Attempted master login with no master passdbs (trying to log in as user: plain) The connections come from an old (embedded) mail client in a printer-fax machine. I googled for this specific error, but I only found info about old clients using "user\0user\0pass" string incorrectly during authentication, which caused a problem for earlier, development versions of dovecot. Actually, I recently migrated from 1.2 to 2.2.4 exactly to alleviate this situation, but the errors persist. Is there a way to remove the problem or work around it? Regards, GS -- Grzegorz Staniak <gstaniak [at] gmail _dot_ com>

2 1

[Dovecot] The docs a re a bit weird on "Directory hashing"
by Eliezer Croitoru 12 Aug '13

12 Aug '13

In squid we use a double layer of hashed directories on the FS to allow storage of millions of files. I was reading the "Directory hashing" section but never understood it.. since it's written.. in a way I could not understand. I am using this line: mail_location = maildir:/home/vmail/%d/%n/Maildir/ and I want to migrate to a hash based directory scheme. While trying to understand how that hash will work I stumbled a old thread at: http://www.dovecot.org/list/dovecot/2010-June/049695.html there they used: mail_location=maildir:/buzones/us.es/%1Hu/%2.1u/%n so I assume it should be used like that: mail_location=maildir:/home/vmail/%H/%2.256Hn/%d_%n/Maildir/ or: mail_location=maildir:/home/vmail/%1Mu/%2.1Mu/%d_%n/Maildir/ It's a bit hard to think alone so I hope you can assist me. let say I want to follow the model of squid cache_dir which has: cache_dir aufs /usr/local/squid/var/cache/squid 40000 16 256 And means a two layers cache of max 16 directories on the first layer and 256 directories on the second layer. The above allows millions of files storage and can benefit from all ext4 lower kernel levels of compatibly rather then do stuff on the user-land.. Since I am not 100% sure that the scheme I understood is indeed what I think I assume the above will need a small correction. Eliezer

3 4

[Dovecot] prevent dovecot from modifying maildirs
by Felix Rubio Dalmau 11 Aug '13

11 Aug '13

Hi all, Is there any possibility to ask dovecot to write nothing to disk, something like a "read only" state, without shutting it down? I have set up a ZFS+postfix+dovecot mail server, and I need both postfix (postsuper -h ALL) and dovecot (¿?) to stop modifying the disk to create the snapshot to be saved. Does anybody has any idea on how to achieve this? Regards! Felix

5 10

[Dovecot] constant Log synchronization error's
by Kim Bisgaard 10 Aug '13

10 Aug '13

Hi, I am seeing constant "Log synchronization error"s in my logs. See later for an example. This is dovecot 2.2.4, pigeonhole 0.4.1, and postfix 2.10.1 (with mailbox_command = /usr/libexec/dovecot/deliver) on a Fedora 19 system. I am using packages from Atrpms so there are some patches applied - ask for details. The mailboxes have resently been moved from a i386 system. I have tried to manually do "doveadm force-resync" for all users, but the problem persists :-( Here are an example from a user which does not use sieve: 11:45:48 Y dovecot: imap-login: Login: user=<X>, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21531, TLS, session=<XxDNm3XhdAA+xz17> 11:45:52 Y dovecot: imap-login: Login: user=<X>, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21541, TLS, session=<UewQnHXhAwA+xz17> 11:45:54 Y dovecot: imap(X): Error: mdbox /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails: map uidvalidity mismatch (0 vs 1283330954) 11:45:54 Y dovecot: imap(X): Disconnected: Internal error occurred. Refer to server log for more information. [2013-07-14 11:45:54] in=353 out=115680 11:45:54 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/storage/dovecot.map.index 11:45:54 Y dovecot: imap(X): Warning: mdbox /var/mail/X/mdbox/storage: rebuilding indexes 11:45:54 Y dovecot: imap(X): Disconnected: Disconnected in IDLE in=707 out=437806 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/INBOX/Kvitteringer/dbox-Mails/dovecot.index: Ex tension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/INBOX/Kvitteringer/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=9,offset=156 for /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails/dovecot.index: Extensi on header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=13,offset=156 for /var/mail/X/mdbox/mailboxes/Facebook/dbox-Mails/dovecot.index: Extension h eader update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Facebook/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Junk/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Junk/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Drafts/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Drafts/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Archives/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Archives/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap-login: Disconnected (no auth attempts in 1 secs): user=<>, rip=62.199.61.123, lip=192.168.0.5, TLS, session=<dz05nHXh9wA+xz17> 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Archives/2012/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Archives/2012/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap-login: Login: user=<X>, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21548, TLS, session=<bAs5nHXhfgA+xz17> 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Trash/Spam/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Trash/Spam/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap-login: Login: user=<X>, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21552, TLS, session=<zCw7nHXh2AA+xz17> 11:45:55 Y dovecot: imap(X): Connection closed: Connection reset by peer in=118 out=111246 11:45:56 Y dovecot: imap-login: Disconnected (no auth attempts in 1 secs): user=<>, rip=62.199.61.123, lip=192.168.0.5, TLS, session=<Ov9MnHXhgwA+xz17> 11:45:56 Y dovecot: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=62.199.61.123, lip=192.168.0.5, TLS, session=<OK5RnHXhiAA+xz17> 11:45:56 Y dovecot: imap(X): Error: mdbox /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails: map uidvalidity mismatch (0 vs 1283330954) 11:45:56 Y dovecot: imap(X): Disconnected: Internal error occurred. Refer to server log for more information. [2013-07-14 11:45:56] in=353 out=115647 11:45:56 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/storage/dovecot.map.index 11:45:56 Y dovecot: imap(X): Warning: mdbox /var/mail/X/mdbox/storage: rebuilding indexes 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/INBOX/Kvitteringer/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/INBOX/Kvitteringer/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=10,offset=156 for /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=14,offset=156 for /var/mail/X/mdbox/mailboxes/Facebook/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Facebook/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=6,offset=156 for /var/mail/X/mdbox/mailboxes/Junk/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Junk/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=6,offset=156 for /var/mail/X/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Drafts/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Drafts/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Archives/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Archives/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Archives/2012/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Archives/2012/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=6,offset=156 for /var/mail/X/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Trash/Spam/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:57 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Trash/Spam/dbox-Mails/dovecot.index 11:45:57 Y dovecot: imap-login: Login: user=<X>, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21563, TLS, session=<gs9WnHXhcwA+xz17> 11:45:57 Y dovecot: imap(X): Connection closed: Connection reset by peer in=150 out=111316 11:45:57 Y dovecot: imap-login: Login: user=<X>, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21568, TLS, session=<4y1hnHXhkQA+xz17> 11:46:05 Y dovecot: imap-login: Login: user=<X>, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21574, TLS, session=<+zbNnHXhBAA+xz17> My config is: # dovecot -n # 2.2.4: /etc/dovecot/dovecot.conf # OS: Linux 3.9.9-301.fc19.x86_64 x86_64 Fedora release 19 (Schrödinger’s Cat) ext4 mail_location = mdbox:/var/mail/%u/mdbox mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_subaddress_sep = - } postmaster_address = postmaster(a)alleroedderne.adsl.dk protocols = imap recipient_delimiter = - ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } protocol lda { mail_plugins = " sieve" } Regards, Kim

3 3

[Dovecot] Mailbox Format
by Vijay Rajah 10 Aug '13

10 Aug '13

Hello List, I'm in the process of implementing a new mail server environment from scratch. I was wondering, what mailbox format is recommended? I have been using maildir format for my other projects. I would like to use some format that provides Single Instance Storage. I'm using postfix 2.11 and will use lmtp. I will be using dovecot 2.2.5 (Latest) version. I'm not planning on using NFS (if that matters) and will use dsync to backup mails to another server. Thanks in Advance Vijay Rajah

1 0

Re: [Dovecot] prevent dovecot from modifying maildirs
by Joseph Tam 10 Aug '13

10 Aug '13

> In order to save space I prefer no to have such half-files (mails) , > and it is for this reason that I am asking if there is any way to > prevent this. > > I'm not an expert in field of file systems, so I can be asking very > naive questions... but I appreciate your comments on this topic. Filesystem consistency is different than, for lack of a better term, dovecot consistency. The latter places additional constraints on the content of files, rather than treating them as sequences of disk blocks. I don't think you can ensure the latter without stopping all dovecot processes (and maybe the MTA/LDA as well), which will be much more difficult and disruptive than just taking a snapshot. (I think some snapshot aware application like databases and hypervisors allows the operator to put the application in a state of acquiesence, long enough to take a snapshot, then unblock all processes after the snapshot.) I'd take the suggestion of the previous poster: take snapshots, don't worry, be happy. The small amount of inconsistencies is trivial compared with quickly recovering a mail store after disaster. Joseph Tam <jtam.home(a)gmail.com>

1 0

Re: [Dovecot] How to troubleshoot LDA or LMTP?
by Joseph Tam 10 Aug '13

10 Aug '13

John Williams writes: > *What doesn't work* I thought the next step would be to execute > dovecot-lda manually (as is suggested on the wiki and in numerous > newsgroup posts), but I can't figure out how to do this. When I execute > it as root and provide my non-root username via the -u option, it > hangs. I can see that it spawns a child process that executes as the > non-root user (specified with the -u option). So, could someone tell > how to execute dovecot-lda manually please? Maybe use "-d"? I had no trouble invoking dovecot-lda -c config-file -d user < mailfile If it doesn't work for you, I suggest process tracing it. > Also, when does LMTP process messages? When sending mail via SMTP, or > when reading mail via IMAP? I would prefer to use LMTP rather than > LDA. The former. Joseph Tam <jtam.home(a)gmail.com>

4 6

[Dovecot] execvp /usr/local/libexec/dovecot/dovecot-lda: Permission denied
by Edward Carraro 09 Aug '13

09 Aug '13

I'm trying to follow the instructions for configuring Dovecot LMTP with postfix for virtual domains but whenever mail arrives, in /var/log/maillog, I see Sep 23 16:01:20 mybox postfix/pipe[572]: 999C83206C6: to=< user(a)mytest.domain.com>, relay=dovecot, delay=0.08, delays=0.04/0.01/0/0.03, dsn=4.3.0, status=deferred (temporary failure. Command output: pipe: fatal: pipe_command: execvp /usr/local/libexec/dovecot/dovecot-lda: Permission denied ) ls -lh for /usr/local/libexec/dovecot/dovecot-lda -rwxr-xr-x 1 root staff 62K Sep 20 15:15 dovecot-lda It will deliver mail when I do the sudo invocation of dovecot-lda, but I thought LMTP was suppose to be an alternative to that postfix/main.cf: virtual_transport = dovecot virtual_mailbox_domains = mytest.domain.com dovecot_destination_recipient_limit = 1 /etc/postfix/master.cf: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/local/libexec/dovecot/dovecot-lda -f ${sender} -d ${recipient} /usr/local/etc/dovecot/conf.d/10-master.conf: service auth { unix_listener auth-userdb { mode = 0600 user = vmail #group = vmail } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } inet_listener lmtp { port = 24 } user = vmail } Did I miss something in my config?

7 9

[Dovecot] Getting default uid/gid of users via socket for virtual user support for sendmail
by Steffen Kaiser 09 Aug '13

09 Aug '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I'm trying to make my life easier with sendmail and virtual users. For that I'd like to pass sendmail the home directory and uid/gid for each user. The user data is storred in a LDAP,& I retrieve it from the auth-userdb socket fine. If I add uid / gid to each user, I get them via that socket as well, but is there a way I get the default uid/gid? I mean, without calling an external program, such as doveadm. There is an "initialize" phase, so the default information is retrieved just once per lifetime of the demon, but each time the sendmail binary is invoked. Kind regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUfp2JF3r2wJMiz2NAQL61Af+MuF1BTwaX+Tm+rOWe+smcVUzRmMYZdtL J08wDGNB2EyQ9a0zXwZleO/X3Jvaqr8HSHaC6oTzliS25yqPT4AYG0VVswZoyDTg hggyS9kVse2R1koLZKPAM1EatTmpTsKfUKDjsB3cxbYsBU5NYMJY+u4YATPTl7ui 46K4YmeL4xkKirRXc7j0fIMxdXttuD9zPq20qJ0p41HK2W0ECVHeQpUahozWY45h DREbwdZBZe9PeZNbfOYTLWnxPi1/FK/AX20QH3y3uxEhgMDfYAUHNwAleSCpack5 JEuVYwTPchxsH6uibk62qIsK/uWO3vZM0Zj18S0BBWDNvPhg0Nz92w== =abqh -----END PGP SIGNATURE-----

2 3

[Dovecot] Override master service settigs with spaces
by Ulrich Zehl 08 Aug '13

08 Aug '13

I'd like to override one setting for a master service in conf.d/10-master.conf. Unfortunately, said setting contains spaces, and I do not know how to escape them properly. Here's what I've tried so far. (Note: This is just the easiest/silliest test case I could come up with; not the actual setting or service I want to overwrite.) conf.d/10-master.conf: service quota-status { executable = quota-status -p postfix -o plugin/quota_status_success=Testing 1 2 3 inet_listener { port = 12340 } } Reaction: $ printf "recipient=test(a)example.org\nsize=0\n\n" | nc 127.0.0.1 12340 action=Testing conf.d/10-master.conf: service quota-status { executable = quota-status -p postfix -o "plugin/quota_status_success=Testing 1 2 3" inet_listener { port = 12340 } } Reaction: $ printf "recipient=test(a)example.org\nsize=0\n\n" | nc 127.0.0.1 12340 action=DUNNO [<-- This is the default setting] conf.d/10-master.conf: service quota-status { executable = quota-status -p postfix -o 'plugin/quota_status_success=Testing 1 2 3' inet_listener { port = 12340 } } Reaction: $ printf "recipient=test(a)example.org\nsize=0\n\n" | nc 127.0.0.1 12340 action=DUNNO [<-- This is the default setting] conf.d/10-master.conf: service quota-status { executable = quota-status -p postfix -o plugin/quota_status_success="Testing 1 2 3" inet_listener { port = 12340 } } Reaction: $ printf "recipient=test(a)example.org\nsize=0\n\n" | nc 127.0.0.1 12340 action="Testing [<-- Note the " after = ] conf.d/10-master.conf: service quota-status { executable = quota-status -p postfix -o plugin/quota_status_success=Testing\ 1\ 2\ 3 inet_listener { port = 12340 } } Reaction: $ printf "recipient=test(a)example.org\nsize=0\n\n" | nc 127.0.0.1 12340 action=Testing\ [<-- Note the \ ] I'm out of ideas now. What's the correct way to quote / escape these options?

3 4

[Dovecot] 2.2.5 fails to compile - SSL_OP_SINGLE_ECDH_USE : Solaris 10 + Sunstudio 12.3
by Tomi Vainio 07 Aug '13

07 Aug '13

Hi, Compile fails in these two files src/lib-ssl-iostream/iostream-openssl-context.c src/login-common/ssl-proxy-openssl.c due to missing SSL_OP_SINGLE_ECDH_USE In these there is only #if !defined(OPENSSL_NO_ECDH) when all the other places it always compares also SSL version #if !defined(OPENSSL_NO_ECDH) && OPENSSL_VERSION_NUMBER >= 0x10002000L Tomppa

3 4

[Dovecot] keywords leak in cmd_append_handle_args()
by Mike Abbott 07 Aug '13

07 Aug '13

In 2.2.5 and earlier it appears that mailbox_keywords_unref(&keywords) is not called in some return paths from cmd_append_handle_args(). Should it be?

2 1

[Dovecot] Postfix aliases with quota-status service
by Thomas Leuxner 07 Aug '13

07 Aug '13

The latest HG commits seem to have fixed some underlying problems with the 'quota-status' service. Now doing some quick tests I wonder if this can be used with aliases on the Postfix side. Appears the 'check_policy_service' used in the example below will query existing users via Dovecot's Auth Backend: http://sys4.de/en/blog/2013/04/05/dovecot-quota-mit-postfix-abfragen/ http://www.postfix.org/SMTPD_POLICY_README.html This works fine for Dovecot user 'philo' where the mail is rejected upfront before it enters the queue: ==> /var/log/mail.log <== Jul 30 13:41:18 spectre postfix/smtpd[31072]: NOQUEUE: reject: RCPT from host.example.com[1.2.3.4]: 554 5.2.2 <philo(a)trashheap.net>: Recipient address rejected: Quota exceeded (mailbox for use r is full); from=<user(a)example.com> to=<philo(a)trashheap.net> proto=ESMTP helo=<host.example.com> Now user 'gunge' is an alias for 'philo' in Postfix, thus the quota check will not recognize the user, will queue the message and reject it at the MDA stage: ==> /var/log/mail.log <== Jul 30 14:41:02 spectre postfix/lmtp[31460]: 3c4HSD5ZkBzBP: to=<philo(a)trashheap.net>, orig_to=<gunge(a)trashheap.net>, relay=spectre.leuxner.net[private/dovecot-lmtp], delay=1.2, delays=1.1/0.01/0/0.13, dsn=4.2.2, status=deferred (host spectre.leuxner.net[private/dovecot-lmtp] said: 452 4.2.2 <philo(a)trashheap.net> Quota exceeded (mailbox for user is full) (in reply to end of DATA command)) This is probably intended behaviour, just want to make sure that I'm not missing a point here. For now the only fix that comes to my mind to create "quota aware" aliases - is creating 'dummy' users in Dovecot which point to the same mailbox rather than performing aliasing on the Postfix end. Open to suggestions... Regards Thomas

7 15

Re: [Dovecot] Please HELP: how to delete all messages older than X days from the server?
by Răzvan Sandu 07 Aug '13

07 Aug '13

On Tue, 06 Aug 2013 19:18:15 +0200, Pascal Volk a scris: > There is also the -A option, see > http://wiki2.dovecot.org/Tools/Doveadm/Expunge#section_options Thank you, but doveadm expunge will ask for the mailbox name: [root@mail1 ~]# doveadm expunge -u john.doe(a)example.com ON 2013-08-07 doveadm(root): Fatal: expunge: To avoid accidents, search query must contain MAILBOX in all search branches What I need is to traverse *all* directories under /var/spool/mail/vhosts/domainname/ (which are /var/spool/mail/vhosts/domainname/username, with further variable subdirectories, name never known in advance...) and to delete all messages older than X days (incoming, sent, drafts, trash, etc.) This must be done without manual confirmation ("are you sure...?") (if I do it via a script run from cron). >From the examples given in the wiki page, the expire plugin presents the same problem: one must know in advance the *name of the mailbox* he has to empty. Also for the correct search criteria: should I use SAVEDBEFORE or SENTBEFORE ? Thanks again, Răzvan

2 1

[Dovecot] v2.2.5 released
by Timo Sirainen 06 Aug '13

06 Aug '13

http://dovecot.org/releases/2.2/dovecot-2.2.5.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.5.tar.gz.sig So, I'm back from the first vacation I've had in about 10 years. (Well, maybe there were a few short ones.) I was planning on coding it the whole time, but looks like I didn't manage to get anything at all done. Maybe that's a good vacation?.. Anyway, I've still a few more pending things to look into, but it's been too long since v2.2.4 so here are the fixes so far. + SSL: Added support for ECDH/ECDHE cipher suites (by David Hicks) + Added some missing man pages (by Pascal Volk) + quota-status: Added quota_status_toolarge setting (by Ulrich Zehl) - director: Users near expiration could have been redirected to different servers at the same time. - pop3: Avoid assert-crash if client disconnects during LIST. - mdbox: Corrupted index header still wasn't automatically fixed. - dsync: Various fixes to work better with imapc and pop3c storages. - ldap: sasl_bind=yes caused crashes, because Dovecot's lib-sasl symbols conflicted with Cyrus SASL library. - imap: Various error handling fixes to CATENATE. (Found using Apple's stress test script.)

4 5

[Dovecot] Please HELP: how to delete all messages older than X days from the server?
by Răzvan Sandu 06 Aug '13

06 Aug '13

Hello, Would you please help me solve the following case? My (CentOS) server runs dovecot and allows both POP3 and IMAP service. Users are virtual users (no home directories), with messages stored in Maildir directories under /var/spool/mail/vhosts/example.com/username Some of them use mobile devices (without local storage space), so I must allow IMAP access, not just POP3. But the storage on the server must be for a strictly *limited* period of time. As an admin, I'm trying to force each user to: - download *locally* received messages when they arrive at the office - don't let copies of messages on the server (incoming, sent, trash, drafts, etc.) For various reasons, e-mail client configuration is not under my control (I can't rely on client configuration for implementing this). Implementing filesystem quotas is not an option because a. presently, all virtual users share same UID/GID on the server and b. administrative reasons (the "full quota" situation may occur unexpectedly and this is not tolerable in corporate policy). So I need EITHER: 1. a method of downloading locally *all* messages from the server (incoming, sent, trash, drafts, etc.) to the workstation, when the user consults his/her mailbox from a POP3 desktop client, thus completely *emptying* the user's mailbox on the server OR 2. an automatic, elegant but forceful method of deleting all messages older than X days (incoming, sent, trash, drafts, etc.) I've tried to use a line such as: doveadm expunge -u john.doe(a)example.com before 4w run as root, from a script in crontab, but for "expunge" doveadm won't let me skip the "-u" parameter (to perform the expunge for *all* users). Could you please help? Any sugestion is welcomed. Thanks a lot, Răzvan

2 1

[Dovecot] Using ldap and pam
by Bo Lynch 06 Aug '13

06 Aug '13

Having some issues with ldap logins. I am using Centos 5,dovecot-1.0.13-1.el5.rfx and openldap-servers-2.3.43-25.el5_8.1 Trying to get this to work with the SoGo interface. First I converted all my standard system users to ldap using the openldap-tools. This worked fine, however when a user changes there password they can no longer see there email. If they change it back to the original password mail can be seen. This has stumped me for a day or so so I was hoping someone could shed some light. /etc/dovecot.conf protocols = imap imaps disable_plaintext_auth = no mbox_read_locks = fcntl mbox_write_locks = fcntl protocol imap { } protocol pop3 { } protocol lda { postmaster_address = postmaster(a)example.com } auth default { mechanisms = plain login passdb pam { } passdb ldap { args = /etc/dovecot-ldap.pass } userdb passwd { } user = root user = root socket listen { client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } } dict { } plugin { } /etc/dovecot-ldap.conf hosts = 127.0.0.1:389 sasl_bind = no auth_bind = yes auth_bind = no ldap_version = 3 deref = never dn = cn=sogo,dc=ameliaschools,dc=com dnpass=password base = dc=ameliaschools,dc=com scope = subtree pass_attrs = uid=user, userPassword=password pass_filter = (uid=%u)

3 5

[Dovecot] How to troubleshoot LDA or LMTP?
by John Williams 06 Aug '13

06 Aug '13

Please forgive me if these are silly questions. I am a normal user, not a system administrator. I am using Dovecot as a kind of IMAP caching proxy, i.e. reading IMAP mail via Gnus + Dovecot + Offlineimap. I am trying to enable sieve functionality. *Desired behaviour* When Gnus (or whatever MUA) asks for new mail from Dovecot, that before Dovecot returns and answer, the sieve rules are executed. Please tell me if I completely misunderstand how the mail system works in this instance. *Actual behaviour* As far as I can tell, not only are the sieve rules not executed, but also neither LDA or LMTP is invoked. *What works* Running the scripts manually via `sieve-filter` works fine. The next time I read from my local dovecot server the mail is all in the desired place. Also, the LMTP service is running, listening on port 24. *What doesn't work* I thought the next step would be to execute dovecot-lda manually (as is suggested on the wiki and in numerous newsgroup posts), but I can't figure out how to do this. When I execute it as root and provide my non-root username via the -u option, it hangs. I can see that it spawns a child process that executes as the non-root user (specified with the -u option). So, could someone tell how to execute dovecot-lda manually please? Also, when does LMTP process messages? When sending mail via SMTP, or when reading mail via IMAP? I would prefer to use LMTP rather than LDA. *My environment* Fedora 19 & sendmail. Is any other information relevant, apart from the dovecot configuration? Thank you, John .2.4: /etc/dovecot/dovecot.conf # OS: Linux 3.10.4-300.fc19.x86_64 x86_64 Fedora release 19 (Schrödinger’s Cat) auth_socket_path = /var/run/dovecot/auth-userdb debug_log_path = /var/log/dovecot-debug.log disable_plaintext_auth = no hostname = falcon.novoalexandrovsk.ru info_log_path = /var/log/dovecot-info.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_greeting = Dovecot ready, folks! mail_access_groups = mail mail_debug = yes mail_location = mbox:~/mail/mailboxes:DIRNAME=mBoX-MeSsAgEs:INDEX=~/mail/index:CONTROL=~/mail/control:INBOX=/var/spool/mail/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/lib/dovecot/sieve/global/ sieve_global_path = /var/lib/dovecot/sieve/default.sieve } postmaster_address = johnfrombluff(a)gmail.com protocols = imap lmtp sieve service auth { unix_listener auth-userdb { mode = 0600 user = mail } } service lmtp { executable = lmtp -L inet_listener lmtp { address = 192.168.0.101 127.0.0.1 ::1 port = 24 } user = mail } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 10 } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } protocol lmtp { info_log_path = /var/log/dovecot-lmtp-info.log log_path = /var/log/dovecot-lmtp-debug.log mail_plugins = " sieve" } protocol lda { info_log_path = /var/log/dovecot-lda-info.log log_path = /var/log/dovecot-lda-errors.log mail_plugins = " sieve" } protocol sieve { mail_max_userip_connections = 10 managesieve_implementation_string = Dovecot Pigeonhole, Asshole! managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 }

3 2

[Dovecot] The "<" sign in config files
by Frank Elsner 06 Aug '13

06 Aug '13

Hallo experts, what is the meaning of the "<" sign in config files as in ssl_key = </etc/pki/tls/private/dovecot.key ^ | ? --Frank Elsner

2 1

[Dovecot] dovecot, spamassasin and lmtp
by alfdc 06 Aug '13

06 Aug '13

Hi, Ok, so I got rid of my procmail in favor of dovecot lmtp as my MDA. However, I lost the ability to tag the emails as SPAM or not. Before, this is done by procmail. Filtering is done by the Evolution client. Is there a way to do something similar now? I still want my filtering to be done by the Evolution. So I need something similar what procmail is doing i.e. altering the email header and putting some tag on it if it is a SPAM. Thanks. -- View this message in context: http://dovecot.2317879.n4.nabble.com/dovecot-spamassasin-and-lmtp-tp43709.h… Sent from the Dovecot mailing list archive at Nabble.com.

3 5

[Dovecot] script to test CATENATE
by Mike Abbott 06 Aug '13

06 Aug '13

Attached please find a perl script which tests the CATENATE support in dovecot. I used this to test my CATENATE implementation a few years ago and it runs fine against dovecot in OS X Server. When run against dovecot-2.2.4 though it always fails or hangs, which in some cases means we interpreted RFCs differently and in other cases means it's finding bugs; both conditions are worthy of scrutiny. (It's random-number driven so every run is different.) A couple months ago I reported a few simple bugs which this script found and you fixed them; thanks. Then it started finding problems for which it's harder to isolate simple reproducible test cases. Vacations and other work interceded but now Apple is pleased to give you the script itself to allow you to iterate faster. Here are some examples of it running. One time only, pass the --init argument to store some template messages used by the real tests: $ ./catenate.pl --host your.test.server --user testuser --password 1234 --init connecting (imaps)... capability... logging in... deleting old templates mailbox... creating templates mailbox... append1... Append succeeded append2... Append succeeded logout... success $ ./catenate.pl --host your.test.server --user testuser --password 1234 connecting (imaps)... capability... logging in... append1... Append failed as it should have (bad url): <append1 NO [BADURL ;invalid;] Invalid IMAP URL: Unexpected IMAP URL path segment: `;invalid;'.> append2... Append failed as it should have (bad url): <append2 NO [BADURL /inbox/;uid=99999999] Message not found.> append3... Append succeeded [...] All tests passed. $ If it concludes with anything other than "All tests passed" or hangs then it found something that it didn't expect and that should be examined. Use the --verbose option to see the entire client-server conversation. We hope that you find this script helpful to harden your CATENATE code. I will be happy to answer any questions.

3 5

[Dovecot] problems with expire plugin
by Felix Rubio Dalmau 06 Aug '13

06 Aug '13

Hi all, I'm experiencing problems to set-up the expire plugin in dovecot. This is the relevant part of my dovecot configuration dict { expire = mysql:/etc/dovecot/dovecot-dict-expire.conf.ext } plugin { expire = Trash 15 Junk 15 expire_dict = proxy::expire } protocol imap { mail_plugins = quota zlib expire imap_quota } File dovecot-dict-expire.conf.ext looks like: connect = host=127.0.0.1 dbname=virtual_email user=<user> password=<passw> map { pattern = shared/expire/$user/$mailbox table = virtual_expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } } and the mysql schema for table virtual_expires is: +--------------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +--------------+--------------+------+-----+---------+-------+ | username | varchar(75) | NO | PRI | NULL | | | mailbox | varchar(255) | NO | PRI | NULL | | | expire_stamp | int(11) | NO | | NULL | | +--------------+--------------+------+-----+---------+-------+ However, when I delete any mail from the Inbox, the table is not updated, and there are no messages in the log, although mail_debug is set to "yes" Does anybody has any idea on how to solve this issue? Regards! Felix

3 9

[Dovecot] Corrupted mboxes with v2.2.4, posix_fallocate and GFS2
by Francesco Prelz 05 Aug '13

05 Aug '13

Hi, on a clustered Dovecot server installation that was recently moved from a shared GPFS filesystem to GFS2, occasional corruptions in the users' INBOXes started appearing, where a new incoming message would be appended directly after a block of NUL bytes, and be scanned by dovecot as being glued to the preceding message. I traced this to the file extension operation performed in mbox_sync_handle_eof_updates, where the 'file_set_size' call is used. If available, file_set_size will use the posix_fallocate call. In GFS2 posix_fallocate increases the file size in 4 kB chunks (there seems to be no guarantee anyway that posix_allocate will extend a file by the exact size requested). After a successful posix_fallocate call, mbox_sync_handle_eof_updates currently proceeds in rewriting the mailbox starting from the originally intended 'file_size': 1306 if (file_set_size(sync_ctx->write_fd, 1307 file_size + -sync_ctx->space_diff) < 0) { 1308 mbox_set_syscall_error(sync_ctx->mbox, 1309 "file_set_size()"); 1310 if (ftruncate(sync_ctx->write_fd, file_size) < 0) { 1311 mbox_set_syscall_error(sync_ctx->mbox, 1312 "ftruncate()"); 1313 } 1314 return -1; 1315 } 1316 mbox_sync_file_updated(sync_ctx, FALSE); 1317 1318 if (mbox_sync_rewrite(sync_ctx, mail_ctx, file_size, 1319 -sync_ctx->space_diff, padding, 1320 sync_ctx->need_space_seq, 1321 sync_ctx->seq) < 0) 1322 return -1; When posix_fallocate extends the mailbox beyond the requested 'file_size', a variable size block of NUL bytes is left behind at the tail of the mailbox, with the side effects described above. I successfully worked around this issue by undefining HAVE_POSIX_FALLOCATE, as the performance penalty with falling back to direct block appends seems small. At least a size check (and possible truncation) after the mbox_sync_file_updated call above should probably be added. I thought that the issue would be anyway worth bringing to your attention. Thanks. Francesco Prelz INFN - Sezione di Milano

2 2

[Dovecot] problems with doveadm
by listserv 05 Aug '13

05 Aug '13

Hello, since few weeks i have problems with the command: doveadm expunge -A mailbox Trash savedbefore 7d => kernel: doveadm[11609]: segfault at 10 ip b75f146a sp bf856ad0 error 4 in libdovecot.so.0.0.0[b7585000+c8000] but for a single user it's works fine: doveadm expunge -u test(a)vtlx.de mailbox Trash savedbefore 30h doveconf -n # 2.2.4 (f16816a69130): /etc/dovecot/dovecot.conf # OS: Linux 3.2.45.stk32 i686 Debian jessie/sid ext3 I hope there is a solution for this. with regards Mario -- 中華人民共和國

3 8

[Dovecot] attachments not with email causing FETCH BODY[] failed
by Anand Kumria 05 Aug '13

05 Aug '13

Hi, Anyone else experiencing this (Dovecot 2.2.4, attachments stored separately): dovecot: imap(user(a)kamdha.com): Error: file_istream.open(/home/ example.com/user/attachments/f5/f0/f5f0f2c08c4311fa404d090a703c3b492f2ea718…) failed: No such file or directory dovecot: imap(user(a)example.com): Error: read(BODY[]) failed: No such file or directory (FETCH for mailbox INBOX UID 42501) dovecot: imap(user(a)example.com): Disconnected: FETCH failed in=186 out=86389 My dovecot.conf attachment related config is: mail_attachment_dir = /home/%d/%n/attachments mail_attachment_min_size = 128k mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} So, questions: - anyone else experiencing this? - how might this occurred? - what is the best way to find the corrupted message? - how should I go about fixing this? Any help or pointers would be appreciated. Thanks, Anand

3 4

[Dovecot] Passing data safely in password_key?
by Attila Nagy 05 Aug '13

05 Aug '13

Hi, I would like to convert my custom POP/IMAP proxy to Dovecot's. In this proxy I do more than giving back user name, password and the host and I need extra information. Luckily all of them are available as variables, but more than one comes as user input (like user name and cleartext password) and I'm not sure how to pass them safely. Obviously I would need a separator, which is guaranteed not to show up either in user name and the cleartext password. Should I use escape (%E) here, or is there a better way?

2 4

[Dovecot] ACL not copied to new mailboxes
by Markus Weippert 05 Aug '13

05 Aug '13

Hi, I had some trouble with ACLs not being copied to new child mailboxes in dovecot 2.2.4. It doesn't matter whether it's a private, shared or public mailbox I create the folder in, the ACLs just seems to be ignored. Anyway, I debugged the executable and came up with the attached patch. Since I'm not a developer, I'm not 100% sure about this but it works for me now. Regards, Markus # dovecot --build-options Build options: ioloop=epoll notify=inotify ipv6 openssl io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail SQL drivers: mysql Passdb: checkpassword ldap pam passwd passwd-file shadow sql Userdb: checkpassword ldap nss passwd prefetch passwd-file sql # doveconf -n # 2.2.4: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-48-generic x86_64 Ubuntu 12.04.2 LTS auth_cache_negative_ttl = 5 mins auth_cache_size = 10 M auth_cache_ttl = 1 mins auth_debug = yes auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes first_valid_gid = 122 first_valid_uid = 114 imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags last_valid_gid = 122 last_valid_uid = 114 mail_debug = yes mail_gid = vmail mail_plugins = acl mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { alias_for = hidden = yes inbox = no list = no location = prefix = INBOX. separator = . type = private } namespace { list = children location = maildir:/var/vmail/public/%d:LAYOUT=fs prefix = Public/ separator = / subscriptions = no type = public } namespace { list = children location = maildir:/var/vmail/mail/%%d/%%n:INDEX=~/shared/%%d/%%n prefix = Shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/auth/%s.master driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/var/vmail/acls:cache_secs=300 acl_shared_dict = file:/var/vmail/mail/shared-mailboxes.db sieve = ~/dovecot.sieve sieve_after = /var/vmail/sieve/after sieve_before = /var/vmail/sieve/before sieve_default = /var/vmail/sieve/default.sieve sieve_dir = ~/sieve sieve_global_dir = /var/vmail/sieve/global } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0777 } } service imap-login { process_min_avail = 10 service_count = 0 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/dovecot.pem ssl_cipher_list = HIGH:!MD5:!eNULL ssl_key = </etc/ssl/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = acl sieve } protocol lda { mail_plugins = acl sieve } protocol imap { mail_plugins = acl imap_acl }

2 1

[Dovecot] Maildir Synchronization warnings
by Kavish Karkera 05 Aug '13

05 Aug '13

Hi, We are repeatedly getting these below warnings for some of our users, al though we have no complaints from them yet, we need to know why these warning occurs. So it would be help full if some one explain these warning msg in detail. ----------------------------------------------------------------------------------------------------------------------------------------------------- Aug 2 12:52:55 blade8 dovecot: imap(kavish.karkera(a)example.com): Warning: Maildir: Scanning /mail/v3store/example.com/kavish.karkera(a)example.com/Maildir/cur took 94 seconds (23191 readdir()s, 0 rename()s to cur/, why=0x1) Aug 2 12:52:55 blade8 dovecot: imap(kavish.karkera(a)example.com): Warning: Maildir /mail/v3store/example.com/kavish.karkera(a)example.com/Maildir: Synchronization took 94 seconds (0 new msgs, 0 flag change attempts, 0 expunge attempts) Aug 2 12:53:54 blade6 dovecot: imap(kavish.karkera(a)example.com): Warning: Maildir: Scanning /mail/v3store/example.com/kavish.karkera(a)example.com/Maildir/cur took 154 seconds (43129 readdir()s, 0 rename()s to cur/, why=0x1) Aug 2 12:53:54 blade6 dovecot: imap(kavish.karkera(a)example.com): Warning: Maildir: Scanning /mail/v3store/example.com/kavish.karkera(a)example.com/Maildir/cur took 162 seconds (43129 readdir()s, 0 rename()s to cur/, why=0xc) Aug 2 12:53:54 blade6 dovecot: imap(kavish.karkera(a)example.com): Warning: Maildir /mail/v3store/example.com/kavish.karkera(a)example.com/Maildir: Synchronization took 162 seconds (0 new msgs, 0 flag change attempts, 0 expunge attempts) Aug 2 12:53:54 blade6 dovecot: imap(kavish.karkera(a)example.com): Warning: Locking transaction log file /indexes//mail/v3store/example.com/kavish.karkera(a)example.com/.INBOX/dovecot.index.log took 50 seconds ----------------------------------------------------------------------------------------------------------------------------------------------------- Thanks In advance, Regards, Kavish Karkera

4 6

[Dovecot] [Metadata Plugin] Q: Source Repository
by Christoph Hintermüller 05 Aug '13

05 Aug '13

Hi I'm currently trying to package V14 of Metadata plugin for Ubuntu Quantal (https://launchpad.net/~privatedata/+archive/dovecot-2.2.2/) to be installed along with dovecot 2.2.4. According to my efforts packaging the plugin i do have some questions For future releases, is it possible to add a link to the current release on the meta data mercurial page which includes in the filename of the tar.gz archive the current version number of the plugin ( metadata-plugin-v14.tar.gz). That would allow to add an appropriate line in the debian/watch file to detect when a new release of the plugin is available. Currently i have to check mercurial page manually and use an updated version mangling entry to ensure that the packaging system downloads the latest version. The link would help to simplify this. Especially as the base link in my debian/watch file currently points to tip.tar.gz and not to the archive the linke of the V14 tag points to. The sources i got represent the tip.tar.gz downloaded on July 19th 2013 23:16 CET which likely do not exactly correspond to the contents of the archive containing sources of V14. Therefore a versioned link to the source archives of the latest version would simplify things a lot, especially adding patches released for the latest version. As well as reporting the following addition. Further I have added a doc directory stub, containing the configuration examples found in thread http://dovecot.2317879.n4.nabble.com/dovecot-metadata-8-released-tp10091.ht… Greetings Christoph

1 0

[Dovecot] Subfolders of Inbox with LAYOUT=fs
by Keith Edmunds 05 Aug '13

05 Aug '13

We've just converted to LAYOUT=fs. Some users had subfolders under Inbox, and for those users some MUAs no longer show those folders. The directory structure is that the cur, tmp and new folders are in the 'location' directory, but the subfolders are in $location/INBOX/$foldername. I am suspicious of this: 12 list "" INBOX * LIST (\HasNoChildren) "/" "INBOX" 12 OK List completed. I have tried moving the cur, tmp and new folders to $location/INBOX, and changing 'location' in dovecot.conf, but the subfolders still do not show. Question: is it legitimate to have subfolders of INBOX when using LAYOUT=fs? If so, what am I missing? Thanks, Keith Config: # dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.1 ext3 lda_mailbox_autocreate = yes log_timestamp = "%Y-%m-%d %H:%M:%S " mail_home = /home/%u mail_location = maildir:/home/imapmail/%u:LAYOUT=fs mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = maildir:/home/imapmail/%u:LAYOUT=fs prefix = separator = / type = private } namespace { hidden = no list = children location = maildir:/home/imapmail/public:INDEX=/home/imapmail/public.indexes/%u.index:LAYOUT=fs prefix = public/ separator = / subscriptions = no type = public } passdb { driver = pam } plugin { acl = vfile acl_shared_dict = file:/home/imapmail/shared-mailboxes fts = squat home = /home/%u sieve = /home/sieve/%u.sieve sieve_dir = /home/sieve/%u } protocols = imap sieve service auth { user = root } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/dovecot/TCL_IMAPS_server.crt ssl_key = </etc/dovecot/TCL_IMAPS_server.key userdb { args = uid=imapmail gid=imapmail driver = static } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = acl imap_acl fts fts_squat } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lda { mail_plugins = sieve } -- "You can't live a perfect day without doing something for someone who will never be able to repay you."

2 2

[Dovecot] Help needed with SOLR integration
by Nigel Smith 05 Aug '13

05 Aug '13

Hi, Is there anything wrong with this config for getting SOLR working ? I'm on Ubuntu 12.04LTS and using the bundled Jetty and SOLR. Calling "http://localhost:8080/solr/update?optimize=true" doesn't return an error. And I'm pretty sure I've replaced the schema ? Help & thanks in advance Nigel # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.5.0-37-generic x86_64 Ubuntu 12.04.2 LTS mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii -numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { fts = solr fts_solr = url=http://localhost:8080/solr/ sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = its-virtmail user = its-virtmail } } service imap-login { process_min_avail = 3 } service lmtp { process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = its-virtmail } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 3 } ssl = required ssl_cert = </etc/ssl/certs/mx_example_com.pem ssl_cipher_list = TLSv1+HIGH:!SSLv2:!aNULL:!eNULL:!3DES:!PSK:@STRENGTH ssl_key = </etc/ssl/private/mx_example_com.key userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 mail_plugins = fts fts_solr } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = postmaster quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } protocol lmtp { mail_plugins = sieve postmaster_address = bp(a)example.com }

1 0

[Dovecot] Weird log entries when some users are composing messages in Thunderbird
by Charles Marcus 05 Aug '13

05 Aug '13

Hi all/Timo, When some of our users are composing a message in Thunderbird, I see a ton of these in the logs, and they keep repeating the entire time they are typing until the message gets sent... > 2013-08-05T10:34:42-04:00 myhost dovecot: imap-login: Login: user=<user(a)media-brokers.com>, method=PLAIN, rip=###.###.###.###, lport=993, mpid=8152, TLS, session=<El2GNTTjNgDAqAIc> > 2013-08-05T10:34:42-04:00 myhost dovecot: imap(user(a)media-brokers.com): Disconnected: Disconnected in IDLE in=149 out=12449 > 2013-08-05T10:34:42-04:00 myhost dovecot: imap-login: Login: user=<user(a)media-brokers.com>, method=PLAIN, rip=###.###.###.###, lport=993, mpid=8153, TLS, session=<lJedNTTjNwDAqAIc> > 2013-08-05T10:34:42-04:00 myhost dovecot: imap(user(a)media-brokers.com): Disconnected: Disconnected in IDLE in=149 out=12449 I confirmed that their 'Auto-Save' settings are the defaults (5 minutes, same as mine), and when I'm composing a message, there are no entries like this. The only other option I could think of that might affect t his is the 'spell check as you type', which is also enabled on mine. Also - I'm not sure this *always* happens to these users... all I know is, I see these flooding the logs sometimes, and when I remote in, that user is composing a message. Anyone have any idea why this happens to only a few of our users, and possibly only sometimes? Could it be something in the HTML of the quoted text when they are replying to certain messages? Thanks, -- Best regards, Charles

2 4

Re: [Dovecot] problems with doveadm
by listserv 05 Aug '13

05 Aug '13

> > On 3.8.2013, at 14.25, listserv <listserv(a)xtlv.cn> wrote: > >> doveadm expunge -A mailbox Trash savedbefore 7d >> => kernel: doveadm[11609]: segfault at 10 ip b75f146a sp bf856ad0 error 4 in >> libdovecot.so.0.0.0[b7585000+c8000] > > gdb backtrace would be useful, for example: > > gdb --args doveadm expunge -A mailbox Trash savedbefore 7d > run > bt full > Thank you for your advice. Here the backtrace: gdb --args doveadm expunge -A mailbox Trash savedbefore 7d GNU gdb (GDB) 7.6 (Debian 7.6-5) Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/bin/doveadm...Reading symbols from /usr/lib/debug/usr/bin/doveadm...done. done. (gdb) run Starting program: /usr/bin/doveadm expunge -A mailbox Trash savedbefore 7d warning: Could not load shared library symbols for linux-gate.so.1. Do you need "set solib-search-path" or "set sysroot"? [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/i386-linux-gnu/i686/cmov/libthread_db.so.1". Program received signal SIGSEGV, Segmentation fault. i_stream_next_line (stream=0x0) at istream.c:382 382 istream.c: Datei oder Verzeichnis nicht gefunden. (gdb) bt full #0 i_stream_next_line (stream=0x0) at istream.c:382 _stream = <optimized out> pos = <optimized out> #1 0xb7dfbd01 in auth_master_user_list_next (ctx=0x80bf668) at auth-master.c:694 line = <optimized out> #2 0xb7ef72cb in mail_storage_service_all_next (ctx=0x80b8f60, username_r=0xbffff550) at mail-storage-service.c:1294 __FUNCTION__ = "mail_storage_service_all_next" #3 0x08057db5 in doveadm_mail_all_users (wildcard_user=0x0, argv=<optimized out>, ctx=0x80b53f0) at doveadm-mail.c:368 ret = <optimized out> input = {module = 0x0, service = 0x8092f63 "doveadm", username = 0x80bf070 "admin(a)xtlv.jp", session_id = 0x0, local_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = (unknown: 0), flags_override_remove = (unknown: 0), no_userdb_lookup = 0} user_idx = 0 user = 0x80bf070 "admin(a)xtlv.jp" error = 0xb7e6f2f0 "" #4 doveadm_mail_cmd (argv=<optimized out>, argc=<optimized out>, cmd=0xbffff5ac) at doveadm-mail.c:523 ctx = 0x80b53f0 getopt_args = <optimized out> ret = <optimized out> c = <optimized out> wildcard_user = 0x0 error = <optimized out> #5 doveadm_mail_try_run (cmd_name=cmd_name@entry=0x80b1209 "expunge", argc=argc@entry=6, argv=argv@entry=0x80b11dc) at doveadm-mail.c:608 cmd = 0xbffff5ac #6 0x08056b26 in main (argc=6, argv=0x80b11dc) at doveadm.c:398 cmd_name = <optimized out> i = <optimized out> quick_init = false c = <optimized out> -- 中華人民共和國

1 0

[Dovecot] dovecot fts solr plugin
by Thomas Baumann 05 Aug '13

05 Aug '13

Hello list, * apache-solr-3.6.2 * dovecot-2.1.7 I configured fts_solr for dovecot, but I have two issues When doing a search request within telnet 127.0.0.1 143 it connects to solr. Jul 21, 2013 4:38:15 PM org.apache.solr.core.SolrCore execute INFO: [] webapp=/solr path=/select params={rows=1&q=box:10361d30f8c4ea51ad7c00002ecaff3b+user:" tom(a)tirism.support.tiri.li"&sort=uid+desc&fl=uid} hits=0 status=0 QTime=10 Jul 21, 2013 4:38:15 PM org.apache.solr.core.SolrCore execute INFO: [] webapp=/solr path=/select params={rows=3&q=(hdr:"test"+OR+body:"test")&fq=%2Bbox:10361d30f8c4ea51ad7c00002ecaff3b+%2Buser:" tom(a)tirism.support.tiri.li"&sort=uid+asc&fl=uid,score} hits=0 status=0 QTime=7 But (1) doveadm fts fails: $ doveadm fts rescan -u tom(a)domain.com Error message: doveadm(tom(a)tirism.support.tiri.li): Error: fts not enabled for user's namespace (null) (2) solr schema has errors Jul 21, 2013 4:35:46 PM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: undefined field text at org.apache.solr.schema.IndexSchema.getDynamicFieldType(IndexSchema.java:1330) at org.apache.solr.schema.IndexSchema$SolrQueryAnalyzer.getAnalyzer(IndexSchema.java:408) at org.apache.solr.schema.IndexSchema$SolrIndexAnalyzer.reusableTokenStream(IndexSchema.java:383) at org.apache.lucene.queryParser.QueryParser.getFieldQuery(QueryParser.java:574) at org.apache.solr.search.SolrQueryParser.getFieldQuery(SolrQueryParser.java:206) at org.apache.lucene.queryParser.QueryParser.Term(QueryParser.java:1436) at org.apache.lucene.queryParser.QueryParser.Clause(QueryParser.java:1319) at org.apache.lucene.queryParser.QueryParser.Query(QueryParser.java:1245) at org.apache.lucene.queryParser.QueryParser.TopLevelQuery(QueryParser.java:1234) at org.apache.lucene.queryParser.QueryParser.parse(QueryParser.java:206) at org.apache.solr.search.LuceneQParser.parse(LuceneQParserPlugin.java:79) at org.apache.solr.search.QParser.getQuery(QParser.java:143) at org.apache.solr.handler.component.QueryComponent.prepare(QueryComponent.java:105) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:165) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376) at org.apache.solr.core.QuerySenderListener.newSearcher(QuerySenderListener.java:59) at org.apache.solr.core.SolrCore$3.call(SolrCore.java:1182) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:314) at java.util.concurrent.FutureTask.run(FutureTask.java:149) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:897) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:919) at java.lang.Thread.run(Thread.java:736) Hope somebody can help! Best regards, Thomas # dovecot --version 2.1.7 # dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.0.74-0.6.10-default x86_64 SUSE Linux Enterprise Server 11 (x86_64) xfs base_dir = /var/run/dovecot/ dict { expire = sqlite:/etc/dovecot/dovecot-dict-sql.conf.ext quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_uid = 5000 listen = * login_greeting = tiri Mail ready. login_trusted_networks = 127.0.0.1 mail_location = maildir:/var/vmail/%u/ mail_plugins = fts fts_solr managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } ssl = no userdb { driver = passwd } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { plugin { fts = solr fts_solr = break-imap-search url=http://localhost:8983/solr/ } } protocol pop3 { plugin { fts = solr fts_solr = break-imap-search url=http://localhost:8983/solr/ } }

3 4

[Dovecot] Design: Adding checksums to index files
by Timo Sirainen 05 Aug '13

05 Aug '13

I've been planning on adding these for years. Maybe it's about time soon. I guess they could be added already to v2.2, but enabled only by a new setting because it requires file format changes that old Dovecots can't then read. I could probably patch v2.1 also so it is able to at least read the new format without failing. For v2.3 this new format could then be made the default. And what would the checksums be exactly? Would the standard CRC32 and CRC8 work fine, or are there any better ones? 1. dovecot.index v2.1+ always only fully recreates this file, never overwrites data to it. So the checksums could be written only when the dovecot.index is being recreated. There are 3 possible things to checksum: - header (32bit checksum) - all of the mail records (32bit checksum) - each mail record independently (8bit checksum per mail) The header's checksum could be verified every time the index is opened. The full mail record checksum could be verified when something appears to be wrong, but it's probably a waste of time to check it in normal operation. I'm not really sure about the per-mail checksums. It would be easy to create them while dovecot.index is being created, but after reading the file into memory the records are updated in many ways in many places. It's probably not worth the complexity and extra slowness to verify and/or update the checksums in all the different places. So is it worth it to even have them? In error conditions when fixing up indexes it could be useful to skip over records with broken checksums (and check if the mail is in dovecot.index.backup with correct checksum). Maybe that's enough to be worth 1 byte per message?.. 2. dovecot.index.log This file is only appended to. Each committed transaction could be prefixed in the new format with <transaction size><transaction 32bit checksum>. With the new format this wouldn't actually increase the log file size much, because there is already some space wasted for a compatibility "boundary" record that could be removed now. 3. dovecot.index.cache Cache file is the most complex file. Its headers get overwritten once in a while. Probably not worth the trouble to checksum the header itself, and there's not a lot that could be done even if a broken checksum was found. But each mail_cache_record could have its own checksum. A 8bit checksum could be added without increasing the file's size. Maybe that would be enough? 4. dovecot.index.thread This is a rather simple file and a 32bit checksum could be added to its header, and verified every time the file is read (because it's fully read anyway). 5. dovecot.mailbox.log This file doesn't even have a header. There are 3 unused bytes in each record currently. One of them could be used for a new "flags" parameter, with the only flag being "checksum added". There would still be space left for 8bit or 16bit checksum. 6. Other files There are also some text files, like dovecot-acl, subscriptions, quota usage and Sieve scripts. They probably have to be without checksums for now.

2 2

[Dovecot] How to configure sendmail using dovecot lmtp
by alfdc 05 Aug '13

05 Aug '13

Hi, I can't seems to find any posting on how to configure sendmail to use dovecot as lmtp. All I see is using it as LDA. I am particularly interested on how to tell sendmail to ask dovecot to deliver the message to the user. In the wiki for lda it says to add the following in the sendmail config: FEATURE(`local_procmail', `/usr/local/libexec/dovecot/deliver',`/usr/local/libexec/dovecot/deliver -d $u') MODIFY_MAILER_FLAGS(`LOCAL', `-f') MAILER(procmail) Is this the same for lmtp? If so how does it know when to use lda or lmtp? Beside, is procmail playing any role in any of these? Can the I just replace the whole thing as: FEATURE(`local_lmtp',`/usr/local/libexec/dovecot/deliver',`/usr/local/libexec/dovecot/deliver -d $u) MAILER(`local') Thanks. -- View this message in context: http://dovecot.2317879.n4.nabble.com/How-to-configure-sendmail-using-doveco… Sent from the Dovecot mailing list archive at Nabble.com.

3 2

[Dovecot] Maildir Synchronization warnings
by Kavish Karkera 05 Aug '13

05 Aug '13

Hi, We are repeatedly getting these below warnings for some of our users, al though we have no complaints from them yet, we need to know why these warning occurs. So it would be help full if some one explain these warning msg in detail. ----------------------------------------------------------------------------------------------------------------------------------------------------- Aug 2 12:52:55 blade8 dovecot: imap(kavish.karkera(a)example.com): Warning: Maildir: Scanning /mail/v3store/example.com/kavish.karkera(a)example.com/Maildir/cur took 94 seconds (23191 readdir()s, 0 rename()s to cur/, why=0x1) Aug 2 12:52:55 blade8 dovecot: imap(kavish.karkera(a)example.com): Warning: Maildir /mail/v3store/example.com/kavish.karkera(a)example.com/Maildir: Synchronization took 94 seconds (0 new msgs, 0 flag change attempts, 0 expunge attempts) Aug 2 12:53:54 blade6 dovecot: imap(kavish.karkera(a)example.com): Warning: Maildir: Scanning /mail/v3store/example.com/kavish.karkera(a)example.com/Maildir/cur took 154 seconds (43129 readdir()s, 0 rename()s to cur/, why=0x1) Aug 2 12:53:54 blade6 dovecot: imap(kavish.karkera(a)example.com): Warning: Maildir: Scanning /mail/v3store/example.com/kavish.karkera(a)example.com/Maildir/cur took 162 seconds (43129 readdir()s, 0 rename()s to cur/, why=0xc) Aug 2 12:53:54 blade6 dovecot: imap(kavish.karkera(a)example.com): Warning: Maildir /mail/v3store/example.com/kavish.karkera(a)example.com/Maildir: Synchronization took 162 seconds (0 new msgs, 0 flag change attempts, 0 expunge attempts) Aug 2 12:53:54 blade6 dovecot: imap(kavish.karkera(a)example.com): Warning: Locking transaction log file /indexes//mail/v3store/example.com/kavish.karkera(a)example.com/.INBOX/dovecot.index.log took 50 seconds ----------------------------------------------------------------------------------------------------------------------------------------------------- Thanks In advance, Regards, Kavish Karkera

3 3

[Dovecot] Antispam folder names
by Jost Krieger 05 Aug '13

05 Aug '13

Is there anywhere a collection of folder names for the antispam_trash and antispam_spam configuration? Our problem is that in academia, you have a vast amount of different clients, and some, like Microsoft, use language-specific folder names *on the server*. So we're now collecting folder names to better handle the rare cases. Two more problems: 1. We needed to fix UTF-8 handling in the plugin, so that we kow canb say antispam_trash_pattern_ignorecase = gelöscht* in place of :set sp antispam_trash_pattern_ignorecase = gel&APY-scht* 2. Some clients allow prefixing the IMAP folders with a fixed name, often "INBOX". So we would like to specify something like antispam_trash_pattern_ignorecase = Junk*;*/Junk* which is not supported. Working on a patch ... Yours Jost -- | Helft Spam ausrotten! HTML in Mail ist unhöflich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gefällig, gefällige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 |

2 1