March 2016 - dovecot - dovecot.org

Xi has a new home
by Stephan Bosch 17 Mar '16

17 Mar '16

Hi, The automatic package builder Xi has moved to system within the Dovecot infrastructure. This also means that the repositories are available at a new host name: xi.dovecot.fi. The old host name still works and is a CNAME pointing to the new venue. I expect the old domain to be active for years to come. So, there is no need to update your /etc/apt/sources.list right away. Still, it is a good idea to do so. I've updated the wiki accordingly. Regards, Stephan.

4 5

Re: spamc during dovecot-smtp delivery?
by madduck＠madduck.net 17 Mar '16

17 Mar '16

[cc'ing the list for posterity] also sprach Tolbert, Joshua P <jtolbert(a)illinois.edu> [2016-03-16 21:46 +0100]: > I’ve been working on a Postfix/Dovecot/sieve mail server migration > (from Sendmail/Dovecot/procmail) and ran in to a similar problem > to one you talked about a while ago on the dovecot mailing lists. > Did you ever find a good solution for running spamc as the > destination user in sieve? If you did, mind sharing? Thanks! I've never had a problem again since upgrading to Debian jessie, but I also think that the problem's solution was installing a NSS cache, because the deadlocks seemed to take place between Spamassassin and libnss-pgsql2. Transport from Postfix to Dovecot is lmtp:unix:private/dovecot-lmtp (no idea how to do that with Sendmail or why you'd want to use Sendmail) and then Dovecot's sieve is configured to run a filter using /etc/dovecot/sieve.before.d: require [ "vnd.dovecot.filter"]; filter "spamc" [ "--no-safe-fallback" ]; which is enabled in conf.d/90-sieve.conf with sieve_before = /etc/dovecot/sieve.before.d sieve_global_extensions = +vnd.dovecot.filter sieve_plugins = sieve_extprograms and in conf.d/90-sieve-extprograms.conf sieve_filter_bin_dir = /etc/dovecot/sieve-filter and then I made a simple symlink from /etc/dovecot/sieve-filter → /usr/bin/spamc Spamassassin starts with --create-prefs --helper-home-dir --allow-tell and the final step is to integrate the mail user database (vmm in my case) with libnss to provide spamassassin with a way to identify home directories. I use libnss-pgsql2. The /etc/nss-pgsql.conf file I use is available here: http://bugs.debian.org/818465 A successful delivery then looks like this: postfix/smtpd[29778]: connect from mail1.smtp.mailserver4.de[62.216.179.241] postfix/smtpd[29778]: 6D2F74024E: client=mail1.smtp.mailserver4.de[62.216.179.241] postfix/cleanup[32593]: 6D2F74024E: message-id=<xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx@xxxxxxxxxxxxxxxxxxxxx> postfix/smtpd[29778]: disconnect from mail1.smtp.mailserver4.de[62.216.179.241] dovecot: lmtp(3570): Connect from local spamd[2140]: spamd: connection from localhost [::1]:57032 to port 783, fd 6 spamd[2140]: spamd: setuid to xxxxxxx%yyyyyyyyyy.zz succeeded spamd[2140]: spamd: processing message <xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx@xxxxxxxxxxxxxxxxxxxxx> for xxxxxxx%yyyyyyyy.zz:70032 spamd[2140]: spamd: clean message (-1.9/5.0) for xxxxxxx%yyyyyyyy.zz:70032 in 3.0 seconds, 10222 bytes. spamd[2140]: spamd: result: . -1 - BAYES_00,DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,HTML_MESSAGE,RCVD_IN_DNSWL_NONE scantime=3.0,size=10222,user=xxxxxxx%yyyyyyyy.zz,uid=70032,required_score=5.0,rhost=localhost,raddr=::1,rport=57032,mid=<xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx@xxxxxxxxxxxxxxxxxxxxx>,bayes=0.000000,autolearn=ham autolearn_force=no dovecot: lmtp(3570, xxxxxxx(a)yyyyyyyy.zz) copy from (file): box=INBOX, uid=30613, msgid=<xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx@xxxxxxxxxxxxxxxxxxxxx>, size=10945 dovecot: lmtp(3570, xxxxxxx(a)yyyyyyyy.zz) QLZ6IoJ/6lbyDQAARsnb6w: sieve: msgid=<xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx@xxxxxxxxxxxxxxxxxxxxx>: stored mail into mailbox 'INBOX' postfix/lmtp[3569]: 6D2F74024E: to=<xxxxxxx(a)yyyyyyyy.zz>, orig_to=<aaaaaa(a)bbbbbbb.zz>, relay=ambassador.madduck.net[private/dovecot-lmtp], delay=5, delays=2/0.02/0.01/3, dsn=2.0.0, status=sent (250 2.0.0 <xxxxxxx(a)yyyyyyyy.zz> QLZ6IoJ/6lbyDQAARsnb6w Saved) dovecot: lmtp(3570): Disconnect from local: Successful quit Hope this helps… -- @martinkrafft | http://madduck.net/ | http://two.sentenc.es/ "the public is wonderfully tolerant. it forgives everything except genius." -- oscar wilde spamtraps: madduck.bogus(a)madduck.net

1 0

subscribe users mailbox with non-valid mutf7 chars
by Matthias Lay 16 Mar '16

16 Mar '16

Hi all, I got a question if its possible to subscribe a mailbox from another user, who contains non mutf7 valid chars in his mailbox path. I have a private namespace which can subscribe to mailboxes of a shared namespace with public/ prefix in this example username in private namespace is johnd public username is "a & p products group" when I try the subscription I get this one: ******************************************** # doveadm mailbox subscribe -u johnd "public/a & p products group/INBOX" doveadm(johnd): Error: Can't public/a & p products group/INBOX mailbox subscribe to: Invalid mailbox name 'public/a & p products group/INBOX': Missing namespace prefix 'public/a &- p products group/' ******************************************** is there a way to work around this? (except for not to use usernames like this) greetz matze

1 1

Question: encrypt/decrypt with plugin mail_filter
by Zhang Huangbin 16 Mar '16

16 Mar '16

Dear all, I'm trying to encrypt/decrypt mail body with Dovecot plugin 'mail_filter': http://wiki2.dovecot.org/Plugins/MailFilter I wrote a Python script to read mail body and encrypt it, the encryption/decryption part is working as expected, but Dovecot always fail to write modified email on disk: Error: Cached message size smaller than expected (1575 < 1644) Error: Maildir filename has wrong S value, renamed the file from /var/vmail/domain.com/user/cur/1458165453.M632521P17600.c7.iredmail.org,S=1575:2, to /var/vmail/domain.com/user/cur/1458165453.M632521P17600.c7.iredmail.org,S=1575:2, Error: Corrupted index cache file /var/vmail/domain.com/user/dovecot.index.cache: Broken physical size for mail UID 4 Error: read() failed: Invalid argument (uid=4) I know this behave is clearly explained in Dovecot wiki page, the question is, is there any way to overcome this and let Dovecot correctly handle the encrypted/decrypted mail? Thanks. :)

1 0

dsync and ProxyAUTH
by Giovanni Mancuso 16 Mar '16

16 Mar '16

Hi, can i use dync to migrate a mailboxes through PROX-AUTH? Could It be an attractive feature for you? Thanks

2 3

overview zlib efficiency?
by Götz Reinicke - IT Koordinator 16 Mar '16

16 Mar '16

Hi, may be someone has already done that: Do you have a script(?) tool which shows the efficiency of the mail compression if zlib is used? Something that shows the uncompressed size vrs. the compressed. Thanks for hints! /Götz

12 17

Plugin "last-login" - Log SMTP-AUTH information
by Benjamin Hück 16 Mar '16

16 Mar '16

Hello all, we are using the Plugin "last-login" [1] to update user's last-login timestamp or the timestamp of the last incoming message in a MySQL backend. Would it be possible to expand the plugin to also log the timestamp of the last smtp-auth attempt/successful process? Currently in our settings, a smtp-auth request (port 587) is forwarded by postfix to a dovecot backend server for authentication. I couldn`t find out the developer of the plugin otherwise I had contact them immediatly. Thanks and best regards, Benjamin Hück [1] http://wiki2.dovecot.org/Plugins/LastLogin -- ________________________________ KEVAG Telekom GmbH Cusanusstr. 7 D 56073 Koblenz Fon: +49 261 20162-0 Fax: +49 261 20162-25100 http://www.kevag-telekom.de/ Geschäftsführer: Bernd Gowitzke, Gerd Thewalt Sitz der Gesellschaft: Koblenz, Amtsgericht Koblenz, HRB Nr. 5343 USt.IdNr. DE 18 77 67 843 St-Nr. 22/650/0182/7

1 0

New dovecot user needs installation help
by Jason Pruim 15 Mar '16

15 Mar '16

Hey Everyone, So I just setup my first dovecot install with postfix running for the mail server… I can telnet into my dovecot install and login just fine with my user locally… But when I try to add the account from my phone, computer, or telnetting from my local computer, it just hangs and eventually kicks back a generic error saying it can’t be added… Where can I start looking? I’m hosted with amazon web services and I’m waiting on them to approve my request to white list my IP on my instance, but that should only restrict my ability to send email out on port 25… I should still be able to operate locally… According to the firewall on amazon port 143 and 993 are both allowed from any IP address into the server (All outbound traffic is currently open until I get it working) I’m thinking it’s something easy, and I can handle pointers! I don’t necessarily need my hand held the entire way… At least not yet… Here is the output of my dovecot -n: [ec2-user@ip-172-31-22-222 log]$ dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 3.14.48-33.39.amzn1.x86_64 x86_64 mail_location = mbox:~/mail:INBOX=/var/mail/%u mbox_write_locks = fcntl passdb { driver = pam } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } [ec2-user@ip-172-31-22-222 log]$ Let me know if there is anything else you need, or where to go from here! Thanks in advance! Jason Pruim pruimj(a)gmail.com

2 5

Reappearing emails - IMAP trace
by Ron Cleven 15 Mar '16

15 Mar '16

A few days back, I sent an overview of this problem, but received no responses. Since then, I have run dozens of traces to isolate the problem, difficult because there are timing issues involved. I have finally nailed it down. If this is not the proper place to report such bugs or if someone knows that this bug has been fixed, please let me know. As I noted in my earlier post, we have been running Dovecot 2.2.10 with a pair of CentOS 7 boxes with replications for the past year. We have been quite happy with the performance and reliability. Recently we received a report that emails could reappear in the INBOX after being deleted. After running a pile of traces, I determined that the problem was strangely related to replications. For the purposes of this discussion, I will refer to the two symmetric replicating servers as A and B. Further, let us assume that during "normal" operation, all the emails are delivered to A via SMTP and are replicated to B. Under those assumptions, if the IMAP user connects to A (where the messages were originally delivered), there is no problem, at least no problem I was able to find. The problem I am describing only arises if the IMAP user connects to B. Connecting to B has never presented any other problems that I am aware of. The test for which I have provided the trace starts with a test mailbox containing only 3 unread messages in the INBOX. Moving 1 of the unread messages to Trash is all that is needed to reproduce the problem. Remember this is ONLY a problem if the IMAP sessions do not connect to the server to which the messages were originally delivered. Also, I found that there is a timing window. The critical IMAP commands are: UID STORE xxx +FLAGS.SILENT (\Seen) UID MOVE xxx Trash If you introduce a large enough delay (I arbitrarily chose 5 seconds) between those two commands, there is no problem. Presumably this has to do with the two boxes syncing up some critical data structure. It takes a short time for the message that was moved to Trash to reappear in the INBOX. The trace initially shows the number of messages going from 3 to 2 when the message is moved to Trash, but a second or so later, the message count goes back up to 3. Interestingly, the reappearing message shows back up as Unseen in the INBOX but a duplicate copy of it stays in Trash as Seen. Dragging unread messages to Trash may not be polite, but it is technically acceptable. Regarding the trace below , CR's show up as \r, LF's show up as \n, and each line starts with S or C depending upon whether it is from the Server or Client. There is blank line following each connection. Thanks, Ron ============================================================================ S * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE I S DLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready.\r\n C 10001 LOGIN testimap(a)usgo.net ***********\r\n S 10001 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENAB S LE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDS S UBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UID S PLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRE S S WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in S \r\n C 10002 STATUS INBOX (MESSAGES UNSEEN)\r\n S * STATUS INBOX (MESSAGES 3 UNSEEN 3)\r\n S 10002 OK Status completed.\r\n C 10003 SELECT INBOX\r\n S * FLAGS (\Answered \Flagged \Deleted \Seen \Draft)\r\n S * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \* S )] Flags permitted.\r\n S * 3 EXISTS\r\n S * 1 RECENT\r\n S * OK [UNSEEN 1] First unseen.\r\n S * OK [UIDVALIDITY 1457030049] UIDs valid\r\n S * OK [UIDNEXT 129] Predicted next UID\r\n S * OK [HIGHESTMODSEQ 417] Highest\r\n S 10003 OK [READ-WRITE] Select completed (0.000 secs).\r\n C 10004 UID SEARCH 3\r\n S * SEARCH 128\r\n S 10004 OK Search completed (0.000 secs).\r\n C 10005 LIST "" Trash\r\n S * LIST (\HasNoChildren \Trash) "." Trash\r\n S 10005 OK List completed.\r\n C 10006 UID STORE 128 +FLAGS.SILENT (\Seen)\r\n S 10006 OK Store completed.\r\n C 10007 UID MOVE 128 Trash\r\n S * OK [COPYUID 1457030331 128 127] Moved UIDs.\r\n S * 3 EXPUNGE\r\n S * 0 RECENT\r\n S 10007 OK Move completed.\r\n C 10008 STATUS INBOX (MESSAGES UNSEEN)\r\n S * STATUS INBOX (MESSAGES 2 UNSEEN 2)\r\n S 10008 OK [CLIENTBUG] Status on selected mailbox completed.\r\n C 10009 STATUS Trash (MESSAGES UNSEEN)\r\n S * STATUS Trash (MESSAGES 1 UNSEEN 0)\r\n S 10009 OK Status completed.\r\n C 10010 LOGOUT\r\n S * BYE Logging out\r\n S 10010 OK Logout completed.\r\n S * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE I S DLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready.\r\n C 10001 LOGIN testimap(a)usgo.net ***********\r\n S 10001 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENAB S LE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDS S UBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UID S PLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRE S S WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in S \r\n C 10002 SELECT INBOX\r\n S * FLAGS (\Answered \Flagged \Deleted \Seen \Draft)\r\n S * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \* S )] Flags permitted.\r\n S * 2 EXISTS\r\n S * 0 RECENT\r\n S * OK [UNSEEN 1] First unseen.\r\n S * OK [UIDVALIDITY 1457030049] UIDs valid\r\n S * OK [UIDNEXT 129] Predicted next UID\r\n S * OK [HIGHESTMODSEQ 419] Highest\r\n S 10002 OK [READ-WRITE] Select completed (0.026 secs).\r\n C 10003 UID FETCH 127 (UID RFC822.SIZE FLAGS INTERNALDATE BODYSTRUCTURE B C ODY.PEEK[HEADER.FIELDS (DATE FROM TO SUBJECT CONTENT-TYPE CC REPLY-TO L C IST-POST DISPOSITION-NOTIFICATION-TO X-PRIORITY IN-REPLY-TO BCC SENDER C MESSAGE-ID CONTENT-TRANSFER-ENCODING REFERENCES X-DRAFT-INFO MAIL-FOLLO C WUP-TO MAIL-REPLY-TO RETURN-PATH)])\r\n S * 2 FETCH (UID 127 RFC822.SIZE 771 FLAGS () INTERNALDATE "08-Mar-2016 0 S 8:48:31 -0600" BODYSTRUCTURE ("text" "plain" ("charset" "us-ascii") NIL S NIL "7bit" 7 1 NIL NIL NIL NIL) BODY[HEADER.FIELDS (DATE FROM TO SUBJE S CT CONTENT-TYPE CC REPLY-TO LIST-POST DISPOSITION-NOTIFICATION-TO X-PRI S ORITY IN-REPLY-TO BCC SENDER MESSAGE-ID CONTENT-TRANSFER-ENCODING REFER S ENCES X-DRAFT-INFO MAIL-FOLLOWUP-TO MAIL-REPLY-TO RETURN-PATH)] {108}\r S \n S From: ron(a)cleven.com\r\n S To: testimap(a)usgo.net\r\n S Date: Tue, 08 Mar 2016 08:48:24 -0600 (CST)\r\n S Subject: test2\r\n S \r\n S )\r\n S 10003 OK Fetch completed.\r\n C 10004 UID FETCH 127 (BODY.PEEK[TEXT])\r\n S * 2 FETCH (UID 127 BODY[TEXT] {7}\r\n S test2\r\n S )\r\n S 10004 OK Fetch completed.\r\n C 10005 UID STORE 127 +FLAGS.SILENT (\Seen)\r\n S 10005 OK Store completed.\r\n C 10006 LOGOUT\r\n S * BYE Logging out\r\n S 10006 OK Logout completed.\r\n S * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE I S DLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready.\r\n C 10001 LOGIN testimap(a)usgo.net ***********\r\n S 10001 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENAB S LE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDS S UBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UID S PLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRE S S WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in S \r\n C 10002 LIST (SUBSCRIBED) "" "*"\r\n S * LIST (\Subscribed) "." Sent\r\n S * LIST (\Subscribed) "." Trash\r\n S * LIST (\Subscribed) "." Drafts\r\n S * LIST (\Subscribed) "." Junk\r\n S * LIST (\Subscribed) "." Blocked\r\n S * LIST (\Subscribed) "." Pending\r\n S * LIST (\Subscribed) "." Archives\r\n S * LIST (\Subscribed) "." Archives.2016\r\n S 10002 OK List completed.\r\n C 10003 STATUS INBOX (MESSAGES UNSEEN)\r\n S * STATUS INBOX (MESSAGES 2 UNSEEN 1)\r\n S 10003 OK Status completed.\r\n C 10004 LOGOUT\r\n S * BYE Logging out\r\n S 10004 OK Logout completed.\r\n S * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE I S DLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready.\r\n C 10001 LOGIN testimap(a)usgo.net ***********\r\n S 10001 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENAB S LE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDS S UBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UID S PLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRE S S WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in S \r\n C 10002 LIST (SUBSCRIBED) "" "*"\r\n S * LIST (\Subscribed) "." Sent\r\n S * LIST (\Subscribed) "." Trash\r\n S * LIST (\Subscribed) "." Drafts\r\n S * LIST (\Subscribed) "." Junk\r\n S * LIST (\Subscribed) "." Blocked\r\n S * LIST (\Subscribed) "." Pending\r\n S * LIST (\Subscribed) "." Archives\r\n S * LIST (\Subscribed) "." Archives.2016\r\n S 10002 OK List completed.\r\n C 10003 STATUS INBOX (MESSAGES UNSEEN)\r\n S * STATUS INBOX (MESSAGES 3 UNSEEN 2)\r\n S 10003 OK Status completed.\r\n C 10004 LOGOUT\r\n S * BYE Logging out\r\n S 10004 OK Logout completed.\r\n ============================================================================

2 1

syncing mailboxes with dsync after switchover
by Sergey Schwartz 15 Mar '16

15 Mar '16

Gents, I'm relocating mailboxes to a new server. Before switching over to a new server I ran syncing a few times without any issues first I sync files with rsync from the old server to have a local copy, then I sync mailboxes with dsync /usr/bin/doveadm -Dv sync -u $MBOX -R "sdbox:/srv/vmail/temp/srv/srv.bgoperator.ru/${MBOX}:DIRNAME=DbOx-mAiLs" After switching over smtp transport and running dsync as above a few mailboxes were deleted dsync(xxx): Warning: Deleting mailbox 'INBOX': UID=1 already exists locally for a different mail: GUIDs don't match (c005a206e1c6e756f02700003a8929e2 vs 0ba1c03796f5dc524c6d0000b4ca29ec) dsync(xxxx): Warning: Deleting mailbox 'INBOX': UID=8855 GUID=80d5841f0fe2e35677630000b4ca29ec is missing locally dsync(xxxxx): Warning: Deleting mailbox 'INBOX': UID=7508 already exists locally for a different mail: GUIDs don't match (1e03d72074d8e756403700003a8929e2 vs 1dc47a3ac5c4e7562a290000b4ca29ec) dsync(xxxxxx): Warning: Deleting mailbox 'INBOX': UID=8238 GUID=2a6a803bd33fe156f85e0000b4ca29ec is missing locally and a few other mailboxes seemed to fail to sync dsync(xxxxxxx): Warning: Mailbox changes caused a desync. You may want to run dsync again. Is it a bug or I am doing something wrong ? -- Best regards, Sergey Schwartz Senior System Administrator Biblio Globus Tour Operator www.bgoperator.ru T: +7 495 5042500 ext 1532 E: sergey.schwartz(a)bgoperator.com

2 2