- dovecot - dovecot.org

Question: encrypt/decrypt with plugin mail_filter
by Zhang Huangbin 16 Mar '16

16 Mar '16

Dear all, I'm trying to encrypt/decrypt mail body with Dovecot plugin 'mail_filter': http://wiki2.dovecot.org/Plugins/MailFilter I wrote a Python script to read mail body and encrypt it, the encryption/decryption part is working as expected, but Dovecot always fail to write modified email on disk: Error: Cached message size smaller than expected (1575 < 1644) Error: Maildir filename has wrong S value, renamed the file from /var/vmail/domain.com/user/cur/1458165453.M632521P17600.c7.iredmail.org,S=1575:2, to /var/vmail/domain.com/user/cur/1458165453.M632521P17600.c7.iredmail.org,S=1575:2, Error: Corrupted index cache file /var/vmail/domain.com/user/dovecot.index.cache: Broken physical size for mail UID 4 Error: read() failed: Invalid argument (uid=4) I know this behave is clearly explained in Dovecot wiki page, the question is, is there any way to overcome this and let Dovecot correctly handle the encrypted/decrypted mail? Thanks. :)

1 0

dsync and ProxyAUTH
by Giovanni Mancuso 16 Mar '16

16 Mar '16

Hi, can i use dync to migrate a mailboxes through PROX-AUTH? Could It be an attractive feature for you? Thanks

2 3

overview zlib efficiency?
by Götz Reinicke - IT Koordinator 16 Mar '16

16 Mar '16

Hi, may be someone has already done that: Do you have a script(?) tool which shows the efficiency of the mail compression if zlib is used? Something that shows the uncompressed size vrs. the compressed. Thanks for hints! /Götz

12 17

Plugin "last-login" - Log SMTP-AUTH information
by Benjamin Hück 16 Mar '16

16 Mar '16

Hello all, we are using the Plugin "last-login" [1] to update user's last-login timestamp or the timestamp of the last incoming message in a MySQL backend. Would it be possible to expand the plugin to also log the timestamp of the last smtp-auth attempt/successful process? Currently in our settings, a smtp-auth request (port 587) is forwarded by postfix to a dovecot backend server for authentication. I couldn`t find out the developer of the plugin otherwise I had contact them immediatly. Thanks and best regards, Benjamin Hück [1] http://wiki2.dovecot.org/Plugins/LastLogin -- ________________________________ KEVAG Telekom GmbH Cusanusstr. 7 D 56073 Koblenz Fon: +49 261 20162-0 Fax: +49 261 20162-25100 http://www.kevag-telekom.de/ Geschäftsführer: Bernd Gowitzke, Gerd Thewalt Sitz der Gesellschaft: Koblenz, Amtsgericht Koblenz, HRB Nr. 5343 USt.IdNr. DE 18 77 67 843 St-Nr. 22/650/0182/7

1 0

New dovecot user needs installation help
by Jason Pruim 16 Mar '16

16 Mar '16

Hey Everyone, So I just setup my first dovecot install with postfix running for the mail server… I can telnet into my dovecot install and login just fine with my user locally… But when I try to add the account from my phone, computer, or telnetting from my local computer, it just hangs and eventually kicks back a generic error saying it can’t be added… Where can I start looking? I’m hosted with amazon web services and I’m waiting on them to approve my request to white list my IP on my instance, but that should only restrict my ability to send email out on port 25… I should still be able to operate locally… According to the firewall on amazon port 143 and 993 are both allowed from any IP address into the server (All outbound traffic is currently open until I get it working) I’m thinking it’s something easy, and I can handle pointers! I don’t necessarily need my hand held the entire way… At least not yet… Here is the output of my dovecot -n: [ec2-user@ip-172-31-22-222 log]$ dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 3.14.48-33.39.amzn1.x86_64 x86_64 mail_location = mbox:~/mail:INBOX=/var/mail/%u mbox_write_locks = fcntl passdb { driver = pam } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } [ec2-user@ip-172-31-22-222 log]$ Let me know if there is anything else you need, or where to go from here! Thanks in advance! Jason Pruim pruimj(a)gmail.com

2 5

Reappearing emails - IMAP trace
by Ron Cleven 16 Mar '16

16 Mar '16

A few days back, I sent an overview of this problem, but received no responses. Since then, I have run dozens of traces to isolate the problem, difficult because there are timing issues involved. I have finally nailed it down. If this is not the proper place to report such bugs or if someone knows that this bug has been fixed, please let me know. As I noted in my earlier post, we have been running Dovecot 2.2.10 with a pair of CentOS 7 boxes with replications for the past year. We have been quite happy with the performance and reliability. Recently we received a report that emails could reappear in the INBOX after being deleted. After running a pile of traces, I determined that the problem was strangely related to replications. For the purposes of this discussion, I will refer to the two symmetric replicating servers as A and B. Further, let us assume that during "normal" operation, all the emails are delivered to A via SMTP and are replicated to B. Under those assumptions, if the IMAP user connects to A (where the messages were originally delivered), there is no problem, at least no problem I was able to find. The problem I am describing only arises if the IMAP user connects to B. Connecting to B has never presented any other problems that I am aware of. The test for which I have provided the trace starts with a test mailbox containing only 3 unread messages in the INBOX. Moving 1 of the unread messages to Trash is all that is needed to reproduce the problem. Remember this is ONLY a problem if the IMAP sessions do not connect to the server to which the messages were originally delivered. Also, I found that there is a timing window. The critical IMAP commands are: UID STORE xxx +FLAGS.SILENT (\Seen) UID MOVE xxx Trash If you introduce a large enough delay (I arbitrarily chose 5 seconds) between those two commands, there is no problem. Presumably this has to do with the two boxes syncing up some critical data structure. It takes a short time for the message that was moved to Trash to reappear in the INBOX. The trace initially shows the number of messages going from 3 to 2 when the message is moved to Trash, but a second or so later, the message count goes back up to 3. Interestingly, the reappearing message shows back up as Unseen in the INBOX but a duplicate copy of it stays in Trash as Seen. Dragging unread messages to Trash may not be polite, but it is technically acceptable. Regarding the trace below , CR's show up as \r, LF's show up as \n, and each line starts with S or C depending upon whether it is from the Server or Client. There is blank line following each connection. Thanks, Ron ============================================================================ S * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE I S DLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready.\r\n C 10001 LOGIN testimap(a)usgo.net ***********\r\n S 10001 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENAB S LE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDS S UBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UID S PLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRE S S WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in S \r\n C 10002 STATUS INBOX (MESSAGES UNSEEN)\r\n S * STATUS INBOX (MESSAGES 3 UNSEEN 3)\r\n S 10002 OK Status completed.\r\n C 10003 SELECT INBOX\r\n S * FLAGS (\Answered \Flagged \Deleted \Seen \Draft)\r\n S * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \* S )] Flags permitted.\r\n S * 3 EXISTS\r\n S * 1 RECENT\r\n S * OK [UNSEEN 1] First unseen.\r\n S * OK [UIDVALIDITY 1457030049] UIDs valid\r\n S * OK [UIDNEXT 129] Predicted next UID\r\n S * OK [HIGHESTMODSEQ 417] Highest\r\n S 10003 OK [READ-WRITE] Select completed (0.000 secs).\r\n C 10004 UID SEARCH 3\r\n S * SEARCH 128\r\n S 10004 OK Search completed (0.000 secs).\r\n C 10005 LIST "" Trash\r\n S * LIST (\HasNoChildren \Trash) "." Trash\r\n S 10005 OK List completed.\r\n C 10006 UID STORE 128 +FLAGS.SILENT (\Seen)\r\n S 10006 OK Store completed.\r\n C 10007 UID MOVE 128 Trash\r\n S * OK [COPYUID 1457030331 128 127] Moved UIDs.\r\n S * 3 EXPUNGE\r\n S * 0 RECENT\r\n S 10007 OK Move completed.\r\n C 10008 STATUS INBOX (MESSAGES UNSEEN)\r\n S * STATUS INBOX (MESSAGES 2 UNSEEN 2)\r\n S 10008 OK [CLIENTBUG] Status on selected mailbox completed.\r\n C 10009 STATUS Trash (MESSAGES UNSEEN)\r\n S * STATUS Trash (MESSAGES 1 UNSEEN 0)\r\n S 10009 OK Status completed.\r\n C 10010 LOGOUT\r\n S * BYE Logging out\r\n S 10010 OK Logout completed.\r\n S * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE I S DLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready.\r\n C 10001 LOGIN testimap(a)usgo.net ***********\r\n S 10001 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENAB S LE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDS S UBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UID S PLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRE S S WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in S \r\n C 10002 SELECT INBOX\r\n S * FLAGS (\Answered \Flagged \Deleted \Seen \Draft)\r\n S * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \* S )] Flags permitted.\r\n S * 2 EXISTS\r\n S * 0 RECENT\r\n S * OK [UNSEEN 1] First unseen.\r\n S * OK [UIDVALIDITY 1457030049] UIDs valid\r\n S * OK [UIDNEXT 129] Predicted next UID\r\n S * OK [HIGHESTMODSEQ 419] Highest\r\n S 10002 OK [READ-WRITE] Select completed (0.026 secs).\r\n C 10003 UID FETCH 127 (UID RFC822.SIZE FLAGS INTERNALDATE BODYSTRUCTURE B C ODY.PEEK[HEADER.FIELDS (DATE FROM TO SUBJECT CONTENT-TYPE CC REPLY-TO L C IST-POST DISPOSITION-NOTIFICATION-TO X-PRIORITY IN-REPLY-TO BCC SENDER C MESSAGE-ID CONTENT-TRANSFER-ENCODING REFERENCES X-DRAFT-INFO MAIL-FOLLO C WUP-TO MAIL-REPLY-TO RETURN-PATH)])\r\n S * 2 FETCH (UID 127 RFC822.SIZE 771 FLAGS () INTERNALDATE "08-Mar-2016 0 S 8:48:31 -0600" BODYSTRUCTURE ("text" "plain" ("charset" "us-ascii") NIL S NIL "7bit" 7 1 NIL NIL NIL NIL) BODY[HEADER.FIELDS (DATE FROM TO SUBJE S CT CONTENT-TYPE CC REPLY-TO LIST-POST DISPOSITION-NOTIFICATION-TO X-PRI S ORITY IN-REPLY-TO BCC SENDER MESSAGE-ID CONTENT-TRANSFER-ENCODING REFER S ENCES X-DRAFT-INFO MAIL-FOLLOWUP-TO MAIL-REPLY-TO RETURN-PATH)] {108}\r S \n S From: ron(a)cleven.com\r\n S To: testimap(a)usgo.net\r\n S Date: Tue, 08 Mar 2016 08:48:24 -0600 (CST)\r\n S Subject: test2\r\n S \r\n S )\r\n S 10003 OK Fetch completed.\r\n C 10004 UID FETCH 127 (BODY.PEEK[TEXT])\r\n S * 2 FETCH (UID 127 BODY[TEXT] {7}\r\n S test2\r\n S )\r\n S 10004 OK Fetch completed.\r\n C 10005 UID STORE 127 +FLAGS.SILENT (\Seen)\r\n S 10005 OK Store completed.\r\n C 10006 LOGOUT\r\n S * BYE Logging out\r\n S 10006 OK Logout completed.\r\n S * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE I S DLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready.\r\n C 10001 LOGIN testimap(a)usgo.net ***********\r\n S 10001 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENAB S LE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDS S UBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UID S PLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRE S S WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in S \r\n C 10002 LIST (SUBSCRIBED) "" "*"\r\n S * LIST (\Subscribed) "." Sent\r\n S * LIST (\Subscribed) "." Trash\r\n S * LIST (\Subscribed) "." Drafts\r\n S * LIST (\Subscribed) "." Junk\r\n S * LIST (\Subscribed) "." Blocked\r\n S * LIST (\Subscribed) "." Pending\r\n S * LIST (\Subscribed) "." Archives\r\n S * LIST (\Subscribed) "." Archives.2016\r\n S 10002 OK List completed.\r\n C 10003 STATUS INBOX (MESSAGES UNSEEN)\r\n S * STATUS INBOX (MESSAGES 2 UNSEEN 1)\r\n S 10003 OK Status completed.\r\n C 10004 LOGOUT\r\n S * BYE Logging out\r\n S 10004 OK Logout completed.\r\n S * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE I S DLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready.\r\n C 10001 LOGIN testimap(a)usgo.net ***********\r\n S 10001 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENAB S LE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDS S UBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UID S PLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRE S S WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in S \r\n C 10002 LIST (SUBSCRIBED) "" "*"\r\n S * LIST (\Subscribed) "." Sent\r\n S * LIST (\Subscribed) "." Trash\r\n S * LIST (\Subscribed) "." Drafts\r\n S * LIST (\Subscribed) "." Junk\r\n S * LIST (\Subscribed) "." Blocked\r\n S * LIST (\Subscribed) "." Pending\r\n S * LIST (\Subscribed) "." Archives\r\n S * LIST (\Subscribed) "." Archives.2016\r\n S 10002 OK List completed.\r\n C 10003 STATUS INBOX (MESSAGES UNSEEN)\r\n S * STATUS INBOX (MESSAGES 3 UNSEEN 2)\r\n S 10003 OK Status completed.\r\n C 10004 LOGOUT\r\n S * BYE Logging out\r\n S 10004 OK Logout completed.\r\n ============================================================================

2 1

syncing mailboxes with dsync after switchover
by Sergey Schwartz 16 Mar '16

16 Mar '16

Gents, I'm relocating mailboxes to a new server. Before switching over to a new server I ran syncing a few times without any issues first I sync files with rsync from the old server to have a local copy, then I sync mailboxes with dsync /usr/bin/doveadm -Dv sync -u $MBOX -R "sdbox:/srv/vmail/temp/srv/srv.bgoperator.ru/${MBOX}:DIRNAME=DbOx-mAiLs" After switching over smtp transport and running dsync as above a few mailboxes were deleted dsync(xxx): Warning: Deleting mailbox 'INBOX': UID=1 already exists locally for a different mail: GUIDs don't match (c005a206e1c6e756f02700003a8929e2 vs 0ba1c03796f5dc524c6d0000b4ca29ec) dsync(xxxx): Warning: Deleting mailbox 'INBOX': UID=8855 GUID=80d5841f0fe2e35677630000b4ca29ec is missing locally dsync(xxxxx): Warning: Deleting mailbox 'INBOX': UID=7508 already exists locally for a different mail: GUIDs don't match (1e03d72074d8e756403700003a8929e2 vs 1dc47a3ac5c4e7562a290000b4ca29ec) dsync(xxxxxx): Warning: Deleting mailbox 'INBOX': UID=8238 GUID=2a6a803bd33fe156f85e0000b4ca29ec is missing locally and a few other mailboxes seemed to fail to sync dsync(xxxxxxx): Warning: Mailbox changes caused a desync. You may want to run dsync again. Is it a bug or I am doing something wrong ? -- Best regards, Sergey Schwartz Senior System Administrator Biblio Globus Tour Operator www.bgoperator.ru T: +7 495 5042500 ext 1532 E: sergey.schwartz(a)bgoperator.com

2 2

VS: New dovecot user needs installation help
by Aki Tuomi 15 Mar '16

15 Mar '16

Can yoi run doveadm log errors too? ---Aki TuomiDovecot oy -------- Alkuperäinen viesti --------Lähettäjä: Jason Pruim <pruimj(a)gmail.com> Päivämäärä: 15.3.2016 4.50 (GMT+02:00) Saaja: dovecot(a)dovecot.org Aihe: New dovecot user needs installation help Hey Everyone, So I just setup my first dovecot install with postfix running for the mail server… I can telnet into my dovecot install and login just fine with my user locally… But when I try to add the account from my phone, computer, or telnetting from my local computer, it just hangs and eventually kicks back a generic error saying it can’t be added… Where can I start looking? I’m hosted with amazon web services and I’m waiting on them to approve my request to white list my IP on my instance, but that should only restrict my ability to send email out on port 25… I should still be able to operate locally… According to the firewall on amazon port 143 and 993 are both allowed from any IP address into the server (All outbound traffic is currently open until I get it working) I’m thinking it’s something easy, and I can handle pointers! I don’t necessarily need my hand held the entire way… At least not yet… Here is the output of my dovecot -n: [ec2-user@ip-172-31-22-222 log]$ dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 3.14.48-33.39.amzn1.x86_64 x86_64 mail_location = mbox:~/mail:INBOX=/var/mail/%u mbox_write_locks = fcntl passdb { driver = pam } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } [ec2-user@ip-172-31-22-222 log]$ Let me know if there is anything else you need, or where to go from here! Thanks in advance! Jason Pruim pruimj(a)gmail.com

2 1

dovecot wiki...
by Andrew McGlashan 15 Mar '16

15 Mar '16

Hi, Just want to know if this is a problem at my end (in my browser), or if it is something else. When I copy text from the wiki, the page changes to an edit one; that is very, very annoying. How can I stop this if it is normal dovecot wiki behaviour and what do you think I might look at in my browser if it isn't? I'm never likely to want to edit the wiki any time soon. Thanks AndrewM

3 3

Logging the TLS cipher suite
by Luigi Rosa 12 Mar '16

12 Mar '16

Hi, could it be possible to log the TLS cipher suite as Postfix does? This is a typical TLS Dovecot log line: imap-login: Login: user=<user(a)acme.com>, method=DIGEST-MD5, rip=1.2.3.4, lip=4.3.2.1, mpid=19671, TLS, session=<Jsvr46wt2c1ScQfY> This is the Postfix equivalent postfix/smtp[59723]: Anonymous TLS connection established to mail.acmne.com[1.2.3.4]:25: TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits) -- Ciao, luigi / +--[Luigi Rosa]-- \ We're not surrounded, we're in a target-rich environment!

2 3