- dovecot - dovecot.org

Dovecot and Postfix
by Jerry 30 Jun '14

30 Jun '14

Does this configuration look sane? I seem to have a few duplicates and I am not sure if that is a problem or not. It seems I have multiple "userdb" sections and I am not sure where they are all originating from. # 2.2.13: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-RELEASE-p3 amd64 ufs auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain log_path = /var/log/dovecot mail_location = maildir:/var/mail/vmail/seibercom/gerard managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = username_format=%u /usr/local/etc/dovecot/user/passwd driver = passwd-file } passdb { driver = pam } passdb { args = scheme=CRYPT username_format=%u /usr/local/etc/dovecot/user/passwd driver = passwd-file } plugin { sieve_global_path = /usr/local/etc/dovecot/sieve/default.sieve } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail user = vmail } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = username_format=%u /usr/local/etc/dovecot/user/passwd default_fields = uid=vmail gid=vmail driver = passwd-file } userdb { driver = passwd } userdb { args = username_format=%u /usr/local/etc/dovecot/user/passwd driver = passwd-file } protocol lda { mail_plugins = " sieve" }

2 4

Sieve seems to break mailbody during automatic redirection
by Urban Loesch 30 Jun '14

30 Jun '14

Hi, I have a strange problem with sieve. After upgrading to 2.2.13 sieve seems to break the mailbody during automatic redirection. I have the following configuration. - User A sends mail to User B. - User B has an automatic redirect to User C - User C geht the mailbody broken I did some debugging. This is a part of the mailbody which i grabbed from the mailqueue before the mail gets delivered to user B: ... Message-ID: <53B12105.2020207(a)domain.net> Date: Mon, 30 Jun 2014 10:34:13 +0200 From: =?ISO-8859-15?Q?Urban_L=F6sch_Enas?= <userA(a)domain.net> User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Urban Loesch <userB(a)domain.net> Subject: testmail 5 X-Enigmail-Version: 1.6 Content-Type: multipart/mixed; boundary="------------040308070600090201000704" This is a multi-part message in MIME format. --------------040308070600090201000704 Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 7bit --------------040308070600090201000704 Content-Type: application/rtf; name="elenco_siti_inibiti.2.rtf" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="elenco_siti_inibiti.2.rtf" e1xydGYxXGFkZWZsYW5nMTAyNVxhbnNpXGFuc2ljcGcxMjUyXHVjMVxhZGVmZjBcZGVmZjBc c3RzaGZkYmNoMFxzdHNoZmxvY2gwXHN0c2hmaGljaDBcc3RzaGZiaTBcZGVmbGFuZzEwNDBc ZGVmbGFuZ2ZlMTA0MFx0aGVtZWxhbmcxMDQwXHRoZW1lbGFuZ2ZlMFx0aGVtZWxhbmdjczB7 XGZvbnR0Ymx7XGYwXGZiaWRpIFxmcm9tYW5cZmNoYXJzZXQwXGZwcnEye1wqXHBhbm9zZSAw MjAyMDYwMzA1MDQwNTAyMDMwNH1UaW1lcyBOZXcgUm9tYW47fQ0Ke1xmMVxmYmlkaSBcZnN3 aXNzXGZjaGFyc2V0MFxmcHJxMntcKlxwYW5vc2UgMDIwYjA2MDQwMjAyMDIwMjAyMDR9QXJp YWx7XCpcZmFsdCBBcmlhbH07fXtcZjJcZmJpZGkgXGZtb2Rlcm5cZmNoYXJzZXQwXGZwcnEx e1wqXHBhbm9zZSAwMjA3MDMwOTAyMDIwNTAyMDQwNH1Db3VyaWVyIE5ldzt9e1xmM1xmYmlk aSBcZnJvbWFuXGZjaGFyc2V0MlxmcHJxMntcKlxwYW5vc2UgMDUwNTAxMDIwMTA3MDYwMjA1 MDd9U3ltYm9sO30NCntcZjRcZmJpZGkgXGZzd2lzc1xmY2hhcnNldDBcZnBycTJ7XCpccGFu b3NlIDAyMGIwNjA0MDIwMjAyMDIwMjA0fUhlbHZldGljYTt9e1xmNVxmYmlkaSBcZm1vZGVy blxmY2hhcnNldDBcZnBycTF7XCpccGFub3NlIDAyMDcwNDA5MDIwMjA1MDIwNDA0fUNvdXJp ZXI7fXtcZjZcZmJpZGkgXGZyb21hblxmY2hhcnNldDBcZnBycTJ7XCpccGFub3NlIDAyMDIw NjAzMDQwNTA1MDIwMzA0fVRtcyBSbW57XCpcZmFsdCBUaW1lcyBOZXcgUm9tYW59O30NCntc ZjdcZmJpZGkgXGZzd2lzc1xmY2hhcnNldDBcZnBycTJ7XCpccGFub3NlIDAyMGIwNjA0MDIw MjAyMDMwMjA0fUhlbHY7fXtcZjhcZmJpZGkgXGZyb21hblxmY2hhcnNldDBcZnBycTJ7XCpc cGFub3NlIDAyMDQwNTAzMDYwNTA2MDIwMzA0fU5ldyBZb3JrO317XGY5XGZiaWRpIFxmc3dp c3NcZmNoYXJzZXQwXGZwcnEye1wqXHBhbm9zZSAwMDAwMDAwMDAwMDAwMDAwMDAwMH1TeXN0 ZW07fQ0Ke1xmMTBcZmJpZGkgXGZuaWxcZmNoYXJzZXQyXGZwcnEye1wqXHBhbm9zZSAwNTAw MDAwMDAwMDAwMDAwMDAwMH1XaW5nZGluZ3M7fXtcZjExXGZiaWRpIFxmbW9kZXJuXGZjaGFy c2V0MTI4XGZwcnExe1wqXHBhbm9zZSAwMjAyMDYwOTA0MDIwNTA4MDMwNH1NUyBNaW5jaG97 XCpcZmFsdCA/bD9yID8/XCc4MVwnNjZjfTt9DQp7XGYxMlxmYmlkaSBcZnJvbWFuXGZjaGFy c2V0MTI5XGZwcnEye1wqXHBhbm9zZSAwMjAzMDYwMDAwMDEwMTAxMDEwMX1CYXRhbmd7XCpc ZmFsdCA/Pz8/P0U/Pz8/P0VjRT8/Pz8/RT8/Y0VjRT8/Pz8/fTt9e1xmMTNcZmJpZGkgXGZu aWxcZmNoYXJzZXQxMzRcZnBycTJ7XCpccGFub3NlIDAyMDEwNjAwMDMwMTAxMDEwMTAxfVNp bVN1bntcKlxmYWx0ID8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz99O30NCntcZjE0 XGZiaWRpIFxmcm9tYW5cZmNoYXJzZXQxMzZcZnBycTJ7XCpccGFub3NlIDAyMDIwNTAwMDAw MDAwMDAwMDAwfVBNaW5nTGlVe1wqXGZhbHQgIVBzMk9jdUFlfTt9e1xmMTVcZmJpZGkgXGZt b2Rlcm5cZmNoYXJzZXQxMjhcZnBycTF7XCpccGFub3NlIDAyMGIwNjA5MDcwMjA1MDgwMjA0 fU1TIEdvdGhpY3tcKlxmYWx0ID9sP3IgP1M/Vj9iP059O30NCntcZjE2XGZiaWRpIFxmc3dp c3NcZmNoYXJzZXQxMjlcZnBycTJ7XCpccGFub3NlIDAyMGIwNjAwMDAwMTAxMDEwMTAxfURv dHVte1wqXGZhbHQgPz8/Pz9FPz9jRT8/Pz8/RWNFPz8/Pz9FPz8/Pz9FY307fXtcZjE3XGZi aWRpIFxmbW9kZXJuXGZjaGFyc2V0MTM0XGZwcnExe1wqXHBhbm9zZSAwMjAxMDYwOTA2MDEw MTAxMDEwMX1TaW1IZWl7XCpcZmFsdCBvPz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/ fTt9DQp7XGYxOFxmYmlkaSBcZm1vZGVyblxmY2hhcnNldDEzNlxmcHJxMXtcKlxwYW5vc2Ug ... Looks normal to me. Now: This is the part of the mailbody which i grabbed from the mailqueue after user B has received the mail and sieve has injectd it to the mailqueue for delivering to user C. ... Message-ID: <53B12105.2020207(a)domain.net> Date: Mon, 30 Jun 2014 10:34:13 +0200 From: =?ISO-8859-15?Q?Urban_L=F6sch_Enas?= <userA(a)domain.net> User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Urban Loesch <userB(a)domain.net> Subject: testmail 5 X-Enigmail-Version: 1.6 Content-Type: multipart/mixed; boundary="------------040308070600090201000704" This is a multi-part message in MIME format.^M --------------040308070600090201000704^M Content-Type: text/plain; charset=ISO-8859-15^M Content-Transfer-Encoding: 7bit^M ^M ^M --------------040308070600090201000704^M Content-Type: application/rtf;^M name="elenco_siti_inibiti.2.rtf"^M Content-Transfer-Encoding: base64^M Content-Disposition: attachment;^M filename="elenco_siti_inibiti.2.rtf"^M ^M e1xydGYxXGFkZWZsYW5nMTAyNVxhbnNpXGFuc2ljcGcxMjUyXHVjMVxhZGVmZjBcZGVmZjBc^M c3RzaGZkYmNoMFxzdHNoZmxvY2gwXHN0c2hmaGljaDBcc3RzaGZiaTBcZGVmbGFuZzEwNDBc^M ZGVmbGFuZ2ZlMTA0MFx0aGVtZWxhbmcxMDQwXHRoZW1lbGFuZ2ZlMFx0aGVtZWxhbmdjczB7^M XGZvbnR0Ymx7XGYwXGZiaWRpIFxmcm9tYW5cZmNoYXJzZXQwXGZwcnEye1wqXHBhbm9zZSAw^M MjAyMDYwMzA1MDQwNTAyMDMwNH1UaW1lcyBOZXcgUm9tYW47fQ0Ke1xmMVxmYmlkaSBcZnN3^M aXNzXGZjaGFyc2V0MFxmcHJxMntcKlxwYW5vc2UgMDIwYjA2MDQwMjAyMDIwMjAyMDR9QXJp^M YWx7XCpcZmFsdCBBcmlhbH07fXtcZjJcZmJpZGkgXGZtb2Rlcm5cZmNoYXJzZXQwXGZwcnEx^M e1wqXHBhbm9zZSAwMjA3MDMwOTAyMDIwNTAyMDQwNH1Db3VyaWVyIE5ldzt9e1xmM1xmYmlk^M aSBcZnJvbWFuXGZjaGFyc2V0MlxmcHJxMntcKlxwYW5vc2UgMDUwNTAxMDIwMTA3MDYwMjA1^M MDd9U3ltYm9sO30NCntcZjRcZmJpZGkgXGZzd2lzc1xmY2hhcnNldDBcZnBycTJ7XCpccGFu^M b3NlIDAyMGIwNjA0MDIwMjAyMDIwMjA0fUhlbHZldGljYTt9e1xmNVxmYmlkaSBcZm1vZGVy^M blxmY2hhcnNldDBcZnBycTF7XCpccGFub3NlIDAyMDcwNDA5MDIwMjA1MDIwNDA0fUNvdXJp^M ZXI7fXtcZjZcZmJpZGkgXGZyb21hblxmY2hhcnNldDBcZnBycTJ7XCpccGFub3NlIDAyMDIw^M NjAzMDQwNTA1MDIwMzA0fVRtcyBSbW57XCpcZmFsdCBUaW1lcyBOZXcgUm9tYW59O30NCntc^M ZjdcZmJpZGkgXGZzd2lzc1xmY2hhcnNldDBcZnBycTJ7XCpccGFub3NlIDAyMGIwNjA0MDIw^M MjAyMDMwMjA0fUhlbHY7fXtcZjhcZmJpZGkgXGZyb21hblxmY2hhcnNldDBcZnBycTJ7XCpc^M cGFub3NlIDAyMDQwNTAzMDYwNTA2MDIwMzA0fU5ldyBZb3JrO317XGY5XGZiaWRpIFxmc3dp^M c3NcZmNoYXJzZXQwXGZwcnEye1wqXHBhbm9zZSAwMDAwMDAwMDAwMDAwMDAwMDAwMH1TeXN0^M ZW07fQ0Ke1xmMTBcZmJpZGkgXGZuaWxcZmNoYXJzZXQyXGZwcnEye1wqXHBhbm9zZSAwNTAw^M MDAwMDAwMDAwMDAwMDAwMH1XaW5nZGluZ3M7fXtcZjExXGZiaWRpIFxmbW9kZXJuXGZjaGFy^M c2V0MTI4XGZwcnExe1wqXHBhbm9zZSAwMjAyMDYwOTA0MDIwNTA4MDMwNH1NUyBNaW5jaG97^M XCpcZmFsdCA/bD9yID8/XCc4MVwnNjZjfTt9DQp7XGYxMlxmYmlkaSBcZnJvbWFuXGZjaGFy^M c2V0MTI5XGZwcnEye1wqXHBhbm9zZSAwMjAzMDYwMDAwMDEwMTAxMDEwMX1CYXRhbmd7XCpc^M ZmFsdCA/Pz8/P0U/Pz8/P0VjRT8/Pz8/RT8/Y0VjRT8/Pz8/fTt9e1xmMTNcZmJpZGkgXGZu^M aWxcZmNoYXJzZXQxMzRcZnBycTJ7XCpccGFub3NlIDAyMDEwNjAwMDMwMTAxMDEwMTAxfVNp^M bVN1bntcKlxmYWx0ID8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz99O30NCntcZjE0^M XGZiaWRpIFxmcm9tYW5cZmNoYXJzZXQxMzZcZnBycTJ7XCpccGFub3NlIDAyMDIwNTAwMDAw^M MDAwMDAwMDAwfVBNaW5nTGlVe1wqXGZhbHQgIVBzMk9jdUFlfTt9e1xmMTVcZmJpZGkgXGZt^M b2Rlcm5cZmNoYXJzZXQxMjhcZnBycTF7XCpccGFub3NlIDAyMGIwNjA5MDcwMjA1MDgwMjA0^M fU1TIEdvdGhpY3tcKlxmYWx0ID9sP3IgP1M/Vj9iP059O30NCntcZjE2XGZiaWRpIFxmc3dp^M c3NcZmNoYXJzZXQxMjlcZnBycTJ7XCpccGFub3NlIDAyMGIwNjAwMDAwMTAxMDEwMTAxfURv^M dHVte1wqXGZhbHQgPz8/Pz9FPz9jRT8/Pz8/RWNFPz8/Pz9FPz8/Pz9FY307fXtcZjE3XGZi^M aWRpIFxmbW9kZXJuXGZjaGFyc2V0MTM0XGZwcnExe1wqXHBhbm9zZSAwMjAxMDYwOTA2MDEw^M MTAxMDEwMX1TaW1IZWl7XCpcZmFsdCBvPz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/Pz8/^M fTt9DQp7XGYxOFxmYmlkaSBcZm1vZGVyblxmY2hhcnNldDEzNlxmcHJxMXtcKlxwYW5vc2Ug^M MDIwMjA1MDkwMDAwMDAwMDAwMDB9TWluZ0xpVXtcKlxmYWx0IDJPY3VBZX07fXtcZjE5XGZi^M aWRpIFxmcm9tYW5cZmNoYXJzZXQxMjhcZnBycTF7XCpccGFub3NlIDAyMDIwNjA5MDQwMzA1^M MDgwMzA1fU1pbmNob3tcKlxmYWx0ID8/XCc4MVwnNjZjfTt9DQp7XGYyMFxmYmlkaSBcZnN3^M ... The part of the mail-header looks normal. But as you can see at beginning of the mailbody something inserts the strange character "^M" after each newline. According to Google this is a endline charachter from Windows. And this seems to break some clients (Eg. Lotus Notes). With dovecot version 2.1.x I don't have this problem. Have you any solution for me? Many thanks Urban Loesch

2 2

Any issues with dsync between 2.1.7 and 2.2.9 ?
by deano-dovecot＠areyes.com 29 Jun '14

29 Jun '14

My current production system is running dovecot 2.1.7-7ubuntu1 on Ubuntu 13.04, and I'm building a new setup based on Ubuntu 14.04 with dovecot 2.2.9-1ubuntu2.1 - current standard in the repos. I'd like to use replication to get the mailstore from the old system to the new. Are there any caveats or gotchas to be aware of ? Is it possible to make it a one-way replication ? So problems or glitches on the new setup don't propagate to the old production ? Thanks - D.

1 0

Procmail to Sieve translation
by Gerhard Wiesinger 28 Jun '14

28 Jun '14

Hello, I'm trying to move from procmail to dovecot sieve. I found the translation script at http://www.dovecot.org/tools/procmail2sieve.pl It works well except the following use cases: * ^From:.*myemail@mydomain.com.* | formail -I"X-Priority: 2 (high)" -I"X-mydomain-com-seen: yes" | $SENDMAIL -oi \ myemail(a)mydomain2.com \ myemail(a)mydomain3.com :0c * ^From:.*myemail@mydomain.com.* ! +1123456789(a)mysmsprovider.com :0c * ^(To|Cc|Bcc):.*myemail@mydomain.com.* ! myemail(a)mydomain2.com myemail(a)mydomain3.com Is there a possibility to support these use cases (can be done manually)? How does forwarding to another domain work at the deliver process? :copy seems not to be supported, right? Thank you. Ciao, Gerhard

2 3

Dovecot virtual and SASL with Postfix
by Jerry 28 Jun '14

28 Jun '14

This is my first attempt to set up virtual users and sasl with Postfix. Can I use a regular password file in this format: user:{plain}password user2:{plain}password2 or do I need to use a different format? I have been trying to find an example of a virtual user SASL file, but without any luck. I suck at Googling too. All of the mail will be delivered to :/var/mail/vmail/<domain>/<user> -- Jerry

2 2

change dovecot mbox localtion
by Charlot W 28 Jun '14

28 Jun '14

hi, i use: dovecot 1.2.7, sendmail and unbuntu to serve my mail service. recent my disk space is not enough, so i want to mange my mail in two ways: *1. change the mail location:* i use: mail_location = mbox:/var/mail:INBOX=/var/mail/%u when i changed it to mail_location = mbox:/home/mail:INBOX=/home/mail/%u but the mail still write to the old path *2. limit the mail file size* i want the mail file reduce when it reach to 100MB how can i config dovecot/sendmail to do in last 2 ways? thank you all:)

1 0

mixing Maildir and mdbox
by gustavo panizzo <gfa> 28 Jun '14

28 Jun '14

Hello i'm in the process to architect a new email system. i plan to use dovecot 2.2.9 (debian's wheezy). i would like to use maildir for 2 folders on each account (spam and no-spam) and the rest of the folders stored on mdbox. this should be opaque to my users. the reason for this, is i want to be able to train my anti-spam tools, but they read maildir or mbox, they don't read mdbox or dbox. but i want the other folders as mdbox (performance, backups, alternate storage) is there any way?, i prefer if is configurable in advance for all accounts but i could live with something that is done after account is created thanks! PD: please keep me CC'ed as i'm not subscribed to the list -- 1AE0 322E B8F7 4717 BDEA BF1D 44BB 1BA7 9F6C 6333

1 0

remove unreferenced files from mail_attachment_dir
by Hardy Flor 27 Jun '14

27 Jun '14

Hello, I restore a backup from all users (mail_location ...) the mail_attachment_dir backup was not from the same time. How can I the unreferenced files from mail_attachment_dir? Hardy

1 0

[Dovecot] mdbox-files not approximately 2 MB
by Hardy Flor 27 Jun '14

27 Jun '14

Hello, there are copies with different size in 3 mailboxes of the user sequentially about 3800 emails. why not something 2MB files? After the big file "m.00000034" with 14MB follow very many small ... ------------------------------------- doveconf: # 2.2.12: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 ext4 mail_attachment_dir = /var/mail/attachments mail_attachment_hash = %{md5} mail_attachment_min_size = 16 k mail_location = mdbox:/var/mail/user/%n mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 2 M ------------------------------------- directory: root@xxx:/var/mail/user/xxx/storage# ls -al insgesamt 76532 drwx--S--- 2 vmail mail 4096 Mär 16 13:52 . drwx--S--- 6 vmail mail 4096 Mär 16 12:10 .. -rw------- 1 vmail mail 74360 Mär 16 12:39 dovecot.map.index -rw------- 1 vmail mail 25204 Mär 16 13:52 dovecot.map.index.log -rw------- 1 vmail mail 63544 Mär 16 12:39 dovecot.map.index.log.2 -rw------- 1 vmail mail 2092921 Mär 16 12:15 m.00000001 -rw------- 1 vmail mail 2086746 Mär 16 12:15 m.00000002 -rw------- 1 vmail mail 2084182 Mär 16 12:15 m.00000003 -rw------- 1 vmail mail 2096826 Mär 16 12:15 m.00000004 -rw------- 1 vmail mail 1882666 Mär 16 12:15 m.00000005 -rw------- 1 vmail mail 1903965 Mär 16 12:15 m.00000006 -rw------- 1 vmail mail 2091169 Mär 16 12:15 m.00000007 -rw------- 1 vmail mail 2086396 Mär 16 12:15 m.00000008 -rw------- 1 vmail mail 507205 Mär 16 12:16 m.00000009 -rw------- 1 vmail mail 2031456 Mär 16 12:17 m.00000010 -rw------- 1 vmail mail 2095697 Mär 16 12:17 m.00000011 -rw------- 1 vmail mail 1689071 Mär 16 12:17 m.00000012 -rw------- 1 vmail mail 2092124 Mär 16 12:17 m.00000013 -rw------- 1 vmail mail 1950602 Mär 16 12:17 m.00000014 -rw------- 1 vmail mail 2092215 Mär 16 12:17 m.00000015 -rw------- 1 vmail mail 2087463 Mär 16 12:17 m.00000016 -rw------- 1 vmail mail 2079795 Mär 16 12:17 m.00000017 -rw------- 1 vmail mail 2014121 Mär 16 12:17 m.00000018 -rw------- 1 vmail mail 2081893 Mär 16 12:17 m.00000019 -rw------- 1 vmail mail 2092088 Mär 16 12:17 m.00000020 -rw------- 1 vmail mail 2090508 Mär 16 12:17 m.00000021 -rw------- 1 vmail mail 1929296 Mär 16 12:17 m.00000022 -rw------- 1 vmail mail 2067685 Mär 16 12:17 m.00000023 -rw------- 1 vmail mail 1745743 Mär 16 12:20 m.00000024 -rw------- 1 vmail mail 866452 Mär 16 12:20 m.00000025 -rw------- 1 vmail mail 296379 Mär 16 12:20 m.00000026 -rw------- 1 vmail mail 433541 Mär 16 12:39 m.00000027 -rw------- 1 vmail mail 92526 Mär 16 12:39 m.00000028 -rw------- 1 vmail mail 19094 Mär 16 12:39 m.00000029 -rw------- 1 vmail mail 106837 Mär 16 12:39 m.00000030 -rw------- 1 vmail mail 162012 Mär 16 12:39 m.00000031 -rw------- 1 vmail mail 412080 Mär 16 13:51 m.00000032 -rw------- 1 vmail mail 1715868 Mär 16 13:51 m.00000033 -rw------- 1 vmail mail 14433784 Mär 16 13:51 m.00000034 -rw------- 1 vmail mail 3280 Mär 16 13:51 m.00000035 -rw------- 1 vmail mail 6308 Mär 16 13:51 m.00000036 -rw------- 1 vmail mail 534274 Mär 16 13:51 m.00000037 -rw------- 1 vmail mail 378719 Mär 16 13:51 m.00000038 -rw------- 1 vmail mail 458528 Mär 16 13:51 m.00000039 -rw------- 1 vmail mail 192504 Mär 16 13:51 m.00000040 -rw------- 1 vmail mail 1277766 Mär 16 13:51 m.00000041 -rw------- 1 vmail mail 33417 Mär 16 13:51 m.00000042 -rw------- 1 vmail mail 142866 Mär 16 13:51 m.00000043 -rw------- 1 vmail mail 113529 Mär 16 13:51 m.00000044 -rw------- 1 vmail mail 55888 Mär 16 13:51 m.00000045 -rw------- 1 vmail mail 673504 Mär 16 13:51 m.00000046 -rw------- 1 vmail mail 430738 Mär 16 13:51 m.00000047 -rw------- 1 vmail mail 218494 Mär 16 13:51 m.00000048 -rw------- 1 vmail mail 96165 Mär 16 13:51 m.00000049 -rw------- 1 vmail mail 8370 Mär 16 13:51 m.00000050 -rw------- 1 vmail mail 29251 Mär 16 13:51 m.00000051 -rw------- 1 vmail mail 394680 Mär 16 13:51 m.00000052 -rw------- 1 vmail mail 674892 Mär 16 13:51 m.00000053 -rw------- 1 vmail mail 1076919 Mär 16 13:51 m.00000054 -rw------- 1 vmail mail 258806 Mär 16 13:51 m.00000055 -rw------- 1 vmail mail 60069 Mär 16 13:51 m.00000056 -rw------- 1 vmail mail 297891 Mär 16 13:51 m.00000057 -rw------- 1 vmail mail 92772 Mär 16 13:51 m.00000058 -rw------- 1 vmail mail 129272 Mär 16 13:51 m.00000059 -rw------- 1 vmail mail 56073 Mär 16 13:51 m.00000060 -rw------- 1 vmail mail 528260 Mär 16 13:51 m.00000061 -rw------- 1 vmail mail 29468 Mär 16 13:51 m.00000062 -rw------- 1 vmail mail 3250 Mär 16 13:51 m.00000063 -rw------- 1 vmail mail 96445 Mär 16 13:51 m.00000064 -rw------- 1 vmail mail 337663 Mär 16 13:51 m.00000065 -rw------- 1 vmail mail 187505 Mär 16 13:51 m.00000066 -rw------- 1 vmail mail 98839 Mär 16 13:51 m.00000067 -rw------- 1 vmail mail 5294 Mär 16 13:51 m.00000068 -rw------- 1 vmail mail 28276 Mär 16 13:51 m.00000069 -rw------- 1 vmail mail 67950 Mär 16 13:52 m.00000070 -rw------- 1 vmail mail 704457 Mär 16 13:52 m.00000071 -rw------- 1 vmail mail 1410205 Mär 16 13:52 m.00000072 -rw------- 1 vmail mail 736330 Mär 16 13:52 m.00000073 -rw------- 1 vmail mail 616992 Mär 16 13:52 m.00000074

1 1

Re: question on lmtp logged message
by Leonardo Rodrigues 27 Jun '14

27 Jun '14

Hi Steffen, Em 26/06/14 11:06, Steffen Kaiser escreveu: > > maildir_copy_with_hardlinks is set on my server, too. It's the default > now. I do not see these errors. > > Can you check if the failed recipient is _never_ the first one? I > remember some discussions about that the Dovecot LDA has to re-open > the storred message of the first recipient, in order to spool it for > the other ones. That caused problems because the server used an > user-specific encryption key. > > If that applies to LMTP, too, this might become problematic, if the > first recipient deletes the message very quickly. Therefore my > question, if the error pops up for the second recipient and maybe all > following ones. Just did some more scripting and got a total of 1413 distinct emails (distinct queueids) that suffered from this 'message was expunged' problem on the 36 hours i got the problems. As noted before, not even a single one of these 1413 were nrcpt=1. Problems were from nrcpt=2 or greater. So, whatever this is, it really seems to NOT affect single recipient messages. As you suspected, on those 1413 the very first recipient ALWAYS got a status=sent from dovecot/lmtp. "Message was expunged" never happened on the very first recipient delivery. About the first user (the first delivered message) checking the message right after delivery, i tried to confirm that by the logs. To make things a little easier, i used nrcpt=2 and nrcpt=3 situations, just to avoid posting lots of logs here. Case #1 1st recipient delivery OK, failed on 2nd recipient, just delivered successfully on 2nd try Jun 25 17:08:53 correio postfix/qmgr[3059]: 2AFA01BF7496F: from=<alejandro.miguel(a)domain.com.br>, size=49366, nrcpt=2 (queue active) Jun 25 17:09:52 correio postfix/lmtp[6029]: 2AFA01BF7496F: to=<fabio.kado(a)domain.com.br>, relay=correio.domain.com.br[private/dovecot-lmtp], delay=59, delays=0.01/47/0/12, dsn=2.0.0, status=sent (250 2.0.0 <fabio.kado(a)domain.com.br> UbjnEywqq1MTPwAAHvf8vg Saved) Jun 25 17:09:55 correio postfix/lmtp[6029]: 2AFA01BF7496F: to=<marcelo.roberto(a)domain.com.br>, relay=correio.domain.com.br[private/dovecot-lmtp], delay=63, delays=0.01/47/0/16, dsn=4.2.0, status=deferred (host correio.domain.com.br[private/dovecot-lmtp] said: 451 4.2.0 <marcelo.roberto(a)domain.com.br> Message was expunged (received-date) (in reply to end of DATA command)) Jun 25 17:24:11 correio postfix/lmtp[26595]: 2AFA01BF7496F: to=<marcelo.roberto(a)domain.com.br>, relay=correio.domain.com.br[private/dovecot-lmtp], delay=918, delays=908/0/0/10, dsn=2.0.0, status=sent (250 2.0.0 <marcelo.roberto(a)domain.com.br> hWS4JMorq1OIdAAAHvf8vg Saved) and in fact the first recipient was checking its email during the LMTP delivery. This is the actual order of the logs: Jun 25 17:09:47 correio dovecot: pop3-login: Login: user=<fabio.kado(a)domain.com.br>, method=PLAIN, rip=10.253.x.x, lip=10.252.x.x, mpid=21164 Jun 25 17:09:52 correio postfix/lmtp[6029]: 2AFA01BF7496F: to=<fabio.kado(a)domain.com.br>, relay=correio.domain.com.br[private/dovecot-lmtp], delay=59, delays=0.01/47/0/12, dsn=2.0.0, status=sent (250 2.0.0 <fabio.kado(a)domain.com.br> UbjnEywqq1MTPwAAHvf8vg Saved) Jun 25 17:09:52 correio dovecot: pop3(fabio.kado(a)domain.com.br), rip=10.253.x.x, lip=10.252.x.x: Disconnected: Logged out top=0/0, retr=1/49582, del=1/1, size=49550 and by the size= of the 'disconnected' pop3 log (size=49550) and the size from qmgr (size=49366), user really seems to have checked (and deleted after that) exactly the message right BEFORE the 2nd recipient delivery was tried by LMTP Case #2 1st and 2nd recipient delivery OK, failed on 3rd recipient, just delivered successfully on 2nd try Jun 25 10:00:31 correio postfix/qmgr[804]: EFEB31A4BB227: from=<andrei.lunkes(a)domain.com.br>, size=26667, nrcpt=3 (queue active) Jun 25 10:00:47 correio postfix/lmtp[6549]: EFEB31A4BB227: to=<marcos.pereira(a)domain.com.br>, relay=correio.domain.com.br[private/dovecot-lmtp], delay=16, delays=0/0/0/16, dsn=2.0.0, status=sent (250 2.0.0 <marcos.pereira(a)domain.com.br> uTsNO+/HqlOHGQAAHvf8vg Saved) Jun 25 10:00:54 correio postfix/lmtp[6549]: EFEB31A4BB227: to=<mario.cabreira(a)domain.com.br>, relay=correio.domain.com.br[private/dovecot-lmtp], delay=22, delays=0/0/0/22, dsn=2.0.0, status=sent (250 2.0.0 <mario.cabreira(a)domain.com.br> uTsNO+/HqlOHGQAAHvf8vg Saved) Jun 25 10:00:55 correio postfix/lmtp[6549]: EFEB31A4BB227: to=<wellington.camargo(a)domain.com.br>, relay=correio.domain.com.br[private/dovecot-lmtp], delay=24, delays=0/0/0/24, dsn=4.2.0, status=deferred (host correio.domain.com.br[private/dovecot-lmtp] said: 451 4.2.0 <wellington.camargo(a)domain.com.br> Message was expunged (received-date) (in reply to end of DATA command)) Jun 25 10:03:57 correio postfix/lmtp[7312]: EFEB31A4BB227: to=<wellington.camargo(a)domain.com.br>, relay=correio.domain.com.br[private/dovecot-lmtp], delay=205, delays=202/1/0/2.2, dsn=2.0.0, status=sent (250 2.0.0 <wellington.camargo(a)domain.com.br> j1dRAU/IqlN6QAAAHvf8vg Saved) 1st recipient in fact checked email (and deleted the message) right after the delivery. Actual log sequence is: Jun 25 10:00:40 correio dovecot: pop3-login: Login: user=<marcos.pereira(a)domain.com.br>, method=PLAIN, rip=10.253.22.56, lip=10.252.38.2, mpid=7233 Jun 25 10:00:47 correio postfix/lmtp[6549]: EFEB31A4BB227: to=<marcos.pereira(a)domain.com.br>, relay=correio.domain.com.br[private/dovecot-lmtp], delay=16, delays=0/0/0/16, dsn=2.0.0, status=sent (250 2.0.0 <marcos.pereira(a)domain.com.br> uTsNO+/HqlOHGQAAHvf8vg Saved) Jun 25 10:00:48 correio dovecot: pop3(marcos.pereira(a)domain.com.br), rip=10.253.22.56, lip=10.252.38.2: Disconnected: Logged out top=0/0, retr=1/26872, del=1/1, size=26849 2nd recipient did NOT checked email near the delivery Jun 25 09:54:08 correio dovecot: pop3-login: Login: user=<mario.cabreira(a)domain.com.br>, method=PLAIN, rip=10.253.22.72, lip=10.252.38.2, mpid=29125 Jun 25 09:54:12 correio dovecot: pop3(mario.cabreira(a)domain.com.br), rip=10.253.22.72, lip=10.252.38.2: Disconnected: Logged out top=0/0, retr=11/1408320, del=11/11, size=1408058 Jun 25 10:06:49 correio dovecot: pop3-login: Login: user=<mario.cabreira(a)domain.com.br>, method=PLAIN, rip=10.253.22.72, lip=10.252.38.2, mpid=13391 Jun 25 10:06:50 correio dovecot: pop3(mario.cabreira(a)domain.com.br), rip=10.253.22.72, lip=10.252.38.2: Disconnected: Logged out top=0/0, retr=10/1923222, del=10/10, size=1923004 this is interesting ... logs seems to show clearly that right after the message was delivered to the 1st recipient, it was checked and deleted. Despite of that, 2nd recipient got the message successfully delivered. But we have also a delay=22 ... maybe lmtp instance had already opened the message BEFORE it was erased by the 1st user ? this delay is high, i know that and, usually, server do NOT suffer from this delays on deliveries. Anyway, during this problem period, queues were pretty large and, thus, load was very high, which i think explains this unusual delays. With these two cases, it really seems that this is somehow related to: - lmtp as delivery agent - multiple recipient messages - first (or previous users in fact) checked and deleted the message before all the recipients got the message delivery About the two parameters, maildir_copy_with_hardlinks and pop3_fast_size_lookups, i'll try to change them one at a time and try to reproduce the problems. Fact is i only had the problem with both set to yes and problems were completly vanished when both were set to no. -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, NÃO mandem email gertrudes(a)solutti.com.br My SPAMTRAP, do not email it

1 0