- dovecot - dovecot.org

Released Pigeonhole v0.4.18 for Dovecot v2.2.29.
by Stephan Bosch 12 Apr '17

12 Apr '17

Hello Dovecot users, Here's the definitive 0.4.18 release. There were no changes since the release candidate. Changelog v0.4.18: + imapsieve plugin: Implemented the copy_source_after rule action. When this is enabled for a mailbox rule, the specified Sieve script is executed for the message in the source mailbox during a "COPY" event. This happens only after the Sieve script that is executed for the corresponding message in the destination mailbox finishes running successfully. + imapsieve plugin: Added non-standard Sieve environment items for the source and destination mailbox. - multiscript: The execution of the discard script had an implicit "keep", rather than an implicit "discard". The release is available as follows: https://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.18.t… https://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.18.t… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

Vpopmail Error
by Bobber 12 Apr '17

12 Apr '17

I'm trying to compile the latest Dovecot (v2.2.29) and when I run make I get this error: > auth-userdb-vpopmail.o: In function `userdb_vpopmail_get_quota': > /usr/local/src/dovecot-2.2.29/src/auth/userdb-vpopmail.c:64: undefined > reference to `var_expand_table_build' > collect2: error: ld returned 1 exit status > Makefile:932: recipe for target 'auth' failed > make[3]: *** [auth] Error 1 > make[3]: Leaving directory '/usr/local/src/dovecot-2.2.29/src/auth' > Makefile:496: recipe for target 'all-recursive' failed > make[2]: *** [all-recursive] Error 1 > make[2]: Leaving directory '/usr/local/src/dovecot-2.2.29/src' > Makefile:619: recipe for target 'all-recursive' failed > make[1]: *** [all-recursive] Error 1 > make[1]: Leaving directory '/usr/local/src/dovecot-2.2.29' > Makefile:463: recipe for target 'all' failed > make: *** [all] Error 2 I'm using Debian Jessie and it's up to date. Just to make sure it wasn't something in Jessie I went back into v2.2.28 (which I've been using since it was released) and did a clean build successfully. I've never had any problems compiling dovecot up until now. Any ideas on how to fix this? -- *Bob Wooldridge* Blog: http://kc0dxf.net/blog/

4 8

v2.2.29.rc1 released
by Timo Sirainen 11 Apr '17

11 Apr '17

http://dovecot.org/releases/2.2/rc/dovecot-2.2.29.rc1.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.29.rc1.tar.gz.sig Planning to release v2.2.29 on Monday. Please find and report any bugs before that. * When Dovecot encounters an internal error, it logs the real error and usually logs another line saying what function failed. Previously the second log line's error message was a rather uninformative "Internal error occurred. Refer to server log for more information." Now the real error message is duplicated in this second log line. * lmtp: If a delivery has multiple recipients, run autoexpunging only for the last recipient. This avoids a problem where a long autoexpunge run causes LMTP client to timeout between the DATA replies, resulting in duplicate mail deliveries. * config: Don't stop the process due to idling. Otherwise the configuration is reloaded when the process restarts. * mail_log plugin: Differentiate autoexpunges from regular expunges * imapc: Use LOGOUT to cleanly disconnect from server. * lib-http: Internal status codes (>9000) are no longer visible in logs * director: Log vhost count changes and HOST-UP/DOWN + quota: Add plugin { quota_max_mail_size } setting to limit the maximum individual mail size that can be saved. + imapc: Add imapc_features=delay-login. If set, connecting to the remote IMAP server isn't done until it's necessary. + imapc: Add imapc_connection_retry_count and imapc_connection_retry_interval settings. + imap, pop3, indexer-worker: Add (deinit) to process title before autoexpunging runs. + Added %{encrypt} and %{decrypt} variables + imap/pop3 proxy: Log proxy state in errors as human-readable string. + imap/pop3-login: All forward_* extra fields returned by passdb are sent to the next hop when proxying using ID/XCLIENT commands. On the receiving side these fields are imported and sent to auth process where they're accessible via %{passdb:forward_*}. This is done only if the sending IP address matches login_trusted_networks. + imap-login: If imap_id_retain=yes, send the IMAP ID string to auth process. %{client_id} expands to it in auth process. The ID string is also sent to the next hop when proxying. - fts-tika: Fixed crash when parsing attachment without Content-Disposition header. Broken by 2.2.28. - trash plugin was broken in 2.2.28 - auth: When passdb/userdb lookups were done via auth-workers, too much data was added to auth cache. This could have resulted in wrong replies when using multiple passdbs/userdbs. - auth: passdb { skip & mechanisms } were ignored for the first passdb - oauth2: Various fixes, including fixes to crashes - dsync: Large Sieve scripts (or other large metadata) weren't always synced. - Index rebuild (e.g. doveadm force-resync) set all mails as \Recent - imap-hibernate: %{userdb:*} wasn't expanded in mail_log_prefix - doveadm: Exit codes weren't preserved when proxying commands via doveadm-server. Almost all errors used exit code 75 (tempfail). - ACLs weren't applied to not-yet-existing autocreated mailboxes. - Fixed a potential crash when parsing a broken message header. - cassandra: Fallback consistency settings weren't working correctly. - doveadm director status <user>: "Initial config" was always empty - imapc: Various reconnection fixes.

3 10

How to use quota with dovecot
by Mik J 11 Apr '17

11 Apr '17

Hello, I would like to use quotas with dovecot and things are not clear to me. I read this page https://wiki2.dovecot.org/Quota 1) I did this # ls /usr/local/lib/dovecot/lib10_quota_plugin.so /usr/local/lib/dovecot/lib10_quota_plugin.so # grep mail_plugins /etc/dovecot/conf.d/10-mail.conf mail_plugins = notify replication quota Then the page tells about 20-imap.conf but an explanation is written # Space separated list of plugins to load (default is global mail_plugins). So what is that default global mail_plugins ? Is it the one coming from 10-mail.conf ? 2) I tried both use this mail_plugins = $mail_plugins quota in 20-imap.conf or comment it. And restarted dovecot each time Then commented out in 90-quota.conf quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_grace = 10%% } But I have this message # doveadm quota recalc -u user(a)mydomain.org doveadm(user(a)mydomain.org): Error: Quota not enabled Does anyone knows why ?

4 5

v2.2.29 released
by Timo Sirainen 11 Apr '17

11 Apr '17

https://dovecot.org/releases/2.2/dovecot-2.2.29.tar.gz https://dovecot.org/releases/2.2/dovecot-2.2.29.tar.gz.sig * passdb/userdb dict: Don't double-expand %variables in keys. If dict was used as the authentication passdb, using specially crafted %variables in the username could be used to cause DoS (CVE-2017-2669) * When Dovecot encounters an internal error, it logs the real error and usually logs another line saying what function failed. Previously the second log line's error message was a rather uninformative "Internal error occurred. Refer to server log for more information." Now the real error message is duplicated in this second log line. * lmtp: If a delivery has multiple recipients, run autoexpunging only for the last recipient. This avoids a problem where a long autoexpunge run causes LMTP client to timeout between the DATA replies, resulting in duplicate mail deliveries. * config: Don't stop the process due to idling. Otherwise the configuration is reloaded when the process restarts. * mail_log plugin: Differentiate autoexpunges from regular expunges * imapc: Use LOGOUT to cleanly disconnect from server. * lib-http: Internal status codes (>9000) are no longer visible in logs * director: Log vhost count changes and HOST-UP/DOWN + quota: Add plugin { quota_max_mail_size } setting to limit the maximum individual mail size that can be saved. + imapc: Add imapc_features=delay-login. If set, connecting to the remote IMAP server isn't done until it's necessary. + imapc: Add imapc_connection_retry_count and imapc_connection_retry_interval settings. + imap, pop3, indexer-worker: Add (deinit) to process title before autoexpunging runs. + Added %{encrypt} and %{decrypt} variables + imap/pop3 proxy: Log proxy state in errors as human-readable string. + imap/pop3-login: All forward_* extra fields returned by passdb are sent to the next hop when proxying using ID/XCLIENT commands. On the receiving side these fields are imported and sent to auth process where they're accessible via %{passdb:forward_*}. This is done only if the sending IP address matches login_trusted_networks. + imap-login: If imap_id_retain=yes, send the IMAP ID string to auth process. %{client_id} expands to it in auth process. The ID string is also sent to the next hop when proxying. + passdb imap: Use ssl_client_ca_* settings for CA validation. - fts-tika: Fixed crash when parsing attachment without Content-Disposition header. Broken by 2.2.28. - trash plugin was broken in 2.2.28 - auth: When passdb/userdb lookups were done via auth-workers, too much data was added to auth cache. This could have resulted in wrong replies when using multiple passdbs/userdbs. - auth: passdb { skip & mechanisms } were ignored for the first passdb - oauth2: Various fixes, including fixes to crashes - dsync: Large Sieve scripts (or other large metadata) weren't always synced. - Index rebuild (e.g. doveadm force-resync) set all mails as \Recent - imap-hibernate: %{userdb:*} wasn't expanded in mail_log_prefix - doveadm: Exit codes weren't preserved when proxying commands via doveadm-server. Almost all errors used exit code 75 (tempfail). - ACLs weren't applied to not-yet-existing autocreated mailboxes. - Fixed a potential crash when parsing a broken message header. - cassandra: Fallback consistency settings weren't working correctly. - doveadm director status <user>: "Initial config" was always empty - imapc: Various reconnection fixes.

4 6

How to migration my mails from another server ?
by Mik J 10 Apr '17

10 Apr '17

Hello, I would like to host my mails and I would like to retrieve my existing mailbox content from my ISP My ISP ====== I don't have root access on the server The server seem to use Dovecot according to the banner. My machine ========== I have root access on the server I use Dovecot 2.2.21 I use Maildir I read this page multiple times but it's not clear to me https://wiki2.dovecot.org/Migration/Dsync "Set up configuration for the IMAP server you wish to migrate from" Is it my ISP's server or my server ? In which configuration file should I do this ? The same for this option dsync_features = empty-header-workaroundwhere is it supposed to be configured ? My most important case is quite "simple": the mailboxes (there are 2 or 3) I want to migrate don't exist on my machine, so there is no such problems as merge existing mails. Will this migration use imap and retrieve the content of the mails ? Will it use port 143 or 993 ? I'll use the backup option I have another case which there are mails on both servers. So I would like to keep existing mails on my machine. I'll use the sync -1 option ? Thank you

3 3

Re: abrt reported "imap killed by SIGBUS"
by Hongying Liu 10 Apr '17

10 Apr '17

Sorry for late response. This issue occurs ran randomly. So I don't know how to run valgrind command. 2017-04-10 17:14 GMT+08:00 Hongying Liu <hongyliu(a)redhat.com>: > Sorry for late response. > > This issue occurs ran randomly. So I don't know how to run valgrind > command. > > I upload the coredump. > > The version of dovecot is dovecot-2.2.10-7.el7.x86_64. > > 2017-04-07 14:07 GMT+08:00 Aki Tuomi <aki.tuomi(a)dovecot.fi>: > >> Please keep responses on list. >> >> Can you please run valgrind on this, as it appears to be some sort of >> memory corruption issue. >> >> Aki >> >> > On April 7, 2017 at 5:37 AM Hongying Liu <hongyliu(a)redhat.com> wrote: >> > >> > >> > Thanks for your response. >> > >> > (gdb) p cache >> > $1 = (struct mail_cache *) 0x7fc4a811a320 >> > (gdb) p cache->hdr >> > $2 = (const struct mail_cache_header *) 0x7fc4a6ddb000 >> > (gdb) p cache->hdr->file_seq >> > Cannot access memory at address 0x7fc4a6ddb008 <---- >> > (gdb) p reset_id >> > $3 = 1488892251 >> > >> > >> > 2017-04-06 19:34 GMT+08:00 Aki Tuomi <aki.tuomi(a)dovecot.fi>: >> > >> > > Hi! >> > > >> > > Responses in middle. >> > > >> > > Aki >> > > >> > > On 06.04.2017 06:05, Hongying Liu wrote: >> > > > Hi sbr-services, >> > > > >> > > > Could you give me some idea? >> > > > >> > > > ### abrt reported the error as below. >> > > > [root@cupop4 log]# abrt-cli list --since 1488267244 id >> > > > ad716dbfd3a68bbe0f055e32ebfe562f4f75df43 >> > > > reason: imap killed by SIGBUS >> > > > time: Sun Mar 19 2017 10:58:27 AM JST >> > > > cmdline: dovecot/imap >> > > > package: dovecot-2.2.10-7.el7 >> > > > uid: 80180 (acaa2325) >> > > > count: 2 >> > > > Directory: /var/spool/abrt/ccpp-2017-03-19-10:58:27-4904 >> > > > 'abrt-cli report を実行する/var/spool/abrt/ccpp-2017 >> -03-19-10:58:27-4904' >> > > > >> > > > >> > > > ### /var/log/messages >> > > > Mar 19 10:58:27 cupop4 abrt-hook-ccpp: Process 4904 (imap) of user >> 80180 >> > > > killed by SIGBUS - dumping core >> > > > >> > > > And, there are lots of ldap error in /var/log/messages. Dovecot >> uses the >> > > > ldap as userdb and passwddb. >> > > > Is the ldap error related to imap crash? >> > > > >> > > > Mar 19 10:58:21 cupop4 nslcd[1534]: [a378de] >> <group/member="postfix"> >> > > > ldap_result() failed: Invalid DN syntax: Invalid DN >> > > >> > > This looks like an invalid DN syntax. >> > > >> > > > >> > > > ### /var/log/dovecot >> > > > >> > > > Mar 19 10:58:27 cupop4 dovecot: imap(acaa2325): Fatal: master: >> > > > service(imap): child 4904 killed with signal 7 (core dumped) >> > > > >> > > Can you do p cache, p cache->hdr, p cache->hdr->file_seq and p >> reset_id >> > > >> > > > ### gdb >> > > > >> > > > Core was generated by `dovecot/imap'. >> > > > Program terminated with signal 7, Bus error. >> > > > #0 0x00007fc4a69f293e in mail_cache_lookup_offset >> (cache=0x7fc4a811a320, >> > > > view=<optimized out>, seq=<optimized out>, offset_r=offset_r@entry >> > > > =0x7ffe23a98900) >> > > > at mail-cache-lookup.c:95 >> > > > 95 while (cache->hdr->file_seq != reset_id) { >> > > > (gdb) bt >> > > > #0 0x00007fc4a69f293e in mail_cache_lookup_offset >> (cache=0x7fc4a811a320, >> > > > view=<optimized out>, seq=<optimized out>, offset_r=offset_r@entry >> > > > =0x7ffe23a98900) >> > > > at mail-cache-lookup.c:95 >> > > > #1 0x00007fc4a69f2afa in mail_cache_lookup_iter_init >> > > > (view=view@entry=0x7fc4a81332b0, >> > > > seq=<optimized out>, ctx_r=ctx_r@entry=0x7ffe23a988e0) >> > > > at mail-cache-lookup.c:154 >> > > > #2 0x00007fc4a69f2f8f in mail_cache_seq (seq=<optimized out>, >> > > > view=0x7fc4a81332b0) at mail-cache-lookup.c:322 >> > > > #3 mail_cache_field_exists (view=view@entry=0x7fc4a81332b0, >> > > seq=seq@entry=760, >> > > > field=field@entry=4) at mail-cache-lookup.c:352 >> > > > #4 0x00007fc4a69f3151 in mail_cache_lookup_field >> (view=0x7fc4a81332b0, >> > > > dest_buf=dest_buf@entry=0x7ffe23a98a00, seq=760, >> > > field_idx=field_idx@entry >> > > > =4) >> > > > at mail-cache-lookup.c:413 >> > > > #5 0x00007fc4a69d9439 in index_mail_cache_lookup_field >> > > > (mail=mail@entry=0x7fc4a8128cd0, >> > > > buf=buf@entry=0x7ffe23a98a00, field_idx=field_idx@entry=4) >> > > > at index-mail.c:68 >> > > > #6 0x00007fc4a69d94a7 in index_mail_get_fixed_field >> > > (mail=0x7fc4a8128cd0, >> > > > field=<optimized out>, data=<optimized out>, data_size=8) at >> > > > index-mail.c:130 >> > > > #7 0x00007fc4a69d9fed in index_mail_get_cached_virtual_size >> > > > (mail=mail@entry=0x7fc4a8128cd0, size_r=size_r@entry=0x7ffe23a98b20) >> at >> > > > index-mail.c:403 >> > > > #8 0x00007fc4a6987c1b in maildir_mail_get_virtual_size >> > > > (_mail=0x7fc4a8128cd0, size_r=0x7ffe23a98b20) at maildir-mail.c:388 >> > > > #9 0x00007fc4a69d9719 in index_mail_update_access_parts >> > > > (mail=mail@entry=0x7fc4a8128cd0) >> > > > at index-mail.c:1490 >> > > > #10 0x00007fc4a69dbb93 in index_mail_set_seq (_mail=0x7fc4a8128cd0, >> > > > seq=760, saving=<optimized out>) at index-mail.c:1521 >> > > > #11 0x00007fc4a69e28cb in search_more_with_mail >> (mail=0x7fc4a8128cd0, >> > > > ctx=0x7fc4a8132730) at index-search.c:1507 >> > > > #12 search_more_with_prefetching (mail_r=<optimized out>, >> ctx=<optimized >> > > > out>) at index-search.c:1579 >> > > > #13 search_more (ctx=ctx@entry=0x7fc4a8132730, >> > > > mail_r=mail_r@entry=0x7ffe23a98c20) >> > > > at index-search.c:1650 >> > > > #14 0x00007fc4a69e2ff4 in index_storage_search_next_nonblock >> > > > (_ctx=0x7fc4a8132730, mail_r=0x7fc4a81120d8, >> tryagain_r=0x7ffe23a98c87) >> > > at >> > > > index-search.c:1674 >> > > > #15 0x00007fc4a69bc4ef in mailbox_search_next_nonblock >> > > > (ctx=ctx@entry=0x7fc4a8132730, >> > > > mail_r=mail_r@entry=0x7fc4a81120d8, >> > > > tryagain_r=tryagain_r@entry=0x7ffe23a98c87) at >> mail-storage.c:1787 >> > > > #16 0x00007fc4a69bc55d in mailbox_search_next (ctx=0x7fc4a8132730, >> > > > mail_r=mail_r@entry=0x7fc4a81120d8) at mail-storage.c:1773 >> > > > #17 0x00007fc4a6e97874 in imap_fetch_more_int (ctx=ctx@entry >> > > =0x7fc4a8112078, >> > > > cancel=false) at imap-fetch.c:479 >> > > > #18 0x00007fc4a6e98852 in imap_fetch_more (ctx=0x7fc4a8112078, >> > > > cmd=cmd@entry=0x7fc4a8111ed0) >> > > > at imap-fetch.c:556 >> > > > #19 0x00007fc4a6e8c17d in cmd_fetch (cmd=0x7fc4a8111ed0) at >> > > cmd-fetch.c:284 >> > > > #20 0x00007fc4a6e9601c in command_exec (cmd=cmd@entry=0x7fc4a8111ed0) >> at >> > > > imap-commands.c:158 >> > > > #21 0x00007fc4a6e94f1f in client_command_input (cmd=cmd@entry >> > > =0x7fc4a8111ed0) >> > > > at imap-client.c:780 >> > > > #22 0x00007fc4a6e95005 in client_command_input (cmd=0x7fc4a8111ed0) >> at >> > > > imap-client.c:841 >> > > > #23 0x00007fc4a6e952fd in client_handle_next_command >> > > > (remove_io_r=<synthetic pointer>, client=0x7fc4a8111530) at >> > > > imap-client.c:879 >> > > > #24 client_handle_input (client=client@entry=0x7fc4a8111530) at >> > > > imap-client.c:891 >> > > > #25 0x00007fc4a6e956c5 in client_input (client=0x7fc4a8111530) at >> > > > imap-client.c:933 >> > > > #26 0x00007fc4a66e1a87 in io_loop_call_io (io=0x7fc4a811edd0) at >> > > > ioloop.c:388 >> > > > #27 0x00007fc4a66e290f in io_loop_handler_run >> > > > (ioloop=ioloop@entry=0x7fc4a80fc750) >> > > > at ioloop-epoll.c:220 >> > > > #28 0x00007fc4a66e15d8 in io_loop_run (ioloop=0x7fc4a80fc750) at >> > > > ioloop.c:412 >> > > > #29 0x00007fc4a668e9e3 in master_service_run >> (service=0x7fc4a80fc5e0, >> > > > callback=callback@entry=0x7fc4a6e9ed70 <client_connected>) at >> > > > master-service.c:571 >> > > > #30 0x00007fc4a6e89324 in main (argc=1, argv=0x7fc4a80fc390) at >> > > main.c:400 >> > > > >> > > > Thank you. >> > > > >> > > > Best regards, >> > > > Hongying Liu >> > > >> > > >> > >

1 0

[Bug] FTS invalid address parsing
by azurit＠pobox.sk 10 Apr '17

10 Apr '17

Hi, i found another bug in FTS while parsing quoted-printable/base64-encoded sender's name inside 'From' header (again, i was figuring out why some of messages cannot be searched). Header: From: =?UTF-8?Q?A=2CB?= <test(a)example.com> Data send to Solr by Dovecot: <field name="from">A@, B &lt;test(a)example.com&gt;</field> Header: From: =?UTF-8?Q?A_B=2CC?= <test(a)example.com> Data send to Solr by Dovecot: <field name="from">A@</field> Header: From: =?UTF-8?B?QSBCLEMK?= <test(a)example.com> Data send to Solr by Dovecot: <field name="from">A@</field> Dovecot 2.2.27. azur

2 2

[Bug] FTS double escaping
by azurit＠pobox.sk 09 Apr '17

09 Apr '17

Hi, i'm trying to resolve few problems with indexing 'From' headers using FTS/Solr. I was tcpdumping the communication between Dovecot and Jetty/Solr and noticed that 'From' headers, which includes also sender's name, are double escaped. This is what was Dovecot sending to Solr: </field><field name="from">Name Surname &lt;test(a)example.com&gt;</field></doc></add> As you can see, characters < and > were escaped to < and > which were, again, escaped to &lt; and &gt;. This is doing problems while trying to index whole e-mail address, as Solr sees it as '<test(a)example.com>'. I spend hours trying to figure out why i'm able to search in all parts of e-mail addresses but searching for full and exact e-mail address was successfull ONLY for messages which doesn't include sender's name in 'From' header. Finally, after i found this bug, this fixed all search problems: <filter class="solr.PatternReplaceFilterFactory" pattern="&lt;" replacement=""/> <filter class="solr.PatternReplaceFilterFactory" pattern="&gt;" replacement=""/> I hope that, at least, this bug, reported by me, will be fixed. Thank you. azur

3 5

sieve does not seem to be working
by Robert Moskowitz 09 Apr '17

09 Apr '17

my local.conf has: # 90-sieve.conf plugin { sieve_before = /home/sieve/globalfilter.sieve } and cat /home/sieve/globalfilter.sieve require ["fileinto","mailbox"]; if anyof ( header :contains "X-Spam-Flag" "YES", header :contains "subject" "***SPAM***" ) { fileinto :create "Spam"; } There IS a globalfilter.svbin when I tried: sendmail -i testit3(a)test.htt-consult.com < sample-spam-GTUBE-junk.txt amavis is flagging it as ***Spam*** but it stays in inbox. So I tried: sieve-test -e -l /home/vmail/test.htt-consult.com/testit3/ /home/sieve/globalfilter.sieve /home/vmail/test.htt-consult.com/testit3/cur/1491512409.M371278P6513.z9m9z.test.htt-consult.com\,S\=1823\,W\=1868\:2\, info: msgid=<GTUBE1.1010101(a)example.net>: stored mail into mailbox 'Spam'. sieve-test(root): Info: final result: success And it DID get copied to Spam, not moved. I am now seeing it in inbox and Spam. Of course ownership on the message in Spam were wrong (root:root instead of vmail:mail, but I fixed that). So two questions, probably linked: Why did sieve not work. Is the subject test case sensitive? If it is case sensitive, why did the sieve-test work? thanks

2 2