- dovecot - dovecot.org

Dovecort-2.2.22
by Ralf Zimmermann 08 Mar '16

08 Mar '16

With Dovecot-2.2.22 and enabled virtual plugin I get following error messages: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x819f0) [0x7f12330bf9f0] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x81adc) [0x7f12330bfadc] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f123306833d] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_close+0x178) [0x7f12320599f8] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9f94) [0x7f1232059f94] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9fe9) [0x7f1232059fe9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f12333825da] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x13) [0x7f1233382663] -> dovecot/imap() [0x41870f] -> dovecot/imap() [0x423ce4] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xda) [0x7f12330d28aa] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x9c) [0x7f12330d3cbc] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7f12330d2a65] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f12330d2c08] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f123306da23] -> dovecot/imap(main+0x2d7) [0x40c3c7] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f1232cb4b45] -> dovecot/imap() [0x40c530] I test it with this configuration on Debian Jessie 64-bit: # dovecot.conf mail_plugins = $mail_plugins acl quota zlib virtual namespace { prefix = virtual/ separator = / location = virtual:~/Maildir/virtual } # ~/Maildir/virtual/unseen/dovecot-virtual INBOX unseen Mit freundlichen Grüßen Ralf Zimmermann Senior Security Engineer State Certified Engineer SIEGNETZ.IT GmbH Einheitsstrasse 2, D-57076 Siegen Telefon: +4927168193130 Fax: +492716819329 Mobil : +491735360015 http://www.siegnetz.de http://rz.siegnetz.de Amtsgericht Siegen HRB4838 Geschäftsführer: Oliver Seitz Sitz der Gesellschaft ist Siegen

2 3

[PATCH] imapc: Accept strings in FLAGS responses
by Richard Laager 08 Mar '16

08 Mar '16

While non-standard, the IMAP server we are replacing returns non-system flags as strings instead of atoms. Prior to this change, imapc would abort processing on the first message with a string flag. --- src/lib-storage/index/imapc/imapc-mailbox.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/src/lib-storage/index/imapc/imapc-mailbox.c b/src/lib-storage/index/imapc/imapc-mailbox.c index c3e12d1..91333dc 100644 --- a/src/lib-storage/index/imapc/imapc-mailbox.c +++ b/src/lib-storage/index/imapc/imapc-mailbox.c @@ -310,7 +310,8 @@ static void imapc_untagged_fetch(const struct imapc_untagged_reply *reply, t_array_init(&keywords, 8); seen_flags = TRUE; for (j = 0; flags_list[j].type != IMAP_ARG_EOL; j++) { - if (!imap_arg_get_atom(&flags_list[j], &atom)) + if (!imap_arg_get_atom(&flags_list[j], &atom) && + !imap_arg_get_string(&flags_list[j], &atom)) return; if (atom[0] == '\\') flags |= imap_parse_system_flag(atom); -- 2.1.4

1 0

segfault in imap and doveadm
by Joe Beaubien 07 Mar '16

07 Mar '16

Hi everyone, Dovecot keeps on segfaulting on me and I am unsure why. This setup has been running for 5 years and has given me very little trouble. I am running Dovecot 2.1.7, setup with mdbox. The imap process keeps on segfaulting for the same account (makes me think maybe an email or folder of that account is problematic). My big issue is that force-resync also causes doveadm to segfault. Here is the mail.err file I am getting: Mar 7 12:34:36 mba kernel: [ 1955.486324] imap[5663]: segfault at 0 ip 00007ff1c1bd0b5e sp 00007fffd8599a40 error 4 in libdovecot-storage.so.0.0.0[7ff1c1b51000+fb000] Mar 7 12:34:36 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/Sara/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:36 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/Lucie/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:37 mba dovecot: imap(document): Error: mdbox map /mba_data/emails/document/storage/dovecot.map.index corrupted: map_uid=284393 refcount too low Mar 7 12:34:37 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/Templates/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:39 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/Sent/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:40 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:40 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:41 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:41 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:41 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:42 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/_EE - a verifier/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:43 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:34:48 mba kernel: [ 1967.972883] imap[5688]: segfault at 0 ip 00007f058ebc9b5e sp 00007fff9baa7c00 error 4 in libdovecot-storage.so.0.0.0[7f058eb4a000+fb000] Mar 7 12:34:49 mba dovecot: imap(document): Error: /mba_data/emails/document/mailboxes/INBOX/Lucie/dbox-Mails/dovecot.index reset, view is now inconsistent Mar 7 12:43:44 mba dovecot: imap(document): Error: indexer disconnected unexpectedly Mar 7 12:43:44 mba dovecot: indexer: Error: Indexer worker disconnected, discarding 119 requests for document Mar 7 12:48:31 mba kernel: [ 2790.363755] doveadm[6586]: segfault at 0 ip 00007f1b2023fb5e sp 00007fff4e8ce200 error 4 in libdovecot-storage.so.0.0.0[7f1b201c0000+fb000] Mar 7 12:49:10 mba kernel: [ 2829.203900] doveadm[6604]: segfault at 0 ip 00007fa0d16e4b5e sp 00007fff1b89f480 error 4 in libdovecot-storage.so.0.0.0[7fa0d1665000+fb000] First line is imap segfaulting. Last lines are doveadm segfaulting when I try to run force-resync. Does anyone have any clue what to do in this situation? Regards, -Joe

1 1

Compilation fails: SSL_TXT_SSLV2 not defined
by Muffinman 07 Mar '16

07 Mar '16

Hello all, I'm trying to compile dovecot 2.2.21 on OS-X 10.11.3 and I'm running a bit of trouble with OpenSSL. I've cloned OpenSSL (OpenSSL 1.1.0-pre4-dev) from github and in openssl/ssl.h SSL_TXT_SSLV2 is not defined anymore. Compilation fails with: libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-test -DMODULE_DIR=\"/usr/local/lib/dovecot\" -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -MT iostream-openssl-common.lo -MD -MP -MF .deps/iostream-openssl-common.Tpo -c iostream-openssl-common.c -fno-common -DPIC -o .libs/iostream-openssl-common.o iostream-openssl-common.c:34:24: error: use of undeclared identifier 'SSL_TXT_SSLV2' if (strcasecmp(name, SSL_TXT_SSLV2) == 0) ^ 1 error generated. make[3]: *** [iostream-openssl-common.lo] Error 1 make[2]: *** [all-recursive] Error 1 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 In openssl/ssl.h the following is defined: # define SSL_TXT_SSLV3 "SSLv3" # define SSL_TXT_TLSV1 "TLSv1" # define SSL_TXT_TLSV1_1 "TLSv1.1" # define SSL_TXT_TLSV1_2 "TLSv1.2" # define SSL_TXT_ALL "ALL" Any suggestions on how to fix this? Kind regards, Maarten

2 3

questions regarding zlib plugin
by Götz Reinicke - IT Koordinator 07 Mar '16

07 Mar '16

Hi, faced with a current space problem on our dovecot 2.2.18 server, I thought about using the zlib plugin. My questions: - is it really as simple as adding the options to the conf files as described in the docs :) ? http://wiki2.dovecot.org/Plugins/Zlib - As this just compresses new messages; dose anybody has a sort of simple cron or whatever script or best practice how to compress existing maildir mails? The doc is a bit complicated to me at that point... Thanks a lot and regards . Götz

3 3

Ubuntu packages
by Peter Chiochetti 07 Mar '16

07 Mar '16

Since dovecot put up packages on their own repo, bigmichi stopped providing his'. I guess this is not Stephan; Would the kind person update ppa.launchpad.net/bigmichi1 ? Thank You -- peter

11 18

VS: Re: v2.2.22 release candidate released
by Aki Tuomi 06 Mar '16

06 Mar '16

In future release we will add master authentication too. Now you can use api key or doveadm password which are essentially same thing. ---Aki TuomiDovecot oy-------- Alkuperäinen viesti --------Lähettäjä: Peter Chiochetti <pch(a)myzel.net> Päivämäärä: 4.3.2016 20.20 (GMT+02:00) Saaja: dovecot(a)dovecot.org Aihe: Re: v2.2.22 release candidate released Am 2016-03-04 um 14:33 schrieb Timo Sirainen: > + Added doveadm HTTP API: See > http://wiki2.dovecot.org/Design/DoveadmProtocol/HTTP Hmm, so anybody who has the API key can send any doveadm commands? I guess something like /etc/sudoers for API keys would be good? Did I miss something? -- peter

3 2

Re: Dovecot stops responding when I update SSL certificate
by Joseph Tam 06 Mar '16

06 Mar '16

HotSlots Webmaster <webmaster(a)hotslots132.com> writes: > I have had Dovecot working fine with SSL for nearly two years now. It's > time to renew the SSL certificate, so I did (same CA). The new > certificate works fine in Apache and Postfix. But when I update Dovecot > to use the same certificate, and restart the server, Dovecot stops > responding to connects. > ... > Here is the end of the dovecot -n file that mentions SSL: > ... > ssl_dh_parameters_length = 2048 When you start dovecot, does CPU load of dovecot/ssl-params roof to 100%? It's possible it's generating ephemeral DH keys. In a previous post to this list, I note that the run time to generate these keys can vary wildly, and gets worse with longer keys. Sometimes you get lucky, and you'll generate then quickly, sometimes it takes a long while (minutes). http://dovecot.org/pipermail/dovecot/2015-November/102447.html Try running openssl dhparam -noout 2048 to see how it varies for you. If what I suspect is true, you can try using shorter keys. A followup post suggest a way you can precompute the key Joseph Tam <jtam.home(a)gmail.com>

3 2

VS: Re: Implementation of TLS OCSP Stapling
by Aki Tuomi 06 Mar '16

06 Mar '16

Luckily ocsp stapling is an SSL extension and clients not supporting it won't be asking for it either. ---Aki TuomiDovecot oy -------- Alkuperäinen viesti --------Lähettäjä: Andrew McGlashan <andrew.mcglashan(a)affinityvision.com.au> Päivämäärä: 6.3.2016 10.36 (GMT+02:00) Saaja: dovecot(a)dovecot.org Aihe: Re: Implementation of TLS OCSP Stapling On 3/03/2016 11:58 PM, aki.tuomi(a)dovecot.fi wrote: > We will take this feature under consideration and see if it can be implemented > in future release. Thank you for your suggestion! As much as I hate Outlook (Look Out!), there are loads of people using really old versions; 2003 is no longer supported, but loads of people use 2007. Thunderbird can be expected to be far more up to date. Implementing features to work with older clients will always be a problem. Just a simple example, almost unrelated here, but this is either wrong by TB or wrong by Outlook (versions 2007, 2010 and 2013 that I know of). When the IMAP server sends a message, OL will pop up a window that requires the user to acknowledge the message via a popup. TB just pops up the message in the normal 'new mail' notify if that is configured and it might be lost if notify isn't set to show. Either way, the implementation is different b/w the two client products. Is OL right or is TB right... IMAP doco says that the message should be made to be acknowledged by the client; OL's version can't easily be ignored or missed, but TB's can easily be missed. But TB's implementation is more user friendly if the server wants to keep sending messages from time to time. I considered using this for MOTD type stuff and maybe random inspirational or motivational messages; even to remind or inform users to do certain things [one example in the dovecot wiki is to advise that the vacation message is still active]. A TB notification is next to harmless, but an OL one needs to be acknowledged every time, which would be very painful. Anyway, the point is that if a feature is added for OCSP stabling support, you couldn't really expect older versions of Look Out to comply with it (even though M$ could patch it easily, they care less about older versions than getting people to subscribe to Office 365 these days). Cheers A.

1 0

Implementation of TLS OCSP Stapling
by dovecot＠flut.demon.nl 06 Mar '16

06 Mar '16

Hi all, About a year ago, Torsten already asked for OCSP stapling (http://dovecot.org/pipermail/dovecot/2015-April/100632.html) Unfortunately, there was no answer to his question. Now RFC 7633 ("TLS Feature Extension", https://tools.ietf.org/html/rfc7633, a.k.a. "Must Staple") has landed, revocation is getting serious! I personally would like to embed all my TLS certificates with the must-staple extension. The great project Let's Encrypt already supports it: https://github.com/letsencrypt/boulder/pull/1224 I'm aware most MTAs don't really care about the certificate, but big players as Google take TLS encryption very seriously: https://googleblog.blogspot.nl/2016/02/building-safer-web-for-everyone.html So I would like to know if Dovecot is planning to feature OCSP stapling. That way I know for sure my "must staple" certificates can be used by Dovecot. And in my opinion, every TLS offering daemon should be up to par to the capabilities of TLS.. Not lag behind :) What's your opinion on this matter? Thanks in advance for any anwser! Greets, Osiris

7 11

dovecot local indexes and multiple servers
by alex 05 Mar '16

05 Mar '16

Hi, I've been testing mdbox with local indexes on our nfs based directors + multiple imap/lda/pop3 server setup. The performance is noticeably better than maildir with indexes on nfs, so I'd like to make this work. About the possible direction to other servers the wiki says that it will create a new index 'on the fly'. That is true, but after the index is recreated, Thunderbird (imap) re-downloads all the messages and sees all those messages as unread again! This is probably quite logical as the message status is only kept in the indexes, but this is not very customer friendly. Is there a way to avoid this problem? I'd rather not manually sync those local indexes between our servers. In fact, I was planning on deleting (old) indexes when a user moved to another server or even if they haven't checked their mail for XX days. with up to 10Gb mailboxes the indexes themselves can get up to 20-40Mb for a mailbox. that amounts to quite a lot of storage for 200k+ users. Thanks, Alex.

2 2

VS: Dovecot stops responding when I update SSL certificate
by Aki Tuomi 05 Mar '16

05 Mar '16

Did you change dh parameter size as well? This causes dh generation which can take some time. ---Aki TuomiDovecot oy-------- Alkuperäinen viesti --------Lähettäjä: HotSlots Webmaster <webmaster(a)hotslots132.com> Päivämäärä: 5.3.2016 4.10 (GMT+02:00) Saaja: dovecot(a)dovecot.org Aihe: Dovecot stops responding when I update SSL certificate Dovecot 2.2.18 CentOS 6.7 (x86_64) Plesk 12.5.30 I have had Dovecot working fine with SSL for nearly two years now. It's time to renew the SSL certificate, so I did (same CA). The new certificate works fine in Apache and Postfix. But when I update Dovecot to use the same certificate, and restart the server, Dovecot stops responding to connects. I have triple-checked that the ssl_cert and ssl_key files are correct - all I did was change the names in the conf file. There's nothing in the log. I have tried various SSL tests but either they don't work (unspecific error) or they tell me nothing is wrong (and show the correct certificate.) I am running out of time to find a solution to this - what else can I look for? The one difference for the certificates is that I opted for one with a SHA256 root rather than SHA1 root. I have separately used a tool to verify that the certificate and private key match. Here is the end of the dovecot -n file that mentions SSL: ssl = required ssl_cert = </etc/pki/tls/certs/hotslots-cert.pem ssl_cipher_list = EECDH+AESGCM+AES128:EECDH+AESGCM+AES256:EDH+AESGCM+AES128:EDH+AESGCM+AES256:EECDH+SHA256+AES128:EECDH+SHA384+AES256:EDH+SHA256+AES128:EDH+SHA256+AES256:EECDH+SHA1+AES128:EECDH+SHA1+AES256:EDH+SHA1+AES128:EDH+SHA1+AES256:EECDH+HIGH:EDH+HIGH:AESGCM+AES128:AESGCM+AES256:SHA256+AES128:SHA256+AES256:SHA1+AES128:SHA1+AES256:HIGH:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!KRB5:!aECDH:!EDH+3DES ssl_dh_parameters_length = 2048 ssl_key = </etc/ssl/private/hotslots-private.pem ssl_protocols = TLSv1.1 TLSv1.2 !TLSv1 userdb { args = uid=popuser gid=popuser driver = static } protocol imap { mail_plugins = " quota imap_quota" } protocol pop3 { pop3_uidl_format = UID%u-%v } protocol lda { mail_plugins = " quota sieve" } (The !TLSv1 doesn't seem to be honored - I tried it with and without that. A problem for later.) Thanks for any help. Steve L

1 0

Dovecot stops responding when I update SSL certificate
by HotSlots Webmaster 05 Mar '16

05 Mar '16

Dovecot 2.2.18 CentOS 6.7 (x86_64) Plesk 12.5.30 I have had Dovecot working fine with SSL for nearly two years now. It's time to renew the SSL certificate, so I did (same CA). The new certificate works fine in Apache and Postfix. But when I update Dovecot to use the same certificate, and restart the server, Dovecot stops responding to connects. I have triple-checked that the ssl_cert and ssl_key files are correct - all I did was change the names in the conf file. There's nothing in the log. I have tried various SSL tests but either they don't work (unspecific error) or they tell me nothing is wrong (and show the correct certificate.) I am running out of time to find a solution to this - what else can I look for? The one difference for the certificates is that I opted for one with a SHA256 root rather than SHA1 root. I have separately used a tool to verify that the certificate and private key match. Here is the end of the dovecot -n file that mentions SSL: ssl = required ssl_cert = </etc/pki/tls/certs/hotslots-cert.pem ssl_cipher_list = EECDH+AESGCM+AES128:EECDH+AESGCM+AES256:EDH+AESGCM+AES128:EDH+AESGCM+AES256:EECDH+SHA256+AES128:EECDH+SHA384+AES256:EDH+SHA256+AES128:EDH+SHA256+AES256:EECDH+SHA1+AES128:EECDH+SHA1+AES256:EDH+SHA1+AES128:EDH+SHA1+AES256:EECDH+HIGH:EDH+HIGH:AESGCM+AES128:AESGCM+AES256:SHA256+AES128:SHA256+AES256:SHA1+AES128:SHA1+AES256:HIGH:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!KRB5:!aECDH:!EDH+3DES ssl_dh_parameters_length = 2048 ssl_key = </etc/ssl/private/hotslots-private.pem ssl_protocols = TLSv1.1 TLSv1.2 !TLSv1 userdb { args = uid=popuser gid=popuser driver = static } protocol imap { mail_plugins = " quota imap_quota" } protocol pop3 { pop3_uidl_format = UID%u-%v } protocol lda { mail_plugins = " quota sieve" } (The !TLSv1 doesn't seem to be honored - I tried it with and without that. A problem for later.) Thanks for any help. Steve L

1 0

Deliver to Public Mailbox
by Chris 03 Mar '16

03 Mar '16

Dear All, I'd like dovecot-lda (deliver) to post a message to a public mailbox. It doesn't seem to work when I just use the -m parameter with the IMAP-Mailbox path, e.g. Public/info . What parameters are required? Do I have to change the headers with formail in any way? TIA! - Chris

1 1

Dovecot 2.2.21 - segfault
by Robert Blayzor 03 Mar '16

03 Mar '16

pid 31943 (dovecot), uid 0: exited on signal 11 (core dumped) dovecot --version 2.2.21 (5345f22) uname -a FreeBSD 10.3-BETA2 #0 r295966M: amd64 bt full #0 0x00000008008eb037 in t_push (marker=0x0) at data-stack.c:133 133 data-stack.c: No such file or directory. in data-stack.c (gdb) bt full #0 0x00000008008eb037 in t_push (marker=0x0) at data-stack.c:133 frame_block = (struct stack_frame_block *) 0x7fffffffb4e0 #1 0x000000080086a5ec in master_service_env_clean () at master-service.c:534 _data_stack_cur_id = 32767 value = 0x801471056 "TZ CORE_OUTOFMEM CORE_ERROR" #2 0x000000000040df88 in service_process_setup_environment (service=0x8014b11e0, uid=58537, hostdomain=0x801419960 “mta3.xxx.net") at service-process.c:234 No locals. #3 0x000000000040dd6d in service_process_create (service=0x8014b11e0) at service-process.c:322 uid_counter = 58537 process = (struct service_process *) 0x8008eb2f3 uid = 58537 hostdomain = 0x801419960 “mta3.xxx.net" pid = 0 process_forked = true #4 0x000000000040d7ff in service_accept (l=0x8014b1378) at service-monitor.c:299 service = (struct service *) 0x8014b11e0 #5 0x000000080090e57f in io_loop_call_io (io=0x80144e7e0) at ioloop.c:559 ioloop = (struct ioloop *) 0x801421080 t_id = 2 #6 0x0000000800911497 in io_loop_handler_run_internal (ioloop=0x801421080) at ioloop-kqueue.c:151 ctx = (struct ioloop_handler_context *) 0x801419880 events = (struct kevent *) 0x8014b9000 event = (const struct kevent *) 0x8014b9000 tv = {tv_sec = 42682, tv_usec = 705349} ts = {tv_sec = 42682, tv_nsec = 705349000} io = (struct io_file *) 0x80144e7e0 events_count = 67 ret = 1 i = 0 #7 0x000000080090eb0e in io_loop_handler_run (ioloop=0x801421080) at ioloop.c:607 No locals. #8 0x000000080090e92f in io_loop_run (ioloop=0x801421080) at ioloop.c:583 No locals. #9 0x000000080086a8bb in master_service_run (service=0x80141b140, callback=0) at master-service.c:640 No locals. #10 0x0000000000406558 in main (argc=3, argv=0x7fffffffb4c0) at main.c:888 set = (struct master_settings *) 0x801429110 error = 0x800ca9283 "H\203Ä ]Ã\017\037\200" doveconf_arg = 0x0 orig_info_callback = (failure_callback_t *) 0x8008ee880 <i_syslog_error_handler> orig_debug_callback = (failure_callback_t *) 0x8008ee880 <i_syslog_error_handler> foreground = false ask_key_pass = false i = 3 c = -1 doubleopts = 0x7fffffffb3a0 Current language: auto; currently minimal

2 2

Dovecot error symbol mysql_options, version libmysqlclient_16 not defined in file libmysqlclient.so.18
by Condor 03 Mar '16

03 Mar '16

Hello, Im using Dovecot version: 2.2.21 (5345f22) Here is my conf file: auth_debug = yes auth_mechanisms = plain login auth_socket_path = /usr/local/var/run/dovecot/auth-userdb auth_verbose = yes base_dir = /usr/local/var/run/dovecot/ debug_log_path = /var/log/dovecot.log default_login_user = nobody default_process_limit = 200 dict { driver = sql quota = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } mail_debug = yes mail_location = maildir:/var/mailq/postmail/%d/%n/Maildir mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify envir onment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autocreate = Trash autocreate2 = Junk autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Sent autosubscribe4 = Drafts sieve = /var/mailq/postmail/%d/%n/.dovecot.sieve sieve_dir = /var/mailq/postmail/%d/%n/sieve/ sieve_global_dir = /usr/local/var/lib/dovecot/sieve sieve_global_path = /usr/local/var/lib/dovecot/sieve/default.sieve sieve_max_actions = 32 sieve_max_redirects = 15 sieve_quota_max_scripts = 20 } protocols = pop3 imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 vsz_limit = 64 M } ssl_cert = </etc/postfix/ssl/certs/dovecot.pem ssl_key = </etc/postfix/ssl/private/dovecot.pem userdb { args = uid=1003 gid=1001 home=/var/mailq/postmail/%d/%n allow_all_users=yes driver = static } userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol imap { imap_max_line_length = 64 k mail_max_userip_connections = 200 mail_plugins = " autocreate" } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole } dovecot-sql. conf grep -v '^ *$#.*$\?$' dovecot-sql.conf.ext driver = mysql connect = host=localhost dbname=postfix user=xxx password=xxx default_pass_scheme = CRYPT password_query = SELECT username AS user, password FROM mailbox WHERE username = '%u'; I get follow error: dovecot: auth-worker: Error: dovecot/auth: relocation error: dovecot/auth: symbol mysql_options, version libmysqlclient_16 not defined in file libmysqlclient.so.18 with link time reference I delete all binary and libs and source code, download again and compile with option with-mysql and always got the same error when I start it: dovecot: auth-worker: Error: dovecot/auth: relocation error: dovecot/auth: symbol mysql_options, version libmysqlclient_16 not defined in file libmysqlclient.so.18 with link time reference Mar 3 16:50:56 mailcontrol dovecot: master: Error: service(auth-worker): command startup failed, throttling for 60 secs Mar 3 16:50:56 mailcontrol dovecot: auth-worker(3276): Fatal: master: service(auth-worker): child 3276 returned error 127 Mar 3 16:50:56 mailcontrol dovecot: auth: Error: auth worker: Aborted PASSV request for xxx@xxx: Worker process died unexpectedly I even check with ldd is there any banary that use libmysqlclient.16.so but did not found. ldd auth is linked libmysqlclient.so.18 => /usr/lib64/libmysqlclient.so.18 (0x00007fad84696000) I use kernel 4.4.3, gcc 5.3.0 $ gcc -v Reading specs from /usr/lib64/gcc/x86_64-slackware-linux/5.3.0/specs COLLECT_GCC=gcc COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-slackware-linux/5.3.0/lto-wrapper Target: x86_64-slackware-linux Configured with: ../gcc-5.3.0/configure --prefix=/usr --libdir=/usr/lib64 --mandir=/usr/man --infodir=/usr/info --enable-shared --enable-bootstrap --enable-languages=ada,c,c++,fortran,go,java,lto,objc --enable-threads=posix --enable-checking=release --enable-objc-gc --with-system-zlib --with-python-dir=/lib64/python2.7/site-packages --enable-libstdcxx-dual-abi --with-default-libstdcxx-abi=gcc4-compatible --disable-libunwind-exceptions --enable-__cxa_atexit --enable-libssp --enable-lto --enable-install-libiberty --with-gnu-ld --verbose --enable-java-home --with-java-home=/usr/lib64/jvm/jre --with-jvm-root-dir=/usr/lib64/jvm --with-jvm-jar-dir=/usr/lib64/jvm/jvm-exports --with-arch-directory=amd64 --with-antlr-jar=/tmp/gcc/antlr-runtime-3.4.jar --enable-java-awt=gtk --disable-gtktest --disable-multilib --target=x86_64-slackware-linux --build=x86_64-slackware-linux --host=x86_64-slackware-linux Thread model: posix gcc version 5.3.0 (GCC) Mysql version: mysql Ver 15.1 Distrib 10.0.24-MariaDB, for Linux (x86_64) using readline 5.1 Glibc version 2.23 any one can help me to understand whats happaened ? HS

1 0

Found bug in quota-status + patch
by Thierry Coppey 03 Mar '16

03 Mar '16

Hello, I've found a bug in the quota-status util (Dovecot 2.2.21, and probably below): it always return OK (sufficient quota) because it fails to load the user properly. More specifically, the branch " if (quser == NULL) return 1; " in src/plugins/quota/quota-status.c:59 is always taken. (at least with postgresql backend, test your config with the (adapted) command below: printf "recipient=mailbox(a)example.com\nsize=10000000000\n\n" | nc inet:mailstore.example.com 12340 it should reject, unless you have no quota, or more than 10G). Therefore it is pointless to configure the quota-status service as described in http://wiki2.dovecot.org/Quota because of that bug: the mail would be always accepted from the client and rejected at the end of the (Postfix) processing by lda. It is possible to reject directly at SMTP level when the mailbox is full using Postfix and main.cf: smtpd_recipient_restrictions = ... reject_unauth_destination, ... check_policy_service inet:mailstore.example.com:12340 smtpd_end_of_data_restrictions = check_policy_service inet:mailstore.example.com:12340 However there remain a *small inconsistency* as lda will count the size of message including headers whereas smtpd_end_of_data_restrictions seems not to count them towards the message size (or additional headers might be added by other preprocessing e.g. antispam etc...) I propose the patch below to fix quota-status. Could an expert double-check that it doesn't have memory leaks? (it shouldn't but I'm not yet comfortable enough with Dovecot memory management). Best regards, Thierry C.

3 3

Dual certificate
by Jean-Baptiste Vignaud 03 Mar '16

03 Mar '16

Hello all; Is anyone knows if it's possible to have a dual certificate setup on dovecot like in postfix or apache ? i tried to add several crts in local name section : local_name imap.server.tdl { ssl_cert = <server_rsa_crt.pem ssl_key = <server_rsa_key.pem ssl_cert = <server_ecdsa_crt.pem ssl_key = <server_ecdsa_key.pem } but it seems that dovecot takes the last one (ecdsa) and that rsa cert is not used. to check if booth are working, i check with openssl: openssl s_client openssl s_client -connect imap.server.tdl:143 -starttls imap -servername imap.server.tdl -cipher ECDHE-RSA-AES128-GCM-SHA256 for rsa and openssl s_client openssl s_client -connect imap.server.tdl:143 -starttls imap -servername imap.server.tdl -cipher ECDHE-ECDSA-AES128-GCM-SHA256 for ecdsa In apache we have to duplicate the cert / key lines one for rsa, one for edcda. In postfix, we have some specific ecdsa conf keys. So is there a way to do the same in dovecot ?

3 3

Deleting / Removing users
by John Krug 03 Mar '16

03 Mar '16

i have a list of users that I’ve removed from LDAP and I want to delete their mail storage. sdbox Dovecot 2.2.15.8 I have mail messages in one location and indexes in another. Should I just rm -rf /messages/<username> rm -rf /indexes/<username> Thanks, JK ----------------------------------------------------------------------- John "JK" Krug System Administrator The University of Chicago | Laboratory Schools 1362 East 59th Street | Chicago, IL 60637 Phone: (773) 834-4476 jk(a)ucls.uchicago.edu <mailto:jkallo@ucls.uchicago.edu> | http://helpdesk.ucls.uchicago.edu _______________________________________________

2 3

Get mailbox from its guid through IMAP
by Peter Chiochetti 02 Mar '16

02 Mar '16

In the shell I'do: doveadm fetch -u bob mailbox mailbox-guid $box uid 1 Is there a way through IMAP to get the same? -- peter

2 1

user configuration question
by Eric Abrahamsen 02 Mar '16

02 Mar '16

I've been using mbsync to sync this email account to a local Dovecot installation. I used to use Gmail, through Google Apps, and a while ago switched the account to self-hosting. I didn't want to upload years' worth of old email to my old server, so I've had two accounts in my MUA: one talking to the local Dovecot account for the old emails, and a second talking directly to the server for the new emails. I'd like to sync the new account to Dovecot as well, and I'm having trouble wrapping my brain around how to configure the two side-by-side accounts in Dovecot (I know there are other solutions to this, but I'm also just trying to figure out how this works). What I don't grok is the exact effect of the different username fields in the passdb file, and how they combine with username_format. Right now my dovecot.conf has this: passdb { driver = passwd-file args = username_format=%u /etc/dovecot/passwd } userdb { driver = static args = uid=eric gid=users home=/home/eric/.mail/%d/%n username_format=%u default_fields = mail=maildir:/home/eric/.mail/%d/%n/mail } And /etc/dovecot/passwd: eric@ericabrahamsen.net:{PLAIN}password:eric@ericabrahamsen.net Say I want to keep my existing mail where it is, and have all the new mail go into ~/.mail/ericabrahamsen.net/eric-new/mail. Ie, when mbsync connects to the local Dovecot, it does so with the username eric-new(a)ericabrahamsen.net. Now, in Dovecot's conf, do I change the email address in the first field of /etc/dovecot/passwd, or the third field, or both? And, if it isn't too much trouble, what is the difference between the two? Thanks! Eric

1 0

Dsync induces redundant mail after rapid append/expunge repeatedly
by 潘信傑 02 Mar '16

02 Mar '16

I meet the problem about dsync with expunge. The problems is expunged mail would reappear after dsyncing and it is easily to reproduce. Environment Settings: - Two servers(serverA, serverB) both enabled plugin "*replication"* - And more detail get by "dovecot -n" show below Reproduce flow: - Run two processes pA and pB both would run in while loop - pA(All behavior is on Draft mailbox and all on serverA): - Clean "Draft" mailbox of userA - Run the following imap command of userA - imap save (save new mail to Draft) - imap delete (delete old mail on Draft) - imap expunge * - Check if draft only have one email (it would be failed in about 50 loops)* - pB(Send mail to serverB): - Send new mail to userA (which would be save in INBOX) It would be easier reproduce by increasing server loading. I have found something - T he expunge changes from server A in dsync connection don't send immediately, these expunge changes appear after 1~2 dsync connection over. - The replicated mail is generated from serverB and sync back to serverA so expunged mail reappeared. dovecot -n (ServerA) # 2.2.19: /etc/dovecot/dovecot.conf # OS: Linux 3.10.77 x86_64 ext4 auth_mechanisms = plain login default_internal_user = root default_login_user = dovecot default_vsz_limit = 0 disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u dsync_target_servers = tcps:10.13.23.139:24245 lda_mailbox_autocreate = yes mail_debug = yes mail_fsync = never mail_location = maildir:/var/spool/mail/%d/%-4.04i/%i/Maildir mail_max_userip_connections = 30 mail_never_cache_fields = * mail_plugins = " notify replication mail_log" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@._/\~&,()[]" mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid size flags from subject } postmaster_address = postmaster@localhost protocols = imap pop3 lmtp imap pop3 sieve replication_dsync_parameters = -N -l 30 -U service aggregator { fifo_listener replication-notify-fifo { group = users mode = 0666 user = admin } unix_listener replication-notify { group = users mode = 0666 user = admin } } service doveadm { inet_listener { address = 10.13.23.136,127.0.0.1 port = 24245 ssl = yes } } service imap-login { inet_listener imap { address = 10.13.23.136,127.0.0.1 port = 143 } inet_listener imaps { address = 10.13.23.136,127.0.0.1 port = 993 ssl = yes } process_limit = 256 service_count = 0 } service indexer-worker { process_limit = 8 } service pop3-login { inet_listener pop3 { address = 10.13.23.136,127.0.0.1 port = 110 } inet_listener pop3s { address = 10.13.23.136,127.0.0.1 port = 995 ssl = yes } process_limit = 256 service_count = 0 } service replicator { unix_listener replicator-doveadm { mode = 0666 } } userdb { driver = passwd } protocol lda { mail_plugins = " notify replication mail_log sieve" } dovecot -n (ServerB) $ ./sbin/dovecot -n # 2.2.19: /etc/dovecot/dovecot.conf # OS: Linux 3.10.77 x86_64 auth_mechanisms = plain login default_internal_user = root default_login_user = dovecot default_vsz_limit = 0 disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u dsync_target_servers = tcps:10.13.23.136:24245 lda_mailbox_autocreate = yes mail_debug = yes mail_fsync = always mail_location = maildir:/var/spool/mail/%d/%-4.04i/%i/Maildir mail_max_userip_connections = 30 mail_never_cache_fields = * mail_plugins = " notify replication mail_log" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational reg ex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@._/\~&,()[]" mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid size flags from subject } postmaster_address = postmaster@localhost protocols = imap pop3 lmtp imap pop3 sieve replication_dsync_parameters = -N -l 30 -U service aggregator { fifo_listener replication-notify-fifo { group = users mode = 0666 user = admin } unix_listener replication-notify { group = users mode = 0666 user = admin } } service doveadm { inet_listener { address = 10.13.23.139,127.0.0.1 port = 24245 ssl = yes } } service imap-login { inet_listener imap { address = 10.13.23.139,127.0.0.1 port = 143 } inet_listener imaps { address = 10.13.23.139,127.0.0.1 port = 993 ssl = yes } process_limit = 256 service_count = 0 } service indexer-worker { process_limit = 4 } service pop3-login { inet_listener pop3 { address = 10.13.23.139,127.0.0.1 port = 110 } inet_listener pop3s { address = 10.13.23.139,127.0.0.1 port = 995 ssl = yes } process_limit = 256 service_count = 0 } service replicator { unix_listener replicator-doveadm { mode = 0666 } } userdb { driver = passwd } protocol lda { mail_plugins = " notify replication mail_log sieve" } Regards, Jay Pan

2 2

Setup changes 1.x to 2.x -- custom POP3 account handling required.
by Andrew McGlashan 02 Mar '16

02 Mar '16

Hi, Previously I did /special/ processing for some email accounts; if a particular file existed in the user's home directory, then I caused the account to use /var/mail/$USER file for POP -- otherwise it used IMAP. Now, because I adjusted the setup for POP only, IMAP still worked perfectly well. Some users have both POP and IMAP access for various reasons. The special POP processing was done using a shell script [1] in place of: /usr/lib/dovecot/pop3 - which in turn called the normal binary once setting up the environment. Now, I have been forced to upgrade my Debian from squeeze-lts to wheezy and the dovecot setup is quite different. How can I implement my /wrapper/ script for POP handling now? Here is my current setup with dovecot -n ... # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 7.9 mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Items" { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap pop3" service imap-login { inet_listener imap { port = 0 } } service pop3-login { inet_listener pop3 { port = 0 } } ssl = required ssl_cert = </etc/exim4/exim.crt ssl_key = </etc/exim4/exim.key userdb { driver = passwd } [1] This is the content of the original wrapper script: #!/bin/sh if [ -f $HOME/.use-mbox-for-pop3s ]; then export MAIL=mbox:$HOME/mail:INBOX=/var/mail/$USER export USER_INBOX=/var/mail/$USER if [ -f $USER_INBOX ] then export USER_INBOX_GROUP=$(stat -c %G $USER_INBOX) if [ $USER_INBOX_GROUP != $USER ] then ( date ls -l $USER_INBOX chown Debian-exim:$USER $USER_INBOX ls -l $USER_INBOX ) >> /var/log/usr-lib-dovecot--pop3-affinity.log fi fi else if [ -d $HOME/Maildir ]; then export MAIL=Maildir:$HOME/Maildir else export MAIL=mbox:$HOME/mail:INBOX=/var/mail/$USER fi fi # Finally execute the imap/pop3. If you use both, you'll need two scripts. # - this customization just for POP3S ... exec /usr/lib/dovecot/pop3 Thanks AndrewM

2 2

dsync issues due to Prefix difference?
by Mark Little 02 Mar '16

02 Mar '16

Hi everyone, I'm hoping I am just missing something obvious - but I cannot seem to get a one-way migration dsync working between two Dovecot servers because the Prefix configuration is different. I am doing a migration from our old Dovecot servers to some new cPanel based ones. Source: 2.2.15 Dest: 2.2.21 Here is the debug output for the sync: doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so doveadm(testuser(a)example.ca): Debug: Effective uid=1322, gid=1322, home=/khstor3/khmail-mailboxes/l/li/example.ca/testuser doveadm(testuser(a)example.ca): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir doveadm(testuser(a)example.ca): Debug: maildir++: root=/khstor3/khmail-mailboxes/l/li/example.ca/testuser/Maildir, index=, indexpvt=, control=, inbox=/khstor3/khmail-mailboxes/l/li/example.ca/testuser/Maildir, alt= doveadm(testuser(a)example.ca): Debug: Namespace : Using permissions from /khstor3/khmail-mailboxes/l/li/example.ca/testuser/Maildir: mode=0777 gid=default stdin: is not a tty dsync-local(testuser(a)example.ca): Debug: brain M: Local mailbox tree: INBOX guid=f055ac07d79cad508a7a000075e38adc uid_validity=1353555159 uid_next=2085 subs=no last_change=0 last_subs=0 dsync-local(testuser(a)example.ca): Debug: brain M: Local mailbox tree: Junk guid=703a8b1d51ceab56f91e0000667eee40 uid_validity=1391566942 uid_next=1 subs=yes last_change=0 last_subs=1454100049 dsync-local(testuser(a)example.ca): Debug: brain M: Local mailbox tree: Trash guid=9bee9f0f2aacb65039260000b171e44d uid_validity=1353555163 uid_next=25 subs=no last_change=0 last_subs=0 dsync-local(testuser(a)example.ca): Debug: brain M: Local mailbox tree: Drafts guid=4d03661058a0f1524f240000e9d81ad0 uid_validity=1391566936 uid_next=1 subs=no last_change=0 last_subs=0 dsync-local(testuser(a)example.ca): Debug: brain M: Local mailbox tree: Sent guid=99ee9f0f2aacb65039260000b171e44d uid_validity=1353555161 uid_next=4 subs=no last_change=0 last_subs=0 dsync-local(testuser(a)example.ca): Debug: brain M: Remote mailbox tree: INBOX guid=6460141741cfab5643470000afb0d608 uid_validity=1454100291 uid_next=2064 subs=no last_change=0 last_subs=0 dsync-local(testuser(a)example.ca): Debug: brain M: Remote mailbox tree: INBOX.Trash guid=6360141741cfab5643470000afb0d608 uid_validity=1454100290 uid_next=12 subs=yes last_change=0 last_subs=1454100289 dsync-local(testuser(a)example.ca): Debug: brain M: Remote mailbox tree: INBOX.Sent guid=6260141741cfab5643470000afb0d608 uid_validity=1454100289 uid_next=2 subs=yes last_change=0 last_subs=1454100289 dsync-remote(testuser(a)example.ca): Error: Couldn't find namespace for mailbox Junk I believe the problem is because on the source we have no prefix set, but on the destination it has INBOX as the prefix. I need to use dsync because we have many POP3 clients so I need to ensure the UIDL's are copied correctly. Here is the output from 'doveconf namespace': Source: namespace inbox { disabled = no hidden = no ignore_on_failure = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe driver = special_use = \Drafts } mailbox Junk { auto = subscribe driver = special_use = \Junk } mailbox Sent { auto = subscribe driver = special_use = \Sent } mailbox "Sent Messages" { auto = no driver = special_use = \Sent } mailbox Trash { auto = subscribe driver = special_use = \Trash } order = 0 prefix = separator = subscriptions = yes type = private } Destination: namespace { disabled = no hidden = no ignore_on_failure = no inbox = yes list = yes location = mailbox Archive { auto = create autoexpunge = 0 comment = driver = special_use = \Archive } mailbox Archives { auto = no autoexpunge = 0 comment = driver = special_use = \Archive } mailbox Drafts { auto = subscribe autoexpunge = 0 comment = driver = special_use = \Drafts } mailbox Junk { auto = create autoexpunge = 0 comment = driver = special_use = \Junk } mailbox Sent { auto = subscribe autoexpunge = 0 comment = driver = special_use = \Sent } mailbox "Sent Messages" { auto = no autoexpunge = 0 comment = driver = special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 0 comment = driver = special_use = \Trash } order = 0 prefix = INBOX. separator = subscriptions = yes type = private } If anyone could provide some assistance it would be greatly appreciated! Thanks, Mark

2 6

where is pop3_migration_ignore_missing_uidls=yes set?
by Leon Kyneur 02 Mar '16

02 Mar '16

While doing pop3 migrations with dsync I am getting an error: dsync(user(a)domain.net): Error: pop3_migration: 2 POP3 messages have no matching IMAP messages (first POP3 msg 2638 UIDL fb3d6f3299541e695a28585f5803ed1c) - set pop3_migration_ignore_missing_uidls=yes to continue anyway dsync(user(a)domain.net): Error: Exporting mailbox INBOX failed: Can't lookup pop3-uidl for UID=3252: POP3 UIDLs couldn't be synced Can't see this is doveconf -a so it's not a setting? - tried configuring it as a plugin setting but that didn't work... Where is the correct place to set this? TIA

2 1

Alternative storage backend for Dovecot
by Oleksandr Natalenko 01 Mar '16

01 Mar '16

Hi. We have corporate Dovecot setup with GlusterFS as file storage. We store maildirs on GlueterFS share, mounting it via NFS. Mounting share via native GlusterFS FUSE client introduces visible performance overhead. Also, NFS mount does not provide us with HA. That's why I have an idea to use GlusterFS C API to access maildirs share. I'd like to preserve maildir structure, but get access to it not via FS mount point but with GlusterFS C API calls. I've discovered that Dovecot source tree has src/lib-fs infrastructure with fs-posix implemented on top of it. Is that the right place to start from? GlusterFS C API calls are POSIX-like, so they could be easily used as substitutions for VFS ops. Could such a backend be implemented as separate plugin? Are there any examples of alternative storage backend to look at? Thanks. Regards, Oleksandr.

2 1

search problem dovecot 2.2.21 + fts - Solr
by Anderson Barbosa 01 Mar '16

01 Mar '16

Hello, Realized update dovecot on my server. Now the search is returning differently from the previous version bringing reference information of other messages . For example when doing a search for anderson.joao this new version of the dovecot dovecot 2.2.21 + fts - Solr response will be all email that has the word anderson and joao, instead of returning only items with the word anderson.joao. Before used version 2.2.18 + dovecot fts - Solr and the problem did not occur . For example practical test : Dovecot 2.2.18 # telnet SERVER 143 Trying SERVER... Connected to SERVER. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Zimbra IMAP4. a login conta(a)conta.com.br 1223456 a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAn a select INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 14 EXISTS * 0 RECENT * OK [UIDVALIDITY 1452548222] UIDs valid * OK [UIDNEXT 25] Predicted next UID * OK [HIGHESTMODSEQ 52] Highest a OK [READ-WRITE] Select completed (0.001 secs). a SEARCH text "anderson" * SEARCH 11 12 (2 found emails) a OK Search completed (0.265 secs). a SEARCH text "joao" * SEARCH 13 14 (2 found emails) a OK Search completed (0.003 secs). a SEARCH text "anderson.joao" * SEARCH (0 found emails) a OK Search completed (0.004 secs). a logout * BYE Logging out a OK Logout completed. Connection closed by foreign host. Dovecot 2.2.21 # telnet SERVER 143 Trying SERVER... Connected to SERVER. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Zimbra IMAP4. a login conta(a)conta.com.br 1223456 a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAn a select INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 14 EXISTS * 0 RECENT * OK [UIDVALIDITY 1452548222] UIDs valid * OK [UIDNEXT 25] Predicted next UID * OK [HIGHESTMODSEQ 52] Highest a OK [READ-WRITE] Select completed (0.000 + 0.000 secs). a SEARCH text "anderson" * SEARCH 11 12 (2 found emails) a OK Search completed (0.004 + 0.000 secs). a SEARCH text "joao" (2 found emails) * SEARCH 13 14 a OK Search completed (0.005 + 0.000 secs). a SEARCH text "anderson.joao" * SEARCH 11 12 13 14 *(4 found emails)* a OK Search completed (0.005 + 0.000 secs). a logout * BYE Logging out a OK Logout completed. Connection closed by foreign host. Even using characters Special "" \ scape, ' ' for an answer will always be all emails with the word anderson and joao. Checking the Changelog dovecot noticed que NAS versions Previous v2.2.20 and v2.2.19 certain changes with respect to fts . There Have Another way to Make Search for Exact Word In this new version to loft? -- Anderson Barbosa dos Santos Em todo o universo, nada existe de mais parecido com Deus que o silêncio. "Johanes Eckhart"

3 3

Inconsistent mdbox index while running doveadm altmove
by Ricardo Machini Barbosa 01 Mar '16

01 Mar '16

Hello, I was performing doveadm altmove for one account while this mailbox was being accessed. Dovecot version: 2.2.21 Mailbox format: mdbox Command: doveadm altmove -u user1(a)domain.com.br before 360d This command took about 5 minutes to finish and during the execution I found some log messages: Feb 25 19:57:51 dovecot: imap(user1(a)domain.com.br): Error: mdbox map /var/mail/user1/mdbox/storage/dovecot.map.index corrupted: Unexpectedly lost INBOX uid=77 map_uid=76 Feb 25 19:57:51 dovecot: imap(user1(a)domain.com.br): Internal error occurred. Refer to server log for more information. [2016-02-25 19:57:51] in=4798 out=1361819 deleted=0 expunged=0 trashed=0 Feb 25 19:57:51 dovecot: imap(user1(a)domain.com.br): Warning: fscking index file /var/mail/user1/mdbox/storage/dovecot.map.index Feb 25 19:58:15 dovecot: imap(user1(a)domain.com.br): Error: /var/mail/user1/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent Feb 25 19:58:20 dovecot: imap(user1(a)domain.com.br): Error: /var/mail/user1/mdbox/mailboxes/Rascunhos/dbox-Mails/dovecot.index reset, view is now inconsistent After that these messages moved to alternate storage disappeared from the mailbox/IMAP but these files were all on alternative storage. I had to execute doveadm force-resync -u user1(a)domain.com.br INBOX to recovery this mailbox, but losing all e-mail's flags. I should do some kind of lock before running the command altmove ? Regards, Ricardo

2 1

Re: severe fork() problems with new dovecot server
by J. Niklas 01 Mar '16

01 Mar '16

On 01.03.2016 18:21, Dolf Schimmel wrote: > Recently I played around a little with cgroups where you can limit the max number of processes per cgroup. > Could it be that, perhaps, you've stumbled upon such a limit? > Systemd does contain all services by default in their own cgroup afaik, > so it could be that you're using it unknowingly. Yes, yes, \o/ ;-) #> systemctl status dovecot.service * dovecot.service - Dovecot IMAP/POP3 email server Loaded: loaded (/lib/systemd/system/dovecot.service; enabled; vendor preset: enabled) Drop-In: /etc/systemd/system/dovecot.service.d `-ulimits.conf Active: active (running) since Tue 2016-03-01 15:28:29; 4h 24min ago Main PID: 10098 (dovecot) Tasks: 204 (limit: 512) CGroup: /system.slice/dovecot.service There ist my "512". The way of systemd, ignoring all the config stuff that has been there for decades while inposing its own, complex and very sparsely documented ruleset on top is beginning to seriously annoy me. At least I would have expected some sort of syslog message. Just for the records, this can be changed by adding e.g. TasksMax=4096 to the /etc/systemd/system/dovecot.service.d/ulimits.conf I cited in my OP. Now I'll have to wait and see how things will evolve tomorrow. Thank you so much for the great hint! -- kind regards, Jon

2 1

severe fork() problems with new dovecot server
by J. Niklas 01 Mar '16

01 Mar '16

Hi all, I am getting to you because I am pretty desperate by now. Please read this and share your ideas. I set up a new Mail server with roughly 750 active accounts on it, based on the usual dovecot+postfix+amavis+sql based vmail setup. This is not the first time I did something like this, but admittedly my largest setup so far. I took my time to setup everything pretty straight and stable and migrated all accounts in time with almost no glitches using imapc and pop3c. Things started out smoothly - until the first business morning when the log suddenly began to pop messages like these: dovecot: master: Error: service(imap): fork() failed: Resource temporarily unavailable dovecot: master: Error: service(pop3): fork() failed: Resource temporarily unavailable The error is not confined to a certain service. There are no other messages in dmesg or syslog which could help in closing in on the root cause. The server always runs at load around 0.4 to 0.5 and has plenty of RAM and Disk, too. Of course I checked resource limits and cranked up everything I could possibly think of to numbers that should easily suffice: /etc/security/limits.conf: daemon soft nproc 2048 daemon hard nproc 3128 dovecot soft nproc 2048 dovecot hard nproc 3128 vmail soft nproc 2048 vmail hard nproc 3128 vmail soft nofile 32768 vmail hard nofile 49152 /etc/systemd/system/dovecot.service.d/ulimits.conf: [Service] LimitNOFILE=65534 However, all my attempts on resolving the problem were futile so far. To work around the problem I implemented a log watcher which constantly looks for the fork failure and dumps some debug info before restarting dovecot to make the problem "go away" - until dovecot hits whatever barrier there is again. Here are today's numbers I gathered from this: > forkdump_03-01_09-42: pop=3, imap=446, all=503, postfix:22, sys: 716 > forkdump_03-01_10-09: pop=9, imap=444, all=510, postfix:28, sys: 741 > forkdump_03-01_10-42: pop=5, imap=450, all=507, postfix:25, sys: 748 > forkdump_03-01_11-18: pop=5, imap=451, all=512, postfix:29, sys: 757 > forkdump_03-01_11-48: pop=3, imap=474, all=511, postfix:37, sys: 765 > forkdump_03-01_12-23: pop=7, imap=444, all=511, postfix:22, sys: 752 > forkdump_03-01_12-53: pop=3, imap=444, all=503, postfix:24, sys: 747 > forkdump_03-01_13-21: pop=3, imap=458, all=504, postfix:31, sys: 766 > forkdump_03-01_13-41: pop=4, imap=451, all=505, postfix:23, sys: 755 > forkdump_03-01_14-35: pop=5, imap=436, all=502, postfix:31, sys: 768 > forkdump_03-01_14-59: pop=3, imap=445, all=501, postfix:27, sys: 764 > forkdump_03-01_15-28: pop=6, imap=452, all=507, postfix:25, sys: 769 There you see the number of pop3 and imap childs in the process list as well as the total number of all dovecot processes and all postfix processes, summarized directly after the fork problem appears in the log. The last column is the sum of all processes in the system. Here is a run where the numbers are measured as the server approaches the last entry in the list above. > 15:26:15: pop=3, imap=432, all=485, VSZ: 14353k, postfix:30, sys: 749 > 15:26:30: pop=4, imap=435, all=490, VSZ: 14497k, postfix:30, sys: 754 > 15:26:45: pop=3, imap=439, all=492, VSZ: 14560k, postfix:28, sys: 754 > 15:27:00: pop=3, imap=444, all=497, VSZ: 14711k, postfix:28, sys: 760 > 15:27:15: pop=4, imap=442, all=496, VSZ: 14673k, postfix:25, sys: 756 > 15:27:30: pop=4, imap=444, all=497, VSZ: 14721k, postfix:25, sys: 757 > 15:27:46: pop=3, imap=446, all=498, VSZ: 14756k, postfix:25, sys: 758 > 15:28:01: pop=3, imap=446, all=497, VSZ: 14718k, postfix:24, sys: 756 > 15:28:16: pop=3, imap=455, all=507, VSZ: 15018k, postfix:25, sys: 767 > 15:28:18: pop=3, imap=455, all=507, VSZ: 15018k, postfix:25, sys: 767 > 15:28:20: pop=3, imap=452, all=504, VSZ: 14931k, postfix:25, sys: 764 ---- service(pop3): fork() failed: Resource temporarily unavailable ---- > 15:28:22: pop=4, imap=452, all=505, VSZ: 14954k, postfix:25, sys: 770 > 15:28:24: pop=4, imap=452, all=505, VSZ: 14954k, postfix:25, sys: 770 > 15:28:26: pop=4, imap=451, all=504, VSZ: 14925k, postfix:25, sys: 769 > 15:28:28: pop=5, imap=451, all=506, VSZ: 14980k, postfix:25, sys: 771 ---- dovecot restart complete ---- > 15:28:30: pop=3, imap=11, all=22, VSZ: 485k, postfix:25, sys: 282 > 15:29:00: pop=4, imap=65, all=83, VSZ: 2293k, postfix:26, sys: 344 > 15:29:31: pop=3, imap=91, all=111, VSZ: 3129k, postfix:27, sys: 373 It always seems to happen shortly after the number of dovecot processes goes beyond 500. The VSZ column is the VSZ sum of all dovecot procs. The number of files opened by vmail (lsof -u <vmailuid> | wc -l) at that moment usually is between 13k and 15k. sysctl fs.file-nr mostly is around 16k total but the system limit is set way higher (at 1532853) However, as you can see in the following dump, there is no process_limit or whatever being set to 500 or 512 or similar. # --------- su vmail -c "ulimit -Ha:" --------------- core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 60026 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 49152 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) unlimited cpu time (seconds, -t) unlimited max user processes (-u) 3128 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited # ---------------- dovecot -n (mildly anonymized) --------------- # 2.2.18: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 4.4.0-8-generic x86_64 Ubuntu Xenial Xerus (development branch) xfs auth_cache_negative_ttl = 0 auth_cache_size = 50 M auth_mechanisms = plain login default_client_limit = 10000 dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } hostname = my.mail.host imap_client_workarounds = delay-newmail lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To listen = * mail_location = sdbox:/mailsrv/users/%d/%u mail_plugins = quota notify mail_log fts managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { fts_autoindex = yes quota = dict:User quota::proxy::quota sieve = file:~/sieve;active=~/.dovecot.sieve sieve_dir = ~/sieve stats_refresh = 30s stats_track_cmds = yes } postmaster_address = postmaster(a)my.mail.host protocols = " imap lmtp sieve pop3" service anvil { client_limit = 11227 } service auth { client_limit = 11324 unix_listener /mailsrv/spool/private/auth { group = postfix mode = 0666 user = postfix } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { process_limit = 10000 process_min_avail = 5 service_count = 0 vsz_limit = 2 G } service imap { process_limit = 2048 vsz_limit = 2 G } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { process_limit = 1024 process_min_avail = 3 service_count = 0 vsz_limit = 2 G } service pop3 { process_limit = 1024 } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_cert = </etc/ssl/local/my.mail.host.crt.pem ssl_key = </etc/ssl/local/my.mail.host.key.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = quota notify mail_log fts quota sieve } protocol lda { mail_plugins = quota notify mail_log fts sieve } protocol imap { mail_max_userip_connections = 15 mail_plugins = quota notify mail_log fts imap_quota stats imap_stats } protocol pop3 { mail_max_userip_connections = 15 } # ------------ end dovecot -n ------------- So, here I am, out of ideas for the moment. Do you have any? -- kind regards, Jonathan

1 0

What happened to dovecot.fi?
by Pieter Koorts 01 Mar '16

01 Mar '16

Hi All, Any news about what happened to dovecot.fi ? Is enterprise or the S3 backend plugin still available? Reason for asking is every attempt to access the dovecot.fi website shows it as down and has done for a while. Pieter

2 1

Returning custom autoexpunge for user's INBOX
by Tom Johnson 01 Mar '16

01 Mar '16

I want to be able to have custom autoexpunge settings for different users. I have it working for various folders (draft, junk, trash), but I can't seem to get it working for the user's primary inbox. In my user_query (I'm using mysql), I'm returning entries like this in the userdb_import field: namespace/inbox/mailbox/autoexpunge=5d namespace/inbox/mailbox/Drafts/autoexpunge=5d namespace/inbox/mailbox/Junk/autoexpunge=5d namespace/inbox/mailbox/Trash/autoexpunge=5d And everything works fine for Drafts, Junk, and Trash, but not for the main inbox. The logs show: Debug: Unknown userdb setting: plugin/namespace/inbox/mailbox/autoexpunge=5d I've also tried variations, trying to get the namespace correct for the main inbox, but they all get the same "Unknown userdb setting" error: namespace/inbox/mailbox/autoexpunge=5d namespace/inbox/mailbox/inbox/autoexpunge=5d namespace/inbox/mailbox/Inbox/autoexpunge=5d namespace/inbox/mailbox/INBOX/autoexpunge=5d I suspect I'm just giving the wrong namespace for the primary inbox. What's the right way to do this? Tom

2 2

UnicodeData
by Vincent Dahmen 29 Feb '16

29 Feb '16

Hey guys, there seem to be a problem with wget and/or the unicode webserver. During the make process there are several files wich are download from the unicode server. I can access them manually but both curl and wget failing to get it. Are they any other mirrors or anyone else expiring this bug? Greetings

2 3

Re: sieve_extprograms - double linebreaks at filtering
by Hajo Locke 29 Feb '16

29 Feb '16

Hello, Am 09.09.2015 um 13:30 schrieb Stephan Bosch: > > > Op 9-9-2015 om 12:37 schreef Hajo Locke: >> Hello, >> >> >> Am 09.09.2015 um 11:26 schrieb Stephan Bosch: >>> >>> >>> Op 8-9-2015 om 13:10 schreef Hajo Locke: >>>> Hello List, >>>> >>>> i have a problem when using sieve-plugin sieve_extprograms. I use >>>> dovecot 2.2.18 and bundled pigeonhole 0.4.6 (Ubuntu 14.04.3 LTS) >>>> >>>> i have enabled sieve_extprograms and vnd.dovecot.filter to send >>>> mail to user-defined script and get changed content back. >>>> My script previously was used with procmail and is working fine. >>>> Using same script with vnd.dovecot.filter leads to odd behavior. >>>> I already found out the problem itself: >>>> By sending Mailcontent to filter-programm it seems that >>>> sieve/sieve_extprograms is adding additional linebreaks to every >>>> line of complete mail. >>>> Please see this image to clarify: >>>> http://r31i.imgup.net/header8d56.jpg?l=de >>>> Every lineending got additional windows-lineendings, which leads to >>>> problems with processing scripts. >>>> Piping mails by procmail to same script is working without >>>> problems, because this mails are recieved "clean" without the "^M". >>> >>> Well, the specified format for an internet message like e-mail has >>> CRLF line endings everywhere. That's why this happens now: >>> >>> http://hg.rename-it.nl/dovecot-2.2-pigeonhole/file/5df1b6d72ec2/src/plugins… >>> >>> >>> But maybe that is not such a good idea in a UNIX environment. I >>> think I can just make it configurable. >> >> ahh, there it is. i think just commenting out this line in my sources >> will result in some errors. Is there a possibility for me to make a >> quickfix in my sources? (use other function or something like that) > > You can replace it with the i_stream_create_lf() function, which > enforces LF rather than CR+LF, which would be what you need. Unfortunately i have to continue this issue. During my last updates this problem is occured again. This are my versions: # 2.2.21 (): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.11 (6ddf62b87f60+) # OS: Linux 3.13.0-77-generic x86_64 Ubuntu 14.04.4 LTS I tried to configure the linebreaks in my plugin section of /etc/dovecot/dovecot.conf by: sieve_extprograms_input_eol = lf But it seems to have no effect. Is this configured the right way or i have to use 0.4.12? Currently it looks like this: plugin { sieve = ~/sieve/.dovecot.sieve sieve_before = ~/sieve_before/.dovecot_before.sieve sieve_after = ~/sieve_after/.dovecot_after.sieve sieve_plugins = sieve_extprograms sieve_extensions = +vnd.dovecot.pipe +vnd.dovecot.filter +vnd.dovecot.execute +editheader sieve_pipe_bin_dir = /usr/local/bin/ sieve_filter_bin_dir = /usr/local/bin/ sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/ sieve_extprograms_input_eol = lf } > > Regards, > > Stephan. > > Thanks, Hajo

2 2

Queries are not being sent to solr when search on server issued via imap client.
by ralph.jones＠modolingo.de 29 Feb '16

29 Feb '16

I traced the network communication with the solr server with tcpdump: sudo tcpdump -i any -A -vvv port 8080 I logged into the imap server via telnet (actually openssl) and issued the command ". search body <string>". About 20 results were returned within about half a second. Nothing was seen in tcpdump. When I issue "doveadm search box <string>", I can see the search string in the output of tcpdump and also in the solr logs. Solr seems to have been initialized correctly, in that when I issue a query via curl, I receive the correct results. I am using: dovecot 2.2.13 (debian jessie) libsolr-java 3.6.2+dfsg-5 relevant config: mail_plugins = fts fts_solr acl virtual plugin { fts = solr fts_solr = url=http://localhost:8080/solr/ debug ... }

2 1

Dovecot sieve - How to check which username a mail is being delivered to?
by Yannik Sembritzki 27 Feb '16

27 Feb '16

Hi everyone, I am looking for a way to check which mailbox an email is being delivered to in a global sieve filter. After not being able to find some kind of variable that is populated by dovecot automatically, I tried to use the `Delivered-To` header. I tried a check like this: header :is "delivered-to" "<user(a)domain.org>" Unfortunately, this does not only match the first occurence of the header (which can be assumed is added by dovecot), but any occurence of this header in the email, which could be added due to previous deliveries and forwards, or just cause of malice. Is there any way to achieve this? Best regards, Yannik

2 3

Assertion crash: (idx * array->element_size < array->buffer->used)
by Joseph Tam 27 Feb '16

27 Feb '16

Log message: Traceback is hex gibberish: if symbolic traceback is needed, I'll recompile with "cc -g" and retest. Panic: file ../../../src/lib/array.h: line 219 (array_idx_i): assertion failed : (idx * array->element_size < array->buffer->used) (Similar to http://dovecot.org/pipermail/dovecot/2015-February/099771.html) IMAP command that provoked the crash: x1 FETCH 3 (BODY) Dovecot version: 2.2.19, Solaris10 (I don't think doveconf -n is relevant, but willing to provide if needed). It seems like a mailbox index issue. Removing, then recreating the indices gets rid of the crash. I saved these indices if it will help. Joseph Tam <jtam.home(a)gmail.com>

1 0

Different Quotas For Public Namespace
by Chris 26 Feb '16

26 Feb '16

Dear All, are different quotas for public namespace folders possible? They're in the same namespace. If I got it right, the wiki says there's one quota per namespace only? - Chris

2 2

Block public namespace mail when quota exceeded
by Chris 26 Feb '16

26 Feb '16

Dear All, is it possible to temporarily reject mails, when quota of public namespace subfolder is exceeded? I'd check folder size with a cronjob. Dovecot is using a system user, so I guess blocking post and insert in ACL isn't a solution? I don't want to set the folder to read-only, that users can still delete mails. Thank you in advance. - Chris

2 2

Question: Directory hashing to support large domains | Dovecot & MySQL
by Altin Ukshini 26 Feb '16

26 Feb '16

Hello there, I have a postfix + dovecot + mysql installation in an ubuntu server. Virtual users and domains in a small mysql db that I manage via a web based mailadmin I wrote myself. The mysql db I'm talking about has a qmail structure that used to be managed by qmailadmin and worked with vpopmail. As for information, I cannot move to a different structure (exc postfixadmin/postfix) for many reasons, so I was forced to stick with it and configure postfix and dovecot to read that structure... If you may know, qmail (depends on the configuration) uses a directory hashing like /home/vpopmail/DOMAIN/P/7/USERNAME (something similar) in order to manage large domains, and this is handled by vpopmail. Please refer to these two links for details: - http://free.acrconsulting.co.uk/email/qmh.html - https://sourceforge.net/p/vpopmail/mailman/message/2710408/ I saw that dovecot uses something similar which I found in dovecot documentation : http://wiki2.dovecot.org/MailLocation#Directory_hashing Unfortunately, I cannot find more details, so I'd be thankful if you help me out with the following: By reading the documentation, I can tell that I can use the dir hashing variables in my dovecot configuration. But, in my case, I get the directory path from my mysql db via dovecot sql user_query - not from mail_location variable in 10-mail.conf Therefore if in case of a first received email for a user: dovecot checks in the db, gets the path and creates the maildir from the given path. In case the maildir column is empty, it fails, and it also fails to authenticate... So, can dovecot write to mysql? I would like to use directory hashing of dovecot, but from what I can find: If dovecot has mail_location variable set to do the dir hashing, it will not then go and add the created path in my mysql db. While if I try to implement something similar from my web gui application, I'd probably have to rewrite the algorithm that does this!? Can anyone help me figure out what's the best way to implement this? Thank you very much in advance for your help! Best, Altin Ukshini

1 0

[Feature Request] doveadm option to return number of messages acted upon
by Haravikk 26 Feb '16

26 Feb '16

So I have a script for handling my specific archive and expunge needs, but it’d be nice to be able to track how many messages are being affected. Currently I’m doing it by firing the same search queries into doveadm search and counting the lines of the result with wc -l, but that’s not a very pretty solution. While I’m mostly doing it out of interest on a personal server, I can’t imagine it’s a very scalable way to do it if you wanted to gather some kind of metrics for example. What I think would make sense would be for relevant doveadm commands such as move, expunge (probably purge too) and others I haven’t thought of to have a new option that, if enabled, will cause the command to output the number of messages affected as the final line of output (most of these commands don’t have any output anyway). A doveadm count command could also be a convenient, more efficient, alternative to doveadm search | wc -l.

2 1

Replication between two ISPCOnfig servers
by Otto Saayman 26 Feb '16

26 Feb '16

Hello I have set up two servers, one master and one slave, using ISPConfig. I have been using rsync to synchronise mails between the two machines, but this has some unstable results. I had a look at setting up replication: http://wiki.dovecot.org/Replication When I run the command, doveadm user '*', only two users are returned. So when I run this command: doveadm replicator replicate \* I get: 2 users updated I run this command: doveadm sync -u [e-mail address] tcp:[2nd/ slave dovecot server IP address] Here I can input any valid e-mail address in the ISPConfig MySQL database and it works. How do I tell the dovecote server to replicate all the users configured in the MySQL database it uses when it handles logins via POP/ IMAP, all of which is working fine? Is there a command I need to run at a set interval via cron to synchronise the two machines' mailboxes, which are identical in every way except the mails the users' mailboxes contain? OR Is there a way that I can instruct the two machines to keep each other's user mailbox contents "up to date"? The main idea is to have a hot backup of my "main" dovecot server and also to enable a lower mail priority for the second server so that mails are still received when the main server becomes busy, or is taken offline for some reason. Any help, or link to a HOWTO would be appreciated. -- Best Regards Otto Saayman

2 1

Checking index sanity
by Emmanuel Dreyfus 25 Feb '16

25 Feb '16

Hello We experienced corrupted dovecot indexes, probably caused by a server crash. This does not cause a lot of harm, just annoyance. For instance, LMTP raises an assertion during delivery, which causes mail to multiple recipients e-mail to remain in the queue if a single of them hits a corrupted index. The workaround for now is to detect the situation in the logs and to remove corrupted indexes when the problem arise. A better fix would be to sanity check all user's index on startup. Is there a command line tool to do this? -- Emmanuel Dreyfus manu(a)netbsd.org

1 0

VS: Re: SQLite driver and auth-worker credentials
by Aki Tuomi 24 Feb '16

24 Feb '16

this is probably something that ought to be fixed. Read only scenario for auth/userdb is quite plausible. ---Aki TuomiDovecot oy-------- Alkuperäinen viesti --------Lähettäjä: Lev Serebryakov <lev(a)serebryakov.spb.ru> Päivämäärä: 24.2.2016 23.32 (GMT+02:00) Saaja: james(a)lottspot.com Kopio: dovecot(a)dovecot.org Aihe: Re: SQLite driver and auth-worker credentials Hello James, Wednesday, February 24, 2016, 11:17:12 PM, you wrote: >> But system should assign all secondary GIDs to effective UID? > separate 'group =' directive in addition to the 'user =' directive > (http://wiki2.dovecot.org/Services) Oh, I missed this one, thank you -- Best regards, Lev mailto:lev@serebryakov.spb.ru

1 0

SQLite driver and auth-worker credentials
by Lev Serebryakov 24 Feb '16

24 Feb '16

I want to use SQLite database as storage for auth and user databases. I've encountered two problems here: (1) There is no way to open SQLite database read-only (via sqlite3_open_v2() call with SQLITE_OPEN_READONLY flag). It looks bad. I don't need (and want) to give dovecot rights to write to this database. (2) I've created system group "hostingdb", added "dovecot" user to it and gives 660 rights to database file, but still "auth-worker" could not open database and complains to log file. Now I'm set "user = root" for auth-worker, but I don't like it! Why auth-worker doesn't belong to "hostingdb" group? -- // Black Lion AKA Lev Serebryakov

2 4

Script dovecot ACLs, Quota and doveadm
by Chris 24 Feb '16

24 Feb '16

Dear All, I'd like to set a) Quota for mailboxes in private and public namespace b) ACLs for both. What's the easiest way to do this? Do I have to call doveadm for every mailbox (private and public)? Is it required to provide a username to doveadm? Can I use the same user for all if it is defined in global ACLs? For Cyrus there are perl modules which have the same functions as cyradm. Is there something like this for dovecot? Are there any modules available? Haven't found anything in CPAN. - Chris

1 0

Streaming MOVE commands
by gallego＠cri.ensmp.fr 24 Feb '16

24 Feb '16

Dear Dovecot devs, is streaming multiple MOVE commands by clients allowed? I am getting duplicated messages with the GNUS mail client, the interchange looks like this: *stream two moves to different folders* > 9019 UID MOVE 4062,4066,4068 "folder0" > 9020 UID MOVE 4063:4064,4067,4069:4072 "folder1" *the messages are copied* > * OK [COPYUID 1424475218 4062,4066,4068 376:378] Moved UIDs. > * OK [COPYUID 1424475231 4063:4064,4067,4069:4072 26:32] Moved UIDs. *however expunge fails to clean 4063, 4064, and 4067* > * VANISHED 4062,4066,4068:4072 thus 4063, 4064, and 4067 end both in inbox and folder1 producing duplicate messages (more details at [1]). At the GNUS mailing list, we were wondering about what should be the correct reading of RFC6851. Version and config information below. Best regards, Emilio [1] More details in the thread http://permalink.gmane.org/gmane.emacs.gnus.general/86813 [2] Version $ /usr/sbin/dovecot --version 2.2.13 [3] Config $ /usr/sbin/dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 8.3 ext4 mail_location = maildir:/home/%u/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap sieve" ssl_cert = ... ssl_key = ... userdb { driver = passwd }

3 6

Automatically inferring %d on multi-domain virtual install ?
by Gabriel L. Somlo 24 Feb '16

24 Feb '16

Hi, I'm trying to allow domain-less logins for a multi-domain virtual IMAP server, and wondering if I can automatically infer the domain (value of variable %d) from the local IP (%l) or the hostname used by the client when connecting to my server. Let's say I have two host names: mail.foo.org (10.0.0.100) and mail.bar.com (10.0.0.200), with forward and reverse DNS configured to resolve A and PTR records in either direction. Let's also say I have 10.0.0.100 and 10.0.0.200 set up as secondaries on my server's loopback interface, and routing is set up to bring client traffic to me for both of those IP addresses. The relevant bits of my dovecot.conf are: ---%<------------------------------------------------------------------ mail_location = maildir:/var/lib/vmail/%d/%n passdb { driver = passwd-file args = /var/lib/vmail/etc/postfix/userdb } userdb { driver = static args = uid=dovenull gid=dovenull home=/var/lib/vmail/%d/%n } ---%<------------------------------------------------------------------ And my userdb passwd-file right now includes: ---%<------------------------------------------------------------------ user1@foo.org:{PLAIN}user1foo user2@foo.org:{PLAIN}user2foo user1@bar.com:{PLAIN}user1bar user2@bar.com:{PLAIN}user2bar ---%<------------------------------------------------------------------ Right now, user1(a)foo.org must configure their imap client like so: IMAP server: mail.foo.org username: user1(a)foo.org password: user1foo I would like to require this (and other) users to only have to set: IMAP server: mail.foo.org username: user1 password: ... and have dovecot somehow infer the "@foo.org" domain based on the fact that the connection was made to 10.0.0.100, which is mail.foo.org, and therefore the domain can *only* be "@foo.org". I could start out by splitting my user database into two files: userdb.foo.org ---%<------------------------------------------------------------------ user1:{PLAIN}user1foo user2:{PLAIN}user2foo ---%<------------------------------------------------------------------ userdb.bar.com ---%<------------------------------------------------------------------ user1:{PLAIN}user1bar user2:{PLAIN}user2bar ---%<------------------------------------------------------------------ ... then modify dovecot.conf's passdb setup like so: ---%<------------------------------------------------------------------ passdb { driver = passwd-file args = /var/lib/vmail/etc/postfix/userdb.%d } ---%<------------------------------------------------------------------ ... but how would I insure that %d is set to the proper value based on e.g. a reverse lookup of %l, which, in foo.org's case would be 10.0.0.100, and resolve to mail.foo.org, and *somehow* that would match %d == "@foo.org" ? Is this even possible in the first place, or am I just being too fussy about the aesthetics of my users' imap client config files ? :) :) Thanks much, --Gabriel

5 9

Dovecot + Ceph Cluster Sizing
by Michele Soragni 24 Feb '16

24 Feb '16

Hi all. We are searching for information about how to size dovecot servers in a clustered architecture (dovecot + postfix + roundcube + mysql). We need to migrate mailboxes from an old Exchange installation: 60k mailbox 900 GB total storage 14 MB/mailbox About 133 email/mailbox Low usage: about 2k simultaneous imap/pop3 connections This is how we are thinking to build our new architecture 3 x Dell R630 or R530 servers with 6x300SAS disks for Ceph storage with 1 replica . Total storage = 2,5 TB for mailboxes 3 x Dell R630 or R530 with 2x CPU 6core,64GB RAM, 4x 300SAS disks hosting the following VMs in a VMware cluster: - 3 x VM Dovecot - 3 x VM Postfix - 3 x VM Roundcube webmail - 3 x VM MySQL All VMs are behind a balancer All OS disks are on local storage Dovecot VMs share Ceph storage with OCFS2 filesystem for the mailboxes. I'd like to have some hints about CPU and memory for Dovecot VMs. 2 vCPU and 8 GB RAM each sould be enough? Is there a way to calculate this? Do you think the storage performance could be a problem using Ceph + OCFS2? Is Ceph + XFS + Dsync replication a better choice? Thanks! Michele

1 0

Segfault using doveadm dsync
by fabio.onorini＠secoges.com 24 Feb '16

24 Feb '16

I'm trying to migrate a imap mailbox from dovecot 1.2.15 to a new imap server with dovecot 2.2.13. I would preserving the IMAP UIDs and POP3 UIDLs. So I'm using doveadm backup command but after folders analyze, command return segmentation fault. Any hint? GDB result: sync(easymail): Debug: brain S: Deleting mailbox 'Bozze' (GUID f0836f3222c335cfa383cb38ff0e3183): UIDNEXT is too high (9 > 1) dsync(easymail): Debug: brain S: Deleting mailbox 'Cestino' (GUID cd0edec22e40323d878a39dc8e432e5a): UIDNEXT is too high (628 > 1) dsync(easymail): Debug: brain S: Deleting mailbox 'INBOX' (GUID c92f64f79f0d1ed01e6d5b314f04886c): UIDVALIDITY changed (1456239585 -> 1456310264) dsync(easymail): Debug: brain S: Deleting mailbox 'Modelli' (GUID f0933f8b90e6eaf3a00a0220b173f3b4): UIDNEXT is too high (2 > 1) dsync(easymail): Debug: brain S: Deleting mailbox 'Sent' (GUID 7d3c7eaa71cdf47ee8a1192687cda8cd): UIDNEXT is too high (39 > 1) Program received signal SIGSEGV, Segmentation fault. imapc_client_mailbox_cmd (box=0x0, callback=callback@entry=0x7ffff76d7140 <imapc_simple_callback>, context=context@entry=0x7fffffffe2d0) at imapc-client.c:351 351 imapc-client.c: No such file or directory. (gdb) bt full #0 imapc_client_mailbox_cmd (box=0x0, callback=callback@entry=0x7ffff76d7140 <imapc_simple_callback>, context=context@entry=0x7fffffffe2d0) at imapc-client.c:351 cmd = <optimized out> __FUNCTION__ = "imapc_client_mailbox_cmd" #1 0x00007ffff76d7915 in imapc_mailbox_noop (mbox=mbox@entry=0x5555558049e0) at imapc-storage.c:154 cmd = <optimized out> sctx = {client = 0x5555557e89b0, ret = -2} #2 0x00007ffff76d5c18 in imapc_mailbox_sync_init (box=0x5555558049e0, flags=(MAILBOX_SYNC_FLAG_FULL_READ | MAILBOX_SYNC_FLAG_FIX_INCONSISTENT)) at imapc-sync.c:476 mbox = 0x5555558049e0 list = <optimized out> capabilities = <optimized out> changes = false ret = 0 #3 0x00007ffff76e9289 in mailbox_sync_init (box=0x5555558049e0, flags=(MAILBOX_SYNC_FLAG_FULL_READ | MAILBOX_SYNC_FLAG_FIX_INCONSISTENT)) at mail-storage.c:1677 _data_stack_cur_id = 3 ctx = <optimized out> #4 0x00007ffff76e93d7 in mailbox_sync (box=box@entry=0x5555558049e0, flags=<optimized out>, flags@entry=MAILBOX_SYNC_FLAG_FULL_READ) at mail-storage.c:1725 ctx = 0x555555804ea8 status = {sync_delayed_expunges = 0} #5 0x00007ffff7715bab in mailbox_expunge_all_data (box=0x5555558049e0) at index-storage.c:648 ctx = 0x7ffff7714e57 <index_storage_mailbox_open+615> t = 0x5555558049e0 mail = 0x7fffffffe4b4 search_args = 0x7fffffffe558 #6 index_storage_mailbox_delete (box=0x5555558049e0) at index-storage.c:701 metadata = {guid = "\264\344\377\377\377\177\000\000\000\000\000\000\000\000\000", virtual_size = 140737488348504, cache_fields = 0x555555807258, precache_fields = (MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE | MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_VIRTUAL_SIZE | MAIL_FETCH_IMAP_ENVELOPE | MAIL_FETCH_REFCOUNT | unknown: 1426065408), backend_ns_prefix = 0x7ffff73b1e59 <t_pop_check+9> ";\003u\v\307\003", backend_ns_type = (unknown: 1434470880)} status = {messages = 4294960472, recent = 32767, unseen = 0, uidvalidity = 0, uidnext = 1434582544, first_unseen_seq = 0, first_recent_uid = 232594432, last_cached_seq = 3612951791, highest_modseq = 93824995052000, highest_pvt_modseq = 93824992578308, keywords = 0x1, permanent_flags = 4151223616, permanent_keywords = 1, allow_new_keywords = 1, nonpermanent_modseqs = 1, no_modseq_tracking = 1, have_guids = 1, have_save_guids = 1, have_only_guid128 = 1} ret_guid = <optimized out> #7 0x00007ffff76ea737 in mailbox_delete (box=box@entry=0x5555558049e0) at mail-storage.c:1319 ret = <optimized out> #8 0x00005555555895d4 in dsync_brain_mailbox_tree_sync_change (brain=brain@entry=0x5555557fcd00, change=<optimized out>) at dsync-brain-mailbox-tree-sync.c:182 box = 0x5555558049e0 destbox = 0x5555558007c8 errstr = 0x5555557ff750 "\030\366\177UUU" func_name = 0x0 ---Type <return> to continue, or q <return> to quit--- storage_name = <optimized out> error = 32767 ret = <optimized out> __FUNCTION__ = "dsync_brain_mailbox_tree_sync_change" #9 0x00005555555892db in dsync_brain_mailbox_trees_sync (brain=0x5555557fcd00) at dsync-brain-mailbox-tree.c:291 ctx = 0x55555580ab40 change = <optimized out> sync_type = <optimized out> sync_flags = <optimized out> #10 dsync_brain_recv_mailbox_tree_deletes (brain=brain@entry=0x5555557fcd00) at dsync-brain-mailbox-tree.c:440 deletes = 0x5555557fa0a0 i = <optimized out> count = 0 sep = 47 '/' __FUNCTION__ = "dsync_brain_recv_mailbox_tree_deletes" #11 0x00005555555860e8 in dsync_brain_run_real (changed_r=0x7fffffffe74b, brain=0x5555557fcd00) at dsync-brain.c:565 ret = true orig_state = DSYNC_STATE_RECV_MAILBOX_TREE_DELETES orig_box_recv_state = DSYNC_BOX_STATE_MAILBOX orig_box_send_state = DSYNC_BOX_STATE_MAILBOX changed = false #12 dsync_brain_run (brain=0x5555557fcd00, changed_r=changed_r@entry=0x7fffffffe74b) at dsync-brain.c:610 _data_stack_cur_id = 2 changed_r = 0x7fffffffe74b brain = 0x5555557fcd00 #13 0x00005555555846f7 in cmd_dsync_run_local (changes_during_sync_r=<synthetic pointer>, ibc2=<optimized out>, brain=0x5555557e1860, user=<optimized out>, ctx=0x5555557cd590) at doveadm-dsync.c:384 brain2 = 0x5555557fcd00 set_parser = <optimized out> location = <optimized out> user2 = 0x0 brain1_running = true changed1 = true ret = <optimized out> set_line = <optimized out> brain2_running = true changed2 = false #14 cmd_dsync_run (_ctx=0x5555557cd590, user=<optimized out>) at doveadm-dsync.c:596 ---Type <return> to continue, or q <return> to quit--- ctx = 0x5555557cd590 ibc = 0x5555557d50d0 ibc2 = 0x5555557e14d0 brain = 0x5555557e1860 set = {process_title_prefix = 0x0, sync_namespaces = {arr = {buffer = 0x5555557c0378, element_size = 8}, v = 0x5555557c0378, v_modifiable = 0x5555557c0378}, sync_box = 0x0, sync_box_guid = '\000' <repeats 15 times>, exclude_mailboxes = 0x0, lock_timeout_secs = 0, state = 0x0} ns = 0x5555557cd670 strp = <optimized out> brain_flags = <optimized out> remote_errors_logged = false changes_during_sync = false status = 0 ret = 0 #15 0x0000555555569e4b in doveadm_mail_next_user (ctx=0x5555557cd590, input=<optimized out>, error_r=0x7fffffffe898) at doveadm-mail.c:314 error = 0x5555557cd590 "p\325|UUU" ret = <optimized out> error_r = 0x7fffffffe898 input = <optimized out> ctx = 0x5555557cd590 ip = <optimized out> ret = 0 #16 0x000055555556ac2c in doveadm_mail_cmd (argv=0x5555557c73b8, argc=4, cmd=0x5555557cb140) at doveadm-mail.c:525 input = {module = 0x0, service = 0x5555555a7367 "doveadm", username = 0x5555557c73e7 "easymail", session_id = 0x0, local_ip = {family = 0, u = {ip6 = { __in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = (unknown: 0), flags_override_remove = (unknown: 0), no_userdb_lookup = 0} ctx = 0x5555557cd590 getopt_args = 0x5555557bf660 "+1dEfg:l:m:n:NPr:Rs:Ux:RAS:u:" ret = <optimized out> c = <optimized out> wildcard_user = 0x0 error = 0x7ffff73b7122 <master_service_init_finish+226> "H\213\204$\230" #17 doveadm_mail_try_run (cmd_name=<optimized out>, argc=4, argv=0x5555557c73a0) at doveadm-mail.c:617 cmd = 0x5555557cb140 #18 0x00005555555699a4 in main (argc=4, argv=0x5555557c73a0) at doveadm.c:398 cmd_name = 0x5555557c73dd "backup" i = <optimized out> ---Type <return> to continue, or q <return> to quit--- quick_init = false c = <optimized out> ----------------------------------------------- Fabio Onorini ----------------------------------------------- Gruppo SeCoGes srl Via Enzo Ferrari, 4/6 - 25134 - Brescia - Italy Tel. +39 030 23 06 877 Fax +39 030 23 15 512 Sito Web: http://www.secoges.com Indirizzo EMail (assistenza): easymail(a)secoges.com ------------------------------------------------

1 0

Require different setting for mail_location for each of POP3S and IMAPS protocols
by Andrew McGlashan 23 Feb '16

23 Feb '16

Okay, Let's try this a different way. I've been able to configure past dovecot to have a different mail_location setting for the same user, but with different protocols. When the user requests POP3S, I adjusted the mail_location to /var/mail/$USER (with mbox in use). When that *same* user requested IMAPS protocol, the required mail_location is the Maildir folder. This allows for independent two mail storage locations, one for the use of mbox and the other for the use of Maildir *and* for the same user. Some users only require mbox with others only requiring Maildir. So, I need to cater for each of these situations. How might I adjust current dovecot configuration to provide different mail_location settings for different protocols? Old dovecot allowed me to run a script before POP3S processing that gave me the chance to adjust the mail_location variable. That is what I need now, just for POP3S. Thanks AndrewM

2 2

syntax for overriding userdb fields from passdb config
by Thomas Möhle 23 Feb '16

23 Feb '16

Dear Dovecot developers, how exactly is the syntax to override a userdb field within the passdb configuration? I cannot find any documentation on this in the wiki. Let's say, I'd like to override the userdb extra field "chroot" with /var/mail. How exactly would be the notation? My auth-sql.conf.ext looks like this: passdb { driver = sql args = /etc/dovecot/dovecot-sql.conf.ext } userdb { driver = sql args = /etc/dovecot/dovecot-sql.conf.ext } I already tried these modifications within the passdb area: override_fields = userdb_chroot=/var/mail override_fields = userdb:chroot=/var/mail override_fields = %{userdb:chroot}=/var/mail override_fields = %{userdb_chroot}=/var/mail but none of the above returned /var/mail when I tried to hand %{userdb:chroot} to an external script. Thanks for your help, Thomas Möhle

2 1

RE: Dovecot Bulletin
by Kevin Kershner 23 Feb '16

23 Feb '16

It also got the bulletin out to new users without admin intervention. Sent from Mobile ________________________________ From: Doug Hardie<mailto:bc979@lafn.org> Sent: ‎2/‎22/‎2016 4:02 To: Dovecot Mailing List<mailto:dovecot@dovecot.org>; Timo Sirainen<mailto:tss@iki.fi> Cc: Kevin Kershner<mailto:cstkersh@outlook.com> Subject: Re: Dovecot Bulletin > On 20 February 2016, at 18:14, Timo Sirainen <tss(a)iki.fi> wrote: > > On 21 Feb 2016, at 02:50, Kevin Kershner <cstkersh(a)outlook.com> wrote: >> >> I'd like to revisit and old post if I may, will/does Dovecot support the old >> qpopper "Bulletin" ability? >> >> Basically I need a simple way of posting bulletins to all domain users. >> Qpopper maintained a bulletin db for each user and sent them the next >> bulletin in sequence. > > I guess there could be a plugin that does this check on each login. But would it actually be useful? Why would it be better than simply sending the mail to all the users? For example: > > doveadm save -A < bulletin.txt The reasons for bulletins as I see it are: 1. The doveadm save command is undocumented. It does show a cryptic line in the output of the command "doveadm". However, it doesn't give any clue what it does or how to provide the message. Your note above provides considerably more information on that command. I tested it and it works as you have indicated though. 2. The doveadm save command causes the email to be saved in each user's mailbox. If you have a lot of users, thats a lot of wasted disk space. Qpopper's bulletins only kept one copy and every user downloaded from that copy. All that was retained per user was a counter of the last bulletin's sequence number that was downloaded. — Doug

3 3

systemd changes in Git/Debian Auto-Builds
by Thomas Leuxner 22 Feb '16

22 Feb '16

Not sure if the issue is limited to the Debian Auto-Builds, but after the latest commits an update of the packages fails: https://github.com/dovecot/core/commit/53cc71cae88ee81fd7eae47aed743496f8c8… Feb 21 07:31:22 nihlus dovecot: master: Dovecot v2.2.devel (950a6e6) starting up for imap, lmtp Feb 21 07:31:22 nihlus systemd[1]: PID file /var/run/dovecot/dovecot/master.pid not readable (yet?) after start. The PID-File seems to be expected under yet another sub-dir of /var/run/dovecot. Regards Thomas

8 14

Dovecot Bulletin
by Kevin Kershner 22 Feb '16

22 Feb '16

I'd like to revisit and old post if I may, will/does Dovecot support the old qpopper "Bulletin" ability? Basically I need a simple way of posting bulletins to all domain users. Qpopper maintained a bulletin db for each user and sent them the next bulletin in sequence. Thanks in advance Kevin

3 3

User@domain.tld doesn't exist (postfix error 550 5.1.1)
by soko.tica 22 Feb '16

22 Feb '16

Hello list, I am trying to send an e-mail message from the local root to another local user (alias to root) on the same box. While it functions without dovecot, it doesn't work with dovecot installed. Local user is recognized, but local user(a)domain.tld isn't. While this option is turned on in postfix, I believe it has something with dovecot configuration, due to doveadm isnt' able to recognise user(a)domain.tld Bellow are the outputs of doveadm user username, doveadm user username(a)domain.tld, doveconf -n, tail -f /var/log/mail.log, cat /etc/aliases and postconf -n. Please advise. Thanks in advance. # doveadm user testuser field value uid 1000 gid 1000 home /home/testuser mail maildir:~/Maildir system_groups_user testuser ======================================== # doveadm user testuser(a)mail.domain.tld field valueuserdb lookup: user testuser(a)mail.domain.tld doesn't exist ====================================== # doveadm user testuser(a)domain.tld field valueuserdb lookup: user testuser(a)domain.tld doesn't exist ======================================= # doveconf -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.18.26-x1-64 x86_64 Debian 8.3 hostname = mail.domain.tld lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To lmtp_save_to_detail_mailbox = yes mail_location = maildir:~/Maildir maildir_very_dirty_syncs = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { driver = pam } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)mail.domain.tld protocols = lmtp service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = no ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd } userdb { driver = passwd } protocol lmtp { mail_fsync = optimized } protocol lda { mail_fsync = optimized } =============================== # tail -f /var/log/mail.log Feb 22 13:21:01 uidigaa4 postfix/qmgr[4657]: 75E0722137: removed Feb 22 13:21:01 uidigaa4 dovecot: lmtp(4764): Connect from local Feb 22 13:21:01 uidigaa4 postfix/lmtp[4763]: 82EA222140: to=<testuser(a)mail.domain.tld>, orig_to=<root(a)mail.domain.tld>, relay=mail.domain.tld[private/dovecot-lmtp], delay=0.01, delays=0/0/0.01/0, dsn=5.1.1, status=bounced (host mail.domain.tld[private/dovecot-lmtp] said: 550 5.1.1 <testuser(a)mail.domain.tld> User doesn't exist: testuser(a)mail.domain.tld (in reply to RCPT TO command)) Feb 22 13:21:01 uidigaa4 dovecot: lmtp(4764): Disconnect from local: Successful quit Feb 22 13:21:01 uidigaa4 postfix/qmgr[4657]: 82EA222140: removed ======================= # cat /etc/aliases # See man 5 aliases for format postmaster: root root: testuser =================== # postconf -n alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases append_dot_mydomain = no biff = no config_directory = /etc/postfix delay_warning_time = 4h inet_interfaces = all mailbox_size_limit = 0 mailbox_transport = lmtp:unix:private/dovecot-lmtp mydestination = $myhostname localhost.$mydomain localhost $mydomain mydomain = domain.tld myhostname = mail.domain.tld mynetworks = [::ffff:127.0.0.0]/104 [::1]/128 myorigin = $myhostname notify_classes = resource, software readme_directory = no recipient_delimiter = + relay_domains = $mydestination relay_transport = error smtp_tls_session_cache_database = btree:${data_directory}/smtp_scache smtpd_banner = $myhostname ESMTP $mail_name (Debian/GNU) smtpd_tls_cert_file = /etc/ssl/certs/ssl-cert-snakeoil.pem smtpd_tls_key_file = /etc/ssl/private/ssl-cert-snakeoil.key smtpd_tls_session_cache_database = btree:${data_directory}/smtpd_scache smtpd_use_tls = yes

1 1

Replication for all users in Dovecot ISPConfig database
by Otto Saayman 22 Feb '16

22 Feb '16

Hello I have set up two servers, one master and one slave, using ISPConfig. I have been using rsync to synchronise mails between the two machines, but this has some unstable results. I had a look at setting up replication: http://wiki.dovecot.org/Replication When I run the command, doveadm user '*', only two users are returned. So when I run this command: doveadm replicator replicate \* I get: 2 users updated I run this command: doveadm sync -u [e-mail address] tcp:[2nd/ slave dovecot server IP address] Here I can input any valid e-mail address in the ISPConfig MySQL database and it works. How do I tell the dovecote server to replicate all the users configured in the MySQL database it uses when it handles logins via POP/ IMAP, all of which is working fine? Is there a command I need to run at a set interval via cron to synchronise the two machines' mailboxes, which are identical in every way except the mails the users' mailboxes contain? OR Is there a way that I can instruct the two machines to keep each other's user mailbox contents "up to date"? The main idea is to have a hot backup of my "main" dovecot server and also to enable a lower mail priority for the second server so that mails are still received when the main server becomes busy, or is taken offline for some reason. Any help, or link to a HOWTO would be appreciated. -- Best Regards *Otto Saayman* /IT Guru and/ /Owner/ *Mobile: E-mail: Skype: Web:* +27 82 821 9119 otto(a)igotafrica.com ozzmaster80 www.igotafrica.com <http://www.igotafrica.com/> “/We can do anything, but we can't do everything./” - John Maxwell Confidentiality notice and disclaimer: This message and the attached files and links contain information intended for the exclusive perusal and/or use, of the addressee only. The information may be confidential and legally privileged and protected by law. Access is authorised only by the intended recipient. If you are not an intended recipient, do not peruse, use, disseminate, distribute, copy or in any manner rely upon the information contained in this message or the attached files (directly or indirectly). The sender and/or IgotAfrica CCshall not be held liable for any loss damage, injury, or expense however caused, whether direct, indirect or consequential in the event that this prohibition is disregarded. If you receive this message and/or the attached files in error, please notify the sender immediately by email, fax or telephone and destroy the original message. The views or representations contained in this communication, whether expressed or implied, are those of the sender only. IgotAfrica CCand the sender do not warrant the truth, integrity, accuracy or completeness of the information provided, or that the message and attached files are free of errors, virus, interception or interference.

1 0

postfix/dovecot - [private/dovecot-lmtp]: No such file or directory
by soko.tica 22 Feb '16

22 Feb '16

Hello list, I am trying to send a mail message from root to a system user on the same box. While postfix functions without dovecot properly, once dovecot is installed, I get the message from logs as set in the subject line - that postfix/lmpt cannot connect to [private/dovecot-lmtp]: No such file or directory Also, user's ~/.Maildir aren't created, although there is such instructions in dovecot. Finally, doveconf -n says there is no ssl enabled, although I explicitly set it in /conf.d/10-ssl.conf Below are dmesg, postconf -n, doveconf -n and a snippet from /var/log/mail.log Please advise. Thanks in advance. $dmesg [ 0.000000] Linux version 3.18.26-x1-64 (root(a)dev0001.support.domain.tld) (gcc version 4.4.5 (Debian 4.4.5-8) ) #1 SMP Mon Feb 8 11:43:41 GMT 2016 [ 0.740773] pps_core: LinuxPPS API ver. 1 registered ================ $ postconf -n alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases append_dot_mydomain = no biff = no config_directory = /etc/postfix default_transport = error delay_warning_time = 4h inet_interfaces = loopback-only mailbox_size_limit = 0 mailbox_transport = lmtp:unix:private/dovecot-lmtp mydestination = $myhostname localhost.$mydomain localhost $mydomain myhostname = mail.domain.tld mynetworks = [::ffff:127.0.0.0]/104 [::1]/128 myorigin = $myhostname notify_classes = resource, software readme_directory = no recipient_delimiter = + relay_domains = $mydestination relay_transport = error smtp_tls_session_cache_database = btree:${data_directory}/smtp_scache smtpd_banner = $myhostname ESMTP $mail_name (Debian/GNU) smtpd_tls_cert_file = /etc/ssl/certs/ssl-cert-snakeoil.pem smtpd_tls_key_file = /etc/ssl/private/ssl-cert-snakeoil.key smtpd_tls_session_cache_database = btree:${data_directory}/smtpd_scache smtpd_use_tls = yes ========================== $ doveconf -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.18.26-x1-64 x86_64 Debian 8.3 hostname = mail.domain.tld lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To mail_location = maildir:~/Maildir maildir_very_dirty_syncs = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { driver = pam } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)mail.domain.tld protocols = lmtp service lmtp { unix_listener lmtp { group = postfix mode = 0600 user = postfix } } ssl = no ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd } userdb { driver = passwd } protocol lmtp { mail_fsync = optimized } protocol lda { mail_fsync = optimized } ============== $ cat /var/log/mail.log Feb 21 23:20:40 boxname dovecot: master: Dovecot v2.2.13 starting up for lmtp (core dumps disabled) Feb 21 23:22:28 boxname postfix/pickup[32138]: EA06822140: uid=0 from=<root> Feb 21 23:22:28 boxname postfix/cleanup[32177]: EA06822140: message-id=<20160221232228.EA06822140(a)mail.domain.tld> Feb 21 23:22:28 boxname postfix/qmgr[32139]: EA06822140: from=<root(a)mail.domain.tld>, size=333, nrcpt=1 (queue active) Feb 21 23:22:29 boxname postfix/lmtp[32180]: EA06822140: to=<brn(a)mail.domain.tld>, orig_to=<brn>, relay=none, delay=0.06, delays=0.02/0.01/0.04/0, dsn=4.4.1, status=deferred (connect to mail.domain.tld[private/dovecot-lmtp]: No such file or directory)

2 1

Maildir++ and fs-layout
by Chris 20 Feb '16

20 Feb '16

Dear All, can I use Maildir++ Layout for private namespace and fs-layout for public namespace on the same server, provided that the hierarchy separator is the same (.)? Are all parts of dovecot (especially deliver, sieve and lmtp) compatible with fs-layout? Are there any restrictions I have to obey? - Chris

2 2

pigeonhole vnd.dovecot.pipe
by Dan Ragle 20 Feb '16

20 Feb '16

Ok, I have pigeonhole setup on my CentOS 6 box and it's working great; the filters are doing almost everything I want them to. I now find that I'd like to add piping support to pigeonhole scripts, and as I am running CentOS 6 (Dovecot 2.0.9, with pigeonhole 0.2.2) I'm trying to get the vnd.dovecot.pipe extension working. Couldn't find that anywhere in the repos, so went to the source as explained on this page: http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Pipe But I'm not able to get it to work. Here's what I've tried so far: 1.) Installed dovecot-devel-2.0.9 (yum install dovecot-devel) 2.) Downloaded the sieve-pipe source (hg clone http://hg.rename-it.nl/pigeonhole-0.2-sieve-pipe/) 3.) In the new sieve-pipe directory: a.) ./autogen.sh (appeared to go smoothly) b.) ./configure --with-dovecot=/usr/lib64/dovecot --with-pigeonhole=/usr/include/dovecot/sieve (again, ok) c.) make This one failed, complaining that sieve-ext-copy.h was unavailable. Found a copy of the file online at http://www.opensource.apple.com/source/dovecot/dovecot-239/dovecot-pigeonho… copied it into /usr/include/dovecot/sieve/ and reran the make, this time no errors. d.) make install (no errors) 4.) Added the sieve_plugins = sieve_pipe config into 90-sieve.conf 5.) Restarted dovecot. It complained thus: Starting Dovecot Imap: managesieve: Fatal: opendir(/usr/lib64/dovecot/sieve) failed: No such file or directory doveconf: Error: managesieve-login: dump-capability process returned 89 6.) Looking through the make install output, I noticed that the new libs had been installed in /usr/local/lib/dovecot/sieve. So, cd /usr/lib64/dovecot ln -s /usr/local/lib/dovecot/sieve sieve 7.) Restarted dovecot. This time a different complaint: Starting Dovecot Imap: managesieve: Error: dlopen(/usr/lib64/dovecot/sieve/lib90_sieve_pipe_plugin.so) failed: /usr/lib64/dovecot/sieve/lib90_sieve_pipe_plugin.so: undefined symbol: uni_utf8_to_ucs4_n managesieve: Fatal: Couldn't load required plugins doveconf: Error: managesieve-login: dump-capability process returned 89 And now without digging into code I'm stuck. I'm guessing I have some incompatibility issues. Do I need to be running the 32bit dovecot for this to work? Or is there some other mismatch or misstep I've made along the way? Was I correct in assuming the necessary dovecot-pigeonhole-devel stuph came with the dovecot-devel install? There is no separate dovecot-pigeonhole-devel package in the main repos (the dovecot-pigeonhole package I have loaded is 2.0.9, looks like it was just named to match the corresponding dovecot package. The version appears to be 0.2.2, as it is adding a X-Sieve: Pigeonhole Sieve 0.2.2 header into redirected messages). Thanks! Dan

2 1

RPMs for Fedora and RHEL/CentOS
by Toooode 20 Feb '16

20 Feb '16

Hi Link on http://www.dovecot.org/download.html for RPMs for Fedora and RHEL/CentOS is not working. It seams that atrpms repo is dead for some time now Can you please update this and suggest me alternative trusted repo with newest dovecot packages for RHEL/CentOS? Thank you

4 6

Bug Report: %% variables not expanded properly with shared namespace using . as separator
by Hugh Bragg 19 Feb '16

19 Feb '16

I think this is a bug. I'd expect that location %% variables are translated the same way % variables are interpreted, but apparently this isn't the case. virtual folders work fine, but my shared folders fail because of the . in the domain name. What I get is the following: # doveadm acl debug -u user1(a)domain1.com.au shared.user2(a)domain2.com.au doveadm(user1(a)domain1.com.au): Error: Mailbox 'com.au' in namespace 'shared.user2@domain2.' doesn't exist in /var/mail/vhosts/domain2/user2/mail/.com.au I know there is a similar report for usernames, but these should be interpreted at the top level and not inside the maildir. I hope this is enough info. Let me know if I can supply any further information. Hugh Here is my config: # dovecot -n # 2.2.21 (5345f22): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.11 (6ddf62b87f60+) # OS: Linux 4.3.5-300.fc23.x86_64 x86_64 Fedora release 23 (Twenty Three) auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb imap_client_workarounds = tb-extra-mailbox-sep listen = * log_path = /var/log/dovecot.log mail_access_groups = mail, vmail mail_home = /var/mail/vmail/%d/%n mail_location = maildir:~/mail mail_plugins = virtual, acl managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } namespace others { list = children location = maildir:/var/mail/vhosts/%%d/%%n/mail:INDEX=/var/mail/vhosts/%d/%n/shared/%%u prefix = shared.%%u. separator = . subscriptions = yes type = shared } namespace virtual { location = virtual:/var/mail/vhosts/%d/%n/virtual prefix = virtual. separator = . } passdb { args = scheme=PLAIN username_format=%u /etc/dovecot/dovecot-users driver = passwd-file } plugin { acl = vfile acl_shared_dict = file:/var/mail/vhosts/shared-mailboxes.db sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/mail/vhosts/sieve-global } protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 0 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl = required ssl_cert = </etc/pki/dovecot/certs/hjbmx.ddns.net.cert.pem ssl_cipher_list = PROFILE=SYSTEM ssl_key = </etc/pki/dovecot/private/hjbmx.ddns.net.key.pem userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n driver = static } protocol lmtp { mail_plugins = virtual, acl , sieve } protocol lda { mail_plugins = virtual, acl , sieve } protocol imap { mail_plugins = virtual, acl , imap_acl }

2 2

edit ACL files
by Chris 19 Feb '16

19 Feb '16

Dear All, is it possible to edit ACL files regularly with an editor or is there any reason to use doveadm? - Chris

4 5

shared folders not working with . separator
by Hugh Bragg 18 Feb '16

18 Feb '16

Hi, I've been trying this for weeks and never managed to get my mail client to see shared folders. Apparently imap_acl works fine as I can see these entries in the dovecot-acl-list files and the correct entries persist in the client. This is my first dovecot setup so I hope I've configured it right. Everything else works beautifully, thanks. # dovecot -n # 2.2.21 (5345f22): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.11 (6ddf62b87f60+) # OS: Linux 4.3.5-300.fc23.x86_64 x86_64 Fedora release 23 (Twenty Three) auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb imap_client_workarounds = tb-extra-mailbox-sep listen = * log_path = /var/log/dovecot.log mail_access_groups = mail, vmail mail_home = /var/mail/vmail/%d/%n mail_location = maildir:~/mail mail_plugins = virtual, acl managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart mbox_write_locks = fcntl namespace { location = virtual:/var/mail/vhosts/%d/%n/virtual prefix = virtual. separator = . } namespace { list = children location = maildir:/var/mail/vhosts/%%d/%%n/mail:INDEX=/var/mail/vhosts/%d/%n/shared/%%u:CONTROL=/var/mail/vhosts/%d/%n/shared/%%u prefix = shared.%%u. separator = . subscriptions = yes type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox virtual/All { comment = All my messages special_use = \All } mailbox virtual/Flagged { comment = All my flagged messages special_use = \Flagged } prefix = } passdb { args = scheme=PLAIN username_format=%u /etc/dovecot/dovecot-users driver = passwd-file } plugin { acl = vfile acl_shared_dict = file:/var/mail/vhosts/shared-mailboxes.db sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/mail/vhosts/sieve-global } protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 0 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.cert.pem ssl_cipher_list = PROFILE=SYSTEM ssl_key = </etc/pki/dovecot/private/dovecot.key.pem userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n driver = static } protocol lmtp { mail_plugins = virtual, acl , sieve } protocol lda { mail_plugins = virtual, acl , sieve } protocol imap { mail_plugins = virtual, acl , imap_acl }

4 8

Re: dovecot Digest, Vol 154, Issue 14
by Richard Platel 18 Feb '16

18 Feb '16

Thanks, Hajo This mostly works, but we can’t seem to send an arbitrary mailbox name with UserDB, we have to initialize it in the config: "namespace/inbox/mailbox=Junk namespace/inbox/mailbox/Junk/name"="Spam" seems to initialize the folder somehow so that the subsequent "namespace/inbox/mailbox/Junk/auto"="subscribe" and "namespace/inbox/mailbox/Junk/special_use"="\Junk" have something to act upon. (the first line doesn't work quite properly, however - it ends up causing a folder named "" to show up) we've noticed that if we set a very minimal config for the mailbox in the main config (that wouldn't cause the mailbox to be autocreated), that this also initializes the folder name allowing for subsequent auto and subscribe directives to be processed for it: namespace inbox { inbox = yes mailbox "Spam" { auto = no } } is there some userdb response that will simply initialize the folder (without doing any name remapping) in the same way that the above config lines do? we have tried a few things based off Hajo's first line, but nothing we guess at seems to do the trick. ie: "namespace/inbox/mailbox"="Spam" "namespace/inbox/mailbox=Spam"=“Spam" > > ------------------------------ > > Message: 2 > Date: Tue, 9 Feb 2016 23:33:53 +0100 > From: Hajo Locke <Hajo.Locke(a)gmx.de> > To: dovecot(a)dovecot.org > Subject: Re: Per-user special folder? > Message-ID: <56BA6951.8010000(a)gmx.de> > Content-Type: text/plain; charset=windows-1252; format=flowed > > Hello, > > Am 09.02.2016 um 22:28 schrieb Richard Platel: >> Hi >> >> It's possible to mark some folders as special use for IMAP in the config like: >> >> namespace inbox { >> mailbox Spam { >> special_use = \Junk >> } >> } >> >> >> Our webmail allows users to use an arbitrary folder for Spam, and we have this settings and we'd like to return it in from our UserDB (which is a custom dict proxy). >> >> For testing were able to set a namespace parameter like "separator" by returning: >> "namespace/inbox/separator" : "=", >> >> from UserDB, but can't figure out a way to set mailbox settings, >> >> "namespace/inbox/mailbox Spam/special_use" : "\Junk", for example doesn't work. >> >> Is there a way to return this setting from a UserDB query? >> > we use this a lot with userdb to allow individual folders marked as special. > your userbd-query should return something like this: > > namespace/inbox/mailbox=Junk namespace/inbox/mailbox/Junk/name=Spam > namespace/inbox/mailbox/Junk/auto=subscribe > namespace/inbox/mailbox/Junk/special_use=\Junk > Spam is visible name in this case. > > Hajo

2 2

doveadm backup to local drive
by Terry Barnum 17 Feb '16

17 Feb '16

I'm trying to get doveadm to backup all users to a local drive without any luck. $ sudo doveadm backup -A /Volumes/mail_bak/mailstore_backup/ Error: User listing returned failure doveadm: Error: Failed to iterate through some users The doveadm-backup man page has the instruction to make sure the iterate query matches the database layout but I'm not sure what that means. If the user_query in dovecot-sql.conf.ext looks like this, what should the iterate_query look like? user_query = \ SELECT '/opt/local/virtual/%d/%n/mail' as home, \ 'maildir:/opt/local/virtual/%d/%n/mail' as mail, 501 as uid, \ 501 as gid, concat("*:storage=", quota) AS quota \ FROM mailbox WHERE username = "%u" AND active = "1" # Query to get a list of all usernames. iterate_query = SELECT username AS user FROM users Thanks, -Terry Terry Barnum digital OutPost Carlsbad, CA http://www.dop.com 800/464-6434

1 1

Dovecot IMAP permissions issue (see original)
by Steve Cole 17 Feb '16

17 Feb '16

/ >/What purpose does vpopmail serve that dovecot alone does not? Isn't it > just an ancient leftover from historic qmail times? qmail and vpopmail are still quite prominent on the Internet. I see no reason to change my setup at the moment. Possibly I could re-architect to read user info directly from mysql but that would not help with the fact that dovecot then likely read or write as the wrong userid on the system (since mailboxes are virtual). Have recreated the same issue (sans mysql) on another vpopmail system. Regardless, it is a bug. From my process list: 25813 vpopmail 20 0 26468 4984 4016 R 0.7 0.0 0:00.02 imap 26730 vpopmail 20 0 28332 5940 4212 S 0.7 0.0 0:00.06 imap For certain, imap being ANY other user than root means that the /var/run/dovecot/imap-* sockets would be unwritable.

1 0

How to understand NFS lookup (requests) spike?
by Alessio Cecchi 17 Feb '16

17 Feb '16

Hi, I'm are running a classic Dovecot setup: About ten thousand connected users mailbox in Maildir format shared via NFS (NetApp) Director for POP/IMAP Delivery via Dovecot LDA All works fine but sometimes I see a spike on the load of POP/IMAP servers and high disk usage (close to 100%) on NFS NetApp. When this happens on NFS stats (of POP/IMAP) I can see an high volume of "lookup, remove, rename" requests. Example (avg is during normal load, max is request number during the spike): Lookup avg 100 max 700 Remove avg 50 max 300 Rename avg 50 max 300 Getattr avg 200 max 250 Total NFS avg 600 max 1800 I think that some users are doing some kinds of "intensive" operations on their mailbox but what and who? I am currently using "iotop" to monitor the activity of individual users but I can't figure out who is causing the high number of I/O requests. Have you any suggestions? Thanks -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice

2 1

sieve: store string list in varable
by whats_up＠gmx.net 17 Feb '16

17 Feb '16

Hi, I'm working on a Sieve script and want to store a list of addresses in a variable to easily access the list multiple times later. For example I want to transform this: if address :is "from" ["daffy.duck(a)example.com", "porky.pig(a)example.com", "speedy.gonzales(a)example.com"] { fileinto "friends"; } into something like this: require ["fileinto", "variables"]; set "friends" ["daffy.duck(a)example.com", "porky.pig(a)example.com", "speedy.gonzales(a)example.com"] if address :is "from" $friends { fileinto "friends"; } Any ideas on this? regards Knut

2 3

more than 6000 subfolders in the same level
by Chris 16 Feb '16

16 Feb '16

Dear All, I'm going to use a public namespace with more than 6000 folders and subfolders. On the local ext4-filesystem the nested IMAP subfolders will all be in the same directory: /var/vmail/public/folder1 /var/vmail/public/folder1.subfolder1a /var/vmail/public/folder1.subfolder1b ... Is this possible without any performance issues? Would it be better to use "real" subfolders with / as separator? Is / separator for public namespace and . for private namespace possible? - Chris

2 1

the prefix number of the configuration filename
by Dogz 16 Feb '16

16 Feb '16

Hi all, I am very curious about the prefix number of the configuration filename, such as 10-auth.conf 10-director.conf 10-logging.conf 10-mail.conf 10-master.conf 10-ssl.conf 15-lda.conf 15-mailboxes.conf 20-imap.conf 20-lmtp.conf 20-managesieve.conf 20-pop3.conf 90-acl.conf 90-plugin.conf 90-quota.conf 90-sieve.conf 90-sieve-extprograms.conf What are those meanings of 10,15,20 and 90 ? Please advise me and thank you in advance. -- Best Regards, Dogz

3 3

Accessing to mail as another user
by Angel L. Mateo 16 Feb '16

16 Feb '16

Hello, I'm looking for a way to access to a POP/IMAP account as another user different than me, but using my password. That is, I'm "someone(a)domain.com" and I want to access to "anotherone(a)domain.com" mailbox using the password of "someone(a)domain.com", not the "anotherone(a)domain.com" (something similar to master passwords, but without sharing any password). Obviously, in my LDAP backend I can configure something to authorize "someone" to access to "anotherone"'s mailbox. At this momment, I'm trying to use someone@domain.com@anotherone@domain.com as username, with a passdb that uses %{username}@%{domain_first} to authenticate the user, but I'm having problem to configure a userdb map to get the mailbox, because the %{domain_first} variable returns just "domain.com". To fix this, I could use "someone@anotherone@domain.com", but this has problems with virtual domains an different users with same username (someone(a)domain.com and someone(a)otherdomain.com) Looking at documentation, at [1], in the "auth_user" variable says: "... If username changes during authentication, this value contains the original username..." what leads me to think that there is some way to change the user during the authentication process, but I don't know how or maybe I'm assuming wrong. Any help with this? Thank you [1] http://wiki.dovecot.org/Variables -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337

4 6

Pigeonhole and duplicate checking
by Dan Ragle 16 Feb '16

16 Feb '16

I spent some time setting up Dovecot LMTP with Pigeonhole this weekend. I got most of the things I wanted to working but have a few issues that I'm hoping that someone might be able to help with. First, I'm running the stock version of the tools from the core repos for CentOS/6, which means Dovecot 2.0.9 and Pigeonhole 0.2.2. Unfortunately, I don't expect to be able to upgrade those anytime soon, so I'm hoping I can find workarounds for my existing versions. My mailserver is sendmail, I linked to Dovecot LMTP by adding: FEATURE(`local_lmtp', `[IPC]', `FILE /var/run/dovecot/lmtp')dnl to my sendmail.mc. In my prior procmail setup, I auto-forwarded all my SPAM E-mail to a separate user on the system with their own account (called spamuser). In the Pigeonhole setup it looks like I have to redirect those messages (i.e., redirect "spamuser(a)mydomain.com";). That works, but I'm having issues with "duplicate" messages getting delivered directly to my inbox instead of getting redirected. IOW, my regular user's .dovecot.sieve has: if header :contains "X-Spam-Flag" "YES" { redirect "spamuser(a)mydomain.com"; stop; } and the spamuser's .dovecot.sieve has: require ["imap4flags"]; setflag "\\seen"; (this system is entirely for personal use, no concerns with a user's Spam being seen via the separate spamuser account). Now, the problem I'm having is that sometimes a message arrives with a duplicate message-ID. Here's an abbreviated example from my maillog: Feb 15 00:30:46 myhost sendmail[26844]: u1F5UeBP026844: from=<ciuehazt(a)autoonecareers.com>, size=613, class=0, nrcpts=1, msgid=<68895654496651-HLTYGGRLPDJDVTZRHFIKGAON(a)hverovvxzb.arkansas-email.com>, proto=SMTP, daemon=MTA, relay=117.27.191.61.broad.static.hf.ah.cndata.com [61.191.27.117] (may be forged) Feb 15 00:31:05 myhost dovecot: lmtp(26856): Connect from local Feb 15 00:31:07 myhost sendmail[26867]: u1F5UvFi026867: from=<ciuehazt(a)autoonecareers.com>, size=613, class=0, nrcpts=1, msgid=<68895654496651-HLTYGGRLPDJDVTZRHFIKGAON(a)hverovvxzb.arkansas-email.com>, proto=SMTP, daemon=MTA, relay=117.27.191.61.broad.static.hf.ah.cndata.com [61.191.27.117] (may be forged) Feb 15 00:31:10 myhost dovecot: lmtp(26856, dmr): 7Hj/LoBiwVboaAAACXJZQA: sieve: msgid=<68895654496651-HLTYGGRLPDJDVTZRHFIKGAON(a)hverovvxzb.arkansas-email.com>: forwarded to <spamuser(a)mydomain.com> Feb 15 00:31:10 myhost dovecot: lmtp(26856): Disconnect from local: Client quit Feb 15 00:31:10 myhost dovecot: lmtp(26893): Connect from local Feb 15 00:31:10 myhost dovecot: lmtp(26893, spamuser): 9TPnN55iwVYNaQAACXJZQA: sieve: msgid=<68895654496651-HLTYGGRLPDJDVTZRHFIKGAON(a)hverovvxzb.arkansas-email.com>: stored mail into mailbox 'INBOX' Feb 15 00:31:11 myhost dovecot: lmtp(26893): Disconnect from local: Client quit Feb 15 00:31:18 myhost dovecot: lmtp(26893): Connect from local Feb 15 00:31:18 myhost dovecot: lmtp(26893, dmr): +TPnN55iwVYNaQAACXJZQA: sieve: msgid=<68895654496651-HLTYGGRLPDJDVTZRHFIKGAON(a)hverovvxzb.arkansas-email.com>: discarded duplicate forward to <spamuser(a)biblestuph.com> Feb 15 00:31:18 myhost dovecot: lmtp(26893, dmr): +TPnN55iwVYNaQAACXJZQA: sieve: msgid=<68895654496651-HLTYGGRLPDJDVTZRHFIKGAON(a)hverovvxzb.arkansas-email.com>: stored mail into mailbox 'INBOX' So the first message comes in and is redirected properly to my spamuser and stored in the inbox. The second one comes in, pigeonhole sees it's a duplicate, refuses to redirect it, and stores it in my inbox instead. I tried forcing the .dovecot.lda-dupes file to be a symlink to /dev/null just to see if it would work, but unfortunately dovecot just recreates it as a normal file the next time it delivers to that user. Ideally, I'd like to just discard the duplicates. It looks like there is duplicate testing functionality available, but not until later versions of Dovecot/Pigeonhole. Is there anyway I can either just discard the duplicates, or get them to be redirected to the spamuser? Also, some other questions I came up with along the way: Is there any way I can force a message to fileinto a different user's Mailbox? I'm guessing no since it appears that the lmtp drops root privileges before the global sieve script is interpreted, but thought I'd ask anyway. I did try: fileinto "/var/mail/spamuser"; But Dovecot complained, something about the mailbox pattern being invalid. If it were possible, I would think it would want something like fileinto "spamuser:INBOX"; instead, but I don't know if that is even possible. In a global sieve script, is there anyway to know/test which system user is the targeted user for delivery? So in a global sieve_before script I could test the target user, and if it's spamuser just file it immediately and stop with no further testing? Thanks for any assistance! Dan

2 2

Health check for dsync?
by Rich Wales 16 Feb '16

16 Feb '16

I am syncing two Dovecot sites using dsync. Are there any tools available to confirm that dsync is (or is not) running properly between the two sites? (E.g., something I could run periodically in Nagios?) Rich Wales richw(a)richw.org

1 0

Redundant and Geobalancing setup
by Cedric Malitte 15 Feb '16

15 Feb '16

Hi, I use dovecot for a long time now, but only as a single isolated server each time. I joined a company a few years back. We had trouble with compagnies hosting our mail, supposedly full redundant and so on. The company is small, but we have many dealers around the world, and it's growing. Mail became the fist choice for clients to contact the dealers. No mail, and we loose sales. For now we have a single server ( with a backup ) on east coast. And sometimes peoples from EU complain about speed.... ah users :) What I'd like to implement is a redundant system with 2 servers, one in NA, one in EU. And I'd also like to be able to add another server if needed on the west coast. Idea is, that if a server goes down, the users will be able to still receive and send mails, and never loose mails. For geobalacing and failover, I read that I can do it with DNS ( I'm with easydns ). I'm at the first stage where I collect informations that I try to understand and foresee a solution. First idea is to set up servers with a mysql master, slaves and a glusterfs in replica mode on the servers. I tried glusterfs on FreeBSD and OMG, it's slow as hell ! ( well maybe it's a trouble on the VMs nics ) On centos it's way better. But I read there might be trouble/index corruption for the mail storage on "shared" space using maildir. I also had a look at dsync, but I wonder if it can be used on more than 2 servers. I found many pages on dovecot clusters using shared storage NFS mounted, but I feel it's not really what I need as the servers will be in different datacenters. So any guide, clue hint would be really appreciated for me to do my homework ! Regards. Cedric

3 5

Re: Question on setting up dovecot
by Jeffery Small 15 Feb '16

15 Feb '16

The problem is solved! A great thanks to everyone for all the valuable information and suggestions you offered. I learned quite a bit, especially about talking to the dovecot server using the telnet/openssl suggestions and the available POP3 commands. Many of you were correct about your diagnosis, but I had some things happening that were creating confusion. Here is a brief summary of what I discovered. There were a few initial dovecot configuration issues which I eventually ironed out and, as I was reporting at the end of last week, the diagnostic logs seemed to indicate that the connection was successful. Yes, it turned out that Outlook was indeed set to leave a copy of the emails on the server for two weeks -- a setting hidden away on a sub-menu. Now, why this did not seem to be the case was because every time Outlook connected to the Solaris system to retrieve mail, all the messages were immediately deleted (despite this setting), so I was expecting the same behavior on the Linux machine and wasn't looking for the setting. There is something different about how the pop3 handler is working on the two systems. The second problem, which some of you guessed, was that the emails left on the server were not being downloaded because when I wasn't looking, Outlook had already downloaded and tagged them. So, even when I thought there was new mail (new to me anyway) in the inbox, Outlook had beaten me to them so that when I looked, I could see no new mail flowing over to the Windows machine. Disabling the retention setting removed the ambiguity and now I see any new mail in the inbox moving to the other system. Thanks again to everyone! -- Jeff

1 0

ANNOTATE plugin? Squirrel uses it for EXPIRATION information
by Heiko Schlittermann 14 Feb '16

14 Feb '16

Hi, it seems that Squirrel mail uses Mailbox annotations for storing Expire times on the Server. It's an Cyrus server currently. (I've no clue how cyrexpire is able to read it's information from the annotiations) Does dovecot support some similiar mechanism? Or - does anybody know anything about how it's supposed to work on Cyrus and how it can be emulated/simulated with dovecot? Thanks in advance, Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -

2 2

Segmentation fault on doveadm search -A with a huge user base
by Heiko Schlittermann 13 Feb '16

13 Feb '16

Hi, I'm using dovecot 2.2.9 with a director/backend setup. The user base is about 4711 users currently. If I start at one of the directors doveadm search -A all savedbefore 5000d it terminates with doveadm(1rrissma): Error: doveadm server disconnected before handshake: EOF doveadm(1rrissma): Error: 2001:638:913:f33::5:ff:24245: Command search failed for 1phaaman: EOF doveadm(1rrissma): Error: doveadm server failure doveadm: Error: Failed to iterate through some users The backend logs about that ... Feb 12 23:09:41 backend1 dovecot: doveadm(2001:638:913:f33::5:1,1mstrei2): Error: doveadm search: Client sent unknown parameter: ? Feb 12 23:09:41 backend1 dovecot: doveadm: Error: search: invalid option -- '5' Feb 12 23:09:41 backend1 dovecot: doveadm(2001:638:913:f33::5:1,1mstrei2): Error: doveadm search: Client sent unknown parameter: ? Feb 12 23:09:41 backend1 dovecot: doveadm: Error: search: invalid option -- '5' Feb 12 23:09:41 backend1 dovecot: doveadm(2001:638:913:f33::5:1,1mstrei2): Error: doveadm search: Client sent unknown parameter: ? Feb 12 23:09:41 backend1 dovecot: doveadm: Error: search: invalid option -- '0' Feb 12 23:09:41 backend1 dovecot: doveadm(2001:638:913:f33::5:1,1mstrei2): Error: doveadm search: Client sent unknown parameter: ? Feb 12 23:09:41 backend1 dovecot: doveadm: Error: search: invalid option -- '0' Feb 12 23:09:41 backend1 dovecot: doveadm(2001:638:913:f33::5:1,1mstrei2): Error: doveadm search: Client sent unknown parameter: ? Feb 12 23:09:41 backend1 dovecot: doveadm: Error: search: invalid option -- '0' Feb 12 23:09:41 backend1 dovecot: doveadm(2001:638:913:f33::5:1,1mstrei2): Error: doveadm search: Client sent unknown parameter: ? Feb 12 23:09:41 backend1 dovecot: doveadm: Error: search: invalid option -- 'd' Feb 12 23:09:41 backend1 dovecot: doveadm(2001:638:913:f33::5:1,1mstrei2): Error: doveadm search: Client sent unknown parameter: ? Feb 12 23:09:41 backend1 dovecot: doveadm(2001:638:913:f33::5:1,1mstrei2): Fatal: master: service(doveadm): child 11235 killed with signal 11 (core dumped) Is this a known behaviour and fixed already, or do I need to do more investigation? (PS: Running the same command on one of the backends works w/o failure) Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -

2 2

Lots of zero-byte hard link files in cur (and new/tmp), cannot see messages in folder
by Charles Marcus 12 Feb '16

12 Feb '16

Hello, I have an el-cheapo shared hosting account on Dreamhost, and have had it for a very long time. For the most part everything usually works fairly well, considering I do keep a lot of folders, and mail, on some of my accounts. They are running dovecot, but still don't have a response as to the version, or doveconf -n output yet. My problem is, one of my most used folders, which was working fine up until a week or so ago, stopped loading the messages, and after some frustrating troubleshooting via email with people who don't listen very well, I finally got a tarball of this folder, and they are using maildir. There are about 24,000 messages in there (non-zero-byte files). This number sounds about right. All other folders (including INBOX, Sent, etc) are still working fine. The problem, though, is there are over 815,000 zero-byte-files in the cur directory, all showing as hardlinks (looks like maybe a whole bunch of duplicates for each of the real message files in the cur directory). There are also 43 non-zero-byte message files in the new directory, and 1,515 of these zero-byte hardlinks (to message files in the new directory). There are also no non-zero-byte message files in the tmp directory, but there are 52 of the hardlinks, linked to something in the new directory. I've never seen any of these kinds of zero-byte files before on the one server I managed for a long time (not shared, just used for a single domain). Anyone ever seen this before? Would running: doveadm index -u myuser * or doveadm force-resync -u myuser * be appropriate commands to try to repair the damage (whatever it is)? Any other commands I could suggest running? Thanks. I know I haven't given much to go on. Charles /* */

2 2

Multiple quota rules from LDAP userdb?
by Heiko Schlittermann 12 Feb '16

12 Feb '16

Hello, I'm just asking myself, how I get multiple quota rules into the LDAP userdb. Dovecot is 2.2.9 userdb_attrs = … fooQuotaRule=quota_rule=%$ which allows me to have an user db entry as fooQuotaRule: *:storage=1000:messages=50 fooQuotaRule: Trash:storage=500 But, if I'd like to have another quota rule for a submailbox of that user? doveadm user returns the first field only field value uid 500 gid 500 home /volumes/dovecot/home/4b/heiko mail maildir:~:INBOX=/volumes/dovecot/inbox/4b/heiko:INDEX=/volumes/dovecot/cache/4b/heiko quota_rule *:storage=1000:messages=50 Inventing additional LDAP attributs fooQuotaRule2, ... doesn't scale well. Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -

2 2

Autoexpunge on INBOX? And disabling autoexpunge for a mailbox via userdb_import?
by Tom Johnson 12 Feb '16

12 Feb '16

I have autoexpunge working for various special_use mailboxes, but I'd like it to optionally be used for users for their inbox as well. I'd also like to be able to disable autoexpunge for some users for certain directories. Is it possible to specify an autoexpunge period for the main inbox? And can autoexpunge be turned off via userdb_import? Here's some detail behind my questions: I have the following in 15-mailboxes.conf, and all is working great for the autoexpunge feature for the Junk and Trash mailboxes: namespace inbox { separator = . mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk autoexpunge = 15d } mailbox Trash { auto = subscribe special_use = \Trash autoexpunge = 15d } mailbox Sent { auto = subscribe special_use = \Sent } } And I can change the autoexpunge field for those mailboxes via userdb_import in a SQL query - that's working great. But I would like for some users to expire the main inbox and the Sent mailbox, and for others for there to be no expiration. Imagine a scenario where there are users who get a maximum of 15 days of storage - everything older than that should expire out. Other users are standard email users - their inboxes, personal folders, Sent mail should never expire. Adding autoexpunge to the main mailbox gives an error: namespace inbox { separator = . autoexpunge = 999d ... ... } doveconf: Fatal: Error in configuration file /etc/dovecot/conf.d/15-mailboxes.conf line 48: Unknown setting: autoexpunge So is there a way to add an autoexpunge setting to the main inbox? And can I set autoexpunge to 0 via userdb_import to disable autoexpunge for a particular mailbox? That doesn't give any error, but does it properly disable autoexpunge for that mailbox? Thanks- Tom

2 1

Re: Question on setting up dovecot
by Jeffery Small 12 Feb '16

12 Feb '16

Many thanks to Joseph Tam and Steffen Kaiser for pointing me to the logging information that I should have been using in the first place. Now that I have separate log files and debugging information, I'm still at a loss to see why the mail is not being pulled over from the Linux system to the Windows 7 machine. To recap, here is the output from doveconf -n: ---------------------------------------------------------------------- # 2.2.18: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 4.2.0-27-generic x86_64 Ubuntu 15.10 auth_debug = yes auth_verbose = yes disable_plaintext_auth = no info_log_path = /var/log/dovecot.info log_path = /var/log/dovecot mail_debug = yes mail_location = mbox:~/lib/Mail:INBOX=/var/mail/%u passdb { driver = pam } protocols = imap pop3 ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd } userdb { driver = passwd } verbose_ssl = yes ---------------------------------------------------------------------- Here is the configuration logging/debug info: ---------------------------------------------------------------------- log_path = /var/log/dovecot info_log_path = /var/log/dovecot.info auth_verbose = yes auth_debug = yes mail_debug = yes verbose_ssl = yes ---------------------------------------------------------------------- And here is the complete set of Debug/Info information logged when Outlook on the Win7 system attempts a Send/Receive operation. Long lines broken for readability: ---------------------------------------------------------------------- Feb 11 08:47:49 auth: Debug: Loading modules from directory: \ /usr/lib/dovecot/modules/auth Feb 11 08:47:49 auth: Debug: Read auth token secret from \ /var/run/dovecot/auth-token-secret.dat Feb 11 08:47:49 auth: Debug: auth client connected (pid=7861) Feb 11 08:47:49 auth: Debug: client in: AUTH 1 PLAIN \ service=pop3 session=dF2ST4ErtQDMa1sC \ lip=<server_IP> rip=<client_IP> \ lport=110 rport=54453 resp=<hidden> Feb 11 08:47:49 auth-worker(7864): Debug: Loading modules from directory: \ /usr/lib/dovecot/modules/auth Feb 11 08:47:49 auth-worker(7864): Debug: pam(sherril,<client_IP>): \ lookup service=dovecot Feb 11 08:47:49 auth-worker(7864): Debug: pam(sherril,<client_IP>): \ #1/1 style=1 msg=Password: Feb 11 08:47:49 auth: Debug: client passdb out: OK 1 user=sherril Feb 11 08:47:49 auth: Debug: master in: REQUEST 1975517185 7861 1 \ b48910c85f39498e2fe83277d7e94028 session_pid=7866 Feb 11 08:47:49 auth-worker(7864): Debug: pam(sherril,<client_IP>): lookup Feb 11 08:47:49 auth: Debug: master userdb out: USER 1975517185 \ sherril system_groups_user=sherril uid=1001 gid=1001 \ home=/u/sherril Feb 11 08:47:49 pop3-login: Info: Login: user=<sherril>, method=PLAIN, \ rip=<client_IP>, lip=<server_IP>, mpid=7866, \ session=<dF2ST4ErtQDMa1sC> Feb 11 08:47:49 pop3(sherril): Debug: Effective uid=1001, gid=1001, \ home=/u/sherril Feb 11 08:47:49 pop3(sherril): Debug: fs: root=/u/sherril/lib/Mail, \ index=, indexpvt=, control=, inbox=/var/mail/sherril, alt= Feb 11 08:47:49 pop3(sherril): Info: Disconnected: Logged out top=0/0, \ retr=0/0, del=0/3, size=36928 ---------------------------------------------------------------------- There are no errors. We have a pop3 connection. The user's name, uid, gid, password, home directory are all correct. The inbox is listed as /var/mail/sherril which is correct, and this file has the correct ownership and permissions: # ls -l /var/mail/sherril -rw-rw---- 1 sherril mail 194900 Feb 11 09:00 /var/mail/sherril Yet, no mail is pulled over. Are there any clues here? Thanks, -- Jeff

5 6

Re: RFC: HTTP based storage API
by David Niklas 12 Feb '16

12 Feb '16

On 08 Feb 2016, at 11:01, Nagy, Attila <bra(a)fsn.hu> wrote: > Nearly every popular programming language has an LMTP/POP/IMAP > implementation, most of them suck in many different ways. > I don't know any server or library which provides a well-established, > compatible protocol frontend with an open backend API, which could be > used to easily make a custom storage backend for the LMTP/POP/IMAP > frontend in any language, in any programming paradigm, irregardless > of the frontend implementation. Sorry to come in late, but as a curl lover I'd like to know what is wrong with their implementation of pop3 and imap (project homepage curl.haxx.se). Thanks, David

2 1

[BUG] Dovecot 2.2.21 crashing with assertion failed: (!have_wait_unfinished || unfinished_count > 0)
by Gary Stanley 12 Feb '16

12 Feb '16

Hello Dovecot's IMAP process appears to be crashing at random times for a few users, but one is crashing at least 3 to 5 times an hour. I applied these patches per http://dovecot.org/list/dovecot/2016-January/102933.html /https://github.com/dovecot/core/commit/1ddf959a750f3860feff4ab3f0e908f32740978f.diff //https://github.com/dovecot/core/commit/c8e9fa2ffa2566e75f0500808b1bc9bf5d9db024.diff //https://github.com/dovecot/core/commit/15307c2c91854e766bd9fb095d611a29b3f7572e.diff //https://github.com/dovecot/core/commit/c7801f830c7d2e7d340065cdd5a5c795b1726223.diff //https://github.com/dovecot/core/commit/f136b0050b3125b466af73984177250b7ed1a3be.diff / But it's still crashing. # 2.2.21 (5345f22): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-604.30.3.lve1.3.63.el6.x86_64 x86_64 CloudLinux Server release 6.7 (Aleksei Gubarev) auth_cache_size = 1 k auth_mechanisms = plain login auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%" disable_plaintext_auth = no first_valid_uid = 201 mail_plugins = " zlib" maildir_very_dirty_syncs = yes namespace { inbox = yes location = mailbox Archive { auto = create special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. type = private } passdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword } plugin { acl = vfile quota = maildir quota_rule = INBOX.Trash:ignore } protocols = imap pop3 service auth { unix_listener auth-client { mode = 0666 } } service imap-login { client_limit = 500 inet_listener imap { address = * } inet_listener imaps { address = * } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 64 M } service imap { process_limit = 512 vsz_limit = 256 M } service managesieve-login { client_limit = 500 process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 64 M } service managesieve { process_limit = 512 vsz_limit = 256 M } service pop3-login { client_limit = 500 inet_listener pop3 { address = * } inet_listener pop3s { address = * } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 64 M } service pop3 { process_limit = 512 vsz_limit = 256 M } ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA ssl_key = </etc/dovecot/ssl/dovecot.key ssl_protocols = !SSLv2 !SSLv3 userdb { driver = prefetch } userdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword } protocol imap { imap_capability = +NAMESPACE imap_idle_notify_interval = 24 mins imap_logout_format = in=%i, out=%o, bytes=%i/%o mail_max_userip_connections = 20 mail_plugins = acl quota imap_quota imap_zlib } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o pop3_uidl_format = UID%u-%v } protocol lda { postmaster_address = postmaster(a)example.com } 1 18:23:54 gw-ud3 dovecot: imap(xxxx(a)xxxx.com): Panic: file imap-client.c: line 849 (client_check_command_hangs): assertion failed: (!have_wait_unfinished || unfinished_count > 0) Feb 11 18:23:54 gw-ud3 dovecot: imap(xxxx(a)xxxx.com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x8096a) [0x7f996c47e96a] -> /usr/lib64/dovecot/libdovecot.so.0(+0x809d6) [0x7f996c47e9d6]$ Feb 11 18:23:55 gw-ud3 dovecot: imap(xxxx(a)xxxx.com): Fatal: master: service(imap): child 329519 killed with signal 6 (core dumped) Here's the backtrace: (gdb) bt full #0 0x00007f046eb2e625 in raise (sig=<value optimized out>) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 resultvar = 0 pid = 98454 selftid = 98454 #1 0x00007f046eb2fe05 in abort () at abort.c:92 save_stage = 2 act = {__sigaction_handler = {sa_handler = 0x2, sa_sigaction = 0x2}, sa_mask = {__val = {139657018134932, 1, 18488448, 0, 139657017886537, 139657017552035, 139657017530872, 206158430224, 140725557583888, 140725557583680, 4362456, 140725557583788, 18440536, 0, 0, 6717455502603727992}}, sa_flags = 1635021663, sa_restorer = 0x7ffd38dee060} sigs = {__val = {32, 0 <repeats 15 times>}} #2 0x00007f046ef10a60 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:201 backtrace = 0x1196158 "/usr/lib64/dovecot/libdovecot.so.0(+0x80a6a) [0x7f046ef10a6a] -> /usr/lib64/dovecot/libdovecot.so.0(+0x80ad6) [0x7f046ef10ad6] -> /usr/lib64/dovecot/libdovecot.so.0(i_error+0) [0x7f046eeb994f] -> dove"... #3 0x00007f046ef10ad6 in i_internal_fatal_handler (ctx=0x7ffd38dee080, format=<value optimized out>, args=<value optimized out>) at failures.c:670 status = 0 #4 0x00007f046eeb994f in i_panic (format=0x18096 <Address 0x18096 out of bounds>) at failures.c:275 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffd38dee160, reg_save_area = 0x7ffd38dee0a0}} #5 0x0000000000418247 in client_continue_pending_input () No symbol table info available. #6 0x00007f046ef22fdb in io_loop_call_io (io=0x11c5860) at ioloop.c:559 ioloop = 0x119e740 t_id = 2 __FUNCTION__ = "io_loop_call_io" #7 0x00007f046ef24577 in io_loop_handler_run_internal (ioloop=<value optimized out>) at ioloop-epoll.c:220 ctx = 0x11a0250 events = <value optimized out> event = 0x11a10c0 list = 0x11a1c80 io = <value optimized out> tv = {tv_sec = 29, tv_usec = 999480} events_count = <value optimized out> msecs = <value optimized out> ret = 1 i = <value optimized out> call = <value optimized out> ---Type <return> to continue, or q <return> to quit--- __FUNCTION__ = "io_loop_handler_run_internal" #8 0x00007f046ef23085 in io_loop_handler_run (ioloop=0x119e740) at ioloop.c:607 No locals. #9 0x00007f046ef23228 in io_loop_run (ioloop=0x119e740) at ioloop.c:583 __FUNCTION__ = "io_loop_run" #10 0x00007f046eebeca3 in master_service_run (service=0x119e5e0, callback=<value optimized out>) at master-service.c:640 No locals. #11 0x0000000000424c5c in main () No symbol table info available.

2 2

Re: Question on setting up dovecot
by Joseph Tam 12 Feb '16

12 Feb '16

Jeffery Small writes: > There are no errors. We have a pop3 connection. The user's name, > uid, gid, password, home directory are all correct. The inbox is > listed as /var/mail/sherril which is correct, and this file has the > correct ownership and permissions: > > # ls -l /var/mail/sherril > -rw-rw---- 1 sherril mail 194900 Feb 11 09:00 /var/mail/sherril > > Yet, no mail is pulled over. Are there any clues here? OK, the next step might be to try talk POP3 directly to your dovecot server, and see if it responds to some common POP3 requests. You might have to use one of telnet server 110 nc server 110 (or "ncat" or "netcat") openssl s_client -connect server:995 (if using SSL) then test with these commands USER someuser PASS their-password (Should list messages and their sizes) LIST (Should list messages and their UIDLs) UIDL (Retrieve the first message) RETR 1 QUIT If these work, then I would look at the client. If not, check the logs why it failed. > Feb 11 08:47:49 pop3(sherril): Info: Disconnected: Logged out top=0/0, \ > retr=0/0, del=0/3, size=36928 If I read this right, the client never tried to download any messages (no top, no retr). Maybe the client downloaded the UIDLs and figured it already had local copies of those messages. Joseph Tam <jtam.home(a)gmail.com>

1 0

Config file syntax in gory detail
by Timo Sirainen 11 Feb '16

11 Feb '16

I finally wrote this: http://wiki2.dovecot.org/ConfigFile Looks like it ended up having a lot more content than I initially assumed.

5 4

Cache unseen count
by Jorge Carling 11 Feb '16

11 Feb '16

Dear all, Lately I am working on PHP mail account management application. It has, among others, Unread messages count column. To get the number of unread messages, I execute "doveadm search" command for each database row. The search time for single account is about 0.03 seconds. Our system has around 750 accounts, so the total loading time is currently around 20 seconds. When setting up Dovecot, I made the user_query, which is also used to store the message quota, and total number of messages stored in particular mailbox. Is there a keyword that can be included in the user_query, or some other way to maintain the unread messages count in the database? Maybe there is a way to execute a script every time a message is received, or becomes read, or unread. Kind regards,JC

2 1

Help migrating a mailbox...
by Willy Gardiol 11 Feb '16

11 Feb '16

Hi! i have a question for you guys, i have been playing with this issue for a while and i am a bit lost. I have dovecot 2.2.16 on a Gentoo linux server, which run a couple of email domains, linked with postfix. I have a huge (>4gb) Outlook PST file which contains a backup coming from a new user, he used to have this backup on his old email system and i need to dump it into his new email account on my server. This is just a "old" backup which needs to be kept for reference, there is no need to preserve any ID/UID/GUID whatever. So, i found the "readpst" util which is capable ot reading the PST file and dump it's contents as mbox structure. (see http://bit-vonameln.de/email-migration-outlook-dovecot-imap/) I did it and i got a 4.4gb folder with some sub-folders, attachments, and more files inside. Then i spent most of a few days trying to have dovecot digest this and import it on top of the user new email address. With no luck. I have being trying with doveadm sync but i cannot find how i need to do it. Note that: 1) there is no local user, only the mail user (user(a)hisdomain.org) 2) i use maildir, the PST has been converted to mbox 3) dovecot is compiled with maildir and mbox support I tried, for example: server # export mail_location=mbox:/path/to/mbox/converted/emails server # doveadm sync -u user(a)hisdomain.org -d doveadm(user(a)hisdomain.org): Fatal: User has no mail_replica in userdb Then i tried: server # export mail_location=/home/vmail/hisdomain.org/user/maildir server # doveadm sync -u user(a)hisdomain.org mbox:/path/to/mbox/converted/emails dsync(user(a)hisdomain.org): Error: Mail locations must use the same virtual mailbox hierarchy separator (specify separator for the default namespace) Also tried: server # export mail_location=/home/vmail/hisdomain.org/user/maildir server # doveadm sync -u user(a)hisdomain.org /path/to/mbox/converted/emails doveadm(user(a)hisdomain.org): Fatal: execvp(/home/vmail/hisdomain.org/user/maildir) failed: Permission denied dsync-local(user(a)hisdomain.org): Error: read(remote) failed: EOF (version not received) My dovecot is configured to use "maildir", the most relevant part of my dovecot.conf is: auth_debug = no login_greeting = Dovecot ready. mail_debug = no auth_debug_passwords = no auth_default_realm = mydomain.org auth_mechanisms = plain login auth_realms = <list of my domains here> auth_verbose = no base_dir = /var/run/dovecot/ disable_plaintext_auth = no mail_uid=999 mail_gid=999 listen = * mail_location = maildir:/home/vmail/%d/%n/maildir protocols = imap sieve lmtp (i can add omitted lines if needed) either i am not undesrtanding anything, which is totally possible, or i am missing something big. If anybody on this list has any insight or suggestion, pelase advise! ps: the destination mailbox is perfectly new and empty, it's already existing and the user can successfully login, send and receive emails. Dovecot works great, and i am operating locally on the server where i uploaded the converted mbox folders. -- Willy Gardiol willy(a)gardiol.org www.gardiol.org www.trackaway.org -> Track YOUR way the way you want!

1 0

Pigeonhole Sieve fails on date-based filter rules - bug?
by Clemens Ender 10 Feb '16

10 Feb '16

Hi list! I’m running dovecot + pigeonhole on a debian wheezy based VPS. Here is the output of „dovecot -n“ # 2.2.18: /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.9 disable_plaintext_auth = no imap_idle_notify_interval = 29 mins mail_plugins = acl quota fts fts_lucene managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace { location = maildir:%%h/maildir:INDEX=~/maildir/shared/%%u prefix = shared/%%u/ separator = / type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = username_format=%u /home/dovecot/auth.d/%d/users driver = passwd-file } plugin { acl_shared_dict = file:/home/dovecot/vmail/%d/shared-mailboxes.db fts = lucene fts_autoindex = yes fts_decoder = decode2text fts_lucene = whitespace_chars=@ sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service decode2text { executable = script /usr/local/libexec/dovecot/decode2text.sh unix_listener decode2text { mode = 0666 } user = dovecot } service lmtp { executable = lmtp -L unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/ssl/certs/dovecot.crt ssl_key = </etc/ssl/private/dovecot.key userdb { args = username_format=%u /home/dovecot/auth.d/%d/users default_fields = uid=vmail gid=vmail home=/home/dovecot/vmail/%d/%n userdb_mail=maildir:~/maildir quota_rule=*:storage=2G driver = passwd-file } protocol lmtp { mail_plugins = acl quota fts fts_lucene sieve postmaster_address = postmaster(a)en-der.at } protocol lda { info_log_path = /var/log/dovecot-lda.log log_path = /var/log/dovecot-lda-errors.log mail_plugins = acl quota fts fts_lucene sieve } I’m trying to filter emails based on the following rule: if allof (date :value "lt" "Date" "date" "2015-01-01") { fileinto "Archiv/2014"; } Some mails which should match are not filtered. Please look at what sieve-filter -e -W -v ... puts out: >> Filtering message: ID: <0.0.6.888.1CFAFF845D5E634.77992(a)mta144.avaaz.org> Date: Size: 17781 bytes Subject: =?utf-8?q?Klimafreunde_-_der_Plan_ste... Performed actions: * store message in folder: Archiv/2014 Implicit keep: (none) >> Filtering message: ID: <1527093595.86163601420098718229.JavaMail.email(a)email.apple.com> Date: Thu, 1 Jan 2015 07:51:58 +0000 (GMT) Size: 19573 bytes Subject: =?ISO-8859-1?Q?Ihre_Rechnung,_Nr.=A01... Performed actions: (none) Implicit keep: * store message in folder: INBOX ... So it appears that the „Date“ header is not properly extracted for the affected emails. Here are the headers of an particular email (the one without „Date:“ listed above): Return-Path: <bounces-43375-33947798(a)bounces.avaaz.org> Delivered-To: <clemens(a)en-der.at> Received: from vps1.en-der.at by vps1 (Dovecot) with LMTP id Vrb9JNSl31M5aQAAwqatwA for <clemens(a)en-der.at>; Mon, 04 Aug 2014 15:25:08 +0000 Received: from mta144.avaaz.org (mta144.avaaz.org [69.60.9.144]) by vps1.en-der.at (Postfix) with ESMTP id 61715ACDAA for <clemens(a)en-der.at>; Mon, 4 Aug 2014 15:25:07 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; s=av_key; d=avaaz.org; h=Content-Type:MIME-Version:Subject:From:To:List-Unsubscribe:Message-ID; i=avaaz(a)avaaz.org; bh=aNrRG1oOw57rU4AT/0miGg8aWAI=; b=erOsRngaWCaW7R0sK8COa4k97QpCISFa6/0ZKfZJHAEHKJu3FbUTExJb/L6OQez/V26UgwpbKJqU Py0l8dDpu68tUlhR42AUnZV+M+lpqI6LdoiTt/QMC0TklQnqdKZt0E4CG+Kz7plluYwhXlZHVSXc +apdPqllFZeYAcsaN5k= DomainKey-Signature: a=rsa-sha1; c=nofws; q=dns; s=av_key; d=avaaz.org; b=YdIs06lkIN6pxGKoLORIDjbBCLU/5vwP1QCVocIa0qB4EgT1uKwf+bDlpbQVWmSsjPzekeZmWbpZ um+paKzqq7UGtJMVb1eGjod/bkuOGeXXdeZG0tGJz8wfLdNog6DbfChRBvMciS/Wsz+xrK3yVbX6 bQuKbeD/gurWPhEDfFc=; Received: by mta144.avaaz.org id hruita1u62ku for <clemens(a)en-der.at>; Mon, 4 Aug 2014 11:25:07 -0400 (envelope-from <bounces-43375-33947798(a)bounces.avaaz.org>) Content-Type: multipart/alternative; boundary="===============1522543492113580631==" MIME-Version: 1.0 Subject: =?utf-8?q?Klimafreunde_-_der_Plan_steht!?= From: Ricken Patel - Avaaz.org <avaaz(a)avaaz.org> To: "clemens(a)en-der.at" <clemens(a)en-der.at> List-Unsubscribe: <https://secure.avaaz.org/act/?r=unsub&cl=5597832458&email=clemens@en-der.at…> X-Campaign-ID: avaazCLIMATEeventhostsrecruitment201407301851073204 X-Version-ID: 43375 Message-ID: <0.0.6.888.1CFAFF845D5E634.77992(a)mta144.avaaz.org> --===============1522543492113580631== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Liebe alle, tausende von uns haben ... Any idea what is wrong here? Best regards, Clemens Ender

1 0

Re: Question on setting up dovecot
by Joseph Tam 10 Feb '16

10 Feb '16

Jeffery Small writes: > I'm new to dovecot and have a configuration question. I'm attempting to > have a Windows 7 system on my secure LAN connect to the Ubuntu server > using POP3 on channel 110 and retrieve mail from the /var/mail directory. > The user is defined on the Ubuntu machine and when running the Windows > Internet E-Mail Settings tool, the Test Account Settings Logs onto the > server successfully and sends a test message. Sending message is a distinct service from retrieving Email. > However, when I perform a > Send/Receive operation from the user's Outlook, all steps complete but no > mail is pulled down from the server. > > I have tried setting: mail_location = /var/mail/%u > > and restarted dovecot, but nothing changes. How can I debug this? I'm > unsure where to look for clues as to what's happening under the hood. Any > pointers would be appreciated. Log files would be a good start. Maybe start with something like log_path = /path/to/logfile auth_verbose = yes auth_debug = yes mail_debug = yes verbose_ssl = yes Joseph Tam <jtam.home(a)gmail.com>

1 0

user password in mail-filter plugin
by Thomas Möhle 10 Feb '16

10 Feb '16

Hello, I would like to use the users password within a mail-filter script. Dovecots %w variable is only available within dovecot-auth, is there any way to access the password for a mail-filter? Thanks, Thomas

4 11

Sieve question
by ＠lbutlr 10 Feb '16

10 Feb '16

Is it possible to use redirect in a sieve to redirect to multiple addresses? if header :contains “from” “test(a)example.xn--com-9o0a { redirect “user1@example.com,user2@example.com”; } I thought this would work, But I am seeing a “redirect address is invalid: not a single addres [sic] (found ‘,’). -- I'll have what the gentleman on the floor is having.

3 3

Question on setting up dovecot
by Jeffery Small 10 Feb '16

10 Feb '16

Server OS: Ubuntu 15.10 Sendmail: 8.14.9-4 # doveconf -n ----------------------------------------------------------- # 2.2.18: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 4.2.0-27-generic x86_64 Ubuntu 15.10 disable_plaintext_auth = no mail_location = mbox:~/lib/Mail:INBOX=/var/mail/%u passdb { driver = pam } protocols = imap pop3 ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd } userdb { driver = passwd } ----------------------------------------------------------- I'm new to dovecot and have a configuration question. I'm attempting to have a Windows 7 system on my secure LAN connect to the Ubuntu server using POP3 on channel 110 and retrieve mail from the /var/mail directory. The user is defined on the Ubuntu machine and when running the Windows Internet E-Mail Settings tool, the Test Account Settings Logs onto the server successfully and sends a test message. However, when I perform a Send/Receive operation from the user's Outlook, all steps complete but no mail is pulled down from the server. I have tried setting: mail_location = /var/mail/%u and restarted dovecot, but nothing changes. How can I debug this? I'm unsure where to look for clues as to what's happening under the hood. Any pointers would be appreciated. Regards, -- Jeff Small

1 0

Per-user special folder?
by Richard Platel 10 Feb '16

10 Feb '16

Hi It's possible to mark some folders as special use for IMAP in the config like: namespace inbox { mailbox Spam { special_use = \Junk } } Our webmail allows users to use an arbitrary folder for Spam, and we have this settings and we'd like to return it in from our UserDB (which is a custom dict proxy). For testing were able to set a namespace parameter like "separator" by returning: "namespace/inbox/separator" : "=", from UserDB, but can't figure out a way to set mailbox settings, "namespace/inbox/mailbox Spam/special_use" : "\Junk", for example doesn't work. Is there a way to return this setting from a UserDB query?

2 1

Load increase and imap processes in state D
by Alessio Cecchi 09 Feb '16

09 Feb '16

Hi, in recent weeks I have notice a sudden increase in the load average of our Dovecot (2.2.19) IMAP/POP servers (and consequently in the NFS storage). After an investigation I found some dovecot/imap processes in D state and running UID FETCH or UID SORT from Webmail (Roundcube) without that user was actually more connected to webmail. Some minutes after the dovecot/imap processes stop to run FETCH/SORT but in "ps aux" I can still see it. If the user try to login in Webmail again the same process start again to run FETCH/SORT (and it consumes a lot of I/O resources) but the webmail does not load any message and return a "FETCH 1: UID INTERNALDATE BODY.PEEK ..." error. The only way to restore the webmail access is to kill the related dovecot/imap process (or with doveadm kick username). I noticed that these processes in D state had started many hours before. Example, now are 17:30 (important, see the time of the dovecot/imap processes) the user alessio@skye try to login in webmail without success and close the webmail, processes are still running: # doveadm who | grep alessio@skye username # proto (pids) (ips) alessio@skye 3 imap (10440 4624) (192.168.5.215) # ps aux | grep SORT vmail 4624 0.0 0.0 108792 16048 ? D 13:32 0:01 dovecot/imap [alessio@skye 192.168.5.215 UID SORT] vmail 10440 0.0 0.1 108520 17832 ? D 12:32 0:02 dovecot/imap [alessio@skye 192.168.5.215 UID SORT] # doveadm kick alessio@skye kicked connections from the following users: alessio@skye Processes are now died, and user can login in Webmail easily. Can be a "reusing processes" issue since I have set service_count=100 for imap and pop3 services or there may be other problems related to my configuration? Thanks my configuration: # 2.2.19.1 (16dc61d3dab3): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.9 (5d26f470efe6) # OS: Linux 2.6.32-573.12.1.el6.x86_64 x86_64 CentOS release 6.7 (Final) auth_cache_negative_ttl = 5 mins auth_cache_size = 10 M auth_cache_ttl = 20 mins auth_master_user_separator = * auth_worker_max_count = 50 deliver_log_format = msgid=%m, from=%f, subject="%s": %$ dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid = 89 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_idle_notify_interval = 29 mins imap_logout_format = in=%i out=%o session=<%{session}> last_valid_gid = 89 last_valid_uid = 89 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 10.96.3.156 login_trusted_networks = 192.168.5.0/24 mail_fsync = always mail_location = maildir:~/Maildir mail_plugins = quota acl expire fts fts_solr zlib maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate vnd.dovecot.duplicate mmap_disable = yes namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-deny-sql.conf.ext deny = yes driver = sql } passdb { args = /etc/dovecot/extra/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl antispam_backend = mailtrain antispam_mail_notspam = --ham antispam_mail_sendmail = /usr/bin/sa-learn antispam_mail_spam = --spam antispam_spam = Spam antispam_trash = Trash expire = Trash expire2 = Spam expire_dict = proxy::expire fts = solr fts_solr = url=http://10.0.0.5:8983/solr/ quota = maildir:UserQuota quota2 = dict:Quota Usage::noenforcing:proxy::sqlquota quota_grace = 10M quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/before.sieve sieve_dir = ~/sieve sieve_extensions = +vnd.dovecot.duplicate -vacation zlib_save = gz zlib_save_level = 6 } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o, session=<%{session}> protocols = imap pop3 sieve sendmail_path = /bin/sendmail service auth { client_limit = 6524 unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service dict { process_limit = 500 unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { process_min_avail = 4 service_count = 0 } service imap-postlogin { executable = script-login /etc/dovecot/imap-postlogin.sh unix_listener imap-postlogin { group = vmail mode = 0660 user = vmail } user = vmail } service imap { executable = imap imap-postlogin process_limit = 5000 service_count = 100 vsz_limit = 384 M } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { process_min_avail = 4 service_count = 0 } service pop3-postlogin { executable = script-login /etc/dovecot/pop3-postlogin.sh unix_listener pop3-postlogin { group = vmail mode = 0660 user = vmail } user = vmail } service pop3 { executable = pop3 pop3-postlogin process_limit = 1024 service_count = 100 } service quota-warning { executable = script /etc/dovecot/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } service stats { fifo_listener stats-mail { group = vmail mode = 0660 user = vmail } } ssl_cert = </etc/dovecot/wildcard.pem ssl_key = </etc/dovecot/wildcard.key ssl_protocols = !SSLv2 !SSLv3 submission_host = 127.0.0.1 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lda { mail_location = maildir:~/Maildir:INDEX=MEMORY mail_plugins = quota acl expire fts fts_solr zlib sieve } protocol imap { mail_max_userip_connections = 25 mail_plugins = quota acl expire fts fts_solr zlib imap_quota imap_acl imap_zlib } protocol sieve { mail_max_userip_connections = 2 } -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice

1 0

Bug: The "listescape" plugin does not work with the option "mail_shared_explicit_inbox = no". [with patch]
by Rudolf Körner 09 Feb '16

09 Feb '16

Hello, there seems to be a problem with the listescape plugin and shared INBOX: === Preconditions: - Dovecot 2.2.21 (or 2.2.13) - IMAP - Separator / - Namespace-prefixes "INBOX/" and "shared/%%u/" - Maildir(++) - option mail_plugins = acl listescape - option mail_shared_explicit_inbox = no - User "owner" shares the INBOX - ACLs set for another user "reader", so "reader" is able to access the shared INBOX of "owner" === Steps to reproduce by using IMAP commands at a telnet session: - a1 login reader password - a2 select shared/owner === Result: Selecting the shared INBOX fails with a response like: a2 NO Mailbox doesn't exist: shared/owner === Expected: The "select" command works. === Analysis: The function "mailbox_list_default_get_storage_name" (lib-storage/mailbox-list.c) does not work as expected when using the mail_plugin "listescape". It compares the mailbox name to the namespace prefix. Since the mailbox name is escaped a few lines before, the comparison yields "strings differ", which makes accessing the shared INBOX fail. For example: for a string vname (mailbox name) "shared/owner", it compares "shared.owner" (escaped string) to the list->ns->prefix which is "shared/owner". Asuming that the stored prefix should not be escaped, there should be a comparison of the unescaped name to the unescaped prefix (or the escaped name to the escaped prefix?). === Patch: Attached is a small patch which shows a possible solution. When applied, the problem is solved, i.e. the shared INBOX is accessible then. Important note: this patch is experimental, it works for the described special case but might not work with a different configuration or might even break things. Best Regards, Rudolf Körner

1 0

RFC: HTTP based storage API
by Nagy, Attila 09 Feb '16

09 Feb '16

Hi, Nearly every popular programming language has an LMTP/POP/IMAP implementation, most of them suck in many different ways. I don't know any server or library which provides a well-established, compatible protocol frontend with an open backend API, which could be used to easily make a custom storage backend for the LMTP/POP/IMAP frontend in any language, in any programming paradigm, irregardless of the frontend implementation. Dovecot is very close to this: it speaks IMAP to the backend, but you still have to make a nearly complete IMAP implementation, which is a PITA. Therefore I am curious about your opinion: what about an HTTP-based open backend (lib-storage) API to Dovecot? Some thoughts on this: 1. it should be a simple REST API 2. it should support efficient operations on both sides (client, server), for example listing a multi-million folder shouldn't be a single JSON response, but a JSON stream, which could be produced and parsed individually or in smaller batches efficiently 3. it should support capabilities, somewhat like the current imapc backend, so if the backend service suppports search, it should announce this capability and dovecot could offload these requests to it, but if it doesn't, dovecot could build its indices. 4. only the needed amount of POP/IMAP legacy should appear in the protocol 5. the operations should be asynchronous on Dovecot's side (to be scalable) 6. maybe even Dovecot's index-queries could be offloaded to the backend service (this way the local file system wouldn't be used at all and all caches could be stored in a distributed dictionary), this could also be a capability 7. it could support some kind of push (for IDLE-ing and the like) 8. it should be stateless If Dovecot could make this right, it could be the FUSE of the mail protocols, acting as a glue for experimental or production ready mail storage backends, without the need to write these backends in "Dovecot C" (I mean it's process and API structure). Of course HTTP here is not a strict requirement. It could be anything, which can be easy to implement and understand and is able to fulfill the needs. An example could be Dovecot's own dictionary protocol. What do you think about this?

4 10

autoexpunge - different settings for different users
by Tom Johnson 09 Feb '16

09 Feb '16

I have some users where I'd like to expunge their mail at different times. For example, I may have some users who I want to expunge everything from every folder at 30 days. Others where I'd like to expunge everything at 90 days. And still others where I only want to expunge mail from the Trash and Junk folders, and nowhere else. Is there a way to do some sort of lookup for this? Or is this beyond the ability of the autoexpunge feature? Should I just use a cron job and use "doveadm expunge" on a user-by-user basis? Thanks-

5 9

Dovecot with pam authentication and user@domain
by Christian Schneider 08 Feb '16

08 Feb '16

Hello all, I'm trying to setup dovecot for local users with pam authentication. The passdb and userdb entries are as follows: passdb { args = username_format=%n driver = pam } userdb { args = username_format=%n driver = passwd } Using "doveadm user chriss" returns the user record as expected, but "doveadm user chriss(a)testmail.ch-sc.de" gives an error: field valueuserdb lookup: user chriss(a)testmail.ch-sc.de doesn't exist As far as I understand, username_format=%n should drop the domain part and only search for the user in the userdb, but it doesn't. What am I missing? Greetings Christian

1 1

Permissions issue with Debian 8, dovecot 2.21, vpopmail
by Stephen 08 Feb '16

08 Feb '16

There is a permissions issue in dovecot 2.21 in the ~/run directory (mine is /var/run/dovecot) at least in Debian 8. Files created by dovecot imap: srw------- 1 root root 0 Feb 3 16:46 imap-hibernate srw------- 1 root root 0 Feb 3 16:46 imap-master changed to make work: srw-rw-rw- 1 root root 0 Feb 3 16:46 imap-hibernate srw-rw-rw- 1 root root 0 Feb 3 16:46 imap-master Errors were reported in /var/log/dovecot.log which we use mainly for fail2ban (it gets huge, but ...) vpopmail version 5.4.33 with one patch I don't think this is a Debian issue ... possibly could be a vpopmail issue, but it's probably caused by the fact that imap daemons are running as vpopmail: vpopmail 30182 9187 0 15:02 ? 00:00:00 dovecot/imap

2 1