- dovecot - dovecot.org

dsync dovecot / Failed connection refused
by Thierry 26 Jan '17

26 Jan '17

Dear all, I am using VMWare and I have cloned my emails server. Now I do have two identicals servers, both running the same version of dovecot (2.2.13) and imap. Let's call them: server1.domain.ltd and server2.domain.ltd. I would like to sync both server using dsync. Dovecot is working well except concerning the sync. dsync config server1.domain.ltd # Enable the replication plugin globally mail_plugins = $mail_plugins notify replication # The mail processes need to have access to the replication-notify fifo and socket. service aggregator { fifo_listener replication-notify-fifo { user = vmail mode = 0666 } unix_listener replication-notify { user = vmail mode = 0666 } } # Enable doveadm replicator commands service replicator { unix_listener replicator-doveadm { mode = 0666 } } # Create a listener for doveadm-server service doveadm { user = vmail inet_listener { port = 12345 } } # configure how many dsyncs can be run in parallel (10 by default) replication_max_conns = 10 # tell doveadm client to use this port by default doveadm_port = 4711 #Both the client and the server also need to have a shared secret doveadm_password = {SHA512-CRYPT}$6$rou.................... # use tcp:hostname as the dsync target plugin { #mail_replica = tcp:server2.domain.ltd # use doveadm_port mail_replica = tcp:server2.domain.ltd:12345 # use port 12345 explicitly } service config { unix_listener config { user = vmail } } *************************************************************************************** dsync config server2.domain.ltd # Enable the replication plugin globally mail_plugins = $mail_plugins notify replication # The mail processes need to have access to the replication-notify fifo and socket. service aggregator { fifo_listener replication-notify-fifo { user = vmail mode = 0666 } unix_listener replication-notify { user = vmail mode = 0666 } } # Enable doveadm replicator commands service replicator { unix_listener replicator-doveadm { mode = 0666 } } # Create a listener for doveadm-server service doveadm { user = vmail inet_listener { port = 12345 } } # configure how many dsyncs can be run in parallel (10 by default) replication_max_conns = 10 # tell doveadm client to use this port by default doveadm_port = 4711 #Both the client and the server also need to have a shared secret doveadm_password = {SHA512-CRYPT}$6$ro............. # use tcp:hostname as the dsync target plugin { #mail_replica = tcp:server1.domain.ltd # use doveadm_port mail_replica = tcp:server1.domain.ltd:12345 # use port 12345 explicitly } service config { unix_listener config { user = vmail } } To test both port I have open on my both servers port 12345 and 4711 : Iptables server1: ACCEPT tcp -- anywhere anywhere tcp dpt:4711 ACCEPT tcp -- anywhere anywhere tcp dpt:12345 Iptables server2: ACCEPT tcp -- anywhere anywhere tcp dpt:4711 ACCEPT tcp -- anywhere anywhere tcp dpt:12345 doveadm replicator status '*' username priority fast sync full sync failed user1(a)domain.ltd none 00:01:21 11:25:40 y user3(a)domain.ltd none 07:31:16 11:25:41 - user2(a)domain.ltd none 00:01:21 11:25:40 y user4(a)domain.ltd none 11:25:41 11:25:41 - user5(a)domain.ltd none 02:17:03 11:25:41 - user6(a)domain.ltd none 11:25:40 11:25:40 - user4(a)domain.ltd none 00:00:51 11:25:40 y When doing, from server1: "doveadm sync -u user1(a)domain.ltd remote:server2.domain.ltd" doveadm(user1(a)domain.ltd): Error: userdb lookup: connect(/var/run/dovecot/auth-userdb) failed: Connection refused doveadm(user1(a)domain.ltd): Fatal: /var/run/dovecot/auth-userdb: passdb lookup failed (to see if user is proxied, because doveadm_port is set) dsync-local(user1(a)domain.ltd): Error: read(server2.domain.ltd) failed: EOF (version not received) Thx for your help. -- Cordialement, Thierry e-mail : lenaigst(a)maelenn.org PGP Key: 0xB7E3B9CD

2 6

Benchmarking auth
by micah anderson 25 Jan '17

25 Jan '17

Hello, I'm attempting to use imaptest to test auths/sec on my imap server, to simulate the number I'm getting now on a new server. Based on my readings of dovecot stats outputs, my current machine is doing somewhere between 11.6 and 196 logins/sec at its busiest, and I want to make sure the new server can handle that amount. With imaptest I attempt to simulate this by just simulating login/logout speed, but I'm not sure I understand the results and where things are being blocked. For testing purposes, I set: mail_max_userip_connections = 6000 mail_max_userip_connections = 6000 auth_worker_max_count = 240 If you have some additional suggestions for what I can also tweak here to improve this, I would like to know. I then ran imaptest with: imaptest clients=196 user=test pass=testpw host=127.0.0.1 port=14300 - select=0 seed=123 secs=300 It doesn't seem like I can simulate *only* authentications/logins. I have to pair them with logouts. It makes me wonder how I can simulate the amount of load on my current live system on this system. How do I read the output? I don't really understand what is being shown here: Logi Logo 100% 100% 0 0 100/100 [51%] does this mean that it tried 100 logins and 100 logouts and 51% succeeded? What are the first two columns? 7 7 104/121 [61%] 6 6 131/139 [70%] 3 3 137/148 (84 stalled >3s) [75%] 84 stalled for more than 3 seconds, how does this relate to the other values presented? 5 5 155/163 (79 stalled >3s) [83%] 1 1 166/166 (107 stalled >3s) [84%] 2 2 168/172 (128 stalled >3s) [87%] 6 5 179/190 (140 stalled >3s) [96%] 22 22 182/196 (136 stalled >3s) 4 3 195/196 (133 stalled >3s) 5845 129 ms/cmd avg I really wonder if these first two columns are ms/cmds? It then continues: Logi Logo 100% 100% 10 11 195/196 (131 stalled >3s) 7 8 194/196 (150 stalled >3s) 3 3 194/196 (171 stalled >3s) 10 9 192/196 (166 stalled >3s) 22 22 182/196 (156 stalled >3s) 8 9 193/196 (153 stalled >3s) - 2 stalled for 16 secs in command: 1 LOGIN "test" "testpw" - 7 stalled for 16 secs in command: 1 LOGIN "test" "testpw" - 8 stalled for 16 secs in command: 1 LOGIN "test" "testpw" - 9 stalled for 16 secs in command: 1 LOGIN "test" "testpw" - 11 stalled for 16 secs in command: 1 LOGIN "test" "testpw" - 12 stalled for 16 secs in command: 1 LOGIN "test" "testpw" - 14 stalled for 16 secs in command: 1 LOGIN "test" "testpw" - 22 stalled for 16 secs in command: 1 LOGIN "test" "testpw" - 25 stalled for 16 secs in command: 1 LOGIN "test" "testpw" ... it starts to build up like this, until I hit control-c twice: - 100 stalled for 17 secs in command: 1 LOGIN "test" "testpw" ^CInfo: Received second SIGINT - stopping immediately 11347 118 ms/cmd avg Totals: Logi Logo 100% 100% 130 134 What are these totals? Thanks! micah

1 0

Apparent Maildir permission issue
by Mark Foley 25 Jan '17

25 Jan '17

I've just upgraded from Slackware 14.1 to 14.2. I've not done anything with dovecot -- it's the same version that was running before the upgrade. However, now I'm getting a permission error: /var/log/maillog: Jan 16 13:09:44 mail dovecot: imap(mark): Error: opendir(/home/HPRS/mark/Maildir) failed: Permission denied (euid=3000026(HPRS\mark) egid=100(users) missing +r perm: /home/HPRS/mark/Maildir, conflicting dir uid=10001(HPRS\mark)) Jan 16 13:09:44 mail last message repeated 4 times Jan 16 13:09:44 mail dovecot: imap(mark): Error: stat(/home/HPRS/mark/Maildir/.Trash) failed: Permission denied (euid=3000026(HPRS\mark) egid=100(users) missing +x perm: /home/HPRS/mark/Maildir, conflicting dir uid=10001(HPRS\mark)) Jan 16 13:09:44 mail dovecot: imap(mark): Error: stat(/home/HPRS/mark/Maildir/tmp) failed: Permission denied (euid=3000026(HPRS\mark) egid=100(users) missing +x perm: /home/HPRS/mark/Maildir, conflicting dir uid=10001(HPRS\mark)) Jan 16 13:09:44 mail dovecot: imap(mark): Error: opendir(/home/HPRS/mark/Maildir) failed: Permission denied (euid=3000026(HPRS\mark) egid=100(users) missing +r perm: /home/HPRS/mark/Maildir, conflicting dir uid=10001(HPRS\mark)) Jan 16 13:09:45 mail last message repeated 11 times Permission on that folder are: $ ls -ld /home/HPRS/mark/Maildir drwx------ 17 HPRS\mark domusers 4096 Dec 7 23:07 /home/HPRS/mark/Maildir/ Permissions are unchanged since before the backup. What do I do to fix this? THX --Mark

5 9

Timing information for passdb/userdb lookups
by Marcus Rückert 25 Jan '17

25 Jan '17

Hi, it would be nice to have an option to enable logging for timings without having to go with auth_verbose/auth_debug. If you try to track down if a slowdown for logging in comes from e.g. running out of login workers or if your auth backend is slow it would really help to get just a one line message per userdb/passdb with the timing for this lookup. something like: imap-login(<username>): userdb ldap lookup time 0.4s imap-login(<username>): passdb ldap lookup time 0.2s or even merging into one: imap-login(<username>): userdb ldap lookup time 0.4s passdb ldap lookup time 0.2s darix -- openSUSE - SUSE Linux is my linux openSUSE is good for you www.opensuse.org

1 0

Clamping down on mailbox sizes...
by SH Development 25 Jan '17

25 Jan '17

I don’t want to do this for all users….but… I have a few users who insist that they use their mailboxes regularly and don’t want it cancelled. Fine. But they won’t clean them out either. What steps would you all recommend for setting quotas on some users but not others? Specifically starting out with identifying WHICH accounts have excessive amounts of crap in them, by age, then sending them a notice stating they are going to get limited, then deleting mail older than x number of days if they don’t do it themselves by a certain time frame... Thoughts? Jeff

4 4

Re: Log authentication attempts
by Joseph Tam 25 Jan '17

25 Jan '17

On 24.01.2017 00:06, rej ex wrote: > Because we are building some monitoring application, we will need to > record all failed and successful login attempts. We need to record > remote IP, entered password in plain text, and if possible whether auth > request is for SMTP or IMAP session. SMTP? Wouldn't that be handled by your MTA, not Dovecot? AKi Tuomi wrote: > Since 2.2.27 we've had auth policy server support which can do this > properly. As I read the docs, the auth policy server would only get the hashed password, and wouldn't be able to record the plaintext password. Maybe use the checkpassword hook? http://wiki.dovecot.org/AuthDatabase/CheckPassword Joseph Tam <jtam.home(a)gmail.com>

2 1

Quota count does not work with lock_method=dotlock
by mkliewe＠gmx.de 24 Jan '17

24 Jan '17

Hello, dovecot crashes when I switch the quota tracking from dict to count. The following is working since years: quota = dict:User quota::proxy::quota I'm using a mysql quota dictionary. Now I want to switch to the new "quota count" + "quota clone" combination. I'm loading the "quota_clone" plugin, and: #quota = dict:User quota::proxy::quota quota = count:User quota quota_vsizes = yes quota_clone_dict = proxy::quota It works on a maschine where I'm using NFS with lock_method=fcntl. It's crashing on another maschine where I'm using NFS with lock_method=dotlock. See below. Sadly I have to use dotlock, because of the NFS server. It looks like quota count does not (yet) work with dotlock? Michael Jan 17 18:46:04 XXXX dovecot: imap-login: Login: user=<XXXX>, method=PLAIN, rip=10.0.XX.XX, lip=10.0.XX.XX, mpid=19123, secured, session=<XXXX> Jan 17 18:46:04 XXXX dovecot: imap(XXXX): Panic: file file-lock.c: line 285: unreached Jan 17 18:46:04 XXXX dovecot: imap(XXXX): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x93ea2) [0x7f33f7812ea2] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x93f8d) [0x7f33f7812f8d] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f33f77ac7c1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x98810) [0x7f33f7817810] -> /usr/local/lib/dovecot/libdovecot.so.0(file_wait_lock_error+0x26) [0x7f33f7817be6] -> /usr/local/lib/dovecot/libdovecot.so.0(file_try_lock_error+0x11) [0x7f33f7817c61] -> /usr/local/lib/dovecot/libdovecot.so.0(file_create_locked+0x17d) [0x7f33f7814d1d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb25f3) [0x7f33f7b4d5f3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mailbox_get_virtual_size+0x4c) [0x7f33f7b4d91c] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mailbox_get_metadata+0x1ab) [0x7f33f7b5510b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x5e357) [0x7f33f7af9357] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa15ac) [0x7f33f7b3c5ac] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_metadata+0x60) [0x7f33f7ae0d80] -> /usr/local/lib/dovecot/lib10_quota_plugin.so(quota_count+0xfe) [0x7f33f6fa6bce] -> /usr/local/lib/dovecot/lib10_quota_plugin.so(+0x7d3e) [0x7f33f6fa6d3e] -> /usr/local/lib/dovecot/lib10_quota_plugin.so(quota_get_resource+0x78) [0x7f33f6fa5578] -> /usr/local/lib/dovecot/lib10_quota_plugin.so(+0x68b4) [0x7f33f6fa58b4] -> /usr/local/lib/dovecot/lib10_quota_plugin.so(quota_over_flag_check_startup+0x78) [0x7f33f6fa63f8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(hook_mail_namespaces_created+0x5e) [0x7f33f7ae21ae] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_namespaces_init_finish+0x46f) [0x7f33f7ad745f] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_namespaces_init+0x104) [0x7f33f7ad7674] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_service_next+0x6c5) [0x7f33f7ae5275] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_service_lookup_next+0x4c) [0x7f33f7ae55dc] -> dovecot/imap(client_create_from_input+0x46) [0x425476] -> dovecot/imap() [0x42567f] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x316d3) [0x7f33f77b06d3] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x319bd) [0x7f33f77b09bd] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3235a) [0x7f33f77b135a] Jan 17 18:46:04 zzz-dovecot01 dovecot: imap(XXXX): Fatal: master: service(imap): child 19123 killed with signal 6 (core dumped)

3 5

Log authentication attempts
by rej ex 24 Jan '17

24 Jan '17

Hi everyone, We are running Dovecot 2.2.9 as a primary IMAP server. Also we use Dovecot SASL for SMTP authentication. Because we are building some monitoring application, we will need to record all failed and successful login attempts. We need to record remote IP, entered password in plain text, and if possible whether auth request is for SMTP or IMAP session. I checked http://wiki.dovecot.org/PostLoginScripting and noticed that post-login scripts are executed only after result_success, but not after result_failure (password mismatch). Also I read http://wiki.dovecot.org/PasswordDatabase where I saw that since version 2.2.10 it is possible to control what happens after passdb check, but allowed result values don't include executing custom script. Does anyone know a way to call external binary / script, or at least save a record in the database after login attempt without reading the log files? P.S. there is also a special case. When someone logs in from webmail, remote IP is set to webmail's server. In this case, we will log the attempt from the webmail itself, because it has the correct remote IP. Robin Wood

2 1

Ox Dovecot - dovecot.fi - dovecot-ee repo access
by Raymond Sellars 23 Jan '17

23 Jan '17

Hi My question is a little off topic but hoping the community has some insight or advise. Has anyone had success in contacting OX dovecot. We previous purchased Dovecot Pro and had access to the dovecot-ee (https://yum.dovecot.fi) repository. Credentials are no longer valid and all attempts (over the months) to reach Ox gain no response. Wondering if others are having Pro access issues or have managed to reach their info/sales team (info(a)dovecot.fi<mailto:info@dovecot.fi>?). Any recommendations on alternatives for commercial support? Primarily active security patching/advisement rather than polling the open source release stream. Thanks Raymond

3 2

Re: Segfault on LIST Command
by Thorsten Hater 23 Jan '17

23 Jan '17

Hi, I did added the default location and stripped down my config to a very basic level, dropping all plugins and database queries, see below. The segfault still appears in the same location. As I have build from source, I wonder whether you can reproduce the problem? Thorsten $ doveconf -n # 2.2.26.0 (23d1de6): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (1dc4c73) # OS: Linux 3.18.16-intel-vm-64bit x86_64 Debian 8.6 auth_debug = yes auth_debug_passwords = yes auth_socket_path = /usr/local/var/run/dovecot/auth-userdb auth_verbose = yes base_dir = /usr/local/var/run/dovecot/ default_internal_user = pop first_valid_uid = 48 import_environment = TZ DEBUG=1 last_valid_uid = 48 login_greeting = Dovecot ready. login_trusted_networks = **** mail_debug = yes mail_gid = pop mail_location = maildir:~/Maildir mail_plugin_dir = /usr/local/lib/dovecot/ mail_uid = pop managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes list = children location = maildir:~/Maildir prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = nopassword=yes driver = static } protocols = imap pop3 lmtp imap pop3 ssl = no userdb { args = home=**** uid=pop gid=pop quota_rule=*:bytes=1000M driver = static } verbose_proctitle = yes protocol lda { auth_socket_path = /usr/local/var/run/dovecot/auth-userdb } On Mon, Jan 23, 2017 at 10:01 AM, Thorsten Hater <thorsten.hater(a)gmail.com> wrote: > Hi, > > thanks for picking this up. The location is pulled from the database, but > is uniform > for all users, so I could set it to maildir:~/Maildir globally. Assuming > ~ is expanded > later on with userdb data. So, no, there is no special intention behind > this. > > Thorsten > > On Mon, Jan 23, 2017 at 9:37 AM, Aki Tuomi <aki.tuomi(a)dovecot.fi> wrote: > >> >> >> On 19.01.2017 15:56, Thorsten Hater wrote: >> > The Problem arises due to a NULL deref in mail_namespaces.c line 601. >> > Backtrace below >> > >> > x LIST "" "" >> > >> > Program received signal SIGSEGV, Segmentation fault. >> > mail_namespaces_get_root_sep (namespaces=0x0) at mail-namespace.c:601 >> > 601 while ((namespaces->flags & NAMESPACE_FLAG_LIST_PREFIX) == 0) >> > (gdb) bt >> > #0 mail_namespaces_get_root_sep (namespaces=0x0) at >> mail-namespace.c:601 >> > #1 0x000000000041164c in cmd_list_ref_root (ref=0x65b060 "", >> > client=0x65a590) at cmd-list.c:324 >> > #2 cmd_list_full (cmd=0x65aee0, lsub=<optimized out>) at cmd-list.c:461 >> > #3 0x0000000000419825 in command_exec (cmd=cmd@entry=0x65aee0) at >> > imap-commands.c:181 >> > #4 0x0000000000417de2 in client_command_input (cmd=cmd@entry=0x65aee0) >> at >> > imap-client.c:988 >> > #5 0x0000000000417e70 in client_command_input (cmd=0x65aee0) at >> > imap-client.c:1048 >> > #6 0x00000000004181e5 in client_handle_next_command >> > (remove_io_r=<synthetic pointer>, client=0x65a590) at imap-client.c:1090 >> > #7 client_handle_input (client=0x65a590) at imap-client.c:1102 >> > #8 0x0000000000418692 in client_input (client=0x65a590) at >> > imap-client.c:1149 >> > #9 0x00007ffff76297ac in io_loop_call_io (io=0x652aa0) at ioloop.c:589 >> > #10 0x00007ffff762ab4a in io_loop_handler_run_internal >> > (ioloop=ioloop@entry=0x63e7f0) >> > at ioloop-epoll.c:222 >> > #11 0x00007ffff7629835 in io_loop_handler_run (ioloop=ioloop@entry >> =0x63e7f0) >> > at ioloop.c:637 >> > #12 0x00007ffff76299d8 in io_loop_run (ioloop=0x63e7f0) at ioloop.c:613 >> > #13 0x00007ffff75b9823 in master_service_run (service=0x63e690, >> > callback=callback@entry=0x423d40 <client_connected>) at >> master-service.c:641 >> > #14 0x000000000040c567 in main (argc=3, argv=0x63e390) at main.c:460 >> > >> > On Thu, Jan 19, 2017 at 1:05 PM, Thorsten Hater < >> thorsten.hater(a)gmail.com> >> > wrote: >> > >> >> Dear all, >> >> >> >> I experience SegFaults in the imap binary on a LIST "" "" command, >> >> as sent by Claws mail. Using LIST "" "INBOX" or similar is fine. >> >> Here is an example telnet session >> >> >> >> $ telnet 127.0.0.1 143 >> >> Trying 127.0.0.1... >> >> Connected to 127.0.0.1. >> >> Escape character is '^]'. >> >> * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE >> IDLE >> >> AUTH=PLAIN] Dovecot ready. >> >> 01 LOGIN **** **** >> >> 01 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE >> >> IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS >> THREAD=ORDEREDSUBJECT >> >> MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS >> >> LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES >> WITHIN >> >> CONTEXT=SEARCH LIST-STATUS BINARY MOVE SPECIAL-USE QUOTA] Logged in >> >> 02 LIST "" "" >> >> Connection closed by foreign host. >> >> >> >> In the log file >> >> >> >> dovecot[8375]: imap(***): Fatal: master: service(imap): child 15803 >> killed >> >> with signal 11 (core dumps disabled) >> >> >> >> Please find the config below. >> >> >> >> Best regards, >> >> Thorsten >> >> >> >> $ doveconf -n >> >> # 2.2.26.0 (23d1de6): /etc/dovecot/dovecot.conf >> >> # Pigeonhole version 0.4.16 (1dc4c73) >> >> # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.6 >> >> auth_debug = yes >> >> auth_debug_passwords = yes >> >> auth_socket_path = /var/run/dovecot/auth-userdb >> >> auth_verbose = yes >> >> base_dir = /var/run/dovecot/ >> >> default_internal_user = pop >> >> first_valid_uid = 48 >> >> import_environment = TZ DEBUG=1 >> >> last_valid_uid = 48 >> >> login_trusted_networks = **** >> >> mail_debug = yes >> >> mail_gid = pop >> >> mail_plugins = " mail_log notify zlib quota" >> >> mail_uid = pop >> >> managesieve_notify_capability = mailto >> >> managesieve_sieve_capability = fileinto reject envelope >> encoded-character >> >> vacation subaddress comparator-i;ascii-numeric relational regex >> imap4flags >> >> copy include variables body enotify environment mailbox date index >> ihave >> >> duplicate mime foreverypart extracttext >> >> namespace inbox { >> >> inbox = yes >> >> list = children >> >> location = >> >> mailbox Drafts { >> >> auto = no >> >> special_use = \Drafts >> >> } >> >> mailbox Sent { >> >> auto = no >> >> special_use = \Sent >> >> } >> >> mailbox Trash { >> >> auto = no >> >> autoexpunge = 30 days >> >> special_use = \Trash >> >> } >> >> mailbox drafts { >> >> auto = no >> >> special_use = \Drafts >> >> } >> >> mailbox sent { >> >> auto = no >> >> special_use = \Sent >> >> } >> >> mailbox spamverdacht { >> >> auto = no >> >> autoexpunge = 30 days >> >> special_use = \Junk >> >> } >> >> mailbox trash { >> >> auto = no >> >> autoexpunge = 30 days >> >> special_use = \Trash >> >> } >> >> mailbox virenverdacht { >> >> auto = no >> >> autoexpunge = 30 days >> >> special_use = \Junk >> >> } >> >> prefix = INBOX. >> >> separator = . >> >> subscriptions = yes >> >> type = private >> >> } >> >> passdb { >> >> args = nopassword=y >> >> driver = static >> >> } >> >> plugin { >> >> last_login_dict = file:~/lastlogin >> >> mail_log_events = delete undelete expunge copy mailbox_delete >> >> mailbox_rename >> >> mail_log_fields = uid box msgid size >> >> quota = maildir:User quota >> >> quota_warning = storage=80%% 80 %u %{userdb:quota_bytes} >> >> quota_warning2 = storage=90%% 90 %u %{userdb:quota_bytes} >> >> quota_warning3 = storage=95%% 95 %u %{userdb:quota_bytes} >> >> sieve = ldap:/etc/dovecot/pigeonhole-ldap.conf >> >> sieve_dir = ~/sieve >> >> sieve_plugins = sieve_storage_ldap >> >> zlib_save = gz >> >> zlib_save_level = 6 >> >> } >> >> service imap { >> >> executable = imap postlogin >> >> } >> >> service pop3 { >> >> executable = pop3 postlogin >> >> } >> >> service postlogin { >> >> executable = script-login -d rawlog >> >> } >> >> service quota-warning { >> >> executable = script /bin/quota-warning.sh >> >> } >> >> ssl = no >> >> userdb { >> >> args = /etc/dovecot/userdb-ldap.conf >> >> driver = ldap >> >> result_failure = return-fail >> >> result_internalfail = return-fail >> >> result_success = continue-ok >> >> } >> >> userdb { >> >> default_fields = quota_bytes=42M >> >> driver = bdb_quota >> >> override_fields = quota_rule=*:bytes=%{userdb:quota_bytes} >> >> result_failure = return-fail >> >> result_internalfail = return-fail >> >> result_success = continue-ok >> >> } >> >> verbose_proctitle = yes >> >> protocol lda { >> >> auth_socket_path = /var/run/dovecot/auth-userdb >> >> mail_plugin_dir = /lib/dovecot/modules >> >> mail_plugins = " mail_log notify zlib quota sieve" >> >> } >> >> protocol imap { >> >> mail_plugins = " mail_log notify zlib quota imap_xauth last_login >> >> imap_quota" >> >> } >> >> protocol pop3 { >> >> mail_plugins = " mail_log notify zlib quota last_login" >> >> } >> >> >> >> Hi! >> >> We are looking into this crash. >> >> Are you intentionally setting inbox namespace location to empty? >> >> Aki >> > >

2 6

Doveadm backup doesn't interpret placeholders
by James Pharaoh 23 Jan '17

23 Jan '17

Hi, Dovecot version: 2.2.27 I'm using replication between two servers for high availability, but I also want to backup all users. I have a setting for the replication to work like this: plugin { mail_replica = tcp:other-dovecot } This is fine, but then I also want to do a backup to a different directory for all users, since I am having trouble with an apparent bug running dovecot on btrfs. For this reason, I am storing my emails on ext4, but want to sync them to the BTRFS filesystem I use for my server before doing a snapshot. My mails are stored in /var/mail/mailboxes, and the backup is in /var/mail/mailboxes-backup, the former being the ext4 mount and the latter being part of the btrfs filesystem which belongs to the container where all this runs. The problem is that dovecot seems to only have a single concept of the mail backup location, which is either a remote, as above, or a filesystem location. The logical answer seems to be to provide the backup location when performing the local copy for a snapshot, so I run: doveadm backup -A mdbox:/var/mail/mailboxes-backup/%d/accounts/%u However, this is not picking up the %d and %u placeholders and replacing them with the values, as it would if configured with the option above. The only workaround I can find is to run doveadm backup individually for every user, with the full expanded path for each one. Am I missing something, or would it make sense for doveadm backup to simply recognise and respect these placeholders when passed on the command line? I've tried all sorts of other things, including -o mail_replica, and putting stuff in the userdb, but I can't find any other way to do this. Thanks in advance, James

2 3

Mailbox alias plugin and INBOX. folders
by James White 23 Jan '17

23 Jan '17

Hi, I'm trying to workaround the lack of IMAP folder mapping settings on Windows 10 Mobile in regards to controlling the Sent, Trash etc folder my device uses. Currently, my device creates its own "Sent Items" folder "Deleted Items" folder along with others, this is pain when using clients like Thunderbird which places such them in the correct places, because it can be configured this way. While this is a Microsoft issue, its looking very unlikely they will add IMAP mapping control, as its been like this since Windows Phone 7. So I was looking for performing a workaround at the server level. I came across the Dovecot Mailbox alias plugin, which sounds like a decent workaround, to at least allow sent email messages from my Windows 10 mobile device to show up in the right place, I'm aware of the potential for double cache etc, but I have enough storage for it. http://wiki2.dovecot.org/Plugins/MailboxAlias What I'm having difficulty with, is expressing the mailbox_alias to an existing INBOX. folder. My email server uses the INBOX prefix setup, so my configured folders are: INBOX\INBOX.Sent INBOX\INBOX.Drafts INBOX\INBOX.Trash INBOX\INBOX.Spam Most examples seem to indicate doing at the root folder level i.e. Sent Items -> Sent not Sent Items -> INBOX\INBOX.Sent. Is it possible to use the alias plugin in this way? If so how would I express this using mailbox_alias_old, I tried INBOX/Sent, but this seems to send all items to a blackhole, as they can no longer be found in any folder. It does appear to work at the root folder level, but as my setup is using the older INBOX prefix, I don't want to do that. Any hints/tips would be appreciated! Thanks, James

2 2

Segfault on LIST Command
by Thorsten Hater 23 Jan '17

23 Jan '17

Dear all, I experience SegFaults in the imap binary on a LIST "" "" command, as sent by Claws mail. Using LIST "" "INBOX" or similar is fine. Here is an example telnet session $ telnet 127.0.0.1 143 Trying 127.0.0.1... Connected to 127.0.0.1. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. 01 LOGIN **** **** 01 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SPECIAL-USE QUOTA] Logged in 02 LIST "" "" Connection closed by foreign host. In the log file dovecot[8375]: imap(***): Fatal: master: service(imap): child 15803 killed with signal 11 (core dumps disabled) Please find the config below. Best regards, Thorsten $ doveconf -n # 2.2.26.0 (23d1de6): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (1dc4c73) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.6 auth_debug = yes auth_debug_passwords = yes auth_socket_path = /var/run/dovecot/auth-userdb auth_verbose = yes base_dir = /var/run/dovecot/ default_internal_user = pop first_valid_uid = 48 import_environment = TZ DEBUG=1 last_valid_uid = 48 login_trusted_networks = **** mail_debug = yes mail_gid = pop mail_plugins = " mail_log notify zlib quota" mail_uid = pop managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes list = children location = mailbox Drafts { auto = no special_use = \Drafts } mailbox Sent { auto = no special_use = \Sent } mailbox Trash { auto = no autoexpunge = 30 days special_use = \Trash } mailbox drafts { auto = no special_use = \Drafts } mailbox sent { auto = no special_use = \Sent } mailbox spamverdacht { auto = no autoexpunge = 30 days special_use = \Junk } mailbox trash { auto = no autoexpunge = 30 days special_use = \Trash } mailbox virenverdacht { auto = no autoexpunge = 30 days special_use = \Junk } prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = nopassword=y driver = static } plugin { last_login_dict = file:~/lastlogin mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = maildir:User quota quota_warning = storage=80%% 80 %u %{userdb:quota_bytes} quota_warning2 = storage=90%% 90 %u %{userdb:quota_bytes} quota_warning3 = storage=95%% 95 %u %{userdb:quota_bytes} sieve = ldap:/etc/dovecot/pigeonhole-ldap.conf sieve_dir = ~/sieve sieve_plugins = sieve_storage_ldap zlib_save = gz zlib_save_level = 6 } service imap { executable = imap postlogin } service pop3 { executable = pop3 postlogin } service postlogin { executable = script-login -d rawlog } service quota-warning { executable = script /bin/quota-warning.sh } ssl = no userdb { args = /etc/dovecot/userdb-ldap.conf driver = ldap result_failure = return-fail result_internalfail = return-fail result_success = continue-ok } userdb { default_fields = quota_bytes=42M driver = bdb_quota override_fields = quota_rule=*:bytes=%{userdb:quota_bytes} result_failure = return-fail result_internalfail = return-fail result_success = continue-ok } verbose_proctitle = yes protocol lda { auth_socket_path = /var/run/dovecot/auth-userdb mail_plugin_dir = /lib/dovecot/modules mail_plugins = " mail_log notify zlib quota sieve" } protocol imap { mail_plugins = " mail_log notify zlib quota imap_xauth last_login imap_quota" } protocol pop3 { mail_plugins = " mail_log notify zlib quota last_login" }

2 2

mail-trends+Dovecot
by Odhiambo Washington 22 Jan '17

22 Jan '17

Hi, Out of curiosity, has anyone managed to use mail-trends[0] to analyse their e-mails. I thought about trying it out, but got stuck midstream. The mail-trends scripts work very well with gmail, but because they say it is supposed to work with _any_ IMAP server, I thought I could get it running with Dovecot too. I know this is NOT a mail-trends support group though, but I believe there is something minor that I am missing, which Dovecot admins could figure out. My idea was to see what comes out of my e-mails stored either in Maildir or mdbox. In my test env, I have mail_location = maildir:/var/spool/virtual/%d/%n/Maildir:INDEX=MEMORY I am testing with a virtual account, whose e-mails are in Maildir/ - some 30,000 mails. The gotcha is that I cannot figure out exactly what to specify in mail.py (for mail-trends [0]) for this situation. There is another modified version of mail-trends[1] which is supposed to be a lot easier than the original one, but this too doesn't seem to work in my setup: 1. My doveconf output -> http://bit.ly/2k11iKb 2. Accounts are virtual, so I have a user - johndoe(a)dom.ain who MUST login as johndoe(a)dom.ain with a password. 3. His mailbox is in /var/spool/virtual/dom.ain/johndoe/Maildir/ So I try this - using the mail-trends code from [1] root@gw:/scripts/mail-trends # ./main.py --server=localhost --username=johndoe(a)dom.ain --password=1234 --use_ssl [2017-01-21 22:24:08,552] Initializing {'username': 'johndoe(a)dom.ain', 'use_ssl': '', 'password': '1234', 'server': 'localhost'} [2017-01-21 22:24:08,552] Connecting [2017-01-21 22:24:08,747] Logging in [2017-01-21 22:24:08,752] Getting mailboxes *[2017-01-21 22:24:08,753] Found INBOX.spam *<-- Where it is getting this from beats me! *[2017-01-21 22:24:08,753] Found INBOX* Traceback (most recent call last): File "./main.py", line 304, in <module> message_infos = GetMessageInfos(opts) File "./main.py", line 104, in GetMessageInfos for mailbox in m.GetMailboxes(): File "/scripts/mail-trends/mail.py", line 61, in GetMailboxes mailboxes.remove('[Gmail]') ValueError: list.remove(x): x not in list root@gw:/scripts/mail-trends # root@gw:/scripts/mail-trends # *ls -al /var/spool/virtual/dom.ain/johndoe/Maildir/* total 3256 drwx------ 5 mailnull mailnull 512 Jan 22 00:04 . drwx------ 3 mailnull mailnull 512 Jan 21 18:48 .. drwx------ 2 mailnull mailnull 1084416 Jan 22 00:04 cur -rw------- 1 mailnull mailnull 1074769 Jan 21 18:52 dovecot-uidlist -rw------- 1 mailnull mailnull 8 Jan 21 18:32 dovecot-uidvalidity -r--r--r-- 1 mailnull mailnull 0 Jan 21 18:32 dovecot-uidvalidity.58837ef3 drwx------ 2 mailnull mailnull 1084416 Jan 21 18:47 new -rw-r--r-- 1 mailnull mailnull 0 Jan 21 18:30 subscriptions drwx------ 2 mailnull mailnull 512 Jan 21 17:44 tmp If anyone is able to hack this with Dovecot, please share the details. [0] http://code.google.com/p/mail-trends/ [1] https://github.com/jpbarraca/mail-trends -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft."

2 2

Relative home path not allowed - but how is this relative?
by Roger Klorese 22 Jan '17

22 Jan '17

I just set up my server with MySQL support for authentication/authorization compatible with Postfix Admin. Initially, I was getting the "Relative home directory paths not supported" message, and it's easy to see why - Postfix Admin stores the maildir as "$domain/$userpart@$domain". But the directories in 10-mail.conf are set as mail_location = maildir:/home/mailboxes/%d/%u mail_home = maildir:/home/mailboxes/%d/%u ...and the user_query has been revised to: user_query = SELECT concat('/home/mailboxes/', maildir) as full_maildir FROM mailbox WHERE username = '%u'; ...so how are any of these relative paths?

1 1

Re: Mailbox problem on centos O/S after some "fiddling"
by Joseph Tam 21 Jan '17

21 Jan '17

> I do not understand why dovecot creates this folder as we ONLY ever use pop3 > (currently with plain text auth but going to secure when this sorted) > for mail and also why when it writes the blank folder it "owns" it with the > user accessing it (also the /var/mail/new folder takes the same owner) I think maybe those mailboxes were created because you've mapped all user home directories to the same folder (/var/mail), and thus, the first user to log in created files that subsequent users could not access. > mail_location = mbox:/var/mail/:INBOX=/var/mail/%u See this for the POP3 scenario you want: http://wiki.dovecot.org/MailLocation/mbox (Section: Only /var/mail mboxes) Don't need these > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } Joseph Tam <jtam.home(a)gmail.com>

1 0

Deleting a mailbox recursively
by Malte Schmidt 20 Jan '17

20 Jan '17

This topic was already discussed on this mailinglist: https://www.dovecot.org/list/dovecot/2011-November/079491.html I am also looking for a nice and convenient way of recursively deleting a mailbox which uses the mdbox-Format. Since then - was there any progress?

3 4

Replication between three servers
by James Pharaoh 19 Jan '17

19 Jan '17

Hi, Dovecot version: 2.2.27 I'm a little unsure if I have set up my replication correctly, and also how to set up replication on three servers, if this is possible. My replication works, with exactly the same configuration on both servers, except that the mail_replica contains the other server name in each case, of course. This seems to work fine. As I understand it, both need to be set up as a client and a server, since I have mail arriving on both. Is this a correct and supported configuration? I believe then I should be able to get three-way replication working, by pointing the three servers at each other in a circle. I am hoping this will cause a mail arriving at server 1 to be sent to server 2, which will then send it to server 3. Server 3 will attempt to send it back to server 1 which will already have it, and so this will terminate the loop. This is obviously going to create a bit of extra load, but I don't want to try it without some advice, and I'm not sure if the replication will be triggered properly by an email which is itself arriving via replication. Reading the description of the components, I think it should, since the aggregator service shouldn't care how an email has arrived, since it is simply reading the log, right? If a server fails, or needs to be taken out manually, I'll obviously need to reconfigure the loop, essentially taking it back to a standard two-server configuration. Similarly, I should be able to add a fourth server, and so on, if I wanted. I'm planning to distribute incoming emails over all servers, so that these will arrive and be stored on a working server during an outage without any reconfiguration, and to use something like nginx as a proxy to send each user to a specific server, to distribute the client load. Thanks in advance, James

1 0

Remove empty milder folders
by ＠lbutlr 18 Jan '17

18 Jan '17

Not sure if anyone will find this useful, but this is how I deleted a bunch (several hundred) of empty mail folders from a user account: # doveadm mailbox status -u “user(a)example.com" messages "*" ALL | grep "=0" | awk -F= '{print $1}' | awk '{print "rm -rf ."$1}' > list then I looked over list just to be sure it wasn’t mucked up and in the users root maildir: # sh < list and done. I probably could do some research on how to combine those two awk pipes but this worked, and it was fast. -- Apple broke AppleScripting signatures in Mail.app, so no random signatures.

2 2

Dynamic autoexpunge for IMAP folders
by Thorsten Hater 18 Jan '17

18 Jan '17

Dear all, is there a way to allow users to set up something like autoexpunge on an individual IMAP folder basis? The idea I implemented does not seem to work, namely returning namespace/inbox/mailbox/Bla/autoexpunge=6h from a userdb, which results in Debug: Unknown userdb setting: plugin/namespace/inbox/mailbox/Bla/autoexpunge=6h >From older questions on the mailing list I gather that the mailbox Bla needs to be set up in the config before I can override its fields. If there is a way around this, I would gladly use this. Another solution that comes to mind would be to use a table-driven cron job, but I would prefer the cleanup to be triggered at delivering and/or moving mail. Best regards, Thorsten

3 8

Plugin "mail_crypt" does not work
by Evgeniy Korneechev 18 Jan '17

18 Jan '17

Hi, i have a problem. I sent test e-mail. It is in folder "Sent", but it was not delivered (folder "Inbox" is empty). /var/log/dovecot: ......... lda(mail(a)example.com): Error: User initialization failed: mail_crypt_plugin: mail_crypt_global_public_key: Couldn't parse public key: Unknown key format ......... Try RSA and EC: https://wiki2.dovecot.org/Plugins/MailCrypt#RSA_key https://wiki2.dovecot.org/Plugins/MailCrypt#EC_key Why "Unknown key format"? RSA pubkey: -----BEGIN PUBLIC KEY----- MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQC4hfgRDlMJtN9rcV2VGa8gOF1g xiXHwokRkKmKfr64ZbqAhXzLzP8fSLo8ZEtRzfS3f/EyLRvYL9LHxlxYuSnq2LTW lbvSj8jcg3ucpA431Pbnq/OVI8WsXhXhZdipGcBDyzWHZw5Dp3I/am+FB96VlfPW maHO/oKGphXXhXSOXwIDAQAB -----END PUBLIC KEY----- EC pubkey: -----BEGIN PUBLIC KEY----- MFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAEw96p6hvv/BJi9njHyXq05ZrKA3RR BNFOslljkgv6YUb4de1pln6hTUN69CjMBEB5P3YI7KP8hooozwM8iN/wLQ== -----END PUBLIC KEY----- ------------------------------------------------ # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.4.39-std-def-alt0.M80P.1 x86_64 ALT 8.1 Server auth_debug = yes auth_debug_passwords = yes auth_default_realm = example.com auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb auth_verbose = yes auth_verbose_passwords = plain base_dir = /var/run/dovecot/ debug_log_path = /var/log/dovecot disable_plaintext_auth = no first_valid_gid = 502 first_valid_uid = 502 last_valid_gid = 502 last_valid_uid = 502 log_path = /var/log/dovecot login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_access_groups = vmail mail_debug = yes mail_gid = 502 mail_location = maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/ mail_plugins = mail_crypt mail_privileged_group = vmail mail_uid = 502 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapflags notify mbox_write_locks = fcntl namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { inbox = yes location = prefix = separator = / type = private } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_crypt_curve = prime256v1 mail_crypt_global_private_key = </etc/dovecot/eckey/ecprivkey.pem mail_crypt_global_public_key = </etc/dovecot/eckey/ecpubkey.pem mail_crypt_save_version = 2 recipient_delimiter = + sieve = /etc/dovecot/sieves/default.sieve sieve_default = /etc/dovecot/sieves/default.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_max_redirects = 8 } protocols = imap pop3 lmtp sieve service auth-worker { user = root } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } } service imap { process_limit = 1024 vsz_limit = 256 M } service lmtp { unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } vsz_limit = 64 M } service pop3-login { inet_listener pop3 { port = 110 } } service pop3 { process_limit = 1024 } ssl_ca = /var/lib/ssl/cert.pem ssl_cert = </etc/dovecot/dovecot.pem ssl_key = # hidden, use -P to show it userdb { driver = passwd } userdb { args = /etc/dovecot/dovecot-ldap-user.conf.ext driver = ldap } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = mail_crypt sieve } protocol lda { mail_plugins = mail_crypt sieve quota plugin { quota = dict:user::file:/var/vmail/glu_vrem/%n/.quotausage } } protocol imap { mail_plugins = mail_crypt autocreate quota imap_quota plugin { autocreate = INBOX autocreate2 = Sent autocreate3 = Trash autocreate4 = Drafts autocreate5 = Junk autosubscribe = INBOX autosubscribe2 = Sent autosubscribe3 = Trash autosubscribe4 = Drafts autosubscribe5 = Junk quota = dict:user::file:/var/vmail/glu_vrem/%n/.quotausage } } protocol sieve { mail_max_userip_connections = 10 managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } -- WBR, BaseALT/ALTLinux Team

2 6

Reappearing emails
by Ron Cleven 17 Jan '17

17 Jan '17

We have been running Dovecot 2.2.10 with a pair of CentOS 7 boxes with replications for the past year. We have been quite happy with the performance and reliability. Recently we received a report from an Android IMAP user that emails that he deleted without reading would often reappear in his INBOX. At first I thought it might be some quirky incompatibility with his email client, but I found that I could easily reproduce it in Roundcube by dragging an unread email to Trash. I have been monitoring this forum fairly religiously and don't recall seeing any similar reports. I plan to capture the IMAP wire interactions, but before doing that, I thought I would submit this to the IMAP gods to see if anyone had heard of this and/or if there is some newer version that might resolve the problem. This particular customer contacted his email vendor and asked them to analyze the problem. The actual log data is gigantic, so I just pasted in the vendor's narrative below in case it helps. Otherwise, as I said, I will capture a similar interaction at the wire level and follow up here. Vendor's narrative: You had 8 messages in the Inbox, and moved two to Trash. The server notified the app on the push connection (for Inbox) that there are now 6 messages. By the time the app got around to catch up with that (it did the Trash folder first), the server said "oh wait, there are 8 messages, not 6" (in the Inbox), and so the app synced them in, just as reported. app selecting the Inbox, server saying there are 8 messages there app moving UID 729 and 730 to Trash (push) server saying Trash now has 34 messages (push) server saying two messages gone from Inbox, 6 left (push) 6 messages left in Inbox becoming 8 (push) and here they are (the two new ones) Thanks, Ron

3 3

Mail rescue from Dovecot Server
by Joakim Magnussen - MediaLabs AS 17 Jan '17

17 Jan '17

Hi all, I have a mail folder from Dovecot server. Screenshot: https://i.stack.imgur.com/11NHs.jpg Is there any way to import to Outlook, or otherwise convert to readable format? I could setup Dovecot on my own server if there is any point.

2 1

Correct settings for ssl protocols" and "ssl ciphers"
by Jerry 17 Jan '17

17 Jan '17

I have the following two settings in my "10-ssl.conf" file # SSL protocols to use ssl_protocols = !SSLv2 # SSL ciphers to use ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL I have seen different configurations while Googling. I am wondering what the consensus is for the best settings for these two items. What do the developers recommend? Thanks! -- Jerry

4 3

fts-solr: Returning 400 on searches; unescaped braces
by Michael Welsh Duggan 17 Jan '17

17 Jan '17

Using Debian, dovecot-solr 1:2.2.26.0-4, and solr-tomcat 3.6.2+dfsg-9, I am getting 400 errors when doing searches. Here is an example search query from dovecot that failed (captured with wireshark): Frame 23: 338 bytes on wire (2704 bits), 338 bytes captured (2704 bits) on interface 0 Linux cooked capture Internet Protocol Version 6, Src: ::1, Dst: ::1 Transmission Control Protocol, Src Port: 56860, Dst Port: 8080, Seq: 1, Ack: 1, Len: 250 Hypertext Transfer Protocol GET /solr/select?fl=uid,score&rows=2664&sort=uid+asc&q={!lucene+q.op%3dAND}(hdr:test+OR+body:test)&fq=%2Bbox:6d5de009f991854df726000012cf7b9c+%2Buser:md5i HTTP/1.1\r\n Host: localhost:8080\r\n Date: Mon, 19 Dec 2016 00:25:56 GMT\r\n Connection: Keep-Alive\r\n \r\n [Full request URI: http://localhost:8080/solr/select?fl=uid,score&rows=2664&sort=uid+asc&q={!l…] [HTTP request 1/1] [Response in frame: 25] Here is the same query from firefox, which succeeds: Frame 66: 646 bytes on wire (5168 bits), 646 bytes captured (5168 bits) on interface 0 Linux cooked capture Internet Protocol Version 6, Src: ::1, Dst: ::1 Transmission Control Protocol, Src Port: 56862, Dst Port: 8080, Seq: 1, Ack: 1, Len: 558 Hypertext Transfer Protocol GET /solr/select?fl=uid,score&rows=2664&sort=uid+asc&q=%7B!lucene+q.op%3DAND%7D(hdr:test+OR+body:test)&fq=%2Bbox:6d5de009f991854df726000012cf7b9c+%2Buser:md5i HTTP/1.1\r\n Host: localhost:8080\r\n Connection: keep-alive\r\n Cache-Control: max-age=0\r\n Upgrade-Insecure-Requests: 1\r\n User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.75 Safari/537.36\r\n Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8\r\n DNT: 1\r\n Accept-Encoding: gzip, deflate, sdch, br\r\n Accept-Language: en-US,en;q=0.8\r\n \r\n [Full request URI: http://localhost:8080/solr/select?fl=uid,score&rows=2664&sort=uid+asc&q=%7B…] [HTTP request 1/1] [Response in frame: 86] The salient difference seems to be the encoding of the braces. Indeed in the tomcat 8 logs, I find the following which seems to corroborate my hypothesis: java.lang.IllegalArgumentException: Invalid character found in the request target. The valid characters are defined in RFC 7230 and RFC 3986 at org.apache.coyote.http11.Http11InputBuffer.parseRequestLine(Http11InputBuffer.java:467) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:667) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:789) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1437) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Indeed the braces are listed in fts-backend-solr.c as part of solr_escape_chars, so don't know how the braces are making it through unencoded. -- Michael Welsh Duggan (md5i(a)md5i.com)

2 3

Dovecot source code audit
by Timo Sirainen 17 Jan '17

17 Jan '17

Mozilla sponsored source code audit for Dovecot. So thanks to them we have our first public code audit: https://wiki.mozilla.org/MOSS/Secure_Open_Source/Completed#dovecot Dates: October 2016 - January 2017 dovecot is a POP and IMAP mailserver; it is used in 68% of IMAP server deployments worldwide. The audit was performed by Cure53. The team found the following problems: • 3 Low The Cure53 team were extremely impressed with the quality of the dovecot code. They wrote: "Despite much effort and thoroughly all-encompassing approach, the Cure53 testers only managed to assert the excellent security-standing of Dovecot. More specifically, only three minor security issues have been found in the codebase, thus translating to an exceptionally good outcome for Dovecot, and a true testament to the fact that keeping security promises is at the core of the Dovecot development and operations."

9 9

Re: Remove empty milder folders
by Joseph Tam 17 Jan '17

17 Jan '17

@lbutlr <kremels(a)kreme.com> writes: > Not sure if anyone will find this useful, but this is how I deleted a > bunch (several hundred) of empty mail folders from a user account: > > # doveadm mailbox status -u ?user(a)example.com" messages "*" ALL | grep "=0" | awk -F= '{print $1}' | awk '{print "rm -rf ."$1}' > list > ... > I probably could do some research on how to combine those two awk pipes > but this worked, and it was fast. You can collapse all 3 downstream processes doveadm ... | awk '/messages=0$/{print "rm -rf ./" substr($1,9}' >list Needs shell escaping/sanitizing if you don't want to be the victim of mischief (e.g. maildir='X;cd ..;rm -rf *'). Joseph Tam <jtam.home(a)gmail.com>

1 0

Sieve: fileinto :create issue with Public Folder
by dovecot＠avv.solutions 16 Jan '17

16 Jan '17

Hello Community, I face the following issue: - using a sieve script to file into a existing private folder: ok - using a sieve script to file into new private folder using ":create": ok - using a sieve script to file into a existing public folder: ok - using a sieve script to file into new public folder using ":create": NOK ! The returned message is: "Permission denied" and the message correctly falls back to inbox. HOWEVER, if I run "doveadm mailbox create -u myuser@mydomain Public/TheNewFolder", the folder is created, and the delete command works as well. Any tip? Running dovecot 2.2.13 on a pi/debian jessie Thanks

2 1

Replication: Can't unsubscribe from shared mailbox
by Karsten Heiken 16 Jan '17

16 Jan '17

Hi, I am running two dovecot servers active/active. Everything runs pretty great, except for the replication of subscriptions in a shared namespace. When I unsubscribe from a folder the subscription instantly re-appears. The timestamp on the subscriptions file is updated, but the entry is still in there. If the other node is shut down, everything works as expected, which leads me to believe that the subscription is re-applied upon a replicator-run. I attached a tcpdump of a dsync run. The only action that was executed was to unsubscribe from the folder shared/weinrot(a)luis.uni-hannover.de/INBOX. Is there any other way I might help debugging this? Thanks, Karsten # 2.2.24 (a82c823): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 2.6.32-44-pve x86_64 Debian 8.5 default_vsz_limit = 512 M dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } imap_max_line_length = 2 M lmtp_rcpt_check_quota = yes mail_attribute_dict = file:%h/Maildir/dovecot-attributes mail_gid = 7777 mail_location = maildir:%h/Maildir:LAYOUT=fs:DIRNAME=maiLdir mail_plugins = " zlib quota acl notify replication " mail_shared_explicit_inbox = yes mail_uid = 7777 mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapflags notify namespace { hidden = no ignore_on_failure = no inbox = no list = children location = maildir:%%h/Maildir:INDEXPVT=%h/shared/%%u:LAYOUT=fs:DIRNAME=maiLdir prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox 30dTrash { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = proxy::acl mail_replica = tcp:10.6.1.10:24245 quota = maildir:Postfach-Limit quota_grace = 2%% quota_rule = *:storage=8G quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_max_actions = 250 sieve_max_redirects = 200 zlib_save = gz zlib_save_level = 6 } protocols = " imap lmtp sieve pop3 sieve" replication_dsync_parameters = -d -l 300 -U -N service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth { unix_listener auth-userdb { group = vmail user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service doveadm { inet_listener { port = 24245 } } service imap-login { process_min_avail = 16 service_count = 0 } service imap { executable = imap postlogin process_limit = 30000 } service lmtp { inet_listener lmtp { port = 24 } vsz_limit = 1 G } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { process_limit = 1024 } service pop3-login { process_min_avail = 4 service_count = 0 } service pop3 { process_limit = 2500 } service postlogin { executable = script-login -d rawlog /usr/local/bin/dovecot-postlogin.sh } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = vmail } } shutdown_clients = no ssl_cert = </etc/dovecot/private/fullchain.pem ssl_key = </etc/dovecot/private/privkey.pem syslog_facility = local6 userdb { args = /etc/dovecot/dovecot-ldap.conf.ext default_fields = home=/var/vmail/%Ld/%Ln quota_rule=*:bytes=8589934592 driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = " zlib quota acl notify replication sieve quota" } protocol lda { mail_plugins = " zlib quota acl notify replication sieve" } protocol imap { imap_metadata = yes mail_max_userip_connections = 100 mail_plugins = " zlib quota acl notify replication imap_quota imap_acl" } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = " zlib quota acl notify replication" }

2 2

Panic: file istream-zlib.c: ...assertion failed: (ret == -1) / core dump on signal 6 / zlib
by C. Bernard 15 Jan '17

15 Jan '17

Hello! I have several gzip'ed mbox Files in my home dir and the problem occurs when I use one of the gzip'ed files as shown mbox in the gui and want to see one mail of it. It also happens on the extended search from Horde which then such a gzip'ed file. Example file: # file In_2014.gz In_2014.gz: gzip compressed data, was "In_2014", last modified: Wed Dec 2 10:53:22 2015, from Unix This happens with any gz Files. That's why I tried to sort out any problem else before submitting this. Directly connecting to dovecot imap (circumvention imapproxy) shows the same error. This setup was in place for 4 years with another server: It did not occur with dovecot 2.2.25 an up-imapproxy1.2.7 (Horde 5.2.12/imp5.2.16) on FreeBsd9.3-p55 (my old server). (I did not update to 2.2.27 on the last server as the maintainer just removed the ssl option from config I...and I knew I would update anyway soon,so I have no test of 2.2.27 with the old setup) The actual setup as follows: System is 10.3-RELEASE-p15 on amd64 Horde ist 5.2.13 / imp 6.2.17 / php-horde_lz4-1.0.7_1 (which is I guess unused here) Lz4 is liblz4-131 FS is UFS connection: Horde webmail -> 1143:imapproxyd:143 -> dovceot imap (or directly -> same) Jan 15 08:40:58 server dovecot: imap(xxx): Panic: file istream-zlib.c: line 416 (i_stream_zlib_seek): assertion failed: (ret == -1) Jan 15 08:40:59 server kernel: pid 73887 (imap), uid 1000: exited on signal 6 (core dumped) Jan 15 08:40:59 server dovecot: imap(xxx): Fatal: master: service(imap): child 73887 killed with signal 6 (core dumped) Jan 15 08:40:59 server HORDE: [imp] [fetch] IMAP error reported by server. [pid 69574 on line 730 of "/usr/local/www/htdocs/m/imp/lib/Imap.php"] Jan 15 08:40:59 server HORDE: [imp] [status] IMAP error reported by server. [pid 69574 on line 730 of "/usr/local/www/htdocs/m/imp/lib/Imap.php"] and Jan 15 08:40:56 server in.imapproxyd[912]: LOGOUT: 'xxx' from server sd [12] Jan 15 08:40:58 server in.imapproxyd[912]: LOGIN: 'xxx' (127.0.0.1:33269) on existing sd [12] Jan 15 08:40:59 server in.imapproxyd[912]: Get_Server_conn(): Unable to reuse server sd [12] for user 'xxx' (127.0.0.1:50504). Connection closed by server. # dovecot -n # 2.2.27 (c0f36b0): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.3-RELEASE-p11 amd64 auth_mechanisms = plain login disable_plaintext_auth = no first_valid_gid = 100 first_valid_uid = 1000 mail_location = mbox:~/:INBOX=/var/mail/%u mail_plugins = " zlib" mail_privileged_group = mail passdb { args = session=yes dovecot driver = pam } protocols = imap pop3 service auth { unix_listener auth-client { mode = 0660 } unix_listener auth-master { mode = 0600 } user = root } service imap { drop_priv_before_exec = yes } ssl = no userdb { args = blocking=yes driver = passwd } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { sendmail_path = /usr/sbin/sendmail } (gdb) bt full #0 0x000000001115c39a in thr_kill () from /lib/libc.so.7 #1 0x000000001115c386 in raise () from /lib/libc.so.7 #2 0x000000001115c309 in abort () from /lib/libc.so.7 #3 0x0000000010e1c9b4 in default_fatal_handler () from /usr/local/lib/dovecot/libdovecot.so.0 #4 0x0000000010e1d6e1 in i_set_failure_internal () from /usr/local/lib/dovecot/libdovecot.so.0 #5 0x0000000010e1cc59 in i_panic () from /usr/local/lib/dovecot/libdovecot.so.0 #6 0x000000001144ffae in i_stream_create_deflate () from /usr/local/lib/dovecot/lib20_zlib_plugin.so #7 0x0000000010e28051 in i_stream_seek_mark () from /usr/local/lib/dovecot/libdovecot.so.0 #8 0x0000000010ad7f15 in istream_raw_mbox_seek () from /usr/local/lib/dovecot/libdovecot-storage.so.0 #9 0x0000000010ad864d in mbox_file_seek () from /usr/local/lib/dovecot/libdovecot-storage.so.0 #10 0x0000000010ada7ad in mbox_dotlock_touch () from /usr/local/lib/dovecot/libdovecot-storage.so.0 #11 0x0000000010ada367 in mbox_dotlock_touch () from /usr/local/lib/dovecot/libdovecot-storage.so.0 #12 0x0000000010a9d365 in mail_get_hdr_stream_because () from /usr/local/lib/dovecot/libdovecot-storage.so.0 #13 0x0000000010b0cbe5 in index_mail_parse_headers () from /usr/local/lib/dovecot/libdovecot-storage.so.0 #14 0x0000000010b0f9d9 in index_mail_get_special () from /usr/local/lib/dovecot/libdovecot-storage.so.0 #15 0x0000000010b0f7b9 in index_mail_get_special () from /usr/local/lib/dovecot/libdovecot-storage.so.0 #16 0x0000000010a9d49f in mail_get_special () from /usr/local/lib/dovecot/libdovecot-storage.so.0 #17 0x000000000041cf1d in imap_fetch_handlers_deinit () #18 0x000000000041c561 in imap_fetch_more () #19 0x000000000041c1f8 in imap_fetch_more () #20 0x000000000040ff4e in cmd_fetch () #21 0x000000000041a4e6 in command_exec () #22 0x0000000000419573 in clients_destroy_all () #23 0x000000000041974f in clients_destroy_all () #24 0x0000000000418d9e in client_handle_input () #25 0x000000000041786c in client_input () #26 0x0000000010e31619 in io_loop_call_io () from /usr/local/lib/dovecot/libdovecot.so.0 #27 0x0000000010e3338d in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 #28 0x0000000010e31b33 in io_loop_handler_run () from /usr/local/lib/dovecot/libdovecot.so.0 #29 0x0000000010e31908 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 #30 0x0000000010dbca08 in master_service_run () from /usr/local/lib/dovecot/libdovecot.so.0 #31 0x00000000004253f4 in main () Thanks C.

1 0

TLS feature missing
by Tributh 13 Jan '17

13 Jan '17

Hi, i was using dovecot 2.2.25 compiled with opnessl 1.0.2 I realised with a cipherscan utility that i was able to support mulitiple TLS curves. Now i upgraded to 2.2.27 with opnessl1.1.0 and was falling back to historical stages where my server only servers one TLS-curve: secp384r1 right now. One big reason to compile the new ersion with openssl1.1.0 was to bring CHACHA20-POLY1305 ciphers and X25519 curves to modern clients. The ciphers i am estimating are working fine, but X25519 and also secp521r1 ist now longer supported, like it was in dovecot 2.2.25. Is there something broken? Or a new (know missing) config feature? Or is it a bug ? Regards Torsten

1 0

Re: doveadm mailbox cryptokey - not found
by Evgeniy Korneechev 12 Jan '17

12 Jan '17

> > You forgot to load mail_crypt plugin. > > mail_plugins = $mail_plugins mail_crypt > With these settings also. # dovecot -n ..... mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_plugins = " mail_crypt" mbox_write_locks = fcntl ..... # service dovecot restart # doveadm mailbox cryptokey usage: doveadm [-Dv] [-f ......... # ls /usr/lib64/dovecot/modules/* | grep mail_crypt /usr/lib64/dovecot/modules/lib05_mail_crypt_acl_plugin.so /usr/lib64/dovecot/modules/lib10_mail_crypt_plugin.so /usr/lib64/dovecot/modules/libfs_mail_crypt.so /usr/lib64/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so -- WBR, BaseALT/ALTLinux Team

1 1

doveadm mailbox cryptokey - not found
by Evgeniy Korneechev 12 Jan '17

12 Jan '17

Hi, we have a problem. Command "doveadm mailbox cryptokey" does not work: # doveadm mailbox cryptokey usage: doveadm [-Dv] [-f <formatter>] mailbox <command> [<args>] create [-u <user>|-A] [-S <socket_path>] [-s] [-g <guid>] <mailbox> [...] delete [-u <user>|-A] [-S <socket_path>] [-e] [-r] [-s] [-Z] <mailbox> [...] ...... What is the problem? ------------------------------------------------ Install: http://wiki2.dovecot.org/CompilingSource#Compiling_Dovecot_From_Sources : ./configure && make && sudo make install # dovecot -n # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # OS: Linux 4.4.38-std-def-alt0.M80P.1 x86_64 ALT starter kit (Hypericum) mail_location = mbox:~/mail:INBOX=/var/mail/%u mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } ssl = required ssl_cert = </var/lib/ssl/certs/dovecot.pem ssl_key = # hidden, use -P to show it userdb { driver = passwd } -- WBR, BaseALT/ALTLinux Team

3 2

Unable to access apt.dovecot.fi
by Alexandre Ellert 12 Jan '17

12 Jan '17

Hi, I bought a Dovecot Enterprise repository acces in 2013 and since several months, I can't access it anymore. It seem that my credential are broken. When doing an apt-get update : W: Failed to fetch http://apt.dovecot.fi/3rdparty/debian/wheezy/dists/wheezy/main/binary-amd64… 401 Unauthorized W: Failed to fetch http://apt.dovecot.fi/stable-2.2/debian/wheezy/dists/wheezy/main/binary-amd… 401 Unauthorized And here is my sources.list : # cat /etc/apt/sources.list.d/dovecot.list deb http://USER:PASSWORD@apt.dovecot.fi/stable-2.2/debian/wheezy wheezy main # cat /etc/apt/sources.list.d/dovecot-3rdparty.list deb http://USER:PASSWORD@apt.dovecot.fi/3rdparty/debian/wheezy wheezy main Thank you for help. Alexandre

2 1

Broken OS after upgrade
by Odhiambo Washington 11 Jan '17

11 Jan '17

Hi, I have broken my OS (FreeBSD) after upgrade, making me unable to compile dovecot the usual way so I am seeking a 3rd eye. The config.log is at : http://bit.ly/2jE5djl Hoping someone can help me figure out what is broken. During configure, it fails with: checking for special C compiler options needed for large files... no checking for _FILE_OFFSET_BITS value needed for large files... unknown checking for _LARGE_FILES value needed for large files... unknown checking for _Bool... yes checking for uoff_t... no checking type of off_t... unknown configure: error: Unsupported off_t type -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft."

2 2

multiple shared/mail format namespaces
by Michal Soltys 11 Jan '17

11 Jan '17

Hi, Are configurations (with separate formats per namespace) - such as ... namespace { type = shared list = children inbox = no separator = / subscriptions = no prefix = shared1/%%n/ location = maildir:/var/mail1/%%n/ } namespace { type = shared list = children inbox = no separator = / subscriptions = no prefix = shared2/%%n/ location = mdbox:/var/mail2/%%n/ } With separate userdbs serving part of the users with maildirs in /var/mail1/ and the other part with mdboxes in /var/mail2 ... valid in dovecot ? To be more precise: 1) Is current version dovecot expected to work with configuration as above ? E.g. if some user's mail location returned from userdb doesn't match location/format from one of the above namespaces - would it be ignored for it ? A very old version of dovecot I could check quickly (2.1.7) was segfaulting (imap processes) all the time with this kind of config. While I'll be upgrading it and the whole system to modern versions, I'm wondering if this kind of thing is formally allowed at all. An interesting variation of the above setup I tested - with the second namespace "un-variabled" and pointing to single user (with matching passwd-file returning that user) managed to work somehow - but the user itself was still created on the fly for the 1st namespace - having just a directory with empty dovecot-acl-list file. This essentially seemed to have worked like a typical public profile (shared acl db didn't seem to be used either) 2) For shared namespace with variables, would overriding shared namespace location in userdb query work ? For example if we had single namespace such as the first one (maildir) above with explicit share1 name, and then in userdb for some users: userdb_namespace/share1/location=mdbox:/var/mail2/some_user_name Would that override a shared namespace pattern on per user basis correctly ? 3) Is there perhaps a way to constraint which userdbs are considered per which shared namespace ? 4) Not strictly related to the above, but in LDAP part of documentation - namely http://wiki2.dovecot.org/AuthDatabase/LDAP/Userdb - why user_attrs = \ =home=%{ldap:homeDirectory}, \ =uid=%{ldap:uidNumber}, \ =gid=%{ldap:gidNumber} instead of user_attrs = \ homeDirectory=home, \ uidNumber=uid, \ gidNumber=gid Do both are equivalent with differet syntax (opening the way for templates for %{} based syntax), or are there some subtle differences between those ? (aside later example with 'attr=' instead of just '='). Would this kind of syntax also be correct for pass_attrs, such as: pass_attrs = \ =password=%{ldap:uid}, \ =userdb_home=%{ldap:homeDirectory}

3 6

Ban dots in folder names
by Marek Grondecki 11 Jan '17

11 Jan '17

Hello Dovecot Community, I am using Dovecot 2.2.13-12~deb8u1 (Debian Jessie). separator = / listescape plugin is NOT active LAYOUT=fs is NOT active I would like to prohibit/ban the creation of folders with dot "." in the names - so creation of a folder "foo.bar" should NOT be possible. Currently, when I create "foo.bar" in Outlook 2013 it will be created but won't be synchronised with the mail server - Outlook shows it as "foo.bar (Only this computer)". Ideally the user should receive an error message informing that "the folder foo.bar could not be created." Thank you for your help. Regards, Marek Grondecki

2 1

pigeonhole + spamprobe
by Mark Constable 11 Jan '17

11 Jan '17

Would anyone have an example of how to use dovecot-pigeonhole to call spamprobe as an external program in the current 2.2.25?

1 0

Dovecot and MariaDB/MySQL
by Michael A. Peters 11 Jan '17

11 Jan '17

Howdy - For most of my dovecot servers, they are small and I just use unix accounts. However I am going to be running a new server for more general users, webmail (probably roundcube but I'm hacking roundcube quite a bit, enough that I'm calling it squarepeg instead so users familiar with roundcube will know it is quite different) and it will use MariaDB for account management. I already have it working, following the instructions at https://www.linode.com/docs/email/postfix/email-with-postfix-dovecot-and-my… - those instructions also work in CentOS 7 with the latest Dovecot - but there is something that really bothers me. It makes no provision for salting the password before the crypt function. What I would like to do is when creating a new account, use /dev/urandom to generate a random salt for the account that is stuck in the database along with the account and used when validating the password. That way in the event of a SQL injection attack that dumps the database - yes it is still bad, but 20 accounts that have the same password will have radically different hashes and thus won't be a clue that they are the same, the blackhat that gets the database dump would have to generate a rainbow table for each unique salt. I've looked at at least a dozen different Dovecot / MariaDB howto guides and none of the ones I have looked at supported any kind of individual salting of the user passwords. Can someone point me to a guide that does? I don't mind keeping the salt in the database, I just want to be able to have a different salt for each account. Thank you

2 2

GMail-like user labels in IMAP/dovecot, situation in 2017?
by Gioele Barabucci 11 Jan '17

11 Jan '17

Hello, I am in the process of updating my IMAP dovecot installation and I was wondering what is the current state of the art for GMail-like user-defined labels. Are GMail-like user-defined labels now somehow achievable with dovecot? If now, what is missing? Standardized metadata formats? Support in clients? I searched the web a bit but I could not find any activity in the relevant IETF working groups. That seems strange to me, because the user-defined labels looks like a feature many users would like to have. I suppose I haven't found the relevant discussion group. Is this kind of enhancement to IMAP being discussed somewhere? Regards, -- Gioele Barabucci <gioele(a)svario.it>

2 2

Poolmon: Problem with index-locking
by Tom Sommer 11 Jan '17

11 Jan '17

I have Poolmon (https://github.com/brandond/poolmon) set up. When it does all the checks concurrently, obviously there are locking issues on each mailserver it tests: "Warning: Locking transaction log file xxxx/indexes/dovecot.list.index.log took 60 seconds (syncing)" It's just an empty mailbox. Is there any way to do a login test, without locking the index files? Hence avoiding these warnings/errors? Thanks. -- Tom

2 2

doveadm output format changes
by Benoit Branciard 10 Jan '17

10 Jan '17

It appears that doveadm output format changes every now and then, without particular notice. For example, the following command: doveadm -f pager mailbox status 'messages recent' '*' did output something like this until v2.2.24 : mailbox: Mailbox1 messages: 58 recent: 12 ^L mailbox: Mailbox2 messages: 128 recent: 0 but switched to that in v2.2.26 : Mailbox1 messages: 58 recent: 12 ^L Mailbox2 messages: 128 recent: 0 This seems related to the following changelog entry: 2016-10-25 20:51:36 +0300 Timo Sirainen <timo.sirainen(a)dovecot.fi> (5baa99e) doveadm: "pager" formatter supports now DOVEADM_PRINT_HEADER_FLAG_HIDE_TITLE M src/doveadm/doveadm-print-pager.c Some other format changes did also occur in the past. For example, "doveadm user" had a specific format in v2.0.19 (and ignored the "-f format" option), and obviously defaulted to the "-f tab" format (which has different rendering) somewhere in the v2.2.x or 2.1.x. Such changes render maintenance of wrapping scripts particularly tedious. Could it be possible to avoid such breaking changes in the future ? -- Benoit BRANCIARD Service InfraStructures (SIS) Direction du Système d'Information et des Usages Numériques (DSIUN) Université Paris 1 Panthéon-Sorbonne Centre Pierre Mendès France 90 rue de Tolbiac - 75634 Paris cedex 13 - France Bur. B406 - Tél +33 1 44 07 89 68 - Fax +33 1 44 07 89 66 Accueil: +33 1 44 07 89 65 - Assistance-DSIUN(a)univ-paris1.fr http://dsi.univ-paris1.fr

1 1

Re: dovecot-pigeonhole running external script ends with signal 11
by Stephan Bosch 10 Jan '17

10 Jan '17

Op 1/8/2017 om 10:00 AM schreef Tobi: > Hi Stephan > > according to ps aux the process that segfaults is (pid 18261) > > vmail 18261 0.0 0.0 0 0 pts/0 Z 09:39 0:00 [lmtp] > <defunct> > > the gdb backtrace I attached to my mail was the deepest one I got That looks like it happens in Dovecot still. > @Steffen > the script does not chroot, at least not that I'm aware of. I checked my > dovecot configs and could not find any active chroot config. All > occurences of mail_chroot are commented out and have no path values. What about the version information I asked about? Regards, Stephan. > Am 06.01.2017 um 00:04 schrieb Stephan Bosch: >> Op 1/4/2017 om 9:37 AM schreef Tobi: >>> Hi Aki >>> >>> yes I built dovecot and pigeonhole rpms in the same rpmbuild. pigeonhole >>> rpm is based on 0.4.14 >>> Do you think that the error might come from self building the rpms? >> But what version of Pigeonhole are you actually using? Version 0.4.16 is >> released for Dovecot v2.2.26. >> >> Also: >> >> - Can you find out which process is getting the segfault? GDB shows the >> pid and you should lookup what process that is while GDB is still active. >> - Isn't that GDB backtrace you provided deeper? It shows only two >> levels, but that makes no sense (i.e. main() is not listed). >> >> Regards, >> >> Stephan. >>

4 4

Virtual POP3 namespaces and quota-status
by Aurélien Beaujean 09 Jan '17

09 Jan '17

Hi, I've tried to do configure Virtual POP3 INBOX (dovecot version 2.2.18) as explained here http://wiki.dovecot.org/Plugins/Virtual with a static userdb and nopassword=y so I dont have any database on the dovecot server without the possibility to distinguish POP3 or IMAP in the userdb extra field to change the namespace on the fly. So I've put the namespace virtual informations inside the protocol pop3 { ... }, I did the same for the protocol imap { }: protocol pop3 { mail_plugins = $mail_plugins last_login virtual namespace inbox { prefix = separator = / list = yes } namespace virtual { inbox = yes prefix = virtual/ separator = / location = virtual:/etc/dovecot/virtual:INDEX=MEMORY list = no hidden = yes } namespace real { prefix = RealMails/ separator = / list = no hidden = yes } } protocol imap { mail_plugins = $mail_plugins imap_quota last_login namespace inbox { inbox = yes } } protocol lda { mail_plugins = " quota sieve" namespace inbox { inbox = yes } } passdb { args = nopassword=y uid=vmail gid=vmail home=/var/mail/%2Mn/%2.2Mn/%n driver = static } userdb { args = nopassword=y uid=vmail gid=vmail home=/var/mail/%2Mn/%2.2Mn/%n driver = static } service quota-status { executable = quota-status -p postfix inet_listener { port = 12340 } process_min_avail = 8 } But the service quota-status getting lost with a message: namespace configuration error: inbox=yes namespace missing I didn't find a way to tell quota-status which namespace to use as you can't setup a default one. If I declare a "global" namespace inbox pop3 deamon fails because of duplicated namespace inbox in the configuration files: pop3(xxx): Error: User initialization failed: namespace configuration error: There can be only one namespace with inbox=yes Any idea before I will patch some piece of code to disable the unique restriction of inbox namespace ? Thanks, -- Auré

1 2

dsync for subscription on public/shared folder
by Mike Fröhner 09 Jan '17

09 Jan '17

Hello, I already wrote regarding that, but maybe it sounded too complex. I will write it a bit softer now. The replication through dsnyc works perfectly with one exception. I am having an issue with the replication of the subscriptions file on shared folder. We have a public mailbox defined: namespace public-test { location = maildir:/opt/mail/_public/test prefix = public/test/ separator = / subscriptions = no type = public } There 2 subfolder .Test1 and .Test2 which I would like to subscribe on my user "ldaptestuser" which is part of the group "ldaptestgroup" The dovecot-acl file on /opt/mail/_public/test and /opt/mail/_public/test/.Test{1,2} are the same and are containing: group=ldaptestgroup lrwstipekxa Now if I login through my client (Thunderbird or Roundcubemail) I can see the following debug log: dovecot: imap(ldaptestuser): Debug: acl: acl username = ldaptestuser dovecot: imap(ldaptestuser): Debug: acl: owner = 0 dovecot: imap(ldaptestuser): Debug: acl: group added: domain users dovecot: imap(ldaptestuser): Debug: acl: group added: ldaptestgroup dovecot: imap(ldaptestuser): Debug: acl: group added: all_mailuser I created one new private folder on the mailbox of my test user and also subscribed it. This subscription is successfully replicated. After that I am trying to subscribe the public folder. I can see the folder in my client after I subscribed them. But on the 2nd dovecot server the subscription file is not updated. imap-1 # cat subscription Private1 public/test/Test1 imap-2 # cat subscription Private1 The debug log on both dovecot server tells me: dovecot: doveadm(<ip>,ldaptestuser): Debug: Effective uid=834603987, gid=991, home=/opt/mail/ldaptestuser dovecot: doveadm(<ip>,ldaptestuser): Debug: acl: No acl_shared_dict setting - shared mailbox listing is disabled dovecot: doveadm(<ip>,ldaptestuser): Debug: maildir++: root=/opt/mail/_public/test, index=, indexpvt=, control=, inbox=, alt= dovecot: doveadm(<ip>,ldaptestuser): Debug: acl: initializing backend with data: vfile dovecot: doveadm(<ip>,ldaptestuser): Debug: acl: acl username = ldaptestuser dovecot: doveadm(<ip>,ldaptestuser): Debug: acl: owner = 0 dovecot: doveadm(<ip>,ldaptestuser): Debug: acl vfile: Global ACLs disabled It looks like the doveadm() cannot find the group or is not checking/initalizing the groups. Anybody any idea if I missconfigured something or is this just a bug? I really would appreciate some help. kind regards, Mike;

1 1

Auth-policy: auth_policy_server_url and https support
by gregc＠olypensupport.com 08 Jan '17

08 Jan '17

When using Auth policy server it doesn’t currently doesn’t support https. In version 2.2.27: Policy server HTTP error: 9002 Couldn't initialize SSL context: Can't verify remote server certs without trusted CAs (ssl_client_ca_* settings) and in version 2.3.devel Policy server HTTP error: 9002 Requested https connection, but no SSL settings given dovecot.conf does have “ssl_client_ca_dir = /etc/ssl/certs” set. Looking around the source, http-client-settings are not given the ssl_ca_dir or ssl_ca_file setting from the config. Admittedly SSL tear up/down is little expensive per auth, but I think it maybe it should still work?

2 1

.dovecot.sieve location issue
by Jibeji 08 Jan '17

08 Jan '17

Hello, I am trying to set sieve up on a Centos 7 server. It's a configuration with postfix, Maildir, MySQL and virtual domains which works fine. I have created a simple .dovecot.sieve in the user's directory: # cat /home/mail/domain.com/user/.dovecot.sieve require "fileinto"; redirect "other_address(a)other_domain.com"; Here are the logs: dovecot: lda(user(a)domain.com): Debug: sieve: Pigeonhole version 0.4.2 initializing lda(user(a)domain.com): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. dovecot: lda(user(a)domain.com): Debug: sieve: script file /home/mail/ domain.com/.dovecot.sieve not found dovecot: lda(user(a)domain.com): Debug: sieve: user's script ~/.dovecot.sieve doesn't exist (trying default script location instead) lda(user(a)domain.com): Debug: sieve: no default script configured for user lda(user(a)domain.com): Debug: sieve: user has no valid location for a personal script lda(user(a)domain.com): Debug: sieve: no scripts to execute: reverting to default delivery. dovecot: lda(user(a)domain.com): msgid=<005b01d269ca$f287ebf0$d797c3d0$@fr>: saved mail to INBOX It tells that user's script ~/.dovecot.sieve doesn't exis However, on the troubleshooting guide, I can see these logs: dovecot: lda(hendrik): Debug: sieve: using sieve path for user's script: /home/hendrik/.dovecot.sieve dovecot: lda(hendrik): Debug: sieve: opening script /home/hendrik/.dovecot.sieve As you can see, it refers to "lda(hendrik)" but not "lda(user(a)domain.com" I am wondering whether Sieve looks for the file elsewhere than /home/mail/ domain.com/user/.dovecot.sieve Do you have any idea?

3 3

Dovecot Selinux Setting
by Günther J. Niederwimmer 08 Jan '17

08 Jan '17

Hello, can any tell me the correct selinux Settings for the Maildir Setting ? in the Moment I have this setting Jan 8 15:04:52 2017 from 192.168.100.100 [root@mx03 ~]# ls -Z /srv/vmail drwx------. vmail vmail unconfined_u:object_r:mail_home_rw_t:s0 example.com drwx------. vmail vmail unconfined_u:object_r:mail_home_rw_t:s0 example.at drwx------. vmail vmail unconfined_u:object_r:mail_home_rw_t:s0 eu-example.at drwx------. vmail vmail unconfined_u:object_r:mail_home_rw_t:s0 example1.com -rw-rw----. vmail vmail unconfined_u:object_r:mail_home_rw_t:s0 shared- mailboxes I mean this not correct, I have problems with sieve to enable the Link and with Sync ? I can't found the correct setting with goo..... Thanks for Help and a answer, -- mit freundlichen Grüssen / best regards Günther J. Niederwimmer

2 1

auth: Error: BUG: Authentication client sent unknown handshake command
by Marcus Endberg 08 Jan '17

08 Jan '17

Hello! I run dovecot for many years now, but today it ran into a bug I've never seen before. Searching the archives, this bug seems to occur very seldom. The current server installation & configuration is running since mid 2015, uptime of the server today is more than two months. It is a virtual machine in a data center, debian 7 / reiserfs, 'dovecot -n' output below. Just within normal operation, suddenly my users could no longer check their IMAP accounts, log shows lots of entries like this: ----------------------- /var/log/mail.log excerpt --------------------- 2017-01-08 08:15:23 dovecot: auth: Error: BUG: Authentication client sent unknown handshake command: REQUEST?3484549121?11364?1?74fa603b892f9a262605ae6c2ce1d9a1 2017-01-08 08:15:23 dovecot: imap: Error: Authentication server didn't send valid SPID as expected: MECH#011PLAIN#011plaintext 2017-01-08 08:15:23 dovecot: imap: Error: Disconnected from auth server, aborting (client-pid=11364 client-id=1) 2017-01-08 08:15:23 dovecot: imap-login: Internal login failure (pid=11364 id=1) (internal failure, 1 succesful auths): user=<USER_NAME>, method=PLAIN, rip=<USER_IP>, lip=85.214.143.57, mpid=11368, TLS, session=<0oiwA5BFmQBQhoL1> ----------------------------------------------------------------------- Strangely, sending mails still worked fine (postfix uses dovecot SASL authentification). I could not find any hint what might have caused the error in any logfile. After restarting dovecot everything is back to normal operation. Is there any other information I can / should provide? Thanks for your efforts, Marcus ----------------------- output of 'dovecot -n' ------------------------ # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.41-042stab120.16 i686 Debian 7.11 mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = " imap" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl_cert = </correct_path_to/mailbox.endberg.net-chain.cert ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA ssl_key = </home/sslcerts/keys/mailbox.endberg.net.key ssl_protocols = !SSLv2 !SSLv3 userdb { driver = passwd } -----------------------------------------------------------------------

1 0

OP/PSA: Net Systems Research mail port diddlers
by lists＠lazygranch.com 07 Jan '17

07 Jan '17

http://netsystemsresearch.com/ dovecot.log.1.bz2:Jan 05 17:28:15 pop3-login: Info: Disconnected (no auth attempts in 3 secs): user=<>, rip=169.54.233.124, lip=MYIP, TLS handshaking: Disconnected, session=<z/L0OVxFetOpNul8> Their "research" pokes your email ports. Block if you want or participate in the (cough cough) research. IP addresses and opt-out email address on webpage.

2 1