May 2017 - dovecot - dovecot.org

Bug with 2.2.29-1~auto+25 back to haunt me
by Ralf Hildebrandt 06 Jun '17

06 Jun '17

After upgrading from 2.2.28-1~auto+45 to 2.2.29-1~auto+25 I'm gettings this: May 31 16:44:31 mproxy dovecot: auth: Fatal: passdb imap: Cannot verify certificate without ssl_ca_dir or ssl_ca_file setting May 31 16:44:31 mproxy dovecot: master: Error: service(auth): command startup failed, throttling for 8 secs May 31 16:44:31 mproxy dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 2 secs): user=<>, rip=141.42.206.36, lip=141.42.206.11, TLS, session=<ze1A9dJQZ8yNKs4k> # doveconf -n # 2.2.devel (215fd61): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.devel (403042e) # OS: Linux 4.4.0-71-generic x86_64 Ubuntu 16.04.2 LTS auth_mechanisms = plain login default_vsz_limit = 1 G imapc_host = exchange-imap.charite.de imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = no listen = *,:: mail_gid = imapproxy mail_home = /home/imapproxy/%u mail_location = imapc:~/imapc mail_plugins = mail_log notify mail_uid = imapproxy passdb { args = host=exchange-imap.charite.de port=993 ssl=imaps default_fields = userdb_imapc_user=%u userdb_imapc_password=%w userdb_imapc_host=exchange-imap.charite.de userdb_imapc_ssl=imaps userdb_imapc_port=993 driver = imap } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = imap service auth { inet_listener { address = 127.0.0.1 port = 12345 } } ssl = required ssl_ca = </etc/ssl/certs/ca-certificates.crt ssl_cert = </etc/dovecot/dovecot.pem ssl_cipher_list = EECDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA384:EECDH+ECDSA+SHA256:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH+aRSA+RC4:EECDH:EDH+aRSA:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS:!RC4 ssl_client_ca_file = /etc/ssl/certs/ca-certificates.crt ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 userdb { driver = prefetch } verbose_proctitle = yes So I added ssl_ca_file = /etc/ssl/certs/ca-certificates.crt But alas: May 31 16:50:24 mproxy dovecot: config: Warning: Obsolete setting in /etc/dovecot/conf.d/10-ssl.conf:36: ssl_ca_file has been replaced by ssl_ca = <file Gnarf! As you can see I do HAVE ssl_ca in my doveconf -n output! ssl_ca = </etc/ssl/certs/ca-certificates.crt So what gives? -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | https://www.charite.de

2 6

Problem with LMTP
by Angel L. Mateo 05 Jun '17

05 Jun '17

Hello, I'm having a problem with LMTP in a proxy server since I upgraded from 2.1.16 to 2.2.28. In my logs I have: Apr 26 12:54:17 musio12 dovecot: lmtp(2082): Fatal: master: service(lmtp): child 2082 killed with signal 11 (core dumped). As far as I could check the message is delivered in a later connection. I have enabled core dumped files, but how could I debug it? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

2 11

Retrieving mail from read-only mdbox
by Mark Moseley 05 Jun '17

05 Jun '17

This is a 'has anyone run into this and solved it' post. And yes, I've been reading and re-reading TFM but without luck. The background is that I'm working on tooling before we start a mass maildir->mdbox conversion. One of those tools is recovering mail from backups (easy as pie with maildir). We've got all of our email on Netapp file servers. They have nice snapshotting but the snapshots are, of course, readonly. My question: is there a doveadm command that will allow for email to be retrieved from a readonly mdbox, either directly (like manipulating the mdbox files directly) or by doveadm talking to the dovecot processes? Ideally, there'd be something like doveadm dump, but that could dump selected message contents. I've tried using IMAP with mail_location pointed at the snapshot, but, though I can get a listing of emails in the mailbox, the fetch fails when dovecot can't write-lock dovecot.index.log. If anyone has gotten something similar to work, I'd love to hear about it. A working IMAP setup would be the ideal, since it's more easily automatible (but I'll take whatever I can get). Any and all hints are most welcome!

4 4

10-ssl.conf: Unknown setting: ssl / debian 1:2.2.13-12~deb8u
by Sophie Loewenthal 05 Jun '17

05 Jun '17

Hi, I've been trying to get dovecot2 running and kept having this error message: May 13 13:38:32 mail systemd[1]: Started Dovecot IMAP/POP3 email server. May 13 13:38:32 mail dovecot[2178]: doveconf: Fatal: Error in configuration file /etc/dovecot/conf.d/10-ssl.conf line 61: Unknown setting: ssl # dovecot --build-options Build options: ioloop=epoll notify=inotify ipv6 openssl io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail SQL driver plugins: mysql postgresql sqlite Passdb: checkpassword ldap pam passwd passwd-file shadow sql Userdb: checkpassword ldap(plugin) nss passwd prefetch passwd-file sql # openssl version OpenSSL 1.0.1t 3 May 2016 This package is from from Debian repos with version number 1:2.2.13-12~deb8u amd64 In case I had inadvertently entered some invisible charaters in 10-ssl.conf, I deleted and typed this out. Not copy-pasted: # >10-ssl.conf # cat 10-ssl.conf # echo 'ssl = required' >10-ssl.conf # echo 'ssl_key = </etc/ssl/private/xxx.key' >>10-ssl.conf # echo 'ssl_cert = </etc/ssl/private/xxx.pem' >>10-ssl.conf I’ve done usual searching online for a week and read some dox, but cannot see what I’ve missed out. Any ideas? Please? Thanks, Sophie

4 14

Panic: file dsync-brain-mailbox.c: line 814 ...
by Sander Lepik 04 Jun '17

04 Jun '17

Hi! We have 2 servers replicating each other and after upgrade to 2.2.26.0 we are seeing this in the logs: Primary server: Nov 17 09:37:39 mailhost01 dovecot: dsync-server(user(a)domain.ee): Panic: file dsync-brain-mailbox.c: line 814 (dsync_brain_slave_recv_mailbox): assertion failed: (memcmp(dsync_box->mailbox_guid, local_dsync_box.mailbox_guid, sizeof(dsync_box->mailbox_guid)) == 0) Nov 17 09:37:39 mailhost01 dovecot: dsync-server(user(a)domain.ee): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x9438e) [0x7f3ccceb238e] -> /usr/lib/dovecot/libdovecot.so.0(+0x9447c) [0x7f3ccceb247c] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f3ccce4ba4e] -> dovecot/doveadm-server(dsync_brain_slave_recv_mailbox+0x3d8) [0x7f3ccd8f66f8] -> dovecot/doveadm-server(dsync_brain_run+0x650) [0x7f3ccd8f4110] -> dovecot/doveadm-server(+0x4143b) [0x7f3ccd8f443b] -> dovecot/doveadm-server(+0x5735f) [0x7f3ccd90a35f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7f3cccec6bdc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10a) [0x7f3cccec809a] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7f3cccec6c65] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f3cccec6e08] -> dovecot/doveadm-server(+0x26b99) [0x7f3ccd8d9b99] -> dovecot/doveadm-server(+0x28efc) [0x7f3ccd8dbefc] -> dovecot/doveadm-server(+0x3daba) [0x7f3ccd8f0aba] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7f3cccec6bdc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10a) [0x7f3cccec809a] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7f3cccec6c65] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f3cccec6e08] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f3ccce51f53] -> dovecot/doveadm-server(main+0x19f) [0x7f3ccd8ccdef] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f3ccca94b45] -> dovecot/doveadm-server(+0x19ea6) [0x7f3ccd8ccea6] Nov 17 09:37:39 mailhost01 dovecot: dsync-server(user(a)domain.ee): Fatal: master: service(doveadm): child 42621 killed with signal 6 (core dumps disabled) Secondary server: Nov 17 09:37:40 secondarymailhost01 dovecot: dsync-local(user(a)domain.ee): Error: read(mailhost01.domeen.ee) failed: EOF (last sent=mailbox, last recv=mailbox_state) I'm guessing that it happens during automatic full resync, but that's just guessing. OS is Debian 8 (x86_64) and Dovecot is recompiled from Debian's unstable repository. -- Sander

2 2

SSL problem - no banner
by Marcio Merlone 01 Jun '17

01 Jun '17

Hi, I am running dovecot 2.2.22-1ubuntu2.4 on a ubuntu 16.04 server. It has a valid Letsencrypt certificate but the problem also happens with a self-digned one. Only openssl s_client -connect localhost:993 works fine and fast, while all MUA's and telnet does not. Telnet timeouts waiting for banner after a minute or so: root@netuno:~# openssl s_client -connect localhost:993 CONNECTED(00000003) depth=2 O = Digital Signature Trust Co., CN = DST Root CA X3 verify return:1 depth=1 C = US, O = Let's Encrypt, CN = Let's Encrypt Authority X3 verify return:1 (...) Start Time: 1496081321 Timeout : 300 (sec) Verify return code: 0 (ok) --- * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. 0 logout * BYE Logging out 0 OK Logout completed. closed root@netuno:~# telnet localhost 993 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. (about 1 minute later...) Connection closed by foreign host. root@netuno:~# I Have enabled verbose_ssl = yes and mail_debug = yes but no useful info got to logs. Has anyone seen this? Any hint? Thanks, best regards. -- *Marcio Merlone*

3 3

sieve folders in maildir with imap: not a directory not fixed with maildir_stat_dirs = yes
by David Gessel 01 Jun '17

01 Jun '17

As my logs fill up with "imap(user(a)domain.com): Error: stat(/mail/doman.com/user//.dovecot.sieve/tmp) failed: Not a directory" errors, I followed the advice at https://wiki2.dovecot.org/VirtualUsers/Home and https://dovecot.org/list/dovecot/2016-June/104403.html and set in /usr/local/etc/dovecot/conf.d/10-mail.conf # By default LIST command returns all entries in maildir beginning with a dot. # Enabling this option makes Dovecot return only entries which are directories. # This is done by stat()ing each entry, so it causes more disk I/O. # (For systems setting struct dirent->d_type, this check is free and it's # done always regardless of this setting) maildir_stat_dirs = yes My mailbox format reads "mail_location = maildir:~:CONTROL=/var/no-quota/%u:INDEX=MEMORY" The error is factually correct, but there is not .dovecot.sieve/tmp directory or file as .dovecot.sieve is a file (the head sieve script that calls the subordinate scripts out of the /sieve directory. There is a tmp directory at /sieve/tmp/ drwxr----- 2 vmail vmail 2B May 31 04:14 tmp Any hints as to why this isn't working? It does seem like the right answer.

2 2

Re: v2.2.30.1 released
by Eric Broch 01 Jun '17

01 Jun '17

Built on CentOS 7 without a hitch. On 5/31/2017 7:24 AM, Timo Sirainen wrote: > https://dovecot.org/releases/2.2/dovecot-2.2.30.1.tar.gz > https://dovecot.org/releases/2.2/dovecot-2.2.30.1.tar.gz.sig > > Due to some release process changes I didn't notice that one important bugfix wasn't included in the v2.2.30 release branch before I made the release. So fixing it here with v2.2.30.1. Also included another less important fix. > > - quota_warning scripts weren't working in v2.2.30 > - vpopmail still wasn't compiling > > Also I guess should mention that in v2.2.30+ the "script" service's protocol changed to a new version. If anyone had written their own script services (not using the included "script" binary) they would need some changes. I haven't heard of anyone having done that though. -- Eric Broch White Horse Technical Consulting (WHTC)

1 0

Re: v2.2.30 released
by Joseph Tam 31 May '17

31 May '17

Timo wrote: >>> + If dovecot.index.cache corruption is detected, reset only the one >>> corrupted mail instead of the whole file. >> >> Is this a big performance win? I still have users with jumbo mailboxes >> who insist on direct mailbox file access using procmail or mail readers, >> which trigger index rebuilds when dovecot accesses them. > > What does Dovecot log then? But probably doesn't affect that. It's > only when Dovecot logs something about dovecot.index.cache corruption > that this helps. It logs stuff like this (Lots of this ...) May 26 15:22:50 server dovecot: pop3(user): Warning: Transaction log file /{cachedir}/dovecot.index.log was locked for 43 seconds (rotating while syncing) May 27 16:57:18 server dovecot: imap(user): Warning: Transaction log file /{cachedir}/dovecot.index.log was locked for 105 seconds (Mailbox was synchronized) (... and some this this ...) May 26 15:43:07 server dovecot: imap(user): Error: Next message unexpectedly corrupted in mbox file /var/mail/user at 9627641 (... but very rarely this ...) May 8 17:05:59 server dovecot: imap(user): Error: Corrupted index cache file /{cachedir}/dovecot.index.cache: Broken virtual size for mail UID 12032 in mailbox INBOX: read(/var/mail/user): FETCH BODY[] got too little data: 6199 vs 6201 >From what you say, the changes would only affects the latter, so no big change. Thanks for the info. Joseph Tam <jtam.home(a)gmail.com>

2 1

shared folder and private index file problems
by Thomas Robers 31 May '17

31 May '17

Hello, I'm using Dovecot 2.2.30 with Pideonhole 0.4.18 and I'm having some problems, perhaps someone can give an hint on how to solve them. When I try to create a folder in the toplevel directory of a shared mailbox, i get a "permission denied" although I have the rights, example: 1.doveadm -f table acl rights -u bob(a)example.com shared/bill(a)example.com Rights lookup read write write-seen write-deleted insert post expunge create delete admin 2.doveadm mailbox create -u bob(a)example.com "shared/bill(a)example.com" doveadm(bob(a)example.com): Error: Can't create mailbox shared/bill(a)example.com: Permission denied Creating an subfolder of a folder which already exists works fine: 1.doveadm -f table acl rights -u bob(a)example.com shared/bill(a)example.com /Drafts Rights lookup read write write-seen write-deleted insert post expunge create delete admin 2.doveadm mailbox create -u bob(a)example.com "shared/bill(a)example.com /Drafts/Test" (no output) 3.doveadm -f table acl rights -u bob(a)example.com shared/bill(a)example.com /Drafts/Test Rights lookup read write write-seen write-deleted insert post expunge create delete So this works, but creating a folder directly in the inbox of the shared mailbox doesn't work and I don't know why. Is this not supported? Or do I miss something important? Another problem I have is, that the private index files in shared folders are often to always marked as inconsistent in the dovecot log file, an example of such log messages look like: - imap(bob(a)example.com): Error: /export/home/imap/bob(a)example.com/shared /bill(a)example.com/.Templates/dovecot.index.pvt view is inconsistent - imap(bob(a)example.com): Error: /export/home/imap/bob(a)example.com/shared /bill(a)example.com/.Templates/dovecot.index.pvt view is inconsistent - imap(bob(a)example.com): Error: /export/home/imap/bob(a)example.com/shared /bill(a)example.com/.Trash/dovecot.index.pvt view is inconsistent - imap(bob(a)example.com): Error: /export/home/imap/bob(a)example.com/shared /bill(a)example.com/.Trash/dovecot.index.pvt view is inconsistent And this is logged for almost every user who has access to a shared mailbox and I don't know how to stop getting the indexes inconsistent. Here's my Dovecot configuration: # 2.2.30 (8acbc67): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.18 (29cc74d) # OS: Linux 2.6.32-642.4.2.el6.x86_64 x86_64 CentOS release 6.9 (Final) ext4 auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no mail_debug = yes mail_location = maildir:/export/home/imap/%Lu/Maildir mail_plugins = acl zlib mail_log notify mailbox_idle_check_interval = 10 secs mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_write_locks = fcntl namespace { hidden = no ignore_on_failure = no inbox = no list = children location = maildir:%%h/Maildir:INDEXPVT=%h/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX/ separator = / type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/export/home/shared-db/shared-mailboxes mail_log_events = append delete undelete expunge copy mailbox_delete mailbox_rename flag_change mail_log_fields = uid box msgid size from flags sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global = /var/lib/dovecot/sieve/global/ sieve_user_log = ~/.dovecot.sieve.log zlib_save = gz zlib_save_level = 6 } protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service imap-login { process_limit = 500 process_min_avail = 20 } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl = required ssl_cert = </etc/pki/dovecot/certs/mail.tutech.de.crt_chain ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!EXPORT ssl_key = # hidden, use -P to show it ssl_protocols = !SSLv3 !SSLv2 syslog_facility = local6 userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } protocol lmtp { mail_plugins = acl zlib mail_log notify sieve } protocol imap { mail_max_userip_connections = 100 mail_plugins = acl zlib mail_log notify imap_zlib imap_acl } Any help is appreciated. Many Thanks & best regards Thomas

1 0