October 2018 - dovecot

Copying from a previous Dovecot server
by Peter Lindgren 31 Oct '18

31 Oct '18

Hello! I have installed a new dovecot server on a new server, using imap and Maildir. The old Maildirs are accessible on a mounted disk. I have tried to copy a few folders manually, by first creating the folder on the new server through the a-mail client, and then copying the contents of the cur folder from the old to the new. Works fine, but is a manual process. I'm looking for a way to script this. Is it safe to copy a template folder to a new folder, and then copy the cur folder contents? The files that Dovecot creates in an empty folder have different contents, will Dovecot update them when the user retrieves the mails in that folder? Or, can I just make a symlink to the old Maildir somewhere? Peter -- Peter Lindgren peter(a)norrskenkonsult.com 0703-393940

2 1

[dovecot quota-status] error "Invalid character in path"
by k675154＠keit.eu 31 Oct '18

31 Oct '18

Hello, I'm using using: - dovecot 2.3.3 (dcead646b) - postfix 3.3.1 - dovecot "quota = maildir:User quota" I'm facing the error: "quota-status: Error: quota-status: Client sent invalid recipient address: Invalid character in path" This occurred with this e-mail address: "John Smith"@keit.eu Well I know it is not a conventional address but it is normally perfectly authorized. When I disable quota check, I can received correctly the incoming e-mail. So is there a mean to enable quota check with this kind of e-mail address ? Thanks

2 1

Dovecot submission announces CHUNKING but backend Postfix does not support it
by Michael Goth 30 Oct '18

30 Oct '18

Hello, I'm setting up Dovecot 2.3.2.1 as a submission proxy to a Postfix backend server. Dovecot announces CHUNKING, but the Postfix backend does not support (or announce) it. HELO from Postfix: 220 backend.mydomain.com ESMTP Postfix (Ubuntu) ehlo test 250-backend.mydomain.com 250-PIPELINING 250-SIZE 104857600 250-VRFY 250-ETRN 250-STARTTLS 250-ENHANCEDSTATUSCODES 250-8BITMIME 250 DSN HELO from Dovecot proxy: 220 proxy.mydomain.com Dovecot ready. ehlo test 250-proxy.mydomain.com 250-8BITMIME 250-AUTH PLAIN LOGIN 250-BURL imap 250-CHUNKING 250-ENHANCEDSTATUSCODES 250-SIZE 250-STARTTLS 250 PIPELINING When a client sends BDAT, Postfix closes the connection. Here's a log snippet from Postfix: < MAIL FROM:<user(a)mydomain.com> > 250 2.1.0 Ok < RCPT TO:<some(a)recipient.com> > 250 2.1.5 Ok < BDAT 114098 LAST > 502 5.5.2 Error: command not recognized < Content-Type: multipart/alternative; boundary=Apple-Mail-55D35F74-2EB7-4B3B-A607-E421DD71C07A > 221 2.7.0 Error: I can break rules, too. Goodbye. Apple Mail seems to ignore the fact that Postfix does not understand BDAT and Postfix does not like that :-) From a quick glance at the code it seems CHUNKING is always added to the capabilities and that's not configurable. Is this a bug or am I doing something wrong? Thanks, Michael

4 7

Request: option to hide user IP/HELO content from mail sent via submissiond
by Lee Maguire 30 Oct '18

30 Oct '18

For reasons of user privacy and security I usually configure submission servers to not include accurate IP address and HELO information of authenticated users. (Usually replacing it with a private-use domain / IPv6 address.) Dovecot submission (2.3.2) will produce a header something like this (where “10.22.36.10" is a public IP address) Received: from [192.168.1.184] ([10.22.36.10]) by x.example.com with ESMTPSA id xY/yDFD9yVtsFwAARu9lhg (envelope-from <test(a)example.com>) for <test(a)example.net>; Fri, 19 Oct 2018 18:50:40 +0100 It would be good if a local administrator could override the trace “from” content with syntactically valid, but privacy respecting, content. e.g. Received: from submission.local ([fdf7:c4e4:1c1e::10]) by x.example.com with ESMTPSA id xY/yDFD9yVtsFwAARu9lhg (envelope-from <test(a)example.com>) for <test(a)example.net>; Fri, 19 Oct 2018 18:50:40 +0100 RFC 5321 specifies that the “from” MUST exist but only specifies that the content SHOULD be the source host. (Assuming that Submission is “an SMTP environment”. RFC 6409 makes some provision for header rewriting to hide machine names. https://tools.ietf.org/html/rfc6409#section-8.8 ) https://tools.ietf.org/html/rfc5321#section-4.4 The FROM clause, which MUST be supplied in an SMTP environment, SHOULD contain both (1) the name of the source host as presented in the EHLO command and (2) an address literal containing the IP address of the source, determined from the TCP connection.

3 2

Panic: file istream-crlf.c: line 24 (i_stream_crlf_read_common): assertion failed: (ret != -2)
by Peter Nabbefeld 30 Oct '18

30 Oct '18

Hello, cannot fetch mails from an IMAP folder because of the error in the subject - fetching always stops with SIGABRT. Could anybody help me, please? Kind regards Peter

3 3

Problem with cached userdb info
by Ángel L. Mateo 30 Oct '18

30 Oct '18

Hi, I'm having a problem with my cached userdb information. These are my passdb and userdbs: passdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext } userdb { driver = prefetch } userdb { driver = ldap args = /etc/dovecot/dovecot-ldap-userdb.conf.ext } In /etc/dovecot/dovecot-ldap-userdb.conf.ext (userdb) I have: user_attrs = =user=%{ldap:mail},=quota_rule=%{ldap:quota:*:storage=10G},=home_prefix=/mail/mailboxes/%L{domain},=index_prefix=/mail/indexes/%L{domain},=relpath=%2L{ldap:umServiceUniqueId}/%L{ldap:umServiceUniqueId},=uuid=%L{ldap:umPersonalUniqueId} user_filter = (&(objectClass=CourierMailAccount)(irisUserStatus=urn:mace:rediris.es:um.es:userstatus:correo:estado:activo)(irisMailhost=popimapclu11.um.es)(|(uid=%{auth_user})(mail=%{auth_user}))) and in /etc/dovecot/dovecot-ldap.conf.ext (passdb) I have: pass_attrs = =userdb_user=%{ldap:mail},=userdb_quota_rule=%{ldap:quota:*:storage=10G},=userdb_home_prefix=/mail/mailboxes/%L{domain},=userdb_index_prefix=/mail/indexes/%L{domain},=userdb_relpath=%2L{ldap:umServiceUniqueId}/%L{ldap:umServiceUniqueId},=userdb_uuid=%L{ldap:umPersonalUniqueId},=uuid=%L{ldap:umPersonalUniqueId} pass_filter = (&(objectClass=CourierMailAccount)(irisUserStatus=urn:mace:rediris.es:um.es:userstatus:correo:estado:activo)(irisMailhost=popimapclu11.um.es)(|(uid=%u)(mail=%u))) The problem I have is that quota information is not updated when I changed in my ldap. These are the steps I'm running: 1. First, I check current quota (dovecot just restarted): amateo_adm@myotis60:/etc/dovecot/conf.d$ sudo doveadm user -f quota_rule angel.luis(a)um.es *:storage=2G in the log I get: Oct 29 14:29:46 myotis60 dovecot: auth: Debug: master in: USER#0111#011angel.luis(a)um.es#011service=doveadm#011debug Oct 29 14:29:46 myotis60 dovecot: auth: Debug: prefetch(angel.luis(a)um.es): passdb didn't return userdb entries, trying the next userdb Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): userdb cache miss Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): user search: base=ou=Usuarios,dc=Telematica scope=subtree filter=(&(objectClass=CourierMailAccount)(irisUserStatus=urn:mace:rediris.es:um.es:userstatus:correo:estado:activo)(irisMailhost=popimapclu11.um.es)(|(uid=angel.luis@um.es)(mail=angel.luis@um.es))) fields=mail,quota,umServiceUniqueId,umServiceUniqueId,umPersonalUniqueId Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): result: mail=angel.luis(a)um.es umServiceUniqueId=3aa35516-d2bd-11e8-8708-d0cb8a49c4ef umPersonalUniqueId=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef quota=*:storage=2G; mail,umPersonalUniqueId,quota,umServiceUniqueId unused Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): result: mail=angel.luis(a)um.es umServiceUniqueId=3aa35516-d2bd-11e8-8708-d0cb8a49c4ef umPersonalUniqueId=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef quota=*:storage=2G Oct 29 14:29:46 myotis60 dovecot: auth: Debug: userdb out: USER#0111#011angel.luis@um.es#011quota_rule=*:storage=2G#011home_prefix=/mail/mailboxes/um.es#011index_prefix=/mail/indexes/um.es#011relpath=3a/3aa35516-d2bd-11e8-8708-d0cb8a49c4ef#011uuid=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef 2. Then I change user quota. 3. And later, I flush auth cache: amateo_adm@myotis60:/etc/dovecot/conf.d$ sudo doveadm auth cache flush angel.luis(a)um.es 0 cache entries flushed with debug log: Oct 29 14:31:00 myotis60 dovecot: auth: Debug: master in: CACHE-FLUSH#0111#011angel.luis(a)um.es 4. Finally, I get again the quota: amateo_adm@myotis60:/etc/dovecot/conf.d$ sudo doveadm user -f quota_rule angel.luis(a)um.es *:storage=2G with debug log: Oct 29 14:31:49 myotis60 dovecot: auth: Debug: master in: USER#0111#011angel.luis(a)um.es#011service=doveadm#011debug Oct 29 14:31:49 myotis60 dovecot: auth: Debug: prefetch(angel.luis(a)um.es): passdb didn't return userdb entries, trying the next userdb Oct 29 14:31:49 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): userdb cache hit: quota_rule=*:storage=2G#011home_prefix=/mail/mailboxes/um.es#011index_prefix=/mail/indexes/um.es#011relpath=3a/3aa35516-d2bd-11e8-8708-d0cb8a49c4ef#011uuid=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef Oct 29 14:31:49 myotis60 dovecot: auth: Debug: userdb out: USER#0111#011angel.luis@um.es#011quota_rule=*:storage=2G#011home_prefix=/mail/mailboxes/um.es#011index_prefix=/mail/indexes/um.es#011relpath=3a/3aa35516-d2bd-11e8-8708-d0cb8a49c4ef#011uuid=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef I'm also confussed about that dovecot is always loggin: prefetch(angel.luis(a)um.es): passdb didn't return userdb entries, trying the next userdb even if I have made a imap/pop3 before the doveadm user command. Am I doing something wrong? Is there any way to flush this userdb cache (without restarting dovecot)? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

1 0

clients out of sync after restoring backup
by Frank-Ulrich Sommer 30 Oct '18

30 Oct '18

Hi, due to a failing disk I had to restore everything from a backup including dovecot (2.2.22) and the Maildir containing the stored mails. A period of some days must later be restored manuall, but that is beyond scope for this question. Naturally this causes confusion for the clients as they keep mails that are no longer on the server. That was expected but what puzzles me is that mails arriving after the succesful restore are only sporadically detected by some clients (e.g. K9 and Thunderbird) that were connected before the crash. A client that was connected for the first time after restoring from the backup works exactly as expected. Might this situation lead to reusing UUIDs that some clients still remember as belonging to a different mail? Is there a clean solution for this on the server side or is it necessary to purge locally stored data by the clients (e.g. by temporarily removing account)? Frank -- Diese Nachricht wurde von meinem Android-Mobiltelefon mit K-9 Mail gesendet.

2 1

Read the quota_exceeded_message from a file
by Maysara A. Abdulhaq 29 Oct '18

29 Oct '18

Greetings, I've been trying to have quota_exceeded_message read from a file according to https://wiki2.dovecot.org/Quota/Configuration#Custom_Quota_Exceeded_Message ; I'm running dovecot 2.2.10 on Centos 7. If I set text right to the equal sign, it works fine, but I'd rather load it from a file as I need a new line and %n and \n and simple \ followed by a newline are not working and would understandably crash the processes if malformed. nothing special about my setting, the file is located in the /etc/dovecot directory but separate from the config files (not in the conf.d directory), with a world readable permission. Regards, M.

4 6

maildirlock time unit?
by Kris von Mach 27 Oct '18

27 Oct '18

What is the time unit maildirlock will accept? I've tried 20s, 20 sec, 20 secs, 20 seconds, all results in: Fatal: Invalid timeout value: 20s And if you don't specify time unit you just get: Panic: BUG: No IOs or timeouts set. Not waiting for infinity. This is on 2.3.3. 2.2 worked fine without needing time unit specified.

3 6

Submission and CHUNKING
by Paul Hecker 26 Oct '18

26 Oct '18

Hi, It seems that there is an issue with the submission service when the SMTP server advertises chunking (I use Exim v4.91). I tried this with Dovecot v2.3.3 and current master and could reproduce it with both versions. My setup is that dovecot submission proxies to Exim on port 10025. The first mail gets through without any issues, but the second email will not get send. I had this issue at first with Apple Mail (it just sends a QUIT and shows an error) and could reproduce it with the OpenDMARC report perl script. You can find a little Perl script attached to reproduce it. It seems to me that Dovecot sends an (unexpected or mixed up) second answer to the client. If I add a “$smtp->getline();” (line 110) sending multiple emails works again. Another workaround is to disable CHUNKING in Exim (in this case only on the “proxy port”): chunking_advertise_hosts = ${if eq{$received_port}{10025}{}{*}} Thanks, Paul

2 1