- dovecot - dovecot.org

Panic: file istream-crlf.c: line 24 (i_stream_crlf_read_common): assertion failed: (ret != -2)
by Peter Nabbefeld 30 Oct '18

30 Oct '18

Hello, cannot fetch mails from an IMAP folder because of the error in the subject - fetching always stops with SIGABRT. Could anybody help me, please? Kind regards Peter

3 3

Problem with cached userdb info
by Ángel L. Mateo 30 Oct '18

30 Oct '18

Hi, I'm having a problem with my cached userdb information. These are my passdb and userdbs: passdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext } userdb { driver = prefetch } userdb { driver = ldap args = /etc/dovecot/dovecot-ldap-userdb.conf.ext } In /etc/dovecot/dovecot-ldap-userdb.conf.ext (userdb) I have: user_attrs = =user=%{ldap:mail},=quota_rule=%{ldap:quota:*:storage=10G},=home_prefix=/mail/mailboxes/%L{domain},=index_prefix=/mail/indexes/%L{domain},=relpath=%2L{ldap:umServiceUniqueId}/%L{ldap:umServiceUniqueId},=uuid=%L{ldap:umPersonalUniqueId} user_filter = (&(objectClass=CourierMailAccount)(irisUserStatus=urn:mace:rediris.es:um.es:userstatus:correo:estado:activo)(irisMailhost=popimapclu11.um.es)(|(uid=%{auth_user})(mail=%{auth_user}))) and in /etc/dovecot/dovecot-ldap.conf.ext (passdb) I have: pass_attrs = =userdb_user=%{ldap:mail},=userdb_quota_rule=%{ldap:quota:*:storage=10G},=userdb_home_prefix=/mail/mailboxes/%L{domain},=userdb_index_prefix=/mail/indexes/%L{domain},=userdb_relpath=%2L{ldap:umServiceUniqueId}/%L{ldap:umServiceUniqueId},=userdb_uuid=%L{ldap:umPersonalUniqueId},=uuid=%L{ldap:umPersonalUniqueId} pass_filter = (&(objectClass=CourierMailAccount)(irisUserStatus=urn:mace:rediris.es:um.es:userstatus:correo:estado:activo)(irisMailhost=popimapclu11.um.es)(|(uid=%u)(mail=%u))) The problem I have is that quota information is not updated when I changed in my ldap. These are the steps I'm running: 1. First, I check current quota (dovecot just restarted): amateo_adm@myotis60:/etc/dovecot/conf.d$ sudo doveadm user -f quota_rule angel.luis(a)um.es *:storage=2G in the log I get: Oct 29 14:29:46 myotis60 dovecot: auth: Debug: master in: USER#0111#011angel.luis(a)um.es#011service=doveadm#011debug Oct 29 14:29:46 myotis60 dovecot: auth: Debug: prefetch(angel.luis(a)um.es): passdb didn't return userdb entries, trying the next userdb Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): userdb cache miss Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): user search: base=ou=Usuarios,dc=Telematica scope=subtree filter=(&(objectClass=CourierMailAccount)(irisUserStatus=urn:mace:rediris.es:um.es:userstatus:correo:estado:activo)(irisMailhost=popimapclu11.um.es)(|(uid=angel.luis@um.es)(mail=angel.luis@um.es))) fields=mail,quota,umServiceUniqueId,umServiceUniqueId,umPersonalUniqueId Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): result: mail=angel.luis(a)um.es umServiceUniqueId=3aa35516-d2bd-11e8-8708-d0cb8a49c4ef umPersonalUniqueId=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef quota=*:storage=2G; mail,umPersonalUniqueId,quota,umServiceUniqueId unused Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): result: mail=angel.luis(a)um.es umServiceUniqueId=3aa35516-d2bd-11e8-8708-d0cb8a49c4ef umPersonalUniqueId=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef quota=*:storage=2G Oct 29 14:29:46 myotis60 dovecot: auth: Debug: userdb out: USER#0111#011angel.luis@um.es#011quota_rule=*:storage=2G#011home_prefix=/mail/mailboxes/um.es#011index_prefix=/mail/indexes/um.es#011relpath=3a/3aa35516-d2bd-11e8-8708-d0cb8a49c4ef#011uuid=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef 2. Then I change user quota. 3. And later, I flush auth cache: amateo_adm@myotis60:/etc/dovecot/conf.d$ sudo doveadm auth cache flush angel.luis(a)um.es 0 cache entries flushed with debug log: Oct 29 14:31:00 myotis60 dovecot: auth: Debug: master in: CACHE-FLUSH#0111#011angel.luis(a)um.es 4. Finally, I get again the quota: amateo_adm@myotis60:/etc/dovecot/conf.d$ sudo doveadm user -f quota_rule angel.luis(a)um.es *:storage=2G with debug log: Oct 29 14:31:49 myotis60 dovecot: auth: Debug: master in: USER#0111#011angel.luis(a)um.es#011service=doveadm#011debug Oct 29 14:31:49 myotis60 dovecot: auth: Debug: prefetch(angel.luis(a)um.es): passdb didn't return userdb entries, trying the next userdb Oct 29 14:31:49 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): userdb cache hit: quota_rule=*:storage=2G#011home_prefix=/mail/mailboxes/um.es#011index_prefix=/mail/indexes/um.es#011relpath=3a/3aa35516-d2bd-11e8-8708-d0cb8a49c4ef#011uuid=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef Oct 29 14:31:49 myotis60 dovecot: auth: Debug: userdb out: USER#0111#011angel.luis@um.es#011quota_rule=*:storage=2G#011home_prefix=/mail/mailboxes/um.es#011index_prefix=/mail/indexes/um.es#011relpath=3a/3aa35516-d2bd-11e8-8708-d0cb8a49c4ef#011uuid=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef I'm also confussed about that dovecot is always loggin: prefetch(angel.luis(a)um.es): passdb didn't return userdb entries, trying the next userdb even if I have made a imap/pop3 before the doveadm user command. Am I doing something wrong? Is there any way to flush this userdb cache (without restarting dovecot)? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

1 0

clients out of sync after restoring backup
by Frank-Ulrich Sommer 30 Oct '18

30 Oct '18

Hi, due to a failing disk I had to restore everything from a backup including dovecot (2.2.22) and the Maildir containing the stored mails. A period of some days must later be restored manuall, but that is beyond scope for this question. Naturally this causes confusion for the clients as they keep mails that are no longer on the server. That was expected but what puzzles me is that mails arriving after the succesful restore are only sporadically detected by some clients (e.g. K9 and Thunderbird) that were connected before the crash. A client that was connected for the first time after restoring from the backup works exactly as expected. Might this situation lead to reusing UUIDs that some clients still remember as belonging to a different mail? Is there a clean solution for this on the server side or is it necessary to purge locally stored data by the clients (e.g. by temporarily removing account)? Frank -- Diese Nachricht wurde von meinem Android-Mobiltelefon mit K-9 Mail gesendet.

2 1

Read the quota_exceeded_message from a file
by Maysara A. Abdulhaq 29 Oct '18

29 Oct '18

Greetings, I've been trying to have quota_exceeded_message read from a file according to https://wiki2.dovecot.org/Quota/Configuration#Custom_Quota_Exceeded_Message ; I'm running dovecot 2.2.10 on Centos 7. If I set text right to the equal sign, it works fine, but I'd rather load it from a file as I need a new line and %n and \n and simple \ followed by a newline are not working and would understandably crash the processes if malformed. nothing special about my setting, the file is located in the /etc/dovecot directory but separate from the config files (not in the conf.d directory), with a world readable permission. Regards, M.

4 6

maildirlock time unit?
by Kris von Mach 27 Oct '18

27 Oct '18

What is the time unit maildirlock will accept? I've tried 20s, 20 sec, 20 secs, 20 seconds, all results in: Fatal: Invalid timeout value: 20s And if you don't specify time unit you just get: Panic: BUG: No IOs or timeouts set. Not waiting for infinity. This is on 2.3.3. 2.2 worked fine without needing time unit specified.

3 6

Submission and CHUNKING
by Paul Hecker 26 Oct '18

26 Oct '18

Hi, It seems that there is an issue with the submission service when the SMTP server advertises chunking (I use Exim v4.91). I tried this with Dovecot v2.3.3 and current master and could reproduce it with both versions. My setup is that dovecot submission proxies to Exim on port 10025. The first mail gets through without any issues, but the second email will not get send. I had this issue at first with Apple Mail (it just sends a QUIT and shows an error) and could reproduce it with the OpenDMARC report perl script. You can find a little Perl script attached to reproduce it. It seems to me that Dovecot sends an (unexpected or mixed up) second answer to the client. If I add a “$smtp->getline();” (line 110) sending multiple emails works again. Another workaround is to disable CHUNKING in Exim (in this case only on the “proxy port”): chunking_advertise_hosts = ${if eq{$received_port}{10025}{}{*}} Thanks, Paul

2 1

[sieve] Restrict redirects to only own domain
by Yassine Chaouche 26 Oct '18

26 Oct '18

Hello list, I'd like to let my colleagues redirect mail automatically (via a sieve filter) to other mailboxes within the same domain, but deny redirects to outside mailboxes (gmail, yahoo etc.) since this is considered bad practice and could lead to blacklisting (forwarding spam for example). If I set sieve_max_redirect to 0 then no redirect is allowed, at all. I wish to let redirects to internal mailboxes still possible. Ideas ? Yassine.

3 5

SIGABRT when fetching encrypted mail with getmail
by Peter Nabbefeld 26 Oct '18

26 Oct '18

Hello, I'm stuck with receiving an encrypted email from IMAP server. My getmail configuration is (getmail --dump): getmail configuration: getmail version 5.6 Python version 2.7.15 (default, Jun 27 2018, 13:05:28) [GCC 8.1.1 20180531] retriever: SimpleIMAPSSLRetriever(ca_certs="None", certfile="None", getmaildir="/home/peter/.getmail/", keyfile="None", mailboxes="('ALL',)", move_on_delete="None", password="*", password_command="()", port="993", record_mailbox="True", server="imap.gmx.net", ssl_cert_hostname="None", ssl_ciphers="None", ssl_fingerprints="()", ssl_version="None", timeout="180", use_cram_md5="False", use_kerberos="False", use_peek="True", use_xoauth2="False", username="peter.nabbefeld(a)gmx.de") destination: MDA_external(allow_root_commands="False", arguments="('-e', '-d', 'peter.nabbefeld(a)gmx.de')", command="deliver", group="vmail", ignore_stderr="False", path="/usr/lib/dovecot/deliver", unixfrom="False", user="vmail") options: delete : True delete_after : 0 delete_bigger_than : 0 delivered_to : False fingerprint : False logfile : logfile(filename="~/.getmail/log") max_bytes_per_session : 0 max_message_size : 0 max_messages_per_session : 0 message_log : ~/.getmail/log message_log_syslog : False message_log_verbose : False read_all : True received : False verbose : 1 dovecot.log: Oct 26 07:41:20 lda(peter.nabbefeld(a)gmx.de)<24607><UvPzGACp0lsfYAAA7IIYzw>: Panic: file istream-crlf.c: line 24 (i_stream_crlf_read_common): assertion failed: (ret != -2) Oct 26 07:41:20 lda(peter.nabbefeld(a)gmx.de)<24607><UvPzGACp0lsfYAAA7IIYzw>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xe8374) [0x7f9ae5706374] -> /usr/lib/dovecot/libdovecot.so.0(+0xe83b1) [0x7f9ae57063b1] -> /usr/lib/dovecot/libdovecot.so.0(+0x44312) [0x7f9ae5662312] -> /usr/lib/dovecot/libdovecot.so.0(+0x4693f) [0x7f9ae566493f] -> /usr/lib/dovecot/libdovecot.so.0(+0xf98b6) [0x7f9ae57178b6] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x81) [0x7f9ae5713a31] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x36) [0x7f9ae5713c56] -> /usr/lib/dovecot/libdovecot.so.0(+0xfebf8) [0x7f9ae571cbf8] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x81) [0x7f9ae5713a31] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x36) [0x7f9ae5713c56] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x4c) [0x7f9ae57146ec] -> /usr/lib/dovecot/libdovecot.so.0(io_stream_copy+0x8a) [0x7f9ae572ec2a] -> /usr/lib/dovecot/libdovecot.so.0(+0x112c12) [0x7f9ae5730c12] -> /usr/lib/dovecot/libdovecot.so.0(o_stream_send_istream+0x4f) [0x7f9ae572e8bf] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_save_continue+0x2e) [0x7f9ae58a965e] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_save_continue+0x27) [0x7f9ae58480f7] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_continue+0x44) [0x7f9ae5819fb4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xf8) [0x7f9ae580b488] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_copy+0x59) [0x7f9ae5843ea9] -> /usr/lib/dovecot/libdovecot-lda.so.0(+0x3dfc) [0x7f9ae593bdfc] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0x10d7c) [0x7f9ae53b0d7c] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x58541) [0x7f9ae581a541] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x4e745) [0x7f9ae3136745] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0x50d) [0x7f9ae312c0ad] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x57139) [0x7f9ae313f139] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_multiscript_run+0xa2) [0x7f9ae3140302] -> /usr/lib/dovecot/modules/lib90_sieve_plugin.so(+0x3d49) [0x7f9ae5609d49] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0xf9) [0x7f9ae593d219] dovecot --version 2.3.3 (dcead646b) For me, it semms like there's a CRLF expected, but probably it cannot be detected correctly, since the mail is encrypted - but that's only my guess ... Any idea how to fix that? Kind regards Peter

1 0

Shared mailboxes - Can't open mailbox shared-boxes/user/name.lastname: Character not allowed in mailbox name: '.'
by Marcio Vogel Merlone dos Santos 25 Oct '18

25 Oct '18

Hi, I am trying to make shared folders work on my server (Ubuntu 18.04, Dovecot 1:2.2.33.2-1ubuntu4.1). Mails are on Maildir++ local filesystem with '.' as layout separator and ALL 100+ users logins fits a template name.lastname, with a dot in the middle. I set up listescape but no luck. When I test with doveadm: root@mail:/etc/dovecot/conf.d# doveadm acl debug -u marcio.merlone(a)a1.ind.br shared-boxes/user/name.lastname doveadm(marcio.merlone(a)a1.ind.br): Error: Can't open mailbox shared-boxes/user/name.lastname: Character not allowed in mailbox name: '.' root@mail:/etc/dovecot/conf.d# Is there something I can do besides changing layout separator? Full dovecot -n output: # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-36-generic x86_64 Ubuntu 18.04.1 LTS ext4 auth_gssapi_hostname = $ALL auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_master_user_separator = * auth_mechanisms = plain ntlm login gssapi auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.@ auth_username_format = %Ln dict { acl = mysql:/etc/dovecot/acl-dict-sql.conf } disable_plaintext_auth = no dotlock_use_excl = no first_valid_uid = 3000 hostname = smtp.a1.ind.br imap_client_workarounds = tb-extra-mailbox-sep delay-newmail last_valid_uid = 3000 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To mail_access_groups = vmail dovecot mail_fsync = always mail_gid = 3000 mail_location = maildir:/mnt/maildirs/%u/Maildir:INDEX=/mnt/maildirs/%u/index mail_plugins = acl mail_privileged_group = vmail mail_server_admin = mailto:postmaster@a1.ind.br mail_uid = 3000 mailbox_list_index = yes mailbox_list_index_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mmap_disable = yes namespace { list = yes location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u:INDEXPVT=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = proxy::acl listescape_char = \ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size sieve = file:~/Maildir/sieve/;active=~/.dovecot.sieve sieve_before = /etc/dovecot/global.sieve sieve_max_actions = 32 sieve_max_redirects = 4 } postmaster_address = postmaster(a)a1.ind.br protocols = " imap lmtp sieve sieve" quota_full_tempfail = yes service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0666 } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { process_limit = 1024 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 0 } service managesieve { process_limit = 1024 } ssl_cert = </etc/letsencrypt/live/imap.a1.ind.br/fullchain.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!RC4::!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it submission_host = localhost syslog_facility = local1 userdb { args = uid=3000 gid=3000 home=/mnt/maildirs/%Ln mail=maildir:/mnt/maildirs/%Ln/Maildir:INBOX=/mnt/maildirs/%Ln/Maildir allow_all_users=yes driver = static } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log mail_plugins = acl } protocol lda { mail_plugins = acl quota sieve acl listescape } protocol imap { mail_max_userip_connections = 300 mail_plugins = acl quota imap_quota acl imap_acl listescape } Thanks, best regards. -- *Marcio Merlone*

1 0

Exclude userdb from iterate users
by Ángel L. Mateo 25 Oct '18

25 Oct '18

Hi, I have a system with various userdbs defined, mostly all of them based on ldap (and a few passwd-files). I want one of my ldap userdbs not to be used in "doveadm user -A" commands, that is to be excluded in iterate searchs. I have no iterate_filter neither iterate_attrs configured in that userdb, but it is still used. Is it possible? How? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

1 1