- dovecot - dovecot.org

Panic: file istream-crlf.c: line 24 (i_stream_crlf_read_common): assertion failed: (ret != -2)
by Peter Nabbefeld 30 Oct '18

30 Oct '18

Hello, cannot fetch mails from an IMAP folder because of the error in the subject - fetching always stops with SIGABRT. Could anybody help me, please? Kind regards Peter

3 3

Problem with cached userdb info
by Ángel L. Mateo 30 Oct '18

30 Oct '18

Hi, I'm having a problem with my cached userdb information. These are my passdb and userdbs: passdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext } userdb { driver = prefetch } userdb { driver = ldap args = /etc/dovecot/dovecot-ldap-userdb.conf.ext } In /etc/dovecot/dovecot-ldap-userdb.conf.ext (userdb) I have: user_attrs = =user=%{ldap:mail},=quota_rule=%{ldap:quota:*:storage=10G},=home_prefix=/mail/mailboxes/%L{domain},=index_prefix=/mail/indexes/%L{domain},=relpath=%2L{ldap:umServiceUniqueId}/%L{ldap:umServiceUniqueId},=uuid=%L{ldap:umPersonalUniqueId} user_filter = (&(objectClass=CourierMailAccount)(irisUserStatus=urn:mace:rediris.es:um.es:userstatus:correo:estado:activo)(irisMailhost=popimapclu11.um.es)(|(uid=%{auth_user})(mail=%{auth_user}))) and in /etc/dovecot/dovecot-ldap.conf.ext (passdb) I have: pass_attrs = =userdb_user=%{ldap:mail},=userdb_quota_rule=%{ldap:quota:*:storage=10G},=userdb_home_prefix=/mail/mailboxes/%L{domain},=userdb_index_prefix=/mail/indexes/%L{domain},=userdb_relpath=%2L{ldap:umServiceUniqueId}/%L{ldap:umServiceUniqueId},=userdb_uuid=%L{ldap:umPersonalUniqueId},=uuid=%L{ldap:umPersonalUniqueId} pass_filter = (&(objectClass=CourierMailAccount)(irisUserStatus=urn:mace:rediris.es:um.es:userstatus:correo:estado:activo)(irisMailhost=popimapclu11.um.es)(|(uid=%u)(mail=%u))) The problem I have is that quota information is not updated when I changed in my ldap. These are the steps I'm running: 1. First, I check current quota (dovecot just restarted): amateo_adm@myotis60:/etc/dovecot/conf.d$ sudo doveadm user -f quota_rule angel.luis(a)um.es *:storage=2G in the log I get: Oct 29 14:29:46 myotis60 dovecot: auth: Debug: master in: USER#0111#011angel.luis(a)um.es#011service=doveadm#011debug Oct 29 14:29:46 myotis60 dovecot: auth: Debug: prefetch(angel.luis(a)um.es): passdb didn't return userdb entries, trying the next userdb Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): userdb cache miss Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): user search: base=ou=Usuarios,dc=Telematica scope=subtree filter=(&(objectClass=CourierMailAccount)(irisUserStatus=urn:mace:rediris.es:um.es:userstatus:correo:estado:activo)(irisMailhost=popimapclu11.um.es)(|(uid=angel.luis@um.es)(mail=angel.luis@um.es))) fields=mail,quota,umServiceUniqueId,umServiceUniqueId,umPersonalUniqueId Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): result: mail=angel.luis(a)um.es umServiceUniqueId=3aa35516-d2bd-11e8-8708-d0cb8a49c4ef umPersonalUniqueId=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef quota=*:storage=2G; mail,umPersonalUniqueId,quota,umServiceUniqueId unused Oct 29 14:29:46 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): result: mail=angel.luis(a)um.es umServiceUniqueId=3aa35516-d2bd-11e8-8708-d0cb8a49c4ef umPersonalUniqueId=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef quota=*:storage=2G Oct 29 14:29:46 myotis60 dovecot: auth: Debug: userdb out: USER#0111#011angel.luis@um.es#011quota_rule=*:storage=2G#011home_prefix=/mail/mailboxes/um.es#011index_prefix=/mail/indexes/um.es#011relpath=3a/3aa35516-d2bd-11e8-8708-d0cb8a49c4ef#011uuid=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef 2. Then I change user quota. 3. And later, I flush auth cache: amateo_adm@myotis60:/etc/dovecot/conf.d$ sudo doveadm auth cache flush angel.luis(a)um.es 0 cache entries flushed with debug log: Oct 29 14:31:00 myotis60 dovecot: auth: Debug: master in: CACHE-FLUSH#0111#011angel.luis(a)um.es 4. Finally, I get again the quota: amateo_adm@myotis60:/etc/dovecot/conf.d$ sudo doveadm user -f quota_rule angel.luis(a)um.es *:storage=2G with debug log: Oct 29 14:31:49 myotis60 dovecot: auth: Debug: master in: USER#0111#011angel.luis(a)um.es#011service=doveadm#011debug Oct 29 14:31:49 myotis60 dovecot: auth: Debug: prefetch(angel.luis(a)um.es): passdb didn't return userdb entries, trying the next userdb Oct 29 14:31:49 myotis60 dovecot: auth: Debug: ldap(angel.luis(a)um.es): userdb cache hit: quota_rule=*:storage=2G#011home_prefix=/mail/mailboxes/um.es#011index_prefix=/mail/indexes/um.es#011relpath=3a/3aa35516-d2bd-11e8-8708-d0cb8a49c4ef#011uuid=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef Oct 29 14:31:49 myotis60 dovecot: auth: Debug: userdb out: USER#0111#011angel.luis@um.es#011quota_rule=*:storage=2G#011home_prefix=/mail/mailboxes/um.es#011index_prefix=/mail/indexes/um.es#011relpath=3a/3aa35516-d2bd-11e8-8708-d0cb8a49c4ef#011uuid=3aa34f3a-d2bd-11e8-8708-d0cb8a49c4ef I'm also confussed about that dovecot is always loggin: prefetch(angel.luis(a)um.es): passdb didn't return userdb entries, trying the next userdb even if I have made a imap/pop3 before the doveadm user command. Am I doing something wrong? Is there any way to flush this userdb cache (without restarting dovecot)? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

1 0

clients out of sync after restoring backup
by Frank-Ulrich Sommer 30 Oct '18

30 Oct '18

Hi, due to a failing disk I had to restore everything from a backup including dovecot (2.2.22) and the Maildir containing the stored mails. A period of some days must later be restored manuall, but that is beyond scope for this question. Naturally this causes confusion for the clients as they keep mails that are no longer on the server. That was expected but what puzzles me is that mails arriving after the succesful restore are only sporadically detected by some clients (e.g. K9 and Thunderbird) that were connected before the crash. A client that was connected for the first time after restoring from the backup works exactly as expected. Might this situation lead to reusing UUIDs that some clients still remember as belonging to a different mail? Is there a clean solution for this on the server side or is it necessary to purge locally stored data by the clients (e.g. by temporarily removing account)? Frank -- Diese Nachricht wurde von meinem Android-Mobiltelefon mit K-9 Mail gesendet.

2 1

Read the quota_exceeded_message from a file
by Maysara A. Abdulhaq 29 Oct '18

29 Oct '18

Greetings, I've been trying to have quota_exceeded_message read from a file according to https://wiki2.dovecot.org/Quota/Configuration#Custom_Quota_Exceeded_Message ; I'm running dovecot 2.2.10 on Centos 7. If I set text right to the equal sign, it works fine, but I'd rather load it from a file as I need a new line and %n and \n and simple \ followed by a newline are not working and would understandably crash the processes if malformed. nothing special about my setting, the file is located in the /etc/dovecot directory but separate from the config files (not in the conf.d directory), with a world readable permission. Regards, M.

4 6

maildirlock time unit?
by Kris von Mach 27 Oct '18

27 Oct '18

What is the time unit maildirlock will accept? I've tried 20s, 20 sec, 20 secs, 20 seconds, all results in: Fatal: Invalid timeout value: 20s And if you don't specify time unit you just get: Panic: BUG: No IOs or timeouts set. Not waiting for infinity. This is on 2.3.3. 2.2 worked fine without needing time unit specified.

3 6

Submission and CHUNKING
by Paul Hecker 26 Oct '18

26 Oct '18

Hi, It seems that there is an issue with the submission service when the SMTP server advertises chunking (I use Exim v4.91). I tried this with Dovecot v2.3.3 and current master and could reproduce it with both versions. My setup is that dovecot submission proxies to Exim on port 10025. The first mail gets through without any issues, but the second email will not get send. I had this issue at first with Apple Mail (it just sends a QUIT and shows an error) and could reproduce it with the OpenDMARC report perl script. You can find a little Perl script attached to reproduce it. It seems to me that Dovecot sends an (unexpected or mixed up) second answer to the client. If I add a “$smtp->getline();” (line 110) sending multiple emails works again. Another workaround is to disable CHUNKING in Exim (in this case only on the “proxy port”): chunking_advertise_hosts = ${if eq{$received_port}{10025}{}{*}} Thanks, Paul

2 1

[sieve] Restrict redirects to only own domain
by Yassine Chaouche 26 Oct '18

26 Oct '18

Hello list, I'd like to let my colleagues redirect mail automatically (via a sieve filter) to other mailboxes within the same domain, but deny redirects to outside mailboxes (gmail, yahoo etc.) since this is considered bad practice and could lead to blacklisting (forwarding spam for example). If I set sieve_max_redirect to 0 then no redirect is allowed, at all. I wish to let redirects to internal mailboxes still possible. Ideas ? Yassine.

3 5

SIGABRT when fetching encrypted mail with getmail
by Peter Nabbefeld 26 Oct '18

26 Oct '18

Hello, I'm stuck with receiving an encrypted email from IMAP server. My getmail configuration is (getmail --dump): getmail configuration: getmail version 5.6 Python version 2.7.15 (default, Jun 27 2018, 13:05:28) [GCC 8.1.1 20180531] retriever: SimpleIMAPSSLRetriever(ca_certs="None", certfile="None", getmaildir="/home/peter/.getmail/", keyfile="None", mailboxes="('ALL',)", move_on_delete="None", password="*", password_command="()", port="993", record_mailbox="True", server="imap.gmx.net", ssl_cert_hostname="None", ssl_ciphers="None", ssl_fingerprints="()", ssl_version="None", timeout="180", use_cram_md5="False", use_kerberos="False", use_peek="True", use_xoauth2="False", username="peter.nabbefeld(a)gmx.de") destination: MDA_external(allow_root_commands="False", arguments="('-e', '-d', 'peter.nabbefeld(a)gmx.de')", command="deliver", group="vmail", ignore_stderr="False", path="/usr/lib/dovecot/deliver", unixfrom="False", user="vmail") options: delete : True delete_after : 0 delete_bigger_than : 0 delivered_to : False fingerprint : False logfile : logfile(filename="~/.getmail/log") max_bytes_per_session : 0 max_message_size : 0 max_messages_per_session : 0 message_log : ~/.getmail/log message_log_syslog : False message_log_verbose : False read_all : True received : False verbose : 1 dovecot.log: Oct 26 07:41:20 lda(peter.nabbefeld(a)gmx.de)<24607><UvPzGACp0lsfYAAA7IIYzw>: Panic: file istream-crlf.c: line 24 (i_stream_crlf_read_common): assertion failed: (ret != -2) Oct 26 07:41:20 lda(peter.nabbefeld(a)gmx.de)<24607><UvPzGACp0lsfYAAA7IIYzw>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xe8374) [0x7f9ae5706374] -> /usr/lib/dovecot/libdovecot.so.0(+0xe83b1) [0x7f9ae57063b1] -> /usr/lib/dovecot/libdovecot.so.0(+0x44312) [0x7f9ae5662312] -> /usr/lib/dovecot/libdovecot.so.0(+0x4693f) [0x7f9ae566493f] -> /usr/lib/dovecot/libdovecot.so.0(+0xf98b6) [0x7f9ae57178b6] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x81) [0x7f9ae5713a31] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x36) [0x7f9ae5713c56] -> /usr/lib/dovecot/libdovecot.so.0(+0xfebf8) [0x7f9ae571cbf8] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x81) [0x7f9ae5713a31] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x36) [0x7f9ae5713c56] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x4c) [0x7f9ae57146ec] -> /usr/lib/dovecot/libdovecot.so.0(io_stream_copy+0x8a) [0x7f9ae572ec2a] -> /usr/lib/dovecot/libdovecot.so.0(+0x112c12) [0x7f9ae5730c12] -> /usr/lib/dovecot/libdovecot.so.0(o_stream_send_istream+0x4f) [0x7f9ae572e8bf] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_save_continue+0x2e) [0x7f9ae58a965e] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_save_continue+0x27) [0x7f9ae58480f7] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_continue+0x44) [0x7f9ae5819fb4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xf8) [0x7f9ae580b488] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_copy+0x59) [0x7f9ae5843ea9] -> /usr/lib/dovecot/libdovecot-lda.so.0(+0x3dfc) [0x7f9ae593bdfc] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0x10d7c) [0x7f9ae53b0d7c] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x58541) [0x7f9ae581a541] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x4e745) [0x7f9ae3136745] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0x50d) [0x7f9ae312c0ad] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x57139) [0x7f9ae313f139] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_multiscript_run+0xa2) [0x7f9ae3140302] -> /usr/lib/dovecot/modules/lib90_sieve_plugin.so(+0x3d49) [0x7f9ae5609d49] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0xf9) [0x7f9ae593d219] dovecot --version 2.3.3 (dcead646b) For me, it semms like there's a CRLF expected, but probably it cannot be detected correctly, since the mail is encrypted - but that's only my guess ... Any idea how to fix that? Kind regards Peter

1 0

Shared mailboxes - Can't open mailbox shared-boxes/user/name.lastname: Character not allowed in mailbox name: '.'
by Marcio Vogel Merlone dos Santos 25 Oct '18

25 Oct '18

Hi, I am trying to make shared folders work on my server (Ubuntu 18.04, Dovecot 1:2.2.33.2-1ubuntu4.1). Mails are on Maildir++ local filesystem with '.' as layout separator and ALL 100+ users logins fits a template name.lastname, with a dot in the middle. I set up listescape but no luck. When I test with doveadm: root@mail:/etc/dovecot/conf.d# doveadm acl debug -u marcio.merlone(a)a1.ind.br shared-boxes/user/name.lastname doveadm(marcio.merlone(a)a1.ind.br): Error: Can't open mailbox shared-boxes/user/name.lastname: Character not allowed in mailbox name: '.' root@mail:/etc/dovecot/conf.d# Is there something I can do besides changing layout separator? Full dovecot -n output: # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-36-generic x86_64 Ubuntu 18.04.1 LTS ext4 auth_gssapi_hostname = $ALL auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_master_user_separator = * auth_mechanisms = plain ntlm login gssapi auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.@ auth_username_format = %Ln dict { acl = mysql:/etc/dovecot/acl-dict-sql.conf } disable_plaintext_auth = no dotlock_use_excl = no first_valid_uid = 3000 hostname = smtp.a1.ind.br imap_client_workarounds = tb-extra-mailbox-sep delay-newmail last_valid_uid = 3000 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To mail_access_groups = vmail dovecot mail_fsync = always mail_gid = 3000 mail_location = maildir:/mnt/maildirs/%u/Maildir:INDEX=/mnt/maildirs/%u/index mail_plugins = acl mail_privileged_group = vmail mail_server_admin = mailto:postmaster@a1.ind.br mail_uid = 3000 mailbox_list_index = yes mailbox_list_index_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mmap_disable = yes namespace { list = yes location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u:INDEXPVT=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = proxy::acl listescape_char = \ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size sieve = file:~/Maildir/sieve/;active=~/.dovecot.sieve sieve_before = /etc/dovecot/global.sieve sieve_max_actions = 32 sieve_max_redirects = 4 } postmaster_address = postmaster(a)a1.ind.br protocols = " imap lmtp sieve sieve" quota_full_tempfail = yes service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0666 } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { process_limit = 1024 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 0 } service managesieve { process_limit = 1024 } ssl_cert = </etc/letsencrypt/live/imap.a1.ind.br/fullchain.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!RC4::!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it submission_host = localhost syslog_facility = local1 userdb { args = uid=3000 gid=3000 home=/mnt/maildirs/%Ln mail=maildir:/mnt/maildirs/%Ln/Maildir:INBOX=/mnt/maildirs/%Ln/Maildir allow_all_users=yes driver = static } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log mail_plugins = acl } protocol lda { mail_plugins = acl quota sieve acl listescape } protocol imap { mail_max_userip_connections = 300 mail_plugins = acl quota imap_quota acl imap_acl listescape } Thanks, best regards. -- *Marcio Merlone*

1 0

Exclude userdb from iterate users
by Ángel L. Mateo 25 Oct '18

25 Oct '18

Hi, I have a system with various userdbs defined, mostly all of them based on ldap (and a few passwd-files). I want one of my ldap userdbs not to be used in "doveadm user -A" commands, that is to be excluded in iterate searchs. I have no iterate_filter neither iterate_attrs configured in that userdb, but it is still used. Is it possible? How? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

1 1

Disable logging for localhost
by André Rodier 24 Oct '18

24 Oct '18

Hello Everyone, I am using Zabbix to monitor my Dovecot server, and my logs are filled with lines like this: > Oct 21 15:04:46 osaka dovecot[1256]: pop3-login: Aborted login (no auth > attempts in 0 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, > session=<bWd0nr14SuF/AAAB> > Oct 21 15:05:29 osaka dovecot[1256]: imap-login: Aborted login (no auth > attempts in 0 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, > session=<MlAGob147Jd/AAAB> How can I disable logging these actions from 127.0.0.1? Thanks, André -- https://github.com/progmaticltd/homebox

4 5

doveadm backup: Error: Both source and destination mail_location points to same directory
by Martin Johannes Dauser 24 Oct '18

24 Oct '18

Hello! I'm using 2 namespaces, "inbox" for INBOX and it's subfolders and "special" containing folders like Sent, Junk or Drafts. Though both use mdbox I decided to represent those namespaces in different locations "mdbox:~/mail" and "mdbox:~/mail_special_folders". The main reason to use 2 namespaces was to keep special_use folders out of INBOX by using the prefix attribute -- it's rather cosmetic. ├── INBOX │ ├── SubFolder1 │ ├── SubFolder2 │ └── SubFolder3 ├── Sent ├── Trash ├── Drafts ├── Junk ├── Templates ├── This is Ham └── Report Spam Now I want to export the emails of some former users to common known maildir or mbox format to be able to hand them over on CD. The problem is that a conversion with doveadm backup fails. I guess this is due to namespace special which is configured with a manual location attribute instead of utilising mail_location. But even telling doveadm to backup only one namespace leads to the identical error (extract of debug message at bottom). As this is a RHEL7 server, the dovecot version is an old 2.2.10 and I don't expect software debugging -- I just ask if I did some misconfiguration or a failure in the command. I already thought of merging the locations of both namespaces. Yet, I'm not sure how to achieve this. >From /etc/dovecot/conf.d/10-mail.conf mail_location = mdbox:~/mail namespace inbox { type = private hidden = no ignore_on_failure = no inbox = yes list = yes location = prefix = INBOX/ separator = / subscriptions = yes } namespace special { type = private hidden = no ignore_on_failure = no inbox = no list = yes location = mdbox:~/mail_special_folders prefix = separator = / subscriptions = yes } HOME is set by LDAP user_attrs = =home=/srv/mail/%Ld/%Ln,=uid=20000,=gid=20000,imapQuota=quota_rule=*:st orage=%$G Identical debug messages of following commands: # dsync -Dv backup -u bob(a)cs.sbg.ac.at maildir:/home/Mailexport/bob or # doveadm -Dv backup -u bob(a)cs.sbg.ac.at maildir:/home/Mailexport/bob or # doveadm -Dv backup -u bob(a)cs.sbg.ac.at -n inbox maildir:/home/Mailexport/bob or # doveadm -Dv backup -u bob(a)cs.sbg.ac.at -n special maildir:/home/Mailexport/bob ... doveadm(bob(a)cs.sbg.ac.at): Debug: Namespace inbox: type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mail doveadm(bob(a)cs.sbg.ac.at): Debug: fs: root=/srv/mail/cs.sbg.ac.at/bob/mail, index=, indexpvt=, control=, inbox=, alt= doveadm(bob(a)cs.sbg.ac.at): Debug: Namespace special: type=private, prefix=, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mail_special_folders doveadm(bob(a)cs.sbg.ac.at): Debug: fs: root=/srv/mail/cs.sbg.ac.at/bob/mail_special_folders, index=, indexpvt=, control=, inbox=, alt= doveadm(bob(a)cs.sbg.ac.at): Debug: Namespace INBOX/: Using permissions from /srv/mail/cs.sbg.ac.at/bob/mail: mode=0774 gid=default dsync(bob(a)cs.sbg.ac.at): Debug: Effective uid=20000, gid=20000, home=/srv/mail/cs.sbg.ac.at/bob dsync(bob(a)cs.sbg.ac.at): Debug: Quota root: name=User quota backend=dict args=:file:/srv/mail/cs.sbg.ac.at/bob/dovecot-quota ... dsync(bob(a)cs.sbg.ac.at): Debug: Namespace inbox: type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/Mailexport/bob dsync(bob(a)cs.sbg.ac.at): Debug: maildir++: root=/home/Mailexport/bob, index=, indexpvt=, control=, inbox=/home/Mailexport/bob, alt= dsync(bob(a)cs.sbg.ac.at): Debug: Namespace special: type=private, prefix=, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mail_special_folders dsync(bob(a)cs.sbg.ac.at): Debug: fs: root=/srv/mail/cs.sbg.ac.at/bob/mail_special_folders, index=, indexpvt=, control=, inbox=, alt= dsync(bob(a)cs.sbg.ac.at): Error: Both source and destination mail_location points to same directory: /srv/mail/cs.sbg.ac.at/bob/mail_special_folders/mailboxes Many thanks for any hint Martin

1 0

Bug: 'noreplicate' database extra field ingnored
by Phil 22 Oct '18

22 Oct '18

The 'noreplicate' user database field described in the wiki appears to make no difference as to whether an account gets replicated or not. My sql user query returns a 'noreplicate' field and I can confirm that this is getting set using 'doveadm user', however when I add a new account with noreplicate=true it gets replicated regardless. User query: user_query = SELECT home, uid, gid, noreplicate FROM mail_accounts WHERE address = '%u' # doveadm user user1(a)mydomain.com field value uid 1000 gid 1000 home /mail/domains/mydomain.com/user1/Maildir mail maildir:/mail/domains/mydomain.com/user1/Maildir noreplicate t # 2.3.3 (dcead646b): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.3 (f018bbab) # OS: FreeBSD 11.2-RELEASE-p4 amd64 # Hostname: mx doveadm_password = # hidden, use -P to show it doveadm_port = 2727 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep listen = * mail_location = maildir:%h managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_replica = tcps:mail2.<mydomain>.com } protocols = imap lmtp submission replication_full_sync_interval = 6 hours service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { user = vmail } user = root } service doveadm { inet_listener { port = 2727 ssl = yes } } service imap-login { inet_listener imaps { address = xxx.xxx.xxx.xxx port = 993 } process_limit = 256 process_min_avail = 6 service_count = 1 vsz_limit = 64 M } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = vmail } } ssl = required ssl_cert = </etc/ssl/certs/mail.<mydomain>.com.pem ssl_client_ca_dir = /etc/ssl/ ssl_client_ca_file = /etc/ssl/cert.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { mail_max_userip_connections = 100 } protocol lda { postmaster_address = postmaster@<mydomain>.com sendmail_path = /usr/sbin/sendmail }

2 2

Calendar function ?
by mca＠caloro.ch 22 Oct '18

22 Oct '18

Hello I running no long time with me Email System Postfix/Dovecot/mysql and i'am whery happy the feature to synchroize Calendar, or view the calender entry from me workpartner i will miss this feature, how do you handle this ? isn't possible to insert this to Dovecot or Postfix? Are this question out of topic ? or how do you implement this in our envirement ? Regards Mauri

15 19

Dovecot 2.2.13 error message
by Albert Whale 19 Oct '18

19 Oct '18

In attempting to reactivate my IMAP communications with my Email Spool (NFS Mounted), I have gotten the following while attempting to download the Emails via POP3. Oct 18 08:00:45 ns4 dovecot: pop3-login: Login: user=<aewhale>, method=PLAIN, rip=74.109.213.194, lip=66.207.133.232 Oct 18 08:02:40 ns4 dovecot: pop3(aewhale): Error: Timeout (180s) while waiting for dotlock for transaction log file /home/aewhale/Maildir/dovecot.index.log Oct 18 08:02:40 ns4 dovecot: pop3(aewhale): Disconnected: Storage error during logout. top=0/0, retr=11511/1566975544, del=11511/11511, size=1566691807 Oct 18 08:02:58 ns4 dovecot: pop3(aewhale): Connection closed top=0/0, retr=0/0, del=0/11520, size=1566929900 This is significantly more information than what I can receive from 2.1.15, but still does not resolve the communications issues. Any help is certainly appreciated. -- Albert E. Whale, CEH CHS CISA CISSP President - Chief Security Officer IT Security, Inc. <http://www.it-security-inc.com/> - A Service Disabled Veteran Owned Company - (SDVOSB) HUBZone Certified LinkedIn <https://www.linkedin.com/in/albertwhale> Profile Phone: 412-515-3010 | Email: Albert.Whale(a)IT-Security-inc.com<br> Cell: 412-889-6870

2 5

Fatal: setgid, imap connections dropped.
by J. de Meijer 19 Oct '18

19 Oct '18

Hi, I'm getting errors with my IMAP setup. Basically, everything seems to work. Mail is delivered nicely from Postfix to Dovecot via LMTP. Dovecot does the authentication to LDAP (also for Postfix). Users are able to send mail via authenticated submission (Postfix) and login into IMAP and POP. However, IMAP connections are dropped frequently with an "ERROR: Connection dropped by IMAP server.". After pressing reload on the webmail, or refreshing in the client might help for a short period. So it fails intermittently. The errors in the maillog are below. It seems to be mixing up users kind of randomly. I think when multiple connections are made at the same time. Did a lot of searching, put couldn't find an answer to this problem. All I can find is related to LDA, which I'm not using. Any help would be appreciated. Errors from the log: Sep 28 00:03:24 mailserver dovecot: imap(userD)<14864><WT8DguF2MspUUoaT>: Fatal: setgid(1012(userD) from userdb lookup) failed with euid=1011(userA), gid=1011(userA), egid=1011(userA): Operation not permitted (This binary should probably be called with process group set to 1012(userD) instead of 1011(userA)) Sep 28 00:03:24 mailserver dovecot: imap(userD)<17009><recJguF2NMpUUoaT>: Fatal: setgid(1012(userD) from userdb lookup) failed with euid=1011(userA), gid=1011(userA), egid=1011(userA): Operation not permitted (This binary should probably be called with process group set to 1012(userD) instead of 1011(userA)) Sep 28 00:03:26 mailserver dovecot: imap(userD)<12807><8T0iguF2NspUUoaT>: Fatal: setgid(1012(userD) from userdb lookup) failed with euid=1011(userA), gid=1011(userA), egid=1011(userA): Operation not permitted (This binary should probably be called with process group set to 1012(userD) instead of 1011(userA)) Sep 28 00:06:59 mailserver dovecot: imap(userD)<15661><UcfOjuF2OcpUUoaT>: Fatal: setgid(1012(userD) from userdb lookup) failed with euid=1011(userA), gid=1011(userA), egid=1011(userA): Operation not permitted (This binary should probably be called with process group set to 1012(userD) instead of 1011(userA)) Sep 28 00:07:54 mailserver dovecot: imap(userA)<45614><NVkakuF2xO5UUoaT>: Fatal: setgid(1011(userA) from userdb lookup) failed with euid=1012(userD), gid=1012(userD), egid=1012(userD): Operation not permitted (This binary should probably be called with process group set to 1011(userA) instead of 1012(userD)) Sep 28 00:08:08 mailserver dovecot: imap(userF)<45055><AWjtkuF2J/ptSCYM>: Fatal: setgid(1033(userF) from userdb lookup) failed with euid=1012(userD), gid=1012(userD), egid=1012(userD): Operation not permitted (This binary should probably be called with process group set to 1033(userF) instead of 1012(userD)) Sep 28 00:08:08 mailserver dovecot: imap(userF)<46412><87ntkuF2JvptSCYM>: Fatal: setgid(1033(userF) from userdb lookup) failed with euid=1011(userA), gid=1011(userA), egid=1011(userA): Operation not permitted (This binary should probably be called with process group set to 1033(userF) instead of 1011(userA)) Sep 28 00:08:08 mailserver dovecot: imap(userF)<44858><0nXzkuF2KfptSCYM>: Fatal: setgid(1033(userF) from userdb lookup) failed with euid=1012(userD), gid=1012(userD), egid=1012(userD): Operation not permitted (This binary should probably be called with process group set to 1033(userF) instead of 1012(userD)) Sep 28 00:08:14 mailserver dovecot: imap(userF)<36517><v/NHk+F2K/ptSCYM>: Fatal: setgid(1033(userF) from userdb lookup) failed with euid=1017(userC), gid=1017(userC), egid=1017(userC): Operation not permitted (This binary should probably be called with process group set to 1033(userF) instead of 1017(userC)) Sep 28 00:08:36 mailserver dovecot: imap(userF)<10531><wpKdlOF2MfptSCYM>: Fatal: setgid(1033(userF) from userdb lookup) failed with euid=1011(userA), gid=1011(userA), egid=1011(userA): Operation not permitted (This binary should probably be called with process group set to 1033(userF) instead of 1011(userA)) # dovecot --version 2.3.2.1 (0719df592) # 2.3.2.1 (0719df592): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.2 (7704de5e) # OS: FreeBSD 11.2-RELEASE amd64 # Hostname: callisto auth_cache_size = 10 M auth_debug = yes imap_idle_notify_interval = 29 mins mail_debug = yes mail_fsync = never mail_location = maildir:~/Maildir mail_plugins = " fts fts_solr" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = create special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { fts = solr fts_autoindex = yes fts_solr = url=http://127.0.0.1:8983/solr/dovecot/ recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /usr/local/etc/dovecot/sieve-after.d sieve_before = /usr/local/etc/dovecot/sieve-before.d sieve_quota_max_storage = 50M } protocols = imap pop3 lmtp sieve service auth { client_limit = 1600 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { address = 127.0.0.1, ::1 } process_min_avail = 3 service_count = 1 } service imap { process_min_avail = 3 service_count = 256 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { address = 127.0.0.1, ::1 } service_count = 1 } ssl = required ssl_cert = </usr/local/etc/ssl/mail.demeijer.com.dovecot.crt ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { args = /usr/local/etc/dovecot/dovecot-ldap-user.conf.ext driver = ldap } protocol lda { mail_fsync = optimized mail_plugins = " fts fts_solr sieve" } protocol imap { mail_max_userip_connections = 50 mail_plugins = " fts fts_solr imap_sieve" } protocol lmtp { lmtp_save_to_detail_mailbox = yes mail_fsync = optimized mail_plugins = " fts fts_solr quota sieve" postmaster_address = webmaster(a)example.com } In /usr/local/etc/dovecot/dovecot-ldap.conf.ext: hosts = localhost dn = cn=reader,ou=Roles,dc=example,dc=com dnpass = secretpassword auth_bind = yes base = ou=People,dc=example,dc=com deref = never scope = subtree user_attrs = uid=uid,homeDirectory=home,uidNumber=uid,gidNumber=gid user_filter = (&(objectClass=posixAccount)(uid=%n)) pass_attrs = uid=user,userPassword=password pass_filter = (&(objectClass=posixAccount)(uid=%u)) default_pass_scheme = SSHA dovecot-ldap-user.conf.ext is the same as dovecot-ldap.conf.ext # freebsd-version 11.2-RELEASE-p3 Everything is installed from ports.

2 6

trouble with ssl disable in centos 7 with version 1.0 1.2 and 3.10
by Joseph Harth 19 Oct '18

19 Oct '18

I am trying to use dovecot without ssl in centos 7. It works with imap but I am not able to make it work with pop3. Pop3 only works with ssl=yes. I can use dovecot in centos 4 ok. I get the same error with thunderbird and outlook. But for some reason it works when I telnet to port 110 and do retr 1. I was able to work pam and shadow passwords. this is the output that does not work with tls disabled Oct 18 13:30:17 auth: Debug: Loading modules from directory: /usr/lib64/dovecot/authOct 18 13:30:17 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/lib20_auth_var_expand_crypt.soOct 18 13:30:17 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.soOct 18 13:30:17 auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.datOct 18 13:30:17 auth: Debug: auth client connected (pid=22513)Oct 18 13:30:17 auth: Debug: client in: AUTH 1 PLAIN service=pop3 session=WXv1I4R4FOXAqAAK lip=192.168.0.37 rip=192.168.0.10 lport=110 rport=58644Oct 18 13:30:17 auth: Debug: client passdb out: CONT 1Oct 18 13:30:17 auth: Debug: client in: CONT 1 == (previous base64 data may contain sensitive data)Oct 18 13:30:17 auth-worker(22515): Debug: Loading modules from directory: /usr/lib64/dovecot/authOct 18 13:30:17 auth-worker(22515): Debug: Module loaded: /usr/lib64/dovecot/auth/lib20_auth_var_expand_crypt.soOct 18 13:30:17 auth-worker(22515): Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.soOct 18 13:30:17 auth-worker(22515): Debug: shadow(joe2,192.168.0.10,<WXv1I4R4FOXAqAAK>): lookupOct 18 13:30:17 auth: Debug: client passdb out: OK 1 user=joe2Oct 18 13:30:17 auth: Debug: master in: REQUEST 2718302209 22513 1 05eac7a2917ce3bc1f0f359b21b138e6 session_pid=22516Oct 18 13:30:17 auth-worker(22515): Debug: passwd(joe2,192.168.0.10,<WXv1I4R4FOXAqAAK>): lookupOct 18 13:30:17 auth: Debug: master userdb out: USER 2718302209 joe2 system_groups_user=joe2 uid=660 gid=661 home=/home/joe2Oct 18 13:30:17 pop3(joe2)<22516><WXv1I4R4FOXAqAAK>: Debug: Effective uid=660, gid=661, home=/home/joe2Oct 18 13:30:17 pop3(joe2)<22516><WXv1I4R4FOXAqAAK>: Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail/:INBOX=/var/mail/joe2Oct 18 13:30:17 pop3(joe2)<22516><WXv1I4R4FOXAqAAK>: Debug: fs: root=/home/joe2/mail, index=, indexpvt=, control=, inbox=/var/mail/joe2, alt=Oct 18 13:30:17 pop3(joe2)<22516><WXv1I4R4FOXAqAAK>: Debug: Mailbox INBOX: Mailbox opened because: POP3 INBOXOct 18 13:30:17 pop3(joe2)<22516><WXv1I4R4FOXAqAAK>: Debug: Mailbox INBOX: UID 30: Opened mail because: accessOct 18 13:30:17 pop3(joe2)<22516><WXv1I4R4FOXAqAAK>: Debug: Mailbox INBOX: UID 30: Opened mail because: RETR This is the output with TLS and it works Oct 18 13:30:32 auth: Debug: auth client connected (pid=22542)Oct 18 13:30:33 auth: Debug: client in: AUTH 1 PLAIN service=pop3 secured=tls session=44feJIR4FeXAqAAK lip=192.168.0.37 rip=192.168.0.10 lport=110 rport=58645 ssl_cipher=ECDHE-RSA-AES128-GCM-SHA256 ssl_cipher_bits=128 ssl_pfs=ECDH ssl_protocol=TLSv1.2Oct 18 13:30:33 auth: Debug: client passdb out: CONT 1Oct 18 13:30:33 auth: Debug: client in: CONT 1 == (previous base64 data may contain sensitive data)Oct 18 13:30:33 auth-worker(22515): Debug: shadow(joe2,192.168.0.10,<44feJIR4FeXAqAAK>): lookupOct 18 13:30:33 auth: Debug: client passdb out: OK 1 user=joe2Oct 18 13:30:33 auth: Debug: master in: REQUEST 4165992449 22542 1 cb03b70f92c0c5c030e25a39ea4b8518 session_pid=22543Oct 18 13:30:33 auth-worker(22515): Debug: passwd(joe2,192.168.0.10,<44feJIR4FeXAqAAK>): lookupOct 18 13:30:33 auth: Debug: master userdb out: USER 4165992449 joe2 system_groups_user=joe2 uid=660 gid=661 home=/home/joe2Oct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: Effective uid=660, gid=661, home=/home/joe2Oct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail/:INBOX=/var/mail/joe2Oct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: fs: root=/home/joe2/mail, index=, indexpvt=, control=, inbox=/var/mail/joe2, alt=Oct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: Mailbox INBOX: Mailbox opened because: POP3 INBOXOct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: Mailbox INBOX: UID 30: Opened mail because: accessOct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: Mailbox INBOX: UID 30: Opened mail because: RETROct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: Mailbox INBOX: UID 31: Opened mail because: accessOct 18 13:30:33 pop3(joe2)<22543><44feJIR4FeXAqAAK>: Debug: Mailbox INBOX: UID 31: Opened mail because: RETR

2 1

doveadm expunge with static users
by azurit＠pobox.sk 18 Oct '18

18 Oct '18

Hi, is it possible to use 'doveadm expunge' with static user database? Or can i, somehow, tell dovecot the directory location where i need to do an expunge? Thank you. azur

2 3

Ass(et) protection for mobile users
by Rupert Gallagher 18 Oct '18

18 Oct '18

Hello! Is it possible to hide the public folder when the user is on its mobile phone?

2 6

Problems recovering IMAP Data
by Albert Whale 18 Oct '18

18 Oct '18

HELP, I have experience an issue with the long running IMAP service using Dovecot 2.1.15. I have replaced the interface cards (suspected failure), and I have only recently been able to retrieve my Inbox (1.45GB) via POP3 protocol (I normally run IMAP) I am suspecting a corrupted dovecot.index, but which one? I have counted 260 files in my IMAP tree with the word dovecot. I cannot determine which folder is corrupted with 2.1.5 even with the Mail Debug option. How can I recover the use of my IMAP configuration? Thank you.

2 1

dovecot passdb driver=checkpassword as external script for block ip
by bes 18 Oct '18

18 Oct '18

Refer to https://dovecot.org/pipermail/dovecot/2015-March/099971.html https://wiki.dovecot.org/PasswordDatabase I tried to repeat the same thing. Set these passdb: passdb { args = /myscript.sh ip=%r driver = checkpassword result_failure = return-fail result_success = continue } passdb { args = /etc/dovecot/dovecot-sql.conf.ext ( my working auth method ) driver = sql } Created executable /myscript.sh: #!/bin/sh exit 1 But I saw in the logs: dovecot[15111]: auth: Error: checkpassword(techdept(a)nestormedia.com,192.168.99.128,<Mos6jW94XNzAqGOA>): Child 15115 exited with status 1 dovecot[18016]: imap-login: Login: user=....[successful login] Why result_failure=return-fail from first passdb does not work?

2 2

"Broken MIME parts for mail"
by Poliman - Serwis 18 Oct '18

18 Oct '18

I have many lines like below in error.log file: Oct 16 10:03:22 s1 dovecot: imap(artur(a)firmastanaszek.pl): Error: unlink(/var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Oct 16 10:03:22 s1 dovecot: imap(artur(a)firmastanaszek.pl): Error: Corrupted index cache file /var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 1019 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) Oct 16 10:03:23 s1 dovecot: imap(artur(a)firmastanaszek.pl): Error: unlink(/var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Oct 16 10:03:23 s1 dovecot: imap(artur(a)firmastanaszek.pl): Error: Corrupted index cache file /var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 1052 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) Oct 16 10:03:23 s1 dovecot: imap(artur(a)firmastanaszek.pl): Error: unlink(/var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Oct 16 10:03:23 s1 dovecot: imap(artur(a)firmastanaszek.pl): Error: Corrupted index cache file /var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 1098 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) I didn't do anything with Dovecot neither update in last time nor move files or something. Does anybody could tell me what above means and how to fix it?

1 0

Replication 'noreplicate' field usage
by Phil 17 Oct '18

17 Oct '18

I've set up replication as per the wiki under 2.3.3 and in my SQL user query I am returning a 'noreplicate' field, this is a boolean and returns true for all users at the moment. However when I do "doveadm replicator status '*'" it lists all users in my database suggesting it is trying to sync all users regardless of the noreplicate field. ``` user_query = SELECT home, uid, gid, noreplicate FROM users WHERE address = '%u' ``` It seems that the noreplicate field is being ignored, am I using it correctly?

1 0

: Re: Corrupted dbox file/index
by Raymond Sellars 16 Oct '18

16 Oct '18

>On Mon, Oct 15, 2018 at 08:50:21AM +0000, Raymond Sellars wrote: > > Hi > > Looking for some insight into mdbox index file management and recovery from corruptions. > What version of dovecot and what OS are you running? Is NFS linux/bsd/netapp/etc? [Raymond] Linux 2.6.32-279.19.1.el6.x86_64 Red Hat Enterprise Linux Server release 6.7 (Santiago) - its selectively patched a little higher than this. nfs-utils-1.2.3-64.el6.x86_64 nfs-utils-lib-1.1.5-11.el6.x86_64 NFS is provided by SAN array. Either Isilon SAN or VNX SAN. I believe the older Isilon with NFS. [Raymond Sellars] fstab: <ip removed>:/ mailshare-isi /mailshare nfs _netdev,noatime,vers=3,rsize=32768,wsize=32768,bg,intr,tcp 0 0 Thanks Raymond

1 0

Corrupted dbox file/index
by Raymond Sellars 15 Oct '18

15 Oct '18

Hi Looking for some insight into mdbox index file management and recovery from corruptions. I have a two node cluster on NFS with proxy director in front for user stickness. One node (a nominated master) bidirectionally replicates to a 3rd node on a DR site. We periodically get index file corruptions resulting in rebuilds. However the user experience is poor as messages read/deleted from months/years ago all reappear as unread again. We've seen corruption because of NFS NTP time sync problems, proxy not being stick, but also the DR node being off line for a while and then tripping corruption within production when it comes back on. Error message example (1 of): Error: Corrupted dbox file /mailshare/.. (removed) ../home/mail/storage/m.4 (around offset=993548): EOF reading msg header (got 0/30 bytes) https://wiki2.dovecot.org/MailboxFormat/dbox- i've read up on all the documentation I can find and understand " you must not lose the dbox index files, they can't be regenerated without data loss." Questions: #1 Any additional tips for avoiding mdbox index corruptions with dsync? Or should I revert to maildir format? I like the performance premise of the mdbox but these index corruptions are a reliability issue. #2 I'm guessing read status is one of the meta data items lost. But its seems it can't recover it from dovecot.index.backup files either. Any technique to preserve that item as its key to the user experience? #3 If index/transaction logs are so critical is there some kind of check point backups I can take? Native dovecot feature or do I need to script something. #4 I've noticed that rebuilding the index does not work if the dovecot.index.log file is lost (deleted as a hard test). The dovecot.index.cache can be but once the log file i gone messages are not automatically (or manually that i can find) recovered from the storage directory. I've not seen any dovecot.index.log file corruptions but that file seems very high risk. If rebuilding the index only from the log file or a combination process from storage directory? Is there perhaps an option to just use the transaction log and not the index? Although that doesn't sound wise for performance. #5 In additional to status UNREAD we also notice files moved to the trash reappear. Is that expected behavior? Thanks Raymond

2 1