- dovecot - dovecot.org

Re: Dovecot and OAuth2 and gmail
by Richard 14 Apr '22

14 Apr '22

> Date: Wednesday, April 13, 2022 17:10:36 -0400 > From: Steve Litt <slitt(a)troubleshooters.com> > > Hi all, > > I'm not sure Dovecot has anything to do with this, but I'd rather > ask and know for sure. > > I do the following: > > Gmail IMAP=>fetchmail=>procmail=>Dovecot IMAP > > Then, I view my Dovecot hosted email with Claws-Mail. > > I understand that on May 31, 2022, current methods to access Gmail > IMAP will turn into pumpkins because of insistence on OAuth2. Do I > need to do anything to Dovecot to get ready for this Mass > Extinction Event? > > Do you think I'll need to dump fetchmail for something else? > While it's a little obtuse, a reading of: <https://support.google.com/accounts/answer/6010255#zippy=%2Cif-less-secure-…> specifically the "fix problems" / "use an app password" section, would seem to indicate that app passwords will continue to work for gmail access after May 30. What google is turning off is "third-party apps or devices which ask you to sign in to your Google Account using only your username and password", i.e., using your google login password with "less secure" 3rd party apps. So, you need to set up, and configure your application to use, app passwords.

2 1

Dovecot and OAuth2 and gmail
by Steve Litt 14 Apr '22

14 Apr '22

Hi all, I'm not sure Dovecot has anything to do with this, but I'd rather ask and know for sure. I do the following: Gmail IMAP=>fetchmail=>procmail=>Dovecot IMAP Then, I view my Dovecot hosted email with Claws-Mail. I understand that on May 31, 2022, current methods to access Gmail IMAP will turn into pumpkins because of insistence on OAuth2. Do I need to do anything to Dovecot to get ready for this Mass Extinction Event? Do you think I'll need to dump fetchmail for something else? Thanks, SteveT Steve Litt March 2022 featured book: Making Mental Models: Advanced Edition http://www.troubleshooters.com/mmm

1 0

Permissions and ownership on /dev/shm/dovecot
by doug 12 Apr '22

12 Apr '22

Hi, Environment: Dovecot 2.3.18 running on CentOS 7, mdbox, LDAP users I'm in the process of moving my mailboxes to NFS and moving with lock and index files in temp storage following instructions from https://doc.dovecot.org/configuration_manual/nfs. I set mail_location as: mail_location = mdbox:/mailstore/%u/mail:VOLATILEDIR=/dev/shm/dovecot/%u:LISTINDEX=/dev/shm/dovecot/%u/dovecot.list.index What I discovered is /dev/shm/dovecot is created by the initial user who accesses their mail from a client, and with permissions 700. This prevents subsequent users from creating their own index and lock files. # ls -l /dev/shm/dovecot total 0 drwx------ 2 mary users 60 Mar 25 10:00 mary Sample error message from maillog during mail delivery and from a dsync script. Mar 25 10:37:15 mailsrv1 dovecot: imap(doug)<19284><WKcX5gvbRe7AqFhA>: Error: mkdir(/dev/shm/dovecot/doug) failed: Permission denied (euid=1002(doug) egid=100(users) missing +x perm: /dev/shm/dovecot, dir owned by 97:100 mode=0700) dsync(test): Error: mkdir(/dev/shm/dovecot/test) failed: Permission denied (euid=2003(test) egid=100(users) missing +x perm: /dev/shm/dovecot, dir owned by 97:100 mode=0700) I couldn't locate documentation or discussions on how to set the ownership or permissions for /dev/shm/dovecot in the Dovecot configuration files. As a hack, I added this to /usr/libexec/dovecot/prestartscript. ! [[ -d /dev/shm/dovecot ]] && mkdir /dev/shm/dovecot chown dovecot:users /dev/shm/dovecot chmod 770 /dev/shm/dovecot This solved the problem, but left me wondering if I missed something obvious or if I am setting myself up for a problem later on, like with a Dovecot version upgrade. I could run these commands at bootup out of rc.local or a systemd script rather than customizing a Dovecot provided script. Is there a appropriate way of doing this that I missed? TIA, Doug

3 6

Re: Permissions and ownership on /dev/shm/dovecot
by doug 11 Apr '22

11 Apr '22

1 0

Set up per user sieve rules
by Austin Witmer 11 Apr '22

11 Apr '22

Hello! I am struggling to wrap my mind around how to set up sieve rules for my individual users on my mail server. I set up a global sieve script file at "/var/lib/dovecot/sieve/default.sieve” and that works great. My users maildirs are located at /mnt/volume1/mailserver/maildir/user. Do I need to create a sieve script file inside of that folder for sieve scripts to work on an individual basis? If so, what permissions will that script file need? Thanks in advance for your help! Austin Witmer

4 9

Dovecot 2.3.13 virtual mailboxes subscription problem
by Slavko 10 Apr '22

10 Apr '22

Hi, by discussion on IRC channel is post details here. I am using virtual plugin in dovecot 2.3.13 and i have porblems with subsription to these virtual mailboxes. I can setup autosubscribe to them and it works as expected. I can SUBSCRIBE to them, dovecot returns OK and they are added in subscriptions file, but then they are not shown in LSUB output. I can UNSUBSCRIBE from subscribed virtual mailbox (dovecot returns OK), but it is not removed from subscriptions file and remains there... I bother with this for long time. I tried to setup mailboxes without UTF-8 chars, but that doesn't matter nad currently problematic mailbox has not any nonASCII char (Virtual.Dnes). I tried to define mailboxes in parent namespace too, doesn't help, nor defining only Virtual in parent namespace (with and without separator at end). Some evidence follows. The (my) subscriptions file (the Virtual.Dnes is at end): --------------------------------------------------------- V 2 <snip> Virtual Dnes --------------------------------------------------------- IMAP LIST (only Virtual namespace), as shown by dovecot's imap command: --------------------------------------------------------- * PREAUTH [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY STATUS=SIZE SAVEDATE LITERAL+ NOTIFY METADATA SPECIAL-USE QUOTA ACL RIGHTS=texk] Logged in as slavko(a)slavino.sk <snip> * LIST (\Noselect \HasChildren) "." Virtual * LIST (\HasNoChildren) "." Virtual.Dnes * LIST (\HasNoChildren) "." Virtual.D&APQ-le&AX4-it&AOk- * LIST (\HasNoChildren) "." Virtual.Pr&AO0-lohy * LIST (\Noselect \HasChildren) "." Verejn&AOk- * LIST (\HasNoChildren \UnMarked) "." Verejn&AOk-.Novinky . OK List completed (0.004 + 0.000 + 0.003 secs). --------------------------------------------------------- One can see that there are three virtual mailboxes, the Virtual.Dnes, the Virtual.Dôležité (encoded) and the Virtual.Prílohy (encoded too), including Virtual namespace. IMAP LSUB output (again only Virtual namespace): --------------------------------------------------------- * PREAUTH [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY STATUS=SIZE SAVEDATE LITERAL+ NOTIFY METADATA SPECIAL-USE QUOTA ACL RIGHTS=texk] Logged in as slavko(a)slavino.sk <snip> * LSUB () "." Virtual.D&APQ-le&AX4-it&AOk- * LSUB () "." Virtual.Pr&AO0-lohy a OK Lsub completed (0.001 + 0.000 secs). --------------------------------------------------------- As one can see, there are only auto-subscribed Virtual mailboxes, the Virtual.Dnes is missing, despite that it is in subscriptions file. The doveconf -n output (can be wrapped): --------------------------------------------------------- # 2.3.13 (89f716dc2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.13 (cdd19fe3) # OS: Linux 4.19.0-20-amd64 x86_64 Debian 10.12 # Hostname: servac.skk auth_default_realm = slavino.sk auth_mechanisms = plain login auth_policy_check_after_auth = no auth_policy_hash_nonce = # hidden, use -P to show it auth_policy_server_timeout_msecs = 5500 auth_policy_server_url = http://127.0.0.1:9090/ auth_verbose = yes first_valid_uid = 130 imap_idle_notify_interval = 15 mins imap_logout_format = in=%i out=%o deleted=%{deleted} expunged=%{expunged} trashed=%{trashed} hdr_count=%{fetch_hdr_count} hdr_bytes=%{fetch_hdr_bytes} body_count=%{fetch_body_count} body_bytes=%{fetch_body_bytes} autoexp=%{autoexpunged} last_valid_uid = 130 lda_original_recipient_header = Envelope-to lmtp_add_received_header = no lmtp_hdr_delivery_address = none lmtp_rcpt_check_quota = yes lmtp_save_to_detail_mailbox = yes login_trusted_networks = 127.0.0.1 ::1 mail_attachment_detection_options = add-flags no-flags-on-fetch exclude-inlined content-type=!application/*-signature content-type=!application/pgp-keys mail_attribute_dict = file:%h/dovecot-attributes mail_home = /srv/vmail/%Ln mail_location = maildir:~/Maildir mail_plugins = " acl fts fts_xapian notify quota virtual quota_clone" mail_privileged_group = mail mail_server_admin = mailto:postmaster@slavino.sk mail_vsize_bg_after_count = 100 mailbox_list_index_very_dirty_syncs = yes maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vnd.dovecot.report imapsieve vnd.dovecot.imapsieve metric imap_cmd { fields = bytes_in bytes_out filter = event=imap_command_finished } metric imap_cmdbad { filter = event=imap_command_finished AND tagged_reply_state=BAD } metric imap_cmdno { filter = event=imap_command_finished AND tagged_reply_state=NO } metric imap_cmdok { filter = event=imap_command_finished AND tagged_reply_state=OK } metric mail_deliv { fields = message_size filter = event=mail_delivery_finished } metric push_notif { filter = event=push_notification_finished } metric sieve_actions { filter = event=sieve_action_finished } metric sieve_scrrun { filter = event=sieve_runtime_script_finished } namespace Virtual { list = yes location = virtual:/usr/local/etc/vmail/virtual:INDEX=~/virtual:UTF-8 mailbox Dôležité { auto = subscribe } mailbox Dnes { auto = no } mailbox Prílohy { auto = subscribe } prefix = Virtual. separator = . subscriptions = no } namespace inbox { inbox = yes location = mailbox Archive { auto = create special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox Verejné.Novinky { auto = subscribe } prefix = separator = . } namespace pub { ignore_on_failure = yes location = maildir:/srv/vmail-public:INDEXPVT=~/public:UTF-8 prefix = Verejné. separator = . subscriptions = no type = public } namespace share { list = children location = maildir:%%h/Maildir:INDEXPVT=~/shared/%%u prefix = Zdieľané.%%u. separator = . subscriptions = no type = shared } passdb { args = username_format=%Ln /usr/local/etc/vmail/passwd.%{if;%Ls;eq;smtp;%Ls;empty} auth_verbose = no driver = passwd-file } passdb { args = username_format=%Ln scheme=ssha256 /usr/local/etc/vmail/passwd driver = passwd-file } plugin { acl = vfile:/etc/dovecot/dovecot-acl acl_shared_dict = file:/usr/local/etc/vmail/shared/shared-mailboxes.db fts = xapian fts_autoindex = yes fts_autoindex_exclude = \Junk fts_autoindex_exclude2 = \Trash fts_autoindex_exclude3 = \Drafts fts_autoindex_exclude4 = Junk fts_autoindex_exclude5 = Trash fts_autoindex_exclude6 = Drafts fts_autoindex_exclude7 = Sent fts_autoindex_exclude8 = Verejné.* fts_autoindex_exclude9 = Virtual.* fts_autoindex_max_recent_msgs = 99 fts_decoder = decode2text fts_enforced = yes fts_index_timeout = 90s fts_xapian = partial=2 full=20 attachments=1 verbose=0 imapsieve_mailbox1_before = file:/usr/local/etc/vmail/sieve/imap/trash-seen.sieve imapsieve_mailbox1_causes = COPY APPEND imapsieve_mailbox1_name = Trash imapsieve_mailbox2_before = file:/usr/local/etc/vmail/sieve/imap/report-spam.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_name = Junk imapsieve_mailbox3_before = file:/usr/local/etc/vmail/sieve/imap/report-ham.sieve imapsieve_mailbox3_causes = COPY imapsieve_mailbox3_from = Junk imapsieve_mailbox3_name = * mail_log_cached_only = yes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename append mail_log_fields = uid box msgid size quota = count:User quota quota_clone_dict = redis:host=127.0.0.1:port=6379:prefix=dovec/:expire_secs=2592000 quota_exceeded_message = Mailbox is full quota_grace = 50M quota_max_mail_size = 50M quota_rule = *:storage=3G quota_rule2 = Trash:storage=+50M quota_rule3 = Junk:storage=+100M quota_rule4 = Sent:storage=+100M quota_vsizes = true sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /usr/local/etc/vmail/sieve/before.d/spam-move.sieve sieve_global_extensions = +vnd.dovecot.filter +vnd.dovecot.execute sieve_implicit_extensions = +vnd.dovecot.report sieve_max_redirects = 0 sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = " imap lmtp sieve pop3" quota_full_tempfail = yes service anvil { unix_listener anvil { group = $default_internal_group mode = 0660 } } service auth { unix_listener auth-client { mode = 0666 } } service decode2text { executable = script /usr/lib/dovecot/decode2text.sh unix_listener decode2text { group = vmail mode = 0660 } user = vmail } service imap-login { inet_listener imap { address = 127.0.0.1 ::1 } process_min_avail = 2 service_count = 100 unix_listener imap { group = www-data mode = 0660 } } service indexer-worker { vsz_limit = 2 G } service lmtp { executable = lmtp -L inet_listener lmtp { address = 127.0.0.1 ::1 port = 24 } unix_listener lmtp { group = Debian-exim mode = 0660 } user = vmail } service managesieve-login { service_count = 100 vsz_limit = 64 M } service managesieve { process_limit = 256 } service pop3-login { inet_listener pop3 { port = 0 } service_count = 100 } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener quota-status { group = Debian-exim mode = 0660 } } service stats { unix_listener stats-reader { group = $default_internal_group mode = 0660 } } ssl_cert = </etc/letsencrypt/live/slavino.sk/fullchain.pem ssl_cipher_list = HIGH:!kRSA:!SRP:!PSK:!DH:!eNULL:!aNULL:!SHA1:!CAMELLIA:+AESGCM:+AES256:+SHA256:+SHA384:+AES128:+AES256 ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes submission_host = 127.0.0.1:25 userdb { args = username_format=%Ln /usr/local/etc/vmail/passwd default_fields = uid=vmail gid=vmail driver = passwd-file } verbose_proctitle = yes protocol lmtp { info_log_path = /var/log/dovecot/lmtp.log log_path = /var/log/dovecot/lmtp-errors.log mail_plugins = " acl fts fts_xapian notify quota virtual quota_clone push_notification sieve" } protocol imap { imap_metadata = yes mail_plugins = " acl fts fts_xapian notify quota virtual quota_clone imap_quota imap_sieve imap_acl" namespace inbox { location = mailbox Drafts { autoexpunge = 4 weeks } mailbox Junk { autoexpunge = 2 weeks } mailbox Sent { autoexpunge = 60 days } mailbox Trash { autoexpunge = 4 weeks autoexpunge_max_mails = 1000 } prefix = } } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole } protocol pop3 { mail_plugins = " acl fts fts_xapian notify quota virtual quota_clone" } local_name servac.slavino.org { ssl_cert = </etc/letsencrypt/live/slavino.org/fullchain.pem ssl_key = # hidden, use -P to show it } local_name servac.skk { ssl_cert = </etc/dovecot/private/servac.pem ssl_key = # hidden, use -P to show it } --------------------------------------------------------- If you need something more, be free to contact me... regards -- Slavko https://www.slavino.sk

2 1

What is the current state of High Availability Dovecot ?
by White, Daniel E. (GSFC-770.0)[NICS] 10 Apr '22

10 Apr '22

… without going to too much fuss ? Searching the Internet produces a lot of old results and many overly complicated results. My only complication is that I am using PostfixAdmin for mailbox management, and all the mailboxes are virtual. Thanks.

2 1

Postfix - Dovecot alias
by John Doe 09 Apr '22

09 Apr '22

Hello, I have the problem with aliases. The emails did not delivery to correct email. I send email to email: to_alias(a)domain.com that is valid alias and email should be sent to real email folder: to(a)domain.com. Dovecot creating to_alias folder and deliver the emails there. Here is the email log: / did not see to(a)domain.com below / Apr 5 18:54:40 www postfix/smtpd[30547]: connect from mail-40137.protonmail.ch[185.70.40.137] Apr 5 18:54:40 www postfix/smtpd[30547]: Anonymous TLS connection established from mail-40137.protonmail.ch[185.70.40.137]: TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-384) server-digest SHA384 Apr 5 18:54:52 www postfix/smtpd[30547]: 85A412E19B6: client= mail-40137.protonmail.ch[185.70.40.137] Apr 5 18:54:52 www postfix/cleanup[30556]: 85A412E19B6: message-id=<M07eijxF0PArGZ92wKYpeCndUNv5g3kSEgYljlhYwOVPxIor3AmNRxrPyNK9T8GcncG1dmxS6Lv35IfR5ompsUPEGPucNn9SjxkMxAgHzhI=@ protonmail.com> Apr 5 18:54:53 www dccifd[1856]: stat(log directory "log"): No such file or directory Apr 5 18:54:57 www postfix/qmgr[1398]: 85A412E19B6: from=< from(a)protonmail.com>, size=2767, nrcpt=1 (queue active) Apr 5 18:54:57 www postfix/smtpd[30547]: disconnect from mail-40137.protonmail.ch[185.70.40.137] ehlo=2 starttls=1 mail=1 rcpt=1 data=1 quit=1 commands=7 Apr 5 18:54:57 www dovecot: lmtp(30559): Connect from local Apr 5 18:54:57 www dovecot: lmtp(compiz(a)domain.com)<30559><U8KALFFmTGJfdwAA8oMCvw>: sieve: msgid=<M07eijxF0PArGZ92wKYpeCndUNv5g3kSEgYljlhYwOVPxIor3AmNRxrPyNK9T8GcncG1dmxS6Lv35IfR5ompsUPEGPucNn9SjxkMxAgHzhI=@ protonmail.com>: stored mail into mailbox 'INBOX' Apr 5 18:54:57 www postfix/lmtp[30558]: 85A412E19B6: to=< to_alias(a)domain.com>, relay=mail.domain.com[private/dovecot-lmtp], delay=17, delays=17/0.01/0.01/0.01, dsn=2.0.0, status=sent (250 2.0.0 < to_alias(a)domain.com> U8KALFFmTGJfdwAA8oMCvw Saved) Apr 5 18:54:57 www dovecot: lmtp(30559): Disconnect from local: Logged out (state=READY) Apr 5 18:54:57 www postfix/qmgr[1398]: 85A412E19B6: removed I was playing with password_query but not sure did I'm on right direction. password_query = \ SELECT username AS user, password, \ '/var/spool/postmail/%d/%n' AS userdb_home, 1002 AS userdb_uid, 1001 AS userdb_gid \ FROM mailbox WHERE username = (SELECT goto FROM alias WHERE address = '%u') I'm using dovecot --version: 2.3.18 (9dd8408c18) and my configuration is: # 2.3.18 (9dd8408c18): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: Linux 5.17.0 x86_64 Slackware 15.0+ ext4 # Hostname: www.ixip.net base_dir = /var/run/dovecot/ default_login_user = nobody dict { driver = sql quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:/var/spool/postmail/%d/%n/Maildir mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = /var/spool/postmail/%d/%n/.dovecot.sieve sieve_dir = /var/spool/postmail/%d/%n/sieve/ sieve_global_dir = /var/lib/dovecot/sieve sieve_global_path = /var/lib/dovecot/sieve/default.sieve } protocols = imap lmtp sieve sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { address = 127.0.0.1 port = 993 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } service_count = 1 vsz_limit = 64 M } ssl_cert = </etc/postfix/ssl/mail.stzbg.com.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = uid=1002 gid=1001 home=/var/spool/postmail/%d/%n allow_all_users=yes driver = static } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole } # grep -v '^ *$#.*$\?$' dovecot-sql.conf.ext driver = mysql connect = host=localhost dbname=postfix user=postfix password=password default_pass_scheme = CRYPT password_query = SELECT username AS user, password FROM mailbox WHERE username = '%u'; Kind Regards, Chris

3 4

Auth by ip address
by Vlastimil Wagner 09 Apr '22

09 Apr '22

Hi is possible authentication by ip address in dovecot? What i need. Now auth is by PAM (Active directory), i want application password (its plugin to Roundcube, passwords in mysql) for example android email client. I know that Multiple Authentication Databases work but i want when user auth from public network use sql and when from internal network use both sql and then pam. thanks for help Bukowski

3 2

Unable to write *.sieve files while Dovecot is running
by Ralph Seichter 08 Apr '22

08 Apr '22

I noticed lately that I can no longer modify *.sieve files while Dovecot is running. Write operations appear not to be permitted anymore: $ echo >> example.sieve zsh: permission denied: example.sieve Text editors like vim cannot write either. Since I used to be able to modify Sieve source files on the fly, I am wondering if the behaviour I see nowadays is intentional? Doveconf reports the following versions: # 2.3.14.1 (9f0cfb6426): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.14 (1b5c82b2) # OS: Linux 5.17.1-gentoo-r1-x86_64 x86_64 Gentoo Base System release 2.7 -Ralph

5 5

Problem with initial sync on new mailbox in a replicated setup
by ppq＠tuta.io 07 Apr '22

07 Apr '22

Hello, I run a two-node replicated setup with director + dovecot and replication between the two nodes. The setup is a couple of years old and has been working properly until recently, so I suspect some type of regression. I'm having an issue with replication and merging of newly created mailboxes. Old mailboxes work properly. When creating a new mailbox, the two nodes will not replicate and sync the new mailbox. I have to manually "merge" the mailbox via a "doveadm sync -1f..." command, after which all works properly. This has not been the case in the past, so I'm trying to debug the issue. When syncing manually, I get the following error: ----------------------------- # doveadm -v sync -df -u 'testaccount(a)mydomain.ext' doveadm(testaccount(a)mydomain.ext)<38041><wl3tAQ5LTWKZlAAAxdOQ8Q>: Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID 6bfcbb2f92484d624b890000c5d390f1 (maybe it was just deleted?) ---------------------------- I have to sync once with a one-way merge using sync -1f and after the sync works properly. My setup is running Dovecot CE 2:2.3.18-4+debian11 from the dovecot.org repository installed on debian bullseye. The replicaiton is dove via TCP plaintext connection. Below I'm attaching some debug logs, for both sync -1f and sync -f. Is this a normal behavior or is this a bug ? Kind regards, Dave ---- CUT ---- # doveadm -v sync -df -u 'testaccount(a)mydomain.ext' Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm 2022-04-06 10:12:17 Debug: Loading modules from directory: /usr/lib/dovecot/modules 2022-04-06 10:12:17 Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so 2022-04-06 10:12:17 Debug: Module loaded: /usr/lib/dovecot/modules/lib02_lazy_expunge_plugin.so 2022-04-06 10:12:17 Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so 2022-04-06 10:12:17 Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so 2022-04-06 10:12:17 Debug: Module loaded: /usr/lib/dovecot/modules/lib20_replication_plugin.so 2022-04-06 10:12:17 Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm 2022-04-06 10:12:17 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so 2022-04-06 10:12:17 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: passdb lookup(testaccount(a)mydomain.ext): Started passdb lookup 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb (pid=181,uid=0): Client connected (fd=9) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: passdb lookup(testaccount(a)mydomain.ext): auth PASS input: user=testaccount(a)mydomain.ext 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: passdb lookup(testaccount(a)mydomain.ext): Finished passdb lookup (user=testaccount(a)mydomain.ext ) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><>: Debug: auth-master: userdb lookup(testaccount(a)mydomain.ext): Started userdb lookup 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><>: Debug: auth-master: userdb lookup(testaccount(a)mydomain.ext): auth USER input: testaccount(a)mydomain.ext home=/var/vmail/mydomain.ext/testaccount <http://mydomain.ext/testaccount> mail=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> uid=5000 gid=5000 quota_rule=*:storage=0B sieve=/var/vmail/mydomain.ext/testaccount/.sieve <http://mydomain.ext/testaccount/.sieve> 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><>: Debug: auth-master: userdb lookup(testaccount(a)mydomain.ext): Finished userdb lookup (username=testaccount(a)mydomain.ext home=/var/vmail/mydomain.ext/testaccount <http://mydomain.ext/testaccount> mail=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> uid=5000 gid=5000 quota_rule=*:storage=0B sieve=/var/vmail/mydomain.ext/testaccount/.sieve <http://mydomain.ext/testaccount/.sieve>) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><>: Debug: Added userdb setting: mail=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><>: Debug: Added userdb setting: plugin/quota_rule=*:storage=0B 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><>: Debug: Added userdb setting: plugin/sieve=/var/vmail/mydomain.ext/testaccount/.sieve <http://mydomain.ext/testaccount/.sieve> 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Effective uid=5000, gid=5000, home=/var/vmail/mydomain.ext/testaccount <http://mydomain.ext/testaccount> 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: acl: No acl_shared_dict setting - shared mailbox listing is disabled 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Quota root: name=user backend=dict args=:file:/var/vmail/mydomain.ext/testaccount/.quotausage <http://mydomain.ext/testaccount/.quotausage> 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Quota rule: root=user mailbox=* bytes=0 messages=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Quota rule: root=user mailbox=EXPUNGED ignored 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Quota grace: root=user bytes=0 (10%) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: quota-dict: user=testaccount(a)mydomain.ext, uri=file:/var/vmail/mydomain.ext/testaccount/.quotausage <http://mydomain.ext/testaccount/.quotausage>, noenforcing=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): dict created (uri=file:/var/vmail/mydomain.ext/testaccount/.quotausage <http://mydomain.ext/testaccount/.quotausage>, base_dir=/var/run/dovecot) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: maildir++: root=/var/vmail/mydomain.ext/testaccount/Maildir <http://mydomain.ext/testaccount/Maildir>, index=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/idx>, indexpvt=, control=, inbox=/var/vmail/mydomain.ext/testaccount/Maildir <http://mydomain.ext/testaccount/Maildir>, alt= 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot.acl 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: acl: acl username = testaccount(a)mydomain.ext 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: acl: owner = 1 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: acl vfile: Global ACL file: /etc/dovecot/dovecot.acl 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: quota: quota_over_flag check: quota_over_script unset - skipping 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: brain M: Namespace has location maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'INBOX' matches global ACL pattern '*' 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/dovecot-acl <http://mydomain.ext/testaccount/Maildir/dovecot-acl> not found 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox '' matches global ACL pattern '*' 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Trash' matches global ACL pattern '*' 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Trash/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Trash/dovecot-acl> not found 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Trash: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Sent' matches global ACL pattern '*' 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Sent/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Sent/dovecot-acl> not found 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Sent: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Junk' matches global ACL pattern '*' 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Junk/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Junk/dovecot-acl> not found 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Junk: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Drafts' matches global ACL pattern '*' 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Drafts/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Drafts/dovecot-acl> not found 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Drafts: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox INBOX: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext): Debug: Namespace : Using permissions from /var/vmail/mydomain.ext/testaccount/Maildir <http://mydomain.ext/testaccount/Maildir>: mode=0700 gid=default 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Local mailbox tree: INBOX guid=08b6a62792484d624b890000c5d390f1 uid_validity=1649232018 uid_next=2 subs=no last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Drafts guid=6bfcbb2f92484d624b890000c5d390f1 uid_validity=1649232022 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Junk guid=6afcbb2f92484d624b890000c5d390f1 uid_validity=1649232021 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Sent guid=69fcbb2f92484d624b890000c5d390f1 uid_validity=1649232020 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Trash guid=68fcbb2f92484d624b890000c5d390f1 uid_validity=1649232019 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: INBOX guid=4d70ba2389484d628fa91300660b22f9 uid_validity=1649232013 uid_next=1 subs=no last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Junk guid=4c70ba2389484d628fa91300660b22f9 uid_validity=1649232012 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Drafts guid=4b70ba2389484d628fa91300660b22f9 uid_validity=1649232011 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Sent guid=4a70ba2389484d628fa91300660b22f9 uid_validity=1649232010 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Trash guid=4970ba2389484d628fa91300660b22f9 uid_validity=1649232009 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Mailbox Drafts: local=6bfcbb2f92484d624b890000c5d390f1/0/1, remote=4b70ba2389484d628fa91300660b22f9/0/1: GUIDs conflict - will be merged later 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Mailbox INBOX: local=08b6a62792484d624b890000c5d390f1/0/1, remote=4d70ba2389484d628fa91300660b22f9/0/1: GUIDs conflict - will be merged later 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Mailbox Junk: local=6afcbb2f92484d624b890000c5d390f1/0/1, remote=4c70ba2389484d628fa91300660b22f9/0/1: GUIDs conflict - will be merged later 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Mailbox Sent: local=69fcbb2f92484d624b890000c5d390f1/0/1, remote=4a70ba2389484d628fa91300660b22f9/0/1: GUIDs conflict - will be merged later 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Mailbox Trash: local=68fcbb2f92484d624b890000c5d390f1/0/1, remote=4970ba2389484d628fa91300660b22f9/0/1: GUIDs conflict - will be merged later 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Drafts: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Drafts: Rotated transaction log /var/vmail-local/mydomain.ext/testaccount/idx/.Drafts/dovecot.index.log <http://mydomain.ext/testaccount/idx/.Drafts/dovecot.index.log> (seq=11, reset=yes) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Drafts: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox INBOX: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox INBOX: Rotated transaction log /var/vmail-local/mydomain.ext/testaccount/idx/.INBOX/dovecot.index.log <http://mydomain.ext/testaccount/idx/.INBOX/dovecot.index.log> (seq=11, reset=yes) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox INBOX: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Junk: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Junk: Rotated transaction log /var/vmail-local/mydomain.ext/testaccount/idx/.Junk/dovecot.index.log <http://mydomain.ext/testaccount/idx/.Junk/dovecot.index.log> (seq=11, reset=yes) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Junk: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Sent: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Sent: Rotated transaction log /var/vmail-local/mydomain.ext/testaccount/idx/.Sent/dovecot.index.log <http://mydomain.ext/testaccount/idx/.Sent/dovecot.index.log> (seq=11, reset=yes) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Sent: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Trash: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Trash: Rotated transaction log /var/vmail-local/mydomain.ext/testaccount/idx/.Trash/dovecot.index.log <http://mydomain.ext/testaccount/idx/.Trash/dovecot.index.log> (seq=11, reset=yes) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Trash: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Drafts: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Change during sync: Remote lost mailbox GUID 4b70ba2389484d628fa91300660b22f9 (maybe it was just deleted?) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox INBOX: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Change during sync: Remote lost mailbox GUID 4d70ba2389484d628fa91300660b22f9 (maybe it was just deleted?) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Junk: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Change during sync: Remote lost mailbox GUID 4c70ba2389484d628fa91300660b22f9 (maybe it was just deleted?) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Sent: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Change during sync: Remote lost mailbox GUID 4a70ba2389484d628fa91300660b22f9 (maybe it was just deleted?) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: Mailbox Trash: Mailbox opened 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: brain M: Change during sync: Remote lost mailbox GUID 4970ba2389484d628fa91300660b22f9 (maybe it was just deleted?) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID 4b70ba2389484d628fa91300660b22f9 (maybe it was just deleted?) 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:12:17 doveadm(testaccount(a)mydomain.ext)<38324><WJH0HGFLTWK0lQAAxdOQ8Q>: Debug: dict(file): dict destroyed 2022-04-06 10:12:17 doveadm(38324): Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb (pid=181,uid=0): Disconnected: Connection closed (fd=9) ------------------------- CUT ------------------------------------- Here's the sync with merge: ------------------- CUT ---------------------------------- # doveadm -v sync -1df -u 'testaccount(a)mydomain.ext' Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm 2022-04-06 10:13:25 Debug: Loading modules from directory: /usr/lib/dovecot/modules 2022-04-06 10:13:25 Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so 2022-04-06 10:13:25 Debug: Module loaded: /usr/lib/dovecot/modules/lib02_lazy_expunge_plugin.so 2022-04-06 10:13:25 Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so 2022-04-06 10:13:25 Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so 2022-04-06 10:13:25 Debug: Module loaded: /usr/lib/dovecot/modules/lib20_replication_plugin.so 2022-04-06 10:13:25 Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm 2022-04-06 10:13:25 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so 2022-04-06 10:13:25 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: passdb lookup(testaccount(a)mydomain.ext): Started passdb lookup 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb (pid=181,uid=0): Client connected (fd=9) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: passdb lookup(testaccount(a)mydomain.ext): auth PASS input: user=testaccount(a)mydomain.ext 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: auth-master: passdb lookup(testaccount(a)mydomain.ext): Finished passdb lookup (user=testaccount(a)mydomain.ext ) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><>: Debug: auth-master: userdb lookup(testaccount(a)mydomain.ext): Started userdb lookup 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><>: Debug: auth-master: userdb lookup(testaccount(a)mydomain.ext): auth USER input: testaccount(a)mydomain.ext home=/var/vmail/mydomain.ext/testaccount <http://mydomain.ext/testaccount> mail=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> uid=5000 gid=5000 quota_rule=*:storage=0B sieve=/var/vmail/mydomain.ext/testaccount/.sieve <http://mydomain.ext/testaccount/.sieve> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><>: Debug: auth-master: userdb lookup(testaccount(a)mydomain.ext): Finished userdb lookup (username=testaccount(a)mydomain.ext home=/var/vmail/mydomain.ext/testaccount <http://mydomain.ext/testaccount> mail=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> uid=5000 gid=5000 quota_rule=*:storage=0B sieve=/var/vmail/mydomain.ext/testaccount/.sieve <http://mydomain.ext/testaccount/.sieve>) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><>: Debug: Added userdb setting: mail=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><>: Debug: Added userdb setting: plugin/quota_rule=*:storage=0B 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><>: Debug: Added userdb setting: plugin/sieve=/var/vmail/mydomain.ext/testaccount/.sieve <http://mydomain.ext/testaccount/.sieve> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Effective uid=5000, gid=5000, home=/var/vmail/mydomain.ext/testaccount <http://mydomain.ext/testaccount> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl: No acl_shared_dict setting - shared mailbox listing is disabled 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Quota root: name=user backend=dict args=:file:/var/vmail/mydomain.ext/testaccount/.quotausage <http://mydomain.ext/testaccount/.quotausage> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Quota rule: root=user mailbox=* bytes=0 messages=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Quota rule: root=user mailbox=EXPUNGED ignored 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Quota grace: root=user bytes=0 (10%) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: quota-dict: user=testaccount(a)mydomain.ext, uri=file:/var/vmail/mydomain.ext/testaccount/.quotausage <http://mydomain.ext/testaccount/.quotausage>, noenforcing=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): dict created (uri=file:/var/vmail/mydomain.ext/testaccount/.quotausage <http://mydomain.ext/testaccount/.quotausage>, base_dir=/var/run/dovecot) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: maildir++: root=/var/vmail/mydomain.ext/testaccount/Maildir <http://mydomain.ext/testaccount/Maildir>, index=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/idx>, indexpvt=, control=, inbox=/var/vmail/mydomain.ext/testaccount/Maildir <http://mydomain.ext/testaccount/Maildir>, alt= 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot.acl 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl: acl username = testaccount(a)mydomain.ext 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl: owner = 1 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl vfile: Global ACL file: /etc/dovecot/dovecot.acl 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: quota: quota_over_flag check: quota_over_script unset - skipping 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: brain M: Namespace has location maildir:/var/vmail/mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext/testaccount/idx <http://mydomain.ext/testaccount/Maildir:INDEX=/var/vmail-local/mydomain.ext…> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'INBOX' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/dovecot-acl <http://mydomain.ext/testaccount/Maildir/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox '' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Trash' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Trash/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Trash/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Trash: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Sent' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Sent/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Sent/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Sent: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Junk' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Junk/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Junk/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Junk: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox 'Drafts' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Drafts/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Drafts/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox Drafts: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Mailbox INBOX: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext): Debug: Namespace : Using permissions from /var/vmail/mydomain.ext/testaccount/Maildir <http://mydomain.ext/testaccount/Maildir>: mode=0700 gid=default 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Local mailbox tree: INBOX guid=4d70ba2389484d628fa91300660b22f9 uid_validity=1649232013 uid_next=2 subs=no last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Drafts guid=4b70ba2389484d628fa91300660b22f9 uid_validity=1649232011 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Junk guid=4c70ba2389484d628fa91300660b22f9 uid_validity=1649232012 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Sent guid=4a70ba2389484d628fa91300660b22f9 uid_validity=1649232010 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Local mailbox tree: Trash guid=4970ba2389484d628fa91300660b22f9 uid_validity=1649232009 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: INBOX guid=08b6a62792484d624b890000c5d390f1 uid_validity=1649232018 uid_next=1 subs=no last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Junk guid=6afcbb2f92484d624b890000c5d390f1 uid_validity=1649232021 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Drafts guid=6bfcbb2f92484d624b890000c5d390f1 uid_validity=1649232022 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Sent guid=69fcbb2f92484d624b890000c5d390f1 uid_validity=1649232020 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Remote mailbox tree: Trash guid=68fcbb2f92484d624b890000c5d390f1 uid_validity=1649232019 uid_next=1 subs=yes last_change=0 last_subs=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Mailbox Drafts: local=4b70ba2389484d628fa91300660b22f9/0/1, remote=6bfcbb2f92484d624b890000c5d390f1/0/1: GUIDs conflict - will be merged later 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Mailbox INBOX: local=4d70ba2389484d628fa91300660b22f9/0/1, remote=08b6a62792484d624b890000c5d390f1/0/1: GUIDs conflict - will be merged later 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Mailbox Junk: local=4c70ba2389484d628fa91300660b22f9/0/1, remote=6afcbb2f92484d624b890000c5d390f1/0/1: GUIDs conflict - will be merged later 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Mailbox Sent: local=4a70ba2389484d628fa91300660b22f9/0/1, remote=69fcbb2f92484d624b890000c5d390f1/0/1: GUIDs conflict - will be merged later 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: brain M: Mailbox Trash: local=4970ba2389484d628fa91300660b22f9/0/1, remote=68fcbb2f92484d624b890000c5d390f1/0/1: GUIDs conflict - will be merged later 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox Drafts: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox 'Drafts' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Drafts/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Drafts/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox INBOX: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: doveadm-sieve: Iterating Sieve mailbox attributes 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: Pigeonhole version 0.5.18 (0bc28b32) initializing 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: Performing auto-detection 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: Use home (/var/vmail/mydomain.ext/testaccount <http://mydomain.ext/testaccount>) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: Using active Sieve script path: /var/vmail/mydomain.ext/testaccount/.sieve <http://mydomain.ext/testaccount/.sieve> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: Using script storage path: /var/vmail/mydomain.ext/testaccount/sieve <http://mydomain.ext/testaccount/sieve> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: Using permissions from /var/vmail/mydomain.ext/testaccount/sieve <http://mydomain.ext/testaccount/sieve>: mode=0700 gid=-1 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: Created storage directory /var/vmail/mydomain.ext/testaccount/sieve/tmp <http://mydomain.ext/testaccount/sieve/tmp> 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: sieve: file storage: sync: Synchronization active 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox 'INBOX' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/dovecot-acl <http://mydomain.ext/testaccount/Maildir/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox INBOX: UID 1: Opened mail because: prefetch 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox INBOX: Adding field date.received to cache for the first time (uid=1) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox INBOX: Adding field date.save to cache for the first time (uid=1) 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox INBOX: Purging (new file_seq=1649232805): creating cache 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox INBOX: Purging finished, file_seq changed 1649232018 -> 1649232805, size=676 -> 172, max_uid=0 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox Junk: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox 'Junk' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Junk/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Junk/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox Sent: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox 'Sent' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Sent/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Sent/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox Trash: Mailbox opened 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: Mailbox 'Trash' matches global ACL pattern '*' 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: acl vfile: file /var/vmail/mydomain.ext/testaccount/Maildir/.Trash/dovecot-acl <http://mydomain.ext/testaccount/Maildir/.Trash/dovecot-acl> not found 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): Waiting for dict to finish pending operations 2022-04-06 10:13:25 doveadm(testaccount(a)mydomain.ext)<38465><+7naC6VLTWJBlgAAxdOQ8Q>: Debug: dict(file): dict destroyed 2022-04-06 10:13:25 doveadm(38465): Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb (pid=181,uid=0): Disconnected: Connection closed (fd=9) ------------------------ CUT --------------------------------------

2 1

resend whole inbox to user
by Marc 07 Apr '22

07 Apr '22

I was wondering if there is some way to force an imap client to 're-download' all the messages from the inbox. I can remember in the 'old days' that when the connection was dropped during a pop download, the whole inbox was re-downloaded, resulting in quite a lot of duplicates. I am looking for such action.

6 6

macOS ManageSieve client?
by Gerben Wierda 07 Apr '22

07 Apr '22

I have a dovecot & dovecot-sieve running under MacPorts on my macOS ’server’. I do a very low tech maintenance on sieve, by using the cli on the server and edit sieve by hand for myself. I’d like to open this up to other users. How do people use this from their macOS clients? For this, the ManageSieve protocol exists and this is implemented by dovecot-sieve, but other than installing roundcube and offering a web-based mail client that also supports ManageSieve, is there another way? A ManageSieve client that directly runs on the macOS client and interfaces with dovecot-sieve on the server? After all, routing mail to different mailboxes better happens server-side so that all clients profit. Gerben Wierda (LinkedIn <https://www.linkedin.com/in/gerbenwierda>) R&A IT Strategy <https://ea.rna.nl/> (main site) Book: Chess and the Art of Enterprise Architecture <https://ea.rna.nl/the-book/> Book: Mastering ArchiMate <https://ea.rna.nl/the-book-edition-iii/>

6 5

remove duplicate emails
by Jean-Max Reymond 06 Apr '22

06 Apr '22

Hi, I have postfix running and sometimes and I have some duplicate emails with the same Message-ID. With dovecot sieve, I understand that duplicate option remove these emails but I don't understand the configuration to apply. Thanks for your tips, # doveconf -n # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.7.2 () # OS: Linux 5.4.0-104-generic x86_64 Ubuntu 20.04.4 LTS # Hostname: B7B3274.online-server.cloud auth_mechanisms = plain login first_valid_uid = 8 log_path = /var/log/dovecot.log mail_location = maildir:~ managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/letsencrypt/live/mail.maxou.fr/fullchain.pem ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 50 } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = postmaster quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r }

3 3

Postfix - Dovecot alias
by John Doe 06 Apr '22

06 Apr '22

Hello, I have the problem with aliases. The emails did not delivery to correct email. I send email to email: to_alias(a)domain.com that is valid alias and email should be sent to real email folder: to(a)domain.com. Dovecot creating to_alias folder and deliver the emails there. Here is the email log: / did not see to(a)domain.com below / Apr 5 18:54:40 www postfix/smtpd[30547]: connect from mail-40137.protonmail.ch[185.70.40.137] Apr 5 18:54:40 www postfix/smtpd[30547]: Anonymous TLS connection established from mail-40137.protonmail.ch[185.70.40.137]: TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-384) server-digest SHA384 Apr 5 18:54:52 www postfix/smtpd[30547]: 85A412E19B6: client= mail-40137.protonmail.ch[185.70.40.137] Apr 5 18:54:52 www postfix/cleanup[30556]: 85A412E19B6: message-id=<M07eijxF0PArGZ92wKYpeCndUNv5g3kSEgYljlhYwOVPxIor3AmNRxrPyNK9T8GcncG1dmxS6Lv35IfR5ompsUPEGPucNn9SjxkMxAgHzhI=@ protonmail.com> Apr 5 18:54:53 www dccifd[1856]: stat(log directory "log"): No such file or directory Apr 5 18:54:57 www postfix/qmgr[1398]: 85A412E19B6: from=< from(a)protonmail.com>, size=2767, nrcpt=1 (queue active) Apr 5 18:54:57 www postfix/smtpd[30547]: disconnect from mail-40137.protonmail.ch[185.70.40.137] ehlo=2 starttls=1 mail=1 rcpt=1 data=1 quit=1 commands=7 Apr 5 18:54:57 www dovecot: lmtp(30559): Connect from local Apr 5 18:54:57 www dovecot: lmtp(compiz(a)domain.com)<30559><U8KALFFmTGJfdwAA8oMCvw>: sieve: msgid=<M07eijxF0PArGZ92wKYpeCndUNv5g3kSEgYljlhYwOVPxIor3AmNRxrPyNK9T8GcncG1dmxS6Lv35IfR5ompsUPEGPucNn9SjxkMxAgHzhI=@ protonmail.com>: stored mail into mailbox 'INBOX' Apr 5 18:54:57 www postfix/lmtp[30558]: 85A412E19B6: to=< to_alias(a)domain.com>, relay=mail.domain.com[private/dovecot-lmtp], delay=17, delays=17/0.01/0.01/0.01, dsn=2.0.0, status=sent (250 2.0.0 < to_alias(a)domain.com> U8KALFFmTGJfdwAA8oMCvw Saved) Apr 5 18:54:57 www dovecot: lmtp(30559): Disconnect from local: Logged out (state=READY) Apr 5 18:54:57 www postfix/qmgr[1398]: 85A412E19B6: removed I was playing with password_query but not sure did I'm on right direction. password_query = \ SELECT username AS user, password, \ '/var/spool/postmail/%d/%n' AS userdb_home, 1002 AS userdb_uid, 1001 AS userdb_gid \ FROM mailbox WHERE username = (SELECT goto FROM alias WHERE address = '%u') I'm using dovecot --version: 2.3.18 (9dd8408c18) and my configuration is: # 2.3.18 (9dd8408c18): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: Linux 5.17.0 x86_64 Slackware 15.0+ ext4 # Hostname: www.ixip.net base_dir = /var/run/dovecot/ default_login_user = nobody dict { driver = sql quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:/var/spool/postmail/%d/%n/Maildir mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = /var/spool/postmail/%d/%n/.dovecot.sieve sieve_dir = /var/spool/postmail/%d/%n/sieve/ sieve_global_dir = /var/lib/dovecot/sieve sieve_global_path = /var/lib/dovecot/sieve/default.sieve } protocols = imap lmtp sieve sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { address = 127.0.0.1 port = 993 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } service_count = 1 vsz_limit = 64 M } ssl_cert = </etc/postfix/ssl/mail.stzbg.com.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = uid=1002 gid=1001 home=/var/spool/postmail/%d/%n allow_all_users=yes driver = static } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole } # grep -v '^ *$#.*$\?$' dovecot-sql.conf.ext driver = mysql connect = host=localhost dbname=postfix user=postfix password=password default_pass_scheme = CRYPT password_query = SELECT username AS user, password FROM mailbox WHERE username = '%u'; Kind Regards, Chris

1 0

Support of "extlists" in sieve filters
by Marcin Bajer 04 Apr '22

04 Apr '22

Hi all, Don’t really know if this is sth. to post on this forum, but I tried to make a sieve filter which tags mails from my contacts by the category of the contact. Seems this feature is available in Protonmail: https://protonmail.com/support/knowledge-base/sieve-advanced-custom-filters/ require [“fileinto”, “extlists”]; Checks that the sender is in your personal address book if header :list “from” “:addrbook:personal?label=Family” { fileinto “Known”; } Would it be possible to implement such feature also in dovecot? BR, Marcin

1 0

Replication issues with 2.3.18 - Replication fails after xxx folders reached.
by Paul Kudla (SCOM.CA Internet) 02 Apr '22

02 Apr '22

please appreciate that i am trying to help .... after much testing i can now reporduce the replication issues at hand I am running on freebsd 12 & 13 stable (both test and production servers) sdram drives etc ... Basically replication works fine until reaching a folder quantity of ~ 256 or more to reproduce using doveadm i created folders like INBOX/folder-0 INBOX/folder-1 INBOX/folder-2 INBOX/folder-3 and so forth ...... I created 200 folders and they replicated ok on both servers I created another 200 (400 total) and the replicator got stuck and would not update the mbox on the alternate server anymore and is still updating 4 days later ? basically replicator goes so far and either hangs or more likely bails on an error that is not reported to the debug reporting ? however dsync will sync the two servers but only when run manually (ie all the folders will sync) I have two test servers avaliable if you need any kind of access - again here to help. [07:28:42] mail18.scom.ca [root:0] ~ # sync.status Queued 'sync' requests 0 Queued 'high' requests 6 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 255 username type status paul(a)scom.ca normal Waiting for dsync to finish keith(a)elirpa.com incremental Waiting for dsync to finish ed.hanna(a)dssmgmt.com incremental Waiting for dsync to finish ed(a)scom.ca incremental Waiting for dsync to finish nick(a)elirpa.com incremental Waiting for dsync to finish paul(a)paulkudla.net incremental Waiting for dsync to finish i have been going through the c code and it seems the replication gets requested ok replicator.db does get updated ok with the replicated request for the mbox in question. however i am still looking for the actual replicator function in the lib's that do the actual replication requests the number of folders & subfolders is defanately the issue - not the mbox pyhsical size as thought origionally. if someone can point me in the right direction, it seems either the replicator is not picking up on the number of folders to replicat properly or it has a hard set limit like 256 / 512 / 65535 etc and stops the replication request thereafter. I am mainly a machine code programmer from the 80's and have concentrated on python as of late, 'c' i am starting to go through just to give you a background on my talents. It took 2 months to finger this out. this issue also seems to be indirectly causing the duplicate messages supression not to work as well. python programming to reproduce issue (loops are for last run started @ 200 - fyi) : # cat mbox.gen #!/usr/local/bin/python2 import os,sys from lib import * user = 'paul(a)paulkudla.net' """ for count in range (0,600) : box = 'INBOX/folder-%s' %count print count command = '/usr/local/bin/doveadm mailbox create -s -u %s %s' %(user,box) print command a = commands.getoutput(command) print a """ for count in range (0,600) : box = 'INBOX/folder-0/sub-%' %count print count command = '/usr/local/bin/doveadm mailbox create -s -u %s %s' %(user,box) print command a = commands.getoutput(command) print a #sys.exit()

1 0

falsely log "auth: unknown user" when multiple userdb
by Anthony Panko 01 Apr '22

01 Apr '22

Hello, When there is a multiple userdb to look for user, Dovecot log «auth: unknown user» when the first userdb search failed. Then Dovecot successfully search user in the second userdb and things works. But "auth: unknown user" event left in a logs. Logs look like this: Apr 1 12:38:48 mail dovecot[75384]: lmtp(75397): Connect from 127.0.5.1 Apr 1 12:38:48 mail dovecot[75384]: auth: ldap(order(a)XXX,127.0.5.1): unknown user Apr 1 12:38:48 mail dovecot[75384]: lmtp(order)<75397><D8m2HCjIRmKFJgEAABdyCg>: msgid=<157609214.20220331172309@YYY>: saved mail to INBOX Debug show failed search in the first userdb and successfull search in the second userdb. When user found in the first userdb «unknown user» event does not appear. Configuration is: userdb { args = /usr/local/etc/dovecot/udb-ldap-personal.conf driver = ldap override_fields = home=/mnt/mboxes/personal/%n } userdb { args = /usr/local/etc/dovecot/udb-ldap-general.conf driver = ldap override_fields = home=/mnt/mboxes/general/%n } Dovecot verision is 2.3.16 (7e2e900c1a). -- Best regards, Anthony Pankov

2 1

Dovecot Submission - rate limiting
by itanguy＠univ-brest.fr 31 Mar '22

31 Mar '22

Hello, is there any way to rate limit submission mail (counting per user) when using Dovecot/Submission (no Postfix)? Using a milter seems impossible. Using Dovecot Events seems "too" global (not per users discrimination). Maybe rate-limiting has to be external and then include in the pass_db query ? Thank your for any hints. Ismaël Tanguy

3 3

Simplifying Support of Virtual and System Users
by Mark Olbert 29 Mar '22

29 Mar '22

Apologies if this has already been raised here (which I suspect it has 😊). I tried to raise it as an issue over on github but issues are not enabled for the repository. The support for mixing virtual users, with fully-qualified email addresses, and system users could be simpler. Assuming it doesn’t mess up other stuff in the code base, of course 😊. The problem appears to be that the PAM passwd module requires just user names without a domain (which makes sense given that they’re system users) but does not, so far as I can see, support the username_format argument. In my setup, the default structure of 10-auth.conf demonstrates this: auth_username_format = %n That means all username arguments lack the domain part…which complicates using fully-qualified ones for virtual users. I realize I could assign arbitrary unique names to the virtual accounts in the lookup file. But that complicates administering the system, so I want to be able to include the domain for virtual users. After about five hair-pulling hours of wrestling with the configuration I stumbled across an answer utilizing conditionals<https://serverfault.com/questions/260488/dovecot-user-lookup-fails-when-usi…> on ServerFault. It works fine. But being able to pass a username_format parameter to the PAM module (which I tried, but it was rejected) would be a lot simpler, and a lot more intuitive. - Mark

5 4

IMAP sync issue in email clients
by ChandranManikandan 29 Mar '22

29 Mar '22

Hi Friends, Some few email accounts are sync issues come in outlook,thunderbird,roundcube and squirrelmail after power shutdown suddenly. The dovecot mail log is shown below for those email accounts. Can anyone help me to fix it? imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Error: Mailbox INBOX: UID=502283: read(/home/vpopmail/domains/ xxx.com/email/Maildir/cur/1648520174.28570.mail.xxx.com,S=13720:2,) failed: Cached message size larger than expected (13720 > 0, box=INBOX, UID=502283) (read reason=mail stream) Mar 29 13:40:48 imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Error: Corrupted record in index cache file /home/vpopmail/domains/ xxx.com/email/Maildir/dovecot.index.cache: Broken physical size in mailbox INBOX: read(/home/vpopmail/domains/ xxx.com/email/Maildir/cur/1648520174.28570.mail.xxx.com,S=13720:2,) failed: Cached message size larger than expected (13720 > 0, box=INBOX, UID=502283) Mar 29 13:40:48 imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Error: Mailbox INBOX: UID=502283: read(/home/vpopmail/domains/ xxx.com/email/Maildir/cur/1648520174.28570..mail.xxx.com,S=13720:2,) failed: Cached message size larger than expected (13720 > 0, box=INBOX, UID=502283) (read reason=) Mar 29 13:40:48 imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Info: FETCH failed: Internal error occurred. Refer to server log for more information. [2022-03-29 13:40:48] in=323 out=589163 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 -- *Regards,Manikandan.C*

2 2

Doveadm backup...
by Stephane Magnier 28 Mar '22

28 Mar '22

Hi I've recently tried to use the Dovecadm backup to backup the emails.. with the following syntax doveadm -Dv backup -u userx maildir:/mnt/nfs-backup/userx Sounds to be OK with few emails... Some of them got a lot of emails and one f them got an error and stop ! dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=1725fa475d774ee19cb98dfb6737b4f1 UID=24891 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=916ed110b4b1522868be6194f1ae36ff UID=24892 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=eb8d75c530a7b02fc26b494d9006c91b UID=24893 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=aee9155875c34861fd6500f1f2f51a26 UID=24894 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Last common UID=24894. Delayed expunges= dsync(userx): Debug: brain S: Import Trash: Saved UIDs: dsync(userx): Debug: brain S: Import Trash: Finish update: min_next_uid=24895 min_first_recent_uid=24895 min_highest_modseq=35344 min_highest_pvt_modseq=0 dsync(userx): Debug: /mnt/nfs-backup/userx/.Trash/dovecot.index.cache: Compressed, file_seq changed 1645803588 -> 1645803589, size=32, max_uid=24894 dsync(userx): Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID 7e05c335174bf1608f0a02004eac7fb4 (maybe it was just deleted?) dsync(userx): Debug: auth-master: conn unix:/run/dovecot/auth-userdb: Disconnected: Connection closed (fd=10) I empty the trash... exactly the same problem... Any idea why this ?? Thanks and regards,

5 10

Private \seen flags lost during message move for other users
by Cube . 28 Mar '22

28 Mar '22

Hello, I have a shared mailbox set up with a private index: maildir:/var/mail/public:INDEXPVT=~/Maildir/public Per user \Seen flags are working fine until one user moves a message into another folder/sub-mailbox. For that user doing the move the message remains \Seen however for other users who have already seen the message the flag is lost and it appears unread in the new location. If the message is moved back it still appears unread to the other user even if had been read in that folder/sub-mailbox in the past. Is there anyway to retain per user \Seen that follows the message when its moved? Thank you.

2 1

dovecot replication on dovecot v 2.3.8
by Stephane Magnier 27 Mar '22

27 Mar '22

Hi, I am trying using a replication. Here is my config : 10-mail.conf. Before going " on real life " I try to make a very basic example... but without any success :-( bad start I took the config example on dovecot wiki The idea is to replicate the user: "user1" on a different server IP 177.28.1.120 at the location /home/SERVER/test and to get at the end the folder "/home/SERVER/test/user1" On the top, I wish to replication with the user / group : vmail. For the transfer, I use the root login on the backup server to avoid other rights problems at the moment 2) how to synchronized specific users ? apparently it's trying to sync other things.. :-) # mbox_very_dirty_syncs = yes mail_plugins=$mail_plugins quota notify replication service replicator { process_min_avail = 1 } dsync_remote_cmd = ssh -l root 177.28.1.120 doveadm dsync-server -u user1 plugin { mail_replica =remote:root@177.28.1.120:/home/SERVER/test/ } service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service replicator { unix_listener replicator-doveadm { mode = 0600 user = vmail } } replication_max_conns = 10 But apparently nothing is happening.... [root@xxx xenia]# doveadm replicator status Queued 'sync' requests 0 Queued 'high' requests 0 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 24 Waiting 'failed' requests 10 Total number of known users 34 and the folder test is empty Any idea what is wrong ? maybe I should ask a start a cmd line to start the process ? ( [root@mbox1 xenia]# doveadm replicator status '*' username priority fast sync full sync success sync failed rngd none - - - - *user1 none 00:00:04 00:40:05 - y ( failed )* saslauth none - - - - sa-milt none - - - -

1 1

disable authentication for a user in specialuserdb passwd-file
by Marc 27 Mar '22

27 Mar '22

Is it possible to disable the authentication for a specific user in userdb password-file?

1 0

log failed plaintext password for specific user only
by mj 25 Mar '22

25 Mar '22

Hi, We are logging failed authentication attempts, with the attempted password as auth_verbose_passwords=sha1 The question: is it possible to configure auth_verbose_passwords=plain for a specific user only? Turning it on globally would be too much sensitive information for the purpose. Reason: We are currently observing a high number of failed authentications for a specific user, coming from *many* diffirent IPs across the globe, with most IPs only trying once or twice, making this difficult to block. The number of failed authentications cause this account to regularly become blocked in AD. We would like to know if they are trying older actual passwords from the user, or if it's just dictionary attack. Thanks!

4 7

Setting imap-login process_limit when service_count>1
by Joseph Tam 25 Mar '22

25 Mar '22

More of my users are accessing mail remotely, which probably explained why I started seeing Mar 18 05:50:34 dovecot: master: Warning: service(imap-login): process_limit (2) reached, client connections are being dropped I played around with increasing limits, but made the mistake of setting service_count to a value other than 0 and 1. service imap-login { client_limit = 1024 service_count = 10240 process_min_avail = 2 process_limit = 8 } Doubling and redoubling process_limit and increasing service_count didn't prevent IMAP from eventually grinding to a halt because process_limit was reached. Mar 18 12:36:12 dovecot: master: Warning: service(imap-login): process_limit (4) reached, client connections are being dropped Mar 18 20:39:48 viol dovecot: master: Warning: service(imap-login): process_limit (8) reached, client connections are being dropped Observing the way imap-login processes spawn and retain file descriptors, I finally understood the subtlety of [1], which explains that imap-login will not exit despite reaching service_count if one SSL connection is still open. With many long-lived client connections, the asymptotic behaviour is that the total #clients plateaus, but get spread out over many imap-login processes, with many lingering on to hold a few SSL connections. For service_count>1, process_limit should be set to a large fraction of peak simultaneous clients (i.e. the same value used when service_count=1), otherwise there is a high likelihood of running into process_limit and game over. Given this behaviour, there doesn't seem much sense in setting service_count to anything but 0 (unlimited => performance mode) or 1 (security mode). Setting to other values supposedly limit memory leaks, but if a single persistent SSL client can hold up an imap-login process from exiting and releasing memory, it seems to negate this purpose. Anyways, maybe [1] can mention this so others don't fall into the same pit I did. References [1] https://doc.dovecot.org/admin_manual/login_processes/ Joseph Tam <jtam.home(a)gmail.com>

1 0

ok replication does not work
by Paul Kudla (SCOM.CA Internet) 24 Mar '22

24 Mar '22

would someone please send me the standard that you are working towards (rfc stuff) in the mean time a bad email or folder or both are simply causing replication not to work no there is no logging of any kind of an error i would appreciate the info as i will start ripping down the c code to fix this doveadm / replication (seems to be seperate ???) remote , tcp tcps nothing works your co operation on this matter would be appreciated i dumped the 5 accounts listed below started from scratch and it just simply DOES NOT WORK all account replicate except for # sync.status Queued 'sync' requests 0 Queued 'high' requests 5 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 255 username type status paul(a)scom.ca incremental Waiting for dsync to finish nick(a)elirpa.com incremental Waiting for dsync to finish keith(a)elirpa.com incremental Waiting for dsync to finish ed.hanna(a)dssmgmt.com incremental Waiting for dsync to finish ed(a)scom.ca incremental Waiting for dsync to finish always the same five accounts and always they choke without any info i am forced to do a sync every five minutes (ten minute intevals) to keep the servers in sync. someone please give me a standard to work with otherwise the hacks that i do will be exactly that a hack???

2 1

Pop3 Panic Error
by Aurel Mihai 24 Mar '22

24 Mar '22

Hello, after upgrade to version 2.3.18, we enconter a lot of errors, such as: Mar 22 14:08:32 mail2 dovecot: pop3(user@domain)<52269><3y3GeM3aQ+tWadtM>: Panic: file lib-event.c: line 585 (event_reason_code_prefix): assertion failed: (name[0] != '\0') Mar 22 14:08:32 mail2 dovecot: pop3(user@domain)<52269><3y3GeM3aQ+tWadtM>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7f7ce322e012] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f7ce322e12e] -> /usr/lib/dovecot/libdovecot.so.0(+0x101d4b) [0x7f7ce323ad4b] -> /usr/lib/dovecot/libdovecot.so.0(+0x101de1) [0x7f7ce323ade1] -> /usr/lib/dovecot/libdovecot.so.0(+0x55519) [0x7f7ce318e519] -> /usr/lib/dovecot/libdovecot.so.0(+0x594e2) [0x7f7ce31924e2] -> dovecot/pop3(client_handle_input+0x1c9) [0x55d5b5efa539] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f7ce3250f79] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x96) [0x7f7ce3251066] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7f7ce32511e0] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f7ce31c4003] -> dovecot/pop3(main+0x2e6) [0x55d5b5ef81f6] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xea) [0x7f7ce2f93d0a] -> dovecot/pop3(_start+0x2a) [0x55d5b5ef838a] Mar 22 14:08:32 mail2 dovecot: pop3(user@domain)<52269><3y3GeM3aQ+tWadtM>: Fatal: master: service(pop3): child 52269 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps) # dovecot -n # 2.3.18 (9dd8408c18): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: Linux 5.10.0-12-amd64 x86_64 Debian 11.2 # Hostname: auth_cache_verify_password_with_worker = yes auth_failure_delay = 5 secs auth_mechanisms = plain login auth_verbose = yes auth_worker_max_count = 256 default_client_limit = 10000 default_process_limit = 10000 default_vsz_limit = 1 G dict { lastlogin = mysql:/etc/dovecot/mysql/dovecot-dict-lastlogin.conf quotadict = mysql:/etc/dovecot/mysql/dovecot-dict-quota.conf } disable_plaintext_auth = no first_valid_uid = 100 imap_hibernate_timeout = 5 secs imap_idle_notify_interval = 3 mins log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l pid=%p %c login_trusted_networks = mail_fsync = always mail_gid = 8 mail_home = /home/virtual0/%d/%n mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = zlib quota mail_log notify mail_privileged_group = mail mail_uid = 150 maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave metric imap_command { filter = event=imap_command_finished AND tagged_reply_state=OK group_by = cmd_name } metric imap_select_no { filter = event=imap_command_finished AND cmd_name=SELECT AND tagged_reply_state=NO } metric imap_select_no_notfound { filter = event=imap_command_finished AND cmd_name=SELECT AND tagged_reply="NO*Mailbox doesn't exist:*" } metric storage_http_gets { filter = event=http_request_finished AND category=storage AND method=get } mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 60 days special_use = \Trash } mailbox virtual/All { special_use = \All } prefix = } passdb { args = /etc/dovecot/mysql/dovecot-sql.conf driver = sql } plugin { last_login_dict = proxy::lastlogin last_login_key = # hidden, use -P to show it mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:user::proxy::quotadict quota_rule2 = Trash:ignore quota_rule3 = Spam:ignore quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 The email account that you tried to reach is over quota quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve trash = /etc/dovecot/dovecot-trash.conf zlib_save = gz zlib_save_level = 6 } protocols = imap sieve pop3 lmtp service anvil { client_limit = 50000 unix_listener anvil-auth-penalty { mode = 00 } } service auth { client_limit = 50000 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = mail mode = 0660 user = vmail } user = root vsz_limit = 1 G } service dict { unix_listener dict { mode = 0660 user = vmail } } service imap-hibernate { unix_listener imap-hibernate { group = $default_internal_group mode = 0660 } } service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } process_min_avail = 16 service_count = 1 } service imap { extra_groups = $default_internal_group process_min_avail = 16 unix_listener imap-master { user = $default_internal_user } vsz_limit = 2 G } service lmtp { process_min_avail = 16 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } vsz_limit = 1 G } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 16 service_count = 1 } service managesieve { vsz_limit = 1 G } service pop3-login { inet_listener pop3 { address = * port = 110 } inet_listener pop3s { address = * port = 995 } process_min_avail = 16 service_count = 1 } service pop3 { process_min_avail = 16 vsz_limit = 1 G } service quota-status { executable = /usr/lib/dovecot/quota-status -p postfix process_min_avail = 16 unix_listener /var/spool/postfix/private/quota-status { group = postfix mode = 0666 user = postfix } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { mode = 0660 user = vmail } user = vmail } service stats { unix_listener stats-reader { mode = 0660 user = vmail } unix_listener stats-writer { mode = 0666 user = vmail } } ssl_cert = </etc/dovecot/ssl/domain.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1 userdb { args = /etc/dovecot/mysql/dovecot-sql.conf driver = sql } protocol imap { imap_max_line_length = 64 k mail_max_userip_connections = 16 mail_plugins = zlib quota mail_log notify trash imap_quota last_login } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = zlib quota mail_log notify last_login pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_no_flag_updates = yes pop3_uidl_format = %08Xu%08Xv } protocol sieve { mail_max_userip_connections = 10 managesieve_max_compile_errors = 5 } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = zlib quota mail_log notify sieve sendmail_path = /usr/lib/sendmail syslog_facility = mail } protocol lmtp { mail_plugins = zlib quota mail_log notify sieve syslog_facility = mail } Any help please? Aurel

2 2

imap_metadata plugin panic
by Elisamuel Resto 23 Mar '22

23 Mar '22

Hello, This may be covered somewhere but recently I enabled the metadata plugin to work with sieve as part of some updates I did a while back and I hadn't checked my logs for any issues with it and so far they're not completely taking my system down. Right now, upon trying to delete a folder I noticed the following in my logs... what am I missing? I see the broken SQL query, but I don't know enough about the dict system or the metadata plugin to know how to add the missing information or fix it otherwise. Regards, Elisamuel Resto Nov 15 12:19:19 wyvern dovecot[461]: dict(51438): Panic: lib-sql: Too many bind args (2) for statement: SELECT meta_key FROM metadata WHERE meta_key LIKE AND username = ? Nov 15 12:19:19 wyvern dovecot[461]: dict(51438): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x43) [0x7f449789d073] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x20) [0x7f449789d190] -> /usr/lib/dovecot/libdovecot.so.0(+0xfaf1f) [0x7f44978a9f1f] -> /usr/lib/dovecot/libdovecot.so.0(+0xfafb1) [0x7f44978a9fb1] -> /usr/lib/dovecot/libdovecot.so.0(+0x4cd20) [0x7f44977fbd20] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](+0x875a) [0x555e60d7775a] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](sql_statement_query+0x42) [0x555e60d7f262] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](+0xd97f) [0x555e60d7c97f] -> /usr/lib/dovecot/libdovecot.so.0(dict_iterate_values+0x25) [0x7f4497868615] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](+0xa929) [0x555e60d79929] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](+0xb224) [0x555e60d7a224] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](+0xb381) [0x555e60d7a381] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](dict_command_input+0xd9) [0x555e60d7a579] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](+0x95b8) [0x555e60d785b8] -> /usr/lib/dovecot/libdovecot.so.0(connection_input_default+0x15e) [0x7f44978a16ce] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x6b) [0x7f44978bfebb] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x13b) [0x7f44978c15cb] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x51) [0x7f44978bff61] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x41) [0x7f44978c0131] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x14) [0x7f4497831f74] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](main+0x189) [0x555e60d78139] -> /usr/lib/libc.so.6(__libc_start_main+0xd5) [0x7f44972cfb25] -> dovecot/dict [0 clients, 0 lookups:0/0/0/0, 0 iters:0/0/0/0, 0 commits:0/0/0/0](_start+0x2e) [0x555e60d7819e] Nov 15 12:19:19 wyvern dovecot[461]: imap(sam(a)samresto.dev)<51449><+BGq2NfQM/7Pisr9>: Error: Mailbox Trash/Processed: dict_iterate(priv/c841ad0291c27461ac670100a07d9965/) failed: Connection closed (reply took 0.204 secs (0.204 in dict wait, 0.000 in other ioloops, 0.000 in locks)) Nov 15 12:19:19 wyvern dovecot[461]: dict(51438): Fatal: master: service(dict): child 51438 killed with signal 6 (core dumped)

4 12

Dovecot 2.3.18 Panic-Error (name[0] != '\0')
by Aurel Mihai 22 Mar '22

22 Mar '22

Hello, after upgrade to version 2.3.18, we enconter a lot of errors, such as: Mar 22 14:08:32 mail2 dovecot: pop3(user@domain)<52269><3y3GeM3aQ+tWadtM>: Panic: file lib-event.c: line 585 (event_reason_code_prefix): assertion failed: (name[0] != '\0') Mar 22 14:08:32 mail2 dovecot: pop3(user@domain)<52269><3y3GeM3aQ+tWadtM>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7f7ce322e012] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f7ce322e12e] -> /usr/lib/dovecot/libdovecot.so.0(+0x101d4b) [0x7f7ce323ad4b] -> /usr/lib/dovecot/libdovecot.so.0(+0x101de1) [0x7f7ce323ade1] -> /usr/lib/dovecot/libdovecot.so.0(+0x55519) [0x7f7ce318e519] -> /usr/lib/dovecot/libdovecot.so.0(+0x594e2) [0x7f7ce31924e2] -> dovecot/pop3(client_handle_input+0x1c9) [0x55d5b5efa539] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f7ce3250f79] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x96) [0x7f7ce3251066] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7f7ce32511e0] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f7ce31c4003] -> dovecot/pop3(main+0x2e6) [0x55d5b5ef81f6] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xea) [0x7f7ce2f93d0a] -> dovecot/pop3(_start+0x2a) [0x55d5b5ef838a] Mar 22 14:08:32 mail2 dovecot: pop3(user@domain)<52269><3y3GeM3aQ+tWadtM>: Fatal: master: service(pop3): child 52269 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps) # dovecot -n # 2.3.18 (9dd8408c18): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: Linux 5.10.0-12-amd64 x86_64 Debian 11.2 # Hostname: auth_cache_verify_password_with_worker = yes auth_failure_delay = 5 secs auth_mechanisms = plain login auth_verbose = yes auth_worker_max_count = 256 default_client_limit = 10000 default_process_limit = 10000 default_vsz_limit = 1 G dict { lastlogin = mysql:/etc/dovecot/mysql/dovecot-dict-lastlogin.conf quotadict = mysql:/etc/dovecot/mysql/dovecot-dict-quota.conf } disable_plaintext_auth = no first_valid_uid = 100 imap_hibernate_timeout = 5 secs imap_idle_notify_interval = 3 mins log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l pid=%p %c login_trusted_networks = mail_fsync = always mail_gid = 8 mail_home = /home/virtual0/%d/%n mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = zlib quota mail_log notify mail_privileged_group = mail mail_uid = 150 maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave metric imap_command { filter = event=imap_command_finished AND tagged_reply_state=OK group_by = cmd_name } metric imap_select_no { filter = event=imap_command_finished AND cmd_name=SELECT AND tagged_reply_state=NO } metric imap_select_no_notfound { filter = event=imap_command_finished AND cmd_name=SELECT AND tagged_reply="NO*Mailbox doesn't exist:*" } metric storage_http_gets { filter = event=http_request_finished AND category=storage AND method=get } mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 60 days special_use = \Trash } mailbox virtual/All { special_use = \All } prefix = } passdb { args = /etc/dovecot/mysql/dovecot-sql.conf driver = sql } plugin { last_login_dict = proxy::lastlogin last_login_key = # hidden, use -P to show it mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:user::proxy::quotadict quota_rule2 = Trash:ignore quota_rule3 = Spam:ignore quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 The email account that you tried to reach is over quota quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve trash = /etc/dovecot/dovecot-trash.conf zlib_save = gz zlib_save_level = 6 } protocols = imap sieve pop3 lmtp service anvil { client_limit = 50000 unix_listener anvil-auth-penalty { mode = 00 } } service auth { client_limit = 50000 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = mail mode = 0660 user = vmail } user = root vsz_limit = 1 G } service dict { unix_listener dict { mode = 0660 user = vmail } } service imap-hibernate { unix_listener imap-hibernate { group = $default_internal_group mode = 0660 } } service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } process_min_avail = 16 service_count = 1 } service imap { extra_groups = $default_internal_group process_min_avail = 16 unix_listener imap-master { user = $default_internal_user } vsz_limit = 2 G } service lmtp { process_min_avail = 16 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } vsz_limit = 1 G } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 16 service_count = 1 } service managesieve { vsz_limit = 1 G } service pop3-login { inet_listener pop3 { address = * port = 110 } inet_listener pop3s { address = * port = 995 } process_min_avail = 16 service_count = 1 } service pop3 { process_min_avail = 16 vsz_limit = 1 G } service quota-status { executable = /usr/lib/dovecot/quota-status -p postfix process_min_avail = 16 unix_listener /var/spool/postfix/private/quota-status { group = postfix mode = 0666 user = postfix } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { mode = 0660 user = vmail } user = vmail } service stats { unix_listener stats-reader { mode = 0660 user = vmail } unix_listener stats-writer { mode = 0666 user = vmail } } ssl_cert = </etc/dovecot/ssl/domain.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1 userdb { args = /etc/dovecot/mysql/dovecot-sql.conf driver = sql } protocol imap { imap_max_line_length = 64 k mail_max_userip_connections = 16 mail_plugins = zlib quota mail_log notify trash imap_quota last_login } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = zlib quota mail_log notify last_login pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_no_flag_updates = yes pop3_uidl_format = %08Xu%08Xv } protocol sieve { mail_max_userip_connections = 10 managesieve_max_compile_errors = 5 } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = zlib quota mail_log notify sieve sendmail_path = /usr/lib/sendmail syslog_facility = mail } protocol lmtp { mail_plugins = zlib quota mail_log notify sieve syslog_facility = mail } Any help please? Aurel

1 0

Disconnected: Shutting down (disconnected while authenticating) :: after mysql restart :: bug?
by rudolf＠padaru.de 17 Mar '22

17 Mar '22

Good morning list, i looking for a while for a solution above problem. We use dovecot 2.3.7.2 (3c910f64b) (Ubuntu 20.04) and 2.3.13 (89f716dc2) (Ubuntu 18.04) . Often we have the problem, that the authentication (dovecot <-> mysql) dont work after an mysql restart. Unfortunately i cant reproduce this problem, if i restart the mysql-server the authentication work when the database is up again. If we have this problem it is enough to reload the dovecot. So that the auth-worker will reconnect and everything is fine again. I have tried to encircle the problem with verbose auth-logging a wile ago but i only see timeouts from the auth-worker while mysql is running But this is not the solution für the problem. Is there an option i can set to force the auth-worker to reconnect? Maybe an timeout or something else? Or is there an value set to high in my conf? Somethin like the idle_kill from anvil service? Or is it simply a bug? doveconf output: auth_anonymous_username = anonymous auth_cache_negative_ttl = 1 hours auth_cache_size = 0 auth_cache_ttl = 1 hours auth_cache_verify_password_with_worker = no auth_debug = no auth_debug_passwords = no auth_default_realm = auth_failure_delay = 2 secs auth_gssapi_hostname = auth_krb5_keytab = auth_master_user_separator = auth_mechanisms = plain login auth_policy_check_after_auth = yes auth_policy_check_before_auth = yes auth_policy_hash_mech = sha256 auth_policy_hash_nonce = auth_policy_hash_truncate = 12 auth_policy_log_only = no auth_policy_reject_on_fail = no auth_policy_report_after_auth = yes auth_policy_request_attributes = login=%{requested_username} pwhash=%{hashed_password} remote=%{rip} device_id=%{client_id} protocol=%s auth_policy_server_api_header = auth_policy_server_timeout_msecs = 2000 auth_policy_server_url = auth_proxy_self = auth_realms = auth_socket_path = auth-userdb auth_ssl_require_client_cert = no auth_ssl_username_from_cert = no auth_stats = no auth_use_winbind = no auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@üÜöÖäÄ auth_username_format = %Lu auth_username_translation = auth_verbose = no auth_verbose_passwords = no auth_winbind_helper_path = /usr/bin/ntlm_auth auth_worker_max_count = 60 base_dir = /var/run/dovecot config_cache_size = 1 M debug_log_path = default_client_limit = 1000 default_idle_kill = 1 mins default_internal_group = dovecot default_internal_user = dovecot default_login_user = dovenull default_process_limit = 100 default_vsz_limit = 256 M deliver_log_format = msgid=%m: %$ dict_db_config = director_flush_socket = director_mail_servers = director_max_parallel_kicks = 100 director_max_parallel_moves = 100 director_output_buffer_size = 10 M director_ping_idle_timeout = 30 secs director_ping_max_timeout = 1 mins director_servers = director_user_expire = 15 mins director_user_kick_delay = 2 secs director_username_hash = %u disable_plaintext_auth = no dotlock_use_excl = yes doveadm_allowed_commands = doveadm_api_key = doveadm_http_rawlog_dir = doveadm_password = doveadm_port = 0 doveadm_socket_path = doveadm-server doveadm_username = doveadm doveadm_worker_count = 0 dsync_alt_char = _ dsync_commit_msgs_interval = 100 dsync_features = dsync_hashed_headers = Date Message-ID dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u -U first_valid_gid = 1 first_valid_uid = 500 haproxy_timeout = 3 secs haproxy_trusted_networks = hostname = imap_capability = +XLIST imap_client_workarounds = imap_fetch_failure = disconnect-immediately imap_hibernate_timeout = 0 imap_id_log = imap_id_retain = no imap_id_send = name * imap_idle_notify_interval = 2 mins imap_literal_minus = no imap_logout_format = in=%i out=%o del=%{deleted} fetched_mails=%{fetch_hdr_count} imap_max_line_length = 64 k imap_metadata = no imap_urlauth_host = imap_urlauth_logout_format = in=%i out=%o imap_urlauth_port = 143 imapc_cmd_timeout = 5 mins imapc_connection_retry_count = 1 imapc_connection_retry_interval = 1 secs imapc_features = imapc_host = imapc_list_prefix = imapc_master_user = imapc_max_idle_time = 29 mins imapc_max_line_length = 0 imapc_password = imapc_port = 143 imapc_rawlog_dir = imapc_sasl_mechanisms = imapc_ssl = no imapc_ssl_verify = yes imapc_user = import_environment = TZ CORE_OUTOFMEM CORE_ERROR LISTEN_PID LISTEN_FDS info_log_path = instance_name = dovecot last_valid_gid = 0 last_valid_uid = 0 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = libexec_dir = /usr/lib/dovecot listen = *, :: lmtp_hdr_delivery_address = final lmtp_proxy = no lmtp_proxy_rawlog_dir = lmtp_rawlog_dir = lmtp_rcpt_check_quota = no lmtp_save_to_detail_mailbox = no lmtp_user_concurrency_limit = 0 lock_method = flock log_core_filter = log_debug = log_path = syslog log_timestamp = "%b %d %H:%M:%S " login_access_sockets = login_greeting = <myServer.com> mailserver ready. login_log_format = %$: %s login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c login_plugin_dir = /usr/lib/dovecot/modules/login login_plugins = login_proxy_max_disconnect_delay = 0 login_proxy_notify_path = proxy-notify login_source_ips = login_trusted_networks = mail_access_groups = mail_always_cache_fields = hdr.* flags mime.parts binary.parts body.snippet mail_attachment_detection_options = mail_attachment_dir = mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} mail_attachment_min_size = 128 k mail_attribute_dict = mail_cache_compress_continued_percentage = 200 mail_cache_compress_delete_percentage = 20 mail_cache_compress_header_continue_count = 4 mail_cache_compress_min_size = 32 k mail_cache_fields = flags mail_cache_min_mail_count = 30 mail_cache_record_max_size = 64 k mail_cache_unaccessed_field_drop = 30 days mail_chroot = mail_debug = no mail_fsync = optimized mail_full_filesystem_access = no mail_gid = mail_home = mail_index_log2_max_age = 2 days mail_index_log_rotate_max_size = 1 M mail_index_log_rotate_min_age = 5 mins mail_index_log_rotate_min_size = 32 k mail_index_rewrite_max_log_bytes = 128 k mail_index_rewrite_min_log_bytes = 8 k mail_location = auto: mail_log_prefix = "%s(%u)<%{pid}><%{session}>: " mail_max_keyword_length = 50 mail_max_lock_timeout = 0 mail_max_userip_connections = 30 mail_never_cache_fields = mail_nfs_index = no mail_nfs_storage = no mail_plugin_dir = /usr/lib/dovecot/modules mail_plugins = " zlib" mail_prefetch_count = 0 mail_privileged_group = mail mail_save_crlf = no mail_server_admin = mail_server_comment = mail_shared_explicit_inbox = no mail_sort_max_read_count = 0 mail_temp_dir = /tmp mail_temp_scan_interval = 1 weeks mail_uid = mail_vsize_bg_after_count = 0 mailbox_idle_check_interval = 30 secs mailbox_list_index = yes mailbox_list_index_include_inbox = no mailbox_list_index_very_dirty_syncs = no maildir_broken_filename_sizes = no maildir_copy_with_hardlinks = yes maildir_empty_new = no maildir_stat_dirs = no maildir_very_dirty_syncs = no managesieve_client_workarounds = managesieve_implementation_string = Dovecot (Ubuntu) Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader imapflags notify vnd.dovecot.pipe vnd.dovecot.filter vnd.dovecot.execute master_user_separator = mbox_dirty_syncs = yes mbox_dotlock_change_timeout = 2 mins mbox_lazy_writes = yes mbox_lock_timeout = 5 mins mbox_md5 = apop3d mbox_min_index_size = 0 mbox_read_locks = dotlock mbox_very_dirty_syncs = yes mbox_write_locks = fcntl dotlock mdbox_preallocate_space = no mdbox_rotate_interval = 0 mdbox_rotate_size = 250 M mmap_disable = no namespace inbox { disabled = no hidden = no ignore_on_failure = no inbox = yes list = yes location = mailbox Archiv { auto = no autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = } mailbox Drafts { auto = no autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = } mailbox Junk { auto = no autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = } mailbox Sent { auto = no autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = } mailbox "Sent Messages" { auto = no autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = \Sent } mailbox Trash { auto = no autoexpunge = 0 autoexpunge_max_mails = 0 comment = driver = special_use = } order = 0 prefix = separator = subscriptions = yes type = private } old_stats_carbon_interval = 30 secs old_stats_carbon_name = old_stats_carbon_server = old_stats_command_min_time = 1 mins old_stats_domain_min_time = 12 hours old_stats_ip_min_time = 12 hours old_stats_memory_limit = 16 M old_stats_session_min_time = 15 mins old_stats_user_min_time = 1 hours passdb { args = /etc/dovecot/conf.d/zDovecot-sql.conf.ext auth_verbose = default default_fields = deny = no driver = sql master = no mechanisms = name = override_fields = pass = no result_failure = continue result_internalfail = continue result_success = return-ok skip = never username_filter = } plugin { sieve = ~/sieve/.dovecot.sieve sieve_after = ~/sieve_after/.dovecot_after.sieve sieve_before = ~/sieve_before/.dovecot_before.sieve sieve_dir = ~/sieve sieve_execute_bin_dir = /usr/local/bin/ sieve_execute_input_eol = lf sieve_extensions = +notify +imapflags +vnd.dovecot.pipe +vnd.dovecot.filter +vnd.dovecot.execute +editheader -reject sieve_filter_bin_dir = /usr/local/bin/ sieve_filter_input_eol = lf sieve_global_dir = /etc/dovecot/sieve/ sieve_max_redirects = 25 sieve_pipe_bin_dir = /usr/local/bin/ sieve_pipe_input_eol = lf sieve_plugins = sieve_extprograms sieve_redirect_envelope_from = recipient zlib_save = gz zlib_save_level = 6 } pop3_client_workarounds = pop3_delete_type = default pop3_deleted_flag = pop3_enable_last = no pop3_fast_size_lookups = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = no pop3_reuse_xuidl = no pop3_save_uidl = no pop3_uidl_duplicates = allow pop3_uidl_format = %08Xu%08Xv pop3c_features = pop3c_host = pop3c_master_user = pop3c_password = pop3c_port = 110 pop3c_quick_received_date = no pop3c_rawlog_dir = pop3c_ssl = no pop3c_ssl_verify = yes pop3c_user = %u postmaster_address = postmaster@%{if;%d;ne;;%d;%{hostname}} protocols = imap pop3 sieve quota_full_tempfail = no rawlog_dir = recipient_delimiter = + rejection_reason = Your message to <%t> was automatically rejected:%n%r rejection_subject = Rejected: %s replication_dsync_parameters = -d -N -l 30 -U replication_full_sync_interval = 1 days replication_max_conns = 10 replicator_host = replicator replicator_port = 0 sendmail_path = /usr/sbin/sendmail service aggregator { chroot = . client_limit = 0 drop_priv_before_exec = no executable = aggregator extra_groups = fifo_listener replication-notify-fifo { group = mode = 0600 user = } group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replication-notify { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 1 mins privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 0 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 1 mins privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-client { group = mode = 0600 user = $default_internal_user } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = mode = 0666 user = $default_internal_user } unix_listener login/login { group = mode = 0666 user = } unix_listener token-login/tokenlogin { group = mode = 0666 user = } user = root vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service dict-async { chroot = client_limit = 0 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict-async { group = $default_internal_group mode = 0660 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = $default_internal_group mode = 0660 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = . client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs inet_listener { address = haproxy = no port = 0 reuse_port = no ssl = no } privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener director-userdb { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns_client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service imap-hibernate { chroot = client_limit = 0 drop_priv_before_exec = no executable = imap-hibernate extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 0 type = unix_listener imap-hibernate { group = $default_internal_group mode = 0660 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = /usr/lib/dovecot/imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = haproxy = no port = 143 reuse_port = no ssl = no } inet_listener imaps { address = haproxy = no port = 993 reuse_port = no ssl = yes } privileged_group = process_limit = 0 process_min_avail = 4 protocol = imap service_count = 0 type = login user = dovecot vsz_limit = 18446744073709551615 B } service imap-urlauth-login { chroot = token-login client_limit = 0 drop_priv_before_exec = no executable = imap-urlauth-login extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login unix_listener imap-urlauth { group = mode = 0666 user = } user = $default_login_user vsz_limit = 18446744073709551615 B } service imap-urlauth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth-worker extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener imap-urlauth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service imap-urlauth { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener token-login/imap-urlauth { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener imap-master { group = mode = 0600 user = } unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service indexer-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = indexer-worker extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 10 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service indexer { chroot = client_limit = 0 drop_priv_before_exec = no executable = indexer extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service ipc { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = ipc extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener ipc { group = mode = 0600 user = $default_internal_user } unix_listener login/ipc-proxy { group = mode = 0600 user = $default_login_user } user = $default_internal_user vsz_limit = 18446744073709551615 B } service lmtp { chroot = client_limit = 1 drop_priv_before_exec = no executable = lmtp extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log unix_listener log-errors { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service managesieve-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = managesieve-login extra_groups = group = idle_kill = 0 inet_listener sieve { address = haproxy = no port = 4190 reuse_port = no ssl = no } privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 0 type = login user = dovecot vsz_limit = 18446744073709551615 B } service managesieve { chroot = client_limit = 1 drop_priv_before_exec = no executable = managesieve extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = sieve service_count = 1 type = unix_listener login/sieve { group = mode = 0666 user = } user = dovecot vsz_limit = 18446744073709551615 B } service old-stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = old-stats extra_groups = fifo_listener old-stats-mail { group = mode = 0600 user = } fifo_listener old-stats-user { group = mode = 0600 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener old-stats { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = /usr/lib/dovecot/pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = haproxy = no port = 110 reuse_port = no ssl = no } inet_listener pop3s { address = haproxy = no port = 995 reuse_port = no ssl = yes } privileged_group = process_limit = 0 process_min_avail = 4 protocol = pop3 service_count = 0 type = login user = dovecot vsz_limit = 18446744073709551615 B } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = /usr/lib/dovecot/pop3 extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service replicator { chroot = client_limit = 0 drop_priv_before_exec = no executable = replicator extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replicator-doveadm { group = mode = 00 user = $default_internal_user } unix_listener replicator { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = stats extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener stats-reader { group = dovecot mode = 0666 user = } unix_listener stats-writer { group = dovecot mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service submission-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = submission-login extra_groups = group = idle_kill = 0 inet_listener submission { address = haproxy = no port = 587 reuse_port = no ssl = no } privileged_group = process_limit = 0 process_min_avail = 0 protocol = submission service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service submission { chroot = client_limit = 1 drop_priv_before_exec = no executable = submission extra_groups = $default_internal_group group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = submission service_count = 1 type = unix_listener login/submission { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service tcpwrap { chroot = client_limit = 1 drop_priv_before_exec = no executable = tcpwrap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = user = $default_internal_user vsz_limit = 18446744073709551615 B } shutdown_clients = no ssl = yes ssl_alt_cert = ssl_alt_key = ssl_ca = </etc/apache2/zertifikate/<myServer.com>.com.pem ssl_cert = </etc/apache2/zertifikate/<myServer.com>.com.pem ssl_cert_username_field = commonName ssl_cipher_list = EECDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA384:EECDH+ECDSA+SHA256:E ECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH+aRSA+RC4:EECDH:EDH+aRSA:!aNULL:!eNU LL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS:!RC4 ssl_client_ca_dir = ssl_client_ca_file = ssl_client_cert = ssl_client_key = ssl_client_require_valid_cert = yes ssl_crypto_device = ssl_curve_list = ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_key_password = ssl_min_protocol = TLSv1.2 ssl_options = ssl_prefer_server_ciphers = yes ssl_require_crl = yes ssl_verify_client_cert = no state_dir = /var/lib/dovecot stats_writer_socket_path = stats-writer submission_client_workarounds = submission_host = submission_logout_format = in=%i out=%o submission_max_mail_size = 0 submission_max_recipients = 0 submission_relay_command_timeout = 5 mins submission_relay_connect_timeout = 30 secs submission_relay_host = submission_relay_master_user = submission_relay_max_idle_time = 29 mins submission_relay_password = submission_relay_port = 25 submission_relay_rawlog_dir = submission_relay_ssl = no submission_relay_ssl_verify = yes submission_relay_trusted = no submission_relay_user = submission_ssl = no submission_timeout = 30 secs syslog_facility = mail userdb { args = /etc/dovecot/conf.d/zDovecot-sql.conf.ext auth_verbose = default default_fields = driver = sql name = override_fields = result_failure = continue result_internalfail = continue result_success = return-ok skip = never } valid_chroot_dirs = verbose_proctitle = yes verbose_ssl = no version_ignore = no protocol lda { mail_plugins = " zlib sieve zlib" rejection_reason = Your message to <%t> was automatically discarded:%n%r } protocol imap { imap_client_workarounds = delay-newmail mail_plugins = " zlib mail_log notify zlib" ssl = yes } protocol pop3 { mail_plugins = zlib pop3_client_workarounds = oe-ns-eoh outlook-no-nuls pop3_no_flag_updates = no pop3_uidl_format = %08Xu%08Xv ssl = yes } Thank you for any advide or solution. Mit freundlichen Grüßen Yours sincerely Pascal Rudolf

1 0

Finding Users Over Quota
by dovecot＠ptld.com 17 Mar '22

17 Mar '22

Using doveadm quota will let you see if a specific user is over quota. Is there a way to have dovecot tell you which users are currently over quota? Is the quota_clone plugin a way to save user quota to dict like how last_login saves to dict? The documentation for quota_clone is MIA. (As of 3/16/22) https://wiki2.dovecot.org/Plugins v https://wiki2.dovecot.org/Plugins/QuotaClone v https://doc.dovecot.org/plugin-settings/quota-clone-plugin/ v 404 Not Found

2 1

SIS and tracing the origin of an attachment
by doug 16 Mar '22

16 Mar '22

Hi All, I'm trying to trace an attachment within an SIS subdirectory to the email message(s) that link to it. I say messages because I'm also using dovecot dedup. My understanding is the linked file name is the hash value of the attachments contents concatenated with the GUID of the email message. I have had marginal success with a message I created myself. Example: I generated an email with two attachments. Here are the links in my attachment directory. ./26/c5/26c5c540d41779d83d2f5388041d05c67d720d9a-73eca8051acd276272310000f2bc99a3 ./65/cd/65cd73112a489ef07f17ed5740aa60358e2dd3fb-74eca8051acd276272310000f2bc99a3 In my sent folder the actual GUID of the message is 75eca8051acd276272310000f2bc99a3. So the GUID of the attachment is based on the GUID of the message, but not exact. The second hex byte seems to be decremented as an offset of the attachment index from the GUID of the message. At least in my one example. # doveadm dump /mailstore/doug/mail/mailboxes/Sent/dbox-Mails/dovecot.index | grep guid | tail -1 - guid: 75eca8051acd276272310000f2bc99a3 With that actual GUID I can find the message with a search: # doveadm search -u doug mailbox Sent guid 75eca8051acd276272310000f2bc99a3 doug e5711f1cf2c9294f71090000059b96e4 53526 Now let's try to track down another email when only the HASH-GUID value is known. Here is one randomly picked. ./00/a2/00a2d5de3e41053d59bd10084826bbe094aa1c59-57857b09d1a327627e260000f2bc99a3 # doveadm search -A mailbox '*' guid 57857b09d1a327627e260000f2bc99a3 # doveadm search -A mailbox '*' guid 58857b09d1a327627e260000f2bc99a3 # doveadm search -A mailbox '*' guid 59857b09d1a327627e260000f2bc99a3 I repeated this incrementing and decrementing from 5085... through 5f85... and never located the message. This seems like it should be trivial but I've been struggling with it for days. The GUID isn't random, there must be a way to track the attachment back. What am I missing? And for those wondering why, our virus scanner flagged a number of attachments, some with several links, and I want ask the users to delete the offending messages so I can purge them from the server. If I can find the emails I can give them the mail folder, date/time, and subject of the message. -- Doug

3 5

AW: [EXT] AW: AW: AW: invalid lz4 chunk size??
by Joachim Lindenberg 16 Mar '22

16 Mar '22

What might go wrong? Or should I copy the directory myself from remote? What can go wrong with that? Thanks, Joachim -----Ursprüngliche Nachricht----- Von: Aki Tuomi <aki.tuomi(a)open-xchange.com> Gesendet: Wednesday, 16 March 2022 11:31 An: Joachim Lindenberg <dovecot(a)lindenberg.one> Betreff: Re: [EXT] AW: AW: AW: invalid lz4 chunk size?? It might, I can't promise it =) Aki > On 16/03/2022 12:29 Joachim Lindenberg <dovecot(a)lindenberg.one> wrote: > > > With remote I am referring to the second instance of mailcow including dovecot I am running, which has dovecot replication active. I am observing the issue on just one box. Thus I am hoping that when I remove the user mail directory on one host, replication will restore it from remote. > Thanks, Joachim > > -----Ursprüngliche Nachricht----- > Von: Aki Tuomi <aki.tuomi(a)open-xchange.com> > Gesendet: Wednesday, 16 March 2022 11:17 > An: Joachim Lindenberg <dovecot(a)lindenberg.one>; dovecot(a)dovecot.org > Betreff: Re: AW: AW: invalid lz4 chunk size?? > > Not sure what "remote" you are talking about. You can remove the file, and dovecot will notice it's absence and update it's indexes if this is maildir++ format. > > If this is sdbox, you need to run `doveadm force-resync -u user FolderName`. > > Aki > > > On 16/03/2022 12:08 Joachim Lindenberg <dovecot(a)lindenberg.one> wrote: > > > > > > Hi Aki, > > sure I can delete (or rename) the file(s) in the mail directory. > > Will sync then restore it from remote or should I do this manually? Should I stop dovecot during the process?` I am not very familiar with dovecot yet, as most of the complexity is hidden by mailcow. > > Thanks, Joachim > > > > -----Ursprüngliche Nachricht----- > > Von: Aki Tuomi <aki.tuomi(a)open-xchange.com> > > Gesendet: Wednesday, 16 March 2022 08:38 > > An: Joachim Lindenberg <dovecot(a)lindenberg.one>; dovecot(a)dovecot.org > > Betreff: Re: AW: invalid lz4 chunk size?? > > > > Hi, > > > > looks a lot like your mail file is corrupted. Not much you can do about it other than maybe delete the file? You can try recover it with `doveadm fetch -u someone text uid 1553 mailbox Sent` and then using `doveadm save -u someone -m Sent` to store it back. > > > > Aki > > > > > On 16/03/2022 09:35 Joachim Lindenberg <dovecot(a)lindenberg.one> wrote: > > > > > > > > > Nobody that can help? > > > Thanks, > > > Joachim > > > > > > ---------- > > > > > > I am still experiencing the issue. Any suggestion? > > > As I do have replication between two nodes and only one is showing the issue - can I rename the mailbox easily on one side and rely on replication to get the copy replaced? If that makes sense, which commands do you recommend? > > > Thanks, > > > Joachim > > > > > > -----Ursprüngliche Nachricht----- > > > Von: Joachim Lindenberg <dovecot(a)lindenberg.one> > > > Gesendet: Thursday, 3 March 2022 12:06 > > > An: 'Aki Tuomi' <aki.tuomi(a)open-xchange.com>; dovecot(a)dovecot.org > > > Betreff: AW: invalid lz4 chunk size?? > > > > > > dovecot --version reports 2.3.17.1 (476cd46418) Joachim > > > > > > -----Ursprüngliche Nachricht----- > > > Von: Aki Tuomi <aki.tuomi(a)open-xchange.com> > > > Gesendet: Thursday, 3 March 2022 11:56 > > > An: Joachim Lindenberg <dovecot(a)lindenberg.one>; > > > dovecot(a)dovecot.org > > > Betreff: Re: invalid lz4 chunk size?? > > > > > > > > > > On 03/03/2022 12:24 Joachim Lindenberg <dovecot(a)lindenberg.one> wrote: > > > > > > > > > > > > Hello, > > > > when accessing one mailbox via ActiveSync / SoGo / Dovecot I get the following error repeatedly in dovecot log: > > > > imap(somemailbox(a)example.org)<1579><***>: Error: Mailbox Sent: > > > > UID=1553: read(compress()) failed: read() failed: lz4.read(): invalid lz4 chunk size: 1601505441 at 16842752 (read reason=) I can still access the mailbox via IMAP though. > > > > What can I do to resolve the issue? > > > > Thanks, > > > > Joachim > > > > > > Which version of Dovecot? > > > > > > Aki

2 1

invalid lz4 chunk size??
by Joachim Lindenberg 16 Mar '22

16 Mar '22

Hello, when accessing one mailbox via ActiveSync / SoGo / Dovecot I get the following error repeatedly in dovecot log: imap(somemailbox(a)example.org)<1579><***>: Error: Mailbox Sent: UID=1553: read(compress()) failed: read() failed: lz4.read(): invalid lz4 chunk size: 1601505441 at 16842752 (read reason=) I can still access the mailbox via IMAP though. What can I do to resolve the issue? Thanks, Joachim

2 7

sieve-filter not respecting :create flag of fileinto
by David Arroyo 16 Mar '22

16 Mar '22

Hello, I recently significantly modified my sieve rules for filing mailing list posts in my Fastmail inbox. The rules contain a few rules that file mail like so: fileinto :create ml.${5}${4}{$3}{$2}{$1}; # reversed list-id The rules work as expected on delivery to fastmail. Because these rules only run on delivery, and the new folder layout is different from my existing one, I want to apply the rules to my existing mail. I thought dovecot's `sieve-filter` command, together with the `imapc` storage backend, would be a good way to do that, so I moved some existing mail into a folder, `sieve-test`, and ran the following: sieve-filter -x '+editheader +mailbox' -W -e rules.sieve sieve-test However, what I see is that sieve-filter fails when the new directory does not exist. Here is some example (redacted) output: Info: imapc(imap.fastmail.com:993): Connected to x.x.x.x:993 (local x.x.x.x) error: msgid=<xxx>: fileinto action: failed to store into mailbox 'ml.gnu.guix-devel': Mailbox does not exist. sieve-filter(me): Info: sieve: msgid=<xxx>: left message in mailbox 'sieve-test' error: sieve script execution failed for this message; message left in source mailbox. sieve-filter(me): Info: sieve: msgid=<yyy>: fileinto action: stored mail into mailbox 'ml.9fans.9fans' My config looks like this: protocols = none mail_location = imapc: namespace { inbox = yes separator = . } imapc_host = imap.fastmail.com imapc_port = 993 imapc_ssl = imaps imapc_user = $username If this is a bug in sieve-filter I'd be happy to try and fix it, but I'm reaching out here first to see if this is expected behavior or a misconfiguration on my part. Thanks for any help, David

2 4

mdbox_rotate_size recommendation / performance
by Lucas Rolff 15 Mar '22

15 Mar '22

Hi guys, When using mdbox under Dovecot, the mdbox_rotate_size setting defaults to 10 megabyte - from a performance point of view if using spinning drives does this matter whether one goes for e.g. 2MB versus 10MB, especially in the combination with compression. Does anyone have any performance data regarding it’s size, and what’s a decent trade-off between limiting IOPS required by the drive versus the sequential read/write speeds. Any pointers would be awesome! Thanks in advance

1 0

AntiVirus in Maildir
by Masakazu Hirose 15 Mar '22

15 Mar '22

Hi all, I run a mail server on Maildir. Does Dovecot work correctly if I delete the mail files stored in Maildir? Do I need to run the doveadm command? I want to run a virus scan on Maildir. When a virus is detected, the mail file is deleted without notifying Dovecot. I assumed this was incorrect behavior for Dovecot. Please help me when someone has time. Thanks, Masa

4 5

allow_nets equivalent for all users?
by Bryan K. Walton 14 Mar '22

14 Mar '22

Hi, It is my understanding that allow_nets is a field that gets used in a password database, and therefore is a per-user setting. Is there an equivalent method for defining allowed network(s) for ALL users? In other words, a single setting that applies to every user? Thanks, Bryan

2 4

Possible bug interaction between Dovecot and Thunderbird 98/99 email client
by Arthur Koziol 11 Mar '22

11 Mar '22

Hi Dovecot devs, My name is Arthur. I'm a volunteer with Mozilla and am working with a user who's having some odd issues with his Thunderbird email client. I'm reaching out to you folks because he's using an at-home IMAP setup with Dovecot. It's not 100% clear if his setup is polling his GMail accounts and then pulling everything to his Dovecot setup but if there's any interesting in jumping into the bug we're trying to help this user with, feel free to browse the bug at https://bugzilla.mozilla.org/show_bug.cgi?id=1726319 I asked the user if he's reached out to the Dovecot devs yet but he's not replied. We're not sure if this is a Dovecot / setup issue, a Thunderbird issue or something in between but we could use some other eyes and ideas of what to check for this user if you guys have a couple seconds to take a look. Thanks for reading. best, Arthur

1 0

Dovecot High Availability ?
by White, Daniel E. (GSFC-770.0)[NICS] 11 Mar '22

11 Mar '22

Are there any current, free high availability strategies for Dovecot ?

2 1

Can't create viable password hashes
by David Griffith 11 Mar '22

11 Mar '22

I recently discovered that I can no longer create viable password hashes for use in /etc/dovecot/dovecot.passwd. So far, I've been using the following command done by root: doveadm_cmd pw -s SHA512-CRYPT -u joe -p mypassword This creates something that looks legit, but dovecot won't accept it. I've been using my own solution for allowing users to change their dovecot passwords (https://gitlab.com/DavidGriffith/dovepasswd) and this is how it generates the hashes. Is there a better way of going about this? -- David Griffith dave(a)661.org A: Because it fouls the order in which people normally read text. Q: Why is top-posting such a bad thing? A: Top-posting. Q: What is the most annoying thing in e-mail?

1 0

XOAUTH2 submission - "500 5.5.2 Line too long"
by Rosario Esposito 08 Mar '22

08 Mar '22

Hello, I setup a dovecot submission server, using xoauth2 authentication. My roundcube webmail points to dovecot submission. In roundcube smtp logs, I see: [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Recv: 250-PIPELINING [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Recv: 250 XCLIENT ADDR PORT PROTO HELO LOGIN SESSION TTL TIMEOUT FORWARD [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Send: AUTH XOAUTH2 dXNlcj1yZXNwb3NpdAFhdXRoPWJlYXJlci<<<...*very long base64 string*....>>> [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Recv: 500 5.5.2 Line too long [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Send: ****** [4] [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Recv: 221 2.0.0 Bye And, in dovecot logs I found: Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: command EHLO: 250 reply: Sent: 250-###.<#####> 8BITMIME AUTH PLAIN OAUTHBEARER XOAUTH2 BURL imap CHUNKING ENHANCEDSTATUSCODES SIZE PIPELINING XCLIENT ADDR PORT PROTO HELO LOGIN SESSION TTL TIMEOUT FORWARD Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: command EHLO: Finished Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: command EHLO: Destroy Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: command EHLO: 250 reply: Destroy Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: Trigger output Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: No more commands pending Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: Sending replies Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: No more commands pending Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: Client sent invalid command: Command line is too long Apparently, the problem came out after upgrading from dovecot 2.3.17 to 2.3.18 Any ideas ?

3 2

Replicator Issues on Large Mail Boxes
by Paul Kudla (Scom.ca Internet Services Inc.) 08 Mar '22

08 Mar '22

Ok running : freebsd-12.1 dovecot-2.3.18.current dovecot-2.3-pigeonhole-0.5.18.current simply put replication works fine on smaller email boxes without issues. dsync also works when run manually, longest sync is 60 secords or so when using dsync so need replicator bumped up ? i get the fact that the file locking issue relative since a larger mailbox will take longer to replicate when an email comes in ? mail18 03-05 18:05:51 {dovecot} [15799] (872623573) doveadm(keith(a)elirpa.com)<32249><GnS3M53sI2L5fQAAz1jc/w>: Error: Couldn't lock /data/dovecot/users/elirpa.com/keith(a)elirpa.com//tmp/.dovecot-sync.lock: fcntl(/data/dovecot/users/elirpa.com/keith@elirpa.com//tmp/.dovecot-sync.lo…, write-lock, F_SETLKW) locking failed: Timed out after 30 seconds (WRITE lock held by pid 31519) so what i need is where fcntl is setting a 30 second timeout for replication (i have adjust all the others in the src code) simply put replicator fails and retries and keeps failing which is understandable as it probably needs a little more time ? # sync.users carol(a)scom.ca none 00:02:51 08:16:34 - y nick(a)elirpa.com low 02:45:17 09:28:32 - y keith(a)elirpa.com none 02:30:13 09:28:32 - y paul(a)scom.ca high 02:45:17 09:28:32 - y ed(a)scom.ca none 02:34:34 09:28:32 - y ed.hanna(a)dssmgmt.com high 02:45:17 09:28:32 - y i found under /programs/src/mail/dovecot-2.3.18.current/src/lib file-lock.c struct flock fl; fl.l_type = lock_type; fl.l_whence = SEEK_SET; fl.l_start = 0; fl.l_len = 0; ret = fcntl(fd, timeout_secs != 0 ? F_SETLKW : F_SETLK, &fl); if (timeout_secs != 0) { alarm(0); file_lock_wait_end(path); } if (ret == 0) break; if (timeout_secs == 0 && (errno == EACCES || errno == EAGAIN)) { /* locked by another process */ *error_r = t_strdup_printf( "fcntl(%s, %s, F_SETLK) locking failed: %m " "(File is already locked)", path, lock_type_str); return 0; } if (err_is_lock_timeout(started, timeout_secs)) { errno = EAGAIN; *error_r = t_strdup_printf( "fcntl(%s, %s, F_SETLKW) locking failed: " "Timed out after %u seconds%s", path, lock_type_str, timeout_secs, file_lock_find(fd, set->lock_method, lock_type)); return 0; } *error_r = t_strdup_printf("fcntl(%s, %s, %s) locking failed: %m", path, lock_type_str, timeout_secs == 0 ? "F_SETLK" : "F_SETLKW"); if (errno == EDEADLK && !set->allow_deadlock) { i_panic("%s%s", *error_r, file_lock_find(fd, set->lock_method, lock_type)); } return -1; #endif -- Happy Saturday !!! Thanks - paul Paul Kudla Scom.ca Internet Services <http://www.scom.ca> 004-1009 Byron Street South Whitby, Ontario - Canada L1N 4S3 Toronto 416.642.7266 Main 1.866.411.7266 Fax 1.888.892.7266

2 1

Is fts_autoindex_exclude options working fine?
by Alessio Cecchi 07 Mar '22

07 Mar '22

Hi, we have some trouble with Solr ad FTS engine. Solr have some spike of load and responding slow when an user expunge or append a message. fts_autoindex is set to "yes". So I add to 90-plugin.conf these options: fts_autoindex_exclude = Drafts fts_autoindex_exclude2 = Spam fts_autoindex_exclude3 = Trash fts_autoindex_exclude4 = Sent or fts_autoindex_exclude = \Drafts fts_autoindex_exclude2 = \Junk fts_autoindex_exclude3 = \Trash fts_autoindex_exclude4 = \Sent But the problem is still present. Here some example of logs when users have timeout in their email client, specially when saving in Drafts automatically: Mar 7 12:21:37 pop01 dovecot: imap(user1(a)company1.com) session=<flNVCZ/ZcO5dPnGT>: Warning: Maildir /home/vmail/domains/company1.com/user1/Maildir/.Drafts: Synchronization took 119 seconds (0 new msgs, 0 flag change attempts, 1 expunge attempts) Mar 7 12:21:37 pop01 dovecot: imap(user1(a)company1.com) session=<flNVCZ/ZcO5dPnGT>: Disconnected: Connection closed (UID EXPUNGE finished 118.715 secs ago) in=77617 out=679511 deleted=1 expunged=1 autoexpunged=0 trashed=0 appended=2 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Mar 7 12:21:52 pop02 dovecot: imap(user2(a)company2.net) session=<B9NNCZ/Z+uC5Ydlv>: Warning: Maildir /home/vmail/domains/company2.net/user2/Maildir/.Trash: Synchronization took 149 seconds (0 new msgs, 0 flag change attempts, 1 expunge attempts) Mar 7 12:21:52 pop02 dovecot: imap(user2(a)company2.net) session=<B9NNCZ/Z+uC5Ydlv>: Disconnected: Logged out in=2407 out=7025 deleted=0 expunged=0 autoexpunged=1 trashed=0 appended=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Is my fts_autoindex_exclude wrong or there are some limits with this option? Here the relevant part of 15-mailboxes.conf namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox virtual/All { comment = All my messages special_use = \All } prefix = separator = / } Thanks -- Alessio Cecchi Postmaster @http://www.qboxmail.it https://www.linkedin.com/in/alessice

1 0

doveadm complains about virtual namespace
by Roberto Sanchez 07 Mar '22

07 Mar '22

Hi, I’ve setup my server __user__nd mail sending/receiving is all working without issue. However, a cron script that cleans up the Junk folder and runs: doveadm expunge -A mailbox Junk savedbefore 60d gives out the following error: doveadm(__user__(a)example.com): Error: Namespace 'Virtual.': Unknown mail storage driver virtual I don’t know if I have a configuration issue or if I have to load the virtual plugin at some other point in the config? I would appreciate any help. This is the output with debug enabled, and further below is my dovecot -n output (I’ve changed the user name to __user__ and the domain to example.com) Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Debug: auth-master: userdb list: Started listing users (user_mask=) Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Client connected (fd=10) Debug: auth-master: userdb list: Returned username: __user__(a)example.com doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: userdb lookup(__user__(a)example.com): Started userdb lookup doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Client connected (fd=12) doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: userdb lookup(__user__(a)example.com): auth USER input: __user__(a)example.com maildir=example.com/__user__/ home=/var/mail/vhosts/example.com/__user__ uid=5000 gid=5000 doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: userdb lookup(__user__(a)example.com): Finished userdb lookup (username=__user__(a)example.com maildir=example.com/__user__/ home=/var/mail/vhosts/example.com/__user__ uid=5000 gid=5000) doveadm(__user__(a)example.com)<1068593><>: Debug: Added userdb setting: plugin/maildir=example.com/__user__/ doveadm(__user__(a)example.com): Debug: Effective uid=5000, gid=5000, home=/var/mail/vhosts/example.com/__user__ doveadm(__user__(a)example.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/vhosts/example.com/__user__/Maildir doveadm(__user__(a)example.com): Debug: maildir++: root=/var/mail/vhosts/example.com/__user__/Maildir, index=, indexpvt=, control=, inbox=/var/mail/vhosts/example.com/__user__/Maildir, alt= doveadm(__user__(a)example.com): Debug: Namespace virtual: type=private, prefix=Virtual., sep=., inbox=no, hidden=no, list=yes, subscriptions=yes location=virtual:/var/mail/virtual:INDEX=/var/mail/vhosts/example.com/__use… doveadm(__user__(a)example.com): Error: Namespace 'Virtual.': Unknown mail storage driver virtual > dovecot -n # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.7.2 () # OS: Linux 5.16.3-x86_64-linode152 x86_64 Ubuntu 20.04.4 LTS # Hostname: bender.example.com auth_mechanisms = plain login auth_username_format = %u mail_location = maildir:%h/Maildir mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = } namespace virtual { list = yes location = virtual:/var/mail/virtual:INDEX=/var/mail/vhosts/%d/%n/virtual mailbox All { auto = subscribe comment = All my messages special_use = \All } mailbox Flagged { auto = subscribe comment = All my flagged messages special_use = \Flagged } prefix = Virtual. separator = . subscriptions = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = file:%h/sieve;active=%h/dovecot.sieve sieve_before = /etc/dovecot/sieve/ } postmaster_address = postmaster at example.com protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { address = localhost port = 4190 } } service stats { unix_listener stats-reader { group = www-data mode = 0660 user = www-data } unix_listener stats-writer { group = www-data mode = 0660 user = www-data } } ssl = required ssl_cert = </etc/dovecot/private/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n driver = static } protocol lmtp { mail_plugins = " sieve virtual" postmaster_address = postmaster(a)example.com } protocol lda { mail_plugins = " virtual" } protocol imap { mail_plugins = " virtual" } protocol sieve { mail_plugins = virtual }

3 2

Pigeonhole Sieve: Vacation Extension issue
by Zakaria 05 Mar '22

05 Mar '22

Hi there, I wondered if there is any one who can help me out on this issue. I tried to setup the vacation extension, and it works fine if the Return-Path header and Envelope-From field in Received wasn’t rewritten and contains the actual sender email address which the vacation extension will retrieve from and reply to. Given, I’ve rewritten both headers, to modify TLS connection mailed-by address and I had to revert back to get the vacation extension working, I wondered if there is anyone know how to modify the Sieve settings in Dovecot config for LMTP/LDA and Sieve, or Sieve script rules to retrieve sender email address from From header or any other specific header? If it's not possible, it would be so good if its implemented, it doesn’t seem to be a hard task, so please log this as a feature request. With thanks. Zakaria. Btw, all my prayers and solidarity I send out to Ukraine, Russia and the rest of Europe, and the world, and the sick from this and COVID and alike. We should value one another, Seriously, Putin must urgently stop giving to who want destruction and harm in Europe and manipulating behind the scene such devil affair and leading to this very sickening and unacceptable horror. Palestine deserve justice than preoccupying the world with creating more injustices.

1 0

doveadm quota get hangs for 60 seconds (some analysis done)
by jaroslav＠thinline.cz 05 Mar '22

05 Mar '22

Hello, I encountered somewhat strange behaviour when running doveadm quota get with wildcard username (all usernames are in user@domain format): doveadm -f pager quota get -u *(a)example.domain The command hangs for 60 seconds before returning its result. I tried to dig into the issue a bit using strace and found out that there seems to be some kind of communication mismatch between Dovecot processes. Here is what I found - sorry for the wall of text, strace outputs tend to be large, I tried to reduce them as much as possible. I also tried to draw some conclusions below. This is from strace in the doveadm process, it connects to auth-userdb and requests list of users 1646473083.263021 connect(10, {sa_family=AF_UNIX, sun_path="/run/dovecot/auth-userdb"}, 110) = 0 1646473083.263627 write(10, "VERSION\t1\t0\nLIST\t1\tuser=*(a)example.domain\n", 47) = 47 1646473083.263807 read(10, "VERSION\t1\t1\nSPID\t30012\n", 8192) = 23 1646473084.188212 read(10, "LIST\t1\tuser1@notthat.domain\nLIST\t1\tuser2@another.domain\nLIST\t1\tuser3@also.not\nLIST\t1\t.... This list goes on, the server has over 10000 user accounts. (As a side note, this behaviour struck me as strange - I would expect that the result would be filtered by the server side of the connection, only listing users that match the requested wildcard. I don't know anything about Dovecot internals though, so this might be perfectly normal.) At some point the returned data contain users doveadm is interested in (ie. users that match the wildcard) and requests their information from other Dovecot services, this is an excerpt for a dict service: 1646473084.224608 connect(13, {sa_family=AF_UNIX, sun_path="/run/dovecot/dict"}, 110) = 0 1646473084.225617 write(13, "H2\t2\t0\trelevantuser(a)example.domain\tsqldomainquota\n", 50) = 50 No data are read from FD 10 during this time. When all users are queried, reading from FD 10 resumes 1646473084.274405 read(10, "ifth.domain\nLIST\t1\tuser987(a)domain.six\nLIST\t1\t... At this point though, the process gets stuck: 1646473084.274514 epoll_wait(11, [], 1, 0) = 0 1646473084.274555 read(10, 0x5620076d79dd, 6035) = -1 EAGAIN (Resource temporarily unavailable) 1646473084.274601 epoll_wait(11, [{EPOLLIN, {u32=124338208, u64=94695563280416}}], 1, 155000) = 1 It resumes after 60 seconds, reads some more users and then receives string "DONE" 1646473144.287149 read(10, "LIST\t1\tuser456@domain.seven\nLIST\t1\tuser123@domain.e8\nLIST\t1\tuser7865@dom.nine\n", 6035) = 99 1646473144.287149 read(10, "LIST\t1\t ... ", 5936) = 82 ... 1646473144.294373 epoll_wait(11, [{EPOLLIN, {u32=124338208, u64=94695563280416}}], 1, 155000) = 1 1646473144.307846 read(10, "DONE\t1\t\n", 1611) = 8 Note that at this point the read syscall is no longer trucated. As opposed to reads above, which amounted to 8kB blocks, these are reading few addresses at a time. After the "DONE" string is received, there is no more communication with other Dovecot processes, doveadm prints out results to the console and terminates. Next I investigated the auth process. 1646473083.263121 accept(11, {sa_family=AF_UNIX}, [28->2]) = 23 1646473083.263181 getsockname(23, {sa_family=AF_UNIX, sun_path="/run/dovecot/auth-userdb"}, [28->27]) = 0 1646473083.263690 read(23, "VERSION\t1\t0\nLIST\t1\tuser=*(a)example.domain\n", 1024) = 47 1646473083.263939 connect(24, {sa_family=AF_UNIX, sun_path="auth-worker"}, 110) = 0 1646473083.264228 write(24, "VERSION\tauth-worker\t1\t0\nDBHASH\t1234567890abcdef1234567890abcdef\tfedcba0987654321fedcba0987654321\n", 97) = 97 1646473083.264271 writev(24, [{iov_base="1\t", iov_len=2}, {iov_base="LIST\t1\tuser=*(a)example.domain\tservice=\toriginal-username", iov_len=61}, {iov_base="\n", iov_len=1}], 3) = 64 1646473084.187567 read(24, "1\t*\tuser1(a)notthat.domain\n1\t*\t... 1646473084.187977 write(23, "LIST\t1\tuser1(a)notthat.domain\nLIST\t1\t Reads and writes alternate until these syscalls: 1646473084.238938 read(24, " ... \n1\tOK\n", 8167) = 5354 1646473084.239108 write(23, "LIST\t1\t ... , 51224) = -1 EAGAIN (Resource temporarily unavailable) 1646473084.239536 write(23, "LIST\t1\t ... , 51224) = -1 EAGAIN (Resource temporarily unavailable) From the timing this looks like a kernel buffer for the connection is filled because the other side is not reading the data. This matches strace from doveadm which is at this point reading information about quotas from dict service (timestamp 1646473084.225617.) Auth process seems to react to this by putting the FD on epoll list and then it goes to handle other connections. FD 24 is removed from the epoll list at the same time: 1646473084.239926 epoll_ctl(14, EPOLL_CTL_ADD, 23, {EPOLLOUT|EPOLLERR|EPOLLHUP, {u32=109861328, u64=94566699784656}}) = 0 1646473084.239980 epoll_ctl(14, EPOLL_CTL_DEL, 24, 0x7ffca3a9ae2c) = 0 FD 23 becomes writable relatively quickly, pending data is written to it and read from FD 24 is attempted with no data available: 1646473084.270224 epoll_ctl(14, EPOLL_CTL_DEL, 23, 0x7ffca3a9ae5c) = 0 1646473084.270271 write(23, "LIST\t1\t ... , 51224) = 51224 1646473084.270620 epoll_ctl(14, EPOLL_CTL_ADD, 24, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=109860944, u64=94566699784272}}) = 0 1646473084.270712 read(24, 0x5602069198e3, 2813) = -1 EAGAIN (Resource temporarily unavailable) Again, nothing else happens for 60 seconds until FD 24 signals what I presume is a connection close attempt. Note that there was no data read from FD 24 but when the "SHUTDOWN" string arrives from it, auth process starts writing items to FD 23, one by one. 1646473144.286936 read(24, "SHUTDOWN\n", 2813) = 9 1646473144.287003 write(23, "LIST\t1\tuser456(a)domain.seven\n", 29) = 29 1646473144.287059 write(23, "LIST\t1\tuser123(a)domain.e8\n", 31) = 31 1646473144.287103 write(23, "LIST\t1\tuser7865(a)dom.nine\n", 39) = 39 There are multiple user databases, I assume the following is a lookup from the others: 1646473144.294256 writev(24, [{iov_base="2\t", iov_len=2}, {iov_base="LIST\t2\tuser=*(a)example.domain\tservice=\toriginal-username", iov_len=61}, {iov_base="\n", iov_len=1}], 3) = 64 1646473144.294379 read(24, 0x5602069198ec, 2804) = -1 EAGAIN (Resource temporarily unavailable) 1646473144.300490 read(24, "2\tOK\n", 2804) = 5 1646473144.300556 writev(24, [{iov_base="3\t", iov_len=2}, {iov_base="LIST\t3\tuser=*(a)example.domain\tservice=\toriginal-username", iov_len=61}, {iov_base="\n", iov_len=1}], 3) = 64 1646473144.300653 read(24, 0x5602069198f1, 2799) = -1 EAGAIN (Resource temporarily unavailable) 1646473144.307687 read(24, "3\tOK\n", 2799) = 5 1646473144.307751 write(23, "DONE\t1\t\n", 8) = 8 1646473144.307944 close(24) = 0 1646473144.308092 read(23, "", 977) = 0 1646473144.308185 close(23) = 0 I also looked into the auth-userdb (auth -w) service, it seems to mirror what happens in the auth process: [pid 22387] 1646473083.407660 accept(7, <unfinished ...> [pid 22387] 1646473083.407767 <... accept resumed>{sa_family=AF_UNIX}, [28->2]) = 17 [pid 22387] 1646473084.187096 write(17, "1\t*\tuser1(a)notthat.domain\n1\t*\t [pid 22387] 1646473084.233120 write(17, "1\tOK\n", 5 <unfinished ...> [pid 22387] 1646473084.233577 epoll_ctl(9, EPOLL_CTL_ADD, 17, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=659542480, u64=94356796068304}} <unfinished ...> [pid 22387] 1646473084.234006 read(17, <unfinished ...> [pid 22387] 1646473084.234254 <... read resumed>0x55d12753b7d1, 8031) = -1 EAGAIN (Resource temporarily unavailable) And after 60 seconds: [pid 22387] 1646473144.286843 write(17, "SHUTDOWN\n", 9 <unfinished ...> At which point the other two requests come in and are replied to. As I said above, I don't know anything about Dovecot internals but from I can gather from these outputs, all data are exchanged correctly and nothing gets stuck reading them from a permanent storage or alike. This bug doesn't manifest every time but seems to be fairly deterministic in that it always triggers for some domains but not for others. From what I've noticed, this affected domain receives all its users in single 8k read in the doveadm process, which in turns triggers (relatively) lengthy lookups and forces the auth process to put more writes on hold (at timestamp 1646473084.239108) Is it possible that when this happens, the "OK" string received from auth-userdb process (timestamp 1646473084.238938) is overlooked and auth process is waiting for more data from auth-userdb while auth-userdb waits for another request? The server itself runs Dovecot 1:2.3.13+dfsg1-2 from Debian repository on amd64. Output from dovecot --version is 2.3.13 (89f716dc2). As far as I can see, nothing indicates this is a performance problem related to insufficient hardware - server runs at 25% CPU utilization average, Pressure Stall Information reports average of 0.5% for CPU, 1% for I/O. System memory used is 10 out of 64GB. As far as I can see, no Dovecot process becomes CPU-bound when doveadm is running. I tried some web search but found nothing related to this. For our purposes, this issue has a relatively simple workaround - using doveadm quota get on specific usernames instead of the wildcard one. Since this might be an issue with a relatively easy fix for someone who knows where to look, I decided to post this bug report anyway. If needed, I should be able to test patches that apply cleanly to Debian sources and compile with dpkg-buildpackage. Thanks

1 0

Dupliate-ish email search?
by ＠lbutlr 04 Mar '22

04 Mar '22

I'm mulling over writing some code to find emails in a maildir that are duplicates, ish. That is to say that sometimes the same message doesn't quite show up as an exact match. Like some ad company may send you three identical messages, except they aren't actually EXACTLY identical, the message-IDs are different, and may the to address quoted part is different, so normal duplicate finders fail to find them. Before I start, is this a solved problem? -- I thought that they were angels, but to my surprise, we climbed aboard their starship, we headed for the skies.

3 2