March 2022 - dovecot - dovecot.org

mdbox_rotate_size recommendation / performance
by Lucas Rolff 15 Mar '22

15 Mar '22

Hi guys, When using mdbox under Dovecot, the mdbox_rotate_size setting defaults to 10 megabyte - from a performance point of view if using spinning drives does this matter whether one goes for e.g. 2MB versus 10MB, especially in the combination with compression. Does anyone have any performance data regarding it’s size, and what’s a decent trade-off between limiting IOPS required by the drive versus the sequential read/write speeds. Any pointers would be awesome! Thanks in advance

1 0

AntiVirus in Maildir
by Masakazu Hirose 15 Mar '22

15 Mar '22

Hi all, I run a mail server on Maildir. Does Dovecot work correctly if I delete the mail files stored in Maildir? Do I need to run the doveadm command? I want to run a virus scan on Maildir. When a virus is detected, the mail file is deleted without notifying Dovecot. I assumed this was incorrect behavior for Dovecot. Please help me when someone has time. Thanks, Masa

4 5

allow_nets equivalent for all users?
by Bryan K. Walton 14 Mar '22

14 Mar '22

Hi, It is my understanding that allow_nets is a field that gets used in a password database, and therefore is a per-user setting. Is there an equivalent method for defining allowed network(s) for ALL users? In other words, a single setting that applies to every user? Thanks, Bryan

2 4

Possible bug interaction between Dovecot and Thunderbird 98/99 email client
by Arthur Koziol 11 Mar '22

11 Mar '22

Hi Dovecot devs, My name is Arthur. I'm a volunteer with Mozilla and am working with a user who's having some odd issues with his Thunderbird email client. I'm reaching out to you folks because he's using an at-home IMAP setup with Dovecot. It's not 100% clear if his setup is polling his GMail accounts and then pulling everything to his Dovecot setup but if there's any interesting in jumping into the bug we're trying to help this user with, feel free to browse the bug at https://bugzilla.mozilla.org/show_bug.cgi?id=1726319 I asked the user if he's reached out to the Dovecot devs yet but he's not replied. We're not sure if this is a Dovecot / setup issue, a Thunderbird issue or something in between but we could use some other eyes and ideas of what to check for this user if you guys have a couple seconds to take a look. Thanks for reading. best, Arthur

1 0

Dovecot High Availability ?
by White, Daniel E. (GSFC-770.0)[NICS] 11 Mar '22

11 Mar '22

Are there any current, free high availability strategies for Dovecot ?

2 1

Can't create viable password hashes
by David Griffith 11 Mar '22

11 Mar '22

I recently discovered that I can no longer create viable password hashes for use in /etc/dovecot/dovecot.passwd. So far, I've been using the following command done by root: doveadm_cmd pw -s SHA512-CRYPT -u joe -p mypassword This creates something that looks legit, but dovecot won't accept it. I've been using my own solution for allowing users to change their dovecot passwords (https://gitlab.com/DavidGriffith/dovepasswd) and this is how it generates the hashes. Is there a better way of going about this? -- David Griffith dave(a)661.org A: Because it fouls the order in which people normally read text. Q: Why is top-posting such a bad thing? A: Top-posting. Q: What is the most annoying thing in e-mail?

1 0

XOAUTH2 submission - "500 5.5.2 Line too long"
by Rosario Esposito 08 Mar '22

08 Mar '22

Hello, I setup a dovecot submission server, using xoauth2 authentication. My roundcube webmail points to dovecot submission. In roundcube smtp logs, I see: [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Recv: 250-PIPELINING [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Recv: 250 XCLIENT ADDR PORT PROTO HELO LOGIN SESSION TTL TIMEOUT FORWARD [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Send: AUTH XOAUTH2 dXNlcj1yZXNwb3NpdAFhdXRoPWJlYXJlci<<<...*very long base64 string*....>>> [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Recv: 500 5.5.2 Line too long [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Send: ****** [4] [08-Mar-2022 15:47:16 +0100]: <qjonb57c> Recv: 221 2.0.0 Bye And, in dovecot logs I found: Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: command EHLO: 250 reply: Sent: 250-###.<#####> 8BITMIME AUTH PLAIN OAUTHBEARER XOAUTH2 BURL imap CHUNKING ENHANCEDSTATUSCODES SIZE PIPELINING XCLIENT ADDR PORT PROTO HELO LOGIN SESSION TTL TIMEOUT FORWARD Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: command EHLO: Finished Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: command EHLO: Destroy Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: command EHLO: 250 reply: Destroy Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: Trigger output Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: No more commands pending Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: Sending replies Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: No more commands pending Mar 8 15:47:17 ### dovecot[97376]: submission-login: Debug: smtp-server: conn 172.18.6.100:38658 [1]: Client sent invalid command: Command line is too long Apparently, the problem came out after upgrading from dovecot 2.3.17 to 2.3.18 Any ideas ?

3 2

Replicator Issues on Large Mail Boxes
by Paul Kudla (Scom.ca Internet Services Inc.) 08 Mar '22

08 Mar '22

Ok running : freebsd-12.1 dovecot-2.3.18.current dovecot-2.3-pigeonhole-0.5.18.current simply put replication works fine on smaller email boxes without issues. dsync also works when run manually, longest sync is 60 secords or so when using dsync so need replicator bumped up ? i get the fact that the file locking issue relative since a larger mailbox will take longer to replicate when an email comes in ? mail18 03-05 18:05:51 {dovecot} [15799] (872623573) doveadm(keith(a)elirpa.com)<32249><GnS3M53sI2L5fQAAz1jc/w>: Error: Couldn't lock /data/dovecot/users/elirpa.com/keith(a)elirpa.com//tmp/.dovecot-sync.lock: fcntl(/data/dovecot/users/elirpa.com/keith@elirpa.com//tmp/.dovecot-sync.lo…, write-lock, F_SETLKW) locking failed: Timed out after 30 seconds (WRITE lock held by pid 31519) so what i need is where fcntl is setting a 30 second timeout for replication (i have adjust all the others in the src code) simply put replicator fails and retries and keeps failing which is understandable as it probably needs a little more time ? # sync.users carol(a)scom.ca none 00:02:51 08:16:34 - y nick(a)elirpa.com low 02:45:17 09:28:32 - y keith(a)elirpa.com none 02:30:13 09:28:32 - y paul(a)scom.ca high 02:45:17 09:28:32 - y ed(a)scom.ca none 02:34:34 09:28:32 - y ed.hanna(a)dssmgmt.com high 02:45:17 09:28:32 - y i found under /programs/src/mail/dovecot-2.3.18.current/src/lib file-lock.c struct flock fl; fl.l_type = lock_type; fl.l_whence = SEEK_SET; fl.l_start = 0; fl.l_len = 0; ret = fcntl(fd, timeout_secs != 0 ? F_SETLKW : F_SETLK, &fl); if (timeout_secs != 0) { alarm(0); file_lock_wait_end(path); } if (ret == 0) break; if (timeout_secs == 0 && (errno == EACCES || errno == EAGAIN)) { /* locked by another process */ *error_r = t_strdup_printf( "fcntl(%s, %s, F_SETLK) locking failed: %m " "(File is already locked)", path, lock_type_str); return 0; } if (err_is_lock_timeout(started, timeout_secs)) { errno = EAGAIN; *error_r = t_strdup_printf( "fcntl(%s, %s, F_SETLKW) locking failed: " "Timed out after %u seconds%s", path, lock_type_str, timeout_secs, file_lock_find(fd, set->lock_method, lock_type)); return 0; } *error_r = t_strdup_printf("fcntl(%s, %s, %s) locking failed: %m", path, lock_type_str, timeout_secs == 0 ? "F_SETLK" : "F_SETLKW"); if (errno == EDEADLK && !set->allow_deadlock) { i_panic("%s%s", *error_r, file_lock_find(fd, set->lock_method, lock_type)); } return -1; #endif -- Happy Saturday !!! Thanks - paul Paul Kudla Scom.ca Internet Services <http://www.scom.ca> 004-1009 Byron Street South Whitby, Ontario - Canada L1N 4S3 Toronto 416.642.7266 Main 1.866.411.7266 Fax 1.888.892.7266

2 1

Is fts_autoindex_exclude options working fine?
by Alessio Cecchi 07 Mar '22

07 Mar '22

Hi, we have some trouble with Solr ad FTS engine. Solr have some spike of load and responding slow when an user expunge or append a message. fts_autoindex is set to "yes". So I add to 90-plugin.conf these options: fts_autoindex_exclude = Drafts fts_autoindex_exclude2 = Spam fts_autoindex_exclude3 = Trash fts_autoindex_exclude4 = Sent or fts_autoindex_exclude = \Drafts fts_autoindex_exclude2 = \Junk fts_autoindex_exclude3 = \Trash fts_autoindex_exclude4 = \Sent But the problem is still present. Here some example of logs when users have timeout in their email client, specially when saving in Drafts automatically: Mar 7 12:21:37 pop01 dovecot: imap(user1(a)company1.com) session=<flNVCZ/ZcO5dPnGT>: Warning: Maildir /home/vmail/domains/company1.com/user1/Maildir/.Drafts: Synchronization took 119 seconds (0 new msgs, 0 flag change attempts, 1 expunge attempts) Mar 7 12:21:37 pop01 dovecot: imap(user1(a)company1.com) session=<flNVCZ/ZcO5dPnGT>: Disconnected: Connection closed (UID EXPUNGE finished 118.715 secs ago) in=77617 out=679511 deleted=1 expunged=1 autoexpunged=0 trashed=0 appended=2 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Mar 7 12:21:52 pop02 dovecot: imap(user2(a)company2.net) session=<B9NNCZ/Z+uC5Ydlv>: Warning: Maildir /home/vmail/domains/company2.net/user2/Maildir/.Trash: Synchronization took 149 seconds (0 new msgs, 0 flag change attempts, 1 expunge attempts) Mar 7 12:21:52 pop02 dovecot: imap(user2(a)company2.net) session=<B9NNCZ/Z+uC5Ydlv>: Disconnected: Logged out in=2407 out=7025 deleted=0 expunged=0 autoexpunged=1 trashed=0 appended=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Is my fts_autoindex_exclude wrong or there are some limits with this option? Here the relevant part of 15-mailboxes.conf namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox virtual/All { comment = All my messages special_use = \All } prefix = separator = / } Thanks -- Alessio Cecchi Postmaster @http://www.qboxmail.it https://www.linkedin.com/in/alessice

1 0

doveadm complains about virtual namespace
by Roberto Sanchez 07 Mar '22

07 Mar '22

Hi, I’ve setup my server __user__nd mail sending/receiving is all working without issue. However, a cron script that cleans up the Junk folder and runs: doveadm expunge -A mailbox Junk savedbefore 60d gives out the following error: doveadm(__user__(a)example.com): Error: Namespace 'Virtual.': Unknown mail storage driver virtual I don’t know if I have a configuration issue or if I have to load the virtual plugin at some other point in the config? I would appreciate any help. This is the output with debug enabled, and further below is my dovecot -n output (I’ve changed the user name to __user__ and the domain to example.com) Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Debug: auth-master: userdb list: Started listing users (user_mask=) Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Client connected (fd=10) Debug: auth-master: userdb list: Returned username: __user__(a)example.com doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: userdb lookup(__user__(a)example.com): Started userdb lookup doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Connecting doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: conn unix:/var/run/dovecot/auth-userdb: Client connected (fd=12) doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: userdb lookup(__user__(a)example.com): auth USER input: __user__(a)example.com maildir=example.com/__user__/ home=/var/mail/vhosts/example.com/__user__ uid=5000 gid=5000 doveadm(__user__(a)example.com)<1068593><>: Debug: auth-master: userdb lookup(__user__(a)example.com): Finished userdb lookup (username=__user__(a)example.com maildir=example.com/__user__/ home=/var/mail/vhosts/example.com/__user__ uid=5000 gid=5000) doveadm(__user__(a)example.com)<1068593><>: Debug: Added userdb setting: plugin/maildir=example.com/__user__/ doveadm(__user__(a)example.com): Debug: Effective uid=5000, gid=5000, home=/var/mail/vhosts/example.com/__user__ doveadm(__user__(a)example.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/vhosts/example.com/__user__/Maildir doveadm(__user__(a)example.com): Debug: maildir++: root=/var/mail/vhosts/example.com/__user__/Maildir, index=, indexpvt=, control=, inbox=/var/mail/vhosts/example.com/__user__/Maildir, alt= doveadm(__user__(a)example.com): Debug: Namespace virtual: type=private, prefix=Virtual., sep=., inbox=no, hidden=no, list=yes, subscriptions=yes location=virtual:/var/mail/virtual:INDEX=/var/mail/vhosts/example.com/__use… doveadm(__user__(a)example.com): Error: Namespace 'Virtual.': Unknown mail storage driver virtual > dovecot -n # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.7.2 () # OS: Linux 5.16.3-x86_64-linode152 x86_64 Ubuntu 20.04.4 LTS # Hostname: bender.example.com auth_mechanisms = plain login auth_username_format = %u mail_location = maildir:%h/Maildir mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = } namespace virtual { list = yes location = virtual:/var/mail/virtual:INDEX=/var/mail/vhosts/%d/%n/virtual mailbox All { auto = subscribe comment = All my messages special_use = \All } mailbox Flagged { auto = subscribe comment = All my flagged messages special_use = \Flagged } prefix = Virtual. separator = . subscriptions = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = file:%h/sieve;active=%h/dovecot.sieve sieve_before = /etc/dovecot/sieve/ } postmaster_address = postmaster at example.com protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { address = localhost port = 4190 } } service stats { unix_listener stats-reader { group = www-data mode = 0660 user = www-data } unix_listener stats-writer { group = www-data mode = 0660 user = www-data } } ssl = required ssl_cert = </etc/dovecot/private/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n driver = static } protocol lmtp { mail_plugins = " sieve virtual" postmaster_address = postmaster(a)example.com } protocol lda { mail_plugins = " virtual" } protocol imap { mail_plugins = " virtual" } protocol sieve { mail_plugins = virtual }

3 2