- dovecot - dovecot.org

Dovecot IMAP Mail latency
by tamilarasan_ext＠iomd.info 05 Dec '24

05 Dec '24

We are working on importing emails from Gmail to Dovecot. During the process, all emails are written to a new directory within the mail folder. For fetching the emails, we are using the IMAP protocol with the imap_tools Python library. After importing, we run the IMAP fetch at 5-second intervals. However, the newly imported emails do not appear immediately. They only become available after 30 to 40 seconds. How can we resolve this issue? What steps can we take to debug and identify the source of the delay?

2 1

Migrating GMail to Dovecot using imapc
by Jan Naumann 30 Nov '24

30 Nov '24

Dear Dovecot community, I try to migrate a GMail mailbox to Dovecot using `doveadm backup -R imapc:`. Since it seems that GMail disabled the login without XOAUTH2, I cannot figure out how to authenticate dovecot to GMail. Could you point me in the right direction? Thank you in advance! Best regards, Jan Here the commands and config I am using: # dovecot --version 2.3.19.1 (9b53102964) # doveadm -D -c gmail.conf backup -R -u user-gmail imapc: # cat gmail.conf !include /etc/dovecot/dovecot.conf imapc_host=imap.gmail.com imapc_port=993 imapc_ssl=imaps imapc_features=rfc822.size fetch-headers gmail-migration mail_prefetch_count=20 imapc_sasl_mechanisms=XOAUTH2 OAUTHBEARER PLAIN rawlog_dir = /tmp/rawlog imapc_rawlog_dir = /tmp/rawlog imapc_user=user(a)googlemail.com imapc_password=pw # cat /tmp/rawlog/20241118-114553.246444.1.in 1731926753.488821 * OK Gimap ready for requests from <ip> <base64> 1731926753.503819 * CAPABILITY IMAP4rev1 UNSELECT IDLE NAMESPACE QUOTA ID XLIST CHILDREN X-GM-EXT-1 XYZZY SASL-IR AUTH=XOAUTH2 AUTH=PLAIN AUTH=PLAIN-CLIENTTOKEN AUTH=OAUTHBEARER 1731926753.503819 1 OK Thats all she wrote! <base64> 1731926753.806967 + <base64> # cat /tmp/rawlog/20241118-114553.246444.1.out 1731926753.488935 1 CAPABILITY 1731926753.504048 2 AUTHENTICATE XOAUTH2 <base64>

14 51

dovecot, virtiofs, fchown, invalid argument
by Кирилл Шигапов 29 Nov '24

29 Nov '24

Hello! Dovecot version: 2.3.16 (7e2e900c1a) dovecon -n deliver_log_format = from=%{from}, envelope_sender=%{from_envelope}, > subject=%{subject}, msgid=%m, size=%{size}, > delivery_time=%{delivery_time}ms, %$ > dict { > acl = mysql:/etc/dovecot/dovecot-share-folder.conf > lastlogin = mysql:/etc/dovecot/dovecot-last-login.conf > quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf > } > first_valid_uid = 2000 > last_valid_uid = 2000 > listen = * [::] > lock_method = dotlock > login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c > %k session=<%{session}> > mail_gid = 2000 > mail_location = maildir:%Lh/Maildir/:INDEX=%Lh/Maildir/ > mail_plugins = quota mailbox_alias acl mail_log notify > mail_uid = 2000 > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character > vacation subaddress comparator-i;ascii-numeric relational regex imap4flags > copy include variables body enotify environment mailbox date index ihave > duplicate mime foreverypart extracttext > namespace { > inbox = yes > location = > mailbox Archive { > auto = no > special_use = \Archive > } > mailbox Archives { > auto = no > special_use = \Archive > } > mailbox "Deleted Messages" { > auto = no > special_use = \Trash > } > mailbox Drafts { > auto = subscribe > special_use = \Drafts > } > mailbox Junk { > auto = subscribe > special_use = \Junk > } > mailbox "Junk E-mail" { > auto = no > special_use = \Junk > } > mailbox Sent { > auto = subscribe > special_use = \Sent > } > mailbox "Sent Items" { > auto = no > special_use = \Sent > } > mailbox "Sent Messages" { > auto = no > special_use = \Sent > } > mailbox Spam { > auto = no > special_use = \Junk > } > mailbox Trash { > auto = subscribe > special_use = \Trash > } > prefix = > separator = / > type = private > } > namespace { > list = children > location = maildir:%%Lh/Maildir/:INDEX=%%Lh/Maildir/Shared/%%Ld/%%Ln > prefix = Shared/%%u/ > separator = / > subscriptions = yes > type = shared > } > passdb { > args = /etc/dovecot/dovecot-mysql.conf > driver = sql > } > passdb { > args = /etc/dovecot/dovecot-master-users > driver = passwd-file > master = yes > } > plugin { > acl = vfile > acl_shared_dict = proxy::acl > last_login_dict = proxy::lastlogin > last_login_key = # hidden, use -P to show it > mail_log_events = delete undelete expunge copy mailbox_create > mailbox_delete mailbox_rename > mail_log_fields = uid box msgid size from subject flags > mailbox_alias_new = Sent Messages > mailbox_alias_new2 = Sent Items > mailbox_alias_old = Sent > mailbox_alias_old2 = Sent > quota = dict:user::proxy::quotadict > quota_grace = 10%% > quota_status_nouser = DUNNO > quota_status_overquota = 552 5.2.2 Mailbox is full > quota_status_success = DUNNO > quota_warning = storage=100%% quota-warning 100 %u > quota_warning2 = storage=95%% quota-warning 95 %u > quota_warning3 = storage=90%% quota-warning 90 %u > quota_warning4 = storage=85%% quota-warning 85 %u > sieve = ~/sieve/dovecot.sieve > sieve_before = /var/vmail/sieve/dovecot.sieve > sieve_dir = ~/sieve > sieve_global_dir = /var/vmail/sieve > sieve_max_redirects = 30 > sieve_vacation_send_from_recipient = yes > } > protocols = pop3 imap sieve lmtp > service auth { > unix_listener /var/spool/postfix/private/dovecot-auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener auth-master { > group = vmail > mode = 0666 > user = vmail > } > unix_listener auth-userdb { > group = vmail > mode = 0660 > user = vmail > } > } > service decode2text { > executable = script /usr/libexec/dovecot/decode2text.sh > unix_listener decode2text { > mode = 0666 > } > user = dovecot > } > service dict { > unix_listener dict { > group = vmail > mode = 0660 > user = vmail > } > } > service imap-login { > process_limit = 500 > service_count = 1 > } > service indexer-worker { > process_limit = 0 > vsz_limit = 2 G > } > service lmtp { > executable = lmtp -L > inet_listener lmtp { > address = 127.0.0.1 > port = 24 > } > process_min_avail = 5 > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0600 > user = postfix > } > user = vmail > } > service managesieve-login { > inet_listener sieve { > address = 127.0.0.1 > port = 4190 > } > } > service pop3-login { > service_count = 1 > } > service quota-status { > client_limit = 1 > executable = quota-status -p postfix > inet_listener { > address = 127.0.0.1 > port = 12340 > } > } > service quota-warning { > executable = script /usr/local/bin/dovecot-quota-warning.sh > unix_listener quota-warning { > group = vmail > mode = 0660 > user = vmail > } > } > service stats { > fifo_listener stats-mail { > group = vmail > mode = 0664 > user = vmail > } > inet_listener { > address = 127.0.0.1 > port = 24242 > } > unix_listener stats-writer { > group = vmail > mode = 0660 > user = vmail > } > } > ssl = required > ssl_cert = </etc/pki/tls/certs/iRedMail.crt > ssl_cipher_list = EECDH+CHACHA20:EECDH+AESGCM:EDH+AESGCM:AES256+EECDH > ssl_dh = # hidden, use -P to show it > ssl_key = # hidden, use -P to show it > ssl_prefer_server_ciphers = yes > syslog_facility = local5 > userdb { > args = /etc/dovecot/dovecot-mysql.conf > driver = sql > } > protocol lda { > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > mail_plugins = quota mailbox_alias acl mail_log notify sieve last_login > } > protocol lmtp { > lmtp_save_to_detail_mailbox = yes > mail_plugins = quota mailbox_alias acl mail_log notify sieve last_login > recipient_delimiter = + > } > protocol imap { > imap_client_workarounds = tb-extra-mailbox-sep > mail_max_userip_connections = 30 > mail_plugins = quota mailbox_alias acl mail_log notify imap_quota > imap_acl last_login > } > protocol pop3 { > mail_max_userip_connections = 30 > mail_plugins = quota mailbox_alias acl mail_log notify last_login > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > pop3_uidl_format = %08Xu%08Xv > } We are using virtiofs share mounted to /var/vmail When dovecot tries to make a directory structure, it fails with error - fchown: Invalid argument strace doveadm mailbox create -u testuser(a)testdomain.com Trash ... mkdir("/var/vmail/vmail1/ testdomain.com/t/e/s/testuser-2024.11.25.12.58.50//Maildir/.Trash", 0700) = 0 umask(077) = 000 openat(AT_FDCWD, "/var/vmail/vmail1/ testdomain.com/t/e/s/testuser-2024.11.25.12.58.50//Maildir/.Trash", O_RDONLY) = 11 fchown(11, -1, -1) = -1 EINVAL (Invalid argument) close(11) = 0 rmdir("/var/vmail/vmail1/ testdomain.com/t/e/s/testuser-2024.11.25.12.58.50//Maildir/.Trash") = 0 ... So there is no permission issue, directory successfully created. It seems that virtiofs not allowing uid=-1 and gid=-1 I write a small C program for testing. And when using fchown($FileDescriptor, 2000, 2000) there is no error. I can't find a way to tell dovecot to use uid & gid 2000 when he tries to do fchown. If I create a directory structure manually, everything works well. Maybe we can make some parameter in config, telling that we are using virtiofs and skip EINVAL when doing fchown...

3 3

Auth timeout after reload
by rudolf＠padaru.de 29 Nov '24

29 Nov '24

Hello everyone, I have a Dovecot running and can often observe that the auth process goes wrong if a reload occurs at the moment of authentication. I have installed dovecot 2.3.21.1 on ubuntu 20. Whether the error also occurs under other versions, I cannot say at the moment. I have included three examples from the mail log: ## start logs ## # 1 # Nov 27 11:28:18 <myServer> dovecot[946292]: auth: Debug: sql(<myUser>,<myIP>,<I1eibOInIOW5zIKi>): Finished passdb lookup Nov 27 11:28:18 <myServer> dovecot[946292]: auth: Debug: auth(<myUser>,<myIP>,<I1eibOInIOW5zIKi>): Auth request finished Nov 27 11:30:49 <myServer> dovecot[946292]: auth: Error: plain(<myUser>,<myIP>,<I1eibOInIOW5zIKi>): Request 946296.13397 timed out after 151 secs, state=3 Nov 27 11:28:18 <myServer> systemd[1]: Reloading Dovecot IMAP/POP3 email server. # 2 # Nov 27 09:05:08 <myServer> dovecot[2940195]: auth: Debug: auth(<myUser><myIP>,<nK2cbOAnaMGiIdFS>): Auth request finished Nov 27 09:07:38 <myServer> dovecot[2940195]: auth: Error: plain(<myUser>,<myIP>,<nK2cbOAnaMGiIdFS>): Request 2940206.363 timed out after 150 secs, state=3 Nov 27 09:05:07 <myServer> systemd[1]: Reloading Dovecot IMAP/POP3 email server. # 3 # Nov 27 10:02:18 <myServer> dovecot[3736041]: auth: Debug: auth(<myUser><myIP>,<1v4HOeEnWtG5zIKi>): Auth request finished Nov 27 10:04:48 <myServer> dovecot[3736041]: auth: Error: plain(<myUser>,<myIP>,<1v4HOeEnWtG5zIKi>): Request 3736048.4962 timed out after 150 secs, state=3 Nov 27 10:02:18 <myServer> systemd[1]: Reloading Dovecot IMAP/POP3 email server. ## end logs ## You can clearly see that the sql query works, but then the auth-worker seems to hang. I suspect that the auth-worker sends the request to the DB, receives the response and is then killed before it can log in the user via imap. This then leads to some users not being able to log in for a long time. I write many configs on the server automatically, then I always run a reload so that the changed config is accepted. Is this a bug or do I have to change something in my setup? [Logo]<https://www.padaru.de/> Pascal Rudolf | Geschäftsführer PADARU-IT | Oppacher Straße 40 | 02689 Wehrsdorf @: rudolf(a)padaru.de | www: padaru.de<https://padaru.de/> mobil: +49 (0) 17 772 595 32

1 0

Error: Mailbox INBOX: open, missing +r perm
by drinaldi＠trustitalia.it 29 Nov '24

29 Nov '24

Hi Guys, Since few weeks, our email server based on Dovecot and Postfix has been returning this error with some users without any changes made to the configuration: mailserver dovecot: imap(user)<1115049><sEfO8d8nm/1dIlwX>: Error: Mailbox INBOX: open(/mnt/mail-storage/user/Maildir/cur/1732656368.M835097P860226.mailserver,S=43548,W=44150:2,) failed: Permission denied (euid=501(vmail) egid=501(vmail) missing +r perm: /mnt/mail-storage/user/Maildir/cur/1732656368.M835097P860226.mailserver,S=43548,W=44150:2, stat(/mnt/mail-storage/user/Maildir/cur/1732656368.M835097P860226.mailserver,S=43548,W=44150:2,) failed: Permission denied) mailserver dovecot: imap(user)<1115049><sEfO8d8nm/1dIlwX>: Disconnected: FETCH failed: Mailbox INBOX: open(/mnt/mail-storage/user/Maildir/cur/1732656368.M835097P860226.mailserver,S=43548,W=44150:2,) failed: Permission denied (euid=501(vmail) egid=501(vmail) missing +r perm: /mnt/mail-storage/user/Maildir/cur/1732656368.M835097P860226.mailserver,S=43548,W=44150:2, stat(/mnt/mail-storage/user/Maildir/cur/1732656368.M835097P860226.mailserver,S=43548,W=44150:2,) failed: Permission denied) in=429 out=24093 deleted=0 expunged=0 trashed=0 hdr_count=2 hdr_bytes=6437 body_count=0 body_bytes=0 This is the stat of the file after reboot the server: stat 1732656368.M835097P860226.ganimede,S=43548,W=44150:2, File: 1732656368.M835097P860226.ganimede,S=43548,W=44150:2, Size: 43548 Blocks: 88 IO Block: 262144 regular file Device: 0,41 Inode: 2155401218 Links: 1 Access: (0600/-rw-------) Uid: ( 501/ vmail) Gid: ( 501/ vmail) Access: 2024-11-26 22:26:09.925862755 +0100 Modify: 2024-11-26 22:26:10.005861434 +0100 Change: 2024-11-26 22:26:11.175842122 +0100 Birth: - The strange thing is that the issue seems to this impact only some Users and looks like the error disappear after restarting the server, and reappear few time later. Dovecot -n: # 2.3.19.1 (9b53102964): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.19 (4eae2f79) # OS: Linux 6.1.0-26-amd64 x86_64 Debian 12.7 auth_mechanisms = plain login default_vsz_limit = 1 G doveadm_password = # hidden, use -P to show it doveadm_port = 12345 mail_gid = 501 mail_location = maildir:~/Maildir:INDEX=/var/indexes/%n mail_max_userip_connections = 50 mail_plugins = " notify replication zlib" mail_privileged_group = vmail mail_uid = 501 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds imapflags notify namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox "Posta inviata" { special_use = \Sent } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { mail_replica = tcp:192.168.3.250 sieve = file:/var/www/html/ooo/%n;active=/var/www/html/ooo/%n/script sieve_default = /var/www/html/ooo/default.sieve sieve_duplicate_default_period = 14d sieve_duplicate_max_period = 7d sieve_extensions = +duplicate +notify +imapflags +vacation-seconds sieve_user_log = /var/www/html/ooo/%n/sieve_error.log } protocols = " imap lmtp sieve pop3" replication_max_conns = 2 service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } } service doveadm { inet_listener { port = 12345 } } service imap-login { process_limit = 200 } service imap { vsz_limit = 1 G } service lmtp { process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 10 service_count = 1 } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 user = vmail } } service stats { unix_listener stats-reader { group = vmail mode = 0666 user = vmail } unix_listener stats-writer { group = vmail mode = 0666 user = vmail } } ssl_cert = </etc/dovecot/private/chain-star_trustitalia_it.pem ssl_cipher_list = ALL:!LOW:!aNULL:!eNULL:!SSLv2:!RC4:!MD5:!DES:!EXP:!SEED:!IDEA:!3DES ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocol lmtp { mail_plugins = " notify replication zlib sieve quota zlib" postmaster_address = postmaster(a)trustitalia.it } protocol lda { auth_socket_path = /var/run/dovecot/auth-master hostname = ganimede.trustitalia.it mail_plugins = " notify replication zlib sieve quota zlib" } protocol imap { mail_plugins = " notify replication zlib zlib" } protocol sieve { mail_max_userip_connections = 10 managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 64 k } protocol pop3 { mail_plugins = " notify replication zlib zlib" } Thanks

2 2

"INBOX can't be deleted" error when syncing from imapc
by Andy Balholm 28 Nov '24

28 Nov '24

I'm syncing mail from an IMAP server to local Maildirs with `doveadm backup -R`, and I sometimes get an error the second time I sync an account: > Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted. I've figured out that the sync completes the first time without an error, but the UIDVALIDITY of the INBOX Maildir doesn't match the UIDVALIDITY on the IMAP server. Then the second time doveadm detects the mismatch and wants to delete the INBOX, but it can't because Maildir INBOXes can't be deleted. So I think the root cause is that the INBOX is being created with the wrong UIDVALIDITY in the first place. It only seems to happen when there are no messages in the INBOX on the server at the time the Maildir is created, but it doesn't seem to happen all the time. Is there anything I can do to make the sync job run smoothly? Andy

1 0

Director to keep redirecting users to the same server even it is down
by abdelhaq.jalboush＠gmail.com 28 Nov '24

28 Nov '24

Hello, why the director always proxying IMAP connections to the same backend even if it is down? Also the director is showing the node as up although I have stopped the dovecot service on it: doveadm director status mail server ip tag vhosts state state changed users Node1 100 up - 2 Node2 100 up - 3 on the director here is: doveconf -n # 2.3.21 (47349e2482): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.21 (f6cd4b8e) # OS: Linux 6.8.0-1018-aws x86_64 Ubuntu 24.04.1 LTS # Hostname: auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_socket_path = director-userdb auth_verbose = yes director_mail_servers = Node1 Node2 director_servers = dir1 dir2 info_log_path = /var/log/dovecot.log listen = * lmtp_proxy = yes log_path = /var/log/dovecot.log mail_gid = vmail mail_privileged_group = mail mail_uid = vmail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-openldap-proxy.conf.ext default_fields = proxy=y driver = ldap } protocols = imap pop3 lmtp service auth { inet_listener { port = 12345 } } service director { fifo_listener login/proxy-notify { mode = 0600 user = $default_login_user } inet_listener { port = 9090 } unix_listener director-admin { mode = 0600 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service ipc { unix_listener ipc { user = dovecot } } service lmtp { inet_listener lmtp { port = 24 } } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 ssl = yes } } service submission-login { inet_listener submission { port = 587 } } ssl_cert = </etc/dovecot/ssl/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it protocol lmtp { auth_socket_path = director-userdb }

3 2

bug? dsync extremely much slower on forward than reverse direction
by Bjørnar Ness 27 Nov '24

27 Nov '24

I have been experimenting with dsync lately, and to my surprise I found that dsync in forward direction is extremely slow compared for reverse (-R) direction for the exact same data, disk caches flushed both times. I have created a docker-compose setup to prove my findings. Am I missing something here, or is this a bug? link to tests: https://github.com/bjne/dovecot-dsync-benchmark -- Bj(/)rnar

2 2

lda_original_recipient_header for LMTP?
by dovecot＠ptld.com 26 Nov '24

26 Nov '24

How to get the X-Original-To: header added for LMTP? I tried adding: lda_original_recipient_header = X-Original-To But that didn't add the header for mail over LMTP. I couldn't find anything else in the docs.

2 1

Problem with Quota notification script
by Deeztek Support 25 Nov '24

25 Nov '24

Hello, Trying to get the following quota notification script to work with Dovecot 2.3.21.1: #!/bin/sh PERCENT=$1 USERNAME=$2 cat << EOF | /usr/lib/dovecot/dovecot-lda -d $USER -o "plugin/quota=count:User quota::noenforcing" From: postmaster(a)deeztek.com Subject: quota warning Your mailbox is now $PERCENT% full. EOF However running it produces the following error: lda: Fatal: Unknown argument: plugin/quota=count:User quota::noenforcing Below are my dovecot.conf settings: # Pigeonhole version 0.5.21.1 (49005e73) # OS: Linux 5.4.0-192-generic x86_64 Debian 11.10 # Hostname: be9f67c4e17e debug_log_path = /dev/stdout dict { quotadict = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_uid = 1000 info_log_path = /dev/stdout last_valid_uid = 1000 listen = * log_path = /dev/stdout mail_debug = yes mail_gid = 1000 mail_home = /srv/mail/%d/%n mail_location = maildir:~/ mail_plugins = " quota zlib mail_crypt" mail_privileged_group = mail mail_uid = 1000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_crypt_curve = prime256v1 mail_crypt_global_private_key = # hidden, use -P to show it mail_crypt_global_public_key = # hidden, use -P to show it mail_crypt_save_version = 2 quota = dict:User quota::proxy::quotadict quota_rule2 = Trash:storage=+10%% quota_warning = storage=100%% quota-warning +100 %u quota_warning2 = storage=95%% quota-warning +95 %u quota_warning3 = storage=80%% quota-warning +80 %u quota_warning4 = -storage=100%% quota-warning -100 %u sieve = /srv/mail/sieve/%u.sieve zlib_save = lz4 } protocols = imap pop3 submission sieve lmtp service auth { inet_listener auth-inet { port = 9587 } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } user = root } service imap-login { client_limit = 1000 process_min_avail = 1 service_count = 0 } service lmtp { inet_listener { port = 24 } } service managesieve-login { client_limit = 1000 process_min_avail = 1 service_count = 0 } service pop3-login { client_limit = 1000 process_min_avail = 1 service_count = 0 } service quota-warning { executable = script /scripts/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } service submission-login { client_limit = 1000 process_min_avail = 1 service_count = 0 } ssl_cert = </certs/fullchain.pem ssl_cipher_list = ALL:!ADH:!LOW:!SSLv2:!SSLv3:!EXP:!aNULL:!eNULL:!3DES:!MD5:!PSK:!DSS:!RC4:!SEED:!IDEA:+HIGH:+MEDIUM ssl_key = # hidden, use -P to show it ssl_options = no_compression no_ticket ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { imap_metadata = yes mail_plugins = " quota zlib mail_crypt imap_quota zlib" } protocol lmtp { mail_plugins = quota sieve } protocol sieve { managesieve_logout_format = bytes=%i/%o } protocol pop3 { mail_plugins = " quota zlib mail_crypt mail_crypt" pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } Thanks

1 0

Extended LIST not working
by tim＠linux-daus.de 25 Nov '24

25 Nov '24

Hi, i try to use extended LIST command but it doesn't work out. I wonder if there is any option necessary to enable it or some option that prevent using extended LIST commands (for example Courier compatible namespace config). I didn't find anything in the documentation. Did anyone notice a similar behavior? curl -u $IMAPUSER:$IMAPPW imaps://... -X 'STATUS INBOX (MESSAGES UNSEEN)' * STATUS INBOX (MESSAGES 105 UNSEEN 79) curl -u $IMAPUSER:$IMAPPW imaps://... -X 'LIST "" "INBOX" RETURN (STATUS (MESSAGES UNSEEN))' * LIST () "." INBOX Best regards, Tim

2 2

Authentication hangs on before SSL initialization
by Matt 22 Nov '24

22 Nov '24

I'm running into below probem; my ath is stuck on initializing SSL. Certificates are fine, cert-chain is tested and auth no further errors are shown. Comparing to the default configuration from the docs it's pretty the same and up-to-date so I'm curious what cloud cause this. Also CHMOD on files has been checked. Nov 21 02:50:29 auth: Debug: Loading modules from directory: /usr/lib/dovecot/auth Nov 21 02:50:29 auth: Debug: Module loaded: /usr/lib/dovecot/auth/lib20_auth_var_expand_crypt.so Nov 21 02:50:29 auth: Debug: Module loaded: /usr/lib/dovecot/auth/libdriver_sqlite.so Nov 21 02:50:29 auth: Debug: Read auth token secret from /run/dovecot/auth-token-secret.dat Nov 21 02:50:29 auth: Debug: auth client connected (pid=477) Nov 21 02:50:29 imap-login: Debug: SSL: where=0x10, ret=1: before SSL initialization Nov 21 02:50:29 imap-login: Debug: SSL: where=0x2001, ret=1: before SSL initialization Nov 21 02:50:29 imap-login: Debug: SSL: where=0x2002, ret=-1: before SSL initialization Maybe someone has a suggestion... Thanks!

2 3

Dovecot Director Proxy (Error: lmtp-server: conn Failed to initialize user: Namespace '': Mail storage autodetection failed with home=(not set))
by abdelhaq.jalboush＠gmail.com 20 Nov '24

20 Nov '24

dovecot --version 2.3.21 (47349e2482) I have Postfix and two dovecot directors I am trying to setup them as proxy in front of two dovecot backends, I am using openldap, when I set passdb { driver = static args = proxy=y nopassword=y } it is working fine. but If I try to authenticate on the proxy I get this error: lmtp(22086): Error: lmtp-server: conn [3]: rcpt : Failed to initialize user: Namespace '': Mail storage autodetection failed with home=(not set) here is my openldap file /etc/dovecot/dovecot-openldap-proxy.conf.ext: uris = ldaps:// dn = CN=,OU=,DC=,dc= dnpass = debug_level = 0 auth_bind = yes ldap_version = 3 base = OU=,DC=,dc= scope = subtree user_attrs = mail=user pass_attrs = userPassword=password pass_filter = (&(objectClass=person)(mail=%u)) dovecot -n on the director side: # 2.3.21 (47349e2482): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.21 (f6cd4b8e) # OS: Linux 6.8.0-1018-aws x86_64 Ubuntu 24.04.1 LTS # Hostname: stg-vm-dir01 auth_debug = yes auth_mechanisms = plain login auth_socket_path = director-userdb auth_verbose = yes director_mail_servers = 10.100.10.15 10.100.15.16 director_servers = 10.100.15.201 10.100.15.202 info_log_path = /var/log/dovecot.log listen = * lmtp_proxy = yes log_path = /var/log/dovecot.log mail_gid = vmail mail_privileged_group = mail mail_uid = vmail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-openldap-proxy.conf.ext driver = ldap } protocols = imap pop3 lmtp service director { fifo_listener login/proxy-notify { mode = 0600 user = $default_login_user } inet_listener { port = 9090 } unix_listener director-admin { mode = 0600 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service ipc { unix_listener ipc { user = dovecot } } service lmtp { inet_listener lmtp { port = 24 } } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 ssl = yes } } service submission-login { inet_listener submission { port = 587 } } ssl_cert = </etc/dovecot/ssl/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it protocol lmtp { auth_socket_path = director-userdb }

2 4

sharing sso between regular mail client and web applications
by Marc 20 Nov '24

20 Nov '24

I am testing a bit with sso with keycloak, I was wondering if/how it is possible that your logged in session between eg Thunderbird and dovecot can be used as a single sign on in webapplications. So as long as you have an active session with dovecot you can access all your web applications without the need to login.

2 1

Fatal: sql proxy::sqlite-proxy: Can't open configuration file
by Matt 14 Nov '24

14 Nov '24

Hi, I'm running into a problem where I'm not sure anymore if it's possible to proxy to an SQLite database file using a dict for authentication. The docs are unclear about it and I thought it was not possible as it's not a connection for SQLite but a file-read where the documentation shows different. ov 14 13:57:52 auth: Debug: Loading modules from directory: /usr/lib/dovecot/auth Nov 14 13:57:52 auth: Debug: Module loaded: /usr/lib/dovecot/auth/lib20_auth_var_expand_crypt.so Nov 14 13:57:52 master: Error: service(auth): command startup failed, throttling for 4.000 secs Nov 14 13:57:52 auth: Debug: Module loaded: /usr/lib/dovecot/auth/libdriver_sqlite.so Nov 14 13:57:52 auth: Fatal: sql proxy::sqlite-proxy: Can't open configuration file proxy::sqlite-proxy: No such file or directory doveconf -n does show me the dict being loaded, the file exists as well but it still says not found. dict { sqlite-proxy = sqlite:/etc/dovecot/conf.d/dicts/sqlite/sqlite-connection.conf.ext } What am I missing here ? Thanks, Matt

2 4

openid / roundcube example
by Marc 14 Nov '24

14 Nov '24

Does anyone have a current config example using openid and with roundcube. I like to add this next to 'regular' logins'. I was able to login once but know I am getting these in the logs " No requests to service for this peer (1 connections exist, 0 pending)" I have added the 2 passdb with links to dovecot-oauth2.token.conf.ext from this manual[1], but it is not really clear if I need these and can just add a config file with openid_configuration_url [1] https://doc.dovecot.org/2.3/configuration_manual/authentication/oauth2/

1 3

2.3.21.1 and oauth
by v＠minakov.pro 14 Nov '24

14 Nov '24

Hello! I'm using dovecot with keycloak for oauth authentication. My config is: client_id = dovecot client_secret = MY_SECRET introspection_url = https://MY_KEYCLOAK/realms/master/protocol/openid-connect/token/introspect introspection_mode = post pass_attrs = pass=%{oauth2:access_token} Everything worked great on version 2.3.20. After upgrading to version 2.3.21.1 oauth stopped working with errors: auth: Debug: http-client: conn [::1]:443 [1]: Got 401 response for request [Req1: POST https://MY_KEYCLOAK/realms/master/protocol/openid-connect/token/introspect] Unauthorized (took 5 ms + >Aug 16 00:23:58 auth: Error: oauth2(MY_EMAIL,127.0.0.1,<HADwdb8f+PN/AAAB>): oauth2 failed: Introspection failed: No username returned I tried all combination of configurations, debugging and versions of keycloak. Seems something was broken in this version of dovecot.

3 3

Locking box for backups
by Steve Atkins 12 Nov '24

12 Nov '24

I’m running 2.3.19.1 on a system that isn’t set up to support filesystem snapshots. So I’d like to back up my mdbox mailboxes at a filesystem level (with rsync, or something equivalent). I’m assuming that to get a consistent backup I should lock the mailbox while I copy it. How should I acquire a (write) lock on an mdbox mailbox? Cheers, Steve

2 1

auto clear trash
by Hua Young 12 Nov '24

12 Nov '24

Hello where can I setup dovecot to auto clear trash periodically? for example, I want the messages in trash folder to be kept up to 20 days. Thanks.

5 5

replication and backup
by Philippe 12 Nov '24

12 Nov '24

Hi all & thanks Aki for adding me to the list. First of all, I'm not a dovecot user yet. For several years now I use cyrus imapd and never saw the urge to switch, until I recently lost random mails from my mailbox which were neither temporally connected nor related in some other way. Fortunately, I had a rolling replication which never expunges, so I was able to restore them. While circumventing some pitfalls during the restore, I learned that the backup and restore procedure cyrus imapd offers is deprecated and will be removed. Now I ponder whether or not I should switch the mda. Does dovecot offer the following? - setting up a rolling replication which replicates every action made to the mailbox (flags, mark as deleted, relocations, etc.) to a different server (one way only) - NOT expunging the emails that have been marked as deleted on the slave server or expunging only manually - restoring selected emails from the slave directly to the master The slave server doesn't need to be accessible via imap, I'd be happy to search for some header data (subject, recipient, sender, date, ...) and restore the email by command line using its uuid or message-id or something like that. Browsing the documentation I found "doveadm-backup" which is using "dsync", but I'm not sure whether or not it fits my requirements. I'd love to hear your opinions. Kind regards, Philippe

3 5

SMTPUTF8 in dovecot lmtp - current status
by Kamil Jońca 12 Nov '24

12 Nov '24

About a year ago I asked about SMTPUTF8 in dovecot-lmtp, and then dovecod did not handle it. Is that changed? KJ -- http://wolnelektury.pl/wesprzyj/teraz/ A bore is someone who persists in holding his own views after we have enlightened him with ours.

3 2

Re: What is the appropriate action for out of memory error for exceeding vsz_limit in my situation?
by Adrian C. 10 Nov '24

10 Nov '24

On Fri, 8 Nov 2024, Marc wrote: > How much does it cost to upgrade to more memory? I have a server with 4G RAM is affordable. But if you do colocation and have to rent remote PoP hands to insert the RAM their hourly rate could be hundreds of dollars. If you're renting the entire server you have to ask your service provider for a quote to provision more RAM.

1 0

Proper configuration of fts-xapian for dovecot
by Torge Riedel 10 Nov '24

10 Nov '24

Dears, I recently installed the package dovecot-fts-xapian on my Ubuntu 22.04 VM, where dovecot 2.3.16 is installed. I enabled the plugins mail_plugins = $mail_plugins fts fts_xapian plugin { ### # fts fts = xapian fts_xapian = partial=3 full=20 fts_autoindex = yes fts_enforced = yes #fts_autoindex_exclude = \Trash # Index attachements fts_decoder = decode2text } I skip to show the "service indexer-worker" and "decode2text" for the moment. After restarting dovecot I ran doveadm index -A \* which ran without any issues. But for the moment I am faced with two issues I am unable to solve on my own and also didn't found a solution on the internet: 1. The indexer created a new directory "xapian-indexes" in the user's mail folder (where also "INBOX", "Drafts", "Sent", ... exists), with the result that you can see this folder in Thunderbird and GMail Android App. How to hide / disable the folder to mail programs, IMHO no mail program should have access to it. 2. When listing the capabilities of my mail server I get "CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SPECIAL-USE LITERAL+ AUTH=PLAIN AUTH=LOGIN" and it seems to lack the FTS capability(s). Am I right? And should dovecot set the capabality on its own or is something missing in the config? If you need more info, just let me know please. Thanks and kind regards Torge

3 4

Re: Expunging and deleting old messages - moving from cyrus-imap
by Joseph Tam 08 Nov '24

08 Nov '24

> doveadm expunge -A MAILBOX * DELETED BEFORE 5d > > and got back: > > Fatal: Unknown argument BOOT > run-parts: /etc/cron.hourly/dovecot-cleanup exited with return code 75 Just a wild-ass guess, but did you escape the wildcard e.g. doveadm expunge -A MAILBOX \* DELETED BEFORE 5d Joseph Tam <jtam.home(a)gmail.com>

2 1

What is the appropriate action for out of memory error for exceeding vsz_limit in my situation?
by Steve Dondley 08 Nov '24

08 Nov '24

Hi, I have sporadic messages on my server about an account getting an out of memory error: Fatal: master: service(imap): child 17910 returned error 83 (Out of memory (service imap { vsz_limit=325 MB }, you may need to increase it) - set CORE_OUTOFMEM=1 environment to get core dump) In response, I raised the limit from 256MB up to 325. That didn’t seem to help. The server has only 512 MB of RAM so I’m afraid to go much higher. I googled around a bit and some people are saying that when the dovecot.index.cache grows too large, it can cause these errors. The imap account has a dovecot.index.cache file that is 167 MB which seems to be well below the limit (but maybe it is compressed?). So I’m not entirely sure as to what the underlying problem is. So before upgrading to the server to 1024 MB of ram and going on a wild goose chase, I just want to get input on whether I have positively identified the problem and whether there might be something else I can do to manage this problem.

2 3