- dovecot - dovecot.org

Dovecot Server issue, cache corruption
by David Mehler 28 Apr '24

28 Apr '24

Hello, I'm using Thunderbird 102 to atempt to retrieve my messages via imap (have tried both 143 and 993) first I wasn't getting any error messages now I am. This is with Dovecot 2.3 on Debian 12.5. Here's the error messages. I do not believe the first set related to public mailboxes is related but I'm not sure what it's problem is either, the problem seems to be corrupted cache. 2024-04-26T02:01:47.832997-04:00 hostname dovecot: imap(username(a)example.com)<586617><WEyTo/kWUwpoDWll>: Error: Mailbox public/example-1: mkdir(/var/vmail/public/.example-1/cur) failed: Permission denied (euid=999(vmail) egid=992(vmail) missing +w perm: /var/vmail/public/.example-1, dir owned by 0:0 mode=0755) 2024-04-26T02:01:48.742111-04:00 hostname dovecot: imap(username(a)example.com)<586617><WEyTo/kWUwpoDWll>: Error: Mailbox INBOX: Deleting corrupted cache record uid=34640: UID 34640: Broken physical size in mailbox INBOX: read(/var/vmail/mailboxes/example.com/username/mail/mailboxes/INBOX/dbox-Ma… failed: Cached message size smaller than expected (1376 < 1647, box=INBOX, UID=34640) 2024-04-26T02:01:48.742239-04:00 hostname dovecot: imap(username(a)example.com)<586617><WEyTo/kWUwpoDWll>: Error: Mailbox INBOX: UID=34640: read(/var/vmail/mailboxes/example.com/username/mail/mailboxes/INBOX/dbox-Ma… failed: Cached message size smaller than expected (1376 < 1647, box=INBOX, UID=34640) (read reason=) 2024-04-26T02:01:48.742308-04:00 hostname dovecot: imap(username(a)example.com)<586617><WEyTo/kWUwpoDWll>: Disconnected: FETCH failed: Mailbox INBOX: UID=34640: read(/var/vmail/mailboxes/example.com/username/mail/mailboxes/INBOX/dbox-Ma… failed: Cached message size smaller than expected (1376 < 1647, box=INBOX, UID=34640) (read reason=) in=889 out=6253 deleted=0 expunged=0 trashed=0 hdr_count=5 hdr_bytes=10 body_count=0 body_bytes=0 Here is a doveconf -n output: # doveconf -n # 2.3.19.1 (9b53102964): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.19 (4eae2f79) # OS: Linux 4.19.0 x86_64 Debian 12.5 # Hostname: hostname.example.com auth_mechanisms = plain login dict { lastlogin = mysql:/etc/dovecot/dovecot-last-login.conf } imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags listen = * lmtp_rcpt_check_quota = yes mail_attribute_dict = file:%h/Maildir/dovecot-attributes mail_gid = vmail mail_home = /var/vmail/mailboxes/%d/%n mail_location = dbox:~/mail:LAYOUT=fs mail_plugins = acl quota welcome mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace { list = children location = maildir:/var/vmail/public:INDEXPVT=~/public prefix = public/ separator = / subscriptions = no type = public } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { acl = vfile:/etc/dovecot/dovecot-acl imapsieve_mailbox1_before = file:/var/vmail/sieve/global/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/var/vmail/sieve/global/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * last_login_dict = proxy::lastlogin last_login_key = # hidden, use -P to show it quota = count:User quota quota2 = maildir:Shared quota:ns=public/ quota_exceeded_message = User %u has exhausted allowed storage space. quota_grace = 10%% quota_max_mail_size = 100M quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_rule3 = SPAM:ignore quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_vsizes = yes quota_warning = storage=100%% quota-warning +100 %u quota_warning2 = storage=95%% quota-warning +95 %u quota_warning3 = storage=80%% quota-warning +80 %u quota_warning4 = -storage=100%% quota-warning -100 %u sieve = file:/var/vmail/sieve/%d/%n/scripts;active=/var/vmail/sieve/%d/%n/active-script.sieve sieve_before = /var/vmail/sieve/global/spam-global.sieve sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /usr/bin sieve_plugins = sieve_imapsieve sieve_extprograms stats_refresh = 30 secs stats_track_cmds = yes welcome_script = welcome %u welcome_wait = no } protocols = imap lmtp sieve service auth-worker { vsz_limit = 0 } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { client_limit = 1 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/dovecot-quota { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } service stats { fifo_listener stats-mail { mode = 0644 user = vmail } inet_listener { address = 127.0.0.1 port = 24242 } } service welcome { executable = script /usr/local/bin/welcome.sh unix_listener welcome { group = vmail mode = 0660 user = vmail } } ssl = required ssl_cert = </etc/ssl/example.com/example.com.fullchain.crt ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-CHACHA20-POLY1305 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol imap { imap_idle_notify_interval = 29 mins imap_metadata = yes mail_max_userip_connections = 20 mail_plugins = acl quota welcome imap_acl imap_quota imap_sieve last_login welcome quota } protocol lmtp { mail_fsync = optimized mail_plugins = acl quota welcome last_login quota sieve postmaster_address = postmaster(a)example.com } Suggestions welcome. Thanks. Dave. -- Sent from Mozilla Thunderbird 91.13.1

1 0

Is it possible to setup ntlm authentication then proxy it to the mail server ?
by karl.l＠as7600.net 26 Apr '24

26 Apr '24

Hi, This is my dovecot version: ``` root@freebsdsvr:~ # dovecot --version 2.3.21 (47349e2482) ``` I'm having trouble in making dovecot as proxy to the mail server when using ntlm authentication. My setup looks like this: email client ------> dovecot (will act as proxy) -------> mail server so basically the email client will connect to dovecot but dovecot will forward it to the mail server. Proxying using auth_mechanism as PLAIN is working but if I use ntlm authentication it just connects into the dovecot server and dovecot server does not proxy to to the mail server. I tried using passdb driver = sql, passdb driver = static, passdb driver = lua and all of them are working when the email client connects using plain auth, once dovecot authenticates the user it will proxy it to the mail server but when I use ntlm authentication it just connects to dovecot and does not do a proxy to the mail server. I switched on all the debugs and I found out in the log that when I connect using PLAIN auth it calls the passdb and gets my default_fields or my proxy fields ```proxy=y``` and ```host=mailserver_domain``` which causes dovecot to proxy into the host(my mail server). but when I connect using NTLM auth it calls the passdb but it does not return my default fields for proxying (when it uses the sql passdb driver it just connects to the database and does not run the password_query) and I think it uses the output from the ```ntlm_auth``` of samba that dovecot uses because it retunrs the field user=username and original_user=username@domain This is the example logs that I recieved once I connect using ntlm and it does not proxy it to my mail server ``` Apr 18 03:37:29 freebsdsvr dovecot[12084]: auth: Debug: mysql(192.168.254.131): Connecting Apr 18 03:37:29 freebsdsvr dovecot[12084]: auth: Debug: auth client connected (pid=12268) Apr 18 03:37:29 freebsdsvr dovecot[12084]: auth: Debug: auth client connected (pid=12270) Apr 18 03:37:30 freebsdsvr dovecot[12084]: auth: Debug: client in: AUTH 1 NTLM service=imap session=Js8TT04WcMnAqP5/ lip=192.168.254.131 rip=192.168.254.127 lport=143 rport=51568 Apr 18 03:37:30 freebsdsvr dovecot[12084]: auth: Debug: client passdb out: CONT 1 Apr 18 03:37:30 freebsdsvr dovecot[12084]: auth: Debug: client in: CONT 1 TlRMTVNTUAABAAAAB4IIAAAAAAAAAAAAAAAAAAAAAAA= (previous base64 data may contain sensitive data) Apr 18 03:37:30 freebsdsvr dovecot[12084]: auth: Debug: client passdb out: CONT 1 TlRMTVNTUAACAAAAFAAUADgAAAAFgooC57WwKq2q4U8sdAAAAAAAAAAFwAXABMAAAABgEAAAasdasdasdAAAA9FAFMAQwAuAE4ARQBUAC4AQQBVAAIAFABFAFMAQwAuAE4ARQBUACad4AQdsQBVAAEasAFABFAFMAQwAuAE4AdaRQBUAC4AQQBVAAQAAAADABQAZQBzAGMALgBuAGUAdAAuAGEAdQAHAAgA/h8T7O2Q2gEAAAAA Apr 18 03:37:30 freebsdsvr dovecot[12084]: auth: Debug: client in: CONT 1 TlRMTVNTUAADAAAAGAAYAFwAAACIAIgAdAAAAAAAAeABAAAAABgAGAEAAAAAWABYARgAAAAAAAAAAAAAABYIIAHMAcwAzAFcATwBSAEsAUwBUAEEAVABJAE8ATgBXKrBA2vF7fMicRiasLK/IyI3fbM46rQ7JHcti/0TU02AqasdasdasdhceI+BaeqMjrAQEAAAAAAACAL88ampDaARzhirKymxxcAAAAAAIAFABFAFMAQwAuAE4ARQBUAC4AQQBVAAEAFABFAFMAQwAuAE4ARQBUAC4AQQBVAAQAAAADABQAZQBzAGMALgBuAGUAdAAuAGEAdQAHAAgA/h8T7O2Q2gEAAAAA (previous base64 data may contain sensitive data) Apr 18 03:37:30 freebsdsvr dovecot[12084]: auth: Debug: auth(userName,192.168.254.127,<Js8TT04WcMnAqP5/>): Auth request finished Apr 18 03:37:30 freebsdsvr dovecot[12084]: auth: Debug: client passdb out: OK 1 user=userName original_user=userName@FREEBSD-TEST ``` Here's the logs that I get when I connect via Plain Auth and it does the proxy to my mail server ``` Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth-worker(12138): Debug: mysql(192.168.254.131): Connecting Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth-worker(12138): Debug: conn unix:auth-worker (uid=0): Server accepted connection (fd=15) Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth-worker(12138): Debug: conn unix:auth-worker (uid=0): Sending version handshake Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth-worker(12138): Debug: conn unix:auth-worker (uid=0): auth-worker<1>: Handling PASSV request Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth-worker(12138): Debug: conn unix:auth-worker (uid=0): auth-worker<1>: sql(ss3,192.168.254.127,<zwTdK04W9MbAqP5/>): Performing passdb lookup Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth-worker(12138): Debug: conn unix:auth-worker (uid=0): auth-worker<1>: sql(ss3,192.168.254.127,<zwTdK04W9MbAqP5/>): query: SELECT destuser, password, host, 'Y' as proxy FROM proxy WHERE user = 'userName'; Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth-worker(12138): Debug: mysql(192.168.254.131): Finished query 'SELECT destuser, password, host, 'Y' as proxy FROM proxy WHERE user = 'userName';' in 0 msecs Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth-worker(12138): Debug: conn unix:auth-worker (uid=0): auth-worker<1>: sql(userName,192.168.254.127,<zwTdK04W9MbAqP5/>): Finished passdb lookup Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth-worker(12138): Debug: conn unix:auth-worker (uid=0): auth-worker<1>: Finished Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth: Debug: sql(userName,192.168.254.127,<zwTdK04W9MbAqP5/>): Finished passdb lookup Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth: Debug: auth(userName,192.168.254.127,<zwTdK04W9MbAqP5/>): Auth request finished Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth: Debug: conn unix:dns-client: dns(mailserver.domain): Lookup started Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth: Debug: conn unix:dns-client: Connecting Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth: Debug: conn unix:dns-client (uid=0): Client connected (fd=27) Apr 18 03:27:39 freebsdsvr dovecot[12084]: auth: Debug: conn unix:dns-client (uid=0): Sending version handshake Apr 18 03:27:40 freebsdsvr dovecot[12084]: auth: Debug: conn unix:dns-client (uid=0): dns(mailserver.domain): Lookup successful after 658 msecs Apr 18 03:27:40 freebsdsvr dovecot[12084]: auth: Debug: client passdb out: OK 1 user=userName destuser=userName host=mailserver.domain proxy hostip=mailserverip pass=password ``` Is there a right way to configure ntlm to do proxy? because it does not seem to use the passdb in sql,lua, and static drivers. This is my dovecot -n ``` root@freebsdsvr:~ # dovecot -n # 2.3.21 (47349e2482): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 13.2-RELEASE amd64 zfs # Hostname: freebsdsvr auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login ntlm auth_use_winbind = yes auth_username_format = %n auth_verbose = yes auth_verbose_passwords = plain auth_winbind_helper_path = /usr/local/bin/ntlm_auth disable_plaintext_auth = no mail_debug = yes mail_gid = 1001 mail_location = maildir:/var/mail/vhosts/%n mail_uid = 1001 namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } protocols = imap pop3 service auth { user = root } ssl_cert = </root/dovecot.crt ssl_cipher_list = ALL:!DH:!kRSA:!SRP:!kDHd:!DSS:!aNULL:!eNULL:!EXPORT:!DES:!3DES:!MD5:!PSK:!RC4:!ADH:!LOW@STRENGTH ssl_key = # hidden, use -P to show it passdb { driver = sql # Path for SQL configuration file, see example-config/dovecot-sql.conf.ext args = /usr/local/etc/dovecot/dovecot-sql.conf.ext } userdb { driver = prefetch } ``` dovecot-sql.conf.ext ``` driver = mysql connect = host=192.168.254.134 port=3306 dbname=mails user=karl password=adminpassword password_query = SELECT destuser, password, host, 'Y' as proxy FROM proxy WHERE user = '%u'; ``` Thanks :)

5 6

using keycloak
by A. Schulze 25 Apr '24

25 Apr '24

Hello, I'm relative new to oauth2. I like to understand a setup for dovecot but https://doc.dovecot.org/configuration_manual/authentication/oauth2/ is not enough for me. Could anybody describe a simple setup where dovecot uses keycloak. For simplification I would start with keycloak's builtin user management only. - how to configure dovecot - how to configure keycloak - how to test with 'curl --verbose --some-magic-options imap://dovecot-server' Thanks, Andreas

1 0

Which DKIM application for postfix 3.9.0
by dovecot＠outputservices.com 25 Apr '24

25 Apr '24

I am upgrading to postfix 3.9.0. I have not used DKIM in previous postfix installs, but I would like to start now with the new google rules. I have done some research and opendkim is the most recommended, however, other research states the opendkim has been abandoned by it's maintainers. So I am looking for a good alternative dkim software that will work with postfix that I can compile myself. I do not run on any linux version, so therefore I can not just apt-get a new dkim application. I run Solaris and therefore need to compile my applications, postfix and dkim. Any good suggestions will be appreciated.

7 8

HELP with email attachments ONLY clean up
by INFO ＠ TRIMLINE 25 Apr '24

25 Apr '24

Hello Dovecot Dev team, In my cpanel, we use your email management. This is what my hosting provider has allowed. Our problem: Since the introduction of "hi def cameras on mobile phones", we are getting emails with "huge attachments". The email which comes with the attachments is also important. However, once we download the email (imap), using any of the email clients (outlook, bluemail etc.) the mailbox still has these huge attachments. Because of this, our mailbox storage gets filled up quickly. In our email client software, we can delete (attachments only), and leave the email in our mailbox. So this work around helps us keep our mailbox size manageable. Unfortunately, not everyone does this "email attachment cleanup" regularly and end up being locked out of email storage space and probably lost a few hours of productive time. Our dev Request: Would it be possible to create a setting for end users in our Cpanel, in which we can delete the attachments without deleting the actual message? So query should have: <per email mailbox account> (drop down selection, like you have it now) * Filter 01: Select Messages older than nnn days (where nnn would be 100 to 999 days) (so for the first 99 days, every imap client would have the opportunity to download the email and the attachments) * From Filter 01 = Filter 02: Select messages which are >xxx Mb (where xxx could be 001 to 999 Mb) * From Filter 02 = Filter 03: Select only messages which contain attachments (Yes) * From Filter 03: Permanently Delete the attachments ONLY, So not deleting the actual email msg (OK). So on day 100 (or after the clean up is done), the imap email client will now only get the email but not the attachments (in the event they need to refresh their email setup). If such a query can be created and installed on our Cpanel, we can run this "clean up attachments" query regularly and as such reduce our mailbox size. Q: Would it be possible to create such a clean up tool (pre-defined) so that the cpanel web service admin user only has to enter (nnn and xxx and Yes) to finally click on "OK" to delete the attachments? If this would be possible, what will it cost us to have it installed on our Cpanel? There is so much information/documentation already on your website (doc.dovecot.org) and I spent about 60 min looking for such a "clean up tool" documentation, but started getting dizzy reading all that script language etc. Not my cup of tea. Please help. Thank you for considering and reading this request. Kind regards M. Akil Walji

3 2

Debian, Postfix, Dovecot, MySQL, and argon2 password hashing scheme?
by David Mehler 25 Apr '24

25 Apr '24

Hello, I have a quick question. Can Debian, and/or it's Postfix/Dovecot/MySQL/MariaDB packages support the argon2 password hashing scheme? I had a previously-working e-mail setup on a *BSD system, utilizing the argon2ID scheme with Dovecot, Postfix, and MySQL. Since changing systems to Debian 12.5 I can't send, though checking the password with a manual login to Dovecot works fine. I'm wondering if I have to migrate the passwords from argon2ID to SHA512-CRYPT? Thanks. Dave. -- Sent from Mozilla Thunderbird 91.13.1

2 1

RE: Which DKIM application for postfix 3.9.0
by Joseph Tam 24 Apr '24

24 Apr '24

On Tue, Apr 23, 2024 at 7:33 AM <dovecot-request(a)dovecot.org> wrote: > > I am upgrading to postfix 3.9.0. I have not used DKIM in previous postfix installs, but I >> would like to start now with the new google rules. I have done some research and opendkim >> is the most recommended, however, other research states the opendkim has been >> abandoned by it's maintainers. So I am looking for a good alternative dkim software >> that will work with postfix that I can compile myself. I do not run on any linux >> version, so therefore I can not just apt-get a new dkim application. >> I run Solaris and therefore need to compile my applications, postfix and dkim. >> Any good suggestions will be appreciated. I just rolled out a locally compiled opendkim on my mail server. It works, but there are a few gotchas. Although it seems like a moribund project, there is a late beta version that includes some important patches, most notably the "Header:\n LongHeaderValue" bug that needs fixing. You can look at https://sourceforge.net/p/opendkim/patches/ to find that patch, as well as others you deem important. As DKIM standards are not going to change soon, having end-of-line software is not as bad as it seems unless you need particular enhancements to make it work better in your circumstances. Once you get your setup dialed, you can probably set it and forget it. Most of the headaches have actually been internal: local mail injection via sendmail would skip miltering, From header canonicalization by the MTA would not be seen by the opendkim milter thereby creating messages with missing or invalid signatures, and mailing list/auto reply/forwarder software mangling messages. I think Postfix does a better job in this regard, so these issues may not present itself. (I did a Postfix/opendkim milter on an Ubuntu system and it was much less hassle.) You should look at *lots* of DMARC RUA reports. People are doing crazy batsh*t stuff with your mail domain. Joseph Tam <jtam.home(a)gmail.com>

4 3

Setting compression to specific namespace
by Filip Bartmann 23 Apr '24

23 Apr '24

Hello, is it possible to set compression for specific namespace or spefic mailbox folder? Thanks, Filip Bartmann

1 0

Question about line length limit in lmtp.
by Kamil Jońca 22 Apr '24

22 Apr '24

I have postfix + dovecot server. Mail for local users are saved by dovecot lmtp. Recently I got some messages from postfix: --8<---------------cut here---------------start------------->8--- 4NQ07L4h4LztXXr: breaking line > 998 bytes with <CR><LF>SPAC --8<---------------cut here---------------end--------------->8--- This is because postfix has configured with default value lmtp_line_length_limit (990). I can turn off this limit (set to 0) but I am curious if dovecot lmtp will accept so lengthty lines? Does dovecot lmtp has any line limits? KJ -- http://stopstopnop.pl/stop_stopnop.pl_o_nas.html

4 6

doveadm index to terminate non-zero in case of failure
by Jaco Kroon 22 Apr '24

22 Apr '24

Hi, It would be great if doveadm index could terminate non-zero in the case of index corruption, that way the tool can be used as a way to determine and remove corrupted indexes. Example: othala [13:56:24] ~ # doveadm index -u lumi_james INBOX doveadm(lumi_james): Error: Corrupted transaction log file /path/to/lumi_james/dovecot.list.index.log seq 2: Unexpected garbage at EOF (sync_offset=7168) doveadm(lumi_james): Error: Failed to map transaction log /path/to/lumi_james/dovecot.list.index.log at sync_offset=7168 after locking: Unexpected garbage at EOF othala [13:56:34] ~ # echo $? 0 othala [13:56:37] ~ # If doveadm index exited non-zero in above case we'd be able to: if ! doveadm index -u lumi_james INBOX; then rm /path/to/lumi_james/dovecot.index{,log,.cache} fi Which may be over-zealous in removing indexes, but we'd rather have that. We believe we already fixed the locking issue that caused the corrupt indexes and are busy cleaning them up based on log files, but it would still be great if the above could be integrated into our check battery if/when users report problems, of "run the script and it fixes 99% of things that are known to break". In the same breath, we're seeing that folders with & in the name are causing problems for doveadm index -u someuser '*' usage. Kind regards, Jaco

1 0

Variable expansion on %w
by Gandalf Corvotempesta 21 Apr '24

21 Apr '24

I'm following the guide for changing the password schema. Everything works as expected (i'm using a static passwd file), but when the plain password has a % inside, dovecot is trying to expand that, triggering an error: Apr 11 21:33:55 mail02 dovecot: pop3(x)<3962994><4soGPNcVXsoln9W6>: Error: Failed to expand plugin setting plain_pass = 'xxxxx%Yxxxxxx!%': Unknown variable '%Y' How can I block the variable expansion inside %w ?

3 10

Sieve not getting recompiled
by Joan Moreau 21 Apr '24

21 Apr '24

Hi I have sieve = /mails/%d/%n/sieve/roundcube.sieve sieve_after = /mails/sieve/after.sieve sieve_before = /mails/sieve/before.sieve sieve_dir = /mails/%d/%n/sieve/ sieve_global_dir = /mails/sieve/ But sieve scripts are not compiled and not executed It was working until I removed the setting "sieve_global_path" Something I dont understand ? Thank you

2 2

exfat not supported ?
by Joan Moreau 21 Apr '24

21 Apr '24

Hi Would placing my storage on a exfat partition work ? If no, why ? Thank you

3 5

Logging e_debug messages
by D S 21 Apr '24

21 Apr '24

Is it possible to log the e_debug events in quota-status.c? [https://github.com/dovecot/core/blob/main/src/plugins/quota/quota-status.c] Running: Dovecot 2.3.19.1 (9b53102964) Here's the config I've tried: log_path = /var/log/dovecot.log event_exporter log { format = json format_args = time-rfc3339 transport = log } metric everything { exporter = log filter = event=* OR category=* } log_debug = event=* auth_verbose = yes auth_debug = yes mail_debug = yes This seems to capture events at INFO level or higher, and some Debug log messages, but not the e_debug messages in quota-status.c. Thanks, Daniel

1 0

thread->detach() creates confusion of dovecot
by Joan Moreau 20 Apr '24

20 Apr '24

Hi When I try to "detach" (https://en.cppreference.com/w/cpp/thread/thread/detach) a thread running inside a plugin, it seems the core dovecot has some influence on that , tries to close this for some unknown reason and usually ends up crashing What is the cause of this ? Thank you

1 0

Error: acl: dict_iterate() failed: sql dict iterate failed for shared : Invalid/unmapped path
by Syrosh 18 Apr '24

18 Apr '24

Hi, This error occurs if you have shared mailboxes configured, but not a map for sharing with "anyone". Dovecot then tries to perform a SQL query for something that doesn't exist and logs this error message. Error: acl: dict_iterate() failed: sql dict iterate failed for shared : Invalid/unmapped path There's a 14 year old discussion that talks about adding a dummy table and map to prevent the error: https://dovecot.dovecot.narkive.com/qWO58HYM/error-sql-dict-iterate-question I'd rather add this table since I'm not using sharing to anyone, is there a way to prevent dovecot from making this query? Best Regards, Syrosh

1 0

Bug report: invalid \HasNoChildren in response when asterisk is used in the name
by Merijn Schering 18 Apr '24

18 Apr '24

Hi, I'm using dovecot 2.3.4.1 (f79e8e7e4). I have created a folder called "Test with *". Now when I do a command: A3 LIST "" "%" RETURN (CHILDREN STATUS (MESSAGES UNSEEN)) It responds: * STATUS Test with * ( MESSAGES 0 UNSEEN 0 ) * LIST ( \HasNoChildren \UnMarked ) / Spam But it actually has children! This only happens when I use a * character in the name. I hope you can fix this some day. Thanks! Best regards, Merijn Schering Intermesh https://www.group-office.com https://twitter.com/GroupOffice

2 4

Wildcard !include statements fail if nothing matches
by Noah Meyerhans 17 Apr '24

17 Apr '24

Forwarding this report from Debian bug #1068478. Please see the full report for more context. [1] Per the documentation on "Including config files", "It’s not an error if wildcards don’t result in any matching files." [2] However, that statement does not seem to reflect the actual behavior of the code. Some relevant snippets of code from src/config/config-parser.c: from config_parse_line(): if (strcmp(key, "!include") == 0) return CONFIG_LINE_TYPE_INCLUDE; if (strcmp(key, "!include_try") == 0) return CONFIG_LINE_TYPE_INCLUDE_TRY; This return value is later handled with a case statement in config_parser_apply_line(): case CONFIG_LINE_TYPE_INCLUDE: case CONFIG_LINE_TYPE_INCLUDE_TRY: (void)settings_include(ctx, fix_relative_path(value, ctx->cur_input), type == CONFIG_LINE_TYPE_INCLUDE_TRY); break; The result of the "type == CONFIG_LINE_TYPE_INCLUDE_TRY" statement is passed as the bool ignore_errors parameter to bool ignore_errors(), so if it evaluates to false as it does when type == CONFIG_LINE_TYPE_INCLUDE, then we return an error: case GLOB_NOMATCH: if (ignore_errors) return 0; ctx->error = "No matches"; return -1; The code is pretty straightforward in how it handles this scenario, so maybe the documentation should be clarified? Thanks noah 1. https://bugs.debian.org/1068478 2. https://doc.dovecot.org/configuration_manual/config_file/#including-config-…

2 2

doveadm import error: quota: Unknown namespace: INBOX/
by Ralf Becker 17 Apr '24

17 Apr '24

Dovecot version is 2.3.20 and I try to restore a folder hierarchy from an older snapshot of the mailbox (folders in question have been deleted): sudo -u dovecot doveadm -Dv import -u pbs(a)xyz.de -s mdbox:$(pwd)/pbs-2024-03-19/mdbox INBOX mailbox 'projekte/8-BZ/*' I'm getting the following error: Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Error: quota: Unknown namespace: INBOX/ I also tried restoring in a (not existing) restore folder: Restore-2024-03-19 and using search query "mailbox 'projekte/8-BZ'", all give the same result :( Any ideas what might be wrong, I did this many times before, and it worked, so I'm puzzeled ... Here is the full output of doveadm import command above and doveconf -n: root@aab41229427e:/var/dovecot/imap/xyz.de# sudo -u dovecot doveadm -Dv import -upbs(a)xyz.de -s mdbox:$(pwd)/pbs-2024-03-19/mdbox INBOX mailbox 'projekte/8-BZ/*' Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Apr 12 10:52:18 Debug: Loading modules from directory: /usr/lib/dovecot/modules Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/lib01_mail_lua_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/lib20_push_notification_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/lib20_replication_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/lib22_push_notification_lua_plugin.so Apr 12 10:52:18 Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so Apr 12 10:52:18 Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Apr 12 10:52:18 Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Apr 12 10:52:18 Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: auth-master: passdb lookup(pbs(a)xyz.de): Started passdb lookup Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: auth-master: conn unix:/run/dovecot/auth-userdb: Connecting Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: auth-master: conn unix:/run/dovecot/auth-userdb (pid=1,uid=0): Client connected (fd=8) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: auth-master: passdb lookup(pbs(a)xyz.de): auth PASS input: Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: auth-master: passdb lookup(pbs(a)xyz.de): Passdb lookup failed Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: auth-master: userdb lookup(pbs(a)xyz.de): Started userdb lookup Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: auth-master: userdb lookup(pbs(a)xyz.de): auth USER input:pbs@xyz.de home=/var/dovecot/imap/xyz.de/pbs quota_rule=*:bytes=20971520000master_user=pbs@xyz.de acl_groups=_admins@xyz.de,_alle-festangestellte@xyz.de,_organisatorische einheiten@xyz.de,_zbt-festangestellte@xyz.de,_zbt-geschaeftsfuehrung@xyz.de, Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: auth-master: userdb lookup(pbs(a)xyz.de): Finished userdb lookup (username=pbs(a)xyz.de home=/var/dovecot/imap/xyz.de/pbs quota_rule=*:bytes=20971520000master_user=pbs@xyz.de acl_groups=_admins@xyz.de,_alle-festangestellte@xyz.de,_organisatorische einheiten@xyz.de,_zbt-festangestellte@xyz.de,_zbt-geschaeftsfuehrung@xyz.de,) Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: Added userdb setting:plugin/acl_groups=_admins@xyz.de,_alle-festangestellte@xyz.de,_organisatorische einheiten@xyz.de,_zbt-festangestellte@xyz.de,_zbt-geschaeftsfuehrung@xyz.de, Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: Added userdb setting:plugin/master_user=pbs@xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: Added userdb setting: plugin/quota_rule=*:bytes=20971520000 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Effective uid=90, gid=101, home=/var/dovecot/imap/xyz.de/pbs Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict created (uri=file:/var/dovecot/imap/xyz.de/shared-mailboxes.db, base_dir=/run/dovecot) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Quota root: name=User quota backend=dict args=:ns=INBOX/:file:/var/dovecot/imap/xyz.de/pbs/dovecot-quota Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Quota rule: root=User quota mailbox=* bytes=20971520000 messages=0 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Quota grace: root=User quota bytes=2097152000 (10%) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: quota-dict:user=pbs@xyz.de, uri=file:/var/dovecot/imap/xyz.de/pbs/dovecot-quota, noenforcing=0 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict created (uri=file:/var/dovecot/imap/xyz.de/pbs/dovecot-quota, base_dir=/run/dovecot) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: lua: Loading /etc/dovecot/dovecot-push.lua Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: lua: Calling script_init Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Namespace inboxes: type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=no location=mdbox:~/mdbox Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: fs: root=/var/dovecot/imap/xyz.de/pbs/mdbox, index=, indexpvt=, control=, inbox=, alt= Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: initializing backend with data: vfile Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: acl username =pbs(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: owner = 1 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _admins(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _alle-festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _organisatorischeeinheiten(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt-festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt-geschaeftsfuehrung(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl vfile: Global ACLs disabled Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Namespace users: type=shared, prefix=user/%n/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=mdbox:%h/mdbox Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: initializing backend with data: vfile Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: acl username =pbs(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: owner = 0 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _admins(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _alle-festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _organisatorischeeinheiten(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt-festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt-geschaeftsfuehrung(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl vfile: Global ACLs disabled Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Namespace subs: type=private, prefix=, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:~/mdbox Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: fs: root=/var/dovecot/imap/xyz.de/pbs/mdbox, index=, indexpvt=, control=, inbox=, alt= Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: initializing backend with data: vfile Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: acl username =pbs(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: owner = 1 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _admins(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _alle-festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _organisatorischeeinheiten(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt-festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt-geschaeftsfuehrung(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl vfile: Global ACLs disabled Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: quota: quota_over_flag check: quota_over_script unset - skipping Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: auth-master: userdb lookup(pbs(a)xyz.de): Started userdb lookup Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: auth-master: userdb lookup(pbs(a)xyz.de): auth USER input:pbs@xyz.de home=/var/dovecot/imap/xyz.de/pbs quota_rule=*:bytes=20971520000master_user=pbs@xyz.de acl_groups=_admins@xyz.de,_alle-festangestellte@xyz.de,_organisatorische einheiten@xyz.de,_zbt-festangestellte@xyz.de,_zbt-geschaeftsfuehrung@xyz.de, Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: auth-master: userdb lookup(pbs(a)xyz.de): Finished userdb lookup (username=pbs(a)xyz.de home=/var/dovecot/imap/xyz.de/pbs quota_rule=*:bytes=20971520000master_user=pbs@xyz.de acl_groups=_admins@xyz.de,_alle-festangestellte@xyz.de,_organisatorische einheiten@xyz.de,_zbt-festangestellte@xyz.de,_zbt-geschaeftsfuehrung@xyz.de,) Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: Added userdb setting:plugin/acl_groups=_admins@xyz.de,_alle-festangestellte@xyz.de,_organisatorische einheiten@xyz.de,_zbt-festangestellte@xyz.de,_zbt-geschaeftsfuehrung@xyz.de, Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: Added userdb setting:plugin/master_user=pbs@xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: Added userdb setting: plugin/quota_rule=*:bytes=20971520000 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Effective uid=90, gid=101, home=/var/dovecot/imap/xyz.de/pbs Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict created (uri=file:/var/dovecot/imap/xyz.de/shared-mailboxes.db, base_dir=/run/dovecot) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Quota root: name=User quota backend=dict args=:ns=INBOX/:file:/var/dovecot/imap/xyz.de/pbs/dovecot-quota Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Quota rule: root=User quota mailbox=* bytes=20971520000 messages=0 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Quota grace: root=User quota bytes=2097152000 (10%) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: quota-dict:user=pbs@xyz.de, uri=file:/var/dovecot/imap/xyz.de/pbs/dovecot-quota, noenforcing=0 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict created (uri=file:/var/dovecot/imap/xyz.de/pbs/dovecot-quota, base_dir=/run/dovecot) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: lua: Loading /etc/dovecot/dovecot-push.lua Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: lua: Calling script_init Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: fs: root=/var/dovecot/imap/xyz.de/pbs-2024-03-19/mdbox, index=, indexpvt=, control=, inbox=, alt= Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: initializing backend with data: vfile Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: acl username =pbs(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: owner = 1 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _admins(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _alle-festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _organisatorischeeinheiten(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt-festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt-geschaeftsfuehrung(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl vfile: Global ACLs disabled Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Error: quota: Unknown namespace: INBOX/ Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: quota: quota_over_flag check: quota_over_script unset - skipping Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl vfile: file /var/dovecot/imap/xyz.de/pbs-2024-03-19/mdbox/mailboxes/dovecot-acl not found Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: User session is finished Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict destroyed Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): Waiting for dict to finish pending operations Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict destroyed Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: User session is finished Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict destroyed Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): Waiting for dict to finish pending operations Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict destroyed Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: auth-master: conn unix:/run/dovecot/auth-userdb (pid=1,uid=0): Disconnected: Connection closed (fd=8) root@aab41229427e:/var/dovecot/imap/xyz.de# doveconf -n # 2.3.20 (80a5ac675d): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.20 (149edcf2) # OS: Linux 5.4.0-174-generic x86_64 Ubuntu 20.04.6 LTS # Hostname: aab41229427e auth_cache_negative_ttl = 2 mins auth_cache_size = 10 M auth_cache_ttl = 5 mins auth_master_user_separator = * auth_mechanisms = plain login auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@#" default_client_limit = 3500 default_process_limit = 512 disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it doveadm_port = 12345 first_valid_uid = 90 listen = * lmtp_rcpt_check_quota = yes log_path = /dev/stderr login_greeting = Dovecot FRA.nfs ready mail_access_groups = dovecot mail_attribute_dict =file:%h/dovecot-metadata mail_gid = dovecot mail_location = mdbox:~/mdbox mail_log_prefix = "%s(%u %p): " mail_max_userip_connections = 200 mail_plugins = acl quota notify replication mail_log mail_lua notify push_notification push_notification_lua mail_uid = dovecot managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.debug mbox_min_index_size = 1000 B mdbox_rotate_size = 50 M namespace inboxes { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Templates { auto = subscribe } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX/ separator = / subscriptions = no } namespace subs { hidden = yes list = no location = prefix = separator = / } namespace users { location = mdbox:%%h/mdbox prefix = user/%%n/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-dict-master-auth.conf driver = dict master = yes } passdb { args = /etc/dovecot/dovecot-dict-auth.conf driver = dict } plugin { acl = vfile acl_shared_dict =file:/var/dovecot/imap/%d/shared-mailboxes.db mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcp:10.44.99.6 push_lua_url =http://push-proxy/ push_notification_driver = lua:file=/etc/dovecot/dovecot-push.lua quota =dict:User quota::ns=INBOX/:file:%h/dovecot-quota quota_rule = *:storage=200GB sieve = ~/sieve/dovecot.sieve sieve_after = /var/dovecot/sieve/after.d/ sieve_before = /var/dovecot/sieve/before.d/ sieve_dir = ~/sieve sieve_extensions = +editheader +vacation-seconds sieve_user_log = ~/.sieve.log sieve_vacation_min_period = 1s } postmaster_address =admins(a)egroupware.org protocols = imap pop3 lmtp sieve replication_dsync_parameters = -d -n INBOX -l 30 -U service aggregator { fifo_listener replication-notify-fifo { user = dovecot } unix_listener replication-notify { user = dovecot } } service auth-worker { user = $default_internal_user } service auth { drop_priv_before_exec = no inet_listener { port = 113 } } service doveadm { inet_listener { port = 12345 } inet_listener { port = 26 } vsz_limit = 640 M } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 5 service_count = 1 vsz_limit = 64 M } service imap { executable = imap process_limit = 2048 vsz_limit = 640 M } service lmtp { inet_listener lmtp { port = 24 } unix_listener lmtp { mode = 0666 } vsz_limit = 512 M } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { executable = pop3 } service postlogin { executable = script-login -d rawlog -b -t } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = dovecot mode = 0660 user = dovecot } } ssl_cert = </etc/certs/mail.egroupware.org.pem ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it submission_host = fra-node-pool-internal.k8s.farm.egroupware.org:25 userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } userdb { args = /etc/dovecot/dovecot-dict-auth.conf driver = dict } verbose_proctitle = yes protocol lda { mail_plugins = acl quota notify replication mail_log mail_lua notify push_notification push_notification_lua acl sieve quota } protocol imap { imap_metadata = yes mail_max_userip_connections = 200 mail_plugins = acl quota notify replication mail_log mail_lua notify push_notification push_notification_lua acl imap_acl quota imap_quota } protocol lmtp { mail_max_lock_timeout = 25 secs mail_plugins = acl quota notify replication mail_log mail_lua notify push_notification push_notification_lua acl sieve quota } -- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0 Dovecot version is 2.3.20 and I try to restore a folder hierarchy from an older snapshot of the mailbox (folders in question have been deleted): sudo -u dovecot doveadm -Dv import -u pbs(a)xyz.de -s mdbox:$(pwd)/pbs-2024-03- 19/mdbox INBOX mailbox 'projekte/8-BZ/*' I'm getting the following error: Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Error: quota: Unknown namespace: INBOX/ I also tried restoring in a (not existing) restore folder: Restore-2024-03-19 and using search query "mailbox 'projekte/8-BZ'", all give the same result :( Any ideas what might be wrong, I did this many times before, and it worked, so I'm puzzeled ... Here is the full output of doveadm import command above and doveconf -n: root@aab41229427e:/var/dovecot/imap/xyz.de# sudo -u dovecot doveadm -Dv import -u pbs(a)xyz.de -s mdbox:$(pwd)/pbs-2024-03-19/mdbox INBOX mailbox 'projekte/8- BZ/*' Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/ dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/ dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: / usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/ dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: / usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/ dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/ dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: / usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/ dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: / usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Apr 12 10:52:18 Debug: Loading modules from directory: /usr/lib/dovecot/modules Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/ lib01_acl_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/ lib01_mail_lua_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/ lib10_quota_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/ lib15_notify_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/ lib20_mail_log_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/ lib20_push_notification_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/ lib20_replication_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/ lib22_push_notification_lua_plugin.so Apr 12 10:52:18 Debug: Loading modules from directory: /usr/lib/dovecot/ modules/doveadm Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_acl_plugin.so Apr 12 10:52:18 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_quota_plugin.so Apr 12 10:52:18 Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/ lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Apr 12 10:52:18 Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Apr 12 10:52:18 Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/ libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: auth-master: passdb lookup (pbs(a)xyz.de) Started passdb lookup Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: auth-master: conn unix:/run/ dovecot/auth-userdb: Connecting Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: auth-master: conn unix:/run/ dovecot/auth-userdb (pid=1,uid=0): Client connected (fd=8) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: auth-master: passdb lookup (pbs(a)xyz.de) auth PASS input: Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: auth-master: passdb lookup (pbs(a)xyz.de) Passdb lookup failed Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: auth-master: userdb lookup (pbs(a)xyz.de) Started userdb lookup Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: auth-master: userdb lookup (pbs(a)xyz.de) auth USER input: pbs(a)xyz.de home=/var/dovecot/imap/xyz.de/pbs quota_rule=*:bytes=20971520000 master_user=pbs(a)xyz.de acl_groups=_admins@xyz.de,_alle-festangestellte@xyz.de,_organisatorische einheiten@xyz.de,_zbt-festangestellte@xyz.de,_zbt-geschaeftsfuehrung@xyz.de, Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: auth-master: userdb lookup (pbs(a)xyz.de) Finished userdb lookup (username=pbs(a)xyz.de home=/var/dovecot/ imap/xyz.de/pbs quota_rule=*:bytes=20971520000 master_user=pbs(a)xyz.de acl_groups=_admins@xyz.de,_alle-festangestellte@xyz.de,_organisatorische einheiten@xyz.de,_zbt-festangestellte@xyz.de,_zbt-geschaeftsfuehrung@xyz.de,) Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: Added userdb setting: plugin/acl_groups=_admins@xyz.de,_alle-festangestellte@xyz.de,_organisatorische einheiten@xyz.de,_zbt-festangestellte@xyz.de,_zbt-geschaeftsfuehrung@xyz.de, Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: Added userdb setting: plugin/master_user=pbs(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: Added userdb setting: plugin/quota_rule=*:bytes=20971520000 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Effective uid=90, gid=101, home=/ var/dovecot/imap/xyz.de/pbs Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict created (uri=file: /var/dovecot/imap/xyz.de/shared-mailboxes.db, base_dir=/run/dovecot) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Quota root: name=User quota backend=dict args=:ns=INBOX/:file:/var/dovecot/imap/xyz.de/pbs/dovecot-quota Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Quota rule: root=User quota mailbox=* bytes=20971520000 messages=0 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Quota grace: root=User quota bytes=2097152000 (10%) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: quota-dict: user=pbs(a)xyz.de, uri=file:/var/dovecot/imap/xyz.de/pbs/dovecot-quota, noenforcing=0 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict created (uri=file: /var/dovecot/imap/xyz.de/pbs/dovecot-quota, base_dir=/run/dovecot) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: lua: Loading /etc/dovecot/dovecot- push.lua Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: lua: Calling script_init Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Namespace inboxes: type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=no location=mdbox:~/mdbox Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: fs: root=/var/dovecot/imap/xyz.de/ pbs/mdbox, index=, indexpvt=, control=, inbox=, alt= Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: initializing backend with data: vfile Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: acl username = pbs(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: owner = 1 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _admins(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _alle- festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _organisatorische einheiten(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt- festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt- geschaeftsfuehrung(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl vfile: Global ACLs disabled Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Namespace users: type=shared, prefix=user/%n/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=mdbox:%h/mdbox Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: initializing backend with data: vfile Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: acl username = pbs(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: owner = 0 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _admins(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _alle- festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _organisatorische einheiten(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt- festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt- geschaeftsfuehrung(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl vfile: Global ACLs disabled Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Namespace subs: type=private, prefix=, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:~/mdbox Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: fs: root=/var/dovecot/imap/xyz.de/ pbs/mdbox, index=, indexpvt=, control=, inbox=, alt= Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: initializing backend with data: vfile Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: acl username = pbs(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: owner = 1 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _admins(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _alle- festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _organisatorische einheiten(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt- festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt- geschaeftsfuehrung(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl vfile: Global ACLs disabled Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: quota: quota_over_flag check: quota_over_script unset - skipping Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: auth-master: userdb lookup (pbs(a)xyz.de) Started userdb lookup Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: auth-master: userdb lookup (pbs(a)xyz.de) auth USER input: pbs(a)xyz.de home=/var/dovecot/imap/xyz.de/pbs quota_rule=*:bytes=20971520000 master_user=pbs(a)xyz.de acl_groups=_admins@xyz.de,_alle-festangestellte@xyz.de,_organisatorische einheiten@xyz.de,_zbt-festangestellte@xyz.de,_zbt-geschaeftsfuehrung@xyz.de, Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: auth-master: userdb lookup (pbs(a)xyz.de) Finished userdb lookup (username=pbs(a)xyz.de home=/var/dovecot/ imap/xyz.de/pbs quota_rule=*:bytes=20971520000 master_user=pbs(a)xyz.de acl_groups=_admins@xyz.de,_alle-festangestellte@xyz.de,_organisatorische einheiten@xyz.de,_zbt-festangestellte@xyz.de,_zbt-geschaeftsfuehrung@xyz.de,) Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: Added userdb setting: plugin/acl_groups=_admins@xyz.de,_alle-festangestellte@xyz.de,_organisatorische einheiten@xyz.de,_zbt-festangestellte@xyz.de,_zbt-geschaeftsfuehrung@xyz.de, Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: Added userdb setting: plugin/master_user=pbs(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de 1416382): Debug: Added userdb setting: plugin/quota_rule=*:bytes=20971520000 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Effective uid=90, gid=101, home=/ var/dovecot/imap/xyz.de/pbs Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict created (uri=file: /var/dovecot/imap/xyz.de/shared-mailboxes.db, base_dir=/run/dovecot) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Quota root: name=User quota backend=dict args=:ns=INBOX/:file:/var/dovecot/imap/xyz.de/pbs/dovecot-quota Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Quota rule: root=User quota mailbox=* bytes=20971520000 messages=0 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: Quota grace: root=User quota bytes=2097152000 (10%) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: quota-dict: user=pbs(a)xyz.de, uri=file:/var/dovecot/imap/xyz.de/pbs/dovecot-quota, noenforcing=0 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict created (uri=file: /var/dovecot/imap/xyz.de/pbs/dovecot-quota, base_dir=/run/dovecot) Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: lua: Loading /etc/dovecot/dovecot- push.lua Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: lua: Calling script_init Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: fs: root=/var/dovecot/imap/xyz.de/ pbs-2024-03-19/mdbox, index=, indexpvt=, control=, inbox=, alt= Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: initializing backend with data: vfile Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: acl username = pbs(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: owner = 1 Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _admins(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _alle- festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _organisatorische einheiten(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt- festangestellte(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: _zbt- geschaeftsfuehrung(a)xyz.de Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl: group added: Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl vfile: Global ACLs disabled Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Error: quota: Unknown namespace: INBOX/ Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: quota: quota_over_flag check: quota_over_script unset - skipping Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: acl vfile: file /var/dovecot/imap/ xyz.de/pbs-2024-03-19/mdbox/mailboxes/dovecot-acl not found Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: User session is finished Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict destroyed Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): Waiting for dict to finish pending operations Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict destroyed Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: User session is finished Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict destroyed Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): Waiting for dict to finish pending operations Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: dict(file): dict destroyed Apr 12 10:52:18 doveadm(pbs(a)xyz.de): Debug: auth-master: conn unix:/run/ dovecot/auth-userdb (pid=1,uid=0): Disconnected: Connection closed (fd=8) root@aab41229427e:/var/dovecot/imap/xyz.de# doveconf -n # 2.3.20 (80a5ac675d): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.20 (149edcf2) # OS: Linux 5.4.0-174-generic x86_64 Ubuntu 20.04.6 LTS # Hostname: aab41229427e auth_cache_negative_ttl = 2 mins auth_cache_size = 10 M auth_cache_ttl = 5 mins auth_master_user_separator = * auth_mechanisms = plain login auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@#" default_client_limit = 3500 default_process_limit = 512 disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it doveadm_port = 12345 first_valid_uid = 90 listen = * lmtp_rcpt_check_quota = yes log_path = /dev/stderr login_greeting = Dovecot FRA.nfs ready mail_access_groups = dovecot mail_attribute_dict = file:%h/dovecot-metadata mail_gid = dovecot mail_location = mdbox:~/mdbox mail_log_prefix = "%s(%u %p): " mail_max_userip_connections = 200 mail_plugins = acl quota notify replication mail_log mail_lua notify push_notification push_notification_lua mail_uid = dovecot managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.debug mbox_min_index_size = 1000 B mdbox_rotate_size = 50 M namespace inboxes { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Templates { auto = subscribe } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX/ separator = / subscriptions = no } namespace subs { hidden = yes list = no location = prefix = separator = / } namespace users { location = mdbox:%%h/mdbox prefix = user/%%n/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-dict-master-auth.conf driver = dict master = yes } passdb { args = /etc/dovecot/dovecot-dict-auth.conf driver = dict } plugin { acl = vfile acl_shared_dict = file:/var/dovecot/imap/%d/shared-mailboxes.db mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcp:10.44.99.6 push_lua_url = http://push-proxy/ push_notification_driver = lua:file=/etc/dovecot/dovecot-push.lua quota = dict:User quota::ns=INBOX/:file:%h/dovecot-quota quota_rule = *:storage=200GB sieve = ~/sieve/dovecot.sieve sieve_after = /var/dovecot/sieve/after.d/ sieve_before = /var/dovecot/sieve/before.d/ sieve_dir = ~/sieve sieve_extensions = +editheader +vacation-seconds sieve_user_log = ~/.sieve.log sieve_vacation_min_period = 1s } postmaster_address = admins(a)egroupware.org protocols = imap pop3 lmtp sieve replication_dsync_parameters = -d -n INBOX -l 30 -U service aggregator { fifo_listener replication-notify-fifo { user = dovecot } unix_listener replication-notify { user = dovecot } } service auth-worker { user = $default_internal_user } service auth { drop_priv_before_exec = no inet_listener { port = 113 } } service doveadm { inet_listener { port = 12345 } inet_listener { port = 26 } vsz_limit = 640 M } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 5 service_count = 1 vsz_limit = 64 M } service imap { executable = imap process_limit = 2048 vsz_limit = 640 M } service lmtp { inet_listener lmtp { port = 24 } unix_listener lmtp { mode = 0666 } vsz_limit = 512 M } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { executable = pop3 } service postlogin { executable = script-login -d rawlog -b -t } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = dovecot mode = 0660 user = dovecot } } ssl_cert = </etc/certs/mail.egroupware.org.pem ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256: ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20- POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256- GCM-SHA384 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it submission_host = fra-node-pool-internal.k8s.farm.egroupware.org:25 userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } userdb { args = /etc/dovecot/dovecot-dict-auth.conf driver = dict } verbose_proctitle = yes protocol lda { mail_plugins = acl quota notify replication mail_log mail_lua notify push_notification push_notification_lua acl sieve quota } protocol imap { imap_metadata = yes mail_max_userip_connections = 200 mail_plugins = acl quota notify replication mail_log mail_lua notify push_notification push_notification_lua acl imap_acl quota imap_quota } protocol lmtp { mail_max_lock_timeout = 25 secs mail_plugins = acl quota notify replication mail_log mail_lua notify push_notification push_notification_lua acl sieve quota } -- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0

2 2

Auth fails for system users
by Christian H. Kuhn 13 Apr '24

13 Apr '24

Hi all, i try to migrate my dovecot to a new server. While everything works fine for my virtual mailbox domains via mysql, my system users for my main domain cannot authenticate. System users can login via ssh, can sudo etc. root@bywater ~ # lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 22.04.4 LTS Release: 22.04 Codename: jammy root@bywater ~ # doveconf -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 5.15.0-102-generic x86_64 Ubuntu 22.04.4 LTS # Hostname: bywater.qno.de auth_debug = yes auth_debug_passwords = yes listen = 65.21.136.15, [::] mail_location = maildir:~/Maildir mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/tables.d/dovecot-sql.conf.ext driver = sql } passdb { args = dovecot driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } postmaster_address = postmaster(a)qno.de protocols = " imap sieve" service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener lmtp { group = postfix mode = 0600 user = postfix } } ssl = required ssl_cert = </etc/letsencrypt/live/imap2.qno.de/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-CHACHA20-POLY1305 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it syslog_facility = local0 userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%u driver = static } userdb { driver = passwd } verbose_proctitle = yes /etc/pam.d/dovecot: #%PAM-1.0 @include common-auth @include common-account @include common-session root@bywater ~ # doveadm auth test qno 'xxxxxxx' passdb: qno auth failed extra fields: user=qno /var/log/auth.log: Apr 12 18:19:16 bywater unix_chkpwd[611002]: check pass; user unknown Apr 12 18:19:16 bywater unix_chkpwd[611003]: check pass; user unknown Apr 12 18:19:16 bywater unix_chkpwd[611003]: password check failed for user (qno) Apr 12 18:19:16 bywater auth worker: PASSV: pam_unix(dovecot:auth): authentication failure; logname= uid=5000 euid=5000 tty=dovecot ruser=qno rhost= user=qno /var/log/dovecot/dovecot.debug: Apr 12 18:19:16 bywater dovecot: auth: Debug: auth client connected (pid=0) Apr 12 18:19:16 bywater dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=doveadm#011debug#011resp=cW5vAHFu bwAhMTRKMDN6ODgu (previous base64 data may contain sensitive data) Apr 12 18:19:16 bywater dovecot: auth: Debug: sql(qno): Performing passdb lookup Apr 12 18:19:16 bywater dovecot: auth-worker(610993): Debug: conn unix:auth-worker (pid=610992,uid=110): auth-worker<5>: Handling PASSV request Apr 12 18:19:16 bywater dovecot: auth-worker(610993): Debug: conn unix:auth-worker (pid=610992,uid=110): auth-worker<5>: sql(qno): Performing passdb lookup Apr 12 18:19:16 bywater dovecot: auth-worker(610993): Debug: conn unix:auth-worker (pid=610992,uid=110): auth-worker<5>: sql(qno): query: SELECT email as user, password FROM user WHERE email='qno' Apr 12 18:19:16 bywater dovecot: auth-worker(610993): Debug: mysql(localhost): Finished query 'SELECT email as user, pas sword FROM user WHERE email='qno'' in 0 msecs Apr 12 18:19:16 bywater dovecot: auth-worker(610993): Debug: conn unix:auth-worker (pid=610992,uid=110): auth-worker<5>: sql(qno): Finished passdb lookup Apr 12 18:19:16 bywater dovecot: auth-worker(610993): Debug: conn unix:auth-worker (pid=610992,uid=110): auth-worker<5>: Finished: user_unknown Apr 12 18:19:16 bywater dovecot: auth: Debug: sql(qno): Finished passdb lookup Apr 12 18:19:16 bywater dovecot: auth: Debug: pam(qno): Performing passdb lookup Apr 12 18:19:16 bywater dovecot: auth-worker(610993): Debug: conn unix:auth-worker (pid=610992,uid=110): auth-worker<6>: Handling PASSV request Apr 12 18:19:16 bywater dovecot: auth-worker(610993): Debug: conn unix:auth-worker (pid=610992,uid=110): auth-worker<6>: pam(qno): Performing passdb lookup Apr 12 18:19:16 bywater dovecot: auth-worker(610993): Debug: conn unix:auth-worker (pid=610992,uid=110): auth-worker<6>: pam(qno): lookup service=dovecot Apr 12 18:19:16 bywater dovecot: auth-worker(610993): Debug: conn unix:auth-worker (pid=610992,uid=110): auth-worker<6>: pam(qno): #1/1 style=1 msg=Password: Apr 12 18:19:17 bywater dovecot: auth-worker(610993): Debug: conn unix:auth-worker (pid=610992,uid=110): auth-worker<6>: pam(qno): Finished passdb lookup Apr 12 18:19:17 bywater dovecot: auth-worker(610993): Debug: conn unix:auth-worker (pid=610992,uid=110): auth-worker<6>: Finished: password_mismatch Apr 12 18:19:17 bywater dovecot: auth: Debug: pam(qno): Finished passdb lookup Apr 12 18:19:17 bywater dovecot: auth: Debug: auth(qno): Auth request finished Same results with a real IMAP client. I have no further ideas where to look for my fault. Can somebody help? TIA QNo

3 2

Re: Dovecot somehow creating new local e-mails from a compromised account
by Joseph Tam 11 Apr '24

11 Apr '24

Greg Earle <earle(a)isolar.dyndns.org> writes: > Obviously I've changed the account password but I would really like to > know how they were able to create e-mails on my system when ostensibly I > would have assumed they could only read the account's e-mails via IMAP. The INBOX is not read-only. There's nothing really special about this mailbox versus other mailboxes. IMAP is used to create messages all the time. For example, if you have an outgoing "Sent" folder, once your mail reader gives it to your mail server, it then puts a copy into the outgoing folder via IMAP. Once someone gain controls over your IMAP account, they can create messages with a format totally different than what your mail server can make. Joseph Tam <jtam.home(a)gmail.com>

1 0

Dovecot somehow creating new local e-mails from a compromised account
by Greg Earle 11 Apr '24

11 Apr '24

Hello all, long-time listener, first-time caller ... I returned from an Eclipse trip to find a couple of sp*m e-mails in an account. I checked the logs and there was no Postfix activity during the delivery times. The 2 spams have basically no headers in them. I went back to the logs and instead found Dovecot IMAP server activity during those times. Apparently Russian hax0rs (hostnames stat_list.ip-ptr.tech and service_stat.ip-ptr.tech) compromised an account and logged into it via IMAP, and somehow were able to create these two sp*m e-mails on my system. Obviously I've changed the account password but I would really like to know how they were able to create e-mails on my system when ostensibly I would have assumed they could only read the account's e-mails via IMAP. If it matters it's an older version of Dovecot on Fedora with a fairly heavily customized set of .conf files. I ran "doveconf -a" but didn't see anything obvious in the output. I may enable rawlogs in case they come knocking again, even though the password has been changed. Thanks.

4 3

Re: Message Age Deletion Query
by Steve Hadachek 11 Apr '24

11 Apr '24

Thanks Lucas! I'll give these a try. On Wednesday, April 10, 2024 at 11:31:42 PM PDT, Lucas Rolff <lucas(a)lucasrolff.com> wrote: https://doc.dovecot.org/3.0/man/doveadm-search-query.7/ Probably something like savedbefore 4weeksOr even sentbefore 4weeks Sent from Outlook for iOSFrom: Steve Hadachek via dovecot <dovecot(a)dovecot.org> Sent: Thursday, April 11, 2024 10:03:22 AM To: dovecot(a)dovecot.org <dovecot(a)dovecot.org> Subject: Message Age Deletion Query Hello. Using Mochahost and want to delete mailbox items older than 1 month (approx) from receipt . Reading DoveCot documentation, not finding age query. Can you please specify this for me and provide an example? Thank you and Kind Regards, -Steve Hadachek Thanks Lucas! I'll give these a try. On Wednesday, April 10, 2024 at 11:31:42 PM PDT, Lucas Rolff <lucas(a)lucasrolff.com> wrote: https://doc.dovecot.org/3.0/man/doveadm-search-query.7/ Probably something like savedbefore 4weeks Or even sentbefore 4weeks Sent from Outlook_for_iOS =============================================================================== From: Steve Hadachek via dovecot <dovecot(a)dovecot.org> Sent: Thursday, April 11, 2024 10:03:22 AM To: dovecot(a)dovecot.org <dovecot(a)dovecot.org> Subject: Message Age Deletion Query Hello. Using Mochahost and want to delete mailbox items older than 1 month (approx) from receipt . Reading DoveCot documentation, not finding age query. Can you please specify this for me and provide an example? Thank you and Kind Regards, -Steve Hadachek

1 0

maybe list rocky and centos9 stream?
by Marc 11 Apr '24

11 Apr '24

maybe list rocky and centos9 stream on the repo page? https://repo.dovecot.org/

3 3

imap/pop proxy
by Gandalf Corvotempesta 11 Apr '24

11 Apr '24

Hi all first time user as dovecot imap/pop3 proxy. As i'm migrating some mailboxes to a new server, i would like to move a couple at once, not everything (more than 10k). The quickest way would be to setup the current (and old) dovecot server as pop3/imap server AND proxy. I'm thinking to start returning proxy_maybe in the password DB query, pointing to the mailbox server. If the mailbox server is migrated to the new one, proxy_maybe will point to the remote server, if the mailbox is still on the old server, proxy_maybe will point to localhost. Is this enough ? Password auth should be done on the "remote" server and not by the proxy itself. Ideas ?

1 0

Strange problem with sieve
by Peter 11 Apr '24

11 Apr '24

Hello, I use Dovecot 2.3.20 on FreeBSD 13.2 (in jail) as a part of iRedMail installation. Some mailboxes are configured for automatic mails processing using sieve (execute :pipe) and a custom binary (started by script). The system was configured and was working correctly during several weeks. Since ~10 days the system starts to work strangely. _*/Some/*_ mails cannot be decoded anymore. No changes at our side, no updates etc. I dumped the content received by my binary, and it looks really strange: pOUc9Z33O0GbfzbW5Mrmi 3L4tTlvKfsD8wP+hc6vN1v1bv+Vx827kW+YX5n/Zxtl240erH4t+nNyeuL1zh92O0p24nYKd vbtcd1UVyBdkFwztDtrdsIexJ2/Pu71L914vnFdYto+0T7JvoCiwqGm/7v6d+78UJxf3lHiU 1B9QO7D1wIeD3IO3S91K68rUy/LLPv/E/6m/3Le8oUK/ovAQ7lDWoaeHow63/8z8ubpStTK/ This is a start of one mail. No headers, no readable data. I removed "discard;" from sieve script to put such mails in the mailbox, and the mails look normally: Mime-Version:1.0 Content-Type:multipart/mixed; boundary="=-/3n/zeVGlN5thgeL28RKiw==" --=-/3n/zeVGlN5thgeL28RKiw== Content-Type: multipart/alternative; boundary="=-sE/MdvfJZlakBmrKkcdzCg==" --=-sE/MdvfJZlakBmrKkcdzCg== Content-Type: multipart/related; boundary="=-cgJVnLNlzX5YuD6yaI5USQ==" --=-cgJVnLNlzX5YuD6yaI5USQ== Content-Transfer-Encoding: base64 Content-Type: text/html; charset=utf-8 etc. Really, I have no idea about any direction to explore. The server is totally under my control, I can do anything, but I have no idea how to debug this situation. I tried to redirect such mails to another mailbox and process them there, but I get the same strange data. If I connect Thunderbird to the mailbox - I can read the mails correctly. So, the problem arrives at the moment when the sieve system is invoked - the mail data is corrupted somehow. Any advise will be really appreciated. Peter Hello, I use Dovecot 2.3.20 on FreeBSD 13.2 (in jail) as a part of iRedMail installation. Some mailboxes are configured for automatic mails processing using sieve (execute :pipe) and a custom binary (started by script). The system was configured and was working correctly during several weeks. Since ~10 days the system starts to work strangely. Some mails cannot be decoded anymore. No changes at our side, no updates etc. I dumped the content received by my binary, and it looks really strange: pOUc9Z33O0GbfzbW5Mrmi 3L4tTlvKfsD8wP+hc6vN1v1bv+Vx827kW+YX5n/Zxtl240erH4t+nNyeuL1zh92O0p24nYKd vbtcd1UVyBdkFwztDtrdsIexJ2/Pu71L914vnFdYto+0T7JvoCiwqGm/7v6d+78UJxf3lHiU 1B9QO7D1wIeD3IO3S91K68rUy/LLPv/E/6m/3Le8oUK/ovAQ7lDWoaeHow63/8z8ubpStTK/ This is a start of one mail. No headers, no readable data. I removed "discard;" from sieve script to put such mails in the mailbox, and the mails look normally: Mime-Version:1.0 Content-Type:multipart/mixed; boundary="=-/3n/zeVGlN5thgeL28RKiw==" --=-/3n/zeVGlN5thgeL28RKiw== Content-Type: multipart/alternative; boundary="=-sE/MdvfJZlakBmrKkcdzCg==" --=-sE/MdvfJZlakBmrKkcdzCg== Content-Type: multipart/related; boundary="=-cgJVnLNlzX5YuD6yaI5USQ==" --=-cgJVnLNlzX5YuD6yaI5USQ== Content-Transfer-Encoding: base64 Content-Type: text/html; charset=utf-8 etc. Really, I have no idea about any direction to explore. The server is totally under my control, I can do anything, but I have no idea how to debug this situation. I tried to redirect such mails to another mailbox and process them there, but I get the same strange data. If I connect Thunderbird to the mailbox - I can read the mails correctly. So, the problem arrives at the moment when the sieve system is invoked - the mail data is corrupted somehow. Any advise will be really appreciated. Peter

2 4

Message Age Deletion Query
by Steve Hadachek 11 Apr '24

11 Apr '24

Hello. Using Mochahost and want to delete mailbox items older than 1 month (approx) from receipt . Reading DoveCot documentation, not finding age query. Can you please specify this for me and provide an example? Thank you and Kind Regards, -Steve Hadachek Hello. Using Mochahost and want to delete mailbox items older than 1 month (approx) from receipt . Reading DoveCot documentation, not finding age query. Can you please specify this for me and provide an example? Thank you and Kind Regards, -Steve Hadachek

2 1

Re: server migration
by Gandalf Corvotempesta 11 Apr '24

11 Apr '24

Guys, any help? Also, what would happen if the new server has a different hostname ? Il giorno dom 10 mar 2024 alle ore 14:28 Gandalf Corvotempesta <gandalf.corvotempesta(a)gmail.com> ha scritto: > > Hi guys > I have to migrate around 10k mailboxes from dovecot 2.13 to (i think) > the same version but on a different server. > > I have to reduce as much as possible the inconveniences to the users, > at least in this (temporary) phase. > > What do you suggest to move everything ? Same config, same maildir > location and rsync everything ? > > Better ideas ? i've thought to use the exact same config on both > servers, then start multiple rsync to sync as much as possible and > when ready, drop the old dovecot in the old server, rsync the latest > changes, and then move the dns pointment from the old ip to the new > one. > > But what about the MUA downloading emails ? I think this would be > safe...or there is a chance that some MUA would re-download everything > ? This would be unacceptable. > > thank you

5 11

Users with enough rope to hang themselves
by Rupert Gallagher 10 Apr '24

10 Apr '24

Hello, I keep finding myself in a corner with a user. He uses mail extensively, which is fine, he has a huge archive of own professional correspondence, which is fine, but he uses mail folders as if they were regular system folders, with very long paths, and keeps renaming them and moving them around, daily, breaking the mail index and ultimately wasting his own time looking around for lost mail. His Inbox holds a gargantuan of subfolders, causing both the client and the server to overwork each time he opens the mail. His Archive is a maze of subfolders with repeating names. I advised him almost daily across 20 year on how to stay organised, but he keeps abusing the service. I want to help him by limiting what he can do with folders. This is the agenda: 1. the Archive is the only place where he can create folders; 2. folder names have a maximum length of 20 characters. Can I do that with Dovecot? Hello, I keep finding myself in a corner with a user. He uses mail extensively, which is fine, he has a huge archive of own professional correspondence, which is fine, but he uses mail folders as if they were regular system folders, with very long paths, and keeps renaming them and moving them around, daily, breaking the mail index and ultimately wasting his own time looking around for lost mail. His Inbox holds a gargantuan of subfolders, causing both the client and the server to overwork each time he opens the mail. His Archive is a maze of subfolders with repeating names. I advised him almost daily across 20 year on how to stay organised, but he keeps abusing the service. I want to help him by limiting what he can do with folders. This is the agenda: 1. the Archive is the only place where he can create folders; 2. folder names have a maximum length of 20 characters. Can I do that with Dovecot?

2 3

error: no member named 'st_ctim' in 'struct stat'
by Lasse Törngren 09 Apr '24

09 Apr '24

Hello James, I get the exact same error when trying to compile Dovecot 2.3.21 on both Mac OS Monterey 12.7.3 and Mac OS Ventura 13.6.4. dbox-storage.c:296:32:error:no member named 'st_atim' in 'struct stat' last_temp_file_scan = stats.st_atim.tv_sec; ~~~~~ ^ dbox-storage.c:297:24:error:no member named 'st_ctim' in 'struct stat' change_time = stats.st_ctim.tv_sec; Dovecot 2.3.20 compiles without any issue. Did you ever understand how to solve the problem? Best regards Lasse Törngren Hello James, I get the exact same error when trying to compile Dovecot 2.3.21 on both Mac OS Monterey 12.7.3 and Mac OS Ventura 13.6.4. dbox-storage.c:296:32:error:no member named 'st_atim' in 'struct stat' last_temp_file_scan = stats.st_atim.tv_sec; ~~~~~ ^ dbox-storage.c:297:24:error:no member named 'st_ctim' in 'struct stat' change_time = stats.st_ctim.tv_sec; Dovecot 2.3.20 compiles without any issue. Did you ever understand how to solve the problem? Best regards Lasse Törngren

1 0

doveadm sync - I/O has stalled
by songliny 09 Apr '24

09 Apr '24

Hi All, We are using dovecot 2.3.19.1 We created a account with more than 1000 mail folders in Maildir format to reproduce the issue. After weeks of testing, we have found a logic that may cause dsync to encounter the error - no activity for 900 seconds.... The function, dsync_ibc_stream_input, is the callback function after some data are ready for be read. This is part of what it does. o_stream_cork(ibc->output); ibc->ibc.io_callback(ibc->ibc.io_context); o_stream_uncork(ibc->output); Normally, ibc->ibc.io_callback(ibc->ibc.io_context) reads some data and then processes it. But when dsync connects over tcps, it uses function implementations in lib-ssl-iostream to send and receive data. And this simplified call stack would result in some data are read when calling o_stream_uncork o_stream_uncork => o_stream_flush => o_stream_ssl_flush_buffer => openssl_iostream_bio_sync => openssl_iostream_bio_input If some data arrive after ibc->ibc.io_callback(ibc->ibc.io_context) and before o_stre am_uncork, o_stream_uncork would read the data and then return. After o_stream_uncork returns, dsync then waits for new data to be read or written. But because the data had been read in o_stream_uncork, and there may be no new data to be read, dsync may then wait until timeout is met. It may happen, but it is hard to reproduce. If you also encounter this situation, you may try to use dsync over tcp connection. It does not read data when calling o_stream_uncork. As a result, it may not stuck. Back to the error itself, Maybe openssl-stream should not read data when doing uncork(flush)? Song-Lin Yang

2 4

DMARC setting change
by Aki Tuomi 05 Apr '24

05 Apr '24

We've changed the list dmarc mitigation to happen unconditionally now. This will likely have an impact on people's mails, so this is a headsup for everyone so they know. Please let me know if this causes too much bother, but keep in mind that right now lot of emails are being bounced and rejected. Aki

3 2

Re: Users with enough rope to hang themselves
by Joseph Tam 05 Apr '24

05 Apr '24

Rupert Gallagher writes: > I keep finding myself in a corner with a user. He uses mail extensively, which > is fine, he has a huge archive of own professional correspondence, which is > fine, but he uses mail folders as if they were regular system folders, with > very long paths, and keeps renaming them and moving them around, daily, > breaking the mail index Tangentially query: is Dveocot smart enough to optimize mailbox renaming to do index renaming (i.e. does not try to copy or recreate indices)? > and ultimately wasting his own time looking around for > lost mail. His Inbox holds a gargantuan of subfolders, causing both the client > and the server to overwork each time he opens the mail. His Archive is a maze > of subfolders with repeating names. I advised him almost daily across 20 year > on how to stay organised, but he keeps abusing the service. Semantically, he may be inept/disorganized/unappreciative, but I wouldn't raise this to abuse. However, the damages are often the same. Maybe the fix is not technical but social by making it clear you're done trying to fix his mistakes and he's on his own. Just sayin'. > I want to help him by limiting what he can do with folders. This is the agenda: > 1. the Archive is the only place where he can create folders; I'm guessing https://doc.dovecot.org/configuration_manual/acl/ > 2. folder names have a maximum length of 20 characters. No clue here: maybe artful remapping of namespaces? https://doc.dovecot.org/configuration_manual/mail_location/#custom-namespac… Joseph Tam <jtam.home(a)gmail.com>

5 13

2.4 ballpark release date?
by Shawn Heisey 05 Apr '24

05 Apr '24

I'm wondering whether there is a ballpark release date for Dovecot 2.4. I know an exact release date is probably not available, but can it at least be narrowed to a specific quarter? Is it likely in 2023? I have seen on previous messages that an Ubuntu repository for 22.04 (jammy) will appear with the 2.4 release. My mail server in AWS is running Ubuntu 20.04 (focal), which I have avoided upgrading for various reasons, including websites that don't work with PHP 8.1. Now the last remaining hurdle is the fact that there is no dovecot repository for jammy. I would prefer the official Dovecot repo over dovecot packages included with Ubuntu, because it's likely to be a newer release, and built from vanilla project code. At the moment jammy includes dovecot 2.3.16, which is even older than the 2.3.20 that I am running on focal from the official dovecot repo. Again, I know that a precise release date won't be possible. I'm just hoping for something like "soon" or "in about six months." Thanks, Shawn

3 5

Re: Fwd: Dovecot, Load Balancing and SSL
by Joseph Tam 04 Apr '24

04 Apr '24

leon(a)relay.gb.net writes: > I wonder if someone would provide me with some advice. I've been setting > up a couple of Postfix servers just for fun. I've got two Postfix > servers m1.domain.com and m2.domain.com. I can send and receive mail via > both of them. Ive also got Postfixadmin and RoundCube on them and I'm > replicating the database over both servers. > > I introduced a load balancer. Postfixadmin and Roundcube work perfectly. > However. When I send mail from Thunderbird. M1 reports that the > certificate does not match. It's expecting a certificate for > mail.domain.com. Complaints when you're sending mail? This is not Dovecot's problem, but Postfix's. If you're setting your SMTP outgoing to M1, then the certificate M1 uses have M1 as a subject. If you're setting the outgoing mail server as "mail.domain.com" load balanced to M1/M2, then both your Postifx servers need to use the same certificate with "mail.domain.com" as a subject. Simple as that. Joseph Tam <jtam.home(a)gmail.com>

1 0

Dovecot, Load Balancing and SSL
by leon＠relay.gb.net 03 Apr '24

03 Apr '24

Hi Everyone! I wonder if someone would provide me with some advice. I've been setting up a couple of Postfix servers just for fun. I've got two Postfix servers m1.domain.com and m2.domain.com. I can send and receive mail via both of them. Ive also got Postfixadmin and RoundCube on them. I introduced a load balancer. Postfixadmin and Roundcube work perfectly. However. When I send mail from Thunderbird. M1 reports that the certificate does not match. It's expecting a certificate for mail.domain.com. On M1 I thought I would try to specify the location of the SSL when using mail.domain.com. I placed the certificate in the NAS and specified it in the 10-ssl file. I did this as per the docs. mail.domain.com local_name mail.domain.com { ssl_cert = </nas/ssl/fullchain.pem ssl_key = </nas/ssl/privkey.pem } It doesn't work. And I'm not entirely sure why M2 works and M1 doesn't. As far as I can see I haven't specified or placed a certificate for mail.domain.com on M2 and searching my bash history doesn't produce anything related to mail.domain.com. So how can I load balance email connections over my two servers without getting a damn certificate warning? Any help would be much appreciated. Thanks.

2 3

Any way to make a shared mailbox(not a shared folder)
by Maksim Rodin 02 Apr '24

02 Apr '24

Hello I wonder if there is a right way to make a shared mailbox? I do not mean "shared folder" but a whole mailbox. E.g. I have a mailbox info(a)company.com and I have a user mailbox user1(a)company.com. I would like that a user which can already authenticate as user1(a)company.com can setup another account in his Thunderbird as, say, user1@company.com\info@company.com or something like user1*info, enters his own password and can use the mailbox info(a)company.com as his second mailbox. It might be something similar to master user feature but I do not want the user1(a)company.com to have access to all the mailboxes on the dovecot imap server. -- Regards Maksim Rodin

4 6

Implications of LMTP socket being world readable and writable (0666) by default
by da-dovecotlist-15＠abelonline.de 31 Mar '24

31 Mar '24

I was surprised to find that the LMTP socket has permission mode 0666 by default and since configs are merged with defaults, there is no way to disable this AFAICS. # doveconf -d ... service lmtp { unix_listener lmtp { group = mode = 0666 user = } ... } Is this also how it is supposed to be used in production? I understand that LMTP is just for delivering new mails but is there really no need to restrict this further? To me it seems reasonable, to force all services on this machine to go through Postfix and not be able to just put e-mails in the users mailboxes via LMTP. Am I missing something? My use case is a "small" NixOS mail server with Postfix, Nextcloud a.o. installed on the same machine. No chroot jails because of NixOS.

3 4

Re: [Dovecot] [dovecot-2.1.15] mdbox corruption, doveadm force-resync can't repair it (throws segfault)
by Manish Prajapati 31 Mar '24

31 Mar '24

3 2

Separate index get dovecot lost
by Joan Moreau 30 Mar '24

30 Mar '24

Hi I have large number of email (~TB) and want to put the index in a separate, rapid drive Initially, I have mail_location = mdbox:/files/mail/%d/%n If I put mail_location = mdbox:/files/mail/%d/%n:INDEX=/data/mailindexes/%d/%n then dovecot gets totally lost and tries to reach mailboxes content and tree from the INDEX location instead of the original location What is wrong ? Thank you Hi I have large number of email (~TB) and want to put the index in a separate, rapid drive Initially, I have mail_location = mdbox:/files/mail/%d/%n If I put mail_location = mdbox:/files/mail/%d/%n:INDEX=/data/mailindexes/%d/%n then dovecot gets totally lost and tries to reach mailboxes content and tree from the INDEX location instead of the original location What is wrong ? Thank you

2 4

replication timeout
by Andy Balholm 28 Mar '24

28 Mar '24

I have two Dovecot mail servers that replicate to each other. Sometimes there are delays in the synchronization, and I notice that the mail log has entries like this: Error: dsync(spokane): I/O has stalled, no activity for 600 seconds (last sent=mailbox, last recv=mailbox_state) Five minutes seems like a long time to sit there waiting with nothing happening. Is there a way to reduce this timeout so that I don't have so many replicaton connections just sitting around doing nothing? (Of course, a way to prevent the I/O stalls would be great too, but with my limited upload bandwidth, they may be unavoidable.) Andy

2 9

panics
by mgrant＠grant.org 28 Mar '24

28 Mar '24

I am still getting panics. Today I'm seeing this panic only when 'eM Client' connects. Not other imap clients. It's almost as if there's a malformed message in my mailbox which might be causing this. I spent some time trying to do things like delete the last 20 messages or so but no luck. I tried to enable debugging in 10-logging but i get nothing at all in the log file /var/log/dovecot. Yes I've restarted dovecot. I'm running the version from here: https://repo.dovecot.org/ce-2.3-latest/debian/bullseye Any ideas?? Mar 26 19:23:14 strange dovecot: imap(mgrant)<2743779><EQ/3kpgUgvxRaQEP>: Panic: file istream-header-filter.c: line 663 (i_stream_header_filter_snapshot_free): assertion failed: (snapshot->mstream->snapshot_pending) Mar 26 19:23:14 strange dovecot: imap(mgrant)<2743779><EQ/3kpgUgvxRaQEP>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7f9d301ed482] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f9d301ed59e] -> /usr/lib/dovecot/libdovecot.so.0(+0x1041fb) [0x7f9d301fa1fb] -> /usr/lib/dovecot/libdovecot.so.0(+0x104291) [0x7f9d301fa291] -> /usr/lib/dovecot/libdovecot.so.0(+0x56670) [0x7f9d3014c670] -> /usr/lib/dovecot/libdovecot.so.0(+0x51ec5) [0x7f9d30147ec5] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_snapshot_free+0x18) [0x7f9d30205c68] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_unref+0x4c) [0x7f9d30205d0c] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header_deinit+0x15) [0x7f9d301d60e5] -> /usr/lib/dovecot/libdovecot.so.0(+0xe29b1) [0x7f9d301d89b1] -> /usr/lib/dovecot/libdovecot.so.0(message_parser_parse_next_block+0x45) [0x7f9d301d84d5] -> /usr/lib/dovecot/libdovecot.so.0(message_parser_parse_header+0x51) [0x7f9d301d8611] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_headers_internal+0x11a) [0x7f9d3039c8ca] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_headers+0x4c) [0x7f9d3039c9ec] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xd885a) [0x7f9d303a185a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xd8a89) [0x7f9d303a1a89] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_special+0x122) [0x7f9d303a1d92] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_special+0xa) [0x7f9d3031cfba] -> dovecot/imap(+0x26808) [0x55f5622cd808] -> dovecot/imap(+0x240a4) [0x55f5622cb0a4] -> dovecot/imap(imap_fetch_more+0x39) [0x55f5622cc4a9] -> dovecot/imap(cmd_fetch+0x39f) [0x55f5622bc8af] -> dovecot/imap(command_exec+0xa4) [0x55f5622c95b4] -> dovecot/imap(+0x2052f) [0x55f5622c752f] -> dovecot/imap(+0x205da) [0x55f5622c75da] -> dovecot/imap(+0x208ed) [0x55f5622c78ed] -> dovecot/imap(client_handle_input+0x1b5) [0x55f5622c7ab5] -> dovecot/imap(client_input+0x70) [0x55f5622c8020] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f9d30210429] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x132) [0x7f9d30211b12] Mar 26 19:23:14 strange dovecot: imap(mgrant)<2743779><EQ/3kpgUgvxRaQEP>: Fatal: master: service(imap): child 2743779 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps)

4 5

SAVEDATE is using ctime instead of btime for Maildir
by Alex 28 Mar '24

28 Mar '24

Dovecot supports SAVEDATE IMAP extension [1]. This is however not implemented correctly for Maildir storage. Compared to "internal date", "save date" is supposed to be the same but well-defined for APPEND and preserved when COPY command is used. However, for Maildir storage INTERNALDATE is implemented using mtime (modification timestamp) and SAVEDATE is implemented using ctime (status change timestamp) [2]. ctime is changed even more often than mtime. For example, chown or chmod operations on the message change its ctime, but preserve its mtime. Dovecot should instead use btime (creation timestamp) when it is available and not implement SAVEDATE at all if there is no btime. Just one example of the message in Maildir: stat 1708031310.M769290P3712350.nine,S=7898,W=8002:2,Sa File: 1708031310.M769290P3712350.nine,S=7898,W=8002:2,Sa Size: 7898 Blocks: 16 IO Block: 4096 regular file Device: 9,2 Inode: 7864351 Links: 1 Access: (0600/-rw-------) Uid: ( 999/ vmail) Gid: ( 996/ vmail) Access: 2024-02-16 08:34:04.374097798 +0100 Modify: 2024-02-15 22:08:30.769813368 +0100 Change: 2024-02-21 13:39:14.878163244 +0100 Birth: 2024-02-15 22:08:30.769813368 +0100 Its Birth date (btime) and Modify date (mtime) are the same, but Change date (ctime) was changed, likely by someone doing chown/chmod manually. You can read more in the issue [3] where we have problems with incorrect INTERNALDATE and investigated the possibility of using SAVEDATE, but found that it is not implemented correctly and is changed even more often than INTERNALDATE. According to the standard it should be the other way round, SAVEDATE should be more stable and survive COPY. [1] <https://www.rfc-editor.org/rfc/rfc8514.html> [2] <https://github.com/dovecot/core/blob/93eb0663336b17f66a67324de43e64bf0bc796…> [3] <https://github.com/deltachat/deltachat-core-rust/issues/5339>

2 1

Post-Auth external check?
by Stephan von Krawczynski 28 Mar '24

28 Mar '24

Hello all, is it possible to include some post-auth check in the password authentication? So after dovecot has found a user allowed to login to execute some external script for checking additional conditions which gives back simple true or false wether the login should be allowed? -- Regards, Stephan

3 2

Re: [Dovecot] Re: Using mbox INBOX with Maildirs?
by Will 26 Mar '24

26 Mar '24

Hi, This is my first time using this group and I have the same question as the subject. I can't seem to get dovecot to read a mbox inbox that is in /var/mail/%u with /home/%u/Maildir as maildir. This just worked on my old server that I am now upgrading to AlmaLinux release 9.3 with dovecot version 2.3.16 (7e2e900c1a). Please help, this upgrade is very painful. Guess I shouldn't have waited 20 years...

3 3

How can I override settings in a dovecot protocol section?
by Christian Rößner 25 Mar '24

25 Mar '24

Hi, I have defined a service and a protocol that shall honor quota, but in an non-enforcing mode (required). Therefr I have done this on a test-server: ``` protocols = lmtp lmtp_noenforcing imap pop3 service lmtp_noenforcing { executable = lmtp inet_listener lmtp_noenforcing { port = 24000 } protocol = lmtp_noenforcing } protocol lmtp_noenforcing { postmaster_address = postmaster@**** mail_plugins = quota sieve fts fts_solr # Just for testing, if this works. userdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext override_fields = quota=count:User quota:noenforcing skip = never result_success = continue result_failure = return-fail } # Just for testing, if this works. userdb { driver = lua args = file=/etc/dovecot/userdb.lua blocking=yes override_fields = quota=count:User quota:noenforcing result_success = return-ok result_failure = continue result_internalfail = continue } # Preferred plugin { quota = count:User quota:noenforcing } } ``` I tried with and without userdbs. With and without plugin{}. It seems that this whole section is never used. I removed "quota" from the mail_plugins parameter, but that seems to show me that the section is not used, because it always fails in a local swaks-test. The test shows that quota is exceeded. I would expect that the quota is ignored. One or the other hand. So why is the protocol not used for this service? We currently use Dovecot 2.3.20 from your repos. Kind regards and thanks in advance Christian Rößner -- Rößner-Network-Solutions Zertifizierter ITSiBe / CISO Karl-Bröger-Str. 10, 36304 Alsfeld Fax: +49 6631 78823409, Mobil: +49 171 9905345 USt-IdNr.: DE225643613, https://roessner.website PGP fingerprint: 658D 1342 B762 F484 2DDF 1E88 38A5 4346 D727 94E5

1 1

virtual user list in a passwd file (without linux user)
by paul＠virtuadv.com 23 Mar '24

23 Mar '24

Hi, I am trying to have a virtual user list in a passwd file (without linux user) but it does not seem to work. I have been trying to make this work for days reading the dovecot documentation and whatever I could find online... Note that I did not enable imap since I only use pop3s to retrieve my emails. I also tried to follow this guide: https://doc.dovecot.org/configuration_manual/howto/simple_virtual_install/ Note that once this works for dovecot, I plan to have postfix use the dovecot auth service to authenticate the virtual users and validate mail boxes. # cat /proc/version Linux version 6.1.0-17-cloud-amd64 (debian-kernel(a)lists.debian.org) (gcc-12 (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC Debian 6.1.69-1 (2023-12-30) # dovecot version Feb 15 15:57:26 master: Info: Dovecot v2.3.19.1 (9b53102964) starting up for pop3, submission, lmtp # doveconf -n # 2.3.19.1 (9b53102964): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.19 (4eae2f79) # OS: Linux 6.1.0-17-cloud-amd64 x86_64 Debian 12.5 # Hostname: 85e10e78339f auth_verbose = yes debug_log_path = /dev/stdout first_valid_uid = 1000 info_log_path = /dev/stdout last_valid_uid = 1000 listen = * log_path = /dev/stdout login_greeting = greeting. mail_debug = yes mail_gid = 1000 mail_home = /srv/vmail/%d/%n mail_location = maildir:~/mail mail_uid = 1000 namespace { inbox = yes location = prefix = separator = / } passdb { args = username_format=%u /path/to/passwd driver = passwd-file } pop3_uidl_format = %g protocols = pop3 submission lmtp service auth { inet_listener { address = <ip> port = 12345 } user = vmail } service lmtp { inet_listener lmtp { address = <ip> port = 12344 } user = vmail } service pop3-login { client_limit = 1000 process_min_avail = 1 service_count = 0 } service submission-login { client_limit = 1000 process_min_avail = 1 service_count = 0 } ssl_cert = <cert.pem ssl_key = # hidden, use -P to show it userdb { args = username_format=%u /path/to/passwd default_fields = uid=vmail gid=vmail home=/srv/vmail/%d/%n driver = passwd-file } verbose_proctitle = yes local_name site1.com { ssl_cert = </etc/apache2/md-ssl/domains/site1.com/pubcert.pem ssl_key = # hidden, use -P to show it } local_name www.site1.com { ssl_cert = </etc/apache2/md-ssl/domains/site1.com/pubcert.pem ssl_key = # hidden, use -P to show it } The passwd file: # user:password:uid:gid:(gecos):home:(shell):extra_fields user1(a)site1.com{PLAIN}password1:::::: user2(a)site2.com{PLAIN}password2:::::: This is the log I am getting when trying to create an account with Thunderbird: Feb 15 15:57:26 master: Info: Dovecot v2.3.19.1 (9b53102964) starting up for pop3, submission, lmtp Feb 15 17:34:45 pop3-login: Info: Disconnected: Aborted login by logging out (no auth attempts in 0 secs): user=<>, rip=<ip>, lip=<ip>, TLS, session=<cMIeC28RVOImVwz3> Feb 15 17:35:02 auth: Info: passwd-file(user1(a)site1.com,<ip>,<AIAjDG8RVuImVwz3>): unknown user Feb 15 17:35:08 auth: Info: passwd-file(user1(a)site1.com,<ip>,<AIAjDG8RVuImVwz3>): unknown user Feb 15 17:35:10 pop3-login: Info: Disconnected: Aborted login by logging out (auth failed, 2 attempts in 8 secs): user=<user1(a)site1.com>, method=PLAIN, rip=<ip>, lip=<ip>, TLS, session=<AIAjDG8RVuImVwz3> I tried using doveadm: # doveadm user user1 userdb lookup: user user1 doesn't exist field value # doveadm user user1(a)site1.com userdb lookup: user user1(a)site1.com doesn't exist field value I also tried with the verbose on (removed all the 'usually intentional'): # doveadm -Dv user user1(a)site1.com Feb 15 17:38:17 doveadm(user1(a)site1.com)<137><>: Debug: auth-master: userdb lookup(user1(a)site1.com): Started userdb lookup Feb 15 17:38:17 doveadm(user1(a)site1.com)<137><>: Debug: auth-master: conn unix:/run/dovecot/auth-userdb: Connecting Feb 15 17:38:17 doveadm(user1(a)site1.com)<137><>: Debug: auth-master: conn unix:/run/dovecot/auth-userdb (pid=7,uid=0): Client connected (fd=9) Feb 15 17:38:17 doveadm(user1(a)site1.com)<137><>: Debug: auth-master: userdb lookup(user1(a)site1.com): auth USER input: Feb 15 17:38:17 doveadm(user1(a)site1.com)<137><>: Debug: auth-master: userdb lookup(user1(a)site1.com): Userdb lookup failed userdb lookup: user user1(a)site1.com doesn't exist Feb 15 17:38:17 Debug: auth-master: conn unix:/run/dovecot/auth-userdb (pid=7,uid=0): Disconnected: Connection closed (fd=9) field value I could not find a way to list either the mailboxes or virtual user list that dovecot is using/serving.

4 17

Debug on FreeBSD: tries to open linux style /proc
by Larry Rosenman 23 Mar '24

23 Mar '24

Aki, Can you comment on this FreeBSD bug I got? https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=274540 Either here on in the bugzilla bug. Thanks! -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106 Aki, Can you comment on this FreeBSD bug I got? https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=274540 Either here on in the bugzilla bug. Thanks! -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106

1 0

Thousands of dovecot/dict processes
by Alex 21 Mar '24

21 Mar '24

Hi, I have a fedora38 system with dovecot-2.3.21 for a few hundred users and just noticed there are 4000 dovecot/dict processes running: 2203938 ? S 0:15 dovecot/dict or sleeping, as the case may be. Some time ago I installed the last_login_dict plugin to record login details per user. Here is my config: plugin { last_login_dict = proxy::sql last_login_key = last-login/%{service}/%{user}/%{remote_ip} last_login_precision = ms } dict { sql = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } There are about 1100 total entries in the last_login table, most of which are localhost for webmail. Is this all to be expected? I don't know how much in terms of resources these 4000 processes are utilizing, and although the system is virtually idle, it does appear to be going into swap. # free -h total used free shared buff/cache available Mem: 62Gi 9.3Gi 2.5Gi 13Mi 51Gi 52Gi Swap: 15Gi 4.4Gi 11Gi Any ideas greatly appreciated. Thanks, Alex Hi, I have a fedora38 system with dovecot-2.3.21 for a few hundred users and just noticed there are 4000 dovecot/dict processes running: 2203938 ? S 0:15 dovecot/dict or sleeping, as the case may be. Some time ago I installed the last_login_dict plugin to record login details per user. Here is my config: plugin { last_login_dict = proxy::sql last_login_key = last-login/%{service}/%{user}/%{remote_ip} last_login_precision = ms } dict { sql = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } There are about 1100 total entries in the last_login table, most of which are localhost for webmail. Is this all to be expected? I don't know how much in terms of resources these 4000 processes are utilizing, and although the system is virtually idle, it does appear to be going into swap. # free -h total used free shared buff/cache available Mem: 62Gi 9.3Gi 2.5Gi 13Mi 51Gi 52Gi Swap: 15Gi 4.4Gi 11Gi Any ideas greatly appreciated. Thanks, Alex

1 0

Disable sieve redirect filters?
by jarland＠mxroute.com 21 Mar '24

21 Mar '24

Right now we're using Dovecot for sieve filters. Good old fairly standard config: https://mxbin.io/N6hDUi I'm hoping someone has an idea, but I think I'm probably on my own here. The problem is that this is the best solution to preventing people from spoofing external senders when creating redirects to external recipients: sieve_redirect_envelope_from = recipient But also, as great as this is, it kind of sucks because users continually insist on receiving spam and phishing emails. When a user sends a phishing email, I step in to make sure our network isn't being abused. That's how we do what we do for high quality inbox delivery, we police the hell out of our network. So my problem is I end up with all of these users that I need to review every day, only to find out they just created a redirect filter and "redirected" a phishing email. So my long winded question is, how can I disable redirect filters? I don't want users to be able to create them. But I want them to have access to the rest of the functions of the sieve filtering. Is this possible, or would this need to be an entirely new function contributed to the project's code?

2 1