- dovecot - dovecot.org

Invalid/Unmapped Key with Last Login Plugin
by Adam Miller 18 Jul '24

18 Jul '24

OS: Ubuntu 22.04.1 Dovecot: 2.3.16 (7e2e900c1a) Hello all! I have the last login plugin working with the IMAP service however with LMTP, it errors. I do not necessarily need / want the LMTP service and did not explicitly enable it but it is throwing an error in my logs. Jul 17 10:22:14 lmtp(184051):Error: last_login_dict: Failed to write value: dict-server returned failure: sql dict set: Invalid/unmapped key:shared/last-login/lmtp/username@domain.com/ (reply took 0.234 secs (0.001 in dict wait, 0.033 in other ioloops, 0.030 in locks, as ync-id reply 0.000 secs ago, started on dict-server 0.220 secs ago, took 0.000 secs)) It would be nice to get rid of this error one or another: either disable last login for LMTP or get it working. Current Configuration from doveconf -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 6.5.0-1020-aws x86_64 Ubuntu 22.04.4 LTS nfs4 # Hostname: ec2-us-east-1a-arda-mail-001.ardaemail.com auth_mechanisms = plain login auth_worker_max_count = 5 base_dir = /var/run/dovecot debug_log_path = /var/log/dovecot/debug.log default_internal_group = ardaemail default_internal_user = ardaemail dict { quota = mysql:/etc/dovecot/inc.d/inc.quota.user.sql.conf sql = mysql:/etc/dovecot/inc.d/inc.lastlogin.sql.conf } hostname = = mail.ardaemail.com info_log_path = /var/log/dovecot/info.log instance_name = ec2-us-east-1a-arda-mail-001.ardaemail.com listen = 172.16.0.200 log_path = /var/log/dovecot/general.log login_greeting = Welcome to ArdaEmail mail_gid = ardaemail mail_location = maildir:/mnt/mail/%d/%n mail_max_userip_connections = 1000 mail_plugins = " quota mailbox_alias last_login" mail_server_admin = mailto:support@ardaemail.com mail_uid = ardaemail maildir_stat_dirs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 90 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = } passdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } plugin { imapsieve_mailbox1_before = file:/etc/dovecot/sieve.d/spam/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve.d/spam/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * last_login_dict = proxy::sql last_login_key = # hidden, use -P to show it last_login_precision = ms mailbox_alias_new = Junk Email mailbox_alias_new2 = Junk E-mail mailbox_alias_new3 = Sent Messages mailbox_alias_new4 = Sent Items mailbox_alias_new5 = Deleted Items mailbox_alias_new6 = Junk Mail mailbox_alias_old = Junk mailbox_alias_old2 = Junk mailbox_alias_old3 = Sent mailbox_alias_old4 = Sent mailbox_alias_old5 = Trash mailbox_alias_old6 = Junk quota = dict:User Quota::proxy::quota quota_exceeded_message = Mailbox is full and cannot receive any more emails quota_status_nouser = DUNNO quota_status_success = DUNNO quota_warning = bytes=95%% quota-warning 95 %u quota_warning2 = bytes=85%% quota-warning 85 %u quota_warning3 = bytes=75%% quota-warning 75 %u recipient_delimiter = + sieve_after = /etc/dovecot/sieve.d/after/ sieve_before = /etc/dovecot/sieve.d/before/ sieve_extensions = +spamtest +spamtestplus +virustest +notify +imapflags sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_quota_max_storage = 0 sieve_spamtest_max_header = X-Spamd-Result: -?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]) sieve_spamtest_status_header = X-Spamd-Result: (-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]] sieve_spamtest_status_type = score } postmaster_address = postmaster(a)ardaemail.com protocols = imap lmtp service auth-worker { group = ardaemail user = ardaemail } service auth { group = ardaemail unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = ardaemail mode = 0666 user = ardaemail } user = ardaemail } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 8 service_count = 0 } service imap { vsz_limit = 4 G } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } service quota-status { executable = /usr/lib/dovecot/quota-status -p postfix unix_listener /var/spool/postfix/private/quota-status { user = postfix } } service quota-warning { executable = script /etc/dovecot/bin/quota-warning.sh unix_listener quota-warning { group = ardaemail mode = 0666 user = ardaemail } } service submission-login { inet_listener submission { port = 0 } } ssl = required ssl_cert = </etc/letsencrypt/live/mail.ardaemail.com/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } protocol imap { mail_plugins = " quota mailbox_alias last_login imap_sieve imap_quota last_login" } protocol lmtp { mail_plugins = " quota mailbox_alias last_login sieve" } In the configuration above, I do not have "last_login" in my actual config for "protocol lmtp", something is adding it. Any help is appreciated. Thank you!

3 7

Missing IMAP METADATA Plugin
by Adam Miller 18 Jul '24

18 Jul '24

OS: Ubuntu 22.04.1 Dovecot: 2.3.16 (7e2e900c1a) When trying to enable the “imap_metadata” plugin, I get the following error: Plugin 'imap_metadata' not found from directory /usr/lib/dovecot/modules I have searched high and low via Google, StackOverflow and even ChatGPT (haha) but I cannot seem to find the package that provides the plugin. Does Dovecot have to be built from source for this plugin to be included? Current Configuration from doveconf -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 6.5.0-1020-aws x86_64 Ubuntu 22.04.4 LTS nfs4 # Hostname: ec2-us-east-1a-arda-mail-001.ardaemail.com auth_mechanisms = plain login auth_worker_max_count = 5 base_dir = /var/run/dovecot debug_log_path = /var/log/dovecot/debug.log default_internal_group = ardaemail default_internal_user = ardaemail dict { quota = mysql:/etc/dovecot/inc.d/inc.quota.user.sql.conf sql = mysql:/etc/dovecot/inc.d/inc.lastlogin.sql.conf } hostname = = mail.ardaemail.com info_log_path = /var/log/dovecot/info.log instance_name = ec2-us-east-1a-arda-mail-001.ardaemail.com listen = 172.16.0.200 log_path = /var/log/dovecot/general.log login_greeting = Welcome to ArdaEmail mail_gid = ardaemail mail_location = maildir:/mnt/mail/%d/%n mail_max_userip_connections = 1000 mail_plugins = " quota mailbox_alias last_login" mail_server_admin = mailto:support@ardaemail.com mail_uid = ardaemail maildir_stat_dirs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 90 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = } passdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } plugin { imapsieve_mailbox1_before = file:/etc/dovecot/sieve.d/spam/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve.d/spam/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * last_login_dict = proxy::sql last_login_key = # hidden, use -P to show it last_login_precision = ms mailbox_alias_new = Junk Email mailbox_alias_new2 = Junk E-mail mailbox_alias_new3 = Sent Messages mailbox_alias_new4 = Sent Items mailbox_alias_new5 = Deleted Items mailbox_alias_new6 = Junk Mail mailbox_alias_old = Junk mailbox_alias_old2 = Junk mailbox_alias_old3 = Sent mailbox_alias_old4 = Sent mailbox_alias_old5 = Trash mailbox_alias_old6 = Junk quota = dict:User Quota::proxy::quota quota_exceeded_message = Mailbox is full and cannot receive any more emails quota_status_nouser = DUNNO quota_status_success = DUNNO quota_warning = bytes=95%% quota-warning 95 %u quota_warning2 = bytes=85%% quota-warning 85 %u quota_warning3 = bytes=75%% quota-warning 75 %u recipient_delimiter = + sieve_after = /etc/dovecot/sieve.d/after/ sieve_before = /etc/dovecot/sieve.d/before/ sieve_extensions = +spamtest +spamtestplus +virustest +notify +imapflags sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_quota_max_storage = 0 sieve_spamtest_max_header = X-Spamd-Result: -?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]) sieve_spamtest_status_header = X-Spamd-Result: (-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]] sieve_spamtest_status_type = score } postmaster_address = postmaster(a)ardaemail.com protocols = imap lmtp service auth-worker { group = ardaemail user = ardaemail } service auth { group = ardaemail unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = ardaemail mode = 0666 user = ardaemail } user = ardaemail } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 8 service_count = 0 } service imap { vsz_limit = 4 G } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } service quota-status { executable = /usr/lib/dovecot/quota-status -p postfix unix_listener /var/spool/postfix/private/quota-status { user = postfix } } service quota-warning { executable = script /etc/dovecot/bin/quota-warning.sh unix_listener quota-warning { group = ardaemail mode = 0666 user = ardaemail } } service submission-login { inet_listener submission { port = 0 } } ssl = required ssl_cert = </etc/letsencrypt/live/mail.ardaemail.com/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } protocol imap { mail_plugins = " quota mailbox_alias last_login imap_sieve imap_quota last_login" } protocol lmtp { mail_plugins = " quota mailbox_alias last_login sieve" } Any help is appreciated. Thank you!

3 3

"panic ... assertion failed" with virtual and flatcurve fts together
by James Cook 17 Jul '24

17 Jul '24

Hi, I'm getting the following error: $ doveadm fetch 'mailbox storageid' guid '1721115116.M995635P1988.exoco.falsifian.org,S=28763,W=29300' Error: net_connect_unix(/var/dovecot/stats-writer) failed: Permission denied doveadm(falsifian): Panic: file index-search-result.c: line 174 (index_search_result_update_appends): assertion failed: (result->search_args->args == &search_arg) When I remove "virtual" from my "plugins" configuration line and remove the virtual namespace, the search works: $ doveadm fetch 'mailbox storageid' guid '1721115116.M995635P1988.exoco.falsifian.org,S=28763,W=29300' Error: net_connect_unix(/var/dovecot/stats-writer) failed: Permission denied mailbox: Spam storageid: 1721115116.M995635P1988.exoco.falsifian.org,S=28763,W=29300 It also works if I remove fts and fts_flatcurve from my "plugins" configuration line, leaving "virtual" alone. I first saw this when I enabled fts (with fts_flatcurve): I saw a lot of such errors in the logs when I attempted full text searches via neomutt. The errors seemed to stop happening after the indexing jobs finally finished, but just today I saw it again with the above query unrelated to fts. I have been using virtual mailboxes for a long time and hadn't noticed the error before trying fts. $ dovecot --version 2.3.21 (47349e2482) Output of doveconf -n (full config that triggers the error) follows signature. I saw something similar was reported in January [0] (that gave me the idea to try turning off virtual). Please let me know what I can do to help debug. It's just my personal mail server so I might be able to do things like run a debug build if necessary (assuming I find the time). [0] https://dovecot.org/mailman3/archives/list/dovecot@dovecot.org/thread/Z2HTM… -- James # 2.3.21 (47349e2482): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.21 (f6cd4b8e) # OS: OpenBSD 7.5 amd64 ffs # Hostname: exoco.falsifian.org first_valid_uid = 1000 mail_location = maildir:/home/%u/Maildir mail_plugins = " fts fts_flatcurve virtual" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } namespace virtual { location = virtual:/mail/%u/virtual prefix = virtual/ separator = / } passdb { args = /etc/dovecot/passdb driver = passwd-file } plugin { fts = flatcurve fts_filters = lowercase fts_flatcurve_substring_search = yes fts_languages = en fts_tokenizers = generic email-address } protocols = imap ssl_cert = </etc/ssl/falsifian.org.fullchain.pem ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/userdb driver = passwd-file } protocol lda { mail_plugins = " fts fts_flatcurve virtual sieve sieve" }

1 0

Debian Bookworm packages, please !
by Laura Smith 16 Jul '24

16 Jul '24

Debian Bookworm (12) was released June 2023. It is therefore somewhat disappointing to see no Bookworm packages in https://repo.dovecot.org/ce-2.3-latest/debian/

16 37

dictionary with %d variable in sql stops insert and select domain part - dovecot 2.3.17+
by Mariusz Piasecki 16 Jul '24

16 Jul '24

Hi, I notice that quota domain when using args %d in dictionary isn't honored in mysql during updates and selects when using dovecot 2.3.17+, so I moved my tests to docker environment, because I started using alpine linux and thought it could be musl library problem. I tested few versions with debian/alpine and after 2.3.17 updates and selects for domain in sql not using domain part, but user@domain. Maybe I missed some changes in configuration, maybe someone experience this behavior? User in logs was changed to h.user(a)example.com. Configuration as described in documentation quota = dict:<quota root name>:<username>[:<option>[...]]:<dictionary URI> where username could be %d for supporting domain-wide quotas quota = dict:user_quota::proxy::sqluserquota quota2 = dict:domain_quota:%d:proxy::sqldomainquota dict { acl = mysql:/etc/dovecot/dovecot-share-folder.conf sqldomainquota = mysql:/etc/dovecot/dovecot-dict-sql-domain.conf sqluserquota = mysql:/etc/dovecot/dovecot-dict-sql-user.conf } dovecot-dict-sql-domain.conf map { pattern= priv/quota/storage table= used_domain_quota username_field= domain value_field= bytes } map { pattern= priv/quota/messages table= used_domain_quota username_field= domain value_field= messages } dovecot-dict-sql-user.conf map { pattern= priv/quota/storage table= used_quota username_field= username value_field= bytes } map { pattern= priv/quota/messages table= used_quota username_field= username value_field= messages } Example dump sql table, in real environment with newer dovecot, there was only h.user(a)example.com and no domain record. *In earlier versions of dovecot there was only domain in this table.* |//**domain**//|varchar(255)|Nie| |bytes|bigint(20)|Nie|0 |messages|bigint(20)|Nie|0 == Dumping data for table used_domain_quota |h.user(a)example.com|36000|36000 |example.com|35000|35000 Debug Doveadm *In both examples below debug args=example.com seems correct * Dovecot version 2.3.17+, in this example debian 10 2.3.17 (e2aa53df5b), select with only username. root@cf801690360c:/# doveadm -D -v quota get -u h.user(a)example.com Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Nov 27 15:46:31 Debug: Loading modules from directory: /usr/lib/dovecot/modules Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mailbox_alias_plugin.so Nov 27 15:46:31 Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so Nov 27 15:46:31 Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Nov 27 15:46:31 Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Nov 27 15:46:31 Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: userdb lookup(h.user(a)example.com): Started userdb lookup Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: conn unix:/var/run/dovecot/director-userdb: Connecting Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: conn unix:/var/run/dovecot/director-userdb (pid=1,uid=0): Client connected (fd=9) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: userdb lookup(h.user(a)example.com): auth USER input: h.user(a)example.com home=/home/mail/virtual/data05/example.com/h.user@example.com quota2_rule=*:bytes=10485760000 quota_rule=*:bytes=1048576000 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: userdb lookup(h.user(a)example.com): Finished userdb lookup (username=h.user(a)example.com home=/home/mail/virtual/data05/example.com/h.user@example.com quota2_rule=*:bytes=10485760000 quota_rule=*:bytes=1048576000) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: Added userdb setting: plugin/quota2_rule=*:bytes=10485760000 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=1048576000 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Effective uid=101, gid=101, home=/home/mail/virtual/data05/example.com/h.user@example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Home dir not found: /home/mail/virtual/data05/example.com/h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: dict(proxy): dict created (uri=proxy::acl, base_dir=/var/run/dovecot) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota root: name=User Quota backend=dict args=:proxy::sqluserquota Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota rule: root=User Quota mailbox=* bytes=1048576000 messages=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=1048576000 (100%) messages=0 reverse=no command=quota-warning 100 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=996147200 (95%) messages=0 reverse=no command=quota-warning 95 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=943718400 (90%) messages=0 reverse=no command=quota-warning 90 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=891289600 (85%) messages=0 reverse=no command=quota-warning 85 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota grace: root=User Quota bytes=104857600 (10%) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota root: name=Domain Quota backend=dict args=example.com:proxy::sqldomainquota Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota rule: root=Domain Quota mailbox=* bytes=10485760000 messages=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota grace: root=Domain Quota bytes=1048576000 (10%) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota-dict: user=h.user(a)example.com, uri=proxy::sqluserquota, noenforcing=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: dict(proxy): dict created (uri=proxy::sqluserquota, base_dir=/var/run/dovecot) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota-dict: user=example.com, uri=proxy::sqldomainquota, noenforcing=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: dict(proxy): dict created (uri=proxy::sqldomainquota, base_dir=/var/run/dovecot) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir://home/mail/virtual/data05/example.com/h.user@example.com/… Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: maildir++: root=//home/mail/virtual/data05/example.com/h.user@example.com/Maildir, index=, indexpvt=, control=, inbox=//home/mail/virtual/data05/example.com/h.user@example.com/Maildir, alt= Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: initializing backend with data: vfile Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: acl username= h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: owner= 1 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl vfile: Global ACLs disabled Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:%Lh/Maildir/:INDEX=%Lh/Maildir/Shared/%u Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: initializing backend with data: vfile Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: acl username= h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: owner= 0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl vfile: Global ACLs disabled Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota: quota_over_flag check: quota_over_script unset - skipping Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota: quota_over_flag check: quota2_over_script unset - skipping Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/var/run/dovecot/dict: Connecting Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/var/run/dovecot/dict (pid=1,uid=0): Client connected (fd=10) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/var/run/dovecot/dict: Connecting Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/var/run/dovecot/dict (pid=1,uid=0): Client connected (fd=12) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): dict destroyed Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Waiting for dict to finish pending operations Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/var/run/dovecot/dict (pid=1,uid=0): Disconnected: Connection closed (fd=10) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): dict destroyed Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Waiting for dict to finish pending operations Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/var/run/dovecot/dict (pid=1,uid=0): Disconnected: Connection closed (fd=12) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): dict destroyed Quota name Type Value Limit % User Quota STORAGE 25 1024000 0 User Quota MESSAGE 25000 - 0 Domain Quota STORAGE 36 10240000 0 Domain Quota MESSAGE 36000 - 0 Nov 27 15:46:31 doveadm(401): Debug: auth-master: conn unix:/var/run/dovecot/director-userdb (pid=1,uid=0): Disconnected: Connection closed (fd=9) Dovecot version 2.3.16, 2.3.15, 2.3.13. in this example 2.3.13 (89f716dc2) bullseye - *correct behavior, select* Debug: Loading modules from directory: /usr/lib/dovecot/modules Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mailbox_alias_plugin.so Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(h.gorska(a)example.com)<93><>: Debug: auth-master: userdb lookup(h.user(a)example.com): Started userdb lookup doveadm(h.user(a)example.com)<93><>: Debug: auth-master: conn unix:/run/dovecot/director-userdb: Connecting doveadm(h.user(a)example.com)<93><>: Debug: auth-master: conn unix:/run/dovecot/director-userdb (pid=1,uid=0): Client connected (fd=9) doveadm(h.user(a)example.com)<93><>: Debug: auth-master: userdb lookup(h.user(a)example.com): auth USER input: h.user(a)example.com home=/home/mail/virtual/data05/example.com/h.user@example.com quota2_rule=*:bytes=10485760000 quota_rule=*:bytes=1048576000 doveadm(h.user(a)example.com)<93><>: Debug: auth-master: userdb lookup(h.user(a)example.com): Finished userdb lookup (username=h.user(a)example.com home=/home/mail/virtual/data05/example.com/h.user@example.com quota2_rule=*:bytes=10485760000 quota_rule=*:bytes=1048576000) doveadm(h.user(a)example.com)<93><>: Debug: Added userdb setting: plugin/quota2_rule=*:bytes=10485760000 doveadm(h.user(a)example.com)<93><>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=1048576000 doveadm(h.user(a)example.com): Debug: Effective uid=101, gid=102, home=/home/mail/virtual/data05/example.com/h.user@example.com doveadm(h.user(a)example.com): Debug: Home dir not found: /home/mail/virtual/data05/example.com/h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota root: name=User Quota backend=dict args=:proxy::sqluserquota doveadm(h.user(a)example.com): Debug: Quota rule: root=User Quota mailbox=* bytes=1048576000 messages=0 doveadm(h.user(a)example.com): Debug: Quota warning: bytes=1048576000 (100%) messages=0 reverse=no command=quota-warning 100 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota warning: bytes=996147200 (95%) messages=0 reverse=no command=quota-warning 95 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota warning: bytes=943718400 (90%) messages=0 reverse=no command=quota-warning 90 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota warning: bytes=891289600 (85%) messages=0 reverse=no command=quota-warning 85 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota grace: root=User Quota bytes=104857600 (10%) doveadm(h.user(a)example.com): Debug: Quota root: name=Domain Quota backend=dict args=example.com:proxy::sqldomainquota doveadm(h.user(a)example.com): Debug: Quota rule: root=Domain Quota mailbox=* bytes=10485760000 messages=0 doveadm(h.user(a)example.com): Debug: Quota grace: root=Domain Quota bytes=1048576000 (10%) doveadm(h.user(a)example.com): Debug: quota-dict: user=h.user(a)example.com, uri=proxy::sqluserquota, noenforcing=0 doveadm(h.user(a)example.com): Debug: quota-dict: user=example.com, uri=proxy::sqldomainquota, noenforcing=0 doveadm(h.user(a)example.com): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir://home/mail/virtual/data05/example.com/h.user@example.com/… doveadm(h.user(a)example.com): Debug: maildir++: root=//home/mail/virtual/data05/example.com/h.user@example.com/Maildir, index=, indexpvt=, control=, inbox=//home/mail/virtual/data05/example.com/h.user@example.com/Maildir, alt= doveadm(h.user(a)example.com): Debug: acl: initiali|//**domain**//|varchar(255)|Nie| |bytes|bigint(20)|Nie|0 |messages|bigint(20)|Nie|0 == Dumping data for table used_domain_quota |h.user(a)example.com|36000|36000 |example.com|35000|35000zing backend with data: vfile doveadm(h.user(a)example.com): Debug: acl: acl username= h.user(a)example.com doveadm(h.user(a)example.com): Debug: acl: owner= 1 doveadm(h.user(a)example.com): Debug: acl vfile: Global ACLs disabled doveadm(h.user(a)example.com): Debug: Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:%Lh/Maildir/:INDEX=%Lh/Maildir/Shared/%u doveadm(h.user(a)example.com): Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= doveadm(h.user(a)example.com): Debug: acl: initializing backend with data: vfile doveadm(h.user(a)example.com): Debug: acl: acl username= h.user(a)example.com doveadm(h.user(a)example.com): Debug: acl: owner= 0 doveadm(h.user(a)example.com): Debug: acl vfile: Global ACLs disabled doveadm(h.user(a)example.com): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(h.user(a)example.com): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping Quota name Type Value Limit % User Quota STORAGE 25 1024000 0 User Quota MESSAGE 25000 - 0 Domain Quota STORAGE 35 10240000 0 Domain Quota MESSAGE 35000 - 0 doveadm(h.user(a)example.com): Debug: auth-master: conn unix:/run/dovecot/director-userdb (pid=1,uid=0): Disconnected: Connection closed (fd=9) MYSQL catch logs Mysql catch log during doveadm quota get -u h.user(a)example.com, version 2.3.17+ 592 Query SELECT username AS user, CONCAT('/home/mail/virtual/',mailbox.storagenode,mailbox.maildir,username) AS home, CONCAT('*:bytes=', domain.maxquota*1048576) AS quota2_rule, CONCAT('*:bytes=', mailbox.quota*1048576) AS quota_rule FROM mailbox,domain WHERE username = 'h.user(a)example.com'AND mailbox.domain=domain.domain AND domain.active=1 AND mailbox.`enabledoveadm`=1 AND mailbox.active=1 593 Connect root(a)10.15.1.40 on postfix using TCP/IP 593 Query SELECT bytes FROM used_quota WHERE username = 'h.user(a)example.com' 593 Query SELECT messages FROM used_quota WHERE username = 'h.user(a)example.com' 594 Connect root(a)10.15.1.40 on postfix using TCP/IP 594 Query SELECT bytes FROM used_domain_quota WHERE domain = 'h.user(a)example.com' 594 Query SELECT messages FROM used_domain_quota WHERE domain = 'h.user(a)example.com' example SQL UPDATE, dovecot version 2.3.20 (80a5ac675d) alpine 3.18.4 - bad behavior # User@Host: user[user @ [192.168.254.176] # Thread_id: 58405753 Schema: postfix QC_hit: No # Query_time: 0.000294 Lock_time: 0.000104 Rows_sent: 0 Rows_examined: 1 # Rows_affected: 1 Bytes_sent: 52 # # explain: id select_type table type possible_keys key key_len ref rows r_rows filtered r_filtered Extra # explain: 1 SIMPLE used_domain_quota range PRIMARY PRIMARY 767 NULL 1 1.00 100.00 100.00 Using where # SET timestamp=1701103297; UPDATE used_domain_quota SET bytes=bytes+4359,messages=messages+1 WHERE domain = 'h.user(a)example.com'; example SQL UPDATE domain and user quota - *good behavior*, dovecot version 2.3.4.1 (f79e8e7e4), debian 10 # User@Host: postfix[postfix] @ [192.168.254.175] # Thread_id: 58406279 Schema: postfix QC_hit: No # Query_time: 0.000252 Lock_time: 0.000080 Rows_sent: 0 Rows_examined: 1 # Rows_affected: 1 Bytes_sent: 52 # # explain: id select_type table type possible_keys key key_len ref rows r_rows filtered r_filtered Extra # explain: 1 SIMPLE used_domain_quota range PRIMARY PRIMARY 767 NULL 1 1.00 100.00 100.00 Using where # SET timestamp=1701103048; UPDATE used_domain_quota SET bytes=bytes+11597,messages=messages+1 WHERE domain = 'example.com'; # User@Host: user[user] @ [192.168.254.175] # Thread_id: 58406274 Schema: postfix QC_hit: No # Query_time: 0.000247 Lock_time: 0.000076 Rows_sent: 0 Rows_examined: 1 # Rows_affected: 1 Bytes_sent: 52 # # explain: id select_type table type possible_keys key key_len ref rows r_rows filtered r_filtered Extra # explain: 1 SIMPLE used_quota range PRIMARY PRIMARY 767 NULL 1 1.00 100.00 100.00 Using where # SET timestamp=1701103048; UPDATE used_quota SET bytes=bytes+11597,messages=messages+1 WHERE username = 'h.user(a)example.com'; Hi, I notice that quota domain when using args %d in dictionary isn't honored in mysql during updates and selects when using dovecot 2.3.17+, so I moved my tests to docker environment, because I started using alpine linux and thought it could be musl library problem. I tested few versions with debian/alpine and after 2.3.17 updates and selects for domain in sql not using domain part, but user@domain. Maybe I missed some changes in configuration, maybe someone experience this behavior? User in logs was changed to h.user(a)example.com. ***** Configuration ***** as described in documentation quota = dict:<quota root name>:<username>[: <option>[...]]:<dictionary URI> where username could be %d for supporting domain-wide quotas quota = dict:user_quota::proxy::sqluserquota quota2 = dict:domain_quota:%d:proxy::sqldomainquota dict { acl = mysql:/etc/dovecot/dovecot-share-folder.conf sqldomainquota = mysql:/etc/dovecot/dovecot-dict-sql-domain.conf sqluserquota = mysql:/etc/dovecot/dovecot-dict-sql-user.conf } dovecot-dict-sql-domain.conf map { pattern = priv/quota/storage table = used_domain_quota username_field = domain value_field = bytes } map { pattern = priv/quota/messages table = used_domain_quota username_field = domain value_field = messages } dovecot-dict-sql-user.conf map { pattern = priv/quota/storage table = used_quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = used_quota username_field = username value_field = messages } Example dump sql table, in real environment with newer dovecot, there was only h.user(a)example.com and no domain record. In earlier versions of dovecot there was only domain in this table. |//**domain**//|varchar(255)|Nie| |bytes|bigint(20)|Nie|0 |messages|bigint(20)|Nie|0 == Dumping data for table used_domain_quota |h.user(a)example.com|36000|36000 |example.com|35000|35000 ***** Debug ***** **** Doveadm **** In both examples below debug args=example.com seems correct Dovecot version 2.3.17+, in this example debian 10 2.3.17 (e2aa53df5b), select with only username. root@cf801690360c:/# doveadm -D -v quota get -u h.user(a)example.com Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/ dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/ dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: / usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/ dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: / usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Nov 27 15:46:31 Debug: Loading modules from directory: /usr/lib/dovecot/modules Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/ lib01_acl_plugin.so Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/ lib10_quota_plugin.so Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/ lib20_mailbox_alias_plugin.so Nov 27 15:46:31 Debug: Loading modules from directory: /usr/lib/dovecot/ modules/doveadm Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_acl_plugin.so Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_quota_plugin.so Nov 27 15:46:31 Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/ lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Nov 27 15:46:31 Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Nov 27 15:46:31 Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/ libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: userdb lookup(h.user(a)example.com): Started userdb lookup Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: conn unix:/var/run/dovecot/director-userdb: Connecting Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: conn unix:/var/run/dovecot/director-userdb (pid=1,uid=0): Client connected (fd=9) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: userdb lookup(h.user(a)example.com): auth USER input: h.user(a)example.com home=/home/ mail/virtual/data05/example.com/h.user@example.com quota2_rule=*: bytes=10485760000 quota_rule=*:bytes=1048576000 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: userdb lookup(h.user(a)example.com): Finished userdb lookup (username=h.user(a)example.com home=/home/mail/virtual/data05/example.com/h.user@example.com quota2_rule=*: bytes=10485760000 quota_rule=*:bytes=1048576000) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: Added userdb setting: plugin/quota2_rule=*:bytes=10485760000 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=1048576000 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Effective uid=101, gid=101, home=/home/mail/virtual/data05/example.com/ h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Home dir not found: /home/mail/virtual/data05/example.com/ h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: dict(proxy): dict created (uri=proxy::acl, base_dir=/var/run/dovecot) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota root: name=User Quota backend=dict args=:proxy::sqluserquota Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota rule: root=User Quota mailbox=* bytes=1048576000 messages=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=1048576000 (100%) messages=0 reverse=no command=quota-warning 100 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=996147200 (95%) messages=0 reverse=no command=quota-warning 95 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=943718400 (90%) messages=0 reverse=no command=quota-warning 90 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=891289600 (85%) messages=0 reverse=no command=quota-warning 85 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota grace: root=User Quota bytes=104857600 (10%) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota root: name=Domain Quota backend=dict args=example.com:proxy:: sqldomainquota Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota rule: root=Domain Quota mailbox=* bytes=10485760000 messages=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota grace: root=Domain Quota bytes=1048576000 (10%) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota-dict: user=h.user(a)example.com, uri=proxy::sqluserquota, noenforcing=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: dict(proxy): dict created (uri=proxy::sqluserquota, base_dir=/var/run/ dovecot) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota-dict: user=example.com, uri=proxy::sqldomainquota, noenforcing=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: dict(proxy): dict created (uri=proxy::sqldomainquota, base_dir=/var/run/ dovecot) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir://home/mail/virtual/data05/ example.com/h.user@example.com/Maildir/:INDEX=//home/mail/virtual/data05/ example.com/h.user@example.com/Maildir/ Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: maildir++: root=//home/mail/virtual/data05/example.com/ h.user(a)example.com/Maildir, index=, indexpvt=, control=, inbox=//home/mail/ virtual/data05/example.com/h.user@example.com/Maildir, alt= Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: initializing backend with data: vfile Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: acl username = h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: owner = 1 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl vfile: Global ACLs disabled Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:%Lh/Maildir/:INDEX=%Lh/ Maildir/Shared/%u Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: initializing backend with data: vfile Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: acl username = h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: owner = 0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl vfile: Global ACLs disabled Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota: quota_over_flag check: quota_over_script unset - skipping Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota: quota_over_flag check: quota2_over_script unset - skipping Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/ var/run/dovecot/dict: Connecting Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/ var/run/dovecot/dict (pid=1,uid=0): Client connected (fd=10) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/ var/run/dovecot/dict: Connecting Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/ var/run/dovecot/dict (pid=1,uid=0): Client connected (fd=12) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): dict destroyed Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Waiting for dict to finish pending operations Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/ var/run/dovecot/dict (pid=1,uid=0): Disconnected: Connection closed (fd=10) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): dict destroyed Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Waiting for dict to finish pending operations Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/ var/run/dovecot/dict (pid=1,uid=0): Disconnected: Connection closed (fd=12) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): dict destroyed Quota name Type Value Limit % User Quota STORAGE 25 1024000 0 User Quota MESSAGE 25000 - 0 Domain Quota STORAGE 36 10240000 0 Domain Quota MESSAGE 36000 - 0 Nov 27 15:46:31 doveadm(401): Debug: auth-master: conn unix:/var/run/dovecot/ director-userdb (pid=1,uid=0): Disconnected: Connection closed (fd=9) Dovecot version 2.3.16, 2.3.15, 2.3.13. in this example 2.3.13 (89f716dc2) bullseye - correct behavior, select Debug: Loading modules from directory: /usr/lib/dovecot/modules Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mailbox_alias_plugin.so Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/ lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: / usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/ dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: / usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(h.gorska(a)example.com)<93><>: Debug: auth-master: userdb lookup (h.user(a)example.com) Started userdb lookup doveadm(h.user(a)example.com)<93><>: Debug: auth-master: conn unix:/run/dovecot/ director-userdb: Connecting doveadm(h.user(a)example.com)<93><>: Debug: auth-master: conn unix:/run/dovecot/ director-userdb (pid=1,uid=0): Client connected (fd=9) doveadm(h.user(a)example.com)<93><>: Debug: auth-master: userdb lookup (h.user(a)example.com) auth USER input: h.user(a)example.com home=/home/mail/ virtual/data05/example.com/h.user@example.com quota2_rule=*:bytes=10485760000 quota_rule=*:bytes=1048576000 doveadm(h.user(a)example.com)<93><>: Debug: auth-master: userdb lookup (h.user(a)example.com) Finished userdb lookup (username=h.user(a)example.com home=/home/mail/virtual/data05/example.com/h.user@example.com quota2_rule=*: bytes=10485760000 quota_rule=*:bytes=1048576000) doveadm(h.user(a)example.com)<93><>: Debug: Added userdb setting: plugin/ quota2_rule=*:bytes=10485760000 doveadm(h.user(a)example.com)<93><>: Debug: Added userdb setting: plugin/ quota_rule=*:bytes=1048576000 doveadm(h.user(a)example.com): Debug: Effective uid=101, gid=102, home=/home/ mail/virtual/data05/example.com/h.user@example.com doveadm(h.user(a)example.com): Debug: Home dir not found: /home/mail/virtual/ data05/example.com/h.user@example.com doveadm(h.user(a)example.com): Debug: Quota root: name=User Quota backend=dict args=:proxy::sqluserquota doveadm(h.user(a)example.com): Debug: Quota rule: root=User Quota mailbox=* bytes=1048576000 messages=0 doveadm(h.user(a)example.com): Debug: Quota warning: bytes=1048576000 (100%) messages=0 reverse=no command=quota-warning 100 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota warning: bytes=996147200 (95%) messages=0 reverse=no command=quota-warning 95 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota warning: bytes=943718400 (90%) messages=0 reverse=no command=quota-warning 90 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota warning: bytes=891289600 (85%) messages=0 reverse=no command=quota-warning 85 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota grace: root=User Quota bytes=104857600 (10%) doveadm(h.user(a)example.com): Debug: Quota root: name=Domain Quota backend=dict args=example.com:proxy::sqldomainquota doveadm(h.user(a)example.com): Debug: Quota rule: root=Domain Quota mailbox=* bytes=10485760000 messages=0 doveadm(h.user(a)example.com): Debug: Quota grace: root=Domain Quota bytes=1048576000 (10%) doveadm(h.user(a)example.com): Debug: quota-dict: user=h.user(a)example.com, uri=proxy::sqluserquota, noenforcing=0 doveadm(h.user(a)example.com): Debug: quota-dict: user=example.com, uri=proxy:: sqldomainquota, noenforcing=0 doveadm(h.user(a)example.com): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir://home/mail/ virtual/data05/example.com/h.user@example.com/Maildir/:INDEX=//home/mail/ virtual/data05/example.com/h.user@example.com/Maildir/ doveadm(h.user(a)example.com): Debug: maildir++: root=//home/mail/virtual/data05/ example.com/h.user@example.com/Maildir, index=, indexpvt=, control=, inbox=// home/mail/virtual/data05/example.com/h.user@example.com/Maildir, alt= doveadm(h.user(a)example.com): Debug: acl: initiali|//**domain**//|varchar (255)|Nie| |bytes|bigint(20)|Nie|0 |messages|bigint(20)|Nie|0 == Dumping data for table used_domain_quota |h.user(a)example.com|36000|36000 |example.com|35000|35000zing backend with data: vfile doveadm(h.user(a)example.com): Debug: acl: acl username = h.user(a)example.com doveadm(h.user(a)example.com): Debug: acl: owner = 1 doveadm(h.user(a)example.com): Debug: acl vfile: Global ACLs disabled doveadm(h.user(a)example.com): Debug: Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir: %Lh/Maildir/:INDEX=%Lh/Maildir/Shared/%u doveadm(h.user(a)example.com): Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= doveadm(h.user(a)example.com): Debug: acl: initializing backend with data: vfile doveadm(h.user(a)example.com): Debug: acl: acl username = h.user(a)example.com doveadm(h.user(a)example.com): Debug: acl: owner = 0 doveadm(h.user(a)example.com): Debug: acl vfile: Global ACLs disabled doveadm(h.user(a)example.com): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(h.user(a)example.com): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping Quota name Type Value Limit % User Quota STORAGE 25 1024000 0 User Quota MESSAGE 25000 - 0 Domain Quota STORAGE 35 10240000 0 Domain Quota MESSAGE 35000 - 0 doveadm(h.user(a)example.com): Debug: auth-master: conn unix:/run/dovecot/ director-userdb (pid=1,uid=0): Disconnected: Connection closed (fd=9) **** MYSQL catch logs **** Mysql catch log during doveadm quota get -u h.user(a)example.com, version 2.3.17+ 592 Query SELECT username AS user, CONCAT('/home/mail/virtual/ ',mailbox.storagenode,mailbox.maildir,username) AS home, CONCAT('*:bytes=', domain.maxquota*1048576) AS quota2_rule, CONCAT('*:bytes=', mailbox.quota*1048576) AS quota_rule FROM mailbox,domain WHERE username = 'h.user(a)example.com' AND mailbox.domain=domain.domain AND domain.active=1 AND mailbox.`enabledoveadm`=1 AND mailbox.active=1 593 Connect root(a)10.15.1.40 on postfix using TCP/IP 593 Query SELECT bytes FROM used_quota WHERE username = 'h.user(a)example.com' 593 Query SELECT messages FROM used_quota WHERE username = 'h.user(a)example.com' 594 Connect root(a)10.15.1.40 on postfix using TCP/IP 594 Query SELECT bytes FROM used_domain_quota WHERE domain = 'h.user(a)example.com' 594 Query SELECT messages FROM used_domain_quota WHERE domain = 'h.user(a)example.com' example SQL UPDATE, dovecot version 2.3.20 (80a5ac675d) alpine 3.18.4 - bad behavior # User@Host: user[user @ [192.168.254.176] # Thread_id: 58405753 Schema: postfix QC_hit: No # Query_time: 0.000294 Lock_time: 0.000104 Rows_sent: 0 Rows_examined: 1 # Rows_affected: 1 Bytes_sent: 52 # # explain: id select_type table type possible_keys key key_len ref rows r_rows filtered r_filtered Extra # explain: 1 SIMPLE used_domain_quota range PRIMARY PRIMARY 767 NULL 1 1.00 100.00 100.00 Using where # SET timestamp=1701103297; UPDATE used_domain_quota SET bytes=bytes+4359,messages=messages+1 WHERE domain = 'h.user(a)example.com'; example SQL UPDATE domain and user quota - good behavior, dovecot version 2.3.4.1 (f79e8e7e4), debian 10 # User@Host: postfix[postfix] @ [192.168.254.175] # Thread_id: 58406279 Schema: postfix QC_hit: No # Query_time: 0.000252 Lock_time: 0.000080 Rows_sent: 0 Rows_examined: 1 # Rows_affected: 1 Bytes_sent: 52 # # explain: id select_type table type possible_keys key key_len ref rows r_rows filtered r_filtered Extra # explain: 1 SIMPLE used_domain_quota range PRIMARY PRIMARY 767 NULL 1 1.00 100.00 100.00 Using where # SET timestamp=1701103048; UPDATE used_domain_quota SET bytes=bytes+11597,messages=messages+1 WHERE domain = 'example.com'; # User@Host: user[user] @ [192.168.254.175] # Thread_id: 58406274 Schema: postfix QC_hit: No # Query_time: 0.000247 Lock_time: 0.000076 Rows_sent: 0 Rows_examined: 1 # Rows_affected: 1 Bytes_sent: 52 # # explain: id select_type table type possible_keys key key_len ref rows r_rows filtered r_filtered Extra # explain: 1 SIMPLE used_quota range PRIMARY PRIMARY 767 NULL 1 1.00 100.00 100.00 Using where # SET timestamp=1701103048; UPDATE used_quota SET bytes=bytes+11597,messages=messages+1 WHERE username = 'h.user(a)example.com';

3 3

doveadm auth lookup fails for system user
by Christian H. Kuhn 15 Jul '24

15 Jul '24

Hi all, next step with my auth problem with dovecot. I want to authenticate a system user. The user exists, can log in, can sudo -i etc.pp. SASL with sql passdb and userdb works fine. root@bywater /etc/dovecot/conf.d # doveadm user qno field value uid 1001 gid 1001 home /home/qno mail maildir:~/Maildir system_groups_user qno But: root@bywater /etc/dovecot/conf.d # doveadm auth lookup qno passdb lookup: user qno doesn't exist And no surprise: root@bywater /etc/dovecot/conf.d # doveadm auth test qno Password: passdb: qno auth failed extra fields: user=qno root@bywater /etc/dovecot/conf.d # doveconf -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 5.15.0-113-generic x86_64 Ubuntu 22.04.4 LTS # Hostname: bywater.qno.de auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain listen = 65.21.136.15, [::] mail_location = maildir:~/Maildir mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/tables.d/dovecot-sql.conf.ext driver = sql } passdb { args = blocking=no driver = passwd } passdb { driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } postmaster_address = postmaster(a)qno.de protocols = " imap sieve" service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener lmtp { group = postfix mode = 0600 user = postfix } } ssl = required ssl_cert = </etc/letsencrypt/live/imap2.qno.de/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-CHACHA20-POLY1305 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it syslog_facility = local0 userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%u driver = static } userdb { driver = passwd } verbose_proctitle = yes How can it be that a user is found by userdb passwd, but not by passdb passwd or PAM? TIA QNo

3 3

Failed to connect to dns-client: Resource temporarily unavailable
by m＠maltris.org 15 Jul '24

15 Jul '24

When using DNS names for backends in a proxied setup, the async dns_client process after a short time of high load (burst scenario) seems to get overwhelmed: auth: Debug: conn unix:dns-client: dns(backend.local): Lookup failed after 0 msecs: Failed to connect to dns-client: Resource temporarily unavailable auth: Error: DNS lookup for backend.local failed: Failed to connect to dns-client: Resource temporarily unavailable The whole thing itself runs for a few thousand requests until this happens. ulimit nofile is set to 65000. When changing the backend from DNS name to IP, there is no problem. What are the possibilities to use dns names but without these problems? Any way to either increase dns resolving capacity OR cache the results for some time (or forever?)? Best regards

2 1

dovecot replication
by Jeff Pang 13 Jul '24

13 Jul '24

Hello, Does the community version of dovecot have the replication feature? When one dovecot was down, another one could take over the tasks. Thanks. _________________________________________________________________ ________________________________________________________ Your E-Mail. Your Cloud. Your Office. eclipso Mail Europe. https://www.eclipso.de

4 7

dovecot imap_zlib
by Joan Moreau 12 Jul '24

12 Jul '24

Hi I tested teh git version of dovecot. It seems the IMAP Compress plugin (imap_zlib) has disappeared. How to get it back ? Thank you

6 7

New Member Introduction
by Selena Thomas 10 Jul '24

10 Jul '24

Hi everyone, I am new to this forum and excited to be here. I'm interested in learning more about Dovecot and its features, and I'm eager to participate in the discussions here. Could someone please guide me on how to ask questions here ? Where should I post if I have a query ? Looking forward to your advice and connecting with you all. Thanks,

2 1

Re: dovecot imap_zlib
by Michael Slusarz 10 Jul '24

10 Jul '24

> On 07/09/2024 6:42 AM MDT Bjoern Franke via dovecot <dovecot(a)dovecot.org> wrote: > > >> I tested teh git version of dovecot. It seems the IMAP Compress plugin > >> (imap_zlib) has disappeared. > > > > https://github.com/dovecot/core/commit/5f27e25c64555dcaae6cb00c479cd05bc263… > > so the zlib plugin is also deprecated and clients should run compress > themselves? These are two distinct plugins. imap-zlib = compression of the IMAP protocol stream zlib = mailbox storage compression on the Dovecot server For 2.4, "zlib" plugin has been renamed to "mail-compress". https://doc.dovecot.org/2.4/core/plugins/mail_compress.html michael

3 2

Pread error over smb3
by Joan Moreau 06 Jul '24

06 Jul '24

Hi I am trying to move my storage of email on a smb3 mounted volume. I am getting the following error : Error: pread(/net/.../storage/dovecot.map.index.log) failed: Permission denied (euid=1004(mailusers) egid=12(mail) UNIX perms appear ok (ACL/MAC wrong?)) How to resolve that ? Thank you

3 8

[auth] epoll_ctl(add, 13) failed: Operation not permitted (fd doesn't support epoll)
by Alexander Vogt 05 Jul '24

05 Jul '24

Hi all, dovecot auth service is failing when using an inet_service. The configuration is essentially: service auth { inet_listener { address = * port = 12345 } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } When I connect to port 12345 (real IMAP client or telnet doesn't make a difference), the auth service crashes. Nov 19 22:21:54 imap.linexus.de dovecot[7195]: auth: Panic: epoll_ctl(add, 13) failed: Operation not permitted (fd doesn't support epoll) Nov 19 22:21:54 imap.linexus.de dovecot[7195]: auth: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x46) [0x7f9319f89486] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x22) [0x7f9319f895a2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10a41b) [0x7f9319f9841b] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10a4b7) [0x7f9319f984b7] -> /usr/lib64/dovecot/libdovecot.so.0(+0x5d11a) [0x7f9319eeb11a] -> /usr/lib64/dovecot/libdovecot.so.0(+0x609b0) [0x7f9319eee9b0] -> /usr/lib64/dovecot/libdovecot.so.0(+0x1215ba) [0x7f9319faf5ba] -> /usr/lib64/dovecot/libdovecot.so.0(io_add_to+0x1d) [0x7f9319faf62d] -> /usr/lib64/dovecot/libdovecot.so.0(io_add+0x28) [0x7f9319faf668] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_io_listeners_add+0x8a ) [0x7f9319f1d16a] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_init_finish+0xff) [0x7f9319f24bdf] -> dovecot/auth(main+0x389) [0x55745603a4f9] -> /lib64/libc.so.6(+0x3feb0) [0x7f931963feb0] -> /lib64/libc.so.6(__libc_start_main+0x80) [0x7f931963ff60] -> dovecot/auth(_start+0x25) [0x55745603a715] System info (sysreport attached): # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 5.14.0-383.el9.x86_64 x86_64 CentOS Stream release 9 This exact configuration is known to work on this system: # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) I tried for almost two hours to get a core dump for this, but finally gave up. I followed https://www.dovecot.org/bugreport-mail/#coredumps and other sources but the best I could get was Nov 19 22:21:54 imap.linexus.de dovecot[7195]: auth: Fatal: master: service(auth): child 7198 killed with signal 6 (core not dumped - https://dovecot.org/bugreport.html#coredumps - core wasn't writable?) for cat /proc/sys/kernel/core_pattern /tmp/core.%e.%p (which is 1777). Any help to get this resolved would be much appreciated! Thanks and best regards Alex

3 5

dsync will be removed in 2.4 - why?
by Oliver Krone 05 Jul '24

05 Jul '24

Hi there, I recently learned that dsync (mail replication) functionality will be removed in the upcoming releases of dovecot. What is the reason and will there be a replacement? How can I synchronize my e-mails in the future? Thanks a lot. Regards Oliver

3 2

Is it possible to access cert_username and original_username the same time?
by bisteycsaba＠gmail.com 05 Jul '24

05 Jul '24

Hello all, If i use auth_ssl_username_from_cert dovecot gets its username from certificate, but seems like it also becomes %orig_user , if i do not use auth_ssl_username_from_cert cert_username completly unaccessable. Is there a way to access the original user supplied username when auth_ssl_username_from_cert is set or am i missed something and there is a variable for cert_username? What i would like to do is use username from cert to determine which email accounts a user with that cert has access to but for that i would both need access to cert_username and the username given by the user, but when username supplied from cert seems like the username supplied by the user no longer accessable, or i cant figure out how to access it. Thanks: Csaba

1 0

dovecot replication problem
by Oliver Krone 05 Jul '24

05 Jul '24

Hi there, I'm experiencing the following when I replicate mails between two host, using different versions of dovecot: *Host A Host B result* dovecot-2.3-19 --> dovecort-2.3.16 ERROR: auth: Error: All password databases were skipped. doveadm(10.0.0.1,oliver.krone(a)snoog.ch): Error: auth-master: passdb lookup(oliver.krone(a)snoog.ch): Auth PASS lookup failed mail | 2024-07-04T14:21:35.635047+00:00 mail dovecot: doveadm(10.0.0.1,oliver.krone(a)snoog.ch): Error: /run/dovecot/auth-userdb: passdb lookup failed (to see if user is proxied, because doveadm_port is set) dovecot-2.3-21 --> dovecort-2.3.16 no errors, working Basically it does work with 2.3-21 --> 2.3-16 and it does not work with 2.3-19 ---> 2.3-16 without any changes in the configuration files. Any ideas? Thank you very much. Best regards Oliver

2 1

Doveadm on director
by g.carabella＠panservice.it 04 Jul '24

04 Jul '24

https://doc.dovecot.org/admin_manual/doveadm_mailbox_commands/ As indicated in the documentation above, in case of configuration with the director, the doveadm commands must be executed from the director itself. However, if I try to run the command "doveadm -D mailbox list -u user(a)example.com" the command fails because it tries to lookup user locally instead on one of the backend servers. Where am I wrong? My configuration consists of three directors and three backend servers. Thanks a lot.

1 0

Error: fts_solr: received invalid uid
by oliver.krone＠snoog.ch 04 Jul '24

04 Jul '24

I'm using dovecot 2.3.13, solr 8.x. and roundcube 1.5.1. However when I do a search I get the the Error: fts_solr: received invalid uid, search results are ok. Thanks

5 4

One-way synchronization with doveadm/TCP
by Дилян Палаузов 04 Jul '24

04 Jul '24

Hello, the replication procedure described at https://doc.dovecot.org/configuration_manual/replication/ suggests to open a server port 12345 on two systems, and then point each system to the other one. This creates bi-directional synchronization. I want to synchronize only from server A to server B, but not in the opposite direction. Is it sufficient on server A to set service doveadm { inet_listener { port = 12345 } } doveadm_password = secret and server B to set doveadm_port = 12345 doveadm_password = secret ? In other words, when a doveadm client (system B) connects to a server (system A) for replication purposes, does it only read data? Or does it instruct the server also to delete data? To start the replication I had to executed «doveadm replicator replicate '*'». Is in necessary to run this periodically? Thanks for your answer, Дилян

2 1

login_access_sockets
by John Fawcett 03 Jul '24

03 Jul '24

Hi I've used Dovecot for a long time but I never stop learning about the depth of features I've never used.... I just discovered the login_access_sockets setting when reading this page: https://doc.dovecot.org/admin_manual/login_processes/ The compilation using --with-libwrap configure setting was not immediate, since on Fedora which I am using there is no tcp_wrappers-devel package so tcpd.h wasn't installed in /usr/include and the library name libwrap.so that was expected by Dovecot needed a symlink to the library installed by tcp_wrappers package. So differently to what I previously understood, Dovecot does have a way of controlling access at connect time via tcp_wrappers hosts.allow and hosts.deny files. But now I also realize that this discovery will be short lived, since I understand this is going away in 3.0 and also 2.4 though I can't find a page on that: https://doc.dovecotpro.com/3.0/installation/upgrading/2.3.x-3.x.html I can understand the logic about slimming down the code to leave out less used features, but this part of the code looks well written and hasn't required much maintenance over the years. I know there's zero chance of reversing the removal of login_access_sockets, but I just wondered whether there could be the chance to introduce a LUA hook at connect time rather than waiting for authentication to be done. Also I have no idea what the overhead of LUA script is, does it spawn additional processes per connection? Thanks John

1 0

IMAP login-logout cycle performance with performance mode seems slow/limited and cause cannot be found
by m＠maltris.org 03 Jul '24

03 Jul '24

Hello, I am running a test setup in a docker stack with Dovecot (2.3.21). Basically as a test to see whats possible. The whole thing works okay, but I noticed that with imaptest (latest version) somewhere between 230 and 270 requests per second on a login+logout cycle it cannot go further. However, this is a 384G memory, 48 core, dual-cpu setup that is pretty much idling (utilization somewhere around 6-12%). The ssds are not loaded at all. The memory usage is low. For testing purpose I set nopassword=y and allowed all logins, the users just require a small mysql db lookup which is done once before the cache is filled. If I copy that exact same stack to my local machine, I yield around 450 cycles per second. And the only difference I somehow see is that my local machine has a faster cpu-memory connection and only one cpu with less cores. Is it possible memory speed is a limiting factor because of the cpu-memory-mapping on the server and the slower memory? What performance should I expect? Asking because I am planning to run a stateless client at a later point and the limited login-performance really seems to make that difficult at scale. doveconf -n: # 2.3.21 (47349e2482): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.21 (f6cd4b8e) # OS: Linux 6.8.0-36-generic x86_64 Debian 11.7 ext4 # Hostname: 4e83f0e9d630 auth_cache_negative_ttl = 0 auth_cache_size = 50 M auth_cache_ttl = 5 hours auth_cache_verify_password_with_worker = yes auth_debug = yes auth_debug_passwords = yes auth_failure_delay = 0 auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = yes auth_worker_max_count = 500 default_vsz_limit = 2 G disable_plaintext_auth = no doveadm_api_key = # hidden, use -P to show it doveadm_password = # hidden, use -P to show it doveadm_port = 2425 log_debug = event=* log_path = /var/log/dovecot-debug.log login_trusted_networks = 10.0.0.0/8 127.0.0.0/8 mail_debug = yes mail_fsync = never mail_gid = 1000 mail_location = maildir:/data/vmail/%d/%1n/%n mail_uid = 1000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = nopassword=y driver = static } protocols = " imap lmtp sieve pop3 submission" service anvil { chroot = empty client_limit = 75100 idle_kill = 4294967295 secs process_limit = 1 unix_listener anvil-auth-penalty { mode = 00 } } service auth-worker { client_limit = 1 process_limit = 6000 user = $default_internal_user } service auth { client_limit = 91000 } service doveadm { inet_listener { port = 2425 } inet_listener http { port = 8080 } } service imap-login { process_limit = 15000 process_min_avail = 48 service_count = 0 vsz_limit = 2 G } service imap { client_limit = 1 process_limit = 15000 } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol doveadm { passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql name = override_fields = port=2425 ssl=no starttls=no } } protocol imap { mail_max_userip_connections = 250 } Best regards

2 5

AW: AW: AW: IMAPSieve plugin will not run rspamd script
by postfix_dovecot＠gmx.de 02 Jul '24

02 Jul '24

Hi John, the prefix is just a sign of my desperation - I tried all sorts of variations yesterday and now forgot to undo it. There’s a very detailed tutorial available (German language) with Debian 10. Just the sieve scripts are little different. I spend the time to raise a Debian 10 with this tutorial – and with exact the same result as with my up to date configuration. So it would be interesting for me to know if there is anyone here who has managed to get this to work on Debian? Jens Von: John Fawcett <john(a)voipsupport.it> Gesendet: Montag, 1. Juli 2024 18:26 An: postfix_dovecot(a)gmx.de Betreff: Re: AW: AW: IMAPSieve plugin will not run rspamd script On 01/07/2024 18:08, postfix_dovecot(a)gmx.de <mailto:postfix_dovecot@gmx.de> wrote: Hi John, is there any other log than system? Jens Hi Jens I meant the same type of logging you already posted (i.e. as below) for exactly the same test case, but where the rules use the mailbox name that includes the prefix you set for the namespace (i.e.INBOX/Spam). There is probably a good reason why you have configured a prefix for your namespace, but my suspicion is that the example imapsieve config you copied assumes no prefix set (it was not part of the example so we cannot see it). I personally tried the settings from the example and they work fine and I have no prefix. I also did the opposite test and I get the behaviour you reported when I have prefix set. In order to solve it (without changing the prefix) I had to state the full mailbox name including the prefix in the imapsieve rules. In that case it worked. What I'd like to check in your logging is if there is a clue why it didn't work for you when yu used INBOX/Spam in the rules. John imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: Module loaded: /usr/lib/dovecot/modules/lib95_imap_sieve_plugin.so imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: imapsieve: mailbox INBOX/Spam: APPEND event imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: Pigeonhole version 0.5.19 (4eae2f79) initializing imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: imapsieve: Static mailbox rule [1]: mailbox=`Spam' from=`*' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-spam.sieve' after=(none) imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: imapsieve: Static mailbox rule [2]: mailbox=`*' from=`Spam' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-ham.sieve' after=(none) imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: mailbox INBOX: FLAG event (changed flags: \Deleted) imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: Pigeonhole version 0.5.19 (4eae2f79) initializing imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: Static mailbox rule [1]: mailbox=`Spam' from=`*' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-spam.sieve' after=(none) imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: Static mailbox rule [2]: mailbox=`*' from=`Spam' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-ham.sieve' after=(none) imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: mailbox INBOX: FLAG event (changed flags: \Seen)

2 10

IMAPSieve plugin will not run rspamd script
by postfix_dovecot＠gmx.de 02 Jul '24

02 Jul '24

Host: VMware Workstation 14.1.8 OS: Debian 12 (Bookworm) Dovecot: 2.3.19.1 Postfix: 3.7.10 Mailclient: Outlook 2016 Hello, I am currently working on a new mail server to replace my Debian 10 mail server. For preparation, I use VMware Workstation to learn and test the installation steps. When I'm eventually done, I'll rebuild my root server from scratch. This time, my problem is getting the IMAPSieve plugin working to trigger rspamd if mail gets moved to the junk folder. Sieve runs well – if rspam recognizes a spam mail, it will be transferred to the junk folder. For me it looks like the IMAPSieve plugin recognizes the move but will not running the script behind. I can see some actions in the log but nothing happens on the rspamd side where the log is also open to view. Moving a mail with Outlook produces the following log entry: imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: Module loaded: /usr/lib/dovecot/modules/lib95_imap_sieve_plugin.so imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: imapsieve: mailbox INBOX/Spam: APPEND event imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: Pigeonhole version 0.5.19 (4eae2f79) initializing imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: imapsieve: Static mailbox rule [1]: mailbox=`Spam' from=`*' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-spam.sieve' after=(none) imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: imapsieve: Static mailbox rule [2]: mailbox=`*' from=`Spam' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-ham.sieve' after=(none) imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: mailbox INBOX: FLAG event (changed flags: \Deleted) imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: Pigeonhole version 0.5.19 (4eae2f79) initializing imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: Static mailbox rule [1]: mailbox=`Spam' from=`*' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-spam.sieve' after=(none) imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: Static mailbox rule [2]: mailbox=`*' from=`Spam' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-ham.sieve' after=(none) imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: mailbox INBOX: FLAG event (changed flags: \Seen) My /etc/dovecot/local.conf looks like this: ## dovecot.conf # Mailuser im Log mit Namen darstellen verbose_proctitle = yes protocols = imap lmtp sieve ## 10-auth.conf # Disable LOGIN command and all other plaintext authentications unless # SSL/TLS is used (LOGINDISABLED capability). Note that if the remote IP # matches the local IP (ie. you're connecting from the same computer), the # connection is considered secure and plaintext authentication is allowed. # See also ssl=required setting. disable_plaintext_auth = yes # Space separated list of wanted authentication mechanisms: # plain login digest-md5 cram-md5 ntlm rpa apop anonymous gssapi otp # gss-spnego # NOTE: See also disable_plaintext_auth setting. auth_mechanisms = plain login # Username formatting before it's looked up from databases. You can use # the standard variables here, eg. %Lu would lowercase the username, %n would # drop away the domain if it was given, or "%n-AT-%d" would change the '@' into # "-AT-". This translation is done after auth_username_translation changes. auth_username_format = %Lu ## ## Password and user databases ## # # Password database is used to verify user's password (and nothing more). # You can have multiple passdbs and userdbs. This is useful if you want to # allow both system users (/etc/passwd) and virtual users to login without # duplicating the system users into virtual database. # # <doc/wiki/PasswordDatabase.txt> # # User database specifies where mails are located and what user/group IDs # own them. For single-UID configuration use "static" userdb. # # <doc/wiki/UserDatabase.txt> #!include conf.d/auth-deny.conf.ext #!include conf.d/auth-master.conf.ext #!include conf.d/auth-system.conf.ext #!include conf.d/auth-sql.conf.ext #!include conf.d/auth-ldap.conf.ext !include conf.d/auth-passwdfile.conf.ext #!include conf.d/auth-checkpassword.conf.ext #!include conf.d/auth-static.conf.ext ## 10-director.conf ## 10-logging.conf # Loglevel festelegen auth_verbose = no auth_debug = no mail_debug = yes ## 10-mail.conf # Format der Mailbox ändern mail_location = maildir:~/Maildir namespace inbox { # Namespace type: private, shared or public type = private # Hierarchy separator to use. You should use the same separator for all # namespaces or some clients get confused. '/' is usually a good one. # The default however depends on the underlying mail storage format. separator = / # Prefix required to access this namespace. This needs to be different for # all namespaces. For example "Public/". prefix = INBOX/ # Physical location of the mailbox. This is in same format as # mail_location, which is also the default for it. location = # There can be only one INBOX, and this setting defines which namespace # has it. inbox = yes # If namespace is hidden, it's not advertised to clients via NAMESPACE # extension. You'll most likely also want to set list=no. This is mostly # useful when converting from another server with different namespaces which # you want to deprecate but still keep working. For example you can create # hidden namespaces with prefixes "~/mail/", "~%u/mail/" and "mail/". hidden = no # If namespace namespace/location fails to load, by default the entire # session will fail to start. If this is set, this namespace will be ignored # instead. ignore_on_failure = no # Show the mailboxes under this namespace with LIST command. This makes the # namespace visible for clients that don't support NAMESPACE extension. # "children" value lists child mailboxes, but hides the namespace prefix. list = yes # Namespace handles its own subscriptions. If set to "no", the parent # namespace handles them (empty prefix should always have this as "yes") subscriptions = yes # See 15-mailboxes.conf for definitions of special mailboxes. } ## 10-master.conf service lmtp { inet_listener lmtp { address = 127.0.0.1 ::1 port = 24 } } service auth { # auth_socket_path points to this userdb socket by default. It's typically # used by dovecot-lda, doveadm, possibly imap process, etc. Users that have # full permissions to this socket are able to get a list of all usernames and # get the results of everyone's userdb lookups. # # The default 0666 mode allows anyone to connect to the socket, but the # userdb lookups will succeed only if the userdb returns an "uid" field that # matches the caller process's UID. Also if caller's uid or gid matches the # socket's uid or gid the lookup succeeds. Anything else causes a failure. # # To give the caller full permissions to lookup all users, set the mode to # something else than 0666 and Dovecot lets the kernel enforce the # permissions (e.g. 0777 allows everyone full permissions). unix_listener auth-userdb { #mode = 0666 #user = #group = } # Postfix smtp-auth unix_listener /var/spool/postfix/private/auth { mode = 0666 } # Auth process is run as this user. #user = $default_internal_user } ## 10-ssl.conf ## 10-tcpwrapper.conf ## 15-lda.conf ## 15-mailboxes.conf namespace inbox { inbox = yes mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } } ## 20-imap.conf protocol imap { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins imap_sieve } ## 20-lmtp.conf protocol lmtp { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins sieve } ## 20-managesieve.conf ## 90-acl.conf ## 90-plugin.conf ## 90-quota.conf ## 90-sieve.conf plugin { sieve_before = /etc/dovecot/conf.d/custom-sieve/global_before.sieve sieve_after = /etc/dovecot/conf.d/custom-sieve/global_after.sieve sieve_plugins = sieve_imapsieve sieve_extprograms # From elsewhere to Spam folder imapsieve_mailbox1_name = Spam imapsieve_mailbox1_causes = COPY APPEND imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve # From Spam folder to elsewhere imapsieve_mailbox2_name = * imapsieve_mailbox2_from = Spam imapsieve_mailbox2_causes = COPY APPEND imapsieve_mailbox2_before = file:/usr/lib/dovecot/sieve/report-ham.sieve sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment } ## 90-sieve-extprograms.conf root@ServerIV-home:~# ^C root@ServerIV-home:~# cat /etc/dovecot/local.conf ## dovecot.conf # Mailuser im Log mit Namen darstellen verbose_proctitle = yes protocols = imap lmtp sieve ## 10-auth.conf # Disable LOGIN command and all other plaintext authentications unless # SSL/TLS is used (LOGINDISABLED capability). Note that if the remote IP # matches the local IP (ie. you're connecting from the same computer), the # connection is considered secure and plaintext authentication is allowed. # See also ssl=required setting. disable_plaintext_auth = yes # Space separated list of wanted authentication mechanisms: # plain login digest-md5 cram-md5 ntlm rpa apop anonymous gssapi otp # gss-spnego # NOTE: See also disable_plaintext_auth setting. auth_mechanisms = plain login # Username formatting before it's looked up from databases. You can use # the standard variables here, eg. %Lu would lowercase the username, %n would # drop away the domain if it was given, or "%n-AT-%d" would change the '@' into # "-AT-". This translation is done after auth_username_translation changes. auth_username_format = %Lu ## ## Password and user databases ## # # Password database is used to verify user's password (and nothing more). # You can have multiple passdbs and userdbs. This is useful if you want to # allow both system users (/etc/passwd) and virtual users to login without # duplicating the system users into virtual database. # # <doc/wiki/PasswordDatabase.txt> # # User database specifies where mails are located and what user/group IDs # own them. For single-UID configuration use "static" userdb. # # <doc/wiki/UserDatabase.txt> #!include conf.d/auth-deny.conf.ext #!include conf.d/auth-master.conf.ext #!include conf.d/auth-system.conf.ext #!include conf.d/auth-sql.conf.ext #!include conf.d/auth-ldap.conf.ext !include conf.d/auth-passwdfile.conf.ext #!include conf.d/auth-checkpassword.conf.ext #!include conf.d/auth-static.conf.ext ## 10-director.conf ## 10-logging.conf # Loglevel festelegen auth_verbose = no auth_debug = no mail_debug = yes ## 10-mail.conf # Format der Mailbox ändern mail_location = maildir:~/Maildir namespace inbox { # Namespace type: private, shared or public type = private # Hierarchy separator to use. You should use the same separator for all # namespaces or some clients get confused. '/' is usually a good one. # The default however depends on the underlying mail storage format. separator = / # Prefix required to access this namespace. This needs to be different for # all namespaces. For example "Public/". prefix = INBOX/ # Physical location of the mailbox. This is in same format as # mail_location, which is also the default for it. location = # There can be only one INBOX, and this setting defines which namespace # has it. inbox = yes # If namespace is hidden, it's not advertised to clients via NAMESPACE # extension. You'll most likely also want to set list=no. This is mostly # useful when converting from another server with different namespaces which # you want to deprecate but still keep working. For example you can create # hidden namespaces with prefixes "~/mail/", "~%u/mail/" and "mail/". hidden = no # If namespace namespace/location fails to load, by default the entire # session will fail to start. If this is set, this namespace will be ignored # instead. ignore_on_failure = no # Show the mailboxes under this namespace with LIST command. This makes the # namespace visible for clients that don't support NAMESPACE extension. # "children" value lists child mailboxes, but hides the namespace prefix. list = yes # Namespace handles its own subscriptions. If set to "no", the parent # namespace handles them (empty prefix should always have this as "yes") subscriptions = yes # See 15-mailboxes.conf for definitions of special mailboxes. } ## 10-master.conf service lmtp { inet_listener lmtp { address = 127.0.0.1 ::1 port = 24 } } service auth { # auth_socket_path points to this userdb socket by default. It's typically # used by dovecot-lda, doveadm, possibly imap process, etc. Users that have # full permissions to this socket are able to get a list of all usernames and # get the results of everyone's userdb lookups. # # The default 0666 mode allows anyone to connect to the socket, but the # userdb lookups will succeed only if the userdb returns an "uid" field that # matches the caller process's UID. Also if caller's uid or gid matches the # socket's uid or gid the lookup succeeds. Anything else causes a failure. # # To give the caller full permissions to lookup all users, set the mode to # something else than 0666 and Dovecot lets the kernel enforce the # permissions (e.g. 0777 allows everyone full permissions). unix_listener auth-userdb { #mode = 0666 #user = #group = } # Postfix smtp-auth unix_listener /var/spool/postfix/private/auth { mode = 0666 } # Auth process is run as this user. #user = $default_internal_user } ## 10-ssl.conf ## 10-tcpwrapper.conf ## 15-lda.conf ## 15-mailboxes.conf namespace inbox { inbox = yes mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } } ## 20-imap.conf protocol imap { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins imap_sieve } ## 20-lmtp.conf protocol lmtp { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins sieve } ## 20-managesieve.conf ## 90-acl.conf ## 90-plugin.conf ## 90-quota.conf ## 90-sieve.conf plugin { sieve_before = /etc/dovecot/conf.d/custom-sieve/global_before.sieve sieve_after = /etc/dovecot/conf.d/custom-sieve/global_after.sieve sieve_plugins = sieve_imapsieve sieve_extprograms # From elsewhere to Spam folder imapsieve_mailbox1_name = Spam imapsieve_mailbox1_causes = COPY APPEND imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve # From Spam folder to elsewhere imapsieve_mailbox2_name = * imapsieve_mailbox2_from = Spam imapsieve_mailbox2_causes = COPY APPEND imapsieve_mailbox2_before = file:/usr/lib/dovecot/sieve/report-ham.sieve sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment } ## 90-sieve-extprograms.conf root@ServerIV-home:~# cat /etc/dovecot/local.conf ## dovecot.conf # Mailuser im Log mit Namen darstellen verbose_proctitle = yes protocols = imap lmtp sieve ## 10-auth.conf # Disable LOGIN command and all other plaintext authentications unless # SSL/TLS is used (LOGINDISABLED capability). Note that if the remote IP # matches the local IP (ie. you're connecting from the same computer), the # connection is considered secure and plaintext authentication is allowed. # See also ssl=required setting. disable_plaintext_auth = yes # Space separated list of wanted authentication mechanisms: # plain login digest-md5 cram-md5 ntlm rpa apop anonymous gssapi otp # gss-spnego # NOTE: See also disable_plaintext_auth setting. auth_mechanisms = plain login # Username formatting before it's looked up from databases. You can use # the standard variables here, eg. %Lu would lowercase the username, %n would # drop away the domain if it was given, or "%n-AT-%d" would change the '@' into # "-AT-". This translation is done after auth_username_translation changes. auth_username_format = %Lu ## ## Password and user databases ## # # Password database is used to verify user's password (and nothing more). # You can have multiple passdbs and userdbs. This is useful if you want to # allow both system users (/etc/passwd) and virtual users to login without # duplicating the system users into virtual database. # # <doc/wiki/PasswordDatabase.txt> # # User database specifies where mails are located and what user/group IDs # own them. For single-UID configuration use "static" userdb. # # <doc/wiki/UserDatabase.txt> #!include conf.d/auth-deny.conf.ext #!include conf.d/auth-master.conf.ext #!include conf.d/auth-system.conf.ext #!include conf.d/auth-sql.conf.ext #!include conf.d/auth-ldap.conf.ext !include conf.d/auth-passwdfile.conf.ext #!include conf.d/auth-checkpassword.conf.ext #!include conf.d/auth-static.conf.ext ## 10-director.conf ## 10-logging.conf # Loglevel festelegen auth_verbose = no auth_debug = no mail_debug = yes ## 10-mail.conf # Format der Mailbox ändern mail_location = maildir:~/Maildir namespace inbox { # Namespace type: private, shared or public type = private # Hierarchy separator to use. You should use the same separator for all # namespaces or some clients get confused. '/' is usually a good one. # The default however depends on the underlying mail storage format. separator = / # Prefix required to access this namespace. This needs to be different for # all namespaces. For example "Public/". prefix = INBOX/ # Physical location of the mailbox. This is in same format as # mail_location, which is also the default for it. location = # There can be only one INBOX, and this setting defines which namespace # has it. inbox = yes # If namespace is hidden, it's not advertised to clients via NAMESPACE # extension. You'll most likely also want to set list=no. This is mostly # useful when converting from another server with different namespaces which # you want to deprecate but still keep working. For example you can create # hidden namespaces with prefixes "~/mail/", "~%u/mail/" and "mail/". hidden = no # If namespace namespace/location fails to load, by default the entire # session will fail to start. If this is set, this namespace will be ignored # instead. ignore_on_failure = no # Show the mailboxes under this namespace with LIST command. This makes the # namespace visible for clients that don't support NAMESPACE extension. # "children" value lists child mailboxes, but hides the namespace prefix. list = yes # Namespace handles its own subscriptions. If set to "no", the parent # namespace handles them (empty prefix should always have this as "yes") subscriptions = yes # See 15-mailboxes.conf for definitions of special mailboxes. } ## 10-master.conf service lmtp { inet_listener lmtp { address = 127.0.0.1 ::1 port = 24 } } service auth { # auth_socket_path points to this userdb socket by default. It's typically # used by dovecot-lda, doveadm, possibly imap process, etc. Users that have # full permissions to this socket are able to get a list of all usernames and # get the results of everyone's userdb lookups. # # The default 0666 mode allows anyone to connect to the socket, but the # userdb lookups will succeed only if the userdb returns an "uid" field that # matches the caller process's UID. Also if caller's uid or gid matches the # socket's uid or gid the lookup succeeds. Anything else causes a failure. # # To give the caller full permissions to lookup all users, set the mode to # something else than 0666 and Dovecot lets the kernel enforce the # permissions (e.g. 0777 allows everyone full permissions). unix_listener auth-userdb { #mode = 0666 #user = #group = } # Postfix smtp-auth unix_listener /var/spool/postfix/private/auth { mode = 0666 } # Auth process is run as this user. #user = $default_internal_user } ## 10-ssl.conf ## 10-tcpwrapper.conf ## 15-lda.conf ## 15-mailboxes.conf namespace inbox { inbox = yes mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } } ## 20-imap.conf protocol imap { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins imap_sieve } ## 20-lmtp.conf protocol lmtp { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins sieve } ## 20-managesieve.conf ## 90-acl.conf ## 90-plugin.conf ## 90-quota.conf ## 90-sieve.conf plugin { sieve_before = /etc/dovecot/conf.d/custom-sieve/global_before.sieve sieve_after = /etc/dovecot/conf.d/custom-sieve/global_after.sieve sieve_plugins = sieve_imapsieve sieve_extprograms # From elsewhere to Spam folder imapsieve_mailbox1_name = Spam imapsieve_mailbox1_causes = COPY APPEND imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve # From Spam folder to elsewhere imapsieve_mailbox2_name = * imapsieve_mailbox2_from = Spam imapsieve_mailbox2_causes = COPY APPEND imapsieve_mailbox2_before = file:/usr/lib/dovecot/sieve/report-ham.sieve sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment } ## 90-sieve-extprograms.conf Meanwhile I tried a lot of several guides in the internet – nothing of them worked for me – what’s hard to understand because it’s a fresh and simple installation I did. Any help is very appreciated! Thanks Jens

4 6

Oauth2 introspection mode bug(?)
by Scott Q. 01 Jul '24

01 Jul '24

Here goes another oauth2 question, hoping it won't be ignored like all the others. I want to use get/auth on tokeninfo_url but post on introspection_url but dovecot doesn't let me. It doesn't add the auth header on tokeninfo_url whenever introspection_mode == post so, if introspection_mode = post, then dovecot no longer sends auth header to tokeninfo_url . Is this by design, is it a bug ? as can be seen in src/lib-oauth2/oauth2-request.c if (add_auth_bearer && http_client_request_get_origin_url(req->req)->user == NULL && set->introspection_mode == INTROSPECTION_MODE_GET_AUTH) { http_client_request_add_header(req->req, "Authorization", t_strdup_printf("Bearer %s", input->token)); }

2 6

Sieve Symlink Error
by Benjamin Rose 01 Jul '24

01 Jul '24

Hello, I'm in the process of moving our mail server from RHEL 6 to RHEL 9. We will be moving to: # dovecot --version 2.3.16 (7e2e900c1a) My issue is that sieve does not appear to work on the new setup, where it does work on the old one. I made a simple filter rule: # cat /u/mail0test/.sieve/ingo.sieve # Sieve Filter # Generated by Ingo (http://www.horde.org/apps/ingo/) (06/28/2024, 11:14:52 PM) require "fileinto"; # Test if header :comparator "i;ascii-casemap" :contains "Subject" "filtertest" { fileinto "Fun"; stop; } Upon sending an email to this test account, the following appears in /var/log/maillog: Jun 29 23:19:56 mail5 dovecot[3066980]: lda(mail0test)<3066980><FA8fFtzOgGZkzC4AuM9lWg>: Warning: sieve: file storage: Active sieve script symlink /u/mail0test/.dovecot.sieve is broken: Invalid/unknown path to storage (points to /u/mail0test/.sieve). Jun 29 23:19:56 mail5 dovecot[2987026]: doveadm(mail0test)<3066983><KFf4FtzOgGZnzC4AuM9lWg>: Warning: sieve: file storage: Active sieve script symlink /u/mail0test/.dovecot.sieve is broken: Invalid/unknown path to storage (points to /u/mail0test/.sieve). Jun 29 23:19:56 mail5 dovecot[2987026]: doveadm(mail0test)<3067016><VdsdK9zOgGaIzC4AuM9lWg>: Warning: sieve: file storage: Active sieve script symlink /u/mail0test/.dovecot.sieve is broken: Invalid/unknown path to storage (points to /u/mail0test/.sieve). Yet: # ll /u/mail0test/.dovecot.sieve lrwxrwxrwx. 1 mail0test sysguest 17 Jun 28 23:26 /u/mail0test/.dovecot.sieve -> .sieve/ingo.sieve # file /u/mail0test/.sieve/ingo.sieve /u/mail0test/.sieve/ingo.sieve: ASCII text That is the filter file I've pasted above. I've set the following directives in /etc/dovecot/conf.d/90-sieve.conf via puppet: augeas { "dovecot_sieve_settings": context => "/files/etc/dovecot/conf.d/90-sieve.conf", changes => [ "set plugin/sieve_dir ~/.sieve", "set plugin/sieve_user_log ~/.sieve/log" ], require => Package["dovecot"], notify => Service["dovecot"]; } The full configuration dump is attached. /u in our environment is the path for user homedirs, which is an NFS mount to a NetApp. The OS is Springdale Linux 9.2, a clone of RedHat from before the IBM license change. It will soon be RHEL 9.4 as we have obtained a license, but for all intents and purposes, Springdale 9.2 and RHEL 9.2 should be considered bug-for-bug compatible. The arch is x86_64 with both machines mail5 and mail6 (replicated) having Intel(R) Xeon(R) Gold 6244 CPU @ 3.60GHz and 768gb of memory. I have the same issue with SELinux in both enforcing and permissive modes, so this is not a permissions error due to SELinux. Am I doing something wrong, or is this a bug? I've seen that there have been some previous issues similar to this that ended up being bugs in pigeonhole, so here I am. Thanks, Ben

2 3

Glean all from addresses from a users mailbox?
by Austin Witmer 01 Jul '24

01 Jul '24

Hello all! Is there a quick and easy way to search through an entire mailbox for a user on my dovecot server and glean all the “from” email addresses? This user would like a record of all the email addresses who have contacted him. Thanks in advance for your ideas. Austin Witmer

3 2

Timeout when opening folder
by Entrepreneur AJ 28 Jun '24

28 Jun '24

Hi all, I'm stuck with an issue. Migrating everything to a k0s kubernetes cluster, trying to migrate dovecot and all so far seems to be well with PVC for mail storage, ssl working great, authentication vis PostgreSQL working great. Issue is when trying to look at another folder say Deleted or Spam etc folder I am getting a timeout error with no logs. I disabled apparmour on the nodes the try again and the following error message appears; Jun 24 21:01:55 imap-login: Info: Login: user=<eaj>, method=PLAIN, rip=194.207.0.0, lip=10.244.24.235, mpid=15, TLS, session=<eTNaF6kbzJHCz3qg> Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Added userdb setting: mail=maildir:/srv/vmail/eaj Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Effective uid=1000, gid=1000, home=/srv/vmail/eaj Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: open(/proc/self/io) failed: Permission denied Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/srv/vmail/eaj Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: maildir++: root=/srv/vmail/eaj, index=, indexpvt=, control=, inbox=/srv/vmail/eaj, alt= Jun 24 21:01:55 imap(eaj)<14><3PRZF6kb0JHCz3qg>: Debug: Mailbox INBOX: Mailbox opened Jun 24 21:02:24 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Mailbox Sent: Couldn't open mailbox in list index: Storage size changed 160 != 396 Jun 24 21:02:24 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Mailbox Sent: Mailbox opened Jun 24 21:02:24 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Mailbox Drafts: Couldn't open mailbox in list index: Storage size changed 160 != 396 Jun 24 21:02:24 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Mailbox Drafts: Mailbox opened Thunderbird keeps showing a timeout error after a few minutes. Dovecot Version: 2.3.21 (47349e2482) dovecot -n config: # 2.3.21 (47349e2482): /etc/dovecot/dovecot.conf # OS: Linux 5.15.0-112-generic x86_64 # Hostname: dovecot-549bdc98ff-tzwcf auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = yes base_dir = /var/run/dovecot/ first_valid_uid = 1000 import_environment = TZ last_valid_uid = 1000 log_path = /dev/stdout login_greeting = IMAP ready. mail_debug = yes mail_home = /srv/vmail/%n mail_location = maildir:~ namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes imap_compress_deflate_level = 9 mail_crypt_global_private_key = # hidden, use -P to show it mail_crypt_global_public_key = # hidden, use -P to show it mail_crypt_save_version = 2 zlib_save = zstd zlib_save_level = 3 } service auth-worker { user = vmail } service auth { unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { port = 24 } user = vmail } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 ssl = yes } } service submission-login { inet_listener submission { port = 0 } inet_listener submissions { port = 0 } } ssl = required ssl_cert = </etc/dovecot/certs/tls.crt ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-CHACHA20-POLY1305 ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_ssl = yes protocol imap { mail_plugins = postmaster_address = postmaster(a)eajglobal.net } protocol lmtp { mail_plugins = postmaster_address = postmaster(a)eajglobal.net } Any pointers would be highly appreciated.

5 7

Oauth2 remote IP address
by Scott Q. 27 Jun '24

27 Jun '24

Anyone knows how to configure Dovecot to send the real remote ip address of the user to the oauth2 provider ( Keycloak in this case ) ? Right now I see the request as coming from the Dovecot server... Thank you, Scott

1 0

sieve comparator i;unicode-casemap RFC5051
by Alexey 25 Jun '24

25 Jun '24

Hello. Am I right that currently there is no chance to compare non-ascii characters case-insensitive? (UTF-8 strings from inside Subject or Body) I'm looking for :comparator i;unicode-casemap, but can't find it. It is described in RFC5051. Regards, Alexey

1 0

logging computer name
by hp＠hungpham.no 25 Jun '24

25 Jun '24

I am running Dovecot 2.3.21. One client has multiple computers in their LAN, connecting to my server with a static IP. One or several computers in that LAN keep logging in with failed password, but the Dovecot log only shows the public static IP, like this Jun 25 10:39:20 server-name dovecot[689]: imap-login: Disconnected: Connection closed (auth failed, 2 attempts in 62 secs): user=<xxxx(a)domainyyy.com>, method=PLAIN, rip=client-public-IP, lip=server-IP, TLS, session=<MCLxoK4bksIO8zXR> I tried to enable debug, but there is no more information about the LAN IP or computer names. Is there any setting which helps me with that purpose? So it will be much easier to locate the failed computers in that LAN? Thank you.

3 2

Re: Only some of my sent emails are stored in sent-folder
by Joseph Tam 21 Jun '24

21 Jun '24

From: Nils <dovecot(a)bugblatterbeast.de> > Still, there is no filter rule that would apply to that. Additionally, I > only use "fileinto" actions in my filter rules. No, I meant Thunderbird's rules and filters. If your mail reader decides to not save the message, IMAP and Sireve will never see it. Joseph Tam <jtam.home(a)gmail.com>

1 0

Only some of my sent emails are stored in sent-folder
by Nils 21 Jun '24

21 Jun '24

Lots of the emails I send aren't stored in the sent folder. It seems that it mostly (but not always) work for sent emails where the main email-address (the one that is also used as login name) is used as sender. It never seems to work when an alias is used as sender name. There isn't any entry in the mail.err log and nothing that looks suspicious to me in the regular mail.log. I didn't notice it at first, because I usually don't check my sent folder that much, but I it seems to have started when I migrated to the new server a few weeks ago. Any idea what could be the reason for it? Kind regards, Nils Test 1 using main email address (NOT STORED IN SENT FOLDER) Jun 20 20:10:28 SERVER postfix/submission/smtpd[5156]: connect from INTERNET_PROVIDER[IPV6_ADDRESS] Jun 20 20:10:28 SERVER postfix/submission/smtpd[5156]: 3B8B0C0DA8: client=INTERNET_PROVIDER[IPV6_ADDRESS], sasl_method=PLAIN, sasl_username=RECIPIENT(a)SERVER.TLD Jun 20 20:10:28 SERVER postfix/cleanup[5161]: 3B8B0C0DA8: message-id=<bcdc1b7e-e3f1-4a82-8fd9-05dd307313e4(a)SERVER.TLD> Jun 20 20:10:28 SERVER amavis[5197]: (05197-01) Passed CLEAN {AcceptedInbound}, AM.PDP-SOCK [IPV6_ADDRESS] [IPV6_ADDRESS] <RECIPIENT(a)SERVER.TLD> -> <RECIPIENT(a)SERVER.TLD>, Queue-ID: 3B8B0C0DA8, Message-ID: <bcdc1b7e-e3f1-4a82-8fd9-05dd307313e4(a)SERVER.TLD>, mail_id: nv7qsKFzK11D, Hits: 0.975, size: 702, 463 ms Jun 20 20:10:28 SERVER opendkim[1081]: 3B8B0C0DA8: DKIM-Signature field added (s=SERVER.TLD, d=SERVER.TLD) Jun 20 20:10:28 SERVER postfix/qmgr[1792]: 3B8B0C0DA8: from=<RECIPIENT(a)SERVER.TLD>, size=402, nrcpt=1 (queue active) Jun 20 20:10:28 SERVER dovecot: lmtp(5228): Connect from local Jun 20 20:10:28 SERVER dovecot: lmtp(RECIPIENT(a)SERVER.TLD)<5228><cL5iLbSMdGZsFAAAVy37qw>: sieve: msgid=<bcdc1b7e-e3f1-4a82-8fd9-05dd307313e4(a)SERVER.TLD>: stored mail into mailbox 'INBOX' Jun 20 20:10:28 SERVER postfix/lmtp[5227]: 3B8B0C0DA8: to=<RECIPIENT(a)SERVER.TLD>, relay=SERVER.TLD[private/dovecot-lmtp], delay=0.55, delays=0.54/0/0/0.01, dsn=2.0.0, status=sent (250 2.0.0 <RECIPIENT(a)SERVER.TLD> cL5iLbSMdGZsFAAAVy37qw Saved) Jun 20 20:10:28 SERVER dovecot: lmtp(5228): Disconnect from local: Logged out (state=READY) Jun 20 20:10:28 SERVER postfix/qmgr[1792]: 3B8B0C0DA8: removed Jun 20 20:10:28 SERVER dovecot: imap-login: Login: user=<RECIPIENT(a)SERVER.TLD>, method=PLAIN, rip=IPV6_ADDRESS, lip=2a01:4f8:10a:e50::2, mpid=5248, TLS, session=<DdED6FcbbusgAwDKv0yBAGXh6Xy3cdaM> Jun 20 20:10:29 SERVER dovecot: imap(RECIPIENT(a)SERVER.TLD)<5248><DdED6FcbbusgAwDKv0yBAGXh6Xy3cdaM>: Disconnected: Logged out in=496 out=637 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Jun 20 20:10:33 SERVER postfix/submission/smtpd[5156]: disconnect from INTERNET_PROVIDER[IPV6_ADDRESS] ehlo=2 starttls=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=8 Test 2 using alias email address (NOT STORED IN SENT FOLDER) Jun 20 20:10:41 SERVER postfix/submission/smtpd[5156]: connect from INTERNET_PROVIDER[IPV6_ADDRESS] Jun 20 20:10:42 SERVER postfix/submission/smtpd[5156]: 184A5C0DAD: client=INTERNET_PROVIDER[IPV6_ADDRESS], sasl_method=PLAIN, sasl_username=EMAIL(a)SERVER.TLD Jun 20 20:10:42 SERVER postfix/cleanup[5161]: 184A5C0DAD: message-id=<bc2f2025-67e0-4780-9a54-8f06c3b16389(a)SERVER.TLD> Jun 20 20:10:42 SERVER amavis[5196]: (05196-02) Passed CLEAN {AcceptedInbound}, AM.PDP-SOCK [IPV6_ADDRESS] [IPV6_ADDRESS] <ALIAS(a)SERVER.TLD> -> <RECIPIENT(a)SERVER.TLD>, Queue-ID: 184A5C0DAD, Message-ID: <bc2f2025-67e0-4780-9a54-8f06c3b16389(a)SERVER.TLD>, mail_id: ySF-pJQA8aRl, Hits: 0.975, size: 716, 607 ms Jun 20 20:10:42 SERVER opendkim[1081]: 184A5C0DAD: DKIM-Signature field added (s=key1, d=SERVER.TLD) Jun 20 20:10:42 SERVER postfix/qmgr[1792]: 184A5C0DAD: from=<ALIAS(a)SERVER.TLD>, size=408, nrcpt=1 (queue active) Jun 20 20:10:42 SERVER dovecot: lmtp(5228): Connect from local Jun 20 20:10:42 SERVER dovecot: lmtp(RECIPIENT(a)SERVER.TLD)<5228><KCs+LcKMdGZsFAAAVy37qw>: sieve: msgid=<bc2f2025-67e0-4780-9a54-8f06c3b16389(a)SERVER.TLD>: stored mail into mailbox 'INBOX' Jun 20 20:10:42 SERVER dovecot: lmtp(5228): Disconnect from local: Logged out (state=READY) Jun 20 20:10:42 SERVER postfix/lmtp[5227]: 184A5C0DAD: to=<RECIPIENT(a)SERVER.TLD>, relay=SERVER.TLD[private/dovecot-lmtp], delay=0.69, delays=0.68/0/0/0.01, dsn=2.0.0, status=sent (250 2.0.0 <RECIPIENT(a)SERVER.TLD> KCs+LcKMdGZsFAAAVy37qw Saved) Jun 20 20:10:42 SERVER postfix/qmgr[1792]: 184A5C0DAD: removed Jun 20 20:10:47 SERVER postfix/submission/smtpd[5156]: disconnect from INTERNET_PROVIDER[IPV6_ADDRESS] ehlo=2 starttls=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=8 Test 3 using main email address (stored in sent-folder) Jun 20 20:30:24 SERVER postfix/submission/smtpd[5813]: connect from INTERNET_PROVIDER[IPV6_ADDRESS] Jun 20 20:30:25 SERVER postfix/submission/smtpd[5813]: 3F2C1C0DAD: client=INTERNET_PROVIDER[IPV6_ADDRESS], sasl_method=PLAIN, sasl_username=EMAIL(a)SERVER.TLD Jun 20 20:30:25 SERVER postfix/cleanup[5818]: 3F2C1C0DAD: message-id=<603d7b61-d8d1-4099-bbc2-f0d2e9c776ee(a)SERVER.TLD> Jun 20 20:30:26 SERVER amavis[5197]: (05197-02) Passed CLEAN {AcceptedInbound}, AM.PDP-SOCK [IPV6_ADDRESS] [IPV6_ADDRESS] <EMAIL(a)SERVER.TLD> -> <RECIPIENT(a)SERVER.TLD>, Queue-ID: 3F2C1C0DAD, Message-ID: <603d7b61-d8d1-4099-bbc2-f0d2e9c776ee(a)SERVER.TLD>, mail_id: KDDY0Tv2B0Ut, Hits: 0.975, size: 704, 1096 ms Jun 20 20:30:26 SERVER opendkim[1081]: 3F2C1C0DAD: DKIM-Signature field added (s=key1, d=SERVER.TLD) Jun 20 20:30:26 SERVER postfix/qmgr[1792]: 3F2C1C0DAD: from=<EMAIL(a)SERVER.TLD>, size=398, nrcpt=1 (queue active) Jun 20 20:30:26 SERVER dovecot: lmtp(5824): Connect from local Jun 20 20:30:26 SERVER dovecot: lmtp(RECIPIENT(a)SERVER.TLD)<5824><xsEAGWKRdGbAFgAAVy37qw>: sieve: msgid=<603d7b61-d8d1-4099-bbc2-f0d2e9c776ee(a)SERVER.TLD>: stored mail into mailbox 'INBOX' Jun 20 20:30:26 SERVER postfix/lmtp[5823]: 3F2C1C0DAD: to=<RECIPIENT(a)SERVER.TLD>, relay=SERVER.TLD[private/dovecot-lmtp], delay=1.2, delays=1.2/0.01/0.01/0.01, dsn=2.0.0, status=sent (250 2.0.0 <RECIPIENT(a)SERVER.TLD> xsEAGWKRdGbAFgAAVy37qw Saved) Jun 20 20:30:26 SERVER dovecot: lmtp(5824): Disconnect from local: Logged out (state=READY) Jun 20 20:30:26 SERVER postfix/qmgr[1792]: 3F2C1C0DAD: removed Jun 20 20:30:26 SERVER dovecot: imap(EMAIL(a)SERVER.TLD)<5669><5nRfHlgbHIYgAwDKv0yBAGXh6Xy3cdaM>: Disconnected: Logged out in=1228 out=11932 deleted=0 expunged=0 trashed=0 hdr_count=3 hdr_bytes=816 body_count=0 body_bytes=0 Jun 20 20:30:31 SERVER postfix/submission/smtpd[5813]: disconnect from INTERNET_PROVIDER[IPV6_ADDRESS] ehlo=2 starttls=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=8

6 15

RE: Only some of my sent emails are stored in sent-folder
by Joseph Tam 21 Jun '24

21 Jun '24

From: Nils <dovecot(a)bugblatterbeast.de> > Lots of the emails I send aren't stored in the sent folder. It seems > that it mostly (but not always) work for sent emails where the main > email-address (the one that is also used as login name) is used as > sender. It never seems to work when an alias is used as sender name. Sounds to me like some mail reader filtering rule. Ordinarily, dovecot does not handle the capture of outgoing mail, Most of the time, it's the mail reader (MUA) that files outgoing messages to a sent-mail folder, and less commonly, the MTA will do it. Mail readers probably employ their own logic to determine what belongs in the sent mail folder: it could be all outgoing mail, it could be redirected based on some role filter. If you have a repeatable case, check it against your filter rule set. If it's inconsistent (the same message does and does not make it into your sent mail folder), you can look at other causes. Joseph Tam <jtam.home(a)gmail.com>

2 1

Core-dump on SSL connection
by Scott Q. 21 Jun '24

21 Jun '24

I'm on Debian 12.5 which comes with openssl 3.0.11 I compiled Dovecot 2.3.21 with some pretty vanilla options: /configure --prefix=/usr/local/dovecot --with-sql --with-mysql --with-docs --with-ssl --without-shadow --without-pam --without-ldap --without-pgsql --without-sqlite --with-systemd systemunitdir=/lib/systemd/system when I connect to it via SSL it core-dumps: Jun 18 20:50:01 mail kernel: imap-login[396438]: segfault at 69 ip 00007f2e5ee19556 sp 00007fffd7ca38f8 error 4 in libcrypto.so.3[7f2e5ecc5000+279000] likely on CPU 8 (core 8, socket 0) Jun 18 20:50:01 mail kernel: Code: c2 31 d2 31 ff c3 66 0f 1f 44 00 00 31 d2 31 ff c3 0f 1f 00 31 c0 48 85 ff 74 41 48 8b 57 08 8b 87 8c 00 00 00 48 85 d2 74 22 8b 52 68 48 85 d2 74 19 48 83 ec 08 ff d2 31 d2 85 c0 0f 48 c2 Anyone encountered something similar and knows how to fix it ?

4 8

Re: Only some of my sent emails are stored in sent-folder
by Joseph Tam 21 Jun '24

21 Jun '24

From: Nils <dovecot(a)bugblatterbeast.de> > Lots of the emails I send aren't stored in the sent folder. It seems > that it mostly (but not always) work for sent emails where the main > email-address (the one that is also used as login name) is used as > sender. It never seems to work when an alias is used as sender name. Sounds to me like some mail reader filtering rule. Ordinarily, dovecot does not handle the capture of outgoing mail, Most of the time, it's the mail reader (MUA) that files outgoing messages to a sent-mail folder, and less commonly, the MTA will do it. Mail readers probably employ their own logic to determine what belongs in the sent mail folder: it could be all outgoing mail, it could be redirected based on some role filter. If you have a repeatable case, check it against your filter rule set. If it's inconsistent (the same message does and does not make it into your sent mail folder), you can look at other causes. Joseph Tam <jtam.home(a)gmail.com>

1 0

Sieve bug on duplicate extension with MessageID break line
by ricardomachini＠gmail.com 19 Jun '24

19 Jun '24

Hello, I noticed that sieve's duplicate function is not working when the MessageID header has a line break and I have encountered messages originating from Microsoft 365 this way. For example: # test 1 From: <mailto:teste@domain.com.br> teste(a)domain.com.br To: <mailto:cron@domain.com.br> cron(a)domain.com.br Subject: test Message-Id: <mailto:854115.209399851-sendEmail@pa1> 854115.209399851-sendEmail@pa1 Date: Wed, 19 Jun 2024 12:35:16 -0300 (-03) Test # test 2 From: <mailto:teste@domain.com.br> teste(a)domain.com.br To: <mailto:cron@domain.com.br> cron(a)domain.com.br Subject: test Message-ID: <mailto:854115.209399851-sendEmail@pa1> 854115.209399851-sendEmail@pa1 Date: Wed, 19 Jun 2024 12:35:16 -0300 (-03) test # dovecot log Jun 19 12:59:33 server1 dovecot[513090]: lmtp(cron(a)domain.com.br) <mailto:cron@domain.com.br)%3c2993309%3e%3c4AeXHGUAc2adrC0AZCVTkw> <2993309><4AeXHGUAc2adrC0AZCVTkw>: sieve: subject=test from:teste@domain.com.br sender:teste@domain.com.br to: cron(a)domain.com.br <mailto:cron@domain.com.br> size:1010 msgid=854115.209399851-sendEmail@pa1 <mailto:854115.209399851-sendEmail@pa1> status=stored mail into mailbox 'INBOX' delivery_time=3 session_time=1 Jun 19 12:59:35 server1 dovecot[513090]: lmtp(cron(a)domain.com.br) <mailto:cron@domain.com.br)%3c2993309%3e%3csKNOK2cAc2adrC0AZCVTkw> <2993309><sKNOK2cAc2adrC0AZCVTkw>: sieve: subject=test from:teste@domain.com.br sender:teste@domain.com.br to: cron(a)domain.com.br <mailto:cron@domain.com.br> size:1014 msgid=854115.209399851-sendEmail@pa1 <mailto:854115.209399851-sendEmail@pa1> status=stored mail into mailbox 'INBOX' delivery_time=3 session_time=1 # sieve rule require ["duplicate", "fileinto", "envelope", "variables"]; if envelope :matches "from" "*" { set "sender" "${1}"; } if header :matches "subject" "*" { set "subject" "${1}"; } if header :matches "message-id" "*" { if duplicate :seconds 300 :uniqueid "${sender} ${subject} ${0}"{ discard; } } Regards, Ricardo

1 0

sieve issue
by savaw82275＠lisoren.com 19 Jun '24

19 Jun '24

Hi! Having a sieve rule: require ["fileinto", "editheader", "variables", "envelope"]; # rule:[med] if allof (address :contains "to" "info(a)mysite.com", header :contains "subject" "invoice") { deleteheader "from"; addheader "from" "info(a)mysite.com"; redirect "final(a)mysite.com"; } I was receiving: redirect action: failed to redirect message to <final(a)mysite.com>: Sendmail program returned error (temporary failure). Enabled debug log level in dovecot, then got some few further lines on this; program exec:/usr/sbin/sendmail (55356): Terminated with non-zero exit code 75 AND this: Error: sieve: redirect action: failed to redirect message to <final(a)mysite.com: Sendmail program returned error (temporary failure). After 2 hours of Google'ing, I finally found a workaround by adding: submission_host = 95.212.12.10 (IP address of my mail server) in dovecot.conf solved the issue. Can someone explain what was the issue and do you guys think this is a correct solution? Regards.

2 1

Re: Sieve generate a lot of hard link copies of mails in mailboxes
by George Asenov 16 Jun '24

16 Jun '24

Hi John, Thanks for taking your time looking at my issue. On 13-Jun-24 3:42 PM, John Stoffel via dovecot wrote: >>>>>> "George" == George Asenov via dovecot <dovecot(a)dovecot.org> writes: > > I don't have a real suggestion, but I do think you can clarify your problem. > >> No one have idea what is wrong here? >> On 07-Jun-24 4:10 PM, George Asenov via dovecot wrote: >>> Hello, >>> >>> I have very strange issue. Sieve generate copies of users messages i.e. >>> not real copies but hardlinks for the same message. It happens to many >>> messages but not every message and not every time, it is not a single >>> user issue I have couple users with that issue. > > Are you expecting sieve to generate copies? And are the copies in the > same folder or across folders? I.e. do you find an email in the > INBOX, and a hardlink in the SPAM folder? The goal here is when user move messages around imap folders to report them as ham/spam depending on where they originate and where they go. I think Sieve should send copy of the message to Rspamd because otherwise client will see the message dispensary which is not intuitive. Copies are all in the same folder. same message with many hard links placed in the same folder. Mostly happen in Trash and Spam folders. > What are the sizes of these emails? Are they all large? Or have > attachements? Is there anything that's common amongst those emails? Nothing in common as far as I can see. Sizes are verry different mostly small. > One idea might be to setup a test account and to just send it a bunch > of emails to try and make the problem occur. And to also look closely > at the rspamd logs as well. Already done that but I'm unable to reproduce it. > What is the size of the system memory on your dovecot server? And > what is the size of the dovecot.index.cache file when you see this > error? You should be able to delete the index and recreate it using > doveadm. > Servers are with enough RAM the smallest one is 64GB. The memory I'm referring is "vsz_limit=256 MB" and in my opinion it is not the issue but a consequence of the large amount of links in the mail and from there large index file and the result not enough memory to work with. When I delete all the copies the "Out of memory" errors are gone. > But from the sound of it, you have users with many thousands of emails > in a folder or folders. Can you check to see if there's any > relationship between users with larger numbers of hardlinks and those > with large numbers of emails? There are users with large number of mails but only some of them have this issue and some don't. Also there are users with small amount that have it which make them with large number of mails(copies). > And maybe instead of having sieve call rspam, maybe you can put it > into a milter and just have the > Rspamd is on a different server and it is set as a milter in postfix. That is why I use curl to report spam/ham. >>> It happens during auto reporting for spam/ham with sieve. >>> But I'm unable to reproduce it. >>> >>> At some point the hardlinks copies become so many that the mailbox index >>> files become so bug that dovecot start throwing error: >>> ################################ >>> dovecot[3385911]: imap(redacted(a)domain.tld)<1992901><RRBL9PQX69IXfCSs>: >>> Error: Mailbox Junk: mmap(size=520636784) failed with file >>> /var/lib/dovecot-virtualmin/index/redacted(a)domain.tld/.Junk/dovecot.index.cache: Cannot allocate memory >>> ################################ >>> other relevant logs are: >>> >>> dovecot: imap-login: Login: user=<redacted.user>, method=PLAIN, >>> rip=YYY.YYY.YYY.YYY, lip=XXX.XXX.XXX.XXX, mpid=3393763, TLS, >>> session=<c1Z1lPsZuPCAWqqI> >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: >>> learn-spam.sieve was triggered on imap.cause=COPY: >>> msgid=<87584056G78841203D85243127W62181551P@idomziqnd> >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: >>> learn-spam on imap.cause=COPY: from=redacted.mail, to=redacted2.mail, >>> subject=Asseyez-vous confortablement, n'importe où..., >>> msgid=<87584056G78841203D85243127W62181551P@idomziqnd>, >>> X-Spamd-Result=default: False [4.49 / 15.00]; >>> FORGED_RECIPIENTS(2.00)[m:redacted2.mail,s:redacted.user.fr]; >>> BAYES_SPAM(1.89)[88.30%]; MID_RHS_NOT_FQDN(0.50)[]; >>> BAD_REP_POLICIES(0.10)[]; RCVD_NO_TLS_LAST(0.10)[]; >>> MIME_GOOD(-0.10)[multipart/related,multipart/alternative,text/plain]; >>> ASN(0.00)[asn:34300, ipnet:62.173.128.0/19, country:RU]; >>> RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~,5:+]; >>> RCPT_COUNT_ONE(0.00)[1]; MISSING_XM_UA(0.00)[]; ARC_NA(0.00)[]; >>> RCVD_VIA_SMTP_AUTH(0.00)[]; GREYLIST(0.00)[pass,body]; >>> R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; >>> R_SPF_ALLOW(0.00)[+mx]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[or.mg]; >>> NEURAL_SPAM(0.00)[0.000] >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: >>> learn-spam send to rspamd spam >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: program >>> exec:/var/lib/dovecot/sieve/rspamd-learn-spam.sh (3397238): Terminated >>> with non-zero exit code 1 >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: Error: sieve: >>> failed to execute to program `rspamd-learn-spam.sh': refer to server log >>> for more information. [2024-06-03 07:36:40] >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: Disconnected: >>> Connection closed (UID FETCH finished 32.173 secs ago) in=2914 out=39237 >>> deleted=1 expunged=1 trashed=0 hdr_count=14 hdr_bytes=10705 body_count=1 >>> body_bytes=1606 >>> >>> I know that this is because the mail which is reported is too big for >>> curl but documentation say that > > Wait, how large is this email you're trying to process? So once you > have rspamd-learn-spam.sh crash on you, then you are really having an > rspam problem. Do you really need to scan large attachements? The "crash" is an error from curl because the mail is too big to send it inline as I pipe it, > What is your rspam configuration? And have you talked to people on > the rspamd mailing list on how to configure things? Rspamd is on a diffrent machine and I think it is not to blame here. > >>> $$$$$$$$$$$$$$$$$ >>> pipe :copy :try "rspamd-learn-spam.sh"; >>> $$$$$$$$$$$$$$$$$ >>> this should ignore the error. >>> I have tested also to change it like that: >>> $$$$$$$$$$$$$$$$$ >>> pipe :copy "rspamd-learn-spam.sh"; >>> $$$$$$$$$$$$$$$$$ >>> but the issue still persists > > So why are you doing a :copy here? If you're trying to say this email > is spam, why not just move it to your spam folder, and then have > rspamd go through your junk folder once a day instead? Because this should be kind of invisible to users. They move mails between folders and in the background they report as spam/ham > Have you looked at the system logs for memory problems when these > hardlink files are created? Are you running out of memory on general > on this mail server? > No memory problems on the machine itself there is plenty of free Ram > Instead of focusing on dovecot, back up a level and think about the > resources allocated to the whole system, and what types of mail > messages are showing this problem. How are they alike? What is your > mail volume? Does the problem happen when you get lots of emails, or > is it really random? It is not the amount of messages coming if I comment out the config executing spam/ham reporting and clean up the hardlinks the issue didn't show up for months. > Do you have old rspamd processes hanging around taking up resources? Rspamd can't make copies on that machine because it is on a separate server. > > Good luck! > John > > > > >>> I can't confirm that the issue is that error because these errors are >>> way less than the messages with hardlink copies. >>> Also sometimes one mail have more than two hardlinks to it. >>> ######################################## >>> here is a example: >>> >>> inode# hardlink_count filename >>> 2430090371 23850 >>> ./Maildir/.Trash/cur/1714190559.M355157P25776.redacted.hostname,S=39259,W=40217:2,S >>> 2430090371 23850 >>> ./Maildir/.Trash/cur/1714190562.M259778P25902.redacted.hostname,S=39259,W=40217:2,S >>> 2430090371 23850 >>> ./Maildir/.Trash/cur/1714190565.M188090P26028.redacted.hostname,S=39259,W=40217:2,S >>> 2430090371 23850 >>> ./Maildir/.Trash/cur/1714190568.M340582P26179.redacted.hostname,S=39259,W=40217:2,S >>> >>> yes this is "23850" hardlinks to the same Inode >>> ####################################### >>> The issue is somewhere in the sieve ham/spam reporting to rspamd but >>> cant figure out where and why. >>> >>> Is this a bug or my configuration is wrong? >>> >>> >>> Here are all related configurations (feel free to ask for more if needed): >>> ###################################################################### >>> # doveconf -n >>> # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf >>> # Pigeonhole version 0.5.16 (09c29328) >>> # OS: Linux 4.18.0-513.24.1.el8_9.x86_64 x86_64 Rocky Linux release 8.9 >>> (Green Obsidian) >>> # Hostname: redacteddomain.tld >>> auth_mechanisms = plain login >>> disable_plaintext_auth = no >>> first_valid_uid = 1000 >>> mail_location = >>> maildir:~/Maildir:INDEX=/var/lib/dovecot-virtualmin/index/%u:CONTROL=/var/lib/dovecot-virtualmin/control/%u >>> managesieve_notify_capability = mailto >>> managesieve_sieve_capability = fileinto reject envelope >>> encoded-character vacation subaddress comparator-i;ascii-numeric >>> relational regex imap4flags copy include variables body enotify >>> environment mailbox date index ihave duplicate mime >>> foreverypart extracttext vacation-seconds imapsieve vnd.dovecot.imapsieve >>> mbox_write_locks = fcntl >>> namespace inbox { >>> inbox = yes >>> location = >>> mailbox Drafts { >>> auto = subscribe >>> special_use = \Drafts >>> } >>> mailbox Junk { >>> auto = create >>> special_use = \Junk >>> } >>> mailbox Sent { >>> auto = subscribe >>> special_use = \Sent >>> } >>> mailbox "Sent Messages" { >>> special_use = \Sent >>> } >>> mailbox Trash { >>> auto = subscribe >>> special_use = \Trash >>> } >>> mailbox spam { >>> auto = subscribe >>> special_use = \Junk >>> } >>> prefix = >>> } >>> passdb { >>> driver = pam >>> } >>> plugin { >>> imapsieve_mailbox1_before = file:/var/lib/dovecot/sieve/learn-spam.sieve >>> imapsieve_mailbox1_causes = COPY >>> imapsieve_mailbox1_name = spam >>> imapsieve_mailbox2_before = file:/var/lib/dovecot/sieve/learn-ham.sieve >>> imapsieve_mailbox2_causes = COPY >>> imapsieve_mailbox2_from = spam >>> imapsieve_mailbox2_name = * >>> imapsieve_mailbox3_before = file:/var/lib/dovecot/sieve/learn-spam.sieve >>> imapsieve_mailbox3_causes = COPY >>> imapsieve_mailbox3_name = Junk >>> imapsieve_mailbox4_before = file:/var/lib/dovecot/sieve/learn-ham.sieve >>> imapsieve_mailbox4_causes = COPY >>> imapsieve_mailbox4_from = Junk >>> imapsieve_mailbox4_name = * >>> quota = fs:user userquota >>> quota2 = fs:group groupquota >>> quota_grace = 100M >>> quota_warning = storage=95%% quota-warning 95 %n %d >>> quota_warning2 = storage=90%% quota-warning 90 %n %d >>> quota_warning3 = storage=80%% quota-warning 80 %n %d >>> sieve = file:~/sieve;active=~/.dovecot.sieve >>> sieve_before = /var/lib/dovecot/sieve/before-global.sieve >>> sieve_extensions = +vacation-seconds >>> sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment >>> +vnd.dovecot.debug >>> sieve_pipe_bin_dir = /var/lib/dovecot/sieve >>> sieve_plugins = sieve_extprograms sieve_imapsieve >>> sieve_vacation_default_period = 10d >>> sieve_vacation_max_period = 30d >>> sieve_vacation_min_period = 1h >>> } >>> protocols = imap pop3 lmtp sieve >>> process_min_avail = 5 >>> service_count = 0 >>> } >>> service imap { >>> process_limit = 400 >>> } >>> service lmtp { >>> unix_listener /var/spool/postfix/private/dovecot-lmtp { >>> group = postfix >>> mode = 01224 >>> user = postfix >>> } >>> } >>> service pop3 { >>> process_limit = 200 >>> } >>> service quota-warning { >>> executable = script /var/lib/dovecot/quota-warning.sh >>> service_count = 1 >>> unix_listener quota-warning { >>> group = dovecot >>> mode = 0666 >>> user = dovecot >>> } >>> } >>> ssl_ca = </etc/pki/dovecot/certs/ca.pem >>> ssl_cert = </etc/pki/dovecot/certs/dovecot.pem >>> ssl_cipher_list = >>> ECDHE-RSA-AES256-SHA384:AES256-SHA256:AES256-SHA256:!RC4:HIGH:MEDIUM:+TLSv1:+TLSv1.1:+TLSv1.2:!MD5:!ADH:!aNULL:!eNULL:!NULL:!DH:!ADH:!EDH:!AESGCM >>> ssl_key = # hidden, use -P to show it >>> userdb { >>> driver = passwd >>> } >>> protocol lmtp { >>> mail_plugins = " sieve" >>> userdb { >>> args = username_format=%n /etc/passwd >>> driver = passwd-file >>> name = >>> } >>> } >>> protocol imap { >>> mail_plugins = " imap_quota imap_sieve quota" >>> } >>> >>> ###################################################################### >>> >>> # cat /var/lib/dovecot/sieve/learn-spam.sieve >>> require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", >>> "imap4flags", "vnd.dovecot.debug", "variables"]; >>> >>> # Logging >>> if address :matches "from" "*" { set "FROM" "${1}"; } >>> if address :matches "to" "*" { set "TO" "${1}"; } >>> if header :matches "subject" "*" { set "SUBJECT" "${1}"; } >>> if header :matches "Message-ID" "*" { set "MSGID" "${1}"; } >>> if header :matches "X-Spamd-Result" "*" { set "XSpamdResult" "${1}"; } >>> if environment :matches "imap.cause" "*" { set "IMAPCAUSE" "${1}"; } >>> debug_log "learn-spam.sieve was triggered on imap.cause=${IMAPCAUSE}: >>> msgid=${MSGID}"; >>> set "LogMsg" "learn-spam on imap.cause=${IMAPCAUSE}: from=${FROM}, >>> to=${TO}, subject=${SUBJECT}, msgid=${MSGID}, >>> X-Spamd-Result=${XSpamdResult}"; >>> >>> # Spam-learning by sending copy with curl to rspmd >>> if anyof (environment :is "imap.cause" "COPY", environment :is >>> "imap.cause" "APPEND") { >>> debug_log "${LogMsg}"; >>> debug_log "learn-spam send to rspamd spam"; >>> pipe :copy :try "rspamd-learn-spam.sh"; >>> } >>> # Catch replied or forwarded spam and send to rspamd ham >>> elsif anyof (allof (hasflag "\\Answered", environment :contains >>> "imap.changedflags" "\\Answered"), >>> allof (hasflag "$Forwarded", environment :contains >>> "imap.changedflags" "$Forwarded")) { >>> debug_log "${LogMsg}"; >>> debug_log "learn-spam send to rspamd ham"; >>> pipe :copy :try "rspamd-learn-ham.sh"; >>> } >>> ###################################################################### >>> >>> cat /var/lib/dovecot/sieve/learn-ham.sieve >>> require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", >>> "variables", "vnd.dovecot.debug"]; >>> >>> # Exclude messages which were moved to Trash (or training mailboxes) >>> from ham learning >>> if environment :matches "imap.mailbox" "*" { >>> set "mailbox" "${1}"; >>> } >>> if string "${mailbox}" [ "INBOX/Trash", "INBOX/Deleted Items", >>> "INBOX/Bin", "INBOX/train_ham", "INBOX/train_prob", "INBOX/train_spam", >>> "Trash" ] { >>> stop; >>> } >>> >>> # Logging >>> if address :matches "from" "*" { set "FROM" "${1}"; } >>> if address :matches "to" "*" { set "TO" "${1}"; } >>> if header :matches "subject" "*" { set "SUBJECT" "${1}"; } >>> if header :matches "Message-ID" "*" { set "MSGID" "${1}"; } >>> if header :matches "X-Spamd-Result" "*" { set "XSpamdResult" "${1}"; } >>> if environment :matches "imap.cause" "*" { set "IMAPCAUSE" "${1}"; } >>> debug_log "learn-ham on imap.cause=${IMAPCAUSE}: from=${FROM}, to=${TO}, >>> subject=${SUBJECT}, msgid=${MSGID}, X-Spamd-Result=${XSpamdResult}"; >>> >>> # Ham-learning sending a copy of the message to rspamd >>> debug_log "learn-ham send to rspamd ham"; >>> pipe :copy :try "rspamd-learn-ham.sh"; >>> ###################################################################### >>> >>> cat /var/lib/dovecot/sieve/rspamd-learn-ham.sh >>> #!/bin/bash >>> >>> function log_error() { echo `date '+%Y-%m-%d %H:%M:%S'` ERROR: $1 >&2; } >>> function log() { echo `date '+%Y-%m-%d %H:%M:%S'` INFO: $1; } >>> >>> MAIL=$(tee) >>> SERVER_LIST=("redacted.tld") #rspamd server >>> >>> PASSWORD="redacted" >>> >>> >>> for SERVER in ${SERVER_LIST[@]}; do >>> log "Trying to report spam to ${SERVER}" >>> RETURN=$(/usr/bin/curl -s --connect-timeout 1 -H "Password: >>> ${PASSWORD}" --data-binary --url "http://${SERVER}:11334/learnham" -d >>> "${MAIL}") >>> STATUS=$? >>> if [ $STATUS -eq 0 ]; then >>> log "Spam reported to ${SERVER}: ${RETURN}" >>> exit 0 >>> else >>> if [ $STATUS -eq 28 ]; then >>> log_error "Reporting SPAM to ${SERVER} failed: Connection >>> timed out." >>> else >>> log_error "Reporting SPAM to ${SERVER} failed: CURL exit >>> status ${STATUS}" >>> fi >>> fi >>> done >>> >>> log_error "Reporting SPAM failed ${SERVERS[@]}" >>> exit 1 >>> ###################################################################### >>> >>> cat /var/lib/dovecot/sieve/rspamd-learn-spam.sh >>> #!/bin/bash >>> >>> function log_error() { echo `date '+%Y-%m-%d %H:%M:%S'` ERROR: $1 >&2; } >>> function log() { echo `date '+%Y-%m-%d %H:%M:%S'` INFO: $1; } >>> >>> MAIL=$(tee) >>> SERVER_LIST=("redacted.tld") #rspamd server >>> PASSWORD="redacted" >>> >>> >>> >>> for SERVER in ${SERVER_LIST[@]}; do >>> log "Trying to report spam to ${SERVER}" >>> RETURN=$(/usr/bin/curl -s --connect-timeout 1 -H "Password: >>> ${PASSWORD}" --data-binary --url "http://${SERVER}:11334/learnspam" -d >>> "${MAIL}") >>> STATUS=$? >>> if [ $STATUS -eq 0 ]; then >>> log "Spam reported to ${SERVER}: ${RETURN}" >>> exit 0 >>> else >>> if [ $STATUS -eq 28 ]; then >>> log_error "Reporting SPAM to ${SERVER} failed: Connection >>> timed out." >>> else >>> log_error "Reporting SPAM to ${SERVER} failed: CURL exit >>> status ${STATUS}" >>> fi >>> fi >>> done >>> >>> log_error "Reporting SPAM failed ${SERVERS[@]}" >>> exit 1 >>> ###################################################################### >>> >>> without all "imapsieve_mailbox.* " directives the problem is gone. >>> >>> >>> Thanks to everyone in advance. >>> > >> -- >> Warm regards >> George A. >> WPXHosting >> _______________________________________________ >> dovecot mailing list -- dovecot(a)dovecot.org >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > _______________________________________________ > dovecot mailing list -- dovecot(a)dovecot.org > To unsubscribe send an email to dovecot-leave(a)dovecot.org -- Warm regards George A.

2 3

Sieve generate a lot of hard link copies of mails in mailboxes
by George Asenov 13 Jun '24

13 Jun '24

Hello, I have very strange issue. Sieve generate copies of users messages i.e. not real copies but hardlinks for the same message. It happens to many messages but not every message and not every time, it is not a single user issue I have couple users with that issue. It happens during auto reporting for spam/ham with sieve. But I'm unable to reproduce it. At some point the hardlinks copies become so many that the mailbox index files become so bug that dovecot start throwing error: ################################ dovecot[3385911]: imap(redacted(a)domain.tld)<1992901><RRBL9PQX69IXfCSs>: Error: Mailbox Junk: mmap(size=520636784) failed with file /var/lib/dovecot-virtualmin/index/redacted(a)domain.tld/.Junk/dovecot.index.cache: Cannot allocate memory ################################ other relevant logs are: dovecot: imap-login: Login: user=<redacted.user>, method=PLAIN, rip=YYY.YYY.YYY.YYY, lip=XXX.XXX.XXX.XXX, mpid=3393763, TLS, session=<c1Z1lPsZuPCAWqqI> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: learn-spam.sieve was triggered on imap.cause=COPY: msgid=<87584056G78841203D85243127W62181551P@idomziqnd> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: learn-spam on imap.cause=COPY: from=redacted.mail, to=redacted2.mail, subject=Asseyez-vous confortablement, n'importe où..., msgid=<87584056G78841203D85243127W62181551P@idomziqnd>, X-Spamd-Result=default: False [4.49 / 15.00]; FORGED_RECIPIENTS(2.00)[m:redacted2.mail,s:redacted.user.fr]; BAYES_SPAM(1.89)[88.30%]; MID_RHS_NOT_FQDN(0.50)[]; BAD_REP_POLICIES(0.10)[]; RCVD_NO_TLS_LAST(0.10)[]; MIME_GOOD(-0.10)[multipart/related,multipart/alternative,text/plain]; ASN(0.00)[asn:34300, ipnet:62.173.128.0/19, country:RU]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~,5:+]; RCPT_COUNT_ONE(0.00)[1]; MISSING_XM_UA(0.00)[]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; GREYLIST(0.00)[pass,body]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(0.00)[+mx]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[or.mg]; NEURAL_SPAM(0.00)[0.000] dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: learn-spam send to rspamd spam dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: program exec:/var/lib/dovecot/sieve/rspamd-learn-spam.sh (3397238): Terminated with non-zero exit code 1 dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: Error: sieve: failed to execute to program `rspamd-learn-spam.sh': refer to server log for more information. [2024-06-03 07:36:40] dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: Disconnected: Connection closed (UID FETCH finished 32.173 secs ago) in=2914 out=39237 deleted=1 expunged=1 trashed=0 hdr_count=14 hdr_bytes=10705 body_count=1 body_bytes=1606 I know that this is because the mail which is reported is too big for curl but documentation say that $$$$$$$$$$$$$$$$$ pipe :copy :try "rspamd-learn-spam.sh"; $$$$$$$$$$$$$$$$$ this should ignore the error. I have tested also to change it like that: $$$$$$$$$$$$$$$$$ pipe :copy "rspamd-learn-spam.sh"; $$$$$$$$$$$$$$$$$ but the issue still persists I can't confirm that the issue is that error because these errors are way less than the messages with hardlink copies. Also sometimes one mail have more than two hardlinks to it. ######################################## here is a example: inode# hardlink_count filename 2430090371 23850 ./Maildir/.Trash/cur/1714190559.M355157P25776.redacted.hostname,S=39259,W=40217:2,S 2430090371 23850 ./Maildir/.Trash/cur/1714190562.M259778P25902.redacted.hostname,S=39259,W=40217:2,S 2430090371 23850 ./Maildir/.Trash/cur/1714190565.M188090P26028.redacted.hostname,S=39259,W=40217:2,S 2430090371 23850 ./Maildir/.Trash/cur/1714190568.M340582P26179.redacted.hostname,S=39259,W=40217:2,S yes this is "23850" hardlinks to the same Inode ####################################### The issue is somewhere in the sieve ham/spam reporting to rspamd but cant figure out where and why. Is this a bug or my configuration is wrong? Here are all related configurations (feel free to ask for more if needed): ###################################################################### # doveconf -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 4.18.0-513.24.1.el8_9.x86_64 x86_64 Rocky Linux release 8.9 (Green Obsidian) # Hostname: redacteddomain.tld auth_mechanisms = plain login disable_plaintext_auth = no first_valid_uid = 1000 mail_location = maildir:~/Maildir:INDEX=/var/lib/dovecot-virtualmin/index/%u:CONTROL=/var/lib/dovecot-virtualmin/control/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds imapsieve vnd.dovecot.imapsieve mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox spam { auto = subscribe special_use = \Junk } prefix = } passdb { driver = pam } plugin { imapsieve_mailbox1_before = file:/var/lib/dovecot/sieve/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = spam imapsieve_mailbox2_before = file:/var/lib/dovecot/sieve/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = spam imapsieve_mailbox2_name = * imapsieve_mailbox3_before = file:/var/lib/dovecot/sieve/learn-spam.sieve imapsieve_mailbox3_causes = COPY imapsieve_mailbox3_name = Junk imapsieve_mailbox4_before = file:/var/lib/dovecot/sieve/learn-ham.sieve imapsieve_mailbox4_causes = COPY imapsieve_mailbox4_from = Junk imapsieve_mailbox4_name = * quota = fs:user userquota quota2 = fs:group groupquota quota_grace = 100M quota_warning = storage=95%% quota-warning 95 %n %d quota_warning2 = storage=90%% quota-warning 90 %n %d quota_warning3 = storage=80%% quota-warning 80 %n %d sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /var/lib/dovecot/sieve/before-global.sieve sieve_extensions = +vacation-seconds sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment +vnd.dovecot.debug sieve_pipe_bin_dir = /var/lib/dovecot/sieve sieve_plugins = sieve_extprograms sieve_imapsieve sieve_vacation_default_period = 10d sieve_vacation_max_period = 30d sieve_vacation_min_period = 1h } protocols = imap pop3 lmtp sieve process_min_avail = 5 service_count = 0 } service imap { process_limit = 400 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 01224 user = postfix } } service pop3 { process_limit = 200 } service quota-warning { executable = script /var/lib/dovecot/quota-warning.sh service_count = 1 unix_listener quota-warning { group = dovecot mode = 0666 user = dovecot } } ssl_ca = </etc/pki/dovecot/certs/ca.pem ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = ECDHE-RSA-AES256-SHA384:AES256-SHA256:AES256-SHA256:!RC4:HIGH:MEDIUM:+TLSv1:+TLSv1.1:+TLSv1.2:!MD5:!ADH:!aNULL:!eNULL:!NULL:!DH:!ADH:!EDH:!AESGCM ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol lmtp { mail_plugins = " sieve" userdb { args = username_format=%n /etc/passwd driver = passwd-file name = } } protocol imap { mail_plugins = " imap_quota imap_sieve quota" } ###################################################################### # cat /var/lib/dovecot/sieve/learn-spam.sieve require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", "imap4flags", "vnd.dovecot.debug", "variables"]; # Logging if address :matches "from" "*" { set "FROM" "${1}"; } if address :matches "to" "*" { set "TO" "${1}"; } if header :matches "subject" "*" { set "SUBJECT" "${1}"; } if header :matches "Message-ID" "*" { set "MSGID" "${1}"; } if header :matches "X-Spamd-Result" "*" { set "XSpamdResult" "${1}"; } if environment :matches "imap.cause" "*" { set "IMAPCAUSE" "${1}"; } debug_log "learn-spam.sieve was triggered on imap.cause=${IMAPCAUSE}: msgid=${MSGID}"; set "LogMsg" "learn-spam on imap.cause=${IMAPCAUSE}: from=${FROM}, to=${TO}, subject=${SUBJECT}, msgid=${MSGID}, X-Spamd-Result=${XSpamdResult}"; # Spam-learning by sending copy with curl to rspmd if anyof (environment :is "imap.cause" "COPY", environment :is "imap.cause" "APPEND") { debug_log "${LogMsg}"; debug_log "learn-spam send to rspamd spam"; pipe :copy :try "rspamd-learn-spam.sh"; } # Catch replied or forwarded spam and send to rspamd ham elsif anyof (allof (hasflag "\\Answered", environment :contains "imap.changedflags" "\\Answered"), allof (hasflag "$Forwarded", environment :contains "imap.changedflags" "$Forwarded")) { debug_log "${LogMsg}"; debug_log "learn-spam send to rspamd ham"; pipe :copy :try "rspamd-learn-ham.sh"; } ###################################################################### cat /var/lib/dovecot/sieve/learn-ham.sieve require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", "variables", "vnd.dovecot.debug"]; # Exclude messages which were moved to Trash (or training mailboxes) from ham learning if environment :matches "imap.mailbox" "*" { set "mailbox" "${1}"; } if string "${mailbox}" [ "INBOX/Trash", "INBOX/Deleted Items", "INBOX/Bin", "INBOX/train_ham", "INBOX/train_prob", "INBOX/train_spam", "Trash" ] { stop; } # Logging if address :matches "from" "*" { set "FROM" "${1}"; } if address :matches "to" "*" { set "TO" "${1}"; } if header :matches "subject" "*" { set "SUBJECT" "${1}"; } if header :matches "Message-ID" "*" { set "MSGID" "${1}"; } if header :matches "X-Spamd-Result" "*" { set "XSpamdResult" "${1}"; } if environment :matches "imap.cause" "*" { set "IMAPCAUSE" "${1}"; } debug_log "learn-ham on imap.cause=${IMAPCAUSE}: from=${FROM}, to=${TO}, subject=${SUBJECT}, msgid=${MSGID}, X-Spamd-Result=${XSpamdResult}"; # Ham-learning sending a copy of the message to rspamd debug_log "learn-ham send to rspamd ham"; pipe :copy :try "rspamd-learn-ham.sh"; ###################################################################### cat /var/lib/dovecot/sieve/rspamd-learn-ham.sh #!/bin/bash function log_error() { echo `date '+%Y-%m-%d %H:%M:%S'` ERROR: $1 >&2; } function log() { echo `date '+%Y-%m-%d %H:%M:%S'` INFO: $1; } MAIL=$(tee) SERVER_LIST=("redacted.tld") #rspamd server PASSWORD="redacted" for SERVER in ${SERVER_LIST[@]}; do log "Trying to report spam to ${SERVER}" RETURN=$(/usr/bin/curl -s --connect-timeout 1 -H "Password: ${PASSWORD}" --data-binary --url "http://${SERVER}:11334/learnham" -d "${MAIL}") STATUS=$? if [ $STATUS -eq 0 ]; then log "Spam reported to ${SERVER}: ${RETURN}" exit 0 else if [ $STATUS -eq 28 ]; then log_error "Reporting SPAM to ${SERVER} failed: Connection timed out." else log_error "Reporting SPAM to ${SERVER} failed: CURL exit status ${STATUS}" fi fi done log_error "Reporting SPAM failed ${SERVERS[@]}" exit 1 ###################################################################### cat /var/lib/dovecot/sieve/rspamd-learn-spam.sh #!/bin/bash function log_error() { echo `date '+%Y-%m-%d %H:%M:%S'` ERROR: $1 >&2; } function log() { echo `date '+%Y-%m-%d %H:%M:%S'` INFO: $1; } MAIL=$(tee) SERVER_LIST=("redacted.tld") #rspamd server PASSWORD="redacted" for SERVER in ${SERVER_LIST[@]}; do log "Trying to report spam to ${SERVER}" RETURN=$(/usr/bin/curl -s --connect-timeout 1 -H "Password: ${PASSWORD}" --data-binary --url "http://${SERVER}:11334/learnspam" -d "${MAIL}") STATUS=$? if [ $STATUS -eq 0 ]; then log "Spam reported to ${SERVER}: ${RETURN}" exit 0 else if [ $STATUS -eq 28 ]; then log_error "Reporting SPAM to ${SERVER} failed: Connection timed out." else log_error "Reporting SPAM to ${SERVER} failed: CURL exit status ${STATUS}" fi fi done log_error "Reporting SPAM failed ${SERVERS[@]}" exit 1 ###################################################################### without all "imapsieve_mailbox.* " directives the problem is gone. Thanks to everyone in advance. -- Warm regards George A. WPXHosting

2 2

"Read the 'bug reports page' …" -> 404
by H. Thiele 13 Jun '24

13 Jun '24

Hi there, while investigating how to possibly report issues to the Dovecot project I noticed that the link to the "bug reports page" in the "mailing list" section on dovecot.org is broken and leads to a 404. https://www.dovecot.org/mailing-lists/ -> "Read the 'bug reports page' before posting a bug report. …" -> "The page you are looking for is not found" regards, H. Thiele

8 10

Re: "Read the 'bug reports page' …" -> 404
by H. Thiele 13 Jun '24

13 Jun '24

I also noticed this affects local documentation in the Dovecot release (v2.3.21), e.g. the old URL is referenced in many of the man files that get installed. It is probably a good idea to setup a 301 redirect rather than just dumping a 404 on the website too. On 12/06/24 8:05 AM, aki.tuomi wrote: > Thanks for letting us know. We'll fix this soon, use > https://dovecot.org/bugreport-mail > > Aki > > -------- Original message -------- > From: "H. Thiele via dovecot" <dovecot(a)dovecot.org> > Date: 6/12/24 06:49 (GMT+00:00) > To: dovecot(a)dovecot.org > Subject: "Read the 'bug reports page' …" -> 404 > > > Hi there, > > while investigating how to possibly report issues to the Dovecot > project I noticed that the link to the "bug reports page" in > the "mailing list" section on dovecot.org is broken and leads to > a 404. > > > https://www.dovecot.org/mailing-lists/ -> > "Read the 'bug reports page' before posting a bug report. …" > > -> "The page you are looking for is not found" > > > > regards, > H. Thiele > _______________________________________________ > dovecot mailing list -- dovecot(a)dovecot.org > To unsubscribe send an email to dovecot-leave(a)dovecot.org >

1 0

Duplicate "cache" in doveadm's help text
by H. Thiele 12 Jun '24

12 Jun '24

1 0

how to disable port 143
by Jeff Peng 10 Jun '24

10 Jun '24

Hello, I have commented out this line in 10-master.conf: service imap-login { inet_listener imap { #port = 143 } But this doesn't close the port 143. So I have changed it to: service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } This let port 143 listen on local address. my question, is it possible to close port 143 entirely in dovecot? Thanks.

5 8

Lots of "Corrupted dbox file" errors in log
by simon＠simonliebold.de 10 Jun '24

10 Jun '24

Hi, I'm leaving this here for others who may see the same issue and are equally perplexed as I was: Dovecot version 2.3.16 w/ sdbox mailbox format. Yesterday, I noticed that I did not see any new mail in Thunderbird. But for whatever reason, new mail did show up on my phone with K9 mail. So, new mails were retained. In the Dovecot logs, I was seeing multiple errors: Corrupted dbox file read() failed for file No buffer space available EOF while reading file header Mailbox INBOX: sdbox: Rebuilding failed Mailbox INBOX: Deleting corrupted cache: reset_id mismatch even after locking The "Corrupted dbox file" and "EOF while reading file header" error was caused by a message file in the INBOX mailbox that was 6681 bytes in size and had all NUL characters. File date of that file was more than two years ago. The "No buffer space available" error was caused by a file that also had a lot of NUL, but also a few other characters in it. Nothing resembling regular message files with headers and body. In total it was a handful of files causing issues. I deleted them all with: doveadm expunge -u {user} MAILBOX INBOX UID {filename without the leading 'u.'} Afterwards Thunderbird showed new mails again. I did not need to restart it. No more errors in the Dovecot logs. Not sure what had caused this. Maybe somebody has seen this before. Simon

1 0

[Patch] Allow sieve redirects to specified domains only
by Kadlecsik József 10 Jun '24

10 Jun '24

Hello, The use case is simple: we have to forbid sieve redirects to outside, but should be able to redirect inside. The patch below adds a new sieve configuration option sieve_allowed_redirects to list the domains to which redirects are permitted and otherwise are not allowed. Please consider it. diff --git a/pigeonhole/doc/example-config/conf.d/90-sieve.conf b/pigeonhole/doc/example-config/conf.d/90-sieve.conf index 238bcf4..3b4ac65 100644 --- a/pigeonhole/doc/example-config/conf.d/90-sieve.conf +++ b/pigeonhole/doc/example-config/conf.d/90-sieve.conf @@ -126,6 +126,10 @@ plugin { # script execution. If set to 0, no redirect actions are allowed. #sieve_max_redirects = 4 + # The comma/space separated list of email domains where redirection is allowed. + # If the list is empty, there is no restriction. + sieve_allowed_redirects = + # The maximum number of personal Sieve scripts a single user can have. If set # to 0, no limit on the number of scripts is enforced. # (Currently only relevant for ManageSieve) diff --git a/pigeonhole/src/lib-sieve/cmd-redirect.c b/pigeonhole/src/lib-sieve/cmd-redirect.c index 6a3b0a4..17e9031 100644 --- a/pigeonhole/src/lib-sieve/cmd-redirect.c +++ b/pigeonhole/src/lib-sieve/cmd-redirect.c @@ -107,6 +107,24 @@ const struct sieve_action_def act_redirect = { .commit = act_redirect_commit, }; +static bool +cmd_redirect_allowed(struct sieve_instance *svinst, + const struct smtp_address *to_address) +{ + const char **domain; + bool result = TRUE; + + if (!svinst->allowed_redirects) + return TRUE; + for (domain = svinst->allowed_redirects; *domain != NULL; ++domain) { + if (strcasecmp(*domain, to_address->domain) == 0) { + return TRUE; + } + result = FALSE; + } + return result; +} + /* * Validation */ @@ -127,6 +145,12 @@ cmd_redirect_validate(struct sieve_validator *validator, if (!sieve_validator_argument_activate(validator, cmd, arg, FALSE)) return FALSE; + if (svinst->max_redirects == 0) { + sieve_command_validate_error(validator, cmd, + "local policy prohibits the use of a redirect action"); + return FALSE; + } + /* We can only assess the validity of the outgoing address when it is * a string literal. For runtime-generated strings this needs to be * done at runtime. @@ -148,14 +172,17 @@ cmd_redirect_validate(struct sieve_validator *validator, } } T_END; + if (!result && + !cmd_redirect_allowed(svinst, + sieve_address_parse_str(raw_address, &error))) { + sieve_command_validate_error(validator, cmd, + "local policy prohibits the use of a redirect action"); + return FALSE; + } + return result; } - if (svinst->max_redirects == 0) { - sieve_command_validate_error(validator, cmd, - "local policy prohibits the use of a redirect action"); - return FALSE; - } return TRUE; } @@ -238,6 +265,11 @@ cmd_redirect_operation_execute(const struct sieve_runtime_env *renv, "local policy prohibits the use of a redirect action"); return SIEVE_EXEC_FAILURE; } + if (!cmd_redirect_allowed(svinst, to_address)) { + sieve_runtime_error(renv, NULL, + "local policy prohibits the use of a redirect action"); + return SIEVE_EXEC_FAILURE; + } if (sieve_runtime_trace_active(renv, SIEVE_TRLVL_ACTIONS)) { sieve_runtime_trace(renv, 0, "redirect action"); diff --git a/pigeonhole/src/lib-sieve/sieve-common.h b/pigeonhole/src/lib-sieve/sieve-common.h index e79fb4d..d980c9d 100644 --- a/pigeonhole/src/lib-sieve/sieve-common.h +++ b/pigeonhole/src/lib-sieve/sieve-common.h @@ -209,6 +209,7 @@ struct sieve_instance { const struct smtp_address *user_email, *user_email_implicit; struct sieve_address_source redirect_from; unsigned int redirect_duplicate_period; + const char **allowed_redirects; }; /* diff --git a/pigeonhole/src/lib-sieve/sieve-settings.c b/pigeonhole/src/lib-sieve/sieve-settings.c index 47f70da..70addc7 100644 --- a/pigeonhole/src/lib-sieve/sieve-settings.c +++ b/pigeonhole/src/lib-sieve/sieve-settings.c @@ -267,4 +267,10 @@ void sieve_settings_load(struct sieve_instance *svinst) svinst->user_email = address; } } + svinst->allowed_redirects = NULL; + str_setting = sieve_setting_get(svinst, "sieve_allowed_redirects"); + if (str_setting != NULL && *str_setting != '\0') { + svinst->allowed_redirects = + (const char **)p_strsplit_spaces(svinst->pool, str_setting, ", "); + } } Best regards, Jozsef -- E-mail : kadlecsik.jozsef(a)wigner.hun-ren.hu PGP key: https://wigner.hu/~kadlec/pgp_public_key.txt Address: Wigner Research Centre for Physics H-1525 Budapest 114, POB. 49, Hungary

1 0

[Patch] blocklist access control for dovecot pop3/imap and pigeonhole managesieve
by John Fawcett 09 Jun '24

09 Jun '24

Hi Just in case this is useful more generally, I'm posting it to the list. While Dovecot has an access control via allow_nets, it is a user database field that applies only at the authentication stage to deny access for the specific user when there is a connection attempt from an unauthorized ip for that user. https://doc.dovecot.org/configuration_manual/authentication/allow_nets/ I don't believe there is anything that checks access at connect time to deny unwanted traffic prior to authentication, for example from compromised machines, botnets etc. Though failed connection attempts do not appear to be a significant issue, maybe better to add some safety net for the future. The attached patch is proof of concept code that introduces the parameters rbl_check and rbl_check_timeout (msecs) to the protocol section. Tested for imap, pop3 and sieve. The following is an example for sieve. protocol sieve { rbl_check = zen.spamhaus.net=127.0.0.4 rbl_check_timeout = 5000 } If the lookup results in a hit the client is disconnected with a BYE "Disconnected for policy." message and the logs report: Jun 09 12:00:56 server.example.com dovecot[977650]: managesieve-login: Disconnected: Policy (disconnected before auth was ready, waited 1 secs): user=<>, service=sieve, rip=n.n.n.n, lip=n.n.n.n The patch also makes the number of pre-login errors and post-login errors configurable (max_login_command_errors and max_command_errors respectively) for pop3, imap and sieve protocols . protocol sieve { max_command_errors = 1 max_login_command_errors = 1 } A potential extension to the logic would be "allow_nets" and "disallow_nets" parameters or maybe something more sophisticated to allow ips/networks that would otherwise be blocked or deny additional ips/networks. John

2 3

Error: Mailbox Spam: Failed to autocreate mailbox: Mailbox can't be created
by Jordan Rosenthal 09 Jun '24

09 Jun '24

Hi, I am getting the error "Error: Mailbox Spam: Failed to autocreate mailbox: Mailbox can't be created" and cannot figure out what is causing it. It seems like some sort of permissions issue, but nothing I have tried seems to fix the problem. I was running my setup for many years without issue, and this error started occurring after a recent Ubuntu upgrade. I am using getmail 6.18.4 to fetch mail from a mail server, which then calls /usr/lib/dovecot/deliver to deliver the mail to my local system. It is during this delivery that the error occurs. The dovecot-lda executable exits with status 75 and the log file contains: Jun 09 08:05:54 honeydukes dovecot[1863]: lda(sally)<1863><L9pgDaKaZWZHBwAASkLcPA>: Error: Mailbox Spam: Failed to autocreate mailbox: Mailbox can't be created Jun 09 08:05:54 honeydukes dovecot[1863]: lda(sally)<1863><L9pgDaKaZWZHBwAASkLcPA>: msgid=<REDACTED>: save failed to open mailbox Spam: Mailbox Below is my dovecot configuration. Any help would be appreciated! ------------------ # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 5.15.0-112-generic x86_64 Ubuntu 22.04.4 LTS # Hostname: honeydukes.fios-router.home lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:~/Maildir mail_privileged_group = mail maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = create special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . } passdb { driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " imap sieve" service imap-login { inet_listener imap { port = 0 } } ssl = required ssl_cert = </etc/dovecot/ssl/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it submission_host = <redacted>.com:465 userdb { driver = passwd }

1 0

Accessing IMAP from Python with Encrypted Password
by adam＠ardaemail.com 09 Jun '24

09 Jun '24

Hello again Dovecoters! I have a need to access an IMAP mailbox via a Python script to parse and stored DMARC reports in a SQL database. Right now, I have it working however I am storing the password in plaintext in my database which obviously is not secure. How would you approach this scenario? Would you store the password in the database encrypted and configure Dovecot to accept said encrypted password? If so, can you point me in the right direction to configure Dovecot to handle this? If not, what would you recommend? Is it possible to intercept the email and upload the attachments to an AWS S3 bucket then move the email to another folder? Likewise, if someone wants to help here as well, I need to send outbound email via an authenticated user from Postfix. How would you approach this scenario? Thank you!

3 2

Can't Empty Inbox that is Over quota
by Jason Hirsh 08 Jun '24

08 Jun '24

> I have been trying to update my Postix/Dovecot/MySQL?Postfixadmin installation > > > I am currently on Dovecot. 2.3.2.1 > > I used the guide set forth in Purplehat.org <http://purplehat.org/> which is what got me in trouble as I am in between with setup. (He went off to Maria-db and NGINX I stayed with Apache and MySQL > > > What has happened is may Dovecot Mailboxes are super super saturated. adI inadvertently allowed email from an alarm > > Quota name Type Value Limit % > User quota STORAGE 239754 5120 4682 > User quota MESSAGE 882 - > > > I tried to empty with the command > > sudo doveadm expunge -A mailbox INBOX ALL > > > I get this error > > Error: auth-master: userdb list: User listing returned failure > doveadm: Error: Failed to iterate through some users. > Is there anyway I can remove Dovecot from my server and reinstalll it? It is so messed up I don’t care about losing data Jasion Hirsh

2 4

Re: Can't Empty Inbox that is Over quota
by Jason Hirsh 06 Jun '24

06 Jun '24

> On Jun 6, 2024, at 11:00 AM, Jason Hirsh <kasdivi(a)mac.com> wrote: > > > >> On Jun 6, 2024, at 3:10 AM, Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: >> >>> >>> On 06/06/2024 04:11 EEST Jason Hirsh via dovecot <dovecot(a)dovecot.org> wrote: >>> >>> >>>> Begin forwarded message: >>>> >>>> From: Jason Hirsh <kasdivi(a)mac.com> >>>> Subject: Can't Empty Inbox that is Over quota >>>> Date: June 3, 2024 at 8:15:53 PM EDT >>>> To: dovecot(a)dovecot.org >>>> >>>> I have been trying to update my Postix/Dovecot/MySQL?Postfixadmin installation >>>> >>>> >>>> I am currently on Dovecot. 2.3.2.1 >>>> >>>> I used the guide set forth in Purplehat.org <http://purplehat.org/> which is what got me in trouble as I am in between with setup. (He went off to Maria-db and NGINX I stayed with Apache and MySQL >>>> >>>> >>>> What has happened is may Dovecot Mailboxes are super super saturated. adI inadvertently allowed email from an alarm >>>> >>>> Quota name Type Value Limit % >>>> User quota STORAGE 239754 5120 4682 >>>> User quota MESSAGE 882 - >>>> >>>> >>>> I tried to empty with the command >>>> >>>> sudo doveadm expunge -A mailbox INBOX ALL >>>> >>>> >>>> I get this error >>>> >>>> Error: auth-master: userdb list: User listing returned failure >>>> doveadm: Error: Failed to iterate through some users. >>>> >>> >>> >>> Is there anyway I can remove Dovecot from my server and reinstalll it? It is so messed up I don’t care about losing data >>> >>> >>> >> >> um.. you have multiple issues. >> >> First of all, try >> > > > >> sudo doveadm expunge -u targetuser mailbox INBOX ALL >> > > > Ok I tried that ,,say its ran but postfixadmn shows the mailbox WAY quote and new message to tha user are being rejected > > "Your message to <jason(a)kasdivi.com <mailto:jason@kasdivi.com>> was automatically rejected: > Storage quota for this account has been exceeded, please try again later.Reporting-MTA: dns; triggerfish.theoceanwindow.com <http://triggerfish.theoceanwindow.com/> > Final-Recipient: rfc822; jason(a)kasdivi.com <mailto:jason@kasdivi.com> > Action: failed > Status: 5.2.2” > > So on to > > >> rf /path/to/user/home > > > It all went away. By mail doesn’t not work. Postfixadmin still shows sett is over limited. I try deleting and get a > > Problems running mailbox postdeletion script! > The mailbox postdeletion script failed, check the error log for details! > > >> -A means all users, and it only works if your userdb iteration works. >> >> If you truly do not care about user data and want just get rid of it, >> you can just rm -rf /path/to/user/home >> >> Aki

1 0