- dovecot - dovecot.org

Sieve Symlink Error
by Benjamin Rose 01 Jul '24

01 Jul '24

Hello, I'm in the process of moving our mail server from RHEL 6 to RHEL 9. We will be moving to: # dovecot --version 2.3.16 (7e2e900c1a) My issue is that sieve does not appear to work on the new setup, where it does work on the old one. I made a simple filter rule: # cat /u/mail0test/.sieve/ingo.sieve # Sieve Filter # Generated by Ingo (http://www.horde.org/apps/ingo/) (06/28/2024, 11:14:52 PM) require "fileinto"; # Test if header :comparator "i;ascii-casemap" :contains "Subject" "filtertest" { fileinto "Fun"; stop; } Upon sending an email to this test account, the following appears in /var/log/maillog: Jun 29 23:19:56 mail5 dovecot[3066980]: lda(mail0test)<3066980><FA8fFtzOgGZkzC4AuM9lWg>: Warning: sieve: file storage: Active sieve script symlink /u/mail0test/.dovecot.sieve is broken: Invalid/unknown path to storage (points to /u/mail0test/.sieve). Jun 29 23:19:56 mail5 dovecot[2987026]: doveadm(mail0test)<3066983><KFf4FtzOgGZnzC4AuM9lWg>: Warning: sieve: file storage: Active sieve script symlink /u/mail0test/.dovecot.sieve is broken: Invalid/unknown path to storage (points to /u/mail0test/.sieve). Jun 29 23:19:56 mail5 dovecot[2987026]: doveadm(mail0test)<3067016><VdsdK9zOgGaIzC4AuM9lWg>: Warning: sieve: file storage: Active sieve script symlink /u/mail0test/.dovecot.sieve is broken: Invalid/unknown path to storage (points to /u/mail0test/.sieve). Yet: # ll /u/mail0test/.dovecot.sieve lrwxrwxrwx. 1 mail0test sysguest 17 Jun 28 23:26 /u/mail0test/.dovecot.sieve -> .sieve/ingo.sieve # file /u/mail0test/.sieve/ingo.sieve /u/mail0test/.sieve/ingo.sieve: ASCII text That is the filter file I've pasted above. I've set the following directives in /etc/dovecot/conf.d/90-sieve.conf via puppet: augeas { "dovecot_sieve_settings": context => "/files/etc/dovecot/conf.d/90-sieve.conf", changes => [ "set plugin/sieve_dir ~/.sieve", "set plugin/sieve_user_log ~/.sieve/log" ], require => Package["dovecot"], notify => Service["dovecot"]; } The full configuration dump is attached. /u in our environment is the path for user homedirs, which is an NFS mount to a NetApp. The OS is Springdale Linux 9.2, a clone of RedHat from before the IBM license change. It will soon be RHEL 9.4 as we have obtained a license, but for all intents and purposes, Springdale 9.2 and RHEL 9.2 should be considered bug-for-bug compatible. The arch is x86_64 with both machines mail5 and mail6 (replicated) having Intel(R) Xeon(R) Gold 6244 CPU @ 3.60GHz and 768gb of memory. I have the same issue with SELinux in both enforcing and permissive modes, so this is not a permissions error due to SELinux. Am I doing something wrong, or is this a bug? I've seen that there have been some previous issues similar to this that ended up being bugs in pigeonhole, so here I am. Thanks, Ben

2 3

Glean all from addresses from a users mailbox?
by Austin Witmer 01 Jul '24

01 Jul '24

Hello all! Is there a quick and easy way to search through an entire mailbox for a user on my dovecot server and glean all the “from” email addresses? This user would like a record of all the email addresses who have contacted him. Thanks in advance for your ideas. Austin Witmer

3 2

Timeout when opening folder
by Entrepreneur AJ 28 Jun '24

28 Jun '24

Hi all, I'm stuck with an issue. Migrating everything to a k0s kubernetes cluster, trying to migrate dovecot and all so far seems to be well with PVC for mail storage, ssl working great, authentication vis PostgreSQL working great. Issue is when trying to look at another folder say Deleted or Spam etc folder I am getting a timeout error with no logs. I disabled apparmour on the nodes the try again and the following error message appears; Jun 24 21:01:55 imap-login: Info: Login: user=<eaj>, method=PLAIN, rip=194.207.0.0, lip=10.244.24.235, mpid=15, TLS, session=<eTNaF6kbzJHCz3qg> Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Added userdb setting: mail=maildir:/srv/vmail/eaj Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Effective uid=1000, gid=1000, home=/srv/vmail/eaj Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: open(/proc/self/io) failed: Permission denied Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/srv/vmail/eaj Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: maildir++: root=/srv/vmail/eaj, index=, indexpvt=, control=, inbox=/srv/vmail/eaj, alt= Jun 24 21:01:55 imap(eaj)<14><3PRZF6kb0JHCz3qg>: Debug: Mailbox INBOX: Mailbox opened Jun 24 21:02:24 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Mailbox Sent: Couldn't open mailbox in list index: Storage size changed 160 != 396 Jun 24 21:02:24 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Mailbox Sent: Mailbox opened Jun 24 21:02:24 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Mailbox Drafts: Couldn't open mailbox in list index: Storage size changed 160 != 396 Jun 24 21:02:24 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Mailbox Drafts: Mailbox opened Thunderbird keeps showing a timeout error after a few minutes. Dovecot Version: 2.3.21 (47349e2482) dovecot -n config: # 2.3.21 (47349e2482): /etc/dovecot/dovecot.conf # OS: Linux 5.15.0-112-generic x86_64 # Hostname: dovecot-549bdc98ff-tzwcf auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = yes base_dir = /var/run/dovecot/ first_valid_uid = 1000 import_environment = TZ last_valid_uid = 1000 log_path = /dev/stdout login_greeting = IMAP ready. mail_debug = yes mail_home = /srv/vmail/%n mail_location = maildir:~ namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes imap_compress_deflate_level = 9 mail_crypt_global_private_key = # hidden, use -P to show it mail_crypt_global_public_key = # hidden, use -P to show it mail_crypt_save_version = 2 zlib_save = zstd zlib_save_level = 3 } service auth-worker { user = vmail } service auth { unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { port = 24 } user = vmail } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 ssl = yes } } service submission-login { inet_listener submission { port = 0 } inet_listener submissions { port = 0 } } ssl = required ssl_cert = </etc/dovecot/certs/tls.crt ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-CHACHA20-POLY1305 ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_ssl = yes protocol imap { mail_plugins = postmaster_address = postmaster(a)eajglobal.net } protocol lmtp { mail_plugins = postmaster_address = postmaster(a)eajglobal.net } Any pointers would be highly appreciated.

5 7

Oauth2 remote IP address
by Scott Q. 27 Jun '24

27 Jun '24

Anyone knows how to configure Dovecot to send the real remote ip address of the user to the oauth2 provider ( Keycloak in this case ) ? Right now I see the request as coming from the Dovecot server... Thank you, Scott

1 0

sieve comparator i;unicode-casemap RFC5051
by Alexey 25 Jun '24

25 Jun '24

Hello. Am I right that currently there is no chance to compare non-ascii characters case-insensitive? (UTF-8 strings from inside Subject or Body) I'm looking for :comparator i;unicode-casemap, but can't find it. It is described in RFC5051. Regards, Alexey

1 0

logging computer name
by hp＠hungpham.no 25 Jun '24

25 Jun '24

I am running Dovecot 2.3.21. One client has multiple computers in their LAN, connecting to my server with a static IP. One or several computers in that LAN keep logging in with failed password, but the Dovecot log only shows the public static IP, like this Jun 25 10:39:20 server-name dovecot[689]: imap-login: Disconnected: Connection closed (auth failed, 2 attempts in 62 secs): user=<xxxx(a)domainyyy.com>, method=PLAIN, rip=client-public-IP, lip=server-IP, TLS, session=<MCLxoK4bksIO8zXR> I tried to enable debug, but there is no more information about the LAN IP or computer names. Is there any setting which helps me with that purpose? So it will be much easier to locate the failed computers in that LAN? Thank you.

3 2

Re: Only some of my sent emails are stored in sent-folder
by Joseph Tam 22 Jun '24

22 Jun '24

From: Nils <dovecot(a)bugblatterbeast.de> > Still, there is no filter rule that would apply to that. Additionally, I > only use "fileinto" actions in my filter rules. No, I meant Thunderbird's rules and filters. If your mail reader decides to not save the message, IMAP and Sireve will never see it. Joseph Tam <jtam.home(a)gmail.com>

1 0

Only some of my sent emails are stored in sent-folder
by Nils 21 Jun '24

21 Jun '24

Lots of the emails I send aren't stored in the sent folder. It seems that it mostly (but not always) work for sent emails where the main email-address (the one that is also used as login name) is used as sender. It never seems to work when an alias is used as sender name. There isn't any entry in the mail.err log and nothing that looks suspicious to me in the regular mail.log. I didn't notice it at first, because I usually don't check my sent folder that much, but I it seems to have started when I migrated to the new server a few weeks ago. Any idea what could be the reason for it? Kind regards, Nils Test 1 using main email address (NOT STORED IN SENT FOLDER) Jun 20 20:10:28 SERVER postfix/submission/smtpd[5156]: connect from INTERNET_PROVIDER[IPV6_ADDRESS] Jun 20 20:10:28 SERVER postfix/submission/smtpd[5156]: 3B8B0C0DA8: client=INTERNET_PROVIDER[IPV6_ADDRESS], sasl_method=PLAIN, sasl_username=RECIPIENT(a)SERVER.TLD Jun 20 20:10:28 SERVER postfix/cleanup[5161]: 3B8B0C0DA8: message-id=<bcdc1b7e-e3f1-4a82-8fd9-05dd307313e4(a)SERVER.TLD> Jun 20 20:10:28 SERVER amavis[5197]: (05197-01) Passed CLEAN {AcceptedInbound}, AM.PDP-SOCK [IPV6_ADDRESS] [IPV6_ADDRESS] <RECIPIENT(a)SERVER.TLD> -> <RECIPIENT(a)SERVER.TLD>, Queue-ID: 3B8B0C0DA8, Message-ID: <bcdc1b7e-e3f1-4a82-8fd9-05dd307313e4(a)SERVER.TLD>, mail_id: nv7qsKFzK11D, Hits: 0.975, size: 702, 463 ms Jun 20 20:10:28 SERVER opendkim[1081]: 3B8B0C0DA8: DKIM-Signature field added (s=SERVER.TLD, d=SERVER.TLD) Jun 20 20:10:28 SERVER postfix/qmgr[1792]: 3B8B0C0DA8: from=<RECIPIENT(a)SERVER.TLD>, size=402, nrcpt=1 (queue active) Jun 20 20:10:28 SERVER dovecot: lmtp(5228): Connect from local Jun 20 20:10:28 SERVER dovecot: lmtp(RECIPIENT(a)SERVER.TLD)<5228><cL5iLbSMdGZsFAAAVy37qw>: sieve: msgid=<bcdc1b7e-e3f1-4a82-8fd9-05dd307313e4(a)SERVER.TLD>: stored mail into mailbox 'INBOX' Jun 20 20:10:28 SERVER postfix/lmtp[5227]: 3B8B0C0DA8: to=<RECIPIENT(a)SERVER.TLD>, relay=SERVER.TLD[private/dovecot-lmtp], delay=0.55, delays=0.54/0/0/0.01, dsn=2.0.0, status=sent (250 2.0.0 <RECIPIENT(a)SERVER.TLD> cL5iLbSMdGZsFAAAVy37qw Saved) Jun 20 20:10:28 SERVER dovecot: lmtp(5228): Disconnect from local: Logged out (state=READY) Jun 20 20:10:28 SERVER postfix/qmgr[1792]: 3B8B0C0DA8: removed Jun 20 20:10:28 SERVER dovecot: imap-login: Login: user=<RECIPIENT(a)SERVER.TLD>, method=PLAIN, rip=IPV6_ADDRESS, lip=2a01:4f8:10a:e50::2, mpid=5248, TLS, session=<DdED6FcbbusgAwDKv0yBAGXh6Xy3cdaM> Jun 20 20:10:29 SERVER dovecot: imap(RECIPIENT(a)SERVER.TLD)<5248><DdED6FcbbusgAwDKv0yBAGXh6Xy3cdaM>: Disconnected: Logged out in=496 out=637 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Jun 20 20:10:33 SERVER postfix/submission/smtpd[5156]: disconnect from INTERNET_PROVIDER[IPV6_ADDRESS] ehlo=2 starttls=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=8 Test 2 using alias email address (NOT STORED IN SENT FOLDER) Jun 20 20:10:41 SERVER postfix/submission/smtpd[5156]: connect from INTERNET_PROVIDER[IPV6_ADDRESS] Jun 20 20:10:42 SERVER postfix/submission/smtpd[5156]: 184A5C0DAD: client=INTERNET_PROVIDER[IPV6_ADDRESS], sasl_method=PLAIN, sasl_username=EMAIL(a)SERVER.TLD Jun 20 20:10:42 SERVER postfix/cleanup[5161]: 184A5C0DAD: message-id=<bc2f2025-67e0-4780-9a54-8f06c3b16389(a)SERVER.TLD> Jun 20 20:10:42 SERVER amavis[5196]: (05196-02) Passed CLEAN {AcceptedInbound}, AM.PDP-SOCK [IPV6_ADDRESS] [IPV6_ADDRESS] <ALIAS(a)SERVER.TLD> -> <RECIPIENT(a)SERVER.TLD>, Queue-ID: 184A5C0DAD, Message-ID: <bc2f2025-67e0-4780-9a54-8f06c3b16389(a)SERVER.TLD>, mail_id: ySF-pJQA8aRl, Hits: 0.975, size: 716, 607 ms Jun 20 20:10:42 SERVER opendkim[1081]: 184A5C0DAD: DKIM-Signature field added (s=key1, d=SERVER.TLD) Jun 20 20:10:42 SERVER postfix/qmgr[1792]: 184A5C0DAD: from=<ALIAS(a)SERVER.TLD>, size=408, nrcpt=1 (queue active) Jun 20 20:10:42 SERVER dovecot: lmtp(5228): Connect from local Jun 20 20:10:42 SERVER dovecot: lmtp(RECIPIENT(a)SERVER.TLD)<5228><KCs+LcKMdGZsFAAAVy37qw>: sieve: msgid=<bc2f2025-67e0-4780-9a54-8f06c3b16389(a)SERVER.TLD>: stored mail into mailbox 'INBOX' Jun 20 20:10:42 SERVER dovecot: lmtp(5228): Disconnect from local: Logged out (state=READY) Jun 20 20:10:42 SERVER postfix/lmtp[5227]: 184A5C0DAD: to=<RECIPIENT(a)SERVER.TLD>, relay=SERVER.TLD[private/dovecot-lmtp], delay=0.69, delays=0.68/0/0/0.01, dsn=2.0.0, status=sent (250 2.0.0 <RECIPIENT(a)SERVER.TLD> KCs+LcKMdGZsFAAAVy37qw Saved) Jun 20 20:10:42 SERVER postfix/qmgr[1792]: 184A5C0DAD: removed Jun 20 20:10:47 SERVER postfix/submission/smtpd[5156]: disconnect from INTERNET_PROVIDER[IPV6_ADDRESS] ehlo=2 starttls=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=8 Test 3 using main email address (stored in sent-folder) Jun 20 20:30:24 SERVER postfix/submission/smtpd[5813]: connect from INTERNET_PROVIDER[IPV6_ADDRESS] Jun 20 20:30:25 SERVER postfix/submission/smtpd[5813]: 3F2C1C0DAD: client=INTERNET_PROVIDER[IPV6_ADDRESS], sasl_method=PLAIN, sasl_username=EMAIL(a)SERVER.TLD Jun 20 20:30:25 SERVER postfix/cleanup[5818]: 3F2C1C0DAD: message-id=<603d7b61-d8d1-4099-bbc2-f0d2e9c776ee(a)SERVER.TLD> Jun 20 20:30:26 SERVER amavis[5197]: (05197-02) Passed CLEAN {AcceptedInbound}, AM.PDP-SOCK [IPV6_ADDRESS] [IPV6_ADDRESS] <EMAIL(a)SERVER.TLD> -> <RECIPIENT(a)SERVER.TLD>, Queue-ID: 3F2C1C0DAD, Message-ID: <603d7b61-d8d1-4099-bbc2-f0d2e9c776ee(a)SERVER.TLD>, mail_id: KDDY0Tv2B0Ut, Hits: 0.975, size: 704, 1096 ms Jun 20 20:30:26 SERVER opendkim[1081]: 3F2C1C0DAD: DKIM-Signature field added (s=key1, d=SERVER.TLD) Jun 20 20:30:26 SERVER postfix/qmgr[1792]: 3F2C1C0DAD: from=<EMAIL(a)SERVER.TLD>, size=398, nrcpt=1 (queue active) Jun 20 20:30:26 SERVER dovecot: lmtp(5824): Connect from local Jun 20 20:30:26 SERVER dovecot: lmtp(RECIPIENT(a)SERVER.TLD)<5824><xsEAGWKRdGbAFgAAVy37qw>: sieve: msgid=<603d7b61-d8d1-4099-bbc2-f0d2e9c776ee(a)SERVER.TLD>: stored mail into mailbox 'INBOX' Jun 20 20:30:26 SERVER postfix/lmtp[5823]: 3F2C1C0DAD: to=<RECIPIENT(a)SERVER.TLD>, relay=SERVER.TLD[private/dovecot-lmtp], delay=1.2, delays=1.2/0.01/0.01/0.01, dsn=2.0.0, status=sent (250 2.0.0 <RECIPIENT(a)SERVER.TLD> xsEAGWKRdGbAFgAAVy37qw Saved) Jun 20 20:30:26 SERVER dovecot: lmtp(5824): Disconnect from local: Logged out (state=READY) Jun 20 20:30:26 SERVER postfix/qmgr[1792]: 3F2C1C0DAD: removed Jun 20 20:30:26 SERVER dovecot: imap(EMAIL(a)SERVER.TLD)<5669><5nRfHlgbHIYgAwDKv0yBAGXh6Xy3cdaM>: Disconnected: Logged out in=1228 out=11932 deleted=0 expunged=0 trashed=0 hdr_count=3 hdr_bytes=816 body_count=0 body_bytes=0 Jun 20 20:30:31 SERVER postfix/submission/smtpd[5813]: disconnect from INTERNET_PROVIDER[IPV6_ADDRESS] ehlo=2 starttls=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=8

6 15

RE: Only some of my sent emails are stored in sent-folder
by Joseph Tam 21 Jun '24

21 Jun '24

From: Nils <dovecot(a)bugblatterbeast.de> > Lots of the emails I send aren't stored in the sent folder. It seems > that it mostly (but not always) work for sent emails where the main > email-address (the one that is also used as login name) is used as > sender. It never seems to work when an alias is used as sender name. Sounds to me like some mail reader filtering rule. Ordinarily, dovecot does not handle the capture of outgoing mail, Most of the time, it's the mail reader (MUA) that files outgoing messages to a sent-mail folder, and less commonly, the MTA will do it. Mail readers probably employ their own logic to determine what belongs in the sent mail folder: it could be all outgoing mail, it could be redirected based on some role filter. If you have a repeatable case, check it against your filter rule set. If it's inconsistent (the same message does and does not make it into your sent mail folder), you can look at other causes. Joseph Tam <jtam.home(a)gmail.com>

2 1

Core-dump on SSL connection
by Scott Q. 21 Jun '24

21 Jun '24

I'm on Debian 12.5 which comes with openssl 3.0.11 I compiled Dovecot 2.3.21 with some pretty vanilla options: /configure --prefix=/usr/local/dovecot --with-sql --with-mysql --with-docs --with-ssl --without-shadow --without-pam --without-ldap --without-pgsql --without-sqlite --with-systemd systemunitdir=/lib/systemd/system when I connect to it via SSL it core-dumps: Jun 18 20:50:01 mail kernel: imap-login[396438]: segfault at 69 ip 00007f2e5ee19556 sp 00007fffd7ca38f8 error 4 in libcrypto.so.3[7f2e5ecc5000+279000] likely on CPU 8 (core 8, socket 0) Jun 18 20:50:01 mail kernel: Code: c2 31 d2 31 ff c3 66 0f 1f 44 00 00 31 d2 31 ff c3 0f 1f 00 31 c0 48 85 ff 74 41 48 8b 57 08 8b 87 8c 00 00 00 48 85 d2 74 22 8b 52 68 48 85 d2 74 19 48 83 ec 08 ff d2 31 d2 85 c0 0f 48 c2 Anyone encountered something similar and knows how to fix it ?

4 8

Re: Only some of my sent emails are stored in sent-folder
by Joseph Tam 21 Jun '24

21 Jun '24

From: Nils <dovecot(a)bugblatterbeast.de> > Lots of the emails I send aren't stored in the sent folder. It seems > that it mostly (but not always) work for sent emails where the main > email-address (the one that is also used as login name) is used as > sender. It never seems to work when an alias is used as sender name. Sounds to me like some mail reader filtering rule. Ordinarily, dovecot does not handle the capture of outgoing mail, Most of the time, it's the mail reader (MUA) that files outgoing messages to a sent-mail folder, and less commonly, the MTA will do it. Mail readers probably employ their own logic to determine what belongs in the sent mail folder: it could be all outgoing mail, it could be redirected based on some role filter. If you have a repeatable case, check it against your filter rule set. If it's inconsistent (the same message does and does not make it into your sent mail folder), you can look at other causes. Joseph Tam <jtam.home(a)gmail.com>

1 0

Sieve bug on duplicate extension with MessageID break line
by ricardomachini＠gmail.com 19 Jun '24

19 Jun '24

Hello, I noticed that sieve's duplicate function is not working when the MessageID header has a line break and I have encountered messages originating from Microsoft 365 this way. For example: # test 1 From: <mailto:teste@domain.com.br> teste(a)domain.com.br To: <mailto:cron@domain.com.br> cron(a)domain.com.br Subject: test Message-Id: <mailto:854115.209399851-sendEmail@pa1> 854115.209399851-sendEmail@pa1 Date: Wed, 19 Jun 2024 12:35:16 -0300 (-03) Test # test 2 From: <mailto:teste@domain.com.br> teste(a)domain.com.br To: <mailto:cron@domain.com.br> cron(a)domain.com.br Subject: test Message-ID: <mailto:854115.209399851-sendEmail@pa1> 854115.209399851-sendEmail@pa1 Date: Wed, 19 Jun 2024 12:35:16 -0300 (-03) test # dovecot log Jun 19 12:59:33 server1 dovecot[513090]: lmtp(cron(a)domain.com.br) <mailto:cron@domain.com.br)%3c2993309%3e%3c4AeXHGUAc2adrC0AZCVTkw> <2993309><4AeXHGUAc2adrC0AZCVTkw>: sieve: subject=test from:teste@domain.com.br sender:teste@domain.com.br to: cron(a)domain.com.br <mailto:cron@domain.com.br> size:1010 msgid=854115.209399851-sendEmail@pa1 <mailto:854115.209399851-sendEmail@pa1> status=stored mail into mailbox 'INBOX' delivery_time=3 session_time=1 Jun 19 12:59:35 server1 dovecot[513090]: lmtp(cron(a)domain.com.br) <mailto:cron@domain.com.br)%3c2993309%3e%3csKNOK2cAc2adrC0AZCVTkw> <2993309><sKNOK2cAc2adrC0AZCVTkw>: sieve: subject=test from:teste@domain.com.br sender:teste@domain.com.br to: cron(a)domain.com.br <mailto:cron@domain.com.br> size:1014 msgid=854115.209399851-sendEmail@pa1 <mailto:854115.209399851-sendEmail@pa1> status=stored mail into mailbox 'INBOX' delivery_time=3 session_time=1 # sieve rule require ["duplicate", "fileinto", "envelope", "variables"]; if envelope :matches "from" "*" { set "sender" "${1}"; } if header :matches "subject" "*" { set "subject" "${1}"; } if header :matches "message-id" "*" { if duplicate :seconds 300 :uniqueid "${sender} ${subject} ${0}"{ discard; } } Regards, Ricardo

1 0

sieve issue
by savaw82275＠lisoren.com 19 Jun '24

19 Jun '24

Hi! Having a sieve rule: require ["fileinto", "editheader", "variables", "envelope"]; # rule:[med] if allof (address :contains "to" "info(a)mysite.com", header :contains "subject" "invoice") { deleteheader "from"; addheader "from" "info(a)mysite.com"; redirect "final(a)mysite.com"; } I was receiving: redirect action: failed to redirect message to <final(a)mysite.com>: Sendmail program returned error (temporary failure). Enabled debug log level in dovecot, then got some few further lines on this; program exec:/usr/sbin/sendmail (55356): Terminated with non-zero exit code 75 AND this: Error: sieve: redirect action: failed to redirect message to <final(a)mysite.com: Sendmail program returned error (temporary failure). After 2 hours of Google'ing, I finally found a workaround by adding: submission_host = 95.212.12.10 (IP address of my mail server) in dovecot.conf solved the issue. Can someone explain what was the issue and do you guys think this is a correct solution? Regards.

2 1

Re: Sieve generate a lot of hard link copies of mails in mailboxes
by George Asenov 16 Jun '24

16 Jun '24

Hi John, Thanks for taking your time looking at my issue. On 13-Jun-24 3:42 PM, John Stoffel via dovecot wrote: >>>>>> "George" == George Asenov via dovecot <dovecot(a)dovecot.org> writes: > > I don't have a real suggestion, but I do think you can clarify your problem. > >> No one have idea what is wrong here? >> On 07-Jun-24 4:10 PM, George Asenov via dovecot wrote: >>> Hello, >>> >>> I have very strange issue. Sieve generate copies of users messages i.e. >>> not real copies but hardlinks for the same message. It happens to many >>> messages but not every message and not every time, it is not a single >>> user issue I have couple users with that issue. > > Are you expecting sieve to generate copies? And are the copies in the > same folder or across folders? I.e. do you find an email in the > INBOX, and a hardlink in the SPAM folder? The goal here is when user move messages around imap folders to report them as ham/spam depending on where they originate and where they go. I think Sieve should send copy of the message to Rspamd because otherwise client will see the message dispensary which is not intuitive. Copies are all in the same folder. same message with many hard links placed in the same folder. Mostly happen in Trash and Spam folders. > What are the sizes of these emails? Are they all large? Or have > attachements? Is there anything that's common amongst those emails? Nothing in common as far as I can see. Sizes are verry different mostly small. > One idea might be to setup a test account and to just send it a bunch > of emails to try and make the problem occur. And to also look closely > at the rspamd logs as well. Already done that but I'm unable to reproduce it. > What is the size of the system memory on your dovecot server? And > what is the size of the dovecot.index.cache file when you see this > error? You should be able to delete the index and recreate it using > doveadm. > Servers are with enough RAM the smallest one is 64GB. The memory I'm referring is "vsz_limit=256 MB" and in my opinion it is not the issue but a consequence of the large amount of links in the mail and from there large index file and the result not enough memory to work with. When I delete all the copies the "Out of memory" errors are gone. > But from the sound of it, you have users with many thousands of emails > in a folder or folders. Can you check to see if there's any > relationship between users with larger numbers of hardlinks and those > with large numbers of emails? There are users with large number of mails but only some of them have this issue and some don't. Also there are users with small amount that have it which make them with large number of mails(copies). > And maybe instead of having sieve call rspam, maybe you can put it > into a milter and just have the > Rspamd is on a different server and it is set as a milter in postfix. That is why I use curl to report spam/ham. >>> It happens during auto reporting for spam/ham with sieve. >>> But I'm unable to reproduce it. >>> >>> At some point the hardlinks copies become so many that the mailbox index >>> files become so bug that dovecot start throwing error: >>> ################################ >>> dovecot[3385911]: imap(redacted(a)domain.tld)<1992901><RRBL9PQX69IXfCSs>: >>> Error: Mailbox Junk: mmap(size=520636784) failed with file >>> /var/lib/dovecot-virtualmin/index/redacted(a)domain.tld/.Junk/dovecot.index.cache: Cannot allocate memory >>> ################################ >>> other relevant logs are: >>> >>> dovecot: imap-login: Login: user=<redacted.user>, method=PLAIN, >>> rip=YYY.YYY.YYY.YYY, lip=XXX.XXX.XXX.XXX, mpid=3393763, TLS, >>> session=<c1Z1lPsZuPCAWqqI> >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: >>> learn-spam.sieve was triggered on imap.cause=COPY: >>> msgid=<87584056G78841203D85243127W62181551P@idomziqnd> >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: >>> learn-spam on imap.cause=COPY: from=redacted.mail, to=redacted2.mail, >>> subject=Asseyez-vous confortablement, n'importe où..., >>> msgid=<87584056G78841203D85243127W62181551P@idomziqnd>, >>> X-Spamd-Result=default: False [4.49 / 15.00]; >>> FORGED_RECIPIENTS(2.00)[m:redacted2.mail,s:redacted.user.fr]; >>> BAYES_SPAM(1.89)[88.30%]; MID_RHS_NOT_FQDN(0.50)[]; >>> BAD_REP_POLICIES(0.10)[]; RCVD_NO_TLS_LAST(0.10)[]; >>> MIME_GOOD(-0.10)[multipart/related,multipart/alternative,text/plain]; >>> ASN(0.00)[asn:34300, ipnet:62.173.128.0/19, country:RU]; >>> RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~,5:+]; >>> RCPT_COUNT_ONE(0.00)[1]; MISSING_XM_UA(0.00)[]; ARC_NA(0.00)[]; >>> RCVD_VIA_SMTP_AUTH(0.00)[]; GREYLIST(0.00)[pass,body]; >>> R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; >>> R_SPF_ALLOW(0.00)[+mx]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[or.mg]; >>> NEURAL_SPAM(0.00)[0.000] >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: >>> learn-spam send to rspamd spam >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: program >>> exec:/var/lib/dovecot/sieve/rspamd-learn-spam.sh (3397238): Terminated >>> with non-zero exit code 1 >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: Error: sieve: >>> failed to execute to program `rspamd-learn-spam.sh': refer to server log >>> for more information. [2024-06-03 07:36:40] >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: Disconnected: >>> Connection closed (UID FETCH finished 32.173 secs ago) in=2914 out=39237 >>> deleted=1 expunged=1 trashed=0 hdr_count=14 hdr_bytes=10705 body_count=1 >>> body_bytes=1606 >>> >>> I know that this is because the mail which is reported is too big for >>> curl but documentation say that > > Wait, how large is this email you're trying to process? So once you > have rspamd-learn-spam.sh crash on you, then you are really having an > rspam problem. Do you really need to scan large attachements? The "crash" is an error from curl because the mail is too big to send it inline as I pipe it, > What is your rspam configuration? And have you talked to people on > the rspamd mailing list on how to configure things? Rspamd is on a diffrent machine and I think it is not to blame here. > >>> $$$$$$$$$$$$$$$$$ >>> pipe :copy :try "rspamd-learn-spam.sh"; >>> $$$$$$$$$$$$$$$$$ >>> this should ignore the error. >>> I have tested also to change it like that: >>> $$$$$$$$$$$$$$$$$ >>> pipe :copy "rspamd-learn-spam.sh"; >>> $$$$$$$$$$$$$$$$$ >>> but the issue still persists > > So why are you doing a :copy here? If you're trying to say this email > is spam, why not just move it to your spam folder, and then have > rspamd go through your junk folder once a day instead? Because this should be kind of invisible to users. They move mails between folders and in the background they report as spam/ham > Have you looked at the system logs for memory problems when these > hardlink files are created? Are you running out of memory on general > on this mail server? > No memory problems on the machine itself there is plenty of free Ram > Instead of focusing on dovecot, back up a level and think about the > resources allocated to the whole system, and what types of mail > messages are showing this problem. How are they alike? What is your > mail volume? Does the problem happen when you get lots of emails, or > is it really random? It is not the amount of messages coming if I comment out the config executing spam/ham reporting and clean up the hardlinks the issue didn't show up for months. > Do you have old rspamd processes hanging around taking up resources? Rspamd can't make copies on that machine because it is on a separate server. > > Good luck! > John > > > > >>> I can't confirm that the issue is that error because these errors are >>> way less than the messages with hardlink copies. >>> Also sometimes one mail have more than two hardlinks to it. >>> ######################################## >>> here is a example: >>> >>> inode# hardlink_count filename >>> 2430090371 23850 >>> ./Maildir/.Trash/cur/1714190559.M355157P25776.redacted.hostname,S=39259,W=40217:2,S >>> 2430090371 23850 >>> ./Maildir/.Trash/cur/1714190562.M259778P25902.redacted.hostname,S=39259,W=40217:2,S >>> 2430090371 23850 >>> ./Maildir/.Trash/cur/1714190565.M188090P26028.redacted.hostname,S=39259,W=40217:2,S >>> 2430090371 23850 >>> ./Maildir/.Trash/cur/1714190568.M340582P26179.redacted.hostname,S=39259,W=40217:2,S >>> >>> yes this is "23850" hardlinks to the same Inode >>> ####################################### >>> The issue is somewhere in the sieve ham/spam reporting to rspamd but >>> cant figure out where and why. >>> >>> Is this a bug or my configuration is wrong? >>> >>> >>> Here are all related configurations (feel free to ask for more if needed): >>> ###################################################################### >>> # doveconf -n >>> # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf >>> # Pigeonhole version 0.5.16 (09c29328) >>> # OS: Linux 4.18.0-513.24.1.el8_9.x86_64 x86_64 Rocky Linux release 8.9 >>> (Green Obsidian) >>> # Hostname: redacteddomain.tld >>> auth_mechanisms = plain login >>> disable_plaintext_auth = no >>> first_valid_uid = 1000 >>> mail_location = >>> maildir:~/Maildir:INDEX=/var/lib/dovecot-virtualmin/index/%u:CONTROL=/var/lib/dovecot-virtualmin/control/%u >>> managesieve_notify_capability = mailto >>> managesieve_sieve_capability = fileinto reject envelope >>> encoded-character vacation subaddress comparator-i;ascii-numeric >>> relational regex imap4flags copy include variables body enotify >>> environment mailbox date index ihave duplicate mime >>> foreverypart extracttext vacation-seconds imapsieve vnd.dovecot.imapsieve >>> mbox_write_locks = fcntl >>> namespace inbox { >>> inbox = yes >>> location = >>> mailbox Drafts { >>> auto = subscribe >>> special_use = \Drafts >>> } >>> mailbox Junk { >>> auto = create >>> special_use = \Junk >>> } >>> mailbox Sent { >>> auto = subscribe >>> special_use = \Sent >>> } >>> mailbox "Sent Messages" { >>> special_use = \Sent >>> } >>> mailbox Trash { >>> auto = subscribe >>> special_use = \Trash >>> } >>> mailbox spam { >>> auto = subscribe >>> special_use = \Junk >>> } >>> prefix = >>> } >>> passdb { >>> driver = pam >>> } >>> plugin { >>> imapsieve_mailbox1_before = file:/var/lib/dovecot/sieve/learn-spam.sieve >>> imapsieve_mailbox1_causes = COPY >>> imapsieve_mailbox1_name = spam >>> imapsieve_mailbox2_before = file:/var/lib/dovecot/sieve/learn-ham.sieve >>> imapsieve_mailbox2_causes = COPY >>> imapsieve_mailbox2_from = spam >>> imapsieve_mailbox2_name = * >>> imapsieve_mailbox3_before = file:/var/lib/dovecot/sieve/learn-spam.sieve >>> imapsieve_mailbox3_causes = COPY >>> imapsieve_mailbox3_name = Junk >>> imapsieve_mailbox4_before = file:/var/lib/dovecot/sieve/learn-ham.sieve >>> imapsieve_mailbox4_causes = COPY >>> imapsieve_mailbox4_from = Junk >>> imapsieve_mailbox4_name = * >>> quota = fs:user userquota >>> quota2 = fs:group groupquota >>> quota_grace = 100M >>> quota_warning = storage=95%% quota-warning 95 %n %d >>> quota_warning2 = storage=90%% quota-warning 90 %n %d >>> quota_warning3 = storage=80%% quota-warning 80 %n %d >>> sieve = file:~/sieve;active=~/.dovecot.sieve >>> sieve_before = /var/lib/dovecot/sieve/before-global.sieve >>> sieve_extensions = +vacation-seconds >>> sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment >>> +vnd.dovecot.debug >>> sieve_pipe_bin_dir = /var/lib/dovecot/sieve >>> sieve_plugins = sieve_extprograms sieve_imapsieve >>> sieve_vacation_default_period = 10d >>> sieve_vacation_max_period = 30d >>> sieve_vacation_min_period = 1h >>> } >>> protocols = imap pop3 lmtp sieve >>> process_min_avail = 5 >>> service_count = 0 >>> } >>> service imap { >>> process_limit = 400 >>> } >>> service lmtp { >>> unix_listener /var/spool/postfix/private/dovecot-lmtp { >>> group = postfix >>> mode = 01224 >>> user = postfix >>> } >>> } >>> service pop3 { >>> process_limit = 200 >>> } >>> service quota-warning { >>> executable = script /var/lib/dovecot/quota-warning.sh >>> service_count = 1 >>> unix_listener quota-warning { >>> group = dovecot >>> mode = 0666 >>> user = dovecot >>> } >>> } >>> ssl_ca = </etc/pki/dovecot/certs/ca.pem >>> ssl_cert = </etc/pki/dovecot/certs/dovecot.pem >>> ssl_cipher_list = >>> ECDHE-RSA-AES256-SHA384:AES256-SHA256:AES256-SHA256:!RC4:HIGH:MEDIUM:+TLSv1:+TLSv1.1:+TLSv1.2:!MD5:!ADH:!aNULL:!eNULL:!NULL:!DH:!ADH:!EDH:!AESGCM >>> ssl_key = # hidden, use -P to show it >>> userdb { >>> driver = passwd >>> } >>> protocol lmtp { >>> mail_plugins = " sieve" >>> userdb { >>> args = username_format=%n /etc/passwd >>> driver = passwd-file >>> name = >>> } >>> } >>> protocol imap { >>> mail_plugins = " imap_quota imap_sieve quota" >>> } >>> >>> ###################################################################### >>> >>> # cat /var/lib/dovecot/sieve/learn-spam.sieve >>> require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", >>> "imap4flags", "vnd.dovecot.debug", "variables"]; >>> >>> # Logging >>> if address :matches "from" "*" { set "FROM" "${1}"; } >>> if address :matches "to" "*" { set "TO" "${1}"; } >>> if header :matches "subject" "*" { set "SUBJECT" "${1}"; } >>> if header :matches "Message-ID" "*" { set "MSGID" "${1}"; } >>> if header :matches "X-Spamd-Result" "*" { set "XSpamdResult" "${1}"; } >>> if environment :matches "imap.cause" "*" { set "IMAPCAUSE" "${1}"; } >>> debug_log "learn-spam.sieve was triggered on imap.cause=${IMAPCAUSE}: >>> msgid=${MSGID}"; >>> set "LogMsg" "learn-spam on imap.cause=${IMAPCAUSE}: from=${FROM}, >>> to=${TO}, subject=${SUBJECT}, msgid=${MSGID}, >>> X-Spamd-Result=${XSpamdResult}"; >>> >>> # Spam-learning by sending copy with curl to rspmd >>> if anyof (environment :is "imap.cause" "COPY", environment :is >>> "imap.cause" "APPEND") { >>> debug_log "${LogMsg}"; >>> debug_log "learn-spam send to rspamd spam"; >>> pipe :copy :try "rspamd-learn-spam.sh"; >>> } >>> # Catch replied or forwarded spam and send to rspamd ham >>> elsif anyof (allof (hasflag "\\Answered", environment :contains >>> "imap.changedflags" "\\Answered"), >>> allof (hasflag "$Forwarded", environment :contains >>> "imap.changedflags" "$Forwarded")) { >>> debug_log "${LogMsg}"; >>> debug_log "learn-spam send to rspamd ham"; >>> pipe :copy :try "rspamd-learn-ham.sh"; >>> } >>> ###################################################################### >>> >>> cat /var/lib/dovecot/sieve/learn-ham.sieve >>> require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", >>> "variables", "vnd.dovecot.debug"]; >>> >>> # Exclude messages which were moved to Trash (or training mailboxes) >>> from ham learning >>> if environment :matches "imap.mailbox" "*" { >>> set "mailbox" "${1}"; >>> } >>> if string "${mailbox}" [ "INBOX/Trash", "INBOX/Deleted Items", >>> "INBOX/Bin", "INBOX/train_ham", "INBOX/train_prob", "INBOX/train_spam", >>> "Trash" ] { >>> stop; >>> } >>> >>> # Logging >>> if address :matches "from" "*" { set "FROM" "${1}"; } >>> if address :matches "to" "*" { set "TO" "${1}"; } >>> if header :matches "subject" "*" { set "SUBJECT" "${1}"; } >>> if header :matches "Message-ID" "*" { set "MSGID" "${1}"; } >>> if header :matches "X-Spamd-Result" "*" { set "XSpamdResult" "${1}"; } >>> if environment :matches "imap.cause" "*" { set "IMAPCAUSE" "${1}"; } >>> debug_log "learn-ham on imap.cause=${IMAPCAUSE}: from=${FROM}, to=${TO}, >>> subject=${SUBJECT}, msgid=${MSGID}, X-Spamd-Result=${XSpamdResult}"; >>> >>> # Ham-learning sending a copy of the message to rspamd >>> debug_log "learn-ham send to rspamd ham"; >>> pipe :copy :try "rspamd-learn-ham.sh"; >>> ###################################################################### >>> >>> cat /var/lib/dovecot/sieve/rspamd-learn-ham.sh >>> #!/bin/bash >>> >>> function log_error() { echo `date '+%Y-%m-%d %H:%M:%S'` ERROR: $1 >&2; } >>> function log() { echo `date '+%Y-%m-%d %H:%M:%S'` INFO: $1; } >>> >>> MAIL=$(tee) >>> SERVER_LIST=("redacted.tld") #rspamd server >>> >>> PASSWORD="redacted" >>> >>> >>> for SERVER in ${SERVER_LIST[@]}; do >>> log "Trying to report spam to ${SERVER}" >>> RETURN=$(/usr/bin/curl -s --connect-timeout 1 -H "Password: >>> ${PASSWORD}" --data-binary --url "http://${SERVER}:11334/learnham" -d >>> "${MAIL}") >>> STATUS=$? >>> if [ $STATUS -eq 0 ]; then >>> log "Spam reported to ${SERVER}: ${RETURN}" >>> exit 0 >>> else >>> if [ $STATUS -eq 28 ]; then >>> log_error "Reporting SPAM to ${SERVER} failed: Connection >>> timed out." >>> else >>> log_error "Reporting SPAM to ${SERVER} failed: CURL exit >>> status ${STATUS}" >>> fi >>> fi >>> done >>> >>> log_error "Reporting SPAM failed ${SERVERS[@]}" >>> exit 1 >>> ###################################################################### >>> >>> cat /var/lib/dovecot/sieve/rspamd-learn-spam.sh >>> #!/bin/bash >>> >>> function log_error() { echo `date '+%Y-%m-%d %H:%M:%S'` ERROR: $1 >&2; } >>> function log() { echo `date '+%Y-%m-%d %H:%M:%S'` INFO: $1; } >>> >>> MAIL=$(tee) >>> SERVER_LIST=("redacted.tld") #rspamd server >>> PASSWORD="redacted" >>> >>> >>> >>> for SERVER in ${SERVER_LIST[@]}; do >>> log "Trying to report spam to ${SERVER}" >>> RETURN=$(/usr/bin/curl -s --connect-timeout 1 -H "Password: >>> ${PASSWORD}" --data-binary --url "http://${SERVER}:11334/learnspam" -d >>> "${MAIL}") >>> STATUS=$? >>> if [ $STATUS -eq 0 ]; then >>> log "Spam reported to ${SERVER}: ${RETURN}" >>> exit 0 >>> else >>> if [ $STATUS -eq 28 ]; then >>> log_error "Reporting SPAM to ${SERVER} failed: Connection >>> timed out." >>> else >>> log_error "Reporting SPAM to ${SERVER} failed: CURL exit >>> status ${STATUS}" >>> fi >>> fi >>> done >>> >>> log_error "Reporting SPAM failed ${SERVERS[@]}" >>> exit 1 >>> ###################################################################### >>> >>> without all "imapsieve_mailbox.* " directives the problem is gone. >>> >>> >>> Thanks to everyone in advance. >>> > >> -- >> Warm regards >> George A. >> WPXHosting >> _______________________________________________ >> dovecot mailing list -- dovecot(a)dovecot.org >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > _______________________________________________ > dovecot mailing list -- dovecot(a)dovecot.org > To unsubscribe send an email to dovecot-leave(a)dovecot.org -- Warm regards George A.

2 3

Sieve generate a lot of hard link copies of mails in mailboxes
by George Asenov 13 Jun '24

13 Jun '24

Hello, I have very strange issue. Sieve generate copies of users messages i.e. not real copies but hardlinks for the same message. It happens to many messages but not every message and not every time, it is not a single user issue I have couple users with that issue. It happens during auto reporting for spam/ham with sieve. But I'm unable to reproduce it. At some point the hardlinks copies become so many that the mailbox index files become so bug that dovecot start throwing error: ################################ dovecot[3385911]: imap(redacted(a)domain.tld)<1992901><RRBL9PQX69IXfCSs>: Error: Mailbox Junk: mmap(size=520636784) failed with file /var/lib/dovecot-virtualmin/index/redacted(a)domain.tld/.Junk/dovecot.index.cache: Cannot allocate memory ################################ other relevant logs are: dovecot: imap-login: Login: user=<redacted.user>, method=PLAIN, rip=YYY.YYY.YYY.YYY, lip=XXX.XXX.XXX.XXX, mpid=3393763, TLS, session=<c1Z1lPsZuPCAWqqI> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: learn-spam.sieve was triggered on imap.cause=COPY: msgid=<87584056G78841203D85243127W62181551P@idomziqnd> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: learn-spam on imap.cause=COPY: from=redacted.mail, to=redacted2.mail, subject=Asseyez-vous confortablement, n'importe où..., msgid=<87584056G78841203D85243127W62181551P@idomziqnd>, X-Spamd-Result=default: False [4.49 / 15.00]; FORGED_RECIPIENTS(2.00)[m:redacted2.mail,s:redacted.user.fr]; BAYES_SPAM(1.89)[88.30%]; MID_RHS_NOT_FQDN(0.50)[]; BAD_REP_POLICIES(0.10)[]; RCVD_NO_TLS_LAST(0.10)[]; MIME_GOOD(-0.10)[multipart/related,multipart/alternative,text/plain]; ASN(0.00)[asn:34300, ipnet:62.173.128.0/19, country:RU]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~,5:+]; RCPT_COUNT_ONE(0.00)[1]; MISSING_XM_UA(0.00)[]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; GREYLIST(0.00)[pass,body]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(0.00)[+mx]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[or.mg]; NEURAL_SPAM(0.00)[0.000] dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: learn-spam send to rspamd spam dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: program exec:/var/lib/dovecot/sieve/rspamd-learn-spam.sh (3397238): Terminated with non-zero exit code 1 dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: Error: sieve: failed to execute to program `rspamd-learn-spam.sh': refer to server log for more information. [2024-06-03 07:36:40] dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: Disconnected: Connection closed (UID FETCH finished 32.173 secs ago) in=2914 out=39237 deleted=1 expunged=1 trashed=0 hdr_count=14 hdr_bytes=10705 body_count=1 body_bytes=1606 I know that this is because the mail which is reported is too big for curl but documentation say that $$$$$$$$$$$$$$$$$ pipe :copy :try "rspamd-learn-spam.sh"; $$$$$$$$$$$$$$$$$ this should ignore the error. I have tested also to change it like that: $$$$$$$$$$$$$$$$$ pipe :copy "rspamd-learn-spam.sh"; $$$$$$$$$$$$$$$$$ but the issue still persists I can't confirm that the issue is that error because these errors are way less than the messages with hardlink copies. Also sometimes one mail have more than two hardlinks to it. ######################################## here is a example: inode# hardlink_count filename 2430090371 23850 ./Maildir/.Trash/cur/1714190559.M355157P25776.redacted.hostname,S=39259,W=40217:2,S 2430090371 23850 ./Maildir/.Trash/cur/1714190562.M259778P25902.redacted.hostname,S=39259,W=40217:2,S 2430090371 23850 ./Maildir/.Trash/cur/1714190565.M188090P26028.redacted.hostname,S=39259,W=40217:2,S 2430090371 23850 ./Maildir/.Trash/cur/1714190568.M340582P26179.redacted.hostname,S=39259,W=40217:2,S yes this is "23850" hardlinks to the same Inode ####################################### The issue is somewhere in the sieve ham/spam reporting to rspamd but cant figure out where and why. Is this a bug or my configuration is wrong? Here are all related configurations (feel free to ask for more if needed): ###################################################################### # doveconf -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 4.18.0-513.24.1.el8_9.x86_64 x86_64 Rocky Linux release 8.9 (Green Obsidian) # Hostname: redacteddomain.tld auth_mechanisms = plain login disable_plaintext_auth = no first_valid_uid = 1000 mail_location = maildir:~/Maildir:INDEX=/var/lib/dovecot-virtualmin/index/%u:CONTROL=/var/lib/dovecot-virtualmin/control/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds imapsieve vnd.dovecot.imapsieve mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox spam { auto = subscribe special_use = \Junk } prefix = } passdb { driver = pam } plugin { imapsieve_mailbox1_before = file:/var/lib/dovecot/sieve/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = spam imapsieve_mailbox2_before = file:/var/lib/dovecot/sieve/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = spam imapsieve_mailbox2_name = * imapsieve_mailbox3_before = file:/var/lib/dovecot/sieve/learn-spam.sieve imapsieve_mailbox3_causes = COPY imapsieve_mailbox3_name = Junk imapsieve_mailbox4_before = file:/var/lib/dovecot/sieve/learn-ham.sieve imapsieve_mailbox4_causes = COPY imapsieve_mailbox4_from = Junk imapsieve_mailbox4_name = * quota = fs:user userquota quota2 = fs:group groupquota quota_grace = 100M quota_warning = storage=95%% quota-warning 95 %n %d quota_warning2 = storage=90%% quota-warning 90 %n %d quota_warning3 = storage=80%% quota-warning 80 %n %d sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /var/lib/dovecot/sieve/before-global.sieve sieve_extensions = +vacation-seconds sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment +vnd.dovecot.debug sieve_pipe_bin_dir = /var/lib/dovecot/sieve sieve_plugins = sieve_extprograms sieve_imapsieve sieve_vacation_default_period = 10d sieve_vacation_max_period = 30d sieve_vacation_min_period = 1h } protocols = imap pop3 lmtp sieve process_min_avail = 5 service_count = 0 } service imap { process_limit = 400 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 01224 user = postfix } } service pop3 { process_limit = 200 } service quota-warning { executable = script /var/lib/dovecot/quota-warning.sh service_count = 1 unix_listener quota-warning { group = dovecot mode = 0666 user = dovecot } } ssl_ca = </etc/pki/dovecot/certs/ca.pem ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = ECDHE-RSA-AES256-SHA384:AES256-SHA256:AES256-SHA256:!RC4:HIGH:MEDIUM:+TLSv1:+TLSv1.1:+TLSv1.2:!MD5:!ADH:!aNULL:!eNULL:!NULL:!DH:!ADH:!EDH:!AESGCM ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol lmtp { mail_plugins = " sieve" userdb { args = username_format=%n /etc/passwd driver = passwd-file name = } } protocol imap { mail_plugins = " imap_quota imap_sieve quota" } ###################################################################### # cat /var/lib/dovecot/sieve/learn-spam.sieve require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", "imap4flags", "vnd.dovecot.debug", "variables"]; # Logging if address :matches "from" "*" { set "FROM" "${1}"; } if address :matches "to" "*" { set "TO" "${1}"; } if header :matches "subject" "*" { set "SUBJECT" "${1}"; } if header :matches "Message-ID" "*" { set "MSGID" "${1}"; } if header :matches "X-Spamd-Result" "*" { set "XSpamdResult" "${1}"; } if environment :matches "imap.cause" "*" { set "IMAPCAUSE" "${1}"; } debug_log "learn-spam.sieve was triggered on imap.cause=${IMAPCAUSE}: msgid=${MSGID}"; set "LogMsg" "learn-spam on imap.cause=${IMAPCAUSE}: from=${FROM}, to=${TO}, subject=${SUBJECT}, msgid=${MSGID}, X-Spamd-Result=${XSpamdResult}"; # Spam-learning by sending copy with curl to rspmd if anyof (environment :is "imap.cause" "COPY", environment :is "imap.cause" "APPEND") { debug_log "${LogMsg}"; debug_log "learn-spam send to rspamd spam"; pipe :copy :try "rspamd-learn-spam.sh"; } # Catch replied or forwarded spam and send to rspamd ham elsif anyof (allof (hasflag "\\Answered", environment :contains "imap.changedflags" "\\Answered"), allof (hasflag "$Forwarded", environment :contains "imap.changedflags" "$Forwarded")) { debug_log "${LogMsg}"; debug_log "learn-spam send to rspamd ham"; pipe :copy :try "rspamd-learn-ham.sh"; } ###################################################################### cat /var/lib/dovecot/sieve/learn-ham.sieve require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", "variables", "vnd.dovecot.debug"]; # Exclude messages which were moved to Trash (or training mailboxes) from ham learning if environment :matches "imap.mailbox" "*" { set "mailbox" "${1}"; } if string "${mailbox}" [ "INBOX/Trash", "INBOX/Deleted Items", "INBOX/Bin", "INBOX/train_ham", "INBOX/train_prob", "INBOX/train_spam", "Trash" ] { stop; } # Logging if address :matches "from" "*" { set "FROM" "${1}"; } if address :matches "to" "*" { set "TO" "${1}"; } if header :matches "subject" "*" { set "SUBJECT" "${1}"; } if header :matches "Message-ID" "*" { set "MSGID" "${1}"; } if header :matches "X-Spamd-Result" "*" { set "XSpamdResult" "${1}"; } if environment :matches "imap.cause" "*" { set "IMAPCAUSE" "${1}"; } debug_log "learn-ham on imap.cause=${IMAPCAUSE}: from=${FROM}, to=${TO}, subject=${SUBJECT}, msgid=${MSGID}, X-Spamd-Result=${XSpamdResult}"; # Ham-learning sending a copy of the message to rspamd debug_log "learn-ham send to rspamd ham"; pipe :copy :try "rspamd-learn-ham.sh"; ###################################################################### cat /var/lib/dovecot/sieve/rspamd-learn-ham.sh #!/bin/bash function log_error() { echo `date '+%Y-%m-%d %H:%M:%S'` ERROR: $1 >&2; } function log() { echo `date '+%Y-%m-%d %H:%M:%S'` INFO: $1; } MAIL=$(tee) SERVER_LIST=("redacted.tld") #rspamd server PASSWORD="redacted" for SERVER in ${SERVER_LIST[@]}; do log "Trying to report spam to ${SERVER}" RETURN=$(/usr/bin/curl -s --connect-timeout 1 -H "Password: ${PASSWORD}" --data-binary --url "http://${SERVER}:11334/learnham" -d "${MAIL}") STATUS=$? if [ $STATUS -eq 0 ]; then log "Spam reported to ${SERVER}: ${RETURN}" exit 0 else if [ $STATUS -eq 28 ]; then log_error "Reporting SPAM to ${SERVER} failed: Connection timed out." else log_error "Reporting SPAM to ${SERVER} failed: CURL exit status ${STATUS}" fi fi done log_error "Reporting SPAM failed ${SERVERS[@]}" exit 1 ###################################################################### cat /var/lib/dovecot/sieve/rspamd-learn-spam.sh #!/bin/bash function log_error() { echo `date '+%Y-%m-%d %H:%M:%S'` ERROR: $1 >&2; } function log() { echo `date '+%Y-%m-%d %H:%M:%S'` INFO: $1; } MAIL=$(tee) SERVER_LIST=("redacted.tld") #rspamd server PASSWORD="redacted" for SERVER in ${SERVER_LIST[@]}; do log "Trying to report spam to ${SERVER}" RETURN=$(/usr/bin/curl -s --connect-timeout 1 -H "Password: ${PASSWORD}" --data-binary --url "http://${SERVER}:11334/learnspam" -d "${MAIL}") STATUS=$? if [ $STATUS -eq 0 ]; then log "Spam reported to ${SERVER}: ${RETURN}" exit 0 else if [ $STATUS -eq 28 ]; then log_error "Reporting SPAM to ${SERVER} failed: Connection timed out." else log_error "Reporting SPAM to ${SERVER} failed: CURL exit status ${STATUS}" fi fi done log_error "Reporting SPAM failed ${SERVERS[@]}" exit 1 ###################################################################### without all "imapsieve_mailbox.* " directives the problem is gone. Thanks to everyone in advance. -- Warm regards George A. WPXHosting

2 2

"Read the 'bug reports page' …" -> 404
by H. Thiele 13 Jun '24

13 Jun '24

Hi there, while investigating how to possibly report issues to the Dovecot project I noticed that the link to the "bug reports page" in the "mailing list" section on dovecot.org is broken and leads to a 404. https://www.dovecot.org/mailing-lists/ -> "Read the 'bug reports page' before posting a bug report. …" -> "The page you are looking for is not found" regards, H. Thiele

8 10

Re: "Read the 'bug reports page' …" -> 404
by H. Thiele 13 Jun '24

13 Jun '24

I also noticed this affects local documentation in the Dovecot release (v2.3.21), e.g. the old URL is referenced in many of the man files that get installed. It is probably a good idea to setup a 301 redirect rather than just dumping a 404 on the website too. On 12/06/24 8:05 AM, aki.tuomi wrote: > Thanks for letting us know. We'll fix this soon, use > https://dovecot.org/bugreport-mail > > Aki > > -------- Original message -------- > From: "H. Thiele via dovecot" <dovecot(a)dovecot.org> > Date: 6/12/24 06:49 (GMT+00:00) > To: dovecot(a)dovecot.org > Subject: "Read the 'bug reports page' …" -> 404 > > > Hi there, > > while investigating how to possibly report issues to the Dovecot > project I noticed that the link to the "bug reports page" in > the "mailing list" section on dovecot.org is broken and leads to > a 404. > > > https://www.dovecot.org/mailing-lists/ -> > "Read the 'bug reports page' before posting a bug report. …" > > -> "The page you are looking for is not found" > > > > regards, > H. Thiele > _______________________________________________ > dovecot mailing list -- dovecot(a)dovecot.org > To unsubscribe send an email to dovecot-leave(a)dovecot.org >

1 0

Duplicate "cache" in doveadm's help text
by H. Thiele 12 Jun '24

12 Jun '24

1 0

how to disable port 143
by Jeff Peng 10 Jun '24

10 Jun '24

Hello, I have commented out this line in 10-master.conf: service imap-login { inet_listener imap { #port = 143 } But this doesn't close the port 143. So I have changed it to: service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } This let port 143 listen on local address. my question, is it possible to close port 143 entirely in dovecot? Thanks.

5 8

Lots of "Corrupted dbox file" errors in log
by simon＠simonliebold.de 10 Jun '24

10 Jun '24

Hi, I'm leaving this here for others who may see the same issue and are equally perplexed as I was: Dovecot version 2.3.16 w/ sdbox mailbox format. Yesterday, I noticed that I did not see any new mail in Thunderbird. But for whatever reason, new mail did show up on my phone with K9 mail. So, new mails were retained. In the Dovecot logs, I was seeing multiple errors: Corrupted dbox file read() failed for file No buffer space available EOF while reading file header Mailbox INBOX: sdbox: Rebuilding failed Mailbox INBOX: Deleting corrupted cache: reset_id mismatch even after locking The "Corrupted dbox file" and "EOF while reading file header" error was caused by a message file in the INBOX mailbox that was 6681 bytes in size and had all NUL characters. File date of that file was more than two years ago. The "No buffer space available" error was caused by a file that also had a lot of NUL, but also a few other characters in it. Nothing resembling regular message files with headers and body. In total it was a handful of files causing issues. I deleted them all with: doveadm expunge -u {user} MAILBOX INBOX UID {filename without the leading 'u.'} Afterwards Thunderbird showed new mails again. I did not need to restart it. No more errors in the Dovecot logs. Not sure what had caused this. Maybe somebody has seen this before. Simon

1 0

[Patch] blocklist access control for dovecot pop3/imap and pigeonhole managesieve
by John Fawcett 10 Jun '24

10 Jun '24

Hi Just in case this is useful more generally, I'm posting it to the list. While Dovecot has an access control via allow_nets, it is a user database field that applies only at the authentication stage to deny access for the specific user when there is a connection attempt from an unauthorized ip for that user. https://doc.dovecot.org/configuration_manual/authentication/allow_nets/ I don't believe there is anything that checks access at connect time to deny unwanted traffic prior to authentication, for example from compromised machines, botnets etc. Though failed connection attempts do not appear to be a significant issue, maybe better to add some safety net for the future. The attached patch is proof of concept code that introduces the parameters rbl_check and rbl_check_timeout (msecs) to the protocol section. Tested for imap, pop3 and sieve. The following is an example for sieve. protocol sieve { rbl_check = zen.spamhaus.net=127.0.0.4 rbl_check_timeout = 5000 } If the lookup results in a hit the client is disconnected with a BYE "Disconnected for policy." message and the logs report: Jun 09 12:00:56 server.example.com dovecot[977650]: managesieve-login: Disconnected: Policy (disconnected before auth was ready, waited 1 secs): user=<>, service=sieve, rip=n.n.n.n, lip=n.n.n.n The patch also makes the number of pre-login errors and post-login errors configurable (max_login_command_errors and max_command_errors respectively) for pop3, imap and sieve protocols . protocol sieve { max_command_errors = 1 max_login_command_errors = 1 } A potential extension to the logic would be "allow_nets" and "disallow_nets" parameters or maybe something more sophisticated to allow ips/networks that would otherwise be blocked or deny additional ips/networks. John

2 3

Error: Mailbox Spam: Failed to autocreate mailbox: Mailbox can't be created
by Jordan Rosenthal 09 Jun '24

09 Jun '24

Hi, I am getting the error "Error: Mailbox Spam: Failed to autocreate mailbox: Mailbox can't be created" and cannot figure out what is causing it. It seems like some sort of permissions issue, but nothing I have tried seems to fix the problem. I was running my setup for many years without issue, and this error started occurring after a recent Ubuntu upgrade. I am using getmail 6.18.4 to fetch mail from a mail server, which then calls /usr/lib/dovecot/deliver to deliver the mail to my local system. It is during this delivery that the error occurs. The dovecot-lda executable exits with status 75 and the log file contains: Jun 09 08:05:54 honeydukes dovecot[1863]: lda(sally)<1863><L9pgDaKaZWZHBwAASkLcPA>: Error: Mailbox Spam: Failed to autocreate mailbox: Mailbox can't be created Jun 09 08:05:54 honeydukes dovecot[1863]: lda(sally)<1863><L9pgDaKaZWZHBwAASkLcPA>: msgid=<REDACTED>: save failed to open mailbox Spam: Mailbox Below is my dovecot configuration. Any help would be appreciated! ------------------ # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 5.15.0-112-generic x86_64 Ubuntu 22.04.4 LTS # Hostname: honeydukes.fios-router.home lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:~/Maildir mail_privileged_group = mail maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = create special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . } passdb { driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " imap sieve" service imap-login { inet_listener imap { port = 0 } } ssl = required ssl_cert = </etc/dovecot/ssl/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it submission_host = <redacted>.com:465 userdb { driver = passwd }

1 0

Accessing IMAP from Python with Encrypted Password
by adam＠ardaemail.com 09 Jun '24

09 Jun '24

Hello again Dovecoters! I have a need to access an IMAP mailbox via a Python script to parse and stored DMARC reports in a SQL database. Right now, I have it working however I am storing the password in plaintext in my database which obviously is not secure. How would you approach this scenario? Would you store the password in the database encrypted and configure Dovecot to accept said encrypted password? If so, can you point me in the right direction to configure Dovecot to handle this? If not, what would you recommend? Is it possible to intercept the email and upload the attachments to an AWS S3 bucket then move the email to another folder? Likewise, if someone wants to help here as well, I need to send outbound email via an authenticated user from Postfix. How would you approach this scenario? Thank you!

3 2

Can't Empty Inbox that is Over quota
by Jason Hirsh 08 Jun '24

08 Jun '24

> I have been trying to update my Postix/Dovecot/MySQL?Postfixadmin installation > > > I am currently on Dovecot. 2.3.2.1 > > I used the guide set forth in Purplehat.org <http://purplehat.org/> which is what got me in trouble as I am in between with setup. (He went off to Maria-db and NGINX I stayed with Apache and MySQL > > > What has happened is may Dovecot Mailboxes are super super saturated. adI inadvertently allowed email from an alarm > > Quota name Type Value Limit % > User quota STORAGE 239754 5120 4682 > User quota MESSAGE 882 - > > > I tried to empty with the command > > sudo doveadm expunge -A mailbox INBOX ALL > > > I get this error > > Error: auth-master: userdb list: User listing returned failure > doveadm: Error: Failed to iterate through some users. > Is there anyway I can remove Dovecot from my server and reinstalll it? It is so messed up I don’t care about losing data Jasion Hirsh

2 4

Re: Can't Empty Inbox that is Over quota
by Jason Hirsh 06 Jun '24

06 Jun '24

> On Jun 6, 2024, at 11:00 AM, Jason Hirsh <kasdivi(a)mac.com> wrote: > > > >> On Jun 6, 2024, at 3:10 AM, Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: >> >>> >>> On 06/06/2024 04:11 EEST Jason Hirsh via dovecot <dovecot(a)dovecot.org> wrote: >>> >>> >>>> Begin forwarded message: >>>> >>>> From: Jason Hirsh <kasdivi(a)mac.com> >>>> Subject: Can't Empty Inbox that is Over quota >>>> Date: June 3, 2024 at 8:15:53 PM EDT >>>> To: dovecot(a)dovecot.org >>>> >>>> I have been trying to update my Postix/Dovecot/MySQL?Postfixadmin installation >>>> >>>> >>>> I am currently on Dovecot. 2.3.2.1 >>>> >>>> I used the guide set forth in Purplehat.org <http://purplehat.org/> which is what got me in trouble as I am in between with setup. (He went off to Maria-db and NGINX I stayed with Apache and MySQL >>>> >>>> >>>> What has happened is may Dovecot Mailboxes are super super saturated. adI inadvertently allowed email from an alarm >>>> >>>> Quota name Type Value Limit % >>>> User quota STORAGE 239754 5120 4682 >>>> User quota MESSAGE 882 - >>>> >>>> >>>> I tried to empty with the command >>>> >>>> sudo doveadm expunge -A mailbox INBOX ALL >>>> >>>> >>>> I get this error >>>> >>>> Error: auth-master: userdb list: User listing returned failure >>>> doveadm: Error: Failed to iterate through some users. >>>> >>> >>> >>> Is there anyway I can remove Dovecot from my server and reinstalll it? It is so messed up I don’t care about losing data >>> >>> >>> >> >> um.. you have multiple issues. >> >> First of all, try >> > > > >> sudo doveadm expunge -u targetuser mailbox INBOX ALL >> > > > Ok I tried that ,,say its ran but postfixadmn shows the mailbox WAY quote and new message to tha user are being rejected > > "Your message to <jason(a)kasdivi.com <mailto:jason@kasdivi.com>> was automatically rejected: > Storage quota for this account has been exceeded, please try again later.Reporting-MTA: dns; triggerfish.theoceanwindow.com <http://triggerfish.theoceanwindow.com/> > Final-Recipient: rfc822; jason(a)kasdivi.com <mailto:jason@kasdivi.com> > Action: failed > Status: 5.2.2” > > So on to > > >> rf /path/to/user/home > > > It all went away. By mail doesn’t not work. Postfixadmin still shows sett is over limited. I try deleting and get a > > Problems running mailbox postdeletion script! > The mailbox postdeletion script failed, check the error log for details! > > >> -A means all users, and it only works if your userdb iteration works. >> >> If you truly do not care about user data and want just get rid of it, >> you can just rm -rf /path/to/user/home >> >> Aki

1 0

Re: Log detective help
by Michael Slusarz 06 Jun '24

06 Jun '24

> On 06/05/2024 1:22 PM MDT GDS via dovecot <dovecot(a)dovecot.org> wrote: > > Hello all, I am seeing hundreds of lines like the one below in my mail.log from this specific IP address, which belongs to Google. Is there a way to determine why this "deferred (delivery temporarily suspended)" is happening? > > Jun 5 19:09:32 arthemis postfix/error[86771]: 5D9D148296D: to=<root(a)localhost.com>, orig_to=<root@localhost>, relay=none, delay=4099, delays=4099/0.02/0/0, dsn=4.4.1, status=deferred (delivery temporarily suspended: connect to localhost.com[74.125.224.72]:25: Connection timed out) "localhost.com" - you almost certainly are intending to connect to localhost (i.e. the local loopback address, 127.0.0.1) rather than the remote domain localhost.com. So it looks like a configuration error. michael

2 1

Fwd: EXPUNGED Folder Always Visible
by Pete Long 06 Jun '24

06 Jun '24

Sorry, forgot to change the To: field :/ Pete. > Begin forwarded message: > > From: Pete Long <pete(a)valar.uk.net> > Subject: Re: EXPUNGED Folder Always Visible > Date: 6 June 2024 at 09:43:50 BST > To: Robert L Mathews <lists(a)tigertech.com> > > > >> On 5 Jun 2024, at 19:18, Robert L Mathews via dovecot <dovecot(a)dovecot.org> wrote: >> >> On Jun 5, 2024, at 12:21 AM, Pete Long via dovecot <dovecot(a)dovecot.org> wrote: >> >>> After a restart of Dovecot, I see this in the logs: >>> >>> Jun 05 08:12:07 imap(pete)<19761><KPYfSB8aj4dWH1ne>: Error: Mailbox Deleted Messages: Lazy-expunge transaction failed: Mailbox Deleted Messages: UID=1 >>> 67: lazy_expunge: Couldn't open expunge mailbox: Failed to open mailbox .EXPUNGED: Invalid mailbox name: Begins with hierarchy separator >> >> Hmmm, I'm not sure about that -- in my setup I have something different, with no actual mailbox for it: >> >> namespace { >> hidden = yes >> inbox = no >> list = no >> location = maildir:~/expunged >> prefix = .EXPUNGED/ >> separator = . >> type = private >> } >> plugin { >> lazy_expunge = .EXPUNGED/ >> lazy_expunge_only_last_instance = yes >> ... >> >> Perhaps someone else who has a similar setup to you with it as a mailbox can offer more advice, sorry! >> > > Not to worry Robert, you've given me some useful information. > > I have a workaround now which 'works for me' (TM). The gist is to copy an acl file to the .EXPUNGED mailbox when it is created, which is usually when a mail is sent, moved or deleted. I am not using global acls so note the commented line in the next paragraph. > > In /etc/dovecot/conf.d/50-expunge.conf: > > namespace inbox { > mailbox EXPUNGED { > autoexpunge = 7days > autoexpunge_max_mails = 100000 > } > } > > > mail_plugins = $mail_plugins lazy_expunge acl > plugin { > # Move messages to an .EXPUNGED mailbox > lazy_expunge = EXPUNGED > > # Define ACL so that user cannot list the .EXPUNGED mailbox > #acl = vfile:/etc/dovecot/global-acls/expunged-acl > > # Expunged messages most likely don't want to be included in quota: > quota_rule = EXPUNGED:ignore > } > > > Once the ~/Maildir/.EXPUNGED directory is created, I copy this 'dovecot-acl' file in to that .EXPUNGED directory: > > owner wstipeka > > Note that there is no l,r or x. https://doc.dovecot.org/configuration_manual/acl/#acl > > > The end result is that the .EXPUNGED mailbox contains deleted and moved mail items but the user cannot see this mailbox and cannot delete it anyway. > > If necessary I can fire up Mutt and traverse to the relevant users .EXPUNGED folder to rescue deleted items. If they also happen to have FTP and/or SSH access, I can make the dovecot-acl immutable if necessary. > > Thanks again Robert for giving me some more options. > > > All the best, > > Pete. >

1 0

Can't Empty Inbox that is Over quota
by Jason Hirsh 06 Jun '24

06 Jun '24

I have been trying to update my Postix/Dovecot/MySQL?Postfixadmin installation I am currently on Dovecot. 2.3.2.1 I used the guide set forth in Purplehat.org <http://purplehat.org/> which is what got me in trouble as I am in between with setup. (He went off to Maria-db and NGINX I stayed with Apache and MySQL What has happened is may Dovecot Mailboxes are super super saturated. adI inadvertently allowed email from an alarm Quota name Type Value Limit % User quota STORAGE 239754 5120 4682 User quota MESSAGE 882 - I tried to empty with the command sudo doveadm expunge -A mailbox INBOX ALL I get this error Error: auth-master: userdb list: User listing returned failure doveadm: Error: Failed to iterate through some users. My dovecot configurations is # 2.3.21 (47349e2482): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.21 (f6cd4b8e) # OS: FreeBSD 13.2-RELEASE-p4 amd64 ufs # Hostname: triggerfish.theoceanwindow.com dict { quota = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 110 first_valid_uid = 110 hostname = triggerfish.theoceanwindow.com last_valid_gid = 110 last_valid_uid = 110 lmtp_rcpt_check_quota = yes mail_location = maildir:/usr/local/virtual/%d/%n mail_plugins = quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { expire = Trash imapsieve_mailbox1_before = file:/usr/local/virtual/sieve/rspamd/rspamd-learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/usr/local/virtual/sieve/rspamd/rspamd-learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * imapsieve_mailbox3_before = file:/usr/local/virtual/sieve/global/read.sieve imapsieve_mailbox3_causes = COPY imapsieve_mailbox3_name = Trash mail_home = /usr/local/virtual/%d/%n mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:User quota::proxy::quota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 10%% quota_max_mail_size = 100M quota_rule = *:storage=1G quota_rule2 = Trash:storage=+30%% quota_rule3 = Sent:storage=+30%% quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning4 = -storage=100%% quota-warning -100 %u sieve = /usr/local/virtual/%d/%n/.dovecot.sieve sieve_before = /usr/local/virtual/sieve/global/default.sieve sieve_dir = /usr/local/virtual/%d/%n/sieve sieve_global = /usr/local/virtual/sieve/global/ sieve_global_dir = /usr/local/virtual/sieve/global/ sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment sieve_pipe_bin_dir = /usr/local/virtual/sieve/rspamd sieve_plugins = sieve_imapsieve sieve_extprograms } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh postmaster_address = admin(a)theoceanwindow.com protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = mail mode = 0666 user = postfix } unix_listener auth-userdb { group = mail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vscan mode = 0660 user = vscan } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/virtual/bin/quota-warning.sh unix_listener quota-warning { user = vscan } user = dovecot } ssl_ca = </usr/local/etc/ssl/openssl/theoceanwindow.com/ca_bundle.crt ssl_cert = </usr/local/etc/ssl/openssl/theoceanwindow.com/certificate.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = quota quota sieve zlib } protocol imap { mail_plugins = quota quota imap_quota zlib } protocol pop3 { mail_plugins = quota } jason@triggerfish:/usr/local/etc/apache24/extra: Sorry about the colors. I am at whit ends with the system and dont have the energy to take on apple mail formating I imagine I have messed up a Mysql query? Thanks for bearing with me

2 2

Log detective help
by GDS 06 Jun '24

06 Jun '24

Hello all, I am seeing hundreds of lines like the one below in my mail.log from this specific IP address, which belongs to Google. Is there a way to determine why this "deferred (delivery temporarily suspended)" is happening? Jun 5 19:09:32 arthemis postfix/error[86771]: 5D9D148296D: to=<root(a)localhost.com>, orig_to=<root@localhost>, relay=none, delay=4099, delays=4099/0.02/0/0, dsn=4.4.1, status=deferred (delivery temporarily suspended: connect to localhost.com[74.125.224.72]:25: Connection timed out) Thank you,Greg

2 1

EXPUNGED Folder Always Visible
by Pete Long 05 Jun '24

05 Jun '24

Hi all, I'm having a bit of a time trying to get the EXPUNGED mailbox to not display when any mail is moved or deleted. Here's what I'm running: Operating System = Debian 11.9 Dovecot = 2.3.13 MUA = Mac OS X Mail 16.0 $3774.600.62$ Here is the information I think is relevant: # cat /etc/dovecot/conf.d/50-expunge.conf namespace INBOX { mailbox EXPUNGED { autoexpunge = 7days autoexpunge_max_mails = 10000 } } mail_plugins = $mail_plugins lazy_expunge acl plugin { lazy_expunge = EXPUNGED quota_rule = EXPUNGED:ignore } # cat /etc/dovecot/conf.d/90-acl.conf [...] plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 } [...] # cat /etc/dovecot/global-acls/expunged.acl EXPUNGED user=masteruser lr I have also tried setting 'expunged.acl' to the following, with no ACL flags: EXPUNGED owner This version doesn't seem to do anything different but that's probably down to me. No matter what I do with this current configuration, I cannot get the EXPUNGED folder to stop showing after any deletion or move. This point aside, Dovecot's doing almost exactly what I want: all mail moved or deleted ends up in EXPUNGED; I just don't want to see it, nor anyone else with an account on my server ;) Thanks for your time and any information you can provide. Pete.

2 3

Debug: open(/proc/self/io) failed: Permission denied
by se＠maildaddy.eu 01 Jun '24

01 Jun '24

Tried all kinds of user setup, and read what I found on different foras, but still get: "Debug: open(/proc/self/io) failed: Permission denied" Is anyone able to spot the misconfig? Thanks in advance! This is my dovecot -n: # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.7.2 () # OS: Linux 5.4.70-050470-generic x86_64 Ubuntu 20.04.6 LTS # Hostname: host auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_username_format = %Ln mail_location = maildir:~/Maildir mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { auto = create special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = create special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = create special_use = \Trash } prefix = } passdb { driver = pam } protocols = imap pop3 lmtp imap lmtp pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = required ssl_cert = </etc/letsencrypt/live/mail.spijoing.com/fullchain.pem ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { driver = passwd }

2 2

problem setting sieve_vacation_send_from_recipient = yes
by schuerbel＠vodafonemail.de 01 Jun '24

01 Jun '24

Hello, dovecot sieve sends vacation replies with an empty FROM: field by default. Sadly my provider rejects such emails. I tried to change this behavior by adding sieve_vacation_send_from_recipient = yes to the plugin section in dovecot.conf. But still vacation replies are send with empty FROM: fields. Is there any further setting i have to change ? My Version is dovecot 2.3.16 (7e2e900c1a) on Ubuntu 22.04 . Here is my setting from dovecot -n : log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:~/Maildir mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_vacation_send_from_recipient = yes } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } user = root } ssl_cert = </etc/ssl/localcerts/servercert_pub.pem ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM ssl_key = # hidden, use -P to show it userdb { driver = passwd } userdb { driver = passwd } verbose_ssl = yes protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = torben(a)garfield.no-work.to quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } regards TS

1 0

sasl database
by Jeff P 01 Jun '24

01 Jun '24

Hello, Is there a guide for using a customized SASL database for dovecot? for example, SQLite. Thanks in advance.

3 2

Pigenohole bad commands limits and proposed minor patch
by John Fawcett 01 Jun '24

01 Jun '24

Hi I was looking into Pigeonhole behaviour in the case of managesieve receiving invalid input either before or after login. I can see that there are hard coded limits after 3 sequential bad commands prior to authentication and 20 after authentication. I was wondering if there is a reason for those values. Sieve is a protocol that is used with software and except for the limited use case of testing it is not used by people typing manually. I don't know of a lot of sieve clients. Unfortunately the one I used in Thunderbird is no longer maintained, so I only have roundcube. But do legitimate sieve clients in general make a lot of mistakes? An additional doubt about errors that I am seeing is that differently to imap and pop3 there doen't appear to be a dedicated ssl port. I only have starttls configured. I do see what look like people trying to connect with ssl directly on port 4190, which with my configuration is never going to be valid. I am attaching a very simple proposed patch to make the error limits configurable via the following settings in conf.d/20-managesieve.conf with defaults as per the existing hard coded ones: managesieve_max_command_errors = 20 managesieve_login_max_command_errors = 3 I have similar doubts about imap error limits but I'll start with sieve ones. John

1 0

Unable to get quotas working
by Adam Miller 01 Jun '24

01 Jun '24

Ubuntu Version: Linux 6.2.0-1017-aws x86_64 Ubuntu 22.04.4 LTS nfs4 Postfix: Version: 3.6.4 Dovecot Version: 2.3.16 (7e2e900c1a) Pigeonhole Version: 0.5.16 (09c29328) Rspamd Version: 3.8.4 Protocols: IMAP, LMTP, SMTP Setup: I have an email server running with virtual domains and virtual mailboxes that is currently hosting about 10GB of email across 15 domains and 8 mailboxes which will expand drastically once I get this to work. The server is an AWS EC2 instance with an AWS RDS instance for the database and using AWS EFS for storage. Everything works quite well except quotas! Problem: I am having an issue with getting quotas to work. When using “doveadm”, I can list the mailboxes however the “Limit” column is just a hyphen “-“ like there is no limit even though every account is set to 10GB for their limit in the database. At the same time, the actual used storage and messages is not getting updated in the database either yet there are no errors from what I can see in the logging. Configuration from “dovecot -n”: auth_debug = yes auth_mechanisms = plain login auth_verbose = yes auth_worker_max_count = 5 base_dir = /var/run/dovecot debug_log_path = /var/log/dovecot/debug.log default_internal_group = ardaemail default_internal_user = ardaemail dict { quota = mysql:/etc/dovecot/inc.d/inc.quota.user.sql.conf } info_log_path = /var/log/dovecot/info.log instance_name = ec2-us-east-1a-arda-mail-001.ardaemail.com listen = 172.16.0.200 log_path = /var/log/dovecot/general.log login_greeting = Welcome to ArdaEmail mail_debug = yes mail_gid = ardaemail mail_location = maildir:/mnt/mail/%d/%n mail_plugins = " quota" mail_uid = ardaemail maildir_stat_dirs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = no special_use = \Drafts } mailbox Junk { auto = no autoexpunge = 30 days special_use = \Junk } mailbox "Junk E-mail" { auto = no autoexpunge = 30 days special_use = \Junk } mailbox "Junk Email" { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = no special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = no autoexpunge = 30 days special_use = \Trash } prefix = } passdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } plugin { imapsieve_mailbox1_before = file:/etc/dovecot/sieve.d/spam/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve.d/spam/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * quota = dict:quota::proxy::quota quota_exceeded_message = 452 4.2.2 Mailbox is full and cannot receive any more emails recipient_delimiter = + sieve_after = /etc/dovecot/sieve.d/after/ sieve_before = /etc/dovecot/sieve.d/before/ sieve_extensions = +spamtest +spamtestplus +virustest +notify +imapflags sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_quota_max_storage = 0 sieve_spamtest_max_header = X-Spam-Score: -?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]) sieve_spamtest_status_header = X-Spam-Score: (-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]] sieve_spamtest_status_type = score } protocols = imap lmtp service auth-worker { group = ardaemail user = ardaemail } service auth { group = ardaemail unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = ardaemail mode = 0666 user = ardaemail } user = ardaemail } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service imap { group = ardaemail user = ardaemail } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } service submission-login { inet_listener submission { port = 0 } } ssl = required ssl_cert = </etc/letsencrypt/live/mail.ardaemail.com/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } verbose_ssl = yes protocol imap { mail_plugins = " quota imap_sieve imap_quota quota" } protocol lmtp { mail_plugins = " quota sieve imap_quota quota" } Configuration for “/etc/dovecot/inc.d/inc.quota.user.sql.conf”: connect = host=mydb dbname=mydb user=mydbuser password=mydbpass map { pattern = priv/quota/storage table = mailbox username_field = email value_field = size } map { pattern = priv/quota/limit/storage table = mailbox username_field = email value_field = quota } map { pattern = priv/quota/messages table = mailbox username_field = email value_field = size_messages } map { pattern = priv/quota/limit/storage table = mailbox username_field = email value_field = quota_messages } Configuration from “/etc/dovecot/inc.d/inc.sql.conf”: driver = mysql connect = host=mydb dbname=mydb user=mydbuser password=mydbpass default_pass_scheme = BLF-CRYPT password_query = SELECT email AS user, password FROM mailbox WHERE email = '%u'; user_query = SELECT maildir AS home, 10000 AS uid, 10000 AS gid, 'dict:quota::proxy::quota' AS quota FROM mailbox WHERE email = '%u'; iterate_query = SELECT email AS username, size, 'dict:quota::proxy::quota' AS quota FROM mailbox ORDER BY domainName ASC, email ASC; Database Table: “mailbox” CREATE TABLE `mailbox` ( `id` int(11) unsigned NOT NULL AUTO_INCREMENT, `uuid` varchar(36) NOT NULL, `domainUuid` varchar(36) NOT NULL, `domainName` varchar(96) DEFAULT NULL, `username` varchar(96) NOT NULL DEFAULT '', `password` varchar(128) NOT NULL, `firstname` varchar(32) NOT NULL, `lastname` varchar(32) NOT NULL, `email` varchar(192) NOT NULL DEFAULT '', `maildir` text NOT NULL, `quota` bigint(24) NOT NULL DEFAULT 0, `quota_messages` bigint(24) NOT NULL DEFAULT 0, `size` bigint(24) NOT NULL DEFAULT 0, `size_messages` bigint(24) NOT NULL DEFAULT 0, `isActive` tinyint(1) NOT NULL DEFAULT 1, `createdAt` datetime NOT NULL DEFAULT current_timestamp(), `updatedAt` datetime NOT NULL DEFAULT current_timestamp() ON UPDATE current_timestamp(), PRIMARY KEY (`id`), UNIQUE KEY `UNIQUE_UUID` (`uuid`) ) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_general_ci; Where “username” is the first part of the email address and “email” is the full email address. I need to query using the full email address because of possible cross domain email addresses. Output from “doveadm quota get -A”: Username Quota name Type Value Limit % HIDDEN quota STORAGE 570742 - 0 HIDDEN quota MESSAGE 0 - 0 HIDDEN quota STORAGE 1 - 0 HIDDEN quota MESSAGE 0 - 0 HIDDEN quota STORAGE 1 - 0 HIDDEN quota MESSAGE 0 - 0 HIDDEN quota STORAGE 1068 - 0 HIDDEN quota MESSAGE 0 - 0 HIDDEN quota STORAGE 462 - 0 HIDDEN quota MESSAGE 0 - 0 HIDDEN quota STORAGE 41165 - 0 HIDDEN quota MESSAGE 0 - 0 HIDDEN quota STORAGE 1598246 - 0 HIDDEN quota MESSAGE 0 - 0 HIDDEN quota STORAGE 695776 - 0 HIDDEN quota MESSAGE 0 - 0 I have no idea what is wrong and I have been at this for over 12 hours trying to get the quotas to work. What I am expecting us when emails are delivered for the “quota” and “messages” columns in the “mailbox” table to be updated and when I run “doveadm quota get -A” to show me the current usages and limits for each mailbox. Once I have that working, I will move on to actually rejecting emails via Postfix + Dovecot LMTP when a users mailbox is full but right now, I am just trying to get this to work. Any help is greatly appreciated. Also, I tried creating an account for the mailing list but never received the email. Thank you!

3 5

Gather statistics to check effectivity of spam filter?
by Camilo Sperberg 30 May '24

30 May '24

Hi list :) We want to make some changes to our spam filter, but we first want to be able to check if what we do does have any effect. So I was thinking of storing in our statistics if somebody moves an email to their Junk folder (or even better: vice versa). I have created the following metric for this: metric imap_command_move { filter = event=imap_command_finished AND cmd_name="UID MOVE" AND (cmd_args = "* Junk" OR cmd_args = "* INBOX") group_by = cmd_args } And when I move something to the Junk folder I get the following after a doveadm stats dump: (...) imap_command_move duration 5 252529 27061 124989 50505.80 34476 37503.81 124989 imap_command_move_15_Junk duration 1 124989 124989 124989 124989.00 124989 0.00 124989 imap_command_move_14_Junk duration 1 38725 38725 38725 38725.00 38725 0.00 38725 imap_command_move_12_INBOX duration 1 27061 27061 27061 27061.00 27061 0.00 27061 imap_command_move_13_INBOX duration 1 27278 27278 27278 27278.00 27278 0.00 27278 imap_command_move_3_INBOX duration 1 34476 34476 34476 34476.00 34476 0.00 34476 In my example, I moved 6 messages: 2 from INBOX to Junk, 1 from INBOX to a separate folder, 2 from Junk back to INBOX and 1 from the separate folder back to INBOX. However, because I'm grouping by cmd_args, it includes the full parameters: IMAP command’s full parameters (e.g. 1:* FLAGS) https://doc.dovecot.org/admin_manual/list_of_events/#imap-command Is there a way to filter out the first part so that I ideally get a stat named imap_command_move_Junk & imap_command_move_INBOX? Is there perhaps a way to get to know specifically the from and to folders the user is moving the mail from and to? Thanks!

1 0

mbox parsing failed and crashed
by runtomaker＠gmail.com 28 May '24

28 May '24

In below data getting from Postfix. Dovecot imap protocol when fetching mails returns no data. So program crashing when parsing mbox file. Mbox file: "From info(a)asd.com Tue May 28 14:53:11 2024 Return-Path: <info(a)asd.com> X-Original-To: test(a)example.com Delivered-To: test(a)example.com Subject: asd " Error: "Panic: file istream-header-filter.c: line 663 (i_stream_header_filter_snapshot_free): assertion failed: (snapshot->mstream->snapshot_pending)"

1 1

Oauth2 MFA config
by Scott Q. 24 May '24

24 May '24

Anyone managed to get Dovecot working as smoothly with OAUTH2 as Gmail has with Outlook ? So that for example when you add the account up in Outlook it performs all the required steps for saving the device, getting tokens, etc. Ideally with a custom ID provider, not Google as described here: https://doc.dovecot.org/configuration_manual/authentication/oauth2/

2 1

I can't configure shared mailbox ACLs using LDAP information
by moso.mosoleu＠gmail.com 24 May '24

24 May '24

It shouldn't be impossible, but I've tried countless ways and not even ChatGPT 4o was able to help me! :D I use three LDIF files to get OpenLDAP ready for testing. In the first LDIF I just modify the schema to add the associatedDomain attributes (then I could configure the server to serve more than one domain). The second LDIF is to add 4 objects to the schema that I use to differentiate accounts that actually receive/send emails and have a password; another thing done in it is to add a "groupOfUniqueNamesWithMail" object that allows the "mail" and "mailEnabled" attributes that are then necessary to use in the entries created in the "shared-mailboxes" OU. Finally, the third LDIF populates the LDAP by creating OUs, user accounts and creating entries in "shared-mailboxes" that serve to say which user accounts have access to which other user accounts. When I start the email server, sending and receiving emails works perfectly. And mailbox shares work as expected if I manually use, for each share, the command: doveadm acl set -u admin(a)mydomain.com.br INBOX user=user.1(a)mydomain.com.br lookup read write write-seen write-deleted insert post expunge create delete But just as authentication works perfectly via LDAP, I believe there must be a way to configure Dovecot to dynamically adjust ACLs via LDAP. The configuration in principle would be this: acl_search_base = ou=shared-mailboxes,dc=mydomain,dc=com,dc=br acl_search_filter = (&(objectClass=groupOfUniqueNamesWithMail)(|(uniqueMember=mail=%u,ou=system-accounts,dc=mydomain,dc=com,dc=br)(uniqueMember=mail=%u,ou=department-accounts ,dc=mydomain,dc=com,dc=br)(uniqueMember=mail=%u,ou=mailing-accounts,dc=mydomain,dc=com,dc=br)(uniqueMember=mail=%u,ou=person -accounts,dc=mydomain,dc=com,dc=br))) acl_user = %u Testing this filter on the command line with "ldapsearch" the expected results are returned. I mean, I enter an email address from a user account and the result is all the other user account email addresses that the first one would have access to. Any charitable soul who is willing to help and needs more information, just say what you need and I will try to respond as quickly as possible. I will place the content of the three LDIFs below. [ 01-modify_domain.ldif ] dn: dc=mydomain,dc=com,dc=br changetype: modify add: objectClass objectClass: domainRelatedObject - add: associatedDomain associatedDomain: mydomain.com.br - add: associatedDomain associatedDomain: anotherdomain.com.br [ 02-add_my_object_classes_to_schema.ldif ] # Object class for system user accounts dn: cn=SystemAccount,cn=schema,cn=config objectClass: olcSchemaConfig cn: SystemAccount olcObjectClasses: ( 1.3.6.1.4.1.99999.1.1 NAME 'SystemAccount' DESC 'Object class for system accounts' SUP top AUXILIARY ) # Object class for department user accounts dn: cn=DepartmentAccount,cn=schema,cn=config objectClass: olcSchemaConfig cn: DepartmentAccount olcObjectClasses: ( 1.3.6.1.4.1.99999.1.2 NAME 'DepartmentAccount' DESC 'Object class for department accounts' SUP top AUXILIARY ) # Object class for mailing user accounts dn: cn=MailingAccount,cn=schema,cn=config objectClass: olcSchemaConfig cn: MailingAccount olcObjectClasses: ( 1.3.6.1.4.1.99999.1.3 NAME 'MailingAccount' DESC 'Object class for mailing accounts' SUP top AUXILIARY ) # Object class for person user accounts dn: cn=PersonAccount,cn=schema,cn=config objectClass: olcSchemaConfig cn: PersonAccount olcObjectClasses: ( 1.3.6.1.4.1.99999.1.4 NAME 'PersonAccount' DESC 'Object class for person accounts' SUP top AUXILIARY ) # Object class that allows groupOfUniqueNames to have a mail attribute dn: cn=groupOfUniqueNamesWithMail,cn=schema,cn=config objectClass: olcSchemaConfig cn: groupOfUniqueNamesWithMail olcObjectClasses: ( 1.3.6.1.4.1.99999.1.5 NAME 'groupOfUniqueNamesWithMail' SUP groupOfUniqueNames STRUCTURAL MAY ( mail $ mailEnabled ) ) [ 03-initialize_mydomain.com.br.ldif ] ### Create organizaitonal units dn: ou=system-accounts,dc=mydomain,dc=com,dc=br ou: system-accounts objectClass: organizaitonalUnit objectClass: top dn: ou=department-accounts,dc=mydomain,dc=com,dc=br ou: department-accounts objectClass: organizaitonalUnit objectClass: top dn: ou=mailing-accounts,dc=mydomain,dc=com,dc=br ou: mailing-accounts objectClass: organizaitonalUnit objectClass: top dn: ou=person-accounts,dc=mydomain,dc=com,dc=br ou: person-accounts objectClass: organizaitonalUnit objectClass: top dn: ou=shared-mailboxes,dc=mydomain,dc=com,dc=br ou: shared-mailboxes objectClass: organizaitonalUnit objectClass: top ################################################################################ ## Create System User Accounts # not related to a person # can be accessed directly or indirectly by more than one person dn: mail=admin(a)mydomain.com.br,ou=system-accounts,dc=mydomain,dc=com,dc=br uid: admin userPassword: {SSHA} displayName: My Domain - Admin givenName: System sn: Admin cn: System Admin mail: admin(a)mydomain.com.br mailAlias: root(a)mydomain.com.br mailAlias: postmaster(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/system-accounts/admin/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/system-accounts/admin/ descripiton: My Domain - Admin (root/postmaster) objectClass: PostfixBookMailAccount objectClass: SystemAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top dn: mail=smtp(a)mydomain.com.br,ou=system-accounts,dc=mydomain,dc=com,dc=br uid: smtp userPassword: {SSHA} displayName: My Domain - SMTP givenName: System sn: SMTP cn: System SMTP mail: smtp(a)mydomain.com.br mailAlias: no-reply(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/system-accounts/smtp/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/system-accounts/smtp/ descripiton: My Domain - System SMTP objectClass: PostfixBookMailAccount objectClass: SystemAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top dn: mail=smtp-auditor(a)mydomain.com.br,ou=system-accounts,dc=mydomain,dc=com,dc=br uid: smtp-auditor userPassword: {SSHA} displayName: My Domain - SMTP Auditor givenName: System sn: SMTP Auditor cn: System SMTP Auditor mail: smtp-auditor(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/system-accounts/smtp-auditor/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/system-accounts/smtp-auditor/ descripiton: My Domain - System SMTP Auditor objectClass: PostfixBookMailAccount objectClass: SystemAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top ################################################################################ ## Create Department User Accounts # not related to a person # can be accessed directly or indirectly by more than one person dn: mail=it(a)mydomain.com.br,ou=department-accounts,dc=mydomain,dc=com,dc=br uid: it userPassword: {SSHA} displayName: My Domain - Information Technology givenName: My Domain sn: IT cn: My Domain - IT mail: it(a)mydomain.com.br mailAlias: information.technology(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/department-accounts/it/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/department-accounts/it/ descripiton: My Domain - Information Technology (IT) objectClass: PostfixBookMailAccount objectClass: DepartmentAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top ################################################################################ ## Create Mailing User Accounts # not related to a person # can be accessed directly or indirectly by more than one person dn: mail=everyone(a)mydomain.com.br,ou=mailing-accounts,dc=mydomain,dc=com,dc=br uid: everyone userPassword: {SSHA} displayName: My Domain - Everyone givenName: My Domain sn: everyone cn: My Domain - Everyone mail: everyone(a)mydomain.com.br mailAlias: everyone(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/mailing-accounts/everyone/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/mailing-accounts/everyone/ descripiton: My Domain - Everyone mailing list objectClass: PostfixBookMailAccount objectClass: MailingAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top dn: mail=mailing.list.1(a)mydomain.com.br,ou=mailing-accounts,dc=mydomain,dc=com,dc=br uid: mailing.list.1 userPassword: {SSHA} displayName: My Domain - Mailing List 1 givenName: My Domain sn: Mailing List 1 cn: My Domain - Mailing List 1 mail: mailing.list.1(a)mydomain.com.br mailAlias: ml.1(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/mailing-accounts/mailing.list.1/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/mailing-accounts/mailing.list.1/ descripiton: My Domain - Mailing List 1 objectClass: PostfixBookMailAccount objectClass: MailingAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top dn: mail=mailing.list.2(a)mydomain.com.br,ou=mailing-accounts,dc=mydomain,dc=com,dc=br uid: mailing.list.2 userPassword: {SSHA} displayName: My Domain - Mailing List 2 givenName: My Domain sn: Mailing List 2 cn: My Domain - Mailing List 2 mail: mailing.list.2(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/mailing-accounts/mailing.list.2/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/mailing-accounts/mailing.list.2/ descripiton: My Domain - Mailing List 2 objectClass: PostfixBookMailAccount objectClass: MailingAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top ################################################################################ ## Create Person User Accounts dn: mail=user.1(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br uid: user.1 userPassword: {SSHA} displayName: User 1 givenName: User sn: 1 cn: User 1 mail: user.1(a)mydomain.com.br mailAlias: user.one(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/person-accounts/user.1/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/person-accounts/user.1/ descripiton: My Domain - User 1 objectClass: PostfixBookMailAccount objectClass: PersonAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top dn: mail=user.2(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br uid: user.2 userPassword: {SSHA} displayName: User 2 givenName: User sn: 2 cn: User 2 mail: user.2(a)mydomain.com.br mailAlias: user.two(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/person-accounts/user.2/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/person-accounts/user.2/ descripiton: My Domain - User 2 objectClass: PostfixBookMailAccount objectClass: PersonAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top dn: mail=user.3(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br uid: user.3 userPassword: {SSHA} displayName: User 3 givenName: User sn: 3 cn: User 3 mail: user.3(a)mydomain.com.br mailAlias: user.three(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/person-accounts/user.3/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/person-accounts/user.3/ descripiton: My Domain - User 3 objectClass: PostfixBookMailAccount objectClass: PersonAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top ################################################################################ ## for Shared System User Accounts dn: cn=admin(a)mydomain.com.br,ou=shared-mailboxes,dc=mydomain,dc=com,dc=br mail: admin(a)mydomain.com.br mailEnabled: TRUE uniqueMember: mail=user.1(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br objectClass: groupOfUniqueNames objectClass: groupOfUniqueNamesWithMail objectClass: top ## for Shared Department User Accounts dn: cn=it(a)mydomain.com.br,ou=shared-mailboxes,dc=mydomain,dc=com,dc=br mail: it(a)mydomain.com.br mailEnabled: TRUE uniqueMember: mail=user.1(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br objectClass: groupOfUniqueNames objectClass: groupOfUniqueNamesWithMail objectClass: top ## for Shared Mailing User Accounts dn: cn=everyone(a)mydomain.com.br,ou=shared-mailboxes,dc=mydomain,dc=com,dc=br mail: everyone(a)mydomain.com.br mailEnabled: TRUE uniqueMember: mail=user.1(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br uniqueMember: mail=user.2(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br uniqueMember: mail=user.3(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br objectClass: groupOfUniqueNames objectClass: groupOfUniqueNamesWithMail objectClass: top dn: cn=mailing.list.1(a)mydomain.com.br,ou=shared-mailboxes,dc=mydomain,dc=com,dc=br mail: mailing.list.1(a)mydomain.com.br mailEnabled: TRUE uniqueMember: mail=user.2(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br uniqueMember: mail=user.3(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br objectClass: groupOfUniqueNames objectClass: groupOfUniqueNamesWithMail objectClass: top dn: cn=mailing.list.2(a)mydomain.com.br,ou=shared-mailboxes,dc=mydomain,dc=com,dc=br mail: mailing.list.2(a)mydomain.com.br mailEnabled: TRUE uniqueMember: mail=user.1(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br objectClass: groupOfUniqueNames objectClass: groupOfUniqueNamesWithMail objectClass: top ## for Shared User Accounts dn: cn=user.2(a)mydomain.com.br,ou=shared-mailboxes,dc=mydomain,dc=com,dc=br mail: user.2(a)mydomain.com.br mailEnabled: FALSE uniqueMember: mail=user.1(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br objectClass: groupOfUniqueNames objectClass: groupOfUniqueNamesWithMail objectClass: top

3 3

Command "doveadm director kick ...." doesn't work
by g.carabella＠panservice.it 23 May '24

23 May '24

Hi, I have a Dovecot installation (version 2.3.16) with 3 directors and 4 backend servers. Three backend servers have the director_tag 'new', one has the director_tag 'old'. The users are on the DB, the director_tag is a table field. I want to migrate mailboxes from the old backend (Maildir format) to the new (mdbox format). For the migration I use the "doveadm backup" command and everything works fine. The problem I'm having is that I can't kick the user (if logged in). Once the migration is done (as indicated https://doc.dovecot.org/3.0/man/doveadm-sync.1/) I modify the user's home, mail_location and director_tag and then execute the command "doveadm director kick ..." but the connection on the directors is not killed. Why does this problem occur? Could it be due to the use of the director_tag and the fact that for the command "doveadm director kick ..." it is not possible to specify it? Even if I run the command "doveadm director move mailbox_account new_backend_server", the director adds a new connection but does not kill the previous one, with the result that there are two connections for the same user, one on the new backend and one on the old one. I also tried to configure the director_tag only for the 3 new servers, but the "director kick" still doesn't work.

1 0

Problems using non-libc memory allocators
by bl0v3 22 May '24

22 May '24

Hey I was trying to use dovecot2 with a not libc based memory allocation such as scudo or graphene-hardened or graphene-hardened-light but ran into the issues I described in https://github.com/NixOS/nixpkgs/issues/313721 I just wanted to mention this here as well as this behavior may suggest a flaw in the memory allocation mechanism of dovecot2/anvil. I haven't yet found the time to check the underlaying issue as I'm quite busy rn. So I thought id just mention what I came across in case this is actually unexpected or potentially even security relevant mis/behavior.

2 1

Dovecot calculating quota wrong or am I stupid?
by jarland＠mxroute.com 21 May '24

21 May '24

I'm currently running 2.3.21 on this system and here's what I'm seeing (a bit cut down for excess): # doveadm quota get -u emailuser(a)domain.net STORAGE 1052385 MESSAGE 2741 So the storage is roughly more than 1GB according to Dovecot. No change after quota recalc. But: root@arrow:/home/username/imap/domain.net# du -sh emailuser 692M emailuser There are no symlinks or anything like that. Quota config is pretty basic: root@arrow:/etc/dovecot# cat conf.d/90-quota.conf #add quota to end of line in: #/etc/dovecot/conf/mail_plugins.conf, eg: #mail_plugins = $mail_plugins quota #add imap_quota to end of line in: #/etc/dovecot/conf/imap_mail_plugins.conf, eg: #mail_plugins = $mail_plugins imap_quota plugin { quota = maildir } If anyone has advice I would greatly appreciate it.

1 1

Re: After user disconnect run the custom script
by Michael Slusarz 20 May '24

20 May '24

> On 05/20/2024 9:43 AM MDT Alexey Krylov via dovecot <dovecot(a)dovecot.org> wrote: > > Please, send me the link, where I can find the info about configuring > firing script after dovecot client is disconnected. > > I found post-login scripting. Than's cool, but... I need to fire script > a little bit later. See https://doc.dovecot.org/admin_manual/list_of_events/#mail-user-session-fini… You will need to build a event listener for this event, and then do your scripting in there. michael

1 0

After user disconnect run the custom script
by Alexey Krylov 20 May '24

20 May '24

Sirs, good day. Please, send me the link, where I can find the info about configuring firing script after dovecot client is disconnected. I found post-login scripting. Than's cool, but... I need to fire script a little bit later. May be I try to build crutches... But I wish with all my heart to do this. Thanks to everyone who responded. -- Это сообщение было проверено антивирусным ПО Avast на наличие вирусов. www.avast.com

1 0

Errors after enable add mail_attachment_detection_options
by Ricardo Machini 20 May '24

20 May '24

Hello, I got a lot of fatal errors on differents mailbox after I added the option: mail_attachment_detection_options = add-flags Rocky Linux release 8.9 (Green Obsidian) 2.3.21 (47349e2482) May 16 15:03:00 Panic: imap(user(a)domain.com.br)<1669762><cOqoC5YYQlq63CaF>: file imap-sieve-storage.c: line 317 (imap_sieve_add_mailbox_event): assertion failed: (ismt->src_box == NULL || ismt->src_box == src_box) May 16 15:03:00 Error: imap(user(a)domain.com.br)<1669762><cOqoC5YYQlq63CaF>: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x41) [0x7f2c9d8b9761] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x22) [0x7f2c9d8b9882] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10bb6b) [0x7f2c9d8c6b6b] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10bc07) [0x7f2c9d8c6c07] -> /usr/lib64/dovecot/libdovecot.so.0(+0x5cec5) [0x7f2c9d817ec5] -> /usr/lib64/dovecot/lib95_imap_sieve_plugin.so(+0x7ebc) [0x7f2c9b011ebc] -> /usr/lib64/dovecot/lib95_imap_sieve_plugin.so(+0x815f) [0x7f2c9b01215f] -> /usr/lib64/dovecot/lib20_zlib_plugin.so(+0x4a37) [0x7f2c9c179a37] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mail_free+0x12) [0x7f2c9dc73982] -> /usr/lib64/dovecot/lib95_imap_sieve_plugin.so(+0x71be) [0x7f2c9b0111be] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_free+0x1e) [0x7f2c9dbef55e] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xf124f) [0x7f2c9dc8624f] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x80) [0x7f2c9dc9f900] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_transaction_commit+0xf1) [0x7f2c9dc867e1] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xccb15) [0x7f2c9dc61b15] -> /usr/lib64/dovecot/lib95_imap_sieve_plugin.so(+0x885d) [0x7f2c9b01285d] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0x13de4) [0x7f2c9c79fde4] -> /usr/lib64/dovecot/lib15_notify_plugin.so(+0x240d) [0x7f2c9c9cf40d] -> /usr/lib64/dovecot/lib10_quota_plugin.so(+0xfcdf) [0x7f2c9cde5cdf] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x7a) [0x7f2c9dc000ba] -> dovecot/imap [user(a)domain.com.br 186.220.38.133 UID COPY](+0x153c2) [0x559668ce73c2] -> dovecot/imap [user(a)domain.com.br 186.220.38.133 UID COPY](command_exec+0x6c) [0x559668cf559c] -> dovecot/imap [user(a)domain.com.br 186.220.38.133 UID COPY](+0x215af) [0x559668cf35af] -> dovecot/imap [user(a)domain.com.br 186.220.38.133 UID COPY](+0x21661) [0x559668cf3661] -> dovecot/imap [user(a)domain.com.br 186.220.38.133 UID COPY](+0x21882) [0x559668cf3882] -> dovecot/imap [ user(a)domain.com.br 186.220.38.133 UID COPY](client_handle_input+0x1c5) [0x559668cf3a95] -> dovecot/imap [user(a)domain.com.br 186.220.38.133 UID COPY](client_input+0x76) [0x559668cf3f96] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x6d) [0x7f2c9d8dd84d] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x139) [0x7f2c9d8def09] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x50) [0x7f2c9d8dd8f0] May 16 15:03:00 Fatal: imap(user(a)domain.com.br)<1669762><cOqoC5YYQlq63CaF>: master: service(imap): child 1669762 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps) Regards, Ricardo

1 0

Change the default base_dir to /run from ${prefix}/var/run
by Дилян Палаузов 20 May '24

20 May '24

Hello, at 6b1bcf1bad1d7, calling ./configure && make install sets prefix=/usr/local, and thus the default base_dir = /usr/local/var/run/dovecot. Moreover it installs /usr/lib/systemd/system/dovecot.service with [Service] ProtectSystem=full. ProtectSystem=full mounts /usr as read-only, so no files can be written under the default base_dir. The Linux Hierachy Standard says for /usr/local - https://refspecs.linuxfoundation.org/FHS_3.0/fhs/ch04s09.html - directories bin, etc, games, include, lib, man, sbin, share, and src must be in /usr/local. No other directories, except those listed below, may be in /usr/local after first installing a FHS-compliant system. var is not listed below. (“below” means the citation above, not the next paragraph) For /var/run LSH contains - https://refspecs.linuxfoundation.org/FHS_3.0/fhs-3.0.html#varrunRuntimeVari… - This directory was once intended for system information data describing the system since it was booted. These functions have been moved to /run; this directory exists to ensure compatibility with systems and software using an older version of this specification. In general, the requirements for /run shall also apply to /var/run. It is valid to implement /var/run as a symlink to /run. . For /run LHS mentions “This directory contains system information data describing the system since it was booted. Files under this directory must be cleared (removed or truncated as appropriate) at the beginning of the boot process.” The defaults base_dir=/usr/local/var/run/dovecot and ProtectSystem=full present a non-working configuration. • Please consider changing the default (implicit) value of base_dir to /run. • When prefix is /usr/local, then dovecot.service should be installed in /usr/local/lib/systemd/system/. Kind regards Дилян

1 1

example/config misses required section names for passdb{} and userdb{}
by Дилян Палаузов 20 May '24

20 May '24

Hello, I installed Dovecot from git 6b1bcf1bad1d78e, copied /usr/local/share/doc/dovecot/example/config to /usr/local/etc/dovecot and called dovecot -F . The system reported doveconf: Fatal: Error in configuration file /usr/local/etc/dovecot/conf.d/auth-system.conf.ext line 11: passdb { } is missing section name The problem remains, if I delete dovecot-dict-auth.conf.ext dovecot-ldap.conf.ext dovecot-oauth2.conf.ext dovecot-sql.conf.ext conf.d/auth-deny.conf.ext conf.d/auth-ldap.conf.ext conf.d/auth-passwdfile.conf.ext conf.d/auth-static.conf.ext conf.d/auth-dict.conf.ext conf.d/auth-master.conf.ext conf.d/auth-sql.conf.ext thus leaving passdb {} and userdb {} defined on a single place. Indeed, auth-system.conf.ext contains the sections passdb and userdb without the optional name, as described at https://doc.dovecot.org/configuration_manual/config_file/#sections . The problem report is that the example configuration does not contain for sections userdb and passdb a section name, and at the same time the as optional described section name is mandatory in Dovecot on these places. Kind regards Dilyan

2 1

Dovecot logging to files causes issues
by Richard Rosner 20 May '24

20 May '24

I have a mailing server setup based on Debian Stable that uses postfix (v3.7.10) for SMTP and dovecot (v2.3.19.1 (9b53102964)) for IMAP. I now wanted to set dovecot to not write to syslog, but to dedicated files in /var/log/dovecot. While everything indicates that this happens successfully as the log files gain in size, I also get lots of these errors: May 13 20:55:37 mail postfix/local[2824184]: 95BCF1000A9: to=<user(a)domain.de>, relay=local, delay=3.2, delays=1.9/0.29/0/1.1, dsn=4.3.0, status=deferred (temporary failure. Command output: lda(user): Error: net_connect_unix(/run/dovecot/stats-writer) failed: Permission denied Can't open log file /var/log/dovecot/error.log: Permission denied ) If it would only log the complaints I wouldn't worry, but as long as I don't revert the changes in dovecot's config, mail receiving is at least vastly delayed, most likely stuck alltogether. So how am I supposed to set these settings? I've chainged these settings in /etc/dovecot/conf.d/10-logging.conf: log_path = /var/log/dovecot/error.log debug_log_path = /var/log/dovecot/debug.log log_debug = category=error The whole directory /var/log/dovecot is owned by dovecot:dovecot, permissions on debug.log, error.log and info.log are 644. Best Richard

5 10

Re: Failing to archive many messages
by Francis Augusto Medeiros-Logeay 18 May '24

18 May '24

Today I realized that it was indeed the sa-learn that is slowing down my Archiving. I added an «&» on the end of the line that calls the sa-learn (called by the report-ham.sieve script): exec /usr/bin/sa-learn -u ${1} --ham & Does anyone thing this is a bad idea? I noticed that archiving got way faster this way… Best, Francis > On 9 May 2024, at 23:09, dovecot-request(a)dovecot.org wrote: > >> On 9 May 2024, at 19:45, dovecot-request(a)dovecot.org <mailto:dovecot-request@dovecot.org> wrote: >> >> Francis Augusto Medeiros-Logeay via dovecot skrev den 2024-05-09 12:29: >> >>>> If you want to analyze emails, why not do it with scheduled crons >>>> after they are archived? >> >> maybe ask for skip older then one day in here >> https://github.com/isbg/isbg/tree/master >> >> while roundcube just set the needed flag for retest ? >> >>> wouldn't it reanalyze all archived messages anyway? >> >> sometimes email is ham at recpt stage, while its spam later on test, >> this is why isbg is made imho :) > > > I see. > > But I wonder if there is something wrong with what I already have. It worked fine for years, and it works fine for most of my users. I tested with a few accounts, and Archving (with its sa-learn script) works blazingly fast. But with one user - happens to be mine - it is super slow when archiving, most likely due the sa-learn. > > Best, > > Francis

2 2

Sieve extprograms pipe :try cancels implicit keep
by Sebastiaan Hoogeveen 17 May '24

17 May '24

Hi, When using the :try tag on the pipe command in the sieve_extprograms plugin Sieve’s implicit keep is cancelled if the executed command fails. The specification on https://raw.githubusercontent.com/dovecot/pigeonhole/master/doc/rfc/spec-bo… states: “When the ":try" tag is specified, the "pipe" instruction will attempt execution of the external program, but failure will not cause the whole Sieve script execution to fail with an error. Instead, the Sieve processing continues as if the "pipe" action was never triggered." However, using the :try tag marks the pip command as successful even if it fails and because pipe is a disposition-type action the implicit keep is cancelled, resulting in the piped message being discarded. If this is the intended behaviour then I would suggest amending the text of the specification to: “When the ":try" tag is specified, the "pipe" instruction will attempt execution of the external program, but failure will not cause the whole Sieve script execution to fail with an error. Instead, the Sieve processing continues as if the "pipe" action was executed successfully and cancel implicit keep.” If this is not the intended behaviour then please consider this a bug report, with my apologies for not adding a patch (it seems to be a bit more complex than just changing the return value of act_pipe_commit). Kind regards, -- Sebastiaan Hoogeveen NederHost https://www.nederhost.nl/ KvK: 34099781

1 0