- dovecot - dovecot.org

lda not sending email on sieve correctly
by Eduardo Diaz Rodriguez 10 Aug '24

10 Aug '24

Hi to all I was using dovecot like 15 years on multiples debian places, and I have the same issue on debian 12 and debian 11. on my configuration I use exim with 2 process to send email, and at the same time use mailscanner to scan all the email that runs on the server. exim1 get the email, and put on the mailscanner directory and mailscanner scan the email and put on another directory to be send by exim2... Debian-+ 242594 1 0 Jul17 ? 00:00:15 /usr/sbin/exim4 -bd -oY -odq -oX 587:25 -oP /var/run/exim4/exim.pid Debian-+ 242597 1 0 Jul17 ? 00:00:01 /usr/sbin/exim4 -oP /run/exim4/eximqr.pid -q15m -oY -DOUTGOING I enable vacation the users, and works ok, but the issue is related the email sent by dovecot… The mail sent by dovecot lacks of the headers and the SPF and DKMI headers but if I sent the email form my command line using /usr/sbin/sendmail the email has the all the headers…. The mail issue here is with the norms for spam from google the nobody get the vacations emails reply. as far I see on the logs of sendmail I see only the email on the exim4 -DOutgoing (log) (I don't know why) because if I send the mail using send mail go to the whole process I don't know why dovecot send the mail to exim -DOUTGOING and not use sendmail on command line.. There any way to create a warper to capture the mail and sending "like this one" /usr/local/bin/dovecot-sendmail-wrapper I enable the debugn on send mail to see what is doing dovect but no luck Aug 8 02:13:27 servidorabm dovecot: lda(luis.alvarez)<870407><rujXC6cNtGYHSA0A40PlXQ>: Debug: program exec:/usr/sbin/exim: Created Aug 8 02:13:27 servidorabm dovecot: lda(luis.alvarez)<870407><rujXC6cNtGYHSA0A40PlXQ>: Debug: program exec:/usr/sbin/exim: Establishing connection Aug 8 02:13:27 servidorabm dovecot: lda(luis.alvarez)<870407><rujXC6cNtGYHSA0A40PlXQ>: Debug: program exec:/usr/sbin/exim: Forked child process Aug 8 02:13:27 servidorabm dovecot: lda(luis.alvarez)<870407><rujXC6cNtGYHSA0A40PlXQ>: Debug: program exec:/usr/sbin/exim (870409): Connected to program Aug 8 02:13:27 servidorabm dovecot: lda(luis.alvarez)<870407><rujXC6cNtGYHSA0A40PlXQ>: Debug: program exec:/usr/sbin/exim (870409): Finished streaming payload to program Aug 8 02:13:27 servidorabm dovecot: lda(luis.alvarez)<870407><rujXC6cNtGYHSA0A40PlXQ>: Debug: program exec:/usr/sbin/exim (870409): Finished input to program Aug 8 02:13:27 servidorabm dovecot: lda(luis.alvarez)<870407><rujXC6cNtGYHSA0A40PlXQ>: Debug: program exec:/usr/sbin/exim (870409): Disconnected Aug 8 02:13:27 servidorabm dovecot: lda(luis.alvarez)<870407><rujXC6cNtGYHSA0A40PlXQ>: Debug: program exec:/usr/sbin/exim (870409): Waiting for program to finish after 0 msecs (timeout = 30000 msecs) Aug 8 02:13:27 servidorabm dovecot: lda(luis.alvarez)<870407><rujXC6cNtGYHSA0A40PlXQ>: Debug: program exec:/usr/sbin/exim (870409): Child process ended Aug 8 02:13:27 servidorabm dovecot: lda(luis.alvarez)<870407><rujXC6cNtGYHSA0A40PlXQ>: Debug: program exec:/usr/sbin/exim (870409): Destroy Aug 8 02:13:27 servidorabm dovecot: lda(luis.alvarez)<870407><rujXC6cNtGYHSA0A40PlXQ>: sieve: msgid=<2118db23-b529-4b96-8d36-4a9ed7596a03(a)pk25.com>: vacation action: sent vacation response to <ediaz(a)pk25.com> I include a example: This is the mail headers sent using dovecot sendmail ================================================================================================================= X-Spam-Status: No X-Pk25-MailScanner-From: X-Pk25-MailScanner: Found to be clean X-Pk25-MailScanner-ID: 1sbqWj-005lt1-2y X-Pk25-MailScanner-Information: Please contact the ISP for more information Received: from mail-108-mta106.mxroute.com ([136.175.108.106]) by pk25.com with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) id 1sbqWj-005lt1-2y forediaz(a)pk25.com; Thu, 08 Aug 2024 01:57:12 +0200 Received: from filter006.mxroute.com ([136.175.111.3] filter006.mxroute.com) (Authenticated sender: mN4UYu2MZsgR) by mail-108-mta106.mxroute.com (ZoneMTA) with ESMTPSA id 1912f46520a0000a78.001 for<ediaz(a)pk25.com> (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384); Wed, 07 Aug 2024 23:57:03 +0000 X-Zone-Loop: a8a214dd47cb92b5b7d264d79136c8507fa7c5926b2e X-Originating-IP: [136.175.111.3] X-Sieve: Pigeonhole Sieve 0.5.13 (cdd19fe3) Message-ID:<dovecot-sieve-1723075020-644445-0(a)servidorabm.interno.abmarquitectos.com> Date: Thu, 08 Aug 2024 01:57:00 +0200 From:<luis.alvarez(a)abmarquitectos.com> To: "Eduardo Diaz Rodriguez"<ediaz(a)pk25.com> In-Reply-To:<071afcb4-79f6-40d6-b12a-e5b23528d951(a)pk25.com> References:<071afcb4-79f6-40d6-b12a-e5b23528d951(a)pk25.com> Auto-Submitted: auto-replied (vacation) Precedence: bulk X-Auto-Response-Suppress: All MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-ABM-MailScanner-Information: Please contact the ISP for more information X-ABM-MailScanner-ID: 1sbqWa-003eIu-Kz X-ABM-MailScanner: Found to be clean X-ABM-MailScanner-From: X-Authenticated-Id:smtp@abmarquitectos.com X-SA-Exim-Connect-IP: 136.175.108.106 X-SA-Exim-Mail-From: X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-13) on servidor1.interno.pk25.com X-Spam-Level: X-Spam-Status: No, score=-1.0 required=5.0 tests=BAYES_00,DMARC_NONE, SPF_HELO_NONE autolearn=no autolearn_force=no version=4.0.0 Subject: Respuesta =?utf-8?q?autom=C3=A1tica:?= Vacaciones / Out of office X-SA-Exim-Version: 4.2.1 (built Wed, 06 Jul 2022 17:57:39 +0000) X-SA-Exim-Scanned: Yes (on pk25.com) EstarÃ© de vacaciones del dÃa 5 al dÃa 23 de agosto ambos incluidos con un acceso muy limitado a mi email. Para cualquier asunto urgente, por favor contactar con el (+34) 91 4114375. Gracias I will be on holiday from the 5th to the 23rd of August (both inclusive) with very limited access to my email. For any urgent matters, please contact me on (+34) 91 4114375. Thank you ------------- ===================================================================================================== This is the email send using command line /usr/sbin/sendmail ediaz(a)pk25.com ===================================================================================================== X-Spam-Status: No X-Pk25-MailScanner-From:luis.alvarez@abmarquitectos.com X-Pk25-MailScanner: Found to be clean X-Pk25-MailScanner-ID: 1sbps4-005iuR-14 X-Pk25-MailScanner-Information: Please contact the ISP for more information Received-SPF: pass (pk25.com: domain of abmarquitectos.com designates 136.175.108.60 as permitted sender) client-ip=136.175.108.60;envelope-from=luis.alvarez(a)abmarquitectos.com; helo=mail-108-mta60.mxroute.com; Received: from mail-108-mta60.mxroute.com ([136.175.108.60]) by pk25.com with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from<luis.alvarez(a)abmarquitectos.com>) id 1sbps4-005iuR-14 forediaz(a)pk25.com; Thu, 08 Aug 2024 01:15:10 +0200 Received: from filter006.mxroute.com ([136.175.111.3] filter006.mxroute.com) (Authenticated sender: mN4UYu2MZsgR) by mail-108-mta60.mxroute.com (ZoneMTA) with ESMTPSA id 1912f1fde1f0000a78.001 for<ediaz(a)pk25.com> (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384); Wed, 07 Aug 2024 23:15:03 +0000 X-Zone-Loop: 9cbc8cfacf0e7622cc097cbc7366c12df531448419ec X-Originating-IP: [136.175.111.3] DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=abmarquitectos.com; s=x; h=Date:From:Message-Id:Sender:Reply-To:Subject:To: Cc:MIME-Version:Content-Type:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:In-Reply-To:References:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=6Vz2aHGFyNLtBTf9yGi/HE3IFNHwpvLh04DkcjY69c0=; b=YhXHjPytW0sUJxsgSer+Mmh8NK IBDuHoqQAsb2Ox3Q2fEtp3lQYx7SEiEzvOfUgzO8dsx9pa7n0nOnGck9R8zVZbjqQEXVourhjGZTA 5TbdPMBlti1o+qO4480DiQGJYF+nszamgMeNhwgePapYRUw0L8wE1cmIHgI5Fn+TnKITHuOZDiTjC Rq/eIQqQONoDNbJrfs3jQozuZ/Kd7yParMiAeJe8WYZUpZxW751kma1z+2xmlrTgWqrT60U9HkGfD 1n7kKug+qf13A3CDbbxmgt/AleosIO4jEyHw+RX+c/hry8jrxBfmE48Z9lLvtT9vgFwh8YFVo9Q1G AgEbd2hw==; DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=abmarquitectos.com; s=abmarquitectos; h=Date:From:Message-Id:Sender: Reply-To:Subject:To:Cc:MIME-Version:Content-Type:Content-Transfer-Encoding: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To:References:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=6Vz2aHGFyNLtBTf9yGi/HE3IFNHwpvLh04DkcjY69c0=; b=H8em8qDC0sVv5r7Oaw9KrCXrGY BhZUhR7naN8XxA58pfOEeE7k5rLZlDMtpsBmrQrCvYaFRqxUJjGNl0gR2ctWvNmmEDUsPMOQzSAsW ELU0jxQDfFaRBTor/Vq6aoN8vy8tlWb6aSLBUtN5p1vYsf/PlV+MtNV/uoll526FurjxWheTYeGBg r0QbSboEDVxMfBQ98aETqXgW4ZqkPBT73UD0azlppxDATAUbQYyZwosFGcptm7OzMyVmaARgiv52t 8hC58avWCiRJpjjyPf3y2PqmQ+LmoaZjgUS64rb1wp3U3xH18Z3WVZGTn3WVY2TG5cPx7gkEz8nft sS7qUGng==; Message-Id:<E1sbprp-003e0r-0P(a)abmarquitectos.com> From: Luis Alvarez<luis.alvarez(a)abmarquitectos.com> Date: Thu, 08 Aug 2024 01:14:54 +0200 X-ABM-MailScanner-Information: Please contact the ISP for more information X-ABM-MailScanner-ID: 1sbprp-003e0r-0P X-ABM-MailScanner: Found to be clean X-ABM-MailScanner-From:luis.alvarez@abmarquitectos.com X-DKIM: signer='abmarquitectos.com' status='pass' reason='' DKIMCheck: Server passes DKIM test, 0 Spam score X-Authenticated-Id:smtp@abmarquitectos.com X-SA-Exim-Connect-IP: 136.175.108.60 X-SA-Exim-Mail-From:luis.alvarez@abmarquitectos.com X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-13) on servidor1.interno.pk25.com X-Spam-Level: X-Spam-Status: No, score=-4.3 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,DMARC_PASS,MISSING_HEADERS, MISSING_SUBJECT,RCVD_IN_DNSWL_HI,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=4.0.0 X-SA-Exim-Version: 4.2.1 (built Wed, 06 Jul 2022 17:57:39 +0000) X-SA-Exim-Scanned: Yes (on pk25.com) prueba prueba prueba ------------- ------------- By Pk25.com

3 6

Userdb empty
by Cam Ellison 08 Aug '24

08 Aug '24

I have shifted from a system-based email system to virtual for a website I manage. The MTA is exim4, and user data are in a MySQL database. It will receive email, but with one exception the userdb is empty and emails go out with no username in the email address. Sample error message from exim: 2024-08-05 05:21:43 1sawid-00065N-0R Error while reading message with no usable sender address (R=1sawiX-00065C-1a): at least one malformed recipient address: @scasl.ca - no local part Here is the output of doveconf -n: # 2.3.19.1 (9b53102964): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.19 (4eae2f79) # OS: Linux 6.1.0-20-rt-686-pae i686 Debian 12.6 ext4 # Hostname: football.scasl.ca auth_debug = yes auth_default_realm = scasl.ca auth_mechanisms = plain login auth_username_format = %Ln auth_verbose = yes base_dir = /var/run/dovecot/ hostname = scasl.ca login_trusted_networks = 209.121.143.10/32 mail_debug = yes mail_gid = vmail mail_home = /var/vmail/%n mail_location = maildir:/var/vmail/%n/Maildir:INBOX=/var/vmail/%n/Maildir/INBOX mail_privileged_group = vmail mail_uid = vmail namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } postmaster_address = postmaster(a)scasl.ca protocols = " imap" service auth { unix_listener auth-client { mode = 0666 } unix_listener auth-userdb { mode = 0666 } } service imap-login { service_count = 1 } service stats { unix_listener stats-reader { group = vmail mode = 0666 } unix_listener stats-writer { group = vmail mode = 0666 } } ssl_cert = </etc/dovecot/private/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { driver = passwd } There are two userdb entries, since one of the users is a system user. It is also the only one that appears in userdb. The relevant commands from dovecot-sql.conf.ext are here: password_query = SELECT email_username AS username, domain, email_password AS password FROM league WHERE email_username = '%n' user_query = SELECT CONCAT('/var/vmail/',email_username) AS home, 5000 AS uid, 5000 AS gid FROM league WHERE email_username = '%n' AND domain = '%d' iterate_query = SELECT email_username AS username, domain FROM league The vmail uid:gid is 5000:5000 As a side issue, it cannot open (/proc/self/io) - I'm not sure whether that means anything. Here is debugging output: 2024-08-05T06:33:18.777211-07:00 football dovecot: auth-worker(24847): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth 2024-08-05T06:33:18.777456-07:00 football dovecot: auth-worker(24847): Debug: Module loaded: /usr/lib/dovecot/modules/auth/lib20_auth_var_expand_crypt.so 2024-08-05T06:33:18.782112-07:00 football dovecot: auth-worker(24847): Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so 2024-08-05T06:33:18.782392-07:00 football dovecot: auth-worker(24847): Debug: sqlpool(mysql): Creating new connection 2024-08-05T06:33:18.784671-07:00 football dovecot: auth-worker(24847): Debug: mysql(localhost): Connecting 2024-08-05T06:33:18.785532-07:00 football dovecot: auth-worker(24847): Debug: conn unix:auth-worker (pid=24845,uid=121): Server accepted connection (fd=14) 2024-08-05T06:33:18.785703-07:00 football dovecot: auth-worker(24847): Debug: conn unix:auth-worker (pid=24845,uid=121): Sending version handshake 2024-08-05T06:33:18.785850-07:00 football dovecot: auth-worker(24847): Debug: conn unix:auth-worker (pid=24845,uid=121): auth-worker<1>: Handling PASSV request 2024-08-05T06:33:18.785986-07:00 football dovecot: auth-worker(24847): Debug: conn unix:auth-worker (pid=24845,uid=121): auth-worker<1>: sql(scasl,209.121.143.14,<Z41TuO8eENjReY8O>): Performing passdb lookup 2024-08-05T06:33:18.786124-07:00 football dovecot: auth-worker(24847): Debug: conn unix:auth-worker (pid=24845,uid=121): auth-worker<1>: sql(scasl,209.121.143.14,<Z41TuO8eENjReY8O>): query: SELECT email_username AS username, domain, emai l_password AS password FROM league WHERE email_username = 'scasl' 2024-08-05T06:33:18.786347-07:00 football dovecot: auth-worker(24847): Debug: mysql(localhost): Finished query 'SELECT email_username AS username, domain, email_password AS password FROM league WHERE email_username = 'scasl'' in 0 msecs 2024-08-05T06:33:18.786524-07:00 football dovecot: auth-worker(24847): Debug: conn unix:auth-worker (pid=24845,uid=121): auth-worker<1>: sql(scasl,209.121.143.14,<Z41TuO8eENjReY8O>): username changed scasl -> scasl(a)scasl.ca 2024-08-05T06:33:18.786672-07:00 football dovecot: auth-worker(24847): Debug: conn unix:auth-worker (pid=24845,uid=121): auth-worker<1>: sql(scasl(a)scasl.ca,209.121.143.14,<Z41TuO8eENjReY8O>): Finished passdb lookup 2024-08-05T06:33:18.786791-07:00 football dovecot: auth-worker(24847): Debug: conn unix:auth-worker (pid=24845,uid=121): auth-worker<1>: Finished 2024-08-05T06:33:18.786940-07:00 football dovecot: auth: Debug: sql(scasl,209.121.143.14,<Z41TuO8eENjReY8O>): username changed scasl -> scasl(a)scasl.ca 2024-08-05T06:33:18.787098-07:00 football dovecot: auth: Debug: sql(scasl(a)scasl.ca,209.121.143.14,<Z41TuO8eENjReY8O>): Finished passdb lookup 2024-08-05T06:33:18.787239-07:00 football dovecot: auth: Debug: auth(scasl(a)scasl.ca,209.121.143.14,<Z41TuO8eENjReY8O>): Auth request finished 2024-08-05T06:33:18.787379-07:00 football dovecot: auth: Debug: client passdb out: OK#0111#011user=scasl(a)scasl.ca#011#011original_user=scasl 2024-08-05T06:33:18.794297-07:00 football dovecot: auth: Debug: master in: REQUEST#011600309761#01124843#0111#0115343bacecb1c0282e3e40282e4ebd64d#011session_pid=24849#011request_auth_token 2024-08-05T06:33:18.794568-07:00 football dovecot: auth: Debug: sql(scasl(a)scasl.ca,209.121.143.14,<Z41TuO8eENjReY8O>): Performing userdb lookup 2024-08-05T06:33:18.794712-07:00 football dovecot: auth-worker(24847): Debug: conn unix:auth-worker (pid=24845,uid=121): auth-worker<2>: Handling USER request 2024-08-05T06:33:18.794859-07:00 football dovecot: auth-worker(24847): Debug: conn unix:auth-worker (pid=24845,uid=121): auth-worker<2>: sql(scasl(a)scasl.ca,209.121.143.14,<Z41TuO8eENjReY8O>): Performing userdb lookup 2024-08-05T06:33:18.795004-07:00 football dovecot: auth-worker(24847): Debug: conn unix:auth-worker (pid=24845,uid=121): auth-worker<2>: sql(scasl(a)scasl.ca,209.121.143.14,<Z41TuO8eENjReY8O>): SELECT CONCAT('/var/vmail/',email_username) A S home, 5000 AS uid, 5000 AS gid FROM league WHERE email_username = 'scasl' AND domain = 'scasl.ca' 2024-08-05T06:33:18.795222-07:00 football dovecot: auth-worker(24847): Debug: mysql(localhost): Finished query 'SELECT CONCAT('/var/vmail/',email_username) AS home, 5000 AS uid, 5000 AS gid FROM league WHERE email_username = 'scasl' AND domain = 'scasl.ca'' in 0 msecs 2024-08-05T06:33:18.795387-07:00 football dovecot: auth-worker(24847): Debug: conn unix:auth-worker (pid=24845,uid=121): auth-worker<2>: sql(scasl(a)scasl.ca,209.121.143.14,<Z41TuO8eENjReY8O>): Finished userdb lookup 2024-08-05T06:33:18.795526-07:00 football dovecot: auth-worker(24847): Debug: conn unix:auth-worker (pid=24845,uid=121): auth-worker<2>: Finished 2024-08-05T06:33:18.795660-07:00 football dovecot: auth: Debug: sql(scasl(a)scasl.ca,209.121.143.14,<Z41TuO8eENjReY8O>): Finished userdb lookup 2024-08-05T06:33:18.795899-07:00 football dovecot: auth: Debug: master userdb out: USER#011600309761#011scasl@scasl.ca#011home=/var/vmail/scasl#011uid=5000#011gid=5000#011auth_mech=PLAIN#011auth_token=e9d7425913886e014c83af029551e70f8db2 98f9#011auth_user=scasl 2024-08-05T06:33:18.796199-07:00 football dovecot: imap-login: Login: user=<scasl(a)scasl.ca>, method=PLAIN, rip=209.121.143.14, lip=209.121.143.10, mpid=24849, TLS, session=<Z41TuO8eENjReY8O> 2024-08-05T06:33:18.797562-07:00 football dovecot: imap(scasl(a)scasl.ca)<24849><Z41TuO8eENjReY8O>: Debug: Effective uid=5000, gid=5000, home=/var/vmail/scasl 2024-08-05T06:33:18.797718-07:00 football dovecot: imap(scasl(a)scasl.ca)<24849><Z41TuO8eENjReY8O>: Debug: open(/proc/self/io) failed: Permission denied 2024-08-05T06:33:18.798021-07:00 football dovecot: imap(scasl(a)scasl.ca)<24849><Z41TuO8eENjReY8O>: Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/scasl/M aildir:INBOX=/var/vmail/scasl/Maildir/INBOX 2024-08-05T06:33:18.798286-07:00 football dovecot: imap(scasl(a)scasl.ca)<24849><Z41TuO8eENjReY8O>: Debug: maildir++: root=/var/vmail/scasl/Maildir, index=, indexpvt=, control=, inbox=/var/vmail/scasl/Maildir/INBOX, alt= 2024-08-05T06:33:18.799780-07:00 football dovecot: imap(scasl(a)scasl.ca)<24849><Z41TuO8eENjReY8O>: Debug: Mailbox INBOX: Mailbox opened 2024-08-05T06:34:18.830024-07:00 football dovecot: auth-worker(24847): Debug: conn unix:auth-worker (pid=24845,uid=121): Disconnected: Connection closed (fd=-1) 2024-08-05T06:34:18.882117-07:00 football dovecot: auth-worker(24847): Debug: mysql(localhost): Connection finished (queries=2, slow queries=0) 2024-08-05T06:34:19.349925-07:00 football dovecot: auth: Debug: mysql(localhost): Connection finished (queries=0, slow queries=0) Sorry this is so long. What am I doing wrong here? Thank you in advance Cam

2 2

username_filter settings in passdb
by zaxwat93＠gmail.com 06 Aug '24

06 Aug '24

got a problem when configured passdb with username_filter — looks like the option doesn't work OS: FreeBSD 13 and 14. Dovecot version: 2.3.21 Part of config: passdb { args = /usr/local/bin/php /usr/local/dovecot/bin/checkpassword.php driver = checkpassword } passdb { args = /usr/local/bin/php /usr/local/dovecot/bin/checkpassword.php driver = checkpassword username_filter = user1(a)postmaster.local.one default_fields = domain=local.one override_fields = user=postmaster(a)local.one } passdb { args = /usr/local/bin/php /usr/local/dovecot/bin/checkpassword.php driver = checkpassword username_filter = user3(a)user2.local.one default_fields = domain=local.one override_fields = user=user2(a)local.one } When I try command "doveadm auth test user1(a)postmaster.local.one" and enter a password of user1 — it works as planned — change user1(a)postmaster.local.one to user1(a)local.one check it's password and override user to postmaster(a)local.one But when I try "doveadm auth test user3(a)user2.local.one" — it also change user3(a)user2.local.one to user3(a)local.one, and after password check — override it to postmaster(a)local.one Debug logs, when I try "doveadm auth test user3(a)user2.local.one": Aug 1 11:01:03 auth: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Aug 1 11:01:03 auth: Debug: Module loaded: /usr/local/lib/dovecot/auth/lib20_auth_var_expand_crypt.so Aug 1 11:01:03 auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat Aug 1 11:01:03 auth: Debug: passwd-file /usr/local/etc/dovecot.users.list:Read 7 users in 0 secs Aug 1 11:01:03 auth: Debug: auth client connected (pid=0) Aug 1 11:01:03 auth: Debug: client in: AUTH 1 PLAIN service=doveadm debug resp=<hidden> Aug 1 11:01:03 auth: Debug: checkpassword(user3(a)user2.local.one): Performing passdb lookup Aug 1 11:01:03 auth: Debug: checkpassword(user3(a)user2.local.one): execute: /usr/local/bin/php /usr/local/dovecot/bin/checkpassword.php /usr/local/libexec/dovecot/checkpassword-reply Aug 1 11:01:03 auth: Debug: checkpassword(user3(a)user2.local.one): Received input: Aug 1 11:01:03 auth: Debug: checkpassword(user3(a)user2.local.one): exit_status=1 Aug 1 11:01:03 auth: checkpassword(user3(a)user2.local.one): Login failed (status=1) Aug 1 11:01:03 auth: Debug: checkpassword(user3(a)user2.local.one): Finished passdb lookup Aug 1 11:01:03 auth: Debug: checkpassword(user3(a)user2.local.one): Performing passdb lookup Aug 1 11:01:03 auth: Debug: checkpassword(user3(a)user2.local.one): username changed user3(a)user2.local.one -> user3(a)local.one Aug 1 11:01:03 auth: Debug: checkpassword(user3(a)local.one): execute: /usr/local/bin/php /usr/local/dovecot/bin/checkpassword.php /usr/local/libexec/dovecot/checkpassword-reply Aug 1 11:01:03 auth: Debug: checkpassword(user3(a)local.one): Received input: user=user3(a)local.one userdb_home=/var/spool/mail/ userdb_uid=dovecot userdb_gid=dovecot Aug 1 11:01:03 auth: Debug: checkpassword(user3(a)local.one): exit_status=0 Aug 1 11:01:03 auth: Debug: checkpassword(user3(a)local.one): username changed user3(a)local.one -> postmaster(a)local.one Aug 1 11:01:03 auth: Debug: checkpassword(postmaster(a)local.one): Finished passdb lookup Aug 1 11:01:03 auth: Debug: auth(postmaster(a)local.one): Auth request finished Aug 1 11:01:03 auth: Debug: client passdb out: OK 1 user=postmaster(a)local.one original_user=user3(a)user2.local.one I've checked sources and find in " core/src/auth/auth-request.c (from line 617) " code that check username_filter and should send "skipping passdb: username filtered" message in debug, but it doesn't do it. Is it a bug or I've missed something in setup?

3 10

dsync crashing
by Benjamin Rose 05 Aug '24

05 Aug '24

Hello, I am running Dovecot 2.3.16 (7e2e900c1a) on RHEL 9.2. I attach my "doveconf -n" configuration. I have replication enabled between 2 servers, both very beefy with 16 cores of Intel(R) Xeon(R) Gold 6244 CPU @ 3.60GHz, 768gb memory, and 100-gig ethernet. The configs are the same except the replication part which points at each other via a puppet template. It seems to work well for most users on modern email clients using the mdbox storage format. The issue I'm having is that some of my users are on the old-style mbox storage format so they can use legacy mail readers such as pine and mutt natively. For some of these users, syncing works just fine. For others, right now about a dozen users, the sync never completes, and I get the following error & backtrace in /var/log/maillog: Aug 4 23:54:22 mail6 dovecot[1177530]: doveadm: Panic: file dsync-mailbox-import.c: line 2163 (dsync_mailbox_import_handle_mail): assertion failed: (array_count(&wanted_uids) > 0) Aug 4 23:54:22 mail6 dovecot[1177530]: doveadm: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x46) [0x7fa6ab05c486] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x22) [0x7fa6ab05c5a2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10a41b) [0x7fa6ab06b41b] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10a4b7) [0x7fa6ab06b4b7] -> /usr/lib64/dovecot/libdovecot.so.0(+0x5d11a) [0x7fa6aafbe11a] -> dovecot/doveadm-server(+0x24029) [0x56433f2f7029] -> dovecot/doveadm-server(dsync_mailbox_import_changes_finish+0x29c) [0x56433f32fb9c] -> dovecot/doveadm-server(dsync_brain_sync_mails+0x8d5) [0x56433f331f15] -> dovecot/doveadm-server(+0x52255) [0x56433f325255] -> dovecot/doveadm-server(+0x52639) [0x56433f325639] -> dovecot/doveadm-server(+0x5fa53) [0x56433f332a53] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x6d) [0x7fa6ab081cbd] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x13a) [0x7fa6ab083bba] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x54) [0x7fa6ab083c64] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7fa6ab083e20] -> dovecot/doveadm-server(+0x37d7c) [0x56433f30ad7c] -> dovecot/doveadm-server(+0x3974d) [0x56433f30c74d] -> dovecot/doveadm-server(+0x5020b) [0x56433f32320b] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x6d) [0x7fa6ab081cbd] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x13a) [0x7fa6ab083bba] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x54) [0x7fa6ab083c64] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7fa6ab083e20] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x17) [0x7fa6aaff2337] -> dovecot/doveadm-server(main+0x102) [0x56433f2f8f92] -> /lib64/libc.so.6(+0x3feb0) [0x7fa6aac3feb0] -> /lib64/libc.so.6(__libc_start_main+0x80) [0x7fa6aac3ff60] -> dovecot/doveadm-server(_start+0x25) [0x56433f2f9015] Aug 4 23:54:22 mail6 dovecot[1177530]: doveadm: Fatal: master: service(doveadm): child 1117475 killed with signal 6 (core dumped) I'm not sure what might be causing this, and wanted to see if anyone here could offer any suggestions. Please let me know if any additional information is needed. Thanks, Ben

3 7

Strange ssl/dso troubles on freeBSD13.3
by Georg Graf 02 Aug '24

02 Aug '24

Hi, I'm George and I think I've been running dovecot for like more than a decade now without any troubles, so: WOW! Nevertheless, after an upgrade from FreeBSD 13.2 to 13.3 plus "pkg upgrade" my dovecot installation refuses to load the ssl certificates. I've tried a version built from source as well as the package. The Problem seems to be something with loading of DSO's: ========================================================================================================= Jul 31 16:42:11 murl dovecot[10801]: imap-login: Error: Failed to initialize SSL server context: Can't load SSL certificate (ssl_cert setting): error:25066067:DSO support routines:dlfcn_load:could not load the shared library: filename(libproviders.so): Shared object "libproviders.so" not found, required by "imap-login", error:25070067:DSO support routines:DSO_load:could not load the shared library, error:0E07506E:configuration file routines:module_load_dso:error loading dso: module=providers, path=providers, error:0E076071:configuration file routines:mo ========================================================================================================= I have never seen 'libproviders' and there's not a lot on it on the internet as well. Here comes my (dead-simple) 'dovecot -n': ========================================================================================================= # 2.3.21 (47349e2482): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 13.3-RELEASE-p4 amd64 # Hostname: murl.graf.priv.at auth_mechanisms = plain login disable_plaintext_auth = no mail_location = maildir:~/Maildir:LAYOUT=fs:INBOX=~/Maildir passdb { driver = pam } protocols = imap ssl_cert = </root/.acme.sh/graf.priv.at/fullchain.cer ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = blocking=yes driver = passwd } verbose_ssl = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep } ========================================================================================================= My openssl s_client shows that the server hangs up (while producing the above log entry): ========================================================================================================= # openssl s_client -servername graf.priv.at -connect graf.priv.at:imaps CONNECTED(00000003) write:errno=0 --- no peer certificate available --- No client certificate CA names sent --- SSL handshake has read 0 bytes and written 314 bytes Verification: OK --- New, (NONE), Cipher is (NONE) Secure Renegotiation IS NOT supported Compression: NONE Expansion: NONE No ALPN negotiated Early data was not sent Verify return code: 0 (ok) --- ========================================================================================================= Just to mention: plaintext IMAP is still working: ========================================================================================================= # telnet graf.priv.at imap Trying 78.41.116.33... Connected to graf.priv.at. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. u login georg <mysupersecretpassword> u OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAM ESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY PREVIEW STATUS=SIZE SAVEDATE LITE RAL+ NOTIFY] Logged in r select INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft $Forwarded $MDNSent $label5 $label3) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft $Forwarded $MDNSent $label5 $label3 \*)] Flags permitted. * 359 EXISTS * 0 RECENT * OK [UNSEEN 2] First unseen. * OK [UIDVALIDITY 1509040425] UIDs valid * OK [UIDNEXT 11767] Predicted next UID * OK [HIGHESTMODSEQ 19640] Highest r OK [READ-WRITE] Select completed (0.006 + 0.000 + 0.005 secs). s logout * BYE Logging out s OK Logout completed (0.001 + 0.000 secs). Connection closed by foreign host. ========================================================================================================= Any helping hint is highly appreciated! Thank you very much, George

2 3

RE: lmtp Fatal: setresgid Operation not permitted
by Rachel Roch 31 Jul '24

31 Jul '24

>> I am getting the following error when Postfix attempts LMTP delivery : >> >> "lmtp(REDACTED)<32674><7Jm0BSVopmaifwAAbW4UVQ>: Fatal: >> setresgid(121(mailbox_user),121(mailbox_user),8(mail)) failed with >> euid=111(mailbox_user): Operation not permitted" >> >> mailbox_user is uid 111, gid 121 on my system. >> > > Not related to low uid/gid numbers? I think newer OS have their limits increased to above 1000 or so. > Well, my OS is Debian Bookworm which should be "newer" enough ? ;-) User/group were originally created via : adduser --system --disabled-login --shell /usr/sbin/nologin mailbox_user addgroup --system mailbox_user

3 2

lmtp Fatal: setresgid Operation not permitted
by Rachel Roch 28 Jul '24

28 Jul '24

I am getting the following error when Postfix attempts LMTP delivery : "lmtp(REDACTED)<32674><7Jm0BSVopmaifwAAbW4UVQ>: Fatal: setresgid(121(mailbox_user),121(mailbox_user),8(mail)) failed with euid=111(mailbox_user): Operation not permitted" mailbox_user is uid 111, gid 121 on my system. doveconf -n ============= ============= # 2.3.19.1 (9b53102964): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.19 (4eae2f79) # OS: Linux 6.1.0-22-cloud-amd64 x86_64 Debian 12.6 xfs # Hostname: REDACTED auth_verbose = yes auth_verbose_passwords = sha1:7 doveadm_password = # hidden, use -P to show it first_valid_gid = 121 first_valid_uid = 111 imap_capability = +SPECIAL-USE imapc_features = rfc822.size fetch-headers fetch-bodystructure imapc_port = 993 imapc_ssl = imaps last_valid_gid = 121 last_valid_uid = 111 mail_location = maildir:/mnt/mxData/dovecot/%d/%n/Maildir mail_plugins = notify replication push_notification mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox "Deleted Messages" { auto = no special_use = \Trash } mailbox Drafts { special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/local_sql_users.conf driver = sql } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } vsz_limit = 2 G } service doveadm { inet_listener { port = 11867 ssl = yes } } service imap-login { process_min_avail = 5 service_count = 1 } service lmtp { process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } user = mailbox_user } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieves { address = port = 5190 ssl = yes } } ssl = required ssl_cert = <REDACTED ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-CHACHA20-POLY1305 ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/local_sql_users.conf default_fields = uid=mailbox_user gid=mailbox_user home=/mnt/mxData/dovecot/%d/%n driver = sql } protocol lmtp { mail_plugins = notify replication push_notification sieve } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = notify replication push_notification sieve quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } protocol imap { mail_max_userip_connections = 20 mail_plugins = notify replication push_notification imap_sieve } ======= ======= postconf -n ======== ======== alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases authorized_submit_users = biff = no compatibility_level = 2 default_database_type = cdb disable_vrfy_command = yes home_mailbox = Maildir/ indexed = ${default_database_type}:${config_directory}/ inet_interfaces = all inet_protocols = all mailbox_size_limit = 0 message_size_limit = 20480000 mydestination = REDACTED,localhost mydomain = REDACTED myhostname = REDACTED mynetworks = $config_directory/mynetworks mynetworks_style = subnet myorigin = $mydomain parent_domain_matches_subdomains = recipient_delimiter = + smtp_bind_address = 0.0.0.0 smtp_bind_address6 = :: smtp_sasl_auth_enable = no smtp_tls_policy_maps = ${indexed}smtp_tls_policy smtpd_banner = $myhostname ESMTP smtpd_recipient_restrictions = reject_unknown_sender_domain, reject_unknown_recipient_domain, reject_unauth_pipelining, permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination smtpd_sasl_auth_enable = no smtpd_sasl_local_domain = $myhostname smtpd_sasl_security_options = noanonymous smtpd_sender_restrictions = reject_unknown_sender_domain smtpd_tls_auth_only = yes smtpd_tls_cert_file = REDACTED smtpd_tls_dh1024_param_file = REDACTED smtpd_tls_eecdh_grade = strong smtpd_tls_key_file = REDACTED smtpd_tls_mandatory_ciphers = high smtpd_tls_mandatory_protocols = !SSLv2, !SSLv3, !TLSv1, !TLSv1.1 smtpd_tls_protocols = !SSLv2, !SSLv3, !TLSv1, !TLSv1.1 smtpd_tls_security_level = may tls_eecdh_strong_curve = prime256v1 tls_preempt_cipherlist = yes tls_random_source = dev:/dev/random virtual_alias_maps = pgsql:${config_directory}/pgsql_virtual.conf virtual_gid_maps = static:121 virtual_mailbox_base = /mnt/mxData/dovecot virtual_mailbox_domains = ${config_directory}/vhosts virtual_mailbox_maps = pgsql:${config_directory}/pgsql_vmap.conf virtual_transport = lmtp:unix:private/dovecot-lmtp virtual_uid_maps = static:111 ======== ========

2 1

dovecot-lda: timeout for external scripts called by sieve
by Meinhard Schneider 28 Jul '24

28 Jul '24

Hello, I have a small problem with dovecot-lda. I am using Debian 12 Bookworm: root@lnxmail01:~# dovecot --version 2.3.13 (89f716dc2) Historically grown (probably still from sendmail times, long time ago) I always used procmail for local e-mail delivery. This also included the call for spamc for SpamAssassin. I have now changed this and set up a route via sieve. There is a small script for this: root@lnxmail01:~# cat /usr/lib/dovecot/sieve-filter/spamc-filter.sh #!/bin/bash /usr/bin/spamc My sieve configuration says (in extracts): root@lnxmail01:~# head -12 ~meini/.dovecot.sieve ## Generated by Roundcube Webmail SieveRules Plugin ## require ["body","comparator-i;ascii-numeric","copy","envelope","fileinto","imap4flags","include","regex","relational","spamtestplus","vacation","variables","spamtest"]; include :global "spamc"; # rule:[Spam] if spamtest :value "ge" :comparator "i;ascii-numeric" "5" { fileinto "Spam"; stop; } In general, this has been working for many months without any problems. But sometimes the whole thing fails due to a timeout: Jul 7 22:00:13 lnxmail01 dovecot: lda(meini)<766014><G9l7JcPzimY+sAsAmbNf3A>: Error: program exec:/usr/lib/dovecot/sieve-filter/spamc-filter.sh (766016): Execution timed out (> 10000 msecs) Jul 7 22:00:13 lnxmail01 dovecot: lda(meini)<766014><G9l7JcPzimY+sAsAmbNf3A>: Error: program exec:/usr/lib/dovecot/sieve-filter/spamc-filter.sh (766016): Forcibly terminated with signal 15 Jul 7 22:00:13 lnxmail01 dovecot: lda(meini)<766014><G9l7JcPzimY+sAsAmbNf3A>: Panic: output stream (temp iostream in /tmp/dovecot.lda. for (program client seekable output)) is missing error handling Jul 7 22:00:13 lnxmail01 dovecot: lda(meini)<766014><G9l7JcPzimY+sAsAmbNf3A>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7ff00aee04e2] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7ff00aee05fe] -> /usr/lib/dovecot/libdovecot.so.0(+0xfc49b) [0x7ff00aeec49b] -> /usr/lib/dovecot/libdovecot.so.0(+0xfc501) [0x7ff00aeec501] -> /usr/lib/dovecot/libdovecot.so.0(+0x53aee) [0x7ff00ae43aee] -> /usr/lib/dovecot/libdovecot.so.0(o_stream_unref+0x5e) [0x7ff00af1003e] -> /usr/lib/dovecot/libdovecot.so.0(program_client_destroy+0x8e) [0x7ff00ae6ee6e] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(sieve_extprogram_destroy+0x18) [0x7ff00aacd8f8] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x556d) [0x7ff00aacb56d] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_continue+0xea) [0x7ff00ab4c9ba] -> /usr/lib/dovecot/libdovecot-sieve.so.0(ext_include_execute_include+0x2c7) [0x7ff00ab72e17] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_continue+0xea) [0x7ff00ab4c9ba] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_multiscript_run+0x82) [0x7ff00ab62b32] -> /usr/lib/dovecot/modules/lib90_sieve_plugin.so(+0x37a3) [0x7ff00abd47a3] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0x176) [0x7ff00b11f906] -> /usr/lib/dovecot/dovecot-lda(main+0x879) [0x55ef085e4fb9] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xea) [0x7ff00ac3ad0a] -> /usr/lib/dovecot/dovecot-lda(_start+0x2a) [0x55ef085e56ea] The worst thing is that the entire mail is lost (/dev/null)! Then I tried to set the timeout higher (than the current 10 seconds): root@lnxmail01:~# doveconf | grep -A 12 ^plugin plugin { sieve = file:~/sieve;active=~/.dovecot.sieve sieve_execute_exec_timeout = 60s sieve_extension_exec_timeout = 60s sieve_extensions = +vnd.dovecot.filter +spamtest +spamtestplus sieve_filter_bin_dir = /usr/lib/dovecot/sieve-filter sieve_filter_socket_dir = sieve-filter sieve_global = /usr/lib/dovecot/sieve-global sieve_plugins = sieve_extprograms sieve_spamtest_max_value = 5 sieve_spamtest_status_header = X-Spam-Level sieve_spamtest_status_type = strlen } I have set both the values for "sieve_execute_exec_timeout" and "sieve_extension_exec_timeout" to 60 sec, but according to the log, this does not seem to affect the 10000 msec mentioned therein. The SpamAssassin daemon has enough child processes to handle the requests (most of them were idle at the time of the error). How can I configure that the external script gets more time for execution? And what can I do so that - should the script terminate contrary to expectations or be killed in the timeout - the mail is not lost but simply processed further? Many thanks & best regards Meinhard

2 5

Looking for Some Help with Dovecot Configuration for IMAP Access
by Selena Thomas 27 Jul '24

27 Jul '24

Hi everyone, I am having a bit of trouble setting up Dovecot for IMAP access. I’ve installed Dovecot and configured the main configuration file,, but I am not sure if I missed something important. Here’s what I have so far ::- 1. Dovecot Version: 2.3.11 2. OS: Ubuntu 20.04 3. Configuration Files: - `/etc/dovecot/dovecot.conf` - `/etc/dovecot/conf.d/10-ssl.conf` - `/etc/dovecot/conf.d/10-auth.conf` I can connect to the server, but I’m having issues with mailbox access and authentication. Does anyone have any tips or common pitfalls I should check: ?? Any guidance would be greatly appreciated..... Thanks in advance... Selena Thomas https://www.igmguru.com/cloud-computing/microsoft-azure-administrator-az-10…

2 1

Sieve duplicate detection not working as expected
by Rosario Esposito 26 Jul '24

26 Jul '24

Hi, On a dovecot server (2.3.21) I have a simple sieve script: require ["duplicate"]; # rule:[duplicate] if duplicate { discard; stop; } I use virtual users with mail aliases on a LDAP backend. I have user "resposit" having 2 mail aliases: - resposit(a)na.infn.it - rosario.esposito(a)na.infn.it If I send a single message to both aliases I still receive 2 copies as you can see from the attached log. Is the "duplicate" sieve extension supposed to work this way ? Any help would be much appreciated ! -- Rosario Esposito

2 3

SMTPUTF8 support
by Dāvis Mosāns 26 Jul '24

26 Jul '24

Hi, I'm interested in SMTPUTF8 support in Dovecot. It seems it's still not implemented? Any plans on implementing it? How much work would it be? I couldn't find any mention of this functionality. Postfix has support which is enabled by default but it's not usable if Dovecot doesn't support it. Thanks! Best regards, Dāvis

2 3

Re: [EXT] Re[8]: Sieve Filters with MySQL
by Aki Tuomi 26 Jul '24

26 Jul '24

It's OK to hide it to the mailbox table as sieveFilterID. Then you can do map { pattern = priv/sieve/name/default table = mailbox username_field = email value_field = sieveFilterID } Aki > On 26/07/2024 10:14 EEST Adam Miller <adam(a)ardaemail.com> wrote: > > > ------ Original Message ------ > From "Aki Tuomi via dovecot" <dovecot(a)dovecot.org> > To "Adam Miller" <adam(a)ardaemail.com>; "Adam Miller via dovecot" > <dovecot(a)dovecot.org> > Date 7/23/2024 10:06:38 PM > Subject Re: Re[6]: Sieve Filters with MySQL > > >Hi! > > > >Usually how the "isActive" stuff is done is bit different. > > > >fwiw i would do the schema differently, and have two tables > > > >table 1: > > > >CREATE TABLE sieve_name_id ( > > id INT, > > email VARCHAR(255), > > name VARCHAR(255), > > PRIMARY KEY(email, name) > >) > > > >table 2 > > > >CREATE TABLE sieve_scripts ( > > id INT, > > content TEXT > >) > > > >Then you can map 'default' to the active script id, or leave it missing when there is no script enabled. This is how it's supposed to work. > > > >It's probably not dead obvious but if you look at the dict configuration you have: > > > >map { > > pattern = priv/sieve/name/$script_name > > table = mailboxFilter > > username_field = email > > value_field = uuid > > fields { > > name = $script_name > > } > >} > > > >You can see that the priv/sieve/name/ is not part of $script_name that is passed to sql in fields. > > > >btw, to debug SQL, you can try > > > >log_debug=category=sql > > > >next time. > > > >Aki > > > > > >> On 24/07/2024 00:42 EEST Adam Miller via dovecot <dovecot(a)dovecot.org> wrote: > >> > >> > >> Is it possible to include extra fields? For example, the “isActive” and > >> make sure it is true / 1? > >> > >> Thank you. > >> > >> > >> ------ Original Message ------ > >> From "Aki Tuomi via dovecot" <dovecot(a)dovecot.org> > >> To "Adam Miller" <adam(a)ardaemail.com>; "Adam Miller via dovecot" > >> <dovecot(a)dovecot.org> > >> Date 7/23/2024 4:44:30 AM > >> Subject Re: Re[4]: Sieve Filters with MySQL > >> > >> >You can try > >> > > >> >doveadm dict get -u adam proxy::sieve priv/sieve/name/default > >> > > >> >this should return id of the default script. > >> > > >> >doveadm dict get -u adam proxy::sieve priv/sieve/data/<id> > >> > > >> >should return the actual script. > >> > > >> >See https://doc.dovecot.org/configuration_manual/sieve/dict/ > >> > > >> >Aki > >> > > >> > > >> >> On 23/07/2024 14:09 EEST Adam Miller via dovecot <dovecot(a)dovecot.org> wrote: > >> >> > >> >> > >> >> Yes, I get that. What I would like to know is what are the queries that > >> >> Dovecot / Sieve is executing so that I can better determine where the > >> >> issue exists? Is there anyway to see them? Do you see an issue anywhere > >> >> in my configuration files? > >> >> > >> >> Thank you. > >> >> > >> >> > >> >> ------ Original Message ------ > >> >> From "Aki Tuomi" <aki.tuomi(a)open-xchange.com> > >> >> To "Adam Miller" <adam(a)ardaemail.com>; "Adam Miller via dovecot" > >> >> <dovecot(a)dovecot.org> > >> >> Date 7/23/2024 4:07:22 AM > >> >> Subject Re: Re[2]: Sieve Filters with MySQL > >> >> > >> >> >Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >sieve: dict storage: script `default': Script `default' not found at > >> >> >path priv/sieve/name/default > >> >> > > >> >> >Aki > >> >> > > >> >> >> On 23/07/2024 13:52 EEST Adam Miller via dovecot <dovecot(a)dovecot.org> wrote: > >> >> >> > >> >> >> > >> >> >> Yes, that is where I got the error from. Here’s more from the log file: > >> >> >> > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: Pigeonhole version 0.5.16 (09c29328) initializing > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: include: sieve_global is not set; it is currently not possible to > >> >> >> include `:global’ scripts. > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.16 (09c29328) > >> >> >> loaded > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.16 (09c29328) > >> >> >> loaded > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: dict storage: user=redacted, uri=proxy::sieve > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: dict storage: script `default': Script `default' not found at > >> >> >> path priv/sieve/name/default > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: User has no active script in storage > >> >> >> `dict:proxy::sieve;user=redacted’ > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: User has no personal script > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: No scripts to execute: reverting to default delivery. > >> >> >> > >> >> >> Is there something specific I should be looking for? > >> >> >> > >> >> >> Thank you! > >> >> >> > >> >> >> ------ Original Message ------ > >> >> >> From "Aki Tuomi via dovecot" <dovecot(a)dovecot.org> > >> >> >> To "Adam Miller" <adam(a)ardaemail.com>; "Adam Miller via dovecot" > >> >> >> <dovecot(a)dovecot.org> > >> >> >> Date 7/23/2024 3:35:17 AM > >> >> >> Subject Re: Sieve Filters with MySQL > >> >> >> > >> >> >> >Did you try with > >> >> >> > > >> >> >> >mail_debug=yes > >> >> >> > > >> >> >> >and > >> >> >> > > >> >> >> >log_debug=category=sieve > >> >> >> > > >> >> >> >Aki > >> >> >> > > >> >> >> >> On 23/07/2024 13:18 EEST Adam Miller via dovecot <dovecot(a)dovecot.org> wrote: > >> >> >> >> > >> >> >> >> > >> >> >> >> Me again! I am trying to get sieve filters working with a MySQL backend > >> >> >> >> but same to be coming up short. Right now, the error I am getting > >> >> >> >> received is: > >> >> >> >> > >> >> >> >> ------------------------------------------------------------------------------------------------------------------ > >> >> >> >> > >> >> >> >> "User has no active script in storage > >> >> >> >> dict:proxy::sieve;user=username@domain.com" > >> >> >> >> > >> >> >> >> ------------------------------------------------------------------------------------------------------------------ > >> >> >> >> > >> >> >> >> The “username(a)domain.xn--com-9o0a is obviously the email address of the > >> >> >> >> receiving mailbox. > >> >> >> >> > >> >> >> >> Here’s my latest config: > >> >> >> >> > >> >> >> >> # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf > >> >> >> >> # Pigeonhole version 0.5.16 (09c29328) > >> >> >> >> # OS: Linux 6.5.0-1020-aws x86_64 Ubuntu 22.04.4 LTS nfs4 > >> >> >> >> # Hostname: ec2-us-east-1a-arda-mail-001.ardaemail.com > >> >> >> >> auth_debug = yes > >> >> >> >> auth_mechanisms = plain login > >> >> >> >> auth_verbose = yes > >> >> >> >> auth_worker_max_count = 5 > >> >> >> >> base_dir = /var/run/dovecot > >> >> >> >> debug_log_path = /var/log/dovecot/debug.log > >> >> >> >> default_internal_group = ardaemail > >> >> >> >> default_internal_user = ardaemail > >> >> >> >> dict { > >> >> >> >> quota = mysql:/etc/dovecot/inc.d/inc.quota.user.sql.conf > >> >> >> >> sieve = mysql:/etc/dovecot/inc.d/inc.sieve.sql.conf > >> >> >> >> sql = mysql:/etc/dovecot/inc.d/inc.lastlogin.sql.conf > >> >> >> >> } > >> >> >> >> hostname = = mail.ardaemail.com > >> >> >> >> info_log_path = /var/log/dovecot/info.log > >> >> >> >> instance_name = ec2-us-east-1a-arda-mail-001.ardaemail.com > >> >> >> >> listen = 172.16.0.200 > >> >> >> >> log_path = /var/log/dovecot/general.log > >> >> >> >> login_greeting = Welcome to ArdaEmail > >> >> >> >> mail_debug = yes > >> >> >> >> mail_gid = ardaemail > >> >> >> >> mail_location = maildir:/mnt/mail/%d/%n > >> >> >> >> mail_max_userip_connections = 1000 > >> >> >> >> mail_plugins = " quota mailbox_alias" > >> >> >> >> mail_server_admin = mailto:support@ardaemail.com > >> >> >> >> mail_uid = ardaemail > >> >> >> >> maildir_stat_dirs = yes > >> >> >> >> namespace inbox { > >> >> >> >> inbox = yes > >> >> >> >> location = > >> >> >> >> mailbox Archive { > >> >> >> >> auto = subscribe > >> >> >> >> special_use = \Archive > >> >> >> >> } > >> >> >> >> mailbox Drafts { > >> >> >> >> auto = subscribe > >> >> >> >> special_use = \Drafts > >> >> >> >> } > >> >> >> >> mailbox Junk { > >> >> >> >> auto = subscribe > >> >> >> >> autoexpunge = 90 days > >> >> >> >> special_use = \Junk > >> >> >> >> } > >> >> >> >> mailbox Sent { > >> >> >> >> auto = subscribe > >> >> >> >> special_use = \Sent > >> >> >> >> } > >> >> >> >> mailbox Trash { > >> >> >> >> auto = subscribe > >> >> >> >> autoexpunge = 30 days > >> >> >> >> special_use = \Trash > >> >> >> >> } > >> >> >> >> prefix = > >> >> >> >> } > >> >> >> >> passdb { > >> >> >> >> args = /etc/dovecot/inc.d/inc.sql.conf > >> >> >> >> driver = sql > >> >> >> >> } > >> >> >> >> plugin { > >> >> >> >> last_login_dict = proxy::sql > >> >> >> >> last_login_key = # hidden, use -P to show it > >> >> >> >> last_login_precision = ms > >> >> >> >> mailbox_alias_new = Junk Email > >> >> >> >> mailbox_alias_new2 = Junk E-mail > >> >> >> >> mailbox_alias_new3 = Sent Messages > >> >> >> >> mailbox_alias_new4 = Sent Items > >> >> >> >> mailbox_alias_new5 = Deleted Items > >> >> >> >> mailbox_alias_new6 = Junk Mail > >> >> >> >> mailbox_alias_old = Junk > >> >> >> >> mailbox_alias_old2 = Junk > >> >> >> >> mailbox_alias_old3 = Sent > >> >> >> >> mailbox_alias_old4 = Sent > >> >> >> >> mailbox_alias_old5 = Trash > >> >> >> >> mailbox_alias_old6 = Junk > >> >> >> >> quota = dict:User Quota::proxy::quota > >> >> >> >> quota_exceeded_message = Mailbox is full and cannot receive any more > >> >> >> >> emails > >> >> >> >> quota_status_nouser = DUNNO > >> >> >> >> quota_status_success = DUNNO > >> >> >> >> quota_warning = bytes=95%% quota-warning 95 %u > >> >> >> >> quota_warning2 = bytes=85%% quota-warning 85 %u > >> >> >> >> quota_warning3 = bytes=75%% quota-warning 75 %u > >> >> >> >> sieve = dict:proxy::sieve > >> >> >> >> sieve_plugins = sieve_imapsieve sieve_extprograms > >> >> >> >> } > >> >> >> >> postmaster_address = postmaster(a)ardaemail.com > >> >> >> >> protocols = imap lmtp > >> >> >> >> service auth-worker { > >> >> >> >> group = ardaemail > >> >> >> >> user = ardaemail > >> >> >> >> } > >> >> >> >> service auth { > >> >> >> >> group = ardaemail > >> >> >> >> unix_listener /var/spool/postfix/private/auth { > >> >> >> >> group = postfix > >> >> >> >> mode = 0666 > >> >> >> >> user = postfix > >> >> >> >> } > >> >> >> >> unix_listener auth-userdb { > >> >> >> >> group = ardaemail > >> >> >> >> mode = 0666 > >> >> >> >> user = ardaemail > >> >> >> >> } > >> >> >> >> user = ardaemail > >> >> >> >> } > >> >> >> >> service imap-login { > >> >> >> >> inet_listener imap { > >> >> >> >> port = 0 > >> >> >> >> } > >> >> >> >> inet_listener imaps { > >> >> >> >> port = 993 > >> >> >> >> ssl = yes > >> >> >> >> } > >> >> >> >> process_min_avail = 8 > >> >> >> >> service_count = 0 > >> >> >> >> } > >> >> >> >> service imap { > >> >> >> >> vsz_limit = 4 G > >> >> >> >> } > >> >> >> >> service lmtp { > >> >> >> >> unix_listener /var/spool/postfix/private/dovecot-lmtp { > >> >> >> >> group = postfix > >> >> >> >> mode = 0666 > >> >> >> >> user = postfix > >> >> >> >> } > >> >> >> >> } > >> >> >> >> service pop3-login { > >> >> >> >> inet_listener pop3 { > >> >> >> >> port = 0 > >> >> >> >> } > >> >> >> >> inet_listener pop3s { > >> >> >> >> port = 0 > >> >> >> >> } > >> >> >> >> } > >> >> >> >> service quota-status { > >> >> >> >> executable = /usr/lib/dovecot/quota-status -p postfix > >> >> >> >> unix_listener /var/spool/postfix/private/quota-status { > >> >> >> >> user = postfix > >> >> >> >> } > >> >> >> >> } > >> >> >> >> service quota-warning { > >> >> >> >> executable = script /etc/dovecot/bin/quota-warning.sh > >> >> >> >> unix_listener quota-warning { > >> >> >> >> group = ardaemail > >> >> >> >> mode = 0666 > >> >> >> >> user = ardaemail > >> >> >> >> } > >> >> >> >> } > >> >> >> >> service submission-login { > >> >> >> >> inet_listener submission { > >> >> >> >> port = 0 > >> >> >> >> } > >> >> >> >> } > >> >> >> >> ssl = required > >> >> >> >> ssl_cert = </etc/letsencrypt/live/mail.ardaemail.com/fullchain.pem > >> >> >> >> ssl_client_ca_dir = /etc/ssl/certs > >> >> >> >> ssl_dh = # hidden, use -P to show it > >> >> >> >> ssl_key = # hidden, use -P to show it > >> >> >> >> ssl_prefer_server_ciphers = yes > >> >> >> >> userdb { > >> >> >> >> args = /etc/dovecot/inc.d/inc.sql.conf > >> >> >> >> driver = sql > >> >> >> >> } > >> >> >> >> protocol imap { > >> >> >> >> imap_metadata = yes > >> >> >> >> mail_plugins = " quota mailbox_alias imap_sieve imap_quota last_login" > >> >> >> >> } > >> >> >> >> protocol lmtp { > >> >> >> >> mail_plugins = " quota mailbox_alias sieve” > >> >> >> >> } > >> >> >> >> > >> >> >> >> This output clearly does not include my Sieve configuration maps so > >> >> >> >> here’s those: > >> >> >> >> > >> >> >> >> connect = host=redacted dbname=redacted user=redacted password=redacted > >> >> >> >> > >> >> >> >> map { > >> >> >> >> pattern = priv/sieve/name/$script_name > >> >> >> >> table = mailboxFilter > >> >> >> >> username_field = email > >> >> >> >> value_field = uuid > >> >> >> >> fields { > >> >> >> >> name = $script_name > >> >> >> >> } > >> >> >> >> } > >> >> >> >> > >> >> >> >> map { > >> >> >> >> pattern = priv/sieve/data/$uuid > >> >> >> >> table = mailboxFilter > >> >> >> >> username_field = email > >> >> >> >> value_field = filter > >> >> >> >> fields { > >> >> >> >> uuid = $uuid > >> >> >> >> } > >> >> >> >> } > >> >> >> >> > >> >> >> >> And here’s the table schema: > >> >> >> >> > >> >> >> >> CREATE TABLE `mailboxFilter` ( > >> >> >> >> `id` int(11) unsigned NOT NULL AUTO_INCREMENT, > >> >> >> >> `uuid` varchar(36) NOT NULL, > >> >> >> >> `email` varchar(192) NOT NULL, > >> >> >> >> `name` varchar(255) NOT NULL, > >> >> >> >> `filter` longtext NOT NULL, > >> >> >> >> `isActive` bit(1) NOT NULL DEFAULT b’1’, > >> >> >> >> `createdAt` datetime NOT NULL DEFAULT current_timestamp(), > >> >> >> >> `updatedAt` datetime NOT NULL DEFAULT current_timestamp() ON UPDATE > >> >> >> >> current_timestamp(), > >> >> >> >> PRIMARY KEY (`id`), > >> >> >> >> UNIQUE KEY `UUID` (`uuid`), > >> >> >> >> UNIQUE KEY `EMAIL` (`email`) > >> >> >> >> ) ENGINE=InnoDB AUTO_INCREMENT=2 DEFAULT CHARSET=utf8mb4 > >> >> >> >> COLLATE=utf8mb4_general_ci; > >> >> >> >> > >> >> >> >> When I run manually queries, everything works fine though I am not > >> >> >> >> entirely sure what the queries are that Dovecot is executing. > >> >> >> >> > >> >> >> >> Any help is appreciated! Also, if I could use the “isActive” field, that > >> >> >> >> would be great as well. My plan to start here is to only have one record > >> >> >> >> in the table per mailbox which would contain all Sieve filters. > >> >> >> >> Eventually, it would be nice if I could adjust the configuration to > >> >> >> >> allow for more than one that returns concatenated so any help there > >> >> >> >> would be great as well! > >> >> >> >> > >> >> >> >> Thank you! > >> >> >> >> _______________________________________________ > >> >> >> >> dovecot mailing list -- dovecot(a)dovecot.org > >> >> >> >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> >> >> >_______________________________________________ > >> >> >> >dovecot mailing list -- dovecot(a)dovecot.org > >> >> >> >To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> >> >> _______________________________________________ > >> >> >> dovecot mailing list -- dovecot(a)dovecot.org > >> >> >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> >> _______________________________________________ > >> >> dovecot mailing list -- dovecot(a)dovecot.org > >> >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> >_______________________________________________ > >> >dovecot mailing list -- dovecot(a)dovecot.org > >> >To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> _______________________________________________ > >> dovecot mailing list -- dovecot(a)dovecot.org > >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > >_______________________________________________ > >dovecot mailing list -- dovecot(a)dovecot.org > >To unsubscribe send an email to dovecot-leave(a)dovecot.org

2 2

sieve mail date change
by Marc 24 Jul '24

24 Jul '24

I am a bit rookie with sieve. Some time ago I created a sieve pipe that would sometimes alter alter the subject and move a message to a different mailbox. Currently this results in that a date changes of this message while I don't see anything in the source altering a date. What could be causing this and how to work around this?

2 2

Sieve Filters with MySQL
by Adam Miller 24 Jul '24

24 Jul '24

Me again! I am trying to get sieve filters working with a MySQL backend but same to be coming up short. Right now, the error I am getting received is: ------------------------------------------------------------------------------------------------------------------ "User has no active script in storage dict:proxy::sieve;user=username@domain.com" ------------------------------------------------------------------------------------------------------------------ The “username(a)domain.xn--com-9o0a is obviously the email address of the receiving mailbox. Here’s my latest config: # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 6.5.0-1020-aws x86_64 Ubuntu 22.04.4 LTS nfs4 # Hostname: ec2-us-east-1a-arda-mail-001.ardaemail.com auth_debug = yes auth_mechanisms = plain login auth_verbose = yes auth_worker_max_count = 5 base_dir = /var/run/dovecot debug_log_path = /var/log/dovecot/debug.log default_internal_group = ardaemail default_internal_user = ardaemail dict { quota = mysql:/etc/dovecot/inc.d/inc.quota.user.sql.conf sieve = mysql:/etc/dovecot/inc.d/inc.sieve.sql.conf sql = mysql:/etc/dovecot/inc.d/inc.lastlogin.sql.conf } hostname = = mail.ardaemail.com info_log_path = /var/log/dovecot/info.log instance_name = ec2-us-east-1a-arda-mail-001.ardaemail.com listen = 172.16.0.200 log_path = /var/log/dovecot/general.log login_greeting = Welcome to ArdaEmail mail_debug = yes mail_gid = ardaemail mail_location = maildir:/mnt/mail/%d/%n mail_max_userip_connections = 1000 mail_plugins = " quota mailbox_alias" mail_server_admin = mailto:support@ardaemail.com mail_uid = ardaemail maildir_stat_dirs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 90 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = } passdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } plugin { last_login_dict = proxy::sql last_login_key = # hidden, use -P to show it last_login_precision = ms mailbox_alias_new = Junk Email mailbox_alias_new2 = Junk E-mail mailbox_alias_new3 = Sent Messages mailbox_alias_new4 = Sent Items mailbox_alias_new5 = Deleted Items mailbox_alias_new6 = Junk Mail mailbox_alias_old = Junk mailbox_alias_old2 = Junk mailbox_alias_old3 = Sent mailbox_alias_old4 = Sent mailbox_alias_old5 = Trash mailbox_alias_old6 = Junk quota = dict:User Quota::proxy::quota quota_exceeded_message = Mailbox is full and cannot receive any more emails quota_status_nouser = DUNNO quota_status_success = DUNNO quota_warning = bytes=95%% quota-warning 95 %u quota_warning2 = bytes=85%% quota-warning 85 %u quota_warning3 = bytes=75%% quota-warning 75 %u sieve = dict:proxy::sieve sieve_plugins = sieve_imapsieve sieve_extprograms } postmaster_address = postmaster(a)ardaemail.com protocols = imap lmtp service auth-worker { group = ardaemail user = ardaemail } service auth { group = ardaemail unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = ardaemail mode = 0666 user = ardaemail } user = ardaemail } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 8 service_count = 0 } service imap { vsz_limit = 4 G } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } service quota-status { executable = /usr/lib/dovecot/quota-status -p postfix unix_listener /var/spool/postfix/private/quota-status { user = postfix } } service quota-warning { executable = script /etc/dovecot/bin/quota-warning.sh unix_listener quota-warning { group = ardaemail mode = 0666 user = ardaemail } } service submission-login { inet_listener submission { port = 0 } } ssl = required ssl_cert = </etc/letsencrypt/live/mail.ardaemail.com/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } protocol imap { imap_metadata = yes mail_plugins = " quota mailbox_alias imap_sieve imap_quota last_login" } protocol lmtp { mail_plugins = " quota mailbox_alias sieve” } This output clearly does not include my Sieve configuration maps so here’s those: connect = host=redacted dbname=redacted user=redacted password=redacted map { pattern = priv/sieve/name/$script_name table = mailboxFilter username_field = email value_field = uuid fields { name = $script_name } } map { pattern = priv/sieve/data/$uuid table = mailboxFilter username_field = email value_field = filter fields { uuid = $uuid } } And here’s the table schema: CREATE TABLE `mailboxFilter` ( `id` int(11) unsigned NOT NULL AUTO_INCREMENT, `uuid` varchar(36) NOT NULL, `email` varchar(192) NOT NULL, `name` varchar(255) NOT NULL, `filter` longtext NOT NULL, `isActive` bit(1) NOT NULL DEFAULT b’1’, `createdAt` datetime NOT NULL DEFAULT current_timestamp(), `updatedAt` datetime NOT NULL DEFAULT current_timestamp() ON UPDATE current_timestamp(), PRIMARY KEY (`id`), UNIQUE KEY `UUID` (`uuid`), UNIQUE KEY `EMAIL` (`email`) ) ENGINE=InnoDB AUTO_INCREMENT=2 DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_general_ci; When I run manually queries, everything works fine though I am not entirely sure what the queries are that Dovecot is executing. Any help is appreciated! Also, if I could use the “isActive” field, that would be great as well. My plan to start here is to only have one record in the table per mailbox which would contain all Sieve filters. Eventually, it would be nice if I could adjust the configuration to allow for more than one that returns concatenated so any help there would be great as well! Thank you!

2 10

Key metrics to monitor for dovecot at CloudWatch
by Sivakumar Vadivel 24 Jul '24

24 Jul '24

Hello Team, Configured dovecot mail server and SES will receive and forward to SNS topic. Lambda subscribed to the topic and it will receive the mail and write to the EFS volume. EFS volume mounted on both dovecot and lambda. Also enabled AWS Cloudwatch to monitor overall infra. I'm going to enable anomaly detection at Cloudwatch and I want to know the list of key metrics to monitor. I'm thinking of the following metrics. 1. No of bounce 2. PublishFailed & Success 3. EFS disk storage Please suggest the other key metrics, so that I can enable anomaly detection to understand and create the cloudwatch alarm.

1 0

Dovecot Stats Plugin
by Adam Miller 23 Jul '24

23 Jul '24

Hello again everyone! I am trying to get the “doveadm stats dump” command to work and even though it does not error, there are no stats. When I try to enable the stats, I get the following error: “Error: Plugin 'stats' not found from directory /usr/lib/dovecot/modules” which is correct, the “stats” plugin does not exist. I do have “/usr/lib/dovecot/stats”. Here’s my configuration: Dovecot Version: 2.3.16 Operating System: Ubuntu 22.04.1 Packages Installed: - dovecot-antispam - dovecot-core - dovecot-imapd - dovecot-lmtpd - dovecot-mysql - dovecot-pop3d - dovecot-sieve Packages Available: - dovecot-auth-lua - dovecot-dev - dovecot-fts-xapian - dovecot-gssapi - dovecot-ldap - dovecot-lucene - dovecot-managesieved - dovecot-pgsql - dovecot-solr - dovecot-sqlite - dovecot-submissiond Dovecot Configuration (without stats enabled): # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 6.5.0-1020-aws x86_64 Ubuntu 22.04.4 LTS nfs4 # Hostname: ec2-us-east-1a-arda-mail-001.ardaemail.com auth_mechanisms = plain login auth_worker_max_count = 5 base_dir = /var/run/dovecot debug_log_path = /var/log/dovecot/debug.log default_internal_group = ardaemail default_internal_user = ardaemail dict { quota = mysql:/etc/dovecot/inc.d/inc.quota.user.sql.conf } hostname = = mail.ardaemail.com info_log_path = /var/log/dovecot/info.log instance_name = ec2-us-east-1a-arda-mail-001.ardaemail.com listen = 172.16.0.200 log_path = /var/log/dovecot/general.log login_greeting = Welcome to ArdaEmail mail_gid = ardaemail mail_location = maildir:/mnt/mail/%d/%n mail_max_userip_connections = 1000 mail_plugins = " quota mailbox_alias" mail_uid = ardaemail maildir_stat_dirs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = no special_use = \Drafts } mailbox Junk { auto = no autoexpunge = 90 days special_use = \Junk } mailbox SPAM { auto = subscribe autoexpunge = 90 days } mailbox Sent { auto = no special_use = \Sent } mailbox Trash { auto = no autoexpunge = 30 days special_use = \Trash } prefix = } passdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } plugin { imapsieve_mailbox1_before = file:/etc/dovecot/sieve.d/spam/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve.d/spam/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * mailbox_alias_new = Junk Email mailbox_alias_new2 = Junk E-mail mailbox_alias_new3 = Sent Messages mailbox_alias_new4 = Sent Items mailbox_alias_new5 = Deleted Items mailbox_alias_old = Junk mailbox_alias_old2 = Junk mailbox_alias_old3 = Sent mailbox_alias_old4 = Sent mailbox_alias_old5 = Trash quota = dict:User Quota::proxy::quota quota_exceeded_message = Mailbox is full and cannot receive any more emails quota_status_nouser = DUNNO quota_status_success = DUNNO quota_warning = bytes=95%% quota-warning 95 %u quota_warning2 = bytes=85%% quota-warning 85 %u quota_warning3 = bytes=75%% quota-warning 75 %u recipient_delimiter = + sieve_after = /etc/dovecot/sieve.d/after/ sieve_before = /etc/dovecot/sieve.d/before/ sieve_extensions = +spamtest +spamtestplus +virustest +notify +imapflags sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_quota_max_storage = 0 sieve_spamtest_max_header = X-Spamd-Result: -?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]) sieve_spamtest_status_header = X-Spamd-Result: (-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]] sieve_spamtest_status_type = score } postmaster_address = postmaster(a)ardaemail.com protocols = imap lmtp service auth-worker { group = ardaemail user = ardaemail } service auth { group = ardaemail unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = ardaemail mode = 0666 user = ardaemail } user = ardaemail } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 8 service_count = 0 } service imap { vsz_limit = 4 G } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } service quota-status { executable = /usr/lib/dovecot/quota-status -p postfix unix_listener /var/spool/postfix/private/quota-status { user = postfix } } service quota-warning { executable = script /etc/dovecot/bin/quota-warning.sh unix_listener quota-warning { group = ardaemail mode = 0666 user = ardaemail } } service submission-login { inet_listener submission { port = 0 } } ssl = required ssl_cert = </etc/letsencrypt/live/mail.ardaemail.com/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } protocol imap { mail_plugins = " quota mailbox_alias imap_sieve imap_quota" } protocol lmtp { mail_plugins = " quota mailbox_alias sieve" } The “stats” plugin does not seem to be found anywhere from my searching. Any help is greatly appreciated. I would like to be able to turn on the INET listener to hit the stats via an HTTP request. Thank you!

3 7

Dovecot proxy/director/replicator upgrade path
by Andrea Gabellini 23 Jul '24

23 Jul '24

Hello, I manage a Dovecot installation version 2.3.4.1 with a pair of proxy/director in front and two backends that use the replicator plugin to synchronize emails between them. I would like to update all 4 machines and would like to understand if I can directly jump to the latest version 2.3.21 and if there is a logical sequence to follow, such as updating the backends first and then the frontends or vice versa. Thanks, Andrea -- __________________________ E-mail Signatures are usually made to compensate for the boring contents of the letter. __________________________ TIM San Marino S.p.A. Andrea Gabellini Engineering R&D TIM San Marino S.p.A. - https://www.telecomitalia.sm Via Ventotto Luglio, 212 - Piano -2 47893 - Borgo Maggiore - Republic of San Marino Tel: (+378) 0549 886237 Fax: (+378) 0549 886188 -- Informativa Privacy Questa email ha per destinatari dei contatti presenti negli archivi di TIM San Marino S.p.A.. Tutte le informazioni vengono trattate e tutelate nel rispetto della normativa vigente sulla protezione dei dati personali (Reg. EU 2016/679). Per richiedere informazioni e/o variazioni e/o la cancellazione dei vostri dati presenti nei nostri archivi potete inviare una email a privacy(a)telecomitalia.sm. Avviso di Riservatezza Il contenuto di questa e-mail e degli eventuali allegati e' strettamente confidenziale e destinato alla/e persona/e a cui e' indirizzato. Se avete ricevuto per errore questa e-mail, vi preghiamo di segnalarcelo immediatamente e di cancellarla dal vostro computer. E' fatto divieto di copiare e divulgare il contenuto di questa e-mail. Ogni utilizzo abusivo delle informazioni qui contenute da parte di persone terze o comunque non indicate nella presente e-mail potra' essere perseguito ai sensi di legge.

1 0

Seeking Guidance on Dovecot Configuration, Security, and Performance Optimization
by Selena Thomas 23 Jul '24

23 Jul '24

Hi everyone, I am setting up Dovecot for the first time and could use some guidance. I have a couple of questions::- -Configuration Basics: What are the essential configuration files I need to focus on for a basic setup: ?? -Security Best Practices: What steps should I take to ensure my Dovecot server is secure, especially regarding -authentication and SSL/TLS: ?? -Performance Tuning: Are there any tips for optimizing performance for a small to medium-sized deployment: ?? I appreciate any advice or resources you can point me towards. Thanks in advance for your help! With Regards, Selena [flutter/https://www.igmguru.com/digital-marketing-programming/flutter-train…]

2 1

Seeking Guidance on Dovecot Configuration, Security, and Performance Optimization
by Selena Thomas 23 Jul '24

23 Jul '24

Hi everyone, I am setting up Dovecot for the first time and could use some guidance. I have a couple of questions::- -Configuration Basics: What are the essential configuration files I need to focus on for a basic setup: ?? -Security Best Practices: What steps should I take to ensure my Dovecot server is secure, especially regarding -authentication and SSL/TLS: ?? -Performance Tuning: Are there any tips for optimizing performance for a small to medium-sized deployment: ?? I appreciate any advice or resources you can point me towards. Thanks in advance for your help! With Regards, Selena https://www.igmguru.com/digital-marketing-programming/flutter-training/

1 0

Seeking Guidance on Dovecot Configuration, Security, and Performance Optimization
by Selena Thomas 23 Jul '24

23 Jul '24

Hi everyone, I am setting up Dovecot for the first time and could use some guidance. I have a couple of questions::- -Configuration Basics: What are the essential configuration files I need to focus on for a basic setup: ?? -Security Best Practices: What steps should I take to ensure my Dovecot server is secure, especially regarding -authentication and SSL/TLS: ?? -Performance Tuning: Are there any tips for optimizing performance for a small to medium-sized deployment: ?? I appreciate any advice or resources you can point me towards. Thanks in advance for your help! With Regards, Selena [https://www.igmguru.com/digital-marketing-programming/flutter-training/flut…]

1 0

auth-worker doesn't systematically log the IP
by Yassine Chaouche 23 Jul '24

23 Jul '24

Dear list, look at this grep auth-worker | nl output from my dovecot log : 166 Jul 22 15:49:47 auth-worker(24409): Info: sql(hakim.boukhadra(a)domain.tld): unknown user 167 Jul 22 15:49:47 auth-worker(13026): Info: sql(prtg(a)domain.tld): unknown user 168 Jul 22 15:53:00 auth-worker(13026): Info: sql(feriel.abbas(a)domain.tld,10.10.10.19): Password mismatch 169 Jul 22 15:53:15 auth-worker(13026): Info: sql(feriel.abbas(a)domain.tld,10.10.10.19): Password mismatch 170 Jul 22 15:55:26 auth-worker(13026): Info: sql(it_sys(a)domain.tld): unknown user 171 Jul 22 15:59:30 auth-worker(13026): Info: sql(radioaintemouchent.domain.tld,10.10.10.19): unknown user 172 Jul 22 15:59:43 auth-worker(13026): Info: sql(mouadoussama(a)radioalgerie.dz): unknown user 173 Jul 22 16:00:38 auth-worker(13026): Info: sql(it_mam(a)domain.tld): unknown user 174 Jul 22 16:00:58 auth-worker(13026): Info: sql(it_mam(a)domain.tld): unknown user 175 Jul 22 16:02:01 auth-worker(13026): Info: sql(it_mam(a)domain.tld): unknown user 176 Jul 22 16:09:35 auth-worker(13026): Info: sql(it_mam(a)domain.tld): unknown user 177 Jul 22 16:09:42 auth-worker(13026): Info: sql(prtg(a)domain.tld): unknown user 178 Jul 22 16:10:11 auth-worker(13026): Info: sql(it_mam(a)domain.tld): unknown user 179 Jul 22 16:15:37 auth-worker(13026): Info: sql(it_sys(a)domain.tld): unknown user 180 Jul 22 16:26:55 auth-worker(13026): Info: sql(it_mam(a)domain.tld): unknown user 181 Jul 22 16:32:01 auth-worker(13026): Info: sql(it_mam(a)domain.tld): unknown user 182 Jul 22 16:35:37 auth-worker(19555): Info: sql(it_sys(a)domain.tld): unknown user As you can see, sometimes the IP addresses of the dubious login attempts are noted, other times this crucial piece of evidence is conspicuously absent. I am wondering what is the source of all those login attempts? or could those be mere username lookups instead to test for mail deliverability? Many thanks, -- yassine -- sysadm +213-779 06 06 23 http://about.me/ychaouche Looking for side gigs.

2 2

doveadm: SSL handshake failed - wrong version number
by Rachel Roch 19 Jul '24

19 Jul '24

When attempting a doveadm backup, e.g. : doveadm -D backup -Ru user tcp:foo.example.com:12345 I am getting the following error : Error: SSL handshake failed: SSL_accept() failed: error:0A00010B:SSL routines::wrong version number There is nothing wrong with my SSL config because, e.g. openssl s_client -connect localhost:993 works on the source host. So I don't know why doveadm doesn't work. My SSL config is: ssl = required ssl_cert = </etc/ssl/foo.example.com.pem ssl_key = </etc/ssl/foo.example.com.priv ssl_client_ca_dir = /etc/ssl/certs ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-CHACHA20-POLY1305 service doveadm { inet_listener { port = 12345 ssl = yes } }

2 1

dovecot.list.index.log
by Joan Moreau 19 Jul '24

19 Jul '24

HI Is it safe to delete the file dovecot.list.index.log (as I am still struggling with using any protocol for network storage of the emails (dbox), and now dovecot complains that my dovecot.list.index.log is corrupted) Thank you

3 3

AD authentication with dovecot not working.
by hkhk_exact10 19 Jul '24

19 Jul '24

Hi All, I am trying to setup AD auth with dovecot and have tried a lot of options but still no success. I am using a bind account for AD authentication and the users are not posix accounts. I am not using the ssl cert as its not available, so disabling it. I have used the similar settings with saslauthd+postfix and it worked, not sure what am I doing wrong with configurations.. My configuration is as follows: # dovecot --version 2.3.16 (7e2e900c1a) # dovecot -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # OS: Linux 5.14.0-474.el9.x86_64 x86_64 CentOS Stream release 9 # Hostname: mail-centos.example.com auth_mechanisms = plain login first_valid_uid = 1000 listen = * mail_location = maildir:~/Maildir mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service pop3-login { process_limit = 500 } service submission-login { inet_listener submission { port = 587 } } ssl_cert = </etc/ssl/example.com/server.pem ssl_cipher_list = PROFILE=SYSTEM ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } ------------------ # cat /etc/dovecot/dovecot-ldap.conf.ext uris = ldaps://10.1.85.11 dn = CN=s_linux_bind,OU=Global,OU=Services,OU=Accounts,OU=root,DC=example,DC=com dnpass = xxxxx auth_bind = yes tls_require_cert = never debug_level = 1 ldap_version = 3 base = dc=example,dc=com scope = subtree deref = never user_filter = (&(objectClass=user)(sAMAccountName=%u)) --------------- Error logs: dovecot[6600]: auth: Error: ** ld 0x556695138d90 Outstanding Requests: dovecot[6600]: auth: Error: * msgid 2, origid 2, status RequestCompleted dovecot[6600]: auth: Error: outstanding referrals 2, parent count 2 dovecot[6600]: auth: Error: * msgid 3, origid 2, status InProgress dovecot[6600]: auth: Error: outstanding referrals 0, parent count 2 dovecot[6600]: auth: Error: * msgid 5, origid 2, status InProgress dovecot[6600]: auth: Error: outstanding referrals 0, parent count 1 dovecot[6600]: auth: Error: ld 0x556695138d90 request count 3 (abandoned 0) dovecot[6600]: auth: Error: ** ld 0x556695138d90 Response Queue: dovecot[6600]: auth: Error: Empty dovecot[6600]: auth: Error: ld 0x556695138d90 response count 0 dovecot[6600]: auth: Error: ldap_chkResponseList ld 0x556695138d90 msgid -1 all 0 dovecot[6600]: auth: Error: ldap_chkResponseList returns ld 0x556695138d90 NULL dovecot[6600]: auth: Error: ldap_int_select postfix/submission/smtpd[6602]: warning: unknown[10.1.70.75]: SASL LOGIN authentication failed: Connection lost to authentication server postfix/submission/smtpd[6602]: disconnect from unknown[10.1.70.75] ehlo=2 starttls=1 auth=0/1 quit=1 commands=4/5 Attaching the detailed error logs. --------- saslauthd settings which worked: # cat /etc/saslauthd.conf ldap_servers: ldaps://10.1.85.11 ldap_search_base: dc=wtg,dc=zone ldap_filter: (sAMAccountName=%u) ldap_bind_dn: CN=s_linux_bind,OU=Global,OU=Services,OU=Accounts,OU=root,DC=example,DC=com ldap_password: xxxx ldap_tls_reqcert: never Regards, Sandeep

4 4

Invalid/Unmapped Key with Last Login Plugin
by Adam Miller 18 Jul '24

18 Jul '24

OS: Ubuntu 22.04.1 Dovecot: 2.3.16 (7e2e900c1a) Hello all! I have the last login plugin working with the IMAP service however with LMTP, it errors. I do not necessarily need / want the LMTP service and did not explicitly enable it but it is throwing an error in my logs. Jul 17 10:22:14 lmtp(184051):Error: last_login_dict: Failed to write value: dict-server returned failure: sql dict set: Invalid/unmapped key:shared/last-login/lmtp/username@domain.com/ (reply took 0.234 secs (0.001 in dict wait, 0.033 in other ioloops, 0.030 in locks, as ync-id reply 0.000 secs ago, started on dict-server 0.220 secs ago, took 0.000 secs)) It would be nice to get rid of this error one or another: either disable last login for LMTP or get it working. Current Configuration from doveconf -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 6.5.0-1020-aws x86_64 Ubuntu 22.04.4 LTS nfs4 # Hostname: ec2-us-east-1a-arda-mail-001.ardaemail.com auth_mechanisms = plain login auth_worker_max_count = 5 base_dir = /var/run/dovecot debug_log_path = /var/log/dovecot/debug.log default_internal_group = ardaemail default_internal_user = ardaemail dict { quota = mysql:/etc/dovecot/inc.d/inc.quota.user.sql.conf sql = mysql:/etc/dovecot/inc.d/inc.lastlogin.sql.conf } hostname = = mail.ardaemail.com info_log_path = /var/log/dovecot/info.log instance_name = ec2-us-east-1a-arda-mail-001.ardaemail.com listen = 172.16.0.200 log_path = /var/log/dovecot/general.log login_greeting = Welcome to ArdaEmail mail_gid = ardaemail mail_location = maildir:/mnt/mail/%d/%n mail_max_userip_connections = 1000 mail_plugins = " quota mailbox_alias last_login" mail_server_admin = mailto:support@ardaemail.com mail_uid = ardaemail maildir_stat_dirs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 90 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = } passdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } plugin { imapsieve_mailbox1_before = file:/etc/dovecot/sieve.d/spam/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve.d/spam/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * last_login_dict = proxy::sql last_login_key = # hidden, use -P to show it last_login_precision = ms mailbox_alias_new = Junk Email mailbox_alias_new2 = Junk E-mail mailbox_alias_new3 = Sent Messages mailbox_alias_new4 = Sent Items mailbox_alias_new5 = Deleted Items mailbox_alias_new6 = Junk Mail mailbox_alias_old = Junk mailbox_alias_old2 = Junk mailbox_alias_old3 = Sent mailbox_alias_old4 = Sent mailbox_alias_old5 = Trash mailbox_alias_old6 = Junk quota = dict:User Quota::proxy::quota quota_exceeded_message = Mailbox is full and cannot receive any more emails quota_status_nouser = DUNNO quota_status_success = DUNNO quota_warning = bytes=95%% quota-warning 95 %u quota_warning2 = bytes=85%% quota-warning 85 %u quota_warning3 = bytes=75%% quota-warning 75 %u recipient_delimiter = + sieve_after = /etc/dovecot/sieve.d/after/ sieve_before = /etc/dovecot/sieve.d/before/ sieve_extensions = +spamtest +spamtestplus +virustest +notify +imapflags sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_quota_max_storage = 0 sieve_spamtest_max_header = X-Spamd-Result: -?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]) sieve_spamtest_status_header = X-Spamd-Result: (-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]] sieve_spamtest_status_type = score } postmaster_address = postmaster(a)ardaemail.com protocols = imap lmtp service auth-worker { group = ardaemail user = ardaemail } service auth { group = ardaemail unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = ardaemail mode = 0666 user = ardaemail } user = ardaemail } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 8 service_count = 0 } service imap { vsz_limit = 4 G } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } service quota-status { executable = /usr/lib/dovecot/quota-status -p postfix unix_listener /var/spool/postfix/private/quota-status { user = postfix } } service quota-warning { executable = script /etc/dovecot/bin/quota-warning.sh unix_listener quota-warning { group = ardaemail mode = 0666 user = ardaemail } } service submission-login { inet_listener submission { port = 0 } } ssl = required ssl_cert = </etc/letsencrypt/live/mail.ardaemail.com/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } protocol imap { mail_plugins = " quota mailbox_alias last_login imap_sieve imap_quota last_login" } protocol lmtp { mail_plugins = " quota mailbox_alias last_login sieve" } In the configuration above, I do not have "last_login" in my actual config for "protocol lmtp", something is adding it. Any help is appreciated. Thank you!

3 7

Missing IMAP METADATA Plugin
by Adam Miller 18 Jul '24

18 Jul '24

OS: Ubuntu 22.04.1 Dovecot: 2.3.16 (7e2e900c1a) When trying to enable the “imap_metadata” plugin, I get the following error: Plugin 'imap_metadata' not found from directory /usr/lib/dovecot/modules I have searched high and low via Google, StackOverflow and even ChatGPT (haha) but I cannot seem to find the package that provides the plugin. Does Dovecot have to be built from source for this plugin to be included? Current Configuration from doveconf -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 6.5.0-1020-aws x86_64 Ubuntu 22.04.4 LTS nfs4 # Hostname: ec2-us-east-1a-arda-mail-001.ardaemail.com auth_mechanisms = plain login auth_worker_max_count = 5 base_dir = /var/run/dovecot debug_log_path = /var/log/dovecot/debug.log default_internal_group = ardaemail default_internal_user = ardaemail dict { quota = mysql:/etc/dovecot/inc.d/inc.quota.user.sql.conf sql = mysql:/etc/dovecot/inc.d/inc.lastlogin.sql.conf } hostname = = mail.ardaemail.com info_log_path = /var/log/dovecot/info.log instance_name = ec2-us-east-1a-arda-mail-001.ardaemail.com listen = 172.16.0.200 log_path = /var/log/dovecot/general.log login_greeting = Welcome to ArdaEmail mail_gid = ardaemail mail_location = maildir:/mnt/mail/%d/%n mail_max_userip_connections = 1000 mail_plugins = " quota mailbox_alias last_login" mail_server_admin = mailto:support@ardaemail.com mail_uid = ardaemail maildir_stat_dirs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 90 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = } passdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } plugin { imapsieve_mailbox1_before = file:/etc/dovecot/sieve.d/spam/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve.d/spam/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * last_login_dict = proxy::sql last_login_key = # hidden, use -P to show it last_login_precision = ms mailbox_alias_new = Junk Email mailbox_alias_new2 = Junk E-mail mailbox_alias_new3 = Sent Messages mailbox_alias_new4 = Sent Items mailbox_alias_new5 = Deleted Items mailbox_alias_new6 = Junk Mail mailbox_alias_old = Junk mailbox_alias_old2 = Junk mailbox_alias_old3 = Sent mailbox_alias_old4 = Sent mailbox_alias_old5 = Trash mailbox_alias_old6 = Junk quota = dict:User Quota::proxy::quota quota_exceeded_message = Mailbox is full and cannot receive any more emails quota_status_nouser = DUNNO quota_status_success = DUNNO quota_warning = bytes=95%% quota-warning 95 %u quota_warning2 = bytes=85%% quota-warning 85 %u quota_warning3 = bytes=75%% quota-warning 75 %u recipient_delimiter = + sieve_after = /etc/dovecot/sieve.d/after/ sieve_before = /etc/dovecot/sieve.d/before/ sieve_extensions = +spamtest +spamtestplus +virustest +notify +imapflags sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_quota_max_storage = 0 sieve_spamtest_max_header = X-Spamd-Result: -?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]) sieve_spamtest_status_header = X-Spamd-Result: (-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]] sieve_spamtest_status_type = score } postmaster_address = postmaster(a)ardaemail.com protocols = imap lmtp service auth-worker { group = ardaemail user = ardaemail } service auth { group = ardaemail unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = ardaemail mode = 0666 user = ardaemail } user = ardaemail } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 8 service_count = 0 } service imap { vsz_limit = 4 G } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } service quota-status { executable = /usr/lib/dovecot/quota-status -p postfix unix_listener /var/spool/postfix/private/quota-status { user = postfix } } service quota-warning { executable = script /etc/dovecot/bin/quota-warning.sh unix_listener quota-warning { group = ardaemail mode = 0666 user = ardaemail } } service submission-login { inet_listener submission { port = 0 } } ssl = required ssl_cert = </etc/letsencrypt/live/mail.ardaemail.com/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } protocol imap { mail_plugins = " quota mailbox_alias last_login imap_sieve imap_quota last_login" } protocol lmtp { mail_plugins = " quota mailbox_alias last_login sieve" } Any help is appreciated. Thank you!

3 3

"panic ... assertion failed" with virtual and flatcurve fts together
by James Cook 17 Jul '24

17 Jul '24

Hi, I'm getting the following error: $ doveadm fetch 'mailbox storageid' guid '1721115116.M995635P1988.exoco.falsifian.org,S=28763,W=29300' Error: net_connect_unix(/var/dovecot/stats-writer) failed: Permission denied doveadm(falsifian): Panic: file index-search-result.c: line 174 (index_search_result_update_appends): assertion failed: (result->search_args->args == &search_arg) When I remove "virtual" from my "plugins" configuration line and remove the virtual namespace, the search works: $ doveadm fetch 'mailbox storageid' guid '1721115116.M995635P1988.exoco.falsifian.org,S=28763,W=29300' Error: net_connect_unix(/var/dovecot/stats-writer) failed: Permission denied mailbox: Spam storageid: 1721115116.M995635P1988.exoco.falsifian.org,S=28763,W=29300 It also works if I remove fts and fts_flatcurve from my "plugins" configuration line, leaving "virtual" alone. I first saw this when I enabled fts (with fts_flatcurve): I saw a lot of such errors in the logs when I attempted full text searches via neomutt. The errors seemed to stop happening after the indexing jobs finally finished, but just today I saw it again with the above query unrelated to fts. I have been using virtual mailboxes for a long time and hadn't noticed the error before trying fts. $ dovecot --version 2.3.21 (47349e2482) Output of doveconf -n (full config that triggers the error) follows signature. I saw something similar was reported in January [0] (that gave me the idea to try turning off virtual). Please let me know what I can do to help debug. It's just my personal mail server so I might be able to do things like run a debug build if necessary (assuming I find the time). [0] https://dovecot.org/mailman3/archives/list/dovecot@dovecot.org/thread/Z2HTM… -- James # 2.3.21 (47349e2482): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.21 (f6cd4b8e) # OS: OpenBSD 7.5 amd64 ffs # Hostname: exoco.falsifian.org first_valid_uid = 1000 mail_location = maildir:/home/%u/Maildir mail_plugins = " fts fts_flatcurve virtual" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } namespace virtual { location = virtual:/mail/%u/virtual prefix = virtual/ separator = / } passdb { args = /etc/dovecot/passdb driver = passwd-file } plugin { fts = flatcurve fts_filters = lowercase fts_flatcurve_substring_search = yes fts_languages = en fts_tokenizers = generic email-address } protocols = imap ssl_cert = </etc/ssl/falsifian.org.fullchain.pem ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/userdb driver = passwd-file } protocol lda { mail_plugins = " fts fts_flatcurve virtual sieve sieve" }

1 0

Debian Bookworm packages, please !
by Laura Smith 17 Jul '24

17 Jul '24

Debian Bookworm (12) was released June 2023. It is therefore somewhat disappointing to see no Bookworm packages in https://repo.dovecot.org/ce-2.3-latest/debian/

16 37

dictionary with %d variable in sql stops insert and select domain part - dovecot 2.3.17+
by Mariusz Piasecki 16 Jul '24

16 Jul '24

Hi, I notice that quota domain when using args %d in dictionary isn't honored in mysql during updates and selects when using dovecot 2.3.17+, so I moved my tests to docker environment, because I started using alpine linux and thought it could be musl library problem. I tested few versions with debian/alpine and after 2.3.17 updates and selects for domain in sql not using domain part, but user@domain. Maybe I missed some changes in configuration, maybe someone experience this behavior? User in logs was changed to h.user(a)example.com. Configuration as described in documentation quota = dict:<quota root name>:<username>[:<option>[...]]:<dictionary URI> where username could be %d for supporting domain-wide quotas quota = dict:user_quota::proxy::sqluserquota quota2 = dict:domain_quota:%d:proxy::sqldomainquota dict { acl = mysql:/etc/dovecot/dovecot-share-folder.conf sqldomainquota = mysql:/etc/dovecot/dovecot-dict-sql-domain.conf sqluserquota = mysql:/etc/dovecot/dovecot-dict-sql-user.conf } dovecot-dict-sql-domain.conf map { pattern= priv/quota/storage table= used_domain_quota username_field= domain value_field= bytes } map { pattern= priv/quota/messages table= used_domain_quota username_field= domain value_field= messages } dovecot-dict-sql-user.conf map { pattern= priv/quota/storage table= used_quota username_field= username value_field= bytes } map { pattern= priv/quota/messages table= used_quota username_field= username value_field= messages } Example dump sql table, in real environment with newer dovecot, there was only h.user(a)example.com and no domain record. *In earlier versions of dovecot there was only domain in this table.* |//**domain**//|varchar(255)|Nie| |bytes|bigint(20)|Nie|0 |messages|bigint(20)|Nie|0 == Dumping data for table used_domain_quota |h.user(a)example.com|36000|36000 |example.com|35000|35000 Debug Doveadm *In both examples below debug args=example.com seems correct * Dovecot version 2.3.17+, in this example debian 10 2.3.17 (e2aa53df5b), select with only username. root@cf801690360c:/# doveadm -D -v quota get -u h.user(a)example.com Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Nov 27 15:46:31 Debug: Loading modules from directory: /usr/lib/dovecot/modules Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mailbox_alias_plugin.so Nov 27 15:46:31 Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so Nov 27 15:46:31 Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Nov 27 15:46:31 Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Nov 27 15:46:31 Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: userdb lookup(h.user(a)example.com): Started userdb lookup Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: conn unix:/var/run/dovecot/director-userdb: Connecting Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: conn unix:/var/run/dovecot/director-userdb (pid=1,uid=0): Client connected (fd=9) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: userdb lookup(h.user(a)example.com): auth USER input: h.user(a)example.com home=/home/mail/virtual/data05/example.com/h.user@example.com quota2_rule=*:bytes=10485760000 quota_rule=*:bytes=1048576000 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: userdb lookup(h.user(a)example.com): Finished userdb lookup (username=h.user(a)example.com home=/home/mail/virtual/data05/example.com/h.user@example.com quota2_rule=*:bytes=10485760000 quota_rule=*:bytes=1048576000) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: Added userdb setting: plugin/quota2_rule=*:bytes=10485760000 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=1048576000 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Effective uid=101, gid=101, home=/home/mail/virtual/data05/example.com/h.user@example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Home dir not found: /home/mail/virtual/data05/example.com/h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: dict(proxy): dict created (uri=proxy::acl, base_dir=/var/run/dovecot) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota root: name=User Quota backend=dict args=:proxy::sqluserquota Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota rule: root=User Quota mailbox=* bytes=1048576000 messages=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=1048576000 (100%) messages=0 reverse=no command=quota-warning 100 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=996147200 (95%) messages=0 reverse=no command=quota-warning 95 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=943718400 (90%) messages=0 reverse=no command=quota-warning 90 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=891289600 (85%) messages=0 reverse=no command=quota-warning 85 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota grace: root=User Quota bytes=104857600 (10%) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota root: name=Domain Quota backend=dict args=example.com:proxy::sqldomainquota Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota rule: root=Domain Quota mailbox=* bytes=10485760000 messages=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota grace: root=Domain Quota bytes=1048576000 (10%) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota-dict: user=h.user(a)example.com, uri=proxy::sqluserquota, noenforcing=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: dict(proxy): dict created (uri=proxy::sqluserquota, base_dir=/var/run/dovecot) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota-dict: user=example.com, uri=proxy::sqldomainquota, noenforcing=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: dict(proxy): dict created (uri=proxy::sqldomainquota, base_dir=/var/run/dovecot) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir://home/mail/virtual/data05/example.com/h.user@example.com/… Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: maildir++: root=//home/mail/virtual/data05/example.com/h.user@example.com/Maildir, index=, indexpvt=, control=, inbox=//home/mail/virtual/data05/example.com/h.user@example.com/Maildir, alt= Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: initializing backend with data: vfile Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: acl username= h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: owner= 1 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl vfile: Global ACLs disabled Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:%Lh/Maildir/:INDEX=%Lh/Maildir/Shared/%u Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: initializing backend with data: vfile Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: acl username= h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: owner= 0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl vfile: Global ACLs disabled Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota: quota_over_flag check: quota_over_script unset - skipping Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota: quota_over_flag check: quota2_over_script unset - skipping Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/var/run/dovecot/dict: Connecting Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/var/run/dovecot/dict (pid=1,uid=0): Client connected (fd=10) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/var/run/dovecot/dict: Connecting Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/var/run/dovecot/dict (pid=1,uid=0): Client connected (fd=12) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): dict destroyed Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Waiting for dict to finish pending operations Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/var/run/dovecot/dict (pid=1,uid=0): Disconnected: Connection closed (fd=10) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): dict destroyed Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Waiting for dict to finish pending operations Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/var/run/dovecot/dict (pid=1,uid=0): Disconnected: Connection closed (fd=12) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): dict destroyed Quota name Type Value Limit % User Quota STORAGE 25 1024000 0 User Quota MESSAGE 25000 - 0 Domain Quota STORAGE 36 10240000 0 Domain Quota MESSAGE 36000 - 0 Nov 27 15:46:31 doveadm(401): Debug: auth-master: conn unix:/var/run/dovecot/director-userdb (pid=1,uid=0): Disconnected: Connection closed (fd=9) Dovecot version 2.3.16, 2.3.15, 2.3.13. in this example 2.3.13 (89f716dc2) bullseye - *correct behavior, select* Debug: Loading modules from directory: /usr/lib/dovecot/modules Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mailbox_alias_plugin.so Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(h.gorska(a)example.com)<93><>: Debug: auth-master: userdb lookup(h.user(a)example.com): Started userdb lookup doveadm(h.user(a)example.com)<93><>: Debug: auth-master: conn unix:/run/dovecot/director-userdb: Connecting doveadm(h.user(a)example.com)<93><>: Debug: auth-master: conn unix:/run/dovecot/director-userdb (pid=1,uid=0): Client connected (fd=9) doveadm(h.user(a)example.com)<93><>: Debug: auth-master: userdb lookup(h.user(a)example.com): auth USER input: h.user(a)example.com home=/home/mail/virtual/data05/example.com/h.user@example.com quota2_rule=*:bytes=10485760000 quota_rule=*:bytes=1048576000 doveadm(h.user(a)example.com)<93><>: Debug: auth-master: userdb lookup(h.user(a)example.com): Finished userdb lookup (username=h.user(a)example.com home=/home/mail/virtual/data05/example.com/h.user@example.com quota2_rule=*:bytes=10485760000 quota_rule=*:bytes=1048576000) doveadm(h.user(a)example.com)<93><>: Debug: Added userdb setting: plugin/quota2_rule=*:bytes=10485760000 doveadm(h.user(a)example.com)<93><>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=1048576000 doveadm(h.user(a)example.com): Debug: Effective uid=101, gid=102, home=/home/mail/virtual/data05/example.com/h.user@example.com doveadm(h.user(a)example.com): Debug: Home dir not found: /home/mail/virtual/data05/example.com/h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota root: name=User Quota backend=dict args=:proxy::sqluserquota doveadm(h.user(a)example.com): Debug: Quota rule: root=User Quota mailbox=* bytes=1048576000 messages=0 doveadm(h.user(a)example.com): Debug: Quota warning: bytes=1048576000 (100%) messages=0 reverse=no command=quota-warning 100 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota warning: bytes=996147200 (95%) messages=0 reverse=no command=quota-warning 95 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota warning: bytes=943718400 (90%) messages=0 reverse=no command=quota-warning 90 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota warning: bytes=891289600 (85%) messages=0 reverse=no command=quota-warning 85 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota grace: root=User Quota bytes=104857600 (10%) doveadm(h.user(a)example.com): Debug: Quota root: name=Domain Quota backend=dict args=example.com:proxy::sqldomainquota doveadm(h.user(a)example.com): Debug: Quota rule: root=Domain Quota mailbox=* bytes=10485760000 messages=0 doveadm(h.user(a)example.com): Debug: Quota grace: root=Domain Quota bytes=1048576000 (10%) doveadm(h.user(a)example.com): Debug: quota-dict: user=h.user(a)example.com, uri=proxy::sqluserquota, noenforcing=0 doveadm(h.user(a)example.com): Debug: quota-dict: user=example.com, uri=proxy::sqldomainquota, noenforcing=0 doveadm(h.user(a)example.com): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir://home/mail/virtual/data05/example.com/h.user@example.com/… doveadm(h.user(a)example.com): Debug: maildir++: root=//home/mail/virtual/data05/example.com/h.user@example.com/Maildir, index=, indexpvt=, control=, inbox=//home/mail/virtual/data05/example.com/h.user@example.com/Maildir, alt= doveadm(h.user(a)example.com): Debug: acl: initiali|//**domain**//|varchar(255)|Nie| |bytes|bigint(20)|Nie|0 |messages|bigint(20)|Nie|0 == Dumping data for table used_domain_quota |h.user(a)example.com|36000|36000 |example.com|35000|35000zing backend with data: vfile doveadm(h.user(a)example.com): Debug: acl: acl username= h.user(a)example.com doveadm(h.user(a)example.com): Debug: acl: owner= 1 doveadm(h.user(a)example.com): Debug: acl vfile: Global ACLs disabled doveadm(h.user(a)example.com): Debug: Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:%Lh/Maildir/:INDEX=%Lh/Maildir/Shared/%u doveadm(h.user(a)example.com): Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= doveadm(h.user(a)example.com): Debug: acl: initializing backend with data: vfile doveadm(h.user(a)example.com): Debug: acl: acl username= h.user(a)example.com doveadm(h.user(a)example.com): Debug: acl: owner= 0 doveadm(h.user(a)example.com): Debug: acl vfile: Global ACLs disabled doveadm(h.user(a)example.com): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(h.user(a)example.com): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping Quota name Type Value Limit % User Quota STORAGE 25 1024000 0 User Quota MESSAGE 25000 - 0 Domain Quota STORAGE 35 10240000 0 Domain Quota MESSAGE 35000 - 0 doveadm(h.user(a)example.com): Debug: auth-master: conn unix:/run/dovecot/director-userdb (pid=1,uid=0): Disconnected: Connection closed (fd=9) MYSQL catch logs Mysql catch log during doveadm quota get -u h.user(a)example.com, version 2.3.17+ 592 Query SELECT username AS user, CONCAT('/home/mail/virtual/',mailbox.storagenode,mailbox.maildir,username) AS home, CONCAT('*:bytes=', domain.maxquota*1048576) AS quota2_rule, CONCAT('*:bytes=', mailbox.quota*1048576) AS quota_rule FROM mailbox,domain WHERE username = 'h.user(a)example.com'AND mailbox.domain=domain.domain AND domain.active=1 AND mailbox.`enabledoveadm`=1 AND mailbox.active=1 593 Connect root(a)10.15.1.40 on postfix using TCP/IP 593 Query SELECT bytes FROM used_quota WHERE username = 'h.user(a)example.com' 593 Query SELECT messages FROM used_quota WHERE username = 'h.user(a)example.com' 594 Connect root(a)10.15.1.40 on postfix using TCP/IP 594 Query SELECT bytes FROM used_domain_quota WHERE domain = 'h.user(a)example.com' 594 Query SELECT messages FROM used_domain_quota WHERE domain = 'h.user(a)example.com' example SQL UPDATE, dovecot version 2.3.20 (80a5ac675d) alpine 3.18.4 - bad behavior # User@Host: user[user @ [192.168.254.176] # Thread_id: 58405753 Schema: postfix QC_hit: No # Query_time: 0.000294 Lock_time: 0.000104 Rows_sent: 0 Rows_examined: 1 # Rows_affected: 1 Bytes_sent: 52 # # explain: id select_type table type possible_keys key key_len ref rows r_rows filtered r_filtered Extra # explain: 1 SIMPLE used_domain_quota range PRIMARY PRIMARY 767 NULL 1 1.00 100.00 100.00 Using where # SET timestamp=1701103297; UPDATE used_domain_quota SET bytes=bytes+4359,messages=messages+1 WHERE domain = 'h.user(a)example.com'; example SQL UPDATE domain and user quota - *good behavior*, dovecot version 2.3.4.1 (f79e8e7e4), debian 10 # User@Host: postfix[postfix] @ [192.168.254.175] # Thread_id: 58406279 Schema: postfix QC_hit: No # Query_time: 0.000252 Lock_time: 0.000080 Rows_sent: 0 Rows_examined: 1 # Rows_affected: 1 Bytes_sent: 52 # # explain: id select_type table type possible_keys key key_len ref rows r_rows filtered r_filtered Extra # explain: 1 SIMPLE used_domain_quota range PRIMARY PRIMARY 767 NULL 1 1.00 100.00 100.00 Using where # SET timestamp=1701103048; UPDATE used_domain_quota SET bytes=bytes+11597,messages=messages+1 WHERE domain = 'example.com'; # User@Host: user[user] @ [192.168.254.175] # Thread_id: 58406274 Schema: postfix QC_hit: No # Query_time: 0.000247 Lock_time: 0.000076 Rows_sent: 0 Rows_examined: 1 # Rows_affected: 1 Bytes_sent: 52 # # explain: id select_type table type possible_keys key key_len ref rows r_rows filtered r_filtered Extra # explain: 1 SIMPLE used_quota range PRIMARY PRIMARY 767 NULL 1 1.00 100.00 100.00 Using where # SET timestamp=1701103048; UPDATE used_quota SET bytes=bytes+11597,messages=messages+1 WHERE username = 'h.user(a)example.com'; Hi, I notice that quota domain when using args %d in dictionary isn't honored in mysql during updates and selects when using dovecot 2.3.17+, so I moved my tests to docker environment, because I started using alpine linux and thought it could be musl library problem. I tested few versions with debian/alpine and after 2.3.17 updates and selects for domain in sql not using domain part, but user@domain. Maybe I missed some changes in configuration, maybe someone experience this behavior? User in logs was changed to h.user(a)example.com. ***** Configuration ***** as described in documentation quota = dict:<quota root name>:<username>[: <option>[...]]:<dictionary URI> where username could be %d for supporting domain-wide quotas quota = dict:user_quota::proxy::sqluserquota quota2 = dict:domain_quota:%d:proxy::sqldomainquota dict { acl = mysql:/etc/dovecot/dovecot-share-folder.conf sqldomainquota = mysql:/etc/dovecot/dovecot-dict-sql-domain.conf sqluserquota = mysql:/etc/dovecot/dovecot-dict-sql-user.conf } dovecot-dict-sql-domain.conf map { pattern = priv/quota/storage table = used_domain_quota username_field = domain value_field = bytes } map { pattern = priv/quota/messages table = used_domain_quota username_field = domain value_field = messages } dovecot-dict-sql-user.conf map { pattern = priv/quota/storage table = used_quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = used_quota username_field = username value_field = messages } Example dump sql table, in real environment with newer dovecot, there was only h.user(a)example.com and no domain record. In earlier versions of dovecot there was only domain in this table. |//**domain**//|varchar(255)|Nie| |bytes|bigint(20)|Nie|0 |messages|bigint(20)|Nie|0 == Dumping data for table used_domain_quota |h.user(a)example.com|36000|36000 |example.com|35000|35000 ***** Debug ***** **** Doveadm **** In both examples below debug args=example.com seems correct Dovecot version 2.3.17+, in this example debian 10 2.3.17 (e2aa53df5b), select with only username. root@cf801690360c:/# doveadm -D -v quota get -u h.user(a)example.com Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/ dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/ dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: / usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/ dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: / usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Nov 27 15:46:31 Debug: Loading modules from directory: /usr/lib/dovecot/modules Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/ lib01_acl_plugin.so Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/ lib10_quota_plugin.so Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/ lib20_mailbox_alias_plugin.so Nov 27 15:46:31 Debug: Loading modules from directory: /usr/lib/dovecot/ modules/doveadm Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_acl_plugin.so Nov 27 15:46:31 Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_quota_plugin.so Nov 27 15:46:31 Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/ lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Nov 27 15:46:31 Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Nov 27 15:46:31 Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/ libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: userdb lookup(h.user(a)example.com): Started userdb lookup Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: conn unix:/var/run/dovecot/director-userdb: Connecting Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: conn unix:/var/run/dovecot/director-userdb (pid=1,uid=0): Client connected (fd=9) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: userdb lookup(h.user(a)example.com): auth USER input: h.user(a)example.com home=/home/ mail/virtual/data05/example.com/h.user@example.com quota2_rule=*: bytes=10485760000 quota_rule=*:bytes=1048576000 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: auth-master: userdb lookup(h.user(a)example.com): Finished userdb lookup (username=h.user(a)example.com home=/home/mail/virtual/data05/example.com/h.user@example.com quota2_rule=*: bytes=10485760000 quota_rule=*:bytes=1048576000) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: Added userdb setting: plugin/quota2_rule=*:bytes=10485760000 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=1048576000 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Effective uid=101, gid=101, home=/home/mail/virtual/data05/example.com/ h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Home dir not found: /home/mail/virtual/data05/example.com/ h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: dict(proxy): dict created (uri=proxy::acl, base_dir=/var/run/dovecot) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota root: name=User Quota backend=dict args=:proxy::sqluserquota Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota rule: root=User Quota mailbox=* bytes=1048576000 messages=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=1048576000 (100%) messages=0 reverse=no command=quota-warning 100 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=996147200 (95%) messages=0 reverse=no command=quota-warning 95 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=943718400 (90%) messages=0 reverse=no command=quota-warning 90 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota warning: bytes=891289600 (85%) messages=0 reverse=no command=quota-warning 85 h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota grace: root=User Quota bytes=104857600 (10%) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota root: name=Domain Quota backend=dict args=example.com:proxy:: sqldomainquota Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota rule: root=Domain Quota mailbox=* bytes=10485760000 messages=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Quota grace: root=Domain Quota bytes=1048576000 (10%) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota-dict: user=h.user(a)example.com, uri=proxy::sqluserquota, noenforcing=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: dict(proxy): dict created (uri=proxy::sqluserquota, base_dir=/var/run/ dovecot) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota-dict: user=example.com, uri=proxy::sqldomainquota, noenforcing=0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: dict(proxy): dict created (uri=proxy::sqldomainquota, base_dir=/var/run/ dovecot) Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir://home/mail/virtual/data05/ example.com/h.user@example.com/Maildir/:INDEX=//home/mail/virtual/data05/ example.com/h.user@example.com/Maildir/ Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: maildir++: root=//home/mail/virtual/data05/example.com/ h.user(a)example.com/Maildir, index=, indexpvt=, control=, inbox=//home/mail/ virtual/data05/example.com/h.user@example.com/Maildir, alt= Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: initializing backend with data: vfile Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: acl username = h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: owner = 1 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl vfile: Global ACLs disabled Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:%Lh/Maildir/:INDEX=%Lh/ Maildir/Shared/%u Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: initializing backend with data: vfile Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: acl username = h.user(a)example.com Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl: owner = 0 Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: acl vfile: Global ACLs disabled Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota: quota_over_flag check: quota_over_script unset - skipping Nov 27 15:46:31 doveadm(h.user(a)example.com)<401><4l0XONe5ZGWRAQAAQCEzFg>: Debug: quota: quota_over_flag check: quota2_over_script unset - skipping Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/ var/run/dovecot/dict: Connecting Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/ var/run/dovecot/dict (pid=1,uid=0): Client connected (fd=10) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/storage' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/ var/run/dovecot/dict: Connecting Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/ var/run/dovecot/dict (pid=1,uid=0): Client connected (fd=12) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/storage': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Looking up (async) 'priv/quota/messages' Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Lookup finished for 'priv/quota/messages': found Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): dict destroyed Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Waiting for dict to finish pending operations Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/ var/run/dovecot/dict (pid=1,uid=0): Disconnected: Connection closed (fd=10) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): dict destroyed Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): Waiting for dict to finish pending operations Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): conn unix:/ var/run/dovecot/dict (pid=1,uid=0): Disconnected: Connection closed (fd=12) Nov 27 15:46:31 doveadm(h.user(a)example.com): Debug: dict(proxy): dict destroyed Quota name Type Value Limit % User Quota STORAGE 25 1024000 0 User Quota MESSAGE 25000 - 0 Domain Quota STORAGE 36 10240000 0 Domain Quota MESSAGE 36000 - 0 Nov 27 15:46:31 doveadm(401): Debug: auth-master: conn unix:/var/run/dovecot/ director-userdb (pid=1,uid=0): Disconnected: Connection closed (fd=9) Dovecot version 2.3.16, 2.3.15, 2.3.13. in this example 2.3.13 (89f716dc2) bullseye - correct behavior, select Debug: Loading modules from directory: /usr/lib/dovecot/modules Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mailbox_alias_plugin.so Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/ lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/ lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: / usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/ dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: / usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(h.gorska(a)example.com)<93><>: Debug: auth-master: userdb lookup (h.user(a)example.com) Started userdb lookup doveadm(h.user(a)example.com)<93><>: Debug: auth-master: conn unix:/run/dovecot/ director-userdb: Connecting doveadm(h.user(a)example.com)<93><>: Debug: auth-master: conn unix:/run/dovecot/ director-userdb (pid=1,uid=0): Client connected (fd=9) doveadm(h.user(a)example.com)<93><>: Debug: auth-master: userdb lookup (h.user(a)example.com) auth USER input: h.user(a)example.com home=/home/mail/ virtual/data05/example.com/h.user@example.com quota2_rule=*:bytes=10485760000 quota_rule=*:bytes=1048576000 doveadm(h.user(a)example.com)<93><>: Debug: auth-master: userdb lookup (h.user(a)example.com) Finished userdb lookup (username=h.user(a)example.com home=/home/mail/virtual/data05/example.com/h.user@example.com quota2_rule=*: bytes=10485760000 quota_rule=*:bytes=1048576000) doveadm(h.user(a)example.com)<93><>: Debug: Added userdb setting: plugin/ quota2_rule=*:bytes=10485760000 doveadm(h.user(a)example.com)<93><>: Debug: Added userdb setting: plugin/ quota_rule=*:bytes=1048576000 doveadm(h.user(a)example.com): Debug: Effective uid=101, gid=102, home=/home/ mail/virtual/data05/example.com/h.user@example.com doveadm(h.user(a)example.com): Debug: Home dir not found: /home/mail/virtual/ data05/example.com/h.user@example.com doveadm(h.user(a)example.com): Debug: Quota root: name=User Quota backend=dict args=:proxy::sqluserquota doveadm(h.user(a)example.com): Debug: Quota rule: root=User Quota mailbox=* bytes=1048576000 messages=0 doveadm(h.user(a)example.com): Debug: Quota warning: bytes=1048576000 (100%) messages=0 reverse=no command=quota-warning 100 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota warning: bytes=996147200 (95%) messages=0 reverse=no command=quota-warning 95 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota warning: bytes=943718400 (90%) messages=0 reverse=no command=quota-warning 90 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota warning: bytes=891289600 (85%) messages=0 reverse=no command=quota-warning 85 h.user(a)example.com doveadm(h.user(a)example.com): Debug: Quota grace: root=User Quota bytes=104857600 (10%) doveadm(h.user(a)example.com): Debug: Quota root: name=Domain Quota backend=dict args=example.com:proxy::sqldomainquota doveadm(h.user(a)example.com): Debug: Quota rule: root=Domain Quota mailbox=* bytes=10485760000 messages=0 doveadm(h.user(a)example.com): Debug: Quota grace: root=Domain Quota bytes=1048576000 (10%) doveadm(h.user(a)example.com): Debug: quota-dict: user=h.user(a)example.com, uri=proxy::sqluserquota, noenforcing=0 doveadm(h.user(a)example.com): Debug: quota-dict: user=example.com, uri=proxy:: sqldomainquota, noenforcing=0 doveadm(h.user(a)example.com): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir://home/mail/ virtual/data05/example.com/h.user@example.com/Maildir/:INDEX=//home/mail/ virtual/data05/example.com/h.user@example.com/Maildir/ doveadm(h.user(a)example.com): Debug: maildir++: root=//home/mail/virtual/data05/ example.com/h.user@example.com/Maildir, index=, indexpvt=, control=, inbox=// home/mail/virtual/data05/example.com/h.user@example.com/Maildir, alt= doveadm(h.user(a)example.com): Debug: acl: initiali|//**domain**//|varchar (255)|Nie| |bytes|bigint(20)|Nie|0 |messages|bigint(20)|Nie|0 == Dumping data for table used_domain_quota |h.user(a)example.com|36000|36000 |example.com|35000|35000zing backend with data: vfile doveadm(h.user(a)example.com): Debug: acl: acl username = h.user(a)example.com doveadm(h.user(a)example.com): Debug: acl: owner = 1 doveadm(h.user(a)example.com): Debug: acl vfile: Global ACLs disabled doveadm(h.user(a)example.com): Debug: Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir: %Lh/Maildir/:INDEX=%Lh/Maildir/Shared/%u doveadm(h.user(a)example.com): Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= doveadm(h.user(a)example.com): Debug: acl: initializing backend with data: vfile doveadm(h.user(a)example.com): Debug: acl: acl username = h.user(a)example.com doveadm(h.user(a)example.com): Debug: acl: owner = 0 doveadm(h.user(a)example.com): Debug: acl vfile: Global ACLs disabled doveadm(h.user(a)example.com): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(h.user(a)example.com): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping Quota name Type Value Limit % User Quota STORAGE 25 1024000 0 User Quota MESSAGE 25000 - 0 Domain Quota STORAGE 35 10240000 0 Domain Quota MESSAGE 35000 - 0 doveadm(h.user(a)example.com): Debug: auth-master: conn unix:/run/dovecot/ director-userdb (pid=1,uid=0): Disconnected: Connection closed (fd=9) **** MYSQL catch logs **** Mysql catch log during doveadm quota get -u h.user(a)example.com, version 2.3.17+ 592 Query SELECT username AS user, CONCAT('/home/mail/virtual/ ',mailbox.storagenode,mailbox.maildir,username) AS home, CONCAT('*:bytes=', domain.maxquota*1048576) AS quota2_rule, CONCAT('*:bytes=', mailbox.quota*1048576) AS quota_rule FROM mailbox,domain WHERE username = 'h.user(a)example.com' AND mailbox.domain=domain.domain AND domain.active=1 AND mailbox.`enabledoveadm`=1 AND mailbox.active=1 593 Connect root(a)10.15.1.40 on postfix using TCP/IP 593 Query SELECT bytes FROM used_quota WHERE username = 'h.user(a)example.com' 593 Query SELECT messages FROM used_quota WHERE username = 'h.user(a)example.com' 594 Connect root(a)10.15.1.40 on postfix using TCP/IP 594 Query SELECT bytes FROM used_domain_quota WHERE domain = 'h.user(a)example.com' 594 Query SELECT messages FROM used_domain_quota WHERE domain = 'h.user(a)example.com' example SQL UPDATE, dovecot version 2.3.20 (80a5ac675d) alpine 3.18.4 - bad behavior # User@Host: user[user @ [192.168.254.176] # Thread_id: 58405753 Schema: postfix QC_hit: No # Query_time: 0.000294 Lock_time: 0.000104 Rows_sent: 0 Rows_examined: 1 # Rows_affected: 1 Bytes_sent: 52 # # explain: id select_type table type possible_keys key key_len ref rows r_rows filtered r_filtered Extra # explain: 1 SIMPLE used_domain_quota range PRIMARY PRIMARY 767 NULL 1 1.00 100.00 100.00 Using where # SET timestamp=1701103297; UPDATE used_domain_quota SET bytes=bytes+4359,messages=messages+1 WHERE domain = 'h.user(a)example.com'; example SQL UPDATE domain and user quota - good behavior, dovecot version 2.3.4.1 (f79e8e7e4), debian 10 # User@Host: postfix[postfix] @ [192.168.254.175] # Thread_id: 58406279 Schema: postfix QC_hit: No # Query_time: 0.000252 Lock_time: 0.000080 Rows_sent: 0 Rows_examined: 1 # Rows_affected: 1 Bytes_sent: 52 # # explain: id select_type table type possible_keys key key_len ref rows r_rows filtered r_filtered Extra # explain: 1 SIMPLE used_domain_quota range PRIMARY PRIMARY 767 NULL 1 1.00 100.00 100.00 Using where # SET timestamp=1701103048; UPDATE used_domain_quota SET bytes=bytes+11597,messages=messages+1 WHERE domain = 'example.com'; # User@Host: user[user] @ [192.168.254.175] # Thread_id: 58406274 Schema: postfix QC_hit: No # Query_time: 0.000247 Lock_time: 0.000076 Rows_sent: 0 Rows_examined: 1 # Rows_affected: 1 Bytes_sent: 52 # # explain: id select_type table type possible_keys key key_len ref rows r_rows filtered r_filtered Extra # explain: 1 SIMPLE used_quota range PRIMARY PRIMARY 767 NULL 1 1.00 100.00 100.00 Using where # SET timestamp=1701103048; UPDATE used_quota SET bytes=bytes+11597,messages=messages+1 WHERE username = 'h.user(a)example.com';

3 3

doveadm auth lookup fails for system user
by Christian H. Kuhn 15 Jul '24

15 Jul '24

Hi all, next step with my auth problem with dovecot. I want to authenticate a system user. The user exists, can log in, can sudo -i etc.pp. SASL with sql passdb and userdb works fine. root@bywater /etc/dovecot/conf.d # doveadm user qno field value uid 1001 gid 1001 home /home/qno mail maildir:~/Maildir system_groups_user qno But: root@bywater /etc/dovecot/conf.d # doveadm auth lookup qno passdb lookup: user qno doesn't exist And no surprise: root@bywater /etc/dovecot/conf.d # doveadm auth test qno Password: passdb: qno auth failed extra fields: user=qno root@bywater /etc/dovecot/conf.d # doveconf -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 5.15.0-113-generic x86_64 Ubuntu 22.04.4 LTS # Hostname: bywater.qno.de auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain listen = 65.21.136.15, [::] mail_location = maildir:~/Maildir mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/tables.d/dovecot-sql.conf.ext driver = sql } passdb { args = blocking=no driver = passwd } passdb { driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } postmaster_address = postmaster(a)qno.de protocols = " imap sieve" service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener lmtp { group = postfix mode = 0600 user = postfix } } ssl = required ssl_cert = </etc/letsencrypt/live/imap2.qno.de/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-CHACHA20-POLY1305 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it syslog_facility = local0 userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%u driver = static } userdb { driver = passwd } verbose_proctitle = yes How can it be that a user is found by userdb passwd, but not by passdb passwd or PAM? TIA QNo

3 3

Failed to connect to dns-client: Resource temporarily unavailable
by m＠maltris.org 15 Jul '24

15 Jul '24

When using DNS names for backends in a proxied setup, the async dns_client process after a short time of high load (burst scenario) seems to get overwhelmed: auth: Debug: conn unix:dns-client: dns(backend.local): Lookup failed after 0 msecs: Failed to connect to dns-client: Resource temporarily unavailable auth: Error: DNS lookup for backend.local failed: Failed to connect to dns-client: Resource temporarily unavailable The whole thing itself runs for a few thousand requests until this happens. ulimit nofile is set to 65000. When changing the backend from DNS name to IP, there is no problem. What are the possibilities to use dns names but without these problems? Any way to either increase dns resolving capacity OR cache the results for some time (or forever?)? Best regards

2 1

dovecot replication
by Jeff Pang 13 Jul '24

13 Jul '24

Hello, Does the community version of dovecot have the replication feature? When one dovecot was down, another one could take over the tasks. Thanks. _________________________________________________________________ ________________________________________________________ Your E-Mail. Your Cloud. Your Office. eclipso Mail Europe. https://www.eclipso.de

4 7

dovecot imap_zlib
by Joan Moreau 12 Jul '24

12 Jul '24

Hi I tested teh git version of dovecot. It seems the IMAP Compress plugin (imap_zlib) has disappeared. How to get it back ? Thank you

6 7

New Member Introduction
by Selena Thomas 10 Jul '24

10 Jul '24

Hi everyone, I am new to this forum and excited to be here. I'm interested in learning more about Dovecot and its features, and I'm eager to participate in the discussions here. Could someone please guide me on how to ask questions here ? Where should I post if I have a query ? Looking forward to your advice and connecting with you all. Thanks,

2 1

Re: dovecot imap_zlib
by Michael Slusarz 10 Jul '24

10 Jul '24

> On 07/09/2024 6:42 AM MDT Bjoern Franke via dovecot <dovecot(a)dovecot.org> wrote: > > >> I tested teh git version of dovecot. It seems the IMAP Compress plugin > >> (imap_zlib) has disappeared. > > > > https://github.com/dovecot/core/commit/5f27e25c64555dcaae6cb00c479cd05bc263… > > so the zlib plugin is also deprecated and clients should run compress > themselves? These are two distinct plugins. imap-zlib = compression of the IMAP protocol stream zlib = mailbox storage compression on the Dovecot server For 2.4, "zlib" plugin has been renamed to "mail-compress". https://doc.dovecot.org/2.4/core/plugins/mail_compress.html michael

3 2

Pread error over smb3
by Joan Moreau 06 Jul '24

06 Jul '24

Hi I am trying to move my storage of email on a smb3 mounted volume. I am getting the following error : Error: pread(/net/.../storage/dovecot.map.index.log) failed: Permission denied (euid=1004(mailusers) egid=12(mail) UNIX perms appear ok (ACL/MAC wrong?)) How to resolve that ? Thank you

3 8

[auth] epoll_ctl(add, 13) failed: Operation not permitted (fd doesn't support epoll)
by Alexander Vogt 05 Jul '24

05 Jul '24

Hi all, dovecot auth service is failing when using an inet_service. The configuration is essentially: service auth { inet_listener { address = * port = 12345 } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } When I connect to port 12345 (real IMAP client or telnet doesn't make a difference), the auth service crashes. Nov 19 22:21:54 imap.linexus.de dovecot[7195]: auth: Panic: epoll_ctl(add, 13) failed: Operation not permitted (fd doesn't support epoll) Nov 19 22:21:54 imap.linexus.de dovecot[7195]: auth: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x46) [0x7f9319f89486] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x22) [0x7f9319f895a2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10a41b) [0x7f9319f9841b] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10a4b7) [0x7f9319f984b7] -> /usr/lib64/dovecot/libdovecot.so.0(+0x5d11a) [0x7f9319eeb11a] -> /usr/lib64/dovecot/libdovecot.so.0(+0x609b0) [0x7f9319eee9b0] -> /usr/lib64/dovecot/libdovecot.so.0(+0x1215ba) [0x7f9319faf5ba] -> /usr/lib64/dovecot/libdovecot.so.0(io_add_to+0x1d) [0x7f9319faf62d] -> /usr/lib64/dovecot/libdovecot.so.0(io_add+0x28) [0x7f9319faf668] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_io_listeners_add+0x8a ) [0x7f9319f1d16a] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_init_finish+0xff) [0x7f9319f24bdf] -> dovecot/auth(main+0x389) [0x55745603a4f9] -> /lib64/libc.so.6(+0x3feb0) [0x7f931963feb0] -> /lib64/libc.so.6(__libc_start_main+0x80) [0x7f931963ff60] -> dovecot/auth(_start+0x25) [0x55745603a715] System info (sysreport attached): # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 5.14.0-383.el9.x86_64 x86_64 CentOS Stream release 9 This exact configuration is known to work on this system: # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) I tried for almost two hours to get a core dump for this, but finally gave up. I followed https://www.dovecot.org/bugreport-mail/#coredumps and other sources but the best I could get was Nov 19 22:21:54 imap.linexus.de dovecot[7195]: auth: Fatal: master: service(auth): child 7198 killed with signal 6 (core not dumped - https://dovecot.org/bugreport.html#coredumps - core wasn't writable?) for cat /proc/sys/kernel/core_pattern /tmp/core.%e.%p (which is 1777). Any help to get this resolved would be much appreciated! Thanks and best regards Alex

3 5

dsync will be removed in 2.4 - why?
by Oliver Krone 05 Jul '24

05 Jul '24

Hi there, I recently learned that dsync (mail replication) functionality will be removed in the upcoming releases of dovecot. What is the reason and will there be a replacement? How can I synchronize my e-mails in the future? Thanks a lot. Regards Oliver

3 2

Is it possible to access cert_username and original_username the same time?
by bisteycsaba＠gmail.com 05 Jul '24

05 Jul '24

Hello all, If i use auth_ssl_username_from_cert dovecot gets its username from certificate, but seems like it also becomes %orig_user , if i do not use auth_ssl_username_from_cert cert_username completly unaccessable. Is there a way to access the original user supplied username when auth_ssl_username_from_cert is set or am i missed something and there is a variable for cert_username? What i would like to do is use username from cert to determine which email accounts a user with that cert has access to but for that i would both need access to cert_username and the username given by the user, but when username supplied from cert seems like the username supplied by the user no longer accessable, or i cant figure out how to access it. Thanks: Csaba

1 0

dovecot replication problem
by Oliver Krone 05 Jul '24

05 Jul '24

Hi there, I'm experiencing the following when I replicate mails between two host, using different versions of dovecot: *Host A Host B result* dovecot-2.3-19 --> dovecort-2.3.16 ERROR: auth: Error: All password databases were skipped. doveadm(10.0.0.1,oliver.krone(a)snoog.ch): Error: auth-master: passdb lookup(oliver.krone(a)snoog.ch): Auth PASS lookup failed mail | 2024-07-04T14:21:35.635047+00:00 mail dovecot: doveadm(10.0.0.1,oliver.krone(a)snoog.ch): Error: /run/dovecot/auth-userdb: passdb lookup failed (to see if user is proxied, because doveadm_port is set) dovecot-2.3-21 --> dovecort-2.3.16 no errors, working Basically it does work with 2.3-21 --> 2.3-16 and it does not work with 2.3-19 ---> 2.3-16 without any changes in the configuration files. Any ideas? Thank you very much. Best regards Oliver

2 1

Doveadm on director
by g.carabella＠panservice.it 04 Jul '24

04 Jul '24

https://doc.dovecot.org/admin_manual/doveadm_mailbox_commands/ As indicated in the documentation above, in case of configuration with the director, the doveadm commands must be executed from the director itself. However, if I try to run the command "doveadm -D mailbox list -u user(a)example.com" the command fails because it tries to lookup user locally instead on one of the backend servers. Where am I wrong? My configuration consists of three directors and three backend servers. Thanks a lot.

1 0

Error: fts_solr: received invalid uid
by oliver.krone＠snoog.ch 04 Jul '24

04 Jul '24

I'm using dovecot 2.3.13, solr 8.x. and roundcube 1.5.1. However when I do a search I get the the Error: fts_solr: received invalid uid, search results are ok. Thanks

5 4

One-way synchronization with doveadm/TCP
by Дилян Палаузов 04 Jul '24

04 Jul '24

Hello, the replication procedure described at https://doc.dovecot.org/configuration_manual/replication/ suggests to open a server port 12345 on two systems, and then point each system to the other one. This creates bi-directional synchronization. I want to synchronize only from server A to server B, but not in the opposite direction. Is it sufficient on server A to set service doveadm { inet_listener { port = 12345 } } doveadm_password = secret and server B to set doveadm_port = 12345 doveadm_password = secret ? In other words, when a doveadm client (system B) connects to a server (system A) for replication purposes, does it only read data? Or does it instruct the server also to delete data? To start the replication I had to executed «doveadm replicator replicate '*'». Is in necessary to run this periodically? Thanks for your answer, Дилян

2 1

login_access_sockets
by John Fawcett 03 Jul '24

03 Jul '24

Hi I've used Dovecot for a long time but I never stop learning about the depth of features I've never used.... I just discovered the login_access_sockets setting when reading this page: https://doc.dovecot.org/admin_manual/login_processes/ The compilation using --with-libwrap configure setting was not immediate, since on Fedora which I am using there is no tcp_wrappers-devel package so tcpd.h wasn't installed in /usr/include and the library name libwrap.so that was expected by Dovecot needed a symlink to the library installed by tcp_wrappers package. So differently to what I previously understood, Dovecot does have a way of controlling access at connect time via tcp_wrappers hosts.allow and hosts.deny files. But now I also realize that this discovery will be short lived, since I understand this is going away in 3.0 and also 2.4 though I can't find a page on that: https://doc.dovecotpro.com/3.0/installation/upgrading/2.3.x-3.x.html I can understand the logic about slimming down the code to leave out less used features, but this part of the code looks well written and hasn't required much maintenance over the years. I know there's zero chance of reversing the removal of login_access_sockets, but I just wondered whether there could be the chance to introduce a LUA hook at connect time rather than waiting for authentication to be done. Also I have no idea what the overhead of LUA script is, does it spawn additional processes per connection? Thanks John

1 0

IMAP login-logout cycle performance with performance mode seems slow/limited and cause cannot be found
by m＠maltris.org 03 Jul '24

03 Jul '24

Hello, I am running a test setup in a docker stack with Dovecot (2.3.21). Basically as a test to see whats possible. The whole thing works okay, but I noticed that with imaptest (latest version) somewhere between 230 and 270 requests per second on a login+logout cycle it cannot go further. However, this is a 384G memory, 48 core, dual-cpu setup that is pretty much idling (utilization somewhere around 6-12%). The ssds are not loaded at all. The memory usage is low. For testing purpose I set nopassword=y and allowed all logins, the users just require a small mysql db lookup which is done once before the cache is filled. If I copy that exact same stack to my local machine, I yield around 450 cycles per second. And the only difference I somehow see is that my local machine has a faster cpu-memory connection and only one cpu with less cores. Is it possible memory speed is a limiting factor because of the cpu-memory-mapping on the server and the slower memory? What performance should I expect? Asking because I am planning to run a stateless client at a later point and the limited login-performance really seems to make that difficult at scale. doveconf -n: # 2.3.21 (47349e2482): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.21 (f6cd4b8e) # OS: Linux 6.8.0-36-generic x86_64 Debian 11.7 ext4 # Hostname: 4e83f0e9d630 auth_cache_negative_ttl = 0 auth_cache_size = 50 M auth_cache_ttl = 5 hours auth_cache_verify_password_with_worker = yes auth_debug = yes auth_debug_passwords = yes auth_failure_delay = 0 auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = yes auth_worker_max_count = 500 default_vsz_limit = 2 G disable_plaintext_auth = no doveadm_api_key = # hidden, use -P to show it doveadm_password = # hidden, use -P to show it doveadm_port = 2425 log_debug = event=* log_path = /var/log/dovecot-debug.log login_trusted_networks = 10.0.0.0/8 127.0.0.0/8 mail_debug = yes mail_fsync = never mail_gid = 1000 mail_location = maildir:/data/vmail/%d/%1n/%n mail_uid = 1000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = nopassword=y driver = static } protocols = " imap lmtp sieve pop3 submission" service anvil { chroot = empty client_limit = 75100 idle_kill = 4294967295 secs process_limit = 1 unix_listener anvil-auth-penalty { mode = 00 } } service auth-worker { client_limit = 1 process_limit = 6000 user = $default_internal_user } service auth { client_limit = 91000 } service doveadm { inet_listener { port = 2425 } inet_listener http { port = 8080 } } service imap-login { process_limit = 15000 process_min_avail = 48 service_count = 0 vsz_limit = 2 G } service imap { client_limit = 1 process_limit = 15000 } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol doveadm { passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql name = override_fields = port=2425 ssl=no starttls=no } } protocol imap { mail_max_userip_connections = 250 } Best regards

2 5

AW: AW: AW: IMAPSieve plugin will not run rspamd script
by postfix_dovecot＠gmx.de 02 Jul '24

02 Jul '24

Hi John, the prefix is just a sign of my desperation - I tried all sorts of variations yesterday and now forgot to undo it. There’s a very detailed tutorial available (German language) with Debian 10. Just the sieve scripts are little different. I spend the time to raise a Debian 10 with this tutorial – and with exact the same result as with my up to date configuration. So it would be interesting for me to know if there is anyone here who has managed to get this to work on Debian? Jens Von: John Fawcett <john(a)voipsupport.it> Gesendet: Montag, 1. Juli 2024 18:26 An: postfix_dovecot(a)gmx.de Betreff: Re: AW: AW: IMAPSieve plugin will not run rspamd script On 01/07/2024 18:08, postfix_dovecot(a)gmx.de <mailto:postfix_dovecot@gmx.de> wrote: Hi John, is there any other log than system? Jens Hi Jens I meant the same type of logging you already posted (i.e. as below) for exactly the same test case, but where the rules use the mailbox name that includes the prefix you set for the namespace (i.e.INBOX/Spam). There is probably a good reason why you have configured a prefix for your namespace, but my suspicion is that the example imapsieve config you copied assumes no prefix set (it was not part of the example so we cannot see it). I personally tried the settings from the example and they work fine and I have no prefix. I also did the opposite test and I get the behaviour you reported when I have prefix set. In order to solve it (without changing the prefix) I had to state the full mailbox name including the prefix in the imapsieve rules. In that case it worked. What I'd like to check in your logging is if there is a clue why it didn't work for you when yu used INBOX/Spam in the rules. John imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: Module loaded: /usr/lib/dovecot/modules/lib95_imap_sieve_plugin.so imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: imapsieve: mailbox INBOX/Spam: APPEND event imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: Pigeonhole version 0.5.19 (4eae2f79) initializing imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: imapsieve: Static mailbox rule [1]: mailbox=`Spam' from=`*' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-spam.sieve' after=(none) imap(mail(a)test.example <mailto:mail@test.example> )<1797><a/FKmgIcqKvAqB4a>: Debug: imapsieve: Static mailbox rule [2]: mailbox=`*' from=`Spam' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-ham.sieve' after=(none) imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: mailbox INBOX: FLAG event (changed flags: \Deleted) imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: Pigeonhole version 0.5.19 (4eae2f79) initializing imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: Static mailbox rule [1]: mailbox=`Spam' from=`*' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-spam.sieve' after=(none) imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: Static mailbox rule [2]: mailbox=`*' from=`Spam' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-ham.sieve' after=(none) imap(mail(a)test.example <mailto:mail@test.example> )<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: mailbox INBOX: FLAG event (changed flags: \Seen)

2 10

IMAPSieve plugin will not run rspamd script
by postfix_dovecot＠gmx.de 02 Jul '24

02 Jul '24

Host: VMware Workstation 14.1.8 OS: Debian 12 (Bookworm) Dovecot: 2.3.19.1 Postfix: 3.7.10 Mailclient: Outlook 2016 Hello, I am currently working on a new mail server to replace my Debian 10 mail server. For preparation, I use VMware Workstation to learn and test the installation steps. When I'm eventually done, I'll rebuild my root server from scratch. This time, my problem is getting the IMAPSieve plugin working to trigger rspamd if mail gets moved to the junk folder. Sieve runs well – if rspam recognizes a spam mail, it will be transferred to the junk folder. For me it looks like the IMAPSieve plugin recognizes the move but will not running the script behind. I can see some actions in the log but nothing happens on the rspamd side where the log is also open to view. Moving a mail with Outlook produces the following log entry: imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: Module loaded: /usr/lib/dovecot/modules/lib95_imap_sieve_plugin.so imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: imapsieve: mailbox INBOX/Spam: APPEND event imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: Pigeonhole version 0.5.19 (4eae2f79) initializing imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: imapsieve: Static mailbox rule [1]: mailbox=`Spam' from=`*' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-spam.sieve' after=(none) imap(mail(a)test.example)<1797><a/FKmgIcqKvAqB4a>: Debug: imapsieve: Static mailbox rule [2]: mailbox=`*' from=`Spam' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-ham.sieve' after=(none) imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: mailbox INBOX: FLAG event (changed flags: \Deleted) imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: Pigeonhole version 0.5.19 (4eae2f79) initializing imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.19 (4eae2f79) loaded imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: Static mailbox rule [1]: mailbox=`Spam' from=`*' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-spam.sieve' after=(none) imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: Static mailbox rule [2]: mailbox=`*' from=`Spam' causes=(COPY APPEND) => before=`file:/usr/lib/dovecot/sieve/report-ham.sieve' after=(none) imap(mail(a)test.example)<1795><iC6JmQIcnqvAqB4a>: Debug: imapsieve: mailbox INBOX: FLAG event (changed flags: \Seen) My /etc/dovecot/local.conf looks like this: ## dovecot.conf # Mailuser im Log mit Namen darstellen verbose_proctitle = yes protocols = imap lmtp sieve ## 10-auth.conf # Disable LOGIN command and all other plaintext authentications unless # SSL/TLS is used (LOGINDISABLED capability). Note that if the remote IP # matches the local IP (ie. you're connecting from the same computer), the # connection is considered secure and plaintext authentication is allowed. # See also ssl=required setting. disable_plaintext_auth = yes # Space separated list of wanted authentication mechanisms: # plain login digest-md5 cram-md5 ntlm rpa apop anonymous gssapi otp # gss-spnego # NOTE: See also disable_plaintext_auth setting. auth_mechanisms = plain login # Username formatting before it's looked up from databases. You can use # the standard variables here, eg. %Lu would lowercase the username, %n would # drop away the domain if it was given, or "%n-AT-%d" would change the '@' into # "-AT-". This translation is done after auth_username_translation changes. auth_username_format = %Lu ## ## Password and user databases ## # # Password database is used to verify user's password (and nothing more). # You can have multiple passdbs and userdbs. This is useful if you want to # allow both system users (/etc/passwd) and virtual users to login without # duplicating the system users into virtual database. # # <doc/wiki/PasswordDatabase.txt> # # User database specifies where mails are located and what user/group IDs # own them. For single-UID configuration use "static" userdb. # # <doc/wiki/UserDatabase.txt> #!include conf.d/auth-deny.conf.ext #!include conf.d/auth-master.conf.ext #!include conf.d/auth-system.conf.ext #!include conf.d/auth-sql.conf.ext #!include conf.d/auth-ldap.conf.ext !include conf.d/auth-passwdfile.conf.ext #!include conf.d/auth-checkpassword.conf.ext #!include conf.d/auth-static.conf.ext ## 10-director.conf ## 10-logging.conf # Loglevel festelegen auth_verbose = no auth_debug = no mail_debug = yes ## 10-mail.conf # Format der Mailbox ändern mail_location = maildir:~/Maildir namespace inbox { # Namespace type: private, shared or public type = private # Hierarchy separator to use. You should use the same separator for all # namespaces or some clients get confused. '/' is usually a good one. # The default however depends on the underlying mail storage format. separator = / # Prefix required to access this namespace. This needs to be different for # all namespaces. For example "Public/". prefix = INBOX/ # Physical location of the mailbox. This is in same format as # mail_location, which is also the default for it. location = # There can be only one INBOX, and this setting defines which namespace # has it. inbox = yes # If namespace is hidden, it's not advertised to clients via NAMESPACE # extension. You'll most likely also want to set list=no. This is mostly # useful when converting from another server with different namespaces which # you want to deprecate but still keep working. For example you can create # hidden namespaces with prefixes "~/mail/", "~%u/mail/" and "mail/". hidden = no # If namespace namespace/location fails to load, by default the entire # session will fail to start. If this is set, this namespace will be ignored # instead. ignore_on_failure = no # Show the mailboxes under this namespace with LIST command. This makes the # namespace visible for clients that don't support NAMESPACE extension. # "children" value lists child mailboxes, but hides the namespace prefix. list = yes # Namespace handles its own subscriptions. If set to "no", the parent # namespace handles them (empty prefix should always have this as "yes") subscriptions = yes # See 15-mailboxes.conf for definitions of special mailboxes. } ## 10-master.conf service lmtp { inet_listener lmtp { address = 127.0.0.1 ::1 port = 24 } } service auth { # auth_socket_path points to this userdb socket by default. It's typically # used by dovecot-lda, doveadm, possibly imap process, etc. Users that have # full permissions to this socket are able to get a list of all usernames and # get the results of everyone's userdb lookups. # # The default 0666 mode allows anyone to connect to the socket, but the # userdb lookups will succeed only if the userdb returns an "uid" field that # matches the caller process's UID. Also if caller's uid or gid matches the # socket's uid or gid the lookup succeeds. Anything else causes a failure. # # To give the caller full permissions to lookup all users, set the mode to # something else than 0666 and Dovecot lets the kernel enforce the # permissions (e.g. 0777 allows everyone full permissions). unix_listener auth-userdb { #mode = 0666 #user = #group = } # Postfix smtp-auth unix_listener /var/spool/postfix/private/auth { mode = 0666 } # Auth process is run as this user. #user = $default_internal_user } ## 10-ssl.conf ## 10-tcpwrapper.conf ## 15-lda.conf ## 15-mailboxes.conf namespace inbox { inbox = yes mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } } ## 20-imap.conf protocol imap { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins imap_sieve } ## 20-lmtp.conf protocol lmtp { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins sieve } ## 20-managesieve.conf ## 90-acl.conf ## 90-plugin.conf ## 90-quota.conf ## 90-sieve.conf plugin { sieve_before = /etc/dovecot/conf.d/custom-sieve/global_before.sieve sieve_after = /etc/dovecot/conf.d/custom-sieve/global_after.sieve sieve_plugins = sieve_imapsieve sieve_extprograms # From elsewhere to Spam folder imapsieve_mailbox1_name = Spam imapsieve_mailbox1_causes = COPY APPEND imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve # From Spam folder to elsewhere imapsieve_mailbox2_name = * imapsieve_mailbox2_from = Spam imapsieve_mailbox2_causes = COPY APPEND imapsieve_mailbox2_before = file:/usr/lib/dovecot/sieve/report-ham.sieve sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment } ## 90-sieve-extprograms.conf root@ServerIV-home:~# ^C root@ServerIV-home:~# cat /etc/dovecot/local.conf ## dovecot.conf # Mailuser im Log mit Namen darstellen verbose_proctitle = yes protocols = imap lmtp sieve ## 10-auth.conf # Disable LOGIN command and all other plaintext authentications unless # SSL/TLS is used (LOGINDISABLED capability). Note that if the remote IP # matches the local IP (ie. you're connecting from the same computer), the # connection is considered secure and plaintext authentication is allowed. # See also ssl=required setting. disable_plaintext_auth = yes # Space separated list of wanted authentication mechanisms: # plain login digest-md5 cram-md5 ntlm rpa apop anonymous gssapi otp # gss-spnego # NOTE: See also disable_plaintext_auth setting. auth_mechanisms = plain login # Username formatting before it's looked up from databases. You can use # the standard variables here, eg. %Lu would lowercase the username, %n would # drop away the domain if it was given, or "%n-AT-%d" would change the '@' into # "-AT-". This translation is done after auth_username_translation changes. auth_username_format = %Lu ## ## Password and user databases ## # # Password database is used to verify user's password (and nothing more). # You can have multiple passdbs and userdbs. This is useful if you want to # allow both system users (/etc/passwd) and virtual users to login without # duplicating the system users into virtual database. # # <doc/wiki/PasswordDatabase.txt> # # User database specifies where mails are located and what user/group IDs # own them. For single-UID configuration use "static" userdb. # # <doc/wiki/UserDatabase.txt> #!include conf.d/auth-deny.conf.ext #!include conf.d/auth-master.conf.ext #!include conf.d/auth-system.conf.ext #!include conf.d/auth-sql.conf.ext #!include conf.d/auth-ldap.conf.ext !include conf.d/auth-passwdfile.conf.ext #!include conf.d/auth-checkpassword.conf.ext #!include conf.d/auth-static.conf.ext ## 10-director.conf ## 10-logging.conf # Loglevel festelegen auth_verbose = no auth_debug = no mail_debug = yes ## 10-mail.conf # Format der Mailbox ändern mail_location = maildir:~/Maildir namespace inbox { # Namespace type: private, shared or public type = private # Hierarchy separator to use. You should use the same separator for all # namespaces or some clients get confused. '/' is usually a good one. # The default however depends on the underlying mail storage format. separator = / # Prefix required to access this namespace. This needs to be different for # all namespaces. For example "Public/". prefix = INBOX/ # Physical location of the mailbox. This is in same format as # mail_location, which is also the default for it. location = # There can be only one INBOX, and this setting defines which namespace # has it. inbox = yes # If namespace is hidden, it's not advertised to clients via NAMESPACE # extension. You'll most likely also want to set list=no. This is mostly # useful when converting from another server with different namespaces which # you want to deprecate but still keep working. For example you can create # hidden namespaces with prefixes "~/mail/", "~%u/mail/" and "mail/". hidden = no # If namespace namespace/location fails to load, by default the entire # session will fail to start. If this is set, this namespace will be ignored # instead. ignore_on_failure = no # Show the mailboxes under this namespace with LIST command. This makes the # namespace visible for clients that don't support NAMESPACE extension. # "children" value lists child mailboxes, but hides the namespace prefix. list = yes # Namespace handles its own subscriptions. If set to "no", the parent # namespace handles them (empty prefix should always have this as "yes") subscriptions = yes # See 15-mailboxes.conf for definitions of special mailboxes. } ## 10-master.conf service lmtp { inet_listener lmtp { address = 127.0.0.1 ::1 port = 24 } } service auth { # auth_socket_path points to this userdb socket by default. It's typically # used by dovecot-lda, doveadm, possibly imap process, etc. Users that have # full permissions to this socket are able to get a list of all usernames and # get the results of everyone's userdb lookups. # # The default 0666 mode allows anyone to connect to the socket, but the # userdb lookups will succeed only if the userdb returns an "uid" field that # matches the caller process's UID. Also if caller's uid or gid matches the # socket's uid or gid the lookup succeeds. Anything else causes a failure. # # To give the caller full permissions to lookup all users, set the mode to # something else than 0666 and Dovecot lets the kernel enforce the # permissions (e.g. 0777 allows everyone full permissions). unix_listener auth-userdb { #mode = 0666 #user = #group = } # Postfix smtp-auth unix_listener /var/spool/postfix/private/auth { mode = 0666 } # Auth process is run as this user. #user = $default_internal_user } ## 10-ssl.conf ## 10-tcpwrapper.conf ## 15-lda.conf ## 15-mailboxes.conf namespace inbox { inbox = yes mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } } ## 20-imap.conf protocol imap { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins imap_sieve } ## 20-lmtp.conf protocol lmtp { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins sieve } ## 20-managesieve.conf ## 90-acl.conf ## 90-plugin.conf ## 90-quota.conf ## 90-sieve.conf plugin { sieve_before = /etc/dovecot/conf.d/custom-sieve/global_before.sieve sieve_after = /etc/dovecot/conf.d/custom-sieve/global_after.sieve sieve_plugins = sieve_imapsieve sieve_extprograms # From elsewhere to Spam folder imapsieve_mailbox1_name = Spam imapsieve_mailbox1_causes = COPY APPEND imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve # From Spam folder to elsewhere imapsieve_mailbox2_name = * imapsieve_mailbox2_from = Spam imapsieve_mailbox2_causes = COPY APPEND imapsieve_mailbox2_before = file:/usr/lib/dovecot/sieve/report-ham.sieve sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment } ## 90-sieve-extprograms.conf root@ServerIV-home:~# cat /etc/dovecot/local.conf ## dovecot.conf # Mailuser im Log mit Namen darstellen verbose_proctitle = yes protocols = imap lmtp sieve ## 10-auth.conf # Disable LOGIN command and all other plaintext authentications unless # SSL/TLS is used (LOGINDISABLED capability). Note that if the remote IP # matches the local IP (ie. you're connecting from the same computer), the # connection is considered secure and plaintext authentication is allowed. # See also ssl=required setting. disable_plaintext_auth = yes # Space separated list of wanted authentication mechanisms: # plain login digest-md5 cram-md5 ntlm rpa apop anonymous gssapi otp # gss-spnego # NOTE: See also disable_plaintext_auth setting. auth_mechanisms = plain login # Username formatting before it's looked up from databases. You can use # the standard variables here, eg. %Lu would lowercase the username, %n would # drop away the domain if it was given, or "%n-AT-%d" would change the '@' into # "-AT-". This translation is done after auth_username_translation changes. auth_username_format = %Lu ## ## Password and user databases ## # # Password database is used to verify user's password (and nothing more). # You can have multiple passdbs and userdbs. This is useful if you want to # allow both system users (/etc/passwd) and virtual users to login without # duplicating the system users into virtual database. # # <doc/wiki/PasswordDatabase.txt> # # User database specifies where mails are located and what user/group IDs # own them. For single-UID configuration use "static" userdb. # # <doc/wiki/UserDatabase.txt> #!include conf.d/auth-deny.conf.ext #!include conf.d/auth-master.conf.ext #!include conf.d/auth-system.conf.ext #!include conf.d/auth-sql.conf.ext #!include conf.d/auth-ldap.conf.ext !include conf.d/auth-passwdfile.conf.ext #!include conf.d/auth-checkpassword.conf.ext #!include conf.d/auth-static.conf.ext ## 10-director.conf ## 10-logging.conf # Loglevel festelegen auth_verbose = no auth_debug = no mail_debug = yes ## 10-mail.conf # Format der Mailbox ändern mail_location = maildir:~/Maildir namespace inbox { # Namespace type: private, shared or public type = private # Hierarchy separator to use. You should use the same separator for all # namespaces or some clients get confused. '/' is usually a good one. # The default however depends on the underlying mail storage format. separator = / # Prefix required to access this namespace. This needs to be different for # all namespaces. For example "Public/". prefix = INBOX/ # Physical location of the mailbox. This is in same format as # mail_location, which is also the default for it. location = # There can be only one INBOX, and this setting defines which namespace # has it. inbox = yes # If namespace is hidden, it's not advertised to clients via NAMESPACE # extension. You'll most likely also want to set list=no. This is mostly # useful when converting from another server with different namespaces which # you want to deprecate but still keep working. For example you can create # hidden namespaces with prefixes "~/mail/", "~%u/mail/" and "mail/". hidden = no # If namespace namespace/location fails to load, by default the entire # session will fail to start. If this is set, this namespace will be ignored # instead. ignore_on_failure = no # Show the mailboxes under this namespace with LIST command. This makes the # namespace visible for clients that don't support NAMESPACE extension. # "children" value lists child mailboxes, but hides the namespace prefix. list = yes # Namespace handles its own subscriptions. If set to "no", the parent # namespace handles them (empty prefix should always have this as "yes") subscriptions = yes # See 15-mailboxes.conf for definitions of special mailboxes. } ## 10-master.conf service lmtp { inet_listener lmtp { address = 127.0.0.1 ::1 port = 24 } } service auth { # auth_socket_path points to this userdb socket by default. It's typically # used by dovecot-lda, doveadm, possibly imap process, etc. Users that have # full permissions to this socket are able to get a list of all usernames and # get the results of everyone's userdb lookups. # # The default 0666 mode allows anyone to connect to the socket, but the # userdb lookups will succeed only if the userdb returns an "uid" field that # matches the caller process's UID. Also if caller's uid or gid matches the # socket's uid or gid the lookup succeeds. Anything else causes a failure. # # To give the caller full permissions to lookup all users, set the mode to # something else than 0666 and Dovecot lets the kernel enforce the # permissions (e.g. 0777 allows everyone full permissions). unix_listener auth-userdb { #mode = 0666 #user = #group = } # Postfix smtp-auth unix_listener /var/spool/postfix/private/auth { mode = 0666 } # Auth process is run as this user. #user = $default_internal_user } ## 10-ssl.conf ## 10-tcpwrapper.conf ## 15-lda.conf ## 15-mailboxes.conf namespace inbox { inbox = yes mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } } ## 20-imap.conf protocol imap { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins imap_sieve } ## 20-lmtp.conf protocol lmtp { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins sieve } ## 20-managesieve.conf ## 90-acl.conf ## 90-plugin.conf ## 90-quota.conf ## 90-sieve.conf plugin { sieve_before = /etc/dovecot/conf.d/custom-sieve/global_before.sieve sieve_after = /etc/dovecot/conf.d/custom-sieve/global_after.sieve sieve_plugins = sieve_imapsieve sieve_extprograms # From elsewhere to Spam folder imapsieve_mailbox1_name = Spam imapsieve_mailbox1_causes = COPY APPEND imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve # From Spam folder to elsewhere imapsieve_mailbox2_name = * imapsieve_mailbox2_from = Spam imapsieve_mailbox2_causes = COPY APPEND imapsieve_mailbox2_before = file:/usr/lib/dovecot/sieve/report-ham.sieve sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment } ## 90-sieve-extprograms.conf Meanwhile I tried a lot of several guides in the internet – nothing of them worked for me – what’s hard to understand because it’s a fresh and simple installation I did. Any help is very appreciated! Thanks Jens

4 6

Oauth2 introspection mode bug(?)
by Scott Q. 01 Jul '24

01 Jul '24

Here goes another oauth2 question, hoping it won't be ignored like all the others. I want to use get/auth on tokeninfo_url but post on introspection_url but dovecot doesn't let me. It doesn't add the auth header on tokeninfo_url whenever introspection_mode == post so, if introspection_mode = post, then dovecot no longer sends auth header to tokeninfo_url . Is this by design, is it a bug ? as can be seen in src/lib-oauth2/oauth2-request.c if (add_auth_bearer && http_client_request_get_origin_url(req->req)->user == NULL && set->introspection_mode == INTROSPECTION_MODE_GET_AUTH) { http_client_request_add_header(req->req, "Authorization", t_strdup_printf("Bearer %s", input->token)); }

2 6

Sieve Symlink Error
by Benjamin Rose 01 Jul '24

01 Jul '24

Hello, I'm in the process of moving our mail server from RHEL 6 to RHEL 9. We will be moving to: # dovecot --version 2.3.16 (7e2e900c1a) My issue is that sieve does not appear to work on the new setup, where it does work on the old one. I made a simple filter rule: # cat /u/mail0test/.sieve/ingo.sieve # Sieve Filter # Generated by Ingo (http://www.horde.org/apps/ingo/) (06/28/2024, 11:14:52 PM) require "fileinto"; # Test if header :comparator "i;ascii-casemap" :contains "Subject" "filtertest" { fileinto "Fun"; stop; } Upon sending an email to this test account, the following appears in /var/log/maillog: Jun 29 23:19:56 mail5 dovecot[3066980]: lda(mail0test)<3066980><FA8fFtzOgGZkzC4AuM9lWg>: Warning: sieve: file storage: Active sieve script symlink /u/mail0test/.dovecot.sieve is broken: Invalid/unknown path to storage (points to /u/mail0test/.sieve). Jun 29 23:19:56 mail5 dovecot[2987026]: doveadm(mail0test)<3066983><KFf4FtzOgGZnzC4AuM9lWg>: Warning: sieve: file storage: Active sieve script symlink /u/mail0test/.dovecot.sieve is broken: Invalid/unknown path to storage (points to /u/mail0test/.sieve). Jun 29 23:19:56 mail5 dovecot[2987026]: doveadm(mail0test)<3067016><VdsdK9zOgGaIzC4AuM9lWg>: Warning: sieve: file storage: Active sieve script symlink /u/mail0test/.dovecot.sieve is broken: Invalid/unknown path to storage (points to /u/mail0test/.sieve). Yet: # ll /u/mail0test/.dovecot.sieve lrwxrwxrwx. 1 mail0test sysguest 17 Jun 28 23:26 /u/mail0test/.dovecot.sieve -> .sieve/ingo.sieve # file /u/mail0test/.sieve/ingo.sieve /u/mail0test/.sieve/ingo.sieve: ASCII text That is the filter file I've pasted above. I've set the following directives in /etc/dovecot/conf.d/90-sieve.conf via puppet: augeas { "dovecot_sieve_settings": context => "/files/etc/dovecot/conf.d/90-sieve.conf", changes => [ "set plugin/sieve_dir ~/.sieve", "set plugin/sieve_user_log ~/.sieve/log" ], require => Package["dovecot"], notify => Service["dovecot"]; } The full configuration dump is attached. /u in our environment is the path for user homedirs, which is an NFS mount to a NetApp. The OS is Springdale Linux 9.2, a clone of RedHat from before the IBM license change. It will soon be RHEL 9.4 as we have obtained a license, but for all intents and purposes, Springdale 9.2 and RHEL 9.2 should be considered bug-for-bug compatible. The arch is x86_64 with both machines mail5 and mail6 (replicated) having Intel(R) Xeon(R) Gold 6244 CPU @ 3.60GHz and 768gb of memory. I have the same issue with SELinux in both enforcing and permissive modes, so this is not a permissions error due to SELinux. Am I doing something wrong, or is this a bug? I've seen that there have been some previous issues similar to this that ended up being bugs in pigeonhole, so here I am. Thanks, Ben

2 3

Glean all from addresses from a users mailbox?
by Austin Witmer 01 Jul '24

01 Jul '24

Hello all! Is there a quick and easy way to search through an entire mailbox for a user on my dovecot server and glean all the “from” email addresses? This user would like a record of all the email addresses who have contacted him. Thanks in advance for your ideas. Austin Witmer

3 2

Timeout when opening folder
by Entrepreneur AJ 28 Jun '24

28 Jun '24

Hi all, I'm stuck with an issue. Migrating everything to a k0s kubernetes cluster, trying to migrate dovecot and all so far seems to be well with PVC for mail storage, ssl working great, authentication vis PostgreSQL working great. Issue is when trying to look at another folder say Deleted or Spam etc folder I am getting a timeout error with no logs. I disabled apparmour on the nodes the try again and the following error message appears; Jun 24 21:01:55 imap-login: Info: Login: user=<eaj>, method=PLAIN, rip=194.207.0.0, lip=10.244.24.235, mpid=15, TLS, session=<eTNaF6kbzJHCz3qg> Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Added userdb setting: mail=maildir:/srv/vmail/eaj Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Effective uid=1000, gid=1000, home=/srv/vmail/eaj Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: open(/proc/self/io) failed: Permission denied Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/srv/vmail/eaj Jun 24 21:01:55 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: maildir++: root=/srv/vmail/eaj, index=, indexpvt=, control=, inbox=/srv/vmail/eaj, alt= Jun 24 21:01:55 imap(eaj)<14><3PRZF6kb0JHCz3qg>: Debug: Mailbox INBOX: Mailbox opened Jun 24 21:02:24 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Mailbox Sent: Couldn't open mailbox in list index: Storage size changed 160 != 396 Jun 24 21:02:24 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Mailbox Sent: Mailbox opened Jun 24 21:02:24 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Mailbox Drafts: Couldn't open mailbox in list index: Storage size changed 160 != 396 Jun 24 21:02:24 imap(eaj)<15><eTNaF6kbzJHCz3qg>: Debug: Mailbox Drafts: Mailbox opened Thunderbird keeps showing a timeout error after a few minutes. Dovecot Version: 2.3.21 (47349e2482) dovecot -n config: # 2.3.21 (47349e2482): /etc/dovecot/dovecot.conf # OS: Linux 5.15.0-112-generic x86_64 # Hostname: dovecot-549bdc98ff-tzwcf auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = yes base_dir = /var/run/dovecot/ first_valid_uid = 1000 import_environment = TZ last_valid_uid = 1000 log_path = /dev/stdout login_greeting = IMAP ready. mail_debug = yes mail_home = /srv/vmail/%n mail_location = maildir:~ namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes imap_compress_deflate_level = 9 mail_crypt_global_private_key = # hidden, use -P to show it mail_crypt_global_public_key = # hidden, use -P to show it mail_crypt_save_version = 2 zlib_save = zstd zlib_save_level = 3 } service auth-worker { user = vmail } service auth { unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { port = 24 } user = vmail } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 ssl = yes } } service submission-login { inet_listener submission { port = 0 } inet_listener submissions { port = 0 } } ssl = required ssl_cert = </etc/dovecot/certs/tls.crt ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-CHACHA20-POLY1305 ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_ssl = yes protocol imap { mail_plugins = postmaster_address = postmaster(a)eajglobal.net } protocol lmtp { mail_plugins = postmaster_address = postmaster(a)eajglobal.net } Any pointers would be highly appreciated.

5 7

Oauth2 remote IP address
by Scott Q. 27 Jun '24

27 Jun '24

Anyone knows how to configure Dovecot to send the real remote ip address of the user to the oauth2 provider ( Keycloak in this case ) ? Right now I see the request as coming from the Dovecot server... Thank you, Scott

1 0

sieve comparator i;unicode-casemap RFC5051
by Alexey 25 Jun '24

25 Jun '24

Hello. Am I right that currently there is no chance to compare non-ascii characters case-insensitive? (UTF-8 strings from inside Subject or Body) I'm looking for :comparator i;unicode-casemap, but can't find it. It is described in RFC5051. Regards, Alexey

1 0

logging computer name
by hp＠hungpham.no 25 Jun '24

25 Jun '24

I am running Dovecot 2.3.21. One client has multiple computers in their LAN, connecting to my server with a static IP. One or several computers in that LAN keep logging in with failed password, but the Dovecot log only shows the public static IP, like this Jun 25 10:39:20 server-name dovecot[689]: imap-login: Disconnected: Connection closed (auth failed, 2 attempts in 62 secs): user=<xxxx(a)domainyyy.com>, method=PLAIN, rip=client-public-IP, lip=server-IP, TLS, session=<MCLxoK4bksIO8zXR> I tried to enable debug, but there is no more information about the LAN IP or computer names. Is there any setting which helps me with that purpose? So it will be much easier to locate the failed computers in that LAN? Thank you.

3 2

Re: Only some of my sent emails are stored in sent-folder
by Joseph Tam 22 Jun '24

22 Jun '24

From: Nils <dovecot(a)bugblatterbeast.de> > Still, there is no filter rule that would apply to that. Additionally, I > only use "fileinto" actions in my filter rules. No, I meant Thunderbird's rules and filters. If your mail reader decides to not save the message, IMAP and Sireve will never see it. Joseph Tam <jtam.home(a)gmail.com>

1 0

Only some of my sent emails are stored in sent-folder
by Nils 21 Jun '24

21 Jun '24

Lots of the emails I send aren't stored in the sent folder. It seems that it mostly (but not always) work for sent emails where the main email-address (the one that is also used as login name) is used as sender. It never seems to work when an alias is used as sender name. There isn't any entry in the mail.err log and nothing that looks suspicious to me in the regular mail.log. I didn't notice it at first, because I usually don't check my sent folder that much, but I it seems to have started when I migrated to the new server a few weeks ago. Any idea what could be the reason for it? Kind regards, Nils Test 1 using main email address (NOT STORED IN SENT FOLDER) Jun 20 20:10:28 SERVER postfix/submission/smtpd[5156]: connect from INTERNET_PROVIDER[IPV6_ADDRESS] Jun 20 20:10:28 SERVER postfix/submission/smtpd[5156]: 3B8B0C0DA8: client=INTERNET_PROVIDER[IPV6_ADDRESS], sasl_method=PLAIN, sasl_username=RECIPIENT(a)SERVER.TLD Jun 20 20:10:28 SERVER postfix/cleanup[5161]: 3B8B0C0DA8: message-id=<bcdc1b7e-e3f1-4a82-8fd9-05dd307313e4(a)SERVER.TLD> Jun 20 20:10:28 SERVER amavis[5197]: (05197-01) Passed CLEAN {AcceptedInbound}, AM.PDP-SOCK [IPV6_ADDRESS] [IPV6_ADDRESS] <RECIPIENT(a)SERVER.TLD> -> <RECIPIENT(a)SERVER.TLD>, Queue-ID: 3B8B0C0DA8, Message-ID: <bcdc1b7e-e3f1-4a82-8fd9-05dd307313e4(a)SERVER.TLD>, mail_id: nv7qsKFzK11D, Hits: 0.975, size: 702, 463 ms Jun 20 20:10:28 SERVER opendkim[1081]: 3B8B0C0DA8: DKIM-Signature field added (s=SERVER.TLD, d=SERVER.TLD) Jun 20 20:10:28 SERVER postfix/qmgr[1792]: 3B8B0C0DA8: from=<RECIPIENT(a)SERVER.TLD>, size=402, nrcpt=1 (queue active) Jun 20 20:10:28 SERVER dovecot: lmtp(5228): Connect from local Jun 20 20:10:28 SERVER dovecot: lmtp(RECIPIENT(a)SERVER.TLD)<5228><cL5iLbSMdGZsFAAAVy37qw>: sieve: msgid=<bcdc1b7e-e3f1-4a82-8fd9-05dd307313e4(a)SERVER.TLD>: stored mail into mailbox 'INBOX' Jun 20 20:10:28 SERVER postfix/lmtp[5227]: 3B8B0C0DA8: to=<RECIPIENT(a)SERVER.TLD>, relay=SERVER.TLD[private/dovecot-lmtp], delay=0.55, delays=0.54/0/0/0.01, dsn=2.0.0, status=sent (250 2.0.0 <RECIPIENT(a)SERVER.TLD> cL5iLbSMdGZsFAAAVy37qw Saved) Jun 20 20:10:28 SERVER dovecot: lmtp(5228): Disconnect from local: Logged out (state=READY) Jun 20 20:10:28 SERVER postfix/qmgr[1792]: 3B8B0C0DA8: removed Jun 20 20:10:28 SERVER dovecot: imap-login: Login: user=<RECIPIENT(a)SERVER.TLD>, method=PLAIN, rip=IPV6_ADDRESS, lip=2a01:4f8:10a:e50::2, mpid=5248, TLS, session=<DdED6FcbbusgAwDKv0yBAGXh6Xy3cdaM> Jun 20 20:10:29 SERVER dovecot: imap(RECIPIENT(a)SERVER.TLD)<5248><DdED6FcbbusgAwDKv0yBAGXh6Xy3cdaM>: Disconnected: Logged out in=496 out=637 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 Jun 20 20:10:33 SERVER postfix/submission/smtpd[5156]: disconnect from INTERNET_PROVIDER[IPV6_ADDRESS] ehlo=2 starttls=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=8 Test 2 using alias email address (NOT STORED IN SENT FOLDER) Jun 20 20:10:41 SERVER postfix/submission/smtpd[5156]: connect from INTERNET_PROVIDER[IPV6_ADDRESS] Jun 20 20:10:42 SERVER postfix/submission/smtpd[5156]: 184A5C0DAD: client=INTERNET_PROVIDER[IPV6_ADDRESS], sasl_method=PLAIN, sasl_username=EMAIL(a)SERVER.TLD Jun 20 20:10:42 SERVER postfix/cleanup[5161]: 184A5C0DAD: message-id=<bc2f2025-67e0-4780-9a54-8f06c3b16389(a)SERVER.TLD> Jun 20 20:10:42 SERVER amavis[5196]: (05196-02) Passed CLEAN {AcceptedInbound}, AM.PDP-SOCK [IPV6_ADDRESS] [IPV6_ADDRESS] <ALIAS(a)SERVER.TLD> -> <RECIPIENT(a)SERVER.TLD>, Queue-ID: 184A5C0DAD, Message-ID: <bc2f2025-67e0-4780-9a54-8f06c3b16389(a)SERVER.TLD>, mail_id: ySF-pJQA8aRl, Hits: 0.975, size: 716, 607 ms Jun 20 20:10:42 SERVER opendkim[1081]: 184A5C0DAD: DKIM-Signature field added (s=key1, d=SERVER.TLD) Jun 20 20:10:42 SERVER postfix/qmgr[1792]: 184A5C0DAD: from=<ALIAS(a)SERVER.TLD>, size=408, nrcpt=1 (queue active) Jun 20 20:10:42 SERVER dovecot: lmtp(5228): Connect from local Jun 20 20:10:42 SERVER dovecot: lmtp(RECIPIENT(a)SERVER.TLD)<5228><KCs+LcKMdGZsFAAAVy37qw>: sieve: msgid=<bc2f2025-67e0-4780-9a54-8f06c3b16389(a)SERVER.TLD>: stored mail into mailbox 'INBOX' Jun 20 20:10:42 SERVER dovecot: lmtp(5228): Disconnect from local: Logged out (state=READY) Jun 20 20:10:42 SERVER postfix/lmtp[5227]: 184A5C0DAD: to=<RECIPIENT(a)SERVER.TLD>, relay=SERVER.TLD[private/dovecot-lmtp], delay=0.69, delays=0.68/0/0/0.01, dsn=2.0.0, status=sent (250 2.0.0 <RECIPIENT(a)SERVER.TLD> KCs+LcKMdGZsFAAAVy37qw Saved) Jun 20 20:10:42 SERVER postfix/qmgr[1792]: 184A5C0DAD: removed Jun 20 20:10:47 SERVER postfix/submission/smtpd[5156]: disconnect from INTERNET_PROVIDER[IPV6_ADDRESS] ehlo=2 starttls=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=8 Test 3 using main email address (stored in sent-folder) Jun 20 20:30:24 SERVER postfix/submission/smtpd[5813]: connect from INTERNET_PROVIDER[IPV6_ADDRESS] Jun 20 20:30:25 SERVER postfix/submission/smtpd[5813]: 3F2C1C0DAD: client=INTERNET_PROVIDER[IPV6_ADDRESS], sasl_method=PLAIN, sasl_username=EMAIL(a)SERVER.TLD Jun 20 20:30:25 SERVER postfix/cleanup[5818]: 3F2C1C0DAD: message-id=<603d7b61-d8d1-4099-bbc2-f0d2e9c776ee(a)SERVER.TLD> Jun 20 20:30:26 SERVER amavis[5197]: (05197-02) Passed CLEAN {AcceptedInbound}, AM.PDP-SOCK [IPV6_ADDRESS] [IPV6_ADDRESS] <EMAIL(a)SERVER.TLD> -> <RECIPIENT(a)SERVER.TLD>, Queue-ID: 3F2C1C0DAD, Message-ID: <603d7b61-d8d1-4099-bbc2-f0d2e9c776ee(a)SERVER.TLD>, mail_id: KDDY0Tv2B0Ut, Hits: 0.975, size: 704, 1096 ms Jun 20 20:30:26 SERVER opendkim[1081]: 3F2C1C0DAD: DKIM-Signature field added (s=key1, d=SERVER.TLD) Jun 20 20:30:26 SERVER postfix/qmgr[1792]: 3F2C1C0DAD: from=<EMAIL(a)SERVER.TLD>, size=398, nrcpt=1 (queue active) Jun 20 20:30:26 SERVER dovecot: lmtp(5824): Connect from local Jun 20 20:30:26 SERVER dovecot: lmtp(RECIPIENT(a)SERVER.TLD)<5824><xsEAGWKRdGbAFgAAVy37qw>: sieve: msgid=<603d7b61-d8d1-4099-bbc2-f0d2e9c776ee(a)SERVER.TLD>: stored mail into mailbox 'INBOX' Jun 20 20:30:26 SERVER postfix/lmtp[5823]: 3F2C1C0DAD: to=<RECIPIENT(a)SERVER.TLD>, relay=SERVER.TLD[private/dovecot-lmtp], delay=1.2, delays=1.2/0.01/0.01/0.01, dsn=2.0.0, status=sent (250 2.0.0 <RECIPIENT(a)SERVER.TLD> xsEAGWKRdGbAFgAAVy37qw Saved) Jun 20 20:30:26 SERVER dovecot: lmtp(5824): Disconnect from local: Logged out (state=READY) Jun 20 20:30:26 SERVER postfix/qmgr[1792]: 3F2C1C0DAD: removed Jun 20 20:30:26 SERVER dovecot: imap(EMAIL(a)SERVER.TLD)<5669><5nRfHlgbHIYgAwDKv0yBAGXh6Xy3cdaM>: Disconnected: Logged out in=1228 out=11932 deleted=0 expunged=0 trashed=0 hdr_count=3 hdr_bytes=816 body_count=0 body_bytes=0 Jun 20 20:30:31 SERVER postfix/submission/smtpd[5813]: disconnect from INTERNET_PROVIDER[IPV6_ADDRESS] ehlo=2 starttls=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=8

6 15

RE: Only some of my sent emails are stored in sent-folder
by Joseph Tam 21 Jun '24

21 Jun '24

From: Nils <dovecot(a)bugblatterbeast.de> > Lots of the emails I send aren't stored in the sent folder. It seems > that it mostly (but not always) work for sent emails where the main > email-address (the one that is also used as login name) is used as > sender. It never seems to work when an alias is used as sender name. Sounds to me like some mail reader filtering rule. Ordinarily, dovecot does not handle the capture of outgoing mail, Most of the time, it's the mail reader (MUA) that files outgoing messages to a sent-mail folder, and less commonly, the MTA will do it. Mail readers probably employ their own logic to determine what belongs in the sent mail folder: it could be all outgoing mail, it could be redirected based on some role filter. If you have a repeatable case, check it against your filter rule set. If it's inconsistent (the same message does and does not make it into your sent mail folder), you can look at other causes. Joseph Tam <jtam.home(a)gmail.com>

2 1

Core-dump on SSL connection
by Scott Q. 21 Jun '24

21 Jun '24

I'm on Debian 12.5 which comes with openssl 3.0.11 I compiled Dovecot 2.3.21 with some pretty vanilla options: /configure --prefix=/usr/local/dovecot --with-sql --with-mysql --with-docs --with-ssl --without-shadow --without-pam --without-ldap --without-pgsql --without-sqlite --with-systemd systemunitdir=/lib/systemd/system when I connect to it via SSL it core-dumps: Jun 18 20:50:01 mail kernel: imap-login[396438]: segfault at 69 ip 00007f2e5ee19556 sp 00007fffd7ca38f8 error 4 in libcrypto.so.3[7f2e5ecc5000+279000] likely on CPU 8 (core 8, socket 0) Jun 18 20:50:01 mail kernel: Code: c2 31 d2 31 ff c3 66 0f 1f 44 00 00 31 d2 31 ff c3 0f 1f 00 31 c0 48 85 ff 74 41 48 8b 57 08 8b 87 8c 00 00 00 48 85 d2 74 22 8b 52 68 48 85 d2 74 19 48 83 ec 08 ff d2 31 d2 85 c0 0f 48 c2 Anyone encountered something similar and knows how to fix it ?

4 8

Re: Only some of my sent emails are stored in sent-folder
by Joseph Tam 21 Jun '24

21 Jun '24

From: Nils <dovecot(a)bugblatterbeast.de> > Lots of the emails I send aren't stored in the sent folder. It seems > that it mostly (but not always) work for sent emails where the main > email-address (the one that is also used as login name) is used as > sender. It never seems to work when an alias is used as sender name. Sounds to me like some mail reader filtering rule. Ordinarily, dovecot does not handle the capture of outgoing mail, Most of the time, it's the mail reader (MUA) that files outgoing messages to a sent-mail folder, and less commonly, the MTA will do it. Mail readers probably employ their own logic to determine what belongs in the sent mail folder: it could be all outgoing mail, it could be redirected based on some role filter. If you have a repeatable case, check it against your filter rule set. If it's inconsistent (the same message does and does not make it into your sent mail folder), you can look at other causes. Joseph Tam <jtam.home(a)gmail.com>

1 0

Sieve bug on duplicate extension with MessageID break line
by ricardomachini＠gmail.com 19 Jun '24

19 Jun '24

Hello, I noticed that sieve's duplicate function is not working when the MessageID header has a line break and I have encountered messages originating from Microsoft 365 this way. For example: # test 1 From: <mailto:teste@domain.com.br> teste(a)domain.com.br To: <mailto:cron@domain.com.br> cron(a)domain.com.br Subject: test Message-Id: <mailto:854115.209399851-sendEmail@pa1> 854115.209399851-sendEmail@pa1 Date: Wed, 19 Jun 2024 12:35:16 -0300 (-03) Test # test 2 From: <mailto:teste@domain.com.br> teste(a)domain.com.br To: <mailto:cron@domain.com.br> cron(a)domain.com.br Subject: test Message-ID: <mailto:854115.209399851-sendEmail@pa1> 854115.209399851-sendEmail@pa1 Date: Wed, 19 Jun 2024 12:35:16 -0300 (-03) test # dovecot log Jun 19 12:59:33 server1 dovecot[513090]: lmtp(cron(a)domain.com.br) <mailto:cron@domain.com.br)%3c2993309%3e%3c4AeXHGUAc2adrC0AZCVTkw> <2993309><4AeXHGUAc2adrC0AZCVTkw>: sieve: subject=test from:teste@domain.com.br sender:teste@domain.com.br to: cron(a)domain.com.br <mailto:cron@domain.com.br> size:1010 msgid=854115.209399851-sendEmail@pa1 <mailto:854115.209399851-sendEmail@pa1> status=stored mail into mailbox 'INBOX' delivery_time=3 session_time=1 Jun 19 12:59:35 server1 dovecot[513090]: lmtp(cron(a)domain.com.br) <mailto:cron@domain.com.br)%3c2993309%3e%3csKNOK2cAc2adrC0AZCVTkw> <2993309><sKNOK2cAc2adrC0AZCVTkw>: sieve: subject=test from:teste@domain.com.br sender:teste@domain.com.br to: cron(a)domain.com.br <mailto:cron@domain.com.br> size:1014 msgid=854115.209399851-sendEmail@pa1 <mailto:854115.209399851-sendEmail@pa1> status=stored mail into mailbox 'INBOX' delivery_time=3 session_time=1 # sieve rule require ["duplicate", "fileinto", "envelope", "variables"]; if envelope :matches "from" "*" { set "sender" "${1}"; } if header :matches "subject" "*" { set "subject" "${1}"; } if header :matches "message-id" "*" { if duplicate :seconds 300 :uniqueid "${sender} ${subject} ${0}"{ discard; } } Regards, Ricardo

1 0

sieve issue
by savaw82275＠lisoren.com 19 Jun '24

19 Jun '24

Hi! Having a sieve rule: require ["fileinto", "editheader", "variables", "envelope"]; # rule:[med] if allof (address :contains "to" "info(a)mysite.com", header :contains "subject" "invoice") { deleteheader "from"; addheader "from" "info(a)mysite.com"; redirect "final(a)mysite.com"; } I was receiving: redirect action: failed to redirect message to <final(a)mysite.com>: Sendmail program returned error (temporary failure). Enabled debug log level in dovecot, then got some few further lines on this; program exec:/usr/sbin/sendmail (55356): Terminated with non-zero exit code 75 AND this: Error: sieve: redirect action: failed to redirect message to <final(a)mysite.com: Sendmail program returned error (temporary failure). After 2 hours of Google'ing, I finally found a workaround by adding: submission_host = 95.212.12.10 (IP address of my mail server) in dovecot.conf solved the issue. Can someone explain what was the issue and do you guys think this is a correct solution? Regards.

2 1

Re: Sieve generate a lot of hard link copies of mails in mailboxes
by George Asenov 16 Jun '24

16 Jun '24

Hi John, Thanks for taking your time looking at my issue. On 13-Jun-24 3:42 PM, John Stoffel via dovecot wrote: >>>>>> "George" == George Asenov via dovecot <dovecot(a)dovecot.org> writes: > > I don't have a real suggestion, but I do think you can clarify your problem. > >> No one have idea what is wrong here? >> On 07-Jun-24 4:10 PM, George Asenov via dovecot wrote: >>> Hello, >>> >>> I have very strange issue. Sieve generate copies of users messages i.e. >>> not real copies but hardlinks for the same message. It happens to many >>> messages but not every message and not every time, it is not a single >>> user issue I have couple users with that issue. > > Are you expecting sieve to generate copies? And are the copies in the > same folder or across folders? I.e. do you find an email in the > INBOX, and a hardlink in the SPAM folder? The goal here is when user move messages around imap folders to report them as ham/spam depending on where they originate and where they go. I think Sieve should send copy of the message to Rspamd because otherwise client will see the message dispensary which is not intuitive. Copies are all in the same folder. same message with many hard links placed in the same folder. Mostly happen in Trash and Spam folders. > What are the sizes of these emails? Are they all large? Or have > attachements? Is there anything that's common amongst those emails? Nothing in common as far as I can see. Sizes are verry different mostly small. > One idea might be to setup a test account and to just send it a bunch > of emails to try and make the problem occur. And to also look closely > at the rspamd logs as well. Already done that but I'm unable to reproduce it. > What is the size of the system memory on your dovecot server? And > what is the size of the dovecot.index.cache file when you see this > error? You should be able to delete the index and recreate it using > doveadm. > Servers are with enough RAM the smallest one is 64GB. The memory I'm referring is "vsz_limit=256 MB" and in my opinion it is not the issue but a consequence of the large amount of links in the mail and from there large index file and the result not enough memory to work with. When I delete all the copies the "Out of memory" errors are gone. > But from the sound of it, you have users with many thousands of emails > in a folder or folders. Can you check to see if there's any > relationship between users with larger numbers of hardlinks and those > with large numbers of emails? There are users with large number of mails but only some of them have this issue and some don't. Also there are users with small amount that have it which make them with large number of mails(copies). > And maybe instead of having sieve call rspam, maybe you can put it > into a milter and just have the > Rspamd is on a different server and it is set as a milter in postfix. That is why I use curl to report spam/ham. >>> It happens during auto reporting for spam/ham with sieve. >>> But I'm unable to reproduce it. >>> >>> At some point the hardlinks copies become so many that the mailbox index >>> files become so bug that dovecot start throwing error: >>> ################################ >>> dovecot[3385911]: imap(redacted(a)domain.tld)<1992901><RRBL9PQX69IXfCSs>: >>> Error: Mailbox Junk: mmap(size=520636784) failed with file >>> /var/lib/dovecot-virtualmin/index/redacted(a)domain.tld/.Junk/dovecot.index.cache: Cannot allocate memory >>> ################################ >>> other relevant logs are: >>> >>> dovecot: imap-login: Login: user=<redacted.user>, method=PLAIN, >>> rip=YYY.YYY.YYY.YYY, lip=XXX.XXX.XXX.XXX, mpid=3393763, TLS, >>> session=<c1Z1lPsZuPCAWqqI> >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: >>> learn-spam.sieve was triggered on imap.cause=COPY: >>> msgid=<87584056G78841203D85243127W62181551P@idomziqnd> >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: >>> learn-spam on imap.cause=COPY: from=redacted.mail, to=redacted2.mail, >>> subject=Asseyez-vous confortablement, n'importe où..., >>> msgid=<87584056G78841203D85243127W62181551P@idomziqnd>, >>> X-Spamd-Result=default: False [4.49 / 15.00]; >>> FORGED_RECIPIENTS(2.00)[m:redacted2.mail,s:redacted.user.fr]; >>> BAYES_SPAM(1.89)[88.30%]; MID_RHS_NOT_FQDN(0.50)[]; >>> BAD_REP_POLICIES(0.10)[]; RCVD_NO_TLS_LAST(0.10)[]; >>> MIME_GOOD(-0.10)[multipart/related,multipart/alternative,text/plain]; >>> ASN(0.00)[asn:34300, ipnet:62.173.128.0/19, country:RU]; >>> RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~,5:+]; >>> RCPT_COUNT_ONE(0.00)[1]; MISSING_XM_UA(0.00)[]; ARC_NA(0.00)[]; >>> RCVD_VIA_SMTP_AUTH(0.00)[]; GREYLIST(0.00)[pass,body]; >>> R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; >>> R_SPF_ALLOW(0.00)[+mx]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[or.mg]; >>> NEURAL_SPAM(0.00)[0.000] >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: >>> learn-spam send to rspamd spam >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: program >>> exec:/var/lib/dovecot/sieve/rspamd-learn-spam.sh (3397238): Terminated >>> with non-zero exit code 1 >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: Error: sieve: >>> failed to execute to program `rspamd-learn-spam.sh': refer to server log >>> for more information. [2024-06-03 07:36:40] >>> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: Disconnected: >>> Connection closed (UID FETCH finished 32.173 secs ago) in=2914 out=39237 >>> deleted=1 expunged=1 trashed=0 hdr_count=14 hdr_bytes=10705 body_count=1 >>> body_bytes=1606 >>> >>> I know that this is because the mail which is reported is too big for >>> curl but documentation say that > > Wait, how large is this email you're trying to process? So once you > have rspamd-learn-spam.sh crash on you, then you are really having an > rspam problem. Do you really need to scan large attachements? The "crash" is an error from curl because the mail is too big to send it inline as I pipe it, > What is your rspam configuration? And have you talked to people on > the rspamd mailing list on how to configure things? Rspamd is on a diffrent machine and I think it is not to blame here. > >>> $$$$$$$$$$$$$$$$$ >>> pipe :copy :try "rspamd-learn-spam.sh"; >>> $$$$$$$$$$$$$$$$$ >>> this should ignore the error. >>> I have tested also to change it like that: >>> $$$$$$$$$$$$$$$$$ >>> pipe :copy "rspamd-learn-spam.sh"; >>> $$$$$$$$$$$$$$$$$ >>> but the issue still persists > > So why are you doing a :copy here? If you're trying to say this email > is spam, why not just move it to your spam folder, and then have > rspamd go through your junk folder once a day instead? Because this should be kind of invisible to users. They move mails between folders and in the background they report as spam/ham > Have you looked at the system logs for memory problems when these > hardlink files are created? Are you running out of memory on general > on this mail server? > No memory problems on the machine itself there is plenty of free Ram > Instead of focusing on dovecot, back up a level and think about the > resources allocated to the whole system, and what types of mail > messages are showing this problem. How are they alike? What is your > mail volume? Does the problem happen when you get lots of emails, or > is it really random? It is not the amount of messages coming if I comment out the config executing spam/ham reporting and clean up the hardlinks the issue didn't show up for months. > Do you have old rspamd processes hanging around taking up resources? Rspamd can't make copies on that machine because it is on a separate server. > > Good luck! > John > > > > >>> I can't confirm that the issue is that error because these errors are >>> way less than the messages with hardlink copies. >>> Also sometimes one mail have more than two hardlinks to it. >>> ######################################## >>> here is a example: >>> >>> inode# hardlink_count filename >>> 2430090371 23850 >>> ./Maildir/.Trash/cur/1714190559.M355157P25776.redacted.hostname,S=39259,W=40217:2,S >>> 2430090371 23850 >>> ./Maildir/.Trash/cur/1714190562.M259778P25902.redacted.hostname,S=39259,W=40217:2,S >>> 2430090371 23850 >>> ./Maildir/.Trash/cur/1714190565.M188090P26028.redacted.hostname,S=39259,W=40217:2,S >>> 2430090371 23850 >>> ./Maildir/.Trash/cur/1714190568.M340582P26179.redacted.hostname,S=39259,W=40217:2,S >>> >>> yes this is "23850" hardlinks to the same Inode >>> ####################################### >>> The issue is somewhere in the sieve ham/spam reporting to rspamd but >>> cant figure out where and why. >>> >>> Is this a bug or my configuration is wrong? >>> >>> >>> Here are all related configurations (feel free to ask for more if needed): >>> ###################################################################### >>> # doveconf -n >>> # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf >>> # Pigeonhole version 0.5.16 (09c29328) >>> # OS: Linux 4.18.0-513.24.1.el8_9.x86_64 x86_64 Rocky Linux release 8.9 >>> (Green Obsidian) >>> # Hostname: redacteddomain.tld >>> auth_mechanisms = plain login >>> disable_plaintext_auth = no >>> first_valid_uid = 1000 >>> mail_location = >>> maildir:~/Maildir:INDEX=/var/lib/dovecot-virtualmin/index/%u:CONTROL=/var/lib/dovecot-virtualmin/control/%u >>> managesieve_notify_capability = mailto >>> managesieve_sieve_capability = fileinto reject envelope >>> encoded-character vacation subaddress comparator-i;ascii-numeric >>> relational regex imap4flags copy include variables body enotify >>> environment mailbox date index ihave duplicate mime >>> foreverypart extracttext vacation-seconds imapsieve vnd.dovecot.imapsieve >>> mbox_write_locks = fcntl >>> namespace inbox { >>> inbox = yes >>> location = >>> mailbox Drafts { >>> auto = subscribe >>> special_use = \Drafts >>> } >>> mailbox Junk { >>> auto = create >>> special_use = \Junk >>> } >>> mailbox Sent { >>> auto = subscribe >>> special_use = \Sent >>> } >>> mailbox "Sent Messages" { >>> special_use = \Sent >>> } >>> mailbox Trash { >>> auto = subscribe >>> special_use = \Trash >>> } >>> mailbox spam { >>> auto = subscribe >>> special_use = \Junk >>> } >>> prefix = >>> } >>> passdb { >>> driver = pam >>> } >>> plugin { >>> imapsieve_mailbox1_before = file:/var/lib/dovecot/sieve/learn-spam.sieve >>> imapsieve_mailbox1_causes = COPY >>> imapsieve_mailbox1_name = spam >>> imapsieve_mailbox2_before = file:/var/lib/dovecot/sieve/learn-ham.sieve >>> imapsieve_mailbox2_causes = COPY >>> imapsieve_mailbox2_from = spam >>> imapsieve_mailbox2_name = * >>> imapsieve_mailbox3_before = file:/var/lib/dovecot/sieve/learn-spam.sieve >>> imapsieve_mailbox3_causes = COPY >>> imapsieve_mailbox3_name = Junk >>> imapsieve_mailbox4_before = file:/var/lib/dovecot/sieve/learn-ham.sieve >>> imapsieve_mailbox4_causes = COPY >>> imapsieve_mailbox4_from = Junk >>> imapsieve_mailbox4_name = * >>> quota = fs:user userquota >>> quota2 = fs:group groupquota >>> quota_grace = 100M >>> quota_warning = storage=95%% quota-warning 95 %n %d >>> quota_warning2 = storage=90%% quota-warning 90 %n %d >>> quota_warning3 = storage=80%% quota-warning 80 %n %d >>> sieve = file:~/sieve;active=~/.dovecot.sieve >>> sieve_before = /var/lib/dovecot/sieve/before-global.sieve >>> sieve_extensions = +vacation-seconds >>> sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment >>> +vnd.dovecot.debug >>> sieve_pipe_bin_dir = /var/lib/dovecot/sieve >>> sieve_plugins = sieve_extprograms sieve_imapsieve >>> sieve_vacation_default_period = 10d >>> sieve_vacation_max_period = 30d >>> sieve_vacation_min_period = 1h >>> } >>> protocols = imap pop3 lmtp sieve >>> process_min_avail = 5 >>> service_count = 0 >>> } >>> service imap { >>> process_limit = 400 >>> } >>> service lmtp { >>> unix_listener /var/spool/postfix/private/dovecot-lmtp { >>> group = postfix >>> mode = 01224 >>> user = postfix >>> } >>> } >>> service pop3 { >>> process_limit = 200 >>> } >>> service quota-warning { >>> executable = script /var/lib/dovecot/quota-warning.sh >>> service_count = 1 >>> unix_listener quota-warning { >>> group = dovecot >>> mode = 0666 >>> user = dovecot >>> } >>> } >>> ssl_ca = </etc/pki/dovecot/certs/ca.pem >>> ssl_cert = </etc/pki/dovecot/certs/dovecot.pem >>> ssl_cipher_list = >>> ECDHE-RSA-AES256-SHA384:AES256-SHA256:AES256-SHA256:!RC4:HIGH:MEDIUM:+TLSv1:+TLSv1.1:+TLSv1.2:!MD5:!ADH:!aNULL:!eNULL:!NULL:!DH:!ADH:!EDH:!AESGCM >>> ssl_key = # hidden, use -P to show it >>> userdb { >>> driver = passwd >>> } >>> protocol lmtp { >>> mail_plugins = " sieve" >>> userdb { >>> args = username_format=%n /etc/passwd >>> driver = passwd-file >>> name = >>> } >>> } >>> protocol imap { >>> mail_plugins = " imap_quota imap_sieve quota" >>> } >>> >>> ###################################################################### >>> >>> # cat /var/lib/dovecot/sieve/learn-spam.sieve >>> require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", >>> "imap4flags", "vnd.dovecot.debug", "variables"]; >>> >>> # Logging >>> if address :matches "from" "*" { set "FROM" "${1}"; } >>> if address :matches "to" "*" { set "TO" "${1}"; } >>> if header :matches "subject" "*" { set "SUBJECT" "${1}"; } >>> if header :matches "Message-ID" "*" { set "MSGID" "${1}"; } >>> if header :matches "X-Spamd-Result" "*" { set "XSpamdResult" "${1}"; } >>> if environment :matches "imap.cause" "*" { set "IMAPCAUSE" "${1}"; } >>> debug_log "learn-spam.sieve was triggered on imap.cause=${IMAPCAUSE}: >>> msgid=${MSGID}"; >>> set "LogMsg" "learn-spam on imap.cause=${IMAPCAUSE}: from=${FROM}, >>> to=${TO}, subject=${SUBJECT}, msgid=${MSGID}, >>> X-Spamd-Result=${XSpamdResult}"; >>> >>> # Spam-learning by sending copy with curl to rspmd >>> if anyof (environment :is "imap.cause" "COPY", environment :is >>> "imap.cause" "APPEND") { >>> debug_log "${LogMsg}"; >>> debug_log "learn-spam send to rspamd spam"; >>> pipe :copy :try "rspamd-learn-spam.sh"; >>> } >>> # Catch replied or forwarded spam and send to rspamd ham >>> elsif anyof (allof (hasflag "\\Answered", environment :contains >>> "imap.changedflags" "\\Answered"), >>> allof (hasflag "$Forwarded", environment :contains >>> "imap.changedflags" "$Forwarded")) { >>> debug_log "${LogMsg}"; >>> debug_log "learn-spam send to rspamd ham"; >>> pipe :copy :try "rspamd-learn-ham.sh"; >>> } >>> ###################################################################### >>> >>> cat /var/lib/dovecot/sieve/learn-ham.sieve >>> require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", >>> "variables", "vnd.dovecot.debug"]; >>> >>> # Exclude messages which were moved to Trash (or training mailboxes) >>> from ham learning >>> if environment :matches "imap.mailbox" "*" { >>> set "mailbox" "${1}"; >>> } >>> if string "${mailbox}" [ "INBOX/Trash", "INBOX/Deleted Items", >>> "INBOX/Bin", "INBOX/train_ham", "INBOX/train_prob", "INBOX/train_spam", >>> "Trash" ] { >>> stop; >>> } >>> >>> # Logging >>> if address :matches "from" "*" { set "FROM" "${1}"; } >>> if address :matches "to" "*" { set "TO" "${1}"; } >>> if header :matches "subject" "*" { set "SUBJECT" "${1}"; } >>> if header :matches "Message-ID" "*" { set "MSGID" "${1}"; } >>> if header :matches "X-Spamd-Result" "*" { set "XSpamdResult" "${1}"; } >>> if environment :matches "imap.cause" "*" { set "IMAPCAUSE" "${1}"; } >>> debug_log "learn-ham on imap.cause=${IMAPCAUSE}: from=${FROM}, to=${TO}, >>> subject=${SUBJECT}, msgid=${MSGID}, X-Spamd-Result=${XSpamdResult}"; >>> >>> # Ham-learning sending a copy of the message to rspamd >>> debug_log "learn-ham send to rspamd ham"; >>> pipe :copy :try "rspamd-learn-ham.sh"; >>> ###################################################################### >>> >>> cat /var/lib/dovecot/sieve/rspamd-learn-ham.sh >>> #!/bin/bash >>> >>> function log_error() { echo `date '+%Y-%m-%d %H:%M:%S'` ERROR: $1 >&2; } >>> function log() { echo `date '+%Y-%m-%d %H:%M:%S'` INFO: $1; } >>> >>> MAIL=$(tee) >>> SERVER_LIST=("redacted.tld") #rspamd server >>> >>> PASSWORD="redacted" >>> >>> >>> for SERVER in ${SERVER_LIST[@]}; do >>> log "Trying to report spam to ${SERVER}" >>> RETURN=$(/usr/bin/curl -s --connect-timeout 1 -H "Password: >>> ${PASSWORD}" --data-binary --url "http://${SERVER}:11334/learnham" -d >>> "${MAIL}") >>> STATUS=$? >>> if [ $STATUS -eq 0 ]; then >>> log "Spam reported to ${SERVER}: ${RETURN}" >>> exit 0 >>> else >>> if [ $STATUS -eq 28 ]; then >>> log_error "Reporting SPAM to ${SERVER} failed: Connection >>> timed out." >>> else >>> log_error "Reporting SPAM to ${SERVER} failed: CURL exit >>> status ${STATUS}" >>> fi >>> fi >>> done >>> >>> log_error "Reporting SPAM failed ${SERVERS[@]}" >>> exit 1 >>> ###################################################################### >>> >>> cat /var/lib/dovecot/sieve/rspamd-learn-spam.sh >>> #!/bin/bash >>> >>> function log_error() { echo `date '+%Y-%m-%d %H:%M:%S'` ERROR: $1 >&2; } >>> function log() { echo `date '+%Y-%m-%d %H:%M:%S'` INFO: $1; } >>> >>> MAIL=$(tee) >>> SERVER_LIST=("redacted.tld") #rspamd server >>> PASSWORD="redacted" >>> >>> >>> >>> for SERVER in ${SERVER_LIST[@]}; do >>> log "Trying to report spam to ${SERVER}" >>> RETURN=$(/usr/bin/curl -s --connect-timeout 1 -H "Password: >>> ${PASSWORD}" --data-binary --url "http://${SERVER}:11334/learnspam" -d >>> "${MAIL}") >>> STATUS=$? >>> if [ $STATUS -eq 0 ]; then >>> log "Spam reported to ${SERVER}: ${RETURN}" >>> exit 0 >>> else >>> if [ $STATUS -eq 28 ]; then >>> log_error "Reporting SPAM to ${SERVER} failed: Connection >>> timed out." >>> else >>> log_error "Reporting SPAM to ${SERVER} failed: CURL exit >>> status ${STATUS}" >>> fi >>> fi >>> done >>> >>> log_error "Reporting SPAM failed ${SERVERS[@]}" >>> exit 1 >>> ###################################################################### >>> >>> without all "imapsieve_mailbox.* " directives the problem is gone. >>> >>> >>> Thanks to everyone in advance. >>> > >> -- >> Warm regards >> George A. >> WPXHosting >> _______________________________________________ >> dovecot mailing list -- dovecot(a)dovecot.org >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > _______________________________________________ > dovecot mailing list -- dovecot(a)dovecot.org > To unsubscribe send an email to dovecot-leave(a)dovecot.org -- Warm regards George A.

2 3

Sieve generate a lot of hard link copies of mails in mailboxes
by George Asenov 13 Jun '24

13 Jun '24

Hello, I have very strange issue. Sieve generate copies of users messages i.e. not real copies but hardlinks for the same message. It happens to many messages but not every message and not every time, it is not a single user issue I have couple users with that issue. It happens during auto reporting for spam/ham with sieve. But I'm unable to reproduce it. At some point the hardlinks copies become so many that the mailbox index files become so bug that dovecot start throwing error: ################################ dovecot[3385911]: imap(redacted(a)domain.tld)<1992901><RRBL9PQX69IXfCSs>: Error: Mailbox Junk: mmap(size=520636784) failed with file /var/lib/dovecot-virtualmin/index/redacted(a)domain.tld/.Junk/dovecot.index.cache: Cannot allocate memory ################################ other relevant logs are: dovecot: imap-login: Login: user=<redacted.user>, method=PLAIN, rip=YYY.YYY.YYY.YYY, lip=XXX.XXX.XXX.XXX, mpid=3393763, TLS, session=<c1Z1lPsZuPCAWqqI> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: learn-spam.sieve was triggered on imap.cause=COPY: msgid=<87584056G78841203D85243127W62181551P@idomziqnd> dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: learn-spam on imap.cause=COPY: from=redacted.mail, to=redacted2.mail, subject=Asseyez-vous confortablement, n'importe où..., msgid=<87584056G78841203D85243127W62181551P@idomziqnd>, X-Spamd-Result=default: False [4.49 / 15.00]; FORGED_RECIPIENTS(2.00)[m:redacted2.mail,s:redacted.user.fr]; BAYES_SPAM(1.89)[88.30%]; MID_RHS_NOT_FQDN(0.50)[]; BAD_REP_POLICIES(0.10)[]; RCVD_NO_TLS_LAST(0.10)[]; MIME_GOOD(-0.10)[multipart/related,multipart/alternative,text/plain]; ASN(0.00)[asn:34300, ipnet:62.173.128.0/19, country:RU]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~,5:+]; RCPT_COUNT_ONE(0.00)[1]; MISSING_XM_UA(0.00)[]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; GREYLIST(0.00)[pass,body]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(0.00)[+mx]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[or.mg]; NEURAL_SPAM(0.00)[0.000] dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: sieve: DEBUG: learn-spam send to rspamd spam dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: program exec:/var/lib/dovecot/sieve/rspamd-learn-spam.sh (3397238): Terminated with non-zero exit code 1 dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: Error: sieve: failed to execute to program `rspamd-learn-spam.sh': refer to server log for more information. [2024-06-03 07:36:40] dovecot: imap(redacted.user)<3393763><c1Z1lPsZuPCAWqqI>: Disconnected: Connection closed (UID FETCH finished 32.173 secs ago) in=2914 out=39237 deleted=1 expunged=1 trashed=0 hdr_count=14 hdr_bytes=10705 body_count=1 body_bytes=1606 I know that this is because the mail which is reported is too big for curl but documentation say that $$$$$$$$$$$$$$$$$ pipe :copy :try "rspamd-learn-spam.sh"; $$$$$$$$$$$$$$$$$ this should ignore the error. I have tested also to change it like that: $$$$$$$$$$$$$$$$$ pipe :copy "rspamd-learn-spam.sh"; $$$$$$$$$$$$$$$$$ but the issue still persists I can't confirm that the issue is that error because these errors are way less than the messages with hardlink copies. Also sometimes one mail have more than two hardlinks to it. ######################################## here is a example: inode# hardlink_count filename 2430090371 23850 ./Maildir/.Trash/cur/1714190559.M355157P25776.redacted.hostname,S=39259,W=40217:2,S 2430090371 23850 ./Maildir/.Trash/cur/1714190562.M259778P25902.redacted.hostname,S=39259,W=40217:2,S 2430090371 23850 ./Maildir/.Trash/cur/1714190565.M188090P26028.redacted.hostname,S=39259,W=40217:2,S 2430090371 23850 ./Maildir/.Trash/cur/1714190568.M340582P26179.redacted.hostname,S=39259,W=40217:2,S yes this is "23850" hardlinks to the same Inode ####################################### The issue is somewhere in the sieve ham/spam reporting to rspamd but cant figure out where and why. Is this a bug or my configuration is wrong? Here are all related configurations (feel free to ask for more if needed): ###################################################################### # doveconf -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 4.18.0-513.24.1.el8_9.x86_64 x86_64 Rocky Linux release 8.9 (Green Obsidian) # Hostname: redacteddomain.tld auth_mechanisms = plain login disable_plaintext_auth = no first_valid_uid = 1000 mail_location = maildir:~/Maildir:INDEX=/var/lib/dovecot-virtualmin/index/%u:CONTROL=/var/lib/dovecot-virtualmin/control/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds imapsieve vnd.dovecot.imapsieve mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox spam { auto = subscribe special_use = \Junk } prefix = } passdb { driver = pam } plugin { imapsieve_mailbox1_before = file:/var/lib/dovecot/sieve/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = spam imapsieve_mailbox2_before = file:/var/lib/dovecot/sieve/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = spam imapsieve_mailbox2_name = * imapsieve_mailbox3_before = file:/var/lib/dovecot/sieve/learn-spam.sieve imapsieve_mailbox3_causes = COPY imapsieve_mailbox3_name = Junk imapsieve_mailbox4_before = file:/var/lib/dovecot/sieve/learn-ham.sieve imapsieve_mailbox4_causes = COPY imapsieve_mailbox4_from = Junk imapsieve_mailbox4_name = * quota = fs:user userquota quota2 = fs:group groupquota quota_grace = 100M quota_warning = storage=95%% quota-warning 95 %n %d quota_warning2 = storage=90%% quota-warning 90 %n %d quota_warning3 = storage=80%% quota-warning 80 %n %d sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /var/lib/dovecot/sieve/before-global.sieve sieve_extensions = +vacation-seconds sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment +vnd.dovecot.debug sieve_pipe_bin_dir = /var/lib/dovecot/sieve sieve_plugins = sieve_extprograms sieve_imapsieve sieve_vacation_default_period = 10d sieve_vacation_max_period = 30d sieve_vacation_min_period = 1h } protocols = imap pop3 lmtp sieve process_min_avail = 5 service_count = 0 } service imap { process_limit = 400 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 01224 user = postfix } } service pop3 { process_limit = 200 } service quota-warning { executable = script /var/lib/dovecot/quota-warning.sh service_count = 1 unix_listener quota-warning { group = dovecot mode = 0666 user = dovecot } } ssl_ca = </etc/pki/dovecot/certs/ca.pem ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = ECDHE-RSA-AES256-SHA384:AES256-SHA256:AES256-SHA256:!RC4:HIGH:MEDIUM:+TLSv1:+TLSv1.1:+TLSv1.2:!MD5:!ADH:!aNULL:!eNULL:!NULL:!DH:!ADH:!EDH:!AESGCM ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol lmtp { mail_plugins = " sieve" userdb { args = username_format=%n /etc/passwd driver = passwd-file name = } } protocol imap { mail_plugins = " imap_quota imap_sieve quota" } ###################################################################### # cat /var/lib/dovecot/sieve/learn-spam.sieve require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", "imap4flags", "vnd.dovecot.debug", "variables"]; # Logging if address :matches "from" "*" { set "FROM" "${1}"; } if address :matches "to" "*" { set "TO" "${1}"; } if header :matches "subject" "*" { set "SUBJECT" "${1}"; } if header :matches "Message-ID" "*" { set "MSGID" "${1}"; } if header :matches "X-Spamd-Result" "*" { set "XSpamdResult" "${1}"; } if environment :matches "imap.cause" "*" { set "IMAPCAUSE" "${1}"; } debug_log "learn-spam.sieve was triggered on imap.cause=${IMAPCAUSE}: msgid=${MSGID}"; set "LogMsg" "learn-spam on imap.cause=${IMAPCAUSE}: from=${FROM}, to=${TO}, subject=${SUBJECT}, msgid=${MSGID}, X-Spamd-Result=${XSpamdResult}"; # Spam-learning by sending copy with curl to rspmd if anyof (environment :is "imap.cause" "COPY", environment :is "imap.cause" "APPEND") { debug_log "${LogMsg}"; debug_log "learn-spam send to rspamd spam"; pipe :copy :try "rspamd-learn-spam.sh"; } # Catch replied or forwarded spam and send to rspamd ham elsif anyof (allof (hasflag "\\Answered", environment :contains "imap.changedflags" "\\Answered"), allof (hasflag "$Forwarded", environment :contains "imap.changedflags" "$Forwarded")) { debug_log "${LogMsg}"; debug_log "learn-spam send to rspamd ham"; pipe :copy :try "rspamd-learn-ham.sh"; } ###################################################################### cat /var/lib/dovecot/sieve/learn-ham.sieve require ["vnd.dovecot.pipe", "copy", "imapsieve", "environment", "variables", "vnd.dovecot.debug"]; # Exclude messages which were moved to Trash (or training mailboxes) from ham learning if environment :matches "imap.mailbox" "*" { set "mailbox" "${1}"; } if string "${mailbox}" [ "INBOX/Trash", "INBOX/Deleted Items", "INBOX/Bin", "INBOX/train_ham", "INBOX/train_prob", "INBOX/train_spam", "Trash" ] { stop; } # Logging if address :matches "from" "*" { set "FROM" "${1}"; } if address :matches "to" "*" { set "TO" "${1}"; } if header :matches "subject" "*" { set "SUBJECT" "${1}"; } if header :matches "Message-ID" "*" { set "MSGID" "${1}"; } if header :matches "X-Spamd-Result" "*" { set "XSpamdResult" "${1}"; } if environment :matches "imap.cause" "*" { set "IMAPCAUSE" "${1}"; } debug_log "learn-ham on imap.cause=${IMAPCAUSE}: from=${FROM}, to=${TO}, subject=${SUBJECT}, msgid=${MSGID}, X-Spamd-Result=${XSpamdResult}"; # Ham-learning sending a copy of the message to rspamd debug_log "learn-ham send to rspamd ham"; pipe :copy :try "rspamd-learn-ham.sh"; ###################################################################### cat /var/lib/dovecot/sieve/rspamd-learn-ham.sh #!/bin/bash function log_error() { echo `date '+%Y-%m-%d %H:%M:%S'` ERROR: $1 >&2; } function log() { echo `date '+%Y-%m-%d %H:%M:%S'` INFO: $1; } MAIL=$(tee) SERVER_LIST=("redacted.tld") #rspamd server PASSWORD="redacted" for SERVER in ${SERVER_LIST[@]}; do log "Trying to report spam to ${SERVER}" RETURN=$(/usr/bin/curl -s --connect-timeout 1 -H "Password: ${PASSWORD}" --data-binary --url "http://${SERVER}:11334/learnham" -d "${MAIL}") STATUS=$? if [ $STATUS -eq 0 ]; then log "Spam reported to ${SERVER}: ${RETURN}" exit 0 else if [ $STATUS -eq 28 ]; then log_error "Reporting SPAM to ${SERVER} failed: Connection timed out." else log_error "Reporting SPAM to ${SERVER} failed: CURL exit status ${STATUS}" fi fi done log_error "Reporting SPAM failed ${SERVERS[@]}" exit 1 ###################################################################### cat /var/lib/dovecot/sieve/rspamd-learn-spam.sh #!/bin/bash function log_error() { echo `date '+%Y-%m-%d %H:%M:%S'` ERROR: $1 >&2; } function log() { echo `date '+%Y-%m-%d %H:%M:%S'` INFO: $1; } MAIL=$(tee) SERVER_LIST=("redacted.tld") #rspamd server PASSWORD="redacted" for SERVER in ${SERVER_LIST[@]}; do log "Trying to report spam to ${SERVER}" RETURN=$(/usr/bin/curl -s --connect-timeout 1 -H "Password: ${PASSWORD}" --data-binary --url "http://${SERVER}:11334/learnspam" -d "${MAIL}") STATUS=$? if [ $STATUS -eq 0 ]; then log "Spam reported to ${SERVER}: ${RETURN}" exit 0 else if [ $STATUS -eq 28 ]; then log_error "Reporting SPAM to ${SERVER} failed: Connection timed out." else log_error "Reporting SPAM to ${SERVER} failed: CURL exit status ${STATUS}" fi fi done log_error "Reporting SPAM failed ${SERVERS[@]}" exit 1 ###################################################################### without all "imapsieve_mailbox.* " directives the problem is gone. Thanks to everyone in advance. -- Warm regards George A. WPXHosting

2 2

"Read the 'bug reports page' …" -> 404
by H. Thiele 13 Jun '24

13 Jun '24

Hi there, while investigating how to possibly report issues to the Dovecot project I noticed that the link to the "bug reports page" in the "mailing list" section on dovecot.org is broken and leads to a 404. https://www.dovecot.org/mailing-lists/ -> "Read the 'bug reports page' before posting a bug report. …" -> "The page you are looking for is not found" regards, H. Thiele

8 10

Re: "Read the 'bug reports page' …" -> 404
by H. Thiele 13 Jun '24

13 Jun '24

I also noticed this affects local documentation in the Dovecot release (v2.3.21), e.g. the old URL is referenced in many of the man files that get installed. It is probably a good idea to setup a 301 redirect rather than just dumping a 404 on the website too. On 12/06/24 8:05 AM, aki.tuomi wrote: > Thanks for letting us know. We'll fix this soon, use > https://dovecot.org/bugreport-mail > > Aki > > -------- Original message -------- > From: "H. Thiele via dovecot" <dovecot(a)dovecot.org> > Date: 6/12/24 06:49 (GMT+00:00) > To: dovecot(a)dovecot.org > Subject: "Read the 'bug reports page' …" -> 404 > > > Hi there, > > while investigating how to possibly report issues to the Dovecot > project I noticed that the link to the "bug reports page" in > the "mailing list" section on dovecot.org is broken and leads to > a 404. > > > https://www.dovecot.org/mailing-lists/ -> > "Read the 'bug reports page' before posting a bug report. …" > > -> "The page you are looking for is not found" > > > > regards, > H. Thiele > _______________________________________________ > dovecot mailing list -- dovecot(a)dovecot.org > To unsubscribe send an email to dovecot-leave(a)dovecot.org >

1 0

Duplicate "cache" in doveadm's help text
by H. Thiele 12 Jun '24

12 Jun '24

1 0

how to disable port 143
by Jeff Peng 10 Jun '24

10 Jun '24

Hello, I have commented out this line in 10-master.conf: service imap-login { inet_listener imap { #port = 143 } But this doesn't close the port 143. So I have changed it to: service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } This let port 143 listen on local address. my question, is it possible to close port 143 entirely in dovecot? Thanks.

5 8

Lots of "Corrupted dbox file" errors in log
by simon＠simonliebold.de 10 Jun '24

10 Jun '24

Hi, I'm leaving this here for others who may see the same issue and are equally perplexed as I was: Dovecot version 2.3.16 w/ sdbox mailbox format. Yesterday, I noticed that I did not see any new mail in Thunderbird. But for whatever reason, new mail did show up on my phone with K9 mail. So, new mails were retained. In the Dovecot logs, I was seeing multiple errors: Corrupted dbox file read() failed for file No buffer space available EOF while reading file header Mailbox INBOX: sdbox: Rebuilding failed Mailbox INBOX: Deleting corrupted cache: reset_id mismatch even after locking The "Corrupted dbox file" and "EOF while reading file header" error was caused by a message file in the INBOX mailbox that was 6681 bytes in size and had all NUL characters. File date of that file was more than two years ago. The "No buffer space available" error was caused by a file that also had a lot of NUL, but also a few other characters in it. Nothing resembling regular message files with headers and body. In total it was a handful of files causing issues. I deleted them all with: doveadm expunge -u {user} MAILBOX INBOX UID {filename without the leading 'u.'} Afterwards Thunderbird showed new mails again. I did not need to restart it. No more errors in the Dovecot logs. Not sure what had caused this. Maybe somebody has seen this before. Simon

1 0

[Patch] blocklist access control for dovecot pop3/imap and pigeonhole managesieve
by John Fawcett 10 Jun '24

10 Jun '24

Hi Just in case this is useful more generally, I'm posting it to the list. While Dovecot has an access control via allow_nets, it is a user database field that applies only at the authentication stage to deny access for the specific user when there is a connection attempt from an unauthorized ip for that user. https://doc.dovecot.org/configuration_manual/authentication/allow_nets/ I don't believe there is anything that checks access at connect time to deny unwanted traffic prior to authentication, for example from compromised machines, botnets etc. Though failed connection attempts do not appear to be a significant issue, maybe better to add some safety net for the future. The attached patch is proof of concept code that introduces the parameters rbl_check and rbl_check_timeout (msecs) to the protocol section. Tested for imap, pop3 and sieve. The following is an example for sieve. protocol sieve { rbl_check = zen.spamhaus.net=127.0.0.4 rbl_check_timeout = 5000 } If the lookup results in a hit the client is disconnected with a BYE "Disconnected for policy." message and the logs report: Jun 09 12:00:56 server.example.com dovecot[977650]: managesieve-login: Disconnected: Policy (disconnected before auth was ready, waited 1 secs): user=<>, service=sieve, rip=n.n.n.n, lip=n.n.n.n The patch also makes the number of pre-login errors and post-login errors configurable (max_login_command_errors and max_command_errors respectively) for pop3, imap and sieve protocols . protocol sieve { max_command_errors = 1 max_login_command_errors = 1 } A potential extension to the logic would be "allow_nets" and "disallow_nets" parameters or maybe something more sophisticated to allow ips/networks that would otherwise be blocked or deny additional ips/networks. John

2 3

Error: Mailbox Spam: Failed to autocreate mailbox: Mailbox can't be created
by Jordan Rosenthal 09 Jun '24

09 Jun '24

Hi, I am getting the error "Error: Mailbox Spam: Failed to autocreate mailbox: Mailbox can't be created" and cannot figure out what is causing it. It seems like some sort of permissions issue, but nothing I have tried seems to fix the problem. I was running my setup for many years without issue, and this error started occurring after a recent Ubuntu upgrade. I am using getmail 6.18.4 to fetch mail from a mail server, which then calls /usr/lib/dovecot/deliver to deliver the mail to my local system. It is during this delivery that the error occurs. The dovecot-lda executable exits with status 75 and the log file contains: Jun 09 08:05:54 honeydukes dovecot[1863]: lda(sally)<1863><L9pgDaKaZWZHBwAASkLcPA>: Error: Mailbox Spam: Failed to autocreate mailbox: Mailbox can't be created Jun 09 08:05:54 honeydukes dovecot[1863]: lda(sally)<1863><L9pgDaKaZWZHBwAASkLcPA>: msgid=<REDACTED>: save failed to open mailbox Spam: Mailbox Below is my dovecot configuration. Any help would be appreciated! ------------------ # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 5.15.0-112-generic x86_64 Ubuntu 22.04.4 LTS # Hostname: honeydukes.fios-router.home lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:~/Maildir mail_privileged_group = mail maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = create special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . } passdb { driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " imap sieve" service imap-login { inet_listener imap { port = 0 } } ssl = required ssl_cert = </etc/dovecot/ssl/dovecot.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it submission_host = <redacted>.com:465 userdb { driver = passwd }

1 0

Accessing IMAP from Python with Encrypted Password
by adam＠ardaemail.com 09 Jun '24

09 Jun '24

Hello again Dovecoters! I have a need to access an IMAP mailbox via a Python script to parse and stored DMARC reports in a SQL database. Right now, I have it working however I am storing the password in plaintext in my database which obviously is not secure. How would you approach this scenario? Would you store the password in the database encrypted and configure Dovecot to accept said encrypted password? If so, can you point me in the right direction to configure Dovecot to handle this? If not, what would you recommend? Is it possible to intercept the email and upload the attachments to an AWS S3 bucket then move the email to another folder? Likewise, if someone wants to help here as well, I need to send outbound email via an authenticated user from Postfix. How would you approach this scenario? Thank you!

3 2

Can't Empty Inbox that is Over quota
by Jason Hirsh 08 Jun '24

08 Jun '24

> I have been trying to update my Postix/Dovecot/MySQL?Postfixadmin installation > > > I am currently on Dovecot. 2.3.2.1 > > I used the guide set forth in Purplehat.org <http://purplehat.org/> which is what got me in trouble as I am in between with setup. (He went off to Maria-db and NGINX I stayed with Apache and MySQL > > > What has happened is may Dovecot Mailboxes are super super saturated. adI inadvertently allowed email from an alarm > > Quota name Type Value Limit % > User quota STORAGE 239754 5120 4682 > User quota MESSAGE 882 - > > > I tried to empty with the command > > sudo doveadm expunge -A mailbox INBOX ALL > > > I get this error > > Error: auth-master: userdb list: User listing returned failure > doveadm: Error: Failed to iterate through some users. > Is there anyway I can remove Dovecot from my server and reinstalll it? It is so messed up I don’t care about losing data Jasion Hirsh

2 4

Re: Can't Empty Inbox that is Over quota
by Jason Hirsh 06 Jun '24

06 Jun '24

> On Jun 6, 2024, at 11:00 AM, Jason Hirsh <kasdivi(a)mac.com> wrote: > > > >> On Jun 6, 2024, at 3:10 AM, Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: >> >>> >>> On 06/06/2024 04:11 EEST Jason Hirsh via dovecot <dovecot(a)dovecot.org> wrote: >>> >>> >>>> Begin forwarded message: >>>> >>>> From: Jason Hirsh <kasdivi(a)mac.com> >>>> Subject: Can't Empty Inbox that is Over quota >>>> Date: June 3, 2024 at 8:15:53 PM EDT >>>> To: dovecot(a)dovecot.org >>>> >>>> I have been trying to update my Postix/Dovecot/MySQL?Postfixadmin installation >>>> >>>> >>>> I am currently on Dovecot. 2.3.2.1 >>>> >>>> I used the guide set forth in Purplehat.org <http://purplehat.org/> which is what got me in trouble as I am in between with setup. (He went off to Maria-db and NGINX I stayed with Apache and MySQL >>>> >>>> >>>> What has happened is may Dovecot Mailboxes are super super saturated. adI inadvertently allowed email from an alarm >>>> >>>> Quota name Type Value Limit % >>>> User quota STORAGE 239754 5120 4682 >>>> User quota MESSAGE 882 - >>>> >>>> >>>> I tried to empty with the command >>>> >>>> sudo doveadm expunge -A mailbox INBOX ALL >>>> >>>> >>>> I get this error >>>> >>>> Error: auth-master: userdb list: User listing returned failure >>>> doveadm: Error: Failed to iterate through some users. >>>> >>> >>> >>> Is there anyway I can remove Dovecot from my server and reinstalll it? It is so messed up I don’t care about losing data >>> >>> >>> >> >> um.. you have multiple issues. >> >> First of all, try >> > > > >> sudo doveadm expunge -u targetuser mailbox INBOX ALL >> > > > Ok I tried that ,,say its ran but postfixadmn shows the mailbox WAY quote and new message to tha user are being rejected > > "Your message to <jason(a)kasdivi.com <mailto:jason@kasdivi.com>> was automatically rejected: > Storage quota for this account has been exceeded, please try again later.Reporting-MTA: dns; triggerfish.theoceanwindow.com <http://triggerfish.theoceanwindow.com/> > Final-Recipient: rfc822; jason(a)kasdivi.com <mailto:jason@kasdivi.com> > Action: failed > Status: 5.2.2” > > So on to > > >> rf /path/to/user/home > > > It all went away. By mail doesn’t not work. Postfixadmin still shows sett is over limited. I try deleting and get a > > Problems running mailbox postdeletion script! > The mailbox postdeletion script failed, check the error log for details! > > >> -A means all users, and it only works if your userdb iteration works. >> >> If you truly do not care about user data and want just get rid of it, >> you can just rm -rf /path/to/user/home >> >> Aki

1 0

Re: Log detective help
by Michael Slusarz 06 Jun '24

06 Jun '24

> On 06/05/2024 1:22 PM MDT GDS via dovecot <dovecot(a)dovecot.org> wrote: > > Hello all, I am seeing hundreds of lines like the one below in my mail.log from this specific IP address, which belongs to Google. Is there a way to determine why this "deferred (delivery temporarily suspended)" is happening? > > Jun 5 19:09:32 arthemis postfix/error[86771]: 5D9D148296D: to=<root(a)localhost.com>, orig_to=<root@localhost>, relay=none, delay=4099, delays=4099/0.02/0/0, dsn=4.4.1, status=deferred (delivery temporarily suspended: connect to localhost.com[74.125.224.72]:25: Connection timed out) "localhost.com" - you almost certainly are intending to connect to localhost (i.e. the local loopback address, 127.0.0.1) rather than the remote domain localhost.com. So it looks like a configuration error. michael

2 1

Fwd: EXPUNGED Folder Always Visible
by Pete Long 06 Jun '24

06 Jun '24

Sorry, forgot to change the To: field :/ Pete. > Begin forwarded message: > > From: Pete Long <pete(a)valar.uk.net> > Subject: Re: EXPUNGED Folder Always Visible > Date: 6 June 2024 at 09:43:50 BST > To: Robert L Mathews <lists(a)tigertech.com> > > > >> On 5 Jun 2024, at 19:18, Robert L Mathews via dovecot <dovecot(a)dovecot.org> wrote: >> >> On Jun 5, 2024, at 12:21 AM, Pete Long via dovecot <dovecot(a)dovecot.org> wrote: >> >>> After a restart of Dovecot, I see this in the logs: >>> >>> Jun 05 08:12:07 imap(pete)<19761><KPYfSB8aj4dWH1ne>: Error: Mailbox Deleted Messages: Lazy-expunge transaction failed: Mailbox Deleted Messages: UID=1 >>> 67: lazy_expunge: Couldn't open expunge mailbox: Failed to open mailbox .EXPUNGED: Invalid mailbox name: Begins with hierarchy separator >> >> Hmmm, I'm not sure about that -- in my setup I have something different, with no actual mailbox for it: >> >> namespace { >> hidden = yes >> inbox = no >> list = no >> location = maildir:~/expunged >> prefix = .EXPUNGED/ >> separator = . >> type = private >> } >> plugin { >> lazy_expunge = .EXPUNGED/ >> lazy_expunge_only_last_instance = yes >> ... >> >> Perhaps someone else who has a similar setup to you with it as a mailbox can offer more advice, sorry! >> > > Not to worry Robert, you've given me some useful information. > > I have a workaround now which 'works for me' (TM). The gist is to copy an acl file to the .EXPUNGED mailbox when it is created, which is usually when a mail is sent, moved or deleted. I am not using global acls so note the commented line in the next paragraph. > > In /etc/dovecot/conf.d/50-expunge.conf: > > namespace inbox { > mailbox EXPUNGED { > autoexpunge = 7days > autoexpunge_max_mails = 100000 > } > } > > > mail_plugins = $mail_plugins lazy_expunge acl > plugin { > # Move messages to an .EXPUNGED mailbox > lazy_expunge = EXPUNGED > > # Define ACL so that user cannot list the .EXPUNGED mailbox > #acl = vfile:/etc/dovecot/global-acls/expunged-acl > > # Expunged messages most likely don't want to be included in quota: > quota_rule = EXPUNGED:ignore > } > > > Once the ~/Maildir/.EXPUNGED directory is created, I copy this 'dovecot-acl' file in to that .EXPUNGED directory: > > owner wstipeka > > Note that there is no l,r or x. https://doc.dovecot.org/configuration_manual/acl/#acl > > > The end result is that the .EXPUNGED mailbox contains deleted and moved mail items but the user cannot see this mailbox and cannot delete it anyway. > > If necessary I can fire up Mutt and traverse to the relevant users .EXPUNGED folder to rescue deleted items. If they also happen to have FTP and/or SSH access, I can make the dovecot-acl immutable if necessary. > > Thanks again Robert for giving me some more options. > > > All the best, > > Pete. >

1 0

Can't Empty Inbox that is Over quota
by Jason Hirsh 06 Jun '24

06 Jun '24

I have been trying to update my Postix/Dovecot/MySQL?Postfixadmin installation I am currently on Dovecot. 2.3.2.1 I used the guide set forth in Purplehat.org <http://purplehat.org/> which is what got me in trouble as I am in between with setup. (He went off to Maria-db and NGINX I stayed with Apache and MySQL What has happened is may Dovecot Mailboxes are super super saturated. adI inadvertently allowed email from an alarm Quota name Type Value Limit % User quota STORAGE 239754 5120 4682 User quota MESSAGE 882 - I tried to empty with the command sudo doveadm expunge -A mailbox INBOX ALL I get this error Error: auth-master: userdb list: User listing returned failure doveadm: Error: Failed to iterate through some users. My dovecot configurations is # 2.3.21 (47349e2482): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.21 (f6cd4b8e) # OS: FreeBSD 13.2-RELEASE-p4 amd64 ufs # Hostname: triggerfish.theoceanwindow.com dict { quota = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 110 first_valid_uid = 110 hostname = triggerfish.theoceanwindow.com last_valid_gid = 110 last_valid_uid = 110 lmtp_rcpt_check_quota = yes mail_location = maildir:/usr/local/virtual/%d/%n mail_plugins = quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { expire = Trash imapsieve_mailbox1_before = file:/usr/local/virtual/sieve/rspamd/rspamd-learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/usr/local/virtual/sieve/rspamd/rspamd-learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * imapsieve_mailbox3_before = file:/usr/local/virtual/sieve/global/read.sieve imapsieve_mailbox3_causes = COPY imapsieve_mailbox3_name = Trash mail_home = /usr/local/virtual/%d/%n mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:User quota::proxy::quota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 10%% quota_max_mail_size = 100M quota_rule = *:storage=1G quota_rule2 = Trash:storage=+30%% quota_rule3 = Sent:storage=+30%% quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning4 = -storage=100%% quota-warning -100 %u sieve = /usr/local/virtual/%d/%n/.dovecot.sieve sieve_before = /usr/local/virtual/sieve/global/default.sieve sieve_dir = /usr/local/virtual/%d/%n/sieve sieve_global = /usr/local/virtual/sieve/global/ sieve_global_dir = /usr/local/virtual/sieve/global/ sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment sieve_pipe_bin_dir = /usr/local/virtual/sieve/rspamd sieve_plugins = sieve_imapsieve sieve_extprograms } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh postmaster_address = admin(a)theoceanwindow.com protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = mail mode = 0666 user = postfix } unix_listener auth-userdb { group = mail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vscan mode = 0660 user = vscan } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/virtual/bin/quota-warning.sh unix_listener quota-warning { user = vscan } user = dovecot } ssl_ca = </usr/local/etc/ssl/openssl/theoceanwindow.com/ca_bundle.crt ssl_cert = </usr/local/etc/ssl/openssl/theoceanwindow.com/certificate.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = quota quota sieve zlib } protocol imap { mail_plugins = quota quota imap_quota zlib } protocol pop3 { mail_plugins = quota } jason@triggerfish:/usr/local/etc/apache24/extra: Sorry about the colors. I am at whit ends with the system and dont have the energy to take on apple mail formating I imagine I have messed up a Mysql query? Thanks for bearing with me

2 2

Log detective help
by GDS 06 Jun '24

06 Jun '24

Hello all, I am seeing hundreds of lines like the one below in my mail.log from this specific IP address, which belongs to Google. Is there a way to determine why this "deferred (delivery temporarily suspended)" is happening? Jun 5 19:09:32 arthemis postfix/error[86771]: 5D9D148296D: to=<root(a)localhost.com>, orig_to=<root@localhost>, relay=none, delay=4099, delays=4099/0.02/0/0, dsn=4.4.1, status=deferred (delivery temporarily suspended: connect to localhost.com[74.125.224.72]:25: Connection timed out) Thank you,Greg

2 1

EXPUNGED Folder Always Visible
by Pete Long 05 Jun '24

05 Jun '24

Hi all, I'm having a bit of a time trying to get the EXPUNGED mailbox to not display when any mail is moved or deleted. Here's what I'm running: Operating System = Debian 11.9 Dovecot = 2.3.13 MUA = Mac OS X Mail 16.0 $3774.600.62$ Here is the information I think is relevant: # cat /etc/dovecot/conf.d/50-expunge.conf namespace INBOX { mailbox EXPUNGED { autoexpunge = 7days autoexpunge_max_mails = 10000 } } mail_plugins = $mail_plugins lazy_expunge acl plugin { lazy_expunge = EXPUNGED quota_rule = EXPUNGED:ignore } # cat /etc/dovecot/conf.d/90-acl.conf [...] plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 } [...] # cat /etc/dovecot/global-acls/expunged.acl EXPUNGED user=masteruser lr I have also tried setting 'expunged.acl' to the following, with no ACL flags: EXPUNGED owner This version doesn't seem to do anything different but that's probably down to me. No matter what I do with this current configuration, I cannot get the EXPUNGED folder to stop showing after any deletion or move. This point aside, Dovecot's doing almost exactly what I want: all mail moved or deleted ends up in EXPUNGED; I just don't want to see it, nor anyone else with an account on my server ;) Thanks for your time and any information you can provide. Pete.

2 3

Debug: open(/proc/self/io) failed: Permission denied
by se＠maildaddy.eu 01 Jun '24

01 Jun '24

Tried all kinds of user setup, and read what I found on different foras, but still get: "Debug: open(/proc/self/io) failed: Permission denied" Is anyone able to spot the misconfig? Thanks in advance! This is my dovecot -n: # 2.3.7.2 (3c910f64b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.7.2 () # OS: Linux 5.4.70-050470-generic x86_64 Ubuntu 20.04.6 LTS # Hostname: host auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_username_format = %Ln mail_location = maildir:~/Maildir mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { auto = create special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = create special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = create special_use = \Trash } prefix = } passdb { driver = pam } protocols = imap pop3 lmtp imap lmtp pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = required ssl_cert = </etc/letsencrypt/live/mail.spijoing.com/fullchain.pem ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { driver = passwd }

2 2

problem setting sieve_vacation_send_from_recipient = yes
by schuerbel＠vodafonemail.de 01 Jun '24

01 Jun '24

Hello, dovecot sieve sends vacation replies with an empty FROM: field by default. Sadly my provider rejects such emails. I tried to change this behavior by adding sieve_vacation_send_from_recipient = yes to the plugin section in dovecot.conf. But still vacation replies are send with empty FROM: fields. Is there any further setting i have to change ? My Version is dovecot 2.3.16 (7e2e900c1a) on Ubuntu 22.04 . Here is my setting from dovecot -n : log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:~/Maildir mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_vacation_send_from_recipient = yes } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } user = root } ssl_cert = </etc/ssl/localcerts/servercert_pub.pem ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM ssl_key = # hidden, use -P to show it userdb { driver = passwd } userdb { driver = passwd } verbose_ssl = yes protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = torben(a)garfield.no-work.to quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } regards TS

1 0

sasl database
by Jeff P 01 Jun '24

01 Jun '24

Hello, Is there a guide for using a customized SASL database for dovecot? for example, SQLite. Thanks in advance.

3 2

Pigenohole bad commands limits and proposed minor patch
by John Fawcett 01 Jun '24

01 Jun '24

Hi I was looking into Pigeonhole behaviour in the case of managesieve receiving invalid input either before or after login. I can see that there are hard coded limits after 3 sequential bad commands prior to authentication and 20 after authentication. I was wondering if there is a reason for those values. Sieve is a protocol that is used with software and except for the limited use case of testing it is not used by people typing manually. I don't know of a lot of sieve clients. Unfortunately the one I used in Thunderbird is no longer maintained, so I only have roundcube. But do legitimate sieve clients in general make a lot of mistakes? An additional doubt about errors that I am seeing is that differently to imap and pop3 there doen't appear to be a dedicated ssl port. I only have starttls configured. I do see what look like people trying to connect with ssl directly on port 4190, which with my configuration is never going to be valid. I am attaching a very simple proposed patch to make the error limits configurable via the following settings in conf.d/20-managesieve.conf with defaults as per the existing hard coded ones: managesieve_max_command_errors = 20 managesieve_login_max_command_errors = 3 I have similar doubts about imap error limits but I'll start with sieve ones. John

1 0

Unable to get quotas working
by Adam Miller 01 Jun '24

01 Jun '24

Ubuntu Version: Linux 6.2.0-1017-aws x86_64 Ubuntu 22.04.4 LTS nfs4 Postfix: Version: 3.6.4 Dovecot Version: 2.3.16 (7e2e900c1a) Pigeonhole Version: 0.5.16 (09c29328) Rspamd Version: 3.8.4 Protocols: IMAP, LMTP, SMTP Setup: I have an email server running with virtual domains and virtual mailboxes that is currently hosting about 10GB of email across 15 domains and 8 mailboxes which will expand drastically once I get this to work. The server is an AWS EC2 instance with an AWS RDS instance for the database and using AWS EFS for storage. Everything works quite well except quotas! Problem: I am having an issue with getting quotas to work. When using “doveadm”, I can list the mailboxes however the “Limit” column is just a hyphen “-“ like there is no limit even though every account is set to 10GB for their limit in the database. At the same time, the actual used storage and messages is not getting updated in the database either yet there are no errors from what I can see in the logging. Configuration from “dovecot -n”: auth_debug = yes auth_mechanisms = plain login auth_verbose = yes auth_worker_max_count = 5 base_dir = /var/run/dovecot debug_log_path = /var/log/dovecot/debug.log default_internal_group = ardaemail default_internal_user = ardaemail dict { quota = mysql:/etc/dovecot/inc.d/inc.quota.user.sql.conf } info_log_path = /var/log/dovecot/info.log instance_name = ec2-us-east-1a-arda-mail-001.ardaemail.com listen = 172.16.0.200 log_path = /var/log/dovecot/general.log login_greeting = Welcome to ArdaEmail mail_debug = yes mail_gid = ardaemail mail_location = maildir:/mnt/mail/%d/%n mail_plugins = " quota" mail_uid = ardaemail maildir_stat_dirs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = no special_use = \Drafts } mailbox Junk { auto = no autoexpunge = 30 days special_use = \Junk } mailbox "Junk E-mail" { auto = no autoexpunge = 30 days special_use = \Junk } mailbox "Junk Email" { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = no special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = no autoexpunge = 30 days special_use = \Trash } prefix = } passdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } plugin { imapsieve_mailbox1_before = file:/etc/dovecot/sieve.d/spam/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve.d/spam/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * quota = dict:quota::proxy::quota quota_exceeded_message = 452 4.2.2 Mailbox is full and cannot receive any more emails recipient_delimiter = + sieve_after = /etc/dovecot/sieve.d/after/ sieve_before = /etc/dovecot/sieve.d/before/ sieve_extensions = +spamtest +spamtestplus +virustest +notify +imapflags sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_quota_max_storage = 0 sieve_spamtest_max_header = X-Spam-Score: -?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]) sieve_spamtest_status_header = X-Spam-Score: (-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]] sieve_spamtest_status_type = score } protocols = imap lmtp service auth-worker { group = ardaemail user = ardaemail } service auth { group = ardaemail unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = ardaemail mode = 0666 user = ardaemail } user = ardaemail } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service imap { group = ardaemail user = ardaemail } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } service submission-login { inet_listener submission { port = 0 } } ssl = required ssl_cert = </etc/letsencrypt/live/mail.ardaemail.com/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } verbose_ssl = yes protocol imap { mail_plugins = " quota imap_sieve imap_quota quota" } protocol lmtp { mail_plugins = " quota sieve imap_quota quota" } Configuration for “/etc/dovecot/inc.d/inc.quota.user.sql.conf”: connect = host=mydb dbname=mydb user=mydbuser password=mydbpass map { pattern = priv/quota/storage table = mailbox username_field = email value_field = size } map { pattern = priv/quota/limit/storage table = mailbox username_field = email value_field = quota } map { pattern = priv/quota/messages table = mailbox username_field = email value_field = size_messages } map { pattern = priv/quota/limit/storage table = mailbox username_field = email value_field = quota_messages } Configuration from “/etc/dovecot/inc.d/inc.sql.conf”: driver = mysql connect = host=mydb dbname=mydb user=mydbuser password=mydbpass default_pass_scheme = BLF-CRYPT password_query = SELECT email AS user, password FROM mailbox WHERE email = '%u'; user_query = SELECT maildir AS home, 10000 AS uid, 10000 AS gid, 'dict:quota::proxy::quota' AS quota FROM mailbox WHERE email = '%u'; iterate_query = SELECT email AS username, size, 'dict:quota::proxy::quota' AS quota FROM mailbox ORDER BY domainName ASC, email ASC; Database Table: “mailbox” CREATE TABLE `mailbox` ( `id` int(11) unsigned NOT NULL AUTO_INCREMENT, `uuid` varchar(36) NOT NULL, `domainUuid` varchar(36) NOT NULL, `domainName` varchar(96) DEFAULT NULL, `username` varchar(96) NOT NULL DEFAULT '', `password` varchar(128) NOT NULL, `firstname` varchar(32) NOT NULL, `lastname` varchar(32) NOT NULL, `email` varchar(192) NOT NULL DEFAULT '', `maildir` text NOT NULL, `quota` bigint(24) NOT NULL DEFAULT 0, `quota_messages` bigint(24) NOT NULL DEFAULT 0, `size` bigint(24) NOT NULL DEFAULT 0, `size_messages` bigint(24) NOT NULL DEFAULT 0, `isActive` tinyint(1) NOT NULL DEFAULT 1, `createdAt` datetime NOT NULL DEFAULT current_timestamp(), `updatedAt` datetime NOT NULL DEFAULT current_timestamp() ON UPDATE current_timestamp(), PRIMARY KEY (`id`), UNIQUE KEY `UNIQUE_UUID` (`uuid`) ) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_general_ci; Where “username” is the first part of the email address and “email” is the full email address. I need to query using the full email address because of possible cross domain email addresses. Output from “doveadm quota get -A”: Username Quota name Type Value Limit % HIDDEN quota STORAGE 570742 - 0 HIDDEN quota MESSAGE 0 - 0 HIDDEN quota STORAGE 1 - 0 HIDDEN quota MESSAGE 0 - 0 HIDDEN quota STORAGE 1 - 0 HIDDEN quota MESSAGE 0 - 0 HIDDEN quota STORAGE 1068 - 0 HIDDEN quota MESSAGE 0 - 0 HIDDEN quota STORAGE 462 - 0 HIDDEN quota MESSAGE 0 - 0 HIDDEN quota STORAGE 41165 - 0 HIDDEN quota MESSAGE 0 - 0 HIDDEN quota STORAGE 1598246 - 0 HIDDEN quota MESSAGE 0 - 0 HIDDEN quota STORAGE 695776 - 0 HIDDEN quota MESSAGE 0 - 0 I have no idea what is wrong and I have been at this for over 12 hours trying to get the quotas to work. What I am expecting us when emails are delivered for the “quota” and “messages” columns in the “mailbox” table to be updated and when I run “doveadm quota get -A” to show me the current usages and limits for each mailbox. Once I have that working, I will move on to actually rejecting emails via Postfix + Dovecot LMTP when a users mailbox is full but right now, I am just trying to get this to work. Any help is greatly appreciated. Also, I tried creating an account for the mailing list but never received the email. Thank you!

3 5

Gather statistics to check effectivity of spam filter?
by Camilo Sperberg 30 May '24

30 May '24

Hi list :) We want to make some changes to our spam filter, but we first want to be able to check if what we do does have any effect. So I was thinking of storing in our statistics if somebody moves an email to their Junk folder (or even better: vice versa). I have created the following metric for this: metric imap_command_move { filter = event=imap_command_finished AND cmd_name="UID MOVE" AND (cmd_args = "* Junk" OR cmd_args = "* INBOX") group_by = cmd_args } And when I move something to the Junk folder I get the following after a doveadm stats dump: (...) imap_command_move duration 5 252529 27061 124989 50505.80 34476 37503.81 124989 imap_command_move_15_Junk duration 1 124989 124989 124989 124989.00 124989 0.00 124989 imap_command_move_14_Junk duration 1 38725 38725 38725 38725.00 38725 0.00 38725 imap_command_move_12_INBOX duration 1 27061 27061 27061 27061.00 27061 0.00 27061 imap_command_move_13_INBOX duration 1 27278 27278 27278 27278.00 27278 0.00 27278 imap_command_move_3_INBOX duration 1 34476 34476 34476 34476.00 34476 0.00 34476 In my example, I moved 6 messages: 2 from INBOX to Junk, 1 from INBOX to a separate folder, 2 from Junk back to INBOX and 1 from the separate folder back to INBOX. However, because I'm grouping by cmd_args, it includes the full parameters: IMAP command’s full parameters (e.g. 1:* FLAGS) https://doc.dovecot.org/admin_manual/list_of_events/#imap-command Is there a way to filter out the first part so that I ideally get a stat named imap_command_move_Junk & imap_command_move_INBOX? Is there perhaps a way to get to know specifically the from and to folders the user is moving the mail from and to? Thanks!

1 0

mbox parsing failed and crashed
by runtomaker＠gmail.com 28 May '24

28 May '24

In below data getting from Postfix. Dovecot imap protocol when fetching mails returns no data. So program crashing when parsing mbox file. Mbox file: "From info(a)asd.com Tue May 28 14:53:11 2024 Return-Path: <info(a)asd.com> X-Original-To: test(a)example.com Delivered-To: test(a)example.com Subject: asd " Error: "Panic: file istream-header-filter.c: line 663 (i_stream_header_filter_snapshot_free): assertion failed: (snapshot->mstream->snapshot_pending)"

1 1

Oauth2 MFA config
by Scott Q. 24 May '24

24 May '24

Anyone managed to get Dovecot working as smoothly with OAUTH2 as Gmail has with Outlook ? So that for example when you add the account up in Outlook it performs all the required steps for saving the device, getting tokens, etc. Ideally with a custom ID provider, not Google as described here: https://doc.dovecot.org/configuration_manual/authentication/oauth2/

2 1

I can't configure shared mailbox ACLs using LDAP information
by moso.mosoleu＠gmail.com 24 May '24

24 May '24

It shouldn't be impossible, but I've tried countless ways and not even ChatGPT 4o was able to help me! :D I use three LDIF files to get OpenLDAP ready for testing. In the first LDIF I just modify the schema to add the associatedDomain attributes (then I could configure the server to serve more than one domain). The second LDIF is to add 4 objects to the schema that I use to differentiate accounts that actually receive/send emails and have a password; another thing done in it is to add a "groupOfUniqueNamesWithMail" object that allows the "mail" and "mailEnabled" attributes that are then necessary to use in the entries created in the "shared-mailboxes" OU. Finally, the third LDIF populates the LDAP by creating OUs, user accounts and creating entries in "shared-mailboxes" that serve to say which user accounts have access to which other user accounts. When I start the email server, sending and receiving emails works perfectly. And mailbox shares work as expected if I manually use, for each share, the command: doveadm acl set -u admin(a)mydomain.com.br INBOX user=user.1(a)mydomain.com.br lookup read write write-seen write-deleted insert post expunge create delete But just as authentication works perfectly via LDAP, I believe there must be a way to configure Dovecot to dynamically adjust ACLs via LDAP. The configuration in principle would be this: acl_search_base = ou=shared-mailboxes,dc=mydomain,dc=com,dc=br acl_search_filter = (&(objectClass=groupOfUniqueNamesWithMail)(|(uniqueMember=mail=%u,ou=system-accounts,dc=mydomain,dc=com,dc=br)(uniqueMember=mail=%u,ou=department-accounts ,dc=mydomain,dc=com,dc=br)(uniqueMember=mail=%u,ou=mailing-accounts,dc=mydomain,dc=com,dc=br)(uniqueMember=mail=%u,ou=person -accounts,dc=mydomain,dc=com,dc=br))) acl_user = %u Testing this filter on the command line with "ldapsearch" the expected results are returned. I mean, I enter an email address from a user account and the result is all the other user account email addresses that the first one would have access to. Any charitable soul who is willing to help and needs more information, just say what you need and I will try to respond as quickly as possible. I will place the content of the three LDIFs below. [ 01-modify_domain.ldif ] dn: dc=mydomain,dc=com,dc=br changetype: modify add: objectClass objectClass: domainRelatedObject - add: associatedDomain associatedDomain: mydomain.com.br - add: associatedDomain associatedDomain: anotherdomain.com.br [ 02-add_my_object_classes_to_schema.ldif ] # Object class for system user accounts dn: cn=SystemAccount,cn=schema,cn=config objectClass: olcSchemaConfig cn: SystemAccount olcObjectClasses: ( 1.3.6.1.4.1.99999.1.1 NAME 'SystemAccount' DESC 'Object class for system accounts' SUP top AUXILIARY ) # Object class for department user accounts dn: cn=DepartmentAccount,cn=schema,cn=config objectClass: olcSchemaConfig cn: DepartmentAccount olcObjectClasses: ( 1.3.6.1.4.1.99999.1.2 NAME 'DepartmentAccount' DESC 'Object class for department accounts' SUP top AUXILIARY ) # Object class for mailing user accounts dn: cn=MailingAccount,cn=schema,cn=config objectClass: olcSchemaConfig cn: MailingAccount olcObjectClasses: ( 1.3.6.1.4.1.99999.1.3 NAME 'MailingAccount' DESC 'Object class for mailing accounts' SUP top AUXILIARY ) # Object class for person user accounts dn: cn=PersonAccount,cn=schema,cn=config objectClass: olcSchemaConfig cn: PersonAccount olcObjectClasses: ( 1.3.6.1.4.1.99999.1.4 NAME 'PersonAccount' DESC 'Object class for person accounts' SUP top AUXILIARY ) # Object class that allows groupOfUniqueNames to have a mail attribute dn: cn=groupOfUniqueNamesWithMail,cn=schema,cn=config objectClass: olcSchemaConfig cn: groupOfUniqueNamesWithMail olcObjectClasses: ( 1.3.6.1.4.1.99999.1.5 NAME 'groupOfUniqueNamesWithMail' SUP groupOfUniqueNames STRUCTURAL MAY ( mail $ mailEnabled ) ) [ 03-initialize_mydomain.com.br.ldif ] ### Create organizaitonal units dn: ou=system-accounts,dc=mydomain,dc=com,dc=br ou: system-accounts objectClass: organizaitonalUnit objectClass: top dn: ou=department-accounts,dc=mydomain,dc=com,dc=br ou: department-accounts objectClass: organizaitonalUnit objectClass: top dn: ou=mailing-accounts,dc=mydomain,dc=com,dc=br ou: mailing-accounts objectClass: organizaitonalUnit objectClass: top dn: ou=person-accounts,dc=mydomain,dc=com,dc=br ou: person-accounts objectClass: organizaitonalUnit objectClass: top dn: ou=shared-mailboxes,dc=mydomain,dc=com,dc=br ou: shared-mailboxes objectClass: organizaitonalUnit objectClass: top ################################################################################ ## Create System User Accounts # not related to a person # can be accessed directly or indirectly by more than one person dn: mail=admin(a)mydomain.com.br,ou=system-accounts,dc=mydomain,dc=com,dc=br uid: admin userPassword: {SSHA} displayName: My Domain - Admin givenName: System sn: Admin cn: System Admin mail: admin(a)mydomain.com.br mailAlias: root(a)mydomain.com.br mailAlias: postmaster(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/system-accounts/admin/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/system-accounts/admin/ descripiton: My Domain - Admin (root/postmaster) objectClass: PostfixBookMailAccount objectClass: SystemAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top dn: mail=smtp(a)mydomain.com.br,ou=system-accounts,dc=mydomain,dc=com,dc=br uid: smtp userPassword: {SSHA} displayName: My Domain - SMTP givenName: System sn: SMTP cn: System SMTP mail: smtp(a)mydomain.com.br mailAlias: no-reply(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/system-accounts/smtp/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/system-accounts/smtp/ descripiton: My Domain - System SMTP objectClass: PostfixBookMailAccount objectClass: SystemAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top dn: mail=smtp-auditor(a)mydomain.com.br,ou=system-accounts,dc=mydomain,dc=com,dc=br uid: smtp-auditor userPassword: {SSHA} displayName: My Domain - SMTP Auditor givenName: System sn: SMTP Auditor cn: System SMTP Auditor mail: smtp-auditor(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/system-accounts/smtp-auditor/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/system-accounts/smtp-auditor/ descripiton: My Domain - System SMTP Auditor objectClass: PostfixBookMailAccount objectClass: SystemAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top ################################################################################ ## Create Department User Accounts # not related to a person # can be accessed directly or indirectly by more than one person dn: mail=it(a)mydomain.com.br,ou=department-accounts,dc=mydomain,dc=com,dc=br uid: it userPassword: {SSHA} displayName: My Domain - Information Technology givenName: My Domain sn: IT cn: My Domain - IT mail: it(a)mydomain.com.br mailAlias: information.technology(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/department-accounts/it/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/department-accounts/it/ descripiton: My Domain - Information Technology (IT) objectClass: PostfixBookMailAccount objectClass: DepartmentAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top ################################################################################ ## Create Mailing User Accounts # not related to a person # can be accessed directly or indirectly by more than one person dn: mail=everyone(a)mydomain.com.br,ou=mailing-accounts,dc=mydomain,dc=com,dc=br uid: everyone userPassword: {SSHA} displayName: My Domain - Everyone givenName: My Domain sn: everyone cn: My Domain - Everyone mail: everyone(a)mydomain.com.br mailAlias: everyone(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/mailing-accounts/everyone/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/mailing-accounts/everyone/ descripiton: My Domain - Everyone mailing list objectClass: PostfixBookMailAccount objectClass: MailingAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top dn: mail=mailing.list.1(a)mydomain.com.br,ou=mailing-accounts,dc=mydomain,dc=com,dc=br uid: mailing.list.1 userPassword: {SSHA} displayName: My Domain - Mailing List 1 givenName: My Domain sn: Mailing List 1 cn: My Domain - Mailing List 1 mail: mailing.list.1(a)mydomain.com.br mailAlias: ml.1(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/mailing-accounts/mailing.list.1/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/mailing-accounts/mailing.list.1/ descripiton: My Domain - Mailing List 1 objectClass: PostfixBookMailAccount objectClass: MailingAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top dn: mail=mailing.list.2(a)mydomain.com.br,ou=mailing-accounts,dc=mydomain,dc=com,dc=br uid: mailing.list.2 userPassword: {SSHA} displayName: My Domain - Mailing List 2 givenName: My Domain sn: Mailing List 2 cn: My Domain - Mailing List 2 mail: mailing.list.2(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/mailing-accounts/mailing.list.2/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/mailing-accounts/mailing.list.2/ descripiton: My Domain - Mailing List 2 objectClass: PostfixBookMailAccount objectClass: MailingAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top ################################################################################ ## Create Person User Accounts dn: mail=user.1(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br uid: user.1 userPassword: {SSHA} displayName: User 1 givenName: User sn: 1 cn: User 1 mail: user.1(a)mydomain.com.br mailAlias: user.one(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/person-accounts/user.1/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/person-accounts/user.1/ descripiton: My Domain - User 1 objectClass: PostfixBookMailAccount objectClass: PersonAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top dn: mail=user.2(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br uid: user.2 userPassword: {SSHA} displayName: User 2 givenName: User sn: 2 cn: User 2 mail: user.2(a)mydomain.com.br mailAlias: user.two(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/person-accounts/user.2/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/person-accounts/user.2/ descripiton: My Domain - User 2 objectClass: PostfixBookMailAccount objectClass: PersonAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top dn: mail=user.3(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br uid: user.3 userPassword: {SSHA} displayName: User 3 givenName: User sn: 3 cn: User 3 mail: user.3(a)mydomain.com.br mailAlias: user.three(a)mydomain.com.br mailEnabled: TRUE mailUidNumber: 5000 mailGidNumber: 5000 mailHomeDirectory: /var/mail/mydomain.com.br/person-accounts/user.3/ mailStorageDirectory: maildir:/var/mail/mydomain.com.br/person-accounts/user.3/ descripiton: My Domain - User 3 objectClass: PostfixBookMailAccount objectClass: PersonAccount objectClass: inetOrgPerson objectClass: organizaitonalPerson objectClass: person objectClass: top ################################################################################ ## for Shared System User Accounts dn: cn=admin(a)mydomain.com.br,ou=shared-mailboxes,dc=mydomain,dc=com,dc=br mail: admin(a)mydomain.com.br mailEnabled: TRUE uniqueMember: mail=user.1(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br objectClass: groupOfUniqueNames objectClass: groupOfUniqueNamesWithMail objectClass: top ## for Shared Department User Accounts dn: cn=it(a)mydomain.com.br,ou=shared-mailboxes,dc=mydomain,dc=com,dc=br mail: it(a)mydomain.com.br mailEnabled: TRUE uniqueMember: mail=user.1(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br objectClass: groupOfUniqueNames objectClass: groupOfUniqueNamesWithMail objectClass: top ## for Shared Mailing User Accounts dn: cn=everyone(a)mydomain.com.br,ou=shared-mailboxes,dc=mydomain,dc=com,dc=br mail: everyone(a)mydomain.com.br mailEnabled: TRUE uniqueMember: mail=user.1(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br uniqueMember: mail=user.2(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br uniqueMember: mail=user.3(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br objectClass: groupOfUniqueNames objectClass: groupOfUniqueNamesWithMail objectClass: top dn: cn=mailing.list.1(a)mydomain.com.br,ou=shared-mailboxes,dc=mydomain,dc=com,dc=br mail: mailing.list.1(a)mydomain.com.br mailEnabled: TRUE uniqueMember: mail=user.2(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br uniqueMember: mail=user.3(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br objectClass: groupOfUniqueNames objectClass: groupOfUniqueNamesWithMail objectClass: top dn: cn=mailing.list.2(a)mydomain.com.br,ou=shared-mailboxes,dc=mydomain,dc=com,dc=br mail: mailing.list.2(a)mydomain.com.br mailEnabled: TRUE uniqueMember: mail=user.1(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br objectClass: groupOfUniqueNames objectClass: groupOfUniqueNamesWithMail objectClass: top ## for Shared User Accounts dn: cn=user.2(a)mydomain.com.br,ou=shared-mailboxes,dc=mydomain,dc=com,dc=br mail: user.2(a)mydomain.com.br mailEnabled: FALSE uniqueMember: mail=user.1(a)mydomain.com.br,ou=person-accounts,dc=mydomain,dc=com,dc=br objectClass: groupOfUniqueNames objectClass: groupOfUniqueNamesWithMail objectClass: top

3 3

Command "doveadm director kick ...." doesn't work
by g.carabella＠panservice.it 23 May '24

23 May '24

Hi, I have a Dovecot installation (version 2.3.16) with 3 directors and 4 backend servers. Three backend servers have the director_tag 'new', one has the director_tag 'old'. The users are on the DB, the director_tag is a table field. I want to migrate mailboxes from the old backend (Maildir format) to the new (mdbox format). For the migration I use the "doveadm backup" command and everything works fine. The problem I'm having is that I can't kick the user (if logged in). Once the migration is done (as indicated https://doc.dovecot.org/3.0/man/doveadm-sync.1/) I modify the user's home, mail_location and director_tag and then execute the command "doveadm director kick ..." but the connection on the directors is not killed. Why does this problem occur? Could it be due to the use of the director_tag and the fact that for the command "doveadm director kick ..." it is not possible to specify it? Even if I run the command "doveadm director move mailbox_account new_backend_server", the director adds a new connection but does not kill the previous one, with the result that there are two connections for the same user, one on the new backend and one on the old one. I also tried to configure the director_tag only for the 3 new servers, but the "director kick" still doesn't work.

1 0

Problems using non-libc memory allocators
by bl0v3 22 May '24

22 May '24

Hey I was trying to use dovecot2 with a not libc based memory allocation such as scudo or graphene-hardened or graphene-hardened-light but ran into the issues I described in https://github.com/NixOS/nixpkgs/issues/313721 I just wanted to mention this here as well as this behavior may suggest a flaw in the memory allocation mechanism of dovecot2/anvil. I haven't yet found the time to check the underlaying issue as I'm quite busy rn. So I thought id just mention what I came across in case this is actually unexpected or potentially even security relevant mis/behavior.

2 1

Dovecot calculating quota wrong or am I stupid?
by jarland＠mxroute.com 21 May '24

21 May '24

I'm currently running 2.3.21 on this system and here's what I'm seeing (a bit cut down for excess): # doveadm quota get -u emailuser(a)domain.net STORAGE 1052385 MESSAGE 2741 So the storage is roughly more than 1GB according to Dovecot. No change after quota recalc. But: root@arrow:/home/username/imap/domain.net# du -sh emailuser 692M emailuser There are no symlinks or anything like that. Quota config is pretty basic: root@arrow:/etc/dovecot# cat conf.d/90-quota.conf #add quota to end of line in: #/etc/dovecot/conf/mail_plugins.conf, eg: #mail_plugins = $mail_plugins quota #add imap_quota to end of line in: #/etc/dovecot/conf/imap_mail_plugins.conf, eg: #mail_plugins = $mail_plugins imap_quota plugin { quota = maildir } If anyone has advice I would greatly appreciate it.

1 1

Re: After user disconnect run the custom script
by Michael Slusarz 20 May '24

20 May '24

> On 05/20/2024 9:43 AM MDT Alexey Krylov via dovecot <dovecot(a)dovecot.org> wrote: > > Please, send me the link, where I can find the info about configuring > firing script after dovecot client is disconnected. > > I found post-login scripting. Than's cool, but... I need to fire script > a little bit later. See https://doc.dovecot.org/admin_manual/list_of_events/#mail-user-session-fini… You will need to build a event listener for this event, and then do your scripting in there. michael

1 0

After user disconnect run the custom script
by Alexey Krylov 20 May '24

20 May '24

Sirs, good day. Please, send me the link, where I can find the info about configuring firing script after dovecot client is disconnected. I found post-login scripting. Than's cool, but... I need to fire script a little bit later. May be I try to build crutches... But I wish with all my heart to do this. Thanks to everyone who responded. -- Это сообщение было проверено антивирусным ПО Avast на наличие вирусов. www.avast.com

1 0

Errors after enable add mail_attachment_detection_options
by Ricardo Machini 20 May '24

20 May '24

Hello, I got a lot of fatal errors on differents mailbox after I added the option: mail_attachment_detection_options = add-flags Rocky Linux release 8.9 (Green Obsidian) 2.3.21 (47349e2482) May 16 15:03:00 Panic: imap(user(a)domain.com.br)<1669762><cOqoC5YYQlq63CaF>: file imap-sieve-storage.c: line 317 (imap_sieve_add_mailbox_event): assertion failed: (ismt->src_box == NULL || ismt->src_box == src_box) May 16 15:03:00 Error: imap(user(a)domain.com.br)<1669762><cOqoC5YYQlq63CaF>: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x41) [0x7f2c9d8b9761] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x22) [0x7f2c9d8b9882] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10bb6b) [0x7f2c9d8c6b6b] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10bc07) [0x7f2c9d8c6c07] -> /usr/lib64/dovecot/libdovecot.so.0(+0x5cec5) [0x7f2c9d817ec5] -> /usr/lib64/dovecot/lib95_imap_sieve_plugin.so(+0x7ebc) [0x7f2c9b011ebc] -> /usr/lib64/dovecot/lib95_imap_sieve_plugin.so(+0x815f) [0x7f2c9b01215f] -> /usr/lib64/dovecot/lib20_zlib_plugin.so(+0x4a37) [0x7f2c9c179a37] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mail_free+0x12) [0x7f2c9dc73982] -> /usr/lib64/dovecot/lib95_imap_sieve_plugin.so(+0x71be) [0x7f2c9b0111be] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_free+0x1e) [0x7f2c9dbef55e] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xf124f) [0x7f2c9dc8624f] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x80) [0x7f2c9dc9f900] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_transaction_commit+0xf1) [0x7f2c9dc867e1] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xccb15) [0x7f2c9dc61b15] -> /usr/lib64/dovecot/lib95_imap_sieve_plugin.so(+0x885d) [0x7f2c9b01285d] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0x13de4) [0x7f2c9c79fde4] -> /usr/lib64/dovecot/lib15_notify_plugin.so(+0x240d) [0x7f2c9c9cf40d] -> /usr/lib64/dovecot/lib10_quota_plugin.so(+0xfcdf) [0x7f2c9cde5cdf] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x7a) [0x7f2c9dc000ba] -> dovecot/imap [user(a)domain.com.br 186.220.38.133 UID COPY](+0x153c2) [0x559668ce73c2] -> dovecot/imap [user(a)domain.com.br 186.220.38.133 UID COPY](command_exec+0x6c) [0x559668cf559c] -> dovecot/imap [user(a)domain.com.br 186.220.38.133 UID COPY](+0x215af) [0x559668cf35af] -> dovecot/imap [user(a)domain.com.br 186.220.38.133 UID COPY](+0x21661) [0x559668cf3661] -> dovecot/imap [user(a)domain.com.br 186.220.38.133 UID COPY](+0x21882) [0x559668cf3882] -> dovecot/imap [ user(a)domain.com.br 186.220.38.133 UID COPY](client_handle_input+0x1c5) [0x559668cf3a95] -> dovecot/imap [user(a)domain.com.br 186.220.38.133 UID COPY](client_input+0x76) [0x559668cf3f96] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x6d) [0x7f2c9d8dd84d] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x139) [0x7f2c9d8def09] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x50) [0x7f2c9d8dd8f0] May 16 15:03:00 Fatal: imap(user(a)domain.com.br)<1669762><cOqoC5YYQlq63CaF>: master: service(imap): child 1669762 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps) Regards, Ricardo

1 0

Change the default base_dir to /run from ${prefix}/var/run
by Дилян Палаузов 20 May '24

20 May '24

Hello, at 6b1bcf1bad1d7, calling ./configure && make install sets prefix=/usr/local, and thus the default base_dir = /usr/local/var/run/dovecot. Moreover it installs /usr/lib/systemd/system/dovecot.service with [Service] ProtectSystem=full. ProtectSystem=full mounts /usr as read-only, so no files can be written under the default base_dir. The Linux Hierachy Standard says for /usr/local - https://refspecs.linuxfoundation.org/FHS_3.0/fhs/ch04s09.html - directories bin, etc, games, include, lib, man, sbin, share, and src must be in /usr/local. No other directories, except those listed below, may be in /usr/local after first installing a FHS-compliant system. var is not listed below. (“below” means the citation above, not the next paragraph) For /var/run LSH contains - https://refspecs.linuxfoundation.org/FHS_3.0/fhs-3.0.html#varrunRuntimeVari… - This directory was once intended for system information data describing the system since it was booted. These functions have been moved to /run; this directory exists to ensure compatibility with systems and software using an older version of this specification. In general, the requirements for /run shall also apply to /var/run. It is valid to implement /var/run as a symlink to /run. . For /run LHS mentions “This directory contains system information data describing the system since it was booted. Files under this directory must be cleared (removed or truncated as appropriate) at the beginning of the boot process.” The defaults base_dir=/usr/local/var/run/dovecot and ProtectSystem=full present a non-working configuration. • Please consider changing the default (implicit) value of base_dir to /run. • When prefix is /usr/local, then dovecot.service should be installed in /usr/local/lib/systemd/system/. Kind regards Дилян

1 1

example/config misses required section names for passdb{} and userdb{}
by Дилян Палаузов 20 May '24

20 May '24

Hello, I installed Dovecot from git 6b1bcf1bad1d78e, copied /usr/local/share/doc/dovecot/example/config to /usr/local/etc/dovecot and called dovecot -F . The system reported doveconf: Fatal: Error in configuration file /usr/local/etc/dovecot/conf.d/auth-system.conf.ext line 11: passdb { } is missing section name The problem remains, if I delete dovecot-dict-auth.conf.ext dovecot-ldap.conf.ext dovecot-oauth2.conf.ext dovecot-sql.conf.ext conf.d/auth-deny.conf.ext conf.d/auth-ldap.conf.ext conf.d/auth-passwdfile.conf.ext conf.d/auth-static.conf.ext conf.d/auth-dict.conf.ext conf.d/auth-master.conf.ext conf.d/auth-sql.conf.ext thus leaving passdb {} and userdb {} defined on a single place. Indeed, auth-system.conf.ext contains the sections passdb and userdb without the optional name, as described at https://doc.dovecot.org/configuration_manual/config_file/#sections . The problem report is that the example configuration does not contain for sections userdb and passdb a section name, and at the same time the as optional described section name is mandatory in Dovecot on these places. Kind regards Dilyan

2 1

Dovecot logging to files causes issues
by Richard Rosner 20 May '24

20 May '24

I have a mailing server setup based on Debian Stable that uses postfix (v3.7.10) for SMTP and dovecot (v2.3.19.1 (9b53102964)) for IMAP. I now wanted to set dovecot to not write to syslog, but to dedicated files in /var/log/dovecot. While everything indicates that this happens successfully as the log files gain in size, I also get lots of these errors: May 13 20:55:37 mail postfix/local[2824184]: 95BCF1000A9: to=<user(a)domain.de>, relay=local, delay=3.2, delays=1.9/0.29/0/1.1, dsn=4.3.0, status=deferred (temporary failure. Command output: lda(user): Error: net_connect_unix(/run/dovecot/stats-writer) failed: Permission denied Can't open log file /var/log/dovecot/error.log: Permission denied ) If it would only log the complaints I wouldn't worry, but as long as I don't revert the changes in dovecot's config, mail receiving is at least vastly delayed, most likely stuck alltogether. So how am I supposed to set these settings? I've chainged these settings in /etc/dovecot/conf.d/10-logging.conf: log_path = /var/log/dovecot/error.log debug_log_path = /var/log/dovecot/debug.log log_debug = category=error The whole directory /var/log/dovecot is owned by dovecot:dovecot, permissions on debug.log, error.log and info.log are 644. Best Richard

5 10

Re: Failing to archive many messages
by Francis Augusto Medeiros-Logeay 18 May '24

18 May '24

Today I realized that it was indeed the sa-learn that is slowing down my Archiving. I added an «&» on the end of the line that calls the sa-learn (called by the report-ham.sieve script): exec /usr/bin/sa-learn -u ${1} --ham & Does anyone thing this is a bad idea? I noticed that archiving got way faster this way… Best, Francis > On 9 May 2024, at 23:09, dovecot-request(a)dovecot.org wrote: > >> On 9 May 2024, at 19:45, dovecot-request(a)dovecot.org <mailto:dovecot-request@dovecot.org> wrote: >> >> Francis Augusto Medeiros-Logeay via dovecot skrev den 2024-05-09 12:29: >> >>>> If you want to analyze emails, why not do it with scheduled crons >>>> after they are archived? >> >> maybe ask for skip older then one day in here >> https://github.com/isbg/isbg/tree/master >> >> while roundcube just set the needed flag for retest ? >> >>> wouldn't it reanalyze all archived messages anyway? >> >> sometimes email is ham at recpt stage, while its spam later on test, >> this is why isbg is made imho :) > > > I see. > > But I wonder if there is something wrong with what I already have. It worked fine for years, and it works fine for most of my users. I tested with a few accounts, and Archving (with its sa-learn script) works blazingly fast. But with one user - happens to be mine - it is super slow when archiving, most likely due the sa-learn. > > Best, > > Francis

2 2

Sieve extprograms pipe :try cancels implicit keep
by Sebastiaan Hoogeveen 17 May '24

17 May '24

Hi, When using the :try tag on the pipe command in the sieve_extprograms plugin Sieve’s implicit keep is cancelled if the executed command fails. The specification on https://raw.githubusercontent.com/dovecot/pigeonhole/master/doc/rfc/spec-bo… states: “When the ":try" tag is specified, the "pipe" instruction will attempt execution of the external program, but failure will not cause the whole Sieve script execution to fail with an error. Instead, the Sieve processing continues as if the "pipe" action was never triggered." However, using the :try tag marks the pip command as successful even if it fails and because pipe is a disposition-type action the implicit keep is cancelled, resulting in the piped message being discarded. If this is the intended behaviour then I would suggest amending the text of the specification to: “When the ":try" tag is specified, the "pipe" instruction will attempt execution of the external program, but failure will not cause the whole Sieve script execution to fail with an error. Instead, the Sieve processing continues as if the "pipe" action was executed successfully and cancel implicit keep.” If this is not the intended behaviour then please consider this a bug report, with my apologies for not adding a patch (it seems to be a bit more complex than just changing the return value of act_pipe_commit). Kind regards, -- Sebastiaan Hoogeveen NederHost https://www.nederhost.nl/ KvK: 34099781

1 0

MySQL connection with SSL
by Gandalf Corvotempesta 16 May '24

16 May '24

Hi all is possible to tell dovecot to use a mysql connection with SSL ? My new remote mysql server only allows ssl connections

6 10

Pigeonhole Sieve only runs scripts if in users' home directories, or if Sieve is purposely broken
by Douglas Morse 15 May '24

15 May '24

Hi, Dovecot version is 2.3.19.1 (9b53102964) running on fully up-to-date Debian 12 (Bookworm) operating system. For the life of me I cannot figure out how to get sieve scripts working correctly in a central directory location. Calling them from users’ home directories works fine (as described below). (Note: This system has recently been migrated from Cyrus IMAP, so some of the directories for a central location are very similar to what would find in a standard Cyrus IMAP installation.) If I set `sieve` to its default value of `file:~/sieve;active=~/.dovecot.sieve` in `conf.d/90-sieve.conf`, sieve works as expected. I have a file `~/sieve/default.sieve` and, as per documentation, I make a symbolic link `~/.dovecot.sieve` that points to that file. The sieve script runs, and I see a `default.svbin` either created or updated in the ~/sieve directories as emails arrive. Setting `sieve` to `file:~/lib/sieve;active=~/.dovecot.sieve` also works as expected. So this verifies I can change the directory where sieve scripts are stored. However, if I then set `sieve` to `file:/var/spool/dovecot/home/%1n/user/%n/sieve;active=file:/var/spool/dovecot/home/%1n/user/%n/.dovecot.sieve`, again a `default.sieve` in each of these user’s centralized `sieve` directories, sieve scripts silently fail to run. No messages of any kind found in any log files. So, with the same exact same configuration as one that is the default and as proven to working, with the single exception of changing the top-level directory (TLD) for the scripts, results in silent failure. Why? What I find particularly odd is that if I keep `sieve` set to this central directory location (i.e., no config changes), and `mv sieve/default.sieve sieve.tmp; rmdir sieve; mv sieve.tmp`, that is, have a *file* called `sieve` where the setting `sieve` points to (which, per docs and experience, should be a *directory*), the users’ sieve scripts *do* run, but with a warning along the lines of `Warning: sieve: file storage: Explicitly specified active script path `file:/var/spool/dovecot/home/m/user/morse/.dovecot.sieve' is ignored; storage path `/var/spool/dovecot/home/m/user/morse/sieve' is not a directory`. In the docs I see that `sieve` used to refer to a file (PidgeonHole Sieve v.0.31 or prior, I believe), and there is mention of a a `sieve_dir` setting (which I have *never* set or used). So my guess is that sieve working in this centralized TLD with `sieve` as a file rather than directory is due to support for some deprecated config / functionality. I have fiddle around with this for some hours, including setting and not setting `mail_home` to the central directory location (i.e., `mail_home` in `conf.d/10-mail.conf` set to the same value as `sieve` in `conf.d/90-sieve.conf`),to no avail. No matter what I do, I cannot get sieve scripts to run in a centralized directory location as they do under `/home`. The only exception is as just described in the preceding paragraph. But the solution only allows a user to have a single sieve script, and I imagine `managesieve` will not work properly is sieve is set up as described in the preceding paragraph. What am I missing or doing incorrectly? Any and all assistance most appreciated. Doug

2 3