- dovecot - dovecot.org

dsync crashing
by Benjamin Rose 05 Aug '24

05 Aug '24

Hello, I am running Dovecot 2.3.16 (7e2e900c1a) on RHEL 9.2. I attach my "doveconf -n" configuration. I have replication enabled between 2 servers, both very beefy with 16 cores of Intel(R) Xeon(R) Gold 6244 CPU @ 3.60GHz, 768gb memory, and 100-gig ethernet. The configs are the same except the replication part which points at each other via a puppet template. It seems to work well for most users on modern email clients using the mdbox storage format. The issue I'm having is that some of my users are on the old-style mbox storage format so they can use legacy mail readers such as pine and mutt natively. For some of these users, syncing works just fine. For others, right now about a dozen users, the sync never completes, and I get the following error & backtrace in /var/log/maillog: Aug 4 23:54:22 mail6 dovecot[1177530]: doveadm: Panic: file dsync-mailbox-import.c: line 2163 (dsync_mailbox_import_handle_mail): assertion failed: (array_count(&wanted_uids) > 0) Aug 4 23:54:22 mail6 dovecot[1177530]: doveadm: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x46) [0x7fa6ab05c486] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x22) [0x7fa6ab05c5a2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10a41b) [0x7fa6ab06b41b] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10a4b7) [0x7fa6ab06b4b7] -> /usr/lib64/dovecot/libdovecot.so.0(+0x5d11a) [0x7fa6aafbe11a] -> dovecot/doveadm-server(+0x24029) [0x56433f2f7029] -> dovecot/doveadm-server(dsync_mailbox_import_changes_finish+0x29c) [0x56433f32fb9c] -> dovecot/doveadm-server(dsync_brain_sync_mails+0x8d5) [0x56433f331f15] -> dovecot/doveadm-server(+0x52255) [0x56433f325255] -> dovecot/doveadm-server(+0x52639) [0x56433f325639] -> dovecot/doveadm-server(+0x5fa53) [0x56433f332a53] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x6d) [0x7fa6ab081cbd] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x13a) [0x7fa6ab083bba] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x54) [0x7fa6ab083c64] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7fa6ab083e20] -> dovecot/doveadm-server(+0x37d7c) [0x56433f30ad7c] -> dovecot/doveadm-server(+0x3974d) [0x56433f30c74d] -> dovecot/doveadm-server(+0x5020b) [0x56433f32320b] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x6d) [0x7fa6ab081cbd] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x13a) [0x7fa6ab083bba] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x54) [0x7fa6ab083c64] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7fa6ab083e20] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x17) [0x7fa6aaff2337] -> dovecot/doveadm-server(main+0x102) [0x56433f2f8f92] -> /lib64/libc.so.6(+0x3feb0) [0x7fa6aac3feb0] -> /lib64/libc.so.6(__libc_start_main+0x80) [0x7fa6aac3ff60] -> dovecot/doveadm-server(_start+0x25) [0x56433f2f9015] Aug 4 23:54:22 mail6 dovecot[1177530]: doveadm: Fatal: master: service(doveadm): child 1117475 killed with signal 6 (core dumped) I'm not sure what might be causing this, and wanted to see if anyone here could offer any suggestions. Please let me know if any additional information is needed. Thanks, Ben

3 7

Strange ssl/dso troubles on freeBSD13.3
by Georg Graf 02 Aug '24

02 Aug '24

Hi, I'm George and I think I've been running dovecot for like more than a decade now without any troubles, so: WOW! Nevertheless, after an upgrade from FreeBSD 13.2 to 13.3 plus "pkg upgrade" my dovecot installation refuses to load the ssl certificates. I've tried a version built from source as well as the package. The Problem seems to be something with loading of DSO's: ========================================================================================================= Jul 31 16:42:11 murl dovecot[10801]: imap-login: Error: Failed to initialize SSL server context: Can't load SSL certificate (ssl_cert setting): error:25066067:DSO support routines:dlfcn_load:could not load the shared library: filename(libproviders.so): Shared object "libproviders.so" not found, required by "imap-login", error:25070067:DSO support routines:DSO_load:could not load the shared library, error:0E07506E:configuration file routines:module_load_dso:error loading dso: module=providers, path=providers, error:0E076071:configuration file routines:mo ========================================================================================================= I have never seen 'libproviders' and there's not a lot on it on the internet as well. Here comes my (dead-simple) 'dovecot -n': ========================================================================================================= # 2.3.21 (47349e2482): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 13.3-RELEASE-p4 amd64 # Hostname: murl.graf.priv.at auth_mechanisms = plain login disable_plaintext_auth = no mail_location = maildir:~/Maildir:LAYOUT=fs:INBOX=~/Maildir passdb { driver = pam } protocols = imap ssl_cert = </root/.acme.sh/graf.priv.at/fullchain.cer ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = blocking=yes driver = passwd } verbose_ssl = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep } ========================================================================================================= My openssl s_client shows that the server hangs up (while producing the above log entry): ========================================================================================================= # openssl s_client -servername graf.priv.at -connect graf.priv.at:imaps CONNECTED(00000003) write:errno=0 --- no peer certificate available --- No client certificate CA names sent --- SSL handshake has read 0 bytes and written 314 bytes Verification: OK --- New, (NONE), Cipher is (NONE) Secure Renegotiation IS NOT supported Compression: NONE Expansion: NONE No ALPN negotiated Early data was not sent Verify return code: 0 (ok) --- ========================================================================================================= Just to mention: plaintext IMAP is still working: ========================================================================================================= # telnet graf.priv.at imap Trying 78.41.116.33... Connected to graf.priv.at. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. u login georg <mysupersecretpassword> u OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAM ESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY PREVIEW STATUS=SIZE SAVEDATE LITE RAL+ NOTIFY] Logged in r select INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft $Forwarded $MDNSent $label5 $label3) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft $Forwarded $MDNSent $label5 $label3 \*)] Flags permitted. * 359 EXISTS * 0 RECENT * OK [UNSEEN 2] First unseen. * OK [UIDVALIDITY 1509040425] UIDs valid * OK [UIDNEXT 11767] Predicted next UID * OK [HIGHESTMODSEQ 19640] Highest r OK [READ-WRITE] Select completed (0.006 + 0.000 + 0.005 secs). s logout * BYE Logging out s OK Logout completed (0.001 + 0.000 secs). Connection closed by foreign host. ========================================================================================================= Any helping hint is highly appreciated! Thank you very much, George

2 3

RE: lmtp Fatal: setresgid Operation not permitted
by Rachel Roch 31 Jul '24

31 Jul '24

>> I am getting the following error when Postfix attempts LMTP delivery : >> >> "lmtp(REDACTED)<32674><7Jm0BSVopmaifwAAbW4UVQ>: Fatal: >> setresgid(121(mailbox_user),121(mailbox_user),8(mail)) failed with >> euid=111(mailbox_user): Operation not permitted" >> >> mailbox_user is uid 111, gid 121 on my system. >> > > Not related to low uid/gid numbers? I think newer OS have their limits increased to above 1000 or so. > Well, my OS is Debian Bookworm which should be "newer" enough ? ;-) User/group were originally created via : adduser --system --disabled-login --shell /usr/sbin/nologin mailbox_user addgroup --system mailbox_user

3 2

lmtp Fatal: setresgid Operation not permitted
by Rachel Roch 28 Jul '24

28 Jul '24

I am getting the following error when Postfix attempts LMTP delivery : "lmtp(REDACTED)<32674><7Jm0BSVopmaifwAAbW4UVQ>: Fatal: setresgid(121(mailbox_user),121(mailbox_user),8(mail)) failed with euid=111(mailbox_user): Operation not permitted" mailbox_user is uid 111, gid 121 on my system. doveconf -n ============= ============= # 2.3.19.1 (9b53102964): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.19 (4eae2f79) # OS: Linux 6.1.0-22-cloud-amd64 x86_64 Debian 12.6 xfs # Hostname: REDACTED auth_verbose = yes auth_verbose_passwords = sha1:7 doveadm_password = # hidden, use -P to show it first_valid_gid = 121 first_valid_uid = 111 imap_capability = +SPECIAL-USE imapc_features = rfc822.size fetch-headers fetch-bodystructure imapc_port = 993 imapc_ssl = imaps last_valid_gid = 121 last_valid_uid = 111 mail_location = maildir:/mnt/mxData/dovecot/%d/%n/Maildir mail_plugins = notify replication push_notification mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox "Deleted Messages" { auto = no special_use = \Trash } mailbox Drafts { special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/local_sql_users.conf driver = sql } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } vsz_limit = 2 G } service doveadm { inet_listener { port = 11867 ssl = yes } } service imap-login { process_min_avail = 5 service_count = 1 } service lmtp { process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } user = mailbox_user } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieves { address = port = 5190 ssl = yes } } ssl = required ssl_cert = <REDACTED ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-CHACHA20-POLY1305 ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/local_sql_users.conf default_fields = uid=mailbox_user gid=mailbox_user home=/mnt/mxData/dovecot/%d/%n driver = sql } protocol lmtp { mail_plugins = notify replication push_notification sieve } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = notify replication push_notification sieve quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } protocol imap { mail_max_userip_connections = 20 mail_plugins = notify replication push_notification imap_sieve } ======= ======= postconf -n ======== ======== alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases authorized_submit_users = biff = no compatibility_level = 2 default_database_type = cdb disable_vrfy_command = yes home_mailbox = Maildir/ indexed = ${default_database_type}:${config_directory}/ inet_interfaces = all inet_protocols = all mailbox_size_limit = 0 message_size_limit = 20480000 mydestination = REDACTED,localhost mydomain = REDACTED myhostname = REDACTED mynetworks = $config_directory/mynetworks mynetworks_style = subnet myorigin = $mydomain parent_domain_matches_subdomains = recipient_delimiter = + smtp_bind_address = 0.0.0.0 smtp_bind_address6 = :: smtp_sasl_auth_enable = no smtp_tls_policy_maps = ${indexed}smtp_tls_policy smtpd_banner = $myhostname ESMTP smtpd_recipient_restrictions = reject_unknown_sender_domain, reject_unknown_recipient_domain, reject_unauth_pipelining, permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination smtpd_sasl_auth_enable = no smtpd_sasl_local_domain = $myhostname smtpd_sasl_security_options = noanonymous smtpd_sender_restrictions = reject_unknown_sender_domain smtpd_tls_auth_only = yes smtpd_tls_cert_file = REDACTED smtpd_tls_dh1024_param_file = REDACTED smtpd_tls_eecdh_grade = strong smtpd_tls_key_file = REDACTED smtpd_tls_mandatory_ciphers = high smtpd_tls_mandatory_protocols = !SSLv2, !SSLv3, !TLSv1, !TLSv1.1 smtpd_tls_protocols = !SSLv2, !SSLv3, !TLSv1, !TLSv1.1 smtpd_tls_security_level = may tls_eecdh_strong_curve = prime256v1 tls_preempt_cipherlist = yes tls_random_source = dev:/dev/random virtual_alias_maps = pgsql:${config_directory}/pgsql_virtual.conf virtual_gid_maps = static:121 virtual_mailbox_base = /mnt/mxData/dovecot virtual_mailbox_domains = ${config_directory}/vhosts virtual_mailbox_maps = pgsql:${config_directory}/pgsql_vmap.conf virtual_transport = lmtp:unix:private/dovecot-lmtp virtual_uid_maps = static:111 ======== ========

2 1

dovecot-lda: timeout for external scripts called by sieve
by Meinhard Schneider 28 Jul '24

28 Jul '24

Hello, I have a small problem with dovecot-lda. I am using Debian 12 Bookworm: root@lnxmail01:~# dovecot --version 2.3.13 (89f716dc2) Historically grown (probably still from sendmail times, long time ago) I always used procmail for local e-mail delivery. This also included the call for spamc for SpamAssassin. I have now changed this and set up a route via sieve. There is a small script for this: root@lnxmail01:~# cat /usr/lib/dovecot/sieve-filter/spamc-filter.sh #!/bin/bash /usr/bin/spamc My sieve configuration says (in extracts): root@lnxmail01:~# head -12 ~meini/.dovecot.sieve ## Generated by Roundcube Webmail SieveRules Plugin ## require ["body","comparator-i;ascii-numeric","copy","envelope","fileinto","imap4flags","include","regex","relational","spamtestplus","vacation","variables","spamtest"]; include :global "spamc"; # rule:[Spam] if spamtest :value "ge" :comparator "i;ascii-numeric" "5" { fileinto "Spam"; stop; } In general, this has been working for many months without any problems. But sometimes the whole thing fails due to a timeout: Jul 7 22:00:13 lnxmail01 dovecot: lda(meini)<766014><G9l7JcPzimY+sAsAmbNf3A>: Error: program exec:/usr/lib/dovecot/sieve-filter/spamc-filter.sh (766016): Execution timed out (> 10000 msecs) Jul 7 22:00:13 lnxmail01 dovecot: lda(meini)<766014><G9l7JcPzimY+sAsAmbNf3A>: Error: program exec:/usr/lib/dovecot/sieve-filter/spamc-filter.sh (766016): Forcibly terminated with signal 15 Jul 7 22:00:13 lnxmail01 dovecot: lda(meini)<766014><G9l7JcPzimY+sAsAmbNf3A>: Panic: output stream (temp iostream in /tmp/dovecot.lda. for (program client seekable output)) is missing error handling Jul 7 22:00:13 lnxmail01 dovecot: lda(meini)<766014><G9l7JcPzimY+sAsAmbNf3A>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7ff00aee04e2] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7ff00aee05fe] -> /usr/lib/dovecot/libdovecot.so.0(+0xfc49b) [0x7ff00aeec49b] -> /usr/lib/dovecot/libdovecot.so.0(+0xfc501) [0x7ff00aeec501] -> /usr/lib/dovecot/libdovecot.so.0(+0x53aee) [0x7ff00ae43aee] -> /usr/lib/dovecot/libdovecot.so.0(o_stream_unref+0x5e) [0x7ff00af1003e] -> /usr/lib/dovecot/libdovecot.so.0(program_client_destroy+0x8e) [0x7ff00ae6ee6e] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(sieve_extprogram_destroy+0x18) [0x7ff00aacd8f8] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x556d) [0x7ff00aacb56d] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_continue+0xea) [0x7ff00ab4c9ba] -> /usr/lib/dovecot/libdovecot-sieve.so.0(ext_include_execute_include+0x2c7) [0x7ff00ab72e17] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_continue+0xea) [0x7ff00ab4c9ba] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_multiscript_run+0x82) [0x7ff00ab62b32] -> /usr/lib/dovecot/modules/lib90_sieve_plugin.so(+0x37a3) [0x7ff00abd47a3] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0x176) [0x7ff00b11f906] -> /usr/lib/dovecot/dovecot-lda(main+0x879) [0x55ef085e4fb9] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xea) [0x7ff00ac3ad0a] -> /usr/lib/dovecot/dovecot-lda(_start+0x2a) [0x55ef085e56ea] The worst thing is that the entire mail is lost (/dev/null)! Then I tried to set the timeout higher (than the current 10 seconds): root@lnxmail01:~# doveconf | grep -A 12 ^plugin plugin { sieve = file:~/sieve;active=~/.dovecot.sieve sieve_execute_exec_timeout = 60s sieve_extension_exec_timeout = 60s sieve_extensions = +vnd.dovecot.filter +spamtest +spamtestplus sieve_filter_bin_dir = /usr/lib/dovecot/sieve-filter sieve_filter_socket_dir = sieve-filter sieve_global = /usr/lib/dovecot/sieve-global sieve_plugins = sieve_extprograms sieve_spamtest_max_value = 5 sieve_spamtest_status_header = X-Spam-Level sieve_spamtest_status_type = strlen } I have set both the values for "sieve_execute_exec_timeout" and "sieve_extension_exec_timeout" to 60 sec, but according to the log, this does not seem to affect the 10000 msec mentioned therein. The SpamAssassin daemon has enough child processes to handle the requests (most of them were idle at the time of the error). How can I configure that the external script gets more time for execution? And what can I do so that - should the script terminate contrary to expectations or be killed in the timeout - the mail is not lost but simply processed further? Many thanks & best regards Meinhard

2 5

Looking for Some Help with Dovecot Configuration for IMAP Access
by Selena Thomas 27 Jul '24

27 Jul '24

Hi everyone, I am having a bit of trouble setting up Dovecot for IMAP access. I’ve installed Dovecot and configured the main configuration file,, but I am not sure if I missed something important. Here’s what I have so far ::- 1. Dovecot Version: 2.3.11 2. OS: Ubuntu 20.04 3. Configuration Files: - `/etc/dovecot/dovecot.conf` - `/etc/dovecot/conf.d/10-ssl.conf` - `/etc/dovecot/conf.d/10-auth.conf` I can connect to the server, but I’m having issues with mailbox access and authentication. Does anyone have any tips or common pitfalls I should check: ?? Any guidance would be greatly appreciated..... Thanks in advance... Selena Thomas https://www.igmguru.com/cloud-computing/microsoft-azure-administrator-az-10…

2 1

Sieve duplicate detection not working as expected
by Rosario Esposito 26 Jul '24

26 Jul '24

Hi, On a dovecot server (2.3.21) I have a simple sieve script: require ["duplicate"]; # rule:[duplicate] if duplicate { discard; stop; } I use virtual users with mail aliases on a LDAP backend. I have user "resposit" having 2 mail aliases: - resposit(a)na.infn.it - rosario.esposito(a)na.infn.it If I send a single message to both aliases I still receive 2 copies as you can see from the attached log. Is the "duplicate" sieve extension supposed to work this way ? Any help would be much appreciated ! -- Rosario Esposito

2 3

SMTPUTF8 support
by Dāvis Mosāns 26 Jul '24

26 Jul '24

Hi, I'm interested in SMTPUTF8 support in Dovecot. It seems it's still not implemented? Any plans on implementing it? How much work would it be? I couldn't find any mention of this functionality. Postfix has support which is enabled by default but it's not usable if Dovecot doesn't support it. Thanks! Best regards, Dāvis

2 3

Re: [EXT] Re[8]: Sieve Filters with MySQL
by Aki Tuomi 26 Jul '24

26 Jul '24

It's OK to hide it to the mailbox table as sieveFilterID. Then you can do map { pattern = priv/sieve/name/default table = mailbox username_field = email value_field = sieveFilterID } Aki > On 26/07/2024 10:14 EEST Adam Miller <adam(a)ardaemail.com> wrote: > > > ------ Original Message ------ > From "Aki Tuomi via dovecot" <dovecot(a)dovecot.org> > To "Adam Miller" <adam(a)ardaemail.com>; "Adam Miller via dovecot" > <dovecot(a)dovecot.org> > Date 7/23/2024 10:06:38 PM > Subject Re: Re[6]: Sieve Filters with MySQL > > >Hi! > > > >Usually how the "isActive" stuff is done is bit different. > > > >fwiw i would do the schema differently, and have two tables > > > >table 1: > > > >CREATE TABLE sieve_name_id ( > > id INT, > > email VARCHAR(255), > > name VARCHAR(255), > > PRIMARY KEY(email, name) > >) > > > >table 2 > > > >CREATE TABLE sieve_scripts ( > > id INT, > > content TEXT > >) > > > >Then you can map 'default' to the active script id, or leave it missing when there is no script enabled. This is how it's supposed to work. > > > >It's probably not dead obvious but if you look at the dict configuration you have: > > > >map { > > pattern = priv/sieve/name/$script_name > > table = mailboxFilter > > username_field = email > > value_field = uuid > > fields { > > name = $script_name > > } > >} > > > >You can see that the priv/sieve/name/ is not part of $script_name that is passed to sql in fields. > > > >btw, to debug SQL, you can try > > > >log_debug=category=sql > > > >next time. > > > >Aki > > > > > >> On 24/07/2024 00:42 EEST Adam Miller via dovecot <dovecot(a)dovecot.org> wrote: > >> > >> > >> Is it possible to include extra fields? For example, the “isActive” and > >> make sure it is true / 1? > >> > >> Thank you. > >> > >> > >> ------ Original Message ------ > >> From "Aki Tuomi via dovecot" <dovecot(a)dovecot.org> > >> To "Adam Miller" <adam(a)ardaemail.com>; "Adam Miller via dovecot" > >> <dovecot(a)dovecot.org> > >> Date 7/23/2024 4:44:30 AM > >> Subject Re: Re[4]: Sieve Filters with MySQL > >> > >> >You can try > >> > > >> >doveadm dict get -u adam proxy::sieve priv/sieve/name/default > >> > > >> >this should return id of the default script. > >> > > >> >doveadm dict get -u adam proxy::sieve priv/sieve/data/<id> > >> > > >> >should return the actual script. > >> > > >> >See https://doc.dovecot.org/configuration_manual/sieve/dict/ > >> > > >> >Aki > >> > > >> > > >> >> On 23/07/2024 14:09 EEST Adam Miller via dovecot <dovecot(a)dovecot.org> wrote: > >> >> > >> >> > >> >> Yes, I get that. What I would like to know is what are the queries that > >> >> Dovecot / Sieve is executing so that I can better determine where the > >> >> issue exists? Is there anyway to see them? Do you see an issue anywhere > >> >> in my configuration files? > >> >> > >> >> Thank you. > >> >> > >> >> > >> >> ------ Original Message ------ > >> >> From "Aki Tuomi" <aki.tuomi(a)open-xchange.com> > >> >> To "Adam Miller" <adam(a)ardaemail.com>; "Adam Miller via dovecot" > >> >> <dovecot(a)dovecot.org> > >> >> Date 7/23/2024 4:07:22 AM > >> >> Subject Re: Re[2]: Sieve Filters with MySQL > >> >> > >> >> >Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >sieve: dict storage: script `default': Script `default' not found at > >> >> >path priv/sieve/name/default > >> >> > > >> >> >Aki > >> >> > > >> >> >> On 23/07/2024 13:52 EEST Adam Miller via dovecot <dovecot(a)dovecot.org> wrote: > >> >> >> > >> >> >> > >> >> >> Yes, that is where I got the error from. Here’s more from the log file: > >> >> >> > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: Pigeonhole version 0.5.16 (09c29328) initializing > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: include: sieve_global is not set; it is currently not possible to > >> >> >> include `:global’ scripts. > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.16 (09c29328) > >> >> >> loaded > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.16 (09c29328) > >> >> >> loaded > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: dict storage: user=redacted, uri=proxy::sieve > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: dict storage: script `default': Script `default' not found at > >> >> >> path priv/sieve/name/default > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: User has no active script in storage > >> >> >> `dict:proxy::sieve;user=redacted’ > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: User has no personal script > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: No scripts to execute: reverting to default delivery. > >> >> >> > >> >> >> Is there something specific I should be looking for? > >> >> >> > >> >> >> Thank you! > >> >> >> > >> >> >> ------ Original Message ------ > >> >> >> From "Aki Tuomi via dovecot" <dovecot(a)dovecot.org> > >> >> >> To "Adam Miller" <adam(a)ardaemail.com>; "Adam Miller via dovecot" > >> >> >> <dovecot(a)dovecot.org> > >> >> >> Date 7/23/2024 3:35:17 AM > >> >> >> Subject Re: Sieve Filters with MySQL > >> >> >> > >> >> >> >Did you try with > >> >> >> > > >> >> >> >mail_debug=yes > >> >> >> > > >> >> >> >and > >> >> >> > > >> >> >> >log_debug=category=sieve > >> >> >> > > >> >> >> >Aki > >> >> >> > > >> >> >> >> On 23/07/2024 13:18 EEST Adam Miller via dovecot <dovecot(a)dovecot.org> wrote: > >> >> >> >> > >> >> >> >> > >> >> >> >> Me again! I am trying to get sieve filters working with a MySQL backend > >> >> >> >> but same to be coming up short. Right now, the error I am getting > >> >> >> >> received is: > >> >> >> >> > >> >> >> >> ------------------------------------------------------------------------------------------------------------------ > >> >> >> >> > >> >> >> >> "User has no active script in storage > >> >> >> >> dict:proxy::sieve;user=username@domain.com" > >> >> >> >> > >> >> >> >> ------------------------------------------------------------------------------------------------------------------ > >> >> >> >> > >> >> >> >> The “username(a)domain.xn--com-9o0a is obviously the email address of the > >> >> >> >> receiving mailbox. > >> >> >> >> > >> >> >> >> Here’s my latest config: > >> >> >> >> > >> >> >> >> # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf > >> >> >> >> # Pigeonhole version 0.5.16 (09c29328) > >> >> >> >> # OS: Linux 6.5.0-1020-aws x86_64 Ubuntu 22.04.4 LTS nfs4 > >> >> >> >> # Hostname: ec2-us-east-1a-arda-mail-001.ardaemail.com > >> >> >> >> auth_debug = yes > >> >> >> >> auth_mechanisms = plain login > >> >> >> >> auth_verbose = yes > >> >> >> >> auth_worker_max_count = 5 > >> >> >> >> base_dir = /var/run/dovecot > >> >> >> >> debug_log_path = /var/log/dovecot/debug.log > >> >> >> >> default_internal_group = ardaemail > >> >> >> >> default_internal_user = ardaemail > >> >> >> >> dict { > >> >> >> >> quota = mysql:/etc/dovecot/inc.d/inc.quota.user.sql.conf > >> >> >> >> sieve = mysql:/etc/dovecot/inc.d/inc.sieve.sql.conf > >> >> >> >> sql = mysql:/etc/dovecot/inc.d/inc.lastlogin.sql.conf > >> >> >> >> } > >> >> >> >> hostname = = mail.ardaemail.com > >> >> >> >> info_log_path = /var/log/dovecot/info.log > >> >> >> >> instance_name = ec2-us-east-1a-arda-mail-001.ardaemail.com > >> >> >> >> listen = 172.16.0.200 > >> >> >> >> log_path = /var/log/dovecot/general.log > >> >> >> >> login_greeting = Welcome to ArdaEmail > >> >> >> >> mail_debug = yes > >> >> >> >> mail_gid = ardaemail > >> >> >> >> mail_location = maildir:/mnt/mail/%d/%n > >> >> >> >> mail_max_userip_connections = 1000 > >> >> >> >> mail_plugins = " quota mailbox_alias" > >> >> >> >> mail_server_admin = mailto:support@ardaemail.com > >> >> >> >> mail_uid = ardaemail > >> >> >> >> maildir_stat_dirs = yes > >> >> >> >> namespace inbox { > >> >> >> >> inbox = yes > >> >> >> >> location = > >> >> >> >> mailbox Archive { > >> >> >> >> auto = subscribe > >> >> >> >> special_use = \Archive > >> >> >> >> } > >> >> >> >> mailbox Drafts { > >> >> >> >> auto = subscribe > >> >> >> >> special_use = \Drafts > >> >> >> >> } > >> >> >> >> mailbox Junk { > >> >> >> >> auto = subscribe > >> >> >> >> autoexpunge = 90 days > >> >> >> >> special_use = \Junk > >> >> >> >> } > >> >> >> >> mailbox Sent { > >> >> >> >> auto = subscribe > >> >> >> >> special_use = \Sent > >> >> >> >> } > >> >> >> >> mailbox Trash { > >> >> >> >> auto = subscribe > >> >> >> >> autoexpunge = 30 days > >> >> >> >> special_use = \Trash > >> >> >> >> } > >> >> >> >> prefix = > >> >> >> >> } > >> >> >> >> passdb { > >> >> >> >> args = /etc/dovecot/inc.d/inc.sql.conf > >> >> >> >> driver = sql > >> >> >> >> } > >> >> >> >> plugin { > >> >> >> >> last_login_dict = proxy::sql > >> >> >> >> last_login_key = # hidden, use -P to show it > >> >> >> >> last_login_precision = ms > >> >> >> >> mailbox_alias_new = Junk Email > >> >> >> >> mailbox_alias_new2 = Junk E-mail > >> >> >> >> mailbox_alias_new3 = Sent Messages > >> >> >> >> mailbox_alias_new4 = Sent Items > >> >> >> >> mailbox_alias_new5 = Deleted Items > >> >> >> >> mailbox_alias_new6 = Junk Mail > >> >> >> >> mailbox_alias_old = Junk > >> >> >> >> mailbox_alias_old2 = Junk > >> >> >> >> mailbox_alias_old3 = Sent > >> >> >> >> mailbox_alias_old4 = Sent > >> >> >> >> mailbox_alias_old5 = Trash > >> >> >> >> mailbox_alias_old6 = Junk > >> >> >> >> quota = dict:User Quota::proxy::quota > >> >> >> >> quota_exceeded_message = Mailbox is full and cannot receive any more > >> >> >> >> emails > >> >> >> >> quota_status_nouser = DUNNO > >> >> >> >> quota_status_success = DUNNO > >> >> >> >> quota_warning = bytes=95%% quota-warning 95 %u > >> >> >> >> quota_warning2 = bytes=85%% quota-warning 85 %u > >> >> >> >> quota_warning3 = bytes=75%% quota-warning 75 %u > >> >> >> >> sieve = dict:proxy::sieve > >> >> >> >> sieve_plugins = sieve_imapsieve sieve_extprograms > >> >> >> >> } > >> >> >> >> postmaster_address = postmaster(a)ardaemail.com > >> >> >> >> protocols = imap lmtp > >> >> >> >> service auth-worker { > >> >> >> >> group = ardaemail > >> >> >> >> user = ardaemail > >> >> >> >> } > >> >> >> >> service auth { > >> >> >> >> group = ardaemail > >> >> >> >> unix_listener /var/spool/postfix/private/auth { > >> >> >> >> group = postfix > >> >> >> >> mode = 0666 > >> >> >> >> user = postfix > >> >> >> >> } > >> >> >> >> unix_listener auth-userdb { > >> >> >> >> group = ardaemail > >> >> >> >> mode = 0666 > >> >> >> >> user = ardaemail > >> >> >> >> } > >> >> >> >> user = ardaemail > >> >> >> >> } > >> >> >> >> service imap-login { > >> >> >> >> inet_listener imap { > >> >> >> >> port = 0 > >> >> >> >> } > >> >> >> >> inet_listener imaps { > >> >> >> >> port = 993 > >> >> >> >> ssl = yes > >> >> >> >> } > >> >> >> >> process_min_avail = 8 > >> >> >> >> service_count = 0 > >> >> >> >> } > >> >> >> >> service imap { > >> >> >> >> vsz_limit = 4 G > >> >> >> >> } > >> >> >> >> service lmtp { > >> >> >> >> unix_listener /var/spool/postfix/private/dovecot-lmtp { > >> >> >> >> group = postfix > >> >> >> >> mode = 0666 > >> >> >> >> user = postfix > >> >> >> >> } > >> >> >> >> } > >> >> >> >> service pop3-login { > >> >> >> >> inet_listener pop3 { > >> >> >> >> port = 0 > >> >> >> >> } > >> >> >> >> inet_listener pop3s { > >> >> >> >> port = 0 > >> >> >> >> } > >> >> >> >> } > >> >> >> >> service quota-status { > >> >> >> >> executable = /usr/lib/dovecot/quota-status -p postfix > >> >> >> >> unix_listener /var/spool/postfix/private/quota-status { > >> >> >> >> user = postfix > >> >> >> >> } > >> >> >> >> } > >> >> >> >> service quota-warning { > >> >> >> >> executable = script /etc/dovecot/bin/quota-warning.sh > >> >> >> >> unix_listener quota-warning { > >> >> >> >> group = ardaemail > >> >> >> >> mode = 0666 > >> >> >> >> user = ardaemail > >> >> >> >> } > >> >> >> >> } > >> >> >> >> service submission-login { > >> >> >> >> inet_listener submission { > >> >> >> >> port = 0 > >> >> >> >> } > >> >> >> >> } > >> >> >> >> ssl = required > >> >> >> >> ssl_cert = </etc/letsencrypt/live/mail.ardaemail.com/fullchain.pem > >> >> >> >> ssl_client_ca_dir = /etc/ssl/certs > >> >> >> >> ssl_dh = # hidden, use -P to show it > >> >> >> >> ssl_key = # hidden, use -P to show it > >> >> >> >> ssl_prefer_server_ciphers = yes > >> >> >> >> userdb { > >> >> >> >> args = /etc/dovecot/inc.d/inc.sql.conf > >> >> >> >> driver = sql > >> >> >> >> } > >> >> >> >> protocol imap { > >> >> >> >> imap_metadata = yes > >> >> >> >> mail_plugins = " quota mailbox_alias imap_sieve imap_quota last_login" > >> >> >> >> } > >> >> >> >> protocol lmtp { > >> >> >> >> mail_plugins = " quota mailbox_alias sieve” > >> >> >> >> } > >> >> >> >> > >> >> >> >> This output clearly does not include my Sieve configuration maps so > >> >> >> >> here’s those: > >> >> >> >> > >> >> >> >> connect = host=redacted dbname=redacted user=redacted password=redacted > >> >> >> >> > >> >> >> >> map { > >> >> >> >> pattern = priv/sieve/name/$script_name > >> >> >> >> table = mailboxFilter > >> >> >> >> username_field = email > >> >> >> >> value_field = uuid > >> >> >> >> fields { > >> >> >> >> name = $script_name > >> >> >> >> } > >> >> >> >> } > >> >> >> >> > >> >> >> >> map { > >> >> >> >> pattern = priv/sieve/data/$uuid > >> >> >> >> table = mailboxFilter > >> >> >> >> username_field = email > >> >> >> >> value_field = filter > >> >> >> >> fields { > >> >> >> >> uuid = $uuid > >> >> >> >> } > >> >> >> >> } > >> >> >> >> > >> >> >> >> And here’s the table schema: > >> >> >> >> > >> >> >> >> CREATE TABLE `mailboxFilter` ( > >> >> >> >> `id` int(11) unsigned NOT NULL AUTO_INCREMENT, > >> >> >> >> `uuid` varchar(36) NOT NULL, > >> >> >> >> `email` varchar(192) NOT NULL, > >> >> >> >> `name` varchar(255) NOT NULL, > >> >> >> >> `filter` longtext NOT NULL, > >> >> >> >> `isActive` bit(1) NOT NULL DEFAULT b’1’, > >> >> >> >> `createdAt` datetime NOT NULL DEFAULT current_timestamp(), > >> >> >> >> `updatedAt` datetime NOT NULL DEFAULT current_timestamp() ON UPDATE > >> >> >> >> current_timestamp(), > >> >> >> >> PRIMARY KEY (`id`), > >> >> >> >> UNIQUE KEY `UUID` (`uuid`), > >> >> >> >> UNIQUE KEY `EMAIL` (`email`) > >> >> >> >> ) ENGINE=InnoDB AUTO_INCREMENT=2 DEFAULT CHARSET=utf8mb4 > >> >> >> >> COLLATE=utf8mb4_general_ci; > >> >> >> >> > >> >> >> >> When I run manually queries, everything works fine though I am not > >> >> >> >> entirely sure what the queries are that Dovecot is executing. > >> >> >> >> > >> >> >> >> Any help is appreciated! Also, if I could use the “isActive” field, that > >> >> >> >> would be great as well. My plan to start here is to only have one record > >> >> >> >> in the table per mailbox which would contain all Sieve filters. > >> >> >> >> Eventually, it would be nice if I could adjust the configuration to > >> >> >> >> allow for more than one that returns concatenated so any help there > >> >> >> >> would be great as well! > >> >> >> >> > >> >> >> >> Thank you! > >> >> >> >> _______________________________________________ > >> >> >> >> dovecot mailing list -- dovecot(a)dovecot.org > >> >> >> >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> >> >> >_______________________________________________ > >> >> >> >dovecot mailing list -- dovecot(a)dovecot.org > >> >> >> >To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> >> >> _______________________________________________ > >> >> >> dovecot mailing list -- dovecot(a)dovecot.org > >> >> >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> >> _______________________________________________ > >> >> dovecot mailing list -- dovecot(a)dovecot.org > >> >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> >_______________________________________________ > >> >dovecot mailing list -- dovecot(a)dovecot.org > >> >To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> _______________________________________________ > >> dovecot mailing list -- dovecot(a)dovecot.org > >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > >_______________________________________________ > >dovecot mailing list -- dovecot(a)dovecot.org > >To unsubscribe send an email to dovecot-leave(a)dovecot.org

2 2

sieve mail date change
by Marc 24 Jul '24

24 Jul '24

I am a bit rookie with sieve. Some time ago I created a sieve pipe that would sometimes alter alter the subject and move a message to a different mailbox. Currently this results in that a date changes of this message while I don't see anything in the source altering a date. What could be causing this and how to work around this?

2 2