July 2024 - dovecot - dovecot.org

Re: [EXT] Re[8]: Sieve Filters with MySQL
by Aki Tuomi 26 Jul '24

26 Jul '24

It's OK to hide it to the mailbox table as sieveFilterID. Then you can do map { pattern = priv/sieve/name/default table = mailbox username_field = email value_field = sieveFilterID } Aki > On 26/07/2024 10:14 EEST Adam Miller <adam(a)ardaemail.com> wrote: > > > ------ Original Message ------ > From "Aki Tuomi via dovecot" <dovecot(a)dovecot.org> > To "Adam Miller" <adam(a)ardaemail.com>; "Adam Miller via dovecot" > <dovecot(a)dovecot.org> > Date 7/23/2024 10:06:38 PM > Subject Re: Re[6]: Sieve Filters with MySQL > > >Hi! > > > >Usually how the "isActive" stuff is done is bit different. > > > >fwiw i would do the schema differently, and have two tables > > > >table 1: > > > >CREATE TABLE sieve_name_id ( > > id INT, > > email VARCHAR(255), > > name VARCHAR(255), > > PRIMARY KEY(email, name) > >) > > > >table 2 > > > >CREATE TABLE sieve_scripts ( > > id INT, > > content TEXT > >) > > > >Then you can map 'default' to the active script id, or leave it missing when there is no script enabled. This is how it's supposed to work. > > > >It's probably not dead obvious but if you look at the dict configuration you have: > > > >map { > > pattern = priv/sieve/name/$script_name > > table = mailboxFilter > > username_field = email > > value_field = uuid > > fields { > > name = $script_name > > } > >} > > > >You can see that the priv/sieve/name/ is not part of $script_name that is passed to sql in fields. > > > >btw, to debug SQL, you can try > > > >log_debug=category=sql > > > >next time. > > > >Aki > > > > > >> On 24/07/2024 00:42 EEST Adam Miller via dovecot <dovecot(a)dovecot.org> wrote: > >> > >> > >> Is it possible to include extra fields? For example, the “isActive” and > >> make sure it is true / 1? > >> > >> Thank you. > >> > >> > >> ------ Original Message ------ > >> From "Aki Tuomi via dovecot" <dovecot(a)dovecot.org> > >> To "Adam Miller" <adam(a)ardaemail.com>; "Adam Miller via dovecot" > >> <dovecot(a)dovecot.org> > >> Date 7/23/2024 4:44:30 AM > >> Subject Re: Re[4]: Sieve Filters with MySQL > >> > >> >You can try > >> > > >> >doveadm dict get -u adam proxy::sieve priv/sieve/name/default > >> > > >> >this should return id of the default script. > >> > > >> >doveadm dict get -u adam proxy::sieve priv/sieve/data/<id> > >> > > >> >should return the actual script. > >> > > >> >See https://doc.dovecot.org/configuration_manual/sieve/dict/ > >> > > >> >Aki > >> > > >> > > >> >> On 23/07/2024 14:09 EEST Adam Miller via dovecot <dovecot(a)dovecot.org> wrote: > >> >> > >> >> > >> >> Yes, I get that. What I would like to know is what are the queries that > >> >> Dovecot / Sieve is executing so that I can better determine where the > >> >> issue exists? Is there anyway to see them? Do you see an issue anywhere > >> >> in my configuration files? > >> >> > >> >> Thank you. > >> >> > >> >> > >> >> ------ Original Message ------ > >> >> From "Aki Tuomi" <aki.tuomi(a)open-xchange.com> > >> >> To "Adam Miller" <adam(a)ardaemail.com>; "Adam Miller via dovecot" > >> >> <dovecot(a)dovecot.org> > >> >> Date 7/23/2024 4:07:22 AM > >> >> Subject Re: Re[2]: Sieve Filters with MySQL > >> >> > >> >> >Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >sieve: dict storage: script `default': Script `default' not found at > >> >> >path priv/sieve/name/default > >> >> > > >> >> >Aki > >> >> > > >> >> >> On 23/07/2024 13:52 EEST Adam Miller via dovecot <dovecot(a)dovecot.org> wrote: > >> >> >> > >> >> >> > >> >> >> Yes, that is where I got the error from. Here’s more from the log file: > >> >> >> > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: Pigeonhole version 0.5.16 (09c29328) initializing > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: include: sieve_global is not set; it is currently not possible to > >> >> >> include `:global’ scripts. > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.16 (09c29328) > >> >> >> loaded > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.16 (09c29328) > >> >> >> loaded > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: dict storage: user=redacted, uri=proxy::sieve > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: dict storage: script `default': Script `default' not found at > >> >> >> path priv/sieve/name/default > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: User has no active script in storage > >> >> >> `dict:proxy::sieve;user=redacted’ > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: User has no personal script > >> >> >> Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: > >> >> >> sieve: No scripts to execute: reverting to default delivery. > >> >> >> > >> >> >> Is there something specific I should be looking for? > >> >> >> > >> >> >> Thank you! > >> >> >> > >> >> >> ------ Original Message ------ > >> >> >> From "Aki Tuomi via dovecot" <dovecot(a)dovecot.org> > >> >> >> To "Adam Miller" <adam(a)ardaemail.com>; "Adam Miller via dovecot" > >> >> >> <dovecot(a)dovecot.org> > >> >> >> Date 7/23/2024 3:35:17 AM > >> >> >> Subject Re: Sieve Filters with MySQL > >> >> >> > >> >> >> >Did you try with > >> >> >> > > >> >> >> >mail_debug=yes > >> >> >> > > >> >> >> >and > >> >> >> > > >> >> >> >log_debug=category=sieve > >> >> >> > > >> >> >> >Aki > >> >> >> > > >> >> >> >> On 23/07/2024 13:18 EEST Adam Miller via dovecot <dovecot(a)dovecot.org> wrote: > >> >> >> >> > >> >> >> >> > >> >> >> >> Me again! I am trying to get sieve filters working with a MySQL backend > >> >> >> >> but same to be coming up short. Right now, the error I am getting > >> >> >> >> received is: > >> >> >> >> > >> >> >> >> ------------------------------------------------------------------------------------------------------------------ > >> >> >> >> > >> >> >> >> "User has no active script in storage > >> >> >> >> dict:proxy::sieve;user=username@domain.com" > >> >> >> >> > >> >> >> >> ------------------------------------------------------------------------------------------------------------------ > >> >> >> >> > >> >> >> >> The “username(a)domain.xn--com-9o0a is obviously the email address of the > >> >> >> >> receiving mailbox. > >> >> >> >> > >> >> >> >> Here’s my latest config: > >> >> >> >> > >> >> >> >> # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf > >> >> >> >> # Pigeonhole version 0.5.16 (09c29328) > >> >> >> >> # OS: Linux 6.5.0-1020-aws x86_64 Ubuntu 22.04.4 LTS nfs4 > >> >> >> >> # Hostname: ec2-us-east-1a-arda-mail-001.ardaemail.com > >> >> >> >> auth_debug = yes > >> >> >> >> auth_mechanisms = plain login > >> >> >> >> auth_verbose = yes > >> >> >> >> auth_worker_max_count = 5 > >> >> >> >> base_dir = /var/run/dovecot > >> >> >> >> debug_log_path = /var/log/dovecot/debug.log > >> >> >> >> default_internal_group = ardaemail > >> >> >> >> default_internal_user = ardaemail > >> >> >> >> dict { > >> >> >> >> quota = mysql:/etc/dovecot/inc.d/inc.quota.user.sql.conf > >> >> >> >> sieve = mysql:/etc/dovecot/inc.d/inc.sieve.sql.conf > >> >> >> >> sql = mysql:/etc/dovecot/inc.d/inc.lastlogin.sql.conf > >> >> >> >> } > >> >> >> >> hostname = = mail.ardaemail.com > >> >> >> >> info_log_path = /var/log/dovecot/info.log > >> >> >> >> instance_name = ec2-us-east-1a-arda-mail-001.ardaemail.com > >> >> >> >> listen = 172.16.0.200 > >> >> >> >> log_path = /var/log/dovecot/general.log > >> >> >> >> login_greeting = Welcome to ArdaEmail > >> >> >> >> mail_debug = yes > >> >> >> >> mail_gid = ardaemail > >> >> >> >> mail_location = maildir:/mnt/mail/%d/%n > >> >> >> >> mail_max_userip_connections = 1000 > >> >> >> >> mail_plugins = " quota mailbox_alias" > >> >> >> >> mail_server_admin = mailto:support@ardaemail.com > >> >> >> >> mail_uid = ardaemail > >> >> >> >> maildir_stat_dirs = yes > >> >> >> >> namespace inbox { > >> >> >> >> inbox = yes > >> >> >> >> location = > >> >> >> >> mailbox Archive { > >> >> >> >> auto = subscribe > >> >> >> >> special_use = \Archive > >> >> >> >> } > >> >> >> >> mailbox Drafts { > >> >> >> >> auto = subscribe > >> >> >> >> special_use = \Drafts > >> >> >> >> } > >> >> >> >> mailbox Junk { > >> >> >> >> auto = subscribe > >> >> >> >> autoexpunge = 90 days > >> >> >> >> special_use = \Junk > >> >> >> >> } > >> >> >> >> mailbox Sent { > >> >> >> >> auto = subscribe > >> >> >> >> special_use = \Sent > >> >> >> >> } > >> >> >> >> mailbox Trash { > >> >> >> >> auto = subscribe > >> >> >> >> autoexpunge = 30 days > >> >> >> >> special_use = \Trash > >> >> >> >> } > >> >> >> >> prefix = > >> >> >> >> } > >> >> >> >> passdb { > >> >> >> >> args = /etc/dovecot/inc.d/inc.sql.conf > >> >> >> >> driver = sql > >> >> >> >> } > >> >> >> >> plugin { > >> >> >> >> last_login_dict = proxy::sql > >> >> >> >> last_login_key = # hidden, use -P to show it > >> >> >> >> last_login_precision = ms > >> >> >> >> mailbox_alias_new = Junk Email > >> >> >> >> mailbox_alias_new2 = Junk E-mail > >> >> >> >> mailbox_alias_new3 = Sent Messages > >> >> >> >> mailbox_alias_new4 = Sent Items > >> >> >> >> mailbox_alias_new5 = Deleted Items > >> >> >> >> mailbox_alias_new6 = Junk Mail > >> >> >> >> mailbox_alias_old = Junk > >> >> >> >> mailbox_alias_old2 = Junk > >> >> >> >> mailbox_alias_old3 = Sent > >> >> >> >> mailbox_alias_old4 = Sent > >> >> >> >> mailbox_alias_old5 = Trash > >> >> >> >> mailbox_alias_old6 = Junk > >> >> >> >> quota = dict:User Quota::proxy::quota > >> >> >> >> quota_exceeded_message = Mailbox is full and cannot receive any more > >> >> >> >> emails > >> >> >> >> quota_status_nouser = DUNNO > >> >> >> >> quota_status_success = DUNNO > >> >> >> >> quota_warning = bytes=95%% quota-warning 95 %u > >> >> >> >> quota_warning2 = bytes=85%% quota-warning 85 %u > >> >> >> >> quota_warning3 = bytes=75%% quota-warning 75 %u > >> >> >> >> sieve = dict:proxy::sieve > >> >> >> >> sieve_plugins = sieve_imapsieve sieve_extprograms > >> >> >> >> } > >> >> >> >> postmaster_address = postmaster(a)ardaemail.com > >> >> >> >> protocols = imap lmtp > >> >> >> >> service auth-worker { > >> >> >> >> group = ardaemail > >> >> >> >> user = ardaemail > >> >> >> >> } > >> >> >> >> service auth { > >> >> >> >> group = ardaemail > >> >> >> >> unix_listener /var/spool/postfix/private/auth { > >> >> >> >> group = postfix > >> >> >> >> mode = 0666 > >> >> >> >> user = postfix > >> >> >> >> } > >> >> >> >> unix_listener auth-userdb { > >> >> >> >> group = ardaemail > >> >> >> >> mode = 0666 > >> >> >> >> user = ardaemail > >> >> >> >> } > >> >> >> >> user = ardaemail > >> >> >> >> } > >> >> >> >> service imap-login { > >> >> >> >> inet_listener imap { > >> >> >> >> port = 0 > >> >> >> >> } > >> >> >> >> inet_listener imaps { > >> >> >> >> port = 993 > >> >> >> >> ssl = yes > >> >> >> >> } > >> >> >> >> process_min_avail = 8 > >> >> >> >> service_count = 0 > >> >> >> >> } > >> >> >> >> service imap { > >> >> >> >> vsz_limit = 4 G > >> >> >> >> } > >> >> >> >> service lmtp { > >> >> >> >> unix_listener /var/spool/postfix/private/dovecot-lmtp { > >> >> >> >> group = postfix > >> >> >> >> mode = 0666 > >> >> >> >> user = postfix > >> >> >> >> } > >> >> >> >> } > >> >> >> >> service pop3-login { > >> >> >> >> inet_listener pop3 { > >> >> >> >> port = 0 > >> >> >> >> } > >> >> >> >> inet_listener pop3s { > >> >> >> >> port = 0 > >> >> >> >> } > >> >> >> >> } > >> >> >> >> service quota-status { > >> >> >> >> executable = /usr/lib/dovecot/quota-status -p postfix > >> >> >> >> unix_listener /var/spool/postfix/private/quota-status { > >> >> >> >> user = postfix > >> >> >> >> } > >> >> >> >> } > >> >> >> >> service quota-warning { > >> >> >> >> executable = script /etc/dovecot/bin/quota-warning.sh > >> >> >> >> unix_listener quota-warning { > >> >> >> >> group = ardaemail > >> >> >> >> mode = 0666 > >> >> >> >> user = ardaemail > >> >> >> >> } > >> >> >> >> } > >> >> >> >> service submission-login { > >> >> >> >> inet_listener submission { > >> >> >> >> port = 0 > >> >> >> >> } > >> >> >> >> } > >> >> >> >> ssl = required > >> >> >> >> ssl_cert = </etc/letsencrypt/live/mail.ardaemail.com/fullchain.pem > >> >> >> >> ssl_client_ca_dir = /etc/ssl/certs > >> >> >> >> ssl_dh = # hidden, use -P to show it > >> >> >> >> ssl_key = # hidden, use -P to show it > >> >> >> >> ssl_prefer_server_ciphers = yes > >> >> >> >> userdb { > >> >> >> >> args = /etc/dovecot/inc.d/inc.sql.conf > >> >> >> >> driver = sql > >> >> >> >> } > >> >> >> >> protocol imap { > >> >> >> >> imap_metadata = yes > >> >> >> >> mail_plugins = " quota mailbox_alias imap_sieve imap_quota last_login" > >> >> >> >> } > >> >> >> >> protocol lmtp { > >> >> >> >> mail_plugins = " quota mailbox_alias sieve” > >> >> >> >> } > >> >> >> >> > >> >> >> >> This output clearly does not include my Sieve configuration maps so > >> >> >> >> here’s those: > >> >> >> >> > >> >> >> >> connect = host=redacted dbname=redacted user=redacted password=redacted > >> >> >> >> > >> >> >> >> map { > >> >> >> >> pattern = priv/sieve/name/$script_name > >> >> >> >> table = mailboxFilter > >> >> >> >> username_field = email > >> >> >> >> value_field = uuid > >> >> >> >> fields { > >> >> >> >> name = $script_name > >> >> >> >> } > >> >> >> >> } > >> >> >> >> > >> >> >> >> map { > >> >> >> >> pattern = priv/sieve/data/$uuid > >> >> >> >> table = mailboxFilter > >> >> >> >> username_field = email > >> >> >> >> value_field = filter > >> >> >> >> fields { > >> >> >> >> uuid = $uuid > >> >> >> >> } > >> >> >> >> } > >> >> >> >> > >> >> >> >> And here’s the table schema: > >> >> >> >> > >> >> >> >> CREATE TABLE `mailboxFilter` ( > >> >> >> >> `id` int(11) unsigned NOT NULL AUTO_INCREMENT, > >> >> >> >> `uuid` varchar(36) NOT NULL, > >> >> >> >> `email` varchar(192) NOT NULL, > >> >> >> >> `name` varchar(255) NOT NULL, > >> >> >> >> `filter` longtext NOT NULL, > >> >> >> >> `isActive` bit(1) NOT NULL DEFAULT b’1’, > >> >> >> >> `createdAt` datetime NOT NULL DEFAULT current_timestamp(), > >> >> >> >> `updatedAt` datetime NOT NULL DEFAULT current_timestamp() ON UPDATE > >> >> >> >> current_timestamp(), > >> >> >> >> PRIMARY KEY (`id`), > >> >> >> >> UNIQUE KEY `UUID` (`uuid`), > >> >> >> >> UNIQUE KEY `EMAIL` (`email`) > >> >> >> >> ) ENGINE=InnoDB AUTO_INCREMENT=2 DEFAULT CHARSET=utf8mb4 > >> >> >> >> COLLATE=utf8mb4_general_ci; > >> >> >> >> > >> >> >> >> When I run manually queries, everything works fine though I am not > >> >> >> >> entirely sure what the queries are that Dovecot is executing. > >> >> >> >> > >> >> >> >> Any help is appreciated! Also, if I could use the “isActive” field, that > >> >> >> >> would be great as well. My plan to start here is to only have one record > >> >> >> >> in the table per mailbox which would contain all Sieve filters. > >> >> >> >> Eventually, it would be nice if I could adjust the configuration to > >> >> >> >> allow for more than one that returns concatenated so any help there > >> >> >> >> would be great as well! > >> >> >> >> > >> >> >> >> Thank you! > >> >> >> >> _______________________________________________ > >> >> >> >> dovecot mailing list -- dovecot(a)dovecot.org > >> >> >> >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> >> >> >_______________________________________________ > >> >> >> >dovecot mailing list -- dovecot(a)dovecot.org > >> >> >> >To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> >> >> _______________________________________________ > >> >> >> dovecot mailing list -- dovecot(a)dovecot.org > >> >> >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> >> _______________________________________________ > >> >> dovecot mailing list -- dovecot(a)dovecot.org > >> >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> >_______________________________________________ > >> >dovecot mailing list -- dovecot(a)dovecot.org > >> >To unsubscribe send an email to dovecot-leave(a)dovecot.org > >> _______________________________________________ > >> dovecot mailing list -- dovecot(a)dovecot.org > >> To unsubscribe send an email to dovecot-leave(a)dovecot.org > >_______________________________________________ > >dovecot mailing list -- dovecot(a)dovecot.org > >To unsubscribe send an email to dovecot-leave(a)dovecot.org

2 2

sieve mail date change
by Marc 24 Jul '24

24 Jul '24

I am a bit rookie with sieve. Some time ago I created a sieve pipe that would sometimes alter alter the subject and move a message to a different mailbox. Currently this results in that a date changes of this message while I don't see anything in the source altering a date. What could be causing this and how to work around this?

2 2

Sieve Filters with MySQL
by Adam Miller 24 Jul '24

24 Jul '24

Me again! I am trying to get sieve filters working with a MySQL backend but same to be coming up short. Right now, the error I am getting received is: ------------------------------------------------------------------------------------------------------------------ "User has no active script in storage dict:proxy::sieve;user=username@domain.com" ------------------------------------------------------------------------------------------------------------------ The “username(a)domain.xn--com-9o0a is obviously the email address of the receiving mailbox. Here’s my latest config: # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 6.5.0-1020-aws x86_64 Ubuntu 22.04.4 LTS nfs4 # Hostname: ec2-us-east-1a-arda-mail-001.ardaemail.com auth_debug = yes auth_mechanisms = plain login auth_verbose = yes auth_worker_max_count = 5 base_dir = /var/run/dovecot debug_log_path = /var/log/dovecot/debug.log default_internal_group = ardaemail default_internal_user = ardaemail dict { quota = mysql:/etc/dovecot/inc.d/inc.quota.user.sql.conf sieve = mysql:/etc/dovecot/inc.d/inc.sieve.sql.conf sql = mysql:/etc/dovecot/inc.d/inc.lastlogin.sql.conf } hostname = = mail.ardaemail.com info_log_path = /var/log/dovecot/info.log instance_name = ec2-us-east-1a-arda-mail-001.ardaemail.com listen = 172.16.0.200 log_path = /var/log/dovecot/general.log login_greeting = Welcome to ArdaEmail mail_debug = yes mail_gid = ardaemail mail_location = maildir:/mnt/mail/%d/%n mail_max_userip_connections = 1000 mail_plugins = " quota mailbox_alias" mail_server_admin = mailto:support@ardaemail.com mail_uid = ardaemail maildir_stat_dirs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 90 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = } passdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } plugin { last_login_dict = proxy::sql last_login_key = # hidden, use -P to show it last_login_precision = ms mailbox_alias_new = Junk Email mailbox_alias_new2 = Junk E-mail mailbox_alias_new3 = Sent Messages mailbox_alias_new4 = Sent Items mailbox_alias_new5 = Deleted Items mailbox_alias_new6 = Junk Mail mailbox_alias_old = Junk mailbox_alias_old2 = Junk mailbox_alias_old3 = Sent mailbox_alias_old4 = Sent mailbox_alias_old5 = Trash mailbox_alias_old6 = Junk quota = dict:User Quota::proxy::quota quota_exceeded_message = Mailbox is full and cannot receive any more emails quota_status_nouser = DUNNO quota_status_success = DUNNO quota_warning = bytes=95%% quota-warning 95 %u quota_warning2 = bytes=85%% quota-warning 85 %u quota_warning3 = bytes=75%% quota-warning 75 %u sieve = dict:proxy::sieve sieve_plugins = sieve_imapsieve sieve_extprograms } postmaster_address = postmaster(a)ardaemail.com protocols = imap lmtp service auth-worker { group = ardaemail user = ardaemail } service auth { group = ardaemail unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = ardaemail mode = 0666 user = ardaemail } user = ardaemail } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 8 service_count = 0 } service imap { vsz_limit = 4 G } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } service quota-status { executable = /usr/lib/dovecot/quota-status -p postfix unix_listener /var/spool/postfix/private/quota-status { user = postfix } } service quota-warning { executable = script /etc/dovecot/bin/quota-warning.sh unix_listener quota-warning { group = ardaemail mode = 0666 user = ardaemail } } service submission-login { inet_listener submission { port = 0 } } ssl = required ssl_cert = </etc/letsencrypt/live/mail.ardaemail.com/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } protocol imap { imap_metadata = yes mail_plugins = " quota mailbox_alias imap_sieve imap_quota last_login" } protocol lmtp { mail_plugins = " quota mailbox_alias sieve” } This output clearly does not include my Sieve configuration maps so here’s those: connect = host=redacted dbname=redacted user=redacted password=redacted map { pattern = priv/sieve/name/$script_name table = mailboxFilter username_field = email value_field = uuid fields { name = $script_name } } map { pattern = priv/sieve/data/$uuid table = mailboxFilter username_field = email value_field = filter fields { uuid = $uuid } } And here’s the table schema: CREATE TABLE `mailboxFilter` ( `id` int(11) unsigned NOT NULL AUTO_INCREMENT, `uuid` varchar(36) NOT NULL, `email` varchar(192) NOT NULL, `name` varchar(255) NOT NULL, `filter` longtext NOT NULL, `isActive` bit(1) NOT NULL DEFAULT b’1’, `createdAt` datetime NOT NULL DEFAULT current_timestamp(), `updatedAt` datetime NOT NULL DEFAULT current_timestamp() ON UPDATE current_timestamp(), PRIMARY KEY (`id`), UNIQUE KEY `UUID` (`uuid`), UNIQUE KEY `EMAIL` (`email`) ) ENGINE=InnoDB AUTO_INCREMENT=2 DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_general_ci; When I run manually queries, everything works fine though I am not entirely sure what the queries are that Dovecot is executing. Any help is appreciated! Also, if I could use the “isActive” field, that would be great as well. My plan to start here is to only have one record in the table per mailbox which would contain all Sieve filters. Eventually, it would be nice if I could adjust the configuration to allow for more than one that returns concatenated so any help there would be great as well! Thank you!

2 10

Key metrics to monitor for dovecot at CloudWatch
by Sivakumar Vadivel 24 Jul '24

24 Jul '24

Hello Team, Configured dovecot mail server and SES will receive and forward to SNS topic. Lambda subscribed to the topic and it will receive the mail and write to the EFS volume. EFS volume mounted on both dovecot and lambda. Also enabled AWS Cloudwatch to monitor overall infra. I'm going to enable anomaly detection at Cloudwatch and I want to know the list of key metrics to monitor. I'm thinking of the following metrics. 1. No of bounce 2. PublishFailed & Success 3. EFS disk storage Please suggest the other key metrics, so that I can enable anomaly detection to understand and create the cloudwatch alarm.

1 0

Dovecot Stats Plugin
by Adam Miller 23 Jul '24

23 Jul '24

Hello again everyone! I am trying to get the “doveadm stats dump” command to work and even though it does not error, there are no stats. When I try to enable the stats, I get the following error: “Error: Plugin 'stats' not found from directory /usr/lib/dovecot/modules” which is correct, the “stats” plugin does not exist. I do have “/usr/lib/dovecot/stats”. Here’s my configuration: Dovecot Version: 2.3.16 Operating System: Ubuntu 22.04.1 Packages Installed: - dovecot-antispam - dovecot-core - dovecot-imapd - dovecot-lmtpd - dovecot-mysql - dovecot-pop3d - dovecot-sieve Packages Available: - dovecot-auth-lua - dovecot-dev - dovecot-fts-xapian - dovecot-gssapi - dovecot-ldap - dovecot-lucene - dovecot-managesieved - dovecot-pgsql - dovecot-solr - dovecot-sqlite - dovecot-submissiond Dovecot Configuration (without stats enabled): # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) # OS: Linux 6.5.0-1020-aws x86_64 Ubuntu 22.04.4 LTS nfs4 # Hostname: ec2-us-east-1a-arda-mail-001.ardaemail.com auth_mechanisms = plain login auth_worker_max_count = 5 base_dir = /var/run/dovecot debug_log_path = /var/log/dovecot/debug.log default_internal_group = ardaemail default_internal_user = ardaemail dict { quota = mysql:/etc/dovecot/inc.d/inc.quota.user.sql.conf } hostname = = mail.ardaemail.com info_log_path = /var/log/dovecot/info.log instance_name = ec2-us-east-1a-arda-mail-001.ardaemail.com listen = 172.16.0.200 log_path = /var/log/dovecot/general.log login_greeting = Welcome to ArdaEmail mail_gid = ardaemail mail_location = maildir:/mnt/mail/%d/%n mail_max_userip_connections = 1000 mail_plugins = " quota mailbox_alias" mail_uid = ardaemail maildir_stat_dirs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = no special_use = \Drafts } mailbox Junk { auto = no autoexpunge = 90 days special_use = \Junk } mailbox SPAM { auto = subscribe autoexpunge = 90 days } mailbox Sent { auto = no special_use = \Sent } mailbox Trash { auto = no autoexpunge = 30 days special_use = \Trash } prefix = } passdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } plugin { imapsieve_mailbox1_before = file:/etc/dovecot/sieve.d/spam/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve.d/spam/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * mailbox_alias_new = Junk Email mailbox_alias_new2 = Junk E-mail mailbox_alias_new3 = Sent Messages mailbox_alias_new4 = Sent Items mailbox_alias_new5 = Deleted Items mailbox_alias_old = Junk mailbox_alias_old2 = Junk mailbox_alias_old3 = Sent mailbox_alias_old4 = Sent mailbox_alias_old5 = Trash quota = dict:User Quota::proxy::quota quota_exceeded_message = Mailbox is full and cannot receive any more emails quota_status_nouser = DUNNO quota_status_success = DUNNO quota_warning = bytes=95%% quota-warning 95 %u quota_warning2 = bytes=85%% quota-warning 85 %u quota_warning3 = bytes=75%% quota-warning 75 %u recipient_delimiter = + sieve_after = /etc/dovecot/sieve.d/after/ sieve_before = /etc/dovecot/sieve.d/before/ sieve_extensions = +spamtest +spamtestplus +virustest +notify +imapflags sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_quota_max_storage = 0 sieve_spamtest_max_header = X-Spamd-Result: -?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]) sieve_spamtest_status_header = X-Spamd-Result: (-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]] sieve_spamtest_status_type = score } postmaster_address = postmaster(a)ardaemail.com protocols = imap lmtp service auth-worker { group = ardaemail user = ardaemail } service auth { group = ardaemail unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = ardaemail mode = 0666 user = ardaemail } user = ardaemail } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 8 service_count = 0 } service imap { vsz_limit = 4 G } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } service quota-status { executable = /usr/lib/dovecot/quota-status -p postfix unix_listener /var/spool/postfix/private/quota-status { user = postfix } } service quota-warning { executable = script /etc/dovecot/bin/quota-warning.sh unix_listener quota-warning { group = ardaemail mode = 0666 user = ardaemail } } service submission-login { inet_listener submission { port = 0 } } ssl = required ssl_cert = </etc/letsencrypt/live/mail.ardaemail.com/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/inc.d/inc.sql.conf driver = sql } protocol imap { mail_plugins = " quota mailbox_alias imap_sieve imap_quota" } protocol lmtp { mail_plugins = " quota mailbox_alias sieve" } The “stats” plugin does not seem to be found anywhere from my searching. Any help is greatly appreciated. I would like to be able to turn on the INET listener to hit the stats via an HTTP request. Thank you!

3 7

Dovecot proxy/director/replicator upgrade path
by Andrea Gabellini 23 Jul '24

23 Jul '24

Hello, I manage a Dovecot installation version 2.3.4.1 with a pair of proxy/director in front and two backends that use the replicator plugin to synchronize emails between them. I would like to update all 4 machines and would like to understand if I can directly jump to the latest version 2.3.21 and if there is a logical sequence to follow, such as updating the backends first and then the frontends or vice versa. Thanks, Andrea -- __________________________ E-mail Signatures are usually made to compensate for the boring contents of the letter. __________________________ TIM San Marino S.p.A. Andrea Gabellini Engineering R&D TIM San Marino S.p.A. - https://www.telecomitalia.sm Via Ventotto Luglio, 212 - Piano -2 47893 - Borgo Maggiore - Republic of San Marino Tel: (+378) 0549 886237 Fax: (+378) 0549 886188 -- Informativa Privacy Questa email ha per destinatari dei contatti presenti negli archivi di TIM San Marino S.p.A.. Tutte le informazioni vengono trattate e tutelate nel rispetto della normativa vigente sulla protezione dei dati personali (Reg. EU 2016/679). Per richiedere informazioni e/o variazioni e/o la cancellazione dei vostri dati presenti nei nostri archivi potete inviare una email a privacy(a)telecomitalia.sm. Avviso di Riservatezza Il contenuto di questa e-mail e degli eventuali allegati e' strettamente confidenziale e destinato alla/e persona/e a cui e' indirizzato. Se avete ricevuto per errore questa e-mail, vi preghiamo di segnalarcelo immediatamente e di cancellarla dal vostro computer. E' fatto divieto di copiare e divulgare il contenuto di questa e-mail. Ogni utilizzo abusivo delle informazioni qui contenute da parte di persone terze o comunque non indicate nella presente e-mail potra' essere perseguito ai sensi di legge.

1 0

Seeking Guidance on Dovecot Configuration, Security, and Performance Optimization
by Selena Thomas 23 Jul '24

23 Jul '24

Hi everyone, I am setting up Dovecot for the first time and could use some guidance. I have a couple of questions::- -Configuration Basics: What are the essential configuration files I need to focus on for a basic setup: ?? -Security Best Practices: What steps should I take to ensure my Dovecot server is secure, especially regarding -authentication and SSL/TLS: ?? -Performance Tuning: Are there any tips for optimizing performance for a small to medium-sized deployment: ?? I appreciate any advice or resources you can point me towards. Thanks in advance for your help! With Regards, Selena [flutter/https://www.igmguru.com/digital-marketing-programming/flutter-train…]

2 1

Seeking Guidance on Dovecot Configuration, Security, and Performance Optimization
by Selena Thomas 23 Jul '24

23 Jul '24

Hi everyone, I am setting up Dovecot for the first time and could use some guidance. I have a couple of questions::- -Configuration Basics: What are the essential configuration files I need to focus on for a basic setup: ?? -Security Best Practices: What steps should I take to ensure my Dovecot server is secure, especially regarding -authentication and SSL/TLS: ?? -Performance Tuning: Are there any tips for optimizing performance for a small to medium-sized deployment: ?? I appreciate any advice or resources you can point me towards. Thanks in advance for your help! With Regards, Selena https://www.igmguru.com/digital-marketing-programming/flutter-training/

1 0

Seeking Guidance on Dovecot Configuration, Security, and Performance Optimization
by Selena Thomas 23 Jul '24

23 Jul '24

Hi everyone, I am setting up Dovecot for the first time and could use some guidance. I have a couple of questions::- -Configuration Basics: What are the essential configuration files I need to focus on for a basic setup: ?? -Security Best Practices: What steps should I take to ensure my Dovecot server is secure, especially regarding -authentication and SSL/TLS: ?? -Performance Tuning: Are there any tips for optimizing performance for a small to medium-sized deployment: ?? I appreciate any advice or resources you can point me towards. Thanks in advance for your help! With Regards, Selena [https://www.igmguru.com/digital-marketing-programming/flutter-training/flut…]

1 0

auth-worker doesn't systematically log the IP
by Yassine Chaouche 23 Jul '24

23 Jul '24

Dear list, look at this grep auth-worker | nl output from my dovecot log : 166 Jul 22 15:49:47 auth-worker(24409): Info: sql(hakim.boukhadra(a)domain.tld): unknown user 167 Jul 22 15:49:47 auth-worker(13026): Info: sql(prtg(a)domain.tld): unknown user 168 Jul 22 15:53:00 auth-worker(13026): Info: sql(feriel.abbas(a)domain.tld,10.10.10.19): Password mismatch 169 Jul 22 15:53:15 auth-worker(13026): Info: sql(feriel.abbas(a)domain.tld,10.10.10.19): Password mismatch 170 Jul 22 15:55:26 auth-worker(13026): Info: sql(it_sys(a)domain.tld): unknown user 171 Jul 22 15:59:30 auth-worker(13026): Info: sql(radioaintemouchent.domain.tld,10.10.10.19): unknown user 172 Jul 22 15:59:43 auth-worker(13026): Info: sql(mouadoussama(a)radioalgerie.dz): unknown user 173 Jul 22 16:00:38 auth-worker(13026): Info: sql(it_mam(a)domain.tld): unknown user 174 Jul 22 16:00:58 auth-worker(13026): Info: sql(it_mam(a)domain.tld): unknown user 175 Jul 22 16:02:01 auth-worker(13026): Info: sql(it_mam(a)domain.tld): unknown user 176 Jul 22 16:09:35 auth-worker(13026): Info: sql(it_mam(a)domain.tld): unknown user 177 Jul 22 16:09:42 auth-worker(13026): Info: sql(prtg(a)domain.tld): unknown user 178 Jul 22 16:10:11 auth-worker(13026): Info: sql(it_mam(a)domain.tld): unknown user 179 Jul 22 16:15:37 auth-worker(13026): Info: sql(it_sys(a)domain.tld): unknown user 180 Jul 22 16:26:55 auth-worker(13026): Info: sql(it_mam(a)domain.tld): unknown user 181 Jul 22 16:32:01 auth-worker(13026): Info: sql(it_mam(a)domain.tld): unknown user 182 Jul 22 16:35:37 auth-worker(19555): Info: sql(it_sys(a)domain.tld): unknown user As you can see, sometimes the IP addresses of the dubious login attempts are noted, other times this crucial piece of evidence is conspicuously absent. I am wondering what is the source of all those login attempts? or could those be mere username lookups instead to test for mail deliverability? Many thanks, -- yassine -- sysadm +213-779 06 06 23 http://about.me/ychaouche Looking for side gigs.

2 2