Oh hell, that is clearly obvious now that I look at it that way, thank you. It was very late for me last night when I got to this part in my task list so I probably should have stopped but instead of kept drudging forward. Haha - Thank you again for the help, I appreciate it.
As for the database tables, I get what you’re saying and that isn’t a bad idea but I really prefer less tables where possible without having more than 10-15 columns per table as well. I have Redis in the environment too for a few things such as RSPAMD and DKIM stuff. I like a lean environment and that includes database tables, schemas and well organized data. I am a bit old school and a bit OCD.
Thanks again, I appreciate it!
------ Original Message ------ From "Aki Tuomi via dovecot" <dovecot@dovecot.org> To "Adam Miller" <adam@ardaemail.com>; "Adam Miller via dovecot" <dovecot@dovecot.org> Date 7/23/2024 10:06:38 PM Subject Re: Re[6]: Sieve Filters with MySQL
Hi!
Usually how the "isActive" stuff is done is bit different.
fwiw i would do the schema differently, and have two tables
table 1:
CREATE TABLE sieve_name_id ( id INT, email VARCHAR(255), name VARCHAR(255), PRIMARY KEY(email, name) )
table 2
CREATE TABLE sieve_scripts ( id INT, content TEXT )
Then you can map 'default' to the active script id, or leave it missing when there is no script enabled. This is how it's supposed to work.
It's probably not dead obvious but if you look at the dict configuration you have:
map { pattern = priv/sieve/name/$script_name table = mailboxFilter username_field = email value_field = uuid fields { name = $script_name } }
You can see that the priv/sieve/name/ is not part of $script_name that is passed to sql in fields.
btw, to debug SQL, you can try
log_debug=category=sql
next time.
Aki
On 24/07/2024 00:42 EEST Adam Miller via dovecot <dovecot@dovecot.org> wrote:
Is it possible to include extra fields? For example, the “isActive” and make sure it is true / 1?
Thank you.
------ Original Message ------ From "Aki Tuomi via dovecot" <dovecot@dovecot.org> To "Adam Miller" <adam@ardaemail.com>; "Adam Miller via dovecot" <dovecot@dovecot.org> Date 7/23/2024 4:44:30 AM Subject Re: Re[4]: Sieve Filters with MySQL
You can try
doveadm dict get -u adam proxy::sieve priv/sieve/name/default
this should return id of the default script.
doveadm dict get -u adam proxy::sieve priv/sieve/data/<id>
should return the actual script.
See https://doc.dovecot.org/configuration_manual/sieve/dict/
Aki
On 23/07/2024 14:09 EEST Adam Miller via dovecot <dovecot@dovecot.org> wrote:
Yes, I get that. What I would like to know is what are the queries that Dovecot / Sieve is executing so that I can better determine where the issue exists? Is there anyway to see them? Do you see an issue anywhere in my configuration files?
Thank you.
------ Original Message ------ From "Aki Tuomi" <aki.tuomi@open-xchange.com> To "Adam Miller" <adam@ardaemail.com>; "Adam Miller via dovecot" <dovecot@dovecot.org> Date 7/23/2024 4:07:22 AM Subject Re: Re[2]: Sieve Filters with MySQL
Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: sieve: dict storage: script
default': Scriptdefault' not found at path priv/sieve/name/defaultAki
On 23/07/2024 13:52 EEST Adam Miller via dovecot <dovecot@dovecot.org> wrote:
Yes, that is where I got the error from. Here’s more from the log file:
Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: sieve: Pigeonhole version 0.5.16 (09c29328) initializing Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include
:global’ scripts. Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.16 (09c29328) loaded Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.16 (09c29328) loaded Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: sieve: dict storage: user=redacted, uri=proxy::sieve Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: sieve: dict storage: scriptdefault': Scriptdefault' not found at path priv/sieve/name/default Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: sieve: User has no active script in storagedict:proxy::sieve;user=redacted’ Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: sieve: User has no personal script Jul 23 10:34:40 lmtp(redacted)<228576><CM1ZFUCHn2bgfAMAwHdlHA>: Debug: sieve: No scripts to execute: reverting to default delivery.Is there something specific I should be looking for?
Thank you!
------ Original Message ------ From "Aki Tuomi via dovecot" <dovecot@dovecot.org> To "Adam Miller" <adam@ardaemail.com>; "Adam Miller via dovecot" <dovecot@dovecot.org> Date 7/23/2024 3:35:17 AM Subject Re: Sieve Filters with MySQL
>Did you try with > >mail_debug=yes > >and > >log_debug=category=sieve > >Aki > >> On 23/07/2024 13:18 EEST Adam Miller via dovecot <dovecot@dovecot.org> wrote: >> >> >> Me again! I am trying to get sieve filters working with a MySQL backend >> but same to be coming up short. Right now, the error I am getting >> received is: >> >> ------------------------------------------------------------------------------------------------------------------ >> >> "User has no active script in storage >> dict:proxy::sieve;user=username@domain.com" >> >> ------------------------------------------------------------------------------------------------------------------ >> >> The “username@domain.com” is obviously the email address of the >> receiving mailbox. >> >> Here’s my latest config: >> >> # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf >> # Pigeonhole version 0.5.16 (09c29328) >> # OS: Linux 6.5.0-1020-aws x86_64 Ubuntu 22.04.4 LTS nfs4 >> # Hostname: ec2-us-east-1a-arda-mail-001.ardaemail.com >> auth_debug = yes >> auth_mechanisms = plain login >> auth_verbose = yes >> auth_worker_max_count = 5 >> base_dir = /var/run/dovecot >> debug_log_path = /var/log/dovecot/debug.log >> default_internal_group = ardaemail >> default_internal_user = ardaemail >> dict { >> quota = mysql:/etc/dovecot/inc.d/inc.quota.user.sql.conf >> sieve = mysql:/etc/dovecot/inc.d/inc.sieve.sql.conf >> sql = mysql:/etc/dovecot/inc.d/inc.lastlogin.sql.conf >> } >> hostname = = mail.ardaemail.com >> info_log_path = /var/log/dovecot/info.log >> instance_name = ec2-us-east-1a-arda-mail-001.ardaemail.com >> listen = 172.16.0.200 >> log_path = /var/log/dovecot/general.log >> login_greeting = Welcome to ArdaEmail >> mail_debug = yes >> mail_gid = ardaemail >> mail_location = maildir:/mnt/mail/%d/%n >> mail_max_userip_connections = 1000 >> mail_plugins = " quota mailbox_alias" >> mail_server_admin = mailto:support@ardaemail.com >> mail_uid = ardaemail >> maildir_stat_dirs = yes >> namespace inbox { >> inbox = yes >> location = >> mailbox Archive { >> auto = subscribe >> special_use = \Archive >> } >> mailbox Drafts { >> auto = subscribe >> special_use = \Drafts >> } >> mailbox Junk { >> auto = subscribe >> autoexpunge = 90 days >> special_use = \Junk >> } >> mailbox Sent { >> auto = subscribe >> special_use = \Sent >> } >> mailbox Trash { >> auto = subscribe >> autoexpunge = 30 days >> special_use = \Trash >> } >> prefix = >> } >> passdb { >> args = /etc/dovecot/inc.d/inc.sql.conf >> driver = sql >> } >> plugin { >> last_login_dict = proxy::sql >> last_login_key = # hidden, use -P to show it >> last_login_precision = ms >> mailbox_alias_new = Junk Email >> mailbox_alias_new2 = Junk E-mail >> mailbox_alias_new3 = Sent Messages >> mailbox_alias_new4 = Sent Items >> mailbox_alias_new5 = Deleted Items >> mailbox_alias_new6 = Junk Mail >> mailbox_alias_old = Junk >> mailbox_alias_old2 = Junk >> mailbox_alias_old3 = Sent >> mailbox_alias_old4 = Sent >> mailbox_alias_old5 = Trash >> mailbox_alias_old6 = Junk >> quota = dict:User Quota::proxy::quota >> quota_exceeded_message = Mailbox is full and cannot receive any more >> emails >> quota_status_nouser = DUNNO >> quota_status_success = DUNNO >> quota_warning = bytes=95%% quota-warning 95 %u >> quota_warning2 = bytes=85%% quota-warning 85 %u >> quota_warning3 = bytes=75%% quota-warning 75 %u >> sieve = dict:proxy::sieve >> sieve_plugins = sieve_imapsieve sieve_extprograms >> } >> postmaster_address = postmaster@ardaemail.com >> protocols = imap lmtp >> service auth-worker { >> group = ardaemail >> user = ardaemail >> } >> service auth { >> group = ardaemail >> unix_listener /var/spool/postfix/private/auth { >> group = postfix >> mode = 0666 >> user = postfix >> } >> unix_listener auth-userdb { >> group = ardaemail >> mode = 0666 >> user = ardaemail >> } >> user = ardaemail >> } >> service imap-login { >> inet_listener imap { >> port = 0 >> } >> inet_listener imaps { >> port = 993 >> ssl = yes >> } >> process_min_avail = 8 >> service_count = 0 >> } >> service imap { >> vsz_limit = 4 G >> } >> service lmtp { >> unix_listener /var/spool/postfix/private/dovecot-lmtp { >> group = postfix >> mode = 0666 >> user = postfix >> } >> } >> service pop3-login { >> inet_listener pop3 { >> port = 0 >> } >> inet_listener pop3s { >> port = 0 >> } >> } >> service quota-status { >> executable = /usr/lib/dovecot/quota-status -p postfix >> unix_listener /var/spool/postfix/private/quota-status { >> user = postfix >> } >> } >> service quota-warning { >> executable = script /etc/dovecot/bin/quota-warning.sh >> unix_listener quota-warning { >> group = ardaemail >> mode = 0666 >> user = ardaemail >> } >> } >> service submission-login { >> inet_listener submission { >> port = 0 >> } >> } >> ssl = required >> ssl_cert = </etc/letsencrypt/live/mail.ardaemail.com/fullchain.pem >> ssl_client_ca_dir = /etc/ssl/certs >> ssl_dh = # hidden, use -P to show it >> ssl_key = # hidden, use -P to show it >> ssl_prefer_server_ciphers = yes >> userdb { >> args = /etc/dovecot/inc.d/inc.sql.conf >> driver = sql >> } >> protocol imap { >> imap_metadata = yes >> mail_plugins = " quota mailbox_alias imap_sieve imap_quota last_login" >> } >> protocol lmtp { >> mail_plugins = " quota mailbox_alias sieve” >> } >> >> This output clearly does not include my Sieve configuration maps so >> here’s those: >> >> connect = host=redacted dbname=redacted user=redacted password=redacted >> >> map { >> pattern = priv/sieve/name/$script_name >> table = mailboxFilter >> username_field = email >> value_field = uuid >> fields { >> name = $script_name >> } >> } >> >> map { >> pattern = priv/sieve/data/$uuid >> table = mailboxFilter >> username_field = email >> value_field = filter >> fields { >> uuid = $uuid >> } >> } >> >> And here’s the table schema: >> >> CREATE TABLE
mailboxFilter( >>idint(11) unsigned NOT NULL AUTO_INCREMENT, >>uuidvarchar(36) NOT NULL, >>namevarchar(255) NOT NULL, >>filterlongtext NOT NULL, >>isActivebit(1) NOT NULL DEFAULT b’1’, >>createdAtdatetime NOT NULL DEFAULT current_timestamp(), >>updatedAtdatetime NOT NULL DEFAULT current_timestamp() ON UPDATE >> current_timestamp(), >> PRIMARY KEY (id), >> UNIQUE KEYUUID(uuid), >> UNIQUE KEY
dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-leave@dovecot.org
dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-leave@dovecot.org
dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-leave@dovecot.org
dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-leave@dovecot.org
dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-leave@dovecot.org