imap_metadata plugin panic

Elisamuel Resto sam at samresto.dev
Wed Dec 1 13:00:43 UTC 2021


Aki,

Since the original email, dicts are now on their own. For the metadata I 
have tried the two dicts (shared/$key, priv/$key), just the priv dict db 
schema with "pattern = $key" per one of your emails to the ML, and just 
the "priv/$key" pattern. All of those combinations produce the same 
issue. In summary, I've tried several things but result is still that I 
can create folders but deletion causes a panic.

As of last email sending the dict, here is what dovecot knows about the 
dicts:
dict {
         quota_clone = mysql:/etc/dovecot/dovecot-quota-dict.conf.ext
         lastlogin = mysql:/etc/dovecot/dovecot-lastlogin-dict.conf.ext
         metadata = mysql:/etc/dovecot/dovecot-metadata-dict.conf.ext
}

And the dovecot-metadata-dict.conf.ext:
map {
         pattern = shared/$key
         table = metadata_shared
         username_field = username
         value_field = meta_value

         fields {
                 meta_key = $key
         }
}

map {
         pattern = priv/$key
         table = metadata_priv
         username_field = username
         value_field = meta_value

         fields {
                 meta_key = $key
         }
}

I've attached the current dovecot.conf.


-Sam

------------------------------------------------------------------------
*From:* Aki Tuomi [mailto:aki.tuomi at open-xchange.com]
*Sent:* Wednesday, December 1, 2021, 2:23 AM
*To:* Elisamuel Resto; dovecot at dovecot.org
*Subject:* imap_metadata plugin panic

> It's probably not a good idea to put all the patterns in same dict. I would first try if it still happens if you make a dedicated mysql dict with only the metadata patterns.
>
> Aki
>
>> On 22/11/2021 18:52 Elisamuel Resto <sam at samresto.dev> wrote:
>>
>>   
>> Aki,
>>
>> My apologies, I thought that it was included in the output of "dovecot
>> -n". I don't have just one, but I concatenated them for ease. See attached.
>>
>> Thanks!
>> -Sam
>> ------------------------------------------------------------------------
>> *From:* Aki Tuomi [mailto:aki.tuomi at open-xchange.com]
>> *Sent:* Monday, November 22, 2021, 5:13 AM
>> *To:* dovecot at dovecot.org, Elisamuel Resto
>> *Cc:* dovecot at ptld.com
>> *Subject:* imap_metadata plugin panic
>>
>>> Hi, I wanted to see /etc/dovecot/dovecot-dict-sql.conf.ext
>>>
>>> Aki
>>>
>>> On 22 November 2021 11.08.01 UTC, Elisamuel Resto <sam at samresto.dev>
>>> wrote:
>>>
>>>      Aki,
>>>
>>>      # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf
>>>      # Pigeonhole version 0.5.16 (09c29328)
>>>      # OS: Linux 5.14.16-arch1-1 x86_64  ext4
>>>
-------------- next part --------------
# 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf
# Pigeonhole version 0.5.16 (09c29328)
# OS: Linux 5.15.4-arch1-1 x86_64  ext4
# Hostname: wyvern.simplysam.us
auth_mechanisms = plain login
dict {
  lastlogin = mysql:/etc/dovecot/dovecot-lastlogin-dict.conf.ext
  metadata = mysql:/etc/dovecot/dovecot-metadata-dict.conf.ext
  quota_clone = mysql:/etc/dovecot/dovecot-quota-dict.conf.ext
}
doveadm_worker_count = 5
first_valid_gid = 5000
first_valid_uid = 5000
imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags
last_valid_gid = 5000
last_valid_uid = 5000
lda_mailbox_autocreate = yes
lda_mailbox_autosubscribe = yes
lda_original_recipient_header = X-Original-To
lmtp_client_workarounds = whitespace-before-path
lmtp_rcpt_check_quota = yes
lmtp_save_to_detail_mailbox = yes
mail_attachment_detection_options = add-flags-on-save
mail_attribute_dict = proxy::metadata
mail_gid = 5000
mail_home = /var/mail/virtual/%Ld/%Ln
mail_location = maildir:/var/mail/virtual/%Ld/%Ln
mail_plugins = " quota quota_clone mailbox_alias trash fts fts_flatcurve"
mail_uid = 5000
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtestplus virustest vnd.dovecot.pipe vnd.dovecot.filter
namespace inbox {
  inbox = yes
  location =
  mailbox Archive {
    auto = subscribe
    special_use = \Archive
  }
  mailbox Drafts {
    auto = subscribe
    special_use = \Drafts
  }
  mailbox Sent {
    auto = subscribe
    special_use = \Sent
  }
  mailbox "Sent Messages" {
    auto = no
    special_use = \Sent
  }
  mailbox Spam {
    auto = subscribe
    autoexpunge = 30 days
    special_use = \Junk
  }
  mailbox Trash {
    auto = subscribe
    autoexpunge = 90 days
    special_use = \Trash
  }
  prefix =
  separator = /
  type = private
}
passdb {
  args = /etc/dovecot/dovecot-sql.conf.ext
  driver = sql
}
plugin {
  antispam_backend = pipe
  antispam_pipe_program = /usr/local/sbin/sa-learn-pipe
  antispam_pipe_program_notspam_arg = --ham
  antispam_pipe_program_spam_arg = --spam
  antispam_pipe_tmpdir = /tmp
  antispam_spam = Junk;Spam
  antispam_trash = trash;Trash;Deleted Items;Deleted Messages
  fts = flatcurve
  fts_autoindex = yes
  fts_autoindex_exclude = \Spam
  fts_autoindex_exclude2 = \Trash
  fts_enforced = yes
  fts_flatcurve = commit_limit=500 max_term_size=30 min_term_size=2 optimize_limit=10 rotate_size=5000 rotate_time=5000 substring_search=yes
  fts_languages = en es
  fts_tokenizer_generic = algorithm=simple
  fts_tokenizers = generic email-address
  imapsieve_mailbox1_after = file:/var/lib/dovecot/sieve/report-spam.sieve
  imapsieve_mailbox1_causes = COPY
  imapsieve_mailbox1_name = Junk
  imapsieve_mailbox2_after = file:/var/lib/dovecot/sieve/report-spam.sieve
  imapsieve_mailbox2_causes = COPY
  imapsieve_mailbox2_name = Spam
  imapsieve_mailbox3_after = file:/var/lib/dovecot/sieve/report-ham.sieve
  imapsieve_mailbox3_causes = COPY
  imapsieve_mailbox3_from = Junk
  imapsieve_mailbox3_name = *
  imapsieve_mailbox4_after = file:/var/lib/dovecot/sieve/report-ham.sieve
  imapsieve_mailbox4_causes = COPY
  imapsieve_mailbox4_from = Spam
  imapsieve_mailbox4_name = *
  imapsieve_mailbox5_after = file:/var/lib/dovecot/sieve/report-ham.sieve
  imapsieve_mailbox5_causes = COPY
  imapsieve_mailbox5_name = Archive
  imapsieve_mailbox6_after = file:/var/lib/dovecot/sieve/mark-seen.sieve
  imapsieve_mailbox6_causes = COPY
  imapsieve_mailbox6_name = Trash
  imapsieve_url = sieve://wyvern.simplysam.us:4190
  last_login_dict = proxy::lastlogin
  last_login_key = # hidden, use -P to show it
  mailbox_alias_new = Sent Messages
  mailbox_alias_new2 = Sent Items
  mailbox_alias_new3 = Junk
  mailbox_alias_old = Sent
  mailbox_alias_old2 = Sent
  mailbox_alias_old3 = Spam
  quota = count:User quota
  quota_clone_dict = proxy::quota_clone
  quota_grace = 10%%
  quota_max_mail_size = 30M
  quota_rule = *:storage=1G
  quota_rule2 = Trash:ignore
  quota_rule3 = Spam:ignore
  quota_status_nouser = DUNNO
  quota_status_overquota = 552 5.2.2 Mailbox is full
  quota_status_success = DUNNO
  quota_vsizes = yes
  sieve = file:~/sieve;active=~/dovecot.sieve
  sieve_before = /var/lib/dovecot/sieve.d/
  sieve_extensions = +spamtestplus +virustest +vnd.dovecot.pipe +vnd.dovecot.filter
  sieve_max_redirects = 30
  sieve_plugins = sieve_extprograms
  sieve_vacation_send_from_recipient = yes
  trash = /etc/dovecot/dovecot-trash.conf.ext
}
pop3_client_workarounds = outlook-no-nuls oe-ns-eoh
pop3_enable_last = yes
pop3_reuse_xuidl = yes
protocols = imap pop3 lmtp sieve
quota_full_tempfail = yes
service auth-worker {
  user = $default_internal_user
}
service auth {
  unix_listener /var/spool/postfix/private/auth {
    group = postfix
    mode = 0660
    user = postfix
  }
  unix_listener auth-userdb {
    mode = 0666
  }
}
service dict {
  unix_listener dict {
    group = vmail
    mode = 0660
    user = vmail
  }
}
service imap-login {
  inet_listener imap {
    port = 143
  }
  inet_listener imaps {
    port = 993
    ssl = yes
  }
  process_min_avail = 1
  service_count = 1
}
service lmtp {
  unix_listener /var/spool/postfix/private/dovecot-lmtp {
    group = postfix
    mode = 0600
    user = postfix
  }
  unix_listener lmtp {
    mode = 0666
  }
}
service managesieve-login {
  inet_listener sieve {
    port = 4190
  }
  process_min_avail = 1
  service_count = 1
}
service managesieve {
  process_limit = 20
}
service pop3-login {
  inet_listener pop3 {
    port = 110
  }
  inet_listener pop3s {
    port = 995
    ssl = yes
  }
}
service stats {
  unix_listener stats-reader {
    group = vmail
    mode = 0664
    user = vmail
  }
  unix_listener stats-writer {
    group = vmail
    mode = 0666
    user = vmail
  }
}
service submission-login {
  inet_listener submission {
    port = 587
  }
}
ssl_cert = </etc/letsencrypt/live/wyvern.simplysam.us/fullchain.pem
ssl_cipher_list = ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384
ssl_dh = # hidden, use -P to show it
ssl_key = # hidden, use -P to show it
userdb {
  args = /etc/dovecot/dovecot-sql.conf.ext
  driver = sql
}
verbose_proctitle = yes
protocol lmtp {
  auth_username_format = %Lu
  mail_plugins = " quota quota_clone mailbox_alias trash fts fts_flatcurve sieve"
}
protocol !indexer-worker {
  mail_vsize_bg_after_count = 100
}
protocol lda {
  mail_plugins = " quota quota_clone mailbox_alias trash fts fts_flatcurve sieve"
}
protocol imap {
  imap_metadata = yes
  mail_plugins = " quota quota_clone mailbox_alias trash fts fts_flatcurve imap_quota last_login"
}
protocol sieve {
  mail_plugins =
}
protocol pop3 {
  mail_plugins = " quota quota_clone mailbox_alias trash fts fts_flatcurve last_login"
}
protocol submission {
  mail_plugins = " quota quota_clone mailbox_alias trash fts fts_flatcurve"
}
-------------- next part --------------
A non-text attachment was scrubbed...
Name: OpenPGP_0xD2D5FB6118615F19.asc
Type: application/pgp-keys
Size: 7818 bytes
Desc: OpenPGP public key
URL: <https://dovecot.org/pipermail/dovecot/attachments/20211201/c66977a1/attachment-0001.key>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: OpenPGP_signature
Type: application/pgp-signature
Size: 840 bytes
Desc: OpenPGP digital signature
URL: <https://dovecot.org/pipermail/dovecot/attachments/20211201/c66977a1/attachment-0001.sig>


More information about the dovecot mailing list