- dovecot - dovecot.org

master - master syncronization: *-temp-1-temp-1-temp-2-* recursion
by Heiko Schlittermann 05 Jul '21

05 Jul '21

Hi, I'm using dovecot 2.3.4.1 (f79e8e7e4) (Debian Build) and doing master/master replication. Recently we added a huuge .Archive* folder structure to the items being replicated. And now, suddenly we see new folders with a naming like *-temp-1-temp-1-temp-2-* appearing. This finally lead to infinite recursion until the replicator crashed. I've a theory, but please see below (**) for influence from outside of dovecot: SiteA starts replication of a huge .Archive folder, which doesn't exist on siteB yet A B .Archive ----> .Archive-temp-1 Because it takes ages to sync, the replicator on siteB now sees the new .Archive-temp-1 folder and starts replicating this back to siteA .Archive-temp-1-temp-1 <----- .Archive-temp-1 If now the replicator on siteA hits that new folder, it starts replicating it to site B .Archive-temp-1-temp-1 ----> .Archive-temp-1-temp-1-temp-2 … and so on. Sometimes the digit is "2", or even "3". I didn't check the Dovecot source yet, if the Replicator fails to skip the temporary folders it gets "injected" from the other side. (**) Possible external influence: On siteA a cronjob once per day moves the .Archive* folders to another filesystem and replaces the .Archive* directory with a symlink. This script "touches" the dovecot-uidlist.lock prior to its action (but doesn't check if there is already a lock). Could this mailbox move *behind* the back of the replicator be a reason for the odd behaviour? Additional info: On *both* nodes the config looks like this: doveadm_password = <password> service doveadm { inet_listener { port = 9090 ssl = yes } } replication_max_conns = 16 plugin { mail_replica = tcps:<other site>:9090 } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 user = dovecot } } service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = dovecot } unix_listener replication-notify { mode = 0666 user = dovecot } }

1 0

Duplicate users with multiple userdb iteration
by Slavko 05 Jul '21

05 Jul '21

Hi, recently i decided to use quota_over_flag with passwd_file userdb. The main idea is to prevent dovecot (or vmail) user to have write access to file with passwords. To do it, i setup separate userdb as this (SQL userdb is SQLite based, thus the same problem with write): passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = username_format=%u /etc/dovecot/over_quota default_fields = quota_over_flag=1 driver = passwd-file result_internalfail = continue-fail result_success = continue-fail } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } For testing i add one user into over_quota file: slavko(a)slavino.eu::::::: With this setting the doveadm user with user in over_quota seems to work: doveadm user slavko(a)slavino.eu field value uid 20000 gid 20000 home /srv/vmail/slavino.eu/slavko mail maildir:~/Maildir quota_over_flag 1 quota_rule *:storage=0M quota2_rule *:storage=0M But the user iteration shows duplicate users: doveadm user '*' slavko(a)slavino.eu slavko(a)slavino.eu ... As we discussed on IRC, it is how iteration works, as it emit users as soon as it meet it, but this doesn't correspond with "multiple userdb are merged" in docs (for iteration). I am surprised by this mainly because the particular userdb has set result_success to "continue-fail" and thus have to set user not found as with any user, which is not in this db. But it seems, that iteration ignores this result. I wrote this as we discussed via IRC, i am not subscribed, thus please CC me. regards -- Slavko http://slavino.sk

1 0

Re: Re: lost mailbox
by Stephane Magnier 05 Jul '21

05 Jul '21

Hi , Thanks Erwan, Yes I did it.. what worries me is, that that instruction lsub "" * seems not to work.. I mean I am not allowed to see it b lsub "" * b NO [NOPERM] No permission to read subscriptions (0.001 + 0.000 secs). So not sure that this is the fault of Thunderbird :-) Thanks for your help

2 1

Pb with Dovecot and visble folders
by Stephane Magnier 04 Jul '21

04 Jul '21

Hi, I've got a problem with my Dovecot installation.. Up to now, that was working fine.but today [root@mbox admin]# telnet localhost 143 Trying ::1... telnet: connect to address ::1: Connection refused Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS AUTH=PLAIN] Dovecot ready. a login azt000 xxxxxx a OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY LITERAL+ NOTIFY SPECIAL-USE QUOTA] Logged in b list "" * * LIST (\NoInferiors \UnMarked) "/" ssss * LIST (\NoInferiors \UnMarked) "/" 2021-TEST * LIST (\NoInferiors \UnMarked) "/" 2015 * LIST (\NoInferiors \UnMarked) "/" 2020-IT * LIST (\NoInferiors \UnMarked) "/" 2018-PERSO * LIST (\NoInferiors \UnMarked) "/" 2017 * LIST (\NoInferiors \UnMarked) "/" 2020-MARKETING * LIST (\NoInferiors \UnMarked) "/" 2019-AZT * LIST (\NoInferiors \UnMarked) "/" 2019-ADMIN * LIST (\NoInferiors \UnMarked) "/" "2020- PERSO" * LIST (\NoInferiors \UnMarked) "/" sss * LIST (\NoInferiors \UnMarked) "/" 2019-COMPTA * LIST (\NoInferiors \UnMarked) "/" 2019-PERSO * LIST (\NoInferiors \UnMarked) "/" 2017-ADMIN * LIST (\NoInferiors \UnMarked) "/" 2016 * LIST (\NoInferiors \UnMarked) "/" 2020-compta * LIST (\NoInferiors \Marked \Trash) "/" Trash * LIST (\NoInferiors \UnMarked) "/" Archives * LIST (\NoInferiors \UnMarked \Sent) "/" Sent * LIST (\NoInferiors \Marked \Junk) "/" Junk * LIST (\NoInferiors \UnMarked \Drafts) "/" Drafts * LIST (\NoInferiors \UnMarked \Sent) "/" "Sent Messages" * LIST (\NoInferiors \UnMarked) "/" INBOX/2021-AZT * LIST (\NoInferiors \UnMarked) "/" INBOX/2021-WebMEETING * LIST (\NoInferiors \UnMarked) "/" INBOX/2021-zezez * LIST (\NoInferiors \UnMarked) "/" INBOX/2021-PERSO * LIST (\NoInferiors \UnMarked) "/" INBOX/2021-MARKETING * LIST (\NoInferiors \UnMarked) "/" INBOX/2021-COMPTA * LIST (\NoInferiors \UnMarked) "/" INBOX/2021-ADMIN * LIST (\NoInferiors \UnMarked) "/" INBOX/2021-ATV * LIST (\NoInferiors \UnMarked) "/" INBOX/2021-test * LIST (\HasChildren) "/" INBOX b OK List completed (0.016 + 0.000 + 0.015 secs). *c lsub "" ** c NO [NOPERM] No permission to read subscriptions (0.001 + 0.000 secs). If I understand correctly, lsub should see what is visible by the Email client ? How can I let all the folders visible ? [root@mbox dovecot]# cat dovecot-new.conf # 2.3.8 (9df20d2db): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.8 (b7b03ba2) # OS: Linux 4.18.0-305.3.1.el8.x86_64 x86_64 CentOS Linux release 8.4.2105 nfs4 # Hostname: mbox1.aztgrp.net auth_debug_passwords = yes auth_username_format = %n disable_plaintext_auth = no login_trusted_networks = 177.18.0.0/16 127.0.0.1 ::1 mail_access_groups = mail mail_fsync = always mail_location = mbox:/var/spool2/mail/%u:INBOX=/var/spool/mail/%u:INDEX=/var/indexes/%u:CONTROL=/var/spool/mail-control mail_plugins = " quota" mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_very_dirty_syncs = yes mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Trash { auto = no special_use = \Trash } mailbox virtual/All { auto = no special_use = \All } prefix = } passdb { driver = pam } plugin { quota_grace = 10%% quota_max_mail_size = 100M quota_rule = *:storage=10000M quota_rule2 = Trash:Storage=+100M quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = file:~/sieve;active=~/.dovecot.sieve } pop3_uidl_format = %v-%u service auth { unix_listener auth-master { mode = 0666 } } service dict { unix_listener dict { mode = 0600 user = mail } } service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = ::1, 127.0.0.1 port = 24 } } service pop3-login { inet_listener pop3 { address = * port = 110 } inet_listener pop3s { address = * port = 995 ssl = yes } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = mail } user = dovecot } ssl = required ssl_ca = </etc/mail/ssl/ssl1/STAR_xxxxp_net.ca-bundle ssl_cert = </etc/mail/ssl/ssl1/STAR_xxxp_net.crt ssl_key = # hidden, use -P to show it userdb { driver = passwd } verbose_proctitle = yes protocol lmtp { mail_plugins = autocreate quota acl fts fts_solr zlib mail_log notify sieve } protocol lda { mail_plugins = " quota sieve quota" } protocol imap { mail_max_userip_connections = 80 mail_plugins = " quota quota imap_quota" ssl_cert = </etc/mail/ssl/ssl1/STAR_xxxp_net.crt ssl_key = # hidden, use -P to show it } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = " quota" } protocol submission { mail_max_userip_connections = 10 mail_plugins = " quota" } My dovecot config Thanks and regards,

1 0

Bypass Trash Folder Sometimes.
by dovecot＠ptld.com 04 Jul '21

04 Jul '21

Is there a way, or a config setting, that would allow you to for-reals delete an email from the inbox instead of sending it to the Trash folder? Not always, the default behavior should still send deleted emails to the trash folder, but on a per case bases be able to just delete an email without it going to the trash folder. Same like how the windows desktop works. If you Delete a file on your desktop it goes to the recycle bin. However if you do Shift + Delete the file gets deleted without going to the recycle bin.

3 3

How to use xapian with non-text attachments
by André Rodier 03 Jul '21

03 Jul '21

Hello, I am developing a hosting platform on Debian Bullseye, with Dovecot amongst other tools. I am trying to use the xapian full test search plugin, but I can see the attachments are skipped: This is what I have in the logs when running the indexing in verbose mode: ----------------------------------------------------------------------- doveadm(camille): Info: FTS Xapian: fts_backend_xapian_check_access doveadm(camille): Info: FTS Xapian: Memory stats : Used = 56 MB, Free = 66 MB doveadm(camille): Info: FTS Xapian: fts_backend_xapian_index_hdr doveadm(camille): Info: FTS Xapian: fts_backend_xapian_query doveadm(camille): Info: FTS Xapian: Query= uid:"44" doveadm(camille): Info: FTS Xapian: Ngram(S) -> 63 items (total 0 KB) doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_unset_build_key doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_set_build_key doveadm(camille): Info: FTS Xapian: New part (Header=Message- Id,Type=(null),Disposition=(null)) doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_build_more doveadm(camille): Info: FTS Xapian: fts_backend_xapian_check_access doveadm(camille): Info: FTS Xapian: Memory stats : Used = 56 MB, Free = 66 MB doveadm(camille): Info: FTS Xapian: fts_backend_xapian_index_hdr doveadm(camille): Info: FTS Xapian: fts_backend_xapian_query doveadm(camille): Info: FTS Xapian: Query= uid:"44" doveadm(camille): Info: FTS Xapian: Ngram(XMID) -> 4 items (total 0 KB) doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_unset_build_key doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_set_build_key doveadm(camille): Info: FTS Xapian: New part (Header=X- Mailer,Type=(null),Disposition=(null)) doveadm(camille): Info: FTS Xapian: Unknown header (indexing) 'xmailer' doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_set_build_key doveadm(camille): Info: FTS Xapian: New part (Header=MIME- Version,Type=(null),Disposition=(null)) doveadm(camille): Info: FTS Xapian: Unknown header (indexing) 'mimeversion' doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_set_build_key doveadm(camille): Info: FTS Xapian: New part (Header=Content- Type,Type=(null),Disposition=(null)) doveadm(camille): Info: FTS Xapian: Unknown header (indexing) 'contenttype' doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_set_build_key doveadm(camille): Info: FTS Xapian: New part (Header=Authentication- Results,Type=(null),Disposition=(null)) doveadm(camille): Info: FTS Xapian: Unknown header (indexing) 'authenticationresults' doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_set_build_key doveadm(camille): Info: FTS Xapian: New part (Header=X-AV- Checked,Type=(null),Disposition=(null)) doveadm(camille): Info: FTS Xapian: Unknown header (indexing) 'xavchecked' doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_set_build_key doveadm(camille): Info: FTS Xapian: New part (Header=Content- Type,Type=(null),Disposition=(null)) doveadm(camille): Info: FTS Xapian: Unknown header (indexing) 'contenttype' doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_set_build_key doveadm(camille): Info: FTS Xapian: New part (Header=(null),Type=text/plain,Disposition=(null)) doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_build_more doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_unset_build_key doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_set_build_key doveadm(camille): Info: FTS Xapian: New part (Header=Content- Type,Type=(null),Disposition=(null)) doveadm(camille): Info: FTS Xapian: Unknown header (indexing) 'contenttype' doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_set_build_key doveadm(camille): Info: FTS Xapian: New part (Header=Content- Description,Type=(null),Disposition=(null)) doveadm(camille): Info: FTS Xapian: Unknown header (indexing) 'contentdescription' doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_set_build_key doveadm(camille): Info: FTS Xapian: New part (Header=Content- Disposition,Type=(null),Disposition=(null)) doveadm(camille): Info: FTS Xapian: Unknown header (indexing) 'contentdisposition' doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_set_build_key doveadm(camille): Info: FTS Xapian: New part (Header=Content-Transfer- Encoding,Type=(null),Disposition=(null)) doveadm(camille): Info: FTS Xapian: Unknown header (indexing) 'contenttransferencoding' doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_set_build_key doveadm(camille): Info: FTS Xapian: New part (Header=(null),Type=text/csv,Disposition=attachment; filename="file.csv") doveadm(camille): Info: FTS Xapian: Skipping part of type 'text/csv' and disposition 'attachment; filename="file.csv"' doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_set_mailbox doveadm(camille): Info: FTS Xapian: Unset box 'INBOX' (c0d4e304584e5460dae30000075d7e67) doveadm(camille): Info: FTS Xapian: fts_backend_xapian_oldbox doveadm(camille): Info: FTS Xapian: Done indexing 'INBOX' (c0d4e304584e5460dae30000075d7e67) (13 msgs in 261 ms, rate: 49.8) doveadm(camille): Info: FTS Xapian: fts_backend_xapian_release (unset_box) doveadm(camille): Info: FTS Xapian: Committed 'unset_box' in 17 ms doveadm(camille): Info: FTS Xapian: Box is empty doveadm(camille): Info: FTS Xapian: fts_backend_xapian_update_deinit (/home/users/camille/mails/indexes/xapian-indexes) doveadm(camille): Info: FTS Xapian: fts_backend_xapian_release (update_deinit) doveadm(camille): Info: FTS Xapian: Committed 'update_deinit' in 0 ms doveadm(camille): Info: FTS Xapian: Deinit /home/users/camille/mails/indexes/xapian-indexes) ----------------------------------------------------------------------- Especially thos line: doveadm(camille): Info: FTS Xapian: Skipping part of type 'text/csv' and disposition 'attachment; filename="file.csv"' I have seen this as a bug on fts-xapian: https://github.com/grosjo/fts-xapian/issues/68 Which then references a PR on Dovecot core itself: https://github.com/dovecot/core/pull/155 Any idea on how to use xapian with non-text attachments ? Thanks a lot for your help! André

2 2

sieve match with contain asterisk
by Hardy Flor 03 Jul '21

03 Jul '21

Hello, I want to find a keyword in the subject between two "*". How do I have to mask the "*" correctly? I tried: if header :matches "subject" "\*xyz\**" if header :matches "subject" "\\*xyz\\**" Hardy

2 3

lost mailbox
by Stephane Magnier 02 Jul '21

02 Jul '21

Hi, I used dovect with the following setup : mbox:/var/spool2/mail/%u:INBOX=/var/spool/mail/%u If I have a look via cmd line [root@mbxx1 ~]# telnet localhost 143 Trying ::1... telnet: connect to address ::1: Connection refused Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE LITERAL+ STARTTLS AUTH=PLAIN] Dovecot ready. a login azt000 lassiemag76 a OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY LITERAL+ NOTIFY SPECIAL-USE QUOTA] Logged in b list "" ** * LIST (\NoInferiors) "/" 2015 * LIST (\NoInferiors) "/" 2020-IT * LIST (\NoInferiors) "/" 2018-PERSO * LIST (\NoInferiors) "/" 2017 * LIST (\NoInferiors) "/" 2020-MARKETING * LIST (\NoInferiors) "/" 2019-AZT * LIST (\NoInferiors) "/" 2019-ADMIN * LIST (\NoInferiors) "/" "2020- PERSO" * LIST (\NoInferiors) "/" sss * LIST (\NoInferiors) "/" 2019-COMPTA * LIST (\NoInferiors) "/" 2019-PERSO * LIST (\NoInferiors) "/" 2017-ADMIN * LIST (\NoInferiors) "/" 2016 * LIST (\NoInferiors \UnMarked) "/" 2020-compta * LIST (\NoInferiors \UnMarked \Trash) "/" Trash * LIST (\NoInferiors \UnMarked) "/" Archives * LIST (\NoInferiors \Sent) "/" Sent * LIST (\NoInferiors \Marked \Junk) "/" Junk * LIST (\NoInferiors \UnMarked \Drafts) "/" Drafts * LIST (\NoInferiors \UnMarked \Sent) "/" "Sent Messages" * LIST (\NoInferiors) "/" INBOX/2021-AZT * LIST (\NoInferiors) "/" INBOX/2021-WebMEETING * LIST (\NoInferiors) "/" INBOX/2021-zezez * LIST (\NoInferiors) "/" INBOX/2021-PERSO * LIST (\NoInferiors) "/" INBOX/2021-MARKETING * LIST (\NoInferiors \UnMarked) "/" INBOX/2021-COMPTA * LIST (\NoInferiors \UnMarked) "/" INBOX/2021-ADMIN * LIST (\NoInferiors \UnMarked) "/" INBOX/2021-ATV * LIST (\NoInferiors \UnMarked) "/" INBOX/2021-test * LIST (\HasChildren) "/" INBOX b OK List completed (0.009 + 0.000 + 0.008 secs). If I've opened my thunderbird.. I have just the INBOX and nothing else ???????????????????????? and the folder : 2021-ADMIN and 2021-ATV and that's it I've tried to do : /doveadm force-resync -u user1 : /nothing happened Any idea in order to syncrhonized a folder with .... thunderbird ?

2 1

How can I prevent sieve filter from being applied to some mail users?
by yuryb 02 Jul '21

02 Jul '21

We have an emarket(a)example.com mailbox that receives orders from customers. Postfix redirects such emails to the email addresses of our sales managers, as well as to the special address parser(a)example.com, which is used by some analytical software. For this, a file named "Virtual" has been created in the Postfix folder with the following contents:emarket@example.com manager1@example.com,manager2@example.com,manager3@example.com,parser@example.comIn addition, Dovecot places all such emails in the Orders folder of each sales manager. For this, a Sieve filter rule has been created: require ["fileinto", "envelope"]; if envelope: is "to" "emarket(a)example.com" { fileinto "Orders"; stop; } But the problem is that the analytics software that uses the parser(a)example.com mailbox is subscribed only to the default Inbox folder. And it doesn't know how to work with the Orders folder. So I need to somehow prevent the filter from being applied to the parser(a)example.com mailbox. How can I do this using Dovecot or Sieve?

1 0

Bug: empty prefix value in userdb lookup defaults to "yes"?
by Dan Malm 02 Jul '21

02 Jul '21

Hi, I'm trying to migrate some users into our system from another one that also run dovecot but with different prefix and separator settings than we do. I've setup userdb to return these values for a test user to match the other systems separator/prefix setup: { "home": "/customers/b/5/3/cdeadbeef/mail/m0123456789abcdef/", "namespace/inbox/separator": "/", "uid": 10000001, "namespace/inbox/prefix": "", "gid": 10000001 } But the empty value for prefix seems to get converted to some default value of "yes" as when I log in with that user dovecot throws this error: Error: namespace configuration error: list=yes requires prefix=yes to end with separator / Dovecot version: 2.3.13 OS: Ubuntu 20.04.2 -- BR/Mvh. Dan Malm, Systems Engineer, One.com

2 3