- dovecot - dovecot.org

Postfix - Dovecot alias
by John Doe 06 Apr '22

06 Apr '22

Hello, I have the problem with aliases. The emails did not delivery to correct email. I send email to email: to_alias(a)domain.com that is valid alias and email should be sent to real email folder: to(a)domain.com. Dovecot creating to_alias folder and deliver the emails there. Here is the email log: / did not see to(a)domain.com below / Apr 5 18:54:40 www postfix/smtpd[30547]: connect from mail-40137.protonmail.ch[185.70.40.137] Apr 5 18:54:40 www postfix/smtpd[30547]: Anonymous TLS connection established from mail-40137.protonmail.ch[185.70.40.137]: TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-384) server-digest SHA384 Apr 5 18:54:52 www postfix/smtpd[30547]: 85A412E19B6: client= mail-40137.protonmail.ch[185.70.40.137] Apr 5 18:54:52 www postfix/cleanup[30556]: 85A412E19B6: message-id=<M07eijxF0PArGZ92wKYpeCndUNv5g3kSEgYljlhYwOVPxIor3AmNRxrPyNK9T8GcncG1dmxS6Lv35IfR5ompsUPEGPucNn9SjxkMxAgHzhI=@ protonmail.com> Apr 5 18:54:53 www dccifd[1856]: stat(log directory "log"): No such file or directory Apr 5 18:54:57 www postfix/qmgr[1398]: 85A412E19B6: from=< from(a)protonmail.com>, size=2767, nrcpt=1 (queue active) Apr 5 18:54:57 www postfix/smtpd[30547]: disconnect from mail-40137.protonmail.ch[185.70.40.137] ehlo=2 starttls=1 mail=1 rcpt=1 data=1 quit=1 commands=7 Apr 5 18:54:57 www dovecot: lmtp(30559): Connect from local Apr 5 18:54:57 www dovecot: lmtp(compiz(a)domain.com)<30559><U8KALFFmTGJfdwAA8oMCvw>: sieve: msgid=<M07eijxF0PArGZ92wKYpeCndUNv5g3kSEgYljlhYwOVPxIor3AmNRxrPyNK9T8GcncG1dmxS6Lv35IfR5ompsUPEGPucNn9SjxkMxAgHzhI=@ protonmail.com>: stored mail into mailbox 'INBOX' Apr 5 18:54:57 www postfix/lmtp[30558]: 85A412E19B6: to=< to_alias(a)domain.com>, relay=mail.domain.com[private/dovecot-lmtp], delay=17, delays=17/0.01/0.01/0.01, dsn=2.0.0, status=sent (250 2.0.0 < to_alias(a)domain.com> U8KALFFmTGJfdwAA8oMCvw Saved) Apr 5 18:54:57 www dovecot: lmtp(30559): Disconnect from local: Logged out (state=READY) Apr 5 18:54:57 www postfix/qmgr[1398]: 85A412E19B6: removed I was playing with password_query but not sure did I'm on right direction. password_query = \ SELECT username AS user, password, \ '/var/spool/postmail/%d/%n' AS userdb_home, 1002 AS userdb_uid, 1001 AS userdb_gid \ FROM mailbox WHERE username = (SELECT goto FROM alias WHERE address = '%u') I'm using dovecot --version: 2.3.18 (9dd8408c18) and my configuration is: # 2.3.18 (9dd8408c18): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: Linux 5.17.0 x86_64 Slackware 15.0+ ext4 # Hostname: www.ixip.net base_dir = /var/run/dovecot/ default_login_user = nobody dict { driver = sql quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:/var/spool/postmail/%d/%n/Maildir mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = /var/spool/postmail/%d/%n/.dovecot.sieve sieve_dir = /var/spool/postmail/%d/%n/sieve/ sieve_global_dir = /var/lib/dovecot/sieve sieve_global_path = /var/lib/dovecot/sieve/default.sieve } protocols = imap lmtp sieve sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { address = 127.0.0.1 port = 993 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } service_count = 1 vsz_limit = 64 M } ssl_cert = </etc/postfix/ssl/mail.stzbg.com.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = uid=1002 gid=1001 home=/var/spool/postmail/%d/%n allow_all_users=yes driver = static } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole } # grep -v '^ *$#.*$\?$' dovecot-sql.conf.ext driver = mysql connect = host=localhost dbname=postfix user=postfix password=password default_pass_scheme = CRYPT password_query = SELECT username AS user, password FROM mailbox WHERE username = '%u'; Kind Regards, Chris

1 0

Support of "extlists" in sieve filters
by Marcin Bajer 04 Apr '22

04 Apr '22

Hi all, Don’t really know if this is sth. to post on this forum, but I tried to make a sieve filter which tags mails from my contacts by the category of the contact. Seems this feature is available in Protonmail: https://protonmail.com/support/knowledge-base/sieve-advanced-custom-filters/ require [“fileinto”, “extlists”]; Checks that the sender is in your personal address book if header :list “from” “:addrbook:personal?label=Family” { fileinto “Known”; } Would it be possible to implement such feature also in dovecot? BR, Marcin

1 0

Replication issues with 2.3.18 - Replication fails after xxx folders reached.
by Paul Kudla (SCOM.CA Internet) 02 Apr '22

02 Apr '22

please appreciate that i am trying to help .... after much testing i can now reporduce the replication issues at hand I am running on freebsd 12 & 13 stable (both test and production servers) sdram drives etc ... Basically replication works fine until reaching a folder quantity of ~ 256 or more to reproduce using doveadm i created folders like INBOX/folder-0 INBOX/folder-1 INBOX/folder-2 INBOX/folder-3 and so forth ...... I created 200 folders and they replicated ok on both servers I created another 200 (400 total) and the replicator got stuck and would not update the mbox on the alternate server anymore and is still updating 4 days later ? basically replicator goes so far and either hangs or more likely bails on an error that is not reported to the debug reporting ? however dsync will sync the two servers but only when run manually (ie all the folders will sync) I have two test servers avaliable if you need any kind of access - again here to help. [07:28:42] mail18.scom.ca [root:0] ~ # sync.status Queued 'sync' requests 0 Queued 'high' requests 6 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 255 username type status paul(a)scom.ca normal Waiting for dsync to finish keith(a)elirpa.com incremental Waiting for dsync to finish ed.hanna(a)dssmgmt.com incremental Waiting for dsync to finish ed(a)scom.ca incremental Waiting for dsync to finish nick(a)elirpa.com incremental Waiting for dsync to finish paul(a)paulkudla.net incremental Waiting for dsync to finish i have been going through the c code and it seems the replication gets requested ok replicator.db does get updated ok with the replicated request for the mbox in question. however i am still looking for the actual replicator function in the lib's that do the actual replication requests the number of folders & subfolders is defanately the issue - not the mbox pyhsical size as thought origionally. if someone can point me in the right direction, it seems either the replicator is not picking up on the number of folders to replicat properly or it has a hard set limit like 256 / 512 / 65535 etc and stops the replication request thereafter. I am mainly a machine code programmer from the 80's and have concentrated on python as of late, 'c' i am starting to go through just to give you a background on my talents. It took 2 months to finger this out. this issue also seems to be indirectly causing the duplicate messages supression not to work as well. python programming to reproduce issue (loops are for last run started @ 200 - fyi) : # cat mbox.gen #!/usr/local/bin/python2 import os,sys from lib import * user = 'paul(a)paulkudla.net' """ for count in range (0,600) : box = 'INBOX/folder-%s' %count print count command = '/usr/local/bin/doveadm mailbox create -s -u %s %s' %(user,box) print command a = commands.getoutput(command) print a """ for count in range (0,600) : box = 'INBOX/folder-0/sub-%' %count print count command = '/usr/local/bin/doveadm mailbox create -s -u %s %s' %(user,box) print command a = commands.getoutput(command) print a #sys.exit()

1 0

falsely log "auth: unknown user" when multiple userdb
by Anthony Panko 01 Apr '22

01 Apr '22

Hello, When there is a multiple userdb to look for user, Dovecot log «auth: unknown user» when the first userdb search failed. Then Dovecot successfully search user in the second userdb and things works. But "auth: unknown user" event left in a logs. Logs look like this: Apr 1 12:38:48 mail dovecot[75384]: lmtp(75397): Connect from 127.0.5.1 Apr 1 12:38:48 mail dovecot[75384]: auth: ldap(order(a)XXX,127.0.5.1): unknown user Apr 1 12:38:48 mail dovecot[75384]: lmtp(order)<75397><D8m2HCjIRmKFJgEAABdyCg>: msgid=<157609214.20220331172309@YYY>: saved mail to INBOX Debug show failed search in the first userdb and successfull search in the second userdb. When user found in the first userdb «unknown user» event does not appear. Configuration is: userdb { args = /usr/local/etc/dovecot/udb-ldap-personal.conf driver = ldap override_fields = home=/mnt/mboxes/personal/%n } userdb { args = /usr/local/etc/dovecot/udb-ldap-general.conf driver = ldap override_fields = home=/mnt/mboxes/general/%n } Dovecot verision is 2.3.16 (7e2e900c1a). -- Best regards, Anthony Pankov

2 1

Dovecot Submission - rate limiting
by itanguy＠univ-brest.fr 31 Mar '22

31 Mar '22

Hello, is there any way to rate limit submission mail (counting per user) when using Dovecot/Submission (no Postfix)? Using a milter seems impossible. Using Dovecot Events seems "too" global (not per users discrimination). Maybe rate-limiting has to be external and then include in the pass_db query ? Thank your for any hints. Ismaël Tanguy

3 3

Simplifying Support of Virtual and System Users
by Mark Olbert 29 Mar '22

29 Mar '22

Apologies if this has already been raised here (which I suspect it has 😊). I tried to raise it as an issue over on github but issues are not enabled for the repository. The support for mixing virtual users, with fully-qualified email addresses, and system users could be simpler. Assuming it doesn’t mess up other stuff in the code base, of course 😊. The problem appears to be that the PAM passwd module requires just user names without a domain (which makes sense given that they’re system users) but does not, so far as I can see, support the username_format argument. In my setup, the default structure of 10-auth.conf demonstrates this: auth_username_format = %n That means all username arguments lack the domain part…which complicates using fully-qualified ones for virtual users. I realize I could assign arbitrary unique names to the virtual accounts in the lookup file. But that complicates administering the system, so I want to be able to include the domain for virtual users. After about five hair-pulling hours of wrestling with the configuration I stumbled across an answer utilizing conditionals<https://serverfault.com/questions/260488/dovecot-user-lookup-fails-when-usi…> on ServerFault. It works fine. But being able to pass a username_format parameter to the PAM module (which I tried, but it was rejected) would be a lot simpler, and a lot more intuitive. - Mark

5 4

IMAP sync issue in email clients
by ChandranManikandan 29 Mar '22

29 Mar '22

Hi Friends, Some few email accounts are sync issues come in outlook,thunderbird,roundcube and squirrelmail after power shutdown suddenly. The dovecot mail log is shown below for those email accounts. Can anyone help me to fix it? imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Error: Mailbox INBOX: UID=502283: read(/home/vpopmail/domains/ xxx.com/email/Maildir/cur/1648520174.28570.mail.xxx.com,S=13720:2,) failed: Cached message size larger than expected (13720 > 0, box=INBOX, UID=502283) (read reason=mail stream) Mar 29 13:40:48 imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Error: Corrupted record in index cache file /home/vpopmail/domains/ xxx.com/email/Maildir/dovecot.index.cache: Broken physical size in mailbox INBOX: read(/home/vpopmail/domains/ xxx.com/email/Maildir/cur/1648520174.28570.mail.xxx.com,S=13720:2,) failed: Cached message size larger than expected (13720 > 0, box=INBOX, UID=502283) Mar 29 13:40:48 imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Error: Mailbox INBOX: UID=502283: read(/home/vpopmail/domains/ xxx.com/email/Maildir/cur/1648520174.28570..mail.xxx.com,S=13720:2,) failed: Cached message size larger than expected (13720 > 0, box=INBOX, UID=502283) (read reason=) Mar 29 13:40:48 imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Info: FETCH failed: Internal error occurred. Refer to server log for more information. [2022-03-29 13:40:48] in=323 out=589163 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 -- *Regards,Manikandan.C*

2 2

Doveadm backup...
by Stephane Magnier 28 Mar '22

28 Mar '22

Hi I've recently tried to use the Dovecadm backup to backup the emails.. with the following syntax doveadm -Dv backup -u userx maildir:/mnt/nfs-backup/userx Sounds to be OK with few emails... Some of them got a lot of emails and one f them got an error and stop ! dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=1725fa475d774ee19cb98dfb6737b4f1 UID=24891 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=916ed110b4b1522868be6194f1ae36ff UID=24892 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=eb8d75c530a7b02fc26b494d9006c91b UID=24893 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=aee9155875c34861fd6500f1f2f51a26 UID=24894 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Last common UID=24894. Delayed expunges= dsync(userx): Debug: brain S: Import Trash: Saved UIDs: dsync(userx): Debug: brain S: Import Trash: Finish update: min_next_uid=24895 min_first_recent_uid=24895 min_highest_modseq=35344 min_highest_pvt_modseq=0 dsync(userx): Debug: /mnt/nfs-backup/userx/.Trash/dovecot.index.cache: Compressed, file_seq changed 1645803588 -> 1645803589, size=32, max_uid=24894 dsync(userx): Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID 7e05c335174bf1608f0a02004eac7fb4 (maybe it was just deleted?) dsync(userx): Debug: auth-master: conn unix:/run/dovecot/auth-userdb: Disconnected: Connection closed (fd=10) I empty the trash... exactly the same problem... Any idea why this ?? Thanks and regards,

5 10

Private \seen flags lost during message move for other users
by Cube . 28 Mar '22

28 Mar '22

Hello, I have a shared mailbox set up with a private index: maildir:/var/mail/public:INDEXPVT=~/Maildir/public Per user \Seen flags are working fine until one user moves a message into another folder/sub-mailbox. For that user doing the move the message remains \Seen however for other users who have already seen the message the flag is lost and it appears unread in the new location. If the message is moved back it still appears unread to the other user even if had been read in that folder/sub-mailbox in the past. Is there anyway to retain per user \Seen that follows the message when its moved? Thank you.

2 1

dovecot replication on dovecot v 2.3.8
by Stephane Magnier 27 Mar '22

27 Mar '22

Hi, I am trying using a replication. Here is my config : 10-mail.conf. Before going " on real life " I try to make a very basic example... but without any success :-( bad start I took the config example on dovecot wiki The idea is to replicate the user: "user1" on a different server IP 177.28.1.120 at the location /home/SERVER/test and to get at the end the folder "/home/SERVER/test/user1" On the top, I wish to replication with the user / group : vmail. For the transfer, I use the root login on the backup server to avoid other rights problems at the moment 2) how to synchronized specific users ? apparently it's trying to sync other things.. :-) # mbox_very_dirty_syncs = yes mail_plugins=$mail_plugins quota notify replication service replicator { process_min_avail = 1 } dsync_remote_cmd = ssh -l root 177.28.1.120 doveadm dsync-server -u user1 plugin { mail_replica =remote:root@177.28.1.120:/home/SERVER/test/ } service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service replicator { unix_listener replicator-doveadm { mode = 0600 user = vmail } } replication_max_conns = 10 But apparently nothing is happening.... [root@xxx xenia]# doveadm replicator status Queued 'sync' requests 0 Queued 'high' requests 0 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 24 Waiting 'failed' requests 10 Total number of known users 34 and the folder test is empty Any idea what is wrong ? maybe I should ask a start a cmd line to start the process ? ( [root@mbox1 xenia]# doveadm replicator status '*' username priority fast sync full sync success sync failed rngd none - - - - *user1 none 00:00:04 00:40:05 - y ( failed )* saslauth none - - - - sa-milt none - - - -

1 1