March 2022 - dovecot - dovecot.org

FTS solr or xapian and Public Folders
by David Williams 13 May '22

13 May '22

Hi all I hope someone can help with this. I'm looking at setting up FTS on a Dovecot server which has some quite big pubic folders (100,000+ emails each) and would appreciate some info about how fts both Xapian and Solr works with public folders. As background of the folders can receive emails and I use a dummy user and an alias file to deliver them for example testfolder: dummy+Public/MYTESTFOLDER(a)example.com delivers email addressed to testfolder(a)example.com to MYTESTFOLDER in the namespace Public. Has anyone successfully setup FTS with public folders using either Xapian or Solr and what happens when one user changes a folder, does that change show up for other users? E.G.: When an email is delivered by dummy and indexed will that email be indexed for other users as well? Similarly what happens that when an email is moved between, deleted from or copied to public folders by one user will that change then show up for the other users or not? I guess the basic question is: Are public folders indexed once and then the indexes are made available to each user with access or are they indexed for each user? Any info or experience that anyone has will be appreciated. Many thanks David

2 1

Permissions and ownership on /dev/shm/dovecot
by doug 12 Apr '22

12 Apr '22

Hi, Environment: Dovecot 2.3.18 running on CentOS 7, mdbox, LDAP users I'm in the process of moving my mailboxes to NFS and moving with lock and index files in temp storage following instructions from https://doc.dovecot.org/configuration_manual/nfs. I set mail_location as: mail_location = mdbox:/mailstore/%u/mail:VOLATILEDIR=/dev/shm/dovecot/%u:LISTINDEX=/dev/shm/dovecot/%u/dovecot.list.index What I discovered is /dev/shm/dovecot is created by the initial user who accesses their mail from a client, and with permissions 700. This prevents subsequent users from creating their own index and lock files. # ls -l /dev/shm/dovecot total 0 drwx------ 2 mary users 60 Mar 25 10:00 mary Sample error message from maillog during mail delivery and from a dsync script. Mar 25 10:37:15 mailsrv1 dovecot: imap(doug)<19284><WKcX5gvbRe7AqFhA>: Error: mkdir(/dev/shm/dovecot/doug) failed: Permission denied (euid=1002(doug) egid=100(users) missing +x perm: /dev/shm/dovecot, dir owned by 97:100 mode=0700) dsync(test): Error: mkdir(/dev/shm/dovecot/test) failed: Permission denied (euid=2003(test) egid=100(users) missing +x perm: /dev/shm/dovecot, dir owned by 97:100 mode=0700) I couldn't locate documentation or discussions on how to set the ownership or permissions for /dev/shm/dovecot in the Dovecot configuration files. As a hack, I added this to /usr/libexec/dovecot/prestartscript. ! [[ -d /dev/shm/dovecot ]] && mkdir /dev/shm/dovecot chown dovecot:users /dev/shm/dovecot chmod 770 /dev/shm/dovecot This solved the problem, but left me wondering if I missed something obvious or if I am setting myself up for a problem later on, like with a Dovecot version upgrade. I could run these commands at bootup out of rc.local or a systemd script rather than customizing a Dovecot provided script. Is there a appropriate way of doing this that I missed? TIA, Doug

3 6

macOS ManageSieve client?
by Gerben Wierda 07 Apr '22

07 Apr '22

I have a dovecot & dovecot-sieve running under MacPorts on my macOS ’server’. I do a very low tech maintenance on sieve, by using the cli on the server and edit sieve by hand for myself. I’d like to open this up to other users. How do people use this from their macOS clients? For this, the ManageSieve protocol exists and this is implemented by dovecot-sieve, but other than installing roundcube and offering a web-based mail client that also supports ManageSieve, is there another way? A ManageSieve client that directly runs on the macOS client and interfaces with dovecot-sieve on the server? After all, routing mail to different mailboxes better happens server-side so that all clients profit. Gerben Wierda (LinkedIn <https://www.linkedin.com/in/gerbenwierda>) R&A IT Strategy <https://ea.rna.nl/> (main site) Book: Chess and the Art of Enterprise Architecture <https://ea.rna.nl/the-book/> Book: Mastering ArchiMate <https://ea.rna.nl/the-book-edition-iii/>

6 5

Dovecot Submission - rate limiting
by itanguy＠univ-brest.fr 31 Mar '22

31 Mar '22

Hello, is there any way to rate limit submission mail (counting per user) when using Dovecot/Submission (no Postfix)? Using a milter seems impossible. Using Dovecot Events seems "too" global (not per users discrimination). Maybe rate-limiting has to be external and then include in the pass_db query ? Thank your for any hints. Ismaël Tanguy

3 3

Simplifying Support of Virtual and System Users
by Mark Olbert 29 Mar '22

29 Mar '22

Apologies if this has already been raised here (which I suspect it has 😊). I tried to raise it as an issue over on github but issues are not enabled for the repository. The support for mixing virtual users, with fully-qualified email addresses, and system users could be simpler. Assuming it doesn’t mess up other stuff in the code base, of course 😊. The problem appears to be that the PAM passwd module requires just user names without a domain (which makes sense given that they’re system users) but does not, so far as I can see, support the username_format argument. In my setup, the default structure of 10-auth.conf demonstrates this: auth_username_format = %n That means all username arguments lack the domain part…which complicates using fully-qualified ones for virtual users. I realize I could assign arbitrary unique names to the virtual accounts in the lookup file. But that complicates administering the system, so I want to be able to include the domain for virtual users. After about five hair-pulling hours of wrestling with the configuration I stumbled across an answer utilizing conditionals<https://serverfault.com/questions/260488/dovecot-user-lookup-fails-when-usi…> on ServerFault. It works fine. But being able to pass a username_format parameter to the PAM module (which I tried, but it was rejected) would be a lot simpler, and a lot more intuitive. - Mark

5 4

IMAP sync issue in email clients
by ChandranManikandan 29 Mar '22

29 Mar '22

Hi Friends, Some few email accounts are sync issues come in outlook,thunderbird,roundcube and squirrelmail after power shutdown suddenly. The dovecot mail log is shown below for those email accounts. Can anyone help me to fix it? imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Error: Mailbox INBOX: UID=502283: read(/home/vpopmail/domains/ xxx.com/email/Maildir/cur/1648520174.28570.mail.xxx.com,S=13720:2,) failed: Cached message size larger than expected (13720 > 0, box=INBOX, UID=502283) (read reason=mail stream) Mar 29 13:40:48 imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Error: Corrupted record in index cache file /home/vpopmail/domains/ xxx.com/email/Maildir/dovecot.index.cache: Broken physical size in mailbox INBOX: read(/home/vpopmail/domains/ xxx.com/email/Maildir/cur/1648520174.28570.mail.xxx.com,S=13720:2,) failed: Cached message size larger than expected (13720 > 0, box=INBOX, UID=502283) Mar 29 13:40:48 imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Error: Mailbox INBOX: UID=502283: read(/home/vpopmail/domains/ xxx.com/email/Maildir/cur/1648520174.28570..mail.xxx.com,S=13720:2,) failed: Cached message size larger than expected (13720 > 0, box=INBOX, UID=502283) (read reason=) Mar 29 13:40:48 imap(email(a)xxx.com)<19758><bW/i3lTbheQxJd/8>: Info: FETCH failed: Internal error occurred. Refer to server log for more information. [2022-03-29 13:40:48] in=323 out=589163 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 -- *Regards,Manikandan.C*

2 2

Doveadm backup...
by Stephane Magnier 28 Mar '22

28 Mar '22

Hi I've recently tried to use the Dovecadm backup to backup the emails.. with the following syntax doveadm -Dv backup -u userx maildir:/mnt/nfs-backup/userx Sounds to be OK with few emails... Some of them got a lot of emails and one f them got an error and stop ! dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=1725fa475d774ee19cb98dfb6737b4f1 UID=24891 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=916ed110b4b1522868be6194f1ae36ff UID=24892 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=eb8d75c530a7b02fc26b494d9006c91b UID=24893 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Import change type=expunge GUID=aee9155875c34861fd6500f1f2f51a26 UID=24894 hdr_hash= result=GUIDs match dsync(userx): Debug: brain S: Import Trash: Last common UID=24894. Delayed expunges= dsync(userx): Debug: brain S: Import Trash: Saved UIDs: dsync(userx): Debug: brain S: Import Trash: Finish update: min_next_uid=24895 min_first_recent_uid=24895 min_highest_modseq=35344 min_highest_pvt_modseq=0 dsync(userx): Debug: /mnt/nfs-backup/userx/.Trash/dovecot.index.cache: Compressed, file_seq changed 1645803588 -> 1645803589, size=32, max_uid=24894 dsync(userx): Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID 7e05c335174bf1608f0a02004eac7fb4 (maybe it was just deleted?) dsync(userx): Debug: auth-master: conn unix:/run/dovecot/auth-userdb: Disconnected: Connection closed (fd=10) I empty the trash... exactly the same problem... Any idea why this ?? Thanks and regards,

5 10

Private \seen flags lost during message move for other users
by Cube . 28 Mar '22

28 Mar '22

Hello, I have a shared mailbox set up with a private index: maildir:/var/mail/public:INDEXPVT=~/Maildir/public Per user \Seen flags are working fine until one user moves a message into another folder/sub-mailbox. For that user doing the move the message remains \Seen however for other users who have already seen the message the flag is lost and it appears unread in the new location. If the message is moved back it still appears unread to the other user even if had been read in that folder/sub-mailbox in the past. Is there anyway to retain per user \Seen that follows the message when its moved? Thank you.

2 1

dovecot replication on dovecot v 2.3.8
by Stephane Magnier 27 Mar '22

27 Mar '22

Hi, I am trying using a replication. Here is my config : 10-mail.conf. Before going " on real life " I try to make a very basic example... but without any success :-( bad start I took the config example on dovecot wiki The idea is to replicate the user: "user1" on a different server IP 177.28.1.120 at the location /home/SERVER/test and to get at the end the folder "/home/SERVER/test/user1" On the top, I wish to replication with the user / group : vmail. For the transfer, I use the root login on the backup server to avoid other rights problems at the moment 2) how to synchronized specific users ? apparently it's trying to sync other things.. :-) # mbox_very_dirty_syncs = yes mail_plugins=$mail_plugins quota notify replication service replicator { process_min_avail = 1 } dsync_remote_cmd = ssh -l root 177.28.1.120 doveadm dsync-server -u user1 plugin { mail_replica =remote:root@177.28.1.120:/home/SERVER/test/ } service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service replicator { unix_listener replicator-doveadm { mode = 0600 user = vmail } } replication_max_conns = 10 But apparently nothing is happening.... [root@xxx xenia]# doveadm replicator status Queued 'sync' requests 0 Queued 'high' requests 0 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 24 Waiting 'failed' requests 10 Total number of known users 34 and the folder test is empty Any idea what is wrong ? maybe I should ask a start a cmd line to start the process ? ( [root@mbox1 xenia]# doveadm replicator status '*' username priority fast sync full sync success sync failed rngd none - - - - *user1 none 00:00:04 00:40:05 - y ( failed )* saslauth none - - - - sa-milt none - - - -

1 1

disable authentication for a user in specialuserdb passwd-file
by Marc 27 Mar '22

27 Mar '22

Is it possible to disable the authentication for a specific user in userdb password-file?

1 0