- dovecot - dovecot.org

Controlling dovecot caching decisions
by Sivathmican Sivakumaran 19 Mar '18

19 Mar '18

Hello, It looks like the "mail_always_cache_fields" and "mail_never_cache_fields" can be used to control dovecot's caching decisions. I cannot seem to find any documentation regarding how these fields should be used. What are acceptable values for these fields? I am quite new to this so any help would be much appreciated. Regards, Siva

2 2

Replication Slave is not auto-creating domain/user folders
by Thore Bödecker 19 Mar '18

19 Mar '18

Hey all, I'm experiencing a weird and annoying issue with my 2-node dovecot replication setup. The setup is based on virtual users in a pgsql database, which is replicated from the master to a slave node. For the mails I rely on the dovecot builtin replication which has been working great for me thus far. However I noticed something was off when looking through my journal yesterday: dovecot[823]: doveadm: Error: Couldn't lock /var/vmail/foxxx0.de/qwer/.dovecot-sync.lock: safe_mkstemp(/var/vmail/foxxx0.de/qwer/.dovecot-sync.lock) failed: No such file or directory In this case the domain directory /var/vmail/foxxx0.de was already existing on the slave, but dovecot didn't bother to create the user folder before trying to lock it. The same happens when the entire domain folder is missing: dovecot[823]: doveadm: Error: Couldn't lock /var/vmail/dj-orakel.de/booking/.dovecot-sync.lock: safe_mkstemp(/var/vmail/dj-orakel.de/booking/.dovecot-sync.lock) failed: No such file or directory (in this case /var/vmail/dj-orakel.de is not existing yet) A natural first though would be "permission problem" - which I suspected too but the filesystem permissions are identical on the master and the slave: master (mx1): ---- root@valhalla ~ > stat /var/vmail/ File: /var/vmail/ Size: 4096 Blocks: 8 IO Block: 4096 directory Device: fd06h/64774d Inode: 2 Links: 28 Access: (2770/drwxrws---) Uid: ( 5000/ vmail) Gid: ( 5000/ vmail) Access: 2016-09-04 13:04:33.837609018 +0200 Modify: 2018-03-17 18:22:47.506323895 +0100 Change: 2018-03-17 18:22:47.506323895 +0100 Birth: - root@valhalla ~ > id dovecot uid=76(dovecot) gid=76(dovecot) groups=76(dovecot) root@valhalla ~ > id vmail uid=5000(vmail) gid=5000(vmail) groups=5000(vmail) ---- replication slave (mx2): ---- root@midgard ~ > stat /var/vmail File: /var/vmail Size: 4096 Blocks: 8 IO Block: 4096 directory Device: fe02h/65026d Inode: 2 Links: 27 Access: (2770/drwxrws---) Uid: ( 5000/ vmail) Gid: ( 5000/ vmail) Access: 2017-10-15 12:09:56.174209161 +0200 Modify: 2018-03-06 15:43:41.463359651 +0100 Change: 2018-03-06 15:43:41.463359651 +0100 Birth: - root@midgard ~ > id dovecot uid=76(dovecot) gid=76(dovecot) groups=76(dovecot) root@midgard ~ > id vmail uid=5000(vmail) gid=5000(vmail) groups=5000(vmail) ---- The replication service is configured in dovecot to run as user vmail, so it should not be a permission problem because the master is automatically creating the domain and user folders inside /var/vmail when new mails arrive. I highly suspect that this is some kind of regression because I can't remember having to manually create the domain/user folders on the slave before it would replicate mails for these, and there are quite a number of domains/users being replicated already. Please find the "doveconf -n" output of both servers below. If you need additional information, please let me know. Cheers, Thore doveconf -n (master/mx1): ---- # 2.3.0.1 (ffd8a29): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.1 (d33dca20) # OS: Linux 4.15.7-1-hardened x86_64 Arch Linux auth_cache_negative_ttl = 10 secs auth_cache_size = 50 M auth_cache_ttl = 5 mins auth_mechanisms = plain login doveadm_password = # hidden, use -P to show it doveadm_port = 12121 mail_home = /var/vmail/%Ld/%Ln mail_location = mdbox:~/mdbox mail_plugins = " acl zlib notify mail_log replication quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mdbox_rotate_size = 20 M namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcps:mx2.nano-srv.net quota = dict:user::file:/var/vmail/%d/%n/.quotausage quota_grace = 1%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global sieve_global_path = /etc/dovecot/sieve/default.sieve zlib_save = gz zlib_save_level = 9 } protocols = imap pop3 sieve lmtp service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { mode = 0600 user = vmail } } service auth { unix_listener auth-client { group = postfix mode = 0660 user = postfix } user = root } service doveadm { inet_listener { port = 12121 ssl = yes } vsz_limit = 1 G } service imap-login { process_limit = 400 process_min_avail = 5 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12122 } } service quota-warning { executable = script /var/vmail/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = vmail mode = 0660 user = vmail } } ssl_cert = </etc/letsencrypt/live/nano-srv.net/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA:DHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES256-GCM-SHA384:DHE-ECDSA-AES256-SHA384:DHE-RSA-AES256-SHA384:DHE-ECDSA-AES128-GCM-SHA256:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-SHA256:DHE-ECDSA-AES128-SHA256:DHE-RSA-AES128-SHA256:DHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes submission_host = 127.0.0.1:10027 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 30 mail_plugins = " acl zlib notify mail_log replication quota imap_quota" } protocol pop3 { mail_plugins = " acl zlib notify mail_log replication quota" pop3_uidl_format = %08Xu%08Xv } protocol lda { mail_plugins = " acl zlib notify mail_log replication quota sieve" postmaster_address = postmaster(a)nano-srv.net } protocol lmtp { mail_plugins = " acl zlib notify mail_log replication quota sieve" postmaster_address = postmaster(a)nano-srv.net } protocol sieve { managesieve_logout_format = bytes ( in=%i : out=%o ) } ---- doveconf -n (slave/mx2): ---- # 2.3.0.1 (ffd8a29): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.1 (d33dca20) # OS: Linux 4.15.7-1-hardened x86_64 Arch Linux auth_cache_negative_ttl = 10 secs auth_cache_size = 50 M auth_cache_ttl = 5 mins auth_mechanisms = plain login doveadm_password = # hidden, use -P to show it doveadm_port = 12121 mail_home = /var/vmail/%Ld/%Ln mail_location = mdbox:~/mdbox mail_plugins = " acl zlib notify mail_log replication quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mdbox_rotate_size = 20 M namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcps:mx1.nano-srv.net quota = dict:user::file:/var/vmail/%d/%n/.quotausage quota_grace = 1%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global sieve_global_path = /etc/dovecot/sieve/default.sieve zlib_save = gz zlib_save_level = 9 } protocols = imap pop3 sieve lmtp service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { mode = 0600 user = vmail } } service auth { unix_listener auth-client { group = postfix mode = 0660 user = postfix } user = root } service doveadm { inet_listener { port = 12121 ssl = yes } vsz_limit = 1 G } service imap-login { process_limit = 400 process_min_avail = 5 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12122 } } service quota-warning { executable = script /var/vmail/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = vmail mode = 0660 user = vmail } } ssl_cert = </etc/letsencrypt/live/nano-srv.net/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA:DHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES256-GCM-SHA384:DHE-ECDSA-AES256-SHA384:DHE-RSA-AES256-SHA384:DHE-ECDSA-AES128-GCM-SHA256:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-SHA256:DHE-ECDSA-AES128-SHA256:DHE-RSA-AES128-SHA256:DHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes submission_host = 127.0.0.1:10027 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 30 mail_plugins = " acl zlib notify mail_log replication quota imap_quota" } protocol pop3 { mail_plugins = " acl zlib notify mail_log replication quota" pop3_uidl_format = %08Xu%08Xv } protocol lda { mail_plugins = " acl zlib notify mail_log replication quota sieve" postmaster_address = postmaster(a)nano-srv.net } protocol lmtp { mail_plugins = " acl zlib notify mail_log replication quota sieve" postmaster_address = postmaster(a)nano-srv.net } protocol sieve { managesieve_logout_format = bytes ( in=%i : out=%o ) } ---- --

1 0

Is possible to override Dovecot variables or Sieve env vars and extdata lookups
by MRob 19 Mar '18

19 Mar '18

Are the dovecot environment variables mutable? I'd like to override like: set "${env.vnd.dovecot.username}" "someuser(a)example.org" Or better, I prefer to override %u Dovecot variable during the userdb lookup. Is either possible? PS, when Sieve does extdata lookups for username key, where does username come from? %u? Does an override as above change the dict lookup key for extdata?

2 3

Dovecot on Debian Stretch with AppArmor
by Andre Rodier 16 Mar '18

16 Mar '18

Hello all, I am using dovecot on Debian stretch, with AppArmor, and I have this audit log: Mar 16 11:25:10 mail kernel: audit: type=1400 audit(1521199510.705:580): apparmor="DENIED" operation="file_mmap" info="Failed name lookup - disconnected path" error=-13 profile="/usr/lib/dovecot/auth" name="var/cache/nscd/hosts" pid=26797 comm="auth" requested_mask="r" denied_mask="r" fsuid=0 ouid=0 With 'name="var/cache/nscd/hosts"', is there any missing '/' at the beginning of the path, somewhere? The version is: 1:2.2.27-3+deb9u2 Thanks for your advices, André Rodier. -- https://github.com/progmaticltd/homebox

2 1

per-user virtual mailboxes
by unknown＠example.com 16 Mar '18

16 Mar '18

Have given up on getting the global virtual config for now, and am trying to setup the virtual mailboxes for just my user account. Basically, it's behaving exactly as it did when I was trying to use a global config. This, and the lack of errors, is causing me to think that it is something odd in my install as opposed to a configuration issue (full doveconf -n at end) mail_location = maildir:~/Maildir mail_plugins = " virtual" namespace { location = virtual:~/Maildir/virtual:LAYOUT=maildir++ prefix = virtual. separator = . } # ldd `which dovecot` /usr/local/sbin//dovecot: libdovecot.so.0 => /usr/local/lib/dovecot/libdovecot.so.0 (0x28085000) libc.so.7 => /lib/libc.so.7 (0x28184000) # cd ~kremels/Maildir # ls -lsR virtual/ total 24 8 drwxr-xr-x 2 kremels kremels 512 Mar 16 14:40 .day 8 drwxr-xr-x 2 kremels kremels 512 Mar 16 14:40 .month 8 drwxr-xr-x 2 kremels kremels 512 Mar 16 14:40 .unread virtual/.day: total 16 8 -rwxr-xr-x 1 kremels kremels 62 Mar 16 14:15 dovecot-vitual 8 -rwxr-xr-x 1 kremels kremels 392 Mar 13 07:12 dovecot.index.log virtual/.month: total 8 8 -rwxr-xr-x 1 kremels kremels 66 Mar 16 14:15 dovecot-vitual virtual/.unread: total 16 8 -rwxr-xr-x 1 kremels kremels 11 Mar 16 14:15 dovecot-vitual 8 -rwxr-xr-x 1 kremels kremels 256 Mar 16 14:42 dovecot.index.log # doveadm search mailbox "virtual.unread" -u kremels (nothing) # cat .virtual.unread/dovecot-vitual # ~/Maildir/virtual/.day/dovecot-virtual * unseen # doveadm mailbox list -u kremels | grep virt virtual.unread virtual.month virtual.day virtual # Again, the "virtual" mailbox shows up, it contains three mailboxes (day, month, unread), and all are empty. I've added :LAYOUT=maildir++ in the location but I also tried using the "fs" layout and just creating folders under ~/Maildir/virtual, but results where the same. I've read https://wiki2.dovecot.org/Plugins/Virtual many times and I feel I must be missing something, but no idea what and with no errors it's proving impossible for me to figure it out. full conf: # doveconf -n # 2.2.34 (874deae): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.22 (22940fb7) # OS: FreeBSD 11.1-RELEASE-p4 i386 # Hostname: mail.covisp.net auth_failure_delay = 5 secs auth_mechanisms = PLAIN LOGIN default_client_limit = 4096 default_process_limit = 1024 default_vsz_limit = 768 M disable_plaintext_auth = no first_valid_uid = 89 imap_id_log = * lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot login_log_format_elements = user=<%u> %r %m %c mail_location = maildir:~/Maildir mail_max_userip_connections = 90 mail_plugins = " virtual" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace { location = virtual:~/Maildir/virtual:LAYOUT=maildir++ prefix = virtual. separator = . } namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam username_filter = !*@* } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/usr/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = </usr/local/etc/dehydrated/certs/covisp.net/fullchain.pem ssl_key = # hidden, use -P to show it userdb { driver = passwd } userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext default_fields = uid=vpopmail gid=vchkpw mail_location=/usr/local/virtual/%u mail=maildir:/usr/local/virtual/%u driver = sql } protocol imap { mail_plugins = " virtual imap_sieve" }

1 0

Sieve not working.
by Jungersen, Danjel - Jungersen Grafisk ApS 15 Mar '18

15 Mar '18

2 3

Disable SIS
by Nick Rosier 15 Mar '18

15 Mar '18

Hi, I'm currently running a small home-server with Dovecot. A long time ago I configured it with SIS enabled. I would like to stop using SIS. If I remove sis from mail_attachment_fs will the old mails that are stored in SIS-storage still be accessible? How can I convert all mailboxes to stop using SIS and store attachments back in the mails? Rgds, N.

3 6

Re: Argon2i support in CE packages
by Grégory Oestreicher 15 Mar '18

15 Mar '18

(Messed up the reply on my mobile, re-sending) Hi Aki, Le Mercredi 14 mars 2018, Aki Tuomi a écrit : > Which operating system is this? Damn, I forgot the most important information, my apologies. I'm using the Debian Stretch CE repository. Cheers, Grégory

2 2

Argon2i support in CE packages
by Grégory Oestreicher 14 Mar '18

14 Mar '18

Hi All, I've been experimenting with the Argon2i password scheme in a local setup, backed by a LDAP server, and Dovecot 2.3.0.1 can't authenticate my users for now. On the LDAP side the user passwords start with {ARGON2I} (and I can authenticate fine to the LDAP server), but it seems that the CE packages are compiled without libsodium. Is that correct? Is at this time the only alternative to recompile Dovecot myself, or are there plans to compile CE packages with libsodium? Cheers, Grégory

2 1

Re: quota-status: Issues with uppercase recipient address
by Christoph Lukas 14 Mar '18

14 Mar '18

Am 10.03.2018 um 12:20 schrieb Aki Tuomi: > Change mail_location too > > > --- > Aki Tuomi > Dovecot oy That did it! Thank you very much! Best regards, Christoph

3 4