March 2019 - dovecot - dovecot.org

dovecot-keywords are not preserved any more when moving mails between folders
by Piper Andreas 14 Mar '19

14 Mar '19

Hello, after an upgrade of dovecot-2.2.5 to dovecot-2.3.4 the dovecot-keywords, which in my case are set by thunderbird, are not preserved any more when moving a mail between folders. Are there any ideas, what may be the reason. Thanks for any hints on that, Andreas 'doveconf -n' gives: # 2.3.4 (0ecbaf23d): /etc/opt/csw/dovecot/dovecot.conf # Pigeonhole version 0.5.4 (60b0f48d) # OS: SunOS 5.11 i86pc # Hostname: xxxxx.hrz.uni-marburg.de auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_master_user_separator = * auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_ auth_username_format = %u auth_worker_max_count = 1024 base_dir = /var/run/dovecot/ default_vsz_limit = 1 G first_valid_gid = 30000 first_valid_uid = 30000 imap_max_line_length = 640 k mail_debug = yes mail_location = maildir:%h/.maildir mail_plugins = " mail_log notify" mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { hidden = no inbox = yes list = yes location = maildir:%h/.maildir prefix = separator = / subscriptions = yes type = private } namespace inbox { hidden = yes inbox = no list = no location = maildir:%h/.maildir prefix = mail/ separator = / subscriptions = no type = private } passdb { args = /etc/dovecot.deny deny = yes driver = passwd-file } passdb { args = /etc/opt/csw/dovecot/private/passwd.masterusers driver = passwd-file master = yes } passdb { args = /etc/opt/csw/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve sieve_default = /var/lib/dovecot/default.sieve } pop3_uidl_format = %08Xv%08Xu postmaster_address = postmaster(a)hrz.uni-marburg.de protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { client_limit = 6000 } service imap-login { process_min_avail = 64 service_count = 0 } service imap { process_limit = 4096 } service lmtp { inet_listener lmtp { port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/opt/csw/ssl/certs/imap+pop.hrz.uni-marburg.de.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/opt/csw/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } protocol imap { mail_max_userip_connections = 25 ssl_cert = </etc/opt/csw/ssl/certs/imap+pop.hrz.uni-marburg.de.pem ssl_key = # hidden, use -P to show it } protocol lmtp { mail_plugins = " mail_log notify sieve" } protocol pop3 { ssl_cert = </etc/opt/csw/ssl/certs/imap+pop.hrz.uni-marburg.de.pem ssl_key = # hidden, use -P to show it }

5 8

replication dropped imap flags
by Patrick Cernko 14 Mar '19

14 Mar '19

Hi list, I think, I found a bug in the replication setup, that drops (custom) flags like Thunderbird labels. I have set up a simple 2 node setup to reproduce and explain it: Host adove.mpi-klsb.mpg.de and bdove.mpi-klsb.mpg.de (doveconf -n attached) have dovecot-imapd (from repo.dovecot.org) installed on an ext4 filesystem. They only have one account "test" via /etc/dovecot/userdb ("test:testpassword:::Test User::/bin/bash:"). It's mailbox contains one message, that is flagged with "$label1": doveadm -f flow fetch -u test 'guid flags' ALL guid=d1516a2b5c08fc5b541d00005a350039 flags=\Recent $label1 Now I simulate a node reinstall on adove by uninstalling dovecot, removing all remnants, reinstalling and configuring it again: apt purge dovecot-core dovecot-imapd rm -rf /var/vmail /var/lib/dovecot /etc/dovecot apt install dovecot-imapd # disable system auth : > /etc/dovecot/conf.d/auth-system.conf.ext # create /var/vmail install -d -o nobody -g nogroup -m 700 /var/vmail # create userdb echo 'test:testpassword:::Test User::/bin/bash:' > /etc/dovecot/userdb # create /etc/dovecot/local.conf # not described here, the resulting doveconf -n is attached! service dovecot restart When I check the flags of the mail of user test now, the "$label1" is disapeared on both machines, even after "doveadm replicator replicate -f test": doveadm -f flow fetch -u test 'guid flags' ALL guid=d1516a2b5c08fc5b541d00005a350039 flags=\Recent Any hints what I am doing wrong here or is this really a bug? Best, -- Patrick Cernko <pcernko(a)mpi-klsb.mpg.de> +49 681 9325 5815 Joint Administration: Information Services and Technology Max-Planck-Institute fuer Informatik & Softwaresysteme

1 2

Am I right to assume certificate renewal with the same filename requires a dovecot reload/restart
by Guido Goluke, MajorLabel 14 Mar '19

14 Mar '19

Running dovecot 2.2, apologies if this question has been asked before: I've done the research but couldn't find anything. I run a server that uses dovecot as a MUA for Postfix and have a Let's Encrypt certificate that auto-renews through certbot on Ubuntu server 16.04. Dovecot did not pick up on the new certificate for the hostname. It did after a restart. To be clear: Let's Encrypt overwrites the previous certificate using the same path and filename. Am I right to assume that Dovecot needs a reload/restart after the certificate has been renewed in order to 'pick up' on the new certificate and if so, would I require a reload or a restart? Thank you in advance -- MajorLabel

4 8

Unable to set quota-fs plugin
by Eric Grammatico 14 Mar '19

14 Mar '19

Hello There, I am try desperatly to setup quota-fs plugin in Dovecot. I have the following configuration in place: /etc/dovecot/conf.d/10-mail.conf:mail_plugins = $mail_plugins quota zlib /etc/dovecot/conf.d/20-imap.conf: mail_plugins = $mail_plugins imap_quota /etc/dovecot/conf.d/90-quota.conf: plugin { #quota = dirsize:User quota #quota = maildir:User quota #quota = dict:User quota::proxy::quota #quota = fs:User quota:user quota = fs:user } The logs report the following error each time quota is requested: Mar 11 17:56:20 mail.xxxxxxx.xx dovecot[4923]: imap(xxxx): Error: Failed to get quota resource STORAGE: quota-fs: quotactl(Q_GETQUOTA, /dev/vda1) failed: No such file or directory I have no idea of which file or directory is missing. Any advice is welcome. Thanks and best regards, - Eric Grammatico _/)

3 11

rsync /old/server new/server ?
by Voytek Eymont 14 Mar '19

14 Mar '19

I have Centos 7 with dovecot/postfix/mysql Maildir I want to bring in a new server, new server will have same hostname as current, but, different IP I was intending to rsync -avzhe ssh vmail@oldserver:/var/vmail/vmail1 /var/vmail/vmail1 and, then, re run as necessary when/if mail still arrives on old server is that "a good plan" ...? TIA, V

4 3

recipient bcc and dovecot
by ＠lbutlr 13 Mar '19

13 Mar '19

I have a recipient_bcc_maps which contains a bcc map that is updated everyday: rbcc.pcre: if !/backup.*@/ /^([^+_]*).*(a)([^.]*)/ backup+071.${1}-${2}(a)adomain.tld endif the 071 portion is changed each day to the current day of the year. Everything works, but I get an error from dovecot on every message: lda(backup(a)adomain.tld): Error: User initialization failed: Namespace '': Ambiguous mail location setting, don't know what to do with it: /usr/local/virtual/backup(a)adomain.tld (try prefixing it with mbox: or maildir:) The mail is delivered two the right directory anyway, but after a temporary failure. I'd like to eliminate the error. the backup user is not a 'real' user (it is not in the lookup map) so should I bypass dovecot entirely in delivering these messages? (and if so, how) If not, where/how would I add the prefix maildir: Is there something I can add to dovecot to specifically deal with messages coming in to backup(a)adomain.tld and add the maildir: specification there? (Still on dovecot 2.2.35) -- And sometimes there's a short cut. A door or a gate. Some standing stones. A tree cleft by lightning, a filing cabinet. Maybe just a spot on some moorland somewhere... A place where THERE is very nearly HERE... If some people knew where such a spot was, if they had experience of what happens when here and there become entangled, then they might - if they knew how - mark such a spot with certain stones. In the hope that enough daft buggers would take it as a warning and keep away. (Lords and Ladies)

2 3

sieve vacation to an alias group
by Monis Monther 13 Mar '19

13 Mar '19

Hi, We have an alias group named xyz(a)example.com, this alias group has 3 actual users a(a)example.com, b(a)example.com and c(a)example.com We set vacation rule on the generic sieve rule, the problem is that 3 responses are sent to the original sender. (obviously because the rule is being executed with each user in the alias group) Is it possible to set auto response only once, we tried the ( :days 1) option but still all 3 respond back. How can such a setup be achieved. (Single auto response to an alias group) CentOS 7.5 dovecot-pigeonhole-2.3.4.1-1.x86_64 dovecot-2.3.4.1-1.x86_64 postfix 2.10-1 -- Best Regards Monis

4 14

Delayed flags changes over IDLE
by Kostya Vasilyev 13 Mar '19

13 Mar '19

Hello, I'm experiencing slow flags changes over IMAP IDLE: - If I start an IDLE session / command - Change the flags of some messages via another email app - Dovecot can take a minute or more to notify the IDLE connection about flags changes If I use another email app to add or remove a message, Dovecot sends that (EXISTS / EXPUNGE) instantly and also flushes the (so far delayed) flags changes. So it does "know" already. The system is Debian Testing, 64 bit, file system is ext4. Dovecot is 2.3.4.1 (f79e8e7e4) - I believe from Debian repos (I had Dovecot's own repo added at some point, disabled now). My mail is stored under ~/mail/.imap (not sure what this format is called), I mean not "single file mbox". I have not changed any IDLE related config settings: doveconf | grep -i idle default_idle_kill = 1 mins director_ping_idle_timeout = 30 secs imap_idle_notify_interval = 2 mins imapc_max_idle_time = 29 mins mailbox_idle_check_interval = 30 secs What can I do to make Dovecot notify IDLE clients about flags changes - more quickly? Preferably near-instant? -- Kostya Vasilyev kman(a)fastmail.com

3 9

“doveadm mailbox” command fails with UTF-8 mailboxes
by Felipe Gasper 13 Mar '19

13 Mar '19

Hello, I’ve got a strange misconfiguration where the following command: doveadm -f pager mailbox status -u spamutf8 'messages vsize guid' INBOX 'INBOX.*' … fails with error code 68, saying that it can’t find one of the mailboxes. (It lists the user’s other mailboxes.) The name of the mailbox in question is saved to disk in UTF-8 rather than mUTF-7, but strace shows that doveadm is stat()ing the mUTF-7 path; the failure of that stat() is, assumedly, what causes doveadm to report the error status. I’ve tried to paw through the source code to see what might be causing this but haven’t made much headway. Can someone here point out where the misconfiguration might be that is causing doveadm to stat() the mUTF-7 path rather than UTF-8? Or perhaps offer any tips as to how I might diagnose what’s going on? What causes doveadm to stat() one path or the other? Thank you! -Felipe Gasper Mississauga, ON

5 9

Inbox quota usage doubled when mailbox_list_index enabled, under some circumstances
by Chris Dillon 13 Mar '19

13 Mar '19

Hello, I searched through the list archives for anything that appeared to be similar to this but I didn't find any good matches. I apologize if this has been brought up before. Beginning with Dovecot 2.2.34, reported quota usage of a user's inbox can be doubled when the following criteria are met: 1) quota plugin is enabled 2) mailbox_list_index=yes 3) A sub-folder of the inbox exists whose name also matches the prefix (for example, "INBOX.Test"), even if that folder has no contents. (Apparently, some mail clients such as K-9 Mail on Android can create these folders automatically) Downgrading to 2.2.33.2 allows this configuration to work normally. I looked through the changes in git between 2.2.33.2 and 2.2.34 and they appeared extensive, so unfortunately I wasn't able to pinpoint a specific change that caused this. Reproduced on a CentOS 7 server with Dovecot 2.2.34 built from git sources according to https://wiki2.dovecot.org/CompilingSource#Compiling_Dovecot_From_Git using the following minimal configuration: ========== root@centos7 [~]# dovecot -n # 2.2.34 (874deae): /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.10.0-862.9.1.el7.x86_64 x86_64 CentOS Linux release 7.5.1804 (Core) # Hostname: centos7.local mail_location = maildir:~/Maildir mail_plugins = quota mailbox_list_index = yes namespace inbox { inbox = yes location = prefix = INBOX. separator = . } passdb { driver = pam } plugin { quota = maildir:Mailbox } userdb { driver = passwd } ========== With the system user "myuser" and a minimal Maildir setup containing 1 email in the inbox, and one sub-folder named "INBOX.Test": ========== root@centos7 [~]# ls -lAR /home/myuser/Maildir /home/myuser/Maildir: total 4 drwxr-xr-x. 2 myuser myuser 77 Jul 25 09:36 cur drwxr-xr-x. 5 myuser myuser 56 Jul 25 15:19 .INBOX.Test -rw-r--r--. 1 myuser myuser 14 Jul 25 15:19 maildirsize drwxr-xr-x. 2 myuser myuser 6 Jul 25 09:36 new drwxr-xr-x. 2 myuser myuser 6 Jul 25 09:36 tmp /home/myuser/Maildir/cur: total 12416 -rw-r--r--. 1 myuser myuser 12712627 Jul 25 09:07 1532529376.M543965P58007.centos7.local,S=12712627,W=12877782:2,S /home/myuser/Maildir/.INBOX.Test: total 0 drwxr-xr-x. 2 myuser myuser 6 Jul 25 09:36 cur -rw-r--r--. 1 myuser myuser 0 Jul 25 09:36 maildirfolder drwxr-xr-x. 2 myuser myuser 6 Jul 25 09:36 new drwxr-xr-x. 2 myuser myuser 6 Jul 25 09:36 tmp /home/myuser/Maildir/.INBOX.Test/cur: total 0 /home/myuser/Maildir/.INBOX.Test/new: total 0 /home/myuser/Maildir/.INBOX.Test/tmp: total 0 /home/myuser/Maildir/new: total 0 /home/myuser/Maildir/tmp: total 0 ========== Given this configuration, when "mailbox_list_index" is enabled, after quota recalculation, quota reports that there are 2 messages and that double the amount of storage is used: ========== root@centos7 [~]# doveadm quota recalc -u myuser; doveadm quota get -u myuser Quota name Type Value Limit % Mailbox STORAGE 24830 - 0 Mailbox MESSAGE 2 - 0 ========== When "mailbox_list_index" is disabled and quota is recalculated, it will report the message and storage counts correctly: ========== root@centos7 [~]# doveadm -o 'mailbox_list_index=no' quota recalc -u myuser; doveadm quota get -u myuser Quota name Type Value Limit % Mailbox STORAGE 12415 - 0 Mailbox MESSAGE 1 - 0 ========== I am hoping that someone with much more familiarity with the code path involved here could take a look at this issue and possibly submit a fix for it -- that would be greatly appreciated. Please let me know if you need any more details regarding the replication steps, though I hope that I didn't miss anything. Thank you! -- Chris Dillon Technical Analyst III Migrations Specialist cPanel, Inc.

2 3