- dovecot - dovecot.org

lazy_expunge doesn't work since upgrade 2.2.30 to 2.2.32
by Harald Leithner 19 Sep '17

19 Sep '17

Hi, it seams that the lazy_expunge plugin doesn't work for me after the upgrade... 2.2.32 cry's about plugin { lazy_expunge_only_last_instance=no } is most likely handled as 'yes' - remove the setting completely to disable it. If this is intentional, add quotes around the value: lazy_expunge_only_last_instance="no" I changed it to lazy_expunge_only_last_instance="no" and tried to remove it but doesn't change the problem. dovecot -n # 2.2.devel (5af0c9f): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.devel (6c95b56) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.9 auth_cache_negative_ttl = 1 secs auth_cache_size = 10 M auth_cache_ttl = 1 secs auth_mechanisms = PLAIN LOGIN DIGEST-MD5 SCRAM-SHA-1 CRAM-MD5 APOP auth_verbose = yes default_client_limit = 600 default_vsz_limit = 512 M dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlacl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_gid = 1001 first_valid_uid = 1001 hostname = mailstore1(a)itronic.at imap_hibernate_timeout = 1 mins imap_id_log = * imap_id_send = * imap_idle_notify_interval = 10 mins imap_logout_format = bytes=%i/%o instance_name = mailstore1 last_valid_gid = 1001 last_valid_uid = 1001 lda_original_recipient_header = X-LDA-Original-To lmtp_rcpt_check_quota = yes login_greeting = ITronic Mail Store login_trusted_networks = x.y.z.0/24 mail_attachment_dir = /srv/storage1/vmail_sis mail_attachment_hash = %{sha512} mail_attachment_min_size = 64 k mail_cache_min_mail_count = 5 mail_gid = vmail mail_location = mdbox:~/mdbox mail_plugins = zlib lazy_expunge stats acl quota mail_log notify mail_prefetch_count = 100 mail_server_admin = mailto:postmaster@itronic.at mail_server_comment = ITronic Mail System mail_shared_explicit_inbox = yes mail_uid = vmail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds mdbox_preallocate_space = yes namespace { hidden = yes list = no location = mdbox:~/mdbox:MAILBOXDIR=expunged prefix = "#EXPUNGED/" subscriptions = no type = private } namespace { list = children location = mdbox:%%h/mdbox prefix = "#Users/%%u/" separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes location = mailbox Archvie { special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::sqlacl last_login_dict = proxy::lastlogin last_login_key = last-login/%u lazy_expunge = "#EXPUNGED/" mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create mail_log_fields = uid box msgid size flags vsize from subject quota = dict:User quota::proxy::sqlquota quota_grace = 10%% quota_rule = *:storage=1024M quota_rule2 = "#EXPUNGED:storage=+1024M" quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=80%% quota-warning 80 %u recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_extensions = +vacation-seconds sieve_global = /etc/dovecot/sieve sieve_max_actions = 64 sieve_max_redirects = 8 sieve_max_script_size = 2M sieve_quota_max_scripts = 0 sieve_quota_max_storage = 64M sieve_vacation_default_period = 1d sieve_vacation_min_period = 1h stats_refresh = 30 secs stats_track_cmds = yes zlib_save = gz zlib_save_level = 6 } pop3_uidl_duplicates = rename protocols = imap lmtp sieve pop3 service auth-worker { user = $default_internal_user } service auth { inet_listener { port = 4180 } unix_listener auth-userdb { mode = 0666 } } service dict { unix_listener dict { group = vmail mode = 0666 } } service imap-hibernate { unix_listener imap-hibernate { group = vmail mode = 0666 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { process_limit = 1024 unix_listener imap-master { user = dovecot } unix_listener imap { group = vmail mode = 0666 } vsz_limit = 512 M } service lmtp { inet_listener lmtp { address = x.y.z.b port = 24000 } unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 50 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_min_avail = 20 service_count = 1 vsz_limit = 64 M } service pop3 { process_limit = 1024 } service quota-warning { executable = script /opt/scripts/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } shutdown_clients = no ssl_cert = </etc/dovecot/private/STAR.itronic.at.pem ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA:AES256-SHA:DHE-RSA-CAMELLIA128-SHA:DHE-RSA-CAMELLIA256-SHA:CAMELLIA128-SHA:CAMELLIA256-SHA:ECDHE-RSA-DES-CBC3-SHA:DES-CBC3-SHA ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_options = no_compression ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 submission_host = x.y.z.a syslog_facility = local0 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } valid_chroot_dirs = /srv/storage1/vmail verbose_proctitle = yes protocol imap { mail_max_userip_connections = 30 mail_plugins = zlib lazy_expunge stats imap_stats quota imap_quota acl imap_acl last_login mail_log notify } protocol lda { mail_plugins = zlib lazy_expunge stats acl sieve quota mail_log notify } protocol lmtp { mail_plugins = zlib lazy_expunge stats acl sieve quota mail_log notify } protocol sieve { mail_max_userip_connections = 10 managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = zlib lazy_expunge stats acl last_login mail_log notify } regards -- Harald Leithner ITronic Wiedner Hauptstraße 120/5.1, 1050 Wien, Austria Tel: +43-1-545 0 604 Mobil: +43-699-123 78 4 78 Mail: leithner(a)itronic.at | itronic.at

4 7

dsync panic in mbox_lock
by manu＠netbsd.org 18 Sep '17

18 Sep '17

Hello I am trying to setup replication with dovecot-2.2.29.1, and for some users, I get a reproductible panic: # doveadm -v -o plugin/mail_replica=remoteprefix:root@mail2.example.net sync -d -u jdoe dsync-local(jdoe): Panic: file mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK) Abort User is not overquota, and filesystem permissions are correct. kernel trace shows it happens just after a stat() on INBOX/dovecot.ind ex.log. Here is doveadm backtrace: #0 0x00007f7ff650e6fa in _lwp_kill () from /lib/libc.so.12 #1 0x00007f7ff650e385 in abort () from /lib/libc.so.12 #2 0x00007f7ff6c91acc in default_fatal_finish () from /usr/pkg/lib/dovecot/libdovecot.so.0 #3 0x00007f7ff6c91b4a in default_fatal_handler () from /usr/pkg/lib/dovecot/libdovecot.so.0 #4 0x00007f7ff6cbcb9b in i_panic () from /usr/pkg/lib/dovecot/libdovecot.so.0 #5 0x00007f7ff7076721 in mbox_lock () from /usr/pkg/lib/dovecot/libdovecot-storage.so.0 #6 0x00007f7ff7077da7 in mbox_save_begin () from /usr/pkg/lib/dovecot/libdovecot-storage.so.0 #7 0x00007f7ff580c3f8 in quota_save_begin () from /usr/pkg/lib/dovecot/lib10_quota_plugin.so #8 0x00007f7ff7047f63 in mailbox_save_begin () from /usr/pkg/lib/dovecot/libdovecot-storage.so.0 #9 0x00007f7ff703d983 in mail_storage_copy () from /usr/pkg/lib/dovecot/libdovecot-storage.so.0 #10 0x00007f7ff5401f10 in notify_copy () from /usr/pkg/lib/dovecot/lib15_notify_plugin.so #11 0x00007f7ff580c259 in quota_copy () from /usr/pkg/lib/dovecot/lib10_quota_plugin.so #12 0x00007f7ff70480f8 in mailbox_copy_int () from /usr/pkg/lib/dovecot/libdovecot-storage.so.0 #13 0x00007f7ff70482a5 in mailbox_move () from /usr/pkg/lib/dovecot/libdovecot-storage.so.0 #14 0x000000000043a118 in ?? () #15 0x000000000043b465 in ?? () #16 0x000000000043db03 in dsync_mailbox_import_changes_finish () #17 0x000000000043906c in dsync_brain_sync_mails () #18 0x0000000000434e4d in dsync_brain_run () #19 0x000000000043514b in ?? () #20 0x0000000000447ca9 in ?? () #21 0x00007f7ff6ca3e65 in io_loop_call_io () from /usr/pkg/lib/dovecot/libdovecot.so.0 #22 0x00007f7ff6ca5179 in io_loop_handler_run_internal () from /usr/pkg/lib/dovecot/libdovecot.so.0 #23 0x00007f7ff6ca3efa in io_loop_handler_run () from /usr/pkg/lib/dovecot/libdovecot.so.0 #24 0x00007f7ff6ca4099 in io_loop_run () from /usr/pkg/lib/dovecot/libdovecot.so.0 #25 0x00000000004205b2 in ?? () #26 0x0000000000422754 in ?? () #27 0x0000000000423074 in ?? () #28 0x00000000004238d1 in doveadm_mail_try_run () #29 0x000000000045182a in main () Any hint? -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu(a)netbsd.org

2 3

hidden shared/public Trash and Junk folders
by Rupert Gallagher 17 Sep '17

17 Sep '17

We need ideas on how to do this reliably and efficiently for a specific client with unfaithful employees. --- We could do this using client-side configuration tied to windows GPO, but prefer a server-side solution. Sent from ProtonMail Mobile

1 1

logins fail for virtual users (permission denied, we're not in group 5000)
by Paul Schreiber 17 Sep '17

17 Sep '17

I have: - Ubuntu 17.04 - Dovecot 2.2.27 (c0f36b0) - Postfix 3.1.4 - regular unix users with mail in /home/bob/Maildir - virtual users with mail in /var/mail/vhosts/domain.com/bob/ The regular users can receive mail as expected. When virtual users try to log in, it fails. The log shows an error like this: 2017-09-14 22:44:55 auth: Error: passwd-file(travler(a)travler.net,54.210.254.169,<EYwzYDFZWoY20v6p>): stat(/var/mail/vhosts/travler.net/shadow) failed: Permission denied (euid=114(dovecot) egid=121(dovecot) missing +x perm: /var/mail/vhosts, we're not in group 5000(vmail), dir owned by 5000:5000 mode=0750) A previous user had a similar problem in 2015: https://dovecot.org/list/dovecot/2015-July/101469.html He was advised to look at https://wiki2.dovecot.org/UserIds … without being given more specific advice. I looked at the page. I tried adding mail_uid and mail_gid. No luck. In my case, I see: # sudo -u dovecot groups dovecot vmail # sudo -u dovecot cat /var/mail/vhosts/travler.net/shadow <file contents> I have a vmail user: # id vmail uid=5000(vmail) gid=5000(vmail) groups=5000(vmail) # ls -la /var/mail/vhosts total 0 drwxr-s--- 1 vmail vmail 246 Jun 30 11:23 . drwxrwsrwt 1 mail mail 26 Dec 5 2016 .. drwxr-s--- 1 vmail vmail 66 Sep 14 23:11 travler.net # ls -l /var/mail/vhosts/travler.net/ total 8 -rwxr-s--- 1 vmail vmail 174 Dec 5 2016 passwd -rwxr-s--- 1 vmail vmail 173 Dec 5 2016 shadow drwxr-s--- 1 vmail vmail 450 Sep 9 13:16 travis.belmont drwxr-s--- 1 vmail vmail 750 Sep 13 14:14 travler I've set mail_gid and mail_uid # doveconf -n|grep id mail_gid = 5000 mail_uid = 5000 Here's my full config: # doveconf -n # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.10.0-33-generic x86_64 Ubuntu 17.04 btrfs log_path = /var/log/dovecot log_timestamp = "%Y-%m-%d %H:%M:%S " mail_gid = 5000 mail_location = maildir:/home/%u/Maildir mail_privileged_group = mail mail_uid = 5000 namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = username_format=%n /var/mail/vhosts/%d/shadow driver = passwd-file } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " imap" service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service imap-login { inet_listener imap { port = 0 } } ssl_cert = [snip] ssl_cipher_list = [snip] ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_protocols = !SSLv3 !SSLv2 userdb { driver = passwd } userdb { args = username_format=%n /var/mail/vhosts/%d/passwd driver = passwd-file } What do I need to set to get dovecot to run as vmail / fix this error? Paul

2 4

What INTERNALDATE does dovecot with mbox storage set on a COPY'd message?
by Steinar Bang 15 Sep '17

15 Sep '17

When a message is copied to a folder on dovecot with mbox storage, is the mtime of the saved mbox file set to the time of the save? Or is the mtime set to the Date: field of the source message that is saved? If there is a difference in the behaviour, do someone know the dovecot version number where the change happened? The reason I'm asking is a problem reported on the Gnus imap client in August 2016, where messaged moved by Gnus showed up with the wrong order and/or wrong date in other imap clients. (The reason for the different message ordering was that the other clients use the INTERNALDATE and that was changed to the time of message move when Gnus was used. Gnus use the Date of the source message) Thanks! - Steinar (Gnus user)

2 4

[RFC master-2.2 0/1] Support OpenSSL 1.1 API for setting allowed TLS versions
by Apollon Oikonomopoulos 14 Sep '17

14 Sep '17

Hi, I came up with the following patch while trying to figure out a good solution for the situation described in Debian bug #871987[1]. In short, OpenSSL in Debian unstable has disabled TLSv1.0 and TLSv1.1 *by default*. That means that unless an application requests otherwise, only TLSv1.2 is supported. In the world of e-mail this is seemingly an issue, as there are still way too many old clients out there supporting only TLSv1 or TLSv1.1. Now, traditionally OpenSSL 0.9.8/1.0 used SSL_CTX_set_options() to allow *disabling* specific protocols, without offering a way to enable previously disabled protocols. OpenSSL 1.1 introduced a dedicated API[2] to set allowed protocol versions, taking a linear version approach: the application may request a minimum and a maximum allowed version (inclusive), allowing all versions inbetween as well. Dovecot's existing ssl_protocols option is probably not ideal to use with this new "linear" model. Instead, I introduced two new options, ssl_min_proto_version and ssl_max_proto_version, that map directly to OpenSSL 1.1 concepts. I have tested the patch with both OpenSSL 1.0 and OpenSSL 1.1. With OpenSSL 1.1 it works as expected; with OpenSSL 1.0 it doesn't seem to break anything. Other than that, this is a first version; I'm sure there are still things to improve, so comments are welcome :) Regards, Apollon [1] https://bugs.debian.org/871987 [2] https://www.openssl.org/docs/man1.1.0/ssl/SSL_CTX_set_min_proto_version.html Apollon Oikonomopoulos (1): Support setting min/max SSL protocol version doc/example-config/conf.d/10-ssl.conf | 4 ++++ src/config/config-parser.c | 25 +++++++++++++++++++++ src/lib-master/master-service-ssl-settings.c | 4 ++++ src/lib-master/master-service-ssl-settings.h | 2 ++ src/lib-master/master-service-ssl.c | 2 ++ src/lib-ssl-iostream/iostream-openssl-common.c | 12 +++++++++++ src/lib-ssl-iostream/iostream-openssl.h | 1 + src/lib-ssl-iostream/iostream-ssl.h | 2 ++ src/login-common/ssl-proxy-openssl.c | 30 ++++++++++++++++++++++++++ 9 files changed, 82 insertions(+) -- 2.14.1

2 2

disable imap for ldap user
by Markus Rosjat 13 Sep '17

13 Sep '17

hi there, I have a LDAP dir with an attribute set to 0 or 1 and in my old setup (a courier server) I used this attribute to map it to an authoption called disableimap. This prevent users to access the mailbox with imap protocol. So the question is what should I set in dovecot to get the same behaviour? I looked at the docs but the part with the pass_ilter and service doesn't really fit. Some advice would be appreciated regards -- Markus Rosjat fon: +49 351 8107223 mail: rosjat(a)ghweb.de G+H Webservice GbR Gorzolla, Herrmann Königsbrücker Str. 70, 01099 Dresden http://www.ghweb.de fon: +49 351 8107220 fax: +49 351 8107227 Bitte prüfen Sie, ob diese Mail wirklich ausgedruckt werden muss! Before you print it, think about your responsibility and commitment to the ENVIRONMENT

3 4

Problems to configure IMAP Quota
by Jacques Belin 13 Sep '17

13 Sep '17

Hello, We manage a mail server using Dovecot under Debian. Since a long time, we run nightly a script permitting to display the storage usage of each user on the webmail, using internal calls. The usage on each mailbox is stored in a Mysql database. For several reasons, we would now want to use the IMAP quota feature, not only to let users have the quota displayed from their Mail clients. But testing that features, I encounter two problems : 1) It seems that when we use the sql dict, a map contaning the patern "priv/quota/limit/messages" is mandatory. Not specifying it in dovecot-dict-sql.conf.ext issues an error. As we are interested only by the storage size and don't want to process the number of messages, how to get rid of it ? 2) We store the storage value in kilobytes. But the plugin seems to only accept storage in bytes, Is there any way to let know to dovecot that the value stored in the database is in kilobytes ? (of course, I tried to put "size/1024" in the value_field field of the map. It works, but generate a lot of error lines in the dovecot log as it create a syntaxly incorrect MySQL uodate request...) Jacques. -- The last man connected to the Interet was browsing some old WebSites. "You have new mail" appeared on the screen... --------------------------- adapted from a short Fredric Brown's story

3 3

concering dovecot logging
by Rajesh M 13 Sep '17

13 Sep '17

hi had a question concerning dovecot lda logging. deliver_log_format = From:<%f>-<%e> :: Subject:<%s> :: Status:<%$> :: MsgID:<%m> :: Size<%p> :: vSize<%w> am getting %e ie envelope sender as MAILER-DAEMON in the logs Sep 11 08:35:50 lda(noc(a)xxx.com): Info: sieve: From:<bmmsro0612(a)xxx.co.in>-<MAILER-DAEMON> :: Subject:<Fw: ccccccn> :: Status:<forwarded to <nocforward(a)yyyyy.com>> :: MsgID:<<OFBECDF3FA.57B3772C-ON65258198.00111392-65258198.00111394(a)xxx.co.in>> :: Size<12497> :: vSize<12687> what could be the reason ? thanks, rajesh

2 1

Problem w/ Dovecot authentication against AD
by Garry Glendown 13 Sep '17

13 Sep '17

Hi, I had to start using Dovecot on a machine as the new OS does not come with Cyrus IMAP anymore. After multiple problems, I managed to get everything working, including LDAP authentication against the (old) Novell LDAP server. Anyway, the authentication is supposed to be migrated to the new Windows AD. For other tools, I successfully migrated the config to use AD, but somehow Dovecot does not work as it should. I've been going back and forth, trying everything I could think of, but still can't get it to work. Here's the excerpt from the config file: hosts = 10.10.10.210 uris = ldap://10.10.10.210:389 dn = cn=Administrator,cn=Users,dc=srv,dc=SLD,dc=net dnpass = PASSWORD tls = no debug_level = -1 auth_bind = yes ldap_version = 3 base = DC=srv,dc=SLD,dc=net deref = never scope = subtree user_attrs = sAMAccountName=user user_filter = (&(sAMAccountName=%n)(objectclass=person)) pass_attrs = sAMAccountName=user pass_filter = (&(sAMAccountName=%n)(objectclass=person)) iterate_attrs = mail=user iterate_filter = (objectclass=person) default_pass_scheme = PLAIN The problem might be caused by the referal-info sent by the AD, which I can see both in the results dovecot gets (checked with tcpdump), as well as in ldapsearch ... apart from the actual search result, I always get three additional results: # refldap://DomainDnsZones.srv.SLD.net/DC=DomainDnsZones,DC=srv,DC=SLD,DC=net # refldap://ForestDnsZones.srv.SLD.net/DC=ForestDnsZones,DC=srv,DC=SLD,DC=net # refldap://srv.SLD.net/CN=Configuration,DC=srv,DC=SLD,DC=net >From what I can see in the pcap as well as some of the logs, dovecot binds to the AD, sends out the LDAP query correctly, gets the lookup result with the user queried plus the above three referrals, then unbinds from the (named) bind, attempts a simple bind without dn/dnpass (multiple times), and finally sends three additional search requests under the search bases cn=Configuration,DC=srv,DC=SLD,DC=net DC=ForestDnsZones,DC=srv,DC=SLD,DC=net DC=DomainDnsZones,DC=srv,DC=SLD,DC=net These three requests are denied by the AD as they are not permitted without a successful prior bind. Dovecot then fails the auth process. Is there a way to stop Dovecot from using the referals? Openldap seems to have an option to disable referals, but Dovecot does not allow that option in its LDAP config, and having the option set in the global ldap.conf doesn't seem to help any, either. Is there possibly a way to disable the referal information on the AD side? Thanks, Garry -- PGP Fingerprint: A79F A33F 5B13 BEB7 A51D 274F F99C 3AE2 4BCB 7015

3 3