- dovecot - dovecot.org

Testing validity of Dovecot config in a script
by Ralph Seichter 24 Nov '18

24 Nov '18

While trying to determine a given configuration is valid from within a script, I found that the following works with Dovecot version 2.3.2.1: #!/usr/bin/env bash doveconf -n >/dev/null || echo "Config is invalid" However, the return code is not documented in the doveconf manual page, and I wonder if the observed behaviour can be relied on? Is this the recommended method to test configuration validity? Personally, I'd like to have a dedicated call available. Something like # Proposal: "-t" for "test config" doveconf -t [-c config-file] with documented return codes would be ideal. -Ralph

2 2

Problems after upgrading to 2.3.2.1
by Joel Dahl 23 Nov '18

23 Nov '18

Hi, I've just upgraded dovecot from 2.2.35 to 2.3.2.1 on my mail server and noticed something odd. My mail clients (mutt and Apple mail) both stopped seeing new mail in my mailboxes. For example, ~/Maildir/mailinglist1/new has 5 new mails. In mutt, vieweing the list of mailboxes mutt reports 0 new mail for "mailinglist1". Opening up the actual mailbox in mutt reveals the 5 new mails. Going back to the list of mailboxes, mutt now correctly reports 5 unread mails. Waiting a few hours, and about 10 new mails have arrived, but mutt still says 5 unread. This is the same for every mailbox. As a test I deleted the index files for a specific mailbox and restarted dovecot. But it didn't help. I use procmail to deliver my mail into the Maildir folders, if that matters. Any ideas? I haven't changed my dovecot configuration in a long time, except for adding ssl_dh after the upgrade. My config is below: auth_mechanisms = plain login imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log mail_location = maildir:~/Maildir mail_privileged_group = mail maildir_very_dirty_syncs = yes passdb { args = session=yes dovecot driver = pam } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl = required ssl_cert = </path/to/cert.pem ssl_dh = # hidden ssl_key = # hidden userdb { driver = passwd } -- Joel

2 2

doveadm dsync-server doesn't use user parameter?
by Harald Leithner 23 Nov '18

23 Nov '18

Hi, I tried to migrate my dovecot 2.2 to a new server with a other storage configuration and dovecot 2.3. New (and old) Server uses mysql for user information I use the following storage settings mail_home = /storage1/vmail/%{userdb:path} mail_location = mdbox:/storage1/fast/%{userdb:path}:FULLDIRNAME=iTrNiCs-DBOx-mAiLs:INDEX=/storage1/indexes/vmail/%{userdb:path}:ALT=/storage1/slow/%{userdb:path}:VOLATILEDIR=/tmp/%{userdb:path} userdb:path is generated by the mysql query and ends in something like "2000/6" SQL: CONCAT(u.idAccount, '/', u.idUser) AS userdb_path If I login with imap dovecot is creating the INBOX on the correct path /storage1/fast/2000/6/mailboxes/INBOX btw. it creates a link to dbox-alt-root but without creating the target directory is this expected? Now if I start doveadm backup -u <username> remote:mailstore2 it ignores it seams that dsync-server doesn't make a database query and doesn't use the userdb_path field. It only uses /storage1/fast/mailboxes/INBOX as path. Is this a problem with my configuration? thx --- doveconf -n # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.3 (f018bbab) # OS: Linux 4.15.18-7-pve x86_64 Debian 9.6 zfs # Hostname: mailstore2 auth_cache_negative_ttl = 1 secs auth_cache_size = 10 M auth_cache_ttl = 1 secs auth_master_user_separator = * auth_mechanisms = PLAIN LOGIN APOP auth_verbose = yes default_client_limit = 600 default_vsz_limit = 512 M dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlacl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_gid = 1001 first_valid_uid = 1001 hostname = mailstore2 imap_hibernate_timeout = 1 mins imap_id_log = * imap_id_send = * imap_idle_notify_interval = 10 mins imap_logout_format = bytes=%i/%o instance_name = mailstore2 last_valid_gid = 1001 last_valid_uid = 1001 lda_original_recipient_header = X-LDA-Original-To lmtp_rcpt_check_quota = yes login_greeting = ITronic Mail Store login_trusted_networks = 172.22.14.0/24 mail_cache_min_mail_count = 5 mail_gid = vmail mail_home = /storage1/vmail/%{userdb:path} mail_location = mdbox:/storage1/fast/%{userdb:path}:FULLDIRNAME=iTrNiCs-DBOx-mAiLs:INDEX=/storage1/indexes/vmail/%{userdb:path}:ALT=/storage1/slow/%{userdb:path}:VOLATILEDIR=/tmp/%{userdb:path} mail_plugins = lazy_expunge acl quota mail_log notify mail_prefetch_count = 100 mail_server_admin = mailto:postmaster@example.com mail_server_comment = Mail System mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds mdbox_preallocate_space = yes namespace { hidden = yes list = no location = mdbox:/storage1/fast/%{userdb:path}:MAILBOXDIR=expunged:LISTINDEX=expunged.list.index:FULLDIRNAME=iTrNiCs-DBOx-mAiLs:INDEX=/storage1/indexes/vmail/%{userdb:path}:ALT=/storage1/slow/%{userdb:path}:VOLATILEDIR=/tmp/%{userdb:path} prefix = "#EXPUNGED/" subscriptions = no type = private } namespace { list = children location = mdbox:%%h/mdbox prefix = "#Users/%%u/" separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes location = mailbox Archvie { special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes result_success = continue-ok } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::sqlacl last_login_dict = proxy::lastlogin last_login_key = # hidden, use -P to show it lazy_expunge = "#EXPUNGED/" lazy_expunge_only_last_instance = no mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create mail_log_fields = uid box msgid size flags vsize from subject quota = dict:User quota::proxy::sqlquota quota_grace = 10%% quota_rule = *:storage=1024M quota_rule2 = "#EXPUNGED:storage=+1024M" quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=80%% quota-warning 80 %u recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = file:/storage1/vmail/%{userdb:idAccount}/ sieve_extensions = +vacation-seconds sieve_global = /etc/dovecot/sieve sieve_max_actions = 64 sieve_max_redirects = 8 sieve_max_script_size = 2M sieve_quota_max_scripts = 0 sieve_quota_max_storage = 64M sieve_vacation_default_period = 1d sieve_vacation_min_period = 1h } pop3_uidl_duplicates = rename protocols = imap lmtp sieve pop3 service auth-worker { user = $default_internal_user } service auth { inet_listener { port = 4180 } unix_listener auth-userdb { mode = 0666 } } service dict { unix_listener dict { group = vmail mode = 0666 } } service imap-hibernate { unix_listener imap-hibernate { group = vmail mode = 0666 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { process_limit = 1024 unix_listener imap-master { user = dovecot } unix_listener imap { group = vmail mode = 0666 } vsz_limit = 512 M } service lmtp { inet_listener lmtp { address = 172.22.14.136 port = 24000 } unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 50 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_min_avail = 20 service_count = 1 vsz_limit = 64 M } service pop3 { process_limit = 1024 } service quota-warning { executable = script /opt/scripts/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } shutdown_clients = no ssl_cert = </etc/dovecot/private/example.com.pem ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA:AES256-SHA:DHE-RSA-CAMELLIA128-SHA:DHE-RSA-CAMELLIA256-SHA:CAMELLIA128-SHA:CAMELLIA256-SHA:ECDHE-RSA-DES-CBC3-SHA:DES-CBC3-SHA ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_options = no_compression ssl_prefer_server_ciphers = yes submission_host = 192.168.14.198 syslog_facility = local0 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } valid_chroot_dirs = /storage1 verbose_proctitle = yes protocol imap { mail_max_userip_connections = 30 mail_plugins = imap_zlib lazy_expunge quota imap_quota acl imap_acl last_login mail_log notify } protocol lda { mail_plugins = lazy_expunge acl sieve quota mail_log notify } protocol lmtp { mail_plugins = lazy_expunge acl sieve quota mail_log notify } protocol sieve { mail_max_userip_connections = 10 managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = lazy_expunge acl last_login mail_log notify } --- -- Harald Leithner ITronic Wiedner Hauptstraße 120/5.1, 1050 Wien, Austria Tel: +43-1-545 0 604 Mobil: +43-699-123 78 4 78 Mail: leithner(a)itronic.at | itronic.at

1 2

Re: LDAP stored quota
by Aki Tuomi 23 Nov '18

23 Nov '18

I noticed that you sent replies to me directly... Anyways, seems the problem was that the LDAP user_attrs is missing commas, and the mailRoutingAddress is used wrong, so the correct syntax would be: user_attrs = \ mailRoutingAddress=user, \ =uid=vmail, \ =gid=mail, \ =home=/var/mail/%d/%n, \ =quota_rule=*:bytes=%{ldap:departmentNumber} Aki > On 22 November 2018 at 15:29 Vincent Seynhaeve <vlamsdoem(a)gmail.com> wrote: > > > doveadm quota recalc -u test doesn't give anything. > Bellow the ouput of the `doveconf -n` and `doveadm user test` > > doveconf -n > # 2.2.10: /etc/dovecot/dovecot.conf > # OS: Linux 3.10.0-862.11.6.el7.x86_64 x86_64 CentOS Linux release 7.5.1804 > (Core) xfs > auth_debug = yes > auth_mechanisms = plain login > auth_verbose = yes > mail_debug = yes > mail_gid = mail > mail_home = /var/mail/%d/%n > mail_location = maildir:/var/mail/%d/%n/Maildir > mail_plugins = " quota" > mail_uid = vmail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character > vacation subaddress comparator-i;ascii-numeric relational regex imap4flags > copy include variables body enotify environment mailbox date ihave > mbox_write_locks = fcntl > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > quota = maildir:User quota > quota_grace = 10%% > quota_rule2 = Trash:storage=+100M > quota_status_nouser = DUNNO > quota_status_overquota = 552 5.2.2 Mailbox is full > quota_status_success = DUNNO > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > protocols = imap pop3 lmtp sieve > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener auth-userdb { > group = mail > mode = 0600 > user = vmail > } > } > service imap-login { > inet_listener imap { > port = 0 > } > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > } > service pop3-login { > inet_listener pop3 { > port = 0 > } > inet_listener pop3s { > port = 0 > } > } > ssl = required > ssl_cert = </etc/pki/tls/certs/imap.example.com.crt > ssl_key = </etc/pki/tls/private/imap.example.com.key > userdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > protocol lda { > mail_plugins = " quota sieve" > } > protocol imap { > mail_plugins = " quota imap_quota" > } > > > > > doveadm user test > field value > uid vmail > gid mail > home /var/mail//test > mail maildir:/var/mail//test/Maildir > mailRoutingAddress user =uid=vmail =gid=mail =home=/var/mail//test > =quota_rule=*:bytes=1M > > > Le jeu. 22 nov. 2018 à 14:18, Aki Tuomi <aki.tuomi(a)open-xchange.com> a > écrit : > > > Can you provide output of `doveconf -n` and `doveadm user test`? > > > > Aki > > > > > On 22 November 2018 at 10:44 Maciej Milaszewski IQ PL < > > maciej.milaszewski(a)iq.pl> wrote: > > > > > > > > > Hi > > > Do you try recalc and get ? > > > > > > On 22.11.2018 08:56, Vincent Seynhaeve wrote: > > > > > > > > Hello, > > > > > > > > I'm trying to set up LDAP stored quota on Dovecot but it doesn't work > > > > and doesn't get reported by the command doveadm quota get. > > > > > > > > I'm using the field departmentNumber in my LDAP server to store the > > quota. > > > > > > > > > > > > doveadm quota get -u test > > > > > > > > Quota name Type Value > > > > > > Limit > > > > % > > > > User quota STORAGE 0 > > > > > > - > > > > 0 > > > > User quota MESSAGE 0 > > > > > > - > > > > 0 > > > > > > > > > > > > log file associated with doveadm quota get command: > > > > > > > > Nov 21 11:38:47 imap dovecot: auth: Debug: master in: > > > > USER#0111#011test#011service=doveadm > > > > Nov 21 11:38:47 imap dovecot: auth: Debug: ldap(test): user search: > > > > base=ou=People,dc=example,dc=com scope=subtree > > > > filter=(&(objectClass=posixAccount)(uid=test)) fields=departmentNumber > > > > Nov 21 11:38:47 imap dovecot: auth: Debug: ldap(test): result: > > > > departmentNumber=1M; departmentNumber unused > > > > Nov 21 11:38:47 imap dovecot: auth: Debug: ldap(test): result: > > > > departmentNumber=1M > > > > Nov 21 11:38:47 imap dovecot: auth: Debug: userdb out: > > > > USER#0111#011test#011mailRoutingAddress=user =uid=vmail =gid=mail > > > > =home=/var/mail//test =quota_rule=*:bytes=1M > > > > > > > > > > > > Bellow my configuration files: > > > > > > > > conf.d/10-mail.conf > > > > > > > > mail_plugins = $mail_plugins quota > > > > > > > > > > > > conf.d/20-imap.conf > > > > > > > > > > > > protocol imap { > > > > mail_plugins = $mail_plugins imap_quota > > > > } > > > > > > > > > > > > conf.d/90-quota.conf > > > > > > > > plugin { > > > > > > > > quota = maildir:User quota > > > > quota_rule2 = Trash:storage=+100M > > > > quota_grace = 10%% > > > > quota_status_success = DUNNO > > > > quota_status_nouser = DUNNO > > > > quota_status_overquota = "552 5.2.2 Mailbox is full" > > > > > > > > } > > > > > > > > > > > > dovecot-ldap.conf.ext > > > > > > > > user_attrs= \ > > > > =mailRoutingAddress=user \ > > > > =uid=vmail \ > > > > =gid=mail \ > > > > =home=/var/mail/%d/%n \ > > > > =quota_rule=*:bytes=%{ldap:departmentNumber} > > > > > > > > > > > > Can somebody help me with this or give me some advice for debugging? > > > > > > > > > > > > > -- > > > Maciej Miłaszewski > > > IQ PL Sp. z o.o. > > > Administrator Systemowy > > > > > > Biuro Obsługi Klienta: > > > e-mail: bok(a)iq.pl > > > tel.: +48 58 326 09 90 - 94 > > > fax: +48 58 326 09 99 > > > > > > Dział pomocy: https://www.iq.pl/pomoc > > > Informacja dotycząca przetwarzania danych osobowych: > > https://www.iq.pl/kontakt > > > Jakość gwarantuje: ISO 9001:2000 > > > > > > IQ PL Sp. z o.o. z siedzibą w Gdańsku (80-298), ul. Geodetów 16, KRS > > 0000007725, Sąd rejestrowy: Sąd Rejonowy w Gdańsku VII Wydział KRS, > > > kapitał zakładowy: 140.000 PLN, NIP 5832736211, REGON 192478853 > > > > >

2 1

Core dump during UID Search
by Bert JW Regeer 22 Nov '18

22 Nov '18

Hey all, I keep finding core dumps of the IMAP process on my FreeBSD 11.2, however the backtrace is not very useful: Core was generated by `imap: [xistence(a)0x58.com 2601:282:4301:befc:1cfb:807f:e527:5a3b UID SEARCH]'. Program terminated with signal 6, Aborted. #0 0x0000000011c0c47a in ?? () (gdb) bt #0 0x0000000011c0c47a in ?? () #1 0x0000000011c0c444 in ?? () #2 0x00000000000188b0 in cmd_store () #3 0x0000000011c0c3b9 in ?? () #4 0x0000000012216810 in ?? () #5 0x0000000000000005 in ?? () #6 0xffffffdf00000000 in ?? () #7 0xffffffffffffffff in ?? () #8 0x00007fffffffffff in ?? () #9 0x0000000000000005 in ?? () #10 0x00007fffffffe240 in ?? () #11 0x000000001189c6f6 in ?? () #12 0x0000000012355e28 in ?? () #13 0x00000000122de048 in ?? () #14 0x0000000000000000 in ?? () (gdb) I am sorry that I haven't been able to find any more information or figure out what is going on :-( doveconf -n output follows: doveconf -n # 2.3.2.1 (0719df592): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.2 (7704de5e) # OS: FreeBSD 11.2-RELEASE-p4 amd64 # Hostname: juxi.0x58.com auth_mechanisms = plain login first_valid_gid = 127 first_valid_uid = 127 hostname = butler.0x58.com last_valid_gid = 127 last_valid_uid = 127 lmtp_save_to_detail_mailbox = yes login_greeting = Assume the position. mail_gid = 127 mail_home = /usr/local/vmail/domains/%d/%n mail_location = maildir:~/Maildir/ mail_plugins = " quota trash zlib virtual " mail_uid = 127 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace butler { hidden = no list = yes location = virtual:/usr/local/vmail/virtual:LAYOUT=maildir++:INDEX=~/virtual mailbox All { auto = subscribe special_use = \All } mailbox Flagged { auto = subscribe special_use = \Flagged } prefix = [Butler]/ separator = / subscriptions = yes type = private } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes } passdb { args = scheme=CRYPT username_format=%u /usr/local/vmail/domains/%d/passwd driver = passwd-file } plugin { fts = squat quota = maildir:User quota quota_rule = *:storage=5G quota_rule2 = Trash:storage=+100M quota_rule3 = Deleted Messages:storage=+100M recipient_delimiter = + sieve = ~/.dovecot.sieve sieve_dir = ~/sieve stats_refresh = 30 secs } postmaster_address = postmaster(a)butler.0x58.com protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service imap { drop_priv_before_exec = yes } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_cert = </usr/home/letsencrypt/letsencrypt.sh/certs/butler.0x58.com/fullchain.pem ssl_cipher_list = HIGH:!SSLv2:!RC4:!3DES:!aNULL:@STRENGTH ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = username_format=%u /usr/local/vmail/domains/%d/passwd default_fields = quota_rule=*:storage=3G driver = passwd-file } verbose_proctitle = yes verbose_ssl = yes protocol lmtp { mail_plugins = " quota trash zlib virtual sieve" } protocol lda { mail_plugins = " quota trash zlib virtual sieve" } protocol imap { mail_plugins = " quota trash zlib virtual fts fts_squat imap_quota imap_zlib" }

3 5

Same emails appearing multiple time after upgrade to version 2.33
by Thomas Durand 22 Nov '18

22 Nov '18

Hi, I have update today dovecot and dovecot pigeonhole to the latest version available on my centos 7. It’s a small email servers with postfix/amavisd/clamav/spamasssin. I had dovecot for IMAP/POP3 with spam plugins to store spam message automatically into the spam folder. After the upgrade, I was noticed by some of my users that they have in their message the same message appearing 2,3 even 10 times. I had the same behavior when using roundecube I was able to stop this after removing pigeonhole rpm (removing/disabling the config was not enough). Would appreciate your help to understand what is wrong with my config. Thanks dovecot conf : [root@justyna conf.d]# dovecot -n # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab127.2 x86_64 CentOS Linux release 7.5.1804 (Core) # Hostname: x auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it doveadm_port = 2727 imap_client_workarounds = delay-newmail mail_location = maildir:~/Maildir mail_plugins = " zlib notify replication" mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcp:62.210.220.186:2727 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_duplicate_default_period = 1h sieve_duplicate_max_period = 1d sieve_extensions = +vnd.dovecot.duplicate sieve_global_dir = /var/lib/dovecot/sieve/ sieve_global_path = /var/lib/dovecot/sieve/default.sieve zlib_save = gz zlib_save_level = 6 } protocols = imap pop3 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service doveadm { inet_listener { port = 2727 } } service imap-login { process_min_avail = 2 service_count = 0 } ssl_ca = /etc/letsencrypt/live/www.cr-avocats.com/lets-encrypt-x3-cross-signed.pem ssl_cert = </etc/letsencrypt/live/mail.cr-avocats.com/cert.pem ssl_client_ca_dir = /etc/ssl/certs/ ssl_client_ca_file = /etc/pki/tls/certs/ca-bundle.trust.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_key_password = # hidden, use -P to show it userdb { driver = passwd } userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } protocol lmtp { mail_plugins = " zlib notify replication" } protocol lda { mail_plugins = " zlib notify replication zlib sieve" } protocol imap { mail_max_userip_connections = 20 mail_plugins = " zlib notify replication" } Thomas Durand

1 0

LDAP stored quota
by Vincent Seynhaeve 22 Nov '18

22 Nov '18

Hello, I'm trying to set up LDAP stored quota on Dovecot but it doesn't work and doesn't get reported by the command doveadm quota get. I'm using the field departmentNumber in my LDAP server to store the quota. doveadm quota get -u test Quota name Type Value Limit % User quota STORAGE 0 - 0 User quota MESSAGE 0 - 0 log file associated with doveadm quota get command: Nov 21 11:38:47 imap dovecot: auth: Debug: master in: USER#0111#011test#011service=doveadm Nov 21 11:38:47 imap dovecot: auth: Debug: ldap(test): user search: base=ou=People,dc=example,dc=com scope=subtree filter=(&(objectClass=posixAccount)(uid=test)) fields=departmentNumber Nov 21 11:38:47 imap dovecot: auth: Debug: ldap(test): result: departmentNumber=1M; departmentNumber unused Nov 21 11:38:47 imap dovecot: auth: Debug: ldap(test): result: departmentNumber=1M Nov 21 11:38:47 imap dovecot: auth: Debug: userdb out: USER#0111#011test#011mailRoutingAddress=user =uid=vmail =gid=mail =home=/var/mail//test =quota_rule=*:bytes=1M Bellow my configuration files: conf.d/10-mail.conf mail_plugins = $mail_plugins quota conf.d/20-imap.conf protocol imap { mail_plugins = $mail_plugins imap_quota } conf.d/90-quota.conf plugin { quota = maildir:User quota quota_rule2 = Trash:storage=+100M quota_grace = 10%% quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is full" } dovecot-ldap.conf.ext user_attrs= \ =mailRoutingAddress=user \ =uid=vmail \ =gid=mail \ =home=/var/mail/%d/%n \ =quota_rule=*:bytes=%{ldap:departmentNumber} Can somebody help me with this or give me some advice for debugging?

3 2

unable to configure the ssl certificate in email client
by ChandranManikandan 22 Nov '18

22 Nov '18

Hi Friends, I have installed ssl certificate on my centos 7 server and website is working fine with https. But email client outlook and thunderbird unable to configure it. The certificate unable installed and import these above email clients when tried to configure the email account. Anyone help me. -- *Thanks & Best Regards,Mani*

2 1

Set only, not exclude
by lty＠cndns.com 22 Nov '18

22 Nov '18

SET ONLY, NOT EXCLUDE I WANT TO INDEX ONLY INBOX MESSAGES, NOT OTHER MAILBOXES HTTPS://WIKI.DOVECOT.ORG/PLUGINS/FTS OTHER SETTINGS plugin { fts_autoindex_exclude = \Junk fts_autoindex_exclude2 = \Trash fts_autoindex_exclude3 = DUMPSTER }

1 0

Multi-server but small scale
by Daniel Miller 21 Nov '18

21 Nov '18

I have a small but critical server that supports our group. As a single server - it's obviously a single-point-of-failure for lots of things. As I just experienced...again. It was a lot more fun building systems from components when I was younger... Previously 3rd-party hosted solutions didn't look attractive for several reasons...but I'm seeing prices now for cloud virtual machines that are stupid cheap. Even if they wind up being limited speed & availability - it would seem they'd be a lot better than nothing! So I'm considering having at least one backup server for various services - obviously that includes mail. So now I have to wonder about the backend. And while I think I'm reasonably current with networked file systems (not distributed or cluster) I haven't played with replication for a quite a while. For this particular usage (I'm envisioning two servers total) - is there a need/reason to use any form of networked/distributed/cluster file storage? Or would this be accomplished via "pure" Dovecot - dsync replication would keep things updated between the servers and director would handle the connections? So with identically configured SMTP servers, passing to the local LMTP agents, the file system would be "purely local" with no NFS or other interconnection? -- Daniel

2 1

analysing of dmarc report
by Poliman - Serwis 21 Nov '18

21 Nov '18

I have a problem with understanding dmarc reports and some features. I attach two reports. First one come from google.com, second one from tumieszkamy.pl. On my server is dns zone of domain kamir-transport.pl but whole mail service is deployed on Google - in dns zone MX points to Google and there are all mailboxes, aliases etc. Last time I have configured dkim and dmarc policies and I got two reports. Honestly I don't know why two, from two different providers - google.com and tumieszkamy.pl. Moreover in report originating from google I see IP of my server [which fails spf and dkim policies] and I don't understand why this IP is evaluated? Second thing which I don't understand is second report which I got from tumieszkamy.pl. SPF record in dns zone of domain kamir-transport.pl was looking like below (now I changed it to slightly different): *v=spf1 mx include:_spf.google.com <http://spf.google.com> -all* Does anybody could help uderstand these things? -- *Pozdrawiam / Best Regards* *Piotr Bracha*

1 0

Quota in MySql Dict not recalculate automatic
by SUnsin＠gv-bayern.de 20 Nov '18

20 Nov '18

Hi, I have a working Installation with: Ubuntu 16.04 LTS Dovecot 2.2.22 MySql 5.7.24 Postfixadmin 3.2 Apache 2.4.18 Rainloop 1.12.1 I manage the E-Mail Accounts with postfixadmin in a MySql-DB. Also I use quotas with Quota Backend postfixadmin-DB (dict). Everything works fine. Now I installed a new Server with the following Versions and migrate the Configs to the new System. Ubuntu 18.04 LTS Doveot 2.2.33 MySQL 5.7.24 Postfixadmin 3.2 Apache 2.4.18 Rainloop 1.12.1 The Problem is now: When I receive a E-Mail, the quota will not Update (recalculate) automatical in the MySql-DB from Dovecot. In the old System there execute the SQL Statement after receiving a E-Mail, for example: UPDATE quota2 SET bytes=bytes+3076,messages=messages+1 WHERE username = <E-Mail Address> On the new System with the newer Dovecot Version, the Statement never comes after receive an E-Mail. With Dovecot Version 2.3 on the old System with Ubuntu 16.04, everything works fine with the same config. Is a BUG in the Dovecot Version 2.2.33 possible? Can everbody help me? Kind regards Stephan dovecot -n # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.15.0-39-generic x86_64 Ubuntu 18.04.1 LTS auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_mechanisms = plain login auth_verbose_passwords = yes dict { sqldomainquota = mysql:/etc/dovecot/dovecot-dict-sql-domain.conf.ext sqluserquota = mysql:/etc/dovecot/dovecot-dict-sql-user.conf.ext } disable_plaintext_auth = no login_greeting = Dovecot ready. mail_debug = yes mail_location = maildir:~/Maildir mail_plugins = " quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User Quota::noenforcing:proxy::sqluserquota quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is over quota / Mailbox ist voll quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u } postmaster_address = postmaster@xxx protocols = " imap lmtp sieve pop3 sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service lmtp { inet_listener lmtp { address = localhost port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } ssl_cert = xxx ssl_key = # hidden, use -P to show it userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " quota" } protocol imap { mail_max_userip_connections = 10 mail_plugins = " quota imap_quota" } grep -v '^ *$#.*$\?$' dovecot-sql.conf : driver = mysql connect = host=localhost dbname=postfixadmin user=pfadmin password=UCLGXEb9rEEOTAO default_pass_scheme = SHA512-CRYPT password_query = \ SELECT username as user, password, '/var/vmail/%Ld/%Ln' as userdb_home, \ 'maildir:/var/vmail/%Ld/%Ln' as userdb_mail, 5000 as userdb_uid, 5000 as userdb_gid \ FROM mailbox WHERE username = '%Lu' AND active = '1' user_query = \ SELECT '/var/vmail/%Ld/%Ln' as home, \ 'maildir:/var/vmail/%Ld/%Ln' as mail, \ 5000 AS uid, \ 5000 AS gid, \ concat('*:bytes=', \ if(mailbox.quota = 0, domain.maxquota*1024000, mailbox.quota)) \ as quota_rule \ FROM mailbox, domain \ WHERE username = '%Lu' AND mailbox.active = '1' AND \ domain.domain = '%d' AND domain.active = '1' iterate_query = SELECT username as user FROM mailbox WHERE active = '1' Ref. Systeme / Bereich Digitalisierung und Informationstechnik (IT) Telefon: 089 2868-3280 Telefax: 089 2868-3275 Internet-E-Mail: SUnsin(a)gv-bayern.de Notes-E-Mail: Stephan Unsin@GVB http://www.gv-bayern.de Genossenschaftsverband Bayern e.V. Türkenstrasse 22-24, 80333 München Es gelten die jeweils aktuellen Allgemeinen Auftragsbedingungen des Genossenschaftsverbands Bayern e.V.

2 5

Update virtual folders via doveadm?
by Daniel Miller 20 Nov '18

20 Nov '18

I'm trying to have my server maintain it's FTS indexes reasonably current at all times. From prior threads, and based on my namespace configuration, I have the following hourly cronjob: doveadm index -A -q '*' doveadm index -A -q 'shared/*' doveadm index -A -q 'virtual/*' This seems to work just fine to maintain the FTS (Solr). However - as I understand it Dovecot's virtual folders are not updated with new mails until they are accessed by a client. Therefore the above command sequence would work fine for my default namespace and the shared - but the virtual namespace won't actually be current. So... Would a command such as: doveadm mailbox status -A messages virtual/* Be appropriate to run prior to the virtual/* FTS indexing? -- Daniel

2 1

IMAP Limitations with Outlook 2013?
by Robert Adkins 19 Nov '18

19 Nov '18

Good Day! I have a fairly new user on my network that has, over about 10 months, created in root inbox and nested sub-folders totaling over 900 individual folders. In the past few weeks, newly created folders will be visible in Outlook 2013, but when an email is moved into that folder, it is no longer visible. I can ssh into the server, drill down to that sub-folder and see the email in the folder AND it is also available to be seen without issue in Thunderbird. I know this is a longshot, but if there is some feature that I haven't found in Dovecot to force Outlook to synchronize with all the folders/sub-folders, please let me know. Beyond that. With this particular users habits, over the next 5 years, there could be nearly 10,000 folders/sub-folders. Does anyone know if this will create any problems with Dovecot or is this JUST a Microsoft software problem? -- Best Regards, Robert Adkins IT Manager/Tool Designer Impel Industries, Inc. 586-254-5800

3 2

"Group doesn't exist: dovecot"
by James Brown 19 Nov '18

19 Nov '18

No matter what I do, I always get this error when trying to start Dovecot: $ sudo /usr/local/opt/dovecot/sbin/dovecot Warning: fd limit (ulimit -n) is lower than required under max. load (256 < 1000), because of default_client_limit Fatal: service(stats) Group doesn't exist: dovecot (See service stats { unix_listener /usr/local/var/run/dovecot/stats-writer { group } } setting) The user and group it should be using are _dovecot. Config: $ sudo /usr/local/opt/dovecot/sbin/dovecot -n # 2.3.2.1 (0719df592): /usr/local/etc/dovecot/dovecot.conf # OS: Darwin 18.2.0 x86_64 apfs # Hostname: mailbordocomau-dr.local doveconf: Error: t_readlink(/usr/local/var/run/dovecot/dovecot.conf) failed: readlink() failed: No such file or directory default_internal_user = _dovenull default_login_user = _dovecot first_valid_gid = 0 first_valid_uid = 102 last_valid_gid = 500 last_valid_uid = 105 mail_gid = 102 mail_location = maildir:/usr/local/virtual/%d/%u mail_uid = 102 namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = _postfix mode = 0660 user = _postfix } unix_listener auth-userdb { mode = 0660 user = _vmail } } ssl_cert = </usr/local/etc/dovecot/cert.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd } userdb { driver = prefetch } userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } Not sure why it’s looking for dovecot.conf in the wrong place. Any suggestions? thanks, James.

1 0

Solr 7.5.0 managed-schema
by Daniel Miller 19 Nov '18

19 Nov '18

The attached is the Dovecot schema I am now using for Solr 7.5.0 - no "deprecated" warnings! -- Daniel

2 1

macOS Mojave: setgroups(501) failed: Too many extra groups
by Heiko W. Rupp 18 Nov '18

18 Nov '18

Hello, I have recently upgraded to macOS 10.14 (Mojave) and am running into an issue where one use can no longer log into dovecot via imap. Log shows Oct 11 08:10:27 imap(hwr)<12659><YpC/0+133+EAAAAAAAAAAAAAAAAAAAAB>: Fatal: setgroups(501) failed: Too many extra groups and indeed, the user is in 17 groups, which is more than NGROUPS_MAX (16). Another user with << 16 groups can log in fine. Unfortunately it is not (easily) doable to reduce the number of groups, as macOS seems to set them internally. Is there a config option that I am missing to work around this? Looking at the source, I see this is handled in src/lib/restrict-access.c::fix_groups_list(), where above the call to setgroups() a gid_list2 is constructed. I wonder if one could have a config option to prevent adding all those extra groups, which then make the call to setgroups() fail Any help appreciated Heiko -- hwr(a)pilhuhn.de m:0179/207 4919 b:http://pilhuhn.blogspot.com

4 6

Re: Issue sharing folders with Thunderbird
by Jason Perry 17 Nov '18

17 Nov '18

Hi Aki I see what you are saying, and no I don’t believe so. I’m using typical /etc/passwd for the user db. I reviewed https://wiki.dovecot.org/UserDatabase/ExtraFields <https://wiki.dovecot.org/UserDatabase/ExtraFields> but I’m not clear on how to actually return system_user userdb attribute. I also have set mail_user_groups = sharedusers in dovecot.conf and then in /etc/group put all the users with mailboxes into the sharedusers group. I can see why that wouldn’t work if the above is not set. Can you point me in the right direction on how to pass that information? Thanks! > On Aug 28, 2018, at 12:40 AM, Aki Tuomi <aki.tuomi(a)dovecot.fi> wrote: > > Are you returning system_user userdb attribute? Extra groups from /etc/group are not applied without this. > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Jason Perry <jason.perry(a)dtainc.us> > Date: 28/08/2018 04:27 (GMT+02:00) > To: Aki Tuomi <aki.tuomi(a)dovecot.fi> > Cc: dovecot(a)dovecot.org > Subject: Re: Issue sharing folders with Thunderbird > > Hi Aki, they are. > >> 3. The permissions for the file are: >> root@dal-notify-01 Maildir]# ls -la /var/lib/dovecot/db/shared-mailboxes.db >> -rw-rw-r--. 1 operations sharedusers 197 Aug 26 20:33 /var/lib/dovecot/db/shared-mailboxes.db >> 4. Users I'm testing with are part of the sharedusers group in /etc/group > > The dir /var/lib/dovecot/db has this for permissions: > drwsrwsrwx. 2 root sharedusers 33 Aug 27 21:12 db > > the user operations is a member of “sharedusers” in /etc/group. I even chmod’ed the permissions after to rw for global and I get the same error/result. > > The file does appear to get written to. For example, lets say user u2.name creates a folder called “starbucks” and uses the IMAP commands to share it out to user operations. It seems to write to the acl_shared_dict file in /var/lib/dovecot/db/shared-mailboxes.db with an entry like >> shared/shared-boxes/user/u2.name/operations >> 1 > > And it writes to the ~/Maildir/.starbucks/dovecot-acl file for u2.user with an entry like: > user=operations lrw > > So it appears to be working. However, if I log into Thunderbird with the user operations account and go to subscribe, I do not see “starbucks” in the list of available folders. And I still get the nfs_flush_chown error. > > Is there anything else I can be doing with the file/dir permissions? > > Thanks. > > >> On Aug 27, 2018, at 10:50 AM, Aki Tuomi <aki.tuomi(a)dovecot.fi <mailto:aki.tuomi@dovecot.fi>> wrote: >> >> acl_shared_dict file & folder must be readwritable by user performing the sharing as stated in wiki. >> >> https://wiki.dovecot.org/SharedMailboxes/Shared <https://wiki.dovecot.org/SharedMailboxes/Shared> >> --- >> Aki Tuomi >> Dovecot oy >> >> -------- Original message -------- >> From: Jason Perry <jason.perry(a)dtainc.us <mailto:jason.perry@dtainc.us>> >> Date: 27/08/2018 17:01 (GMT+02:00) >> To: dovecot(a)dovecot.org <mailto:dovecot@dovecot.org> >> Subject: Issue sharing folders with Thunderbird >> >> Trying to share folder "JasonAlerts" within mailbox operations to user u1.name >> >> Issues: >> 1. Shared mailboxes do not appear under subscriptions in Thunderbird for another user >> 2. When I try to set permissions via IMAP commands I get in /var/log/dovecot.log >> Aug 26 20:33:24 imap(operations): Error: nfs_flush_chown_uid: chown(/var/lib/dovecot/db) failed: Permission denied >> 3. The permissions for the file are: >> root@dal-notify-01 Maildir]# ls -la /var/lib/dovecot/db/shared-mailboxes.db >> -rw-rw-r--. 1 operations sharedusers 197 Aug 26 20:33 /var/lib/dovecot/db/shared-mailboxes.db >> 4. Users I'm testing with are part of the sharedusers group in /etc/group >> 5. IMAP commands DO write to the file: >> [root@dal-notify-01 Maildir]# cat /var/lib/dovecot/db/shared-mailboxes.db >> shared/shared-boxes/user/u1.name/u2.name >> 1 >> shared/shared-boxes/user/operations/u2.name >> 1 >> shared/shared-boxes/user/u1.name/operations >> 1 >> shared/shared-boxes/user/u1.name/operations >> 1 >> 6. It will also write to the user's /home/operations/Maildir/.JasonAlert/dovecot-acl file >> user=u1.name ilrw >> >> However if I got into Thunderbird and try to subscribe, none of the shared folders are listed. Can anyone help?? Thanks!! >> >> Dovecot version = 2.2.10 >> >> dovecot -n >> [root@server]# dovecot -n >> # 2.2.10: /etc/dovecot/dovecot.conf >> # OS: Linux 3.10.0-693.17.1.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) >> first_valid_uid = 100 >> listen = * >> log_path = /var/log/dovecot.log >> mail_debug = yes >> mail_location = maildir:~/Maildir >> mail_plugins = acl >> mail_privileged_group = mail >> mbox_write_locks = fcntl >> namespace Private { >> hidden = no >> inbox = no >> list = no >> location = >> prefix = Private/ >> separator = / >> type = private >> } >> namespace Public { >> hidden = no >> inbox = no >> list = no >> location = maildir:/var/mail/public >> prefix = Public/ >> separator = / >> subscriptions = yes >> type = public >> } >> namespace Shared { >> hidden = no >> inbox = no >> list = yes >> location = maildir:/var/mail/%u:INDEXPVT=~/Maildir/%u >> prefix = shared/%u/ >> separator = / >> subscriptions = yes >> type = shared >> } >> namespace inbox { >> inbox = yes >> location = >> mailbox Drafts { >> special_use = \Drafts >> } >> mailbox Junk { >> special_use = \Junk >> } >> mailbox Sent { >> special_use = \Sent >> } >> mailbox "Sent Messages" { >> special_use = \Sent >> } >> mailbox Trash { >> special_use = \Trash >> } >> prefix = >> separator = / >> } >> passdb { >> driver = pam >> } >> passdb { >> driver = pam >> } >> plugin { >> acl = vfile >> acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db <file:///var/lib/dovecot/db/shared-mailboxes.db> >> } >> protocols = imap >> ssl_cert = </etc/pki/dovecot/certs/dovecot.pem >> ssl_key = </etc/pki/dovecot/private/dovecot.pem >> syslog_facility = local2 >> userdb { >> driver = passwd >> } >> userdb { >> driver = passwd >> } >> protocol imap { >> mail_plugins = acl imap_acl >> } >

1 1

RSA+ECC certificates
by Alex Hautequest 17 Nov '18

17 Nov '18

Any way of using both a RSA and an ECC certificates, letting the client pick the one to use? Alex

2 1

Mail slowed down to a crawl...
by StarionTech (IMAP) 16 Nov '18

16 Nov '18

Been moving along just fine for a couple years now, then in the last two days, email has slowed to a crawl. Retrieving email via IMAP is very slow, progress bar in the mail client shows that it is downloading messages almost constantly, like it never closes the connection, or it’s getting the messages very slowly. The server that dovecot/postfix is on has also bogged down to a crawl. The postfix queue is sitting with hundreds of queued up good customer email. It’s almost acting like dovecot is not getting the messages from postfix, or they’re being delayed for some reason. How to approach fixing this? Jeff J.

4 4

huge increase in storage activity afther dovecot upgrade
by Adrian M 16 Nov '18

16 Nov '18

Hi, we upgraded our servers from version 2.2.13 to 2.2.27. After the upgrade we notice a 10x increase in traffic with the nfs storage an errors like this in the logfile: Nov 12 09:48:16 mail dovecot: imap(...): Error: Corrupted index cache file /.../dovecot.index.cache: invalid record size Nov 12 09:48:16 mail dovecot: imap(...): Error: unlink(/.../dovecot.index.cache) failed: No such file or directory (in mail-cache.c:29) Nov 12 09:48:16 mail dovecot: imap(...): Error: Corrupted index cache file /.../dovecot.index.cache: invalid record size Nov 12 09:48:16 mail dovecot: imap(...): Error: Broken file /.../dovecot-uidlist line 8: Invalid data: Is this normal ? Will the activity wind down ? Can we do something, like deleting the old dovecot.index* or dovecot-uidlist files from maildirs, or doing an doveadm force-refresh for all inboxes ? Thank you ! Here's my configuration: # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-8-amd64 x86_64 Debian 9.6 nfs auth_failure_delay = 15 secs auth_mechanisms = plain login auth_verbose = yes auth_worker_max_count = 256 default_client_limit = 40000 default_process_limit = 512 dict { lastlogin = mysql:/etc/dovecot/mysql/dovecot-dict-lastlogin.conf quotadict = mysql:/etc/dovecot/mysql/dovecot-dict-quota.conf } disable_plaintext_auth = no first_valid_uid = 100 log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l pid=%p %c mail_fsync = always mail_location = maildir:*/home/virtual/*%d/%u mail_max_userip_connections = 16 mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = zlib quota mail_log notify mail_privileged_group = mail mailbox_list_index = yes maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox virtual/All { special_use = \All } prefix = } passdb { args = /etc/dovecot/mysql/dovecot-sql.conf driver = sql } plugin { last_login_dict = proxy::lastlogin last_login_key = last-login/%u mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:user::proxy::quotadict quota_rule2 = Trash:ignore quota_rule3 = Spam:ignore quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 The email account that you tried to reach is over quota quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve stats_refresh = 30 secs stats_track_cmds = yes trash = /etc/dovecot/dovecot-trash.conf zlib_save = gz zlib_save_level = 6 } protocols = imap sieve pop3 lmtp service anvil { client_limit = 20000 unix_listener anvil-auth-penalty { mode = 00 } } service auth { client_limit = 20000 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = mail mode = 0660 user = vmail } user = root vsz_limit = 1 G } service dict { unix_listener dict { mode = 0660 user = vmail } } service imap-login { client_limit = 4096 executable = /usr/lib/dovecot/imap-login inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } process_limit = 4096 process_min_avail = 24 service_count = 100 } service imap { executable = /usr/lib/dovecot/imap process_limit = 4096 process_min_avail = 24 vsz_limit = 1 G } service lmtp { process_min_avail = 24 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } vsz_limit = 1 G } service managesieve-login { client_limit = 4096 inet_listener sieve { port = 4190 } process_limit = 4096 process_min_avail = 24 service_count = 1 } service managesieve { process_limit = 4096 vsz_limit = 1 G } service pop3-login { client_limit = 4096 executable = /usr/lib/dovecot/pop3-login inet_listener pop3 { address = * port = 0 } inet_listener pop3s { address = * port = 995 } process_limit = 4096 process_min_avail = 24 service_count = 100 } service pop3 { executable = /usr/lib/dovecot/pop3 process_limit = 4096 process_min_avail = 24 vsz_limit = 1 G } service quota-status { client_limit = 4096 executable = /usr/lib/dovecot/quota-status -p postfix process_min_avail = 24 unix_listener /var/spool/postfix/private/quota-status { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { mode = 0660 user = vmail } user = vmail } userdb { args = /etc/dovecot/mysql/dovecot-sql.conf driver = sql } protocol imap { imap_idle_notify_interval = 4 mins imap_max_line_length = 64 k mail_max_userip_connections = 16 mail_plugins = zlib quota mail_log notify trash imap_quota } protocol pop3 { mail_max_userip_connections = 16 mail_plugins = zlib quota mail_log notify pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_no_flag_updates = yes pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = zlib quota mail_log notify sieve sendmail_path = /usr/lib/sendmail syslog_facility = mail } protocol sieve { mail_max_userip_connections = 16 managesieve_max_compile_errors = 5 } protocol lmtp { mail_plugins = zlib quota mail_log notify sieve syslog_facility = mail }

4 8

failed: Invalid cross-device link
by KES 15 Nov '18

15 Nov '18

Hi. I mount ~/Maildir/new via s3fs s3fs mybucket /home/kes/Maildir/new -f -o use_cache=/tmp/S3 -o noatime -o endpoint=eu-west-1 -o profile=mail -o allow_other -o uid=1000,gid=1000 I configure dovecot: maildir_copy_with_hardlinks = no Nov 15 19:30:48 work dovecot: imap(kes): Error: rename(/home/kes/Maildir/new/ddd3, /home/kes/Maildir/cur/ddd3:2,) failed: Invalid cross-device link Tell me please, why I still get this error and how to fix it?

2 1

dovecot 2.2/openssl 1.0 vs dovecot 2.3/openssl 1.1.1 ssl regression
by Arkadiusz Miśkiewicz 15 Nov '18

15 Nov '18

Hi. I'm considering dovecot migration from 2.2.36 run with openssl 1.0.2o to dovecot 2.3.3 run with openssl 1.1.1. Currently I have both variants running with identical configs and certs (the only differences are due to config syntax changes in dovecot 2.3), so for example on both I have: ssl_ca = </etc/openssl/certs/wildcard_ca.pem (this file contains single intermediate certificate of my CA) ssl_cert = </etc/openssl/certs/wildcard_crt.pem (this contains single cerificate for my *.example.com domain) ssl_key = # hidden, use -P to show it (and one key) No alt certs in use. Chain is: - CA trusted by clients (this certificate isn't provided by my dovecot, it's not needed) - wildcard_ca.pem - intermediate CA - wildcard_crt.pem - wildcard certificate for my *.example.com domain dovecot 2.2.36 behaviour is to provide wildcard_ca.pem and wildcard_crt.pem to the client - that behaviour is OK. Client has full trust chain. dovecot 2.3.3 provides only wildcard_crt.pem certificate to the client which is a big problem because missing wildcard_ca.pem (intermediate certificate) breaks chain and client is not able to verify trust chain. Testing is done with simple: openssl s_client -connect my.example.com:143 -starttls imap -servername my.example.com -showcerts 2.3.x announcements and upgrade wiki mention no such behaviour change, so I assume it is a regression. Now doing cat wildcard_ca.pem >> wildcard_crt.pem solves the problem and dovecot starts providing both certs to clients but if that's the proper way of solving this issue then what's the point of having ssl_ca config setting? Ideas? -- Arkadiusz Miśkiewicz, arekm / ( maven.pl | pld-linux.org )

3 3

FETCH BODY vs FETCH BODYSTRUCTURE + FETCH BODY.PEEK
by Alessio Cecchi 15 Nov '18

15 Nov '18

Hello, we are developing a web page, for a ticket system, to show the email messages ordered by the biggest attachments size present in an IMAP folder, with a pagination of 100 messages per page. Each raw represents a message with "DATE, FROM, SUBJECT, the preview (the first 500 chars of the text/html of the messsage) and the list of the attachments (name + size) it contains. The problem is that the page load is VERY slow because we fetch the entire BODY of all 100 messages, in order to get the preview and the attachments name and size. Now, considering that each messages can contain up to 50 MB of attachments, we risk to download 5000MB from IMAP for every page. An option might be to perform two FETCH for each message: - one fetch with just the BODYSTRUCTURE (where we can get the attachments name and size and the text/html parts). - one fetch with the body parts (BODY.PEEK[]) we need to build the preview (text + html). We are wondering if there is a single FETCH command to get the text and html parts (needed to build the preview) with only the name and the size of the attachments without downloading the entire message. Thanks. -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice

2 1

Dovecot proxy: per user/domain 'namespace/inbox/prefix' from MySQL
by Adi Pircalabu 15 Nov '18

15 Nov '18

As a way to try and avoid using "prefix = INBOX." ad infinitum for the inbox namespace, I'm looking for ways to move on to "prefix =" for new mail accounts, and grandfather the existing ones. Previously running Courier-IMAP, now Dovecot, I looked at https://wiki.dovecot.org/Namespaces#Backwards_Compatibility:_Courier_IMAP and decided it's too risky to go down that path and use namespace compat, with so many IMAP clients out there the scope of testing is huge and the outcome is uncertain and not worth it. After reading https://wiki.dovecot.org/Namespaces#Per-user_Namespace_Location_From_SQL I thought I might be able to overwrite the server configuration per user returning 'namespace/inbox/prefix' value from SQL. Here's the setup I attempted, briefly: 1. Client connects to the Dovecot proxy, which authenticates the user and proxies to the backend using a query like this in /etc/dovecot/conf.d/dovecot-sql.conf.ext: driver = mysql connect = <connection_string> password_query = SELECT NULL AS password, 'Y' as nopassword, host, 'any-cert' as 'starttls', 'Y' AS proxy FROM mailbox WHERE email = '%u' AND disabled_smtpauth=0 Works a treat. 2. Next, I'm trying to add the prefix lookup in the picture. In the same file I've added: user_query = SELECT ns_inbox_prefix AS 'namespace/inbox/prefix' FROM mailbox WHERE email = '%u' AND disabled_smtpauth=0 3. The mailbox table schema reads: CREATE TABLE `mailbox` ( `id` int(11) unsigned NOT NULL AUTO_INCREMENT, `email` varchar(255) NOT NULL DEFAULT '', `password` varchar(255) NOT NULL DEFAULT '', `clear_password` varchar(255) NOT NULL DEFAULT '', `name` varchar(255) NOT NULL DEFAULT '', `host` varchar(32) DEFAULT NULL, `port` varchar(32) DEFAULT NULL, `ns_inbox_prefix` varchar(255) NOT NULL DEFAULT '', `lastlog_remote_ips` bigint(20) unsigned NOT NULL DEFAULT 0, `curlog_remote_ips` bigint(20) unsigned NOT NULL DEFAULT 0, `disabled_smtpauth` tinyint(1) NOT NULL DEFAULT 0, `last_modified` timestamp NOT NULL DEFAULT current_timestamp() ON UPDATE current_timestamp(), PRIMARY KEY (`id`), UNIQUE KEY `email` (`email`) ) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=latin1; The 2 queries above return: MariaDB [postfix]> SELECT NULL AS password, 'Y' as nopassword, host, 'any-cert' as 'starttls', 'Y' AS proxy FROM mailbox WHERE email = 'adi2(a)0aditest.local' AND disabled_smtpauth=0; +----------+------------+----------------+----------+-------+ | password | nopassword | host | starttls | proxy | +----------+------------+----------------+----------+-------+ | NULL | Y | 192.168.123.24 | any-cert | Y | +----------+------------+----------------+----------+-------+ 1 row in set (0.00 sec) MariaDB [postfix]> SELECT ns_inbox_prefix AS 'namespace/inbox/prefix' FROM mailbox WHERE email = 'adi2(a)0aditest.local' AND disabled_smtpauth=0; +------------------------+ | namespace/inbox/prefix | +------------------------+ | | +------------------------+ 1 row in set (0.00 sec) After reloading dovecot service with auth_debug = yes are the maillog for an IMAP session: Nov 15 12:43:48 proxy1 dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Nov 15 12:43:48 proxy1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/lib20_auth_var_expand_crypt.so Nov 15 12:43:48 proxy1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Nov 15 12:43:48 proxy1 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Nov 15 12:43:48 proxy1 dovecot: auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat Nov 15 12:43:48 proxy1 dovecot: auth: Debug: auth client connected (pid=7527) Nov 15 12:43:53 proxy1 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=AorrLqp6drgAAAAAAAAAAAAAAAAAAAAB#011lip=::1#011rip=::1#011lport=1143#011rport=47222#011resp=<hidden> Nov 15 12:43:53 proxy1 dovecot: auth: Debug: sql(adi2@0aditest.local,::1,<AorrLqp6drgAAAAAAAAAAAAAAAAAAAAB>): cache miss Nov 15 12:43:53 proxy1 dovecot: auth-worker(7533): Debug: Loading modules from directory: /usr/lib64/dovecot/auth Nov 15 12:43:53 proxy1 dovecot: auth-worker(7533): Debug: Module loaded: /usr/lib64/dovecot/auth/lib20_auth_var_expand_crypt.so Nov 15 12:43:53 proxy1 dovecot: auth-worker(7533): Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Nov 15 12:43:53 proxy1 dovecot: auth-worker(7533): Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Nov 15 12:43:53 proxy1 dovecot: auth-worker(7533): Debug: sql(adi2@0aditest.local,::1,<AorrLqp6drgAAAAAAAAAAAAAAAAAAAAB>): query: SELECT NULL AS password, 'Y' as nopassword, host, 'any-cert' as 'starttls', 'Y' AS proxy FROM mailbox WHERE email = 'adi2(a)0aditest.local' AND disabled_smtpauth=0 Nov 15 12:43:53 proxy1 dovecot: auth: Debug: client passdb out: OK#0111#011user=adi2@0aditest.local#011host=192.168.123.24#011starttls=any-cert#011proxy#011pass=<hidden> Nov 15 12:43:53 proxy1 dovecot: imap-login: Invalid certificate: [...] Nov 15 12:43:53 proxy1 dovecot: imap-login: Invalid certificate: [...] Nov 15 12:43:53 proxy1 dovecot: imap-login: Invalid certificate: [...] Nov 15 12:43:53 proxy1 dovecot: imap-login: Invalid certificate: [...] Nov 15 12:43:53 proxy1 dovecot: imap-login: Invalid certificate: [...] Nov 15 12:43:53 proxy1 dovecot: imap-login: proxy(adi2(a)0aditest.local): started proxying to 192.168.123.24:143: user=<adi2(a)0aditest.local>, method=PLAIN, rip=::1, lip=::1, secured, session=<AorrLqp6drgAAAAAAAAAAAAAAAAAAAAB> Looks like user_query isn't executed, why? And here's the corresponding IMAP session: Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot ready. . LOGIN adi2(a)0aditest.local <hidden> . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE NOTIFY SPECIAL-USE QUOTA] Logged in . NAMESPACE * NAMESPACE (("INBOX." ".")) NIL NIL . OK Namespace completed (0.000 + 0.000 secs). . LIST "" * * LIST (\HasChildren) "." INBOX * LIST (\HasNoChildren \Trash) "." INBOX.Trash * LIST (\HasNoChildren) "." INBOX.Templates * LIST (\HasNoChildren \Sent) "." INBOX.Sent * LIST (\HasNoChildren \Drafts) "." INBOX.Drafts * LIST (\HasNoChildren \Archive) "." INBOX.Archives * LIST (\HasNoChildren \UnMarked \Junk) "." INBOX.Spam . OK List completed (0.000 + 0.000 secs). . LSUB "" * * LSUB (\Archive) "." INBOX.Archives * LSUB (\Drafts) "." INBOX.Drafts * LSUB (\Sent) "." INBOX.Sent * LSUB (\Junk) "." INBOX.Spam * LSUB () "." INBOX.Templates * LSUB (\Trash) "." INBOX.Trash . OK Lsub completed (0.000 + 0.000 secs). . LOGOUT * BYE Logging out . OK Logout completed (0.000 + 0.000 secs). Connection closed by foreign host. How do I overwrite 'namespace/inbox/prefix' for an user on the Dovecot proxy? Is user_query working in this context? -- Adi Pircalabu

1 1