- dovecot - dovecot.org

Master-Master replication question
by Remko Lodder 29 Jul '16

29 Jul '16

Dear list, I have setup a master-master replication setup. My primairy MX's send email over on a DNS loadbalanced way, so DNS is doing some kind of round-robin way of sending mail to both master servers. I found out, that on one of the two machines, the email synchronisation is heavily delayed. Lets assume server A receives a mail from the MX; it synchronises almost instantly with the other server. Whenever server B receives the email, it could take up to several hours to synchronise the email, it seems that it is not detected prior. It is also interesting to see, that the mailboxes on server A (Where users login to retrieve their email via webmail/clients) are significantly smaller then the mailboxes on server B. When investigating, it seems that "older" mailboxes (or storage rather since we use mdbox) are still there on server B, which already had been removed on server A. My personal mailbox was 170MB on server A, while it was still 2.5GB on server B. (which was around that size before cleaning up the mailsboxes). I enabled debugging on the servers, and I see rather quick : "Replication requests" on server A, but when getting an email on server B, I do not see the request at all. My servers are both running the same version, same configuration (utilizing puppet), both running on ZFS and FreeBSD. Where server B is more loaded in it's memory because of some bhyve VM's and the server A does not run any VM. Does someone have any pointers on where to look? Thanks in advance ;-) Remko Included below the configurations from server A and B: Server A: # 2.2.25 (7be1766): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.14 (099a97c) # OS: FreeBSD 10.3-RELEASE-p2 amd64 auth_mechanisms = plain login disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it haproxy_trusted_networks = YYYY lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lmtp_save_to_detail_mailbox = yes mail_debug = yes mail_fsync = always mail_location = mdbox:~/mdbox mail_plugins = " quota notify replication" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . } passdb { driver = pam } plugin { antispam_backend = mailtrain antispam_mail_notspam = --ham antispam_mail_sendmail = /usr/local/bin/sa-learn.sh antispam_mail_spam = --spam antispam_spam_pattern_ignorecase = spam;junk antispam_trash_pattern_ignorecase = trash;deleted items;deleted messages antispam_verbose_debug = 1 mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcps:the other server:12346 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /usr/local/etc/dovecot/sieve/global/ sieve_global_path = /usr/local/etc/dovecot/sieve/default.sieve } postmaster_address = postmaster@xxx protocols = imap pop3 lmtp sieve replication_dsync_parameters = -d -N -l 60 -U replication_max_conns = 100 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service doveadm { inet_listener { port = 12346 ssl = yes } } service imap-login { inet_listener imap_haproxy { haproxy = yes port = 10143 } inet_listener imaps_haproxy { haproxy = yes port = 10144 ssl = yes } service_count = 1 } service imap { process_limit = 1024 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3 { process_limit = 1024 } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl_ca = </usr/local/etc/letsencrypt/live/XXX ssl_cert = </usr/local/etc/letsencrypt/live/XXX ssl_client_ca_file = /usr/local/certificates/letsencrypt-ca.pem ssl_key = </usr/local/etc/letsencrypt/live/XXX ssl_protocols = !SSLv2 !SSLv3 userdb { driver = passwd } verbose_proctitle = yes protocol lmtp { auth_username_format = %n mail_plugins = quota sieve postmaster_address = postmaster@xxxx } protocol lda { mail_plugins = " quota notify replication sieve" } protocol imap { mail_max_userip_connections = 50 mail_plugins = " quota notify replication imap_quota antispam" } Server B: # 2.2.25 (7be1766): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.14 (099a97c) # OS: FreeBSD 10.3-RELEASE amd64 auth_mechanisms = plain login disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it haproxy_trusted_networks = YYYY lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lmtp_save_to_detail_mailbox = yes mail_debug = yes mail_fsync = always mail_location = mdbox:~/mdbox mail_plugins = " quota notify replication" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . } passdb { driver = pam } plugin { antispam_backend = mailtrain antispam_mail_notspam = --ham antispam_mail_sendmail = /usr/local/bin/sa-learn.sh antispam_mail_spam = --spam antispam_spam_pattern_ignorecase = spam;junk antispam_trash_pattern_ignorecase = trash;deleted items;deleted messages antispam_verbose_debug = 1 mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcps:the other host:12346 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /usr/local/etc/dovecot/sieve/global/ sieve_global_path = /usr/local/etc/dovecot/sieve/default.sieve } postmaster_address = postmaster@xxx protocols = imap pop3 lmtp sieve replication_dsync_parameters = -d -N -l 60 -U replication_max_conns = 100 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service doveadm { inet_listener { port = 12346 ssl = yes } } service imap-login { inet_listener imap_haproxy { haproxy = yes port = 10143 } inet_listener imaps_haproxy { haproxy = yes port = 10144 ssl = yes } service_count = 1 } service imap { process_limit = 1024 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3 { process_limit = 1024 } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl_ca = </usr/local/etc/letsencrypt/live/xxx ssl_cert = </usr/local/etc/letsencrypt/live/xxx ssl_client_ca_file = /usr/local/certificates/letsencrypt-ca.pem ssl_key = </usr/local/etc/letsencrypt/live/xxx ssl_protocols = !SSLv2 !SSLv3 userdb { driver = passwd } verbose_proctitle = yes protocol lmtp { auth_username_format = %n mail_plugins = quota sieve postmaster_address = postmaster@XXXXX } protocol lda { mail_plugins = " quota notify replication sieve" } protocol imap { mail_max_userip_connections = 50 mail_plugins = " quota notify replication imap_quota antispam" }

4 12

Re: Client app says my chained Comodo cert is invalid
by Joseph Tam 28 Jul '16

28 Jul '16

> The trouble appears when I attempt to configure a client account in > Mail.app on my Mac. For the POP server name, I enter my VPS? > ?45.56.81.181", because public DNS is still pointing to my existing > host. I set the account to use the Apple TLS certificate, and then > click to save this new account info. Before saving, Mail.app checks my > entries by attempting to log in. The result is: ?The identify of > server 45.56.81.181 cannot be verified. The certificate for this > server is invalid.? Well, yes, that's what you would expect. You've told your mail client to connect to "45.56.81.181", the client starts the SSL negotiation and finds the certificate is made out for "sheepsystems.com", and your mail client complains about the mismatch (a possible MITM attack). This is what you want SSL enabled system to do. Since 45.56.81.181 does not map to "sheepsystems.com" yet, you can short-circuit DNS and add a direct mapping to your Mac by adding this to /etc/hosts: 45.56.81.181 sheepsystems.com then reconfiguring your mail client to use the server "sheepsystems.com". This will appease the SSL constraint. > appear in /var/log/mail.log [2]. Don't know what this is about -- probably your Mac bailing out on authentication. Joseph Tam <jtam.home(a)gmail.com>

3 2

Client app says my chained Comodo cert is invalid
by Jerry Krinock 27 Jul '16

27 Jul '16

I’ve configured Dovecot and Postfix on a new VPS running Ubuntu 16.04, using Linode’s tutorial [1], to require authentication and SSL encryption for both POP3 and SMTP. All looks OK to me except, when my email client app (macOS Mail.app) tries to log in, it says that my cert is invalid. The trouble appears when I attempt to configure a client account in Mail.app on my Mac. For the POP server name, I enter my VPS’ “45.56.81.181", because public DNS is still pointing to my existing host. I set the account to use the Apple TLS certificate, and then click to save this new account info. Before saving, Mail.app checks my entries by attempting to log in. The result is: “The identify of server 45.56.81.181 cannot be verified. The certificate for this server is invalid.” At the same time, on my new server, some entries appear in /var/log/mail.log [2]. The certificate in question is a new PositiveSSL/Comodo cert I bought the other day. It works OK for serving web pages - I mean, on this same Mac, when I visit my under-construction site at https://45.56.81.181 in Safari or Firefox, I get the padlock icon and no warnings. Comodo gave me two two files, a “.crt” which contains my cert, and a “.ca-bundle.crt” which contains their certs. Per Dovecot documentation, I concatenated these into a “chained” file containing all 3 certs, starting with mine. In /etc/dovecot/conf.d/10-ssl.conf, I set ssl_cert = this “chained” file. I tried adding the two original cert files to macOS Keychain.app with “Always trust” but that did not help. Being new at this, I would appreciate any suggestions. My `dovecot -n` output is below [3]. Thank you very much! Jerry Krinock [1] https://www.linode.com/docs/email/postfix/email-with-postfix-dovecot-and-my… ************************************************** [2] /var/log/mail.log entries when client attempts login Jul 27 12:22:19 bird dovecot: pop3-login: Debug: SSL: where=0x10, ret=1: before/accept initialization [24.4.251.228] Jul 27 12:22:19 bird dovecot: pop3-login: Debug: SSL: where=0x2001, ret=1: before/accept initialization [24.4.251.228] Jul 27 12:22:19 bird dovecot: pop3-login: Debug: SSL: where=0x2001, ret=1: unknown state [24.4.251.228] Jul 27 12:22:19 bird dovecot: message repeated 6 times: [ pop3-login: Debug: SSL: where=0x2001, ret=1: unknown state [24.4.251.228]] Jul 27 12:22:19 bird dovecot: pop3-login: Debug: SSL: where=0x2002, ret=-1: unknown state [24.4.251.228] Jul 27 12:22:19 bird dovecot: pop3-login: Debug: SSL: where=0x2002, ret=-1: unknown state [24.4.251.228] Jul 27 12:22:19 bird dovecot: pop3-login: Warning: SSL failed: where=0x2002: unknown state [24.4.251.228] Jul 27 12:22:19 bird dovecot: pop3-login: Debug: SSL error: Disconnected Jul 27 12:22:19 bird dovecot: pop3-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=24.4.251.228, lip=45.56.81.181, TLS handshaking: Disconnected, session=<8HuX76I4p8gYBPvk> Yes, 24.4.251.228 is the IP address of my Mac. ************************************************** [3] Output from `dovecot -n` # 2.2.22 (fe789d2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 4.5.5-x86_64-linode69 x86_64 Ubuntu 16.04 LTS ext4 auth_mechanisms = plain login mail_location = maildir:/var/mail/vhosts/%d/%n mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = imap pop3 lmtp service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 } } ssl = required ssl_cert = </etc/ssl/localcerts/sheepsystems_com_chained.crt ssl_key = </etc/ssl/localcerts/linode.sheepsystems.com.key userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n driver = static } verbose_ssl = yes

1 0

Sieve vacation address problem
by Harald Leithner 27 Jul '16

27 Jul '16

Hi, it seams I have a problem with the vacation script. The problem is that the vacation answers to a address that is not listed in the sieve script. I checked the postfix master.conf which delivers to lda correct parameter. In the logfile you can see that that office(a)example.com received a message that get delivered to user(a)example.com (with the sievescipt) and to office(a)example.com (another user without script). The sieve script has the :addresses parameter only set to user(a)example.com Is something wrong with my setup? We use roundcube + sievemanage to create sieve scripts. Sievescript: ## Generated by Roundcube Webmail SieveRules Plugin ## require ["date","relational","vacation"]; # rule:[Urlaub] if allof (currentdate :zone "+0200" :value "gt" "date" "2016-07-22", currentdate :zone "+0200" :value "lt" "date" "2016-08-08") { vacation :days 1 :addresses ["user(a)example.com"] :subject "Abwesenheitsnotiz" text: Thx i'm not here . ; } -------------- postfix master.conf dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/dovecot-lda -f ${sender} -a ${original_recipient} -d ${user}@${nexthop} -e -------------- Logfile: Postfix: 2016-07-27T11:44:30+02:00 mailstore1 postfix/smtpd[5037]: connect from unknown[172.20.20.229]:15677 2016-07-27T11:44:30+02:00 mailstore1 postfix/smtpd[5037]: 3rzqp64klWzF: client=unknown[172.20.20.229]:15677 2016-07-27T11:44:30+02:00 mailstore1 postfix/cleanup[5040]: 3rzqp64klWzF: message-id=<019301d1e7eb$76b26a70$64173f50$(a)example.org> 2016-07-27T11:44:30+02:00 mailstore1 postfix/qmgr[704]: 3rzqp64klWzF: from=<user(a)example.org>, size=7337, nrcpt=2 (queue active) 2016-07-27T11:44:30+02:00 mailstore1 postfix/smtpd[5037]: disconnect from unknown[172.20.20.229]:15677 2016-07-27T11:44:30+02:00 mailstore1 postfix/pipe[5157]: 3rzqp64klWzF: to=<office(a)example.com>, relay=dovecot, delay=0.12, delays=0.02/0.03/0/0.06, dsn=2.0.0, status=sent (delivered via dovecot service) 2016-07-27T11:44:30+02:00 mailstore1 postfix/pipe[5042]: 3rzqp64klWzF: to=<user(a)example.com>, orig_to=<office(a)example.com>, relay=dovecot, delay=0.12, delays=0.02/0.03/0/0.07, dsn=2.0.0, status=sent (delivered via dovecot service) 2016-07-27T11:44:30+02:00 mailstore1 postfix/qmgr[704]: 3rzqp64klWzF: removed dovecot lda 2016-07-27T11:44:30+02:00 mailstore1 dovecot: lda(user(a)example.com): sieve: msgid=<019301d1e7eb$76b26a70$64173f50$(a)example.org>: sent vacation response to <user(a)example.org> 2016-07-27T11:44:30+02:00 mailstore1 dovecot: lda(office(a)example.com): msgid=<019301d1e7eb$76b26a70$64173f50$(a)example.org>: saved mail to INBOX 2016-07-27T11:44:30+02:00 mailstore1 dovecot: lda(user(a)example.com): sieve: msgid=<019301d1e7eb$76b26a70$64173f50$(a)example.org>: stored mail into mailbox 'INBOX' ----------- doveocot conf # 2.2.devel (d81a83b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.devel (3f51b82) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.5 auth_cache_negative_ttl = 1 secs auth_cache_size = 10 M auth_cache_ttl = 1 secs auth_mechanisms = PLAIN LOGIN DIGEST-MD5 SCRAM-SHA-1 CRAM-MD5 APOP auth_verbose = yes default_client_limit = 600 default_vsz_limit = 512 M dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlacl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_gid = 1001 first_valid_uid = 1001 hostname = mailstore1(a)itronic.at imap_hibernate_timeout = 1 mins imap_id_log = * imap_id_send = * imap_idle_notify_interval = 10 mins instance_name = mailstore1 last_valid_gid = 1001 last_valid_uid = 1001 lda_original_recipient_header = X-LDA-Original-To lmtp_rcpt_check_quota = yes login_greeting = ITronic Mail Store login_trusted_networks = 172.22.14.0/24 mail_attachment_dir = /srv/storage1/vmail_sis mail_attachment_hash = %{sha512} mail_attachment_min_size = 64 k mail_cache_min_mail_count = 5 mail_gid = vmail mail_location = mdbox:~/mdbox mail_plugins = zlib lazy_expunge stats acl quota mail_prefetch_count = 100 mail_server_admin = mailto:postmaster@itronic.at mail_server_comment = ITronic Mail System mail_shared_explicit_inbox = yes mail_uid = vmail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mdbox_preallocate_space = yes namespace { hidden = yes list = no location = mdbox:~/mdbox:MAILBOXDIR=expunged prefix = "#EXPUNGED/" subscriptions = no type = private } namespace { list = children location = mdbox:%%h/mdbox prefix = "#Users/%%u/" separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes location = mailbox Archvie { special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::sqlacl last_login_dict = proxy::lastlogin last_login_key = last-login/%u lazy_expunge = "#EXPUNGED/" lazy_expunge_only_last_instance = no quota = dict:User quota::proxy::sqlquota quota_grace = 10%% quota_rule = *:storage=1024M quota_rule2 = "#EXPUNGED:storage=+100M" quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=80%% quota-warning 80 %u recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_global = /etc/dovecot/sieve sieve_max_actions = 64 sieve_max_redirects = 8 sieve_max_script_size = 2M sieve_quota_max_scripts = 0 sieve_quota_max_storage = 64M stats_refresh = 30 secs stats_track_cmds = yes zlib_save = gz zlib_save_level = 6 } pop3_uidl_duplicates = rename protocols = imap lmtp sieve pop3 sieve service auth-worker { user = $default_internal_user } service auth { inet_listener { port = 4180 } unix_listener auth-userdb { mode = 0666 } } service dict { unix_listener dict { group = vmail mode = 0666 } } service imap-hibernate { unix_listener imap-hibernate { group = vmail mode = 0666 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { process_limit = 1024 unix_listener imap-master { user = dovecot } unix_listener imap { group = vmail mode = 0666 } vsz_limit = 512 M } service lmtp { inet_listener lmtp { address = 172.22.14.135 port = 24000 } unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 50 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_min_avail = 20 service_count = 1 vsz_limit = 64 M } service pop3 { process_limit = 1024 } service quota-warning { executable = script /opt/scripts/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } shutdown_clients = no ssl_cert = </etc/dovecot/private/STAR.itronic.at.pem ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA:AES256-SHA:DHE-RSA-CAMELLIA128-SHA:DHE-RSA-CAMELLIA256-SHA:CAMELLIA128-SHA:CAMELLIA256-SHA:ECDHE-RSA-DES-CBC3-SHA:DES-CBC3-SHA ssl_dh_parameters_length = 2048 ssl_key = </etc/dovecot/private/STAR.itronic.at.pem ssl_options = no_compression ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 submission_host = 172.22.14.198 syslog_facility = local0 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } valid_chroot_dirs = /srv/storage1/vmail verbose_proctitle = yes protocol imap { mail_max_userip_connections = 20 mail_plugins = zlib lazy_expunge stats imap_stats quota imap_quota acl imap_acl last_login } protocol lda { mail_plugins = zlib lazy_expunge stats acl sieve quota } protocol lmtp { mail_plugins = zlib lazy_expunge stats acl sieve quota } protocol sieve { mail_max_userip_connections = 10 managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = zlib lazy_expunge stats acl last_login } -- Harald Leithner ITronic Wiedner Hauptstraße 120/5.1, 1050 Wien, Austria Tel: +43-1-545 0 604 Mobil: +43-699-123 78 4 78 Mail: leithner(a)itronic.at | itronic.at

2 2

Opportunistic quota recalc
by Tom Sommer 27 Jul '16

27 Jul '16

I'm switching quota backend to redis (from maildir++), so all my current usages are reset. I get that I can do "doveadm quota recalc -A", but it takes forever (and auth processes time out/crash). It would make much more sense to recalc the usage on login if the current usage is unset. Is there no way to do a recalc-quota-on-first-login? Thanks. -- Tom Sommer

2 7

Dovecot v2.2.25 crashed on startup in Mac OSX
by Michael Chen 27 Jul '16

27 Jul '16

I built from dovecot-2.2.25.tar.gz on Mac OSX 10.11.15 (El Capitan) the usual way: CFLAGS=-I/usr/local/ssl/include LDFLAGS=-L/usr/local/ssl/lib ./configure make sudo make install sudo /usr/local/sbin/dovecot It consistently crash on startup with the following entries in /var/log/mail.log (edited backtrace): Jul 27 07:39:26 macbook-pro dovecot[70234]: master: Dovecot v2.2.25 (7be1766) starting up for imap, pop3, lmtp Jul 27 07:39:26 macbook-pro dovecot[70234]: master: Panic: kevent(EV_ADD, READ, 60) failed: Bad file descriptor Jul 27 07:39:26 macbook-pro dovecot[70234]: master: Error: Raw backtrace: 2 libdovecot.0.dylib 0x00000001000dc3fb default_fatal_finish + 43 -> 3 libdovecot.0.dylib 0x00000001000dd4e0 syslog_handler + 0 -> 4 dovecot 0x0000000100026f8d master_fatal_callback + 429 -> 5 libdovecot.0.dylib 0x00000001000dca9f i_panic + 415 -> 6 libdovecot.0.dylib 0x00000001000ff022 io_loop_handle_add + 194 -> 7 libdovecot.0.dylib 0x00000001000fb5f1 io_add_file + 385 -> 8 libdovecot.0.dylib 0x00000001000fb456 io_add + 118 -> 9 libdovecot.0.dylib 0x0000000100102b83 lib_signals_set_handler + 355 -> 10 dovecot 0x0000000100027070 main_init + 112 -> 11 dovecot 0x0000000100026628 main + 2024 -> 12 libdyld.dylib 0x00007fff889ac5ad start + 1 It looks similar to this report: http://article.gmane.org/gmane.mail.imap.dovecot/86319/match=panic+kevent HomeBrew installed 2.2.24, and it works in my Mac. Can someone confirm this is a bug? I also built 2.2.25 with debug, but can't make it break at line iolook-kqueue.c:67 i_panic("kevent(EV_ADD, READ, %d) failed: %m", io->fd); Thanks --mc . -- CONFIDENTIALITY NOTICE: This e-mail, including attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information or otherwise be protected by law. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender and destroy all copies and the original message.

2 2

Converting mailboxes to UTF-8
by Артем Перекресний 27 Jul '16

27 Jul '16

Is any proven routine to migrate mailboxes from mUTF-7 to UTF-8 encoding? I've try to use doveadm list/mutf7/rename but have been stuck with nested inboxes. Say I have the next structure: INBOX INBOX.жыр INBOX.жыр.ядъ encoded for FS respectively as .INBOX .INBOX.&BDYESwRA- .INBOX.&BDYESwRA-.&BE8ENARK- When I've try to rename INBOX.жыр with doveadm mailbox rename -u me -s "INBOX.&BDYESwRA-" $(doveadm mailbox mutf7 -7 "INBOX.&BDYESwRA-") I've get the next: .INBOX .INBOX.жыр .INBOX.жыр.&BE8ENARK- Sure when I've try to rename .INBOX.жыр.&BE8ENARK- I've get a message that this is not a valid mUTF7-encoded string. So that is the question.

2 3

imap & pop3 using same mailbox with virtual plugin
by Michael Fox 26 Jul '16

26 Jul '16

This is a noobie question, so bear with me if it's not worded correctly: Primary Requirements: 1) I'd like to have two namespaces - one private/per-user, and one public (visible by all logged-in users). The public mailbox would be used to distribute information to all users. 2) I'd like both POP3 and IMAP users to see both namespaces. As I understand it, this requires the use of the virtual plugin to create a virtual namespace which would mix together the private and public namespaces into one mailbox. I have read: http://wiki.dovecot.org/Plugins/Virtual https://sys4.de/de/blog/2013/02/11/dovecot-virtual-setup-mit-globaler-sieve- spamfilter-regel-fur-pop3-nutzer/ (via Google translation) I don't really understand the example MySQL code (too much "..." for me to follow) in the above web pages. As I understand it (and I could be very wrong), the solution relies on a MySQL query to determine which namespace should have inbox = yes -- the private namespace or the virtual namespace -- depending on if the user is an imap or pop3 user, respectively. Question 1: How would this be done on a user-by-user basis if the userdb is a passwd-file flat file? Would it be something like this? -- Userdb extra fields for IMAP User: userdb_namespace/inbox/inbox=yes -- Userdb extra fields for POP3 User: userdb_namespace/virtual/inbox=yes Question 2: If I want to allow any user to use either POP3 or IMAP, then could I do it this way? protocol imap { namespace inbox { inbox = yes } } protocol pop3 { namespace virtual { inbox = yes } } Thanks, Michael

1 0

Dovecot cannot find mailboxes
by C. Andrews Lavarre 26 Jul '16

26 Jul '16

Edgar, thank you for your help: I have solved gaining access from a client (Evolution) via IMAP to the server: I can refresh, add folders, and delete folders. But I am still confounded, as IMAP does not see any mailboxes. Neither we from the command line (telnet, openssl, login, select) nor the system can find the mailbox, despite following FindMailLocation: telnet, openssl, login, then b select inbox * 0 EXISTS * 0 RECENT and postfix fails with 2016-07-23T21:22:37.312039-04:00 lavarre postfix/error[17088]: A8DA2C1BB2: to=<andy(a)privustech.com>, orig_to=<andy>, relay But the mailboxes do exist in /var/mail/vhosts/privustech.com/andy and we point to them in /etc/dovecot/users. doveconf -n is attached. ----- Two issues are: 1. file permissions and ownership 2. virtual versus system users 1. It appears that having the correct ownership and permissions on various files is critical (of course), but those parameters must also be included in the interior of the /etc/dovecot/user. So if you change permissions you also must change that file. For example, you said: i also noticed your certificate chain is broken. http://wiki2.dovecot.org/testinstallation I worked through this link, thank you. Changing permissions for the directories /var/mail/* to root:mail ($UID:$GID = 1000:12) and then changing /etc/dovecot/users correspondingly to user(a)privustech.com :{plain}actualpassword: 1000:12 ::/var/mail/vhosts/privustech.com/user now allows a normal login. and we can create a new folder (e.g., work) and delete it. However, this is at variance with http://wiki2.dovecot.org/HowTo/SimpleVirtualInstall which says to set the ownership to vmail:vmail ($UID:$GID = 100: 5000). Doing so breaks dovecot. 2. The various links suggest that having virtual users is preferable to setting system users. The former do not require directories under /homebut they do require a directory in the mail system, which I have provided under /var/mail/vhosts. It also turns out that for virtual users you must include the domain (andy(a)privustech.com) Making that change allowed the success reported above. But despite that, we still cannot find the mailboxes on login. Any thoughts on how to have IMAP find the mailboxes (beyond FindMailLocation, which doesn't seem to work for me) would be most appreciated. Kind regards, Andy

3 2

[2.2.25 auth issue] auth-request.c: line 1049 (auth_request_lookup_credentials): assertion failed: (request->credentials_scheme == scheme)
by Alexey Asemov (Alex/AT) 26 Jul '16

26 Jul '16

Hello, Since updating to 2.2.25, we do have the following issue (seems to be related to the new auth policy code): Jul 9 00:00:14 LXmail01 dovecot: auth-worker(6558): sql(user(a)domain.org,*.*.*.*,<wjpa7SY3nNFR8yTo>): unknown user Jul 9 00:00:14 LXmail01 dovecot: auth: Panic: file auth-request.c: line 1049 (auth_request_lookup_credentials): assertion failed: (request->credentials_scheme == scheme) Jul 9 00:00:14 LXmail01 dovecot: auth: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x8d57e) [0x7f197bd8157e] -> /usr/lib64/dovecot/libdovecot.so.0(+0x8d65e) [0x7f197bd8165e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f197bd201f6] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x1a15a) [0x7f197c44715a] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x26f8f) [0x7f197c453f8f] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x19d2b) [0x7f197c446d2b] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](auth_request_lookup_credentials_callback+0x68) [0x7f197c4 46e28] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](passdb_handle_credentials+0x92) [0x7f197c457742] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x2af06) [0x7f197c457f06] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x2065a) [0x7f197c44d65a] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7f197bd94edc] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_in ternal+0xff) [0x7f197bd9633f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7f197bd94f65] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f197bd95118] -> /usr /lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f197bd26663] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](main+0x3a1) [0x7f197c43cbe1] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f197b30ab15] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0xfdd1) [0x7f197c43cdd1] Jul 9 00:00:14 LXmail01 dovecot: auth: Fatal: master: service(auth): child 6555 killed with signal 6 (core dumps disabled) Jul 9 00:00:14 LXmail01 dovecot: pop3-login: Warning: Auth connection closed with 1 pending requests (max 1 secs, pid=8133, EOF) Environment is MySQL passdb/userdb, we are using plain scheme as default and password_noscheme field. In 2.2.24 and below auth worked without scratch. Reverting all policy-related commits in 2.2.25 fixes this, but I have not dug the details. KR, Alex

3 2