- dovecot - dovecot.org

2.3.1 Replication is throwing scary errors
by Michael Grimm 03 Apr '18

03 Apr '18

Hi [This is Dovecot 2.3.1 at FreeBSD STABLE-11.1 running in two jails at distinct servers.] I did upgrade from 2.2.35 to 2.3.1 today, and I do become pounded by error messages at server1 (and vice versa at server2) as follows: | Apr 2 17:12:18 <mail.err> server1.lan dovecot: doveadm: Error: dsync(server2.lan): I/O has stalled, \ no activity for 600 seconds (last sent=mail_change, last recv=mail_change (EOL)) | Apr 2 17:12:18 <mail.err> server1.lan dovecot: doveadm: Error: Timeout during state=sync_mails \ (send=changes recv=mail_requests) […] | Apr 2 18:59:03 <mail.err> server1.lan dovecot: doveadm: Error: dsync(server2.lan): I/O has stalled, \ no activity for 600 seconds (last sent=mail, last recv=mail (EOL)) | Apr 2 18:59:03 <mail.err> server1.lan dovecot: doveadm: Error: Timeout during state=sync_mails \ (send=mails recv=recv_last_common) I cannot see in my personal account any missing replications, *but* I haven't tested this thoroughly enough. I do have customers being serviced at these productive servers, *thus* I'm back to 2.2.35 until I do understand or have learned what is going on. Any ideas/feedback? FYI: I haven't seen such errors before. Replication has been working for years now, without any glitches at all. Regards, Michael

1 1

dovecot auth error: Illegal seek
by panetta 03 Apr '18

03 Apr '18

Hi, I recently configured dovecot to manage auth for both local and virtual user. When i login as a virtual user (claudio.panetta) I get the following message: dovecot: auth: Error: passwd(claudio.panetta,160.97.62.1,<WLjlnZ9oRACgYT4B>): getpwnam() failed: Illegal seek but login is ok and sending/receiving email is ok, how can, if possible, I suppress this error message? In the following my dovecot config: host-prompt# dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-5-686-pae i686 Debian 7.11 auth_mechanisms = plain login auth_username_format = %Ln listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Server ready. mail_full_filesystem_access = yes mail_location = mbox:~/:INBOX=/var/mail/%u:INDEX=/var/index/%u mail_privileged_group = mail passdb { driver = pam } passdb { args = scheme=MD5-CRYPT username_format=%n /etc/dovecot/users driver = passwd-file } protocols = " imap" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service imap-login { inet_listener imap { port = 0 } } ssl_cert = </etc/ssl/certs/chained-cert-9599-ml.mat.unical.it.pem ssl_key = </etc/ssl/private/csrkey-ml.mat.unical.it.pem userdb { driver = passwd } userdb { args = username_format=%n /etc/dovecot/users uid=vmail gid=vmail home=/var/vmail/%d/%n mail=maildir:/var/vmail/%d/%n/Maildir driver = static } verbose_proctitle = yes host-prompt# cat /etc/dovecot/users claudio.panetta:{MD5-CRYPT}$1$abcdefghijklmnopqrst ciccio.pasticcio:{MD5-CRYPT}$1$abcdefghijklmnopqrst Regards, Claudio

2 2

multi-site SSL certificates
by Jeff Abrahamson 03 Apr '18

03 Apr '18

I'm handling mail for several domains, let's call them a.com, b.com, and c.com. I have certificates for each of these domains individually via certbot (letsencrypt) and nginx is happy with all of that. Since I initially configured the site to handle mail only for a.com, my /etc/postfix/main.cf file currently has these two lines: smtpd_tls_cert_file = /etc/letsencrypt/live/mail.a.com/fullchain.pem smtpd_tls_key_file = /etc/letsencrypt/live/mail.a.com/privkey.pem But I see that mail test tools are reporting that MX for b.com and c.com are misconfigured due to an SSL name mismatch. Indeed, this is true! So I believe I should generate a multi-site SSL cert. I try this: sudo certbot certonly --cert-name postfix --webroot \ --webroot-path /var/www/a-com -d www.a.com -d a.com -d mail.a.com \ --webroot-path /var/www/b-com -d www.b.com -d b.com \ --webroot-path /var/www/c-com -d www.c.com -d c.com And that fails with a bunch of errors like this: Domain: www.a.com Type: unauthorized Detail: Invalid response from http://www.a.com/.well-known/acme-challenge/IT7-YURAep4bniD9zYpKpdRUBQcgCRJ…: "<html> <head><title>404 Not Found</title></head> <body bgcolor="white"> <center><h1>404 Not Found</h1></center> <hr><center>" I see that the file .well-known/acme-challenge/IT7-YURAep4bniD9zYpKpdRUBQcgCRJ6FflmZzWQGNg is being created (and one other file, too) but that nginx reports that the _directory_ .well-known/acme-challenge/IT7-YURAep4bniD9zYpKpdRUBQcgCRJ6FflmZzWQGNg doesn't exist. Multi-site + letsencrypt + postfix is a subject that has recently changed quite a bit, so I'm suspecting my web reading is merely leading me astray. It is also entirely possible I've misunderstood things about SSL certificates. Any pointers how to generate (or point to) the certificates that I need to make those who contact my postfix instance happy with their SSL conversation? Thanks!

5 7

dovecot lastlogin tracking
by David Mehler 03 Apr '18

03 Apr '18

Hello, I am trying to get Dovecot 2.3.1 to track lastlogins of users. I'm using a MySQL database. When I log in I am getting this in the error log: 2018-04-02 18:24:21 imap(user(a)domain.com)<61855><6R0rDeVodcl/AAAB>: Error: last_login_dict: Failed to write value for user user(a)domain.com: dict-server returned failure: sql dict: commit failed: Field 'name' doesn't have a default value (reply took 0.026 secs (0.000 in dict wait, 0.020 in other ioloops, 0.001 in locks, async-id reply 0.000 secs ago, started on dict-server 0.019 secs ago, took 0.005 secs)) Here's an excerpt from my dovecot-dict-sql.conf.ext file: map { pattern = shared/last-login/$username table = accounts username_field = username value_field = lastlogin fields { username = $username } } I've got all users in the accounts table and there is a lastlogin column: describe accounts; +-----------+------------------+------+-----+---------+----------------+ | Field | Type | Null | Key | Default | Extra | +-----------+------------------+------+-----+---------+----------------+ | id | int(10) unsigned | NO | PRI | NULL | auto_increment | | name | varchar(255) | NO | | NULL | | | username | varchar(64) | NO | MUL | NULL | | | domain | varchar(255) | NO | MUL | NULL | | | password | varchar(255) | NO | | NULL | | | quota | int(10) unsigned | YES | | 0 | | | enabled | tinyint(1) | YES | | 0 | | | sendonly | tinyint(1) | YES | | 0 | | | lastlogin | int(11) unsigned | NO | | 0 | | Thanks. Dave. doveconf -n # 2.3.1 (8e2f634): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.1 (d9bc6dfe) # OS: FreeBSD 11.1-RELEASE-p4 amd64 # Hostname: localhost auth_cache_size = 24 M auth_cache_ttl = 18 hours auth_default_realm = example.com auth_mechanisms = plain login auth_realms = example.com example2.com dict { acl = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext lastlogin = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext quota = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 999 first_valid_uid = 999 hostname = mail.example.com imap_idle_notify_interval = 10 mins last_valid_gid = 999 last_valid_uid = 999 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To listen = 127.0.0.1 xxx.xxx.xxx.xxx log_path = /var/log/dovecot/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_access_groups = vmail mail_gid = vmail mail_home = /home/vmail/mailboxes/%d/%n mail_location = maildir:~/mail:LAYOUT=fs mail_plugins = acl mail_log notify quota trash virtual welcome zlib mail_privileged_group = vmail mail_server_admin = mailto:postmaster@example.com mail_uid = vmail mailbox_idle_check_interval = 59 secs managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtest spamtestplus virustest editheader imapflags notify imapsieve vnd.dovecot.imapsieve namespace { location = maildir:/home/vmail/public/:CONTROL=~/mail/public:INDEX=~/mail/public mailbox TestFolder { auto = subscribe comment = Public Folder for message sharing } prefix = Public/ separator = / subscriptions = yes type = public } namespace { list = children location = maildir:/home/vmail/mail/%%d/%%n:LAYOUT=fs:INDEX=/home/vmail/indexes/%d/%n/shared/%%u:INDEXPVT=/home/vmail/indexes/%d/%n/shared/%%u prefix = shared/%%d/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } mailbox virtual/All { comment = All my messages special_use = \All } prefix = separator = / type = private } namespace virtual { location = virtual:/usr/local/etc/dovecot/virtual:INDEX=~/virtual:CONTROL=~/virtual prefix = virtual/ separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl fts = lucene fts_autoindex = yes fts_autoindex_max_recent_msgs = 80 fts_index_timeout = 90 fts_lucene = whitespace_chars=@. normalize no_snowball imapsieve_mailbox1_before = file:/home/vmail/sieve/global/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/home/vmail/sieve/global/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * last_login_dict = proxy::lastlogin last_login_key = last-login/%n mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:User quota::proxy::quota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_vsizes = true quota_warning = storage=100%% quota-exceeded 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u quota_warning5 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_before = /home/vmail/sieve/before.d sieve_default = /home/vmail/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags +spamtest +spamtestplus +virustest +editheader sieve_global_dir = /home/vmail/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute +vnd.dovecot.environment sieve_max_redirects = 30 sieve_max_script_size = 1M sieve_pipe_bin_dir = /home/vmail/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_spamtest_max_header = X-Spamd-Result: default: [[:alnum:]]+ \[-?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]+)\] sieve_spamtest_status_header = X-Spamd-Result: default: [[:alnum:]]+ \[(-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]]+\] sieve_spamtest_status_type = score sieve_user_log = /home/vmail/sieve/sieve_error.log sieve_virustest_status_header = X-Virus-Scan: Found to be (.+)\. sieve_virustest_status_type = text sieve_virustest_text_value1 = clean sieve_virustest_text_value5 = infected trash = /usr/local/etc/dovecot/trash.conf welcome_script = welcome %u welcome_wait = yes } postmaster_address = postmaster(a)example.com protocols = imap lmtp sieve sendmail_path = /usr/local/sbin/sendmail service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } user = root } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { address = xxx.xxx.xxx.xxx port = 993 ssl = yes } } service imap { executable = imap } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/dovecot-quota { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/etc/dovecot/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } service welcome { executable = script /usr/local/etc/dovecot/welcome.sh unix_listener welcome { user = vmail } user = vmail } ssl = required ssl_cert = </usr/local/etc/ssl/acme/example.com/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { info_log_path = /var/log/dovecot/dovecot-lmtp.log log_path = /var/log/dovecot/dovecot-lmtp-errors.log mail_plugins = acl mail_log notify quota trash virtual welcome zlib sieve } protocol lda { mail_plugins = acl mail_log notify quota trash virtual welcome zlib sieve } protocol imap { mail_max_userip_connections = 20 mail_plugins = acl mail_log notify quota trash virtual welcome zlib imap_acl imap_quota imap_sieve imap_zlib last_login fts fts_lucene } protocol sieve { info_log_path = /var/log/dovecot/dovecot-sieve.log log_path = /var/log/dovecot/dovecot-sieve-errors.log }

1 0

domain email autoconfiguration
by David Mehler 01 Apr '18

01 Apr '18

Hello, If anyone has autoconfiguration going with their email domain please email me privately. I'd like to ask you some questions about your setup. What do you use? Thanks. Dave.

3 2

Replication fails with dsync-server(admin@asergis.com): Error: Couldn't create lock /home/admin/.dovecot-sync.lock: No such file or directory
by Vladimir Tiukhtin 31 Mar '18

31 Mar '18

Hello I have configured replication using dsync. It fails with a message Error: Couldn't create lock /home/admin/.dovecot-sync.lock: No such file or directory This directory predictably does not exist - all my users are supposed to be virtual. I can not find an option to switch this off. At the same time if I try manual replication I get segfault error Mar 30 17:17:24 localhost.localdomain dovecot[29063]: dsync-server(admin(a)asergis.com): Error: Couldn't create lock /home/admin/.dovecot-sync.lock: No such file or directory Mar 30 17:17:54 localhost.localdomain dovecot[29063]: dsync-server(admin(a)asergis.com): Error: sieve-storage: couldn't find storage root directory; sieve_dir was left unconfigured and autodetection failed Mar 30 17:17:54 localhost.localdomain dovecot[29063]: dsync-server(admin(a)asergis.com): Fatal: master: service(doveadm): child 29133 killed with signal 11 (core dumps disabled) Mar 30 17:17:54 localhost.localdomain kernel: doveadm-server[29133]: segfault at 58 ip 00007fa0608c9ca1 sp 00007fffbf349480 error 4 in lib10_doveadm_sieve_plugin.so[7fa0608c2000+b000] Mar 30 17:22:25 localhost.localdomain dovecot[29063]: dsync-server(admin(a)asergis.com): Error: Couldn't create lock /home/admin/.dovecot-sync.lock: No such file or directory Mar 30 17:27:58 localhost.localdomain kernel: doveadm[29153]: segfault at 58 ip 00007fc1e65baca1 sp 00007ffd1a78b020 error 4 in lib10_doveadm_sieve_plugin.so[7fc1e65b3000+b000] ** *My OS*: # cat /etc/os-release NAME="CentOS Linux" VERSION="7 (Core)" ID="centos" ID_LIKE="rhel fedora" VERSION_ID="7" PRETTY_NAME="CentOS Linux 7 (Core)" ANSI_COLOR="0;31" CPE_NAME="cpe:/o:centos:centos:7" HOME_URL="https://www.centos.org/" BUG_REPORT_URL="https://bugs.centos.org/" CENTOS_MANTISBT_PROJECT="CentOS-7" CENTOS_MANTISBT_PROJECT_VERSION="7" REDHAT_SUPPORT_PRODUCT="centos" REDHAT_SUPPORT_PRODUCT_VERSION=" *My dovecot:* # dovecot --version 2.2.10 *My config*: auth_cache_size = 12 M auth_cache_ttl = 1 days auth_debug = yes auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyz.@ auth_verbose = yes base_dir = /var/run/dovecot/ default_client_limit = 1024 default_process_limit = 128 doveadm_password = mysecretpasswordsharedamongservers first_valid_uid = 1000 instance_name = powergate login_greeting = with a great power comes great responsibility mail_location = mdbox:/var/mail/%d/%n mail_plugins = replication notify mail_privileged_group = mail mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = no special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = create special_use = \Junk } mailbox Trash { auto = no special_use = \Trash } mailbox virtual/All { auto = no special_use = \All } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_replica = tcp:192.168.100.11:54321 } protocols = imap lmtp service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = $default_internal_user } unix_listener replication-notify { mode = 0666 user = $default_internal_user } } service auth { client_limit = 512 inet_listener auth-client { port = 12345 } unix_listener auth-userdb { mode = 0666 } } service doveadm { inet_listener { port = 54321 } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 2 service_count = 1 } service imap { service_count = 1 } service lmtp { unix_listener lmtp { group = postfix mode = 0600 user = postfix } } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_dh_parameters_length = 2048 ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql }

2 1

Issue with a bug with imap-login
by Grant Keller 31 Mar '18

31 Mar '18

Hello, Currently working on migrating our existing directors from 2.1.13 to 2.2.10. In 2.2.10 when issuing the logout command on an unauthenticated connection, the connection is closed before the server sends the BYE line to the client. The new version works as expected with a non-secure connection. I will include the strace output from the imap-login process that shows the connection closing before the message can be sent. # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-693.21.1.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) auth_master_user_separator = * auth_username_format = %Ln auth_verbose = yes default_client_limit = 20000 director_mail_servers = removed director_servers = c.director.imapd.sonic.net d.director.imapd.sonic.net disable_plaintext_auth = no doveadm_port = 1842 login_trusted_networks = removed mbox_write_locks = fcntl passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = proxy=y nopassword=y driver = static } service anvil { client_limit = 40103 } service auth { client_limit = 41704 } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9321 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director process_limit = 20000 process_min_avail = 1 } service imap { process_limit = 20480 } service pop3-login { executable = pop3-login director process_limit = 20000 process_min_avail = 32 } ssl_ca = </etc/dovecot/ssl/gd_bundle.crt ssl_cert = </etc/dovecot/ssl/imap.sonic.net.crt ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA ssl_key = </etc/dovecot/ssl/imap.sonic.net.key ssl_parameters_regenerate = 1 days ssl_protocols = !SSLv2 !SSLv3 syslog_facility = local0 protocol imap { imap_max_line_length = 128 k ssl_ca = </etc/dovecot/ssl/gd_bundle.crt ssl_cert = </etc/dovecot/ssl/imap.sonic.net.crt ssl_key = </etc/dovecot/ssl/imap.sonic.net.key } protocol pop3 { ssl_ca = </etc/dovecot/ssl/pop.sonic.net.ca-bundle ssl_cert = </etc/dovecot/ssl/pop.sonic.net.crt ssl_key = </etc/dovecot/ssl/pop.sonic.net.key } STRACE: 263563 epoll_wait(14<anon_inode:[eventpoll]>, [{EPOLLIN, {u32=2772983280, u64=94500643429872}}], 8, -1) = 1 263563 accept(9<TCP:[0.0.0.0:993]>, {sa_family=AF_INET, sin_port=htons(39552), sin_addr=inet_addr("64.142.18.25")}, [16]) = 18<TCP:[64.142.111.79:993->64.142.18.25:39552]> 263563 fcntl(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, F_GETFL) = 0x2 (flags O_RDWR) 263563 fcntl(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, F_SETFL, O_RDWR|O_NONBLOCK) = 0 263563 write(5<pipe:[1445541]>, "\213\5\4\0\223\16\0\0\0\0\0\0", 12) = 12 263563 write(2<pipe:[1445512]>, "\1\010263563 ip=64.142.18.25\n", 25) = 25 263563 getsockname(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, {sa_family=AF_INET, sin_port=htons(993), sin_addr=inet_addr("64.142.111.79")}, [16]) = 0 263563 socket(AF_LOCAL, SOCK_STREAM, 0) = 19<UNIX:[1458853]> 263563 fcntl(19<UNIX:[1458853]>, F_GETFL) = 0x2 (flags O_RDWR) 263563 fcntl(19<UNIX:[1458853]>, F_SETFL, O_RDWR|O_NONBLOCK) = 0 263563 connect(19<UNIX:[1458853]>, {sa_family=AF_LOCAL, sun_path="ssl-params"}, 110) = 0 263563 fcntl(19<UNIX:[1458853]>, F_GETFL) = 0x802 (flags O_RDWR|O_NONBLOCK) 263563 fcntl(19<UNIX:[1458853]>, F_SETFL, O_RDWR) = 0 263563 read(19<UNIX:[1458853]>, "\0\2\0\0", 4) = 4 263563 read(19<UNIX:[1458853]>, "H\0\0\0", 4) = 4 263563 read(19<UNIX:[1458853]>, "0F\2A\0\246@\4\253O,\222\10\300\237\334\240>\331\270\24K\261w\300\16\0076\230\2039\1"..., 72) = 72 263563 read(19<UNIX:[1458853]>, "\0\4\0\0", 4) = 4 263563 read(19<UNIX:[1458853]>, "\212\0\0\0", 4) = 4 263563 read(19<UNIX:[1458853]>, "0\201\207\2\201\201\0\213:7H\"\251}6d\371}\212\312\276\177p!\10\26\1[\241\265\254\216"..., 138) = 138 263563 read(19<UNIX:[1458853]>, "\0\0\0\0", 4) = 4 263563 read(19<UNIX:[1458853]>, "", 1) = 0 263563 close(19<UNIX:[1458853]>) = 0 263563 socketpair(AF_LOCAL, SOCK_STREAM, 0, [19<UNIX:[1401333->1401334]>, 20<UNIX:[1401334->1401333]>]) = 0 263563 fcntl(19<UNIX:[1401333->1401334]>, F_GETFL) = 0x2 (flags O_RDWR) 263563 fcntl(19<UNIX:[1401333->1401334]>, F_SETFL, O_RDWR|O_NONBLOCK) = 0 263563 fcntl(20<UNIX:[1401334->1401333]>, F_GETFL) = 0x2 (flags O_RDWR) 263563 fcntl(20<UNIX:[1401334->1401333]>, F_SETFL, O_RDWR|O_NONBLOCK) = 0 263563 fcntl(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, F_GETFL) = 0x802 (flags O_RDWR|O_NONBLOCK) 263563 fcntl(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, F_SETFL, O_RDWR|O_NONBLOCK) = 0 263563 fstat(20<UNIX:[1401334->1401333]>, {st_mode=S_IFSOCK|0777, st_size=0, ...}) = 0 263563 lseek(20<UNIX:[1401334->1401333]>, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) 263563 getsockname(20<UNIX:[1401334->1401333]>, {sa_family=AF_LOCAL, NULL}, [2]) = 0 263563 epoll_ctl(14<anon_inode:[eventpoll]>, EPOLL_CTL_ADD, 20<UNIX:[1401334->1401333]>, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=2773038880, u64=94500643485472}}) = 0 263563 write(20<UNIX:[1401334->1401333]>, "* OK [CAPABILITY IMAP4rev1 LITER"..., 103) = 103 263563 brk(NULL) = 0x55f2a549d000 263563 brk(0x55f2a54c2000) = 0x55f2a54c2000 263563 read(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "\26\3\1\0\253\1\0\0\247\3\3", 11) = 11 263563 read(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "\205\224\354\263zY\200p\240T\21\377\276\224\251(\343\255x\277\273.\223\304\"<R\222\16\3538s"..., 165) = 165 263563 write(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "\26\3\3\0=\2\0\0009\3\0033\336\314\231\205\305\330\206M\361qQ\240\272\225\317^\331Ysc"..., 4096) = 4096 263563 write(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "http://ocsp.usertrust.com0\r\6\t*\206H"..., 680) = 680 263563 read(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, 0x55f2a5498db3, 5) = -1 EAGAIN (Resource temporarily unavailable) 263563 epoll_ctl(14<anon_inode:[eventpoll]>, EPOLL_CTL_ADD, 18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=2773128976, u64=94500643575568}}) = 0 263563 epoll_ctl(14<anon_inode:[eventpoll]>, EPOLL_CTL_DEL, 7<TCP:[0.0.0.0:143]>, 0x7ffcd4f4f270) = 0 263563 epoll_ctl(14<anon_inode:[eventpoll]>, EPOLL_CTL_DEL, 8<TCPv6:[:::143]>, 0x7ffcd4f4f270) = 0 263563 epoll_ctl(14<anon_inode:[eventpoll]>, EPOLL_CTL_DEL, 9<TCP:[0.0.0.0:993]>, 0x7ffcd4f4f270) = 0 263563 epoll_ctl(14<anon_inode:[eventpoll]>, EPOLL_CTL_DEL, 10<TCPv6:[:::993]>, 0x7ffcd4f4f270) = 0 263563 close(7<TCP:[0.0.0.0:143]>) = 0 263563 close(8<TCPv6:[:::143]>) = 0 263563 close(9<TCP:[0.0.0.0:993]>) = 0 263563 close(10<TCPv6:[:::993]>) = 0 263563 epoll_wait(14<anon_inode:[eventpoll]>, [{EPOLLIN, {u32=2773128976, u64=94500643575568}}], 10, 179981) = 1 263563 read(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "\26\3\3\0f", 5) = 5 263563 read(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "\20\0\0ba\4:tZW\323_&\31\205\274\254\242\246\203\342\324O\350\36\206uX\36@/\r"..., 102) = 102 263563 read(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "\24\3\3\0\1", 5) = 5 263563 read(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "\1", 1) = 1 263563 read(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "\26\3\3\0(", 5) = 5 263563 read(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "\224\204\216\367\254\217z\253$S\325\242F\t\256<'vz\3\355\37\fmz\204\261li\307\23\225"..., 40) = 40 263563 write(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "\26\3\3\0\252\4\0\0\246\0\0\1,\0\240q/\300C\32\250\251\253I>\177\205A\3\331&\\"..., 226) = 226 263563 epoll_ctl(14<anon_inode:[eventpoll]>, EPOLL_CTL_ADD, 19<UNIX:[1401333->1401334]>, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=2773039024, u64=94500643485616}}) = 0 263563 read(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, 0x55f2a5498db3, 5) = -1 EAGAIN (Resource temporarily unavailable) 263563 epoll_wait(14<anon_inode:[eventpoll]>, [{EPOLLIN, {u32=2773039024, u64=94500643485616}}], 10, 179974) = 1 263563 read(19<UNIX:[1401333->1401334]>, "* OK [CAPABILITY IMAP4rev1 LITER"..., 1024) = 103 263563 setsockopt(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, SOL_TCP, TCP_CORK, [1], 4) = 0 263563 write(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "\27\3\3\0\177[\202'O\267-\354\\\301@\225\301\363YeQ\213\341\204!x\347\314\305\327\16\366"..., 132) = 132 263563 read(19<UNIX:[1401333->1401334]>, 0x55f2a5492a54, 1024) = -1 EAGAIN (Resource temporarily unavailable) 263563 setsockopt(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, SOL_TCP, TCP_CORK, [0], 4) = 0 263563 epoll_wait(14<anon_inode:[eventpoll]>, [{EPOLLIN, {u32=2773128976, u64=94500643575568}}], 10, 179973) = 1 263563 read(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "\27\3\3\0!", 5) = 5 263563 read(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "\224\204\216\367\254\217z\254\366W\2765\27\22l\277\262\v\217f\323\254i\272\214\364\264#q\254n\323"..., 33) = 33 263563 sendto(19<UNIX:[1401333->1401334]>, "? logout\n", 9, 0, NULL, 0) = 9 263563 read(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, 0x55f2a5498db3, 5) = -1 EAGAIN (Resource temporarily unavailable) 263563 epoll_wait(14<anon_inode:[eventpoll]>, [{EPOLLIN, {u32=2773038880, u64=94500643485472}}], 10, 177320) = 1 263563 read(20<UNIX:[1401334->1401333]>, "? logout\n", 863) = 9 263563 write(2<pipe:[1445512]>, "\1\010263563 prefix=imap-login: \n", 29) = 29 263563 write(2<pipe:[1445512]>, "\1\002263563 Aborted login (no auth "..., 131) = 131 263563 epoll_ctl(14<anon_inode:[eventpoll]>, EPOLL_CTL_DEL, 18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, 0x7ffcd4f4f2d0) = 0 263563 epoll_ctl(14<anon_inode:[eventpoll]>, EPOLL_CTL_DEL, 19<UNIX:[1401333->1401334]>, 0x7ffcd4f4f2d0) = 0 263563 write(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>, "\25\3\3\0\32[\202'O\267-\354]\221\344\235?\351'\270g\262\2-\31\216V\236\364\314\253", 31) = 31 263563 close(18<TCP:[64.142.111.79:993->64.142.18.25:39552]>) = 0 263563 close(19<UNIX:[1401333->1401334]>) = 0 263563 setsockopt(20<UNIX:[1401334->1401333]>, SOL_TCP, TCP_CORK, [1], 4) = -1 EOPNOTSUPP (Operation not supported) 263563 write(20<UNIX:[1401334->1401333]>, "* BYE Logging out\r\n? OK Logout c"..., 43) = -1 EPIPE (Broken pipe) 263563 --- SIGPIPE {si_signo=SIGPIPE, si_code=SI_USER, si_pid=263563, si_uid=994} --- 263563 epoll_ctl(14<anon_inode:[eventpoll]>, EPOLL_CTL_DEL, 20<UNIX:[1401334->1401333]>, 0x7ffcd4f4f2e0) = 0 263563 close(20<UNIX:[1401334->1401333]>) = 0 263563 epoll_ctl(14<anon_inode:[eventpoll]>, EPOLL_CTL_DEL, 17<UNIX:[1347141->1423948]>, 0x7ffcd4f4f280) = 0 263563 close(17<UNIX:[1347141->1423948]>) = 0 263563 epoll_ctl(14<anon_inode:[eventpoll]>, EPOLL_CTL_DEL, 13<UNIX:[1347139->1250858]>, 0x7ffcd4f4f400) = 0 263563 close(13<UNIX:[1347139->1250858]>) = 0 263563 close(11<UNIX:[1347138->1449033]>) = 0 263563 epoll_ctl(14<anon_inode:[eventpoll]>, EPOLL_CTL_DEL, 6<pipe:[1445521]>, 0x7ffcd4f4f420) = 0 263563 epoll_ctl(14<anon_inode:[eventpoll]>, EPOLL_CTL_DEL, 15<pipe:[1347140]>, 0x7ffcd4f4f3f0) = 0 263563 close(15<pipe:[1347140]>) = 0 263563 close(16<pipe:[1347140]>) = 0 263563 close(14<anon_inode:[eventpoll]>) = 0 263563 exit_group(0) = ? 263563 +++ exited with 0 +++ Grant Keller System Operations grant.keller(a)sonic.com

2 1

debian lintian warn: hardening-no-fortify-functions
by A. Schulze 30 Mar '18

30 Mar '18

Hello, to build + packages dovecot I use the usual Debian tool chain. That includes build with selected GCC options and running lintian. I notice since a long time (read: many earlier versions, up to 2.2.35) this lintian warnings: I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/auth N: N: This package provides an ELF binary that lacks the use of fortified libc N: functions. Either there are no potentially unfortified functions called N: by any routines, all unfortified calls have already been fully validated N: at compile-time, or the package was not built with the default Debian N: compiler flags defined by dpkg-buildflags. If built using N: dpkg-buildflags directly, be sure to import CPPFLAGS. N: N: NB: Due to false-positives, Lintian ignores some unprotected functions N: (e.g. memcpy). N: N: Refer to https://wiki.debian.org/Hardening and N: https://bugs.debian.org/673112 for details. N: N: Severity: normal, Certainty: wild-guess N: N: Check: binaries, Type: binary, udeb N: I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/config I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/director I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/gdbhelper I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/imap I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/libdovecot-login.so.0.0.0 I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/libdovecot-storage.so.0.0.0 I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/modules/lib10_quota_plugin.so I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/modules/lib20_fts_plugin.so I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/modules/lib20_replication_plugin.so I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/modules/lib99_welcome_plugin.so I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/quota-status I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/script I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/script-login I: dovecot-core: hardening-no-fortify-functions usr/lib/dovecot/xml2text As you may note, not all binaries are affected. doveadm, doveconf or dovecot aren't for example. My (simplyfied) debian/rules: #!/usr/bin/make -f export DEB_BUILD_MAINT_OPTIONS = hardening=+all DPKG_EXPORT_BUILDFLAGS = 1 include /usr/share/dpkg/buildflags.mk include /usr/share/cdbs/1/rules/debhelper.mk include /usr/share/cdbs/1/class/autotools.mk DEB_DH_STRIP_ARGS = --dbg-package=dovecot-core-dbg This result in that call to configure: CFLAGS="-g -O2 -fdebug-prefix-map=/<<PKGBUILDDIR>>=. -fstack-protector-strong -Wformat -Werror=format-security" CXXFLAGS="-g -O2 -fdebug-prefix-map=/<<PKGBUILDDIR>>=. -fstack-protector-strong -Wformat -Werror=format-security" CPPFLAGS="-Wdate-time -D_FORTIFY_SOURCE=2" LDFLAGS="-Wl,-z,relro -Wl,-z,now" /<<PKGBUILDDIR>>/./configure --build=x86_64-linux-gnu --prefix=/usr --includedir="\${prefix}/include" --mandir="\${prefix}/share/man" --infodir="\${prefix}/share/info" --sysconfdir=/etc --localstatedir=/var --libexecdir="\${prefix}/lib/dovecot" --srcdir=. --disable-maintainer-mode --disable-dependency-tracking --disable-silent-rules --libexecdir=/usr/lib --localstatedir=/var --with-statedir=/var/lib/dovecot --with-moduledir=/usr/lib/dovecot/modules --without-docs I may provide a full build log if that would be helpful. To me that looks like not all binaries are build with same CFLAGS / CXXFLAGS / CPPFLAGS / LDFLAGS Andreas

2 2

mail_max_userip_connections from userdb query
by Arkadiusz Miśkiewicz 30 Mar '18

30 Mar '18

Hello. Is still true that mail_max_userip_connections cannot be overriden in userdb query? Want lower global and raise for some logins. https://www.dovecot.org/pipermail/dovecot/2017-July/108520.html -- Arkadiusz Miśkiewicz, arekm / ( maven.pl | pld-linux.org )

2 1

Re: 2.3.1 from ghettoforge-testing causes auth failures
by Fabian A. Santiago 30 Mar '18

30 Mar '18

On March 28, 2018 8:23:42 PM EDT, "Fabian A. Santiago" <fsantiago(a)garbage-juice.com> wrote: >Hello, > >I updated today to v2.3.1 from @gf-testing and it broke my imap auth >mechanism. My dovecot-imap.log reported: > >Temporary auth service failure > >I needed it back up so I downgraded (immediately prior version also >from @gf-testing) and I was fine. > >Centos 7.4 > >I can plan some testing / debug logging time if anyone wishes. > >My doveconf -n is here: > >https://pastebin.com/WVV9JFkT > >Thanks. > > >-- > >Thanks, > >Fabian S. > >OpenPGP: 3C3FA072ACCB7AC5DB0F723455502B0EEB9070FC Resending due to msg not appearing after original send to list. -- Thanks, Fabian S. OpenPGP: 3C3FA072ACCB7AC5DB0F723455502B0EEB9070FC

1 0

Frequentl failures to create /tmp/dovecot.imap
by Peter 29 Mar '18

29 Mar '18

I am using dovecot 2.2.27 with plesk 12 and I have made no modifications to the dovecot config. my log file frequently (but not always!) reports errors that /tmp/dovecot.imap could not be created. The errors don't appear for every imap connect but for about 5% to 10% of the time. I already attempted to solve the problem by adding the following line to /etc/dovecot/dovecot.conf but that did not remove the error: mail_temp_dir = /tmp So why does dovecot mostly work without errors but sometimes fails to create the /tmp/dovecot.imap? ..excerpt from /var/log/syslog... dovecot: service=imap, user=user1(a)mydomain1.com, ip=[::1]. Error: Temp file creation to /tmp/dovecot.imap. failed: No such file or directory]: 1 Time(s) dovecot: service=imap, user=users2(a)mydomain2.com, ip=[::1]. Error: Temp file creation to /tmp/dovecot.imap. failed: No such file or directory: 10 Time(s) --- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

1 0

Release 2.3.1
by aki.tuomi＠dovecot.fi 29 Mar '18

29 Mar '18

Hi! We are releasing v2.3.1, which mostly consists of bug fixes for 2.3.0, and few improvements. This is also available via https://repo.dovecot.org if you want packages. libsodium support didn't get into this build, due to build environment issues, but 2.3.2 will contain it. * Submission server support improvements and bug fixes - Lots of bug fixes to submission server * API CHANGE: array_idx_modifiable will no longer allocate space - Particularly affects how you should check MODULE_CONTEXT result, or use REQUIRE_MODULE_CONTEXT. + mail_attachment_detection_options setting controls when $HasAttachment and $HasNoAttachment keywords are set for mails. + imap: Support fetching body snippets using FETCH (SNIPPET) or (SNIPPET (LAZY=FUZZY)) + fs-compress: Automatically detect whether input is compressed or not. Prefix the compression algorithm with "maybe-" to enable the detection, for example: "compress:maybe-gz:6:..." + Added settings to change dovecot.index* files' optimization behavior. See https://wiki2.dovecot.org/IndexFiles#Settings + Auth cache can now utilize auth workers to do password hash verification by setting auth_cache_verify_password_with_worker=yes. + Added charset_alias plugin. See https://wiki2.dovecot.org/Plugins/CharsetAlias + imap_logout_format and pop3_logout_format settings now support all of the generic variables (e.g. %{rip}, %{session}, etc.) -- Aki Tuomi Dovecot oy

4 9

murmurhash3 test failures on big-endian systems
by Apollon Oikonomopoulos 29 Mar '18

29 Mar '18

Hi, The dovecot 2.3.0.1 Debian package currently fails to build on all big-endian architectures[1], due to murmurhash3 tests failing. The relevant output from e.g. s390x is: test-murmurhash3.c:22: Assert(#8) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 test-murmurhash3.c:22: Assert(#11) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 test-murmurhash3.c:22: Assert(#12) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 murmurhash3 (murmurhash3_32) ......................................... : FAILED test-murmurhash3.c:22: Assert(#1) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 test-murmurhash3.c:22: Assert(#2) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 test-murmurhash3.c:22: Assert(#3) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 test-murmurhash3.c:22: Assert(#4) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 test-murmurhash3.c:22: Assert(#5) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 test-murmurhash3.c:22: Assert(#6) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 test-murmurhash3.c:22: Assert(#7) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 test-murmurhash3.c:22: Assert(#8) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 test-murmurhash3.c:22: Assert(#9) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 test-murmurhash3.c:22: Assert(#10) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 test-murmurhash3.c:22: Assert(#11) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 test-murmurhash3.c:22: Assert(#12) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 test-murmurhash3.c:22: Assert(#13) failed: memcmp(result, vectors[i].result, sizeof(result)) == 0 murmurhash3 (murmurhash3_128) ........................................ : FAILED Looks like the murmurhash3 implementation in Dovecot is currently broken on big-endian systems. Regards, Apollon [1] https://buildd.debian.org/status/package.php?p=dovecot&suite=experimental

3 9

[sieve][pigeonhole] Can't catch stdout for pipe script after upgrade Dovecot 2.2 -> 2.3
by Konstantin Shalygin 29 Mar '18

29 Mar '18

Hi. I use custom script: > require [ "vnd.dovecot.pipe", "variables" ]; > > if address :is :all "from" "snip@snap" > { > pipe "sieve_to_owncloud"; > } sieve_to_owncloud: > DATE=`date +%Y-%m-%d_%H-%M-%S` > PYTHONIOENCODING=utf8 python /opt/sieve-pipe/python-imap-to-owncloud.py \ > --owncloud-host https://<snip-snap> \ > --owncloud-user user \ > --owncloud-password secret \ > --owncloud-path /path/to/here &>/tmp/sieve_logger_py_${DATE} On dovecot 2.2 after script execution I will get plaintext log files on /tmp. After upgrade - don't. I also changed transport to lmtp when upgrade. Any ideas where is my stdout? k

2 2

Dovecot 2.3 panic
by Martynas Bendorius 29 Mar '18

29 Mar '18

Dovecot version: 2.3.1 (happens with 2.3.x too) OS: CentOS 7 64-bit Mar 28 16:29:24 lmtp(30383): Panic: file lib-event.c: line 182 (event_pop_global): assertion failed: (event != NULL) Mar 28 16:29:24 lmtp(30383): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xcc7a4) [0x7fac7f5177a4] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7fac7f5177ea] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fac7f48826b] -> /usr/lib/dovecot/libdovecot.so.0(+0xe8392) [0x7fac7f533392] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x4ffc8) [0x7fac7f814fc8] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_context_deactivate+0x5d) [0x7fac7f52ec5d] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x85) [0x7fac7f52f055] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10f) [0x7fac7f53092f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7fac7f52f132] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fac7f52f358] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fac7f4ab6e3] -> dovecot/lmtp [local READY](main+0x229) [0x7fac7ff4a319] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7fac7f0a9c05] -> dovecot/lmtp [local READY](+0x5445) [0x7fac7ff4a445] Mar 28 16:30:03 lmtp(17330): Panic: file lib-event.c: line 182 (event_pop_global): assertion failed: (event != NULL) Mar 28 16:30:03 lmtp(17330): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xcc7a4) [0x7f31e1b977a4] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f31e1b977ea] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f31e1b0826b] -> /usr/lib/dovecot/libdovecot.so.0(+0xe8392) [0x7f31e1bb3392] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x4ffc8) [0x7f31e1e94fc8] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_context_deactivate+0x5d) [0x7f31e1baec5d] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x85) [0x7f31e1baf055] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10f) [0x7f31e1bb092f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f31e1baf132] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f31e1baf358] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f31e1b2b6e3] -> dovecot/lmtp [local READY](main+0x229) [0x7f31e25ca319] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f31e1729c05] -> dovecot/lmtp [local READY](+0x5445) [0x7f31e25ca445] Mar 28 16:31:52 lmtp(883): Panic: file lib-event.c: line 182 (event_pop_global): assertion failed: (event != NULL) Mar 28 16:31:52 lmtp(883): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xcc7a4) [0x7feb746127a4] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7feb746127ea] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7feb7458326b] -> /usr/lib/dovecot/libdovecot.so.0(+0xe8392) [0x7feb7462e392] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x4ffc8) [0x7feb7490ffc8] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_context_deactivate+0x5d) [0x7feb74629c5d] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x85) [0x7feb7462a055] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10f) [0x7feb7462b92f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7feb7462a132] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7feb7462a358] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7feb745a66e3] -> dovecot/lmtp [local READY](main+0x229) [0x7feb75045319] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7feb741a4c05] -> dovecot/lmtp [local READY](+0x5445) [0x7feb75045445] # 2.3.1 (8e2f634): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.1 (d9bc6dfe) # OS: Linux 3.10.0-714.10.2.lve1.5.12.el7.x86_64 x86_64 CloudLinux release 7.4 (Georgy Grechko) # Hostname: XXXXXXXXXXXXXXX auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@& auth_verbose = yes default_client_limit = 12288 default_login_user = dovecot default_process_limit = 2048 default_vsz_limit = 512 M disable_plaintext_auth = no listen = * lmtp_rcpt_check_quota = yes login_greeting = Dovecot ready. mail_access_groups = mail mail_location = maildir:~/Maildir mail_max_userip_connections = 150 mail_plugins = " quota" maildir_copy_with_hardlinks = no managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext passdb { driver = shadow username_filter = !*@* } passdb { args = username_format=%n /etc/virtual/%d/passwd driver = passwd-file username_filter = *@* } plugin { quota = maildir sieve = file:~/sieve;active=~/.dovecot.sieve sieve_default = /var/lib/dovecot/sieve/default.sieve sieve_global = /var/lib/dovecot/sieve/global/ } protocols = imap pop3 lmtp sieve service auth { user = root } service imap-login { process_min_avail = 16 user = dovecot } service lmtp { executable = lmtp -L process_min_avail = 16 unix_listener lmtp-client { group = mail mode = 0660 user = mail } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 4 service_count = 1 } service pop3-login { process_min_avail = 16 user = dovecot } ssl_cert = </etc/exim.cert ssl_cipher_list = ALL:!ADH:RC4+RSA:+HIGH:+MEDIUM:-LOW:-SSLv2:-EXP ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd } userdb { args = username_format=%n /etc/virtual/%d/passwd driver = passwd-file } verbose_proctitle = yes protocol imap { mail_plugins = " quota quota imap_quota" } protocol pop3 { pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o pop3_uidl_format = %08Xu%08Xv } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " quota quota sieve" postmaster_address = root@%{hostname} quota_full_tempfail = no } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } remote 127.0.0.1 { mail_max_userip_connections = 550 } local_name XXXXXX { ssl_cert = </etc/domains/XXXXXX.cert.combined ssl_key = # hidden, use -P to show it } -- Best regards, Martynas Bendorius

2 1

Master Users, ACL and POP3
by Riccardo Bicelli 28 Mar '18

28 Mar '18

Hello, I'm on Dovecot 2.0.9 and I'mfacing issues connecting via POP3 with master user. I'm using the ACL plugin, so I set up a postlogin script that sets the current user as master user: #!/bin/sh MASTER_USER=$USER exec "$@" When I login via IMAP everything seems ok, but when I try via POP3 I get: -ERR [IN-USE] Couldn't open INBOX: Mailbox doesn't exist: INBOX Connection closed by foreign host. Any hints? Thanks

1 0

Dovecot quota
by David Mehler 28 Mar '18

28 Mar '18

Hello, I'm running Dovecot on a FreeBSD system with Postfix in a virtual user setup, with Mysql. I am trying to understand the quota configuration. I've got a Mysql database with an accounts table with a quota field. I've also got two other tables one quota (currently has nothing in it an empty set), and quota2 messages and bytes which has one entry. My goal is to have different quotas for each user so say one user has a 512MB quota I put 512 in the accounts quota column, while another user might have 256MB, put 256 in the accounts quota column. These are just examples. I'm assuming messages in the quota2 table track how many messages are under that user's is it inbox or all folders in the account? And bytes is that the space being taken up again by inbox or by all messages in the account? I'm also trying to have a separate quota for my public folders, which is not working. If anyone could take a look at this configuration see if it looks good and maybe where public is not happening i'd appreciate it. Thanks. Dave. Configuration: mysql> describe accounts; +------------------+------------------+------+-----+---------+----------------+ | Field | Type | Null | Key | Default | Extra | +------------------+------------------+------+-----+---------+----------------+ | id | int(10) unsigned | NO | PRI | NULL | auto_increment | | name | varchar(255) | NO | | NULL | | | username | varchar(64) | NO | MUL | NULL | | | domain | varchar(255) | NO | MUL | NULL | | | password | varchar(255) | NO | | NULL | | | quota | int(10) unsigned | YES | | 0 | | | enabled | tinyint(1) | YES | | 0 | | | sendonly | tinyint(1) | YES | | 0 | | | last_login | int(11) | YES | | NULL | | | last_login_ip | varchar(16) | YES | | NULL | | | last_login_date | datetime | YES | | NULL | | | last_login_proto | varchar(16) | YES | | NULL | | +------------------+------------------+------+-----+---------+----------------+ 12 rows in set (0.00 sec) mysql> describe quota; +----------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +----------+--------------+------+-----+---------+-------+ | username | varchar(255) | NO | PRI | NULL | | | path | varchar(100) | NO | PRI | NULL | | | current | bigint(20) | NO | | 0 | | +----------+--------------+------+-----+---------+-------+ 3 rows in set (0.00 sec) mysql> describe quota2; +----------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +----------+--------------+------+-----+---------+-------+ | username | varchar(100) | NO | PRI | NULL | | | bytes | bigint(20) | NO | | 0 | | | messages | int(11) | NO | | 0 | | +----------+--------------+------+-----+---------+-------+ 3 rows in set (0.01 sec) mysql> select * from quota; Empty set (0.00 sec) mysql> select * from quota2; +------------------------+-----------+----------+ | username | bytes | messages | +------------------------+-----------+----------+ | user(a)example.com | 171430625 | 20591 | +------------------------+-----------+----------+ 1 row in set (0.00 sec) doveconf -n # 2.2.35 (b1cb664): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.23 (b2e41927) # OS: FreeBSD 11.1-RELEASE-p4 amd64 # Hostname: localhost auth_cache_size = 24 M auth_cache_ttl = 18 hours auth_default_realm = example.com auth_mechanisms = plain login auth_realms = example.com dict { acl = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext quota = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 999 first_valid_uid = 999 hostname = mail.example.com imap_idle_notify_interval = 10 mins last_valid_gid = 999 last_valid_uid = 999 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To listen = 127.0.0.1 xxx.xxx.xxx.xxx log_path = /var/log/dovecot/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_access_groups = vmail mail_fsync = never mail_gid = vmail mail_home = /home/vmail/mailboxes/%d/%n mail_location = maildir:~/mail:LAYOUT=fs mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib mail_privileged_group = vmail mail_server_admin = mailto:postmaster@example.com mail_uid = vmail mailbox_idle_check_interval = 59 secs mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtest spamtestplus virustest editheader imapflags notify imapsieve vnd.dovecot.imapsieve namespace { location = maildir:/home/vmail/public/:CONTROL=~/mail/public:INDEX=~/mail/public mailbox TestFolder { auto = subscribe comment = Public Folder for message sharing } prefix = Public/ separator = / subscriptions = yes type = public } namespace { list = children location = maildir:/home/vmail/mail/%%d/%%n:LAYOUT=fs:INDEX=/home/vmail/indexes/%d/%n/shared/%%u:INDEXPVT=/home/vmail/indexes/%d/%n/shared/%%u prefix = shared/%%d/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } mailbox virtual/All { comment = All my messages special_use = \All } prefix = separator = / type = private } namespace virtual { location = virtual:/usr/local/etc/dovecot/virtual:INDEX=~/virtual:CONTROL=~/virtual prefix = virtual/ separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl fts = lucene fts_autoindex = yes fts_autoindex_max_recent_msgs = 80 fts_index_timeout = 90 fts_lucene = whitespace_chars=@. normalize no_snowball imapsieve_mailbox1_before = file:/home/vmail/sieve/global/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/home/vmail/sieve/global/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:User quota::proxy::quota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_vsizes = true quota_warning = storage=100%% quota-exceeded 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u quota_warning5 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_before = /home/vmail/sieve/before.d sieve_default = /home/vmail/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags +spamtest +spamtestplus +virustest +editheader sieve_global_dir = /home/vmail/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute +vnd.dovecot.environment sieve_max_redirects = 30 sieve_max_script_size = 1M sieve_pipe_bin_dir = /home/vmail/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_spamtest_max_header = X-Spamd-Result: default: [[:alnum:]]+ \[-?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]+)\] sieve_spamtest_status_header = X-Spamd-Result: default: [[:alnum:]]+ \[(-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]]+\] sieve_spamtest_status_type = score sieve_user_log = /home/vmail/sieve/sieve_error.log sieve_virustest_status_header = X-Virus-Scan: Found to be (.+)\. sieve_virustest_status_type = text sieve_virustest_text_value1 = clean sieve_virustest_text_value5 = infected welcome_script = welcome %u welcome_wait = yes } postmaster_address = postmaster(a)example.com protocols = imap lmtp sieve sendmail_path = /usr/local/sbin/sendmail service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } user = root } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { address = xxx.xxx.xxx.xxx port = 993 ssl = yes } } service imap { executable = imap } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/dovecot-quota { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/etc/dovecot/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } service welcome { executable = script /usr/local/etc/dovecot/welcome.sh unix_listener welcome { user = vmail } user = vmail } ssl = required ssl_cert = </usr/local/etc/ssl/acme/example.com/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256 ssl_dh_parameters_length = 4096 ssl_key = # hidden, use -P to show it ssl_options = no_compression ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 !TLSv1 !TLSv1.1 TLSv1.2 userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_fsync = optimized mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib quota acl sieve } protocol lda { mail_fsync = optimized mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib quota acl sieve virtual } protocol imap { mail_max_userip_connections = 20 mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib quota acl imap_acl imap_quota imap_sieve imap_zlib last_login virtual fts fts_lucene } dovecot-dict-sql.conf.ext connect = host=SocketLocation dbname=DBName user=UserName password=PasswordHere map { pattern = priv/quota/storage table = quota2 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota2 username_field = username value_field = messages } map { pattern = shared/shared-boxes/user/$to/$from table = user_shares value_field = dummy fields { from_user = $from to_user = $to } } map { pattern = shared/shared-boxes/anyone/$from table = anyone_shares value_field = dummy fields { from_user = $from } } dovecot-sql.conf.extdriver = mysql connect = host=SocketLocation dbname=DBName user=UserName password=PasswordHere default_pass_scheme = SHA512-CRYPT password_query = SELECT username AS user, domain, password FROM accounts WHERE username = '%n' AND domain = '%d' and enabled = true LIMIT 1; user_query = SELECT concat('*:storage=', quota, 'M') AS quota_rule FROM accounts WHERE username = '%n' AND domain = '%d' AND sendonly = false; iterate_query = SELECT username, domain FROM accounts where sendonly = false;

2 1

Released Pigeonhole v0.5.1 for Dovecot v2.3.1.
by Stephan Bosch 28 Mar '18

28 Mar '18

Hello Dovecot users, Here's the Pigeonhole release that goes with Dovecot v2.3.1. You will need this release for Dovecot v2.3.1, because the previous v0.5.0.1 release will not work. Apart from compatibility changes, it only contains bugfixes. Changelog v0.5.1: - Explicitly disallow UTF-8 in localpart in addresses parsed from Sieve script. - editheader extension: Corrected the stream position calculations performed while making the modified message available as a stream. Pigeonhole Sieve crashed in LMTP with an assertion panic when the Sieve editheader extension was used before the message was redirected. Experiments indicate that the problem occurred only with LMTP and that LDA is not affected. - fileinto extension: Fix assert panic occurring when fileinto is used without being listed in the require line, while the copy extension is listed there. This is a very old bug. - imapsieve plugin: Do not assert crash or log an error for messages that disappear concurrently while applying Sieve scripts. This event is now logged as a debug message. - Sieve extprograms plugin: Large output from "execute" command crashed delivery. Fixed buffering issue in code that handles output from the external program. The release is available as follows: https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.1.ta… https://pigeonhole.dovecot.org/releases/2.3/dovecot-2.3-pigeonhole-0.5.1.ta… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

dovecot logging
by A. Schulze 27 Mar '18

27 Mar '18

Hello, I'm currently playing with a number of dovecot instances to evaluate my "next generation setup" For now I run 6 instances of dovecot, one per docker container: - 2x redirector - 2x backend #1 - 2x backend #2 All docker container use syslog. And there the problems starts. Every instance identify itself as "dovecot" That's not helpful :-/ I tried to set an instance name but that change nothing. My options are now - let rsyslogd separate the sources by IP - use logfiles files Are there other? Currently the code use a fixed string "dovecot": https://github.com/dovecot/core/blob/master/src/lib-master/master-service.c… I would ask if it's possible to use the instance name as syslog identifier, too? Andreas

2 2

Slow imap connection to local dovecot server
by Lothar Paltins 27 Mar '18

27 Mar '18

Hi, this is my setup: OpenSuse tumbleweed dovecot 2.3.0.1 (ffd8a29) thunderbird 52.6.0 I'm running a local dovecot server on my private network to be able to access my saved mails from several computers on the network. The network is behind a firewall, therefore I'm only using plain imap on port 143 with plain text password authentification. But very often the login from thunderbird to the dovecot server takes a very long time, even if thunderbird and dovecot are running on the same machine. It can take more than a minute until I can read a message. I dont't have this problem with the remote imap servers of my mail providers. Does anybody know, why this happens or how I could debug this issue?

2 2

Duplicate mails on pop3 expunge with dsync replication on 2.2.35 (2.2.33.2 works)
by Gerald Galster 27 Mar '18

27 Mar '18

Hello, consider the following setup with dovecot 2.2.35: smtp/587 (subject: test 1535) | | mx2a.example.com --> dsync/ssh --> mx2b.example.com | pop3 fetch/expunge (uid 23) | !! dsync (copy from INBOX -> uid 24) /| dsync (expunge uid 23) / The pop3 client deletes mail from the server which triggers a copy from INBOX before it is expunged. On the next pop3 fetch you get the copy of the mail you thought had been expunged. This occurs only if mail is received by smtp on mx2a, synced to mx2b via dsync/ssh and then expunged via pop3 on mx2b. It does not occur if mail is received and expunged on mx2b. As a temporary workaround the system has been downgraded to 2.2.33.2. There are no duplicate emails after expunge with this version. 2.2.34 has not been tested. Does anyone know if there were changes in the dsync code from 2.2.33.2 to 2.2.35? Log: (mail received on mx2a.example.com and delivered via dsync to mx2b.example.com, then expunged via pop3 on mx2b.example.com -> copy/duplicate) Mar 26 15:35:57 mx2b.example.com dovecot[3825]: pop3-login: Login: user=<poptest(a)example.com>, method=PLAIN, rip=91.0.0.1, lip=188.0.0.1, mpid=3922, TLS, TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits) Mar 26 15:35:58 mx2b.example.com dovecot[3825]: pop3(poptest(a)example.com): expunge: box=INBOX, uid=23, msgid=<ACD482CD-443E-479A-A9E9-67549E186E35(a)example.com>, size=1210, subject=test 1535 Mar 26 15:35:58 mx2b.example.com dovecot[3825]: pop3(poptest(a)example.com): Disconnected: Logged out top=0/0, retr=1/1259, del=1/1, size=1242 Mar 26 15:35:58 mx2b.example.com dovecot[3825]: doveadm: Error: dsync-remote(poptest(a)example.com): Info: copy from INBOX: box=INBOX, uid=24, msgid=<ACD482CD-443E-479A-A9E9-67549E186E35(a)example.com>, size=1210, subject=test 1535 Mar 26 15:35:58 mx2b.example.com dovecot[3825]: doveadm: Error: dsync-remote(poptest(a)example.com): Info: expunge: box=INBOX, uid=23, msgid=<ACD482CD-443E-479A-A9E9-67549E186E35(a)example.com>, size=1210, subject=test 1535 (mail received on mx2b.example.com and expunged via pop3 on mx2b.example.com -> no copy/duplicate) Mar 26 15:36:09 mx2b.example.com dovecot[3825]: pop3-login: Login: user=<poptest(a)example.com>, method=PLAIN, rip=91.0.0.1, lip=188.0.0.1, mpid=3927, TLS, TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits) Mar 26 15:36:09 mx2b.example.com dovecot[3825]: pop3(poptest(a)example.com): expunge: box=INBOX, uid=24, msgid=<ACD482CD-443E-479A-A9E9-67549E186E35(a)example.com>, size=1210, subject=test 1535 Mar 26 15:36:09 mx2b.example.com dovecot[3825]: pop3(poptest(a)example.com): Disconnected: Logged out top=0/0, retr=1/1259, del=1/1, size=1242 Mar 26 15:36:10 mx2b.example.com dovecot[3825]: doveadm: Error: dsync-remote(poptest(a)example.com): Info: expunge: box=INBOX, uid=24, msgid=<ACD482CD-443E-479A-A9E9-67549E186E35(a)example.com>, size=1210, subject=test 1535 Thanks for looking into this Gerald

1 0

BUG: Unknown command in userdb socket: CPID?2625
by Vladimir Tiukhtin 26 Mar '18

26 Mar '18

Hi guys. I am getting strange error: BUG: Unknown command in userdb socket: CPID?2625 I am using service auth to authenticate users on postfix. *My OS*: # cat /etc/os-release NAME="CentOS Linux" VERSION="7 (Core)" ID="centos" ID_LIKE="rhel fedora" VERSION_ID="7" PRETTY_NAME="CentOS Linux 7 (Core)" ANSI_COLOR="0;31" CPE_NAME="cpe:/o:centos:centos:7" HOME_URL="https://www.centos.org/" BUG_REPORT_URL="https://bugs.centos.org/" CENTOS_MANTISBT_PROJECT="CentOS-7" CENTOS_MANTISBT_PROJECT_VERSION="7" REDHAT_SUPPORT_PRODUCT="centos" REDHAT_SUPPORT_PRODUCT_VERSION=" *My dovecot:* # dovecot --version 2.2.10 *My config*: service auth { unix_listener auth-userdb { mode = 0600 user = postfix group = postfix } } *My Postfix:* # rpm -qa | grep postf postfix-2.10.1-6.el7.x86_64 *Log*: Mar 25 16:52:33 mail-server postfix/smtpd[2625]: connect from unknown[10.254.200.202] Mar 25 16:52:33 mail-server dovecot[2621]: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Mar 25 16:52:33 mail-server dovecot[2621]: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Mar 25 16:52:33 mail-server dovecot[2621]: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Mar 25 16:52:33 mail-server dovecot[2621]: auth: Debug: Read auth token secret from /var/run/dovecot//auth-token-secret.dat Mar 25 16:52:33 mail-server dovecot[2621]: auth: Debug: master in: CPID 2625 Mar 25 16:52:33 mail-server dovecot[2621]: auth: Error: BUG: Unknown command in userdb socket: CPID?2625 Mar 25 16:52:33 mail-server postfix/smtpd[2625]: fatal: no SASL authentication mechanisms Mar 25 16:52:34 mail-server postfix/master[2424]: warning: process /usr/libexec/postfix/smtpd pid 2625 exit status 1 Mar 25 16:52:34 mail-server postfix/master[2424]: warning: /usr/libexec/postfix/smtpd: bad command startup -- throttling The interesting thing is IF I am taking off "-" (minus) from the socket name, everything works just perfect! So if I change config to: service auth { unix_listener blabla { mode = 0600 user = postfix group = postfix } } Mar 25 16:55:12 mail-server postfix/smtpd[2872]: connect from unknown[10.254.200.202] Mar 25 16:55:12 mail-server dovecot[2786]: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Mar 25 16:55:12 mail-server dovecot[2786]: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Mar 25 16:55:12 mail-server dovecot[2786]: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Mar 25 16:55:12 mail-server dovecot[2786]: auth: Debug: Read auth token secret from /var/run/dovecot//auth-token-secret.dat Mar 25 16:55:12 mail-server dovecot[2786]: auth: Debug: auth client connected (pid=0) Mar 25 16:55:13 mail-server dovecot[2786]: auth: Debug: client in: AUTH 1 PLAIN service=smtp nologin lip=192.168.101.24 rip=10.254.200.202 secured resp=<hidden> Mar 25 16:55:13 mail-server dovecot[2786]: auth: Debug: cache(admin(a)asergis.com,10.254.200.202): miss Mar 25 16:55:13 mail-server dovecot[2786]: auth-worker(2878): Debug: Loading modules from directory: /usr/lib64/dovecot/auth Mar 25 16:55:13 mail-server dovecot[2786]: auth-worker(2878): Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Mar 25 16:55:13 mail-server dovecot[2786]: auth-worker(2878): Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Mar 25 16:55:13 mail-server dovecot[2786]: auth-worker(2878): Debug: sql(admin(a)asergis.com,10.254.200.202): query: SELECT userid AS username, domain, password FROM users WHERE userid = 'admin' AND domain = 'asergis.com' Mar 25 16:55:13 mail-server dovecot[2786]: auth: Debug: client passdb out: OK 1 user=admin(a)asergis.com Mar 25 16:55:13 mail-server postfix/smtpd[2872]: 5C63030208: client=unknown[10.254.200.202], sasl_method=PLAIN, sasl_username=admin(a)asergis.com Mar 25 16:55:13 mail-server postfix/cleanup[2881]: 5C63030208: message-id=<d7706aa7-a2ad-6890-5590-e6f83b5ec3af(a)asergis.com> Mar 25 16:55:13 mail-server postfix/qmgr[2870]: 5C63030208: from=<admin(a)asergis.com>, size=622, nrcpt=1 (queue active) P.s. I don't mind to use socket without minus on its name. But this looks really strange. Thanks. You are awesome Vladimir

4 9

dsync backuping folders only, not emails
by Istvan Prosinger 26 Mar '18

26 Mar '18

Hi guys, I have an issue when I try to backup a remote mailbox, apparently it exits with no errors, it creates the mailbox folders in local, but it doesn't copy any email. doveadm -Dv -o dsync_features=empty-header-workaround -o imapc_host=secure.emailsrvr.com -o imapc_password='passwd' backup -R -u somemail(a)counselorinberlin.de imapc: Any hints? All the best, Istvan

1 0

Re: How to format auth-worker logs ?
by chaouche yacine 26 Mar '18

26 Mar '18

Hello list, Here's how auth-worker logs : Mar 26 10:56:38 auth-worker(1753): Info: sql(someuser(a)mydomain.tld,202.107.34.250): Password mismatch I would like to add the service used, like this : Mar 26 10:56:38 auth-worker(1753): Info: service=smtp sql(someuser(a)mydomain.tld,202.107.34.250): Password mismatch Any hints on how to acheive this ? Yassine.

1 0

Quota set-up problems
by Marcin Norek 26 Mar '18

26 Mar '18

Hi, I've recently started using Dovecot as our main mail storage, and it's performing great. But I have a question/problems with quotas. First of we are using: dovecot --version 2.2.32 (dfbe293d4) Dovecot is a part of a pre set environment (mailcow-dockerized) Aside the inbox namespace we have set-up an additional archive ns (Archiwum) like this namespace Archiwum { type = private separator = / prefix = Archiwum/ location = maildir:/var/vmail/arch/%n:INDEXPVT=~/Maildir/Archiwum subscriptions = yes list = yes mailbox "Wyslane" { auto = subscribe } } It is on an separate disk array, and works well. The problem is that this namespace and all its sub mailboxes should have different quota then the main storage so the config is like this quota = dict:Userquota::proxy::sqlquota quota2 = maildir:ns=Archiwum quota_rule = Trash:storage=+100% quota2_rule = *:ignore It works.. but not as intender. While mail located directly in the name space are ignored everything in sub mailbox of the Archiwum is still accounted to the main quota. I've been fighting this for some time now and can not find the solution. So help would be appreciated. Regards Marcin

1 0

destuser setting useless on LMTP proxy
by Jan-Pieter Cornet 26 Mar '18

26 Mar '18

I tried setting the "destuser" setting on the LMTP director as follows, to preserve the original envelope rcpt: protocol lmtp { auth_socket_path = director-userdb passdb { driver = ... override_fields = destuser=%{orig_user} } } The passdb driver would return the appropriate "user" for each alias. Suppose, for example, user1 has emails user1(a)domain.tld, but also alias1(a)domain.tld. Now, it turns out that setting the destuser *changes* the backend. It seems that when the passdb returns "destuser", that username is completely ignored and the hashing of the destuser determines the backend chosen. This is incorrect, the backend should be chosen based on the returned "user", and the "destuser" should only be used for the remote login (or rcpt, in case of LMTP). I'm using version 2.2.35. The problem seems to be in lmtp/commands.c, in client_proxy_rcpt_parse_fields, line 281-285 says: } else if (strcmp(key, "user") == 0 || strcmp(key, "destuser") == 0) { /* changing the username */ *address = value; } ... So it looks as if "user" and "destuser" are treated equally in the LMTP proxy. -- Jan-Pieter Cornet <johnpc(a)xs4all.net> Systeembeheer XS4ALL Internet bv www.xs4all.nl

2 1

Config problem: Service #0 is missing name
by Chris Ross 25 Mar '18

25 Mar '18

Okay. So following up on the problems I was discussing weeks ago, I have hand-patched dovecot to work around problems that I believe may be in libc and not dovecot. Trying to get the properly built and installed dovecot-2.2.35, however, is giving me an error I haven’t seen before. I presume that something got munged while I was hand-configuring and installing/uninstalling/reinstalling the port in recent weeks. Running on a FreeBSD 11-stable machine, when I run “service dovecot start”, it tells me: % sudo service dovecot start Starting dovecot. Fatal: Error reading configuration: Invalid settings: Service #0 is missing name /usr/local/etc/rc.d/dovecot: WARNING: failed to start dovecot % Surprisingly, googling for “Service #0 is missing name” didn’t yield a suggestion. My config is the same as it had been previously, I believe. Does anyone have an idea what might be wrong here? Thanks. - Chris

2 2

Config problem: Service #0 is missing name
by Chris Ross 25 Mar '18

25 Mar '18

Okay. So following up on the problems I was discussing weeks ago, I have hand-patched dovecot to work around problems that I believe may be in libc and not dovecot. Trying to get the properly built and installed dovecot-2.2.35, however, is giving me an error I haven’t seen before. I presume that something got munged while I was hand-configuring and installing/uninstalling/reinstalling the port in recent weeks. Running on a FreeBSD 11-stable machine, when I run “service dovecot start”, it tells me: % sudo service dovecot start Starting dovecot. Fatal: Error reading configuration: Invalid settings: Service #0 is missing name /usr/local/etc/rc.d/dovecot: WARNING: failed to start dovecot % Surprisingly, googling for “Service #0 is missing name” didn’t yield a suggestion. My config is the same as it had been previously, I believe. Does anyone have an idea what might be wrong here? Thanks. - Chris

1 0

recipient delimiter and sieve filters
by André Rodier 24 Mar '18

24 Mar '18

Dear all, I have found a way to automatically copy sent emails in the "Sent" folder, but I am not sure it is the simplest and more reliable way on the long term. I am open to suggestions if I miss a feature in Dovecot - or Postfix, that allows me to do this. I vaguely remember an SMTP extension that do that, but my memory could be wrong. First, I use "~" as a recipient delimiter. Then, I set up a postfix senders_bcc_map that add the ~Sent part: andre(a)homebox.space → bcc: andre~Sent(a)homebox.space It worked, except that the emails was marked as new. I tried first to add a global sieve filter like this: ---------------------------------------------------------------------- # Sieve script executed before for user require ["fileinto","imap4flags"]; # Move automatically copied emails to the sent folder # And mark them as read if header :contains "Delivered-To" "~Sent" { setflag "\\Seen"; fileinto "Sent"; } ---------------------------------------------------------------------- But it did not work, so maybe there is a trick I am not aware of. If I use the "Received" header and a regex, it works ---------------------------------------------------------------------- require ["fileinto","imap4flags","regex"]; if header :regex "Received" "for <[a-z]+~Sent(a)homebox.space>;" { setflag "\\Seen"; fileinto "Sent"; } ---------------------------------------------------------------------- This is working perfectly, but there is limitations, IMHO. - If the recipient delimiter is not compatible with a regex (e.g. "+"), then the script will probably fail. - Parsing every new email using a regular expression might not be the best option in term of system load. So, I finally use this: ---------------------------------------------------------------------- # Move automatically copied emails to the sent folder # And mark them as read require ["fileinto","imap4flags"]; if header :contains "Received" "~Sent" { setflag "\\Seen"; fileinto "Sent"; } ---------------------------------------------------------------------- My question is why the first one does not work? Does the email has been moved to the Sent folder, and dovecot sieve plugin is not able to find the email any more? Kind regards, André -- https://github.com/progmaticltd/homebox

2 2

lmtp service timeouting even after receiving full message
by Arkadiusz Miśkiewicz 23 Mar '18

23 Mar '18

I have a problem with some messages passed from exim to dovecot lmtp service: From exim debug: using socket /var/run/dovecot/lmtp LMTP<< 220 mbox8 ready LMTP>> LHLO mbox8... LMTP<< 250-mbox8 LMTP<< 250-STARTTLS LMTP<< 250-8BITMIME LMTP<< 250-ENHANCEDSTATUSCODES LMTP<< 250 PIPELINING LMTP>> MAIL FROM:... LMTP<< 250 2.1.0 OK LMTP>> RCPT TO:... LMTP<< 250 2.1.5 OK LMTP>> DATA LMTP<< 354 OK LMTP>> writing message and terminating "." cannot use sendfile for body: terminating dot wanted writing data block fd=6 size=6585 timeout=300 LMTP>> QUIT LMTP<< 421 4.4.2 mbox8 Disconnected client for inactivity now above "writting message and terminating" according to exim strace looks like this: 13413 22:07:24 write(2, " LMTP>> writing message and terminating \".\"\n", 45) = 45 <0.000018> 13413 22:07:24 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2705, ...}) = 0 <0.000025> 13413 22:07:24 write(2, "cannot use sendfile for body: terminating dot wanted\n", 53) = 53 <0.000022> 13413 22:07:24 lseek(3, 19, SEEK_SET) = 19 <0.000015> [...] 13413 22:07:24 write(2, "writing data block fd=6 size=6585 timeout=300\n", 46) = 46 <0.000019> 13413 22:07:24 alarm(300) = 0 <0.000013> 13413 22:07:24 write(6, "Return-path: [...] \nwrap\"><br></span></div>.\n", 6585) = 6585 <0.000023> and then exim waits for dovecot lmtp to say it accepted message but lmtp never does that. Isn't .\n always enough for dovecot to signal end of message? Because exim wrote full message to dovecot lmtp unix socket. Now the interesting this - exim does only one write() with 6585 bytes to write that message to lmtp. If exim needs more than one write() to do that (message is larger by some buffer) then it succeeds, dovecot accepts it. Could dovecot lmtp handling for single write() case be broken? dovecot 2.2.35 -- Arkadiusz Miśkiewicz, arekm / ( maven.pl | pld-linux.org )

2 4

Dovecot replication does not replicate subscription in shared mailboxes
by Ralf Becker 23 Mar '18

23 Mar '18

We use a pair of replicating Dovecot servers. If a user subscribes to a folder, shared by an other user, in one replica, that does not get replicated to the other node. Subscription of regular folders below INBOX seem to replicate correctly. Is that a general bug, a known problem or do we need to enable that somehow. Here's our configuration for the concerned namespace: namespace users { location = mdbox:%%h/mdbox:INDEXPVT=~/shared/%%u prefix = user/%%n/ separator = / subscriptions = no type = shared } I attached the full doveconf -n. Thanks for any points :) Ralf -- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0

1 0

How to stop sieve processing to skip sieve_after scripts ?
by Mr Nicolas Belan 23 Mar '18

23 Mar '18

Hello the list, I am trying to achieve filter processing using sieve, but i am not sure I can do what I want. I want to let the user decide to use my filtering script (sieve_after) or not.According to the documentation, i am trying to stop processing in user sieve script, but processing continue. I am using dovecot 2.2 (CentOS). My sieve configuration is:plugin { sieve = /var/vmail/%d/%n/%n.sieve sieve_before = /etc/dovecot/sieve/global-before sieve_after = /etc/dovecot/sieve/global [...]} 'sieve' is the filter script created by users. When trying to stop processing, it is generated by roundcube like:# rule:[deliver to mailbox] if anyof (true) { stop; } 'sieve_after' is the filter which handles the spam processing (fileinto Junk). But the processing continue until all sieve filters are processed: Mar 22 14:50:23 lda(user(a)example.com): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt=Mar 22 14:50:23 lda(user(a)example.com): Debug: Destination address: user(a)example.com (source: -a parameter) Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: Pigeonhole version 0.4.2 initializing Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: executed before user's personal Sieve script(1): /etc/dovecot/sieve/global-before Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: using the following location for user's Sieve script: /var/vmail/example.com/user/user.sieve;name=main script Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: executed after user's Sieve script(3): /etc/dovecot/sieve/global Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: opening script 1 of 3 from /etc/dovecot/sieve/global-before Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: loading script /etc/dovecot/sieve/global-before Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: script binary /etc/dovecot/sieve/global-before.svbin successfully loaded Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: binary save: not saving binary /etc/dovecot/sieve/global-before.svbin, because it is already stored Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: executing script from /etc/dovecot/sieve/global-before.svbin Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: opening script 2 of 3 from /var/vmail/example.com/user/user.sieve;name=main script Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: loading script /var/vmail/example.com/user/user.sieve;name=main script Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: script binary /var/vmail/example.com/user/user.svbin successfully loaded Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: binary save: not saving binary /var/vmail/example.com/user/user.svbin, because it is already stored Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: executing script from /var/vmail/example.com/user/user.svbin Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: opening script 3 of 3 from /etc/dovecot/sieve/global Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: loading script /etc/dovecot/sieve/global Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: script binary /etc/dovecot/sieve/global.svbin successfully loaded Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: binary save: not saving binary /etc/dovecot/sieve/global.svbin, because it is already stored Mar 22 14:50:23 lda(user(a)example.com): Debug: sieve: executing script from /etc/dovecot/sieve/global.svbin Mar 22 14:50:23 lda(user(a)example.com): Debug: Namespace : Using permissions from /var/vmail/example.com/user/Maildir: mode=0700 gid=default Mar 22 14:50:23 lda(user(a)example.com): Info: sieve: msgid=<cm.0045046409888.jyshukd.kidudykyhi.r(a)cmail19.com>: stored mail into mailbox 'Courrier indésirable' I would like to stop processing afterMar 22 14:50:23 lda(user(a)example.com): Debug: sieve: using the following location for user's Sieve script: /var/vmail/example.com/user/user.sieve;name=main scriptAt the end, I do not want mail to be delivered into Junk, but into INBOX.. Is it possible ? Perhaps a sieve, sieve2 setting exists ? (like sieve_before, sieve_before2 ...) Thank you for your help, ideas :) Best regards, Nicolas

3 5

limit pop login per user and per minute
by Markus Eckerl 23 Mar '18

23 Mar '18

Hi, like I have written in the subject line I want to limit the pop login per user and per minute. Currently I am having several customers which are fetching their email with popcon (MS Exchange). This has never been a problem. But... They all have got the same "technician" which take care of their systems. The problem is, that he misconfigured the servers of these customers. In detail: their servers are trying to fetch email every 2 - 5 seconds. For every email address. In the past I contacted the technician and told him about his mistake. He was not very helpful and simply told me that he is doing the same configuration since several years at all of his customer servers. Without problems. It is up to me to fix my problem myself. Well, I googled a lot but all I found is to limit for a specific IP or for a secific account. Both is not what I am looking for. Maybe someone can give me a hint? Thanks and kind regards Markus -- stairweb GmbH Firmensitz: Gutenbergstr. 8, 94036 Passau Telefon: +49 (0)851 / 20426650 Telefax: +49 (0)851 / 20426655 e-Mail: info(a)stairweb.de Internet: www.stairweb.de Registergericht: Amtsgericht Passau, HRB 6044 Geschäftsführer: Markus Eckerl, Karl Preißler, Alexander Lengl

4 4

why is dovecot "Allowing any password"
by mj 22 Mar '18

22 Mar '18

Hi, I noticed the following in the logs of our debian wheezy server: > Mar 21 07:13:47 mail dovecot: auth: Debug: ldap(username,1.2.3.4,<g2/rF+ZnjAAu5ceg>): bind search: base=CN=Users, DC=samba, DC=company, DC=com filter=(&(objectclass=person)(sAMA > ccountName=username)(!(userAccountControl=514))) > Mar 21 07:13:47 mail dovecot: auth: Debug: ldap(username,1.2.3.4,<g2/rF+ZnjAAu5ceg>): result: uid=username; uid unused > Mar 21 07:13:47 mail dovecot: auth: Debug: ldap(username,1.2.3.4,<g2/rF+ZnjAAu5ceg>): result: uid=username > Mar 21 07:13:48 mail dovecot: auth: ldap(username,1.2.3.4,<g2/rF+ZnjAAu5ceg>): invalid credentials (given password: invalid_password) > Mar 21 07:13:48 mail dovecot: auth: Debug: static(username,1.2.3.4,<g2/rF+ZnjAAu5ceg>): lookup > Mar 21 07:13:48 mail dovecot: auth: Debug: static(username,1.2.3.4,<g2/rF+ZnjAAu5ceg>): allow_nets: Matching for network 127.0.0.1/32 > Mar 21 07:13:48 mail dovecot: auth: static(username,1.2.3.4,<g2/rF+ZnjAAu5ceg>): allow_nets check failed: IP not in allowed networks > Mar 21 07:13:48 mail dovecot: auth: Debug: static(username,1.2.3.4,<g2/rF+ZnjAAu5ceg>): Allowing any password > Mar 21 07:13:54 mail dovecot: auth: Debug: auth client connected (pid=6174) The line second last line "Allowing any password" comes as a surprise..? Why would dovecot Allow any password..? We had the following bit in our config, but I removed it now: > #passdb { > # driver = static > # args = nopassword=y allow_nets=127.0.0.1/32 > #} Could anyone expain the "Allowing any password"? And lastly our current doveconf -n: > # 2.2.13: /etc/dovecot/dovecot.conf > # OS: Linux 3.2.0-5-amd64 x86_64 Debian 7.11 xfs > auth_debug = yes > auth_debug_passwords = yes > auth_failure_delay = 10 secs > auth_master_user_separator = * > auth_mechanisms = plain login > auth_username_format = %Ln > auth_verbose = yes > auth_verbose_passwords = plain > deliver_log_format = %f | %s | msgid=%m: %$ > disable_plaintext_auth = no > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > login_greeting = Dovecot ready. > mail_gid = vmail > mail_location = maildir:/var/vmail/%Ln/Maildir:LAYOUT=fs:DIRNAME=mAildir > mail_plugins = acl lazy_expunge zlib quota mail_log notify > mail_uid = vmail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave > namespace { > list = children > location = maildir:/var/vmail/%%u/Maildir:LAYOUT=fs:DIRNAME=mAildir:INDEX=/var/vmail/%u/shared/%%u > prefix = shared/%%n/ > separator = / > subscriptions = no > type = shared > } > namespace inbox { > inbox = yes > location = > mailbox "Deleted items" { > special_use = \Trash > } > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent items" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > mailbox inbox { > auto = subscribe > } > prefix = > separator = / > type = private > } > passdb { > args = /etc/dovecot/master-users > driver = passwd-file > master = yes > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > acl = vfile > acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db > mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename append > mail_log_fields = uid box msgid from subject > quota = maildir > quota_rule = ?:storage=5G > quota_rule2 = Trash:storage=+100M > quota_warning = storage=97%% quota-warning 97 %u > quota_warning2 = storage=95%% quota-warning 95 %u > quota_warning3 = storage=90%% quota-warning 90 %u > quota_warning4 = storage=85%% quota-warning 85 %u > quota_warning5 = storage=80%% quota-warning 80 %u > quota_warning6 = -storage=100%% quota-warning below %u > sieve = ~/.dovecot.sieve > sieve_default = /var/lib/dovecot/default.sieve > sieve_dir = ~/sieve > } > protocols = imap lmtp sieve > service auth { > unix_listener /var/spool/postfix/private/auth { > mode = 0666 > } > unix_listener auth-userdb { > group = vmail > mode = 0666 > user = vmail > } > } > service imap-login { > process_limit = 500 > process_min_avail = 2 > } > service quota-warning { > executable = script /usr/local/bin/quota-warning.sh > unix_listener quota-warning { > user = vmail > } > user = dovecot > } > shutdown_clients = no > ssl_ca = </etc/ssl/letsencrypt/fullchain.pem > ssl_cert = </etc/ssl/letsencrypt/cert.pem > ssl_key = </etc/ssl/letsencrypt/key.pem > ssl_protocols = !SSLv2 !SSLv3 > userdb { > args = uid=vmail gid=vmail home=/var/vmail/%n allow_all_users=yes > driver = static > } > verbose_proctitle = yes > protocol lda { > mail_plugins = acl lazy_expunge zlib quota mail_log notify sieve quota > } > protocol imap { > imap_max_line_length = 2 M > mail_max_userip_connections = 30 > mail_plugins = acl lazy_expunge zlib quota mail_log notify imap_quota imap_acl > } MJ

4 16

dovecot-uidlist is not up-to-date
by Dmitry Filonov 22 Mar '18

22 Mar '18

Hi, Am using dovecot-2.2.10-8 on Centos-7 and everything seemed to be totally fine for many years. Now am trying to migrate our on-premises mail server to the cloud and I had to get some statistics. I was doing that using the doveadm utility. Unfortunately I found that the numbers don't match if I check the real messages in my Maildirs. For some account doveadm was reporting number of messages but that account didn't have any messages stored at all. So I looked a bit further and found that doveadm utility reports data form indexes and indexes are built using dovecot-uidlist data. For quite some folders these files have way more data than actual mailbox has. For example, my personal Inbox has 569 messages but dovecot-uidlist has 716 entries. I don't know when and how that happened but this happens a lot on many different mailboxes on my server. I never touched dovecot-uidlist files outside of dovecot. I might have removed messages from Maildirs though, but not at this scale. Now the question is if there's any way to tell dovecot to rebuild dovecot-uidlist files using actual Maildir data. I don't want to remove dovecot-uidlist files as this triggers the whole mailbox being re-downloaded by the imap client. With some accounts having over 100Gb of mail this is too much of a hassle. I just need dovecot itself to fix it's data. Thanks, Fil -- Dmitry Filonov Network Analyst 300 Longwood Ave. Enders-1262.2 Boston, MA 02115 617-919-4702

3 4

"failed to map segment from shared object" in sieve pipe
by Dorian Taylor 22 Mar '18

22 Mar '18

Hello, I have encountered a problem attempting to run a program in a sieve pipe. The program is a Perl script that loads a number of binary (XS) modules at runtime. The program crashes, it appears, if it tries to load too many. The (non-Perl part of the) error message is "failed to map segment from shared object” — no additional information. Cryptic error messages like this have the odour of imposed resource restrictions, so I’m wondering if there are any on the pipe/filter/execute implementation (e.g. via program_client_run). Any configuration knobs I can twiddle? Any insights for debugging? PS this is the dovecot 2.2.22 (fe789d2), the one that ships with Ubuntu Xenial. Regards, -- Dorian Taylor Make things. Make sense. https://doriantaylor.com

3 4

Fwd: Fwd: Everything works except sending mail
by Armin Tangelder 21 Mar '18

21 Mar '18

(Sorry Aki I send it wrong the first time, I feel like a n00b) ---------- Forwarded message ---------- From: Armin Tangelder <a.tangelder(a)gmail.com> Date: Tue, Mar 20, 2018 at 3:25 PM Subject: Re: Fwd: Everything works except sending mail To: Aki Tuomi <aki.tuomi(a)dovecot.fi> Hi Aki, Mij postfix is sending and receiving mail. it might be an issue between Postfix and Dovecot. That is why I'm asking if one of the more experienced guru's ever did see something like this. A mail doesn't even reach the Postfix queue. And in paralel, I'm with this on postfix forums to take a look as well. But as Postfix probably is not discussed here I kept it to Dovecot only. But based on the dovecot -n you see anything wrong? Thnx, Armin Tangelder -- Very funny scotty, now beam down my clothes. On Tue, Mar 20, 2018 at 12:13 PM, Aki Tuomi <aki.tuomi(a)dovecot.fi> wrote: > This sounds more like postfix problem. > > Aki > > On 20.03.2018 13:04, Armin Tangelder wrote: > > Hi people, > > > > Version of my beloved Dovecot installation: > > 2.2.27 (c0f36b0) > > > > I moved from a OS X server to a Linux (Ubuntu) Headless server. > All fun and good to play around with. Love almost everything. > > In the combination with Postfix and Dovecot I’m stuck to despair into > oblivion. > > > > Everything works except I cannot send mail from my (OS X) Outlook client I > keep getting: > > > > Connection to the server failed or was dropped. Error Code -3253 > > > > Nothing More and nothing less. O do not get any other error in a logfile > or anything. > And I followed almost every installation manual I found. Postfix I can > send and receive through telnet. > But I just can’t get this to work… > > The mail doesn’t even reach Postfix queue as I cannot connect to send. > I do have a awesome connection receiving my mail though ☺ > > Anyway: > > dovecot -n gives this (and I probably don’t see it anymore as I’ve been at > this for several days now) > > # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf > > # Pigeonhole version 0.4.16 (fed8554) > > # OS: Linux 4.13.0-37-generic x86_64 Ubuntu 17.10 > > auth_mechanisms = plain login > > auth_realms = formule1.demon.nl > > login_greeting = Dovecot ready. > > mail_location = maildir:~/Maildir > > mail_max_userip_connections = 50 > > namespace inbox { > > inbox = yes > > location = > > mailbox Drafts { > > special_use = \Drafts > > } > > mailbox Junk { > > special_use = \Junk > > } > > mailbox Sent { > > special_use = \Sent > > } > > mailbox "Sent Messages" { > > special_use = \Sent > > } > > mailbox Trash { > > special_use = \Trash > > } > > prefix = > > } > > passdb { > > driver = pam > > } > > protocols = imap > > service auth { > > unix_listener /var/spool/postfix/private/auth { > > group = postfix > > mode = 0666 > > user = postfix > > } > > } > > ssl_cert = </etc/ssl/certs/server.crt > > ssl_key = # hidden, use -P to show it > > userdb { > > driver = passwd > > } > > > > Anything useful I would love to see. > Any information needed. > > > > THNKS… > > > > Armin > > -- > > Very funny Scotty, now beam down my clothes… > > >

1 1

v2.2.35 released
by Aki Tuomi 21 Mar '18

21 Mar '18

https://dovecot.org/releases/2.2/dovecot-2.2.35.tar.gz https://dovecot.org/releases/2.2/dovecot-2.2.35.tar.gz.sig - charset_alias: compile fails with Solaris Studio, reported by John Woods. - Fix local name handling in v2.2.34 SNI code, bug found by cPanel. - imapc: Don't try to add mails to index if they already exist there. - imapc: If email is modified in istream_opened hook, mail size isn't updated. - lib-dcrypt: When reading encrypted data, more data would not be read if buffer was not consumed causing panic or hang. - notify: When notify plugin is used and transaction commit fails in dsync, crash occurs. - sdbox: When delivering to a mailbox that is over quota, temp files are not cleaned up when saving or copying fails.

3 4

dovecot caching decisions
by Sivathmican Sivakumaran 21 Mar '18

21 Mar '18

Hello guys, Should the following configuration: mail_cache_fields = flags,imap.body,imap.bodystructure mail_always_cache_fields = imap.body,imap.bodystructure have an effect on the following command? doveadm index -u bob INBOX It seems to have no effect for some reason. Regards, Siva

1 0

pylori error in dovecot log
by ＠lbutlr 21 Mar '18

21 Mar '18

I am getting the following in my /var/log/dovecot: Error: sieve: Execution of script /usr/lib/dovecot/sieve/report-spam.sieve failed Error: plugin: failed to parse plugin (from @INC): Can't locate Mail/SpamAssassin/Plugin/Razor.pm in @INC (you may need to install the Mail::SpamAssassin::Plugin::Razor module) (@INC contains: /usr/local/lib/perl5/site_perl /usr/local/lib/perl5/site_perl/mach/5.24 /usr/local/lib/perl5/5.24/mach /usr/local/lib/perl5/5.24) at (eval 44) line 1. Error: program `/usr/lib/dovecot/sieve/sa-learn-spam.sh' was forcibly terminated with signal 15 Error: sieve: pipe action: failed to pipe message to program `sa-learn-spam.sh': refer to server log for more information. [2018-03-19 12:52:51] Info: sieve: left message in mailbox 'Junk'

2 4

Compiling from sources and security contexts (dovecot_selinux)
by TraxOnDaRocks 20 Mar '18

20 Mar '18

Hi, installation by prebuilt binaries creates security contexts on each file (as shown here https://linux.die.net/man/8/dovecot_selinux) so that dovecot integrates perfectly in SELinux. I've compiled instead from sources (as described here https://wiki2.dovecot.org/CompilingSource) and i'd like to know how create same security contexts of prebuilt binaries to have an identical behaviour in SELinux. Thank you

1 0

Permissions on /var/log/dovecot
by ＠lbutlr 20 Mar '18

20 Mar '18

/var/log/dovecot exists and has a lot of logging in it, but I get errors (in mail.log) on an always_bcc action in postfix: mail postfix/pipe[13015]: 401cvS0R8BzbSkL: to=<backup+073.kremels-kreme(a)doamin.tld>, relay=dovecot, delay=398058, delays=398045/13/0/0.04, dsn=4.3.0, status=deferred (temporary failure. Command output: Can't open log file /var/log/dovecot: Permission denied ) What should the permissions on /var/log/dovecot be? (they are 640 root:wheel on FreeBSD, identical to mail.log)

5 10

Fwd: Everything works except sending mail
by Armin Tangelder 20 Mar '18

20 Mar '18

Hi people, Version of my beloved Dovecot installation: 2.2.27 (c0f36b0) I moved from a OS X server to a Linux (Ubuntu) Headless server. All fun and good to play around with. Love almost everything. In the combination with Postfix and Dovecot I’m stuck to despair into oblivion. Everything works except I cannot send mail from my (OS X) Outlook client I keep getting: Connection to the server failed or was dropped. Error Code -3253 Nothing More and nothing less. O do not get any other error in a logfile or anything. And I followed almost every installation manual I found. Postfix I can send and receive through telnet. But I just can’t get this to work… The mail doesn’t even reach Postfix queue as I cannot connect to send. I do have a awesome connection receiving my mail though ☺ Anyway: dovecot -n gives this (and I probably don’t see it anymore as I’ve been at this for several days now) # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.13.0-37-generic x86_64 Ubuntu 17.10 auth_mechanisms = plain login auth_realms = formule1.demon.nl login_greeting = Dovecot ready. mail_location = maildir:~/Maildir mail_max_userip_connections = 50 namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } ssl_cert = </etc/ssl/certs/server.crt ssl_key = # hidden, use -P to show it userdb { driver = passwd } Anything useful I would love to see. Any information needed. THNKS… Armin -- Very funny Scotty, now beam down my clothes…

3 2

Accentuated email addresses stored in LDAP
by André Rodier 20 Mar '18

20 Mar '18

Hello everyone, I have successfully set up Dovecot with an LDAP backend, and everything works like a charm, except one small use case. I know it is possible, so if anyone knows a solution, thank you! Basically, I just want to send an email to one of my email address, which contains an accent, i.e. andré(a)homebox.space.... Every other alias works, but not those with accents. They are correctly stored in the LDAP database, using base64. I suspect I would need to use base64 again before the lookup, but I don't know how to do and if it is even possible. My filter is set up as this: filter=(&(objectClass=posixAccount)(|(uid=%n)(mail=%u)(mailLocalAddress=%u))) It works perfectly for any email without accent. Thanks for your help. > Mar 18 22:14:28 homebox dovecot[24636]: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth > Mar 18 22:14:28 homebox dovecot[24636]: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth > Mar 18 22:14:28 homebox dovecot[24636]: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so > Mar 18 22:14:28 homebox dovecot[24636]: auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat > Mar 18 22:14:28 homebox dovecot[24636]: auth: Debug: LDAP initialization took 7 msecs > Mar 18 22:14:28 homebox dovecot[24636]: auth: Debug: auth client connected (pid=0) > Mar 18 22:14:28 homebox dovecot[24636]: quota-status(andré(a)homebox.space): Debug: Loading modules from directory: /usr/lib/dovecot/modules Mar 18 22:14:28 homebox dovecot[24636]: quota-status(andré(a)homebox.space): Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so > Mar 18 22:14:28 homebox dovecot[24636]: auth: Debug: master in: USER 1 andré(a)homebox.space service=quota-status > Mar 18 22:14:28 homebox dovecot[24636]: auth: Debug: ldap(andré(a)homebox.space): user search: base=dc=homebox,dc=space scope=subtree filter=(&(objectClass=posixAccount)(|(uid=andré)(mailLocalAddress=andré(a)homebox.space))) fields=homeDirectory,uidNumber,gidNumber,mail > Mar 18 22:14:28 homebox dovecot[24636]: auth: Debug: ldap(andré(a)homebox.space): no fields returned by the server > Mar 18 22:14:28 homebox dovecot[24636]: auth: ldap(andré(a)homebox.space): unknown user > Mar 18 22:14:28 homebox dovecot[24636]: auth: Debug: userdb out: NOTFOUND 1 > Mar 18 22:14:28 homebox dovecot[24636]: quota-status(andré(a)homebox.space): Debug: auth USER input: > Mar 18 22:14:28 homebox postfix/smtpd[24734]: NOQUEUE: reject: RCPT from smtpfr.rodier.me[164.132.53.161]: 554 5.7.1 <andré(a)homebox.space>: Recipient address rejected: Unknown user; from=<root(a)smtpuk.rodier.me> to=<andré(a)homebox.space> pro > to=ESMTP helo=<smtpuk.rodier.me> > Mar 18 22:14:28 homebox postfix/smtpd[24734]: disconnect from smtpfr.rodier.me[164.132.53.161] ehlo=1 mail=1 rcpt=0/1 data=0/1 rset=1 quit=1 commands=4/6

5 8

Strange "IMAP connection broken (server response)" errors
by Jozsef Kadlecsik 20 Mar '18

20 Mar '18

Hello, We upgraded one of our dovecot servers to debian stretch with dovecot 2.2.27 and since then one of our users has been experiencing random IMAP failures. We enabled raw logging at the server side and it shows normal IMAP commands/responses: 1507292522.222427 * 6 FETCH (FLAGS () BODYSTRUCTURE ("text" "plain" ("charset" "us-ascii") NIL NIL "7bit" 4645 112 NIL NIL NIL NIL)) 1507292522.222653 00000011 OK Fetch completed (0.006 + 0.000 secs). On the client side the user runs alpine and the corresponding debug lines: IMAP DEBUG 14:22:02.216167: 00000011 FETCH 6 (BODYSTRUCTURE FLAGS) 14:22:02.217396 IMAP 14:22:02 10/6 mm_notify bye: {[127.0.0.1]:1555/imap/user="ha4aa"}INBOX: [CLOSED] IMAP connection broken (server response) 14:22:02.217471 IMAP 14:22:02 10/6 mm_log error: [CLOSED] IMAP connection broken (server response) The "[127.0.0.1]:1555/imap/user="ha4aa" part in the log comes from an socat inserted between the client and the server to check independetly the imap session. According to socat, the server response didn't reach the client!: 00000010 OK Fetch completed (0.005 + 0.000 secs).\r > 2017/10/06 14:22:02.216299 length=40 from=845 to=884 00000011 FETCH 6 (BODYSTRUCTURE FLAGS)\r and here ends the socat log, the server response didn't reach the client. The same alpine package is used against older dovecot servers from debian jessie and works flawlessly. The server and client are both KVM guests and there's no any content filtering software between them. There's no corresponding error in the dovecot log file and dovecot didn't regard the connection broken and detected client close: ... Oct 6 14:19:44 mail2 dovecot: imap(ha4aa): Debug: Mailbox INBOX: Opened mail UID=55244 because: MIME part Oct 6 14:22:02 mail2 dovecot: imap(ha4aa): Connection closed in=797 out=73151 We are out of the ideas what can be the reason for the random lost server responses. Any help is appreciated! Best regards, Jozsef -- E-mail : kadlecsik.jozsef(a)wigner.mta.hu PGP key: http://www.kfki.hu/~kadlec/pgp_public_key.txt Address: Wigner Research Centre for Physics, Hungarian Academy of Sciences H-1525 Budapest 114, POB. 49, Hungary

3 3

Released Pigeonhole v0.4.23 for Dovecot v2.2.35.
by Stephan Bosch 20 Mar '18

20 Mar '18

Hello Dovecot users, Here is a new Pigeonhole release that goes with the new Dovecot v2.2.35 release. This release is not strictly necessary, as previous versions should be usable as well. This release only contains bug fixes. However, considering the rather nasty editheader bug that emerged in the previous release, upgrade is recommended. Changelog v0.4.23: - editheader extension: Corrected the stream position calculations performed while making the modified message available as a stream. Pigeonhole Sieve crashed in LMTP with an assertion panic when the Sieve editheader extension was used before the message was redirected. Experiments indicate that the problem occurred only with LMTP and that LDA is not affected. - fileinto extension: Fix assert panic occurring when fileinto is used without being listed in the require line, while the copy extension is listed there. This is a very old bug. - imapsieve plugin: Do not log an error for messages that disappear concurrently while applying Sieve scripts. This is a further improvement on the imapsieve fix in the previous release (which fixed a panic). This event is now logged as a debug message. The release is available as follows: https://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.23.t… https://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.23.t… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

Fts solr and https
by Alex 19 Mar '18

19 Mar '18

Hi, Dovecot 2.2.32-34 FreeBSD 10.4 Solr 7.2.1(Centos 6) When I try to use https to connect to solr, I get error when a self-signed certificate: Mar 3 05:15:47 server dovecot: indexer-worker(email(a)domain.com): Received invalid SSL certificate: self signed certificate: /C=Country/ ST=State/L=Location/O=Organization/OU=Organizational Unit/CN=solr.domain.com Mar 3 05:15:47 server dovecot: indexer-worker(email(a)domain.com): Received invalid SSL certificate: self signed certificate: /C=Country/ ST=State/L=Location/O=Organization/OU=Organizational Unit/CN=solr.domain.com Mar 3 05:15:47 server dovecot: indexer-worker(email(a)domain.com): Error: fts_solr: Indexing failed: SSL handshaking with 1.1.1.1: 8983 failed: read(SSL 1.1.1.1:8983) failed: Received invalid SSL certificate: self signed certificate: /C=Country/ST=State/L=L ocation/O=Organization/OU=Organizational Unit/CN=solr.domain.com (2 attempts in 0.043 secs) Mar 3 05:15:47 server dovecot: indexer-worker(email(a)domain.com): Received invalid SSL certificate: self signed certificate: /C=Country/ ST=State/L=Location/O=Organization/OU=Organizational Unit/CN=solr.domain.com Mar 3 05:15:47 server dovecot: indexer-worker(email(a)domain.com): Received invalid SSL certificate: self signed certificate: /C=Country/ ST=State/L=Location/O=Organization/OU=Organizational Unit/CN=solr.domain.com Mar 3 05:15:47 server dovecot: indexer-worker(email(a)domain.com): Error: fts_solr: Indexing failed: SSL handshaking with 1.1.1.1: 8983 failed: read(SSL 1.1.1.1:8983) failed: Received invalid SSL certificate: self signed certificate: /C=Country/ST=State/L=L ocation/O=Organization/OU=Organizational Unit/CN=solr.domain.com (2 attempts in 0.430 secs) Mar 3 05:15:47 server dovecot: indexer-worker(email(a)domain.com): Error: Mailbox INBOX: Transaction commit failed: FTS transaction commi t failed: backend deinit (attempted to index 1 messages (UIDs 799975..799975)) or error when letsencrypt: Mar 3 01:26:31 server dovecot: indexer-worker(email(a)domain.com): Received invalid SSL certificate: unable to get local issuer certifi cate: /C=US/O=Let\\\'s Encrypt/CN=Let\\\'s Encrypt Authority X3 Mar 3 01:26:31 server dovecot: indexer-worker(email(a)domain.com): Received invalid SSL certificate: unable to get local issuer certifi cate: /C=US/O=Let\\\'s Encrypt/CN=Let\\\'s Encrypt Authority X3 Mar 3 01:26:31 server dovecot: indexer-worker(email(a)domain.com): Error: fts_solr: Indexing failed: SSL handshaking with 1.1.1.1 3:8983 failed: read(SSL 1.1.1.1:8983) failed: Received invalid SSL certificate: unable to get local issuer certificate: /C=US/ O=Let\\\'s Encrypt/CN=Let\\\'s Encrypt Authority X3 (2 attempts in 0.085 secs) Mar 3 01:26:31 server dovecot: indexer-worker(email(a)domain.com): Received invalid SSL certificate: unable to get local issuer certifi cate: /C=US/O=Let\\\'s Encrypt/CN=Let\\\'s Encrypt Authority X3 Mar 3 01:26:31 server dovecot: indexer-worker(email(a)domain.com): Received invalid SSL certificate: unable to get local issuer certifi cate: /C=US/O=Let\\\'s Encrypt/CN=Let\\\'s Encrypt Authority X3 Mar 3 01:26:31 server dovecot: indexer-worker(email(a)domain.com): Error: fts_solr: Indexing failed: SSL handshaking with 1.1.1.1 3:8983 failed: read(SSL 1.1.1.1:8983) failed: Received invalid SSL certificate: unable to get local issuer certificate: /C=US/ O=Let\\\'s Encrypt/CN=Let\\\'s Encrypt Authority X3 (2 attempts in 0.112 secs) Mar 3 01:26:31 server dovecot: indexer-worker(email(a)domain.com): Error: Mailbox INBOX: Transaction commit failed: FTS transaction com mit failed: backend deinit (attempted to index 1 messages (UIDs 104770..104770)) 90-plugins.conf: fts_autoindex=yes fts = solr fts_solr = url=https://login:pass@solr.domain.com:8983/solr/dovecot/ break-imap-search debug curl and other software connect to solr without errors in both cases. Does dovecot have option to disable certificate validation (may be ssl_verify = false etc.) ? Thanks.

2 2

Controlling dovecot caching decisions
by Sivathmican Sivakumaran 19 Mar '18

19 Mar '18

Hello, It looks like the "mail_always_cache_fields" and "mail_never_cache_fields" can be used to control dovecot's caching decisions. I cannot seem to find any documentation regarding how these fields should be used. What are acceptable values for these fields? I am quite new to this so any help would be much appreciated. Regards, Siva

2 2

Replication Slave is not auto-creating domain/user folders
by Thore Bödecker 19 Mar '18

19 Mar '18

Hey all, I'm experiencing a weird and annoying issue with my 2-node dovecot replication setup. The setup is based on virtual users in a pgsql database, which is replicated from the master to a slave node. For the mails I rely on the dovecot builtin replication which has been working great for me thus far. However I noticed something was off when looking through my journal yesterday: dovecot[823]: doveadm: Error: Couldn't lock /var/vmail/foxxx0.de/qwer/.dovecot-sync.lock: safe_mkstemp(/var/vmail/foxxx0.de/qwer/.dovecot-sync.lock) failed: No such file or directory In this case the domain directory /var/vmail/foxxx0.de was already existing on the slave, but dovecot didn't bother to create the user folder before trying to lock it. The same happens when the entire domain folder is missing: dovecot[823]: doveadm: Error: Couldn't lock /var/vmail/dj-orakel.de/booking/.dovecot-sync.lock: safe_mkstemp(/var/vmail/dj-orakel.de/booking/.dovecot-sync.lock) failed: No such file or directory (in this case /var/vmail/dj-orakel.de is not existing yet) A natural first though would be "permission problem" - which I suspected too but the filesystem permissions are identical on the master and the slave: master (mx1): ---- root@valhalla ~ > stat /var/vmail/ File: /var/vmail/ Size: 4096 Blocks: 8 IO Block: 4096 directory Device: fd06h/64774d Inode: 2 Links: 28 Access: (2770/drwxrws---) Uid: ( 5000/ vmail) Gid: ( 5000/ vmail) Access: 2016-09-04 13:04:33.837609018 +0200 Modify: 2018-03-17 18:22:47.506323895 +0100 Change: 2018-03-17 18:22:47.506323895 +0100 Birth: - root@valhalla ~ > id dovecot uid=76(dovecot) gid=76(dovecot) groups=76(dovecot) root@valhalla ~ > id vmail uid=5000(vmail) gid=5000(vmail) groups=5000(vmail) ---- replication slave (mx2): ---- root@midgard ~ > stat /var/vmail File: /var/vmail Size: 4096 Blocks: 8 IO Block: 4096 directory Device: fe02h/65026d Inode: 2 Links: 27 Access: (2770/drwxrws---) Uid: ( 5000/ vmail) Gid: ( 5000/ vmail) Access: 2017-10-15 12:09:56.174209161 +0200 Modify: 2018-03-06 15:43:41.463359651 +0100 Change: 2018-03-06 15:43:41.463359651 +0100 Birth: - root@midgard ~ > id dovecot uid=76(dovecot) gid=76(dovecot) groups=76(dovecot) root@midgard ~ > id vmail uid=5000(vmail) gid=5000(vmail) groups=5000(vmail) ---- The replication service is configured in dovecot to run as user vmail, so it should not be a permission problem because the master is automatically creating the domain and user folders inside /var/vmail when new mails arrive. I highly suspect that this is some kind of regression because I can't remember having to manually create the domain/user folders on the slave before it would replicate mails for these, and there are quite a number of domains/users being replicated already. Please find the "doveconf -n" output of both servers below. If you need additional information, please let me know. Cheers, Thore doveconf -n (master/mx1): ---- # 2.3.0.1 (ffd8a29): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.1 (d33dca20) # OS: Linux 4.15.7-1-hardened x86_64 Arch Linux auth_cache_negative_ttl = 10 secs auth_cache_size = 50 M auth_cache_ttl = 5 mins auth_mechanisms = plain login doveadm_password = # hidden, use -P to show it doveadm_port = 12121 mail_home = /var/vmail/%Ld/%Ln mail_location = mdbox:~/mdbox mail_plugins = " acl zlib notify mail_log replication quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mdbox_rotate_size = 20 M namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcps:mx2.nano-srv.net quota = dict:user::file:/var/vmail/%d/%n/.quotausage quota_grace = 1%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global sieve_global_path = /etc/dovecot/sieve/default.sieve zlib_save = gz zlib_save_level = 9 } protocols = imap pop3 sieve lmtp service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { mode = 0600 user = vmail } } service auth { unix_listener auth-client { group = postfix mode = 0660 user = postfix } user = root } service doveadm { inet_listener { port = 12121 ssl = yes } vsz_limit = 1 G } service imap-login { process_limit = 400 process_min_avail = 5 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12122 } } service quota-warning { executable = script /var/vmail/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = vmail mode = 0660 user = vmail } } ssl_cert = </etc/letsencrypt/live/nano-srv.net/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA:DHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES256-GCM-SHA384:DHE-ECDSA-AES256-SHA384:DHE-RSA-AES256-SHA384:DHE-ECDSA-AES128-GCM-SHA256:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-SHA256:DHE-ECDSA-AES128-SHA256:DHE-RSA-AES128-SHA256:DHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes submission_host = 127.0.0.1:10027 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 30 mail_plugins = " acl zlib notify mail_log replication quota imap_quota" } protocol pop3 { mail_plugins = " acl zlib notify mail_log replication quota" pop3_uidl_format = %08Xu%08Xv } protocol lda { mail_plugins = " acl zlib notify mail_log replication quota sieve" postmaster_address = postmaster(a)nano-srv.net } protocol lmtp { mail_plugins = " acl zlib notify mail_log replication quota sieve" postmaster_address = postmaster(a)nano-srv.net } protocol sieve { managesieve_logout_format = bytes ( in=%i : out=%o ) } ---- doveconf -n (slave/mx2): ---- # 2.3.0.1 (ffd8a29): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.1 (d33dca20) # OS: Linux 4.15.7-1-hardened x86_64 Arch Linux auth_cache_negative_ttl = 10 secs auth_cache_size = 50 M auth_cache_ttl = 5 mins auth_mechanisms = plain login doveadm_password = # hidden, use -P to show it doveadm_port = 12121 mail_home = /var/vmail/%Ld/%Ln mail_location = mdbox:~/mdbox mail_plugins = " acl zlib notify mail_log replication quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mdbox_rotate_size = 20 M namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcps:mx1.nano-srv.net quota = dict:user::file:/var/vmail/%d/%n/.quotausage quota_grace = 1%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global sieve_global_path = /etc/dovecot/sieve/default.sieve zlib_save = gz zlib_save_level = 9 } protocols = imap pop3 sieve lmtp service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { mode = 0600 user = vmail } } service auth { unix_listener auth-client { group = postfix mode = 0660 user = postfix } user = root } service doveadm { inet_listener { port = 12121 ssl = yes } vsz_limit = 1 G } service imap-login { process_limit = 400 process_min_avail = 5 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12122 } } service quota-warning { executable = script /var/vmail/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = vmail mode = 0660 user = vmail } } ssl_cert = </etc/letsencrypt/live/nano-srv.net/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA:DHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES256-GCM-SHA384:DHE-ECDSA-AES256-SHA384:DHE-RSA-AES256-SHA384:DHE-ECDSA-AES128-GCM-SHA256:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-SHA256:DHE-ECDSA-AES128-SHA256:DHE-RSA-AES128-SHA256:DHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes submission_host = 127.0.0.1:10027 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 30 mail_plugins = " acl zlib notify mail_log replication quota imap_quota" } protocol pop3 { mail_plugins = " acl zlib notify mail_log replication quota" pop3_uidl_format = %08Xu%08Xv } protocol lda { mail_plugins = " acl zlib notify mail_log replication quota sieve" postmaster_address = postmaster(a)nano-srv.net } protocol lmtp { mail_plugins = " acl zlib notify mail_log replication quota sieve" postmaster_address = postmaster(a)nano-srv.net } protocol sieve { managesieve_logout_format = bytes ( in=%i : out=%o ) } ---- --

1 0

Is possible to override Dovecot variables or Sieve env vars and extdata lookups
by MRob 19 Mar '18

19 Mar '18

Are the dovecot environment variables mutable? I'd like to override like: set "${env.vnd.dovecot.username}" "someuser(a)example.org" Or better, I prefer to override %u Dovecot variable during the userdb lookup. Is either possible? PS, when Sieve does extdata lookups for username key, where does username come from? %u? Does an override as above change the dict lookup key for extdata?

2 3