December 2015 - dovecot

[Dovecot] Replication and public namespaces
by Markus Weippert 11 Apr '16

11 Apr '16

Hi, I'm having some issues with replicating public namespaces. Everything seems to work fine for private namespaces, but while importing some huge mailboxes (many small mails) into a public namespace via imapsync, something goes wrong. The expected mail flow is: old-server (imapsync)> new-server1 (replication)> new-server2 But then, dovecot seems to run into race conditions when the replications process tries to sync the same public mailbox under two or more different users at the same time. As a result, messages get duplicated, new-server2 sends those back to new-server1 which then starts to produce duplicates too. If I don't kill the processes in time and delete the faulty mailbox, they start to produce thousands of mails. In fact, server2 should not export messages at all, since it's not productive yet and does not get any mail except from the replication. The only thing getting logged (only few compared to the huge amount of duplicates produced): "dsync-server(user(a)example.com): Warning: Maildir /...: Expunged message reappeared, giving a new UID" Is there any way to fix this? Regards, Markus doveadm_password = *********** doveadm_port = ***** mail_home = /var/vmail/private/%d/%n mail_location = maildir:~/mail mail_plugins = acl virtual listescape notify replication namespace inbox { inbox = yes location = prefix = separator = / type = private } namespace legacy { alias_for = # ... } namespace ns_public { list = children location = maildir:/var/vmail/public/%d prefix = Public/ separator = / subscriptions = no type = public } namespace virtual { # ... } plugin { mail_replica = tcps:************** } protocols = imap lmtp sieve replication_dsync_parameters = -d -l 60 -N -x virtual -x ns_public -U replication_full_sync_interval = 4 hours replication_max_conns = 20 service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service doveadm { inet_listener { port = 8143 ssl = yes } process_min_avail = 5 user = vmail vsz_limit = 4 G } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = vmail } }

3 7

basic configuratio error
by soko.tica 01 Feb '16

01 Feb '16

Hello list, After many hours I still fail to configure properly dovecot as the LDA with opensmtpd, for system users only. I don't want pop at all, jus lmtp and imap, but still haven't stripped it. Here is the info, thanks in advance for your response: ===== # doveconf -n # 2.2.14: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.6 i386 auth_verbose = yes auth_verbose_passwords = yes disable_plaintext_auth = no first_valid_uid = 1000 hostname = imap.home.lan imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To mail_debug = yes mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = bsdauth } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh postmaster_address = postmaster(a)mileva.home.lan protocols = imap pop3 lmtp sieve service auth-worker { user = root } service auth { unix_listener auth-userdb { group = _dovenull mode = 0666 user = _dovenull } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 0 service_count = 1 } service imap { process_limit = 1024 } service lmtp { unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl_cert = </etc/ssl/dovecotcert.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } verbose_ssl = yes protocol lmtp { mail_plugins = } protocol lda { mail_plugins = } # /usr/local/sbin/dovecot -F Oct 28 13:00:01 mileva newsyslog[1110]: logfile turned over Oct 28 14:30:46 mileva dovecot: master: Dovecot v2.2.14 starting up for imap, pop3, lmtp, sieve Oct 28 14:30:46 mileva dovecot: master: Error: service(aggregator): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(pop3): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: open(/var/dovecot/login-master-notifya57a2b8821460734) failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(pop3-login): safe_mkstemp(/var/dovecot/login-master-notify) failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(log): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(lmtp): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(ipc): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(indexer-worker): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(indexer): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(imap): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(imap-urlauth-worker): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(imap-urlauth): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: open(/var/dovecot/login-master-notify5dd2a3a0591effcc) failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(imap-urlauth-login): safe_mkstemp(/var/dovecot/login-master-notify) failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: open(/var/dovecot/login-master-notify152a1bb891f6f764) failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(imap-login): safe_mkstemp(/var/dovecot/login-master-notify) failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(doveadm): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(dns_client): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(director): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(dict): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(config): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(auth): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(auth-worker): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(anvil): command startup failed, throttling for 2 secs Oct 28 14:30:56 mileva dovecot: master: Error: service(ssl-params): command startup failed, throttling for 2 secs [snipped 18 pages of /var/log/maillog] Oct 28 20:47:44 mileva dovecot: master: Dovecot v2.2.14 starting up for imap, pop3, lmtp, sieve Oct 28 20:47:44 mileva dovecot: master: Error: service(aggregator): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(pop3): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: open(/var/dovecot/login-master-notifydd522320d99e7f4c) failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(pop3-login): safe_mkstemp(/var/dovecot/login-master-notify) failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(log): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(lmtp): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(ipc): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(indexer-worker): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(indexer): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(imap): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(imap-urlauth-worker): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(imap-urlauth): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: open(/var/dovecot/login-master-notify95aa9b38117677e4) failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(imap-urlauth-login): safe_mkstemp(/var/dovecot/login-master-notify) failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: open(/var/dovecot/login-master-notify4d021350494e6f7c) failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(imap-login): safe_mkstemp(/var/dovecot/login-master-notify) failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(doveadm): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(dns_client): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(director): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(dict): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(config): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(auth): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(auth-worker): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(anvil): command startup failed, throttling for 2 secs Oct 28 20:47:46 mileva dovecot: master: Warning: Killed with signal 2 (by pid=0 uid=0 code=kill) Oct 28 20:47:46 mileva dovecot: master: Error: open(/var/dovecot/.temp.mileva.home.lan.17422.055a8b6881266714) failed: Too many open files Oct 28 20:47:46 mileva dovecot: master: Error: file_dotlock_open(/var/dovecot/instances) failed: Too many open files Oct 28 20:47:46 mileva dovecot: master: Error: service(ssl-params): command startup failed, throttling for 2 secs # /usr/sbin/smtpd -n configuration OK

2 3

Sieve "foreverypart" and "mime" extensions (RFC 5703) now implemented
by Stephan Bosch 24 Jan '16

24 Jan '16

Hi, I have finally managed to implement the Sieve "foreverypart" and "mime" extensions (RFC 5703). These are now included in the main Mercurial repository and will be included in the next release. I will be fixing a few minor details in the coming week; e.g., interaction with "include" and "editheader" extensions needs more work. Still, in the mean time, those of you who are interested can already test this feature a bit. It is not a small feature, so knowing bugs early is helpful. You can install it from the Mercurial repository or get the latest Debian packages from Xi. When I finish the last details (probably next week), I will release a first RC version of Pigeonhole v0.4.10 right away. Regards, Stephan.

2 2

Problem! Dovecot 2.2.9 does not send the information on ending the quota to user
by Serge Spinoza 13 Jan '16

13 Jan '16

Hi. I have Dovecot + Postfix + MySQL. Version of Postix: postfix_2.11.3-1ubuntu1_amd64 Version of Dovecot: 2.2.9 Operations system is: Ubuntu 15.04 x64 Postfix have patched (patch VDA - http://vda.sourceforge.net) for using with quota, it means that file "maildirsize" in mail directory already exists and changed when add/delete mail. Quota for virtual box take in MySQL db. ########################## Problem: Dovecot does not send the information on ending the quota to user. ########################## # dovecot -n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab112.15 x86_64 Ubuntu 15.04 ext4 auth_debug = yes auth_default_realm = mydomain.ru auth_mechanisms = plain login auth_realms = znak-corp.ru debug_log_path = /var/log/dovecot-debug.log info_log_path = /var/log/dovecot.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot.log login_greeting = Welcome to OOO "Corporation ZNAK" mail_gid = 1000 mail_location = maildir:/var/vmail/%n@%d mail_plugins = " quota" mail_uid = 1000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autocreate = INBOX autosubscribe = INBOX quota = maildir:User quota quota_rule = *:storage=10M #(this derective takes from mysql, but i wrote it just in case) quota_warning = storage=90%% quota-warning 90 %u quota_warning2 = storage=80%% quota-warning 80 %u } protocols = pop3 imap quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/dovecot-smtp-auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = /usr/lib/dovecot/quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl_cert = </etc/ssl/mydomain.ru.crt ssl_key = </etc/ssl/mydomain.ru.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { mail_plugins = " quota imap_quota autocreate" } protocol pop3 { mail_plugins = quota } protocol lda { mail_plugins = " quota autocreate" } ##### quota-warning.sh ##### #!/bin/sh PERCENT=$1 USER=$2 cat << EOF | /usr/lib/dovecot/dovecot-lda -d $USER -o "plugin/quota=maildir:User quota:noenforcing" From: aaa(a)mydomain.ru Subject: Quota warning $PERCENT% Your mailbox is now $PERCENT% full. Please remove unnecessary emails to avoid new mail loosing. EOF ##### Script has chmod 777 ##### root@mx:~# ls -la /usr/local/bin/quota-warning.sh -rwxrwxrwx 1 vmail vmail 285 Dec 17 11:09 /usr/local/bin/quota-warning.sh Check the script this command is successful: # /usr/local/bin/quota-warning.sh 82 rrr(a)mydomain.ru (a letter is sent to rrr(a)mydomain.ru that box is filled to 82%) ##### dovecot-sql.conf.ext ##### driver = mysql connect = host=localhost dbname=postfix user=postfix password=xxxxxxx default_pass_scheme = MD5-CRYPT user_query = SELECT '/var/vmail/%n@%d' as home, 'maildir:/var/vmail/%n@%d'as mail, 1000 AS uid, 1000 AS gid, concat('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = '%u' AND active = '1' password_query = SELECT username as user, password, '/var/vmail/%n@%d' as userdb_home, 'maildir:/var/vmail/%n@%d' as userdb_mail, 1000 as userdb_uid, 1000 as userdb_gid, concat('*:bytes=', quota) AS userdb_quota_rule FROM mailbox WHERE username = '%u' AND active = '1' ##### Check that the socket has a quota-warning: # lsof |grep quota-warning dovecot 17277 root 57u unix 0xffff8802d7845b80 0t0 62354154 /var/run/dovecot/quota-warning ##### Verify that the plugin quota is running I doing like this: # doveadm -D -v quota get -u rrr(a)mydomain.ru Conclusion: doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) doveadm(rrr(a)mydomain.ru): Debug: Added userdb setting: mail=maildir:/var/vmail/rrr@mydomain.ru doveadm(rrr(a)mydomain.ru): Debug: Added userdb setting: plugin/quota_rule=*:bytes=10240000 doveadm(rrr(a)mydomain.ru): Debug: Effective uid=1000, gid=1000, home=/var/vmail/rrr(a)mydomain.ru doveadm(rrr(a)mydomain.ru): Debug: Quota root: name=User quota backend=maildir args= doveadm(rrr(a)mydomain.ru): Debug: Quota rule: root=User quota mailbox=* bytes=10240000 messages=0 doveadm(rrr(a)mydomain.ru): Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 doveadm(rrr(a)mydomain.ru): Debug: Quota rule: root=User quota mailbox=SPAM ignored doveadm(rrr(a)mydomain.ru): Debug: Quota warning: bytes=9216000 (90%) messages=0 reverse=no command=quota-warning 90 rrr(a)mydomain.ru doveadm(rrr(a)mydomain.ru): Debug: Quota warning: bytes=8192000 (80%) messages=0 reverse=no command=quota-warning 80 rrr(a)mydomain.ru doveadm(rrr(a)mydomain.ru): Debug: Quota grace: root=User quota bytes=1024000 (10%) doveadm(rrr(a)mydomain.ru): Debug: maildir++: root=/var/vmail/rrr(a)mydomain.ru, index=, indexpvt=, control=, inbox=/var/vmail/rrr(a)mydomain.ru, alt= Quota name Type Value Limit % User quota STORAGE 9008 10000 90 User quota MESSAGE 6 - 0 ##### Those plugin is successfully loaded and checked. When removing/receiving emails percent of employment, respectively changes. I read in dovecot manual, that the notification send only when the quota border crossing - then I tested like this: Clears the box up to 60% and then send letters, which occupy about 5% more of allocated quota. And so the lead up to 95%. But reports of ending the quota not be sent. In what may be another problem? Thanks. ------------------ Serge

2 2

autoexpunge problems
by Olaf Hopp 12 Jan '16

12 Jan '16

Hello, I tried to use the new autoexpunge for my Trash folders I had in 15-mailboxes.conf mailbox Trash { special_use = \Trash auto = subscribe } (dovecot -n of the original config is below) and added just the line autoexpunge = 1h Just a short period on my test system. But it failed. In the log I see Dec 18 10:54:07 irams2 dovecot: imap(ms2test): Error: Failed to autoexpunge mailbox 'Trash': Invalid mailbox name 'Trash': Missing namespace prefix 'INBOX.' But in 10-mail.conf I have namespace inbox { prefix = INBOX. separator = . inbox = yes } So I changed the line "mailbox Trash" to "mailbox INBOX.Trash". I now have mailbox INBOX.Trash { special_use = \Trash auto = subscribe autoexpunge = 1h } Now it seems to work (Trash is emptied, log file is fine) but in the mail client I see two Trash folders. Once the normal one below INBOX and another one also called Trash which is under a new created folder named INBOX below the original INBOX Thus I have INBOX INBOX.Trash INBOX.INBOX.Trash autoexpunge seems to work, but this is not what I like to offer to my users. Any glues ? Olaf # 2.2.21 (5345f22): /opt/dovecot/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.10 (d61ff8a5af9e+) doveconf: Warning: service auth { client_limit=2000 } is lower than required under max. load (23192) doveconf: Warning: service anvil { client_limit=2000 } is lower than required under max. load (17195) # OS: Linux 2.6.32-573.12.1.el6.x86_64 x86_64 CentOS release 6.7 (Final) auth_failure_delay = 3 secs auth_master_user_separator = * auth_mechanisms = plain login auth_username_format = %Ln auth_verbose = yes auth_worker_max_count = 60 default_client_limit = 2000 default_process_limit = 3000 mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox spambox { auto = create special_use = \Junk } prefix = INBOX. separator = . } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = dovecot driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /etc/dovecot/sieve-master sieve_max_redirects = 20 } protocols = imap pop3 lmtp sieve sieve quota_full_tempfail = yes service imap-login { process_limit = 8192 process_min_avail = 16 service_count = 0 } service imap { process_limit = 8192 } service lmtp { executable = lmtp -L } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3 { process_limit = 8192 } ssl = required ssl_ca = </etc/pki/tls/certs/chain.pem ssl_cert = </etc/pki/tls/certs/imap.pem ssl_key = </etc/pki/tls/private/imap.key ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 syslog_facility = local3 userdb { driver = passwd } verbose_proctitle = yes protocol lmtp { mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 100 ssl_cert = </etc/pki/tls/certs/imap.pem ssl_key = </etc/pki/tls/private/imap.key } protocol pop3 { ssl_cert = </etc/pki/tls/certs/pop.pem ssl_key = </etc/pki/tls/private/pop.key } -- Karlsruher Institut für Technologie (KIT) ATIS - Abt. Technische Infrastruktur, Fakultät für Informatik Dipl.-Geophys. Olaf Hopp - Leitung IT-Dienste - Am Fasanengarten 5, Gebäude 50.34, Raum 009 76131 Karlsruhe Telefon: +49 721 608-43973 Fax: +49 721 608-46699 E-Mail: Olaf.Hopp(a)kit.edu atis.informatik.kit.edu www.kit.edu KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft Das KIT ist seit 2010 als familiengerechte Hochschule zertifiziert.

2 2

Dovecot code repository moved to Github
by Timo Sirainen 11 Jan '16

11 Jan '16

http://hg.dovecot.org/ is no longer being updated. The public repository exists now in https://github.com/dovecot/core instead. I'm not sure yet if we should continue pushing commit emails to dovecot-cvs list or if Github's internal notifications are enough. In any case dovecot-cvs list isn't working right now.

5 9

doveadm import - strange warning
by Ralf Hildebrandt 08 Jan '16

08 Jan '16

I'm using the doveadm import command to extract mails from my backup: % doveadm import -u restore(a)backup.invalid mdbox:/home/copymail/mdbox "" \ mailbox INBOX header Delivered-To backup+$SEARCHPATTERN(a)backup.invalid This works like a charm, I'm getting all the mails, and I can access the newly generated mailbox. But when executing the command I'm getting an annoying warning: doveadm(restore(a)backup.invalid): Error: chdir(/root/) failed: Permission denied (euid=1001(copymail) egid=1001(copymail) missing +x perm: /root, dir owned by 0:0 mode=0700) doveadm(restore(a)backup.invalid): Error: chdir(/root) failed: Permission denied I'm using a file based authentication: # cat passwd restore@backup.invalid:{SHA}+/...the.hash...:1001:1001:(gecos):/home/restore:: So why is "restore(a)backup.invalid" being associated with /root? I'm using 2:2.2.18-1~auto+91, but the warning has been around for ages :) -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

5 7

allow_nets=local in passdb gets "auth: Panic"
by SATOH Fumiyasu 05 Jan '16

05 Jan '16

Hi, I have the following configuration in my dovecot.conf for Dovecot 2.2.21: passdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext default_fields = allow_nets=local,127.0.0.1,10.255.1.0/24 } This triggers "auth: Panic" on POP3/IMAP logins as the below: Dec 22 14:57:39 localhost dovecot: auth: ldap(u0000,::1,<oiF8SHYngqsAAAAAAAAAAAAAAAAAAAAB>): allow_nets: Invalid network 'local' Dec 22 14:57:39 localhost dovecot: auth: Panic: file net.c: line 1137 (net_is_in_network): assertion failed: (IPADDR_IS_V6(ip) == IPADDR_IS_V6(net_ip)) `doveadm auth test <username> <password>` is no problem as expected. What's wrong? Regards, -- -- Name: SATOH Fumiyasu @ OSS Technology Corp. (fumiyas @ osstech co jp) -- Business Home: http://www.OSSTech.co.jp/ -- GitHub Home: https://GitHub.com/fumiyas/ -- PGP Fingerprint: BBE1 A1C9 525A 292E 6729 CDEC ADC2 9DCA 5E1C CBCA

2 3

2.2.21 imap core dump after enabling autoexpunge
by Tomi Vainio 04 Jan '16

04 Jan '16

Hi, I've enabled autoexpunge for Trash and Junk. Now imap process core dumps occasionally. Tomppa > program terminated by signal SEGV (no mapping at the fault address) > 0xff0dc2e0: o_stream_get_buffer_used_size : ld [%o0 + 20], %o0 > Current function is notify_ok (optimized) > 13 if (o_stream_get_buffer_used_size(client->output) != 0) > (dbx) where > [1] o_stream_get_buffer_used_size(0x0, 0x83ee8, 0x83ee8, 0x5f520, 0xfffe681c, 0xff13a978), at 0xff0dc2e0 > =>[2] notify_ok(mailbox = 0x90188, text = 0x83ee8 "Stale mailbox lock file detected, will override in 0 seconds", context = 0xa3588) (optimized), at 0x5f524 (line ~13) in "mail-storage-callbacks.c" > [3] dotlock_callback(0x0, 0x1, 0x90188, 0x567a61fe, 0xff1352a0, 0x2), at 0xff1ff478 > [4] dotlock_create(0xcc3d8, 0x2dc6c0, 0x1, 0x0, 0x0, 0x567a61fe), at 0xff0b0e68 > [5] file_dotlock_create_real(0xcc3d8, 0x1, 0x541c, 0x4, 0xff1352a0, 0xff13a6bc), at 0xff0b1104 > [6] file_dotlock_create(0xbf674, 0x8f990, 0x1, 0xbf690, 0x5, 0xcc3d8), at 0xff0b126c > [7] maildir_uidlist_lock_timeout(0xbf648, 0x1, 0x1, 0x1, 0x3f, 0x26c00), at 0xff1ff0ec > [8] maildir_uidlist_sync_lock(0xbf648, 0x8, 0xffbff59f, 0x1, 0x1, 0xf19c8), at 0xff2035bc > [9] maildir_uidlist_sync_init(0xbf648, 0x8, 0x83d20, 0x1, 0x44, 0xff2f502c), at 0xff203680 > [10] maildir_sync_context(0x83d08, 0x1, 0x0, 0xffbff707, 0x83d20, 0x83d08), at 0xff1fe290 > [11] maildir_sync_run(0x90188, 0x44, 0x0, 0x0, 0x0, 0x90420), at 0xff1fe74c > [12] maildir_storage_sync_init(0x90188, 0x44, 0x541c, 0x0, 0x80, 0xff2f502c), at 0xff1feaa0 > [13] mailbox_sync(0x90188, 0x44, 0x0, 0x4, 0x44, 0x90388), at 0xff1b91cc > [14] index_mailbox_get_metadata(0x90188, 0x40, 0xffbff910, 0x0, 0xff2f502c, 0x0), at 0xff273858 > [15] maildir_mailbox_get_metadata(0x90188, 0x40, 0xffbff910, 0xfffffff8, 0x0, 0xff2f502c), at 0xff1f9e4c > [16] mailbox_get_metadata(0x90188, 0x40, 0xffbff910, 0x0, 0xff2f502c, 0x2), at 0xff1b8ecc > [17] mailbox_autoexpunge(0x90188, 0x5651837e, 0xa1e28, 0xa2630, 0x0, 0x0), at 0xff1a6fcc > [18] mail_user_autoexpunge(0x9eaf4, 0x8, 0x5651837e, 0xff2f502c, 0x9c290, 0xffbff9ac), at 0xff1a72e8 > [19] mail_user_unref(0x9de20, 0xfffd135c, 0xff2f502c, 0x1, 0xff2c6388, 0xa35d4), at 0xff1c328c > [20] client_default_destroy(client = 0xa3588, reason = <value unavailable>) (optimized), at 0x41c8c (line ~390) in "imap-client.c" > [21] io_loop_call_io(0x9ca18, 0xfffdbba8, 0x0, 0xff1352a0, 0x8c6b8, 0x24400), at 0xff0c8fd4 > [22] io_loop_handler_run_internal(0x8c6b8, 0x1, 0x0, 0x8d1b8, 0x1, 0x9ca18), at 0xff0cadd8 > [23] io_loop_run(0x8c6b8, 0x1, 0xc0, 0xff13b26c, 0xff1352a0, 0x8d1b8), at 0xff0c90fc > [24] master_service_run(0x8c608, 0x60fe0, 0x1, 0x80, 0x27c00, 0x2), at 0xff0236c8 > [25] main(argc = <value unavailable>, argv = 0x1) (optimized), at 0x619c4 (line ~442) in "main.c" > (dbx) > # 2.2.21 (5345f22): /usr/local/etc/dovecot/dovecot.conf > # OS: SunOS 5.10 sun4u > base_dir = /var/run/dovecot/ > dsync_remote_cmd = ssh -l%{login} %{host} /usr/local/bin/doveadm dsync-server -u%u -U > first_valid_uid = 100 > last_valid_uid = 199 > mail_location = maildir:~/Maildir > mail_plugins = fts fts_solr > namespace inbox { > inbox = yes > location = > mailbox "Deleted Messages" { > special_use = \Trash > } > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > auto = create > autoexpunge = 31 days > special_use = \Junk > } > mailbox Sent { > auto = subscribe > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Spam { > special_use = \Junk > } > mailbox Trash { > autoexpunge = 31 days > special_use = \Trash > } > prefix = > } > passdb { > driver = pam > } > plugin { > fts = solr > fts_autoindex = yes > fts_solr = url=http://127.0.0.1:8983/solr/ break-imap-search > } > protocols = imap > service auth { > user = root > } > service imap-login { > inet_listener imap { > address = localhost > port = 143 > } > inet_listener imaps { > address = * > port = 993 > } > } > ssl_cert = </etc/mail/certs/server-all.crt > ssl_cipher_list = AES128+EECDH:AES128+EDH > ssl_dh_parameters_length = 2048 > ssl_key = </etc/mail/certs/server.key > ssl_prefer_server_ciphers = yes > ssl_protocols = !SSLv2 !SSLv3 > userdb { > driver = passwd > }

2 2

Re: segfault in dict_transaction_rollback() on doveadm quota recalc -u
by Lazy 04 Jan '16

04 Jan '16

Bump > Hi, > > We have a dovecot cluster with nfs storage, 2 directors and 3 > imap/pop3/lmtp backends. > > Redis is used as a dict backend with a dict proxy. > > dict { > quota = redis:host=127.0.0.1:prefix=user/ > } > > plugin { > > quota = dict:User quota::proxy::quota > > } > > Redis server is behind haproxy working in tcp mode. > > doveadm quota recalc -u user always couses dict process segfault (called > from imap backend or director host), otherwise quota is working correctly. > > > #0 dict_transaction_rollback (_ctx=_ctx@entry=0xea5fd0) at dict.c:194 > 194 ctx->dict->v.transaction_rollback(ctx); > (gdb) bt > #0 dict_transaction_rollback (_ctx=_ctx@entry=0xea5fd0) at dict.c:194 > #1 0x0000000000404d4d in dict_connection_destroy (conn=conn@entry=0xea5af0) > at dict-connection.c:166 > #2 0x0000000000405098 in dict_connection_input (conn=<optimized out>) at > dict-connection.c:127 > #3 dict_connection_input (conn=0xea5af0) at dict-connection.c:96 > #4 0x00007fbf886fe4fb in io_loop_call_io (io=0xeab550) at ioloop.c:501 > #5 0x00007fbf886ff54b in io_loop_handler_run_internal (ioloop=ioloop@entry=0xe9f730) > at ioloop-epoll.c:220 > #6 0x00007fbf886fe589 in io_loop_handler_run (ioloop=ioloop@entry=0xe9f730) > at ioloop.c:548 > #7 0x00007fbf886fe608 in io_loop_run (ioloop=0xe9f730) at ioloop.c:525 > #8 0x00007fbf8869fbc3 in master_service_run (service=0xe9f5c0, > callback=callback@entry=0x4059c0 <client_connected>) at > master-service.c:581 > #9 0x0000000000404ad8 in main (argc=1, argv=0xe9f390) at main.c:105 > (gdb) p ctx > $1 = (struct dict_transaction_context *) 0x0 > > > dovecot 2.2.18, redis server 2.8 > > > > Regards Michal >

2 2