June 2015 - dovecot - dovecot.org

crash dovecot 2.2.18
by Hajo Locke 19 Jun '15

19 Jun '15

Hello, after upgrading from 2.1.17 to 2.2.18 i have a specific Inbox which causes a crash on dovecot: Jun 19 09:28:03 hostname dovecot: imap(username): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x7075f) [0x7f9298c4375f] -> /usr/lib/dovecot/libdovecot.so.0(+0x707be) [0x7f9298c437be] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f9298bf11aa] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x2bd9a) [0x7f9298ee2d9a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x98f8b) [0x7f9298f4ff8b] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0xb9) [0x7f9298f502c9] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_first_header+0x38) [0x7f9298ee3d18] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xabfa2) [0x7f9298f62fa2] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xac1e2) [0x7f9298f631e2] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x68) [0x7f9298c4d118] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7f9298c4da9d] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x65) [0x7f9298c33065] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header+0x38) [0x7f9298c338d8] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_headers+0x80) [0x7f9298f4f940] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x98cca) [0x7f9298f4fcca] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0xb9) [0x7f9298f502c9] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_first_header+0x38) [0x7f9298ee3d18] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9a85a) [0x7f9298f5185a] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_date+0x92) [0x7f9298f51972] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_date+0x36) [0x7f9298ee3b76] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa3113) [0x7f9298f5a113] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_sort_list_add+0x31) [0x7f9298f5a471] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x3d) [0x7f9298f5801d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x27) [0x7f9298eecd67] -> dovecot/imap [username ip.ip.ip.ip UID SORT](+0x1e7f7) [0x7f92994117f7] -> dovecot/imap [username ip.ip.ip.ip UID SORT](imap_search_start+0xf1) [0x7f9299411c41] -> dovecot/imap [username ip.ip.ip.ip UID SORT](cmd_sort+0x25b) [0x7f9299407c4b] -> dovecot/imap [username ip.ip.ip.ip UID SORT](command_exec+0x4d) [0x7f929940c40d] Mailboxformat is mbox. I think reason was a damaged Index in ~username/mail/.imap/INBOX/ I removed this folder and immediately errors are gone and Mailbox was readable again. Never noticed this kind of errors for years on 2.1.17, maybe this helps to find a Bug in Code. Thanks, Hajo

1 0

dsync selectively
by lejeczek 19 Jun '15

19 Jun '15

hi everybody I've barely started reading on dsync and I wonder.. would you know if it is possible to sync/replicate only specific domain(users)? or it's always the whole lot? many thanks P.

4 8

Dovecot 2.1.9 shared folder deletion causes fault
by JT 19 Jun '15

19 Jun '15

Hey all, I'm getting a fault in dovecot (see below) using shared folders. I have a mailbox that receives new mail (Account X/INBOX). Another account (Account A) has access to the other account (Account X/INBOX) with ACL below. The ACL directory (.DEFAULT) contains: user=AccountA lrwst I removed a test email from Account A/INBOX, which is supposed to remove the email from Account X/INBOX. A fault occurs whenever my client (Thunderbird) attempts to connect and complete the deletion. Other actions complete successfully. It only appears to happen when using Thunderbird. Mac Mail does not cause the fault. I'm not getting a core dump so all I have is what the log outputs. I can reproduce this regularly so let me know if you need any additional information. Thanks, JT === Version: 2.1.9 (Ubuntu Trustydeb package) OS: Ubuntu trusty 14.04 2015-06-18T19:17:50.518505+00:00 mail-103 dovecot: imap(XXX): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x5e271) [0x7eff3f6d1271] -> /usr/lib/dovecot/libdovecot.so.0(+0x5e34e) [0x7eff3f6d134e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7eff3f68ca9e] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa7cbc) [0x7eff3f9e2cbc] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x6c) [0x7eff3f9ac8ec] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x15) [0x7eff3f9ac985] -> dovecot/imap(+0xded5) [0x7eff3fe78ed5] -> dovecot/imap(command_exec+0x3c) [0x7eff3fe836dc] -> dovecot/imap(+0x176cf) [0x7eff3fe826cf] -> dovecot/imap(+0x17785) [0x7eff3fe82785] -> dovecot/imap(client_handle_input+0x125) [0x7eff3fe82aa5] -> dovecot/imap(client_input+0x75) [0x7eff3fe82e35] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7eff3f6e1247] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7eff3f6e1fd7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7eff3f6e0de8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7eff3f691c93] -> dovecot/imap(main+0x2c4) [0x7eff3fe772f4] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7eff3f2cfec5] -> dovecot/imap(+0xc460) [0x7eff3fe77460] 2015-06-18T19:17:50.736901+00:00 mail-103 dovecot: imap(XXX): Fatal: master: service(imap): child 4461 killed with signal 6 (core dumped) 2015-06-18T19:17:51.662157+00:00 mail-103 dovecot: imap(XXX): Panic: file mail-index.c: line 380 (mail_index_keywords_unref): assertion failed: (keywords->refcount > 0) 2015-06-18T19:17:51.662969+00:00 mail-103 dovecot: imap(XXX): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x5e271) [0x7f3fa05bb271] -> /usr/lib/dovecot/libdovecot.so.0(+0x5e34e) [0x7f3fa05bb34e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f3fa0576a9e] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa7cbc) [0x7f3fa08cccbc] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x6c) [0x7f3fa08968ec] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x15) [0x7f3fa0896985] -> dovecot/imap(+0xded5) [0x7f3fa0d62ed5] -> dovecot/imap(command_exec+0x3c) [0x7f3fa0d6d6dc] -> dovecot/imap(+0x176cf) [0x7f3fa0d6c6cf] -> dovecot/imap(+0x17785) [0x7f3fa0d6c785] -> dovecot/imap(client_handle_input+0x125) [0x7f3fa0d6caa5] -> dovecot/imap(client_input+0x75) [0x7f3fa0d6ce35] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7f3fa05cb247] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7f3fa05cbfd7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f3fa05cade8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f3fa057bc93] -> dovecot/imap(main+0x2c4) [0x7f3fa0d612f4] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f3fa01b9ec5] -> dovecot/imap(+0xc460) [0x7f3fa0d61460] 2015-06-18T19:17:51.857451+00:00 mail-103 dovecot: imap(XXX): Fatal: master: service(imap): child 4464 killed with signal 6 (core dumped) protocol imap { imap_client_workarounds = tb-extra-mailbox-sep imap_idle_notify_interval = 1 mins mail_max_userip_connections = 10 mail_plugins = acl quota acl imap_acl quota imap_quota } plugin { acl = vfile:/etc/dovecot/acl acl_defaults_from_inbox = yes acl_shared_dict = proxy::acl ... } namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { hidden = no list = children location = maildir:/var/mail/public/Maildir:INDEX=/var/mail/%d/%n/Maildir/public prefix = public/ separator = / subscriptions = yes type = public } namespace { list = yes location = maildir:%%h/Maildir:CONTROL=~/Maildir/control/%%u:INDEX=~/Maildir/shared/%%u.indx:INDEXPVT=~/Maildir/shared/%%u.pvt prefix = shared/%%u/ separator = / subscriptions = no type = shared }

2 1

centos 7 dovecot 2.2.10 segmentation fault on devcot/auth using ldap driver in userdb
by Andrea Lisci 19 Jun '15

19 Jun '15

dovecot 2.2.10 packaged by centos 7 configuring ldap driver on userdb cause imap crash during login userdb { driver = ldap args = /etc/dovecot/dovecot-ldap-userdb.conf3.ext # Default fields can be used to specify defaults that LDAP may override #default_fields = home=/home/virtual/%u } #ldap conf --------------- hosts = myDChost base = dc=company,dc=testdomain,dc=dom ldap_version = 3 auth_bind = yes auth_bind_userdn = windowsdomain\%u user_filter = (&(objectclass=person)(|(mail=%u)(sAMAccountName=%n))) user_attrs = =uid=vmail,=gid=vmail,=home=/users/vmail/maildomain.com/%n,=mail_location=maildir:/users/vmail/maildomain.com/%n/Maildir tls = yes tls_require_cert = never dovecot -n --------------- # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-229.4.2.el7.x86_64 x86_64 CentOS Linux release 7.1.1503 (Core) xfs auth_debug = yes auth_mechanisms = plain login listen = * mail_debug = yes mail_location = maildir:/users/vmail/maildomain.com/%n/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf2.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = required ssl_cert = </etc/pki/dovecot/certs/mail.maildomain.com.crt.pem ssl_key = </etc/pki/dovecot/private/mail.maildomain.com.key.pem userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf3.ext driver = ldap } protocol lmtp { mail_plugins = " quota sieve" passdb { args = password=foo driver = static } } protocol lda { mail_plugins = " sieve" } core dump ------------- gdb /usr/libexec/dovecot/auth /var/core/25122 GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-64.el7 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/libexec/dovecot/auth...Reading symbols from /usr/lib/debug/usr/libexec/dovecot/auth.debug...done. done. [New LWP 25122] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Missing separate debuginfo for /usr/lib64/libnssckbi.so Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/1e/a2171aee7143d971607597b24f2a97e9276cbb.debug Core was generated by `dovecot/auth'. Program terminated with signal 11, Segmentation fault. #0 db_ldap_handle_request_result (res=0x0, idx=<optimized out>, request=<optimized out>, conn=<optimized out>) at db-ldap.c:819 819 request->callback(conn, request, res->msg); (gdb) bt full #0 db_ldap_handle_request_result (res=0x0, idx=<optimized out>, request=<optimized out>, conn=<optimized out>) at db-ldap.c:819 _data_stack_cur_id = 3 srequest = <optimized out> ret = <optimized out> final_result = <optimized out> named_res = <optimized out> #1 db_ldap_handle_result (res=<optimized out>, conn=<optimized out>) at db-ldap.c:886 auth_request = 0x7f3704fa2620 idx = <optimized out> msgid = <optimized out> #2 ldap_input (conn=<optimized out>) at db-ldap.c:918 timeout = {tv_sec = 0, tv_usec = 0} res = 0x7f3704b1b530 msg = 0x7f370489fcb0 prev_reply_diff = <optimized out> ret = <optimized out> #3 0x00007f3702a19a47 in io_loop_call_io (io=0x7f37046dbad0) at ioloop.c:388 ioloop = 0x7f37046bd7b0 t_id = 2 #4 0x00007f3702a1a8cf in io_loop_handler_run (ioloop=ioloop@entry=0x7f37046bd7b0) at ioloop-epoll.c:220 ctx = 0x7f37046c5450 events = <optimized out> list = 0x7f3704998170 io = <optimized out> tv = {tv_sec = 0, tv_usec = 999118} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #5 0x00007f3702a19598 in io_loop_run (ioloop=0x7f37046bd7b0) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #6 0x00007f37029c69e3 in master_service_run (service=0x7f37046bd640, callback=<optimized out>) at master-service.c:571 No locals. #7 0x00007f3702ea77f1 in main (argc=1, argv=0x7f37046bd390) at main.c:393 c = <optimized out>

3 2

maildir, how to always add size tags to filename (,S=).
by Sergei Franco 19 Jun '15

19 Jun '15

Hi There, I have thoroughly read through documentation and wiki and I simply cannot find how to force dovecot to always add the size tag to the filename when using maildir format. We are using dovecot 2.2.9 (whatever comes from ubuntu 14.04 LTS). We are using dovecot in conjunction with exim with maidirsize file enabled and maildir quotas. For example exim has following configuration: maildir_tag = ,S=$message_size Which adds the size to the filename of the message. This has enormous (orders of magnitude) performance benefit as to calculate quota one does not need to stat every single file (only getents for each directory). I have wrote a script that adds the size tag retrospectively to files it didn't had it, and rebuild the dovecot index/cache if changes where made. This worked fine. Behaviour of dovecot is very peculiar: it generally adds the ,S= tag (along with ,W= tag) but occasionally it does not (I wander if it depends on the IMAP client). Is there anyway to force dovecot to add size tag to the files (like with exim example above)? Thank you very much. Sergei.

3 2

Best practices for mailbox network file storage?
by Andy Csillag 18 Jun '15

18 Jun '15

Is there a current best practice for a shared filesystem backend for mailboxes (in my case, all virtual accounts)? NFS 3/4, GFS2, GlusterFS, other? In the case of the latter ones, is the use of Director necessary? Any specific anti-recommendations? Also, if it matters, I *think* I want to use BackBlaze racks for storage. Also, I've seen recommendations for the filesystem underneath like XFS or ext4 or whatever. Is there a best practice? Thanks, Drew

3 2

Help with Namespaces
by Steve Matzura 18 Jun '15

18 Jun '15

Most of my users are virtual. Do I need defined namespaces or is the default undefined one OK?

2 2

LMTP with Postfix Problem
by Steve Matzura 18 Jun '15

18 Jun '15

Here's a maillog entry that's one of many I receive when I try sending a test message to my system. The recipient is a virtual user in /etc/virtual. The way I'm expecting it to work is that my message from me to this Postfix virtual user will be sent back to me. Every time the message delivery is attempted, Dovecot says the LMTP directory doesn't exist. I thought it was created automatically as messages arrive. Jun 18 01:48:27 <machine-name> postfix/lmtp[30644]: 4CA5B8CB6: to=<postmaster@<my-domain>>, orig_to=<postmaster>, relay=none, delay=0.02, delays=0.02/0/0/0, dsn=4.4.1, status=deferred (connect to <my-FQDN>[private/dovecot-lmtp]: No such file or directory)

2 2

Pigeonhole vacation from alias address
by Dino Blazeka 18 Jun '15

18 Jun '15

Hi everyone. I've set up my instance not to check recipient address with sieve_vacation_dont_check_recipient=yes to enable users to set up their vacation script without listing addresses (there are to many). Only problem remaining is that when they receive an e-mail sent to their alias, the vacation response comes from their original mail address. Is there a setting or workaround that would enable vacation extension to send response with from field set to whichever address the original message was addressed to. Thank you in advance, Dino P. S. This is my first message to the list so I apologize in advance if I have broken any rules. It was not done intentionally

1 0

get failed auth
by My Work 18 Jun '15

18 Jun '15

Hi, how i can write all users to my db (mysql example) if it is possible that get "unknown user", "auth failed" e.g.? dovecot 2.2.13 root@dev0:/home/fov# dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.0 ext4 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-master base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_gid = 103 first_valid_uid = 101 listen = * mail_access_groups = mail,Debian-exim,dovecot mail_debug = yes mail_full_filesystem_access = yes mail_gid = 103 mail_location = maildir:/var/vmail/%d/%n mail_uid = 101 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace inbox { inbox = yes location = prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { autocreate = Trash autocreate2 = Sent autocreate3 = Drafts autocreate4 = Junk autosubscribe = Trash autosubscribe2 = Sent autosubscribe3 = Drafts autosubscribe4 = Junk sieve = /var/vmail/%d/%n/currently-active-script.sieve sieve_dir = /var/vmail/%d/%n/sieve } protocols = imap sieve service auth { unix_listener auth-client { group = Debian-exim mode = 0666 user = Debian-exim } unix_listener auth-master { group = Debian-exim mode = 0666 user = Debian-exim } user = root } service imap-login { inet_listener imap { port = 143 } } service managesieve-login { executable = /usr/lib/dovecot/managesieve-login inet_listener sieve { port = 2074 } process_min_avail = 1 service_count = 1 vsz_limit = 64 M } service managesieve { executable = /usr/lib/dovecot/managesieve process_limit = 10 } ssl = no userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = /tmp/dovecot-deliver.log log_path = /tmp/dovecot-deliver.log mail_plugins = sieve postmaster_address = postmaster(a)horsetele.com.ua sendmail_path = /usr/sbin/exim4 } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = autocreate } protocol sieve { managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 }

2 1