June 2016 - dovecot - dovecot.org

segfault in IMAP APPEND with compressed maildir
by Roland Rosenfeld 08 Jun '16

08 Jun '16

Hi! After upgrading from Debian wheezy with (self compiled) dovecot 2.2.15 to Debian jessie with (self compiled) 2.2.24, I observe the following segmentation fault in the logs: Jun 7 09:23:09 imap dovecot: imap(user(a)example.com): Error: read(<imap client>) failed: read(size=8003) failed: Connection reset by peer (uid=0, box=trash) Jun 7 09:23:09 imap dovecot: imap(user(a)example.com): Error: zlib.read(/srv/mailstore/user(a)example.com/mail/.trash/tmp/1465283884.M336492P22902.imap): unexpected EOF at 88001 Jun 7 09:23:09 imap dovecot: imap(user(a)example.com): Error: read(zlib(/srv/mailstore/user(a)example.com/mail/.trash/tmp/1465283884.M336492P22902.imap)) failed: read(/srv/mailstore/user(a)example.com/mail/.trash/tmp/1465283884.M336492P22902.imap) failed: zlib.read(/srv/mailstore/user(a)example.com/mail/.trash/tmp/1465283884.M336492P22902.imap): unexpected EOF at 88001 (uid=0, box=trash) Jun 7 09:23:09 imap dovecot: imap(user(a)example.com): Fatal: master: service(imap): child 22902 killed with signal 11 (core dumped) We also observed the same (rare) error in the past on the old system. But on the old system, there were only the first 3 lines without the segmentation fault, so we ignored the issue until now. The problem always happens on IMAP folders where the client writes to, like "trash", "drafts", "sent" and the like. I wasn't able to actively reproduce this issue, but can only observe in the logs that some customers run into this issue from time to time. So all I have is a core dump with the following backtrace: Core was generated by `dovecot/imap'. Program terminated with signal SIGSEGV, Segmentation fault. (gdb) bt full #0 0x00007f57e276f29f in i_stream_default_get_size (stream=0x1fd2790, exact=<optimized out>, size_r=0x7ffed3839718) at istream.c:807 No locals. #1 0x00007f57e17024e4 in zlib_mail_close (_mail=0x1fd4de0) at zlib-plugin.c:170 mail = 0x1fd4de0 zmail = 0x1fd5398 zuser = 0x1fbd040 cache = 0x1fbd050 size = 33201320 #2 0x00007f57e2a2a8b9 in mailbox_save_cancel (_ctx=_ctx@entry=0x1fc4d48) at mail-storage.c:2117 ctx = 0x1fd3dd0 keywords = 0x0 mail = <optimized out> __FUNCTION__ = "mailbox_save_cancel" #3 0x000000000040c759 in cmd_append_finish (ctx=0x1fc4cf0) at cmd-append.c:149 __FUNCTION__ = "cmd_append_finish" #4 0x000000000040c835 in client_input_append (cmd=0x1fc4bc0) at cmd-append.c:89 ctx = <optimized out> client = 0x1fc3fc0 reason = 0x1f9e0b8 "Disconnected in APPEND (1 msgs, 306 secs, 188416/1122858 bytes)" finished = <optimized out> lit_offset = <optimized out> __FUNCTION__ = "client_input_append" #5 0x00007f57e2778dcc in io_loop_call_io (io=0x1fc4ad0) at ioloop.c:564 ioloop = 0x1fa6750 t_id = 2 __FUNCTION__ = "io_loop_call_io" #6 0x00007f57e277a0f1 in io_loop_handler_run_internal (ioloop=ioloop@entry=0x1fa6750) at ioloop-epoll.c:220 ctx = 0x1fa8260 io = <optimized out> tv = {tv_sec = 1799, tv_usec = 997118} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 j = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #7 0x00007f57e2778e55 in io_loop_handler_run (ioloop=ioloop@entry=0x1fa6750) at ioloop.c:612 No locals. #8 0x00007f57e2778ff8 in io_loop_run (ioloop=0x1fa6750) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #9 0x00007f57e2713713 in master_service_run (service=0x1fa65f0, callback=callback@entry=0x423a20 <client_connected>) at master-service.c:640 No locals. #10 0x000000000040c427 in main (argc=1, argv=0x1fa6390) at main.c:460 set_roots = {0x42c480 <imap_setting_parser_info>, 0x635440 <lda_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0x1f9e048 "ailed: Connection reset by peer", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x424170 <login_client_connected>, failure_callback = 0x423b30 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 auth_socket_path = 0x42d42e "auth-master" c = <optimized out> This is on a server, which uses compressed maildir on a NFS storage. Here's dovecot -n output: # 2.2.24 (a82c823): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.14 (099a97c) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.4 auth_cache_negative_ttl = 5 mins auth_cache_size = 100 M auth_cache_ttl = 15 mins auth_default_realm = example.com auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf } disable_plaintext_auth = no listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = always mail_gid = 999 mail_location = maildir:~/mail mail_plugins = acl quota zlib mail_uid = 999 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapflags mmap_disable = yes namespace { list = children location = maildir:%%h/mail:INDEX=~/mail/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl quota = maildir sieve = ~/.dovecot.sieve sieve_dir = ~/mail/sieve sieve_extensions = +imapflags zlib_save = gz } pop3_no_flag_updates = yes pop3_uidl_format = %v.%u protocols = imap pop3 sieve service auth { unix_listener auth-master { group = vmail mode = 0600 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap { process_limit = 4000 } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { process_limit = 100 } service pop3 { process_limit = 1000 } shutdown_clients = no ssl = no syslog_facility = local2 userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol imap { mail_max_userip_connections = 10 mail_plugins = acl quota zlib imap_quota imap_acl } protocol pop3 { mail_plugins = acl quota zlib } I hope, that this is all required information to find and solve this issue. Greetings Roland

2 4

Re: [g.danti@assyoma.it: [Dovecot] Re: Questions about hardlinks, alternate storage and compression]
by Gionatan Danti 08 Jun '16

08 Jun '16

Il 26-11-2015 15:15 John R. Dennison ha scritto: > You are strongly encouraged to update that CentOS system. Current is > 6.7 (released some 3 months ago) and dovecot-2.0.9-19. Ouch! I copied outdated information from my old post. My current system _is_ CentOS 6.7 with dovecot dovecot-2.0.9-19.el6_7.2.x86_64 Sorry for the confusion. Still, the problems remain > If you find you need a more modern dovecot version you will find that > dovecot-2.2.19-1 is in the GhettoForge 3rd-party repo, packaged and > maintained by a respected CentOS community member. Information > on this repo can be found by following the links off of: > > http://wiki.centos.org/AdditionalResources/Repositories > The point is that I _don't know_ if more recent Dovecot version have the same problem or not. Moreover, as this is a production machine, I would like to leave a key package as Dovecot as near as possible to the shipping O.S. Thanks. -- Danti Gionatan Supporto Tecnico Assyoma S.r.l. - www.assyoma.it email: g.danti(a)assyoma.it - info(a)assyoma.it GPG public key ID: FF5F32A8

3 10

Slow auth
by Ranbir 07 Jun '16

07 Jun '16

Hi Everyone, I'm running dovecot on a CentOS 7 box using PLAIN and GSSAPI auth. I need to use both because I have some clients that can't use GSSAPI. I haven't been able to get the userdb working properly without a password file and a userdb file. For example, I have to set the home default and change the username_format. I use FreeIPA and the dovecot server is joined properly to the realm. Authentication works (I don't have any passwords in the userdb file). The problem is authentication is slow. When I use Roundcube, the login takes longer than it should. In fact, every operation (changing folders, opening an email, replying, etc.) is just slow. The web server where Roundcube is running is barely loaded, the dovecot server isn't loaded and the FreeIPA server is basically sitting idle. When I watch /var/log/secure as I login to roundcube, I see this in the logs: http://pastebin.ca/3620032 Why is pam_unix being hit and then pam_sss? I'm thinking the pam_unix failures are the reason why the auth is slow. Here's the output from dovecot -n: http://pastebin.ca/3620029 I'm sure I haven't configured something correctly, hence the performance problems. Any help would be appreciated. -- Ranbir

4 6

Multiple recipient delimiter support?
by Tanstaafl 07 Jun '16

07 Jun '16

Trying to find out if dovecot supports the use of multiple recipient delimiters, as postfix does, but can't find an answer... The wiki only mentions it in two meaningful places (that I can find)... With respect to postfix: /wiki.dovecot.org/LDA/Postfix The above seems to imply that for postfix/LDA all I need to do is define it in postfix (which supports multiple recipient delimiters). And with Pigeonhole/Sieve: wiki.dovecot.org/Pigeonhole/Sieve/Configuration It seems to be saying that I must also define the same recipient_delimiters in dovecot config if using LMTP, and also if I want to use sieve for filtering of mail. But, the example and text says nothing about the use of multiple delimiters... So, is this supported? If so, the wiki should be updated to reflect this...

2 4

Can't delete emails from or write replies to Inbox
by Edwin Humphries 07 Jun '16

07 Jun '16

Hi, I'm running Dovecot and Thunderbird, with 2 separate accounts (business and personal). One operates fine, but the other one won't allow me to write replies to the Inbox (so that I can track current threads), and if I move emails to another folder, it copies them instead. New emails do appear in the Inbox. I've checked the permissions on the two Inboxes, and they are the same (except for the owner name). I've tried compacting the problem Inbox, but that hasn't changed things. Edwin

2 1

Re: Blowfish hashed passwords
by KT Walrus 07 Jun '16

07 Jun '16

(I subscribed to a daily digest for this list and can’t figure out how to reply to a reply.) Anyway, Aki Tuomi replied to my feature request saying: > We support in latest 2.2 release > > MD5 MD5-CRYPT SHA SHA1 SHA256 SHA512 SMD5 SSHA SSHA256 SSHA512 PLAIN > CLEAR CLEARTEXT PLAIN-TRUNC CRAM-MD5 SCRAM-SHA-1 HMAC-MD5 DIGEST-MD5 > PLAIN-MD4 PLAIN-MD5 LDAP-MD5 LANMAN NTLM OTP SKEY RPA CRYPT SHA256-CRYPT > SHA512-CRYPT > > There is also blowfish support as BLF-CRYPT, but that requires that your > system supports it. CRYPT supports whatever your crypt() supports. > The reason I suggest building in fallback hash type support is that my install of Dovecot on Ubuntu 14.04 didn’t support SHA512-CRYPT or BLF-CRYPT. If Dovecot just included the PHP .c files to make sure it can process Blowfish/SHA512 password hashes on all installs, it would greatly simplify adding Dovecot as a service for my existing user accounts (without forcing them to give their password for the site so I can generate new hashes in a form that Dovecot supports). SHA256-CRYPT is probably my best option for password hashing since it supports ROUNDS to make hash generation slower. But, I would rather use BLF-CRYPT so I can re-use my existing hashes for my user accounts. Kevin

5 9

Update Kills Dovecot
by Sven Roellig 07 Jun '16

07 Jun '16

Hi,i run Dovecot 2.3.0 Alpha The last two Updates broken dovecot.in the mail.war log i became the error, on every mail, ..........de)<3+RHF1k4VFfDOwAApDKQ5A>: Fatal: master: service(lmtp): child 15299 killed with signal 6 (core dumps disabled) Jun 5 16:39:40 director dovecot: lmtp(roellig(a)*******.org)<1o6JAKw5VFcPPAAApDKQ5A>: Panic: file imem.c: line 60 (i_strconcat): assertion failed: (str1 != NULL) ....dovecot: lmtp(roellig(a)*******.org)<1o6JAKw5VFcPPAAApDKQ5A>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x8cfbe) [0x7f62fe5defbe] -> /usr/lib/dovecot/libdovecot.so.0(+0x8d0ac) [0x7f62fe5df0ac] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f62fe57dd1e] -> /usr/lib/dovecot/libdovecot.so.0(i_strconcat+0x146) [0x7f62fe5e6bb6] -> /usr/lib/dovecot/libdovecot-lda.so.0(duplicate_init+0x5d) [0x7f62feba1dfd] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0x3c) [0x7f62feba47bc] -> dovecot/lmtp(+0x6ac8) [0x7f62fefd3ac8] -> dovecot/lmtp(+0x73cf) [0x7f62fefd43cf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7f62fe5f2ffc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x101) [0x7f62fe5f4461] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7f62fe5f3085] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f62fe5f3228] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f62fe584273] -> dovecot/lmtp(main+0x165) [0x7f62fefd21a5] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f62fe1c8b45] -> dovecot/lmtp(+0x5293) [0x7f62fefd2293] the errors is from update to dovecot-lmtpd_2%3a2.3.0~alpha0-1~auto+67_amd64.deb on debian 8.3on the morning it came an update to debian 8.4 an dovecot dovecot-lmtpd_2%3a2.3.0~alpha0-1~auto+78_amd64.deb can anyone help Sorry for my english. Sven

3 2

[PATCH v2 0/7] Fixes for lib-mail message-address
by Pali Rohár 05 Jun '16

05 Jun '16

Hello, I borrowed dovecot parser for email addresses and I'm using it in my new perl module Email::Address::XS for parsing & formatting list of email addresses. That perl module is available at github [1]. During implementation and testing I found bugs in dovecot code. So I'm sending my patches (together with tests) which I'm using in my perl module. Lot of other (normal & corner) test cases are part of that perl module [2], so if you are interested feel free to reuse them. Because writing new test cases for dovecot is hard for me, I'm not going to do it. In perl for perl modules it is a lot of easier for me. [1] - https://github.com/pali/Email-Address-XS [2] - https://github.com/pali/Email-Address-XS/blob/master/t/Email-Address-XS.t Changes since v1: * Updated description with test example * Rebased on top of master branch Pali Rohár (7): lib-mail: message_address_write: Fix generating empty group list lib-mail: message_address_write: Fix generating group list with empty name lib-mail: parse_addr_spec: Like in rfc822_skip_comment() check if last_comment is not NULL lib-mail: parse_addr_spec: Email address without local-part is invalid lib-mail: parse_mailbox: Set display name instead mailbox when parsing failed lib-mail: message_address_write: Quote and escape strings if needed lib-mail: Update tests for message address src/lib-mail/message-address.c | 99 +++++++++++++++++++++++++++++++---- src/lib-mail/test-message-address.c | 11 +++- 2 files changed, 98 insertions(+), 12 deletions(-) -- 1.7.9.5

1 7

Shared Mailbox?
by craig 04 Jun '16

04 Jun '16

Hi, I've been doing a lot of reading on this topic, I'm just finding a lot of doco that's potentially out of date now? System: Red Hat Enterprise Linux Server release 7.2 (Maipo) dovecot-2.2.10-5.el7.x86_64 The need: 1. I'd like to create a mailbox called "accounts", email would simply get delivered to the account via "accounts(a)example.com" (Maildir format) 2. Share this mailbox so it appears in three other accounts as an extra folder called "accounts" 3. If a user reads an email in the "accounts" folder, I'd like the other users to know this. Clients: * Latest Thunderbird * Outlook 2013. Any advice welcome ;) Cheers, Craig

3 2

Doveadm HTTP API - Disconnected for inactivity
by Ricardo Machini Barbosa 04 Jun '16

04 Jun '16

Hello, I am doing some calls using doveadm http API and I noticed that when some calls took more than 5 seconds the connection are closed, this happen general with huge mailbox's. There are some kind of timeout that I have to set ? For example: # curl call time curl -v --user doveadm:senha -H "Content-Type: application/json" -d '[["purge",{"user":"email(a)dominio.com.br"},"c01"]]' http://192.168.0.1:8080/doveadm/v1 * About to connect() to 192.168.0.1 port 8080 (#0) * Trying 192.168.0.1... connected * Connected to host (192.168.0.1) port 8080 (#0) * Server auth using Basic with user 'doveadm' > POST /doveadm/v1 HTTP/1.1 > Authorization: Basic XXXXXX > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > Host: 192.168.0.1:8080 > Accept: */* > Content-Type: application/json > Content-Length: 69 > * Empty reply from server * Connection #0 to host 192.168.0.1 left intact curl: (52) Empty reply from server * Closing connection #0 real 0m5.432s user 0m0.003s sys 0m0.002s # server log Jun 3 17:11:09 host dovecot: doveadm(192.168.0.2): Executing command 'purge' as 'email(a)dominio.com.br' Jun 3 17:11:14 host dovecot: doveadm: http-server: conn 192.168.0.2:59617 [1]: Disconnected for inactivity Regards, Ricardo

2 1