- dovecot - dovecot.org

[Dovecot] imap-login hanging when firewall blocks ssl handshaking
by Erik A Johnson 04 Dec '12

04 Dec '12

imap-login processes are hanging (using 100% of CPU) when connected from a client that is partially blocked by a firewall. It appears that imap-login is stuck in a loop trying to complete an ssl handshake. imap-login is working fine for other clients not blocked by the firewall (including localhost). This is dovecot 2.1.10 under Mac OS X 10.8.2 (compiled from sources); the firewall is Little Snitch 3.0.1 blocking port 993, which appears to let the connection initiate but then squashes and disconnects the socket during ssl handshaking. gdb backtrace and Activity Monitor's "Sample Process" show that imap-login is stuck calling ioloop-kqueue's io_loop_handler_run -> io_loop_call_io -> ssl_step repeatedly; dtruss shows that it is repeatedly making system calls to kevent and read, the latter returning -1 with errno 57=ENOTCONN="Socket is not connected". (I also tried ./configure --with-ioloop=poll and --with-iopoll=select instead of the default best = kqueue but the results were the same; --with-iopoll=epoll didn't work because epoll is not available on this machine.) The client, initiated by the command "openssl s_client -connect SERVER:993", first responds "CONNECTED(00000003)" but then immediately the error "60278:error:140790E5:SSL routines:SSL23_WRITE:ssl handshake failure:/SourceCache/OpenSSL098/OpenSSL098-44/src/ssl/s23_lib.c:182:". The infinite loop is in src/lib/ioloop.c in the function "io_loop_run" where the statement "while (ioloop->running) io_loop_handler_run(ioloop)" is executed. While I think the firewall is not doing the right thing (i.e., it lets a connection start but then kills it), it seems that imap-login should fail gracefully when the socket is no longer connected. Ideas? Thanks. ----------------------------------- /usr/local/sbin/dovecot -n # 2.1.10: /usr/local/etc/dovecot/dovecot.conf # OS: Darwin 12.2.0 x86_64 default_internal_user = _dovecot default_login_user = _dovenull namespace { hidden = no list = yes location = mbox:/Users/%u/Documents/Mailboxes prefix = mbox/ separator = / type = private } namespace { inbox = yes location = maildir:/Users/%u/Documents/Maildir mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { driver = pam } protocols = imap lmtp ssl = required ssl_cert = </usr/local/etc/dovecot/dovecot.pem ssl_key = </usr/local/etc/dovecot/dovecot.pem userdb { driver = passwd } protocol imap { mail_plugins = " zlib imap_zlib" } ----------------------------------- gdb's "bt full" gives various results depending on where in the loop, but they are they same from ssl23_accept on down. (gdb) bt full #0 0x00007fff92d19f63 in sha1_block_data_order () #1 0x00007fff92d1a4ae in SHA1_Final () #2 0x00007fff92d45430 in EVP_DigestFinal_ex () #3 0x00007fff92d17d7a in ssleay_rand_add () #4 0x00007fff974529be in ssl23_accept () #5 0x000000010cac0729 in ssl_handshake [inlined] () at /private/tmp/johnsone/dovecot-2.1.10/src/login-common/ssl-proxy-openssl.c:465 ret = -949939536 #6 0x000000010cac0729 in ssl_step (proxy=0x7fff53152b90) at ssl-proxy-openssl.c:528 ret = -949939536 #7 0x000000010cb11bd1 in io_loop_call_io (io=0x7f7fa0c1c240) at ioloop.c:379 ioloop = (struct ioloop *) 0x7f7fa0c03b00 t_id = 2 #8 0x000000010cb12c69 in io_loop_handler_run (ioloop=0x0) at ioloop-kqueue.c:148 tv = { tv_sec = 130, tv_usec = 124797 } ctx = (struct ioloop_handler_context *) 0x7f7fa0c1a890 ret = 1 ts = { tv_sec = 130, tv_nsec = 124797000 } events = (struct kevent *) 0x10cb4ee78 #9 0x000000010cb11b88 in io_loop_run (ioloop=0x7fff53152b90) at ioloop.c:398 No locals. #10 0x000000010cafde9b in master_service_run (service=0x7f7fa0c039f0, callback=0x7f7fa0c1c2d8) at master-service.c:543 No locals. #11 0x000000010cabdcd1 in main_deinit [inlined] () at /private/tmp/johnsone/dovecot-2.1.10/src/login-common/main.c:406 set_pool = (pool_t) 0x7f7fa100b420 login_socket = 0x10cb4f7f8 "?9??" #12 0x000000010cabdcd1 in login_binary_run (argc=1, argv=0x7f7fa0c037c0, binary=0x7fff53152b90) at main.c:407 set_pool = (pool_t) 0x7f7fa100b420 login_socket = 0x10cb4f7f8 "?9??" #13 0x00007fff8ac847e1 in start () (gdb) bt full #0 0x00007fff96e4c110 in malloc_zone_malloc () #1 0x00007fff96e4cba7 in malloc () #2 0x00007fff92d2c9e2 in CRYPTO_malloc () #3 0x00007fff92d4535f in EVP_DigestInit_ex () #4 0x00007fff92d17caa in ssleay_rand_add () #5 0x00007fff974529be in ssl23_accept () ... #0 0x00007fff94775ffa in read () #1 0x00007fff92cf41e6 in sock_read () #2 0x00007fff92d15598 in BIO_read () #3 0x00007fff9745294a in ssl23_read_bytes () #4 0x00007fff97452c3e in ssl23_get_client_hello () #5 0x00007fff97452b4d in ssl23_accept () ... -----------------------------------

4 14

[Dovecot] clucene (in)stability
by Dave Abrahams 04 Dec '12

04 Dec '12

Considering two crashing bugs, which have got no response (https://sourceforge.net/tracker/?func=detail&aid=3587525&group_id=80013&ati… and https://sourceforge.net/tracker/?func=detail&aid=3592291&group_id=80013&ati…) and the lack of activity in its Git repository, I am inclined to think that CLucene's current release series (e.g. 2.3.3.4) should be considered unsuitable for serious use (including with Dovecot). I'm going to try CLucene 0.9.21, which they claim has been "proven to be stable over time" (see http://clucene.sourceforge.net) and see how it works out. I wonder if there's a future envisioned for FTS with Dovecot that's suitable for small installations (i.e. doesn't require a Solr server) and has a good chance of correctness and stability? -- Dave Abrahams BoostPro Computing Software Development Training http://www.boostpro.com Clang/LLVM/EDG Compilers C++ Boost

2 2

[Dovecot] Store mailbox usage in mysql not just the limit
by tibby＠tibby.hu 03 Dec '12

03 Dec '12

Hello! I have dovecot working using mysql for auth and mailbox quota. in the mail database I have a user table with colums for: email, password, quota_kb, quota_messages I want to make a php script that would get the quota_kb and substract the usage to display the total free space left for mail usage. How can I do this? Is there a function in dovecot to store the current usage per mailbox ? Thanks!

2 1

[Dovecot] Gmail style conversations
by Romer Ventura 03 Dec '12

03 Dec '12

Hello, I am wondering if there is any way to support Gmail style conversation when using Dovecot? Someway of associating all inbound and sent emails..? I know that some clients let you display the emails in "conversation" which kinda does what Gmail does, however, it does not associate the Sent emails with it. Thanks for any information. <BR CLEAR="ALL"> <hr style="border: 1px solid #CCC;"> <p style="font-style:italic; font-size:8pt; font-family:verdana; color:gray;">This document and attachments may contain technical data controlled under the U.S. International Traffic in Arms Regulations (ITAR) or the Export Administration Regulations (EAR) and may not be exported to a Foreign Person, either in the U.S. or abroad, without the proper authorization by the U.S. Department of State or Department of Commerce, whichever is applicable. CONFIDENTIALITY NOTE: This electronic transmission, including all attachments, is directed in confidence solely to the person(s) to whom it is addressed, or an authorized recipient, and may not otherwise be distributed, copied or disclosed. The contents of the transmission may also be subject to intellectual property rights and such rights are expressly claimed and are not waived. If you have received this transmission in error, please notify the sender immediately by return electronic transmission and then immediately delete this transmission, including all attachments, without copying, distributing or disclosing same. The recipient should check this e-mail and any attachments for the presence of viruses. Houston Sigma Technologies L.P. accepts no liability for any damage caused by any virus transmitted by this e-mail.</p>

3 2

[Dovecot] pop3-login: Error: SSL: Stacked error:
by Frank Bonnet 03 Dec '12

03 Dec '12

Hello again I have few messages in dovecot.log like the following : Dec 03 15:52:07 pop3-login: Error: SSL: Stacked error: error:140943F2:SSL routines:SSL3_READ_BYTES:sslv3 alert unexpected message: SSL alert number 10 Anyone could tell what does this means ? Thank you

1 0

[Dovecot] conversion MBOX -->Maildir
by Frank Bonnet 03 Dec '12

03 Dec '12

Hello I would like to start MBOX to Maildir conversion at 2.1.12 what would be the safest method to perform this ? wiki2 says the following , is it up to date ? mbox -> maildir migration. Set mail_location=maildir:~/Maildir and run dsync -u username mirror mbox:~/mail:INBOX=/var/mail/username thank you

1 0

[Dovecot] sieve problem after upgrade to 2.1.12
by Daniel Funke 03 Dec '12

03 Dec '12

Hi, I have a sieve filter for a mailbox with amavisd-admin mails. if header :regex "Subject" "^INVALID HEADER" { fileinto "INVALID HEADER"; } After the upgrade to dovecot 2.1.12 this filter doesn't work for some (16) messages with this subject. For 424 messages it worked correct. Any ideas where to look? Bye Daniel

2 2

[Dovecot] Thunderbird SSL/TLS client authentication fails
by Roger Hunen 03 Dec '12

03 Dec '12

Hi, This is my first post to the list, so greetings to you all! I am seeking your help with SSL/TLS client authentication. I currently have the following setup: * Server: - Debian Squeeze (fully patched) - OpenSSL 0.9.8o - Dovecot v2.1.10 (Debian backport package from Wheezy) - SSL listener on port 993 with the Dovecot selfsigned certificate that was created during installation - Virtual users (user(a)domain.net) with password in passwd style file * Client: - Windows XP SP3 (fully patched) - Thunderbird 17.0 - IMAP account using "Normal password" authentication - Roundcube webmail (to be added soon) This works just fine :) ==> I now want to set Thunderbird to use "TLS certificate" authentication so that I can safely expose port 993 to the internet for mobile use. The idea is that clients with a trusted client certificate do not need a password so that I can change my password for Roundcube without having to change passwords on other IMAP clients (Roundcube will connect to localhost without SSL). To do so I did the following: - use XCA (v0.9.3, Windows version) to setup a private root CA with a CRL - export root CA certificate and CRL in PEM format and join them into a ca.pem file (order: certificate, CRL) - configure Dovecot to use the ca.pem file and require a client certificate - use XCA to generate a private key and certificate for commonName=user(a)mydomain.net - import certificate and private key into Thunderbird - change IMAP account setting in Thunderbird to use "TLS Certificate" authentication - When prompted, select the imported certificate to be used for authentication. Unfortunately the authentication fails :( Using "verbose_ssl=yes" I can see in the Dovecot logfile that Thunderbird connects and that the SSL handshake completes successfully. "Valid certificate" is logged for both client certificate and root CA certificate. This looks "so far so good" to me :) The Dovecot log has the following lines at the point of failure: imap-login: Warning: SSL alert: where=0x4004, ret=256: warning close notify [<IP>] imap-login: Warning: SSL alert: where=0x4008, ret=256: warning close notify [<IP>] imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=<IP>, lip=<IP>, TLS, session=<ID> (IP address and TLS session ID removed) The last log line ("user=<>") suggests that Dovecot does not try to use the commonName from the client certificate as the username even though (I think) I have configured Dovecot to do so. The relevant lines in the Dovecot configuration are: <config> auth_mechanisms = plain auth_ssl_require_client_cert = yes auth_ssl_username_from_cert = yes disable_plaintext_auth = yes protocols = imap ssl = yes ssl_ca = </etc/dovecot/ssl/ca.pem ssl_cert = </etc/ssl/certs/dovecot.pem ssl_cert_username_field = commonName ssl_key = </etc/ssl/private/dovecot.pem ssl_parameters_regenerate = 0 ssl_require_crl = yes ssl_verify_client_cert = yes service imap-login { chroot = login process_min_avail = 1 service_count = 1 inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } </config> Observation: with "auth_ssl_require_client_cert = yes" Dovecot requires Thunderbird to send the client certificate even when Thunderbird uses "Normal password" authentication (authentication only fails if I delete the certificate from Thunderbird). So the SSL part looks OK to me. It seems that Dovecot is waiting for the client to logon over the established SSL/TLS connection instead of taking the username from the commonName in the certificate. ==> What could be going wrong here? I can post full config and logfile lines if you wnt to. Except for some possible oversight on my behalf there is nothing secret in there (I just didn't want to add too many lines to this already long post). Regards, -Roger

2 2

[Dovecot] Connection closed by foreign host.
by 张昊 03 Dec '12

03 Dec '12

hi, when i telnet 127.0.0.1 110,input the username and password,echo the error: Connection closed by foreign host. THE CONFIG: [root@www fuse-dfs]# dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-71.el6.i686 i686 CentOS Linux release 6.0 (Final) listen = * login_trusted_networks = 10.12.0.0/16 mail_location = mbox:~/mail:INBOX=/var/mail/%u mbox_write_locks = fcntl passdb { driver = pam } protocols = pop3 ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } THE LOG: Dec 3 14:29:13 www dovecot: pop3-login: Aborted login (auth failed, 1 attempts): user=<zhanghao(a)zhanghao.com>, method=PLAIN, rip=10.12.3.1, lip=10.12.3.101, secured Dec 3 14:29:17 www dovecot: auth: Error: userdb(zhanghao,10.12.3.1): user not found from userdb passwd Dec 3 14:29:17 www dovecot: pop3: Error: Authenticated user not found from userdb, auth lookup id=3926917121 (client-pid=8774 client-id=1) Dec 3 14:29:17 www dovecot: pop3-login: Internal login failure (pid=8774 id=1) (auth failed, 1 attempts): user=<zhanghao>, method=PLAIN, rip=10.12.3.1, lip=10.12.3.101, mpid=8775, secured thank you very much! Best Regards 北京信联云通科技有限责任公司 Beijing Octopus link Co. Ltd 北京市海淀区北四环中路257号科群大厦西区 607 技术服务部张昊手机：13810705782 Email: support(a)octlink.com

1 0

[Dovecot] IMAP+SSL
by jugree＠lavabit.com 03 Dec '12

03 Dec '12

Hi. I've already posted on the list (0), but I can't access that account. I don't want to hijack that thread that's why I decided to create this one. > Please don't trim the doveconf -n output... > It shows the version of dovecot (so no one has to ask)... I'm using 1.2.15. (0) http://dovecot.org/pipermail/dovecot/2012-November/069665.html

1 0