- dovecot - dovecot.org

[Dovecot] infinite loop (causing crash) whilst closing connection
by Anand Kumria 05 Nov '13

05 Nov '13

Hi Timo, As a follow-up to my earlier email, I've managed to get a few backtraces now. #305439 o_stream_close (stream=0x1680c10) at ostream.c:85 #305440 0x00007ff222f70f3c in o_stream_zlib_send_outbuf (zstream=0x1680b80) at ostream-zlib.c:97 #305441 0x00007ff222f70fef in o_stream_zlib_send_flush (zstream=0x1680b80) at ostream-zlib.c:182 #305442 0x00007ff222f711cb in o_stream_zlib_flush (stream=<optimized out>) at ostream-zlib.c:222 #305443 0x00007ff2243f142d in o_stream_flush (stream=0x1680c10) at ostream.c:147 #305444 0x00007ff222f70ddf in o_stream_zlib_close (stream=0x1680b80, close_parent=true) at ostream-zlib.c:35 #305445 0x00007ff2243f12ce in o_stream_close_full (close_parents=true, stream=0x1680c10) at ostream.c:49 #305446 o_stream_close (stream=0x1680c10) at ostream.c:85 #305447 0x00007ff222f70f3c in o_stream_zlib_send_outbuf (zstream=0x1680b80) at ostream-zlib.c:97 #305448 0x00007ff222f70fef in o_stream_zlib_send_flush (zstream=0x1680b80) at ostream-zlib.c:182 #305449 0x00007ff222f711cb in o_stream_zlib_flush (stream=<optimized out>) at ostream-zlib.c:222 #305450 0x00007ff2243f142d in o_stream_flush (stream=0x1680c10) at ostream.c:147 #305451 0x00007ff222f70ddf in o_stream_zlib_close (stream=0x1680b80, close_parent=true) at ostream-zlib.c:35 #305452 0x00007ff2243f12ce in o_stream_close_full (close_parents=true, stream=0x1680c10) at ostream.c:49 #305453 o_stream_close (stream=0x1680c10) at ostream.c:85 #305454 0x00007ff222f70f3c in o_stream_zlib_send_outbuf (zstream=0x1680b80) at ostream-zlib.c:97 #305455 0x00007ff222f710ff in o_stream_zlib_send_flush (zstream=0x1680b80) at ostream-zlib.c:193 #305456 0x00007ff222f71491 in o_stream_zlib_sendv (stream=0x1680b80, iov=0x7fff6b3e1870, iov_count=1) at ostream-zlib.c:257 #305457 0x00007ff2243f1785 in o_stream_sendv (stream=0x1680c10, iov=0x7fff6b3e1870, iov_count=1) at ostream.c:229 #305458 0x00007ff2243f186f in o_stream_nsendv (stream=0x1680c10, iov=<optimized out>, iov_count=<optimized out>) at ostream.c:263 #305459 0x00007ff2243f189a in o_stream_nsend (stream=<optimized out>, data=<optimized out>, size=<optimized out>) at ostream.c:255 #305460 0x00000000004157f0 in client_send_tagline (cmd=<optimized out>, data=0x423c82 "OK Close completed.") at imap-client.c:388 #305461 0x000000000040c833 in cmd_close (cmd=0x167c4d0) at cmd-close.c:37 #305462 0x000000000041707d in command_exec (cmd=0x167c4d0) at imap-commands.c:158 #305463 0x0000000000416110 in client_command_input (cmd=0x167c4d0) at imap-client.c:780 #305464 0x00000000004161f5 in client_command_input (cmd=0x167c4d0) at imap-client.c:841 #305465 0x000000000041649d in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x167b8f0) at imap-client.c:879 #305466 client_handle_input (client=0x167b8f0) at imap-client.c:891 #305467 0x00000000004165de in client_continue_pending_input (client=0x167b8f0) at imap-client.c:715 #305468 0x000000000040ed89 in idle_client_input (ctx=<optimized out>) at cmd-idle.c:112 #305469 0x00007ff2243e8686 in io_loop_call_io (io=0x16e67e0) at ioloop.c:387 #305470 0x00007ff2243e953f in io_loop_handler_run (ioloop=<optimized out>) at ioloop-epoll.c:220 #305471 0x00007ff2243e8198 in io_loop_run (ioloop=0x165d730) at ioloop.c:411 #305472 0x00007ff224397b93 in master_service_run (service=0x165d5c0, callback=<optimized out>) at master-service.c:566 #305473 0x000000000040af18 in main (argc=1, argv=0x165d390) at main.c:400 Let me know if you need further information. This is with dovecot v2.2.7 (1:2.2.7.0-1) Thanks, Anand

1 0

[Dovecot] Config problem: want SSL + local roundcube
by Rich 05 Nov '13

05 Nov '13

Hi, Have used dovecot for many years, happy that it worked well without me needing to do anything much! But since the upgrade from v1 to v2.1.7-7 I've come across some config probs. I want IMAP and to force TLS for all internet connections. However, I run RoundCube on the same server (over https) and this needs access too, but this doesn't need to be TLS because it's local anyway. The auto-config update script made some changes, it added the following to force SSL. service imap-login { inet_listener imap { port = 0 } } ssl = required But this seems to forbid the local roundcube service from logging in. Can anyone help me with my config? I had a stab, adding the following, but it didn't work. Was a complete guess anyway! remote 127.0.0.1 { ssl = no service imap-login { inet_listener imap { port = 143 } } } Here's my full config: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 7.2 ext3 auth_default_realm = artfulrobot.com log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/home/virtual/%d/%n mail_privileged_group = mail passdb { args = username_format=%n /etc/exim4/virtual_domains/%d/passwords driver = passwd-file } protocols = imap service auth { unix_listener auth-client { group = Debian-exim mode = 0660 } user = root } service imap-login { inet_listener imap { port = 0 } } ssl = required ssl_cert = </etc/ssl/certs/mail.artfulrobot.com-with-chain.crt ssl_key = </etc/ssl/private/mail.artfulrobot.com.key userdb { args = uid=1001 gid=1001 driver = static } userdb { driver = passwd } Thanks, Rich

3 5

[Dovecot] [bug] ssl-params hangs when FIPS is enabled
by Michal Hlavinka 05 Nov '13

05 Nov '13

Hi, we found a bug in ssl-params. It calls openssl DH generator for 512 and 1024 bits, but in FIPS mode, openssl won't generate anything for less than 1024, so it fails with: error:0506A06E:Diffie-Hellman routines:DH_BUILTIN_GENPARAMS:key size too small but when DH generator fails, ssl-params hangs forever in io_loop_run: __epoll_wait_nocancel() io_loop_handler_run(..) at ioloop-epoll.c:176 io_loop_run(..) at ioloop.c:406 master_service_run(..) at master-service.c:566 main(..) at main.c:156 Getting system in FIPS mode can be a little tricky, but DH_generator simulated failure can do the trick. Just change ssl-params/ssl-params-openssl.c:generate_dh_paramaters:39 - if (dh == NULL) { + if (1 || dh == NULL) { and when you run ssl-params (with no ssl-parameters.dat), it hangs. Let me know if you need more information. Regards, Michal Hlavinka

2 3

[Dovecot] Issue with postfix not handing over e-mails to dovecot
by Tru Pheenix 05 Nov '13

05 Nov '13

Hello! I have installed postfix with dovecot and postgresql. I have set up SASL authentication for postfix and dovecot and been able to test them successfully. I am able to send sasl authenticated emails through smtpd on postfix using a mail client like Thunderbird. However, now I am unable to receive any e-mails. When I respond to the emails, I get a not delivered failure from postfix. I cannot figure out why postfix is not handing over the e-mails to dovecot. So here are some links to follow: posftconf output: https://gist.github.com/anonymous/7318863 doveconf output: https://gist.github.com/anonymous/7318896 tail -f /var/log/mail.* output (when receiving mail): https://gist.github.com/anonymous/7318945 Any help to solve this would be highly appreciated. Regards Tru Pheenix

1 0

Re: [Dovecot] dovecot Digest, Vol 127, Issue 7
by DV Henkel-Wallace 05 Nov '13

05 Nov '13

> Date: Tue, 5 Nov 2013 08:22:57 +0100 (CET) > From: Steffen Kaiser <skdovecot(a)smail.inf.fh-brs.de> > >> >> My specific application: I am running spamassassin and would like users >> to be able to submit spam (and ham) directly by moving it into special >> folders. > I did this before switching to antispam. > I use antispam with spool2dir now, that central directory has a inotify > watcher that trains the messages instantly. This is a great idea. In my case I think I will get away with a five minute cron job since the pickup latency should be manageable to the users and there is less to install. But I like in principle the idea of an immediate, fs-driven trigger, which would probably use fewer CPU cycles in the aggregate. > [...]all my users moved messages into spam/yes, > but copied them into spam/no Unfortunately I can't rely on users getting this right, much less understanding the difference between copy and move semantics. And I'm probably not going to be able to upgrade my users. Thanks for your advice! -d

1 0

[Dovecot] s it safe to manipulate Maildir files directly?
by DV Henkel-Wallace 05 Nov '13

05 Nov '13

> Date: Tue, 5 Nov 2013 08:40:31 +0100 > From: Oli Schacher <dovecot(a)lists.wgwh.ch> > > On Mon, 4 Nov 2013 21:49:59 -0800 > David Henkel-Wallace <gumby(a)henkel-wallace.org> wrote: > >> Having the cron job find the messages and train spamassassin is no >> problem. The question is how to move the messages. Is it safe to >> simply rename the files from my cron job? > [...] >> If I have to go through to Dovecot I am afraid I'd need the user's >> credentials, which is not appropriate. > > you can do all this with doveadm scripts. Oli, thanks for the suggestion. It hadn't occured to me to consider doveadm. That's exactly the right tool. Regards, David

1 0

[Dovecot] Is it safe to manipulate Maildir files directly?
by David Henkel-Wallace 05 Nov '13

05 Nov '13

Dovecoters, is it safe to manipulate files in Maildir/xxx directly or will Dovecot become unstable if I don't make these changes by talking to Dovecot and having it make the changes? (I'm running 2.1.7 under Wheezy, IMAP only) My specific application: I am running spamassassin and would like users to be able to submit spam (and ham) directly by moving it into special folders. A cron job can then find it and take action: feed spam messages to the bayesian trainer and then delete them; feed ham messages to the trainer and then move them into ~/Maildir/cur/ Having the cron job find the messages and train spamassassin is no problem. The question is how to move the messages. Is it safe to simply rename the files from my cron job? The dovecot wiki implies that dovecot will notice a change in mtime and deal with it safely. Am I reading this correctly? Changing a message flags (i.e. name) and/or directory will change mtime. If I have to go through to Dovecot I am afraid I'd need the user's credentials, which is not appropriate. Thanks! -d

3 2

[Dovecot] Stuck with authentication for my dovecot installation.
by Tru Pheenix 04 Nov '13

04 Nov '13

Hello! I have been following instructions from here to setup dovecot along with postfix and postgresql and sasl2. I try to login but I keep getting the following messages in /var/log/mail.log Nov 2 19:51:39 localhost dovecot: ssl-params: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Nov 2 19:51:39 localhost dovecot: anvil: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Nov 2 19:51:39 localhost dovecot: config: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Nov 2 19:51:39 localhost dovecot: log: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Nov 2 19:51:39 localhost dovecot: master: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Nov 2 19:51:44 localhost dovecot: master: Dovecot v2.0.19 starting up (core dumps disabled) Nov 2 19:53:11 localhost dovecot: master: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Nov 2 19:53:11 localhost dovecot: log: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Nov 2 19:53:11 localhost dovecot: master: Dovecot v2.0.19 starting up (core dumps disabled) Nov 2 19:53:29 localhost dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Nov 2 19:53:29 localhost dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_pgsql.so Nov 2 19:53:29 localhost dovecot: auth: Debug: auth client connected (pid=12718) Nov 2 19:53:29 localhost dovecot: auth: pgsql(localhost): Connected to database mails Nov 2 19:53:41 localhost dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011lip=127.0.0.1#011rip=127.0.0.1#011lport=143#011rport=58759#011resp=<hidden> Nov 2 19:53:41 localhost dovecot: auth: Debug: sql(someone(a)mydomain.com,127.0.0.1): query: SELECT userid as user, password FROM users WHERE userid = 'someone(a)mydomain.com' Nov 2 19:53:41 localhost dovecot: auth: sql(someone(a)mydomain.com,127.0.0.1): Password mismatch My doveconf -n gives the following output # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-24-virtual i686 Ubuntu 12.04 LTS auth_debug = yes auth_verbose = yes passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } passdb { driver = pam } protocols = " imap pop3" ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } userdb { driver = passwd } Please let me know what is wrong. Regards Tru Pheenix

2 2

[Dovecot] backup maildir mailbox bugs
by Anand Kumria 04 Nov '13

04 Nov '13

Hi, Using dovecot v2.2.5.5, I get the following: $ doveadm -v backup -R -u user(a)example.com maildir:/home/rsync/ example.com/user/Maildir/ [...] dsync(user(a)example.com): Panic: file dsync-mailbox-export.c: line 228 (export_save_change_get): assertion failed: (change->type == DSYNC_MAIL_CHANGE_TYPE_FLAG_CHANGE) dsync(user(a)example.com): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x59e6a) [0x7f91ad185e6a] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f91ad185f2a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f91ad144b89] -> doveadm [user(a)example.com Printing Quotes send:mailbox recv:mailbox](dsync_mailbox_export_init+0x8b8) [0x434028] -> doveadm [ user(a)example.com Printing Quotes send:mailbox recv:mailbox](dsync_brain_sync_mailbox_open+0x233) [0x42ba83] -> doveadm [ user(a)example.com Printing Quotes send:mailbox recv:mailbox](dsync_brain_slave_recv_mailbox+0x125) [0x42c615] -> doveadm [ user(a)example.com Printing Quotes send:mailbox recv:mailbox](dsync_brain_run+0x369) [0x42a929] -> doveadm [user(a)example.comPrinting Quotes send:mailbox recv:mailbox]() [0x42881b] -> doveadm [ user(a)example.com Printing Quotes send:mailbox recv:mailbox]() [0x411ad7] -> doveadm [user(a)example.com Printing Quotes send:mailbox recv:mailbox](doveadm_mail_try_run+0x260) [0x4127a0] -> doveadm [ user(a)example.com Printing Quotes send:mailbox recv:mailbox](main+0x3f0) [0x4116c0] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xed) [0x7f91acd8e76d] -> doveadm [user(a)example.com Printing Quotes send:mailbox recv:mailbox]() [0x4118bd] Other lines emitted were Info lines indicating what message was being processed. Unfortunately this appears to stop the backup dead in it's tracks. Suggestions on how to proceed? I was (originally) doing this as an IMAP to IMAP copy, and when that failed I managed to get the raw Maildir. Now I appear stuck with that too. Regards, Anand -- “Don’t be sad because it’s over. Smile because it happened.” – Dr. Seuss

2 4

[Dovecot] v2.2.7 released
by Timo Sirainen 04 Nov '13

04 Nov '13

http://dovecot.org/releases/2.2/dovecot-2.2.7.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.7.tar.gz.sig * Some usage of passdb checkpassword could have been exploitable by local users. You may need to modify your setup to keep it working. See http://wiki2.dovecot.org/AuthDatabase/CheckPassword#Security + auth: Added ability to truncate values logged by auth_verbose_passwords (see 10-logging.conf comment) + mdbox: Added "mdbox_deleted" storage, which can be used to access messages with refcount=0. For example: doveadm import mdbox_deleted:~/mdbox "" mailbox inbox subject oops + ssl-params: Added ssl_dh_parameters_length setting. - master process was doing a hostname.domain lookup for each created process, which may have caused a lot of unnecessary DNS lookups. - dsync: Syncing over 100 messages at once caused problems in some situations, causing messages to get new UIDs. - fts-solr: Different Solr hosts for different users didn't work.

4 4