- dovecot - dovecot.org

[Dovecot] Missing i_stream_unref in imap_msgpart_crlf_seek()?
by Tomasz Potega 06 Nov '13

06 Nov '13

Hi, imap_msgpart_crlf_seek() returns an error stream in case of problems in message_skip_virtual(). The original input stream is not being unreferenced, preventing destroy callbacks from being executed. Shouldn't we have an i_stream_unref(&input) here: src/lib-imap-storage/imap-msgpart.c: 398 if (message_skip_virtual(input, virtual_skip, &cr_skipped) < 0) { 399 errinput = i_stream_create_error(errno); 400 i_stream_set_name(errinput, i_stream_get_name(input)); 401 return errinput; 402 } ? Best regards, Tomasz Potęga [Wirtualna Polska] <http://www.wp.pl> Znajdziesz nas tutaj: [Wp na Facebooku] <https://www.facebook.com/WirtualnaPolska> [Wp na Twitterze] <https://twitter.com/wirtualnapolska> [Wp na SlideShare] <http://www.slideshare.net/wirtualnapolska> [Wp w Google+] <https://plus.google.com/+wppl> [Wp na YouTube] <https://www.youtube.com/user/wptvwppl> "WIRTUALNA POLSKA" Spółka Akcyjna z siedzibą w Gdańsku przy ul. Traugutta 115 C, wpisana do Krajowego Rejestru Sądowego - Rejestru Przedsiębiorców prowadzonego przez Sąd Rejonowy Gdańsk - Północ w Gdańsku pod numerem KRS 0000068548, o kapitale zakładowym 67.980.024,00 złotych opłaconym w całości oraz Numerze Identyfikacji Podatkowej 957-07-51-216.

2 1

[Dovecot] get_disconnect_reason() gets called with NULL ctx->litinput
by Tomasz Potega 06 Nov '13

06 Nov '13

Hi, I have found get_disconnect_reason() to be called with NULL ctx->litinput at times, making dovecot crash when accessing v_offset: src/imap/cmd-append.c: 83 switch (i_stream_read(client->input)) { 84 case -1: 85 /* disconnected */ 86 reason = get_disconnect_reason(ctx, ctx->litinput->v_offset); 87 cmd_append_finish(cmd->context); 88 /* Reset command so that client_destroy() doesn't try to call 89 cmd_append_continue_message() anymore. */ Best regards, Tomasz Potęga [Wirtualna Polska] <http://www.wp.pl> Znajdziesz nas tutaj: [Wp na Facebooku] <https://www.facebook.com/WirtualnaPolska> [Wp na Twitterze] <https://twitter.com/wirtualnapolska> [Wp na SlideShare] <http://www.slideshare.net/wirtualnapolska> [Wp w Google+] <https://plus.google.com/+wppl> [Wp na YouTube] <https://www.youtube.com/user/wptvwppl> "WIRTUALNA POLSKA" Spółka Akcyjna z siedzibą w Gdańsku przy ul. Traugutta 115 C, wpisana do Krajowego Rejestru Sądowego - Rejestru Przedsiębiorców prowadzonego przez Sąd Rejonowy Gdańsk - Północ w Gdańsku pod numerem KRS 0000068548, o kapitale zakładowym 67.980.024,00 złotych opłaconym w całości oraz Numerze Identyfikacji Podatkowej 957-07-51-216.

2 1

[Dovecot] ssl-params regeneration with dovecot 2.2.7
by Frank Elsner 06 Nov '13

06 Nov '13

Hello, after switching from version 2.2.7 to 2.2.7 I miss the loglines which say: ssl-params: Generating SSL parameters ssl-params: SSL parameters regeneration completed The configuration has not been changed and reads: | # 2.2.7: /usr/local/dovecot/etc/dovecot/dovecot.conf | # OS: Linux 2.6.35.14-106.fc14.i686.PAE i686 Fedora release 14 (Laughlin) ext3 | auth_mechanisms = plain login | default_vsz_limit = 512 M | first_valid_uid = 200 | last_valid_uid = 65534 | listen = * | lmtp_save_to_detail_mailbox = yes | login_greeting = c64.shuttle.de - IMAPs Service (dovecot) ready. | login_log_format_elements = %u %r %c | mail_location = maildir:/var/spool/mail/%u | mail_log_prefix = "%Us(%u,%r): " | mail_plugin_dir = /usr/dovecot/lib/dovecot/ | mail_plugins = notify quota fts fts_squat | namespace inbox { | inbox = yes | list = yes | location = | mailbox Drafts { | special_use = \Drafts | } | mailbox Gesendet { | special_use = \Sent | } | mailbox SPAM { | special_use = \Junk | } | mailbox Sent { | special_use = \Sent | } | mailbox Trash { | special_use = \Trash | } | prefix = | subscriptions = yes | type = private | } | passdb { | args = dovecot | driver = pam | } | plugin { | fts = squat | fts_squat = partial=4 full=10 | mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append | mail_log_fields = uid box from subject msgid size flags | mail_log_group_events = yes | quota = maildir:User quota | quota_rule = *:storage=2G | quota_rule2 = Trash:storage=+100M | } | postmaster_address = postmaster(a)moltke28.b.shuttle.de | protocols = imap | service anvil { | client_limit = 1027 | } | service auth { | unix_listener auth-client { | group = exim | mode = 0660 | user = exim | } | } | service imap-login { | inet_listener imap { | port = 143 | } | inet_listener imaps { | port = 993 | ssl = yes | } | process_limit = 512 | process_min_avail = 10 | } | service imap-postlogin { | executable = script-login /usr/local/sbin/dovecot-imap-post-login | } | service imap { | executable = imap imap-postlogin | } | service lmtp { | inet_listener lmtp { | address = 0.0.0.0 | port = 24 | } | } | service pop3-login { | inet_listener pop3 { | port = 110 | } | inet_listener pop3s { | port = 995 | ssl = yes | } | } | service pop3 { | process_limit = 1024 | } | ssl_cert = </usr/local/etc/c64.shuttle.de.CRT | ssl_key = </usr/local/etc/c64.shuttle.de-dovecot.KEY | ssl_parameters_regenerate = 1 hours | userdb { | driver = passwd | } | verbose_proctitle = yes | protocol lmtp { | mail_plugins = notify quota fts fts_squat | } | protocol lda { | mail_plugins = notify quota fts fts_squat | } | protocol imap { | imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags | imap_logout_format = [%i/%o] | mail_max_userip_connections = 0 | mail_plugins = notify quota fts fts_squat quota mail_log imap_quota listescape fts fts_squat | } What's going on? No more logging or no regeneration? Greetings, Frank Elsner

2 2

[Dovecot] 2.2.6 auth process crash using LMTP and LDAP on director.
by Olivier Girard 06 Nov '13

06 Nov '13

I'm upgrading my configuration to use director and lmtp for delivery. (doveconf -n at end of the mail). I use the same config for auth on mail backends and see no errors. My setup seem to work nicely but i have some auth process crashing when using lmtp protocol. Everything is working a sexpected then i've got 5-6 errors like this in logs and a crach of the auth process: dovecot: lmtp(47269): Error: passdb lookup(_mail_): Disconnected unexpectedly pid 47406 (auth), uid 143: exited on signal 11 Actually, i didn't configure to core dump. Do you think seting up lmtp protocol to static auth adding something like folow will be better for this problem? protocol lmtp { passdb { args = proxy=y nopassword=y driver = static } } Please note that my configuration is actually listening on inet fot LMTP but that the goal is to configure postfix on the same server and switch to socket, this expain the configuration of the service auth to provide a socket to postfix. Here is my director config: % doveconf -n # 2.2.6: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.4-RELEASE-p4 amd64 auth_cache_negative_ttl = 0 auth_cache_size = 16 M auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = sha1 default_process_limit = 4000 director_mail_servers = 192.168.16.1 192.168.16.2 192.168.16.3 director_servers = 192.168.16.4 192.168.16.5 192.168.16.6 disable_plaintext_auth = no doveadm_port = 24245 info_log_path = syslog instance_name = director lmtp_proxy = yes mail_debug = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size } service anvil { client_limit = 12003 } service auth-worker { process_min_avail = 10 user = $default_internal_user } service auth { client_limit = 16000 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0666 user = $default_internal_user } user = $default_internal_user } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = 192.168.16.4 port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap-login { executable = imap-login director } service lmtp { inet_listener lmtp { address = * :: port = 24 } } service pop3-login { executable = pop3-login director } ssl_cert = </etc/ssl/cert/mail.univ-angers.fr.pem ssl_key = </etc/ssl/cert/mail.univ-angers.fr.key userdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { auth_socket_path = director-userdb } protocol doveadm { auth_socket_path = director-userdb } local 192.168.16.0/24/24 { doveadm_password = mysecret } Last thing, in my config file, there is only one /24 on local network but this is another problem.

1 0

[Dovecot] Best way from Mbox to Maildir using 2.17?
by Regan Yelcich 05 Nov '13

05 Nov '13

Can someone advise the best way to convert mailboxes from Mbox to Maildir for Dovecot 2.17 on Ubuntu? Thanks.

9 20

Re: [Dovecot] Issue with postfix not handing over e-mails to dovecot
by Joseph Tam 05 Nov '13

05 Nov '13

Tru Pheenix writes: > posftconf output: https://gist.github.com/anonymous/7318863 > doveconf output: https://gist.github.com/anonymous/7318896 > tail -f /var/log/mail.* output (when receiving mail): > https://gist.github.com/anonymous/7318945 Unless these are exceeding long, you probably should inline the contents to save people from having to jump around to get the information to help you. It will also properly archive the context to the solution. >From your logs, it appears your mail system does not know what user is mapped to "someone(a)mydomain.com": Nov 5 13:21:06 localhost postfix/local[11185]: 5716D8007B: to=<someone(a)mydomain.com>, relay=local, delay=0.59, delays=0.57/0.01/0/0.01, dsn=5.1.1, status=bounced (unknown user: "someone") I don't know whether this message is produced by postfix or by dovecot, but one thing I did notice is that your postfix configuration mailbox_command = /usr/lib/dovecot/deliver -c /etc/dovecot/conf.d/01-mail-stack-delivery.conf -m "${EXTENSION}" has upper-case "EXTENSION", whereas the Dovecot wiki uses lower case: http://wiki2.dovecot.org/LDA/Postfix If that's not it, maybe it's your SQL. You can also ask dovecot to look up user "somebody" and debug your way from there: doveadm user somebody Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] squat assertion result core dump with imap process
by Kui Zhang 05 Nov '13

05 Nov '13

Hello, Recently, we had a file system problem. After fsck we started to get some core dump with imap process. Nov 4 15:15:04 mail_server1 dovecot: imap(user(a)domain.tld): Panic: file squat-trie.c: line 293 (squat_trie_lock): assertion failed: (trie->fd != -1) Nov 4 15:15:04 mail_server1 dovecot: imap(user(a)domain.tld): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4892a) [0x7fe8b7c9392a] -> /usr/lib/dovecot/libdovecot.so.0(+0x48976) [0x7fe8b7c93976] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7fe8b7c66faf] -> /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so(+0x4ef4) [0x7fe8b51d9ef4] -> /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so(squat_trie_build_deinit+0x9d2) [0x7fe8b51dcc02] -> /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so(+0x4150) [0x7fe8b51d9150] -> /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so(+0x41b1) [0x7fe8b51d91b1] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0x6b7c) [0x7fe8b5a05b7c] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_backend_update_deinit+0x2c) [0x7fe8b5a05bfc] -> /usr/lib/dovecot/modules/lib10_quota_plugin.so(+0xb65a) [0x7fe8b642765a] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_sync_begin+0x419) [0x7fe8b7f22069] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_sync+0x46) [0x7fe8b7f224a6] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_storage_sync_init+0x87) [0x7fe8b7f22587] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x31) [0x7fe8b7f614d1] -> dovecot/imap [user(a)domain.tld 204.174.223.223 UID](imap_sync_init+0x67) [0x419397] -> dovecot/imap [user(a)domain.tld204.174.223.223 UID](cmd_sync_delayed+0x1c7) [0x419637] -> dovecot/imap [user(a)domain.tld 204.174.223.223 UID](client_handle_input+0x1fd) [0x41131d] -> dovecot/imap [user(a)domain.tld 204.174.223.223 UID](client_input+0x5f) [0x411b7f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7fe8b7c9fb56] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7fe8b7ca0b8f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7fe8b7c9faf8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fe8b7c8b413] -> dovecot/imap [user(a)domain.tld 204.174.223.223 UID](main+0x2a4) [0x419dd4] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7fe8b78dfead] -> dovecot/imap [user(a)domain.tld 204.174.223.223 UID Nov 4 15:15:04 mail_server1 dovecot: imap(user(a)domain.tld): Fatal: master: service(imap): child 28415 killed with signal 6 (core dumped) doveadm index -u user(a)domain.tld mailbox_name Removing index files and re index help with the crashes. From time to time we still get these in the log: Nov 5 10:52:53 mail_server1 dovecot: imap(user(a)domain.tld): Error: Corrupted squat uidlist file /media/drbd/user_name/mdbox/mailboxes/Drafts/dbox-Mails/dovecot.index.search.uids: wrong indexid Nov 5 11:40:00 mail_server1 dovecot: imap(user(a)domain.tld): Error: Corrupted squat uidlist file /media/drbd/user_name/mdbox/mailboxes/folder2/dbox-Mails/dovecot.index.search.uids: wrong indexid I am using: dovecot-dbg 2:2.1.16-0~auto+30 Thanks Kui.Z

1 0

[Dovecot] increased core dumps with v2.2.7
by Anand Kumria 05 Nov '13

05 Nov '13

Hi, After upgrading to v2.2.7 yesterday, I am starting to get a larger number of bugs occurring -- unfortunately I hadn't configured things to save core dumps (now done). But I am seeing things like: dovecot: imap(user(a)example.com): Fatal: master: service(imap): child 27931 killed with signal 11 (core dumped) kernel: [151706.763475] imap[4878]: segfault at 7fff53b0aff8 ip 00007fdc7ed65ece sp 00007fff53b0b000 error 6 in lib20_zlib_plugin.so[7fdc7ed61000+7000] dovecot: imap(user2(a)example.com): Fatal: master: service(imap): child 4870 killed with signal 11 (core dumped) As soon as I have more info., I'll let you know. A

2 2

[Dovecot] (Maybe stupid) question about selecting mailbox
by kjonca＠o2.pl 05 Nov '13

05 Nov '13

Does mailbox with "\NoSelect" can be select or examine? I'm not sure but IMVHO "select x" should not work. $/usr/lib/dovecot/imap * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE COMPRESS=DEFLATE] Logged in as kjonca 2 LIST "x" "*" * LIST (\Noselect \HasChildren) "/" "x" * LIST (\HasNoChildren) "/" "x/y" 2 OK List completed. 3 SELECT x * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1376977764] UIDs valid * OK [UIDNEXT 1] Predicted next UID * OK [NOMODSEQ] No permanent modsequences 3 OK [READ-WRITE] Select completed. 4 logout IMAP(kjonca): Info: Disconnected: Logged out in=35 out=813 * BYE Logging out 4 OK Logout completed. doveconf -n # 2.1.17 (d463fab6db95): /etc/dovecot/dovecot.conf # OS: Linux 3.8.9+1 x86_64 Debian wheezy/sid auth_debug = yes auth_mechanisms = plain digest-md5 cram-md5 login auth_username_format = %n auth_verbose = yes listen = alfa log_path = /var/log/dovecot mail_debug = yes mail_location = maildir:~/Mail/1:LAYOUT=fs:INBOX=~/Mail/1/INBOX mail_log_prefix = "%Us(%u): " mail_plugins = zlib passdb { args = scheme=PLAIN /etc/security/dovecot.pwd driver = passwd-file } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mail_log_fields = uid box msgid size from flags sieve = ~/.dovecot.sieve sieve_execute_bin_dir = %h/sieve/bin sieve_execute_exec_timeout = 86400s sieve_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute +vnd.dovecot.filter sieve_filter_bin_dir = %h/sieve/bin sieve_filter_exec_timeout = 86400s sieve_pipe_bin_dir = %h/sieve/bin sieve_pipe_exec_timeout = 86400s sieve_plugins = sieve_extprograms } protocols = " imap lmtp" service auth { user = root } ssl = no ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd } protocol lmtp { mail_plugins = zlib sieve } protocol lda { deliver_log_format = msgid=%m: %$ log_path = ~/log/deliver.log mail_plugins = zlib sieve postmaster_address = root@localhost } protocol imap { mail_max_userip_connections = 20 mail_plugins = zlib imap_zlib mail_log notify acl } -- http://blogdebart.pl/2009/12/22/mamy-chorych-dzieci/ The goal of Computer Science is to build something that will last at least until we've finished building it.

2 2

[Dovecot] Message parser loops on certain messages (e.g. with a trailing CR character)
by Tomasz Potega 05 Nov '13

05 Nov '13

Hi, dovecot's message parser enters an endless loop when fed with certain multipart messages with stray CR characters. parse_next_body_to_boundary() assumes the '\r' might be the beginning of a boundary line, reducing the block size by one: src/lib-mail/message-parser.c: 404 /* no linefeeds in this block. we can just skip it. */ 405 ret = 0; 406 if (block_r->data[block_r->size-1] == '\r') { 407 /* this may be the beginning of the \r\n--boundary */ 408 block_r->size--; 409 } For a block size of 1 (e.g. the trailing '\r' character), dovecot ends up processing zero-sized blocks, calling message_parser_read_more() without skipping the input stream: ... #6 0x00007f94f49374c7 in i_stream_read (stream=0xbe2fc8) at istream.c:167 #7 0x00007f94f49383d5 in i_stream_read_data (stream=0xbe2fc8, data_r=0x7fff2141d6b0, size_r=0x7fff2141d6b8, threshold=1) at istream.c:497 #8 0x00007f94f4918c2b in message_parser_read_more (ctx=0xbe7c10, block_r=0x7fff2141d6a0, full_r=0x7fff2141d667) at message-parser.c:128 #9 0x00007f94f491af67 in message_parser_parse_next_block (ctx=0xbe7c10, block_r=0x7fff2141d6a0) at message-parser.c:1012 #10 0x00007f94f491b2fb in message_parser_parse_body (ctx=0xbe7c10, hdr_callback=0x7f94f4c69a75 <parse_bodystructure_part_header>, context=0xbf0450) at message-parser.c:1075 #11 0x00007f94f4c6a876 in index_mail_parse_body (mail=0xbecd00, field=MAIL_CACHE_IMAP_BODYSTRUCTURE) at index-mail.c:895 #12 0x00007f94f4c6aedb in index_mail_parse_bodystructure (mail=0xbecd00, field=MAIL_CACHE_IMAP_BODYSTRUCTURE) at index-mail.c:1046 #13 0x00007f94f4c6b4a5 in index_mail_get_special (_mail=0xbecd00, field=MAIL_FETCH_IMAP_BODYSTRUCTURE, value_r=0x7fff2141d958) at index-mail.c:1170 #14 0x00007f94f4bfab53 in maildir_mail_get_special (_mail=0xbecd00, field=MAIL_FETCH_IMAP_BODYSTRUCTURE, value_r=0x7fff2141d958) at maildir-mail.c:570 #15 0x00007f94f4c36ea1 in mail_get_special (mail=0xbecd00, field=MAIL_FETCH_IMAP_BODYSTRUCTURE, value_r=0x7fff2141d958) at mail.c:269 #16 0x000000000041c5d7 in fetch_bodystructure (ctx=0xbd6a48, mail=0xbecd00, context=0x0) at imap-fetch.c:678 ... You will find a sample message attached to this mail. I have added a check to see if the parser is past the EOF (and omit reducing the block size then) as a band-aid fix, but this might call for a more elegant solution. Best regards, Tomasz Potêga [Wirtualna Polska] <http://www.wp.pl> Znajdziesz nas tutaj: [Wp na Facebooku] <https://www.facebook.com/WirtualnaPolska> [Wp na Twitterze] <https://twitter.com/wirtualnapolska> [Wp na SlideShare] <http://www.slideshare.net/wirtualnapolska> [Wp w Google+] <https://plus.google.com/+wppl> [Wp na YouTube] <https://www.youtube.com/user/wptvwppl> "WIRTUALNA POLSKA" Spółka Akcyjna z siedzibą w Gdańsku przy ul. Traugutta 115 C, wpisana do Krajowego Rejestru Sądowego - Rejestru Przedsiębiorców prowadzonego przez Sąd Rejonowy Gdańsk - Północ w Gdańsku pod numerem KRS 0000068548, o kapitale zakładowym 67.980.024,00 złotych opłaconym w całości oraz Numerze Identyfikacji Podatkowej 957-07-51-216.

2 1