February 2014 - dovecot

[Dovecot] allow_nets + default + ldap
by Andreas Schulze 21 May '14

21 May '14

Hello, I'm playing with allow_nets function. It is really cool! In a filebased passwd backend you simply add "allow_nets=192.0.2.143/32" as mentioned in http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/AllowNets But if I use an LDAP backend it looks different. Following http://wiki2.dovecot.org/AuthDatabase/LDAP/AuthBinds and http://wiki2.dovecot.org/AuthDatabase/LDAP/Userdb#Attribute_templates_.28v2… my pass_attrs looks this: pass_attrs = =user=%{ldap:uid}, \ =allow_nets=%{ldap:allownets} Using this syntax I could add an attribute "allownets" in the ldapserver to limit access for a user. A problem occour if the attribute is not present. For example if a user should not be limited or only some but not any user should be limited. So I extend my pass_attrs with a default. pass_attrs = =user=%{ldap:uid}, \ =allow_nets=%{ldap:allownets:10.0.0.0/8} Again, that's fine. Any user was allowed to connect from my private network. But then some users connect via ipv6. I tried to extend my default to pass_attrs = =user=%{ldap:uid}, \ =allow_nets=%{ldap:allownets:10.0.0.0/8,fec0::/16} That syntax, a comma separated list, produces errors no matter if quoting using " or ' or no quoting at all. So I looked at the source (thanks, it's open!) and wrote a little patch to allow simple defaults: - ALL -> allow any address - NONE -> deny any address Now I could write pass_attrs = =user=%{ldap:uid}, =allow_nets=%{ldap:allownets:ALL} or pass_attrs = =user=%{ldap:uid}, =allow_nets=%{ldap:allownets:NONE} to allow or deny any ldap account not having an attribute allownets. Maybe there are other solutions, but that's my way... Andreas

2 3

[Dovecot] 2.2.12: Panic: file mail-index.c: line 380 (mail_index_keywords_unref): assertion failed: (keywords->refcount > 0)
by Leho Kraav 12 May '14

12 May '14

I upgraded 2.1 -> 2.2 something like a week ago because I needed INDEXPVT. Not sure if this crash started immediately or not, noticed it today looking at journalctl. Backtrace http://bpaste.net/raw/181944/ and pasted below. This seems to crash on every IMAP connection made, so any ideas for a possible client-level workaround are quite welcome until dovecot code improves here. root@server ~ $ dovecot -n # 2.2.12: /etc/dovecot/dovecot.conf # OS: Linux 3.4.54-vs2.3.3.5+pf64 x86_64 Gentoo Base System release 2.2 ext4 hostname = *hidden* listen = 192.168.1.2 log_path = /dev/stderr log_timestamp = mail_gid = mail mail_home = /secure/Maildir/%n mail_location = Maildir:/secure/Maildir/%n mail_plugins = acl mail_privileged_group = mail mail_uid = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = children location = maildir:/secure/Maildir/%%n:INDEXPVT=/secure/Maildir/%n/shared/%%n prefix = Shared.%%n. separator = . subscriptions = no type = shared } namespace { location = maildir:/secure/Maildir/projekt:INDEX=/secure/Maildir/%n/projekt prefix = Projekt. separator = . subscriptions = no type = public } namespace { location = maildir:/secure/Maildir/rss:INDEX=/secure/Maildir/%n/rss prefix = RSS. separator = . subscriptions = no type = public } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/secure/Maildir/shared-mailboxes.db mail_log_events = mailbox_delete sieve = /secure/Maildir/%n/dovecot-sieve sieve_dir = /secure/Maildir/%n/sieve sieve_global_path = /etc/dovecot/sieve/default.sieve } postmaster_address = postmaster protocols = imap lmtp sieve service auth { unix_listener auth-userdb { mode = 0600 user = mail } user = mail } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/ssl/server.crt ssl_key = </etc/ssl/server.key userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = acl sieve acl } protocol imap { mail_max_userip_connections = 20 mail_plugins = acl imap_acl } protocol sieve { managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date } #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out>

3 2

[Dovecot] Dovecot quoting problem?
by Gerhard Wiesinger 07 May '14

07 May '14

Hello Timo, I think the following commit makes problems: http://hg.dovecot.org/dovecot-2.2/rev/68a8b650578e # Doesn't work A01 LIST "" ~/Mail/Gesendet # OK with quoted mailbox A02 LIST "" "~/Mail/Gesendet" Details: imap * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in as user A01 LIST "" ~/Mail/Gesendet A01 BAD Error in IMAP command LIST: literal8 not allowed here A02 LIST "" "~/Mail/Gesendet" * LIST (\NoInferiors \UnMarked) "/" ~/Mail/Gesendet A02 OK List completed. A03 STATUS ~/Mail/Gesendet (MESSAGES UNSEEN RECENT) A03 BAD Error in IMAP command STATUS: literal8 not allowed here A04 STATUS "~/Mail/Gesendet" (MESSAGES UNSEEN RECENT) * STATUS ~/Mail/Gesendet (MESSAGES 0 RECENT 0 UNSEEN 0) A04 OK Status completed. Is this a bug of dovecot or a bug of the IMAP client (roundcube mail)? Thank you Ciao, Gerhard

2 2

[Dovecot] BUG report: doveadm HEADER <field> <pattern> when concatenating with another Search key
by megodin＠inboxalias.com 07 May '14

07 May '14

Hey there, I'm pretty sure I've found a bug with doveadm when concatenating with another search key. While doveadm HEADER <field pattern> works fine when not using additional search keys, it doesn't work properly when concatenating with other serarch keys - it then simply seems to ignore the additional HEADER <field pattern> search key. It's reproduceable, also with different user accounts on 2 different productive systems. Testing it on latest dovecot-ee 2.2.9.2 and 2.2.5.5. I think it's best explained with showing some examples: doveadm search -u exampleuser SUBJECT Silvester (outputs correctly 10 matches) 5a09f50926daef51b50e000025ab05f8 1106 5a09f50926daef51b50e000025ab05f8 1107 5a09f50926daef51b50e000025ab05f8 1579 5a09f50926daef51b50e000025ab05f8 4092 5a09f50926daef51b50e000025ab05f8 5330 5a09f50926daef51b50e000025ab05f8 9773 5a09f50926daef51b50e000025ab05f8 11460 5a09f50926daef51b50e000025ab05f8 12718 5a09f50926daef51b50e000025ab05f8 15653 5a09f50926daef51b50e000025ab05f8 15697 doveadm search -u exampleuser SUBJECT Silvester HEADER Return-Path someuser(a)example.com (gives exactly the same output - but this is WRONG, as the given Subject AND Return-Path is really only found in 1 Message - uid 15697) 5a09f50926daef51b50e000025ab05f8 1106 5a09f50926daef51b50e000025ab05f8 1107 5a09f50926daef51b50e000025ab05f8 1579 5a09f50926daef51b50e000025ab05f8 4092 5a09f50926daef51b50e000025ab05f8 5330 5a09f50926daef51b50e000025ab05f8 9773 5a09f50926daef51b50e000025ab05f8 11460 5a09f50926daef51b50e000025ab05f8 12718 5a09f50926daef51b50e000025ab05f8 15653 5a09f50926daef51b50e000025ab05f8 15697 doveadm search -u exampleuser HEADER Return-Path someuser(a)example.com (showing that Return-Path as standalone search key is working fine - note that message uid 15697 with subject "Silvester" is also found of course. I manually checked all Mails showing up here, they all contained the Return-Path "someuser(a)example.com" as they should): 5a09f50926daef51b50e000025ab05f8 14080 5a09f50926daef51b50e000025ab05f8 14814 5a09f50926daef51b50e000025ab05f8 14815 5a09f50926daef51b50e000025ab05f8 14820 5a09f50926daef51b50e000025ab05f8 14825 5a09f50926daef51b50e000025ab05f8 14830 5a09f50926daef51b50e000025ab05f8 14832 5a09f50926daef51b50e000025ab05f8 14833 5a09f50926daef51b50e000025ab05f8 15427 5a09f50926daef51b50e000025ab05f8 15428 5a09f50926daef51b50e000025ab05f8 15430 5a09f50926daef51b50e000025ab05f8 15431 5a09f50926daef51b50e000025ab05f8 15697 Further testing with: doveadm search -u exampleuser HEADER Return-Path completegarbageforsurenotinheaders (Correctly no output was given.) doveadm search -u exampleuser SUBJECT Silvester HEADER Return-Path completegarbageforsurenotinheaders (again ignoring the additional HEADER and showing all uids which just match the SUBJECT) 5a09f50926daef51b50e000025ab05f8 1106 5a09f50926daef51b50e000025ab05f8 1107 5a09f50926daef51b50e000025ab05f8 1579 5a09f50926daef51b50e000025ab05f8 4092 5a09f50926daef51b50e000025ab05f8 5330 5a09f50926daef51b50e000025ab05f8 9773 5a09f50926daef51b50e000025ab05f8 11460 5a09f50926daef51b50e000025ab05f8 12718 5a09f50926daef51b50e000025ab05f8 15653 5a09f50926daef51b50e000025ab05f8 15697 Moreove, when playing with HEADER Reply-To it shows some strange behaviour, note the differences with the ":" : doveadm search -u exampleuser SUBJECT blubbs HEADER Reply-to kacke(a)example.com f64cf50926daef51b50e000025ab05f8 2231 f64cf50926daef51b50e000025ab05f8 2781 5a09f50926daef51b50e000025ab05f8 13620 5a09f50926daef51b50e000025ab05f8 15763 doveadm search -u exampleuser SUBJECT blubbs HEADER Reply-to: kacke(a)example.com f64cf50926daef51b50e000025ab05f8 2231 5a09f50926daef51b50e000025ab05f8 13620 Can you please have a look at this and fix it? Thanks in advance, Megodin -- mailstorage @ NFS with nfsvers=3 (NetApp) # 2.2.5.5 (e5350245ad9b): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.4 (Santiago) nfs import_environment = TZ DEBUG_OUTOFMEM DOVECOT_HOSTDOMAIN # 2.2.9.2 (8d71ef248a6e): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 CentOS release 6.5 (Final) nfs _________________________________________________________________ Send and receive anonymous emails to your inbox with InboxAlias. http://www.inboxalias.com

2 1

[Dovecot] New global ACL mailbox pattern feature in HG
by Thomas Leuxner 07 May '14

07 May '14

Hi, I played around with changeset 9376bf098692 a bit. Right now I'm unsure how to describe a namespace using this feature. Using something like 'Public/*" doesn't seem to work while 'Public*" does, but would also potentially alter non-related mailboxes elsewhere: $ cat global-acl INBOX owner lrwstiekxap Public* group=PublicMailboxAdmins lrwsik Regards Thomas

2 8

[Dovecot] SSL/TLS handshake stays forever without timeout
by morrison 07 May '14

07 May '14

Hi, I am a system admin and I am evaluating using dovecot as our email server. In my test, I found that if I telneted to 993 port and did not do anything or I telneted to 143 port, sent starttls command and then did not do anything, the connection stayed forever without timeout. This will make our mail server vulnerable to DOS attack. I dig into dovecot Wiki and did not find any solution. This seems to me that dovecot does not handle SSL/TLS handshake timeout. I am wondering if this is a known issue and will be fixed in near future. Thanks,

6 5

[Dovecot] output of doveconf in conflict with order of settings in conf.d/*-*.conf files
by Steffen Kaiser 02 May '14

02 May '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I wanted to enable stats, so I added the settings from http://wiki2.dovecot.org/Statistics into conf.d/99-stats.conf: mail_plugins = $mail_plugins stats protocol imap { mail_plugins = $mail_plugins imap_stats } plugin { # how often to session statistics stats_refresh = 30 secs # track per-IMAP command statistics stats_track_cmds = yes } reloaded dovecot, see output of doveconf -n below, but I got the error: imap: Error: Can't load plugin imap_stats_plugin: Plugin stats must be loaded also (you must set: mail_plugins=$mail_plugins stats) If I move the line "mail_plugins = $mail_plugins stats" from 99-stats.conf into 15-stats.conf, the output of doveconf -n looks the same, but the stats is working. I tried finding information about the significance of the order of settings - I mean which number should a conf-file has - , but failed in the Wiki and mailing list. Is this a bug or should there be a documentation? ===== # 2.2.10 (5432b55a2b87): /usr/local/dovecot-2.2.10/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.8 auth_cache_size = 10 M auth_mechanisms = plain login base_dir = /var/run/dovecot2.2/ default_vsz_limit = 512 M deliver_log_format = msgid=%m: %$ %p/%w "%f" "%s" dict { acl = pgsql:/usr/local/dovecot-2.2.10/etc/dovecot/dovecot-dict-sql.conf.ext quota = pgsql:/usr/local/dovecot-2.2.10/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no instance_name = dovecot2.2 lda_mailbox_autocreate = yes lmtp_save_to_detail_mailbox = yes log_path = /var/log/dovecot/dovecot2.2.log log_timestamp = "%F %H:%M:%S " mail_gid = vmail mail_log_prefix = "%Us(%u) [%p]: " mail_max_userip_connections = 0 mail_plugins = " quota notify mail_log zlib acl stats" mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = users.%%u. separator = . type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = proxy::acl antispam_allow_append_to_spam = yes antispam_backend = spool2dir antispam_spam = SPAM+ReportAsSPAM antispam_spool2dir_notspam = /tmp/spamspool/%%020lu-%%05lu-%u-H antispam_spool2dir_spam = /tmp/spamspool/%%020lu-%%05lu-%u-S antispam_trash = trash;TRASH;Trash;spam;SPAM;Spam;junk;JUNK;Junk;Deleted Items;Deleted Messages;Gel&APY-schte Elemente;Gel&APY-schte Objekte;Junk E-mail;Junk-E-Mail;INBOX.Trash;INBOX.TRASH;INBOX.trash mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size vsize from subject quota = dict:User quota::proxy::quota quota_rule = *:storage=300MB quota_rule2 = Trash:storage=+30M recipient_delimiter = + sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_actions = 0 sieve_quota_max_storage = 3M stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 128 M stats_refresh = 30 secs stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours } postmaster_address = postmaster(a)inf.h-brs.de protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { unix_listener auth-client { mode = 0766 } unix_listener auth-userdb { mode = 0766 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service doveadm { unix_listener doveadm-server { mode = 0666 } } service imap-login { process_min_avail = 4 service_count = 0 vsz_limit = 768 M } service imap { process_limit = 10000 vsz_limit = 768 M } service lmtp { vsz_limit = 768 M } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { process_min_avail = 5 service_count = 0 vsz_limit = 512 M } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_ca = </etc/ssl/certs/ca.crt ssl_cert = </etc/ssl/certs/imap.pem ssl_key = </etc/ssl/private/imap.key userdb { driver = prefetch } userdb { args = /usr/local/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf.ext default_fields = home=/home/%u uid=vmail gid=vmail driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = " quota notify mail_log zlib acl quota sieve" } protocol lda { mail_plugins = " quota notify mail_log zlib acl quota sieve" } protocol imap { mail_plugins = " quota notify mail_log zlib acl imap_quota imap_zlib imap_acl antispam imap_stats" } - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUwHPOnD1/YhP6VMHAQJ4Gwf/S+Vve0EOamXd0qok6Q8soRkmbXbU+lgm Fc2759gkZo05N9cNgHTe5T5ulSvZ+XcOt0DnResyHhz0/r6UlxCeR4pQyvxFHG9K eKsej2IlsG5ilT3xKCMHaB+wQg9f2lb4PQzD1flLANPESU3LSVZMpPCxy7O3LWN2 JQahrRNNjyK8mNOAw0M3F8SbT604co37acO47S90BEMcd2lfIZpHiAkH8NV22l9E /vM9yzvPwMADWXeFbMnvb8lSSb78zTe+P2tl/IOlxrBOODPF4+Whh790zpu5K8DO yLddMVFsGmC07aPGI70BldITvTkc0LzHurB2dTLH3mdoN5tgD1JhtA== =uqLL -----END PGP SIGNATURE-----

2 3

[Dovecot] ID command and dovecot
by Jernej Porenta 02 May '14

02 May '14

Heya, we are seeing some strange issues with IMAP ID command using latest Roundcube builds on dovecot 2.2.10 responding "Input buffer full, aborting". Roundcube webmail connects to IMAP server and issues ID command first with some long arguments to ID command, however shorter than 1024 octets, which are specified in RFC2971 for ID IMAP extension. The situation is easily reproducible (see http://pastebin.com/q4HX4wqb) # telnet hostname 143 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Server ready. . ID ("name" "Roundcube" "version" "1.0-git" "php" "5.3.3" "os" "Linux" "command" "<$long_less_than_1024_octets_string>") * BYE Input buffer full, aborting However, this problem does not occur when user is already logged in. RFC2971 is saying "Field strings MUST NOT be longer than 30 octets. Value strings MUST NOT be longer than 1024 octets. Implementations MUST NOT send more than 30 field-value pairs." IMHO, dovecot is handling ID command before successful login successfully only if the length of the whole command is less than 1024 octets (exactly 861 octets is working fine, over that "Input buffer full" occurs). I tried finding the reference in the source code, however I am unable to find where this limit actually occurs (maybe IMAP_ARG_STRING imap_arg->type?) thank you in advance, regards, Jernej

2 1

[Dovecot] nfs flush/fsync config settings problem
by Troton_admin 03 Apr '14

03 Apr '14

Hi, I need to place a maildir storage on a NFS filesystem, so I set up the config like this: mmap_disable = yes mail_nfs_storage = yes mail_nfs_index = yes mail_fsync = always lock_method = dotlock (also tried fcntl - local lockd is running, no success, now using dotlock, to be sure while debugging) The problem is that Dovecot (2.2.9/2.2.10 - the relevant code in mail-index.c is the same) logs a fatal error and quits the session (no daemon crash/coredump). Jan 07 14:13:31 auth: Debug: client in: AUTH 1 PLAIN service=pop3 session=fRCRJGHvbADDUKU9 lip=192.168.100.102 rip=IP_ADDR lport=1110 rport=48236 resp=AHRyb3RvbjEAdHJvdG9uMQ== (previous base64 data may contain sensitive data) Jan 07 14:13:31 auth: Debug: passwd-file(troton1,IP_ADDR,<fRCRJGHvbADDUKU9>): lookup: user=troton1 file=/usr/local/etc/dovecot/passwd-file Jan 07 14:13:31 auth: Debug: client passdb out: OK 1 user=troton1 Jan 07 14:13:31 auth: Debug: master in: REQUEST 1289355265 29049 1 4f9fdd9e4069fa503e8e6bcc09d4cf30 session_pid=29089 Jan 07 14:13:31 auth: Debug: passwd-file(troton1,IP_ADDR,<fRCRJGHvbADDUKU9>): lookup: user=troton1 file=/usr/local/etc/dovecot/passwd-file Jan 07 14:13:31 auth: Debug: master userdb out: USER 1289355265 troton1 uid=81 gid=81 home=/home/troton1 mail=maildir:~/Maildir Jan 07 14:13:31 pop3-login: Info: Login: user=<troton1>, method=PLAIN, rip=IP_ADDR, lip=192.168.100.102, mpid=29089, session=<fRCRJGHvbADDUKU9> Jan 07 14:13:31 pop3: Debug: Added userdb setting: mail=maildir:~/Maildir Jan 07 14:13:31 pop3(troton1): Debug: Effective uid=81, gid=81, home=/home/troton1 Jan 07 14:13:31 pop3(troton1): Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir Jan 07 14:13:31 pop3(troton1): Debug: maildir++: root=/home/troton1/Maildir, index=, indexpvt=, control=, inbox=/home/troton1/Maildir, alt= Jan 07 14:13:31 pop3(troton1): Info: DEBUG1: fsync_mode=2 , mask=0 Jan 07 14:13:31 pop3(troton1): Info: DEBUG2: fsync_mode=2 flags=85 Jan 07 14:13:31 pop3(troton1): Debug: Namespace : Using permissions from /home/troton1/Maildir: mode=0700 gid=default Jan 07 14:13:31 pop3(troton1): Info: DEBUG2: fsync_mode=0 flags=85 The user/passdb is just a plaintext file, for debugging purposes. But what is strange, the messages system log shows: Jan 7 14:13:31 mailhub2 dovecot: pop3(troton1): Fatal: nfs flush requires mail_fsync=always That is obviously wrong, even its own doveconf -n utility shows the correct value. # doveconf -n | grep -E 'sync|nfs' mail_fsync = always mail_nfs_index = yes mail_nfs_storage = yes maildir_very_dirty_syncs = yes Affected code seems to be in the lib-index/mail-index.c file, mail_index_file function - around line 585 : // my custom debug line i_info("DEBUG2: fsync_mode=%u flags=%u", (unsigned int)(index->fsync_mode),(unsigned int)flags); if ((flags & MAIL_INDEX_OPEN_FLAG_NFS_FLUSH) != 0 && index->fsync_mode != FSYNC_MODE_ALWAYS) i_fatal("nfs flush requires mail_fsync=always"); The first time it sees fsync_mode=2 (which is correct value of FSYNC_MODE_ALWAYS), but next function call is with index->fsync_mode=0 and an error is raised, see the logfile above. Dovecot correctly creates its working files in user's home directory - dovecot-uidlist, dovecot-uidvalidity, dovecot-uidvalidity.52cbfd7b, dovecot.index.log . The complete (testing, not production) doveconf -n is: == # 2.2.10: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 7.3-RELEASE-p3 amd64 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = sha1 default_process_limit = 200 disable_plaintext_auth = no first_valid_uid = 81 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep info_log_path = /var/log/dovecot.log last_valid_uid = 81 listen = 192.168.100.102 lock_method = dotlock mail_debug = yes mail_fsync = always mail_gid = 81 mail_location = maildir:%h/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_prefetch_count = 5 mail_uid = 81 mailbox_list_index = yes maildir_stat_dirs = yes maildir_very_dirty_syncs = yes mmap_disable = yes namespace inbox { inbox = yes location = mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . type = private } passdb { args = scheme=plain username_format=%n /usr/local/etc/dovecot/passwd-file driver = passwd-file } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid subject size } pop3_enable_last = yes pop3_save_uidl = yes protocols = imap pop3 service doveadm { inet_listener { port = 9292 } } service imap-login { inet_listener imap { port = 1143 } } service imap { process_limit = 250 } service pop3-login { inet_listener pop3 { port = 1110 } } service pop3 { process_limit = 200 } ssl = no userdb { args = username_format=%n /usr/local/etc/dovecot/passwd-file default_fields = uid=81 gid=0 home=/home/%n driver = passwd-file } protocol imap { mail_max_userip_connections = 5 } protocol pop3 { mail_max_userip_connections = 5 } == OS: 7.3-RELEASE-p3 FreeBSD 7.3-RELEASE-p3 #1 amd64 Affected Dovecot version: 2.2.9, 2.2.10 How to repeat: Anytime I enter the correct username/pass pair And I tried to place the homedir on a local disk too, and I got the same error as on NFS. Any ideas, what could possibly be wrong ? Is it a feature or a bug ? Thanks for your help. Regards, Troton

3 2

[Dovecot] Is replication broken?
by IT geek 31 03 Apr '14

03 Apr '14

Hi, Apologies for this being my 248th post about replication... The current error I'm getting is: Jan 30 12:10:54 Server1 dovecot: dsync-local(MailUser1): Error: dsync( Server2.test.com) read() failed: read((fd)) failed: Connection reset by peer Subsequent errors are: Jan 30 12:15:47 Server1 dovecot: dsync-local(MailUser1): Error: read( Server2.test.com) failed: EOF The above error is seen on Server1, after the initial sync completes of the first mailbox (Sent folder to be precise). Does anyone have an ideas as to what might be causing it? These are brand new rebuilds, running the latest build - I just can't seem to get this working. Bug maybe? Configs are as follows: Server1: # 2.2.10: /usr/pkg/etc/dovecot/dovecot.conf # OS: NetBSD 5.2 cobalt auth_mechanisms = plain login doveadm_password = secret doveadm_port = 12345 first_valid_uid = 1003 last_valid_uid = 1020 listen = 192.168.1.1 login_greeting = test.com mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_plugins = " notify replication" passdb { driver = passwd } plugin { mail_replica = tcp:Server2.test.com } protocols = imap service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0600 } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service imap-login { inet_listener imap { port = 0 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl_cert = </etc/openssl/certs/Server1.test.crt ssl_key = </etc/openssl/private/Server1.test.key userdb { driver = passwd } protocol lda { postmaster_address = postmaster(a)test.com } ServerB: # 2.2.10: /usr/pkg/etc/dovecot/dovecot.conf # OS: NetBSD 5.1 cobalt auth_mechanisms = plain login doveadm_password = secret doveadm_port = 12345 listen = 192.168.1.2 login_greeting = test.com mail_location = mbox:~/mail:INBOX=/var/mail/%u passdb { driver = passwd } protocols = imap service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0600 } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service doveadm { inet_listener { port = 12345 } } service imap-login { inet_listener imap { port = 0 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl_cert = </etc/openssl/certs/Server2.test.com.crt ssl_key = </etc/openssl/private/Server2.test.com.key userdb { driver = passwd } protocol lda { postmaster_address = postmaster(a)test.com }

4 15