- dovecot - dovecot.org

[Dovecot] imap process and indexer-worker crash while creating folders
by Michael Kliewe 07 May '14

07 May '14

Hi, our dovecot processes sometimes crash when we create new folders. The "imap" process and the "indexer worker" process is crashing. We can reproduce this, we have a java program with multiple threads, and sometimes 2 threads try to create the same folder for the same user, and if both collide, dovecot processes crash. We don't see this happening in the real world if "normal" imap clients are connected, but our special java program trying to create folders in parallel is producing these crashes. Below you can see the log entries and gdb "bt full" output, one for an "imap" process and one for an "indexer worker" process. We are using dovecot 2.2.9, and I did not find anything in the changelog regarding this problem. Does ist make sense to try the newest version 2.2.12? Thanks Michael ================== Apr 1 19:58:28 dovecot01 dovecot: imap(user(a)domain.de): Panic: file mail-index-transaction-export.c: line 117 (log_append_ext_intro): assertion failed: (intro->ext_id == idx || idx == (uint32_t)-1) Apr 1 19:58:28 dovecot01 dovecot: imap(user(a)domain.de): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x66ab1) [0x7f0028259ab1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x66b8e) [0x7f0028259b8e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f00282153ce] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb9c72) [0x7f002857ec72] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_export+0x200) [0x7f002857f140] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb932f) [0x7f002857e32f] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x9d) [0x7f002857e78d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit+0xc) [0x7f002857e82c] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x3e1ea) [0x7f00285031ea] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x3e44c) [0x7f002850344c] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x90a15) [0x7f0028555a15] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_metadata+0x95) [0x7f0028542345] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync_name+0x2a4) [0x7f0028556324] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync+0x10a) [0x7f002855694a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_refresh+0x9e) [0x7f002855184e] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_iter_init+0x129) [0x7f0028553169] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_iter_init_multiple+0x29) [0x7f0028556ec9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x93179) [0x7f0028558179] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x91baf) [0x7f0028556baf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_iter_next+0x334) [0x7f00285577c4] -> dovecot/imap [user(a)domain.de 10.0.121.43 LIST]() [0x40f089] -> dovecot/imap [user(a)domain.de 10.0.121.43 LIST](cmd_list_full+0x4de) [0x40f8ce] -> dovecot/imap [user(a)domain.de 10.0.121.43 LIST](command_exec+0x3c) [0x416adc] -> dovecot/imap [user(a)domain.de 10.0.121.43 LIST]() [0x415b3f] -> dovecot/imap [user(a)domain.de 10.0.121.43 LIST]() [0x415bf5] -> dovecot/imap [user(a)domain.de 10.0.121.43 LIST](client_handle_input+0x115) [0x415ef5] -> dovecot/imap [user(a)domain.de 10.0.121.43 LIST](client_input+0x72) [0x416282] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7f0028269a87] Apr 1 19:58:28 dovecot01 dovecot: imap(user(a)domain.de): Fatal: master: service(imap): child 3928 killed with signal 6 (core dumped) ================== Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. #0 0x00007f0027e61f77 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 56 ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory. (gdb) bt full #0 0x00007f0027e61f77 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 resultvar = 0 pid = 3928 selftid = 3928 #1 0x00007f0027e655e8 in __GI_abort () at abort.c:90 save_stage = 2 act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {11509168, 0, 139638656126069, 1, 0, 4283381, 139638645923048, 140736983670273, 0, 11764224, 139638656153381, 0, 139638646863616, 139638652804256, 11513608, 140736983669916}}, sa_flags = 4096, sa_restorer = 0x7f0027e79134 } sigs = {__val = {32, 0 }} #2 0x00007f0028259ad8 in default_fatal_finish (type=, status=status@entry=0) at failures.c:192 backtrace = 0xaf9eb8 "/usr/local/lib/dovecot/libdovecot.so.0(+0x66ab1) [0x7f0028259ab1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x66b8e) [0x7f0028259b8e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f0028215"... #3 0x00007f0028259b8e in i_internal_fatal_handler (ctx=0x7fffe1eb1e30, format=, args=) at failures.c:653 status = 0 #4 0x00007f00282153ce in i_panic (format=format@entry=0x7f0028597088 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:264 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffe1eb1f20, reg_save_area = 0x7fffe1eb1e60}} #5 0x00007f002857ec72 in log_append_ext_intro (ctx=ctx@entry=0x7fffe1eb2040, ext_id=ext_id@entry=5, reset_id=0, hdr_size_r=hdr_size_r@entry=0x7fffe1eb2018) at mail-index-transaction-export.c:117 t = 0xb3dd30 intro = 0xb3cd04 resizes = 0xb3cca0 buf = 0xaf9db0 idx = 0 count = 6 __FUNCTION__ = "log_append_ext_intro" #6 0x00007f002857f140 in mail_transaction_log_append_ext_intros (ctx=0x7fffe1eb2040) at mail-index-transaction-export.c:283 resize = ext_reset = {new_reset_id = 0, preserve_data = 0 '\000', unused_padding = "\000\000"} resize_count = ext_count = 6 hdrs = hdrs_count = 6 ext_id = 5 reset_count = 0 hdr_size = 0 reset = 0x0 reset_buf = {data = 0x7fffe1eb2020, used = 8, priv = {0x7fffe1eb2020, 0x0, 0x8, 0x0, 0x0}} t = reset_id_count = 0 reset_id = reset_ids = 0x0 #7 mail_index_transaction_export (t=t@entry=0xb3dd30, append_ctx=0xb43570) at mail-index-transaction-export.c:409 null4 = "\000\000\000" change_mask = (unknown: 0) ctx = {trans = 0xb3dd30, append_ctx = 0xb43570} __FUNCTION__ = "mail_index_transaction_export" #8 0x00007f002857e32f in mail_index_transaction_commit_real (commit_size_r=0x7fffe1eb2180, t=0xb3dd30) at mail-index-transaction.c:165 _data_stack_cur_id = 7 ctx = 0xb43570 log_seq2 = 0 log_offset1 = 0 log = 0xb38e00 trans_flags = ---Type to continue, or q to quit--- log_seq1 = 11763008 log_offset2 = 7 #9 mail_index_transaction_commit_v (t=0xb3dd30, result_r=0x7fffe1eb2170) at mail-index-transaction.c:203 index = 0xb37d40 changed = true ret = __FUNCTION__ = "mail_index_transaction_commit_v" #10 0x00007f002857e78d in mail_index_transaction_commit_full (_t=_t@entry=0x7fffe1eb21b0, result_r=result_r@entry=0x7fffe1eb2170) at mail-index-transaction.c:262 t = 0xb3dd30 index = 0xb37d40 index_undeleted = false #11 0x00007f002857e82c in mail_index_transaction_commit (t=t@entry=0x7fffe1eb21b0) at mail-index-transaction.c:236 result = {log_file_seq = 0, log_file_offset = 0, commit_size = 0, ignored_modseq_changes = 0} #12 0x00007f00285031ea in mdbox_write_index_header (box=box@entry=0xb37170, update=update@entry=0x0, trans=0xb3dd30, trans@entry=0x0) at mdbox-storage.c:312 mbox = 0xb37170 new_trans = 0x0 view = 0x0 hdr = 0xb39350 uid_validity = 1306175967 uid_next = 0 #13 0x00007f002850344c in mdbox_mailbox_get_guid (guid_r=0x7fffe1eb2370 "", mbox=0xb37170) at mdbox-storage.c:391 need_resize = true ret = 0 idx_hdr = hdr = {map_uid_validity = 0, mailbox_guid = '\000' , flags = 0 '\000', unused = "\000\000"} #14 mdbox_mailbox_get_metadata (box=0xb37170, items=, metadata_r=0x7fffe1eb2370) at mdbox-storage.c:411 items = metadata_r = 0x7fffe1eb2370 box = 0xb37170 mbox = 0xb37170 #15 0x00007f0028555a15 in index_list_get_metadata (box=0xb37170, items=MAILBOX_METADATA_GUID, metadata_r=0x7fffe1eb2370) at mailbox-list-index-status.c:202 ibox = 0xb37a70 #16 0x00007f0028542345 in mailbox_get_metadata (box=0xb37170, items=items@entry=MAILBOX_METADATA_GUID, metadata_r=metadata_r@entry=0x7fffe1eb2370) at mail-storage.c:1544 __FUNCTION__ = "mailbox_get_metadata" #17 0x00007f0028556324 in node_lookup_guid (ctx=, guid_r=0x7fffe1eb2358 "", node=0xb22780) at mailbox-list-index-sync.c:25 box = 0xb37170 vname = str = 0xaf9920 ns_sep = metadata = {guid = '\000' , virtual_size = 0, cache_fields = 0x0, precache_fields = (unknown: 0), backend_ns_prefix = 0x0, backend_ns_type = (unknown: 0)} #18 node_add_to_index (seq_r=0x7fffe1eb2330, node=0xb22780, ctx=0xb34ef0) at mailbox-list-index-sync.c:45 _data_stack_cur_id = 6 irec = {name_id = 65, parent_uid = 0, guid = '\000' , uid_validity = 0} seq = 11759984 #19 mailbox_list_index_node_add (seq_r=0x7fffe1eb2330, name=, parent=, ctx=0xb34ef0) at mailbox-list-index-sync.c:87 node = 0xb22780 dup_name = 0xb227b0 "GoogleMail 01.04.2014 19:58" #20 mailbox_list_index_sync_name (ctx=ctx@entry=0xb34ef0, name=, node_r=node_r@entry=0x7fffe1eb2418, created_r=created_r@entry=0x7fffe1eb240b) at mailbox-list-index-sync.c:125 path = 0xaf9808 empty_path = {0x7f00285982ff "", 0x0} node = parent = i = 0 seq = 0 ---Type to continue, or q to quit--- __FUNCTION__ = "mailbox_list_index_sync_name" #21 0x00007f002855694a in mailbox_list_index_sync_list (sync_ctx=0xb34ef0) at mailbox-list-index-sync.c:318 name = _data_stack_cur_id = 5 iter = 0xb352c0 info = 0xb35340 flags = (unknown: 0) node = 0xb21c40 seq = patterns = {0x7f00285a55d3 "*", 0x0} created = false #22 mailbox_list_index_sync (list=list@entry=0xb15df0) at mailbox-list-index-sync.c:390 sync_ctx = 0xb34ef0 ret = 0 #23 0x00007f002855184e in mailbox_list_index_refresh (list=0xb15df0) at mailbox-list-index.c:380 ilist = 0xb16288 view = 0xb27890 ret = #24 0x00007f0028553169 in iter_use_index (ctx=0xb26dc0, ctx=0xb26dc0) at mailbox-list-index-iter.c:25 ilist = 0xb16288 #25 mailbox_list_index_iter_init (list=0xb15df0, patterns=0xb26c88, flags=(MAILBOX_LIST_ITER_RETURN_CHILDREN | MAILBOX_LIST_ITER_RETURN_SPECIALUSE)) at mailbox-list-index-iter.c:52 ilist = 0xb16288 ctx = 0xb26dc0 pool = 0xb26da0 ns_sep = #26 0x00007f0028556ec9 in mailbox_list_iter_init_multiple (list=0xb15df0, patterns=, flags=(MAILBOX_LIST_ITER_RETURN_CHILDREN | MAILBOX_LIST_ITER_RETURN_SPECIALUSE)) at mailbox-list-iter.c:173 ctx = ret = 0 #27 0x00007f0028558179 in mailbox_list_ns_iter_try_next (info_r=, _ctx=0xb269b0) at mailbox-list-iter.c:574 ctx = 0xb269b0 info = errstr = has_children = ns = error = MAIL_ERROR_NONE #28 mailbox_list_ns_iter_next (_ctx=0xb269b0) at mailbox-list-iter.c:645 info = #29 0x00007f0028556baf in mailbox_list_iter_next_call (ctx=ctx@entry=0xb269b0) at mailbox-list-iter.c:941 info = set = #30 0x00007f00285577c4 in mailbox_list_iter_next (ctx=0xb269b0) at mailbox-list-iter.c:1012 _data_stack_cur_id = 4 info = #31 0x000000000040f089 in cmd_list_continue (cmd=cmd@entry=0xb24190) at cmd-list.c:229 ctx = 0xb242a8 info = flags = str = 0xaf93a0 mutf7_name = 0xaf94f0 name = ret = #32 0x000000000040f8ce in cmd_list_full (cmd=0xb24190, lsub=) at cmd-list.c:463 client = args = 0xb04a98 ---Type to continue, or q to quit--- list_args = 0x0 arg_count = 32512 ctx = 0xb242a8 patterns = {arr = {buffer = 0xb24300, element_size = 8}, v = 0xb24300, v_modifiable = 0xb24300} ref = 0xb242d8 "" pattern = 0xb242e0 "GoogleMail 01.04.2014 19:58" str = #33 0x0000000000416adc in command_exec (cmd=0xb24190) at imap-commands.c:158 hook = 0xb020f0 ret = #34 0x0000000000415b3f in client_command_input (cmd=0xb24190) at imap-client.c:780 client = 0xb235b0 command = __FUNCTION__ = "client_command_input" #35 0x0000000000415bf5 in client_command_input (cmd=0xb24190) at imap-client.c:841 client = 0xb235b0 command = __FUNCTION__ = "client_command_input" #36 0x0000000000415ef5 in client_handle_next_command (remove_io_r=, client=0xb235b0) at imap-client.c:879 No locals. #37 client_handle_input (client=client@entry=0xb235b0) at imap-client.c:891 _data_stack_cur_id = 3 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #38 0x0000000000416282 in client_input (client=0xb235b0) at imap-client.c:933 cmd = 0xb16a70 output = 0xb23fe0 bytes = 42 __FUNCTION__ = "client_input" #39 0x00007f0028269a87 in io_loop_call_io (io=0xb240b0) at ioloop.c:388 ioloop = 0xb01730 t_id = 2 #40 0x00007f002826a817 in io_loop_handler_run (ioloop=ioloop@entry=0xb01730) at ioloop-epoll.c:220 ctx = 0xb023d0 list = 0xb03e00 io = tv = {tv_sec = 1799, tv_usec = 999837} events_count = msecs = ret = 1 i = 0 call = __FUNCTION__ = "io_loop_handler_run" #41 0x00007f0028269628 in io_loop_run (ioloop=0xb01730) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #42 0x00007f002821a5c3 in master_service_run (service=0xb015c0, callback=callback@entry=0x41ec00 ) at master-service.c:566 No locals. #43 0x000000000040b03f in main (argc=1, argv=0xb01390) at main.c:400 set_roots = {0x4269a0 , 0x0} login_set = {auth_socket_path = 0xaf9058 "(", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41efb0 , failure_callback = 0x41ece0 , request_auth_token = 1} service_flags = storage_service_flags = username = 0x0 ---Type to continue, or q to quit--- c = ================== Apr 1 20:19:42 dovecot01 dovecot: indexer-worker(user(a)domain.de): Panic: file mail-index-transaction-export.c: line 117 (log_append_ext_intro): assertion failed: (intro->ext_id == idx || idx == (uint32_t)-1) Apr 1 20:19:42 dovecot01 dovecot: indexer-worker(user(a)domain.de): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x66ab1) [0x7f77b4f2aab1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x66b8e) [0x7f77b4f2ab8e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f77b4ee63ce] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb9c72) [0x7f77b524fc72] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_export+0x200) [0x7f77b5250140] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb932f) [0x7f77b524f32f] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x9d) [0x7f77b524f78d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit+0xc) [0x7f77b524f82c] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x3e1ea) [0x7f77b51d41ea] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x3e44c) [0x7f77b51d444c] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x90a15) [0x7f77b5226a15] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_metadata+0x95) [0x7f77b5213345] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync_name+0x2a4) [0x7f77b5227324] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync+0x10a) [0x7f77b522794a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_refresh+0x9e) [0x7f77b522284e] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9072e) [0x7f77b522672e] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x909a3) [0x7f77b52269a3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_deinit+0x22) [0x7f77b5211ef2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x39) [0x7f77b5211fa9] -> dovecot/indexer-worker [user(a)domain.de INBOX]() [0x4022f7] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7f77b4f3aa87] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7f77b4f3b817] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f77b4f3a628] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f77b4eeb5c3] -> dovecot/indexer-worker [user(a)domain.de INBOX](main+0xe3) [0x401f03] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f77b4b1dde5] -> dovecot/indexer-worker [user(a)domain.de INBOX]() [0x401fc2] Apr 1 20:19:42 dovecot01 dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user(a)domain.de Apr 1 20:19:42 dovecot01 dovecot: indexer-worker(user(a)domain.de): Fatal: master: service(indexer-worker): child 8806 killed with signal 6 (core dumped) ================== Core was generated by `dovecot/indexer-worker'. Program terminated with signal 6, Aborted. #0 0x00007f77b4b32f77 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 56 ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory. (gdb) bt full #0 0x00007f77b4b32f77 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 resultvar = 0 pid = 8806 selftid = 8806 #1 0x00007f77b4b365e8 in __GI_abort () at abort.c:90 save_stage = 2 act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {12654816, 0, 140152119483509, 140149077835777, 0, 4202243, 140152109280488, 140733744696321, 0, 12801792, 140152119510821, 0, 140152110221056, 140152116161696, 12659256, 140733744696092}}, sa_flags = 4096, sa_restorer = 0x7f77b4b4a134 } sigs = {__val = {32, 0 }} #2 0x00007f77b4f2aad8 in default_fatal_finish (type=, status=status@entry=0) at failures.c:192 backtrace = 0xc119e8 "/usr/local/lib/dovecot/libdovecot.so.0(+0x66ab1) [0x7f77b4f2aab1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x66b8e) [0x7f77b4f2ab8e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f77b4ee6"... #3 0x00007f77b4f2ab8e in i_internal_fatal_handler (ctx=0x7fff20dc4cb0, format=, args=) at failures.c:653 status = 0 #4 0x00007f77b4ee63ce in i_panic (format=format@entry=0x7f77b5268088 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:264 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fff20dc4da0, reg_save_area = 0x7fff20dc4ce0}} #5 0x00007f77b524fc72 in log_append_ext_intro (ctx=ctx@entry=0x7fff20dc4ec0, ext_id=ext_id@entry=5, reset_id=0, hdr_size_r=hdr_size_r@entry=0x7fff20dc4e98) at mail-index-transaction-export.c:117 t = 0xc6d700 intro = 0xc6dac4 resizes = 0xc6da60 buf = 0xc118e0 idx = 0 count = 6 __FUNCTION__ = "log_append_ext_intro" #6 0x00007f77b5250140 in mail_transaction_log_append_ext_intros (ctx=0x7fff20dc4ec0) at mail-index-transaction-export.c:283 resize = ext_reset = {new_reset_id = 0, preserve_data = 0 '\000', unused_padding = "\000\000"} resize_count = ext_count = 6 hdrs = hdrs_count = 6 ext_id = 5 reset_count = 0 hdr_size = 0 reset = 0x0 reset_buf = {data = 0x7fff20dc4ea0, used = 8, priv = {0x7fff20dc4ea0, 0x0, 0x8, 0x0, 0x0}} t = reset_id_count = 0 reset_id = reset_ids = 0x0 #7 mail_index_transaction_export (t=t@entry=0xc6d700, append_ctx=0xc6dcd0) at mail-index-transaction-export.c:409 null4 = "\000\000\000" change_mask = (unknown: 0) ctx = {trans = 0xc6d700, append_ctx = 0xc6dcd0} __FUNCTION__ = "mail_index_transaction_export" #8 0x00007f77b524f32f in mail_index_transaction_commit_real (commit_size_r=0x7fff20dc5000, t=0xc6d700) at mail-index-transaction.c:165 _data_stack_cur_id = 6 ctx = 0xc6dcd0 log_seq2 = 0 log_offset1 = 140733744697296 log = 0xc35bb0 trans_flags = ---Type to continue, or q to quit--- log_seq1 = 24 log_offset2 = 140733193388038 #9 mail_index_transaction_commit_v (t=0xc6d700, result_r=0x7fff20dc4ff0) at mail-index-transaction.c:203 index = 0xc35190 changed = true ret = __FUNCTION__ = "mail_index_transaction_commit_v" #10 0x00007f77b524f78d in mail_index_transaction_commit_full (_t=_t@entry=0x7fff20dc5030, result_r=result_r@entry=0x7fff20dc4ff0) at mail-index-transaction.c:262 t = 0xc6d700 index = 0xc35190 index_undeleted = false #11 0x00007f77b524f82c in mail_index_transaction_commit (t=t@entry=0x7fff20dc5030) at mail-index-transaction.c:236 result = {log_file_seq = 0, log_file_offset = 0, commit_size = 0, ignored_modseq_changes = 0} #12 0x00007f77b51d41ea in mdbox_write_index_header (box=box@entry=0xc345c0, update=update@entry=0x0, trans=0xc6d700, trans@entry=0x0) at mdbox-storage.c:312 mbox = 0xc345c0 new_trans = 0x0 view = 0x0 hdr = 0xc45e00 uid_validity = 1306175995 uid_next = 3038592790 #13 0x00007f77b51d444c in mdbox_mailbox_get_guid (guid_r=0x7fff20dc51f0 "", mbox=0xc345c0) at mdbox-storage.c:391 need_resize = true ret = 0 idx_hdr = hdr = {map_uid_validity = 0, mailbox_guid = '\000' , flags = 0 '\000', unused = "\000\000"} #14 mdbox_mailbox_get_metadata (box=0xc345c0, items=, metadata_r=0x7fff20dc51f0) at mdbox-storage.c:411 items = metadata_r = 0x7fff20dc51f0 box = 0xc345c0 mbox = 0xc345c0 #15 0x00007f77b5226a15 in index_list_get_metadata (box=0xc345c0, items=MAILBOX_METADATA_GUID, metadata_r=0x7fff20dc51f0) at mailbox-list-index-status.c:202 ibox = 0xc34ed0 #16 0x00007f77b5213345 in mailbox_get_metadata (box=0xc345c0, items=items@entry=MAILBOX_METADATA_GUID, metadata_r=metadata_r@entry=0x7fff20dc51f0) at mail-storage.c:1544 __FUNCTION__ = "mailbox_get_metadata" #17 0x00007f77b5227324 in node_lookup_guid (ctx=, guid_r=0x7fff20dc51d8 "", node=0xc30110) at mailbox-list-index-sync.c:25 box = 0xc345c0 vname = str = 0xc11428 ns_sep = metadata = {guid = '\000' , virtual_size = 0, cache_fields = 0x0, precache_fields = (unknown: 0), backend_ns_prefix = 0x0, backend_ns_type = (unknown: 0)} #18 node_add_to_index (seq_r=0x7fff20dc51b0, node=0xc30110, ctx=0xc25bb0) at mailbox-list-index-sync.c:45 _data_stack_cur_id = 5 irec = {name_id = 86, parent_uid = 76, guid = '\000' , uid_validity = 0} seq = 12797376 #19 mailbox_list_index_node_add (seq_r=0x7fff20dc51b0, name=, parent=, ctx=0xc25bb0) at mailbox-list-index-sync.c:87 node = 0xc30110 dup_name = 0xc30140 "Drafts" #20 mailbox_list_index_sync_name (ctx=ctx@entry=0xc25bb0, name=, node_r=node_r@entry=0x7fff20dc5298, created_r=created_r@entry=0x7fff20dc528b) at mailbox-list-index-sync.c:125 path = 0xc11310 empty_path = {0x7f77b52692ff "", 0x0} node = parent = i = 1 seq = 0 ---Type to continue, or q to quit--- __FUNCTION__ = "mailbox_list_index_sync_name" #21 0x00007f77b522794a in mailbox_list_index_sync_list (sync_ctx=0xc25bb0) at mailbox-list-index-sync.c:318 name = _data_stack_cur_id = 4 iter = 0xc31b30 info = 0xc31bb0 flags = (unknown: 0) node = 0xc2ff18 seq = patterns = {0x7f77b52765d3 "*", 0x0} created = false #22 mailbox_list_index_sync (list=list@entry=0xc49360) at mailbox-list-index-sync.c:390 sync_ctx = 0xc25bb0 ret = 0 #23 0x00007f77b522284e in mailbox_list_index_refresh (list=0xc49360) at mailbox-list-index.c:380 ilist = 0xc497f8 view = 0xc275a0 ret = #24 0x00007f77b522672e in index_list_update_mailbox (box=box@entry=0xc4a1a0) at mailbox-list-index-status.c:363 ilist = 0xc497f8 list_sync_ctx = 0xc27270 list_view = 0xc48c20 list_trans = 0x7f77b5213a75 changes = {status = {messages = 256, recent = 0, unseen = 12890576, uidvalidity = 0, uidnext = 65, first_unseen_seq = 0, first_recent_uid = 12886432, last_cached_seq = 0, highest_modseq = 140733744698432, highest_pvt_modseq = 12888328, keywords = 0xc49718, permanent_flags = 3025012879, permanent_keywords = 1, allow_new_keywords = 1, nonpermanent_modseqs = 1, have_guids = 0, have_save_guids = 1, have_only_guid128 = 1}, guid = "\360\261\304\000\000\000\000\000p\247\304\000\000\000\000", seq = 12890576, rec_changed = false, msgs_changed = false, hmodseq_changed = false} ret = __FUNCTION__ = "index_list_update_mailbox" #25 0x00007f77b52269a3 in index_list_sync_deinit (ctx=0x0, status_r=0x7fff20dc5440) at mailbox-list-index-status.c:470 box = 0xc4a1a0 ibox = #26 0x00007f77b5211ef2 in mailbox_sync_deinit (_ctx=_ctx@entry=0x7fff20dc5448, status_r=status_r@entry=0x7fff20dc5440) at mail-storage.c:1691 ctx = box = 0xc4a1a0 errormsg = error = MAIL_ERROR_NONE ret = #27 0x00007f77b5211fa9 in mailbox_sync (box=, flags=) at mail-storage.c:1717 ctx = 0x0 status = {sync_delayed_expunges = 0} #28 0x00000000004022f7 in index_mailbox (what=0xc0f07e "i", max_recent_msgs=0, mailbox=0xc0f076 "INBOX", user=0xc52f00, conn=0xc1bfb0) at master-connection.c:161 box = 0xc4a1a0 status = {messages = 5000, recent = 0, unseen = 3035915435, uidvalidity = 32631, uidnext = 64, first_unseen_seq = 0, first_recent_uid = 12679056, last_cached_seq = 0, highest_modseq = 5000, highest_pvt_modseq = 213, keywords = 0x7f77b4f01ac0 , permanent_flags = 12838464, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, have_guids = 0, have_save_guids = 0, have_only_guid128 = 0} errstr = ret = 0 ns = path = 0xc11048 "/mnt/filestorage01/team.mail.de/m.kliewe/maildir/mailboxes/INBOX/dbox-Mails" error = MAIL_ERROR_NONE sync_flags = #29 master_connection_input_line (line=, conn=0xc1bfb0) at master-connection.c:208 str = max_recent_msgs = 0 ---Type to continue, or q to quit--- ret = args = input = {module = 0x4029ff "mail", service = 0x4029f0 "indexer-worker", username = 0xc0f060 "m.kliewe(a)team.mail.de", session_id = 0x0, local_ip = {family = 0, u = {ip6 = { __in6_u = {__u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = { family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = (unknown: 0), flags_override_remove = (unknown: 0), no_userdb_lookup = 0} service_user = 0xc1f098 user = 0xc52f00 error = 0x7fff20dc5620 "\002" #30 master_connection_input (conn=0xc1bfb0) at master-connection.c:245 _data_stack_cur_id = 3 line = #31 0x00007f77b4f3aa87 in io_loop_call_io (io=0xc1bff0) at ioloop.c:388 ioloop = 0xc17730 t_id = 2 #32 0x00007f77b4f3b817 in io_loop_handler_run (ioloop=ioloop@entry=0xc17730) at ioloop-epoll.c:220 ctx = 0xc1a560 list = 0xc1c040 io = tv = {tv_sec = 0, tv_usec = 0} events_count = msecs = ret = 1 i = 0 call = __FUNCTION__ = "io_loop_handler_run" #33 0x00007f77b4f3a628 in io_loop_run (ioloop=0xc17730) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #34 0x00007f77b4eeb5c3 in master_service_run (service=0xc175c0, callback=callback@entry=0x402090 ) at master-service.c:566 No locals. #35 0x0000000000401f03 in main (argc=1, argv=0xc17390) at indexer-worker.c:78 storage_service_flags = (MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT | MAIL_STORAGE_SERVICE_FLAG_USERDB_LOOKUP | MAIL_STORAGE_SERVICE_FLAG_TEMP_PRIV_DROP | MAIL_STORAGE_SERVICE_FLAG_NO_IDLE_TIMEOUT) c = ==================

3 2

[Dovecot] sieve - different sieve scripts
by Héctor Moreno Blanco 07 May '14

07 May '14

Hello everybody, We have Dovecot 2.1.6 and PigeonHole 0.3.0. Is possible to have two different sieve scripts working at the same time? My sieve configuration in dovecot.conf: ... managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify ... sieve = %h/.dovecot.sieve sieve_dir = %h/sieve sieve_extensions = +imapflags +notify } protocols = imap pop3 sieve ... service managesieve-login { executable = /usr/local/dovecot/libexec/dovecot/managesieve-login inet_listener sieve { address = * port = 4190 } inet_listener sieve_deprecated { address = * port = 12000 } user = vmail } service managesieve { executable = /usr/local/dovecot/libexec/dovecot/managesieve } ... protocol sieve { managesieve_implementation_string = dovecot Pigeonhole managesieve_logout_format = bytes ( in=%i : out=%o ) managesieve_max_line_length = 65536 } Thank you very much in advanced. Kind regards. Héctor Moreno Blanco. P Please consider the environment before printing this e-mail. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________

5 5

[Dovecot] WG: on High Load using IMAPSYNC : Panic: file ostream-lzma.c: line 147: unreached. Dovecot 2.2.12 with zlib/XZ compression
by Robert Nowotny 07 May '14

07 May '14

when syncing Mailboxes with IMAPSYNC, using xz compression the dbox file gets corrupted. the same configuration was working ok on low load with xz compression. Dovecot Version 2.2.12 Linux Mint 16 EXT4 Filesystem another dovecot user already reported the same problem on the mailinglist, using dsync. That user switched to bz2 compression what worked for him. the answer was : > are you on latest patchlevel ? > there are some dsync fixes since 2.2.12 but it is not a problem of dsync. when looking at the code, we get here an unexpected returnvalue when flushing. I propose it would be good practice to write some logging in the default switch cases, to see the unexpected returnvalues in the errorlog. something like : ostream-lzma.c : -- Line 147 : i_unreached(); ++ Line 147 : i_fatal("unexpected lzma errorcode when flushing : %s", ret); after that modification the errorlog shows : May 6 14:03:05 vm-imap dovecot: imap(test): Fatal: lzma errorcode when flushing : (null) maybe You can also investigate and let me know when fixed. Here the log : May 5 14:53:10 vm-imap dovecot: imap(rrernboeck): Panic: file ostream-lzma.c: line 147: unreached May 5 14:53:10 vm-imap dovecot: imap(rrernboeck): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x67450) [0x7ff99d8ce450] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x6752e) [0x7ff99d8ce52e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7ff99d88955e] -> /usr/local/lib/dovecot/lib20_zlib_plugin.so(+0x4f0a) [0x7ff99ce87f0a] -> /usr/local/lib/dovecot/libdovecot.so.0(o_stream_flush+0x3e) [0x7ff99d8e6dbe] -> /usr/local/lib/dovecot/libdovecot.so.0(o_stream_nflush+0xf) [0x7ff99d8e71df] -> /usr/local/lib/dovecot/libdovecot.so.0(o_stream_nfinish+0x9) [0x7ff99d8e7229] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(dbox_save_end+0x29) [0x7ff99db7cfa9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mdbox_save_finish+0x39) [0x7ff99db76619] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_finish+0x4d) [0x7ff99dbb6a4d] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND]() [0x40be09] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND](command_exec+0x3c) [0x416cfc] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND]() [0x40b491] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7ff99d8de527] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7ff99d8df2b7] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7ff99d8de0c8] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7ff99d88e753] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND](main+0x2af) [0x40b06f] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7ff99d4c0de5] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND]() [0x40b1cc] May 5 14:53:10 vm-imap dovecot: imap(rrernboeck): Fatal: master: service(imap): child 47957 killed with signal 6 (core dumped) May 5 14:53:10 vm-imap dovecot: imap(rrernboeck): Error: Corrupted dbox file /home/vmail/virtualmailboxes/rrernboeck/storage/m.1 (around offset=1302): msg header has bad magic value

3 4

[Dovecot] crash while fts searching a virtual folder
by Matthias Rieber 07 May '14

07 May '14

Hi, searching a virtual folder crashes dovecot quite often. I'm using dovecot 2.2.12. Here's the backtrace: [New LWP 28245] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. #0 0x00007fc1d73f4425 in raise () from /lib/x86_64-linux-gnu/libc.so.6 #0 0x00007fc1d73f4425 in raise () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #1 0x00007fc1d73f7b8b in abort () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #2 0x00007fc1d77e6d45 in default_fatal_finish (type=<optimized out>, status=0) at failures.c:193 backtrace = 0x1cdc318 "/usr/local/lib/dovecot/libdovecot.so.0(+0x68d4f) [0x7fc1d77e6d4f] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x68dae) [0x7fc1d77e6dae] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fc1d77a0"... #3 0x00007fc1d77e6dae in i_internal_fatal_handler (ctx=0x7fff86d4b2d0, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007fc1d77a03b9 in i_panic (format=<optimized out>) at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fff86d4b3a0, reg_save_area = 0x7fff86d4b2e0}} #5 0x00007fc1d6774ed9 in level_scores_add_vuids (br=0x2413ab8, level=0x1c0c2e0, vbox=0x170c950) at fts-search.c:81 i = <optimized out> count = 234 backend_uids = {arr = {buffer = 0x1cdbe90, element_size = 8}, v = 0x1cdbe90, v_modifiable = 0x1cdbe90} vuids_arr = {arr = {buffer = 0x1cdba98, element_size = 4}, v = 0x1cdba98, v_modifiable = 0x1cdba98} vuids = 0xea scores = 0x23c8f50 score = 0xea #6 multi_add_lookup_result (args=0x1bbb220, level=0x1c0c2e0, fctx=0x18c2240, result=<optimized out>) at fts-search.c:146 br = 0x2413ab8 vbox = 0x170c950 vuids = {arr = {buffer = 0x16dbe70, element_size = 8}, v = 0x16dbe70, v_modifiable = 0x16dbe70} orig_size = <optimized out> i = <optimized out> #7 fts_search_lookup_level_multi (and_args=true, args=0x1bbb220, fctx=0x18c2240) at fts-search.c:194 mailboxes_arr = {arr = {buffer = 0x1e0a580, element_size = 8}, v = 0x1e0a580, v_modifiable = 0x1e0a580} backend = <optimized out> j = 60 vbox = <optimized out> mailboxes = 0x1e0a5b8 level = 0x1c0c2e0 result = {pool = 0x1e0a560, box_results = 0x2413838} i = <optimized out> mailbox_count = 60 #8 fts_search_lookup_level (fctx=0x18c2240, args=0x1bbb220, and_args=true) at fts-search.c:208 _data_stack_cur_id = 4 ret = <optimized out> #9 0x00007fc1d6774f86 in fts_search_lookup (fctx=<optimized out>) at fts-search.c:354 last_uid = 32653 seq1 = 0 seq2 = 0 __FUNCTION__ = "fts_search_lookup" #10 0x00007fc1d6776388 in fts_mailbox_search_init (t=<optimized out>, args=0x1bbb160, sort_program=<optimized out>, wanted_fields=0, wanted_headers=0x0) at fts-storage.c:207 ft = 0x1d4be20 fbox = <optimized out> flist = 0x1706610 ctx = 0x192f540 fctx = 0x18c2240 #11 0x000000000041caa0 in imap_search_start (ctx=0x170a238, sargs=0x1bbb160, sort_program=0x0) at imap-search.c:576 cmd = 0x170a130 __FUNCTION__ = "imap_search_start" #12 0x00000000004117b6 in cmd_search (cmd=0x170a130) at cmd-search.c:48 ctx = 0x170a238 sargs = 0x1bbb160 args = 0x16e2a38 charset = 0x424d0b "UTF-8" ret = <optimized out> #13 0x000000000041734d in command_exec (cmd=0x170a130) at imap-commands.c:158 hook = 0x16e00f0 ret = <optimized out> #14 0x00000000004163e0 in client_command_input (cmd=0x170a130) at imap-client.c:780 client = 0x17095e0 command = <optimized out> __FUNCTION__ = "client_command_input" #15 0x00000000004164c5 in client_command_input (cmd=0x170a130) at imap-client.c:841 client = 0x17095e0 command = <optimized out> __FUNCTION__ = "client_command_input" #16 0x000000000041676d in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x17095e0) at imap-client.c:879 No locals. #17 client_handle_input (client=0x17095e0) at imap-client.c:891 _data_stack_cur_id = 3 ret = 48 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #18 0x0000000000416ae2 in client_input (client=0x17095e0) at imap-client.c:933 cmd = <optimized out> output = 0x1709ff0 bytes = 26 __FUNCTION__ = "client_input" #19 0x00007fc1d77f7616 in io_loop_call_io (io=0x17071a0) at ioloop.c:388 ioloop = 0x16df730 t_id = 2 #20 0x00007fc1d77f84cf in io_loop_handler_run (ioloop=<optimized out>) at ioloop-epoll.c:220 ctx = 0x16e03d0 events = 0x0 event = 0x16e1230 list = 0x16e1e00 io = <optimized out> tv = {tv_sec = 2, tv_usec = 425339} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #21 0x00007fc1d77f7128 in io_loop_run (ioloop=0x16df730) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #22 0x00007fc1d77a57d3 in master_service_run (service=0x16df5c0, callback=<optimized out>) at master-service.c:566 No locals. #23 0x000000000040af58 in main (argc=1, argv=0x16df390) at main.c:400 set_roots = {0x427840, 0x0} login_set = {auth_socket_path = 0x16d7058 "", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41fb00 <login_client_connected>, failure_callback = 0x41f810 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = <optimized out> c = <optimized out> Rebuilding the fts index and erasing all dovecot.index.* files didn't help. Regards, Matthias

2 3

[Dovecot] Can Auth dict proxy protocol be used to validate a password?
by Thomas Johnson 07 May '14

07 May '14

I'm interested in using authentication via a UNIX socket as documented at http://wiki2.dovecot.org/AuthDatabase/Dict. (We are currently using a checkpassword script to enable us to authenticate against a django app that stores passwords in pbkdf2 format, but I'm concerned about scalability as we grow - specifically the comment about performance on http://wiki2.dovecot.org/AuthDatabase/CheckPassword) The example clearly shows retrieving a password, but is there some way to validate a password that was provided the way a checkpassword script does? Otherwise, for performance reasons, perhaps we should implement a new password scheme directly for dovecot? Thanks- Tom

2 1

[Dovecot] Again: pop3: Panic: Trying to allocate 0 bytes
by Urban Loesch 07 May '14

07 May '14

Hi, in April I wrote an e-mail to the list, that with dovecot 2.2.12 on debian squeeze some pop3-sessions were killed sometimes. But I got no anwser from the list. At this was not a urgend problem and it happend very rarely it was not a big problem. But today it happend again more several times and I have no idea why. I have the following in my errorlog: ... May 6 13:26:52 mailstore dovecot: pop3(user(a)domain.com pid:48986 session:<bLxBhrn4ywBCNkO3>): Panic: Trying to allocate 0 bytes May 6 13:26:52 mailstore dovecot: pop3(user(a)domain.com pid:48986 session:<bLxBhrn4ywBCNkO3>): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x6c38a) [0x7f8ed4c7538a] -> /usr/lib/dovecot/libdovecot.so.0(+0x6c406) [0x7f8ed4c75406] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f8ed4c2e1af] -> /usr/lib/dovecot/libdovecot.so.0(+0x81e1b) [0x7f8ed4c8ae1b] -> dovecot/pop3() [0x4077f0] -> dovecot/pop3(client_command_execute+0x9d) [0x407d0d] -> dovecot/pop3(client_handle_input+0x80) [0x405810] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4e) [0x7f8ed4c856ae] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xaf) [0x7f8ed4c8682f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f8ed4c85739] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f8ed4c857c8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f8ed4c32f63] -> dovecot/pop3(main+0x257) [0x404a67] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f8ed48c5c8d] -> dovecot/pop3() [0x4045b9] May 6 13:26:52 mailstore dovecot: pop3(user(a)domain.com pid:48986 session:<bLxBhrn4ywBCNkO3>): Fatal: master: service(pop3): child 48986 killed with signal 6 (core dumped) ... I got a coredump. Here comes the backtrace: ... (gdb) bt full #0 0x00007f8ed48d91b5 in raise () from /lib/libc.so.6 No symbol table info available. #1 0x00007f8ed48dbfc0 in abort () from /lib/libc.so.6 No symbol table info available. #2 0x00007f8ed4c75380 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:193 backtrace = 0x1c180c8 "/usr/lib/dovecot/libdovecot.so.0(+0x6c38a) [0x7f8ed4c7538a] -> /usr/lib/dovecot/libdovecot.so.0(+0x6c406) [0x7f8ed4c75406] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f8ed4c2e1af] -> /usr/lib/d"... #3 0x00007f8ed4c75406 in i_internal_fatal_handler (ctx=0x7fff547b5940, format=<value optimized out>, args=<value optimized out>) at failures.c:657 status = 0 #4 0x00007f8ed4c2e1af in i_panic (format=0xbf5a <Address 0xbf5a out of bounds>) at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 16, fp_offset = 48, overflow_arg_area = 0x7fff547b5a10, reg_save_area = 0x7fff547b5950}} #5 0x00007f8ed4c8ae1b in pool_system_malloc (pool=<value optimized out>, size=0) at mempool-system.c:81 No locals. #6 0x00000000004077f0 in client_uidls_save (client=0x1c42990, seq=0) at pop3-commands.c:798 str = <value optimized out> permanent_uidl = <value optimized out> search_ctx = 0x1c230d0 mail = <value optimized out> prev_uidls = {_table = 0x1c23330, _key = 0x1c23330 "\300o\355Ԏ\177", _keyp = 0x1c23330, _const_key = 0x1c23330 "\300o\355Ԏ\177", _value = 0x1c23330, _valuep = 0x1c23330} search_args = 0x0 seq_uidls = 0x60a4d8 uidl = <value optimized out> wanted_fields = <value optimized out> #7 cmd_uidl_init (client=0x1c42990, seq=0) at pop3-commands.c:842 ctx = <value optimized out> search_args = <value optimized out> wanted_fields = <value optimized out> #8 0x0000000000407d0d in cmd_uidl (client=0x1c42990, name=<value optimized out>, args=0x408820 "") at pop3-commands.c:873 ctx = <value optimized out> seq = <value optimized out> #9 client_command_execute (client=0x1c42990, name=<value optimized out>, args=0x408820 "") at pop3-commands.c:938 No locals. #10 0x0000000000405810 in client_handle_input (client=0x1c42990) at pop3-client.c:739 _data_stack_cur_id = 3 line = <value optimized out> args = 0x408820 "" ret = <value optimized out> #11 0x00007f8ed4c856ae in io_loop_call_io (io=0x1c414a0) at ioloop.c:441 ioloop = 0x1c20740 t_id = 2 __FUNCTION__ = "io_loop_call_io" #12 0x00007f8ed4c8682f in io_loop_handler_run_internal (ioloop=<value optimized out>) at ioloop-epoll.c:220 ctx = 0x1c20aa0 event = 0x1c21910 list = 0x1c22500 io = 0xbf5a tv = {tv_sec = 9, tv_usec = 999120} msecs = <value optimized out> ret = 1 i = 0 call = false __FUNCTION__ = "io_loop_handler_run_internal" #13 0x00007f8ed4c85739 in io_loop_handler_run (ioloop=0xbf5a) at ioloop.c:488 No locals. #14 0x00007f8ed4c857c8 in io_loop_run (ioloop=0x1c20740) at ioloop.c:465 __FUNCTION__ = "io_loop_run" #15 0x00007f8ed4c32f63 in master_service_run (service=0x1c205d0, callback=0xbf5a) at master-service.c:566 No locals. #16 0x0000000000404a67 in main (argc=1, argv=0x1c20390) at main.c:277 set_roots = {0x409480, 0x0} login_set = {auth_socket_path = 0x1c18050 "/var/run/dovecot/auth-master", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x404c40 <login_client_connected>, failure_callback = 0x404bf0 <login_client_failed>, request_auth_token = 0} service_flags = <value optimized out> storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 ---Type <return> to continue, or q <return> to quit--- c = <value optimized out> ... Can you help to resolve this issue? many Thanks Urban Loesch --------------------- doveconf -n --------------------- # 2.2.12 (16212e6d4fd4): /etc/dovecot/dovecot.conf # OS: Linux 3.4.67-vs2.3.3.9-rol-em64t-efigpt x86_64 Debian 6.0.9 ext4 auth_cache_negative_ttl = 0 auth_cache_size = 40 M auth_cache_ttl = 1 weeks auth_mechanisms = plain login deliver_log_format = msgid=%m: %$ %p %w disable_plaintext_auth = no info_log_path = syslog login_trusted_networks = $INTERNAL_IPS mail_gid = mailstore mail_location = mdbox:/home/vmail/%d/%n mail_log_prefix = "%s(%u pid:%p session:<%{session}>): " mail_plugins = " quota mail_log notify acl zlib stats virtual" mail_uid = mailstore managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate imapflags notify mdbox_rotate_size = 10 M namespace { list = children location = mdbox:/home/vmail/%%d/%%n prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { hidden = no inbox = no list = children location = virtual:/home/virtual:INDEX=~/virtual prefix = [rolmail]/ separator = / subscriptions = yes type = private } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Items" { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox [mail]/All { auto = no special_use = \All } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql-account.conf driver = sql } plugin { acl = vfile acl_shared_dict = file:/home/vmail/%d/shared-mailboxes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size from mail_log_group_events = no quota = dict:Storage used::file:%h/dovecot-quota quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_max_redirects = 10 stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 16 M stats_refresh = 30 secs stats_session_min_time = 15 mins stats_track_cmds = no stats_user_min_time = 1 hours zlib_save = gz zlib_save_level = 9 } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = mailstore mode = 0660 user = root } } service imap-login { inet_listener imap { port = 143 } process_limit = 48 process_min_avail = 3 service_count = 1 } service imap { process_limit = 48 process_min_avail = 2 service_count = 1 } service lmtp { inet_listener lmtp { port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 110 } process_limit = 16 process_min_avail = 2 service_count = 1 } service pop3 { process_limit = 16 process_min_avail = 2 service_count = 1 } service quota-warning { executable = script /usr/local/rol/dovecot/quota-warning.sh unix_listener quota-warning { user = mailstore } user = mailstore } service stats { fifo_listener stats-mail { mode = 0600 user = mailstore } } ssl = no ssl_cert = </etc/dovecot/certs/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql-account.conf driver = sql } protocol lmtp { mail_fsync = optimized mail_plugins = " quota mail_log notify acl zlib stats virtual sieve zlib" } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep imap_id_log = * imap_logout_format = bytes=%i/%o session=<%{session}> mail_max_userip_connections = 20 mail_plugins = " quota mail_log notify acl zlib stats virtual imap_quota imap_acl imap_zlib imap_stats" } protocol pop3 { mail_plugins = " quota mail_log notify acl zlib stats virtual" pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_lock_session = yes pop3_logout_format = bytes_sent=%o top=%t/%p, retr=%r/%b, del=%d/%m, size=%s uidl_hash=%u session=<%{session}> pop3_reuse_xuidl = yes }

2 3

[Dovecot] When you send an email with specific characters are included, dovecot.sieve is aborted.
by Atsuko Tanaka 07 May '14

07 May '14

Hello. I found a problem of dovecot.sieve. When you send an email with specific characters are included, dovecot.sieve is aborted. Are you sure I report details to this mailing list? Please reply. Thank you. -- ---------------------------------------- Atsuko Tanaka DesigNET Inc. e-mail：tanaka(a)designet.co.jp ----------------------------------------

2 2

[Dovecot] Some Information about compression rates to expect using zlib/xz compression
by Robert Nowotny 06 May '14

06 May '14

compression : xz, Level 6 here some compression rates I experienced : Diskspace usage : user1: uncompressed : 2.3GB --> compressed 1 GB user2: uncompressed : 6.2GB --> compressed 3.9 GB just for your reference Ing. Robert Nowotny Rotek GmbH Vienna/Austria

1 0

Re: [Dovecot] LMTP, TLS/SSL, authentication, proxy
by Stanislas SABATIER 06 May '14

06 May '14

Hello, unfortunatly, TLS doesn't seem to work on LMTP, anyway, not by simply put ssl=yet to the lmtp inet_listener. I've tried and when I *openssl s_client -connect* to the lmtp listener I've got the following response : CONNECTED(00000003) 34379118248:error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol:/usr/src/secure/lib/libssl/../../../crypto/openssl/ssl/s23_clnt.c:766: My postfix server can't neither establish a TLS connection on LMTP listener. On 22.10.2013, at 14.37, Jogi Hofmüller <jogi(a)mur.at> wrote: Can dovecot use TLS/SSL on LTMP inet socket? Oct 26, 2013 8:11:19 am , Timo Sirainen <tss(a)iki.fi> replied: Probably. Try adding ssl=yes to the inet_listener {}. --------------------------------------------------------------- Stanislas SABATIER s.sabatier(a)pobox.com ---------------------------------------------------------------

1 0

[Dovecot] Status of sieve-extdata?
by Jiri Bourek 06 May '14

06 May '14

Hi, I'd like to ask about status of extdata plugin for sieve. The wiki page (http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Extdata) mentions versions for PigeonHole 0.2 and 0.3, but there seems to be no version for 0.4 and Dovecot 2.2. Is the plugin dead or is it planned to make version for Dovecot 2.2 (when time allows I guess)? Regards J.

2 5