keent() from Tika - with doveadm

Aki Tuomi aki.tuomi at dovecot.fi
Tue Oct 25 08:59:25 UTC 2016


This seems to be some kind of clucene internal error.

Aki

On 24.10.2016 17:21, Larry Rosenman wrote:
> that seems to fix this kevent() problem, but I got the following lucene
> assert.  Is that because of previous fails?
>
> Also, while I have your attention, is fts_autoindex supposed to work
> accross NAMESPACES?
>
> doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39483 because:
> fts indexing
> doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39484 because:
> fts indexing
> doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39485 because:
> fts indexing
> doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39486 because:
> fts indexing
> Assertion failed: (numDocsInStore*8 == directory->fileLength(
> (docStoreSegment + "." + IndexFileNames::FIELDS_INDEX_EXTENSION).c_str()
> )), function closeDocStore, file
> src/core/CLucene/index/DocumentsWriter.cpp, line 210.
>
> Program received signal SIGABRT, Aborted.
> 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7
> (gdb) bt full
> #0  0x00000008014e6f7a in thr_kill () from /lib/libc.so.7
> No symbol table info available.
> #1  0x00000008014e6f66 in raise () from /lib/libc.so.7
> No symbol table info available.
> #2  0x00000008014e6ee9 in abort () from /lib/libc.so.7
> No symbol table info available.
> #3  0x000000080154dee1 in __assert () from /lib/libc.so.7
> No symbol table info available.
> #4  0x0000000803ea1762 in lucene::index::DocumentsWriter::closeDocStore() ()
>    from /usr/local/lib/libclucene-core.so.1
> No symbol table info available.
> #5  0x0000000803ea3d89 in lucene::index::DocumentsWriter::flush(bool) ()
>    from /usr/local/lib/libclucene-core.so.1
> No symbol table info available.
> #6  0x0000000803ed26bb in lucene::index::IndexWriter::doFlush(bool) ()
>    from /usr/local/lib/libclucene-core.so.1
> No symbol table info available.
> #7  0x0000000803ece25e in lucene::index::IndexWriter::flush(bool, bool) ()
>    from /usr/local/lib/libclucene-core.so.1
> No symbol table info available.
> #8  0x0000000803ececbe in
> lucene::index::IndexWriter::addDocument(lucene::document::Document*,
> lucene::analysis::Analyzer*) ()
>    from /usr/local/lib/libclucene-core.so.1
> No symbol table info available.
> ---Type <return> to continue, or q <return> to quit---
> #9  0x0000000803b8cd55 in lucene_index_build_flush (index=0x801c1b640)
>     at lucene-wrapper.cc:552
>         analyzer = 0x801c251c0
>         ret = 0
>         err = @0x801cd90d0: {
>           _awhat = 0x801cd9108 "Return-Path: <m.ray.mullins+caf_=mrm=
> lerctr.org at gmail.com>\nDelivered-To: mrm at lerctr.org\n",
>           _twhat = 0x58 <error: Cannot access memory at address 0x58>,
>           error_number = 30249224}
> #10 0x0000000803b8c42e in lucene_index_build_more (index=0x801c1b640,
>     uid=39486, part_idx=0,
>     data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>",
> size=45,
>     hdr_name=0x801c1a520 "Return-Path") at lucene-wrapper.cc:572
>         id =
> L"\x1cc8c40\b\xffffd970\x7fff\xffffd960\x7fff\x1190eba\b\x1cc0c00\b\x1191739\b\x1cc8c40\b\x1190eba\b\xffffd990\x7fff-\000\000\001-"
>         namesize = 34378158489
>         datasize = 140737488345424
>         dest = 0x801190eba <i_stream_is_buffer_invalid+138>
> L"\x45880124\xff458aff\xb60f0124\xc48348c0\xfc35d10\x4855001f\x8348e589\x8d4840ec\x8948e075\x8b48f07d\x8b48f07d\x8948107f\x8b48e87d\x8b48e87d\x140bf\x458b4800\x888b48e8\510\x48f92948\x1488889\x8b480000\xc748e845\x14080"
>         dest_free = 0x7fffffffd920
> L"\xffffd950\x7fff\x1191199\b\x1cc8c40\b\xffffd970\x7fff\xffffd960\x7fff\x1190eba\b\x1cc0c00\b\x1191739\b\x1cc8c40\b\x1190eba\b\xffffd990\x7fff-"
> ---Type <return> to continue, or q <return> to quit---
>         token_flag = 0
> #11 0x0000000803b8a420 in fts_backend_lucene_update_build_more (
>     _ctx=0x801c21240,
>     data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>",
> size=45)
>     at fts-backend-lucene.c:432
>         _data_stack_cur_id = 6
>         ctx = 0x801c21240
>         backend = 0x801c3a200
>         ret = 8
> #12 0x000000080220e035 in fts_backend_update_build_more (ctx=0x801c21240,
>     data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>",
> size=45)
>     at fts-api.c:193
> No locals.
> #13 0x000000080221015b in fts_build_full_words (ctx=0x7fffffffdc98,
>     data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>",
> size=45,
>     last=true) at fts-build-mail.c:402
>         i = 45
> #14 0x000000080220fd45 in fts_build_data (ctx=0x7fffffffdc98,
>     data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>",
> size=45,
>     last=true) at fts-build-mail.c:423
> No locals.
> #15 0x000000080221067d in fts_build_unstructured_header (ctx=0x7fffffffdc98,
>     hdr=0x801ccf118) at fts-build-mail.c:104
>         data = 0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>"
> ---Type <return> to continue, or q <return> to quit---
>         buf = 0x0
>         i = 45
>         ret = 18164334
> #16 0x000000080220fa54 in fts_build_mail_header (ctx=0x7fffffffdc98,
>     block=0x7fffffffdc40) at fts-build-mail.c:179
>         hdr = 0x801ccf118
>         key = {uid = 39486, type = FTS_BACKEND_BUILD_KEY_HDR,
>           part = 0x801c09c58, hdr_name = 0x801c4ba20 "Return-Path",
>           body_content_type = 0x0, body_content_disposition = 0x0}
>         ret = 32767
> #17 0x000000080220f292 in fts_build_mail_real (update_ctx=0x801c21240,
>     mail=0x801c63040) at fts-build-mail.c:548
>         ctx = {mail = 0x801c63040, update_ctx = 0x801c21240,
>           content_type = 0x0, content_disposition = 0x0, body_parser = 0x0,
>           word_buf = 0x0, pending_input = 0x0, cur_user_lang = 0x0}
>         input = 0x801cc9030
>         parser = 0x801c2f040
>         decoder = 0x801ccf100
>         raw_block = {part = 0x801c09c58, hdr = 0x801c53900, data = 0x0,
>           size = 0}
>         block = {part = 0x801c09c58, hdr = 0x801ccf118,
>           data = 0x7fffffffdc90 "0\220\314\001\b", size = 0}
>         prev_part = 0x801c09c58
>         parts = 0x4ffffdca8
> ---Type <return> to continue, or q <return> to quit---
>         skip_body = false
>         body_part = false
>         body_added = false
>         binary_body = 255
>         error = 0x801cc88c0 "\200\212\314\001\b"
>         ret = 1
> #18 0x000000080220ee72 in fts_build_mail (update_ctx=0x801c21240,
>     mail=0x801c63040) at fts-build-mail.c:594
>         _data_stack_cur_id = 5
>         ret = 8
> #19 0x000000080221a626 in fts_mail_index (_mail=0x801c63040)
>     at fts-storage.c:503
>         ft = 0x801c196e0
>         flist = 0x801c5dbd8
> #20 0x0000000802217d40 in fts_mail_precache (_mail=0x801c63040)
>     at fts-storage.c:522
>         _data_stack_cur_id = 4
>         mail = 0x801c63040
>         fmail = 0x801c634f0
>         ft = 0x801c196e0
> #21 0x0000000800d3d992 in mail_precache (mail=0x801c63040) at mail.c:420
>         _data_stack_cur_id = 3
>         p = 0x801c63040
> #22 0x0000000000433b59 in cmd_index_box_precache (box=0x8074edc40)
> ---Type <return> to continue, or q <return> to quit---
>     at doveadm-mail-index.c:75
>         status = {messages = 5342, recent = 0, unseen = 0,
>           uidvalidity = 1362362144, uidnext = 43009, first_unseen_seq = 0,
>           first_recent_uid = 43007, last_cached_seq = 0, highest_modseq = 0,
>           highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0,
>           permanent_keywords = 0, allow_new_keywords = 0,
>           nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1,
>           have_save_guids = 0, have_only_guid128 = 0}
>         trans = 0x801c3a800
>         search_args = 0x0
>         ctx = 0x801c1c040
>         mail = 0x801c63040
>         metadata = {guid = '\000' <repeats 15 times>, virtual_size = 0,
>           physical_size = 0, first_save_date = 0, cache_fields = 0x0,
>           precache_fields = (MAIL_FETCH_STREAM_HEADER |
> MAIL_FETCH_STREAM_BODY | MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE |
> MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_VIRTUAL_SIZE |
> MAIL_FETCH_UIDL_BACKEND | MAIL_FETCH_GUID | MAIL_FETCH_POP3_ORDER),
> backend_ns_prefix = 0x0, backend_ns_type = (unknown: 0)}
>         seq = 1
>         counter = 1819
>         max = 5342
>         ret = 0
> #23 0x0000000000433907 in cmd_index_box (ctx=0x801c2ac40, info=0x801c5f0c0)
>     at doveadm-mail-index.c:130
> ---Type <return> to continue, or q <return> to quit---
>         box = 0x8074edc40
>         status = {messages = 4294958944, recent = 32767, unseen = 14577888,
>           uidvalidity = 8, uidnext = 4294958944, first_unseen_seq =
> 16809983,
>           first_recent_uid = 29749440, last_cached_seq = 8,
>           highest_modseq = 34389277760, highest_pvt_modseq =
> 140737488346996,
>           keywords = 0x7fffffffdf90, permanent_flags = 18334301,
>           permanent_keywords = 0, allow_new_keywords = 0,
>           nonpermanent_modseqs = 0, no_modseq_tracking = 1, have_guids = 0,
>           have_save_guids = 0, have_only_guid128 = 0}
>         ret = 0
> #24 0x00000000004335ee in cmd_index_run (_ctx=0x801c2ac40, user=0x801c45040)
>     at doveadm-mail-index.c:201
>         _data_stack_cur_id = 2
>         ctx = 0x801c2ac40
>         iter_flags = (MAILBOX_LIST_ITER_NO_AUTO_BOXES |
> MAILBOX_LIST_ITER_STAR_WITHIN_NS | MAILBOX_LIST_ITER_RETURN_NO_FLAGS)
>         ns_mask = (MAIL_NAMESPACE_TYPE_PRIVATE | MAIL_NAMESPACE_TYPE_SHARED
> | MAIL_NAMESPACE_TYPE_PUBLIC)
>         iter = 0x801c2bc40
>         info = 0x801c5f0c0
>         i = 32767
>         ret = 0
> #25 0x000000000042b90a in doveadm_mail_next_user (ctx=0x801c2ac40,
>     cctx=0x7fffffffe350, error_r=0x7fffffffe0f8) at doveadm-mail.c:404
> ---Type <return> to continue, or q <return> to quit---
>         input = {module = 0x0, service = 0x484aa6 "doveadm",
>           username = 0x7fffffffef58 "mrm", session_id = 0x0,
>           session_id_prefix = 0x0, session_create_time = 0, local_ip = {
>             family = 0, u = {ip6 = {__u6_addr = {
>                   __u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0,
> 0,
>                     0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {
>                 s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {
>                 __u6_addr = {__u6_addr8 = '\000' <repeats 15 times>,
>                   __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0,
> 0,
>                     0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0,
>           remote_port = 0, userdb_fields = 0x0,
>           flags_override_add = (unknown: 0),
>           flags_override_remove = (unknown: 0), no_userdb_lookup = 0,
>           debug = 0}
>         error = 0x7fffffffe420 "\200\347\377\377\377\177"
>         ip = 0x8011deee3 ""
>         ret = 0
> #26 0x000000000042b5bc in doveadm_mail_single_user (ctx=0x801c2ac40,
>     cctx=0x7fffffffe350, error_r=0x7fffffffe0f8) at doveadm-mail.c:435
> No locals.
> #27 0x000000000042d50a in doveadm_mail_cmd_exec (ctx=0x801c2ac40,
>     cctx=0x7fffffffe350, wildcard_user=0x0) at doveadm-mail.c:596
>         ret = 32767
>         error = 0x801c2ae18 "P\256\302\001\b"
> ---Type <return> to continue, or q <return> to quit---
> #28 0x000000000042d0a5 in doveadm_cmd_ver2_to_mail_cmd_wrapper (
>     cctx=0x7fffffffe350) at doveadm-mail.c:1061
>         mctx = 0x801c2ac40
>         wildcard_user = 0x0
>         fieldstr = 0x7fffffffe1e0 "\300\342\377\377\377\177"
>         pargv = {arr = {buffer = 0x801c2ae98, element_size = 8},
>           v = 0x801c2ae98, v_modifiable = 0x801c2ae98}
>         full_args = {arr = {buffer = 0x801c2ae18, element_size = 8},
>           v = 0x801c2ae18, v_modifiable = 0x801c2ae18}
>         i = 7
>         mail_cmd = {alloc = 0x433210 <cmd_index_alloc>,
>           name = 0x48da32 "index",
>           usage_args = 0x488030 "[-u <user>|-A] [-S <socket_path>] [-q] [-n
> <max recent>] <mailbox mask>"}
>         args_pos = 0
> #29 0x0000000000443cfe in doveadm_cmd_run_ver2 (argc=2, argv=0x7fffffffe438,
>     cctx=0x7fffffffe350) at doveadm-cmd.c:523
>         param = 0x801c06ce0
>         pargv = {arr = {buffer = 0x801c06a38, element_size = 104},
>           v = 0x801c06a38, v_modifiable = 0x801c06a38}
>         opts = {arr = {buffer = 0x801c06800, element_size = 32},
>           v = 0x801c06800, v_modifiable = 0x801c06800}
>         pargc = 7
>         c = -1
> ---Type <return> to continue, or q <return> to quit---
>         li = 32767
>         pool = 0x801c06768
>         optbuf = 0x801c06780
> #30 0x00000000004437f4 in doveadm_cmd_try_run_ver2 (
>     cmd_name=0x7fffffffe7a3 "index", argc=2, argv=0x7fffffffe438,
>     cctx=0x7fffffffe350) at doveadm-cmd.c:446
>         cmd = 0x801c4db98
> #31 0x0000000000447f51 in main (argc=2, argv=0x7fffffffe438) at
> doveadm.c:379
>         service_flags = (MASTER_SERVICE_FLAG_STANDALONE |
> MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN)
>         cctx = {cmd = 0x801c4db98, argc = 7, argv = 0x801c06a70,
>           username = 0x7fffffffef58 "mrm", cli = true, tcp_server = false,
>           local_ip = {family = 0, u = {ip6 = {__u6_addr = {
>                   __u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0,
> 0,
>                     0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {
>                 s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {
>                 __u6_addr = {__u6_addr8 = '\000' <repeats 15 times>,
>                   __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0,
> 0,
>                     0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0,
>           remote_port = 0, conn = 0x0}
>         cmd_name = 0x7fffffffe7a3 "index"
>         i = 6
>         quick_init = false
>         c = -1
> (gdb)
>
> On Mon, Oct 24, 2016 at 4:34 AM, Aki Tuomi <aki.tuomi at dovecot.fi> wrote:
>
>> Hi!
>>
>> We found some problems with those patches, and ended up doing slightly
>> different fix:
>>
>> https://github.com/dovecot/core/compare/3e41b3d%5E...cca98b.patch
>>
>> Aki
>>
>> On 24.10.2016 10:17, Aki Tuomi wrote:
>>> Hi!
>>>
>>> Can you try these two patches?
>>>
>>> Aki
>>>
>>>
>>> On 24.10.2016 08:48, Aki Tuomi wrote:
>>>> Ok so that timeval makes no sense. We'll look into it.
>>>>
>>>> Aki
>>>>
>>>>> On October 24, 2016 at 12:22 AM Larry Rosenman <larryrtx at gmail.com>
>> wrote:
>>>>>
>>>>> doveadm(mrm): Debug: http-client: conn 127.0.0.1:9998 [1]: Got 200
>> response
>>>>> for request [Req38: PUT http://localhost:9998/tika/] (took 296 ms + 8
>> ms in
>>>>> queue)
>>>>> doveadm(mrm): Panic: kevent(): Invalid argument
>>>>>
>>>>> Program received signal SIGABRT, Aborted.
>>>>> 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7
>>>>> (gdb) fr 6
>>>>> #6  0x00000008011a3e49 in io_loop_handler_run_internal
>> (ioloop=0x801c214e0)
>>>>>     at ioloop-kqueue.c:131
>>>>> 131 i_panic("kevent(): %m");
>>>>> (gdb) p ts
>>>>> $1 = {tv_sec = 34389923520, tv_nsec = 140737488345872000}
>>>>> (gdb) p errno
>>>>> $2 = 22
>>>>> (gdb) p ret
>>>>> $3 = -1
>>>>> (gdb) p *ioloop
>>>>> $4 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980,
>>>>>   next_io_file = 0x0, timeouts = 0x801d17540, timeouts_new = {arr = {
>>>>>       buffer = 0x801cd9700, element_size = 8}, v = 0x801cd9700,
>>>>>     v_modifiable = 0x801cd9700}, handler_context = 0x801d17560,
>>>>>   notify_handler_context = 0x0, max_fd_count = 0,
>>>>>   time_moved_callback = 0x800d53bb0 <mail_storage_service_time_moved>,
>>>>>   next_max_time = 1477257580, ioloop_wait_usecs = 27148,
>> io_pending_count =
>>>>> 1,
>>>>>   running = 1, iolooping = 1}
>>>>> (gdb) p* ctx
>>>>> $5 = {kq = 21, deleted_count = 0, events = {arr = {buffer =
>> 0x801cd9740,
>>>>>       element_size = 32}, v = 0x801cd9740, v_modifiable = 0x801cd9740}}
>>>>> (gdb) p *events
>>>>> $6 = {ident = 22, filter = -1, flags = 0, fflags = 0, data = 8,
>>>>>   udata = 0x801c4f980}
>>>>> (gdb)
>>>>>
>>>>> thebighonker.lerctr.org ~ $ ps auxw|grep doveadm
>>>>> mrm      46965   0.0  0.2   108516  55264  0  I+    4:19PM    0:02.28
>> gdb
>>>>> /usr/local/bin/doveadm (gdb7111)
>>>>> mrm      46985   0.0  0.0    81236  15432  0  TX    4:19PM    0:03.51
>>>>> /usr/local/bin/doveadm -D -vvvvvvv index *
>>>>> ler      47221   0.0  0.0    18856   2360  1  S+    4:21PM    0:00.00
>> grep
>>>>> doveadm
>>>>> thebighonker.lerctr.org ~ $ sudo lsof -p 46985
>>>>> Password:
>>>>> COMMAND   PID USER   FD     TYPE             DEVICE SIZE/OFF   NODE
>> NAME
>>>>> doveadm 46985  mrm  cwd     VDIR      22,2669215774      152      4
>>>>> /home/mrm
>>>>> doveadm 46985  mrm  rtd     VDIR       19,766509061       28      4 /
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129  1714125 182952
>>>>> /usr/local/bin/doveadm
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061   132272  14382
>>>>> /libexec/ld-elf.so.1
>>>>> doveadm 46985  mrm  txt     VREG      22,2669215774     6920  10680
>>>>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log
>>>>> doveadm 46985  mrm  txt     VREG      22,2669215774     7224  10716
>>>>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log
>>>>> doveadm 46985  mrm  txt     VREG      22,2669215774    11080  10650
>>>>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log
>>>>> doveadm 46985  mrm  txt     VREG      22,2669215774     2968  10679
>>>>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache
>>>>> doveadm 46985  mrm  txt     VREG      22,2669215774     3108  10715
>>>>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache
>>>>> doveadm 46985  mrm  txt     VREG      22,2669215774     6520 139902
>>>>> /home/mrm/mail/.imap/Sent/dovecot.index.log
>>>>> doveadm 46985  mrm  txt     VREG      22,2669215774     9236  10648
>>>>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache
>>>>> doveadm 46985  mrm  txt     VREG      22,2669215774   174892 143343
>>>>> /home/mrm/mail/.imap/Sent/dovecot.index.cache
>>>>> doveadm 46985  mrm  txt     VREG      22,2669215774    32656 143058
>>>>> /home/mrm/mail/.imap/INBOX/dovecot.index.log
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061      720  30627
>>>>> /usr/share/i18n/csmapper/CP/CP1251%UCS.mps
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061      720  30630
>>>>> /usr/share/i18n/csmapper/CP/CP1252%UCS.mps
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061    89576   6846
>>>>> /lib/libz.so.6
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061    62008   5994
>>>>> /lib/libcrypt.so.5
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129  6725689 183611
>>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0.0.0
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129  3162259 183615
>>>>> /usr/local/lib/dovecot/libdovecot.so.0.0.0
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061  1649944   4782
>>>>> /lib/libc.so.7
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129    80142 183550
>>>>> /usr/local/lib/dovecot/lib15_notify_plugin.so
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129   652615 183556
>>>>> /usr/local/lib/dovecot/lib20_fts_plugin.so
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129  2730888 268825
>>>>> /usr/local/lib/libicui18n.so.57.1
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129  1753976 268849
>>>>> /usr/local/lib/libicuuc.so.57.1
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129     1704 268821
>>>>> /usr/local/lib/libicudata.so.57.1
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061   102560   6745
>>>>> /lib/libthr.so.3
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061   184712   5795
>>>>> /lib/libm.so.5
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061   774000   5642
>>>>> /usr/lib/libc++.so.1
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061   103304   5742
>>>>> /lib/libcxxrt.so.1
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061    56344   7436
>>>>> /lib/libgcc_s.so.1
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129   349981 183782
>>>>> /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129  1969384 113258
>>>>> /usr/local/lib/libclucene-core.so.2.3.3.4
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129   128992 113261
>>>>> /usr/local/lib/libclucene-shared.so.2.3.3.4
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129   143141 183578
>>>>> /usr/local/lib/dovecot/lib90_stats_plugin.so
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129    37368 151926
>>>>> /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129   693808 151924
>>>>> /usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0.0.0
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129   146477 183599
>>>>> /usr/local/lib/dovecot/libdovecot-lda.so.0.0.0
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129    13823 183780
>>>>> /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so
>>>>> doveadm 46985  mrm  txt     VREG     119,3584295129    88081 183527
>>>>> /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061     8304   6330
>>>>> /usr/lib/i18n/libiconv_std.so.4
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061     6744   6318
>>>>> /usr/lib/i18n/libUTF8.so.4
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061     4384   6336
>>>>> /usr/lib/i18n/libmapper_none.so.4
>>>>> doveadm 46985  mrm  txt     VREG       19,766509061     7584   6345
>>>>> /usr/lib/i18n/libmapper_std.so.4
>>>>> doveadm 46985  mrm    0u    VCHR              0,188 0t390889    188
>>>>> /dev/pts/0
>>>>> doveadm 46985  mrm    1u    VCHR              0,188 0t390889    188
>>>>> /dev/pts/0
>>>>> doveadm 46985  mrm    2u    VCHR              0,188 0t390889    188
>>>>> /dev/pts/0
>>>>> doveadm 46985  mrm    3u    PIPE 0xfffff806fdf505d0    16384
>>>>>  ->0xfffff806fdf50730
>>>>> doveadm 46985  mrm    4u    PIPE 0xfffff806fdf50730        0
>>>>>  ->0xfffff806fdf505d0
>>>>> doveadm 46985  mrm    5u  KQUEUE 0xfffff806350b0600
>>>>> count=0, state=0
>>>>> doveadm 46985  mrm    6w    FIFO      163,709754999      0t0  29707
>>>>> /var/run/dovecot/stats-mail
>>>>> doveadm 46985  mrm    7u    VREG      22,2669215774    11080  10650
>>>>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log
>>>>> doveadm 46985  mrm    8u    VREG      22,2669215774      536 137895
>>>>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index
>>>>> doveadm 46985  mrm    9u    VREG      22,2669215774     6920  10680
>>>>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log
>>>>> doveadm 46985  mrm   10u    VREG      22,2669215774     2968  10679
>>>>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache
>>>>> doveadm 46985  mrm   11u    VREG      22,2669215774     6520 139902
>>>>> /home/mrm/mail/.imap/Sent/dovecot.index.log
>>>>> doveadm 46985  mrm   12u    VREG      22,2669215774     9288 139905
>>>>> /home/mrm/mail/.imap/Sent/dovecot.index
>>>>> doveadm 46985  mrm   13u    VREG      22,2669215774     7224  10716
>>>>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log
>>>>> doveadm 46985  mrm   14u    VREG      22,2669215774     3108  10715
>>>>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache
>>>>> doveadm 46985  mrm   15u    VREG      22,2669215774     9236  10648
>>>>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache
>>>>> doveadm 46985  mrm   16u    VREG      22,2669215774   174892 143343
>>>>> /home/mrm/mail/.imap/Sent/dovecot.index.cache
>>>>> doveadm 46985  mrm   17u    VREG      22,2669215774    32656 143058
>>>>> /home/mrm/mail/.imap/INBOX/dovecot.index.log
>>>>> doveadm 46985  mrm   18u    VREG      22,2669215774        0 135848
>>>>> /home/mrm (zroot/home/mrm)
>>>>> doveadm 46985  mrm   19u    VREG      22,2669215774    35656 135336
>>>>> /home/mrm/mail/.imap/INBOX/dovecot.index
>>>>> doveadm 46985  mrm   20u    VREG      22,2669215774        0 135849
>>>>> /home/mrm (zroot/home/mrm)
>>>>> doveadm 46985  mrm   21u  KQUEUE 0xfffff80163b1ba00
>>>>> count=1, state=0
>>>>> doveadm 46985  mrm   22u    IPv4 0xfffff805ea69a000      0t0    TCP
>>>>> localhost:44730->localhost:9998 (ESTABLISHED)
>>>>> doveadm 46985  mrm   25uR   VREG      22,2669215774 32997612   4151
>>>>> /home/mrm/mail/Sent
>>>>> thebighonker.lerctr.org
>>>>>
>>>>>
>>>>>
>>>>> On Sun, Oct 23, 2016 at 12:20 PM, Aki Tuomi <aki.tuomi at dovecot.fi>
>> wrote:
>>>>>> According to man page, the only way it can return EINVAL (22) is
>> either
>>>>>> bad filter, or bad timeout. I can't see how the filter would be bad,
>> so I'm
>>>>>> guessing ts must be bad. Unfortunately I forgot to ask for it, so I am
>>>>>> going to have to ask you run it again and run
>>>>>>
>>>>>> p ts
>>>>>>
>>>>>> if that's valid, then the only thing that can be bad if the file
>>>>>> descriptor 23.
>>>>>>
>>>>>> Aki
>>>>>>
>>>>>>> On October 23, 2016 at 7:42 PM Larry Rosenman <larryrtx at gmail.com>
>>>>>> wrote:
>>>>>>> ok, gdb7 works:
>>>>>>> (gdb) fr 6
>>>>>>> #6  0x00000008011a3e49 in io_loop_handler_run_internal
>>>>>> (ioloop=0x801c214e0)
>>>>>>> at ioloop-kqueue.c:131
>>>>>>> 131 i_panic("kevent(): %m");
>>>>>>> (gdb) p errno
>>>>>>> $1 = 22
>>>>>>> (gdb) p ret
>>>>>>> $2 = -1
>>>>>>> (gdb) p *ioloop
>>>>>>> $3 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980,
>>>>>>> next_io_file = 0x0, timeouts = 0x801c19e60, timeouts_new = {arr =
>>>>>> {buffer =
>>>>>>> 0x801c5ac80, element_size = 8}, v = 0x801c5ac80,
>>>>>>>     v_modifiable = 0x801c5ac80}, handler_context = 0x801c19e80,
>>>>>>> notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback =
>>>>>>> 0x800d53bb0 <mail_storage_service_time_moved>,
>>>>>>>   next_max_time = 1477240784, ioloop_wait_usecs = 29863,
>>>>>> io_pending_count =
>>>>>>> 1, running = 1, iolooping = 1}
>>>>>>> (gdb) p *ctx
>>>>>>> $4 = {kq = 22, deleted_count = 0, events = {arr = {buffer =
>> 0x801c5acc0,
>>>>>>> element_size = 32}, v = 0x801c5acc0, v_modifiable = 0x801c5acc0}}
>>>>>>> (gdb) p *events
>>>>>>> $5 = {ident = 23, filter = -1, flags = 0, fflags = 0, data = 8,
>> udata =
>>>>>>> 0x801c4f980}
>>>>>>> (gdb)
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Sun, Oct 23, 2016 at 11:27 AM, Larry Rosenman <larryrtx at gmail.com
>>>>>> wrote:
>>>>>>>> grrr.
>>>>>>>>
>>>>>>>> /home/mrm $ gdb /usr/local/bin/doveadm
>>>>>>>> GNU gdb 6.1.1 [FreeBSD]
>>>>>>>> Copyright 2004 Free Software Foundation, Inc.
>>>>>>>> GDB is free software, covered by the GNU General Public License, and
>>>>>> you
>>>>>>>> are
>>>>>>>> welcome to change it and/or distribute copies of it under certain
>>>>>>>> conditions.
>>>>>>>> Type "show copying" to see the conditions.
>>>>>>>> There is absolutely no warranty for GDB.  Type "show warranty" for
>>>>>> details.
>>>>>>>> This GDB was configured as "amd64-marcel-freebsd"...
>>>>>>>> (gdb) run -D -vvvvvv index *
>>>>>>>> Starting program: /usr/local/bin/doveadm -D -vvvvvv index *
>>>>>>>>
>>>>>>>> Program received signal SIGTRAP, Trace/breakpoint trap.
>>>>>>>> Cannot remove breakpoints because program is no longer writable.
>>>>>>>> It might be running in another process.
>>>>>>>> Further execution is probably impossible.
>>>>>>>> 0x0000000800624490 in ?? ()
>>>>>>>> (gdb)
>>>>>>>>
>>>>>>>> Ideas?
>>>>>>>>
>>>>>>>>
>>>>>>>> On Sun, Oct 23, 2016 at 11:14 AM, Aki Tuomi <aki.tuomi at dovecot.fi>
>>>>>> wrote:
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> can you run doveadm in gdb, wait for it to crash, and then go to
>>>>>> frame 6
>>>>>>>>> ( io_loop_handler_run_internal) and run
>>>>>>>>>
>>>>>>>>> p errno
>>>>>>>>> p ret
>>>>>>>>> p *ioloop
>>>>>>>>> p *ctx
>>>>>>>>> p *events
>>>>>>>>>
>>>>>>>>> Sorry but the crash doesn't make enough sense yet to me, we need to
>>>>>>>>> determine what the invalid parameter is.
>>>>>>>>>
>>>>>>>>>> Larry Rosenman                     http://www.lerctr.org/~ler
>>>>>>>>>> Phone: +1 214-642-9640 (c)     E-Mail: larryrtx at gmail.com
>>>>>>>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
>>>>>>>> --
>>>>>>>> Larry Rosenman                     http://www.lerctr.org/~ler
>>>>>>>> Phone: +1 214-642-9640 (c)     E-Mail: larryrtx at gmail.com
>>>>>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
>>>>>>>>
>>>>>>> --
>>>>>>> Larry Rosenman                     http://www.lerctr.org/~ler
>>>>>>> Phone: +1 214-642-9640 (c)     E-Mail: larryrtx at gmail.com
>>>>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
>>>>> --
>>>>> Larry Rosenman                     http://www.lerctr.org/~ler
>>>>> Phone: +1 214-642-9640 (c)     E-Mail: larryrtx at gmail.com
>>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
>
>



More information about the dovecot mailing list