keent() from Tika - with doveadm

Larry Rosenman larryrtx at gmail.com
Mon Oct 24 14:21:48 UTC 2016


that seems to fix this kevent() problem, but I got the following lucene
assert.  Is that because of previous fails?

Also, while I have your attention, is fts_autoindex supposed to work
accross NAMESPACES?

doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39483 because:
fts indexing
doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39484 because:
fts indexing
doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39485 because:
fts indexing
doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39486 because:
fts indexing
Assertion failed: (numDocsInStore*8 == directory->fileLength(
(docStoreSegment + "." + IndexFileNames::FIELDS_INDEX_EXTENSION).c_str()
)), function closeDocStore, file
src/core/CLucene/index/DocumentsWriter.cpp, line 210.

Program received signal SIGABRT, Aborted.
0x00000008014e6f7a in thr_kill () from /lib/libc.so.7
(gdb) bt full
#0  0x00000008014e6f7a in thr_kill () from /lib/libc.so.7
No symbol table info available.
#1  0x00000008014e6f66 in raise () from /lib/libc.so.7
No symbol table info available.
#2  0x00000008014e6ee9 in abort () from /lib/libc.so.7
No symbol table info available.
#3  0x000000080154dee1 in __assert () from /lib/libc.so.7
No symbol table info available.
#4  0x0000000803ea1762 in lucene::index::DocumentsWriter::closeDocStore() ()
   from /usr/local/lib/libclucene-core.so.1
No symbol table info available.
#5  0x0000000803ea3d89 in lucene::index::DocumentsWriter::flush(bool) ()
   from /usr/local/lib/libclucene-core.so.1
No symbol table info available.
#6  0x0000000803ed26bb in lucene::index::IndexWriter::doFlush(bool) ()
   from /usr/local/lib/libclucene-core.so.1
No symbol table info available.
#7  0x0000000803ece25e in lucene::index::IndexWriter::flush(bool, bool) ()
   from /usr/local/lib/libclucene-core.so.1
No symbol table info available.
#8  0x0000000803ececbe in
lucene::index::IndexWriter::addDocument(lucene::document::Document*,
lucene::analysis::Analyzer*) ()
   from /usr/local/lib/libclucene-core.so.1
No symbol table info available.
---Type <return> to continue, or q <return> to quit---
#9  0x0000000803b8cd55 in lucene_index_build_flush (index=0x801c1b640)
    at lucene-wrapper.cc:552
        analyzer = 0x801c251c0
        ret = 0
        err = @0x801cd90d0: {
          _awhat = 0x801cd9108 "Return-Path: <m.ray.mullins+caf_=mrm=
lerctr.org at gmail.com>\nDelivered-To: mrm at lerctr.org\n",
          _twhat = 0x58 <error: Cannot access memory at address 0x58>,
          error_number = 30249224}
#10 0x0000000803b8c42e in lucene_index_build_more (index=0x801c1b640,
    uid=39486, part_idx=0,
    data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>",
size=45,
    hdr_name=0x801c1a520 "Return-Path") at lucene-wrapper.cc:572
        id =
L"\x1cc8c40\b\xffffd970\x7fff\xffffd960\x7fff\x1190eba\b\x1cc0c00\b\x1191739\b\x1cc8c40\b\x1190eba\b\xffffd990\x7fff-\000\000\001-"
        namesize = 34378158489
        datasize = 140737488345424
        dest = 0x801190eba <i_stream_is_buffer_invalid+138>
L"\x45880124\xff458aff\xb60f0124\xc48348c0\xfc35d10\x4855001f\x8348e589\x8d4840ec\x8948e075\x8b48f07d\x8b48f07d\x8948107f\x8b48e87d\x8b48e87d\x140bf\x458b4800\x888b48e8\510\x48f92948\x1488889\x8b480000\xc748e845\x14080"
        dest_free = 0x7fffffffd920
L"\xffffd950\x7fff\x1191199\b\x1cc8c40\b\xffffd970\x7fff\xffffd960\x7fff\x1190eba\b\x1cc0c00\b\x1191739\b\x1cc8c40\b\x1190eba\b\xffffd990\x7fff-"
---Type <return> to continue, or q <return> to quit---
        token_flag = 0
#11 0x0000000803b8a420 in fts_backend_lucene_update_build_more (
    _ctx=0x801c21240,
    data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>",
size=45)
    at fts-backend-lucene.c:432
        _data_stack_cur_id = 6
        ctx = 0x801c21240
        backend = 0x801c3a200
        ret = 8
#12 0x000000080220e035 in fts_backend_update_build_more (ctx=0x801c21240,
    data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>",
size=45)
    at fts-api.c:193
No locals.
#13 0x000000080221015b in fts_build_full_words (ctx=0x7fffffffdc98,
    data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>",
size=45,
    last=true) at fts-build-mail.c:402
        i = 45
#14 0x000000080220fd45 in fts_build_data (ctx=0x7fffffffdc98,
    data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>",
size=45,
    last=true) at fts-build-mail.c:423
No locals.
#15 0x000000080221067d in fts_build_unstructured_header (ctx=0x7fffffffdc98,
    hdr=0x801ccf118) at fts-build-mail.c:104
        data = 0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>"
---Type <return> to continue, or q <return> to quit---
        buf = 0x0
        i = 45
        ret = 18164334
#16 0x000000080220fa54 in fts_build_mail_header (ctx=0x7fffffffdc98,
    block=0x7fffffffdc40) at fts-build-mail.c:179
        hdr = 0x801ccf118
        key = {uid = 39486, type = FTS_BACKEND_BUILD_KEY_HDR,
          part = 0x801c09c58, hdr_name = 0x801c4ba20 "Return-Path",
          body_content_type = 0x0, body_content_disposition = 0x0}
        ret = 32767
#17 0x000000080220f292 in fts_build_mail_real (update_ctx=0x801c21240,
    mail=0x801c63040) at fts-build-mail.c:548
        ctx = {mail = 0x801c63040, update_ctx = 0x801c21240,
          content_type = 0x0, content_disposition = 0x0, body_parser = 0x0,
          word_buf = 0x0, pending_input = 0x0, cur_user_lang = 0x0}
        input = 0x801cc9030
        parser = 0x801c2f040
        decoder = 0x801ccf100
        raw_block = {part = 0x801c09c58, hdr = 0x801c53900, data = 0x0,
          size = 0}
        block = {part = 0x801c09c58, hdr = 0x801ccf118,
          data = 0x7fffffffdc90 "0\220\314\001\b", size = 0}
        prev_part = 0x801c09c58
        parts = 0x4ffffdca8
---Type <return> to continue, or q <return> to quit---
        skip_body = false
        body_part = false
        body_added = false
        binary_body = 255
        error = 0x801cc88c0 "\200\212\314\001\b"
        ret = 1
#18 0x000000080220ee72 in fts_build_mail (update_ctx=0x801c21240,
    mail=0x801c63040) at fts-build-mail.c:594
        _data_stack_cur_id = 5
        ret = 8
#19 0x000000080221a626 in fts_mail_index (_mail=0x801c63040)
    at fts-storage.c:503
        ft = 0x801c196e0
        flist = 0x801c5dbd8
#20 0x0000000802217d40 in fts_mail_precache (_mail=0x801c63040)
    at fts-storage.c:522
        _data_stack_cur_id = 4
        mail = 0x801c63040
        fmail = 0x801c634f0
        ft = 0x801c196e0
#21 0x0000000800d3d992 in mail_precache (mail=0x801c63040) at mail.c:420
        _data_stack_cur_id = 3
        p = 0x801c63040
#22 0x0000000000433b59 in cmd_index_box_precache (box=0x8074edc40)
---Type <return> to continue, or q <return> to quit---
    at doveadm-mail-index.c:75
        status = {messages = 5342, recent = 0, unseen = 0,
          uidvalidity = 1362362144, uidnext = 43009, first_unseen_seq = 0,
          first_recent_uid = 43007, last_cached_seq = 0, highest_modseq = 0,
          highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0,
          permanent_keywords = 0, allow_new_keywords = 0,
          nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1,
          have_save_guids = 0, have_only_guid128 = 0}
        trans = 0x801c3a800
        search_args = 0x0
        ctx = 0x801c1c040
        mail = 0x801c63040
        metadata = {guid = '\000' <repeats 15 times>, virtual_size = 0,
          physical_size = 0, first_save_date = 0, cache_fields = 0x0,
          precache_fields = (MAIL_FETCH_STREAM_HEADER |
MAIL_FETCH_STREAM_BODY | MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE |
MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_VIRTUAL_SIZE |
MAIL_FETCH_UIDL_BACKEND | MAIL_FETCH_GUID | MAIL_FETCH_POP3_ORDER),
backend_ns_prefix = 0x0, backend_ns_type = (unknown: 0)}
        seq = 1
        counter = 1819
        max = 5342
        ret = 0
#23 0x0000000000433907 in cmd_index_box (ctx=0x801c2ac40, info=0x801c5f0c0)
    at doveadm-mail-index.c:130
---Type <return> to continue, or q <return> to quit---
        box = 0x8074edc40
        status = {messages = 4294958944, recent = 32767, unseen = 14577888,
          uidvalidity = 8, uidnext = 4294958944, first_unseen_seq =
16809983,
          first_recent_uid = 29749440, last_cached_seq = 8,
          highest_modseq = 34389277760, highest_pvt_modseq =
140737488346996,
          keywords = 0x7fffffffdf90, permanent_flags = 18334301,
          permanent_keywords = 0, allow_new_keywords = 0,
          nonpermanent_modseqs = 0, no_modseq_tracking = 1, have_guids = 0,
          have_save_guids = 0, have_only_guid128 = 0}
        ret = 0
#24 0x00000000004335ee in cmd_index_run (_ctx=0x801c2ac40, user=0x801c45040)
    at doveadm-mail-index.c:201
        _data_stack_cur_id = 2
        ctx = 0x801c2ac40
        iter_flags = (MAILBOX_LIST_ITER_NO_AUTO_BOXES |
MAILBOX_LIST_ITER_STAR_WITHIN_NS | MAILBOX_LIST_ITER_RETURN_NO_FLAGS)
        ns_mask = (MAIL_NAMESPACE_TYPE_PRIVATE | MAIL_NAMESPACE_TYPE_SHARED
| MAIL_NAMESPACE_TYPE_PUBLIC)
        iter = 0x801c2bc40
        info = 0x801c5f0c0
        i = 32767
        ret = 0
#25 0x000000000042b90a in doveadm_mail_next_user (ctx=0x801c2ac40,
    cctx=0x7fffffffe350, error_r=0x7fffffffe0f8) at doveadm-mail.c:404
---Type <return> to continue, or q <return> to quit---
        input = {module = 0x0, service = 0x484aa6 "doveadm",
          username = 0x7fffffffef58 "mrm", session_id = 0x0,
          session_id_prefix = 0x0, session_create_time = 0, local_ip = {
            family = 0, u = {ip6 = {__u6_addr = {
                  __u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0,
0,
                    0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {
                s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {
                __u6_addr = {__u6_addr8 = '\000' <repeats 15 times>,
                  __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0,
0,
                    0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0,
          remote_port = 0, userdb_fields = 0x0,
          flags_override_add = (unknown: 0),
          flags_override_remove = (unknown: 0), no_userdb_lookup = 0,
          debug = 0}
        error = 0x7fffffffe420 "\200\347\377\377\377\177"
        ip = 0x8011deee3 ""
        ret = 0
#26 0x000000000042b5bc in doveadm_mail_single_user (ctx=0x801c2ac40,
    cctx=0x7fffffffe350, error_r=0x7fffffffe0f8) at doveadm-mail.c:435
No locals.
#27 0x000000000042d50a in doveadm_mail_cmd_exec (ctx=0x801c2ac40,
    cctx=0x7fffffffe350, wildcard_user=0x0) at doveadm-mail.c:596
        ret = 32767
        error = 0x801c2ae18 "P\256\302\001\b"
---Type <return> to continue, or q <return> to quit---
#28 0x000000000042d0a5 in doveadm_cmd_ver2_to_mail_cmd_wrapper (
    cctx=0x7fffffffe350) at doveadm-mail.c:1061
        mctx = 0x801c2ac40
        wildcard_user = 0x0
        fieldstr = 0x7fffffffe1e0 "\300\342\377\377\377\177"
        pargv = {arr = {buffer = 0x801c2ae98, element_size = 8},
          v = 0x801c2ae98, v_modifiable = 0x801c2ae98}
        full_args = {arr = {buffer = 0x801c2ae18, element_size = 8},
          v = 0x801c2ae18, v_modifiable = 0x801c2ae18}
        i = 7
        mail_cmd = {alloc = 0x433210 <cmd_index_alloc>,
          name = 0x48da32 "index",
          usage_args = 0x488030 "[-u <user>|-A] [-S <socket_path>] [-q] [-n
<max recent>] <mailbox mask>"}
        args_pos = 0
#29 0x0000000000443cfe in doveadm_cmd_run_ver2 (argc=2, argv=0x7fffffffe438,
    cctx=0x7fffffffe350) at doveadm-cmd.c:523
        param = 0x801c06ce0
        pargv = {arr = {buffer = 0x801c06a38, element_size = 104},
          v = 0x801c06a38, v_modifiable = 0x801c06a38}
        opts = {arr = {buffer = 0x801c06800, element_size = 32},
          v = 0x801c06800, v_modifiable = 0x801c06800}
        pargc = 7
        c = -1
---Type <return> to continue, or q <return> to quit---
        li = 32767
        pool = 0x801c06768
        optbuf = 0x801c06780
#30 0x00000000004437f4 in doveadm_cmd_try_run_ver2 (
    cmd_name=0x7fffffffe7a3 "index", argc=2, argv=0x7fffffffe438,
    cctx=0x7fffffffe350) at doveadm-cmd.c:446
        cmd = 0x801c4db98
#31 0x0000000000447f51 in main (argc=2, argv=0x7fffffffe438) at
doveadm.c:379
        service_flags = (MASTER_SERVICE_FLAG_STANDALONE |
MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN)
        cctx = {cmd = 0x801c4db98, argc = 7, argv = 0x801c06a70,
          username = 0x7fffffffef58 "mrm", cli = true, tcp_server = false,
          local_ip = {family = 0, u = {ip6 = {__u6_addr = {
                  __u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0,
0,
                    0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {
                s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {
                __u6_addr = {__u6_addr8 = '\000' <repeats 15 times>,
                  __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0,
0,
                    0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0,
          remote_port = 0, conn = 0x0}
        cmd_name = 0x7fffffffe7a3 "index"
        i = 6
        quick_init = false
        c = -1
(gdb)

On Mon, Oct 24, 2016 at 4:34 AM, Aki Tuomi <aki.tuomi at dovecot.fi> wrote:

> Hi!
>
> We found some problems with those patches, and ended up doing slightly
> different fix:
>
> https://github.com/dovecot/core/compare/3e41b3d%5E...cca98b.patch
>
> Aki
>
> On 24.10.2016 10:17, Aki Tuomi wrote:
> > Hi!
> >
> > Can you try these two patches?
> >
> > Aki
> >
> >
> > On 24.10.2016 08:48, Aki Tuomi wrote:
> >> Ok so that timeval makes no sense. We'll look into it.
> >>
> >> Aki
> >>
> >>> On October 24, 2016 at 12:22 AM Larry Rosenman <larryrtx at gmail.com>
> wrote:
> >>>
> >>>
> >>> doveadm(mrm): Debug: http-client: conn 127.0.0.1:9998 [1]: Got 200
> response
> >>> for request [Req38: PUT http://localhost:9998/tika/] (took 296 ms + 8
> ms in
> >>> queue)
> >>> doveadm(mrm): Panic: kevent(): Invalid argument
> >>>
> >>> Program received signal SIGABRT, Aborted.
> >>> 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7
> >>> (gdb) fr 6
> >>> #6  0x00000008011a3e49 in io_loop_handler_run_internal
> (ioloop=0x801c214e0)
> >>>     at ioloop-kqueue.c:131
> >>> 131 i_panic("kevent(): %m");
> >>> (gdb) p ts
> >>> $1 = {tv_sec = 34389923520, tv_nsec = 140737488345872000}
> >>> (gdb) p errno
> >>> $2 = 22
> >>> (gdb) p ret
> >>> $3 = -1
> >>> (gdb) p *ioloop
> >>> $4 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980,
> >>>   next_io_file = 0x0, timeouts = 0x801d17540, timeouts_new = {arr = {
> >>>       buffer = 0x801cd9700, element_size = 8}, v = 0x801cd9700,
> >>>     v_modifiable = 0x801cd9700}, handler_context = 0x801d17560,
> >>>   notify_handler_context = 0x0, max_fd_count = 0,
> >>>   time_moved_callback = 0x800d53bb0 <mail_storage_service_time_moved>,
> >>>   next_max_time = 1477257580, ioloop_wait_usecs = 27148,
> io_pending_count =
> >>> 1,
> >>>   running = 1, iolooping = 1}
> >>> (gdb) p* ctx
> >>> $5 = {kq = 21, deleted_count = 0, events = {arr = {buffer =
> 0x801cd9740,
> >>>       element_size = 32}, v = 0x801cd9740, v_modifiable = 0x801cd9740}}
> >>> (gdb) p *events
> >>> $6 = {ident = 22, filter = -1, flags = 0, fflags = 0, data = 8,
> >>>   udata = 0x801c4f980}
> >>> (gdb)
> >>>
> >>> thebighonker.lerctr.org ~ $ ps auxw|grep doveadm
> >>> mrm      46965   0.0  0.2   108516  55264  0  I+    4:19PM    0:02.28
> gdb
> >>> /usr/local/bin/doveadm (gdb7111)
> >>> mrm      46985   0.0  0.0    81236  15432  0  TX    4:19PM    0:03.51
> >>> /usr/local/bin/doveadm -D -vvvvvvv index *
> >>> ler      47221   0.0  0.0    18856   2360  1  S+    4:21PM    0:00.00
> grep
> >>> doveadm
> >>> thebighonker.lerctr.org ~ $ sudo lsof -p 46985
> >>> Password:
> >>> COMMAND   PID USER   FD     TYPE             DEVICE SIZE/OFF   NODE
> NAME
> >>> doveadm 46985  mrm  cwd     VDIR      22,2669215774      152      4
> >>> /home/mrm
> >>> doveadm 46985  mrm  rtd     VDIR       19,766509061       28      4 /
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129  1714125 182952
> >>> /usr/local/bin/doveadm
> >>> doveadm 46985  mrm  txt     VREG       19,766509061   132272  14382
> >>> /libexec/ld-elf.so.1
> >>> doveadm 46985  mrm  txt     VREG      22,2669215774     6920  10680
> >>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log
> >>> doveadm 46985  mrm  txt     VREG      22,2669215774     7224  10716
> >>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log
> >>> doveadm 46985  mrm  txt     VREG      22,2669215774    11080  10650
> >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log
> >>> doveadm 46985  mrm  txt     VREG      22,2669215774     2968  10679
> >>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache
> >>> doveadm 46985  mrm  txt     VREG      22,2669215774     3108  10715
> >>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache
> >>> doveadm 46985  mrm  txt     VREG      22,2669215774     6520 139902
> >>> /home/mrm/mail/.imap/Sent/dovecot.index.log
> >>> doveadm 46985  mrm  txt     VREG      22,2669215774     9236  10648
> >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache
> >>> doveadm 46985  mrm  txt     VREG      22,2669215774   174892 143343
> >>> /home/mrm/mail/.imap/Sent/dovecot.index.cache
> >>> doveadm 46985  mrm  txt     VREG      22,2669215774    32656 143058
> >>> /home/mrm/mail/.imap/INBOX/dovecot.index.log
> >>> doveadm 46985  mrm  txt     VREG       19,766509061      720  30627
> >>> /usr/share/i18n/csmapper/CP/CP1251%UCS.mps
> >>> doveadm 46985  mrm  txt     VREG       19,766509061      720  30630
> >>> /usr/share/i18n/csmapper/CP/CP1252%UCS.mps
> >>> doveadm 46985  mrm  txt     VREG       19,766509061    89576   6846
> >>> /lib/libz.so.6
> >>> doveadm 46985  mrm  txt     VREG       19,766509061    62008   5994
> >>> /lib/libcrypt.so.5
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129  6725689 183611
> >>> /usr/local/lib/dovecot/libdovecot-storage.so.0.0.0
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129  3162259 183615
> >>> /usr/local/lib/dovecot/libdovecot.so.0.0.0
> >>> doveadm 46985  mrm  txt     VREG       19,766509061  1649944   4782
> >>> /lib/libc.so.7
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129    80142 183550
> >>> /usr/local/lib/dovecot/lib15_notify_plugin.so
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129   652615 183556
> >>> /usr/local/lib/dovecot/lib20_fts_plugin.so
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129  2730888 268825
> >>> /usr/local/lib/libicui18n.so.57.1
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129  1753976 268849
> >>> /usr/local/lib/libicuuc.so.57.1
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129     1704 268821
> >>> /usr/local/lib/libicudata.so.57.1
> >>> doveadm 46985  mrm  txt     VREG       19,766509061   102560   6745
> >>> /lib/libthr.so.3
> >>> doveadm 46985  mrm  txt     VREG       19,766509061   184712   5795
> >>> /lib/libm.so.5
> >>> doveadm 46985  mrm  txt     VREG       19,766509061   774000   5642
> >>> /usr/lib/libc++.so.1
> >>> doveadm 46985  mrm  txt     VREG       19,766509061   103304   5742
> >>> /lib/libcxxrt.so.1
> >>> doveadm 46985  mrm  txt     VREG       19,766509061    56344   7436
> >>> /lib/libgcc_s.so.1
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129   349981 183782
> >>> /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129  1969384 113258
> >>> /usr/local/lib/libclucene-core.so.2.3.3.4
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129   128992 113261
> >>> /usr/local/lib/libclucene-shared.so.2.3.3.4
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129   143141 183578
> >>> /usr/local/lib/dovecot/lib90_stats_plugin.so
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129    37368 151926
> >>> /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129   693808 151924
> >>> /usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0.0.0
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129   146477 183599
> >>> /usr/local/lib/dovecot/libdovecot-lda.so.0.0.0
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129    13823 183780
> >>> /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so
> >>> doveadm 46985  mrm  txt     VREG     119,3584295129    88081 183527
> >>> /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so
> >>> doveadm 46985  mrm  txt     VREG       19,766509061     8304   6330
> >>> /usr/lib/i18n/libiconv_std.so.4
> >>> doveadm 46985  mrm  txt     VREG       19,766509061     6744   6318
> >>> /usr/lib/i18n/libUTF8.so.4
> >>> doveadm 46985  mrm  txt     VREG       19,766509061     4384   6336
> >>> /usr/lib/i18n/libmapper_none.so.4
> >>> doveadm 46985  mrm  txt     VREG       19,766509061     7584   6345
> >>> /usr/lib/i18n/libmapper_std.so.4
> >>> doveadm 46985  mrm    0u    VCHR              0,188 0t390889    188
> >>> /dev/pts/0
> >>> doveadm 46985  mrm    1u    VCHR              0,188 0t390889    188
> >>> /dev/pts/0
> >>> doveadm 46985  mrm    2u    VCHR              0,188 0t390889    188
> >>> /dev/pts/0
> >>> doveadm 46985  mrm    3u    PIPE 0xfffff806fdf505d0    16384
> >>>  ->0xfffff806fdf50730
> >>> doveadm 46985  mrm    4u    PIPE 0xfffff806fdf50730        0
> >>>  ->0xfffff806fdf505d0
> >>> doveadm 46985  mrm    5u  KQUEUE 0xfffff806350b0600
> >>> count=0, state=0
> >>> doveadm 46985  mrm    6w    FIFO      163,709754999      0t0  29707
> >>> /var/run/dovecot/stats-mail
> >>> doveadm 46985  mrm    7u    VREG      22,2669215774    11080  10650
> >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log
> >>> doveadm 46985  mrm    8u    VREG      22,2669215774      536 137895
> >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index
> >>> doveadm 46985  mrm    9u    VREG      22,2669215774     6920  10680
> >>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log
> >>> doveadm 46985  mrm   10u    VREG      22,2669215774     2968  10679
> >>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache
> >>> doveadm 46985  mrm   11u    VREG      22,2669215774     6520 139902
> >>> /home/mrm/mail/.imap/Sent/dovecot.index.log
> >>> doveadm 46985  mrm   12u    VREG      22,2669215774     9288 139905
> >>> /home/mrm/mail/.imap/Sent/dovecot.index
> >>> doveadm 46985  mrm   13u    VREG      22,2669215774     7224  10716
> >>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log
> >>> doveadm 46985  mrm   14u    VREG      22,2669215774     3108  10715
> >>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache
> >>> doveadm 46985  mrm   15u    VREG      22,2669215774     9236  10648
> >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache
> >>> doveadm 46985  mrm   16u    VREG      22,2669215774   174892 143343
> >>> /home/mrm/mail/.imap/Sent/dovecot.index.cache
> >>> doveadm 46985  mrm   17u    VREG      22,2669215774    32656 143058
> >>> /home/mrm/mail/.imap/INBOX/dovecot.index.log
> >>> doveadm 46985  mrm   18u    VREG      22,2669215774        0 135848
> >>> /home/mrm (zroot/home/mrm)
> >>> doveadm 46985  mrm   19u    VREG      22,2669215774    35656 135336
> >>> /home/mrm/mail/.imap/INBOX/dovecot.index
> >>> doveadm 46985  mrm   20u    VREG      22,2669215774        0 135849
> >>> /home/mrm (zroot/home/mrm)
> >>> doveadm 46985  mrm   21u  KQUEUE 0xfffff80163b1ba00
> >>> count=1, state=0
> >>> doveadm 46985  mrm   22u    IPv4 0xfffff805ea69a000      0t0    TCP
> >>> localhost:44730->localhost:9998 (ESTABLISHED)
> >>> doveadm 46985  mrm   25uR   VREG      22,2669215774 32997612   4151
> >>> /home/mrm/mail/Sent
> >>> thebighonker.lerctr.org
> >>>
> >>>
> >>>
> >>> On Sun, Oct 23, 2016 at 12:20 PM, Aki Tuomi <aki.tuomi at dovecot.fi>
> wrote:
> >>>
> >>>> According to man page, the only way it can return EINVAL (22) is
> either
> >>>> bad filter, or bad timeout. I can't see how the filter would be bad,
> so I'm
> >>>> guessing ts must be bad. Unfortunately I forgot to ask for it, so I am
> >>>> going to have to ask you run it again and run
> >>>>
> >>>> p ts
> >>>>
> >>>> if that's valid, then the only thing that can be bad if the file
> >>>> descriptor 23.
> >>>>
> >>>> Aki
> >>>>
> >>>>> On October 23, 2016 at 7:42 PM Larry Rosenman <larryrtx at gmail.com>
> >>>> wrote:
> >>>>> ok, gdb7 works:
> >>>>> (gdb) fr 6
> >>>>> #6  0x00000008011a3e49 in io_loop_handler_run_internal
> >>>> (ioloop=0x801c214e0)
> >>>>> at ioloop-kqueue.c:131
> >>>>> 131 i_panic("kevent(): %m");
> >>>>> (gdb) p errno
> >>>>> $1 = 22
> >>>>> (gdb) p ret
> >>>>> $2 = -1
> >>>>> (gdb) p *ioloop
> >>>>> $3 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980,
> >>>>> next_io_file = 0x0, timeouts = 0x801c19e60, timeouts_new = {arr =
> >>>> {buffer =
> >>>>> 0x801c5ac80, element_size = 8}, v = 0x801c5ac80,
> >>>>>     v_modifiable = 0x801c5ac80}, handler_context = 0x801c19e80,
> >>>>> notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback =
> >>>>> 0x800d53bb0 <mail_storage_service_time_moved>,
> >>>>>   next_max_time = 1477240784, ioloop_wait_usecs = 29863,
> >>>> io_pending_count =
> >>>>> 1, running = 1, iolooping = 1}
> >>>>> (gdb) p *ctx
> >>>>> $4 = {kq = 22, deleted_count = 0, events = {arr = {buffer =
> 0x801c5acc0,
> >>>>> element_size = 32}, v = 0x801c5acc0, v_modifiable = 0x801c5acc0}}
> >>>>> (gdb) p *events
> >>>>> $5 = {ident = 23, filter = -1, flags = 0, fflags = 0, data = 8,
> udata =
> >>>>> 0x801c4f980}
> >>>>> (gdb)
> >>>>>
> >>>>>
> >>>>>
> >>>>> On Sun, Oct 23, 2016 at 11:27 AM, Larry Rosenman <larryrtx at gmail.com
> >
> >>>> wrote:
> >>>>>> grrr.
> >>>>>>
> >>>>>> /home/mrm $ gdb /usr/local/bin/doveadm
> >>>>>> GNU gdb 6.1.1 [FreeBSD]
> >>>>>> Copyright 2004 Free Software Foundation, Inc.
> >>>>>> GDB is free software, covered by the GNU General Public License, and
> >>>> you
> >>>>>> are
> >>>>>> welcome to change it and/or distribute copies of it under certain
> >>>>>> conditions.
> >>>>>> Type "show copying" to see the conditions.
> >>>>>> There is absolutely no warranty for GDB.  Type "show warranty" for
> >>>> details.
> >>>>>> This GDB was configured as "amd64-marcel-freebsd"...
> >>>>>> (gdb) run -D -vvvvvv index *
> >>>>>> Starting program: /usr/local/bin/doveadm -D -vvvvvv index *
> >>>>>>
> >>>>>> Program received signal SIGTRAP, Trace/breakpoint trap.
> >>>>>> Cannot remove breakpoints because program is no longer writable.
> >>>>>> It might be running in another process.
> >>>>>> Further execution is probably impossible.
> >>>>>> 0x0000000800624490 in ?? ()
> >>>>>> (gdb)
> >>>>>>
> >>>>>> Ideas?
> >>>>>>
> >>>>>>
> >>>>>> On Sun, Oct 23, 2016 at 11:14 AM, Aki Tuomi <aki.tuomi at dovecot.fi>
> >>>> wrote:
> >>>>>>> Hi,
> >>>>>>>
> >>>>>>> can you run doveadm in gdb, wait for it to crash, and then go to
> >>>> frame 6
> >>>>>>> ( io_loop_handler_run_internal) and run
> >>>>>>>
> >>>>>>> p errno
> >>>>>>> p ret
> >>>>>>> p *ioloop
> >>>>>>> p *ctx
> >>>>>>> p *events
> >>>>>>>
> >>>>>>> Sorry but the crash doesn't make enough sense yet to me, we need to
> >>>>>>> determine what the invalid parameter is.
> >>>>>>>
> >>>>>>>> Larry Rosenman                     http://www.lerctr.org/~ler
> >>>>>>>> Phone: +1 214-642-9640 (c)     E-Mail: larryrtx at gmail.com
> >>>>>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
> >>>>>>
> >>>>>> --
> >>>>>> Larry Rosenman                     http://www.lerctr.org/~ler
> >>>>>> Phone: +1 214-642-9640 (c)     E-Mail: larryrtx at gmail.com
> >>>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
> >>>>>>
> >>>>>
> >>>>> --
> >>>>> Larry Rosenman                     http://www.lerctr.org/~ler
> >>>>> Phone: +1 214-642-9640 (c)     E-Mail: larryrtx at gmail.com
> >>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
> >>>
> >>> --
> >>> Larry Rosenman                     http://www.lerctr.org/~ler
> >>> Phone: +1 214-642-9640 (c)     E-Mail: larryrtx at gmail.com
> >>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
>



-- 
Larry Rosenman                     http://www.lerctr.org/~ler
Phone: +1 214-642-9640 (c)     E-Mail: larryrtx at gmail.com
US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281


More information about the dovecot mailing list