Re: keent() from Tika - with doveadm - dovecot

newer
Problem to configure...

Re: keent() from Tika - with doveadm

older
Break up massive INBOX?

Aki Tuomi

23 Oct 2016 23 Oct '16

7:14 p.m.

Hi,

can you run doveadm in gdb, wait for it to crash, and then go to frame 6 ( io_loop_handler_run_internal) and run

p errno p ret p *ioloop p *ctx p *events

Sorry but the crash doesn't make enough sense yet to me, we need to determine what the invalid parameter is.

...

Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

Show replies by date

Larry Rosenman

23 Oct 23 Oct

7:27 p.m.

New subject: keent() from Tika - with doveadm

grrr.

/home/mrm $ gdb /usr/local/bin/doveadm GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... (gdb) run -D -vvvvvv index * Starting program: /usr/local/bin/doveadm -D -vvvvvv index *

Program received signal SIGTRAP, Trace/breakpoint trap. Cannot remove breakpoints because program is no longer writable. It might be running in another process. Further execution is probably impossible. 0x0000000800624490 in ?? () (gdb)

Ideas?

On Sun, Oct 23, 2016 at 11:14 AM, Aki Tuomi aki.tuomi@dovecot.fi wrote:

...

Hi,

can you run doveadm in gdb, wait for it to crash, and then go to frame 6 ( io_loop_handler_run_internal) and run

p errno p ret p *ioloop p *ctx p *events

Sorry but the crash doesn't make enough sense yet to me, we need to determine what the invalid parameter is.

...
Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

Larry Rosenman

7:42 p.m.

New subject: keent() from Tika - with doveadm

ok, gdb7 works: (gdb) fr 6 #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) at ioloop-kqueue.c:131 131 i_panic("kevent(): %m"); (gdb) p errno $1 = 22 (gdb) p ret $2 = -1 (gdb) p *ioloop $3 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, next_io_file = 0x0, timeouts = 0x801c19e60, timeouts_new = {arr = {buffer = 0x801c5ac80, element_size = 8}, v = 0x801c5ac80, v_modifiable = 0x801c5ac80}, handler_context = 0x801c19e80, notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = 0x800d53bb0 , next_max_time = 1477240784, ioloop_wait_usecs = 29863, io_pending_count = 1, running = 1, iolooping = 1} (gdb) p *ctx $4 = {kq = 22, deleted_count = 0, events = {arr = {buffer = 0x801c5acc0, element_size = 32}, v = 0x801c5acc0, v_modifiable = 0x801c5acc0}} (gdb) p *events $5 = {ident = 23, filter = -1, flags = 0, fflags = 0, data = 8, udata = 0x801c4f980} (gdb)

On Sun, Oct 23, 2016 at 11:27 AM, Larry Rosenman larryrtx@gmail.com wrote:

...

grrr.

/home/mrm $ gdb /usr/local/bin/doveadm GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... (gdb) run -D -vvvvvv index * Starting program: /usr/local/bin/doveadm -D -vvvvvv index *

Program received signal SIGTRAP, Trace/breakpoint trap. Cannot remove breakpoints because program is no longer writable. It might be running in another process. Further execution is probably impossible. 0x0000000800624490 in ?? () (gdb)

Ideas?

On Sun, Oct 23, 2016 at 11:14 AM, Aki Tuomi aki.tuomi@dovecot.fi wrote:

...
Hi,

can you run doveadm in gdb, wait for it to crash, and then go to frame 6 ( io_loop_handler_run_internal) and run

p errno p ret p *ioloop p *ctx p *events

Sorry but the crash doesn't make enough sense yet to me, we need to determine what the invalid parameter is.

...
Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

Aki Tuomi

8:20 p.m.

New subject: keent() from Tika - with doveadm

According to man page, the only way it can return EINVAL (22) is either bad filter, or bad timeout. I can't see how the filter would be bad, so I'm guessing ts must be bad. Unfortunately I forgot to ask for it, so I am going to have to ask you run it again and run

p ts

if that's valid, then the only thing that can be bad if the file descriptor 23.

Aki

...

On October 23, 2016 at 7:42 PM Larry Rosenman larryrtx@gmail.com wrote:

ok, gdb7 works: (gdb) fr 6 #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) at ioloop-kqueue.c:131 131 i_panic("kevent(): %m"); (gdb) p errno $1 = 22 (gdb) p ret $2 = -1 (gdb) p *ioloop $3 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, next_io_file = 0x0, timeouts = 0x801c19e60, timeouts_new = {arr = {buffer = 0x801c5ac80, element_size = 8}, v = 0x801c5ac80, v_modifiable = 0x801c5ac80}, handler_context = 0x801c19e80, notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = 0x800d53bb0 , next_max_time = 1477240784, ioloop_wait_usecs = 29863, io_pending_count = 1, running = 1, iolooping = 1} (gdb) p *ctx $4 = {kq = 22, deleted_count = 0, events = {arr = {buffer = 0x801c5acc0, element_size = 32}, v = 0x801c5acc0, v_modifiable = 0x801c5acc0}} (gdb) p *events $5 = {ident = 23, filter = -1, flags = 0, fflags = 0, data = 8, udata = 0x801c4f980} (gdb)

On Sun, Oct 23, 2016 at 11:27 AM, Larry Rosenman larryrtx@gmail.com wrote:

...
grrr.

/home/mrm $ gdb /usr/local/bin/doveadm GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... (gdb) run -D -vvvvvv index * Starting program: /usr/local/bin/doveadm -D -vvvvvv index *

Program received signal SIGTRAP, Trace/breakpoint trap. Cannot remove breakpoints because program is no longer writable. It might be running in another process. Further execution is probably impossible. 0x0000000800624490 in ?? () (gdb)

Ideas?

On Sun, Oct 23, 2016 at 11:14 AM, Aki Tuomi aki.tuomi@dovecot.fi wrote:

...
Hi,

can you run doveadm in gdb, wait for it to crash, and then go to frame 6 ( io_loop_handler_run_internal) and run

p errno p ret p *ioloop p *ctx p *events

Sorry but the crash doesn't make enough sense yet to me, we need to determine what the invalid parameter is.

...
Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

Larry Rosenman

24 Oct 24 Oct

12:22 a.m.

New subject: keent() from Tika - with doveadm

doveadm(mrm): Debug: http-client: conn 127.0.0.1:9998 [1]: Got 200 response for request [Req38: PUT http://localhost:9998/tika/] (took 296 ms + 8 ms in queue) doveadm(mrm): Panic: kevent(): Invalid argument

Program received signal SIGABRT, Aborted. 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7 (gdb) fr 6 #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) at ioloop-kqueue.c:131 131 i_panic("kevent(): %m"); (gdb) p ts $1 = {tv_sec = 34389923520, tv_nsec = 140737488345872000} (gdb) p errno $2 = 22 (gdb) p ret $3 = -1 (gdb) p *ioloop $4 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, next_io_file = 0x0, timeouts = 0x801d17540, timeouts_new = {arr = { buffer = 0x801cd9700, element_size = 8}, v = 0x801cd9700, v_modifiable = 0x801cd9700}, handler_context = 0x801d17560, notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = 0x800d53bb0 , next_max_time = 1477257580, ioloop_wait_usecs = 27148, io_pending_count = 1, running = 1, iolooping = 1} (gdb) p* ctx $5 = {kq = 21, deleted_count = 0, events = {arr = {buffer = 0x801cd9740, element_size = 32}, v = 0x801cd9740, v_modifiable = 0x801cd9740}} (gdb) p *events $6 = {ident = 22, filter = -1, flags = 0, fflags = 0, data = 8, udata = 0x801c4f980} (gdb)

thebighonker.lerctr.org ~ $ ps auxw|grep doveadm mrm 46965 0.0 0.2 108516 55264 0 I+ 4:19PM 0:02.28 gdb /usr/local/bin/doveadm (gdb7111) mrm 46985 0.0 0.0 81236 15432 0 TX 4:19PM 0:03.51 /usr/local/bin/doveadm -D -vvvvvvv index * ler 47221 0.0 0.0 18856 2360 1 S+ 4:21PM 0:00.00 grep doveadm thebighonker.lerctr.org ~ $ sudo lsof -p 46985 Password: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME doveadm 46985 mrm cwd VDIR 22,2669215774 152 4 /home/mrm doveadm 46985 mrm rtd VDIR 19,766509061 28 4 / doveadm 46985 mrm txt VREG 119,3584295129 1714125 182952 /usr/local/bin/doveadm doveadm 46985 mrm txt VREG 19,766509061 132272 14382 /libexec/ld-elf.so.1 doveadm 46985 mrm txt VREG 22,2669215774 6920 10680 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 7224 10716 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 11080 10650 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 2968 10679 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 3108 10715 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 6520 139902 /home/mrm/mail/.imap/Sent/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 9236 10648 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 174892 143343 /home/mrm/mail/.imap/Sent/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 32656 143058 /home/mrm/mail/.imap/INBOX/dovecot.index.log doveadm 46985 mrm txt VREG 19,766509061 720 30627 /usr/share/i18n/csmapper/CP/CP1251%UCS.mps doveadm 46985 mrm txt VREG 19,766509061 720 30630 /usr/share/i18n/csmapper/CP/CP1252%UCS.mps doveadm 46985 mrm txt VREG 19,766509061 89576 6846 /lib/libz.so.6 doveadm 46985 mrm txt VREG 19,766509061 62008 5994 /lib/libcrypt.so.5 doveadm 46985 mrm txt VREG 119,3584295129 6725689 183611 /usr/local/lib/dovecot/libdovecot-storage.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 3162259 183615 /usr/local/lib/dovecot/libdovecot.so.0.0.0 doveadm 46985 mrm txt VREG 19,766509061 1649944 4782 /lib/libc.so.7 doveadm 46985 mrm txt VREG 119,3584295129 80142 183550 /usr/local/lib/dovecot/lib15_notify_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 652615 183556 /usr/local/lib/dovecot/lib20_fts_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 2730888 268825 /usr/local/lib/libicui18n.so.57.1 doveadm 46985 mrm txt VREG 119,3584295129 1753976 268849 /usr/local/lib/libicuuc.so.57.1 doveadm 46985 mrm txt VREG 119,3584295129 1704 268821 /usr/local/lib/libicudata.so.57.1 doveadm 46985 mrm txt VREG 19,766509061 102560 6745 /lib/libthr.so.3 doveadm 46985 mrm txt VREG 19,766509061 184712 5795 /lib/libm.so.5 doveadm 46985 mrm txt VREG 19,766509061 774000 5642 /usr/lib/libc++.so.1 doveadm 46985 mrm txt VREG 19,766509061 103304 5742 /lib/libcxxrt.so.1 doveadm 46985 mrm txt VREG 19,766509061 56344 7436 /lib/libgcc_s.so.1 doveadm 46985 mrm txt VREG 119,3584295129 349981 183782 /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 1969384 113258 /usr/local/lib/libclucene-core.so.2.3.3.4 doveadm 46985 mrm txt VREG 119,3584295129 128992 113261 /usr/local/lib/libclucene-shared.so.2.3.3.4 doveadm 46985 mrm txt VREG 119,3584295129 143141 183578 /usr/local/lib/dovecot/lib90_stats_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 37368 151926 /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 693808 151924 /usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 146477 183599 /usr/local/lib/dovecot/libdovecot-lda.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 13823 183780 /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 88081 183527 /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so doveadm 46985 mrm txt VREG 19,766509061 8304 6330 /usr/lib/i18n/libiconv_std.so.4 doveadm 46985 mrm txt VREG 19,766509061 6744 6318 /usr/lib/i18n/libUTF8.so.4 doveadm 46985 mrm txt VREG 19,766509061 4384 6336 /usr/lib/i18n/libmapper_none.so.4 doveadm 46985 mrm txt VREG 19,766509061 7584 6345 /usr/lib/i18n/libmapper_std.so.4 doveadm 46985 mrm 0u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 1u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 2u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 3u PIPE 0xfffff806fdf505d0 16384 ->0xfffff806fdf50730 doveadm 46985 mrm 4u PIPE 0xfffff806fdf50730 0 ->0xfffff806fdf505d0 doveadm 46985 mrm 5u KQUEUE 0xfffff806350b0600 count=0, state=0 doveadm 46985 mrm 6w FIFO 163,709754999 0t0 29707 /var/run/dovecot/stats-mail doveadm 46985 mrm 7u VREG 22,2669215774 11080 10650 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log doveadm 46985 mrm 8u VREG 22,2669215774 536 137895 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index doveadm 46985 mrm 9u VREG 22,2669215774 6920 10680 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log doveadm 46985 mrm 10u VREG 22,2669215774 2968 10679 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache doveadm 46985 mrm 11u VREG 22,2669215774 6520 139902 /home/mrm/mail/.imap/Sent/dovecot.index.log doveadm 46985 mrm 12u VREG 22,2669215774 9288 139905 /home/mrm/mail/.imap/Sent/dovecot.index doveadm 46985 mrm 13u VREG 22,2669215774 7224 10716 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log doveadm 46985 mrm 14u VREG 22,2669215774 3108 10715 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache doveadm 46985 mrm 15u VREG 22,2669215774 9236 10648 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache doveadm 46985 mrm 16u VREG 22,2669215774 174892 143343 /home/mrm/mail/.imap/Sent/dovecot.index.cache doveadm 46985 mrm 17u VREG 22,2669215774 32656 143058 /home/mrm/mail/.imap/INBOX/dovecot.index.log doveadm 46985 mrm 18u VREG 22,2669215774 0 135848 /home/mrm (zroot/home/mrm) doveadm 46985 mrm 19u VREG 22,2669215774 35656 135336 /home/mrm/mail/.imap/INBOX/dovecot.index doveadm 46985 mrm 20u VREG 22,2669215774 0 135849 /home/mrm (zroot/home/mrm) doveadm 46985 mrm 21u KQUEUE 0xfffff80163b1ba00 count=1, state=0 doveadm 46985 mrm 22u IPv4 0xfffff805ea69a000 0t0 TCP localhost:44730->localhost:9998 (ESTABLISHED) doveadm 46985 mrm 25uR VREG 22,2669215774 32997612 4151 /home/mrm/mail/Sent thebighonker.lerctr.org

On Sun, Oct 23, 2016 at 12:20 PM, Aki Tuomi aki.tuomi@dovecot.fi wrote:

...

According to man page, the only way it can return EINVAL (22) is either bad filter, or bad timeout. I can't see how the filter would be bad, so I'm guessing ts must be bad. Unfortunately I forgot to ask for it, so I am going to have to ask you run it again and run

p ts

if that's valid, then the only thing that can be bad if the file descriptor 23.

Aki

...
On October 23, 2016 at 7:42 PM Larry Rosenman larryrtx@gmail.com wrote:

ok, gdb7 works: (gdb) fr 6 #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) at ioloop-kqueue.c:131 131 i_panic("kevent(): %m"); (gdb) p errno $1 = 22 (gdb) p ret $2 = -1 (gdb) p *ioloop $3 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, next_io_file = 0x0, timeouts = 0x801c19e60, timeouts_new = {arr = {buffer = 0x801c5ac80, element_size = 8}, v = 0x801c5ac80, v_modifiable = 0x801c5ac80}, handler_context = 0x801c19e80, notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = 0x800d53bb0 , next_max_time = 1477240784, ioloop_wait_usecs = 29863, io_pending_count = 1, running = 1, iolooping = 1} (gdb) p *ctx $4 = {kq = 22, deleted_count = 0, events = {arr = {buffer = 0x801c5acc0, element_size = 32}, v = 0x801c5acc0, v_modifiable = 0x801c5acc0}} (gdb) p *events $5 = {ident = 23, filter = -1, flags = 0, fflags = 0, data = 8, udata = 0x801c4f980} (gdb)

On Sun, Oct 23, 2016 at 11:27 AM, Larry Rosenman larryrtx@gmail.com wrote:

...
grrr.

/home/mrm $ gdb /usr/local/bin/doveadm GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... (gdb) run -D -vvvvvv index * Starting program: /usr/local/bin/doveadm -D -vvvvvv index *

Program received signal SIGTRAP, Trace/breakpoint trap. Cannot remove breakpoints because program is no longer writable. It might be running in another process. Further execution is probably impossible. 0x0000000800624490 in ?? () (gdb)

Ideas?

On Sun, Oct 23, 2016 at 11:14 AM, Aki Tuomi aki.tuomi@dovecot.fi wrote:

...
Hi,

can you run doveadm in gdb, wait for it to crash, and then go to frame 6 ( io_loop_handler_run_internal) and run

p errno p ret p *ioloop p *ctx p *events

Sorry but the crash doesn't make enough sense yet to me, we need to determine what the invalid parameter is.

...
Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

Aki Tuomi

8:48 a.m.

New subject: keent() from Tika - with doveadm

Ok so that timeval makes no sense. We'll look into it.

Aki

...

On October 24, 2016 at 12:22 AM Larry Rosenman larryrtx@gmail.com wrote:

doveadm(mrm): Debug: http-client: conn 127.0.0.1:9998 [1]: Got 200 response for request [Req38: PUT http://localhost:9998/tika/] (took 296 ms + 8 ms in queue) doveadm(mrm): Panic: kevent(): Invalid argument

Program received signal SIGABRT, Aborted. 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7 (gdb) fr 6 #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) at ioloop-kqueue.c:131 131 i_panic("kevent(): %m"); (gdb) p ts $1 = {tv_sec = 34389923520, tv_nsec = 140737488345872000} (gdb) p errno $2 = 22 (gdb) p ret $3 = -1 (gdb) p *ioloop $4 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, next_io_file = 0x0, timeouts = 0x801d17540, timeouts_new = {arr = { buffer = 0x801cd9700, element_size = 8}, v = 0x801cd9700, v_modifiable = 0x801cd9700}, handler_context = 0x801d17560, notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = 0x800d53bb0 , next_max_time = 1477257580, ioloop_wait_usecs = 27148, io_pending_count = 1, running = 1, iolooping = 1} (gdb) p* ctx $5 = {kq = 21, deleted_count = 0, events = {arr = {buffer = 0x801cd9740, element_size = 32}, v = 0x801cd9740, v_modifiable = 0x801cd9740}} (gdb) p *events $6 = {ident = 22, filter = -1, flags = 0, fflags = 0, data = 8, udata = 0x801c4f980} (gdb)

thebighonker.lerctr.org ~ $ ps auxw|grep doveadm mrm 46965 0.0 0.2 108516 55264 0 I+ 4:19PM 0:02.28 gdb /usr/local/bin/doveadm (gdb7111) mrm 46985 0.0 0.0 81236 15432 0 TX 4:19PM 0:03.51 /usr/local/bin/doveadm -D -vvvvvvv index * ler 47221 0.0 0.0 18856 2360 1 S+ 4:21PM 0:00.00 grep doveadm thebighonker.lerctr.org ~ $ sudo lsof -p 46985 Password: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME doveadm 46985 mrm cwd VDIR 22,2669215774 152 4 /home/mrm doveadm 46985 mrm rtd VDIR 19,766509061 28 4 / doveadm 46985 mrm txt VREG 119,3584295129 1714125 182952 /usr/local/bin/doveadm doveadm 46985 mrm txt VREG 19,766509061 132272 14382 /libexec/ld-elf.so.1 doveadm 46985 mrm txt VREG 22,2669215774 6920 10680 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 7224 10716 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 11080 10650 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 2968 10679 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 3108 10715 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 6520 139902 /home/mrm/mail/.imap/Sent/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 9236 10648 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 174892 143343 /home/mrm/mail/.imap/Sent/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 32656 143058 /home/mrm/mail/.imap/INBOX/dovecot.index.log doveadm 46985 mrm txt VREG 19,766509061 720 30627 /usr/share/i18n/csmapper/CP/CP1251%UCS.mps doveadm 46985 mrm txt VREG 19,766509061 720 30630 /usr/share/i18n/csmapper/CP/CP1252%UCS.mps doveadm 46985 mrm txt VREG 19,766509061 89576 6846 /lib/libz.so.6 doveadm 46985 mrm txt VREG 19,766509061 62008 5994 /lib/libcrypt.so.5 doveadm 46985 mrm txt VREG 119,3584295129 6725689 183611 /usr/local/lib/dovecot/libdovecot-storage.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 3162259 183615 /usr/local/lib/dovecot/libdovecot.so.0.0.0 doveadm 46985 mrm txt VREG 19,766509061 1649944 4782 /lib/libc.so.7 doveadm 46985 mrm txt VREG 119,3584295129 80142 183550 /usr/local/lib/dovecot/lib15_notify_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 652615 183556 /usr/local/lib/dovecot/lib20_fts_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 2730888 268825 /usr/local/lib/libicui18n.so.57.1 doveadm 46985 mrm txt VREG 119,3584295129 1753976 268849 /usr/local/lib/libicuuc.so.57.1 doveadm 46985 mrm txt VREG 119,3584295129 1704 268821 /usr/local/lib/libicudata.so.57.1 doveadm 46985 mrm txt VREG 19,766509061 102560 6745 /lib/libthr.so.3 doveadm 46985 mrm txt VREG 19,766509061 184712 5795 /lib/libm.so.5 doveadm 46985 mrm txt VREG 19,766509061 774000 5642 /usr/lib/libc++.so.1 doveadm 46985 mrm txt VREG 19,766509061 103304 5742 /lib/libcxxrt.so.1 doveadm 46985 mrm txt VREG 19,766509061 56344 7436 /lib/libgcc_s.so.1 doveadm 46985 mrm txt VREG 119,3584295129 349981 183782 /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 1969384 113258 /usr/local/lib/libclucene-core.so.2.3.3.4 doveadm 46985 mrm txt VREG 119,3584295129 128992 113261 /usr/local/lib/libclucene-shared.so.2.3.3.4 doveadm 46985 mrm txt VREG 119,3584295129 143141 183578 /usr/local/lib/dovecot/lib90_stats_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 37368 151926 /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 693808 151924 /usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 146477 183599 /usr/local/lib/dovecot/libdovecot-lda.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 13823 183780 /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 88081 183527 /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so doveadm 46985 mrm txt VREG 19,766509061 8304 6330 /usr/lib/i18n/libiconv_std.so.4 doveadm 46985 mrm txt VREG 19,766509061 6744 6318 /usr/lib/i18n/libUTF8.so.4 doveadm 46985 mrm txt VREG 19,766509061 4384 6336 /usr/lib/i18n/libmapper_none.so.4 doveadm 46985 mrm txt VREG 19,766509061 7584 6345 /usr/lib/i18n/libmapper_std.so.4 doveadm 46985 mrm 0u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 1u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 2u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 3u PIPE 0xfffff806fdf505d0 16384 ->0xfffff806fdf50730 doveadm 46985 mrm 4u PIPE 0xfffff806fdf50730 0 ->0xfffff806fdf505d0 doveadm 46985 mrm 5u KQUEUE 0xfffff806350b0600 count=0, state=0 doveadm 46985 mrm 6w FIFO 163,709754999 0t0 29707 /var/run/dovecot/stats-mail doveadm 46985 mrm 7u VREG 22,2669215774 11080 10650 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log doveadm 46985 mrm 8u VREG 22,2669215774 536 137895 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index doveadm 46985 mrm 9u VREG 22,2669215774 6920 10680 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log doveadm 46985 mrm 10u VREG 22,2669215774 2968 10679 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache doveadm 46985 mrm 11u VREG 22,2669215774 6520 139902 /home/mrm/mail/.imap/Sent/dovecot.index.log doveadm 46985 mrm 12u VREG 22,2669215774 9288 139905 /home/mrm/mail/.imap/Sent/dovecot.index doveadm 46985 mrm 13u VREG 22,2669215774 7224 10716 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log doveadm 46985 mrm 14u VREG 22,2669215774 3108 10715 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache doveadm 46985 mrm 15u VREG 22,2669215774 9236 10648 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache doveadm 46985 mrm 16u VREG 22,2669215774 174892 143343 /home/mrm/mail/.imap/Sent/dovecot.index.cache doveadm 46985 mrm 17u VREG 22,2669215774 32656 143058 /home/mrm/mail/.imap/INBOX/dovecot.index.log doveadm 46985 mrm 18u VREG 22,2669215774 0 135848 /home/mrm (zroot/home/mrm) doveadm 46985 mrm 19u VREG 22,2669215774 35656 135336 /home/mrm/mail/.imap/INBOX/dovecot.index doveadm 46985 mrm 20u VREG 22,2669215774 0 135849 /home/mrm (zroot/home/mrm) doveadm 46985 mrm 21u KQUEUE 0xfffff80163b1ba00 count=1, state=0 doveadm 46985 mrm 22u IPv4 0xfffff805ea69a000 0t0 TCP localhost:44730->localhost:9998 (ESTABLISHED) doveadm 46985 mrm 25uR VREG 22,2669215774 32997612 4151 /home/mrm/mail/Sent thebighonker.lerctr.org

On Sun, Oct 23, 2016 at 12:20 PM, Aki Tuomi aki.tuomi@dovecot.fi wrote:

...
According to man page, the only way it can return EINVAL (22) is either bad filter, or bad timeout. I can't see how the filter would be bad, so I'm guessing ts must be bad. Unfortunately I forgot to ask for it, so I am going to have to ask you run it again and run

p ts

if that's valid, then the only thing that can be bad if the file descriptor 23.

Aki

...
On October 23, 2016 at 7:42 PM Larry Rosenman larryrtx@gmail.com wrote:

ok, gdb7 works: (gdb) fr 6 #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) at ioloop-kqueue.c:131 131 i_panic("kevent(): %m"); (gdb) p errno $1 = 22 (gdb) p ret $2 = -1 (gdb) p *ioloop $3 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, next_io_file = 0x0, timeouts = 0x801c19e60, timeouts_new = {arr = {buffer = 0x801c5ac80, element_size = 8}, v = 0x801c5ac80, v_modifiable = 0x801c5ac80}, handler_context = 0x801c19e80, notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = 0x800d53bb0 , next_max_time = 1477240784, ioloop_wait_usecs = 29863, io_pending_count = 1, running = 1, iolooping = 1} (gdb) p *ctx $4 = {kq = 22, deleted_count = 0, events = {arr = {buffer = 0x801c5acc0, element_size = 32}, v = 0x801c5acc0, v_modifiable = 0x801c5acc0}} (gdb) p *events $5 = {ident = 23, filter = -1, flags = 0, fflags = 0, data = 8, udata = 0x801c4f980} (gdb)

On Sun, Oct 23, 2016 at 11:27 AM, Larry Rosenman larryrtx@gmail.com wrote:

...
grrr.

/home/mrm $ gdb /usr/local/bin/doveadm GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... (gdb) run -D -vvvvvv index * Starting program: /usr/local/bin/doveadm -D -vvvvvv index *

Program received signal SIGTRAP, Trace/breakpoint trap. Cannot remove breakpoints because program is no longer writable. It might be running in another process. Further execution is probably impossible. 0x0000000800624490 in ?? () (gdb)

Ideas?

On Sun, Oct 23, 2016 at 11:14 AM, Aki Tuomi aki.tuomi@dovecot.fi wrote:

...
Hi,

can you run doveadm in gdb, wait for it to crash, and then go to frame 6 ( io_loop_handler_run_internal) and run

p errno p ret p *ioloop p *ctx p *events

Sorry but the crash doesn't make enough sense yet to me, we need to determine what the invalid parameter is.

...
Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

Aki Tuomi

10:17 a.m.

New subject: keent() from Tika - with doveadm

Hi!

Can you try these two patches?

Aki

On 24.10.2016 08:48, Aki Tuomi wrote:

...

Ok so that timeval makes no sense. We'll look into it.

Aki

...
On October 24, 2016 at 12:22 AM Larry Rosenman larryrtx@gmail.com wrote:

doveadm(mrm): Debug: http-client: conn 127.0.0.1:9998 [1]: Got 200 response for request [Req38: PUT http://localhost:9998/tika/] (took 296 ms + 8 ms in queue) doveadm(mrm): Panic: kevent(): Invalid argument

Program received signal SIGABRT, Aborted. 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7 (gdb) fr 6 #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) at ioloop-kqueue.c:131 131 i_panic("kevent(): %m"); (gdb) p ts $1 = {tv_sec = 34389923520, tv_nsec = 140737488345872000} (gdb) p errno $2 = 22 (gdb) p ret $3 = -1 (gdb) p *ioloop $4 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, next_io_file = 0x0, timeouts = 0x801d17540, timeouts_new = {arr = { buffer = 0x801cd9700, element_size = 8}, v = 0x801cd9700, v_modifiable = 0x801cd9700}, handler_context = 0x801d17560, notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = 0x800d53bb0 , next_max_time = 1477257580, ioloop_wait_usecs = 27148, io_pending_count = 1, running = 1, iolooping = 1} (gdb) p* ctx $5 = {kq = 21, deleted_count = 0, events = {arr = {buffer = 0x801cd9740, element_size = 32}, v = 0x801cd9740, v_modifiable = 0x801cd9740}} (gdb) p *events $6 = {ident = 22, filter = -1, flags = 0, fflags = 0, data = 8, udata = 0x801c4f980} (gdb)

thebighonker.lerctr.org ~ $ ps auxw|grep doveadm mrm 46965 0.0 0.2 108516 55264 0 I+ 4:19PM 0:02.28 gdb /usr/local/bin/doveadm (gdb7111) mrm 46985 0.0 0.0 81236 15432 0 TX 4:19PM 0:03.51 /usr/local/bin/doveadm -D -vvvvvvv index * ler 47221 0.0 0.0 18856 2360 1 S+ 4:21PM 0:00.00 grep doveadm thebighonker.lerctr.org ~ $ sudo lsof -p 46985 Password: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME doveadm 46985 mrm cwd VDIR 22,2669215774 152 4 /home/mrm doveadm 46985 mrm rtd VDIR 19,766509061 28 4 / doveadm 46985 mrm txt VREG 119,3584295129 1714125 182952 /usr/local/bin/doveadm doveadm 46985 mrm txt VREG 19,766509061 132272 14382 /libexec/ld-elf.so.1 doveadm 46985 mrm txt VREG 22,2669215774 6920 10680 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 7224 10716 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 11080 10650 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 2968 10679 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 3108 10715 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 6520 139902 /home/mrm/mail/.imap/Sent/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 9236 10648 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 174892 143343 /home/mrm/mail/.imap/Sent/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 32656 143058 /home/mrm/mail/.imap/INBOX/dovecot.index.log doveadm 46985 mrm txt VREG 19,766509061 720 30627 /usr/share/i18n/csmapper/CP/CP1251%UCS.mps doveadm 46985 mrm txt VREG 19,766509061 720 30630 /usr/share/i18n/csmapper/CP/CP1252%UCS.mps doveadm 46985 mrm txt VREG 19,766509061 89576 6846 /lib/libz.so.6 doveadm 46985 mrm txt VREG 19,766509061 62008 5994 /lib/libcrypt.so.5 doveadm 46985 mrm txt VREG 119,3584295129 6725689 183611 /usr/local/lib/dovecot/libdovecot-storage.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 3162259 183615 /usr/local/lib/dovecot/libdovecot.so.0.0.0 doveadm 46985 mrm txt VREG 19,766509061 1649944 4782 /lib/libc.so.7 doveadm 46985 mrm txt VREG 119,3584295129 80142 183550 /usr/local/lib/dovecot/lib15_notify_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 652615 183556 /usr/local/lib/dovecot/lib20_fts_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 2730888 268825 /usr/local/lib/libicui18n.so.57.1 doveadm 46985 mrm txt VREG 119,3584295129 1753976 268849 /usr/local/lib/libicuuc.so.57.1 doveadm 46985 mrm txt VREG 119,3584295129 1704 268821 /usr/local/lib/libicudata.so.57.1 doveadm 46985 mrm txt VREG 19,766509061 102560 6745 /lib/libthr.so.3 doveadm 46985 mrm txt VREG 19,766509061 184712 5795 /lib/libm.so.5 doveadm 46985 mrm txt VREG 19,766509061 774000 5642 /usr/lib/libc++.so.1 doveadm 46985 mrm txt VREG 19,766509061 103304 5742 /lib/libcxxrt.so.1 doveadm 46985 mrm txt VREG 19,766509061 56344 7436 /lib/libgcc_s.so.1 doveadm 46985 mrm txt VREG 119,3584295129 349981 183782 /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 1969384 113258 /usr/local/lib/libclucene-core.so.2.3.3.4 doveadm 46985 mrm txt VREG 119,3584295129 128992 113261 /usr/local/lib/libclucene-shared.so.2.3.3.4 doveadm 46985 mrm txt VREG 119,3584295129 143141 183578 /usr/local/lib/dovecot/lib90_stats_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 37368 151926 /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 693808 151924 /usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 146477 183599 /usr/local/lib/dovecot/libdovecot-lda.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 13823 183780 /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 88081 183527 /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so doveadm 46985 mrm txt VREG 19,766509061 8304 6330 /usr/lib/i18n/libiconv_std.so.4 doveadm 46985 mrm txt VREG 19,766509061 6744 6318 /usr/lib/i18n/libUTF8.so.4 doveadm 46985 mrm txt VREG 19,766509061 4384 6336 /usr/lib/i18n/libmapper_none.so.4 doveadm 46985 mrm txt VREG 19,766509061 7584 6345 /usr/lib/i18n/libmapper_std.so.4 doveadm 46985 mrm 0u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 1u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 2u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 3u PIPE 0xfffff806fdf505d0 16384 ->0xfffff806fdf50730 doveadm 46985 mrm 4u PIPE 0xfffff806fdf50730 0 ->0xfffff806fdf505d0 doveadm 46985 mrm 5u KQUEUE 0xfffff806350b0600 count=0, state=0 doveadm 46985 mrm 6w FIFO 163,709754999 0t0 29707 /var/run/dovecot/stats-mail doveadm 46985 mrm 7u VREG 22,2669215774 11080 10650 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log doveadm 46985 mrm 8u VREG 22,2669215774 536 137895 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index doveadm 46985 mrm 9u VREG 22,2669215774 6920 10680 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log doveadm 46985 mrm 10u VREG 22,2669215774 2968 10679 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache doveadm 46985 mrm 11u VREG 22,2669215774 6520 139902 /home/mrm/mail/.imap/Sent/dovecot.index.log doveadm 46985 mrm 12u VREG 22,2669215774 9288 139905 /home/mrm/mail/.imap/Sent/dovecot.index doveadm 46985 mrm 13u VREG 22,2669215774 7224 10716 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log doveadm 46985 mrm 14u VREG 22,2669215774 3108 10715 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache doveadm 46985 mrm 15u VREG 22,2669215774 9236 10648 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache doveadm 46985 mrm 16u VREG 22,2669215774 174892 143343 /home/mrm/mail/.imap/Sent/dovecot.index.cache doveadm 46985 mrm 17u VREG 22,2669215774 32656 143058 /home/mrm/mail/.imap/INBOX/dovecot.index.log doveadm 46985 mrm 18u VREG 22,2669215774 0 135848 /home/mrm (zroot/home/mrm) doveadm 46985 mrm 19u VREG 22,2669215774 35656 135336 /home/mrm/mail/.imap/INBOX/dovecot.index doveadm 46985 mrm 20u VREG 22,2669215774 0 135849 /home/mrm (zroot/home/mrm) doveadm 46985 mrm 21u KQUEUE 0xfffff80163b1ba00 count=1, state=0 doveadm 46985 mrm 22u IPv4 0xfffff805ea69a000 0t0 TCP localhost:44730->localhost:9998 (ESTABLISHED) doveadm 46985 mrm 25uR VREG 22,2669215774 32997612 4151 /home/mrm/mail/Sent thebighonker.lerctr.org

On Sun, Oct 23, 2016 at 12:20 PM, Aki Tuomi aki.tuomi@dovecot.fi wrote:

...
According to man page, the only way it can return EINVAL (22) is either bad filter, or bad timeout. I can't see how the filter would be bad, so I'm guessing ts must be bad. Unfortunately I forgot to ask for it, so I am going to have to ask you run it again and run

p ts

if that's valid, then the only thing that can be bad if the file descriptor 23.

Aki

...
On October 23, 2016 at 7:42 PM Larry Rosenman larryrtx@gmail.com wrote:

ok, gdb7 works: (gdb) fr 6 #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) at ioloop-kqueue.c:131 131 i_panic("kevent(): %m"); (gdb) p errno $1 = 22 (gdb) p ret $2 = -1 (gdb) p *ioloop $3 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, next_io_file = 0x0, timeouts = 0x801c19e60, timeouts_new = {arr = {buffer = 0x801c5ac80, element_size = 8}, v = 0x801c5ac80, v_modifiable = 0x801c5ac80}, handler_context = 0x801c19e80, notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = 0x800d53bb0 , next_max_time = 1477240784, ioloop_wait_usecs = 29863, io_pending_count = 1, running = 1, iolooping = 1} (gdb) p *ctx $4 = {kq = 22, deleted_count = 0, events = {arr = {buffer = 0x801c5acc0, element_size = 32}, v = 0x801c5acc0, v_modifiable = 0x801c5acc0}} (gdb) p *events $5 = {ident = 23, filter = -1, flags = 0, fflags = 0, data = 8, udata = 0x801c4f980} (gdb)

...
grrr.

/home/mrm $ gdb /usr/local/bin/doveadm GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for

...
This GDB was configured as "amd64-marcel-freebsd"... (gdb) run -D -vvvvvv index * Starting program: /usr/local/bin/doveadm -D -vvvvvv index *

Program received signal SIGTRAP, Trace/breakpoint trap. Cannot remove breakpoints because program is no longer writable. It might be running in another process. Further execution is probably impossible. 0x0000000800624490 in ?? () (gdb)

Ideas?

On Sun, Oct 23, 2016 at 11:14 AM, Aki Tuomi aki.tuomi@dovecot.fi wrote:

...
Hi,

can you run doveadm in gdb, wait for it to crash, and then go to

On Sun, Oct 23, 2016 at 11:27 AM, Larry Rosenman larryrtx@gmail.com wrote: details. frame 6

...
...
( io_loop_handler_run_internal) and run

p errno p ret p *ioloop p *ctx p *events

Sorry but the crash doesn't make enough sense yet to me, we need to determine what the invalid parameter is.

> Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com > US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

Aki Tuomi

12:34 p.m.

New subject: keent() from Tika - with doveadm

Hi!

We found some problems with those patches, and ended up doing slightly different fix:

https://github.com/dovecot/core/compare/3e41b3d%5E...cca98b.patch

Aki

On 24.10.2016 10:17, Aki Tuomi wrote:

...

Hi!

Can you try these two patches?

Aki

On 24.10.2016 08:48, Aki Tuomi wrote:

...
Ok so that timeval makes no sense. We'll look into it.

Aki

...
On October 24, 2016 at 12:22 AM Larry Rosenman larryrtx@gmail.com wrote:

doveadm(mrm): Debug: http-client: conn 127.0.0.1:9998 [1]: Got 200 response for request [Req38: PUT http://localhost:9998/tika/] (took 296 ms + 8 ms in queue) doveadm(mrm): Panic: kevent(): Invalid argument

Program received signal SIGABRT, Aborted. 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7 (gdb) fr 6 #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) at ioloop-kqueue.c:131 131 i_panic("kevent(): %m"); (gdb) p ts $1 = {tv_sec = 34389923520, tv_nsec = 140737488345872000} (gdb) p errno $2 = 22 (gdb) p ret $3 = -1 (gdb) p *ioloop $4 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, next_io_file = 0x0, timeouts = 0x801d17540, timeouts_new = {arr = { buffer = 0x801cd9700, element_size = 8}, v = 0x801cd9700, v_modifiable = 0x801cd9700}, handler_context = 0x801d17560, notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = 0x800d53bb0 , next_max_time = 1477257580, ioloop_wait_usecs = 27148, io_pending_count = 1, running = 1, iolooping = 1} (gdb) p* ctx $5 = {kq = 21, deleted_count = 0, events = {arr = {buffer = 0x801cd9740, element_size = 32}, v = 0x801cd9740, v_modifiable = 0x801cd9740}} (gdb) p *events $6 = {ident = 22, filter = -1, flags = 0, fflags = 0, data = 8, udata = 0x801c4f980} (gdb)

thebighonker.lerctr.org ~ $ ps auxw|grep doveadm mrm 46965 0.0 0.2 108516 55264 0 I+ 4:19PM 0:02.28 gdb /usr/local/bin/doveadm (gdb7111) mrm 46985 0.0 0.0 81236 15432 0 TX 4:19PM 0:03.51 /usr/local/bin/doveadm -D -vvvvvvv index * ler 47221 0.0 0.0 18856 2360 1 S+ 4:21PM 0:00.00 grep doveadm thebighonker.lerctr.org ~ $ sudo lsof -p 46985 Password: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME doveadm 46985 mrm cwd VDIR 22,2669215774 152 4 /home/mrm doveadm 46985 mrm rtd VDIR 19,766509061 28 4 / doveadm 46985 mrm txt VREG 119,3584295129 1714125 182952 /usr/local/bin/doveadm doveadm 46985 mrm txt VREG 19,766509061 132272 14382 /libexec/ld-elf.so.1 doveadm 46985 mrm txt VREG 22,2669215774 6920 10680 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 7224 10716 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 11080 10650 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 2968 10679 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 3108 10715 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 6520 139902 /home/mrm/mail/.imap/Sent/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 9236 10648 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 174892 143343 /home/mrm/mail/.imap/Sent/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 32656 143058 /home/mrm/mail/.imap/INBOX/dovecot.index.log doveadm 46985 mrm txt VREG 19,766509061 720 30627 /usr/share/i18n/csmapper/CP/CP1251%UCS.mps doveadm 46985 mrm txt VREG 19,766509061 720 30630 /usr/share/i18n/csmapper/CP/CP1252%UCS.mps doveadm 46985 mrm txt VREG 19,766509061 89576 6846 /lib/libz.so.6 doveadm 46985 mrm txt VREG 19,766509061 62008 5994 /lib/libcrypt.so.5 doveadm 46985 mrm txt VREG 119,3584295129 6725689 183611 /usr/local/lib/dovecot/libdovecot-storage.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 3162259 183615 /usr/local/lib/dovecot/libdovecot.so.0.0.0 doveadm 46985 mrm txt VREG 19,766509061 1649944 4782 /lib/libc.so.7 doveadm 46985 mrm txt VREG 119,3584295129 80142 183550 /usr/local/lib/dovecot/lib15_notify_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 652615 183556 /usr/local/lib/dovecot/lib20_fts_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 2730888 268825 /usr/local/lib/libicui18n.so.57.1 doveadm 46985 mrm txt VREG 119,3584295129 1753976 268849 /usr/local/lib/libicuuc.so.57.1 doveadm 46985 mrm txt VREG 119,3584295129 1704 268821 /usr/local/lib/libicudata.so.57.1 doveadm 46985 mrm txt VREG 19,766509061 102560 6745 /lib/libthr.so.3 doveadm 46985 mrm txt VREG 19,766509061 184712 5795 /lib/libm.so.5 doveadm 46985 mrm txt VREG 19,766509061 774000 5642 /usr/lib/libc++.so.1 doveadm 46985 mrm txt VREG 19,766509061 103304 5742 /lib/libcxxrt.so.1 doveadm 46985 mrm txt VREG 19,766509061 56344 7436 /lib/libgcc_s.so.1 doveadm 46985 mrm txt VREG 119,3584295129 349981 183782 /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 1969384 113258 /usr/local/lib/libclucene-core.so.2.3.3.4 doveadm 46985 mrm txt VREG 119,3584295129 128992 113261 /usr/local/lib/libclucene-shared.so.2.3.3.4 doveadm 46985 mrm txt VREG 119,3584295129 143141 183578 /usr/local/lib/dovecot/lib90_stats_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 37368 151926 /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 693808 151924 /usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 146477 183599 /usr/local/lib/dovecot/libdovecot-lda.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 13823 183780 /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 88081 183527 /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so doveadm 46985 mrm txt VREG 19,766509061 8304 6330 /usr/lib/i18n/libiconv_std.so.4 doveadm 46985 mrm txt VREG 19,766509061 6744 6318 /usr/lib/i18n/libUTF8.so.4 doveadm 46985 mrm txt VREG 19,766509061 4384 6336 /usr/lib/i18n/libmapper_none.so.4 doveadm 46985 mrm txt VREG 19,766509061 7584 6345 /usr/lib/i18n/libmapper_std.so.4 doveadm 46985 mrm 0u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 1u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 2u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 3u PIPE 0xfffff806fdf505d0 16384 ->0xfffff806fdf50730 doveadm 46985 mrm 4u PIPE 0xfffff806fdf50730 0 ->0xfffff806fdf505d0 doveadm 46985 mrm 5u KQUEUE 0xfffff806350b0600 count=0, state=0 doveadm 46985 mrm 6w FIFO 163,709754999 0t0 29707 /var/run/dovecot/stats-mail doveadm 46985 mrm 7u VREG 22,2669215774 11080 10650 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log doveadm 46985 mrm 8u VREG 22,2669215774 536 137895 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index doveadm 46985 mrm 9u VREG 22,2669215774 6920 10680 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log doveadm 46985 mrm 10u VREG 22,2669215774 2968 10679 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache doveadm 46985 mrm 11u VREG 22,2669215774 6520 139902 /home/mrm/mail/.imap/Sent/dovecot.index.log doveadm 46985 mrm 12u VREG 22,2669215774 9288 139905 /home/mrm/mail/.imap/Sent/dovecot.index doveadm 46985 mrm 13u VREG 22,2669215774 7224 10716 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log doveadm 46985 mrm 14u VREG 22,2669215774 3108 10715 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache doveadm 46985 mrm 15u VREG 22,2669215774 9236 10648 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache doveadm 46985 mrm 16u VREG 22,2669215774 174892 143343 /home/mrm/mail/.imap/Sent/dovecot.index.cache doveadm 46985 mrm 17u VREG 22,2669215774 32656 143058 /home/mrm/mail/.imap/INBOX/dovecot.index.log doveadm 46985 mrm 18u VREG 22,2669215774 0 135848 /home/mrm (zroot/home/mrm) doveadm 46985 mrm 19u VREG 22,2669215774 35656 135336 /home/mrm/mail/.imap/INBOX/dovecot.index doveadm 46985 mrm 20u VREG 22,2669215774 0 135849 /home/mrm (zroot/home/mrm) doveadm 46985 mrm 21u KQUEUE 0xfffff80163b1ba00 count=1, state=0 doveadm 46985 mrm 22u IPv4 0xfffff805ea69a000 0t0 TCP localhost:44730->localhost:9998 (ESTABLISHED) doveadm 46985 mrm 25uR VREG 22,2669215774 32997612 4151 /home/mrm/mail/Sent thebighonker.lerctr.org

On Sun, Oct 23, 2016 at 12:20 PM, Aki Tuomi aki.tuomi@dovecot.fi wrote:

...
According to man page, the only way it can return EINVAL (22) is either bad filter, or bad timeout. I can't see how the filter would be bad, so I'm guessing ts must be bad. Unfortunately I forgot to ask for it, so I am going to have to ask you run it again and run

p ts

if that's valid, then the only thing that can be bad if the file descriptor 23.

Aki

...
On October 23, 2016 at 7:42 PM Larry Rosenman larryrtx@gmail.com wrote: ok, gdb7 works: (gdb) fr 6 #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) at ioloop-kqueue.c:131 131 i_panic("kevent(): %m"); (gdb) p errno $1 = 22 (gdb) p ret $2 = -1 (gdb) p *ioloop $3 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, next_io_file = 0x0, timeouts = 0x801c19e60, timeouts_new = {arr = {buffer = 0x801c5ac80, element_size = 8}, v = 0x801c5ac80, v_modifiable = 0x801c5ac80}, handler_context = 0x801c19e80, notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = 0x800d53bb0 , next_max_time = 1477240784, ioloop_wait_usecs = 29863, io_pending_count = 1, running = 1, iolooping = 1} (gdb) p *ctx $4 = {kq = 22, deleted_count = 0, events = {arr = {buffer = 0x801c5acc0, element_size = 32}, v = 0x801c5acc0, v_modifiable = 0x801c5acc0}} (gdb) p *events $5 = {ident = 23, filter = -1, flags = 0, fflags = 0, data = 8, udata = 0x801c4f980} (gdb)

...
grrr.

/home/mrm $ gdb /usr/local/bin/doveadm GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for

...
This GDB was configured as "amd64-marcel-freebsd"... (gdb) run -D -vvvvvv index * Starting program: /usr/local/bin/doveadm -D -vvvvvv index *

Program received signal SIGTRAP, Trace/breakpoint trap. Cannot remove breakpoints because program is no longer writable. It might be running in another process. Further execution is probably impossible. 0x0000000800624490 in ?? () (gdb)

Ideas?

On Sun, Oct 23, 2016 at 11:14 AM, Aki Tuomi aki.tuomi@dovecot.fi wrote: > Hi, > > can you run doveadm in gdb, wait for it to crash, and then go to

On Sun, Oct 23, 2016 at 11:27 AM, Larry Rosenman larryrtx@gmail.com wrote: details. frame 6

...
> ( io_loop_handler_run_internal) and run > > p errno > p ret > p *ioloop > p *ctx > p *events > > Sorry but the crash doesn't make enough sense yet to me, we need to > determine what the invalid parameter is. > >> Larry Rosenman http://www.lerctr.org/~ler >> Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com >> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

Larry Rosenman

5:21 p.m.

New subject: keent() from Tika - with doveadm

that seems to fix this kevent() problem, but I got the following lucene assert. Is that because of previous fails?

Also, while I have your attention, is fts_autoindex supposed to work accross NAMESPACES?

doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39483 because: fts indexing doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39484 because: fts indexing doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39485 because: fts indexing doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39486 because: fts indexing Assertion failed: (numDocsInStore*8 == directory->fileLength( (docStoreSegment + "." + IndexFileNames::FIELDS_INDEX_EXTENSION).c_str() )), function closeDocStore, file src/core/CLucene/index/DocumentsWriter.cpp, line 210.

Program received signal SIGABRT, Aborted. 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7 (gdb) bt full #0 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7 No symbol table info available. #1 0x00000008014e6f66 in raise () from /lib/libc.so.7 No symbol table info available. #2 0x00000008014e6ee9 in abort () from /lib/libc.so.7 No symbol table info available. #3 0x000000080154dee1 in __assert () from /lib/libc.so.7 No symbol table info available. #4 0x0000000803ea1762 in lucene::index::DocumentsWriter::closeDocStore() () from /usr/local/lib/libclucene-core.so.1 No symbol table info available. #5 0x0000000803ea3d89 in lucene::index::DocumentsWriter::flush(bool) () from /usr/local/lib/libclucene-core.so.1 No symbol table info available. #6 0x0000000803ed26bb in lucene::index::IndexWriter::doFlush(bool) () from /usr/local/lib/libclucene-core.so.1 No symbol table info available. #7 0x0000000803ece25e in lucene::index::IndexWriter::flush(bool, bool) () from /usr/local/lib/libclucene-core.so.1 No symbol table info available. #8 0x0000000803ececbe in lucene::index::IndexWriter::addDocument(lucene::document::Document*, lucene::analysis::Analyzer*) () from /usr/local/lib/libclucene-core.so.1 No symbol table info available. ---Type <return> to continue, or q <return> to quit--- #9 0x0000000803b8cd55 in lucene_index_build_flush (index=0x801c1b640) at lucene-wrapper.cc:552 analyzer = 0x801c251c0 ret = 0 err = @0x801cd90d0: { _awhat = 0x801cd9108 "Return-Path: =mrm= lerctr.org@gmail.com>\nDelivered-To: mrm@lerctr.org\n", _twhat = 0x58 , error_number = 30249224} #10 0x0000000803b8c42e in lucene_index_build_more (index=0x801c1b640, uid=39486, part_idx=0, data=0x806041000 "=mrm=lerctr.org@gmail.com>", size=45, hdr_name=0x801c1a520 "Return-Path") at lucene-wrapper.cc:572 id = L"\x1cc8c40\b\xffffd970\x7fff\xffffd960\x7fff\x1190eba\b\x1cc0c00\b\x1191739\b\x1cc8c40\b\x1190eba\b\xffffd990\x7fff-\000\000\001-" namesize = 34378158489 datasize = 140737488345424 dest = 0x801190eba L"\x45880124\xff458aff\xb60f0124\xc48348c0\xfc35d10\x4855001f\x8348e589\x8d4840ec\x8948e075\x8b48f07d\x8b48f07d\x8948107f\x8b48e87d\x8b48e87d\x140bf\x458b4800\x888b48e8\510\x48f92948\x1488889\x8b480000\xc748e845\x14080" dest_free = 0x7fffffffd920 L"\xffffd950\x7fff\x1191199\b\x1cc8c40\b\xffffd970\x7fff\xffffd960\x7fff\x1190eba\b\x1cc0c00\b\x1191739\b\x1cc8c40\b\x1190eba\b\xffffd990\x7fff-" ---Type <return> to continue, or q <return> to quit--- token_flag = 0 #11 0x0000000803b8a420 in fts_backend_lucene_update_build_more ( _ctx=0x801c21240, data=0x806041000 "=mrm=lerctr.org@gmail.com>", size=45) at fts-backend-lucene.c:432 _data_stack_cur_id = 6 ctx = 0x801c21240 backend = 0x801c3a200 ret = 8 #12 0x000000080220e035 in fts_backend_update_build_more (ctx=0x801c21240, data=0x806041000 "=mrm=lerctr.org@gmail.com>", size=45) at fts-api.c:193 No locals. #13 0x000000080221015b in fts_build_full_words (ctx=0x7fffffffdc98, data=0x806041000 "m.ray.mullins+caf_=mrm=lerctr.org@gmail.com", size=45, last=true) at fts-build-mail.c:402 i = 45 #14 0x000000080220fd45 in fts_build_data (ctx=0x7fffffffdc98, data=0x806041000 "m.ray.mullins+caf_=mrm=lerctr.org@gmail.com", size=45, last=true) at fts-build-mail.c:423 No locals. #15 0x000000080221067d in fts_build_unstructured_header (ctx=0x7fffffffdc98, hdr=0x801ccf118) at fts-build-mail.c:104 data = 0x806041000 "m.ray.mullins+caf_=mrm=lerctr.org@gmail.com" ---Type <return> to continue, or q <return> to quit--- buf = 0x0 i = 45 ret = 18164334 #16 0x000000080220fa54 in fts_build_mail_header (ctx=0x7fffffffdc98, block=0x7fffffffdc40) at fts-build-mail.c:179 hdr = 0x801ccf118 key = {uid = 39486, type = FTS_BACKEND_BUILD_KEY_HDR, part = 0x801c09c58, hdr_name = 0x801c4ba20 "Return-Path", body_content_type = 0x0, body_content_disposition = 0x0} ret = 32767 #17 0x000000080220f292 in fts_build_mail_real (update_ctx=0x801c21240, mail=0x801c63040) at fts-build-mail.c:548 ctx = {mail = 0x801c63040, update_ctx = 0x801c21240, content_type = 0x0, content_disposition = 0x0, body_parser = 0x0, word_buf = 0x0, pending_input = 0x0, cur_user_lang = 0x0} input = 0x801cc9030 parser = 0x801c2f040 decoder = 0x801ccf100 raw_block = {part = 0x801c09c58, hdr = 0x801c53900, data = 0x0, size = 0} block = {part = 0x801c09c58, hdr = 0x801ccf118, data = 0x7fffffffdc90 "0\220\314\001\b", size = 0} prev_part = 0x801c09c58 parts = 0x4ffffdca8 ---Type <return> to continue, or q <return> to quit--- skip_body = false body_part = false body_added = false binary_body = 255 error = 0x801cc88c0 "\200\212\314\001\b" ret = 1 #18 0x000000080220ee72 in fts_build_mail (update_ctx=0x801c21240, mail=0x801c63040) at fts-build-mail.c:594 _data_stack_cur_id = 5 ret = 8 #19 0x000000080221a626 in fts_mail_index (_mail=0x801c63040) at fts-storage.c:503 ft = 0x801c196e0 flist = 0x801c5dbd8 #20 0x0000000802217d40 in fts_mail_precache (_mail=0x801c63040) at fts-storage.c:522 _data_stack_cur_id = 4 mail = 0x801c63040 fmail = 0x801c634f0 ft = 0x801c196e0 #21 0x0000000800d3d992 in mail_precache (mail=0x801c63040) at mail.c:420 _data_stack_cur_id = 3 p = 0x801c63040 #22 0x0000000000433b59 in cmd_index_box_precache (box=0x8074edc40) ---Type <return> to continue, or q <return> to quit--- at doveadm-mail-index.c:75 status = {messages = 5342, recent = 0, unseen = 0, uidvalidity = 1362362144, uidnext = 43009, first_unseen_seq = 0, first_recent_uid = 43007, last_cached_seq = 0, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1, have_save_guids = 0, have_only_guid128 = 0} trans = 0x801c3a800 search_args = 0x0 ctx = 0x801c1c040 mail = 0x801c63040 metadata = {guid = '\000' , virtual_size = 0, physical_size = 0, first_save_date = 0, cache_fields = 0x0, precache_fields = (MAIL_FETCH_STREAM_HEADER | MAIL_FETCH_STREAM_BODY | MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE | MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_VIRTUAL_SIZE | MAIL_FETCH_UIDL_BACKEND | MAIL_FETCH_GUID | MAIL_FETCH_POP3_ORDER), backend_ns_prefix = 0x0, backend_ns_type = (unknown: 0)} seq = 1 counter = 1819 max = 5342 ret = 0 #23 0x0000000000433907 in cmd_index_box (ctx=0x801c2ac40, info=0x801c5f0c0) at doveadm-mail-index.c:130 ---Type <return> to continue, or q <return> to quit--- box = 0x8074edc40 status = {messages = 4294958944, recent = 32767, unseen = 14577888, uidvalidity = 8, uidnext = 4294958944, first_unseen_seq = 16809983, first_recent_uid = 29749440, last_cached_seq = 8, highest_modseq = 34389277760, highest_pvt_modseq = 140737488346996, keywords = 0x7fffffffdf90, permanent_flags = 18334301, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 1, have_guids = 0, have_save_guids = 0, have_only_guid128 = 0} ret = 0 #24 0x00000000004335ee in cmd_index_run (_ctx=0x801c2ac40, user=0x801c45040) at doveadm-mail-index.c:201 _data_stack_cur_id = 2 ctx = 0x801c2ac40 iter_flags = (MAILBOX_LIST_ITER_NO_AUTO_BOXES | MAILBOX_LIST_ITER_STAR_WITHIN_NS | MAILBOX_LIST_ITER_RETURN_NO_FLAGS) ns_mask = (MAIL_NAMESPACE_TYPE_PRIVATE | MAIL_NAMESPACE_TYPE_SHARED | MAIL_NAMESPACE_TYPE_PUBLIC) iter = 0x801c2bc40 info = 0x801c5f0c0 i = 32767 ret = 0 #25 0x000000000042b90a in doveadm_mail_next_user (ctx=0x801c2ac40, cctx=0x7fffffffe350, error_r=0x7fffffffe0f8) at doveadm-mail.c:404 ---Type <return> to continue, or q <return> to quit--- input = {module = 0x0, service = 0x484aa6 "doveadm", username = 0x7fffffffef58 "mrm", session_id = 0x0, session_id_prefix = 0x0, session_create_time = 0, local_ip = { family = 0, u = {ip6 = {__u6_addr = { __u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = { s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = { __u6_addr = {__u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = (unknown: 0), flags_override_remove = (unknown: 0), no_userdb_lookup = 0, debug = 0} error = 0x7fffffffe420 "\200\347\377\377\377\177" ip = 0x8011deee3 "" ret = 0 #26 0x000000000042b5bc in doveadm_mail_single_user (ctx=0x801c2ac40, cctx=0x7fffffffe350, error_r=0x7fffffffe0f8) at doveadm-mail.c:435 No locals. #27 0x000000000042d50a in doveadm_mail_cmd_exec (ctx=0x801c2ac40, cctx=0x7fffffffe350, wildcard_user=0x0) at doveadm-mail.c:596 ret = 32767 error = 0x801c2ae18 "P\256\302\001\b" ---Type <return> to continue, or q <return> to quit--- #28 0x000000000042d0a5 in doveadm_cmd_ver2_to_mail_cmd_wrapper ( cctx=0x7fffffffe350) at doveadm-mail.c:1061 mctx = 0x801c2ac40 wildcard_user = 0x0 fieldstr = 0x7fffffffe1e0 "\300\342\377\377\377\177" pargv = {arr = {buffer = 0x801c2ae98, element_size = 8}, v = 0x801c2ae98, v_modifiable = 0x801c2ae98} full_args = {arr = {buffer = 0x801c2ae18, element_size = 8}, v = 0x801c2ae18, v_modifiable = 0x801c2ae18} i = 7 mail_cmd = {alloc = 0x433210 , name = 0x48da32 "index", usage_args = 0x488030 "[-u <user>|-A] [-S ] [-q] [-n <max recent>] <mailbox mask>"} args_pos = 0 #29 0x0000000000443cfe in doveadm_cmd_run_ver2 (argc=2, argv=0x7fffffffe438, cctx=0x7fffffffe350) at doveadm-cmd.c:523 param = 0x801c06ce0 pargv = {arr = {buffer = 0x801c06a38, element_size = 104}, v = 0x801c06a38, v_modifiable = 0x801c06a38} opts = {arr = {buffer = 0x801c06800, element_size = 32}, v = 0x801c06800, v_modifiable = 0x801c06800} pargc = 7 c = -1 ---Type <return> to continue, or q <return> to quit--- li = 32767 pool = 0x801c06768 optbuf = 0x801c06780 #30 0x00000000004437f4 in doveadm_cmd_try_run_ver2 ( cmd_name=0x7fffffffe7a3 "index", argc=2, argv=0x7fffffffe438, cctx=0x7fffffffe350) at doveadm-cmd.c:446 cmd = 0x801c4db98 #31 0x0000000000447f51 in main (argc=2, argv=0x7fffffffe438) at doveadm.c:379 service_flags = (MASTER_SERVICE_FLAG_STANDALONE | MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN) cctx = {cmd = 0x801c4db98, argc = 7, argv = 0x801c06a70, username = 0x7fffffffef58 "mrm", cli = true, tcp_server = false, local_ip = {family = 0, u = {ip6 = {__u6_addr = { __u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = { s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = { __u6_addr = {__u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, conn = 0x0} cmd_name = 0x7fffffffe7a3 "index" i = 6 quick_init = false c = -1 (gdb)

On Mon, Oct 24, 2016 at 4:34 AM, Aki Tuomi aki.tuomi@dovecot.fi wrote:

...
Hi!

We found some problems with those patches, and ended up doing slightly different fix:

https://github.com/dovecot/core/compare/3e41b3d%5E...cca98b.patch

Aki

On 24.10.2016 10:17, Aki Tuomi wrote:

...
Hi!

Can you try these two patches?

Aki

On 24.10.2016 08:48, Aki Tuomi wrote:

...
Ok so that timeval makes no sense. We'll look into it.

Aki

...
On October 24, 2016 at 12:22 AM Larry Rosenman larryrtx@gmail.com wrote:

doveadm(mrm): Debug: http-client: conn 127.0.0.1:9998 [1]: Got 200 response for request [Req38: PUT http://localhost:9998/tika/] (took 296 ms + 8 ms in queue) doveadm(mrm): Panic: kevent(): Invalid argument

Program received signal SIGABRT, Aborted. 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7 (gdb) fr 6 #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) at ioloop-kqueue.c:131 131 i_panic("kevent(): %m"); (gdb) p ts $1 = {tv_sec = 34389923520, tv_nsec = 140737488345872000} (gdb) p errno $2 = 22 (gdb) p ret $3 = -1 (gdb) p *ioloop $4 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, next_io_file = 0x0, timeouts = 0x801d17540, timeouts_new = {arr = { buffer = 0x801cd9700, element_size = 8}, v = 0x801cd9700, v_modifiable = 0x801cd9700}, handler_context = 0x801d17560, notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = 0x800d53bb0 , next_max_time = 1477257580, ioloop_wait_usecs = 27148, io_pending_count = 1, running = 1, iolooping = 1} (gdb) p* ctx $5 = {kq = 21, deleted_count = 0, events = {arr = {buffer = 0x801cd9740, element_size = 32}, v = 0x801cd9740, v_modifiable = 0x801cd9740}} (gdb) p *events $6 = {ident = 22, filter = -1, flags = 0, fflags = 0, data = 8, udata = 0x801c4f980} (gdb)

thebighonker.lerctr.org ~ $ ps auxw|grep doveadm mrm 46965 0.0 0.2 108516 55264 0 I+ 4:19PM 0:02.28 gdb /usr/local/bin/doveadm (gdb7111) mrm 46985 0.0 0.0 81236 15432 0 TX 4:19PM 0:03.51 /usr/local/bin/doveadm -D -vvvvvvv index * ler 47221 0.0 0.0 18856 2360 1 S+ 4:21PM 0:00.00 grep doveadm thebighonker.lerctr.org ~ $ sudo lsof -p 46985 Password: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME doveadm 46985 mrm cwd VDIR 22,2669215774 152 4 /home/mrm doveadm 46985 mrm rtd VDIR 19,766509061 28 4 / doveadm 46985 mrm txt VREG 119,3584295129 1714125 182952 /usr/local/bin/doveadm doveadm 46985 mrm txt VREG 19,766509061 132272 14382 /libexec/ld-elf.so.1 doveadm 46985 mrm txt VREG 22,2669215774 6920 10680 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 7224 10716 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 11080 10650 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 2968 10679 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 3108 10715 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 6520 139902 /home/mrm/mail/.imap/Sent/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 9236 10648 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 174892 143343 /home/mrm/mail/.imap/Sent/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 32656 143058 /home/mrm/mail/.imap/INBOX/dovecot.index.log doveadm 46985 mrm txt VREG 19,766509061 720 30627 /usr/share/i18n/csmapper/CP/CP1251%UCS.mps doveadm 46985 mrm txt VREG 19,766509061 720 30630 /usr/share/i18n/csmapper/CP/CP1252%UCS.mps doveadm 46985 mrm txt VREG 19,766509061 89576 6846 /lib/libz.so.6 doveadm 46985 mrm txt VREG 19,766509061 62008 5994 /lib/libcrypt.so.5 doveadm 46985 mrm txt VREG 119,3584295129 6725689 183611 /usr/local/lib/dovecot/libdovecot-storage.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 3162259 183615 /usr/local/lib/dovecot/libdovecot.so.0.0.0 doveadm 46985 mrm txt VREG 19,766509061 1649944 4782 /lib/libc.so.7 doveadm 46985 mrm txt VREG 119,3584295129 80142 183550 /usr/local/lib/dovecot/lib15_notify_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 652615 183556 /usr/local/lib/dovecot/lib20_fts_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 2730888 268825 /usr/local/lib/libicui18n.so.57.1 doveadm 46985 mrm txt VREG 119,3584295129 1753976 268849 /usr/local/lib/libicuuc.so.57.1 doveadm 46985 mrm txt VREG 119,3584295129 1704 268821 /usr/local/lib/libicudata.so.57.1 doveadm 46985 mrm txt VREG 19,766509061 102560 6745 /lib/libthr.so.3 doveadm 46985 mrm txt VREG 19,766509061 184712 5795 /lib/libm.so.5 doveadm 46985 mrm txt VREG 19,766509061 774000 5642 /usr/lib/libc++.so.1 doveadm 46985 mrm txt VREG 19,766509061 103304 5742 /lib/libcxxrt.so.1 doveadm 46985 mrm txt VREG 19,766509061 56344 7436 /lib/libgcc_s.so.1 doveadm 46985 mrm txt VREG 119,3584295129 349981 183782 /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 1969384 113258 /usr/local/lib/libclucene-core.so.2.3.3.4 doveadm 46985 mrm txt VREG 119,3584295129 128992 113261 /usr/local/lib/libclucene-shared.so.2.3.3.4 doveadm 46985 mrm txt VREG 119,3584295129 143141 183578 /usr/local/lib/dovecot/lib90_stats_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 37368 151926 /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 693808 151924 /usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 146477 183599 /usr/local/lib/dovecot/libdovecot-lda.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 13823 183780 /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 88081 183527 /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so doveadm 46985 mrm txt VREG 19,766509061 8304 6330 /usr/lib/i18n/libiconv_std.so.4 doveadm 46985 mrm txt VREG 19,766509061 6744 6318 /usr/lib/i18n/libUTF8.so.4 doveadm 46985 mrm txt VREG 19,766509061 4384 6336 /usr/lib/i18n/libmapper_none.so.4 doveadm 46985 mrm txt VREG 19,766509061 7584 6345 /usr/lib/i18n/libmapper_std.so.4 doveadm 46985 mrm 0u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 1u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 2u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 3u PIPE 0xfffff806fdf505d0 16384 ->0xfffff806fdf50730 doveadm 46985 mrm 4u PIPE 0xfffff806fdf50730 0 ->0xfffff806fdf505d0 doveadm 46985 mrm 5u KQUEUE 0xfffff806350b0600 count=0, state=0 doveadm 46985 mrm 6w FIFO 163,709754999 0t0 29707 /var/run/dovecot/stats-mail doveadm 46985 mrm 7u VREG 22,2669215774 11080 10650 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log doveadm 46985 mrm 8u VREG 22,2669215774 536 137895 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index doveadm 46985 mrm 9u VREG 22,2669215774 6920 10680 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log doveadm 46985 mrm 10u VREG 22,2669215774 2968 10679 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache doveadm 46985 mrm 11u VREG 22,2669215774 6520 139902 /home/mrm/mail/.imap/Sent/dovecot.index.log doveadm 46985 mrm 12u VREG 22,2669215774 9288 139905 /home/mrm/mail/.imap/Sent/dovecot.index doveadm 46985 mrm 13u VREG 22,2669215774 7224 10716 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log doveadm 46985 mrm 14u VREG 22,2669215774 3108 10715 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache doveadm 46985 mrm 15u VREG 22,2669215774 9236 10648 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache doveadm 46985 mrm 16u VREG 22,2669215774 174892 143343 /home/mrm/mail/.imap/Sent/dovecot.index.cache doveadm 46985 mrm 17u VREG 22,2669215774 32656 143058 /home/mrm/mail/.imap/INBOX/dovecot.index.log doveadm 46985 mrm 18u VREG 22,2669215774 0 135848 /home/mrm (zroot/home/mrm) doveadm 46985 mrm 19u VREG 22,2669215774 35656 135336 /home/mrm/mail/.imap/INBOX/dovecot.index doveadm 46985 mrm 20u VREG 22,2669215774 0 135849 /home/mrm (zroot/home/mrm) doveadm 46985 mrm 21u KQUEUE 0xfffff80163b1ba00 count=1, state=0 doveadm 46985 mrm 22u IPv4 0xfffff805ea69a000 0t0 TCP localhost:44730->localhost:9998 (ESTABLISHED) doveadm 46985 mrm 25uR VREG 22,2669215774 32997612 4151 /home/mrm/mail/Sent thebighonker.lerctr.org

On Sun, Oct 23, 2016 at 12:20 PM, Aki Tuomi aki.tuomi@dovecot.fi wrote:

...
According to man page, the only way it can return EINVAL (22) is either bad filter, or bad timeout. I can't see how the filter would be bad, so I'm guessing ts must be bad. Unfortunately I forgot to ask for it, so I am going to have to ask you run it again and run

p ts

if that's valid, then the only thing that can be bad if the file descriptor 23.

Aki

...
On October 23, 2016 at 7:42 PM Larry Rosenman larryrtx@gmail.com wrote: ok, gdb7 works: (gdb) fr 6 #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) at ioloop-kqueue.c:131 131 i_panic("kevent(): %m"); (gdb) p errno $1 = 22 (gdb) p ret $2 = -1 (gdb) p *ioloop $3 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, next_io_file = 0x0, timeouts = 0x801c19e60, timeouts_new = {arr = {buffer = 0x801c5ac80, element_size = 8}, v = 0x801c5ac80, v_modifiable = 0x801c5ac80}, handler_context = 0x801c19e80, notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = 0x800d53bb0 , next_max_time = 1477240784, ioloop_wait_usecs = 29863, io_pending_count = 1, running = 1, iolooping = 1} (gdb) p *ctx $4 = {kq = 22, deleted_count = 0, events = {arr = {buffer = 0x801c5acc0, element_size = 32}, v = 0x801c5acc0, v_modifiable = 0x801c5acc0}} (gdb) p *events $5 = {ident = 23, filter = -1, flags = 0, fflags = 0, data = 8, udata = 0x801c4f980} (gdb)

On Sun, Oct 23, 2016 at 11:27 AM, Larry Rosenman
...
...
...
...
> grrr. > > /home/mrm $ gdb /usr/local/bin/doveadm > GNU gdb 6.1.1 [FreeBSD] > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and you > are > welcome to change it and/or distribute copies of it under certain > conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for

...
> This GDB was configured as "amd64-marcel-freebsd"... > (gdb) run -D -vvvvvv index * > Starting program: /usr/local/bin/doveadm -D -vvvvvv index * > > Program received signal SIGTRAP, Trace/breakpoint trap. > Cannot remove breakpoints because program is no longer writable. > It might be running in another process. > Further execution is probably impossible. > 0x0000000800624490 in ?? () > (gdb) > > Ideas? > > > On Sun, Oct 23, 2016 at 11:14 AM, Aki Tuomi aki.tuomi@dovecot.fi wrote: >> Hi, >> >> can you run doveadm in gdb, wait for it to crash, and then go to

wrote: details. frame 6

...
>> ( io_loop_handler_run_internal) and run >> >> p errno >> p ret >> p *ioloop >> p *ctx >> p *events >> >> Sorry but the crash doesn't make enough sense yet to me, we need to >> determine what the invalid parameter is. >> >>> Larry Rosenman http://www.lerctr.org/~ler >>> Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com >>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 > > -- > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com > US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

-- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

0 0

Reply
Sign in to reply online Use email software

Aki Tuomi

25 Oct 25 Oct
11:59 a.m.

New subject: keent() from Tika - with doveadm

This seems to be some kind of clucene internal error.

Aki

On 24.10.2016 17:21, Larry Rosenman wrote:

...
that seems to fix this kevent() problem, but I got the following lucene assert. Is that because of previous fails?

Also, while I have your attention, is fts_autoindex supposed to work accross NAMESPACES?

doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39483 because: fts indexing doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39484 because: fts indexing doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39485 because: fts indexing doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39486 because: fts indexing Assertion failed: (numDocsInStore*8 == directory->fileLength( (docStoreSegment + "." + IndexFileNames::FIELDS_INDEX_EXTENSION).c_str() )), function closeDocStore, file src/core/CLucene/index/DocumentsWriter.cpp, line 210.

Program received signal SIGABRT, Aborted. 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7 (gdb) bt full #0 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7 No symbol table info available. #1 0x00000008014e6f66 in raise () from /lib/libc.so.7 No symbol table info available. #2 0x00000008014e6ee9 in abort () from /lib/libc.so.7 No symbol table info available. #3 0x000000080154dee1 in __assert () from /lib/libc.so.7 No symbol table info available. #4 0x0000000803ea1762 in lucene::index::DocumentsWriter::closeDocStore() () from /usr/local/lib/libclucene-core.so.1 No symbol table info available. #5 0x0000000803ea3d89 in lucene::index::DocumentsWriter::flush(bool) () from /usr/local/lib/libclucene-core.so.1 No symbol table info available. #6 0x0000000803ed26bb in lucene::index::IndexWriter::doFlush(bool) () from /usr/local/lib/libclucene-core.so.1 No symbol table info available. #7 0x0000000803ece25e in lucene::index::IndexWriter::flush(bool, bool) () from /usr/local/lib/libclucene-core.so.1 No symbol table info available. #8 0x0000000803ececbe in lucene::index::IndexWriter::addDocument(lucene::document::Document*, lucene::analysis::Analyzer*) () from /usr/local/lib/libclucene-core.so.1 No symbol table info available. ---Type <return> to continue, or q <return> to quit--- #9 0x0000000803b8cd55 in lucene_index_build_flush (index=0x801c1b640) at lucene-wrapper.cc:552 analyzer = 0x801c251c0 ret = 0 err = @0x801cd90d0: { _awhat = 0x801cd9108 "Return-Path: =mrm= lerctr.org@gmail.com>\nDelivered-To: mrm@lerctr.org\n", _twhat = 0x58 , error_number = 30249224} #10 0x0000000803b8c42e in lucene_index_build_more (index=0x801c1b640, uid=39486, part_idx=0, data=0x806041000 "=mrm=lerctr.org@gmail.com>", size=45, hdr_name=0x801c1a520 "Return-Path") at lucene-wrapper.cc:572 id = L"\x1cc8c40\b\xffffd970\x7fff\xffffd960\x7fff\x1190eba\b\x1cc0c00\b\x1191739\b\x1cc8c40\b\x1190eba\b\xffffd990\x7fff-\000\000\001-" namesize = 34378158489 datasize = 140737488345424 dest = 0x801190eba L"\x45880124\xff458aff\xb60f0124\xc48348c0\xfc35d10\x4855001f\x8348e589\x8d4840ec\x8948e075\x8b48f07d\x8b48f07d\x8948107f\x8b48e87d\x8b48e87d\x140bf\x458b4800\x888b48e8\510\x48f92948\x1488889\x8b480000\xc748e845\x14080" dest_free = 0x7fffffffd920 L"\xffffd950\x7fff\x1191199\b\x1cc8c40\b\xffffd970\x7fff\xffffd960\x7fff\x1190eba\b\x1cc0c00\b\x1191739\b\x1cc8c40\b\x1190eba\b\xffffd990\x7fff-" ---Type <return> to continue, or q <return> to quit--- token_flag = 0 #11 0x0000000803b8a420 in fts_backend_lucene_update_build_more ( _ctx=0x801c21240, data=0x806041000 "=mrm=lerctr.org@gmail.com>", size=45) at fts-backend-lucene.c:432 _data_stack_cur_id = 6 ctx = 0x801c21240 backend = 0x801c3a200 ret = 8 #12 0x000000080220e035 in fts_backend_update_build_more (ctx=0x801c21240, data=0x806041000 "=mrm=lerctr.org@gmail.com>", size=45) at fts-api.c:193 No locals. #13 0x000000080221015b in fts_build_full_words (ctx=0x7fffffffdc98, data=0x806041000 "m.ray.mullins+caf_=mrm=lerctr.org@gmail.com", size=45, last=true) at fts-build-mail.c:402 i = 45 #14 0x000000080220fd45 in fts_build_data (ctx=0x7fffffffdc98, data=0x806041000 "m.ray.mullins+caf_=mrm=lerctr.org@gmail.com", size=45, last=true) at fts-build-mail.c:423 No locals. #15 0x000000080221067d in fts_build_unstructured_header (ctx=0x7fffffffdc98, hdr=0x801ccf118) at fts-build-mail.c:104 data = 0x806041000 "m.ray.mullins+caf_=mrm=lerctr.org@gmail.com" ---Type <return> to continue, or q <return> to quit--- buf = 0x0 i = 45 ret = 18164334 #16 0x000000080220fa54 in fts_build_mail_header (ctx=0x7fffffffdc98, block=0x7fffffffdc40) at fts-build-mail.c:179 hdr = 0x801ccf118 key = {uid = 39486, type = FTS_BACKEND_BUILD_KEY_HDR, part = 0x801c09c58, hdr_name = 0x801c4ba20 "Return-Path", body_content_type = 0x0, body_content_disposition = 0x0} ret = 32767 #17 0x000000080220f292 in fts_build_mail_real (update_ctx=0x801c21240, mail=0x801c63040) at fts-build-mail.c:548 ctx = {mail = 0x801c63040, update_ctx = 0x801c21240, content_type = 0x0, content_disposition = 0x0, body_parser = 0x0, word_buf = 0x0, pending_input = 0x0, cur_user_lang = 0x0} input = 0x801cc9030 parser = 0x801c2f040 decoder = 0x801ccf100 raw_block = {part = 0x801c09c58, hdr = 0x801c53900, data = 0x0, size = 0} block = {part = 0x801c09c58, hdr = 0x801ccf118, data = 0x7fffffffdc90 "0\220\314\001\b", size = 0} prev_part = 0x801c09c58 parts = 0x4ffffdca8 ---Type <return> to continue, or q <return> to quit--- skip_body = false body_part = false body_added = false binary_body = 255 error = 0x801cc88c0 "\200\212\314\001\b" ret = 1 #18 0x000000080220ee72 in fts_build_mail (update_ctx=0x801c21240, mail=0x801c63040) at fts-build-mail.c:594 _data_stack_cur_id = 5 ret = 8 #19 0x000000080221a626 in fts_mail_index (_mail=0x801c63040) at fts-storage.c:503 ft = 0x801c196e0 flist = 0x801c5dbd8 #20 0x0000000802217d40 in fts_mail_precache (_mail=0x801c63040) at fts-storage.c:522 _data_stack_cur_id = 4 mail = 0x801c63040 fmail = 0x801c634f0 ft = 0x801c196e0 #21 0x0000000800d3d992 in mail_precache (mail=0x801c63040) at mail.c:420 _data_stack_cur_id = 3 p = 0x801c63040 #22 0x0000000000433b59 in cmd_index_box_precache (box=0x8074edc40) ---Type <return> to continue, or q <return> to quit--- at doveadm-mail-index.c:75 status = {messages = 5342, recent = 0, unseen = 0, uidvalidity = 1362362144, uidnext = 43009, first_unseen_seq = 0, first_recent_uid = 43007, last_cached_seq = 0, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1, have_save_guids = 0, have_only_guid128 = 0} trans = 0x801c3a800 search_args = 0x0 ctx = 0x801c1c040 mail = 0x801c63040 metadata = {guid = '\000' , virtual_size = 0, physical_size = 0, first_save_date = 0, cache_fields = 0x0, precache_fields = (MAIL_FETCH_STREAM_HEADER | MAIL_FETCH_STREAM_BODY | MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE | MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_VIRTUAL_SIZE | MAIL_FETCH_UIDL_BACKEND | MAIL_FETCH_GUID | MAIL_FETCH_POP3_ORDER), backend_ns_prefix = 0x0, backend_ns_type = (unknown: 0)} seq = 1 counter = 1819 max = 5342 ret = 0 #23 0x0000000000433907 in cmd_index_box (ctx=0x801c2ac40, info=0x801c5f0c0) at doveadm-mail-index.c:130 ---Type <return> to continue, or q <return> to quit--- box = 0x8074edc40 status = {messages = 4294958944, recent = 32767, unseen = 14577888, uidvalidity = 8, uidnext = 4294958944, first_unseen_seq = 16809983, first_recent_uid = 29749440, last_cached_seq = 8, highest_modseq = 34389277760, highest_pvt_modseq = 140737488346996, keywords = 0x7fffffffdf90, permanent_flags = 18334301, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 1, have_guids = 0, have_save_guids = 0, have_only_guid128 = 0} ret = 0 #24 0x00000000004335ee in cmd_index_run (_ctx=0x801c2ac40, user=0x801c45040) at doveadm-mail-index.c:201 _data_stack_cur_id = 2 ctx = 0x801c2ac40 iter_flags = (MAILBOX_LIST_ITER_NO_AUTO_BOXES | MAILBOX_LIST_ITER_STAR_WITHIN_NS | MAILBOX_LIST_ITER_RETURN_NO_FLAGS) ns_mask = (MAIL_NAMESPACE_TYPE_PRIVATE | MAIL_NAMESPACE_TYPE_SHARED | MAIL_NAMESPACE_TYPE_PUBLIC) iter = 0x801c2bc40 info = 0x801c5f0c0 i = 32767 ret = 0 #25 0x000000000042b90a in doveadm_mail_next_user (ctx=0x801c2ac40, cctx=0x7fffffffe350, error_r=0x7fffffffe0f8) at doveadm-mail.c:404 ---Type <return> to continue, or q <return> to quit--- input = {module = 0x0, service = 0x484aa6 "doveadm", username = 0x7fffffffef58 "mrm", session_id = 0x0, session_id_prefix = 0x0, session_create_time = 0, local_ip = { family = 0, u = {ip6 = {__u6_addr = { __u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = { s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = { __u6_addr = {__u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = (unknown: 0), flags_override_remove = (unknown: 0), no_userdb_lookup = 0, debug = 0} error = 0x7fffffffe420 "\200\347\377\377\377\177" ip = 0x8011deee3 "" ret = 0 #26 0x000000000042b5bc in doveadm_mail_single_user (ctx=0x801c2ac40, cctx=0x7fffffffe350, error_r=0x7fffffffe0f8) at doveadm-mail.c:435 No locals. #27 0x000000000042d50a in doveadm_mail_cmd_exec (ctx=0x801c2ac40, cctx=0x7fffffffe350, wildcard_user=0x0) at doveadm-mail.c:596 ret = 32767 error = 0x801c2ae18 "P\256\302\001\b" ---Type <return> to continue, or q <return> to quit--- #28 0x000000000042d0a5 in doveadm_cmd_ver2_to_mail_cmd_wrapper ( cctx=0x7fffffffe350) at doveadm-mail.c:1061 mctx = 0x801c2ac40 wildcard_user = 0x0 fieldstr = 0x7fffffffe1e0 "\300\342\377\377\377\177" pargv = {arr = {buffer = 0x801c2ae98, element_size = 8}, v = 0x801c2ae98, v_modifiable = 0x801c2ae98} full_args = {arr = {buffer = 0x801c2ae18, element_size = 8}, v = 0x801c2ae18, v_modifiable = 0x801c2ae18} i = 7 mail_cmd = {alloc = 0x433210 , name = 0x48da32 "index", usage_args = 0x488030 "[-u <user>|-A] [-S ] [-q] [-n <max recent>] <mailbox mask>"} args_pos = 0 #29 0x0000000000443cfe in doveadm_cmd_run_ver2 (argc=2, argv=0x7fffffffe438, cctx=0x7fffffffe350) at doveadm-cmd.c:523 param = 0x801c06ce0 pargv = {arr = {buffer = 0x801c06a38, element_size = 104}, v = 0x801c06a38, v_modifiable = 0x801c06a38} opts = {arr = {buffer = 0x801c06800, element_size = 32}, v = 0x801c06800, v_modifiable = 0x801c06800} pargc = 7 c = -1 ---Type <return> to continue, or q <return> to quit--- li = 32767 pool = 0x801c06768 optbuf = 0x801c06780 #30 0x00000000004437f4 in doveadm_cmd_try_run_ver2 ( cmd_name=0x7fffffffe7a3 "index", argc=2, argv=0x7fffffffe438, cctx=0x7fffffffe350) at doveadm-cmd.c:446 cmd = 0x801c4db98 #31 0x0000000000447f51 in main (argc=2, argv=0x7fffffffe438) at doveadm.c:379 service_flags = (MASTER_SERVICE_FLAG_STANDALONE | MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN) cctx = {cmd = 0x801c4db98, argc = 7, argv = 0x801c06a70, username = 0x7fffffffef58 "mrm", cli = true, tcp_server = false, local_ip = {family = 0, u = {ip6 = {__u6_addr = { __u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = { s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = { __u6_addr = {__u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, conn = 0x0} cmd_name = 0x7fffffffe7a3 "index" i = 6 quick_init = false c = -1 (gdb)

On Mon, Oct 24, 2016 at 4:34 AM, Aki Tuomi aki.tuomi@dovecot.fi wrote:

...
Hi!

We found some problems with those patches, and ended up doing slightly different fix:

https://github.com/dovecot/core/compare/3e41b3d%5E...cca98b.patch

Aki

On 24.10.2016 10:17, Aki Tuomi wrote:

...
Hi!

Can you try these two patches?

Aki

On 24.10.2016 08:48, Aki Tuomi wrote:

...
Ok so that timeval makes no sense. We'll look into it.

Aki

...
On October 24, 2016 at 12:22 AM Larry Rosenman larryrtx@gmail.com wrote:

doveadm(mrm): Debug: http-client: conn 127.0.0.1:9998 [1]: Got 200 response for request [Req38: PUT http://localhost:9998/tika/] (took 296 ms + 8 ms in queue) doveadm(mrm): Panic: kevent(): Invalid argument

Program received signal SIGABRT, Aborted. 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7 (gdb) fr 6 #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) at ioloop-kqueue.c:131 131 i_panic("kevent(): %m"); (gdb) p ts $1 = {tv_sec = 34389923520, tv_nsec = 140737488345872000} (gdb) p errno $2 = 22 (gdb) p ret $3 = -1 (gdb) p *ioloop $4 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, next_io_file = 0x0, timeouts = 0x801d17540, timeouts_new = {arr = { buffer = 0x801cd9700, element_size = 8}, v = 0x801cd9700, v_modifiable = 0x801cd9700}, handler_context = 0x801d17560, notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = 0x800d53bb0 , next_max_time = 1477257580, ioloop_wait_usecs = 27148, io_pending_count = 1, running = 1, iolooping = 1} (gdb) p* ctx $5 = {kq = 21, deleted_count = 0, events = {arr = {buffer = 0x801cd9740, element_size = 32}, v = 0x801cd9740, v_modifiable = 0x801cd9740}} (gdb) p *events $6 = {ident = 22, filter = -1, flags = 0, fflags = 0, data = 8, udata = 0x801c4f980} (gdb)

thebighonker.lerctr.org ~ $ ps auxw|grep doveadm mrm 46965 0.0 0.2 108516 55264 0 I+ 4:19PM 0:02.28 gdb /usr/local/bin/doveadm (gdb7111) mrm 46985 0.0 0.0 81236 15432 0 TX 4:19PM 0:03.51 /usr/local/bin/doveadm -D -vvvvvvv index * ler 47221 0.0 0.0 18856 2360 1 S+ 4:21PM 0:00.00 grep doveadm thebighonker.lerctr.org ~ $ sudo lsof -p 46985 Password: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME doveadm 46985 mrm cwd VDIR 22,2669215774 152 4 /home/mrm doveadm 46985 mrm rtd VDIR 19,766509061 28 4 / doveadm 46985 mrm txt VREG 119,3584295129 1714125 182952 /usr/local/bin/doveadm doveadm 46985 mrm txt VREG 19,766509061 132272 14382 /libexec/ld-elf.so.1 doveadm 46985 mrm txt VREG 22,2669215774 6920 10680 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 7224 10716 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 11080 10650 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 2968 10679 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 3108 10715 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 6520 139902 /home/mrm/mail/.imap/Sent/dovecot.index.log doveadm 46985 mrm txt VREG 22,2669215774 9236 10648 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 174892 143343 /home/mrm/mail/.imap/Sent/dovecot.index.cache doveadm 46985 mrm txt VREG 22,2669215774 32656 143058 /home/mrm/mail/.imap/INBOX/dovecot.index.log doveadm 46985 mrm txt VREG 19,766509061 720 30627 /usr/share/i18n/csmapper/CP/CP1251%UCS.mps doveadm 46985 mrm txt VREG 19,766509061 720 30630 /usr/share/i18n/csmapper/CP/CP1252%UCS.mps doveadm 46985 mrm txt VREG 19,766509061 89576 6846 /lib/libz.so.6 doveadm 46985 mrm txt VREG 19,766509061 62008 5994 /lib/libcrypt.so.5 doveadm 46985 mrm txt VREG 119,3584295129 6725689 183611 /usr/local/lib/dovecot/libdovecot-storage.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 3162259 183615 /usr/local/lib/dovecot/libdovecot.so.0.0.0 doveadm 46985 mrm txt VREG 19,766509061 1649944 4782 /lib/libc.so.7 doveadm 46985 mrm txt VREG 119,3584295129 80142 183550 /usr/local/lib/dovecot/lib15_notify_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 652615 183556 /usr/local/lib/dovecot/lib20_fts_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 2730888 268825 /usr/local/lib/libicui18n.so.57.1 doveadm 46985 mrm txt VREG 119,3584295129 1753976 268849 /usr/local/lib/libicuuc.so.57.1 doveadm 46985 mrm txt VREG 119,3584295129 1704 268821 /usr/local/lib/libicudata.so.57.1 doveadm 46985 mrm txt VREG 19,766509061 102560 6745 /lib/libthr.so.3 doveadm 46985 mrm txt VREG 19,766509061 184712 5795 /lib/libm.so.5 doveadm 46985 mrm txt VREG 19,766509061 774000 5642 /usr/lib/libc++.so.1 doveadm 46985 mrm txt VREG 19,766509061 103304 5742 /lib/libcxxrt.so.1 doveadm 46985 mrm txt VREG 19,766509061 56344 7436 /lib/libgcc_s.so.1 doveadm 46985 mrm txt VREG 119,3584295129 349981 183782 /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 1969384 113258 /usr/local/lib/libclucene-core.so.2.3.3.4 doveadm 46985 mrm txt VREG 119,3584295129 128992 113261 /usr/local/lib/libclucene-shared.so.2.3.3.4 doveadm 46985 mrm txt VREG 119,3584295129 143141 183578 /usr/local/lib/dovecot/lib90_stats_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 37368 151926 /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 693808 151924 /usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 146477 183599 /usr/local/lib/dovecot/libdovecot-lda.so.0.0.0 doveadm 46985 mrm txt VREG 119,3584295129 13823 183780 /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so doveadm 46985 mrm txt VREG 119,3584295129 88081 183527 /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so doveadm 46985 mrm txt VREG 19,766509061 8304 6330 /usr/lib/i18n/libiconv_std.so.4 doveadm 46985 mrm txt VREG 19,766509061 6744 6318 /usr/lib/i18n/libUTF8.so.4 doveadm 46985 mrm txt VREG 19,766509061 4384 6336 /usr/lib/i18n/libmapper_none.so.4 doveadm 46985 mrm txt VREG 19,766509061 7584 6345 /usr/lib/i18n/libmapper_std.so.4 doveadm 46985 mrm 0u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 1u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 2u VCHR 0,188 0t390889 188 /dev/pts/0 doveadm 46985 mrm 3u PIPE 0xfffff806fdf505d0 16384 ->0xfffff806fdf50730 doveadm 46985 mrm 4u PIPE 0xfffff806fdf50730 0 ->0xfffff806fdf505d0 doveadm 46985 mrm 5u KQUEUE 0xfffff806350b0600 count=0, state=0 doveadm 46985 mrm 6w FIFO 163,709754999 0t0 29707 /var/run/dovecot/stats-mail doveadm 46985 mrm 7u VREG 22,2669215774 11080 10650 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log doveadm 46985 mrm 8u VREG 22,2669215774 536 137895 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index doveadm 46985 mrm 9u VREG 22,2669215774 6920 10680 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log doveadm 46985 mrm 10u VREG 22,2669215774 2968 10679 /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache doveadm 46985 mrm 11u VREG 22,2669215774 6520 139902 /home/mrm/mail/.imap/Sent/dovecot.index.log doveadm 46985 mrm 12u VREG 22,2669215774 9288 139905 /home/mrm/mail/.imap/Sent/dovecot.index doveadm 46985 mrm 13u VREG 22,2669215774 7224 10716 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log doveadm 46985 mrm 14u VREG 22,2669215774 3108 10715 /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache doveadm 46985 mrm 15u VREG 22,2669215774 9236 10648 /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache doveadm 46985 mrm 16u VREG 22,2669215774 174892 143343 /home/mrm/mail/.imap/Sent/dovecot.index.cache doveadm 46985 mrm 17u VREG 22,2669215774 32656 143058 /home/mrm/mail/.imap/INBOX/dovecot.index.log doveadm 46985 mrm 18u VREG 22,2669215774 0 135848 /home/mrm (zroot/home/mrm) doveadm 46985 mrm 19u VREG 22,2669215774 35656 135336 /home/mrm/mail/.imap/INBOX/dovecot.index doveadm 46985 mrm 20u VREG 22,2669215774 0 135849 /home/mrm (zroot/home/mrm) doveadm 46985 mrm 21u KQUEUE 0xfffff80163b1ba00 count=1, state=0 doveadm 46985 mrm 22u IPv4 0xfffff805ea69a000 0t0 TCP localhost:44730->localhost:9998 (ESTABLISHED) doveadm 46985 mrm 25uR VREG 22,2669215774 32997612 4151 /home/mrm/mail/Sent thebighonker.lerctr.org

On Sun, Oct 23, 2016 at 12:20 PM, Aki Tuomi aki.tuomi@dovecot.fi wrote:

...
According to man page, the only way it can return EINVAL (22) is either bad filter, or bad timeout. I can't see how the filter would be bad, so I'm guessing ts must be bad. Unfortunately I forgot to ask for it, so I am going to have to ask you run it again and run

p ts

if that's valid, then the only thing that can be bad if the file descriptor 23.

Aki

> On October 23, 2016 at 7:42 PM Larry Rosenman larryrtx@gmail.com wrote: > ok, gdb7 works: > (gdb) fr 6 > #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) > at ioloop-kqueue.c:131 > 131 i_panic("kevent(): %m"); > (gdb) p errno > $1 = 22 > (gdb) p ret > $2 = -1 > (gdb) p *ioloop > $3 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, > next_io_file = 0x0, timeouts = 0x801c19e60, timeouts_new = {arr = {buffer = > 0x801c5ac80, element_size = 8}, v = 0x801c5ac80, > v_modifiable = 0x801c5ac80}, handler_context = 0x801c19e80, > notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = > 0x800d53bb0 , > next_max_time = 1477240784, ioloop_wait_usecs = 29863, io_pending_count = > 1, running = 1, iolooping = 1} > (gdb) p *ctx > $4 = {kq = 22, deleted_count = 0, events = {arr = {buffer = 0x801c5acc0, > element_size = 32}, v = 0x801c5acc0, v_modifiable = 0x801c5acc0}} > (gdb) p *events > $5 = {ident = 23, filter = -1, flags = 0, fflags = 0, data = 8, udata = > 0x801c4f980} > (gdb) > > > > On Sun, Oct 23, 2016 at 11:27 AM, Larry Rosenman > grrr. >> >> /home/mrm $ gdb /usr/local/bin/doveadm >> GNU gdb 6.1.1 [FreeBSD] >> Copyright 2004 Free Software Foundation, Inc. >> GDB is free software, covered by the GNU General Public License, and you >> are >> welcome to change it and/or distribute copies of it under certain >> conditions. >> Type "show copying" to see the conditions. >> There is absolutely no warranty for GDB. Type "show warranty" for details. >> This GDB was configured as "amd64-marcel-freebsd"... >> (gdb) run -D -vvvvvv index * >> Starting program: /usr/local/bin/doveadm -D -vvvvvv index * >> >> Program received signal SIGTRAP, Trace/breakpoint trap. >> Cannot remove breakpoints because program is no longer writable. >> It might be running in another process. >> Further execution is probably impossible. >> 0x0000000800624490 in ?? () >> (gdb) >> >> Ideas? >> >> >> On Sun, Oct 23, 2016 at 11:14 AM, Aki Tuomi aki.tuomi@dovecot.fi wrote: >>> Hi, >>> >>> can you run doveadm in gdb, wait for it to crash, and then go to frame 6 >>> ( io_loop_handler_run_internal) and run >>> >>> p errno >>> p ret >>> p *ioloop >>> p *ctx >>> p *events >>> >>> Sorry but the crash doesn't make enough sense yet to me, we need to >>> determine what the invalid parameter is. >>> >>>> Larry Rosenman http://www.lerctr.org/~ler >>>> Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com >>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >> -- >> Larry Rosenman http://www.lerctr.org/~ler >> Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com >> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >> > -- > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com > US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx@gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

0 0

Reply
Sign in to reply online Use email software

2954
Age (days ago)

2956
Last active (days ago)

List overview

9 comments

2 participants

Add to favorites Remove from favorites

tags

participants (2)

Aki Tuomi

Larry Rosenman