<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=ISO-8859-15">
</head>
<body>
<p>Hi,<br>
<br>
after the upgrade to dovecot 2.3.15 the Panic: indexer-worker
error is still present. I don't know if is related to searching in
a Virtual folder (look for my previous email on list with subject
"Panic on indexer-worker and Dovecot stop to search on Solr" for
more details).<br>
<br>
Here the relevant configuration of FTS plugin:<br>
<br>
plugin {<br>
fts = solr<br>
fts_autoindex = no<br>
fts_autoindex_exclude = \Junk<br>
fts_autoindex_exclude2 = \Drafts<br>
fts_decoder = decode2text<br>
fts_enforced = body<br>
fts_index_timeout = 5s<br>
fts_solr = url=<a class="moz-txt-link-freetext" href="http://10.0.0.32:8983/solr/dovecot/">http://10.0.0.32:8983/solr/dovecot/</a><br>
[...]<br>
<br>
I'm running Dovecot with FTS Solr 7.7, here the log error and the
bt full:<br>
<br>
Jun 29 13:06:26 Panic: indexer-worker(<a class="moz-txt-link-abbreviated" href="mailto:user1@company.net">user1@company.net</a>)
session=<SLTLmOXFFIy5Ydlu:6BC4HLH+2mBHQwAAxbYlJw>: file
http-clien<br>
t-request.c: line 1240 (http_client_request_send_more): assertion
failed: (req->payload_input != NULL)<br>
Jun 29 13:06:26 Error: indexer-worker(<a class="moz-txt-link-abbreviated" href="mailto:user1@company.net">user1@company.net</a>)
session=<SLTLmOXFFIy5Ydlu:6BC4HLH+2mBHQwAAxbYlJw>: Raw
backtrace: <br>
/usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x42)
[0x7f7212b36862] ->
/usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x1e)<br>
[0x7f7212b3696e] ->
/usr/lib64/dovecot/libdovecot.so.0(+0xf50fe) [0x7f7212b440fe]
-> /usr/lib64/dovecot/libdovecot.so.0(+0xf51a1) [<br>
0x7f7212b441a1] ->
/usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f7212a9460c]
-> /usr/lib64/dovecot/libdovecot.so.0(http_client_<br>
request_send_more+0x3dd) [0x7f7212add54d] ->
/usr/lib64/dovecot/libdovecot.so.0(http_client_connection_output+0xf1)
[0x7f7212ae1ca1]<br>
-> /usr/lib64/dovecot/libdovecot.so.0(+0x11e870)
[0x7f7212b6d870] ->
/usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x65) [0x7f<br>
7212b5c425] ->
/usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12b)
[0x7f7212b5ddab] -> /usr/lib64/dovecot/libdove<br>
cot.so.0(io_loop_handler_run+0x59) [0x7f7212b5c529] ->
/usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38)
[0x7f7212b5c768] -> /usr<br>
/lib64/dovecot/libdovecot.so.0(http_client_wait+0xcd)
[0x7f7212aeadbd] ->
/usr/lib64/dovecot/lib21_fts_solr_plugin.so(solr_connectio<br>
n_select+0xe5) [0x7f7210a79265] ->
/usr/lib64/dovecot/lib21_fts_solr_plugin.so(+0x4684)
[0x7f7210a75684] -> /usr/lib64/dovecot/lib20<br>
_fts_plugin.so(fts_backend_get_last_uid+0x6e) [0x7f7211e1944e]
-> /usr/lib64/dovecot/lib20_fts_plugin.so(+0xf9d2)
[0x7f7211e1f9d2] -<br>
> /usr/lib64/dovecot/lib20_fts_plugin.so(+0x10f56)
[0x7f7211e20f56] ->
/usr/lib64/dovecot/lib20_virtual_plugin.so(+0x94da) [0x7f7211<br>
a014da] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0x10ba6)
[0x7f7211e20ba6] ->
/usr/lib64/dovecot/libdovecot-storage.so.0(mail_prec<br>
ache+0x2e) [0x7f7212e48fae] -> dovecot/indexer-worker
[<a class="moz-txt-link-abbreviated" href="mailto:user1@company.net">user1@company.net</a> Virtual/All](+0x2bb1) [0x55559e522bb1] ->
/usr/lib<br>
64/dovecot/libdovecot.so.0(io_loop_call_io+0x65) [0x7f7212b5c425]
->
/usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal<br>
+0x12b) [0x7f7212b5ddab] ->
/usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x59)
[0x7f7212b5c529] -> /usr/lib64/dovecot/libd<br>
ovecot.so.0(io_loop_run+0x38) [0x7f7212b5c768] ->
/usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13)
[0x7f7212ac63c3] -> do<br>
vecot/indexer-worker [<a class="moz-txt-link-abbreviated" href="mailto:user1@company.net">user1@company.net</a> Virtual/All](main+0xd7)
[0x55559e522437] -> /lib64/libc.so.6(__libc_start_main+0xf5<br>
) [0x7f72126a3555] -> dovecot/indexer-worker [<a class="moz-txt-link-abbreviated" href="mailto:user1@company.net">user1@company.net</a>
Virtual/All](+0x24fa) [0x55559e5224fa]<br>
Jun 29 13:06:26 Fatal: indexer-worker(<a class="moz-txt-link-abbreviated" href="mailto:user1@company.net">user1@company.net</a>)
session=<SLTLmOXFFIy5Ydlu:6BC4HLH+2mBHQwAAxbYlJw>: master:
service(indexer-worker): child 17223 killed with signal 6 (core
dumped)<br>
<br>
<br>
# gdb /usr/libexec/dovecot/indexer-worker
/var/core/core.indexer-worker.17223 <br>
GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-120.el7<br>
Copyright (C) 2013 Free Software Foundation, Inc.<br>
License GPLv3+: GNU GPL version 3 or later
<a class="moz-txt-link-rfc2396E" href="http://gnu.org/licenses/gpl.html"><http://gnu.org/licenses/gpl.html></a><br>
This is free software: you are free to change and redistribute it.<br>
There is NO WARRANTY, to the extent permitted by law. Type "show
copying"<br>
and "show warranty" for details.<br>
This GDB was configured as "x86_64-redhat-linux-gnu".<br>
For bug reporting instructions, please see:<br>
<a class="moz-txt-link-rfc2396E" href="http://www.gnu.org/software/gdb/bugs/"><http://www.gnu.org/software/gdb/bugs/></a>...<br>
Reading symbols from /usr/libexec/dovecot/indexer-worker...Reading
symbols from
/usr/lib/debug/usr/libexec/dovecot/indexer-worker.debug...done.<br>
done.<br>
[New LWP 17223]<br>
[Thread debugging using libthread_db enabled]<br>
Using host libthread_db library "/lib64/libthread_db.so.1".<br>
Core was generated by `dovecot/indexer-worker'.<br>
Program terminated with signal 6, Aborted.<br>
#0 0x00007f72126b7387 in raise () from /lib64/libc.so.6<br>
Missing separate debuginfos, use: debuginfo-install
bzip2-libs-1.0.6-13.el7.x86_64 expat-2.1.0-12.el7.x86_64
glibc-2.17-324.el7_9.x86_64 libgcc-4.8.5-44.el7.x86_64
libzstd-1.5.0-1.el7.x86_64 xz-libs-5.2.2-1.el7.x86_64
zlib-1.2.7-19.el7_9.x86_64<br>
(gdb) bt full<br>
#0 0x00007f72126b7387 in raise () from /lib64/libc.so.6<br>
No symbol table info available.<br>
#1 0x00007f72126b8a78 in abort () from /lib64/libc.so.6<br>
No symbol table info available.<br>
#2 0x00007f7212b440b7 in default_fatal_finish (status=0,
type=<optimized out>) at failures.c:459<br>
backtrace = 0x55559eb75970
"/usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x42)
[0x7f7212b36862] ->
/usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x1e)
[0x7f7212b3696e] ->
/usr/lib64/dovecot/libdovecot.so.0(+0xf50fe) [0"...<br>
recursed = 0<br>
#3 fatal_handler_real (ctx=<optimized out>,
format=<optimized out>, args=<optimized out>) at
failures.c:471<br>
status = 0<br>
#4 0x00007f7212b441a1 in i_internal_fatal_handler
(ctx=<optimized out>, format=<optimized out>,
args=<optimized out>)<br>
at failures.c:866<br>
No locals.<br>
#5 0x00007f7212a9460c in i_panic
(format=format@entry=0x7f7212b85cf8 "file %s: line %d (%s):
assertion failed: (%s)")<br>
at failures.c:523<br>
ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp =
0x0, timestamp_usecs = 0, log_prefix = 0x0, <br>
log_prefix_type_pos = 0}<br>
args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area
= 0x7ffe7b6e7150, reg_save_area = 0x7ffe7b6e7090}}<br>
#6 0x00007f7212add54d in http_client_request_send_more
(req=req@entry=0x55559eca9db8, pipelined=pipelined@entry=false)<br>
at http-client-request.c:1240<br>
conn = 0x55559ec8b750<br>
cctx = 0x55559ebb63a8<br>
output = 0x55559ecafa70<br>
res = <optimized out><br>
error = <optimized out><br>
offset = <optimized out><br>
__func__ = "http_client_request_send_more"<br>
#7 0x00007f7212ae1ca1 in http_client_connection_continue_request
(conn=0x55559ec8b750) at http-client-connection.c:1342<br>
tmp_conn = 0x55559ec8b750<br>
count = 1<br>
ret = <optimized out><br>
reqs = <optimized out><br>
req = 0x55559eca9db8<br>
pipelined = false<br>
#8 http_client_connection_output (conn=0x55559ec8b750) at
http-client-connection.c:1374<br>
output = <optimized out><br>
ret = <optimized out><br>
#9 0x00007f7212b6d870 in stream_send_io (fstream=0x55559ec8cb20)
at ostream-file.c:526<br>
ostream = 0x55559ec8cbc0<br>
am = 0x55559ec8cb20<br>
use_cork = true<br>
ret = <optimized out><br>
---Type <return> to continue, or q <return> to quit---<br>
#10 0x00007f7212b5c425 in io_loop_call_io (io=0x55559ec925f0) at
ioloop.c:715<br>
ioloop = 0x55559ecaf4d0<br>
t_id = 6<br>
__func__ = "io_loop_call_io"<br>
#11 0x00007f7212b5ddab in io_loop_handler_run_internal
(ioloop=ioloop@entry=0x55559ecaf4d0) at ioloop-epoll.c:222<br>
ctx = 0x55559ecab870<br>
events = <optimized out><br>
list = 0x55559ec8c8e0<br>
io = <optimized out><br>
tv = {tv_sec = 0, tv_usec = 0}<br>
events_count = <optimized out><br>
msecs = <optimized out><br>
ret = 1<br>
i = 0<br>
call = <optimized out><br>
__func__ = "io_loop_handler_run_internal"<br>
#12 0x00007f7212b5c529 in io_loop_handler_run
(ioloop=ioloop@entry=0x55559ecaf4d0) at ioloop.c:767<br>
__func__ = "io_loop_handler_run"<br>
#13 0x00007f7212b5c768 in io_loop_run (ioloop=0x55559ecaf4d0) at
ioloop.c:740<br>
__func__ = "io_loop_run"<br>
#14 0x00007f7212aeadbd in http_client_wait () at http-client.c:339<br>
prev_ioloop = 0x55559eb7b050<br>
client_ioloop = 0x55559ecaf4d0<br>
prev_client_ioloop = 0x55559eb7b050<br>
__func__ = "http_client_wait"<br>
#15 0x00007f7210a79265 in solr_connection_select
(conn=0x55559eb8b150, query=<optimized out>,
pool=<optimized out>, <br>
box_results_r=0x7ffe7b6e7400) at solr-connection.c:211<br>
lctx = {result_pool = 0x55559ec03910, payload = 0x0, io =
0x0, request_status = 0, parser = 0x0, results = 0x0}<br>
http_req = 0x55559ecb3b48<br>
url = <optimized out><br>
#16 0x00007f7210a75684 in fts_backend_solr_get_last_uid
(_backend=0x55559eb8b090, box=0x55559ebe59a8,
last_uid_r=0x7ffe7b6e74a4)<br>
at fts-backend-solr.c:238<br>
hdr = {last_indexed_uid = 0, settings_checksum = 0, unused
= 0}<br>
#17 0x00007f7211e1944e in fts_backend_get_last_uid
(backend=<optimized out>, box=box@entry=0x55559ebe59a8, <br>
last_uid_r=last_uid_r@entry=0x7ffe7b6e74a4) at fts-api.c:106<br>
hdr = {last_indexed_uid = 2, settings_checksum = 0, unused
= 317606002}<br>
#18 0x00007f7211e1f9d2 in fts_mailbox_get_last_cached_seq
(box=box@entry=0x55559ebe59a8, seq_r=seq_r@entry=0x7ffe7b6e74f4)<br>
at fts-storage.c:85<br>
flist = <optimized out><br>
seq1 = 21845<br>
seq2 = 2663132384<br>
last_uid = 21845<br>
---Type <return> to continue, or q <return> to quit---<br>
#19 0x00007f7211e20f56 in fts_mail_precache_init
(_mail=<optimized out>, _mail=<optimized out>) at
fts-storage.c:478<br>
ft = 0x55559ec8c820<br>
flist = 0x55559ebca0a0<br>
last_seq = 21845<br>
#20 fts_mail_index (_mail=0x55559ecaed08) at fts-storage.c:501<br>
ft = 0x55559ec8c820<br>
flist = 0x55559ebca0a0<br>
pmail = 0x55559ecaed08<br>
#21 fts_mail_precache (_mail=0x55559ecaed08) at fts-storage.c:562<br>
_data_stack_cur_id = 5<br>
mail = 0x55559ecaed08<br>
fmail = <optimized out><br>
ft = 0x55559ec8c820<br>
ret = 0<br>
__func__ = "fts_mail_precache"<br>
#22 0x00007f7211a014da in virtual_mail_precache
(mail=<optimized out>) at virtual-mail.c:243<br>
vmail = <optimized out><br>
backend_mail = 0x55559ecaed08<br>
p = <optimized out><br>
#23 0x00007f7211e20ba6 in fts_mail_precache (_mail=0x55559ec027f8)
at fts-storage.c:555<br>
mail = 0x55559ec027f8<br>
fmail = 0x55559ec02f70<br>
ft = 0x55559ebff760<br>
ret = 0<br>
__func__ = "fts_mail_precache"<br>
#24 0x00007f7212e48fae in mail_precache (mail=0x55559ec027f8) at
mail.c:455<br>
_data_stack_cur_id = 4<br>
p = 0x55559ec027f8<br>
ret = <optimized out><br>
#25 0x000055559e522bb1 in index_mailbox_precache
(conn=<optimized out>, box=0x55559eb9c498) at
master-connection.c:119<br>
counter = 1<br>
max = 93<br>
percentage_sent = 0<br>
storage = <optimized out><br>
status = {messages = 93, recent = 0, unseen = 0,
uidvalidity = 1624964785, uidnext = 94, first_unseen_seq = 0, <br>
first_recent_uid = 94, last_cached_seq = 0,
highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, <br>
permanent_flags = 0, flags = 0, permanent_keywords =
false, allow_new_keywords = false, nonpermanent_modseqs = false, <br>
no_modseq_tracking = false, have_guids = true,
have_save_guids = true, have_only_guid128 = false}<br>
uids = <optimized out><br>
username = 0x55559eba0e18 <a class="moz-txt-link-rfc2396E" href="mailto:user1@company.net">"user1@company.net"</a><br>
first_uid = 1<br>
percentage_str = "\261\376\332`"<br>
---Type <return> to continue, or q <return> to quit---<br>
percentage = <optimized out><br>
error = MAIL_ERROR_NONE<br>
trans = 0x55559ebf1b00<br>
ctx = 0x55559ebf3640<br>
last_uid = 2<br>
ret = 0<br>
index_event = 0x55559ebf3250<br>
box_vname = 0x55559eb9c830 "Virtual/All"<br>
errstr = <optimized out><br>
search_args = 0x0<br>
mail = 0x55559ec027f8<br>
metadata = {guid = '\000' <repeats 15 times>,
virtual_size = 0, physical_size = 0, first_save_date = 0, <br>
cache_fields = 0x0, <br>
precache_fields = (MAIL_FETCH_STREAM_HEADER |
MAIL_FETCH_STREAM_BODY | MAIL_FETCH_RECEIVED_DATE |
MAIL_FETCH_SAVE_DATE | MAIL_FETCH_PHYSICAL_SIZE |
MAIL_FETCH_VIRTUAL_SIZE | MAIL_FETCH_UIDL_BACKEND |
MAIL_FETCH_GUID | MAIL_FETCH_POP3_ORDER), <br>
backend_ns_prefix = 0x0, backend_ns_type = (unknown: 0)}<br>
seq = <optimized out><br>
#26 index_mailbox (user=<optimized out>, user=<optimized
out>, what=<optimized out>, max_recent_msgs=<optimized
out>, <br>
mailbox=<optimized out>, conn=0x55559ebd8a80) at
master-connection.c:238<br>
box = 0x55559eb9c498<br>
status = {messages = 2662839088, recent = 21845, unseen =
1, uidvalidity = 0, uidnext = 2662837936, <br>
first_unseen_seq = 21845, first_recent_uid = 313289502,
last_cached_seq = 32626, highest_modseq = 140730969257744, <br>
highest_pvt_modseq = 93826223419056, keywords =
0x55559eb7aeb0, permanent_flags = 313289927, flags = 32626, <br>
permanent_keywords = false, allow_new_keywords = false,
nonpermanent_modseqs = false, no_modseq_tracking = false, <br>
have_guids = true, have_save_guids = false,
have_only_guid128 = false}<br>
errstr = <optimized out><br>
ret = 0<br>
ns = <optimized out><br>
path = 0x55559eb74a50
"/home/vmail/domains/2/company.net/0/user1/Maildir/virtual/All"<br>
error = 93<br>
sync_flags = <optimized out><br>
#27 master_connection_input_line (line=<optimized out>,
conn=0x55559ebd8a80) at master-connection.c:280<br>
str = <optimized out><br>
max_recent_msgs = 0<br>
ret = <optimized out><br>
args = <optimized out><br>
input = {event_parent = 0x0, module = 0x55559e52343f
"mail", service = 0x55559e523430 "indexer-worker", <br>
username = 0x55559eb72038 <a class="moz-txt-link-rfc2396E" href="mailto:user1@company.net">"user1@company.net"</a>,
session_id = 0x0, <br>
session_id_prefix = 0x55559eb7205f "SLTLmOXFFIy5Ydlu",
session_create_time = 0, local_ip = {family = 0, u = {ip6 = {<br>
__in6_u = {__u6_addr8 = '\000' <repeats 15
times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 =
{0, 0, 0, <br>
0}}}, ip4 = {s_addr = 0}}}, remote_ip =
{family = 0, u = {ip6 = {__in6_u = {<br>
__u6_addr8 = '\000' <repeats 15 times>,
__u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0,
0}}}, <br>
---Type <return> to continue, or q <return> to quit---<br>
ip4 = {s_addr = 0}}}, local_port = 0, remote_port =
0, userdb_fields = 0x0, forward_fields = 0x0, <br>
flags_override_add = (unknown: 0), flags_override_remove
= (unknown: 0), no_userdb_lookup = false, debug = false, <br>
conn_secured = false, conn_ssl_secured = false}<br>
service_user = 0x55559ebcb318<br>
user = 0x55559eba0cf8<br>
error = 0x0<br>
#28 master_connection_input (conn=0x55559ebd8a80) at
master-connection.c:320<br>
_data_stack_cur_id = 3<br>
line = <optimized out><br>
#29 0x00007f7212b5c425 in io_loop_call_io (io=0x55559ec54760) at
ioloop.c:715<br>
ioloop = 0x55559eb7b050<br>
t_id = 2<br>
__func__ = "io_loop_call_io"<br>
#30 0x00007f7212b5ddab in io_loop_handler_run_internal
(ioloop=ioloop@entry=0x55559eb7b050) at ioloop-epoll.c:222<br>
ctx = 0x55559eb7bc40<br>
events = <optimized out><br>
list = 0x55559eb86770<br>
io = <optimized out><br>
tv = {tv_sec = 2147483, tv_usec = 0}<br>
events_count = <optimized out><br>
msecs = <optimized out><br>
ret = 1<br>
i = 0<br>
call = <optimized out><br>
__func__ = "io_loop_handler_run_internal"<br>
#31 0x00007f7212b5c529 in io_loop_handler_run
(ioloop=ioloop@entry=0x55559eb7b050) at ioloop.c:767<br>
__func__ = "io_loop_handler_run"<br>
#32 0x00007f7212b5c768 in io_loop_run (ioloop=0x55559eb7b050) at
ioloop.c:740<br>
__func__ = "io_loop_run"<br>
#33 0x00007f7212ac63c3 in master_service_run
(service=0x55559eb7aeb0, callback=callback@entry=0x55559e5225f0
<client_connected>)<br>
at master-service.c:862<br>
No locals.<br>
#34 0x000055559e522437 in main (argc=1, argv=0x55559eb7ab90) at
indexer-worker.c:76<br>
storage_service_flags =
(MAIL_STORAGE_SERVICE_FLAG_USERDB_LOOKUP |
MAIL_STORAGE_SERVICE_FLAG_TEMP_PRIV_DROP |
MAIL_STORAGE_SERVICE_FLAG_NO_IDLE_TIMEOUT)<br>
c = <optimized out><br>
(gdb) quit<br>
<br>
Hope can be fixed.<br>
Thanks<br>
</p>
<pre class="moz-signature" cols="72">--
Alessio Cecchi
Postmaster @ <a class="moz-txt-link-freetext" href="http://www.qboxmail.it">http://www.qboxmail.it</a>
<a class="moz-txt-link-freetext" href="https://www.linkedin.com/in/alessice">https://www.linkedin.com/in/alessice</a></pre>
</body>
</html>