<div dir="ltr">Thanks, Stephan. I've added the workaround patch to the FreeBSD port. I went through the mailbox trees that I was seeing errors on, and no crashes with the patches applied. <div><br></div><div>Let me know if there is anything I can do to help or provide access to. </div><div><br></div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr">On Wed, Jan 2, 2019 at 4:05 PM Stephan Bosch <<a href="mailto:stephan@rename-it.nl">stephan@rename-it.nl</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><br>
Op 02/01/2019 om 22:51 schreef Larry Rosenman:<br>
> <a href="https://www.lerctr.org/~ler/dovecot/doveadm-index-fts-debug.txt" rel="noreferrer" target="_blank">https://www.lerctr.org/~ler/dovecot/doveadm-index-fts-debug.txt</a><br>
><br>
> <a href="https://www.lerctr.org/~ler/dovecot/doveadm-index-fts-bt.txt" rel="noreferrer" target="_blank">https://www.lerctr.org/~ler/dovecot/doveadm-index-fts-bt.txt</a><br>
><br>
> I wish there was a way to set plugins {fts_solr = <blah>} from the <br>
> command line :(<br>
><br>
> but I turned it on globally for that run.<br>
<br>
Yeah, it is caused by the interaction between the solr and tika HTTP <br>
clients in this case. The bug itself will require some care and <br>
attention, but a quick fix should be provided by:<br>
<br>
diff --git a/src/plugins/fts-solr/solr-connection.c <br>
b/src/plugins/fts-solr/solr-connection.c<br>
index 947ea76af..3389729d1 100644<br>
--- a/src/plugins/fts-solr/solr-connection.c<br>
+++ b/src/plugins/fts-solr/solr-connection.c<br>
@@ -156,7 +156,7 @@ int solr_connection_init(const char *url,<br>
http_set.request_timeout_msecs = 60*1000;<br>
http_set.ssl = ssl_client_set;<br>
http_set.debug = debug;<br>
- solr_http_client = http_client_init(&http_set);<br>
+ solr_http_client = http_client_init_private(&http_set);<br>
}<br>
<br>
conn->xml_parser = XML_ParserCreate("UTF-8");<br>
diff --git a/src/plugins/fts/fts-parser-tika.c <br>
b/src/plugins/fts/fts-parser-tika.c<br>
index a4b8b5c30..b8b57a350 100644<br>
--- a/src/plugins/fts/fts-parser-tika.c<br>
+++ b/src/plugins/fts/fts-parser-tika.c<br>
@@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user, <br>
struct http_url **http_url_r)<br>
http_set.request_timeout_msecs = 60*1000;<br>
http_set.ssl = &ssl_set;<br>
http_set.debug = user->mail_debug;<br>
- tika_http_client = http_client_init(&http_set);<br>
+ tika_http_client = http_client_init_private(&http_set);<br>
}<br>
*http_url_r = tuser->http_url;<br>
return 0;<br>
<br>
This will bluntly prevent sharing any state between Solr and Tika HTTP <br>
clients, also across users (if there is more than one per mail process).<br>
<br>
Regards,<br>
<br>
<br>
Stephan.<br>
<br>
><br>
> On Wed, Jan 2, 2019 at 3:40 PM Stephan Bosch <<a href="mailto:stephan@rename-it.nl" target="_blank">stephan@rename-it.nl</a> <br>
> <mailto:<a href="mailto:stephan@rename-it.nl" target="_blank">stephan@rename-it.nl</a>>> wrote:<br>
><br>
> Oh, d'oh. I was looking for some solr debug logging in your<br>
> output, but<br>
> I didn't see much of it. Then I noticed that for some reason fts-solr<br>
> has its own debug setting , while fts-tika uses mail_debug. Can you<br>
> enable that as well?<br>
><br>
> Regards,<br>
><br>
> Stephan.<br>
><br>
> Op 02/01/2019 om 14:41 schreef Larry Rosenman:<br>
> ><br>
> > created with: doveadm -D -o mail_debug=yes index 2>&1 | tee<br>
> > <a href="https://www.lerctr.org/~ler/dovecot/doveadm.index.debug.out" rel="noreferrer" target="_blank">https://www.lerctr.org/~ler/dovecot/doveadm.index.debug.out</a><br>
> ><br>
> > bt full for the above:<br>
> > <a href="https://www.lerctr.org/~ler/dovecot/doveadm.index.crash.bt.txt" rel="noreferrer" target="_blank">https://www.lerctr.org/~ler/dovecot/doveadm.index.crash.bt.txt</a><br>
> ><br>
> > On Wed, Jan 2, 2019 at 2:11 AM Stephan Bosch<br>
> <<a href="mailto:stephan@rename-it.nl" target="_blank">stephan@rename-it.nl</a> <mailto:<a href="mailto:stephan@rename-it.nl" target="_blank">stephan@rename-it.nl</a>><br>
> > <mailto:<a href="mailto:stephan@rename-it.nl" target="_blank">stephan@rename-it.nl</a> <mailto:<a href="mailto:stephan@rename-it.nl" target="_blank">stephan@rename-it.nl</a>>>> wrote:<br>
> ><br>
> ><br>
> > Op 01/01/2019 om 02:12 schreef Larry Rosenman:<br>
> > > I got the following crash whilst looking at my logs and<br>
> seeing some<br>
> > > indexer-worker crashes.<br>
> > ><br>
> > > doveadm(ler): Panic: file http-client-request.c: line 1108<br>
> > > (http_client_request_send_more): assertion failed:<br>
> > (req->payload_input<br>
> > > != NULL)<br>
> > > Abort trap (core dumped)<br>
> > ><br>
> > > bt full at:<br>
> > > <a href="https://www.lerctr.org/~ler/doveadm.index.crash.txt" rel="noreferrer" target="_blank">https://www.lerctr.org/~ler/doveadm.index.crash.txt</a><br>
> > ><br>
> > > doveconf -n:<br>
> > > <a href="https://www.lerctr.org/~ler/doveconf.n.txt" rel="noreferrer" target="_blank">https://www.lerctr.org/~ler/doveconf.n.txt</a><br>
> > ><br>
> > > 2.3.4 from FreeBSD ports.<br>
> > ><br>
> > > What else do you need?<br>
> ><br>
> > This may have something to do with the fact that you're<br>
> using both<br>
> > Tika<br>
> > and Solr. Is this something you can reproduce? It would be<br>
> helpful to<br>
> > have a debug log for the Tika and Solr HTTP exchange before the<br>
> > panic.<br>
> > This can be obtained by having mail_debug=yes.<br>
> ><br>
> > Regards,<br>
> ><br>
> ><br>
> > Stephan.<br>
> ><br>
> ><br>
> ><br>
> > ><br>
> > ><br>
> > > --<br>
> > > Larry Rosenman <a href="http://www.lerctr.org/~ler" rel="noreferrer" target="_blank">http://www.lerctr.org/~ler</a><br>
> > > Phone: +1 214-642-9640 (c) E-Mail: <a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a><br>
> <mailto:<a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a>><br>
> > <mailto:<a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a> <mailto:<a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a>>><br>
> > > <mailto:<a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a> <mailto:<a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a>><br>
> <mailto:<a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a> <mailto:<a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a>>>><br>
> > > US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106<br>
> ><br>
> ><br>
> ><br>
> > --<br>
> > Larry Rosenman <a href="http://www.lerctr.org/~ler" rel="noreferrer" target="_blank">http://www.lerctr.org/~ler</a><br>
> > Phone: +1 214-642-9640 (c) E-Mail: <a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a><br>
> <mailto:<a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a>><br>
> > <mailto:<a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a> <mailto:<a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a>>><br>
> > US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106<br>
><br>
><br>
><br>
> -- <br>
> Larry Rosenman <a href="http://www.lerctr.org/~ler" rel="noreferrer" target="_blank">http://www.lerctr.org/~ler</a><br>
> Phone: +1 214-642-9640 (c) E-Mail: <a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a> <br>
> <mailto:<a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a>><br>
> US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106<br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr">Larry Rosenman <a href="http://www.lerctr.org/~ler" target="_blank">http://www.lerctr.org/~ler</a><br><span>Phone: <span title="Call with Google Voice"><span title="Call with Google Voice"><span title="Call with Google Voice">+1 214-642-9640</span></span></span> (c) E-Mail: </span><a href="mailto:larryrtx@gmail.com" target="_blank">larryrtx@gmail.com</a><br>US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106</div></div></div></div></div></div></div></div>