Indexer error after upgrade to 2.3.11.3

Scott Q. qmail at top-consulting.net
Mon Sep 7 07:06:31 EEST 2020 

Not sure if I mentioned it but I'm on FreeBSD too. I wonder if any
of the patches FreeBSD applies automatically is causing this. I looked
through them but couldn't find anything obvious that might cause this

--- configure.orig      2020-08-12 12:20:51 UTC
+++ configure
@@ -28901,13 +28901,13 @@ fi




   if test $want_stemmer != no; then
-    { $as_echo "$as_me:${as_lineno-$LINENO}: checking for
sb_stemmer_new in -lstemmer" >&5
-$as_echo_n "checking for sb_stemmer_new in -lstemmer... " >&6; }
+    { $as_echo "$as_me:${as_lineno-$LINENO}: checking for
sb_stemmer_new in -lclucene-contribs-lib" >&5
+$as_echo_n "checking for sb_stemmer_new in -lclucene-contribs-lib...
" >&6; }
 if ${ac_cv_lib_stemmer_sb_stemmer_new+:} false; then :
   $as_echo_n "(cached) " >&6
 else
   ac_check_lib_save_LIBS=$LIBS
-LIBS="-lstemmer  $LIBS"
+LIBS="-lclucene-contribs-lib  $LIBS"
 cat confdefs.h - base_dir, "/"MASTER_PID_FILE_NAME, NULL);
--- src/plugins/fts-lucene/SnowballFilter.h.orig        2020-08-12
12:20:41 UTC
+++ src/plugins/fts-lucene/SnowballFilter.h
@@ -8,7 +8,7 @@
 #define _lucene_analysis_snowball_filter_


 #include "CLucene/analysis/AnalysisHeader.h"
-#include "libstemmer.h"
+#include "CLucene/snowball/libstemmer.h"


 CL_NS_DEF2(analysis,snowball)


--- src/plugins/fts-solr/solr-connection.c.orig 2020-08-12 12:20:41
UTC
+++ src/plugins/fts-solr/solr-connection.c
@@ -103,7 +103,7 @@ int solr_connection_init(const struct
fts_solr_setting
                http_set.ssl = ssl_client_set;
                http_set.debug = solr_set->debug;
                http_set.rawlog_dir = solr_set->rawlog_dir;
-               solr_http_client =
http_client_init(&http_set);
+               solr_http_client =
http_client_init_private(&http_set);
        }


        *conn_r = conn;
/usr gets changed to ${LOCALBASE} in post-patch:, so we
cheat and set xpdf's path to /usr/lib.


--- src/plugins/fts/decode2text.sh.orig 2017-10-28 12:21:20 UTC
+++ src/plugins/fts/decode2text.sh
@@ -79,16 +79,20 @@ wait_timeout() {
 LANG=en_US.UTF-8
 export LANG
 if [ $fmt = "pdf" ]; then
-  /usr/bin/pdftotext $path - 2>/dev/null&
+  if [ -x /usr/lib/xpdf/pdftotext ]; then
+    /usr/lib/xpdf/pdftotext $path - 2>/dev/null&
+  else
+    /usr/local/bin/pdftotext $path - 2>/dev/null&
+  fi
   wait_timeout 2>/dev/null
 elif [ $fmt = "doc" ]; then
-  (/usr/bin/catdoc $path; true) 2>/dev/null&
+  (/usr/local/bin/catdoc $path; true) 2>/dev/null&
   wait_timeout 2>/dev/null
 elif [ $fmt = "ppt" ]; then
-  (/usr/bin/catppt $path; true) 2>/dev/null&
+  (/usr/local/bin/catppt $path; true) 2>/dev/null&
   wait_timeout 2>/dev/null
 elif [ $fmt = "xls" ]; then
-  (/usr/bin/xls2csv $path; true) 2>/dev/null&
+  (/usr/local/bin/xls2csv $path; true) 2>/dev/null&
   wait_timeout 2>/dev/null
 elif [ $fmt = "odt" -o $fmt = "ods" -o $fmt = "odp" ]; then
   xmlunzip "content.xml"
--- src/plugins/fts/fts-parser-tika.c.orig      2019-01-02 22:11:26
UTC
+++ src/plugins/fts/fts-parser-tika.c
@@ -77,7 +77,7 @@ tika_get_http_client_url(struct mail_user *user,
struc
                http_set.request_timeout_msecs = 60*1000;
                http_set.ssl = &ssl_set;
                http_set.debug = user->mail_debug;
-               tika_http_client =
http_client_init(&http_set);
+               tika_http_client =
http_client_init_private(&http_set);
        }
        *http_url_r = tuser->http_url;
        return 0;






On Sunday, 06/09/2020 at 10:14 Bane Ivosev wrote:


Just to confirm, same problem, FreeBSD, after update from 2.3.10.1 to
2.3.11.3 with Solr 7.7.

On 8/19/20 5:03 PM, Alessio Cecchi wrote:
> Hi,
> 
> after the upgrade to Dovecot 2.3.11.3, from 2.3.10.1, I see
frequently
> these errors from different users:
> 
> Aug 18 11:02:35 Panic: indexer-worker(info at domain.com)
> session=: file
> http-client-request.c: line 1232 (http_client_request_send_more):
> assertion failed: (req->payload_input != NULL)
> Aug 18 11:02:35 Error: indexer-worker(info at domain.com)
> session=: Raw backtrace:
> /usr/lib64/dovecot/libdovecot.so [1].0(backtrace_append+0x2f)
> [0x7f0ee3c828bf] ->
> /usr/lib64/dovecot/libdovecot.so [1].0(backtrace_get+0x26)
[0x7f0ee3c829d6]
> -> /usr/lib64/dovecot/libdovecot.so [1].0(+0xeb7ba) [0x7f0ee3c8d7ba]
->
> /usr/lib64/dovecot/libdovecot.so [1].0(+0xeb801) [0x7f0ee3c8d801] ->
> /usr/lib64/dovecot/libdovecot.so [1].0(+0x42ff1) [0x7f0ee3be4ff1] ->
> /usr/lib64/dovecot/libdovecot.so
[1].0(http_client_request_send_more+0x415)
> [0x7f0ee3c2ba25] ->
> /usr/lib64/dovecot/libdovecot.so
[1].0(http_client_connection_output+0x114)
> [0x7f0ee3c30994] -> /usr/lib64/dovecot/libdovecot.so
[1].0(+0x115470)
> [0x7f0ee3cb7470] ->
> /usr/lib64/dovecot/libdovecot.so [1].0(io_loop_call_io+0x55)
> [0x7f0ee3ca4eb5] ->
> /usr/lib64/dovecot/libdovecot.so
[1].0(io_loop_handler_run_internal+0xdc)
> [0x7f0ee3ca6ebc] ->
> /usr/lib64/dovecot/libdovecot.so [1].0(io_loop_handler_run+0x5c)
> [0x7f0ee3ca4fac] -> /usr/lib64/dovecot/libdovecot.so
[1].0(io_loop_run+0x38)
> [0x7f0ee3ca51f8] -> /usr/lib64/dovecot/libdovecot.so [1].0(+0x8a955)
> [0x7f0ee3c2c955] ->
> /usr/lib64/dovecot/libdovecot.so
[1].0(http_client_request_finish_payload+0x21)
> [0x7f0ee3c2cbd1] ->
> /usr/lib64/dovecot/lib21_fts_solr_plugin.so
[2](solr_connection_post_end+0x45)
> [0x7f0ee1c85d15] -> /usr/lib64/dovecot/lib21_fts_solr_plugin.so
[2](+0x3fa0)
> [0x7f0ee1c81fa0] -> /usr/lib64/dovecot/lib20_fts_plugin.so
[2](+0x86cc)
> [0x7f0ee297f6cc] ->
> /usr/lib64/dovecot/lib20_fts_plugin.so
[2](fts_backend_update_deinit+0x2c)
> [0x7f0ee297f74c] -> /usr/lib64/dovecot/lib20_fts_plugin.so
[2](+0xfd04)
> [0x7f0ee2986d04] -> /usr/lib64/dovecot/lib20_fts_plugin.so
[2](+0xff3f)
> [0x7f0ee2986f3f] -> /usr/lib64/dovecot/lib10_quota_plugin.so
[2](+0xf64b)
> [0x7f0ee2dc764b] -> /usr/lib64/dovecot/lib01_acl_plugin.so
[2](+0xde43)
> [0x7f0ee2fdce43] ->
> /usr/lib64/dovecot/libdovecot-storage.so
[3].0(mailbox_transaction_commit_get_changes+0x54)
> [0x7f0ee3f91db4] ->
> /usr/lib64/dovecot/libdovecot-storage.so
[3].0(mailbox_transaction_commit+0x16)
> [0x7f0ee3f91e76] -> dovecot/indexer-worker [info at domain.com
> INBOX](+0x291c) [0x557584acb91c] -> dovecot/indexer-worker
> [info at domain.com INBOX](+0x2e54) [0x557584acbe54] ->
> /usr/lib64/dovecot/libdovecot.so [1].0(io_loop_call_io+0x55)
> [0x7f0ee3ca4eb5] ->
> /usr/lib64/dovecot/libdovecot.so
[1].0(io_loop_handler_run_internal+0xdc)
> [0x7f0ee3ca6ebc] ->
> /usr/lib64/dovecot/libdovecot.so [1].0(io_loop_handler_run+0x5c)
> [0x7f0ee3ca4fac] -> /usr/lib64/dovecot/libdovecot.so
[1].0(io_loop_run+0x38)
> [0x7f0ee3ca51f8]
> Aug 18 11:02:35 Error: indexer: Indexer worker disconnected,
discarding
> 1 requests for info at domain.com
> Aug 18 11:02:35 Error: imap(info at domain.com) session=:
> indexer failed to index mailbox INBOX
> Aug 18 11:02:35 Fatal: indexer-worker(info at domain.com)
> session=: master:
> service(indexer-worker): child 24604 killed with signal 6 (core
dumps
> disabled - https://dovecot.org/bugreport.html#coredumps)
> 
> I'm using FTS with Solr 6.6.5. What is it?
> 
> Thanks
> 
> -- 
> Alessio Cecchi
> Postmaster @ http://www.qboxmail.it
> https://www.linkedin.com/in/alessice
>





Links:
------
[1] http://libdovecot.so
[2] http://plugin.so
[3] http://libdovecot-storage.so
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://dovecot.org/pipermail/dovecot/attachments/20200907/1e09fe52/attachment-0001.html>

More information about the dovecot mailing list