v2.3.11.3 solr plugin search via MUA fails to match accented ascii characters; cmd line exec of `doveadm fts lookup` PANICs (assertion failed)

[John Fawcett]

On 12/10/2020 00:27, PGNet Dev wrote:
> for _un_accented "tambien",  match is correctly -- and quickly -- returned.
>
> in logs,
>
> 	==> /var/log/dovecot/dovecot-info.log <==
> 	2020-10-11 14:57:05 imap-login: Info: Login: user=<myuser at example.com>, method=PLAIN, rip=10.0.1.7, lip=10.0.1.50, mpid=67743, TLS
> 	2020-10-11 14:57:16 indexer-worker(myuser at example.com)<3ZUzQ2yx2JKsHgsH:9gu0MbF/g1+hCAEA+IOfAw>: Info: Indexed 4788 messages in INBOX (UIDs 135476..140263)
>
> BUT, repeating search for ACCENTED "también" returns *no* match/result.
>
> No errors in log, simply no match.
>
I have no issues searching for accented characters from Thunderbird. For
example I found your message search for either tambien or también. My
configuration is somewhat simpler though.

Maybe a silly question, but if you repeat the test for other words with
accents does it work? I noticed you have configured stopwords so some
words are not going to get indexed and seems that también is one of those.

> Attempting to test/debug from from cmd line,
>
> 	doveadm fts lookup -u myuser at example.com body "tambien"
>
> causes a PANIC
>
> 	doveadm(myuser at example.com): Panic: file mail-storage.c: line 2112 (mailbox_get_open_status): assertion failed: (box->opened)
> 	doveadm(myuser at example.com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x46) [0x7f3ee94accc6] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x22) [0x7f3ee94acde2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10025b) [0x7f3ee94b625b] -> /usr/lib64/dovecot/libdovecot.so.0(+0x100297) [0x7f3ee94b6297] -> /usr/lib64/dovecot/libdovecot.so.0(+0x59bc6) [0x7f3ee940fbc6] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x4779e) [0x7f3ee95c379e] -> /usr/lib64/dovecot/lib21_fts_solr_plugin.so(+0x5849) [0x7f3ee9015849] -> /usr/lib64/dovecot/lib20_fts_plugin.so(fts_backend_lookup+0x51) [0x7f3ee8c37491] -> /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so(+0x3280) [0x7f3ee8ba9280] -> doveadm(+0x343cd) [0x5637e99443cd] -> doveadm(+0x34fe0) [0x5637e9944fe0] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x22d) [0x5637e9945e2d] -> doveadm(doveadm_cmd_run_ver2+0x4e8) [0x5637e99568d8] -> doveadm(doveadm_cmd_try_run_ver2+0x3e) [0x5637e995692e] -> doveadm(main+0x1d4) [0x5637e9934cf4] -> /lib64/libc.so.6(__libc_start_main+0xf2) [0x7f3ee9071042] -> doveadm(_start+0x2e) [0x5637e99351ce]
> 	Aborted
>
>
> (1) What config -- dovecot &/or solr -- is needed to match on accented characters?
> (2) What add'l detail, if any, is needed for troubleshooting the panic?
>
I've had more luck searching the index from the command line with the
following

doveadm search -u myuser at example.com body tambien

I've noticed various errors when running some of the doveadm comamnds
and I've always put it down to not having run it under the right user or
in the right intial conditions or having a virtual setup rather than
system users. Not sure if that's the case with this error. I confirm I
get the same error as you.

John