Squat

[Joan Moreau]

Yes, but the bottom line is that Squat does the job needed for end
users, Solr does not

On 2018-12-04 16:53, Michael Slusarz wrote:

>> On December 4, 2018 at 8:18 AM Aki Tuomi <aki.tuomi at open-xchange.com> wrote:
>> 
>> We don't consider it as "very early beta". We consider it production ready. It is bit more work to set up though.
> 
> FWIW, Squat has been deprecated since 2.0, so none of this should come as a surprise.
> 
> https://wiki.dovecot.org/Plugins/FTS
> 
> Aki
> 
> On 04 December 2018 at 17:16 Joan Moreau <jom at grosjo.net> wrote:
> 
> Thanks for mySql 
> 
> For Squat vs Solr, Solr does not reach Squat by very far in terms of
> results : If I setup Solr, and search (via the search in Roundbube or
> Evolution) for a keyword or part of the keyword, the results are
> complete non sense. The diference between "search in full body" and
> "search in fields" does not even work. 
> 
> Solr with Dovecot seems very early beta isnt'it ? 
> 
> On 2018-12-04 15:57, Aki Tuomi wrote:
> 
> On 04 December 2018 at 16:46 Joan Moreau via dovecot <dovecot at dovecot.org> wrote:
> 
> Hi 
> 
> How to solve this ? 
> 
> So many similar segfaults 
> 
> Thank you 
> 
> On 2018-11-30 06:11, Joan Moreau wrote:
> 
> ANother (very very long) example : 
> 
> # gdb /usr/libexec/dovecot/indexer-worker core.indexer-worker.0.3a33f56105e043de802a7dfcee265a07.21017.1543533424000000
> GNU gdb (GDB) 8.2
> Copyright (C) 2018 Free Software Foundation, Inc.
> License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
> This is free software: you are free to change and redistribute it.
> There is NO WARRANTY, to the extent permitted by law.
> Type "show copying" and "show warranty" for details.
> This GDB was configured as "x86_64-pc-linux-gnu".
> Type "show configuration" for configuration details.
> For bug reporting instructions, please see:
> <http://www.gnu.org/software/gdb/bugs/>.
> Find the GDB manual and other documentation resources online at:
> <http://www.gnu.org/software/gdb/documentation/>. 
> 
> For help, type "help".
> Type "apropos word" to search for commands related to "word"...
> Reading symbols from /usr/libexec/dovecot/indexer-worker...done.
> [New LWP 21017]
> [Thread debugging using libthread_db enabled]
> Using host libthread_db library "/usr/lib/libthread_db.so.1".
> Core was generated by `dovecot/indexer-worker'.
> Program terminated with signal SIGSEGV, Segmentation fault.
> #0 0x00007f768b62b13e in file_lock_do (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, 
> lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=60, error_r=0x7fff045010b0) at file-lock.c:173
> 173 {
> (gdb) bt full
> #0 0x00007f768b62b13e in file_lock_do (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, 
> lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=60, error_r=0x7fff045010b0) at file-lock.c:173
> lock_type_str = <optimized out>
> started = <optimized out>
> ret = <optimized out>
> __func__ = "file_lock_do"
> #1 0x00007f768b62b5b6 in file_wait_lock_error (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, 
> lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=<optimized out>, lock_r=0x7fff04501118, error_r=0x7fff045010b0) at file-lock.c:318
> lock = <optimized out>
> ret = <optimized out>
> #2 0x00007f768b62b660 in file_wait_lock (fd=<optimized out>, path=<optimized out>, lock_type=lock_type at entry=0, lock_method=<optimized out>, timeout_secs=timeout_secs at entry=60, 
> lock_r=lock_r at entry=0x7fff04501118) at file-lock.c:303
> error = 0x564540376490 ""
> ret = <optimized out>
> #3 0x00007f768a976c87 in squat_trie_lock (trie=0x564540376490, lock_type=0, file_lock_r=0x7fff04501118, dotlock_r=0x7fff04501120) at squat-trie.c:294
> ret = <optimized out>
> dotlock_r = 0x7fff04501120
> file_lock_r = 0x7fff04501118
> trie = 0x564540376490
> ret = <optimized out>
> __func__ = "squat_trie_lock"
> lock_type = 0
> ret = <optimized out>
> __func__ = "squat_trie_lock"
> #4 0x00007f768a978627 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1487
> file_lock = 0x0
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #5 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #6 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #7 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #8 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #9 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210c850
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #10 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #11 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #12 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #13 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #14 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210c7b0
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #15 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #16 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #17 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #18 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #19 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210c710
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #20 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #21 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #22 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #23 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #24 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210c670
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #25 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #26 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #27 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #28 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #29 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210c5d0
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #30 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #31 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #32 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #33 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #34 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210c530
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #35 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #36 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #37 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #38 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #39 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210c490
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #40 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #41 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #42 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #43 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #44 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210c3f0
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #45 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #46 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #47 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #48 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #49 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210c350
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #50 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> #51 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #52 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #53 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #54 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210c2b0
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #55 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #56 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #57 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #58 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #59 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210c210
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #60 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #61 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #62 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #63 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #64 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210c170
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #65 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #66 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #67 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #68 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #69 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210c0d0
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #70 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #71 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #72 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #73 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #74 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210c030
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #75 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #76 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #77 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #78 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #79 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210bf90
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #80 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #81 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #82 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #83 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #84 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210bef0
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #85 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #86 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #87 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #88 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #89 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210be50
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #90 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #91 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #92 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #93 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #94 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210bdb0
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #95 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #96 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #97 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #98 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #99 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210bd10
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #100 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #101 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #102 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #103 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #104 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210bc70
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #105 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #106 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #107 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #108 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #109 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210bbd0
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #110 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #111 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #112 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #113 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #114 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210bb30
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #115 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #116 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #117 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #118 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #119 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210ba90
> dotlock = 0x0
> changed = <optimized out>
> ret = <optimized out>
> #120 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378
> No locals.
> #121 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477
> mmap_hdr = <optimized out>
> ret = <optimized out>
> #122 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546
> No locals.
> #123 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569
> No locals.
> #124 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526
> file_lock = 0x56454210b9f0
> dotlock = 0x0
> changed = <optimized out> 
> 
> (continues for ages) 
> 
> On 2018-11-29 19:36, Joan Moreau wrote:
> 
> finally managed to locate the dump 
> 
> here the output: 
> 
> # gdb /usr/libexec/dovecot/auth /var/lib/systemd/coredump/core.auth.0.3a33f56105e043de802a7dfcee265a07.28130.1543516118000000
> GNU gdb (GDB) 8.2
> (gdb) bt full
> #0 0x00007f739c35cd7f in raise () from /usr/lib/libc.so.6
> No symbol table info available.
> #1 0x00007f739c347672 in abort () from /usr/lib/libc.so.6
> No symbol table info available.
> #2 0x00007f739c39f878 in __libc_message () from /usr/lib/libc.so.6
> No symbol table info available.
> #3 0x00007f739c3a618a in malloc_printerr () from /usr/lib/libc.so.6
> No symbol table info available.
> #4 0x00007f739c3a7b27 in _int_free () from /usr/lib/libc.so.6
> No symbol table info available.
> #5 0x00007f739cc33585 in mysql_close (mysql=0x5636af7abdc0) at /usr/src/mariadb-10.3.11/libmariadb/libmariadb/mariadb_lib.c:1939
> mysql = 0x5636af7abdc0
> p = <optimized out>
> p = <optimized out>
> #6 0x00005636aef08f7c in driver_sqlpool_disconnect (_db=0x5636af7aaf30) at driver-sqlpool.c:590
> conn__foreach_end = 0x5636af7ab570
> db = 0x5636af7aaf30
> conn = 0x5636af7ab560
> #7 0x00005636aeefed65 in db_sql_unref (_conn=0x5636af7b0020) at db-sql.c:128
> conn = 0x5636af7ae388
> #8 0x00005636aeef7e15 in userdb_deinit (userdb=0x5636af7afff8) at userdb.c:191
> idx = 0
> __func__ = "userdb_deinit"
> #9 0x00005636aeede209 in auth_deinit (auth=0x5636af7afd58) at auth.c:335
> passdb = <optimized out>
> userdb = 0x5636af7aff18
> passdb = <optimized out>
> userdb = <optimized out>
> #10 auths_deinit () at auth.c:433
> auth__foreach_end = 0x5636af7ae2f8
> auth = 0x5636af7ae2f0
> #11 0x00005636aeedcf65 in main_deinit () at main.c:270
> l = <optimized out>
> l = <optimized out>
> l_end = <optimized out>
> #12 main (argc=<optimized out>, argv=<optimized out>) at main.c:401
> c = <optimized out> 
> On 27.11.2018 8.39, Joan Moreau wrote: 
> 
> Thank you Aki 
> 
> here the requested data (below) 
> 
> Please not as well that we have numerous subfolders (>50) and pretty big
> mailbox sizes (>20G) 
> 
> Bug appears mostly in auth process and index-worker 
> 
> dovecot -n : 
> 
> # 2.4.devel (de42b54aa): /etc/dovecot/dovecot.conf
> # Pigeonhole version 0.6.devel (65909cfa)
> # OS: Linux 4.19.4-arch1-1-ARCH x86_64 ext4
> # Hostname: gjserver
> base_dir = /run/dovecot
> default_login_user = dovecot
> default_vsz_limit = 16 G
> disable_plaintext_auth = no
> listen = *
> log_path = /var/log/mail/dovecot.log
> mail_gid = mail
> mail_location = mdbox:/data/mail/%d/%n:ALT=/data/mail/archives/%d/%n
> mail_plugins = fts fts_squat
> mail_uid = mailusers
> managesieve_notify_capability = mailto
> managesieve_sieve_capability = fileinto reject envelope
> encoded-character vacation subaddress comparator-i;ascii-numeric
> relational regex imap4flags copy include variables body enotify
> environment mailbox date index ihave duplicate mime foreverypart
> extracttext
> mdbox_rotate_size = 24 M 
> 
> (...) 
> 
> passdb {
> args = /etc/dovecot/dovecot-sql.conf
> driver = sql
> }
> (the rest default values) 
> fts squat was already deprecated in 2.2, and it's considered obsolete in
> 2.3. We hopefully get around removing it from 2.4, but you should move
> away from it to Solr.
> 
> The MySQL crash has been fixed in master, see
> https://github.com/dovecot/core/commit/3c5101ffdd2a8115e03ed7180d53578765dea4c9.patch
> 
> Aki
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://dovecot.org/pipermail/dovecot/attachments/20181204/bf152482/attachment-0001.html>