finally managed to locate the dump
here the output:
# gdb /usr/libexec/dovecot/auth /var/lib/systemd/coredump/core.auth.0.3a33f56105e043de802a7dfcee265a07.28130.1543516118000000
GNU gdb (GDB) 8.2
Copyright (C) 2018 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-pc-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/libexec/dovecot/auth...done.
[New LWP 28130]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/usr/lib/libthread_db.so.1".
Core was generated by `dovecot/auth wor'.
Program terminated with signal SIGABRT, Aborted.
#0 0x00007f739c35cd7f in raise () from /usr/lib/libc.so.6
(gdb) bt full
#0 0x00007f739c35cd7f in raise () from /usr/lib/libc.so.6
No symbol table info available.
#1 0x00007f739c347672 in abort () from /usr/lib/libc.so.6
No symbol table info available.
#2 0x00007f739c39f878 in __libc_message () from /usr/lib/libc.so.6
No symbol table info available.
#3 0x00007f739c3a618a in malloc_printerr () from /usr/lib/libc.so.6
No symbol table info available.
#4 0x00007f739c3a7b27 in _int_free () from /usr/lib/libc.so.6
No symbol table info available.
#5 0x00007f739cc33585 in mysql_close (mysql=0x5636af7abdc0) at /usr/src/mariadb-10.3.11/libmariadb/libmariadb/mariadb_lib.c:1939
mysql = 0x5636af7abdc0
p = <optimized out>
p = <optimized out>
#6 0x00005636aef08f7c in driver_sqlpool_disconnect (_db=0x5636af7aaf30) at driver-sqlpool.c:590
conn__foreach_end = 0x5636af7ab570
db = 0x5636af7aaf30
conn = 0x5636af7ab560
#7 0x00005636aeefed65 in db_sql_unref (_conn=0x5636af7b0020) at db-sql.c:128
conn = 0x5636af7ae388
#8 0x00005636aeef7e15 in userdb_deinit (userdb=0x5636af7afff8) at userdb.c:191
idx = 0
__func__ = "userdb_deinit"
#9 0x00005636aeede209 in auth_deinit (auth=0x5636af7afd58) at auth.c:335
passdb = <optimized out>
userdb = 0x5636af7aff18
passdb = <optimized out>
userdb = <optimized out>
#10 auths_deinit () at auth.c:433
auth__foreach_end = 0x5636af7ae2f8
auth = 0x5636af7ae2f0
#11 0x00005636aeedcf65 in main_deinit () at main.c:270
l = <optimized out>
l = <optimized out>
l_end = <optimized out>
#12 main (argc=<optimized out>, argv=<optimized out>) at main.c:401
c = <optimized out>
Can't find any "core" files (updatedb ; locate "core"). Coredump are usually in /var/liv/systemd/coredump for other programs, but nothing for dovecot.
Looks like issue is in 'auth' and 'indexer-worker'. Where can be the coredump files ?
See https://dovecot.org/bugreport.html#coredumps
Without a backtrace it's not really possible to figure out where it's crashing.
On 28 Nov 2018, at 13.20, Joan Moreau <jom@grosjo.net> wrote:
Where to get that ?
It's still missing core dump (or bt full from it)
Aki
On 27.11.2018 8.39, Joan Moreau wrote:Thank you Aki
here the requested data (below)
Please not as well that we have numerous subfolders (>50) and pretty big mailbox sizes (>20G)
Bug appears mostly in auth process and index-worker
dovecot -n :
# 2.4.devel (de42b54aa): /etc/dovecot/dovecot.conf
# Pigeonhole version 0.6.devel (65909cfa)
# OS: Linux 4.19.4-arch1-1-ARCH x86_64 ext4
# Hostname: gjserver
base_dir = /run/dovecot
default_login_user = dovecot
default_vsz_limit = 16 G
disable_plaintext_auth = no
listen = *
log_path = /var/log/mail/dovecot.log
mail_gid = mail
mail_location = mdbox:/data/mail/%d/%n:ALT=/data/mail/archives/%d/%n
mail_plugins = fts fts_squat
mail_uid = mailusers
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext
mdbox_rotate_size = 24 M(...)
passdb {
args = /etc/dovecot/dovecot-sql.conf
driver = sql
}
(the rest default values)
On 25 November 2018 at 06:29 Joan Moreau < jom@grosjo.net> wrote:HiTHis is the lines I have in my dmesg (see below)In dovecot log , I see:Nov 25 04:26:47 auth-worker: Error: double free or corruption (fasttop)What do to about it ?Using lastest 2.3.4 versionThank you--------[132932.169265] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 0000 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 aa 36 f5 7a 7f 0000 <40> 24 3d f5 7a 7f 00 00 21 80 00 00 00 00 00 00 00 94 16 d6 ee 55[134031.969596] auth[27031]: segfault at 55e509612c30 ip000055e509612c30 sp 00007ffeb96dee48 error 15[134031.969603] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 0000 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 3a d3 e4 ef 7f 0000 <40> b4 d9 e4 ef 7f 00 00 21 80 00 00 00 00 00 00 00 04 5f 09 e5 55[134081.497871] doveadm[28930]: segfault at 7ffe4a16efc8 ip00007f393841013e sp 00007ffe4a16efc0 error 6 inlibdovecot.so.0.0.0[7f3938363000+e2000][134081.497876] Code: 7d be e9 68 ff ff ff e8 10 4c f5 ff 41 57 41 89 cf41 56 49 89 f6 41 55 41 89 fd 31 ff 41 54 55 44 89 c5 53 89 d3 48 83 ec58 <4c> 89 4c 24 08 64 48 8b 04 25 28 00 00 00 48 89 44 24 48 31 c0 e8[134084.145731] doveadm[29186]: segfault at 7fff1cfdbff8 ip00007f4376e32ffb sp 00007fff1cfdc000 error 6 inlibdovecot.so.0.0.0[7f4376d86000+e2000][134084.145735] Code: ff 66 0f 1f 44 00 00 e9 9d dc f6 ff 0f 1f 00 48 83ec 08 48 83 3d 14 16 0b 00 00 0f 85 d2 76 f6 ff 31 f6 48 8d 3d 05 16 0b00 <e8> 00 54 f5 ff 85 c0 0f 88 e4 76 f6 ff 48 83 c4 08 e9 69 dc f6 ff[135453.211242] indexer-worker[2539]: segfault at 7ffec3ba4ff8 ip00007ffec43fdcff sp 00007ffec3ba5000 error 6[135453.211245] Code: 95 4c 89 f7 48 89 75 d0 e8 5e fc ff ff 48 8b 75 d0e9 56 ff ff ff 0f 1f 44 00 00 55 48 89 e5 41 57 41 56 41 55 41 54 49 89f4 <53> 48 83 ec 08 48 85 ff 0f 84 b3 00 00 00 48 89 fb 4c 8d 35 69 c3[135453.730250] indexer-worker[9236]: segfault at 7fffed921ff8 ip00007fb7c9c4f5b1 sp 00007fffed922000 error 6 inlibdovecot.so.0.0.0[7fb7c9ba2000+e2000][135453.730256] Code: 2e 0f 1f 84 00 00 00 00 00 41 57 4d 89 cf 41 56 4189 fe 41 55 49 89 f5 41 54 41 89 d4 55 89 cd 53 48 83 ec 08 4c 8b 4c 2440 <e8> 6a fb ff ff 85 c0 7e 4f 48 8b 05 7f f9 0a 00 be 38 00 00 00 48[135796.171575] auth[11121]: segfault at 555f8645cc30 ip0000555f8645cc30 sp 00007ffcbb510868 error 15[135796.171586] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 0000 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 ba ed 38 b7 7f 0000 <40> 34 f4 38 b7 7f 00 00 21 80 00 00 00 00 00 00 00 a4 43 86 5f 55[136710.562003] auth[17828]: segfault at 563443604c30 ip0000563443604c30 sp 00007ffc1aa8b498 error 15[136710.562013] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 0000 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 fa 48 da d5 7f 0000 <40> 74 4f da d5 7f 00 00 21 80 00 00 00 00 00 00 00 24 5e 43 34 56[138331.686718] auth[31046]: segfault at 55b27bc63c30 ip000055b27bc63c30 sp 00007ffd5d5b9298 error 15[138331.686721] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 0000 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 9a 08 17 cd 7f 0000 <40> 14 0f 17 cd 7f 00 00 21 80 00 00 00 00 00 00 00 14 c4 7b b2 55[138521.070485] auth[32481]: segfault at 556e05197c30 ip0000556e05197c30 sp 00007ffe87217c08 error 15[138521.070487] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 0000 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 aa a7 20 3c 7f 0000 <40> 24 ae 20 3c 7f 00 00 21 80 00 00 00 00 00 00 00 54 17 05 6e 55[138782.544700] auth[2408]: segfault at 5570d3e46c30 ip 00005570d3e46c30sp 00007ffc9118a5e8 error 15[138782.544709] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 0000 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 da fc 71 11 7f 0000 <40> 54 03 72 11 7f 00 00 21 80 00 00 00 00 00 00 00 44 e2 d3 70 55[139113.225511] indexer-worker[3785]: segfault at 7ffe49316ff8 ip00007ffe49ba7cff sp 00007ffe49317000 error 6[139113.225514] Code: 95 4c 89 f7 48 89 75 d0 e8 5e fc ff ff 48 8b 75 d0e9 56 ff ff ff 0f 1f 44 00 00 55 48 89 e5 41 57 41 56 41 55 41 54 49 89f4 <53> 48 83 ec 08 48 85 ff 0f 84 b3 00 00 00 48 89 fb 4c 8d 35 69 c3[139113.733885] indexer-worker[5483]: segfault at 7ffcdc00efb8 ip00007fa68292a13e sp 00007ffcdc00efb0 error 6 inlibdovecot.so.0.0.0[7fa68287d000+e2000][139113.733890] Code: 7d be e9 68 ff ff ff e8 10 4c f5 ff 41 57 41 89 cf41 56 49 89 f6 41 55 41 89 fd 31 ff 41 54 55 44 89 c5 53 89 d3 48 83 ec58 <4c> 89 4c 24 08 64 48 8b 04 25 28 00 00 00 48 89 44 24 48 31 c0 e8[139120.612228] indexer-worker[5498]: segfault at 7ffc90beaff8 ip00007f0e09ae259f sp 00007ffc90beb000 error 6 inlibdovecot.so.0.0.0[7f0e09a35000+e2000][139120.612232] Code: c2 48 8b 44 24 08 48 8b 30 31 c0 e8 cb 2d f5 ff 6666 2e 0f 1f 84 00 00 00 00 00 41 57 4d 89 cf 41 56 41 89 fe 41 55 49 89f5 <41> 54 41 89 d4 55 89 cd 53 48 83 ec 08 4c 8b 4c 24 40 e8 6a fb ff[139747.003229] auth[9545]: segfault at 558b5e039c30 ip 0000558b5e039c30sp 00007ffd43633008 error 15[139747.003239] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 0000 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 2a ef 0e 75 7f 0000 <40> a4 f5 0e 75 7f 00 00 21 80 00 00 00 00 00 00 00 74 01 5e 8b 55[140640.900512] auth[17221]: segfault at 55e952d41c30 ip000055e952d41c30 sp 00007ffc36fa0908 error 15[140640.900523] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 0000 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 5a ec 80 b9 7f 0000 <40> d4 f2 80 b9 7f 00 00 21 80 00 00 00 00 00 00 00 f4 d1 52 e9 55[140777.927292] auth[18114]: segfault at 55bd72adec30 ip000055bd72adec30 sp 00007ffca394ba98 error 15[140777.927302] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 0000 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 ba cb 67 d7 7f 0000 <40> 34 d2 67 d7 7f 00 00 21 80 00 00 00 00 00 00 00 c4 ab 72 bd 55Please see https://dovecot.org/bugreport.html---
Aki