Bug in dovecot 2.3 virtual plugin
Hi there!
I compiled dovecot 2.3 from git. Because there is already a bug in
virtual-plugin, and i hoped, it get fixed... but it doesn't. So this
is the error-message from the log
Jän 03 16:27:08 aldebaran dovecot[26460]:
indexer-worker(jakob)<26476>qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g:
Panic: file unichar.c: line 160 (uni_ucs4_to_utf8_c): assertion
failed: (uni_is_valid_ucs4(chr))
Jän 03 16:27:08 aldebaran dovecot[26460]:
indexer-worker(jakob)<26476>qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g:
Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021)
[0x7f8299f7a021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed)
[0x7f8299f7a0ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0)
[0x7f8299eec481] ->
/usr/local/lib/dovecot/libdovecot.so.0(uni_ucs4_to_utf8_c+0xa0)
[0x7f8299fb1500] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xa75e0)
[0x7f8299f5b5e0] ->
/usr/local/lib/dovecot/libdovecot.so.0(mail_html2text_more+0xc5)
[0x7f8299f5b775] ->
/usr/local/lib/dovecot/lib20_fts_plugin.so(+0xcfcc) [0x7f82990aefcc]
-> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_parser_more+0x27)
[0x7f82990aeca7] ->
/usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x5e9)
[0x7f82990acc39] ->
/usr/local/lib/dovecot/lib20_fts_plugin.so(+0x1122d) [0x7f82990b322d]
-> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x916a)
[0x7f82958e316a] ->
/usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10f5d) [0x7f82990b2f5d]
-> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x916a)
[0x7f82958e316a] ->
/usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10f5d) [0x7f82990b2f5d]
-> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x2e)
[0x7f829a2641be] -> dovecot/indexer-worker jakob
Synoptic/AKTUELL [0x562227882533] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)
[0x7f8299f91bf9] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
[0x7f8299f93499] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)
[0x7f8299f91d02] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38)
[0x7f8299f91f18] ->
/usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13)
[0x7f8299f0f1e3] -> dovecot/indexer-worker jakob
Synoptic/AKTUELL [0x562227881f47] ->
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1)
[0x7f8299b352b1] -> dovecot/indexer-worker jakob
Synoptic/AKTUELL [0x56222788201a]
Jän 03 16:27:08 aldebaran dovecot[26460]: indexer: Error: Indexer
worker disconnected, discarding 1 requests for jakob
Jän 03 16:27:08 aldebaran dovecot[26460]:
imap(jakob)<26472>
mailbox Synoptic/AKTUELL
Jän 03 16:27:08 aldebaran dovecot[26460]:
indexer-worker(jakob)<26476>qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g:
Fatal: master: service(indexer-worker): child 26476 killed with signal
6 (core dumps disabled)
Jän 03 16:27:09 aldebaran dovecot[26460]:
indexer-worker(jakob)<26484>qQ6g1+BhIJvAqAAO:J6mUIEz2TFp0ZwAAk1Mx3g:
Error: lucene index
/var/lib/dovecot/db/indexes/Maildir/jakob/lucene-indexes:
IndexWriter() failed (#1): Lock obtain timed out
Jän 03 16:27:10 aldebaran dovecot[26460]:
indexer-worker(jakob)<26484>qQ6g1+BhIJvAqAAO:J6mUIEz2TFp0ZwAAk1Mx3g:
Error: Mailbox Synoptic/AKTUELL: Transaction commit failed: BUG:
Unknown internal error (attempted to index 1488 messages (UIDs
15214..16775))
Jän 03 16:27:10 aldebaran dovecot[26460]:
imap(jakob)<26480><lP5r2OBhKJvAqAAO>: Error: indexer failed to index
mailbox Synoptic/AKTUELL
Jän 03 16:27:11 aldebaran dovecot[26460]:
imap(jakob)<26472>
793 (mail_index_close): assertion failed: (index->open_count > 0)
Jän 03 16:27:11 aldebaran dovecot[26460]:
imap(jakob)<26472>
/usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7fb0fbd3a021] ->
/usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7fb0fbd3a0ed] ->
/usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb0fbcac481] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf39a8)
[0x7fb0fc0d99a8] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd92d1)
[0x7fb0fc0bf2d1] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd9363)
[0x7fb0fc0bf363] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_free+0x9)
[0x7fb0fc0b0f39] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd05a4)
[0x7fb0fc0b65a4] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x19)
[0x7fb0fc030c99] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xabdc)
[0x7fb0f729bbdc] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9)
[0x7fb0f729bcb9] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
[0x7fb0fc030c0a] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xac60)
[0x7fb0f729bc60] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9)
[0x7fb0f729bcb9] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
[0x7fb0fc030c0a] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x13)
[0x7fb0fc030c93] -> dovecot/imap jakob 192.168.0.14
LOGOUT [0x56514d31305b] ->
dovecot/imap jakob 192.168.0.14 LOGOUT
[0x56514d309485] -> dovecot/imap jakob 192.168.0.14
LOGOUT [0x56514d312ca4] -> dovecot/imap jakob
192.168.0.14 LOGOUT [0x56514d3110b2] -> dovecot/imap jakob
192.168.0.14 LOGOUT [0x56514d31113c] -> dovecot/imap jakob
192.168.0.14 LOGOUT [0x56514d311565] ->
dovecot/imap jakob 192.168.0.14 LOGOUT
[0x56514d311be2] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)
[0x7fb0fbd51bf9] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
[0x7fb0fbd53499] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)
[0x7fb0fbd51d02] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38)
[0x7fb0fbd51f18] ->
/usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13)
[0x7fb0fbccf1e3]
Jän 03 16:27:11 aldebaran dovecot[26460]:
imap(jakob)<26472>
child 26472 killed with signal 6 (core dumps disabled)
I get this errors when i open or search in a virtual folder. i have
enabled fts_lucene.
My config is:
# dovecot -n
# 2.3.devel (393bfbea8): /usr/local/etc/dovecot/dovecot.conf
# Pigeonhole version 0.5.0.rc1 (d68c23a1)
# OS: Linux 4.13.0-trunk-amd64 x86_64 Debian 9.3 btrfs
auth_mechanisms = plain login cram-md5 digest-md5
auth_socket_path = /usr/local/var/run/dovecot/auth-userdb
first_valid_uid = 1000
imap_capability = +XDOVECOT
imap_client_workarounds = tb-extra-mailbox-sep
lda_mailbox_autocreate = yes
lda_mailbox_autosubscribe = yes
listen = *, ::1
login_trusted_networks = 127.0.0.1/8 192.168.0.0/24 192.168.1.0/24
172.17.0.0/24 172.18.0.0/24
mail_gid = vmail
mail_home = /var/mail/%u
mail_location =
maildir:/var/mail/%u/Maildir:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/Maildir/%u:INDEXPVT=/var/lib/dovecot/db/indexes/Maildir/%u:CONTROL=/var/lib/dovecot/db/control/Maildir/%u
mail_plugins = zlib quota acl listescape mail_log notify virtual fts
fts_lucene
mail_privileged_group = vmail
mail_server_admin = mailto:jakob@xundeenergie.at
mail_shared_explicit_inbox = yes
mail_uid = vmail
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope
encoded-character vacation subaddress comparator-i;ascii-numeric
relational regex imap4flags copy include variables body enotify
environment mailbox date index ihave duplicate mime foreverypart
extracttext
namespace {
list = children
location =
maildir:/var/mail/public/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/public/%u:INDEXPVT=/var/lib/dovecot/db/indexes/public/%u
prefix = Roseggergasse/
separator = /
subscriptions = no
type = public
}
namespace Geteilt {
hidden = no
inbox = no
list = children
location =
maildir:/var/mail/%%u/Maildir:LAYOUT=fs:INDEXPVT=/var/lib/dovecot/db/indexes/shared/%u/%%u:INDEX=/var/lib/dovecot/db/indexes/shared/%u/%%u
prefix = Geteilt/%%n/
separator = /
subscriptions = no
type = shared
}
namespace Mailarchiv {
hidden = no
inbox = no
list = children
location =
maildir:/var/mail/mailarchiv/%u/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/mailarchiv/%u:INDEXPVT=/var/lib/dovecot/db/indexes/mailarchiv/%u
mailbox incoming {
auto = create
}
mailbox outgoing {
auto = create
}
prefix = Mailarchiv/
separator = /
subscriptions = no
type = private
}
namespace Real {
hidden = yes
list = no
location = virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u
prefix = Real/
separator = /
subscriptions = no
}
namespace Synoptic {
hidden = no
list = children
location =
virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u
mailbox INBOX/Archives {
auto = no
special_use = \Archive
}
mailbox INBOX/Drafts {
auto = no
special_use = \Drafts
}
mailbox INBOX/Entwürfe {
auto = no
special_use = \Drafts
}
mailbox INBOX/Junk {
auto = no
special_use = \Junk
}
mailbox INBOX/Sent {
auto = no
special_use = \Sent
}
mailbox INBOX/Spam {
auto = no
special_use = \Junk
}
prefix = Synoptic/
separator = /
subscriptions = no
}
namespace inbox {
hidden = no
inbox = yes
location =
mailbox Archiv {
auto = no
special_use = \Archive
}
mailbox Archive {
auto = no
special_use = \Archive
}
mailbox Archives {
auto = no
special_use = \Archive
}
mailbox "Deleted Messages" {
auto = no
autoexpunge = 30 days
special_use = \Trash
}
mailbox Drafts {
auto = no
special_use = \Drafts
}
mailbox Entwürfe {
auto = no
special_use = \Drafts
}
mailbox "Gelöschte Elemente" {
auto = no
autoexpunge = 30 days
special_use = \Trash
}
mailbox "Gelöschte Objekte" {
auto = no
autoexpunge = 30 days
special_use = \Trash
}
mailbox Gesendet {
auto = no
special_use = \Sent
}
mailbox "Gesendete Elemente" {
auto = no
special_use = \Sent
}
mailbox "Gesendete Objekte" {
auto = no
special_use = \Sent
}
mailbox Important {
auto = no
}
mailbox Junk {
auto = subscribe
autoexpunge = 30 days
special_use = \Junk
}
mailbox Mistkübel {
auto = no
autoexpunge = 30 days
special_use = \Trash
}
mailbox Papierkorb {
auto = no
autoexpunge = 30 days
special_use = \Trash
}
mailbox Sent {
auto = subscribe
special_use = \Sent
}
mailbox "Sent Messages" {
auto = no
special_use = \Sent
}
mailbox Spam {
auto = no
autoexpunge = 30 days
special_use = \Junk
}
mailbox Synoptic/Alle {
auto = no
comment = All my messages
special_use = \All
}
mailbox Trash {
auto = no
autoexpunge = 30 days
special_use = \Trash
}
mailbox Wichtig {
auto = create
}
prefix = INBOX/
separator = /
subscriptions = no
type = private
}
namespace subscriptions {
hidden = yes
list = no
location =
prefix =
subscriptions = yes
}
passdb {
args = scheme=CRYPT username_format=%u /usr/local/etc/dovecot/users
driver = passwd-file
}
plugin {
acl = vfile:/etc/dovecot/dovecot-acl:cache_secs=300
acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db
fts = lucene
fts_autoindex = yes
fts_autoindex_max_recent_msgs = 80
fts_index_timeout = 90s
fts_lucene = whitespace_chars=@. normalize no_snowball
mail_home = /var/mail/%u
setting_name = sieve, managedsieve
sieve = file:/var/mail/%u/sieve/;active=/var/mail/%u/sieve/%u.sieve
}
postmaster_address = postmaster@localhost
protocols = imap pop3 lmtp imap lmtp sieve pop3 sieve
service anvil {
unix_listener anvil-auth-penalty {
mode = 00
}
}
service auth {
unix_listener auth-client {
group = vmail
mode = 0666
user = Debian-exim
}
unix_listener auth-userdb {
group = vmail
mode = 0666
user = vmail
}
}
service imap-login {
inet_listener imap {
port = 143
}
inet_listener imaps {
port = 993
ssl = yes
}
process_min_avail = 1
service_count = 0
}
service imap {
executable = imap postlogin
process_limit = 1024
vsz_limit = 400 M
}
service lmtp {
executable = lmtp -L
user = vmail
vsz_limit = 400 M
}
service postlogin {
executable = script-login -d rawlog
}
ssl = required
ssl_cert =
fts fts_lucene quota sieve acl
}
protocol lda {
mail_plugins = zlib quota acl listescape mail_log notify virtual
fts fts_lucene quota sieve acl
}
protocol imap {
mail_max_userip_connections = 10
mail_plugins = zlib quota acl listescape mail_log notify virtual
fts fts_lucene imap_quota imap_acl
}
The virtual Folder-definitions are:
# find /var/mail/virtual/ /var/mail/real/ /var/mail/virtual/ /var/mail/virtual/GINBOX /var/mail/virtual/GINBOX/dovecot-virtual /var/mail/virtual/Neue /var/mail/virtual/Neue/dovecot-virtual /var/mail/virtual/Markierte /var/mail/virtual/Markierte/dovecot-virtual /var/mail/virtual/Ungelesene /var/mail/virtual/Ungelesene/dovecot-virtual /var/mail/virtual/Sent /var/mail/virtual/Sent/dovecot-virtual /var/mail/virtual/Drafts /var/mail/virtual/Drafts/dovecot-virtual /var/mail/virtual/Trash /var/mail/virtual/Trash/dovecot-virtual /var/mail/virtual/AKTUELL /var/mail/virtual/AKTUELL/dovecot-virtual /var/mail/virtual/Archives /var/mail/virtual/Archives/dovecot-virtual /var/mail/virtual/dovecot-acl-list /var/mail/virtual/WICHTIG /var/mail/virtual/WICHTIG/dovecot-virtual /var/mail/real/ /var/mail/real/Alle /var/mail/real/Alle/dovecot-virtual /var/mail/real/dovecot-acl-list /var/mail/real/einjahr /var/mail/real/einjahr/dovecot-virtual /var/mail/real/zweijahr /var/mail/real/zweijahr/dovecot-virtual /var/mail/real/dreijahr /var/mail/real/dreijahr/dovecot-virtual
# cat /var/mail/virtual/AKTUELL/dovecot-virtual Real/Alle inthread refs younger 2592000
# cat /var/mail/real/Alle/dovecot-virtual !INBOX INBOX/* -INBOX/Trash -INBOX/Trash/* -INBOX/Archives -INBOX/Archives/* -INBOX/Drafts -INBOX/Drafts/* -INBOX/Junk -INBOX/Junk/* -INBOX/SYSTEM -INBOX/SYSTEM/* all
The others are similar.
Greez
Jakob
This is not a bug in virtual plugin, but in some email which contains invalid unicode sequence somehow. Can you send me a core file? This should not have occured ofc but would be nice to know how it ended up here.
Aki
On January 3, 2018 at 5:35 PM Jakobus Schürz wertstoffe@nurfuerspam.de wrote:
Hi there!
I compiled dovecot 2.3 from git. Because there is already a bug in
virtual-plugin, and i hoped, it get fixed... but it doesn't. So this
is the error-message from the logJän 03 16:27:08 aldebaran dovecot[26460]:
indexer-worker(jakob)<26476>qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g:
Panic: file unichar.c: line 160 (uni_ucs4_to_utf8_c): assertion
failed: (uni_is_valid_ucs4(chr)) Jän 03 16:27:08 aldebaran dovecot[26460]:
indexer-worker(jakob)<26476>qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g:
Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021)
[0x7f8299f7a021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed)
[0x7f8299f7a0ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0)
[0x7f8299eec481] ->
/usr/local/lib/dovecot/libdovecot.so.0(uni_ucs4_to_utf8_c+0xa0)
[0x7f8299fb1500] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xa75e0)
[0x7f8299f5b5e0] ->
/usr/local/lib/dovecot/libdovecot.so.0(mail_html2text_more+0xc5)
[0x7f8299f5b775] ->
/usr/local/lib/dovecot/lib20_fts_plugin.so(+0xcfcc) [0x7f82990aefcc]
-> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_parser_more+0x27)
[0x7f82990aeca7] ->
/usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x5e9)
[0x7f82990acc39] ->
/usr/local/lib/dovecot/lib20_fts_plugin.so(+0x1122d) [0x7f82990b322d]
-> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x916a)
[0x7f82958e316a] ->
/usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10f5d) [0x7f82990b2f5d]
-> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x916a)
[0x7f82958e316a] ->
/usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10f5d) [0x7f82990b2f5d]
-> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x2e)
[0x7f829a2641be] -> dovecot/indexer-worker jakob
Synoptic/AKTUELL [0x562227882533] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)
[0x7f8299f91bf9] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
[0x7f8299f93499] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)
[0x7f8299f91d02] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38)
[0x7f8299f91f18] ->
/usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13)
[0x7f8299f0f1e3] -> dovecot/indexer-worker jakob
Synoptic/AKTUELL [0x562227881f47] ->
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1)
[0x7f8299b352b1] -> dovecot/indexer-worker jakob
Synoptic/AKTUELL [0x56222788201a] Jän 03 16:27:08 aldebaran dovecot[26460]: indexer: Error: Indexer
worker disconnected, discarding 1 requests for jakob Jän 03 16:27:08 aldebaran dovecot[26460]:
imap(jakob)<26472>: Error: indexer failed to index
mailbox Synoptic/AKTUELL Jän 03 16:27:08 aldebaran dovecot[26460]:
indexer-worker(jakob)<26476>qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g:
Fatal: master: service(indexer-worker): child 26476 killed with signal
6 (core dumps disabled) Jän 03 16:27:09 aldebaran dovecot[26460]:
indexer-worker(jakob)<26484>qQ6g1+BhIJvAqAAO:J6mUIEz2TFp0ZwAAk1Mx3g:
Error: lucene index
/var/lib/dovecot/db/indexes/Maildir/jakob/lucene-indexes:
IndexWriter() failed (#1): Lock obtain timed out Jän 03 16:27:10 aldebaran dovecot[26460]:
indexer-worker(jakob)<26484>qQ6g1+BhIJvAqAAO:J6mUIEz2TFp0ZwAAk1Mx3g:
Error: Mailbox Synoptic/AKTUELL: Transaction commit failed: BUG:
Unknown internal error (attempted to index 1488 messages (UIDs
15214..16775)) Jän 03 16:27:10 aldebaran dovecot[26460]:
imap(jakob)<26480><lP5r2OBhKJvAqAAO>: Error: indexer failed to index
mailbox Synoptic/AKTUELL Jän 03 16:27:11 aldebaran dovecot[26460]:
imap(jakob)<26472>: Panic: file mail-index.c: line
793 (mail_index_close): assertion failed: (index->open_count > 0) Jän 03 16:27:11 aldebaran dovecot[26460]:
imap(jakob)<26472>: Error: Raw backtrace:
/usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7fb0fbd3a021] ->
/usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7fb0fbd3a0ed] ->
/usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb0fbcac481] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf39a8)
[0x7fb0fc0d99a8] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd92d1)
[0x7fb0fc0bf2d1] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd9363)
[0x7fb0fc0bf363] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_free+0x9)
[0x7fb0fc0b0f39] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd05a4)
[0x7fb0fc0b65a4] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x19)
[0x7fb0fc030c99] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xabdc)
[0x7fb0f729bbdc] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9)
[0x7fb0f729bcb9] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
[0x7fb0fc030c0a] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xac60)
[0x7fb0f729bc60] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9)
[0x7fb0f729bcb9] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
[0x7fb0fc030c0a] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x13)
[0x7fb0fc030c93] -> dovecot/imap jakob 192.168.0.14
LOGOUT [0x56514d31305b] ->
dovecot/imap jakob 192.168.0.14 LOGOUT
[0x56514d309485] -> dovecot/imap jakob 192.168.0.14
LOGOUT [0x56514d312ca4] -> dovecot/imap jakob
192.168.0.14 LOGOUT [0x56514d3110b2] -> dovecot/imap jakob
192.168.0.14 LOGOUT [0x56514d31113c] -> dovecot/imap jakob
192.168.0.14 LOGOUT [0x56514d311565] ->
dovecot/imap jakob 192.168.0.14 LOGOUT
[0x56514d311be2] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)
[0x7fb0fbd51bf9] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
[0x7fb0fbd53499] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)
[0x7fb0fbd51d02] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38)
[0x7fb0fbd51f18] ->
/usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13)
[0x7fb0fbccf1e3] Jän 03 16:27:11 aldebaran dovecot[26460]:
imap(jakob)<26472>: Fatal: master: service(imap):
child 26472 killed with signal 6 (core dumps disabled)I get this errors when i open or search in a virtual folder. i have
enabled fts_lucene.My config is:
# dovecot -n # 2.3.devel (393bfbea8): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.rc1 (d68c23a1) # OS: Linux 4.13.0-trunk-amd64 x86_64 Debian 9.3 btrfs auth_mechanisms = plain login cram-md5 digest-md5 auth_socket_path = /usr/local/var/run/dovecot/auth-userdb first_valid_uid = 1000 imap_capability = +XDOVECOT imap_client_workarounds = tb-extra-mailbox-sep lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = *, ::1 login_trusted_networks = 127.0.0.1/8 192.168.0.0/24 192.168.1.0/24
172.17.0.0/24 172.18.0.0/24 mail_gid = vmail mail_home = /var/mail/%u mail_location =
maildir:/var/mail/%u/Maildir:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/Maildir/%u:INDEXPVT=/var/lib/dovecot/db/indexes/Maildir/%u:CONTROL=/var/lib/dovecot/db/control/Maildir/%u mail_plugins = zlib quota acl listescape mail_log notify virtual fts
fts_lucene mail_privileged_group = vmail mail_server_admin = mailto:jakob@xundeenergie.at mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope
encoded-character vacation subaddress comparator-i;ascii-numeric
relational regex imap4flags copy include variables body enotify
environment mailbox date index ihave duplicate mime foreverypart
extracttext namespace { list = children location =
maildir:/var/mail/public/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/public/%u:INDEXPVT=/var/lib/dovecot/db/indexes/public/%u prefix = Roseggergasse/ separator = / subscriptions = no type = public } namespace Geteilt { hidden = no inbox = no list = children location =
maildir:/var/mail/%%u/Maildir:LAYOUT=fs:INDEXPVT=/var/lib/dovecot/db/indexes/shared/%u/%%u:INDEX=/var/lib/dovecot/db/indexes/shared/%u/%%u prefix = Geteilt/%%n/ separator = / subscriptions = no type = shared } namespace Mailarchiv { hidden = no inbox = no list = children location =
maildir:/var/mail/mailarchiv/%u/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/mailarchiv/%u:INDEXPVT=/var/lib/dovecot/db/indexes/mailarchiv/%u mailbox incoming { auto = create } mailbox outgoing { auto = create } prefix = Mailarchiv/ separator = / subscriptions = no type = private } namespace Real { hidden = yes list = no location = virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u prefix = Real/ separator = / subscriptions = no } namespace Synoptic { hidden = no list = children location =
virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u mailbox INBOX/Archives { auto = no special_use = \Archive } mailbox INBOX/Drafts { auto = no special_use = \Drafts } mailbox INBOX/Entwürfe { auto = no special_use = \Drafts } mailbox INBOX/Junk { auto = no special_use = \Junk } mailbox INBOX/Sent { auto = no special_use = \Sent } mailbox INBOX/Spam { auto = no special_use = \Junk } prefix = Synoptic/ separator = / subscriptions = no } namespace inbox { hidden = no inbox = yes location = mailbox Archiv { auto = no special_use = \Archive } mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } mailbox "Deleted Messages" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Drafts { auto = no special_use = \Drafts } mailbox Entwürfe { auto = no special_use = \Drafts } mailbox "Gelöschte Elemente" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox "Gelöschte Objekte" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Gesendet { auto = no special_use = \Sent } mailbox "Gesendete Elemente" { auto = no special_use = \Sent } mailbox "Gesendete Objekte" { auto = no special_use = \Sent } mailbox Important { auto = no } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Mistkübel { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Papierkorb { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Synoptic/Alle { auto = no comment = All my messages special_use = \All } mailbox Trash { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Wichtig { auto = create } prefix = INBOX/ separator = / subscriptions = no type = private } namespace subscriptions { hidden = yes list = no location = prefix = subscriptions = yes } passdb { args = scheme=CRYPT username_format=%u /usr/local/etc/dovecot/users driver = passwd-file } plugin { acl = vfile:/etc/dovecot/dovecot-acl:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db fts = lucene fts_autoindex = yes fts_autoindex_max_recent_msgs = 80 fts_index_timeout = 90s fts_lucene = whitespace_chars=@. normalize no_snowball mail_home = /var/mail/%u setting_name = sieve, managedsieve sieve = file:/var/mail/%u/sieve/;active=/var/mail/%u/sieve/%u.sieve } postmaster_address = postmaster@localhost protocols = imap pop3 lmtp imap lmtp sieve pop3 sieve service anvil { unix_listener anvil-auth-penalty { mode = 00 } } service auth { unix_listener auth-client { group = vmail mode = 0666 user = Debian-exim } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { executable = imap postlogin process_limit = 1024 vsz_limit = 400 M } service lmtp { executable = lmtp -L user = vmail vsz_limit = 400 M } service postlogin { executable = script-login -d rawlog } ssl = required ssl_cert = fts fts_lucene quota sieve acl } protocol lda { mail_plugins = zlib quota acl listescape mail_log notify virtual
fts fts_lucene quota sieve acl } protocol imap { mail_max_userip_connections = 10 mail_plugins = zlib quota acl listescape mail_log notify virtual
fts fts_lucene imap_quota imap_acl }The virtual Folder-definitions are:
# find /var/mail/virtual/ /var/mail/real/ /var/mail/virtual/ /var/mail/virtual/GINBOX /var/mail/virtual/GINBOX/dovecot-virtual /var/mail/virtual/Neue /var/mail/virtual/Neue/dovecot-virtual /var/mail/virtual/Markierte /var/mail/virtual/Markierte/dovecot-virtual /var/mail/virtual/Ungelesene /var/mail/virtual/Ungelesene/dovecot-virtual /var/mail/virtual/Sent /var/mail/virtual/Sent/dovecot-virtual /var/mail/virtual/Drafts /var/mail/virtual/Drafts/dovecot-virtual /var/mail/virtual/Trash /var/mail/virtual/Trash/dovecot-virtual /var/mail/virtual/AKTUELL /var/mail/virtual/AKTUELL/dovecot-virtual /var/mail/virtual/Archives /var/mail/virtual/Archives/dovecot-virtual /var/mail/virtual/dovecot-acl-list /var/mail/virtual/WICHTIG /var/mail/virtual/WICHTIG/dovecot-virtual /var/mail/real/ /var/mail/real/Alle /var/mail/real/Alle/dovecot-virtual /var/mail/real/dovecot-acl-list /var/mail/real/einjahr /var/mail/real/einjahr/dovecot-virtual /var/mail/real/zweijahr /var/mail/real/zweijahr/dovecot-virtual /var/mail/real/dreijahr /var/mail/real/dreijahr/dovecot-virtual
# cat /var/mail/virtual/AKTUELL/dovecot-virtual Real/Alle inthread refs younger 2592000
# cat /var/mail/real/Alle/dovecot-virtual !INBOX INBOX/* -INBOX/Trash -INBOX/Trash/* -INBOX/Archives -INBOX/Archives/* -INBOX/Drafts -INBOX/Drafts/* -INBOX/Junk -INBOX/Junk/* -INBOX/SYSTEM -INBOX/SYSTEM/* all
The others are similar.
Greez
Jakob
Hi!
Is this a bug according to the other one?
When i try to open a real or virtual mailbox, i often (not on every
mailbox) get this error-message:
Jän 04 11:03:32 aldebaran dovecot[24534]:
imap(jakob)<24705>
/var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened
in index-storage.c:336
Jän 04 11:03:32 aldebaran dovecot[24534]:
imap(jakob)<24705>
/usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] ->
/usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] ->
/usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942)
[0x7f47d5c11942] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72) [0x7f47d5be8ec2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f47d5b68c0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7f47d0dd397b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026) [0x7f47d0dd6926] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7f47d5be7781] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1) [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975) [0x7f47d5001975] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7f47d5b6b4b1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d) [0x7f47d0dd6a4d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195a91a1] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195b0ca4] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af0b2] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af13c] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af565] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195afbe2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f47d5889bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7f47d588b499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)
[0x7f47d5889d02]
Jän 04 11:03:32 aldebaran dovecot[24534]:
imap(jakob)<24705>
child 24705 killed with signal 6 (core dumps disabled)
I deinstalled all debian-dovecot-packages and installed the user
dovenull manually again. This is all, i did.
jakob
Hi!
This is very strange... This error affects only one mailaccount, and it happend not yesterday. The file
/var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
which hat "Panic: Leaked view for index" does not exist. only dovecot.index.log and .cache exists in this mailbox. (which is normal for small mailboxes, i've read). But why is dovecot throwing an error?
And i could find out, this is only, when i try to open a virtual folder.
I switched back to older self-compiled dovecot-versions... but the error exists also there (but not before the update!!!)
I also deleted all the dovecot.index-files, dovecot.index.log and dovecot.index.cache-files to let rebuild dovecot the index again... the error persists.
Is it a misconfiguration?
So i tried to build for the virtual-Mailboxes the Index in memory... the error persists and dovecot wants to read this index-file.
My virtual folders not working any longer (on this account only!)
For debug purpose i deleted all the emails in this mailbox, the error dissapered on this folder, but comes back in the next folder.
could this be a problem with ulimit?
greez jakob
Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
Hi!
Is this a bug according to the other one?
When i try to open a real or virtual mailbox, i often (not on every mailbox) get this error-message:
Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705>
: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in index-storage.c:336 Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705> : Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942) [0x7f47d5c11942] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72) [0x7f47d5be8ec2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f47d5b68c0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7f47d0dd397b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026) [0x7f47d0dd6926] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7f47d5be7781] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1) [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975) [0x7f47d5001975] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7f47d5b6b4b1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d) [0x7f47d0dd6a4d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195a91a1] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195b0ca4] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af0b2] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af13c] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af565] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195afbe2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f47d5889bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7f47d588b499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f47d5889d02] Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705> : Fatal: master: service(imap): child 24705 killed with signal 6 (core dumps disabled) I deinstalled all debian-dovecot-packages and installed the user dovenull manually again. This is all, i did.
jakob
Good morning!
I did more research on this error. The virtual mailboxes are working in two other accounts. The big difference to my account is, i have a lot (sub)mailboxes (about 430) and a lot emails in my account. The other accounts only have a few emails and mailboxes (5 or 6 standard, inbox, trash, templates...)
So i moved all my mailboxes to another place and left there only a few. The virtual mailbox is working. Then i put back some mailboxes, it is working. Then i put back the next and the next and tried if the virtual mailbox is reachable. it was working, and after i put back more then a half of my mailboxes, the error occured again. dovecot says:
Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/TU-Wien/dovecot.index: Opened in index-storage.c:336
The missing dovecot.indes file is now another. But it is on every error-message the same missing indes-file.
Deleting the according mailbox, it gets another missing index-file. And the every error-message stays on the next indes-file...
It looks to me, it'S a question about too many mailboxes, then an internal index gets broken and can't rebuild on the every same point (mailbox). This is just an idea, but i don't know how dovecot really works...
I do not understand, why it worked till yesterday. And why it breaked on deleting not used debian-packages... (maybe this is not the reason)
I removed all my virtual mailboxes from config
Am 04.01.2018 um 22:41 schrieb Jakob Schürz:
Hi!
This is very strange... This error affects only one mailaccount, and it happend not yesterday. The file
/var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
which hat "Panic: Leaked view for index" does not exist. only dovecot.index.log and .cache exists in this mailbox. (which is normal for small mailboxes, i've read). But why is dovecot throwing an error?
And i could find out, this is only, when i try to open a virtual folder.
I switched back to older self-compiled dovecot-versions... but the error exists also there (but not before the update!!!)
I also deleted all the dovecot.index-files, dovecot.index.log and dovecot.index.cache-files to let rebuild dovecot the index again... the error persists.
Is it a misconfiguration?
So i tried to build for the virtual-Mailboxes the Index in memory... the error persists and dovecot wants to read this index-file.
My virtual folders not working any longer (on this account only!)
For debug purpose i deleted all the emails in this mailbox, the error dissapered on this folder, but comes back in the next folder.
could this be a problem with ulimit?
greez jakob
Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
Hi!
Is this a bug according to the other one?
When i try to open a real or virtual mailbox, i often (not on every mailbox) get this error-message:
Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705>
: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in index-storage.c:336 Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705> : Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942) [0x7f47d5c11942] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72) [0x7f47d5be8ec2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f47d5b68c0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7f47d0dd397b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026) [0x7f47d0dd6926] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7f47d5be7781] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1) [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975) [0x7f47d5001975] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7f47d5b6b4b1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d) [0x7f47d0dd6a4d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195a91a1] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195b0ca4] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af0b2] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af13c] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af565] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195afbe2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f47d5889bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7f47d588b499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f47d5889d02] Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705> : Fatal: master: service(imap): child 24705 killed with signal 6 (core dumps disabled) I deinstalled all debian-dovecot-packages and installed the user dovenull manually again. This is all, i did.
jakob
This is a different bug, and I suspect it might be caused by virtual plugin. We'll look into it.
Aki
On 04.01.2018 23:41, Jakob Schürz wrote:
Hi!
This is very strange... This error affects only one mailaccount, and it happend not yesterday. The file
/var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
which hat "Panic: Leaked view for index" does not exist. only dovecot.index.log and .cache exists in this mailbox. (which is normal for small mailboxes, i've read). But why is dovecot throwing an error?
And i could find out, this is only, when i try to open a virtual folder.
I switched back to older self-compiled dovecot-versions... but the error exists also there (but not before the update!!!)
I also deleted all the dovecot.index-files, dovecot.index.log and dovecot.index.cache-files to let rebuild dovecot the index again... the error persists.
Is it a misconfiguration?
So i tried to build for the virtual-Mailboxes the Index in memory... the error persists and dovecot wants to read this index-file.
My virtual folders not working any longer (on this account only!)
For debug purpose i deleted all the emails in this mailbox, the error dissapered on this folder, but comes back in the next folder.
could this be a problem with ulimit?
greez jakob
Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
Hi!
Is this a bug according to the other one?
When i try to open a real or virtual mailbox, i often (not on every mailbox) get this error-message:
Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705>
: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in index-storage.c:336 Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705> : Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942) [0x7f47d5c11942] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72) [0x7f47d5be8ec2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f47d5b68c0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7f47d0dd397b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026) [0x7f47d0dd6926] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7f47d5be7781] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1) [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975) [0x7f47d5001975] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7f47d5b6b4b1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d) [0x7f47d0dd6a4d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195a91a1] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195b0ca4] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af0b2] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af13c] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af565] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195afbe2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f47d5889bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7f47d588b499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f47d5889d02] Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705> : Fatal: master: service(imap): child 24705 killed with signal 6 (core dumps disabled) I deinstalled all debian-dovecot-packages and installed the user dovenull manually again. This is all, i did.
jakob
Ok! So the subject for this bug is correct...
Do you need some configs and deeper descriptions from me?
I have two namespaces with virtual mailboxes: The first "Real" is normally hidden. It's not hidden now for debug-purpose.
namespace Real { hidden = no ignore_on_failure = yes list = children location = virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u prefix = Real/ separator = / subscriptions = no }
namespace Synoptic { hidden = no ignore_on_failure = yes list = children location = virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u mailbox INBOX/Archives { auto = no special_use = \Archive } mailbox INBOX/Drafts { auto = no special_use = \Drafts } mailbox INBOX/Entwürfe { auto = no special_use = \Drafts } mailbox INBOX/Junk { auto = no special_use = \Junk } mailbox INBOX/Sent { auto = no special_use = \Sent } mailbox INBOX/Spam { auto = no special_use = \Junk } prefix = Synoptic/ separator = / subscriptions = no }
The "Real" namespace is to get a first filter for emails for all, the last 1, 2 and 3 years:
Here is the virtual-mailbox-definition:
/var/mail/real: # tree . ├── Alle │ └── dovecot-virtual ├── dovecot-acl-list ├── dreijahr │ └── dovecot-virtual ├── einjahr │ └── dovecot-virtual └── zweijahr └── dovecot-virtual
and the index-files /var/lib/dovecot/db/indexes: # tree real/ real/ └── jakob ├── Alle │ └── dovecot.index.log ├── dovecot.list.index.log ├── dreijahr │ └── dovecot.index.log ├── einjahr │ └── dovecot.index.log └── zweijahr └── dovecot.index.log
/var/mail/real: # cat Alle/dovecot-virtual !INBOX INBOX/* -INBOX/Trash -INBOX/Trash/* -INBOX/Archives -INBOX/Archives/* -INBOX/Drafts -INBOX/Drafts/* -INBOX/Junk -INBOX/Junk/* -INBOX/SYSTEM -INBOX/SYSTEM/* all
/var/mail/real: # cat einjahr/dovecot-virtual Real/Alle all younger 31536000
And the namespace Synoptic is the one, i can subscribe. It has as Background the "Real"-namespace:
/var/mail/virtual: # tree . ├── AKTUELL │ └── dovecot-virtual ├── Archives │ └── dovecot-virtual ├── dovecot-acl-list ├── Drafts │ └── dovecot-virtual ├── GINBOX │ └── dovecot-virtual ├── Markierte │ └── dovecot-virtual ├── Neue │ └── dovecot-virtual ├── Sent │ └── dovecot-virtual ├── Trash │ └── dovecot-virtual ├── Ungelesene │ └── dovecot-virtual └── WICHTIG └── dovecot-virtual
/var/mail/virtual: # cat AKTUELL/dovecot-virtual Real/einjahr inthread refs younger 2592000
/var/mail/virtual: # cat Markierte/dovecot-virtual Real/Alle flagged
The error only appears in a Mailbox from one of this two namespaces. Every other mailboxes (public, private, shared) are working correct. When i try to open a mailbox from one of this two namespaces, the error below (Panic: Leaked view for index) is throwen
jakob
Am 05.01.2018 um 10:25 schrieb Aki Tuomi:
This is a different bug, and I suspect it might be caused by virtual plugin. We'll look into it.
Aki
On 04.01.2018 23:41, Jakob Schürz wrote:
Hi!
This is very strange... This error affects only one mailaccount, and it happend not yesterday. The file
/var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
which hat "Panic: Leaked view for index" does not exist. only dovecot.index.log and .cache exists in this mailbox. (which is normal for small mailboxes, i've read). But why is dovecot throwing an error?
And i could find out, this is only, when i try to open a virtual folder.
I switched back to older self-compiled dovecot-versions... but the error exists also there (but not before the update!!!)
I also deleted all the dovecot.index-files, dovecot.index.log and dovecot.index.cache-files to let rebuild dovecot the index again... the error persists.
Is it a misconfiguration?
So i tried to build for the virtual-Mailboxes the Index in memory... the error persists and dovecot wants to read this index-file.
My virtual folders not working any longer (on this account only!)
For debug purpose i deleted all the emails in this mailbox, the error dissapered on this folder, but comes back in the next folder.
could this be a problem with ulimit?
greez jakob
Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
Hi!
Is this a bug according to the other one?
When i try to open a real or virtual mailbox, i often (not on every mailbox) get this error-message:
Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705>
: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in index-storage.c:336 Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705> : Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942) [0x7f47d5c11942] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72) [0x7f47d5be8ec2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f47d5b68c0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7f47d0dd397b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026) [0x7f47d0dd6926] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7f47d5be7781] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1) [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975) [0x7f47d5001975] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7f47d5b6b4b1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d) [0x7f47d0dd6a4d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195a91a1] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195b0ca4] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af0b2] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af13c] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af565] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195afbe2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f47d5889bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7f47d588b499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f47d5889d02] Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705> : Fatal: master: service(imap): child 24705 killed with signal 6 (core dumps disabled) I deinstalled all debian-dovecot-packages and installed the user dovenull manually again. This is all, i did.
jakob
Does it always happen with 2.2 and 2.3? I was not immediately able to reproduce your problem.
Aki
On 05.01.2018 12:26, Jakobus Schürz wrote:
Ok! So the subject for this bug is correct...
Do you need some configs and deeper descriptions from me?
I have two namespaces with virtual mailboxes: The first "Real" is normally hidden. It's not hidden now for debug-purpose.
namespace Real { hidden = no ignore_on_failure = yes list = children location = virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u prefix = Real/ separator = / subscriptions = no }
namespace Synoptic { hidden = no ignore_on_failure = yes list = children location = virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u mailbox INBOX/Archives { auto = no special_use = \Archive } mailbox INBOX/Drafts { auto = no special_use = \Drafts } mailbox INBOX/Entwürfe { auto = no special_use = \Drafts } mailbox INBOX/Junk { auto = no special_use = \Junk } mailbox INBOX/Sent { auto = no special_use = \Sent } mailbox INBOX/Spam { auto = no special_use = \Junk } prefix = Synoptic/ separator = / subscriptions = no }
The "Real" namespace is to get a first filter for emails for all, the last 1, 2 and 3 years:
Here is the virtual-mailbox-definition:
/var/mail/real: # tree . ├── Alle │ └── dovecot-virtual ├── dovecot-acl-list ├── dreijahr │ └── dovecot-virtual ├── einjahr │ └── dovecot-virtual └── zweijahr └── dovecot-virtual
and the index-files /var/lib/dovecot/db/indexes: # tree real/ real/ └── jakob ├── Alle │ └── dovecot.index.log ├── dovecot.list.index.log ├── dreijahr │ └── dovecot.index.log ├── einjahr │ └── dovecot.index.log └── zweijahr └── dovecot.index.log
/var/mail/real: # cat Alle/dovecot-virtual !INBOX INBOX/* -INBOX/Trash -INBOX/Trash/* -INBOX/Archives -INBOX/Archives/* -INBOX/Drafts -INBOX/Drafts/* -INBOX/Junk -INBOX/Junk/* -INBOX/SYSTEM -INBOX/SYSTEM/* all
/var/mail/real: # cat einjahr/dovecot-virtual Real/Alle all younger 31536000
And the namespace Synoptic is the one, i can subscribe. It has as Background the "Real"-namespace:
/var/mail/virtual: # tree . ├── AKTUELL │ └── dovecot-virtual ├── Archives │ └── dovecot-virtual ├── dovecot-acl-list ├── Drafts │ └── dovecot-virtual ├── GINBOX │ └── dovecot-virtual ├── Markierte │ └── dovecot-virtual ├── Neue │ └── dovecot-virtual ├── Sent │ └── dovecot-virtual ├── Trash │ └── dovecot-virtual ├── Ungelesene │ └── dovecot-virtual └── WICHTIG └── dovecot-virtual
/var/mail/virtual: # cat AKTUELL/dovecot-virtual Real/einjahr inthread refs younger 2592000
/var/mail/virtual: # cat Markierte/dovecot-virtual Real/Alle flagged
The error only appears in a Mailbox from one of this two namespaces. Every other mailboxes (public, private, shared) are working correct. When i try to open a mailbox from one of this two namespaces, the error below (Panic: Leaked view for index) is throwen
jakob
Am 05.01.2018 um 10:25 schrieb Aki Tuomi:
This is a different bug, and I suspect it might be caused by virtual plugin. We'll look into it.
Aki
On 04.01.2018 23:41, Jakob Schürz wrote:
Hi!
This is very strange... This error affects only one mailaccount, and it happend not yesterday. The file
/var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
which hat "Panic: Leaked view for index" does not exist. only dovecot.index.log and .cache exists in this mailbox. (which is normal for small mailboxes, i've read). But why is dovecot throwing an error?
And i could find out, this is only, when i try to open a virtual folder.
I switched back to older self-compiled dovecot-versions... but the error exists also there (but not before the update!!!)
I also deleted all the dovecot.index-files, dovecot.index.log and dovecot.index.cache-files to let rebuild dovecot the index again... the error persists.
Is it a misconfiguration?
So i tried to build for the virtual-Mailboxes the Index in memory... the error persists and dovecot wants to read this index-file.
My virtual folders not working any longer (on this account only!)
For debug purpose i deleted all the emails in this mailbox, the error dissapered on this folder, but comes back in the next folder.
could this be a problem with ulimit?
greez jakob
Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
Hi!
Is this a bug according to the other one?
When i try to open a real or virtual mailbox, i often (not on every mailbox) get this error-message:
Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705>
: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in index-storage.c:336 Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705> : Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942) [0x7f47d5c11942] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72) [0x7f47d5be8ec2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f47d5b68c0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b)
[0x7f47d0dd397b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026)
[0x7f47d0dd6926] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31)
[0x7f47d5be7781] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1) [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975) [0x7f47d5001975] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31)
[0x7f47d5b6b4b1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d)
[0x7f47d0dd6a4d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195a91a1] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195b0ca4] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af0b2] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af13c] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af565] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195afbe2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f47d5889bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
[0x7f47d588b499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f47d5889d02] Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705>
: Fatal: master: service(imap): child 24705 killed with signal 6 (core dumps disabled) I deinstalled all debian-dovecot-packages and installed the user dovenull manually again. This is all, i did.
jakob
Am 05.01.2018 um 10:25 schrieb Aki Tuomi:
This is a different bug, and I suspect it might be caused by virtual plugin. We'll look into it.
Aki
Ok! So the subject for this bug is (now) correct...
I found out, that the count of mailboxes is not the problem. But the count of emails!! So i deletet all my mailboxes an created them new with doveadm. 430 empty mailboxes existed then. No problem with my virtual boxes. Then i restored my emails mailbox for mailbox from backup. After each restored mailbox i tested the virtual mailboxes.
It worked with 15482 emails. Then i restored a larger one. The total amount of emails was then 16843, and the virtual mailbox crashed like before. Then i deleted the emails from the box... all is working. I added them again, deletet 200, all is working. deleted all of them again and added them again... so they are again 16844 (one email arrived in another mailbox), all is working. :-/
Put more and more emails to my mailboxes... checking every time if virtual mailboxes are working, so i get a new error:
Jän 05 14:28:18 aldebaran dovecot[17022]:
imap(jakob)<5117>
Do you need some configs and deeper descriptions from me?
I have two namespaces with virtual mailboxes: The first "Real" is normally hidden. It's not hidden now for debug-purpose.
namespace Real { hidden = no ignore_on_failure = yes list = children location = virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u prefix = Real/ separator = / subscriptions = no }
namespace Synoptic { hidden = no ignore_on_failure = yes list = children location = virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u mailbox INBOX/Archives { auto = no special_use = \Archive } mailbox INBOX/Drafts { auto = no special_use = \Drafts } mailbox INBOX/Entwürfe { auto = no special_use = \Drafts } mailbox INBOX/Junk { auto = no special_use = \Junk } mailbox INBOX/Sent { auto = no special_use = \Sent } mailbox INBOX/Spam { auto = no special_use = \Junk } prefix = Synoptic/ separator = / subscriptions = no }
The "Real" namespace is to get a first filter for emails for all, the last 1, 2 and 3 years:
Here is the virtual-mailbox-definition:
/var/mail/real: # tree . ├── Alle │ └── dovecot-virtual ├── dovecot-acl-list ├── dreijahr │ └── dovecot-virtual ├── einjahr │ └── dovecot-virtual └── zweijahr └── dovecot-virtual
and the index-files /var/lib/dovecot/db/indexes: # tree real/ real/ └── jakob ├── Alle │ └── dovecot.index.log ├── dovecot.list.index.log ├── dreijahr │ └── dovecot.index.log ├── einjahr │ └── dovecot.index.log └── zweijahr └── dovecot.index.log
/var/mail/real: # cat Alle/dovecot-virtual !INBOX INBOX/* -INBOX/Trash -INBOX/Trash/* -INBOX/Archives -INBOX/Archives/* -INBOX/Drafts -INBOX/Drafts/* -INBOX/Junk -INBOX/Junk/* -INBOX/SYSTEM -INBOX/SYSTEM/* all
/var/mail/real: # cat einjahr/dovecot-virtual Real/Alle all younger 31536000
And the namespace Synoptic is the one, i can subscribe. It has as Background the "Real"-namespace:
/var/mail/virtual: # tree . ├── AKTUELL │ └── dovecot-virtual ├── Archives │ └── dovecot-virtual ├── dovecot-acl-list ├── Drafts │ └── dovecot-virtual ├── GINBOX │ └── dovecot-virtual ├── Markierte │ └── dovecot-virtual ├── Neue │ └── dovecot-virtual ├── Sent │ └── dovecot-virtual ├── Trash │ └── dovecot-virtual ├── Ungelesene │ └── dovecot-virtual └── WICHTIG └── dovecot-virtual
/var/mail/virtual: # cat AKTUELL/dovecot-virtual Real/einjahr inthread refs younger 2592000
/var/mail/virtual: # cat Markierte/dovecot-virtual Real/Alle flagged
The error only appears in a Mailbox from one of this two namespaces. Every other mailboxes (public, private, shared) are working correct. When i try to open a mailbox from one of this two namespaces, the error below (Panic: Leaked view for index) is throwen
jakob
On 04.01.2018 23:41, Jakob Schürz wrote:
Hi!
This is very strange... This error affects only one mailaccount, and it happend not yesterday. The file
/var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
which hat "Panic: Leaked view for index" does not exist. only dovecot.index.log and .cache exists in this mailbox. (which is normal for small mailboxes, i've read). But why is dovecot throwing an error?
And i could find out, this is only, when i try to open a virtual folder.
I switched back to older self-compiled dovecot-versions... but the error exists also there (but not before the update!!!)
I also deleted all the dovecot.index-files, dovecot.index.log and dovecot.index.cache-files to let rebuild dovecot the index again... the error persists.
Is it a misconfiguration?
So i tried to build for the virtual-Mailboxes the Index in memory... the error persists and dovecot wants to read this index-file.
My virtual folders not working any longer (on this account only!)
For debug purpose i deleted all the emails in this mailbox, the error dissapered on this folder, but comes back in the next folder.
could this be a problem with ulimit?
greez jakob
Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
Hi!
Is this a bug according to the other one?
When i try to open a real or virtual mailbox, i often (not on every mailbox) get this error-message:
Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705>
: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in index-storage.c:336 Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705> : Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942) [0x7f47d5c11942] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72) [0x7f47d5be8ec2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f47d5b68c0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7f47d0dd397b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026) [0x7f47d0dd6926] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7f47d5be7781] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1) [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975) [0x7f47d5001975] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7f47d5b6b4b1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d) [0x7f47d0dd6a4d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195a91a1] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195b0ca4] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af0b2] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af13c] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af565] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195afbe2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f47d5889bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7f47d588b499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f47d5889d02] Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705> : Fatal: master: service(imap): child 24705 killed with signal 6 (core dumps disabled) I deinstalled all debian-dovecot-packages and installed the user dovenull manually again. This is all, i did.
jakob
Hi!
Now an error is back. I didn't change my configuration and get now this error, whily i try to refresh my thunderbird. I think it happens in a virtual folder again.
Jän 11 01:29:19 aldebaran dovecot[11597]: imap-login: Login: user=<jakob>, method=CRAM-MD5, rip=127.0.0.1, lip=127.0.0.1, mpid=5008, TLS, session=<+MAgPXVisrx/AAAB> Jän 11 01:29:22 aldebaran dovecot[11597]: imap(jakob)<5008><+MAgPXVisrx/AAAB>: Panic: file mail-index.c: line 793 (mail_index_close): assertion failed: (index->open_count > 0) Jän 11 01:29:22 aldebaran dovecot[11597]: imap(jakob)<5008><+MAgPXVisrx/AAAB>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7fd17fbb9021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7fd17fbb90ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fd17fb2b481] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf39a8) [0x7fd17ff589a8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd92d1) [0x7fd17ff3e2d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd9363) [0x7fd17ff3e363] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_free+0x9) [0x7fd17ff2ff39] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd05a4) [0x7fd17ff355a4] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x19) [0x7fd17feafc99] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xabdc) [0x7fd17b11abdc] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9) [0x7fd17b11acb9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fd17feafc0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xac60) [0x7fd17b11ac60] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9) [0x7fd17b11acb9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fd17feafc0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xac60) [0x7fd17b11ac60] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9) [0x7fd17b11acb9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fd17feafc0a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x13) [0x7fd17feafc93] -> dovecot/imap jakob 127.0.0.1 select [0x5633bdd9905b] -> dovecot/imap jakob 127.0.0.1 select [0x5633bdd90f03] -> dovecot/imap jakob 127.0.0.1 select [0x5633bdd91129] -> dovecot/imap jakob 127.0.0.1 select [0x5633bdd98ca4] -> dovecot/imap jakob 127.0.0.1 select [0x5633bdd970b2] -> dovecot/imap jakob 127.0.0.1 select [0x5633bdd9713c] -> dovecot/imap jakob 127.0.0.1 select [0x5633bdd97565] -> dovecot/imap jakob 127.0.0.1 select [0x5633bdd97be2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7fd17fbd0c09] Jän 11 01:29:22 aldebaran dovecot[11597]: imap(jakob)<5008><+MAgPXVisrx/AAAB>: Fatal: master: service(imap): child 5008 killed with signal 6 (core not dumped)
Am 2018-01-05 um 10:25 schrieb Aki Tuomi:
This is a different bug, and I suspect it might be caused by virtual plugin. We'll look into it.
Aki
On 04.01.2018 23:41, Jakob Schürz wrote:
Hi!
This is very strange... This error affects only one mailaccount, and it happend not yesterday. The file
/var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
which hat "Panic: Leaked view for index" does not exist. only dovecot.index.log and .cache exists in this mailbox. (which is normal for small mailboxes, i've read). But why is dovecot throwing an error?
And i could find out, this is only, when i try to open a virtual folder.
I switched back to older self-compiled dovecot-versions... but the error exists also there (but not before the update!!!)
I also deleted all the dovecot.index-files, dovecot.index.log and dovecot.index.cache-files to let rebuild dovecot the index again... the error persists.
Is it a misconfiguration?
So i tried to build for the virtual-Mailboxes the Index in memory... the error persists and dovecot wants to read this index-file.
My virtual folders not working any longer (on this account only!)
For debug purpose i deleted all the emails in this mailbox, the error dissapered on this folder, but comes back in the next folder.
could this be a problem with ulimit?
greez jakob
Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
Hi!
Is this a bug according to the other one?
When i try to open a real or virtual mailbox, i often (not on every mailbox) get this error-message:
Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705>
: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in index-storage.c:336 Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705> : Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942) [0x7f47d5c11942] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72) [0x7f47d5be8ec2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f47d5b68c0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7f47d0dd397b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026) [0x7f47d0dd6926] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7f47d5be7781] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1) [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975) [0x7f47d5001975] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7f47d5b6b4b1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d) [0x7f47d0dd6a4d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195a91a1] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195b0ca4] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af0b2] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af13c] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195af565] -> dovecot/imap jakob 192.168.0.14 EXAMINE [0x555d195afbe2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f47d5889bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7f47d588b499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f47d5889d02] Jän 04 11:03:32 aldebaran dovecot[24534]: imap(jakob)<24705> : Fatal: master: service(imap): child 24705 killed with signal 6 (core dumps disabled) I deinstalled all debian-dovecot-packages and installed the user dovenull manually again. This is all, i did.
jakob
Hi, did you have time to investigate about 'Panic: file unichar.c' bug ? Because I have the same problem with a 2.3.0 installation without virtual plugin.
Thanks, Marco
On 2018-01-03 16:52, Aki Tuomi wrote:
This is not a bug in virtual plugin, but in some email which contains invalid unicode sequence somehow. Can you send me a core file? This should not have occured ofc but would be nice to know how it ended up here.
Aki
On January 3, 2018 at 5:35 PM Jakobus Schürz wertstoffe@nurfuerspam.de wrote:
Hi there!
I compiled dovecot 2.3 from git. Because there is already a bug in virtual-plugin, and i hoped, it get fixed... but it doesn't. So this is the error-message from the log
Jän 03 16:27:08 aldebaran dovecot[26460]: indexer-worker(jakob)<26476>qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g: Panic: file unichar.c: line 160 (uni_ucs4_to_utf8_c): assertion failed: (uni_is_valid_ucs4(chr)) Jän 03 16:27:08 aldebaran dovecot[26460]: indexer-worker(jakob)<26476>qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f8299f7a021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f8299f7a0ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8299eec481] -> /usr/local/lib/dovecot/libdovecot.so.0(uni_ucs4_to_utf8_c+0xa0) [0x7f8299fb1500] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xa75e0) [0x7f8299f5b5e0] -> /usr/local/lib/dovecot/libdovecot.so.0(mail_html2text_more+0xc5) [0x7f8299f5b775] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xcfcc) [0x7f82990aefcc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_parser_more+0x27) [0x7f82990aeca7] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x5e9) [0x7f82990acc39] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x1122d) [0x7f82990b322d] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x916a) [0x7f82958e316a] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10f5d) [0x7f82990b2f5d] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x916a) [0x7f82958e316a] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10f5d) [0x7f82990b2f5d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x2e) [0x7f829a2641be] -> dovecot/indexer-worker jakob Synoptic/AKTUELL [0x562227882533] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f8299f91bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7f8299f93499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f8299f91d02] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f8299f91f18] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f8299f0f1e3] -> dovecot/indexer-worker jakob Synoptic/AKTUELL [0x562227881f47] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f8299b352b1] -> dovecot/indexer-worker jakob Synoptic/AKTUELL [0x56222788201a] Jän 03 16:27:08 aldebaran dovecot[26460]: indexer: Error: Indexer worker disconnected, discarding 1 requests for jakob Jän 03 16:27:08 aldebaran dovecot[26460]: imap(jakob)<26472>
: Error: indexer failed to index mailbox Synoptic/AKTUELL Jän 03 16:27:08 aldebaran dovecot[26460]: indexer-worker(jakob)<26476>qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g: Fatal: master: service(indexer-worker): child 26476 killed with signal 6 (core dumps disabled) Jän 03 16:27:09 aldebaran dovecot[26460]: indexer-worker(jakob)<26484>qQ6g1+BhIJvAqAAO:J6mUIEz2TFp0ZwAAk1Mx3g: Error: lucene index /var/lib/dovecot/db/indexes/Maildir/jakob/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out Jän 03 16:27:10 aldebaran dovecot[26460]: indexer-worker(jakob)<26484>qQ6g1+BhIJvAqAAO:J6mUIEz2TFp0ZwAAk1Mx3g: Error: Mailbox Synoptic/AKTUELL: Transaction commit failed: BUG: Unknown internal error (attempted to index 1488 messages (UIDs 15214..16775)) Jän 03 16:27:10 aldebaran dovecot[26460]: imap(jakob)<26480><lP5r2OBhKJvAqAAO>: Error: indexer failed to index mailbox Synoptic/AKTUELL Jän 03 16:27:11 aldebaran dovecot[26460]: imap(jakob)<26472> : Panic: file mail-index.c: line 793 (mail_index_close): assertion failed: (index->open_count > 0) Jän 03 16:27:11 aldebaran dovecot[26460]: imap(jakob)<26472> : Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7fb0fbd3a021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7fb0fbd3a0ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb0fbcac481] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf39a8) [0x7fb0fc0d99a8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd92d1) [0x7fb0fc0bf2d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd9363) [0x7fb0fc0bf363] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_free+0x9) [0x7fb0fc0b0f39] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd05a4) [0x7fb0fc0b65a4] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x19) [0x7fb0fc030c99] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xabdc) [0x7fb0f729bbdc] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9) [0x7fb0f729bcb9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fb0fc030c0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xac60) [0x7fb0f729bc60] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9) [0x7fb0f729bcb9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fb0fc030c0a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x13) [0x7fb0fc030c93] -> dovecot/imap jakob 192.168.0.14 LOGOUT [0x56514d31305b] -> dovecot/imap jakob 192.168.0.14 LOGOUT [0x56514d309485] -> dovecot/imap jakob 192.168.0.14 LOGOUT [0x56514d312ca4] -> dovecot/imap jakob 192.168.0.14 LOGOUT [0x56514d3110b2] -> dovecot/imap jakob 192.168.0.14 LOGOUT [0x56514d31113c] -> dovecot/imap jakob 192.168.0.14 LOGOUT [0x56514d311565] -> dovecot/imap jakob 192.168.0.14 LOGOUT [0x56514d311be2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7fb0fbd51bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7fb0fbd53499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7fb0fbd51d02] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fb0fbd51f18] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fb0fbccf1e3] Jän 03 16:27:11 aldebaran dovecot[26460]: imap(jakob)<26472> : Fatal: master: service(imap): child 26472 killed with signal 6 (core dumps disabled) I get this errors when i open or search in a virtual folder. i have enabled fts_lucene.
My config is:
# dovecot -n # 2.3.devel (393bfbea8): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.rc1 (d68c23a1) # OS: Linux 4.13.0-trunk-amd64 x86_64 Debian 9.3 btrfs auth_mechanisms = plain login cram-md5 digest-md5 auth_socket_path = /usr/local/var/run/dovecot/auth-userdb first_valid_uid = 1000 imap_capability = +XDOVECOT imap_client_workarounds = tb-extra-mailbox-sep lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = *, ::1 login_trusted_networks = 127.0.0.1/8 192.168.0.0/24 192.168.1.0/24 172.17.0.0/24 172.18.0.0/24 mail_gid = vmail mail_home = /var/mail/%u mail_location = maildir:/var/mail/%u/Maildir:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/Maildir/%u:INDEXPVT=/var/lib/dovecot/db/indexes/Maildir/%u:CONTROL=/var/lib/dovecot/db/control/Maildir/%u mail_plugins = zlib quota acl listescape mail_log notify virtual fts fts_lucene mail_privileged_group = vmail mail_server_admin = mailto:jakob@xundeenergie.at mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { list = children location = maildir:/var/mail/public/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/public/%u:INDEXPVT=/var/lib/dovecot/db/indexes/public/%u prefix = Roseggergasse/ separator = / subscriptions = no type = public } namespace Geteilt { hidden = no inbox = no list = children location = maildir:/var/mail/%%u/Maildir:LAYOUT=fs:INDEXPVT=/var/lib/dovecot/db/indexes/shared/%u/%%u:INDEX=/var/lib/dovecot/db/indexes/shared/%u/%%u prefix = Geteilt/%%n/ separator = / subscriptions = no type = shared } namespace Mailarchiv { hidden = no inbox = no list = children location = maildir:/var/mail/mailarchiv/%u/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/mailarchiv/%u:INDEXPVT=/var/lib/dovecot/db/indexes/mailarchiv/%u mailbox incoming { auto = create } mailbox outgoing { auto = create } prefix = Mailarchiv/ separator = / subscriptions = no type = private } namespace Real { hidden = yes list = no location = virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u prefix = Real/ separator = / subscriptions = no } namespace Synoptic { hidden = no list = children location = virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u mailbox INBOX/Archives { auto = no special_use = \Archive } mailbox INBOX/Drafts { auto = no special_use = \Drafts } mailbox INBOX/Entwürfe { auto = no special_use = \Drafts } mailbox INBOX/Junk { auto = no special_use = \Junk } mailbox INBOX/Sent { auto = no special_use = \Sent } mailbox INBOX/Spam { auto = no special_use = \Junk } prefix = Synoptic/ separator = / subscriptions = no } namespace inbox { hidden = no inbox = yes location = mailbox Archiv { auto = no special_use = \Archive } mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } mailbox "Deleted Messages" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Drafts { auto = no special_use = \Drafts } mailbox Entwürfe { auto = no special_use = \Drafts } mailbox "Gelöschte Elemente" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox "Gelöschte Objekte" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Gesendet { auto = no special_use = \Sent } mailbox "Gesendete Elemente" { auto = no special_use = \Sent } mailbox "Gesendete Objekte" { auto = no special_use = \Sent } mailbox Important { auto = no } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Mistkübel { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Papierkorb { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Synoptic/Alle { auto = no comment = All my messages special_use = \All } mailbox Trash { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Wichtig { auto = create } prefix = INBOX/ separator = / subscriptions = no type = private } namespace subscriptions { hidden = yes list = no location = prefix = subscriptions = yes } passdb { args = scheme=CRYPT username_format=%u /usr/local/etc/dovecot/users driver = passwd-file } plugin { acl = vfile:/etc/dovecot/dovecot-acl:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db fts = lucene fts_autoindex = yes fts_autoindex_max_recent_msgs = 80 fts_index_timeout = 90s fts_lucene = whitespace_chars=@. normalize no_snowball mail_home = /var/mail/%u setting_name = sieve, managedsieve sieve = file:/var/mail/%u/sieve/;active=/var/mail/%u/sieve/%u.sieve } postmaster_address = postmaster@localhost protocols = imap pop3 lmtp imap lmtp sieve pop3 sieve service anvil { unix_listener anvil-auth-penalty { mode = 00 } } service auth { unix_listener auth-client { group = vmail mode = 0666 user = Debian-exim } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { executable = imap postlogin process_limit = 1024 vsz_limit = 400 M } service lmtp { executable = lmtp -L user = vmail vsz_limit = 400 M } service postlogin { executable = script-login -d rawlog } ssl = required ssl_cert =
The virtual Folder-definitions are:
# find /var/mail/virtual/ /var/mail/real/ /var/mail/virtual/ /var/mail/virtual/GINBOX /var/mail/virtual/GINBOX/dovecot-virtual /var/mail/virtual/Neue /var/mail/virtual/Neue/dovecot-virtual /var/mail/virtual/Markierte /var/mail/virtual/Markierte/dovecot-virtual /var/mail/virtual/Ungelesene /var/mail/virtual/Ungelesene/dovecot-virtual /var/mail/virtual/Sent /var/mail/virtual/Sent/dovecot-virtual /var/mail/virtual/Drafts /var/mail/virtual/Drafts/dovecot-virtual /var/mail/virtual/Trash /var/mail/virtual/Trash/dovecot-virtual /var/mail/virtual/AKTUELL /var/mail/virtual/AKTUELL/dovecot-virtual /var/mail/virtual/Archives /var/mail/virtual/Archives/dovecot-virtual /var/mail/virtual/dovecot-acl-list /var/mail/virtual/WICHTIG /var/mail/virtual/WICHTIG/dovecot-virtual /var/mail/real/ /var/mail/real/Alle /var/mail/real/Alle/dovecot-virtual /var/mail/real/dovecot-acl-list /var/mail/real/einjahr /var/mail/real/einjahr/dovecot-virtual /var/mail/real/zweijahr /var/mail/real/zweijahr/dovecot-virtual /var/mail/real/dreijahr /var/mail/real/dreijahr/dovecot-virtual
# cat /var/mail/virtual/AKTUELL/dovecot-virtual Real/Alle inthread refs younger 2592000
# cat /var/mail/real/Alle/dovecot-virtual !INBOX INBOX/* -INBOX/Trash -INBOX/Trash/* -INBOX/Archives -INBOX/Archives/* -INBOX/Drafts -INBOX/Drafts/* -INBOX/Junk -INBOX/Junk/* -INBOX/SYSTEM -INBOX/SYSTEM/* all
The others are similar.
Greez
Jakob
-- Marco Giunta - ITCS SysAdmin Via Bonomea, 265 34136 - Trieste, Italy Tel: +39-040-3787-503 Fax: +39-040-3787-244
Yeah, sorry I forgot to report back, it's now fixed in https://github.com/dovecot/core/commit/5c1837529e6957da3e389683c43bd00685939...
Aki
On 05.02.2018 14:04, Marco Giunta wrote:
Hi, did you have time to investigate about 'Panic: file unichar.c' bug ? Because I have the same problem with a 2.3.0 installation without virtual plugin.
Thanks, Marco
On 2018-01-03 16:52, Aki Tuomi wrote:
This is not a bug in virtual plugin, but in some email which contains invalid unicode sequence somehow. Can you send me a core file? This should not have occured ofc but would be nice to know how it ended up here.
Aki
On January 3, 2018 at 5:35 PM Jakobus Schürz wertstoffe@nurfuerspam.de wrote:
Hi there!
I compiled dovecot 2.3 from git. Because there is already a bug in virtual-plugin, and i hoped, it get fixed... but it doesn't. So this is the error-message from the log
Jän 03 16:27:08 aldebaran dovecot[26460]: indexer-worker(jakob)<26476>qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g: Panic: file unichar.c: line 160 (uni_ucs4_to_utf8_c): assertion failed: (uni_is_valid_ucs4(chr)) Jän 03 16:27:08 aldebaran dovecot[26460]: indexer-worker(jakob)<26476>qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f8299f7a021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f8299f7a0ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8299eec481] -> /usr/local/lib/dovecot/libdovecot.so.0(uni_ucs4_to_utf8_c+0xa0) [0x7f8299fb1500] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xa75e0) [0x7f8299f5b5e0] -> /usr/local/lib/dovecot/libdovecot.so.0(mail_html2text_more+0xc5) [0x7f8299f5b775] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xcfcc) [0x7f82990aefcc] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_parser_more+0x27) [0x7f82990aeca7] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x5e9) [0x7f82990acc39] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x1122d) [0x7f82990b322d] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x916a) [0x7f82958e316a] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10f5d) [0x7f82990b2f5d] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x916a) [0x7f82958e316a] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10f5d) [0x7f82990b2f5d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x2e) [0x7f829a2641be] -> dovecot/indexer-worker jakob Synoptic/AKTUELL [0x562227882533] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f8299f91bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
[0x7f8299f93499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f8299f91d02] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f8299f91f18] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f8299f0f1e3] -> dovecot/indexer-worker jakob Synoptic/AKTUELL [0x562227881f47] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f8299b352b1] -> dovecot/indexer-worker jakob Synoptic/AKTUELL [0x56222788201a] Jän 03 16:27:08 aldebaran dovecot[26460]: indexer: Error: Indexer worker disconnected, discarding 1 requests for jakob Jän 03 16:27:08 aldebaran dovecot[26460]: imap(jakob)<26472>
: Error: indexer failed to index mailbox Synoptic/AKTUELL Jän 03 16:27:08 aldebaran dovecot[26460]: indexer-worker(jakob)<26476>qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g: Fatal: master: service(indexer-worker): child 26476 killed with signal 6 (core dumps disabled) Jän 03 16:27:09 aldebaran dovecot[26460]: indexer-worker(jakob)<26484>qQ6g1+BhIJvAqAAO:J6mUIEz2TFp0ZwAAk1Mx3g: Error: lucene index /var/lib/dovecot/db/indexes/Maildir/jakob/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out Jän 03 16:27:10 aldebaran dovecot[26460]: indexer-worker(jakob)<26484>qQ6g1+BhIJvAqAAO:J6mUIEz2TFp0ZwAAk1Mx3g: Error: Mailbox Synoptic/AKTUELL: Transaction commit failed: BUG: Unknown internal error (attempted to index 1488 messages (UIDs 15214..16775)) Jän 03 16:27:10 aldebaran dovecot[26460]: imap(jakob)<26480><lP5r2OBhKJvAqAAO>: Error: indexer failed to index mailbox Synoptic/AKTUELL Jän 03 16:27:11 aldebaran dovecot[26460]: imap(jakob)<26472> : Panic: file mail-index.c: line 793 (mail_index_close): assertion failed: (index->open_count > 0) Jän 03 16:27:11 aldebaran dovecot[26460]: imap(jakob)<26472> : Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7fb0fbd3a021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7fb0fbd3a0ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb0fbcac481] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf39a8) [0x7fb0fc0d99a8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd92d1) [0x7fb0fc0bf2d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd9363) [0x7fb0fc0bf363] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_free+0x9) [0x7fb0fc0b0f39] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd05a4) [0x7fb0fc0b65a4] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x19) [0x7fb0fc030c99] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xabdc) [0x7fb0f729bbdc] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9) [0x7fb0f729bcb9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fb0fc030c0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xac60) [0x7fb0f729bc60] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9) [0x7fb0f729bcb9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fb0fc030c0a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x13) [0x7fb0fc030c93] -> dovecot/imap jakob 192.168.0.14 LOGOUT [0x56514d31305b] -> dovecot/imap jakob 192.168.0.14 LOGOUT [0x56514d309485] -> dovecot/imap jakob 192.168.0.14 LOGOUT [0x56514d312ca4] -> dovecot/imap jakob 192.168.0.14 LOGOUT [0x56514d3110b2] -> dovecot/imap jakob 192.168.0.14 LOGOUT [0x56514d31113c] -> dovecot/imap jakob 192.168.0.14 LOGOUT [0x56514d311565] -> dovecot/imap jakob 192.168.0.14 LOGOUT [0x56514d311be2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7fb0fbd51bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
[0x7fb0fbd53499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7fb0fbd51d02] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fb0fbd51f18] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fb0fbccf1e3] Jän 03 16:27:11 aldebaran dovecot[26460]: imap(jakob)<26472>
: Fatal: master: service(imap): child 26472 killed with signal 6 (core dumps disabled) I get this errors when i open or search in a virtual folder. i have enabled fts_lucene.
My config is:
# dovecot -n # 2.3.devel (393bfbea8): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.rc1 (d68c23a1) # OS: Linux 4.13.0-trunk-amd64 x86_64 Debian 9.3 btrfs auth_mechanisms = plain login cram-md5 digest-md5 auth_socket_path = /usr/local/var/run/dovecot/auth-userdb first_valid_uid = 1000 imap_capability = +XDOVECOT imap_client_workarounds = tb-extra-mailbox-sep lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = *, ::1 login_trusted_networks = 127.0.0.1/8 192.168.0.0/24 192.168.1.0/24 172.17.0.0/24 172.18.0.0/24 mail_gid = vmail mail_home = /var/mail/%u mail_location = maildir:/var/mail/%u/Maildir:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/Maildir/%u:INDEXPVT=/var/lib/dovecot/db/indexes/Maildir/%u:CONTROL=/var/lib/dovecot/db/control/Maildir/%u
mail_plugins = zlib quota acl listescape mail_log notify virtual fts fts_lucene mail_privileged_group = vmail mail_server_admin = mailto:jakob@xundeenergie.at mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { list = children location = maildir:/var/mail/public/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/public/%u:INDEXPVT=/var/lib/dovecot/db/indexes/public/%u
prefix = Roseggergasse/ separator = / subscriptions = no type = public } namespace Geteilt { hidden = no inbox = no list = children location = maildir:/var/mail/%%u/Maildir:LAYOUT=fs:INDEXPVT=/var/lib/dovecot/db/indexes/shared/%u/%%u:INDEX=/var/lib/dovecot/db/indexes/shared/%u/%%u
prefix = Geteilt/%%n/ separator = / subscriptions = no type = shared } namespace Mailarchiv { hidden = no inbox = no list = children location = maildir:/var/mail/mailarchiv/%u/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/mailarchiv/%u:INDEXPVT=/var/lib/dovecot/db/indexes/mailarchiv/%u
mailbox incoming { auto = create } mailbox outgoing { auto = create } prefix = Mailarchiv/ separator = / subscriptions = no type = private } namespace Real { hidden = yes list = no location = virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u prefix = Real/ separator = / subscriptions = no } namespace Synoptic { hidden = no list = children location = virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u mailbox INBOX/Archives { auto = no special_use = \Archive } mailbox INBOX/Drafts { auto = no special_use = \Drafts } mailbox INBOX/Entwürfe { auto = no special_use = \Drafts } mailbox INBOX/Junk { auto = no special_use = \Junk } mailbox INBOX/Sent { auto = no special_use = \Sent } mailbox INBOX/Spam { auto = no special_use = \Junk } prefix = Synoptic/ separator = / subscriptions = no } namespace inbox { hidden = no inbox = yes location = mailbox Archiv { auto = no special_use = \Archive } mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } mailbox "Deleted Messages" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Drafts { auto = no special_use = \Drafts } mailbox Entwürfe { auto = no special_use = \Drafts } mailbox "Gelöschte Elemente" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox "Gelöschte Objekte" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Gesendet { auto = no special_use = \Sent } mailbox "Gesendete Elemente" { auto = no special_use = \Sent } mailbox "Gesendete Objekte" { auto = no special_use = \Sent } mailbox Important { auto = no } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Mistkübel { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Papierkorb { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Synoptic/Alle { auto = no comment = All my messages special_use = \All } mailbox Trash { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Wichtig { auto = create } prefix = INBOX/ separator = / subscriptions = no type = private } namespace subscriptions { hidden = yes list = no location = prefix = subscriptions = yes } passdb { args = scheme=CRYPT username_format=%u /usr/local/etc/dovecot/users driver = passwd-file } plugin { acl = vfile:/etc/dovecot/dovecot-acl:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db fts = lucene fts_autoindex = yes fts_autoindex_max_recent_msgs = 80 fts_index_timeout = 90s fts_lucene = whitespace_chars=@. normalize no_snowball mail_home = /var/mail/%u setting_name = sieve, managedsieve sieve = file:/var/mail/%u/sieve/;active=/var/mail/%u/sieve/%u.sieve } postmaster_address = postmaster@localhost protocols = imap pop3 lmtp imap lmtp sieve pop3 sieve service anvil { unix_listener anvil-auth-penalty { mode = 00 } } service auth { unix_listener auth-client { group = vmail mode = 0666 user = Debian-exim } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { executable = imap postlogin process_limit = 1024 vsz_limit = 400 M } service lmtp { executable = lmtp -L user = vmail vsz_limit = 400 M } service postlogin { executable = script-login -d rawlog } ssl = required ssl_cert =
The virtual Folder-definitions are:
# find /var/mail/virtual/ /var/mail/real/ /var/mail/virtual/ /var/mail/virtual/GINBOX /var/mail/virtual/GINBOX/dovecot-virtual /var/mail/virtual/Neue /var/mail/virtual/Neue/dovecot-virtual /var/mail/virtual/Markierte /var/mail/virtual/Markierte/dovecot-virtual /var/mail/virtual/Ungelesene /var/mail/virtual/Ungelesene/dovecot-virtual /var/mail/virtual/Sent /var/mail/virtual/Sent/dovecot-virtual /var/mail/virtual/Drafts /var/mail/virtual/Drafts/dovecot-virtual /var/mail/virtual/Trash /var/mail/virtual/Trash/dovecot-virtual /var/mail/virtual/AKTUELL /var/mail/virtual/AKTUELL/dovecot-virtual /var/mail/virtual/Archives /var/mail/virtual/Archives/dovecot-virtual /var/mail/virtual/dovecot-acl-list /var/mail/virtual/WICHTIG /var/mail/virtual/WICHTIG/dovecot-virtual /var/mail/real/ /var/mail/real/Alle /var/mail/real/Alle/dovecot-virtual /var/mail/real/dovecot-acl-list /var/mail/real/einjahr /var/mail/real/einjahr/dovecot-virtual /var/mail/real/zweijahr /var/mail/real/zweijahr/dovecot-virtual /var/mail/real/dreijahr /var/mail/real/dreijahr/dovecot-virtual
# cat /var/mail/virtual/AKTUELL/dovecot-virtual Real/Alle inthread refs younger 2592000
# cat /var/mail/real/Alle/dovecot-virtual !INBOX INBOX/* -INBOX/Trash -INBOX/Trash/* -INBOX/Archives -INBOX/Archives/* -INBOX/Drafts -INBOX/Drafts/* -INBOX/Junk -INBOX/Junk/* -INBOX/SYSTEM -INBOX/SYSTEM/* all
The others are similar.
Greez
Jakob
Hi there!
I compiled dovecot from git on 5.2.2018.
The id of the last commit is:
$ git log --format="%H" -n 1 83b1300b96e753206f9226e3738a7ad9f5428a75
From https://github.com/dovecot/core.git
There is a new error, when i try to open a virtual folder for my archiv (almost 30.000 mails) in thunderbird, also in k9-mail on android.
Feb 07 11:09:55 aldebaran dovecot[7455]: imap(jakob)<7472><U2Uvf5xkCQRcPAkS>: Panic: Leaked view for index /var/lib/dovecot/db/indexes/archiv/jakob/Archiv/2016/Mailinglisten/stvkr-a/dovecot.index: Opened in index-storage.c:336 Feb 07 11:09:55 aldebaran dovecot[7455]: imap(jakob)<7472><U2Uvf5xkCQRcPAkS>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc9431) [0x7f6edc3dd431] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc94fa) [0x7f6edc3dd4fa] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f6edc34fbe8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf44f2) [0x7f6edc77b4f2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72) [0x7f6edc752d32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f6edc6d227a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa700) [0x7f6ed78e8700] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7f6ed78e889b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) [0x7f6ed78eba79] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7f6edc6d4781] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f6edc6d4837] -> dovecot/imap jakob 92.60.9.18 select [0x55bde8d2a08e] -> dovecot/imap jakob 92.60.9.18 select [0x55bde8d318d4] -> dovecot/imap jakob 92.60.9.18 select [0x55bde8d2fd82] -> dovecot/imap jakob 92.60.9.18 select [0x55bde8d2fe1c] -> dovecot/imap jakob 92.60.9.18 select [0x55bde8d30225] -> dovecot/imap jakob 92.60.9.18 select [0x55bde8d30844] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f6edc3f51c9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) [0x7f6edc3f6a3e] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4c) [0x7f6edc3f52cc] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f6edc3f54d8] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f6edc3725d3] -> dovecot/imap jakob 92.60.9.18 select [0x55bde8d22599] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xea) [0x7f6edbf7ef2a] -> dovecot/imap jakob 92.60.9.18 select [0x55bde8d2277a] Feb 07 11:09:55 aldebaran dovecot[7455]: imap(jakob)<7472><U2Uvf5xkCQRcPAkS>: Fatal: master: service(imap): child 7472 killed with signal 6 (core not dumped) Feb 07 11:09:55 aldebaran dovecot[7455]: imap-login: Login: user=<jakob>, method=CRAM-MD5, rip=1.2.3.4, lip=192.168.0.14, mpid=7474, TLS, session=<tHw8f5xkCwRcPAkS> Feb 07 11:09:56 aldebaran dovecot[7455]: imap(jakob)<7474><tHw8f5xkCwRcPAkS>: Panic: Leaked view for index /var/lib/dovecot/db/indexes/archiv/jakob/Archiv/2016/Mailinglisten/stvkr-a/dovecot.index: Opened in index-storage.c:336 Feb 07 11:09:56 aldebaran dovecot[7455]: imap(jakob)<7474><tHw8f5xkCwRcPAkS>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc9431) [0x7fc44d019431] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc94fa) [0x7fc44d0194fa] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fc44cf8bbe8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf44f2) [0x7fc44d3b74f2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72) [0x7fc44d38ed32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fc44d30e27a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa700) [0x7fc448524700] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7fc44852489b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) [0x7fc448527a79] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7fc44d310781] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7fc44d310837] -> dovecot/imap jakob 92.60.9.18 select [0x55770c32408e] -> dovecot/imap jakob 92.60.9.18 select [0x55770c32b8d4] -> dovecot/imap jakob 92.60.9.18 select [0x55770c329d82] -> dovecot/imap jakob 92.60.9.18 select [0x55770c329e1c] -> dovecot/imap jakob 92.60.9.18 select [0x55770c32a225] -> dovecot/imap jakob 92.60.9.18 select [0x55770c32a844] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7fc44d0311c9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) [0x7fc44d032a3e] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4c) [0x7fc44d0312cc] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fc44d0314d8] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fc44cfae5d3] -> dovecot/imap jakob 92.60.9.18 select [0x55770c31c599] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xea) [0x7fc44cbbaf2a] -> dovecot/imap jakob 92.60.9.18 select [0x55770c31c77a] Feb 07 11:09:56 aldebaran dovecot[7455]: imap(jakob)<7474><tHw8f5xkCwRcPAkS>: Fatal: master: service(imap): child 7474 killed with signal 6 (core not dumped)
The systemd-Unit for my self-compiled dovecot has set some ulimits, because i got problems on a large amount of mails with doveadm, increasing the ulimit avoid this problems:
# systemctl cat xe-dovecot.service |grep -v '^#' [Unit] Description=IMAP server (dovecot) OnFailure=status-email-root@%n.service PartOf=mailserver.service xe-dovecot.socket ReloadPropagatedFrom=mailserver.service
[Service] ExecStart=/usr/local/sbin/dovecot -F -c /usr/local/etc/dovecot/dovecot.conf ExecReload=/usr/local/sbin/dovecot reload ExecStop=/usr/local/sbin/dovecot stop Restart=on-success RestartSec=2 LimitAS=infinity LimitRSS=infinity LimitCORE=infinity LimitNOFILE=infinity PrivateTmp=true ProtectKernelTunables=true ProtectKernelModules=true ProtectControlGroups=true NoNewPrivileges=true
[Install] WantedBy=mailserver.target
My dovecot-conf is:
# doveconf -n # 2.3.devel (83b1300b9): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.rc1 (d33dca20) # OS: Linux 4.14.0-3-amd64 x86_64 Debian buster/sid btrfs # Hostname: aldebaran.xundeenergie.at auth_mechanisms = plain login cram-md5 digest-md5 auth_socket_path = /usr/local/var/run/dovecot/auth-userdb first_valid_uid = 1000 imap_capability = +XDOVECOT imap_client_workarounds = tb-extra-mailbox-sep lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = *, ::1 login_trusted_networks = 127.0.0.1/8 192.168.0.0/24 192.168.1.0/24 172.17.0.0/24 172.18.0.0/24 mail_gid = vmail mail_home = /var/mail/%u mail_location = maildir:/var/mail/%u/Maildir:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/Maildir/%u:INDEXPVT=/var/lib/dovecot/db/indexes/Maildir/%u:CONTROL=/var/lib/dovecot/db/control/Maildir/%u mail_plugins = zlib quota acl listescape mail_log notify virtual fts fts_lucene mail_privileged_group = vmail mail_server_admin = mailto:jakob@xundeenergie.at mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mmap_disable = yes namespace { list = children location = maildir:/var/mail/public/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/public/%u:INDEXPVT=/var/lib/dovecot/db/indexes/public/%u prefix = Roseggergasse/ separator = / subscriptions = no type = public } namespace Archiv { hidden = no inbox = no list = children location = maildir:/var/mail/archiv/%u/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/archiv/%u:INDEXPVT=/var/lib/dovecot/db/indexes/archiv/%u:CONTROL=/var/lib/dovecot/db/control/archiv/%u mailbox Archiv { auto = subscribe special_use = \Archive } mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } prefix = Archiv/ separator = / subscriptions = no type = private } namespace Geteilt { hidden = no inbox = no list = children location = maildir:/var/mail/%%u/Maildir:LAYOUT=fs:INDEXPVT=/var/lib/dovecot/db/indexes/shared/%u/%%u:INDEX=/var/lib/dovecot/db/indexes/shared/%u/%%u prefix = Geteilt/%%n/ separator = / subscriptions = no type = shared } namespace Mailarchiv { hidden = no inbox = no list = children location = maildir:/var/mail/mailarchiv/%u/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/mailarchiv/%u:INDEXPVT=/var/lib/dovecot/db/indexes/mailarchiv/%u:CONTROL=/var/lib/dovecot/db/control/mailarchiv/%u mailbox incoming { auto = create } mailbox outgoing { auto = create } prefix = Mailarchiv/ separator = / subscriptions = no type = private } namespace Real { hidden = yes ignore_on_failure = no list = no location = virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u prefix = Real/ separator = / subscriptions = no } namespace Synoptic { hidden = no ignore_on_failure = no list = children location = virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u mailbox AKTUELL { auto = subscribe } mailbox INBOX/Archives { auto = no special_use = \Archive } mailbox INBOX/Drafts { auto = no special_use = \Drafts } mailbox INBOX/Entwürfe { auto = no special_use = \Drafts } mailbox INBOX/Junk { auto = no special_use = \Junk } mailbox INBOX/Sent { auto = no special_use = \Sent } mailbox INBOX/Spam { auto = no special_use = \Junk } mailbox Neue { auto = subscribe } mailbox Real/Alle { auto = no } mailbox WICHTIG { auto = subscribe } prefix = Synoptic/ separator = / subscriptions = no } namespace inbox { hidden = no inbox = yes location = mailbox "Deleted Messages" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Drafts { auto = no special_use = \Drafts } mailbox Entwürfe { auto = no special_use = \Drafts } mailbox "Gelöschte Elemente" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox "Gelöschte Objekte" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Gesendet { auto = no special_use = \Sent } mailbox "Gesendete Elemente" { auto = no special_use = \Sent } mailbox "Gesendete Objekte" { auto = no special_use = \Sent } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Mistkübel { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Papierkorb { auto = no autoexpunge = 30 days special_use = \Trash } mailbox SYSTEM { auto = subscribe } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Synoptic/Alle { auto = no comment = All my messages special_use = \All } mailbox Trash { auto = no autoexpunge = 30 days special_use = \Trash } prefix = INBOX/ separator = / subscriptions = no type = private } namespace subscriptions { hidden = yes list = no location = prefix = subscriptions = yes } passdb { args = scheme=CRYPT username_format=%u /usr/local/etc/dovecot/users driver = passwd-file } plugin { acl = vfile:/usr/local/etc/dovecot/dovecot-acl:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db fts = lucene fts_autoindex = yes fts_autoindex_max_recent_msgs = 80 fts_index_timeout = 90 fts_lucene = whitespace_chars=@. normalize no_snowball mail_home = /var/mail/%u setting_name = sieve, managedsieve sieve = file:/var/mail/%u/sieve/;active=/var/mail/%u/sieve/%u.sieve sieve_before = /usr/local/etc/dovecot/sieve/global.sieve sieve_global_dir = /usr/local/etc/dovecot/sieve/ } postmaster_address = postmaster@localhost protocols = imap pop3 lmtp sieve service anvil { client_limit = 199999 unix_listener anvil-auth-penalty { mode = 0700 } } service auth { unix_listener auth-client { group = vmail mode = 0666 user = Debian-exim } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { executable = imap postlogin process_limit = 1024 vsz_limit = 400 M } service lmtp { executable = lmtp -L user = vmail vsz_limit = 400 M } service postlogin { executable = script-login -d rawlog } ssl = required ssl_cert =
This is unchanged from my original bug-report:
The virtual Folder-definitions are:
# find /var/mail/virtual/ /var/mail/real/ /var/mail/virtual/ /var/mail/virtual/GINBOX /var/mail/virtual/GINBOX/dovecot-virtual /var/mail/virtual/Neue /var/mail/virtual/Neue/dovecot-virtual /var/mail/virtual/Markierte /var/mail/virtual/Markierte/dovecot-virtual /var/mail/virtual/Ungelesene /var/mail/virtual/Ungelesene/dovecot-virtual /var/mail/virtual/Sent /var/mail/virtual/Sent/dovecot-virtual /var/mail/virtual/Drafts /var/mail/virtual/Drafts/dovecot-virtual /var/mail/virtual/Trash /var/mail/virtual/Trash/dovecot-virtual /var/mail/virtual/AKTUELL /var/mail/virtual/AKTUELL/dovecot-virtual /var/mail/virtual/Archives /var/mail/virtual/Archives/dovecot-virtual /var/mail/virtual/dovecot-acl-list /var/mail/virtual/WICHTIG /var/mail/virtual/WICHTIG/dovecot-virtual /var/mail/real/ /var/mail/real/Alle /var/mail/real/Alle/dovecot-virtual /var/mail/real/dovecot-acl-list /var/mail/real/einjahr /var/mail/real/einjahr/dovecot-virtual /var/mail/real/zweijahr /var/mail/real/zweijahr/dovecot-virtual /var/mail/real/dreijahr /var/mail/real/dreijahr/dovecot-virtual
# cat /var/mail/virtual/AKTUELL/dovecot-virtual Real/Alle inthread refs younger 2592000
# cat /var/mail/real/Alle/dovecot-virtual !INBOX INBOX/* -INBOX/Trash -INBOX/Trash/* -INBOX/Archives -INBOX/Archives/* -INBOX/Drafts -INBOX/Drafts/* -INBOX/Junk -INBOX/Junk/* -INBOX/SYSTEM -INBOX/SYSTEM/* all
The others are similar.
Greez
Jakob
participants (5)
-
Aki Tuomi
-
Jakob Schürz
-
Jakobus Schürz
-
Jakobus Schürz
-
Marco Giunta