sieve stopped working and doveadm mailbox list without -s shows less folders then with
Dovecot 2.2.31 with mailboxes in mdbox format.
Since a couple of days some mailboxes have the problem, that sieve rules moving mails to folders stop working and .sieve.log in mailbox shows:
sieve: info: started log at Sep 07 13:57:17. error: msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de>: failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: INBOX/Munser.
When I do a doveadm mailbox list -s -u <user>@<domain> I get all folders incl. the one mentioned above, while doveadm mailbox list without -s shows just user INBOX
I already tried doveadm force-resync -u <user>@<domain> INBOX, but it did not change anything.
I also moved the mailbox in filesystem to an other name and tried to restore it from there, which helped with most broken mailbox problems in the pre 2.2.31 aftermath, but that failed completly:
/var/dovecot/imap/<domain> # mv <user> <user>.broken
/var/dovecot/imap/<domain> # doveadm force-resync -u <user>@<domain> INBOX
/var/dovecot/imap/<domain> # sudo -u dovecot doveadm -Dv import -u <user>@<domain> -s mdbox:$(pwd)/<user>.broken/mdbox INBOX all Debug: Loading modules from directory: /usr/lib/dovecot Debug: Module loaded: /usr/lib/dovecot/lib01_acl_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib15_notify_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib20_mail_log_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib20_replication_plugin.so Debug: Loading modules from directory: /usr/lib/dovecot/doveadm Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: expire_set_lookup: symbol not found (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: fts_backend_rescan: symbol not found (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: mail_crypt_box_get_public_key: symbol not found (this is usually intentional, so just ignore this message) doveadm(<user>@<domain> 54303): Debug: Added userdb setting: plugin/master_user=<user>@<domain> doveadm(<user>@<domain> 54303): Debug: Added userdb setting: plugin/userdb_acl_groups=admins@<domain>,hts büro@<domain>,hts@<domain> doveadm(<user>@<domain> 54303): Debug: Added userdb setting: plugin/userdb_quota_rule=*:bytes=10485760000 doveadm(<user>@<domain>): Debug: Effective uid=90, gid=101, home=/var/dovecot/imap/<domain>/<user> doveadm(<user>@<domain>): Debug: Quota root: name=User quota backend=dict args=:ns=INBOX/:file:/var/dovecot/imap/<domain>/<user>/dovecot-quota doveadm(<user>@<domain>): Debug: Quota rule: root=User quota mailbox=* bytes=107374182400 messages=0 doveadm(<user>@<domain>): Debug: Quota grace: root=User quota bytes=10737418240 (10%) doveadm(<user>@<domain>): Debug: dict quota: user=<user>@<domain>, uri=file:/var/dovecot/imap/<domain>/<user>/dovecot-quota, noenforcing=0 doveadm(<user>@<domain>): Debug: Namespace inboxes: type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=no location=mdbox:~/mdbox doveadm(<user>@<domain>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<user>@<domain>): Debug: acl: initializing backend with data: vfile doveadm(<user>@<domain>): Debug: acl: acl username = <user>@<domain> doveadm(<user>@<domain>): Debug: acl: owner = 0 doveadm(<user>@<domain>): Debug: acl vfile: Global ACLs disabled doveadm(<user>@<domain>): Debug: Namespace users: type=shared, prefix=user/%n/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=mdbox:%h/mdbox:INDEXPVT=~/shared/%u doveadm(<user>@<domain>): Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= doveadm(<user>@<domain>): Debug: acl: initializing backend with data: vfile doveadm(<user>@<domain>): Debug: acl: acl username = <user>@<domain> doveadm(<user>@<domain>): Debug: acl: owner = 0 doveadm(<user>@<domain>): Debug: acl vfile: Global ACLs disabled doveadm(<user>@<domain>): Debug: Namespace subs: type=private, prefix=, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:~/mdbox doveadm(<user>@<domain>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<user>@<domain>): Debug: acl: initializing backend with data: vfile doveadm(<user>@<domain>): Debug: acl: acl username = <user>@<domain> doveadm(<user>@<domain>): Debug: acl: owner = 0 doveadm(<user>@<domain>): Debug: acl vfile: Global ACLs disabled doveadm(<user>@<domain>): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(<user>@<domain>): user-lookup(<user>@<domain>)Debug: Added userdb setting: plugin/master_user=<user>@<domain> doveadm(<user>@<domain>): user-lookup(<user>@<domain>)Debug: Added userdb setting: plugin/userdb_acl_groups=admins@<domain>,hts büro@<domain>,hts@<domain> doveadm(<user>@<domain>): user-lookup(<user>@<domain>)Debug: Added userdb setting: plugin/userdb_quota_rule=*:bytes=10485760000 doveadm(<user>@<domain>): Debug: Effective uid=90, gid=101, home=/var/dovecot/imap/<domain>/<user> doveadm(<user>@<domain>): Debug: Quota root: name=User quota backend=dict args=:ns=INBOX/:file:/var/dovecot/imap/<domain>/<user>/dovecot-quota doveadm(<user>@<domain>): Debug: Quota rule: root=User quota mailbox=* bytes=107374182400 messages=0 doveadm(<user>@<domain>): Debug: Quota grace: root=User quota bytes=10737418240 (10%) doveadm(<user>@<domain>): Debug: dict quota: user=<user>@<domain>, uri=file:/var/dovecot/imap/<domain>/<user>/dovecot-quota, noenforcing=0 doveadm(<user>@<domain>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>.broken/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<user>@<domain>): Debug: acl: initializing backend with data: vfile doveadm(<user>@<domain>): Debug: acl: acl username = <user>@<domain> doveadm(<user>@<domain>): Debug: acl: owner = 0 doveadm(<user>@<domain>): Debug: acl vfile: Global ACLs disabled doveadm(<user>@<domain>): Error: quota: Unknown namespace: INBOX/ doveadm(<user>@<domain>): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(<user>@<domain>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>.broken/mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl not found doveadm(<user>@<domain>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>.broken/mdbox/mailboxes/dovecot-acl not found doveadm(<user>@<domain>): Debug: acl: Mailbox not in dovecot-acl-list: MailboxA doveadm(<user>@<domain>): Debug: acl: Mailbox not in dovecot-acl-list: MailboxB <skiped many more mailboxes/> doveadm(<user>@<domain>): Debug: INBOX: Mailbox opened because: import doveadm(<user>@<domain>): Debug: Namespace : Using permissions from /var/dovecot/imap/<domain>/<user>/mdbox: mode=0700 gid=default doveadm(<user>@<domain>): Debug: replication: Replication requested by 'mailbox subscribe', priority=1 doveadm(<user>@<domain>): Debug: INBOX/INBOX: Mailbox opened because: import doveadm(<user>@<domain>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl not found doveadm(<user>@<domain>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/dovecot-acl not found doveadm(<user>@<domain>): Error: Opening INBOX failed: Mailbox doesn't exist: INBOX/INBOX doveadm(<user>@<domain>): Error: Syncing mailbox INBOX/INBOX failed: Opening INBOX failed: Mailbox doesn't exist: INBOX/INBOX
Any ideas what the problem could be and how to fix it?
Or what other information I can supply to help diagnose the problem.
Ralf
-- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0
Noone an idea how it can be that subscribed folders are more then all folders and how to repair that situation?
Ralf
Am 07.09.17 um 16:42 schrieb Ralf Becker:
Dovecot 2.2.31 with mailboxes in mdbox format.
Since a couple of days some mailboxes have the problem, that sieve rules moving mails to folders stop working and .sieve.log in mailbox shows:
sieve: info: started log at Sep 07 13:57:17. error: msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de>: failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: INBOX/Munser.
When I do a doveadm mailbox list -s -u <user>@<domain> I get all folders incl. the one mentioned above, while doveadm mailbox list without -s shows just user INBOX
I already tried doveadm force-resync -u <user>@<domain> INBOX, but it did not change anything.
I also moved the mailbox in filesystem to an other name and tried to restore it from there, which helped with most broken mailbox problems in the pre 2.2.31 aftermath, but that failed completly:
/var/dovecot/imap/<domain> # mv <user> <user>.broken
/var/dovecot/imap/<domain> # doveadm force-resync -u <user>@<domain> INBOX
/var/dovecot/imap/<domain> # sudo -u dovecot doveadm -Dv import -u <user>@<domain> -s mdbox:$(pwd)/<user>.broken/mdbox INBOX all Debug: Loading modules from directory: /usr/lib/dovecot Debug: Module loaded: /usr/lib/dovecot/lib01_acl_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib15_notify_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib20_mail_log_plugin.so Debug: Module loaded: /usr/lib/dovecot/lib20_replication_plugin.so Debug: Loading modules from directory: /usr/lib/dovecot/doveadm Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: expire_set_lookup: symbol not found (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: fts_backend_rescan: symbol not found (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: Error relocating /usr/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: mail_crypt_box_get_public_key: symbol not found (this is usually intentional, so just ignore this message) doveadm(<user>@<domain> 54303): Debug: Added userdb setting: plugin/master_user=<user>@<domain> doveadm(<user>@<domain> 54303): Debug: Added userdb setting: plugin/userdb_acl_groups=admins@<domain>,hts büro@<domain>,hts@<domain> doveadm(<user>@<domain> 54303): Debug: Added userdb setting: plugin/userdb_quota_rule=*:bytes=10485760000 doveadm(<user>@<domain>): Debug: Effective uid=90, gid=101, home=/var/dovecot/imap/<domain>/<user> doveadm(<user>@<domain>): Debug: Quota root: name=User quota backend=dict args=:ns=INBOX/:file:/var/dovecot/imap/<domain>/<user>/dovecot-quota doveadm(<user>@<domain>): Debug: Quota rule: root=User quota mailbox=* bytes=107374182400 messages=0 doveadm(<user>@<domain>): Debug: Quota grace: root=User quota bytes=10737418240 (10%) doveadm(<user>@<domain>): Debug: dict quota: user=<user>@<domain>, uri=file:/var/dovecot/imap/<domain>/<user>/dovecot-quota, noenforcing=0 doveadm(<user>@<domain>): Debug: Namespace inboxes: type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=no location=mdbox:~/mdbox doveadm(<user>@<domain>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<user>@<domain>): Debug: acl: initializing backend with data: vfile doveadm(<user>@<domain>): Debug: acl: acl username = <user>@<domain> doveadm(<user>@<domain>): Debug: acl: owner = 0 doveadm(<user>@<domain>): Debug: acl vfile: Global ACLs disabled doveadm(<user>@<domain>): Debug: Namespace users: type=shared, prefix=user/%n/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=mdbox:%h/mdbox:INDEXPVT=~/shared/%u doveadm(<user>@<domain>): Debug: shared: root=/run/dovecot, index=, indexpvt=, control=, inbox=, alt= doveadm(<user>@<domain>): Debug: acl: initializing backend with data: vfile doveadm(<user>@<domain>): Debug: acl: acl username = <user>@<domain> doveadm(<user>@<domain>): Debug: acl: owner = 0 doveadm(<user>@<domain>): Debug: acl vfile: Global ACLs disabled doveadm(<user>@<domain>): Debug: Namespace subs: type=private, prefix=, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:~/mdbox doveadm(<user>@<domain>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<user>@<domain>): Debug: acl: initializing backend with data: vfile doveadm(<user>@<domain>): Debug: acl: acl username = <user>@<domain> doveadm(<user>@<domain>): Debug: acl: owner = 0 doveadm(<user>@<domain>): Debug: acl vfile: Global ACLs disabled doveadm(<user>@<domain>): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(<user>@<domain>): user-lookup(<user>@<domain>)Debug: Added userdb setting: plugin/master_user=<user>@<domain> doveadm(<user>@<domain>): user-lookup(<user>@<domain>)Debug: Added userdb setting: plugin/userdb_acl_groups=admins@<domain>,hts büro@<domain>,hts@<domain> doveadm(<user>@<domain>): user-lookup(<user>@<domain>)Debug: Added userdb setting: plugin/userdb_quota_rule=*:bytes=10485760000 doveadm(<user>@<domain>): Debug: Effective uid=90, gid=101, home=/var/dovecot/imap/<domain>/<user> doveadm(<user>@<domain>): Debug: Quota root: name=User quota backend=dict args=:ns=INBOX/:file:/var/dovecot/imap/<domain>/<user>/dovecot-quota doveadm(<user>@<domain>): Debug: Quota rule: root=User quota mailbox=* bytes=107374182400 messages=0 doveadm(<user>@<domain>): Debug: Quota grace: root=User quota bytes=10737418240 (10%) doveadm(<user>@<domain>): Debug: dict quota: user=<user>@<domain>, uri=file:/var/dovecot/imap/<domain>/<user>/dovecot-quota, noenforcing=0 doveadm(<user>@<domain>): Debug: fs: root=/var/dovecot/imap/<domain>/<user>.broken/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(<user>@<domain>): Debug: acl: initializing backend with data: vfile doveadm(<user>@<domain>): Debug: acl: acl username = <user>@<domain> doveadm(<user>@<domain>): Debug: acl: owner = 0 doveadm(<user>@<domain>): Debug: acl vfile: Global ACLs disabled doveadm(<user>@<domain>): Error: quota: Unknown namespace: INBOX/ doveadm(<user>@<domain>): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(<user>@<domain>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>.broken/mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl not found doveadm(<user>@<domain>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>.broken/mdbox/mailboxes/dovecot-acl not found doveadm(<user>@<domain>): Debug: acl: Mailbox not in dovecot-acl-list: MailboxA doveadm(<user>@<domain>): Debug: acl: Mailbox not in dovecot-acl-list: MailboxB <skiped many more mailboxes/> doveadm(<user>@<domain>): Debug: INBOX: Mailbox opened because: import doveadm(<user>@<domain>): Debug: Namespace : Using permissions from /var/dovecot/imap/<domain>/<user>/mdbox: mode=0700 gid=default doveadm(<user>@<domain>): Debug: replication: Replication requested by 'mailbox subscribe', priority=1 doveadm(<user>@<domain>): Debug: INBOX/INBOX: Mailbox opened because: import doveadm(<user>@<domain>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl not found doveadm(<user>@<domain>): Debug: acl vfile: file /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/dovecot-acl not found doveadm(<user>@<domain>): Error: Opening INBOX failed: Mailbox doesn't exist: INBOX/INBOX doveadm(<user>@<domain>): Error: Syncing mailbox INBOX/INBOX failed: Opening INBOX failed: Mailbox doesn't exist: INBOX/INBOX
Any ideas what the problem could be and how to fix it?
Or what other information I can supply to help diagnose the problem.
Ralf
-- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0
On 7 Sep 2017, at 17.42, Ralf Becker <rb@egroupware.org> wrote:
Dovecot 2.2.31 with mailboxes in mdbox format.
Since a couple of days some mailboxes have the problem, that sieve rules moving mails to folders stop working and .sieve.log in mailbox shows:
sieve: info: started log at Sep 07 13:57:17. error: msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de>: failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: INBOX/Munser.
When I do a doveadm mailbox list -s -u <user>@<domain> I get all folders incl. the one mentioned above, while doveadm mailbox list without -s shows just user INBOX
Subscriptions are stored independently from the actual folders. So it looks like the subscription file exists and is correct, but somehow you've lost all the folders. Do you see the folders in the filesystem under user/mailboxes/ directory? My guess is that it only has INBOX, which means the folders were deleted by something (Dovecot corruption can't lose entire folders - something must explicitly delete them).
Am 14.09.17 um 01:07 schrieb Timo Sirainen:
On 7 Sep 2017, at 17.42, Ralf Becker <rb@egroupware.org> wrote:
Dovecot 2.2.31 with mailboxes in mdbox format.
Since a couple of days some mailboxes have the problem, that sieve rules moving mails to folders stop working and .sieve.log in mailbox shows:
sieve: info: started log at Sep 07 13:57:17. error: msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de>: failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: INBOX/Munser.
When I do a doveadm mailbox list -s -u <user>@<domain> I get all folders incl. the one mentioned above, while doveadm mailbox list without -s shows just user INBOX Subscriptions are stored independently from the actual folders. So it looks like the subscription file exists and is correct, but somehow you've lost all the folders. Do you see the folders in the filesystem under user/mailboxes/ directory?
Yes, the folders exist under /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/. Just doveadm mailbox list -u <user>@<domain> (without -s) does only show INBOX and user. (I can send you the list of folders via private mail, but I can not post them on the list.)
Anything I can do to get Dovecot to eg. rescan the folders from the filesystem or any other way to fix that problem? I have it with a couple of mailboxes, so I believe it's some kind of systematic problem, nothing the users did.
Ralf
My guess is that it only has INBOX, which means the folders were deleted by something (Dovecot corruption can't lose entire folders - something must explicitly delete them).
-- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0
On 18.09.2017 12:10, Ralf Becker wrote:
On 7 Sep 2017, at 17.42, Ralf Becker <rb@egroupware.org> wrote:
Dovecot 2.2.31 with mailboxes in mdbox format.
Since a couple of days some mailboxes have the problem, that sieve rules moving mails to folders stop working and .sieve.log in mailbox shows:
sieve: info: started log at Sep 07 13:57:17. error: msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de>: failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: INBOX/Munser.
When I do a doveadm mailbox list -s -u <user>@<domain> I get all folders incl. the one mentioned above, while doveadm mailbox list without -s shows just user INBOX Subscriptions are stored independently from the actual folders. So it looks like the subscription file exists and is correct, but somehow you've lost all the folders. Do you see the folders in the filesystem under user/mailboxes/ directory? Yes, the folders exist under /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/. Just doveadm mailbox list -u <user>@<domain> (without -s) does only show INBOX and user. (I can send you the list of folders via private mail, but I can not post
Am 14.09.17 um 01:07 schrieb Timo Sirainen: them on the list.)
Anything I can do to get Dovecot to eg. rescan the folders from the filesystem or any other way to fix that problem? I have it with a couple of mailboxes, so I believe it's some kind of systematic problem, nothing the users did.
Ralf
My guess is that it only has INBOX, which means the folders were deleted by something (Dovecot corruption can't lose entire folders - something must explicitly delete them).
You can always try doveadm force-resync -u victim "*"
You should run it twice, I guess.
Aki
Hi Aki,
Am 18.09.17 um 11:13 schrieb Aki Tuomi:
On 18.09.2017 12:10, Ralf Becker wrote:
On 7 Sep 2017, at 17.42, Ralf Becker <rb@egroupware.org> wrote:
Dovecot 2.2.31 with mailboxes in mdbox format.
Since a couple of days some mailboxes have the problem, that sieve rules moving mails to folders stop working and .sieve.log in mailbox shows:
sieve: info: started log at Sep 07 13:57:17. error: msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de>: failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: INBOX/Munser.
When I do a doveadm mailbox list -s -u <user>@<domain> I get all folders incl. the one mentioned above, while doveadm mailbox list without -s shows just user INBOX Subscriptions are stored independently from the actual folders. So it looks like the subscription file exists and is correct, but somehow you've lost all the folders. Do you see the folders in the filesystem under user/mailboxes/ directory? Yes, the folders exist under /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/. Just doveadm mailbox list -u <user>@<domain> (without -s) does only show INBOX and user. (I can send you the list of folders via private mail, but I can not post
Am 14.09.17 um 01:07 schrieb Timo Sirainen: them on the list.)
Anything I can do to get Dovecot to eg. rescan the folders from the filesystem or any other way to fix that problem? I have it with a couple of mailboxes, so I believe it's some kind of systematic problem, nothing the users did.
Ralf
My guess is that it only has INBOX, which means the folders were deleted by something (Dovecot corruption can't lose entire folders - something must explicitly delete them). You can always try doveadm force-resync -u victim "*"
You should run it twice, I guess.
Tried that before and just tried it again, no luck :(
root@fra-nfs-mail:/var/dovecot/imap/<domain># doveadm force-resync -u <user>@<domain> "*" doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index doveadm(<user>@<domain>): Warning: mdbox /var/dovecot/imap/<domain>/<user>/mdbox/storage: rebuilding indexes doveadm(<user>@<domain>): Warning: Transaction log file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index.log was locked for 72 seconds (mdbox storage rebuild) doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index
root@fra-nfs-mail:/var/dovecot/imap/<domain># doveadm force-resync -u <user>@<domain> "*" doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index doveadm(<user>@<domain>): Warning: mdbox /var/dovecot/imap/<domain>/<user>/mdbox/storage: rebuilding indexes doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index
root@fra-nfs-mail:/var/dovecot/imap/<domain># doveadm mailbox list -u <user>@<domain> user INBOX
What else can I do to analyse the problem?
Ralf
-- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0
On 18.09.2017 12:20, Ralf Becker wrote:
Hi Aki,
Am 18.09.17 um 11:13 schrieb Aki Tuomi:
On 18.09.2017 12:10, Ralf Becker wrote:
On 7 Sep 2017, at 17.42, Ralf Becker <rb@egroupware.org> wrote:
Dovecot 2.2.31 with mailboxes in mdbox format.
Since a couple of days some mailboxes have the problem, that sieve rules moving mails to folders stop working and .sieve.log in mailbox shows:
sieve: info: started log at Sep 07 13:57:17. error: msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de>: failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: INBOX/Munser.
When I do a doveadm mailbox list -s -u <user>@<domain> I get all folders incl. the one mentioned above, while doveadm mailbox list without -s shows just user INBOX Subscriptions are stored independently from the actual folders. So it looks like the subscription file exists and is correct, but somehow you've lost all the folders. Do you see the folders in the filesystem under user/mailboxes/ directory? Yes, the folders exist under /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/. Just doveadm mailbox list -u <user>@<domain> (without -s) does only show INBOX and user. (I can send you the list of folders via private mail, but I can not post
Am 14.09.17 um 01:07 schrieb Timo Sirainen: them on the list.)
Anything I can do to get Dovecot to eg. rescan the folders from the filesystem or any other way to fix that problem? I have it with a couple of mailboxes, so I believe it's some kind of systematic problem, nothing the users did.
Ralf
My guess is that it only has INBOX, which means the folders were deleted by something (Dovecot corruption can't lose entire folders - something must explicitly delete them). You can always try doveadm force-resync -u victim "*"
You should run it twice, I guess. Tried that before and just tried it again, no luck :(
root@fra-nfs-mail:/var/dovecot/imap/<domain># doveadm force-resync -u <user>@<domain> "*" doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index doveadm(<user>@<domain>): Warning: mdbox /var/dovecot/imap/<domain>/<user>/mdbox/storage: rebuilding indexes doveadm(<user>@<domain>): Warning: Transaction log file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index.log was locked for 72 seconds (mdbox storage rebuild) doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index
root@fra-nfs-mail:/var/dovecot/imap/<domain># doveadm force-resync -u <user>@<domain> "*" doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index doveadm(<user>@<domain>): Warning: mdbox /var/dovecot/imap/<domain>/<user>/mdbox/storage: rebuilding indexes doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index
root@fra-nfs-mail:/var/dovecot/imap/<domain># doveadm mailbox list -u <user>@<domain> user INBOX
What else can I do to analyse the problem?
Ralf
It seems you are running into https://github.com/dovecot/core/commit/c8be39472a93a5de2cc1051bdbd4468bea0ca...
Aki
Hi Aki,
Am 18.09.17 um 11:22 schrieb Aki Tuomi:
On 18.09.2017 12:20, Ralf Becker wrote:
Hi Aki,
Am 18.09.17 um 11:13 schrieb Aki Tuomi:
On 18.09.2017 12:10, Ralf Becker wrote:
On 7 Sep 2017, at 17.42, Ralf Becker <rb@egroupware.org> wrote:
Dovecot 2.2.31 with mailboxes in mdbox format.
Since a couple of days some mailboxes have the problem, that sieve rules moving mails to folders stop working and .sieve.log in mailbox shows:
sieve: info: started log at Sep 07 13:57:17. error: msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de>: failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: INBOX/Munser.
When I do a doveadm mailbox list -s -u <user>@<domain> I get all folders incl. the one mentioned above, while doveadm mailbox list without -s shows just user INBOX Subscriptions are stored independently from the actual folders. So it looks like the subscription file exists and is correct, but somehow you've lost all the folders. Do you see the folders in the filesystem under user/mailboxes/ directory? Yes, the folders exist under /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/. Just doveadm mailbox list -u <user>@<domain> (without -s) does only show INBOX and user. (I can send you the list of folders via private mail, but I can not post
Am 14.09.17 um 01:07 schrieb Timo Sirainen: them on the list.)
Anything I can do to get Dovecot to eg. rescan the folders from the filesystem or any other way to fix that problem? I have it with a couple of mailboxes, so I believe it's some kind of systematic problem, nothing the users did.
Ralf
My guess is that it only has INBOX, which means the folders were deleted by something (Dovecot corruption can't lose entire folders - something must explicitly delete them). You can always try doveadm force-resync -u victim "*"
You should run it twice, I guess. Tried that before and just tried it again, no luck :(
root@fra-nfs-mail:/var/dovecot/imap/<domain># doveadm force-resync -u <user>@<domain> "*" doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index doveadm(<user>@<domain>): Warning: mdbox /var/dovecot/imap/<domain>/<user>/mdbox/storage: rebuilding indexes doveadm(<user>@<domain>): Warning: Transaction log file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index.log was locked for 72 seconds (mdbox storage rebuild) doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index
root@fra-nfs-mail:/var/dovecot/imap/<domain># doveadm force-resync -u <user>@<domain> "*" doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index doveadm(<user>@<domain>): Warning: mdbox /var/dovecot/imap/<domain>/<user>/mdbox/storage: rebuilding indexes doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index
root@fra-nfs-mail:/var/dovecot/imap/<domain># doveadm mailbox list -u <user>@<domain> user INBOX
What else can I do to analyse the problem?
Ralf
It seems you are running into https://github.com/dovecot/core/commit/c8be39472a93a5de2cc1051bdbd4468bea0ca...
That commit is part of 2.2.32, as far as I can see on Github, so I *only* need to update?
I'm a bit reluctant to update, after all the problems in the version bitween 2.2.27 and 2.2.31 ...
You recon the update 2.2.31 to .32 has no know problems so far?
Ralf
-- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0
Am 18.09.17 um 11:34 schrieb Ralf Becker:
Hi Aki,
Am 18.09.17 um 11:22 schrieb Aki Tuomi:
On 18.09.2017 12:20, Ralf Becker wrote:
Hi Aki,
Am 18.09.17 um 11:13 schrieb Aki Tuomi:
On 18.09.2017 12:10, Ralf Becker wrote:
On 7 Sep 2017, at 17.42, Ralf Becker <rb@egroupware.org> wrote: > Dovecot 2.2.31 with mailboxes in mdbox format. > > Since a couple of days some mailboxes have the problem, that sieve rules > moving mails to folders stop working and .sieve.log in mailbox shows: > > sieve: info: started log at Sep 07 13:57:17. > error: > msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de>: > failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: > INBOX/Munser. > > When I do a doveadm mailbox list -s -u <user>@<domain> I get all folders > incl. the one mentioned above, while doveadm mailbox list without -s > shows just > user > INBOX Subscriptions are stored independently from the actual folders. So it looks like the subscription file exists and is correct, but somehow you've lost all the folders. Do you see the folders in the filesystem under user/mailboxes/ directory? Yes, the folders exist under /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/. Just doveadm mailbox list -u <user>@<domain> (without -s) does only show INBOX and user. (I can send you the list of folders via private mail, but I can not post
Am 14.09.17 um 01:07 schrieb Timo Sirainen: them on the list.)
Anything I can do to get Dovecot to eg. rescan the folders from the filesystem or any other way to fix that problem? I have it with a couple of mailboxes, so I believe it's some kind of systematic problem, nothing the users did.
Ralf
My guess is that it only has INBOX, which means the folders were deleted by something (Dovecot corruption can't lose entire folders - something must explicitly delete them). You can always try doveadm force-resync -u victim "*"
You should run it twice, I guess. Tried that before and just tried it again, no luck :(
root@fra-nfs-mail:/var/dovecot/imap/<domain># doveadm force-resync -u <user>@<domain> "*" doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index doveadm(<user>@<domain>): Warning: mdbox /var/dovecot/imap/<domain>/<user>/mdbox/storage: rebuilding indexes doveadm(<user>@<domain>): Warning: Transaction log file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index.log was locked for 72 seconds (mdbox storage rebuild) doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index
root@fra-nfs-mail:/var/dovecot/imap/<domain># doveadm force-resync -u <user>@<domain> "*" doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index doveadm(<user>@<domain>): Warning: mdbox /var/dovecot/imap/<domain>/<user>/mdbox/storage: rebuilding indexes doveadm(<user>@<domain>): Warning: fscking index file /var/dovecot/imap/<domain>/<user>/mdbox/storage/dovecot.map.index
root@fra-nfs-mail:/var/dovecot/imap/<domain># doveadm mailbox list -u <user>@<domain> user INBOX
What else can I do to analyse the problem?
Ralf
It seems you are running into https://github.com/dovecot/core/commit/c8be39472a93a5de2cc1051bdbd4468bea0ca... That commit is part of 2.2.32, as far as I can see on Github, so I *only* need to update?
I'm a bit reluctant to update, after all the problems in the version bitween 2.2.27 and 2.2.31 ...
You recon the update 2.2.31 to .32 has no know problems so far?
Ralf
Did the update to 2.2.32 now, but no change, after 2 force-resync doveadm mailbox list still only reports INBOX and user.
Trying Timos ACL stuff now ...
Ralf
-- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0
On 18 Sep 2017, at 12.10, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org>> wrote:
Am 14.09.17 um 01:07 schrieb Timo Sirainen:
On 7 Sep 2017, at 17.42, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org>> wrote:
Dovecot 2.2.31 with mailboxes in mdbox format.
Since a couple of days some mailboxes have the problem, that sieve rules moving mails to folders stop working and .sieve.log in mailbox shows:
sieve: info: started log at Sep 07 13:57:17. error: msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de <mailto:20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de>>: failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: INBOX/Munser.
When I do a doveadm mailbox list -s -u <user>@<domain> I get all folders incl. the one mentioned above, while doveadm mailbox list without -s shows just user INBOX Subscriptions are stored independently from the actual folders. So it looks like the subscription file exists and is correct, but somehow you've lost all the folders. Do you see the folders in the filesystem under user/mailboxes/ directory?
Yes, the folders exist under /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/. Just doveadm mailbox list -u <user>@<domain> (without -s) does only show INBOX and user. (I can send you the list of folders via private mail, but I can not post them on the list.)
Anything I can do to get Dovecot to eg. rescan the folders from the filesystem or any other way to fix that problem? I have it with a couple of mailboxes, so I believe it's some kind of systematic problem, nothing the users did.
I can't really think of any reason why it wouldn't simply work. Especially since you're not using v2.2.32, the folder listing is always performed by listing the directories in filesystem, so there's nothing really to resync. What's your doveconf -n? You could try with mailbox_list_index=no if that happens to make any difference, but it shouldn't.
You could also try what "strace -o log -s 100 doveadm mailbox list -u user@domain" shows. Is it opening the correct mailboxes/ directory? Maybe the path is just wrong for some reason (some typo added somewhere)?
Hi Timo,
Am 18.09.17 um 12:03 schrieb Timo Sirainen:
On 18 Sep 2017, at 12.10, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org>> wrote:
Am 14.09.17 um 01:07 schrieb Timo Sirainen:
On 7 Sep 2017, at 17.42, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org>> wrote:
Dovecot 2.2.31 with mailboxes in mdbox format.
Since a couple of days some mailboxes have the problem, that sieve rules moving mails to folders stop working and .sieve.log in mailbox shows:
sieve: info: started log at Sep 07 13:57:17. error: msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de <mailto:20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de>>: failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: INBOX/Munser.
When I do a doveadm mailbox list -s -u <user>@<domain> I get all folders incl. the one mentioned above, while doveadm mailbox list without -s shows just user INBOX Subscriptions are stored independently from the actual folders. So it looks like the subscription file exists and is correct, but somehow you've lost all the folders. Do you see the folders in the filesystem under user/mailboxes/ directory?
Yes, the folders exist under /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/. Just doveadm mailbox list -u <user>@<domain> (without -s) does only show INBOX and user. (I can send you the list of folders via private mail, but I can not post them on the list.)
Anything I can do to get Dovecot to eg. rescan the folders from the filesystem or any other way to fix that problem? I have it with a couple of mailboxes, so I believe it's some kind of systematic problem, nothing the users did.
I can't really think of any reason why it wouldn't simply work. Especially since you're not using v2.2.32, the folder listing is always performed by listing the directories in filesystem, so there's nothing really to resync. What's your doveconf -n? You could try with mailbox_list_index=no if that happens to make any difference, but it shouldn't.
You could also try what "strace -o log -s 100 doveadm mailbox list -u user@domain" shows. Is it opening the correct mailboxes/ directory? Maybe the path is just wrong for some reason (some typo added somewhere)?
Nope it lstats the correct directories, but does not show them.
I send you the strace / sysdig output per private mail, as it contains private information of that user.
Ralf
-- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0
On 18 Sep 2017, at 20.12, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org>> wrote:
Hi Timo,
Am 18.09.17 um 12:03 schrieb Timo Sirainen:
On 18 Sep 2017, at 12.10, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org> <mailto:rb@egroupware.org <mailto:rb@egroupware.org>>> wrote:
Am 14.09.17 um 01:07 schrieb Timo Sirainen:
On 7 Sep 2017, at 17.42, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org> <mailto:rb@egroupware.org <mailto:rb@egroupware.org>>> wrote:
Dovecot 2.2.31 with mailboxes in mdbox format.
Since a couple of days some mailboxes have the problem, that sieve rules moving mails to folders stop working and .sieve.log in mailbox shows:
sieve: info: started log at Sep 07 13:57:17. error: msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de <mailto:20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de> <mailto:20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de <mailto:20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de>>>: failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: INBOX/Munser.
When I do a doveadm mailbox list -s -u <user>@<domain> I get all folders incl. the one mentioned above, while doveadm mailbox list without -s shows just user INBOX Subscriptions are stored independently from the actual folders. So it looks like the subscription file exists and is correct, but somehow you've lost all the folders. Do you see the folders in the filesystem under user/mailboxes/ directory?
Yes, the folders exist under /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/. Just doveadm mailbox list -u <user>@<domain> (without -s) does only show INBOX and user. (I can send you the list of folders via private mail, but I can not post them on the list.)
Anything I can do to get Dovecot to eg. rescan the folders from the filesystem or any other way to fix that problem? I have it with a couple of mailboxes, so I believe it's some kind of systematic problem, nothing the users did.
I can't really think of any reason why it wouldn't simply work. Especially since you're not using v2.2.32, the folder listing is always performed by listing the directories in filesystem, so there's nothing really to resync. What's your doveconf -n? You could try with mailbox_list_index=no if that happens to make any difference, but it shouldn't.
You could also try what "strace -o log -s 100 doveadm mailbox list -u user@domain" shows. Is it opening the correct mailboxes/ directory? Maybe the path is just wrong for some reason (some typo added somewhere)?
Nope it lstats the correct directories, but does not show them.
I send you the strace / sysdig output per private mail, as it contains private information of that user.
Looks like you have some dovecot-acl and dovecot-acl-list files, so it has to be because Dovecot thinks the ACLs are preventing access to the user. Try deleting dovecot-acl-list to see if the problem is with that. If not, look at the dovecot-acl files and/or "doveadm acl debug -u user@domain <folder that's supposed to exist>" to figure out what's wrong.
Hi Timo,
update to 2.2.32 (suggested by Aki) did not change the situation ...
Am 18.09.17 um 20:49 schrieb Timo Sirainen:
On 18 Sep 2017, at 20.12, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org>> wrote:
Hi Timo,
Am 18.09.17 um 12:03 schrieb Timo Sirainen:
On 18 Sep 2017, at 12.10, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org> <mailto:rb@egroupware.org>> wrote:
Am 14.09.17 um 01:07 schrieb Timo Sirainen:
On 7 Sep 2017, at 17.42, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org> <mailto:rb@egroupware.org>> wrote:
Dovecot 2.2.31 with mailboxes in mdbox format.
Since a couple of days some mailboxes have the problem, that sieve rules moving mails to folders stop working and .sieve.log in mailbox shows:
sieve: info: started log at Sep 07 13:57:17. error: msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de <mailto:20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de> <mailto:20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de>>: failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: INBOX/Munser.
When I do a doveadm mailbox list -s -u <user>@<domain> I get all folders incl. the one mentioned above, while doveadm mailbox list without -s shows just user INBOX Subscriptions are stored independently from the actual folders. So it looks like the subscription file exists and is correct, but somehow you've lost all the folders. Do you see the folders in the filesystem under user/mailboxes/ directory?
Yes, the folders exist under /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/. Just doveadm mailbox list -u <user>@<domain> (without -s) does only show INBOX and user. (I can send you the list of folders via private mail, but I can not post them on the list.)
Anything I can do to get Dovecot to eg. rescan the folders from the filesystem or any other way to fix that problem? I have it with a couple of mailboxes, so I believe it's some kind of systematic problem, nothing the users did.
I can't really think of any reason why it wouldn't simply work. Especially since you're not using v2.2.32, the folder listing is always performed by listing the directories in filesystem, so there's nothing really to resync. What's your doveconf -n? You could try with mailbox_list_index=no if that happens to make any difference, but it shouldn't.
You could also try what "strace -o log -s 100 doveadm mailbox list -u user@domain" shows. Is it opening the correct mailboxes/ directory? Maybe the path is just wrong for some reason (some typo added somewhere)?
Nope it lstats the correct directories, but does not show them.
I send you the strace / sysdig output per private mail, as it contains private information of that user.
Looks like you have some dovecot-acl and dovecot-acl-list files, so it has to be because Dovecot thinks the ACLs are preventing access to the user. Try deleting dovecot-acl-list to see if the problem is with that. If not, look at the dovecot-acl files and/or "doveadm acl debug -u user@domain <folder that's supposed to exist>" to figure out what's wrong.
root@fra-nfs-mail:~# doveadm acl debug -u <user>@<domain> INBOX/AA doveadm(<user>@<domain>): Info: Mailbox 'AA' is in namespace 'INBOX/' doveadm(<user>@<domain>): Info: Mailbox path: /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/AA/dbox-Mails doveadm(<user>@<domain>): Info: All message flags are shared across users in mailbox doveadm(<user>@<domain>): Info: User <user>@<domain> has no rights for mailbox doveadm(<user>@<domain>): Error: User <user>@<domain> is missing 'lookup' right doveadm(<user>@<domain>): Info: Mailbox INBOX/AA is NOT visible in LIST
Ok, but when I try to fix it:
root@fra-nfs-mail:~# doveadm acl add -u <user>@<domain> INBOX/AA user=<user>@<domain> admin create delete expunge insert lookup post read write write-deleted write-seen
root@fra-nfs-mail:~# doveadm acl add -u <user>@<domain> INBOX/AA owner admin create delete expunge insert lookup post read write write-deleted write-seen
root@fra-nfs-mail:~# doveadm acl get -u <user>@<domain> INBOX/AA ID Global Rights owner admin create delete expunge insert lookup post read write write-deleted write-seen user=<user>@<domain> admin create delete expunge insert lookup post read write write-deleted write-seen
Nothing has changed :(
root@fra-nfs-mail:~# doveadm acl debug -u <user>@<domain> INBOX/AA doveadm(<user>@<domain>): Info: Mailbox 'AA' is in namespace 'INBOX/' doveadm(<user>@<domain>): Info: Mailbox path: /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/AA/dbox-Mails doveadm(<user>@<domain>): Info: All message flags are shared across users in mailbox doveadm(<user>@<domain>): Info: User <user>@<domain> has no rights for mailbox doveadm(<user>@<domain>): Error: User <user>@<domain> is missing 'lookup' right doveadm(<user>@<domain>): Info: Mailbox INBOX/AA is NOT visible in LIST
How to fix that situation?
Is there a way to reset acl of all folders of a user to all rights for the owner?
root@fra-nfs-mail:/var/dovecot/imap/<domain>/<user># find -name "dovecot-acl*" ./mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl ./mdbox/mailboxes/AA/dbox-Mails/dovecot-acl ./mdbox/dovecot-acl-list
Ralf
-- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0
Am 19.09.17 um 00:03 schrieb Ralf Becker:
Hi Timo,
update to 2.2.32 (suggested by Aki) did not change the situation ...
Am 18.09.17 um 20:49 schrieb Timo Sirainen:
Hi Timo,
Am 18.09.17 um 12:03 schrieb Timo Sirainen:
On 18 Sep 2017, at 12.10, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org> <mailto:rb@egroupware.org>> wrote:
On 7 Sep 2017, at 17.42, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org> <mailto:rb@egroupware.org>> wrote: > Dovecot 2.2.31 with mailboxes in mdbox format. > > Since a couple of days some mailboxes have the problem, that sieve > rules > moving mails to folders stop working and .sieve.log in mailbox shows: > > sieve: info: started log at Sep 07 13:57:17. > error: > msgid=<20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de > <mailto:20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de> > <mailto:20170907155704.EGroupware.S4yThVJRr12WSiJLpKbK0Bz@somedomain.egroupware.de>>: > failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist: > INBOX/Munser. > > When I do a doveadm mailbox list -s -u <user>@<domain> I get all > folders > incl. the one mentioned above, while doveadm mailbox list without -s > shows just > user > INBOX Subscriptions are stored independently from the actual folders. So it looks like the subscription file exists and is correct, but somehow you've lost all the folders. Do you see the folders in the filesystem under user/mailboxes/ directory? Yes, the folders exist under /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/. Just doveadm mailbox list -u <user>@<domain> (without -s) does only show INBOX and user. (I can send you the list of folders via private mail, but I can not
Am 14.09.17 um 01:07 schrieb Timo Sirainen: post them on the list.)
Anything I can do to get Dovecot to eg. rescan the folders from the filesystem or any other way to fix that problem? I have it with a couple of mailboxes, so I believe it's some kind of systematic problem, nothing the users did. I can't really think of any reason why it wouldn't simply work. Especially since you're not using v2.2.32, the folder listing is always performed by listing the directories in filesystem, so there's nothing really to resync. What's your doveconf -n? You could try with mailbox_list_index=no if that happens to make any difference, but it shouldn't.
You could also try what "strace -o log -s 100 doveadm mailbox list -u user@domain" shows. Is it opening the correct mailboxes/ directory? Maybe the path is just wrong for some reason (some typo added somewhere)?
Nope it lstats the correct directories, but does not show them.
I send you the strace / sysdig output per private mail, as it contains private information of that user. Looks like you have some dovecot-acl and dovecot-acl-list files, so it has to be because Dovecot thinks the ACLs are preventing access to the user. Try deleting dovecot-acl-list to see if the problem is with
On 18 Sep 2017, at 20.12, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org>> wrote: that. If not, look at the dovecot-acl files and/or "doveadm acl debug -u user@domain <folder that's supposed to exist>" to figure out what's wrong.
root@fra-nfs-mail:~# doveadm acl debug -u <user>@<domain> INBOX/AA doveadm(<user>@<domain>): Info: Mailbox 'AA' is in namespace 'INBOX/' doveadm(<user>@<domain>): Info: Mailbox path: /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/AA/dbox-Mails doveadm(<user>@<domain>): Info: All message flags are shared across users in mailbox doveadm(<user>@<domain>): Info: User <user>@<domain> has no rights for mailbox doveadm(<user>@<domain>): Error: User <user>@<domain> is missing 'lookup' right doveadm(<user>@<domain>): Info: Mailbox INBOX/AA is NOT visible in LIST
Ok, but when I try to fix it:
root@fra-nfs-mail:~# doveadm acl add -u <user>@<domain> INBOX/AA user=<user>@<domain> admin create delete expunge insert lookup post read write write-deleted write-seen
root@fra-nfs-mail:~# doveadm acl add -u <user>@<domain> INBOX/AA owner admin create delete expunge insert lookup post read write write-deleted write-seen
root@fra-nfs-mail:~# doveadm acl get -u <user>@<domain> INBOX/AA ID Global Rights owner admin create delete expunge insert lookup post read write write-deleted write-seen user=<user>@<domain> admin create delete expunge insert lookup post read write write-deleted write-seen
Nothing has changed :(
root@fra-nfs-mail:~# doveadm acl debug -u <user>@<domain> INBOX/AA doveadm(<user>@<domain>): Info: Mailbox 'AA' is in namespace 'INBOX/' doveadm(<user>@<domain>): Info: Mailbox path: /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/AA/dbox-Mails doveadm(<user>@<domain>): Info: All message flags are shared across users in mailbox doveadm(<user>@<domain>): Info: User <user>@<domain> has no rights for mailbox doveadm(<user>@<domain>): Error: User <user>@<domain> is missing 'lookup' right doveadm(<user>@<domain>): Info: Mailbox INBOX/AA is NOT visible in LIST
How to fix that situation?
Is there a way to reset acl of all folders of a user to all rights for the owner?
root@fra-nfs-mail:/var/dovecot/imap/<domain>/<user># find -name "dovecot-acl*" ./mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl ./mdbox/mailboxes/AA/dbox-Mails/dovecot-acl ./mdbox/dovecot-acl-list
Ralf
Here's my config:
root@fra-nfs-mail:~# doveadm config -n # 2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) # OS: Linux 4.4.0-93-generic x86_64 auth_cache_negative_ttl = 2 mins auth_cache_size = 10 M auth_cache_ttl = 5 mins auth_master_user_separator = * auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@#" default_client_limit = 3500 default_process_limit = 512 disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it doveadm_port = 12345 first_valid_uid = 90 listen = * log_path = /dev/stderr mail_access_groups = dovecot mail_gid = dovecot mail_location = mdbox:~/mdbox mail_log_prefix = "%s(%u %p): " mail_max_userip_connections = 200 mail_plugins = acl quota notify replication mail_log mail_uid = dovecot managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.debug mbox_min_index_size = 1000 B mdbox_rotate_size = 50 M namespace inboxes { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Templates { auto = subscribe } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX/ separator = / subscriptions = no } namespace subs { hidden = yes list = no location = prefix = separator = / } namespace users { location = mdbox:%%h/mdbox:INDEXPVT=~/shared/%%u prefix = user/%%n/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-dict-master-auth.conf driver = dict master = yes } passdb { args = /etc/dovecot/dovecot-dict-auth.conf driver = dict } plugin { acl = vfile acl_shared_dict = file:/var/dovecot/imap/%d/shared-mailboxes.db mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcp:10.44.99.1 quota = dict:User quota::ns=INBOX/:file:%h/dovecot-quota quota_rule = *:storage=100GB sieve = ~/sieve/dovecot.sieve sieve_after = /var/dovecot/sieve/after.d/ sieve_before = /var/dovecot/sieve/before.d/ sieve_dir = ~/sieve sieve_extensions = +editheader sieve_user_log = ~/.sieve.log } postmaster_address = admins@egroupware.org protocols = imap pop3 lmtp sieve quota_full_tempfail = yes replication_dsync_parameters = -d -n INBOX -l 30 -U service aggregator { fifo_listener replication-notify-fifo { user = dovecot } unix_listener replication-notify { user = dovecot } } service auth-worker { user = $default_internal_user } service doveadm { inet_listener { port = 12345 } inet_listener { port = 26 } vsz_limit = 512 M } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 5 service_count = 1 vsz_limit = 64 M } service imap { executable = imap process_limit = 2048 vsz_limit = 512 M } service lmtp { inet_listener lmtp { port = 24 } unix_listener lmtp { mode = 0666 } vsz_limit = 512 M } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { executable = pop3 } service postlogin { executable = script-login -d rawlog -b -t } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = dovecot mode = 0660 user = dovecot } } ssl_cert = </etc/certs/mail.egroupware.org.pem ssl_key = # hidden, use -P to show it userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-dict-auth.conf driver = dict } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol lda { mail_plugins = acl quota notify replication mail_log acl sieve quota } protocol imap { mail_max_userip_connections = 200 mail_plugins = acl quota notify replication mail_log acl imap_acl quota imap_quota } protocol lmtp { mail_max_lock_timeout = 25 secs mail_plugins = acl quota notify replication mail_log acl sieve quota }
-- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0
On 19 Sep 2017, at 1.03, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org>> wrote:
doveadm(<user>@<domain>): Info: Mailbox INBOX/AA is NOT visible in LIST
How to fix that situation?
Is there a way to reset acl of all folders of a user to all rights for the owner?
root@fra-nfs-mail:/var/dovecot/imap/<domain>/<user># find -name "dovecot-acl*" ./mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl ./mdbox/mailboxes/AA/dbox-Mails/dovecot-acl ./mdbox/dovecot-acl-list
Did you try deleting dovecot-acl-list to see if it makes a difference? What do these two dovecot-acl files contain? If you delete those, it should reset all the ACLs.
Hi Timo,
Am 20.09.17 um 02:06 schrieb Timo Sirainen:
On 19 Sep 2017, at 1.03, Ralf Becker <rb@egroupware.org <mailto:rb@egroupware.org>> wrote:
doveadm(<user>@<domain>): Info: Mailbox INBOX/AA is NOT visible in LIST
How to fix that situation?
Is there a way to reset acl of all folders of a user to all rights for the owner?
root@fra-nfs-mail:/var/dovecot/imap/<domain>/<user># find -name "dovecot-acl*" ./mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl ./mdbox/mailboxes/AA/dbox-Mails/dovecot-acl ./mdbox/dovecot-acl-list
Did you try deleting dovecot-acl-list to see if it makes a difference? What do these two dovecot-acl files contain?
root@fra-nfs-mail:/var/dovecot/imap/<domain>/<user># find -name dovecot-acl\* ./mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl ./mdbox/dovecot-acl-list root@fra-nfs-mail:/var/dovecot/imap/gruene-berlin.de/Christopher.Poschmann# cat mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl owner akxeilprwts user=<user>@<domain> akxeilprwts
This are the ACLs I set before.
If you delete those, it should reset all the ACLs.
root@fra-nfs-mail:/var/dovecot/imap/gruene-berlin.de/Christopher.Poschmann# find -name dovecot-acl\* ./mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl ./mdbox/dovecot-acl-list root@fra-nfs-mail:/var/dovecot/imap/gruene-berlin.de/Christopher.Poschmann# cat mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl owner akxeilprwts user=christopher.poschmann@gruene-berlin.de akxeilprwts root@fra-nfs-mail:/var/dovecot/imap/gruene-berlin.de/Christopher.Poschmann# rm mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl mdbox/dovecot-acl-list root@fra-nfs-mail:/var/dovecot/imap/gruene-berlin.de/Christopher.Poschmann# doveadm mailbox list -u christopher.poschmann@gruene-berlin.de user INBOX root@fra-nfs-mail:/var/dovecot/imap/<domain>/<user># doveadm acl debug -u <user>@<domain> INBOX doveadm(<user>@<domain>): Info: Mailbox 'INBOX' is in namespace 'INBOX/' doveadm(<user>@<domain>): Info: Mailbox path: /var/dovecot/imap/<domain>/<user>/mdbox/mailboxes/INBOX/dbox-Mails doveadm(<user>@<domain>): Info: All message flags are shared across users in mailbox doveadm(<user>@<domain>): Info: User <user>@<domain> has no rights for mailbox doveadm(<user>@<domain>): Error: User <user>@<domain> is missing 'lookup' right doveadm(<user>@<domain>): Info: Mailbox INBOX is NOT visible in LIST
Problem still exists, after deleting the dovecot-acl* files :(
I believe it's some kind of corruption in the mdbox files. I tried to move the mailbox away and import it again from the moved location, which so far fixed most of the problems we had in the past, but in case of that mailbox, it failed with a fatal error (see my first post in this thread).
Ralf
-- Ralf Becker EGroupware GmbH [www.egroupware.org] Handelsregister HRB Kaiserslautern 3587 Geschäftsführer Birgit und Ralf Becker Leibnizstr. 17, 67663 Kaiserslautern, Germany Telefon +49 631 31657-0
participants (3)
-
Aki Tuomi
-
Ralf Becker
-
Timo Sirainen