purge causing reappearing mails?
Hello,
today i got reappearing mails again, but not from purging. In the logs i only found this. I've got massive problems by many users because reappearing mails. If you need more information, i could provide.
Sep 02 12:58:43 doveadm: Warning: Transaction log file /var/spool/mail/<user>/storage/dovecot.map.index.log was locked for 43 second s (mdbox storage rebuild) Sep 02 12:58:43 doveadm: Warning: fscking index file /var/spool/mail/<user>/storage/dovecot.map.index Sep 02 12:58:43 doveadm: Warning: mdbox /var/spool/mail/<user>/storage: rebuilding indexes Sep 02 12:59:01 dsync-local(<user>)<esxhKpHzbF2jHQAA0H466A>: Error: Couldn't lock /var/spool/mail/<user>/.dovecot-sync.lock: fcntl(/var/spool/mail/<user>/.dovecot-sync.lock, write-lock, F_SETLKW) locking failed: Timed out after 600 seconds (WRITE lock held by pid 7584) Sep 02 12:59:34 doveadm: Warning: Transaction log file /var/spool/mail/<user>/storage/dovecot.map.index.log was locked for 51 seconds (mdbox storage rebuild) Sep 02 12:59:34 doveadm: Warning: fscking index file /var/spool/mail/<user>/storage/dovecot.map.index Sep 02 12:59:34 doveadm: Warning: fscking index file /var/spool/mail/<user>/storage/dovecot.map.index Sep 02 12:59:35 doveadm: Warning: mdbox /var/spool/mail/<user>/storage: rebuilding indexes Sep 02 13:00:22 doveadm: Warning: Transaction log file /var/spool/mail/<user>/storage/dovecot.map.index.log was locked for 48 seconds (mdbox storage rebuild) Sep 02 13:00:23 doveadm: Warning: fscking index file /var/spool/mail/<user>/storage/dovecot.map.index
On 26.08.19 18:06, sch tel via dovecot wrote:
Hello, i'm running 2 dovecot 2.3.4.1 servers with replication. once a week purge command is executed. but from time to time it seems there are deleted messages reappering after purge is executed. so i run in debug mode. i saw in the past a few questions about reappearing messages here on list. doveadm -v -D purge -A doveadm(user): Error: Corrupted dbox file /var/spool/mail/user/storage/m.10603 (around offset=7148503): invalid metadata magic doveadm(user): Warning: fscking index file /var/spool/mail/user/storage/dovecot.map.index doveadm(user): Warning: mdbox /var/spool/mail/user/storage: rebuilding indexes doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID bc4aa501fc4f7df7ac275f8c79279ff5 in m.2171:525629 (size=2026) and m.855:946779 (size=1784) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID b48e29a402f8683e7c91f32d16c52936 in m.2086:305158 (size=89091) and m.2732:614638 (size=88842) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 43d2f95804075dc336d8c4224bbba0b5 in m.2290:1234440 (size=1942) and m.9021:224875 (size=1943) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID df24cd27a10a8d431e01fabc157e66d0 in m.756:16 (size=47961) and m.1133:1693832 (size=47960) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 6e196b915f37623455521cc591b15294 in m.2263:63985 (size=2036) and m.1933:21800 (size=2037) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 7e890f08cef769c1800d24fd2c206c2d in m.2133:1658427 (size=64459) and m.2268:1012431 (size=64193) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID ab95f2c3b9df8950518e8064f1a89b2a in m.2133:827558 (size=23629) and m.2268:1304070 (size=23637) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID f4a82d0705e4072908ea4937ff49a6e1 in m.2144:1673818 (size=4380) and m.1638:2079685 (size=4117) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 82e1f95de0473e0425ce5e81055e6578 in m.1322:16 (size=2264817) and m.1280:16 (size=2264818) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 144c8f800e3201960cc197ea47169691 in m.2140:1820601 (size=2396) and m.2003:275867 (size=2127) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 52ea5e1729d92b384efd7b8796c798b5 in m.2268:1774031 (size=5661) and m.2292:117114 (size=5665) doveadm(user): Error: Corrupted dbox file /var/spool/mail/user/storage/m.10603 (around offset=7148503): metadata header has bad magic value doveadm(user): Warning: dbox: Copy of the broken file saved to /var/spool/mail/user/storage/m.10603.broken
Any idea what pid 7584 is?
Aki
On 2.9.2019 14.08, telsch via dovecot wrote:
Hello,
today i got reappearing mails again, but not from purging. In the logs i only found this. I've got massive problems by many users because reappearing mails. If you need more information, i could provide.
Sep 02 12:58:43 doveadm: Warning: Transaction log file /var/spool/mail/<user>/storage/dovecot.map.index.log was locked for 43 second s (mdbox storage rebuild) Sep 02 12:58:43 doveadm: Warning: fscking index file /var/spool/mail/<user>/storage/dovecot.map.index Sep 02 12:58:43 doveadm: Warning: mdbox /var/spool/mail/<user>/storage: rebuilding indexes Sep 02 12:59:01 dsync-local(<user>)<esxhKpHzbF2jHQAA0H466A>: Error: Couldn't lock /var/spool/mail/<user>/.dovecot-sync.lock: fcntl(/var/spool/mail/<user>/.dovecot-sync.lock, write-lock, F_SETLKW) locking failed: Timed out after 600 seconds (WRITE lock held by pid 7584) Sep 02 12:59:34 doveadm: Warning: Transaction log file /var/spool/mail/<user>/storage/dovecot.map.index.log was locked for 51 seconds (mdbox storage rebuild) Sep 02 12:59:34 doveadm: Warning: fscking index file /var/spool/mail/<user>/storage/dovecot.map.index Sep 02 12:59:34 doveadm: Warning: fscking index file /var/spool/mail/<user>/storage/dovecot.map.index Sep 02 12:59:35 doveadm: Warning: mdbox /var/spool/mail/<user>/storage: rebuilding indexes Sep 02 13:00:22 doveadm: Warning: Transaction log file /var/spool/mail/<user>/storage/dovecot.map.index.log was locked for 48 seconds (mdbox storage rebuild) Sep 02 13:00:23 doveadm: Warning: fscking index file /var/spool/mail/<user>/storage/dovecot.map.index
On 26.08.19 18:06, sch tel via dovecot wrote:
Hello, i'm running 2 dovecot 2.3.4.1 servers with replication. once a week purge command is executed. but from time to time it seems there are deleted messages reappering after purge is executed. so i run in debug mode. i saw in the past a few questions about reappearing messages here on list. doveadm -v -D purge -A doveadm(user): Error: Corrupted dbox file /var/spool/mail/user/storage/m.10603 (around offset=7148503): invalid metadata magic doveadm(user): Warning: fscking index file /var/spool/mail/user/storage/dovecot.map.index doveadm(user): Warning: mdbox /var/spool/mail/user/storage: rebuilding indexes doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID bc4aa501fc4f7df7ac275f8c79279ff5 in m.2171:525629 (size=2026) and m.855:946779 (size=1784) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID b48e29a402f8683e7c91f32d16c52936 in m.2086:305158 (size=89091) and m.2732:614638 (size=88842) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 43d2f95804075dc336d8c4224bbba0b5 in m.2290:1234440 (size=1942) and m.9021:224875 (size=1943) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID df24cd27a10a8d431e01fabc157e66d0 in m.756:16 (size=47961) and m.1133:1693832 (size=47960) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 6e196b915f37623455521cc591b15294 in m.2263:63985 (size=2036) and m.1933:21800 (size=2037) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 7e890f08cef769c1800d24fd2c206c2d in m.2133:1658427 (size=64459) and m.2268:1012431 (size=64193) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID ab95f2c3b9df8950518e8064f1a89b2a in m.2133:827558 (size=23629) and m.2268:1304070 (size=23637) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID f4a82d0705e4072908ea4937ff49a6e1 in m.2144:1673818 (size=4380) and m.1638:2079685 (size=4117) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 82e1f95de0473e0425ce5e81055e6578 in m.1322:16 (size=2264817) and m.1280:16 (size=2264818) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 144c8f800e3201960cc197ea47169691 in m.2140:1820601 (size=2396) and m.2003:275867 (size=2127) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 52ea5e1729d92b384efd7b8796c798b5 in m.2268:1774031 (size=5661) and m.2292:117114 (size=5665) doveadm(user): Error: Corrupted dbox file /var/spool/mail/user/storage/m.10603 (around offset=7148503): metadata header has bad magic value doveadm(user): Warning: dbox: Copy of the broken file saved to /var/spool/mail/user/storage/m.10603.broken
if it's still the same pid, yes:
<user> 7584 13.2 1.5 221168 63508 ? R 12:48 3:36 dovecot/doveadm-server
On 02.09.19 13:13, Aki Tuomi via dovecot wrote:
Any idea what pid 7584 is?
Aki
On 2.9.2019 14.08, telsch via dovecot wrote:
Hello,
today i got reappearing mails again, but not from purging. In the logs i only found this. I've got massive problems by many users because reappearing mails. If you need more information, i could provide.
Sep 02 12:58:43 doveadm: Warning: Transaction log file /var/spool/mail/<user>/storage/dovecot.map.index.log was locked for 43 second s (mdbox storage rebuild) Sep 02 12:58:43 doveadm: Warning: fscking index file /var/spool/mail/<user>/storage/dovecot.map.index Sep 02 12:58:43 doveadm: Warning: mdbox /var/spool/mail/<user>/storage: rebuilding indexes Sep 02 12:59:01 dsync-local(<user>)<esxhKpHzbF2jHQAA0H466A>: Error: Couldn't lock /var/spool/mail/<user>/.dovecot-sync.lock: fcntl(/var/spool/mail/<user>/.dovecot-sync.lock, write-lock, F_SETLKW) locking failed: Timed out after 600 seconds (WRITE lock held by pid 7584) Sep 02 12:59:34 doveadm: Warning: Transaction log file /var/spool/mail/<user>/storage/dovecot.map.index.log was locked for 51 seconds (mdbox storage rebuild) Sep 02 12:59:34 doveadm: Warning: fscking index file /var/spool/mail/<user>/storage/dovecot.map.index Sep 02 12:59:34 doveadm: Warning: fscking index file /var/spool/mail/<user>/storage/dovecot.map.index Sep 02 12:59:35 doveadm: Warning: mdbox /var/spool/mail/<user>/storage: rebuilding indexes Sep 02 13:00:22 doveadm: Warning: Transaction log file /var/spool/mail/<user>/storage/dovecot.map.index.log was locked for 48 seconds (mdbox storage rebuild) Sep 02 13:00:23 doveadm: Warning: fscking index file /var/spool/mail/<user>/storage/dovecot.map.index
On 26.08.19 18:06, sch tel via dovecot wrote:
Hello, i'm running 2 dovecot 2.3.4.1 servers with replication. once a week purge command is executed. but from time to time it seems there are deleted messages reappering after purge is executed. so i run in debug mode. i saw in the past a few questions about reappearing messages here on list. doveadm -v -D purge -A doveadm(user): Error: Corrupted dbox file /var/spool/mail/user/storage/m.10603 (around offset=7148503): invalid metadata magic doveadm(user): Warning: fscking index file /var/spool/mail/user/storage/dovecot.map.index doveadm(user): Warning: mdbox /var/spool/mail/user/storage: rebuilding indexes doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID bc4aa501fc4f7df7ac275f8c79279ff5 in m.2171:525629 (size=2026) and m.855:946779 (size=1784) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID b48e29a402f8683e7c91f32d16c52936 in m.2086:305158 (size=89091) and m.2732:614638 (size=88842) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 43d2f95804075dc336d8c4224bbba0b5 in m.2290:1234440 (size=1942) and m.9021:224875 (size=1943) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID df24cd27a10a8d431e01fabc157e66d0 in m.756:16 (size=47961) and m.1133:1693832 (size=47960) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 6e196b915f37623455521cc591b15294 in m.2263:63985 (size=2036) and m.1933:21800 (size=2037) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 7e890f08cef769c1800d24fd2c206c2d in m.2133:1658427 (size=64459) and m.2268:1012431 (size=64193) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID ab95f2c3b9df8950518e8064f1a89b2a in m.2133:827558 (size=23629) and m.2268:1304070 (size=23637) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID f4a82d0705e4072908ea4937ff49a6e1 in m.2144:1673818 (size=4380) and m.1638:2079685 (size=4117) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 82e1f95de0473e0425ce5e81055e6578 in m.1322:16 (size=2264817) and m.1280:16 (size=2264818) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 144c8f800e3201960cc197ea47169691 in m.2140:1820601 (size=2396) and m.2003:275867 (size=2127) doveadm(user): Error: mdbox /var/spool/mail/user/storage: Duplicate GUID 52ea5e1729d92b384efd7b8796c798b5 in m.2268:1774031 (size=5661) and m.2292:117114 (size=5665) doveadm(user): Error: Corrupted dbox file /var/spool/mail/user/storage/m.10603 (around offset=7148503): metadata header has bad magic value doveadm(user): Warning: dbox: Copy of the broken file saved to /var/spool/mail/user/storage/m.10603.broken
participants (3)
-
Aki Tuomi
-
sch tel
-
telsch