[Dovecot] Corrupted index cache file and Maildir filename has wrong W value
kmail stopped working and when I check the dovecot log file I see:
May 4 11:40:38 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Corrupted virtual size for uid=234: 633278 != 633251 May 4 11:40:38 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Corrupted virtual size for uid=234: 633278 != 633251 May 4 12:34:44 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/.Mailing Lists.Xorg Devel 2010-04/dovecot.index.cache: Corrupted virtual size for uid=312: 8884 != 8858 May 4 12:34:44 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/.Mailing Lists.Xorg Devel 2010-04/dovecot.index.cache: Corrupted virtual size for uid=312: 8884 != 8858 ... more of the same... May 4 13:02:54 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/.Mailing Lists.Xorg Users 2010-04/dovecot.index.cache: Corrupted virtual size for uid=38: 30392 != 30366 May 4 13:02:58 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/.Mailing Lists.Xorg Users 2010-04/dovecot.index.cache: Corrupted virtual size for uid=43: 8796 != 8770 May 4 15:25:03 f12barry dovecot: IMAP(bscott): FETCH [] for mailbox _NewMail-com UID 48 got too little data: 3230 vs 3278 May 4 15:25:03 f12barry dovecot: IMAP(bscott): Maildir filename has wrong W value: /home/bscott/Maildir/._NewMail-com/cur/1271683097.M615087P3538.f12barry.office.onelan.co.uk,S=3154,W=3278:2,S May 4 15:25:03 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Broken virtual size for mail UID 48 May 4 15:25:03 f12barry dovecot: IMAP(bscott): Disconnected: FETCH failed bytes=15437134/33737060 May 4 17:45:41 f12barry dovecot: dovecot: Killed with signal 15 (by pid=7300 uid=0 code=kill)
At this point I had only tail'ed the log and seen the issue with UID 48. I then:
- stopped dovecot
- deleted the ofending file
- deleted the dovecot* files
- started dovecot
May 4 17:49:58 f12barry dovecot: Dovecot v1.2.11 starting up (core dumps disabled) May 4 17:52:17 f12barry dovecot: Killed with signal 15 (by pid=7556 uid=0 code=kill) May 4 17:53:21 f12barry dovecot: Dovecot v1.2.11 starting up (core dumps disabled) May 4 17:53:21 f12barry sendmail[2067]: starting daemon (8.14.3): SMTP+queueing@01:00:00 May 4 17:53:21 f12barry sm-msp-queue[2075]: starting daemon (8.14.3): queueing@01:00:00 May 4 17:55:26 f12barry dovecot: imap-login: Login: user=<bscott>, method=PLAIN, rip=::1, lip=::1, secured May 4 17:55:29 f12barry dovecot: IMAP(bscott): FETCH [] for mailbox _NewMail-com UID 48 got too little data: 3878 vs 3920 May 4 17:55:29 f12barry dovecot: IMAP(bscott): Maildir filename has wrong W value: /home/bscott/Maildir/._NewMail-com/cur/1271683097.M733325P3538.f12barry.office.onelan.co.uk,S=3780,W=3920:2,S May 4 17:55:29 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Broken virtual size for mail UID 48 May 4 17:55:29 f12barry dovecot: IMAP(bscott): Disconnected: FETCH failed bytes=3955/48628 May 4 18:05:55 f12barry dovecot: imap-login: Login: user=<bscott>, method=PLAIN, rip=::1, lip=::1, secured
Now another file is being complained about.
What would cause these problems? What is the W value and how could I check it?
Here is the details of the dovecot I'm using and the kmail version I'm using.ƀ
$ sudo dovecot -n # 1.2.11: /etc/dovecot.conf # OS: Linux 2.6.32.11-99.fc12.x86_64 x86_64 Fedora release 12 (Constantine) login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd
Client is kmail from kdepim-4.4.2-1.fc12.x86_64
Barry
On Tuesday 04 May 2010 18:21:50 Barry Scott wrote:
kmail stopped working and when I check the dovecot log file I see:
May 4 11:40:38 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Corrupted virtual size for uid=234: 633278 != 633251 May 4 11:40:38 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Corrupted virtual size for uid=234: 633278 != 633251 May 4 12:34:44 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/.Mailing Lists.Xorg Devel 2010-04/dovecot.index.cache: Corrupted virtual size for uid=312: 8884 != 8858 May 4 12:34:44 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/.Mailing Lists.Xorg Devel 2010-04/dovecot.index.cache: Corrupted virtual size for uid=312: 8884 != 8858 ... more of the same... May 4 13:02:54 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/.Mailing Lists.Xorg Users 2010-04/dovecot.index.cache: Corrupted virtual size for uid=38: 30392 != 30366 May 4 13:02:58 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/.Mailing Lists.Xorg Users 2010-04/dovecot.index.cache: Corrupted virtual size for uid=43: 8796 != 8770 May 4 15:25:03 f12barry dovecot: IMAP(bscott): FETCH [] for mailbox _NewMail-com UID 48 got too little data: 3230 vs 3278 May 4 15:25:03 f12barry dovecot: IMAP(bscott): Maildir filename has wrong W value: /home/bscott/Maildir/._NewMail-com/cur/1271683097.M615087P3538.f12barry.office.onelan.co.uk,S=3154,W=3278:2,S May 4 15:25:03 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Broken virtual size for mail UID 48 May 4 15:25:03 f12barry dovecot: IMAP(bscott): Disconnected: FETCH failed bytes=15437134/33737060 May 4 17:45:41 f12barry dovecot: dovecot: Killed with signal 15 (by pid=7300 uid=0 code=kill)
At this point I had only tail'ed the log and seen the issue with UID 48. I then:
- stopped dovecot
- deleted the ofending file
- deleted the dovecot* files
- started dovecot
May 4 17:49:58 f12barry dovecot: Dovecot v1.2.11 starting up (core dumps disabled) May 4 17:52:17 f12barry dovecot: Killed with signal 15 (by pid=7556 uid=0 code=kill) May 4 17:53:21 f12barry dovecot: Dovecot v1.2.11 starting up (core dumps disabled) May 4 17:53:21 f12barry sendmail[2067]: starting daemon (8.14.3): SMTP+queueing@01:00:00 May 4 17:53:21 f12barry sm-msp-queue[2075]: starting daemon (8.14.3): queueing@01:00:00 May 4 17:55:26 f12barry dovecot: imap-login: Login: user=<bscott>, method=PLAIN, rip=::1, lip=::1, secured May 4 17:55:29 f12barry dovecot: IMAP(bscott): FETCH [] for mailbox _NewMail-com UID 48 got too little data: 3878 vs 3920 May 4 17:55:29 f12barry dovecot: IMAP(bscott): Maildir filename has wrong W value: /home/bscott/Maildir/._NewMail-com/cur/1271683097.M733325P3538.f12barry.office.onelan.co.uk,S=3780,W=3920:2,S May 4 17:55:29 f12barry dovecot: IMAP(bscott): Corrupted index cache file /home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Broken virtual size for mail UID 48 May 4 17:55:29 f12barry dovecot: IMAP(bscott): Disconnected: FETCH failed bytes=3955/48628 May 4 18:05:55 f12barry dovecot: imap-login: Login: user=<bscott>, method=PLAIN, rip=::1, lip=::1, secured
Now another file is being complained about.
What would cause these problems? What is the W value and how could I check it?
Here is the details of the dovecot I'm using and the kmail version I'm using.ƀ
$ sudo dovecot -n # 1.2.11: /etc/dovecot.conf # OS: Linux 2.6.32.11-99.fc12.x86_64 x86_64 Fedora release 12 (Constantine) login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd
Client is kmail from kdepim-4.4.2-1.fc12.x86_64
Barry
I'm seeing this problem again.
Can anyone provide any insight into what may be wrong?
At least point me to an explanation for the wrong W value message?
Barry
On Tue, 2010-05-04 at 18:21 +0100, Barry Scott wrote:
May 4 15:25:03 f12barry dovecot: IMAP(bscott): Maildir filename has wrong W value: /home/bscott/Maildir/._NewMail-com/cur/1271683097.M615087P3538.f12barry.office.onelan.co.uk,S=3154,W=3278:2,S
S=3154 means the file's size should be 3154 bytes. W=3278 means the file's "virtual size" = size if linefeeds were CRLF should be 3278 bytes.
Easy way to check these values is with e.g.:
# wc 1274725794.M935807P27627.kurkku,S=1901,W=1951:2, 50 212 1901 1274725794.M935807P27627.kurkku,S=1901,W=1951:2, # echo 1901+50|bc 1951
If W value is wrong, it's not currently fixed automatically. Because it just shouldn't happen. How are you delivering new mails? That file looks like it's created by Dovecot. So the only possibilities are:
a) Something modified the file after it was already written.
b) The program writing the maildir file is buggy (I'm not aware of any Dovecot bugs related to this.)
c) Filesystem corrupted the mail file.
On Tuesday 25 May 2010 16:26:15 Timo Sirainen wrote:
On Tue, 2010-05-04 at 18:21 +0100, Barry Scott wrote:
May 4 15:25:03 f12barry dovecot: IMAP(bscott): Maildir filename has wrong W value: /home/bscott/Maildir/._NewMail-com/cur/1271683097.M615087P3538.f12barry.office.onelan.co.uk,S=3154,W=3278:2,S
S=3154 means the file's size should be 3154 bytes. W=3278 means the file's "virtual size" = size if linefeeds were CRLF should be 3278 bytes.
Easy way to check these values is with e.g.:
# wc 1274725794.M935807P27627.kurkku,S=1901,W=1951:2, 50 212 1901 1274725794.M935807P27627.kurkku,S=1901,W=1951:2, # echo 1901+50|bc 1951
If W value is wrong, it's not currently fixed automatically. Because it just shouldn't happen. How are you delivering new mails? That file looks like it's created by Dovecot. So the only possibilities are:
a) Something modified the file after it was already written.
b) The program writing the maildir file is buggy (I'm not aware of any Dovecot bugs related to this.)
c) Filesystem corrupted the mail file.
Thanks for the info. I'll write some tools to check the W values and see if I can track down the corruption source.
Barry
On Tuesday 25 May 2010 16:26:15 Timo Sirainen wrote:
On Tue, 2010-05-04 at 18:21 +0100, Barry Scott wrote:
May 4 15:25:03 f12barry dovecot: IMAP(bscott): Maildir filename has wrong W value: /home/bscott/Maildir/._NewMail-com/cur/1271683097.M615087P3538.f12barry.o ffice.onelan.co.uk,S=3154,W=3278:2,S
S=3154 means the file's size should be 3154 bytes. W=3278 means the file's "virtual size" = size if linefeeds were CRLF should be 3278 bytes.
Easy way to check these values is with e.g.:
# wc 1274725794.M935807P27627.kurkku,S=1901,W=1951:2, 50 212 1901 1274725794.M935807P27627.kurkku,S=1901,W=1951:2, # echo 1901+50|bc 1951
If W value is wrong, it's not currently fixed automatically. Because it just shouldn't happen. How are you delivering new mails? That file looks like it's created by Dovecot. So the only possibilities are:
a) Something modified the file after it was already written.
This was the cause. I had miss configured spambayes and it was updating the files. I had figure out to fix up the S= values but had not fixed the W= values.
Again, Thanks for the info.
Barry
participants (2)
-
Barry Scott
-
Timo Sirainen