[Dovecot] Corrupted index cache file
Hello
I got this error message yesterday evening for a user I've checked LDA error log it happened 6 times in 3 days for 5 differents users, not much but I wonder what's going on as actually the server is moderately loaded ( Easter holidays ) we have currently 250/300 IMAP processes , in "normal" production time we have approx 1000 IMAP processes running.
Apr 14 19:24:37 imap(xxxxxxx): Error: FETCH [] for mailbox Drafts (Hugues at ESIEE) UID 17836 got too little data: 16384 vs 18012 Apr 14 19:24:37 imap(xxxxxxx): Error: Corrupted index cache file /var/cache/dovecot/index/xxxxxxx/.imap/Drafts (Hugues at ESIEE)/dovecot.index.cache: Broken virtual size for mail UID 17836
The machine is supposed to be HUDGE for our 4000 mailboxes HP Proliant DL380 G7 , 12 Gb RAM 24 cores !!!
I've located index/cache files on another disk than users mailboxes
mailboxes are living on a 2Tb RAID array ( 50% full ) index/cache are living on another single disk ( 10% full )
I run Dovecot 2.0.11 + dovecot2-pigeonhole compiled from FreeBSD 8.2 ports
Dovecot or hardware problem ???
Thanks a lot for any ideas/infos
On 2011-04-15 2:32 AM, Frank Bonnet wrote:
Dovecot or hardware problem ???
Thanks a lot for any ideas/infos
Sorry, crystal ball is broken, rather than making us guess, maybe you could provide your config details (dovecot -n output for starters)?
--
Best regards,
Charles
On 04/15/2011 01:38 PM, Charles Marcus wrote:
On 2011-04-15 2:32 AM, Frank Bonnet wrote:
Dovecot or hardware problem ???
Thanks a lot for any ideas/infos
Sorry, crystal ball is broken, rather than making us guess, maybe you could provide your config details (dovecot -n output for starters)?
yes of course here it is
On Fri, 2011-04-15 at 08:32 +0200, Frank Bonnet wrote:
Apr 14 19:24:37 imap(xxxxxxx): Error: FETCH [] for mailbox Drafts (Hugues at ESIEE) UID 17836 got too little data: 16384 vs 18012 Apr 14 19:24:37 imap(xxxxxxx): Error: Corrupted index cache file /var/cache/dovecot/index/xxxxxxx/.imap/Drafts (Hugues at ESIEE)/dovecot.index.cache: Broken virtual size for mail UID 17836
mboxes are a bit annoying things. I guess there's a bug somewhere in Dovecot code, but unless you can show me how to reproduce it I don't think I can do anything about it. (I've earlier spent days looking at the mbox code without seeing any bugs in it.)
Maybe once everything else is working perfectly I'll just try once more to rewrite the mbox code to be simpler to understand and become perfect. :)
For what it's worth..
I've seen the FETCH error with "got too little data" also with Maildir setup. So, not only limited to mbox. This was quite some time ago with (I think) 1.0.15. Back then, I just removed the dovecot.index and cache files (leaving only the uidlist file) for that maildir folder. Worked fine after that (except I had to convince Outlook to resync.. Mail bodies in Outlook cache sometimes didn't match with mail headers...) Currently running 1.2.15, no further corruption seen.
-- Maarten
On Mon, 9 May 2011, Timo Sirainen wrote:
On Fri, 2011-04-15 at 08:32 +0200, Frank Bonnet wrote:
Apr 14 19:24:37 imap(xxxxxxx): Error: FETCH [] for mailbox Drafts (Hugues at ESIEE) UID 17836 got too little data: 16384 vs 18012 Apr 14 19:24:37 imap(xxxxxxx): Error: Corrupted index cache file /var/cache/dovecot/index/xxxxxxx/.imap/Drafts (Hugues at ESIEE)/dovecot.index.cache: Broken virtual size for mail UID 17836
mboxes are a bit annoying things. I guess there's a bug somewhere in Dovecot code, but unless you can show me how to reproduce it I don't think I can do anything about it. (I've earlier spent days looking at the mbox code without seeing any bugs in it.)
Maybe once everything else is working perfectly I'll just try once more to rewrite the mbox code to be simpler to understand and become perfect. :)
participants (4)
-
Charles Marcus
-
Frank Bonnet
-
Maarten Bezemer
-
Timo Sirainen