[Dovecot] SiS: Attachment file larger than expected
I recently set up SiS and imported a large chunk of mail.
I've noticed one or two instances of this in the logs:
Mar 28 09:03:50 mail dovecot: imap(xxx@yyy.zz): Error: Attachment file /mailstore/attachments/ce/73/ce737a45fe07495e2ae6466f9e381a30d5ec300406f11269d79bd5608cc0c922-822b3d2df67f8e4d7f5000009501e12a larger than expected (252218) Mar 28 14:52:34 mail dovecot: pop3(zzz@xxx.yy): Error: Attachment file /mailstore/attachments/c5/e1/c5e13d671d1d796680ae7166363afcb819af3d9cd04e01de7d65031b2f732bdf-b2ecf918b910904d826200009501e12a larger than expected (143959)
Could that be an indication of a hash collision? No problem reports from the affected users.
Output of du -b below:
186572 /mailstore/attachments/ce/73/ce737a45fe07495e2ae6466f9e381a30d5ec300406f11269d79bd5608cc0c922-822b3d2df67f8e4d7f5000009501e12a 106489 /mailstore/attachments/c5/e1/c5e13d671d1d796680ae7166363afcb819af3d9cd04e01de7d65031b2f732bdf-b2ecf918b910904d826200009501e12a
Both attachments are PDF documents. I'm using Dovecot 2.0.11 + changesets d3d6ed6d268b and 890a46b3ab63 from git.
-- Andrew Lewis andrew@sybaweb.com
On 28.3.2011, at 16.25, Andrew Lewis wrote:
I recently set up SiS and imported a large chunk of mail.
With dsync?
I've noticed one or two instances of this in the logs:
Mar 28 09:03:50 mail dovecot: imap(xxx@yyy.zz): Error: Attachment file /mailstore/attachments/ce/73/ce737a45fe07495e2ae6466f9e381a30d5ec300406f11269d79bd5608cc0c922-822b3d2df67f8e4d7f5000009501e12a larger than expected (252218)
Do you think it's possible for you to reproduce this? If you have the original pre-dbox mail and you convert it to a new and empty dbox+sis and reading it gives this error message, I'd really like to get the original mail.
Could that be an indication of a hash collision?
Highly unlikely. There have been other similar error reports, so I know there's a bug somewhere. I just don't really know where. I haven't managed to reproduce any SIS errors with any of my tests.
Hi Timo,
I recently set up SiS and imported a large chunk of mail. With dsync?
Using fetchmail (delivery via LMTP) and imapsync, dsync does not support the mail storage I moved away from.
Do you think it's possible for you to reproduce this? If you have the original pre-dbox mail and you convert it to a new and empty dbox+sis and reading it gives this error message, I'd really like to get the original mail.
Yes, I was able to reproduce this (by imapsync'ing the old mailbox and then sync'ing the copy elsewhere):
Mar 28 15:54:38 mail dovecot: imap(dru.test@xxx): Error: Attachment file /mailstore/attachments/ce/73/ce737a45fe07495e2ae6466f9e381a30d5ec300406f11269d79bd5608cc0c922-e2ff0d2b0692904dc51b00009501e12a larger than expected (252218) Mar 28 15:54:54 mail dovecot: imap(dru.test@xxx): Error: Attachment file /mailstore/attachments/ad/16/ad1634c6cd19fd3cfb5b924bfa1ca8bf57075c760da29c16669a261af4edf11c-e0e90f379b92904dc72400009501e12a larger than expected (135722) Mar 28 15:54:54 mail dovecot: imap(dru.test@xxx): Error: FETCH [] for mailbox Backup/Sent Items UID 81 got too little data: 1253411 vs 1253413 Mar 28 15:54:54 mail dovecot: imap(dru.test@xxx): Error: Corrupted index cache file /mailstore/sybaweb.co.za/dru.test/mailboxes/Backup/Sent Items/dbox-Mails/dovecot.index.cache: Broken virtual size for mail UID 81
How best to extract the problem e-mail to send it to you?
Could that be an indication of a hash collision? Highly unlikely. There have been other similar error reports, so I know there's a bug somewhere. I just don't really know where. I haven't managed to reproduce any SIS errors with any of my tests.
Good to hear. I didn't think I'd be that unlucky (though suspected I could be).
-- Andrew Lewis andrew@sybaweb.com
On Mon, 2011-03-28 at 16:00 +0200, Andrew Lewis wrote:
Do you think it's possible for you to reproduce this? If you have the original pre-dbox mail and you convert it to a new and empty dbox+sis and reading it gives this error message, I'd really like to get the original mail.
Yes, I was able to reproduce this (by imapsync'ing the old mailbox and then sync'ing the copy elsewhere):
Mar 28 15:54:38 mail dovecot: imap(dru.test@xxx): Error: Attachment file /mailstore/attachments/ce/73/ce737a45fe07495e2ae6466f9e381a30d5ec300406f11269d79bd5608cc0c922-e2ff0d2b0692904dc51b00009501e12a larger than expected (252218) Mar 28 15:54:54 mail dovecot: imap(dru.test@xxx): Error: Attachment file /mailstore/attachments/ad/16/ad1634c6cd19fd3cfb5b924bfa1ca8bf57075c760da29c16669a261af4edf11c-e0e90f379b92904dc72400009501e12a larger than expected (135722) Mar 28 15:54:54 mail dovecot: imap(dru.test@xxx): Error: FETCH [] for mailbox Backup/Sent Items UID 81 got too little data: 1253411 vs 1253413 Mar 28 15:54:54 mail dovecot: imap(dru.test@xxx): Error: Corrupted index cache file /mailstore/sybaweb.co.za/dru.test/mailboxes/Backup/Sent Items/dbox-Mails/dovecot.index.cache: Broken virtual size for mail UID 81
You still have this?
How best to extract the problem e-mail to send it to you?
I think my server accepts max. 10 MB mails, so as long as it's less than that email is fine.
On Mon, 2011-04-04 at 17:59 +0300, Timo Sirainen wrote:
Mar 28 15:54:38 mail dovecot: imap(dru.test@xxx): Error: Attachment file /mailstore/attachments/ce/73/ce737a45fe07495e2ae6466f9e381a30d5ec300406f11269d79bd5608cc0c922-e2ff0d2b0692904dc51b00009501e12a larger than expected (252218) Mar 28 15:54:54 mail dovecot: imap(dru.test@xxx): Error: Attachment file /mailstore/attachments/ad/16/ad1634c6cd19fd3cfb5b924bfa1ca8bf57075c760da29c16669a261af4edf11c-e0e90f379b92904dc72400009501e12a larger than expected (135722)
http://hg.dovecot.org/dovecot-2.0/rev/10ea7f598e11 should fix these.
participants (2)
-
Andrew Lewis
-
Timo Sirainen