[Dovecot] Regenerating mdbox/sis
It's apparent I have some level of corruption in my mailboxes - something to do with the combination of mdbox, sis, and zlib. I should note that I know I have a mix of compressed and raw messages - if that makes any difference in identifying the problems.
I think I need to somehow regenerate the mailboxes with issues. Is there a suggestion for how to accomplish this? Should I perhaps use dsync to shift to a temporary mail location and then rename it back?
If I DO use dsync in this manner, and I have zlib enabled - will this then compress all the messages in the new mail storage?
--
Daniel
On 16.2.2011, at 2.35, <dmiller@amfes.com> <dmiller@amfes.com> wrote:
It's apparent I have some level of corruption in my mailboxes - something to do with the combination of mdbox, sis, and zlib. I should note that I know I have a mix of compressed and raw messages - if that makes any difference in identifying the problems.
The mixing shouldn't make any difference. Would be nice to know if the problem is from mdbox+sis, mdbox+zlib or if it really needs a combination of all 3.
I wonder if http://hg.dovecot.org/dovecot-2.0/rev/b71834419ea3 might help here.
I think I need to somehow regenerate the mailboxes with issues. Is there a suggestion for how to accomplish this? Should I perhaps use dsync to shift to a temporary mail location and then rename it back?
That should do it.
If I DO use dsync in this manner, and I have zlib enabled - will this then compress all the messages in the new mail storage?
When dsync reads messages it decompresses them into memory, and recompresses them when saving.
On 2/16/2011 8:21 AM, Timo Sirainen wrote:
On 16.2.2011, at 2.35,<dmiller@amfes.com> <dmiller@amfes.com> wrote:
It's apparent I have some level of corruption in my mailboxes - something to do with the combination of mdbox, sis, and zlib. I should note that I know I have a mix of compressed and raw messages - if that makes any difference in identifying the problems. The mixing shouldn't make any difference. Would be nice to know if the problem is from mdbox+sis, mdbox+zlib or if it really needs a combination of all 3.
I wonder if http://hg.dovecot.org/dovecot-2.0/rev/b71834419ea3 might help here.
I think I need to somehow regenerate the mailboxes with issues. Is there a suggestion for how to accomplish this? Should I perhaps use dsync to shift to a temporary mail location and then rename it back? That should do it.
Tried dsync to convert to maildir - got this: dsync -u amiller@amfes.com -o mail_plugins="zlib" backup maildir:/var/mail/backup/amiller dsync(amiller@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce15100003bc41c5f smaller than expected (530943 < 530944) dsync(amiller@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce15100003bc41c5f smaller than expected (530943 < 530944) dsync(amiller@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce15100003bc41c5f smaller than expected (530943 < 530944) dsync(amiller@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce15100003bc41c5f smaller than expected (530943 < 530944) dsync(amiller@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce15100003bc41c5f smaller than expected (530943 < 530944) dsync(amiller@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce15100003bc41c5f smaller than expected (530943 < 530944) dsync(amiller@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce15100003bc41c5f smaller than expected (530943 < 530944) dsync(amiller@amfes.com): Error: read(msg input) failed: Input/output error dsync(amiller@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce15100003bc41c5f smaller than expected (530943 < 530944) dsync(amiller@amfes.com): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(amiller@amfes.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ca8a) [0x7fde07aaea8a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7fde07aaeb72] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x16dea) [0x7fde07a88dea] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x90397) [0x7fde07d80397] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x92f75) [0x7fde07d82f75] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0x37) [0x7fde07d72317] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x81) [0x7fde07d74041] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x46679) [0x7fde07d36679] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4e) [0x7fde07d36bfe] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x43381) [0x7fde07d33381] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x43489) [0x7fde07d33489] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0x85) [0x7fde07d33555] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_free+0x17) [0x7fde07d32b87] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_free+0xd) [0x7fde07d19f0d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(maildir_transaction_save_commit_pre+0x3c1) [0x7fde07d47a01] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x52c12) [0x7fde07d42c12] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x96) [0x7fde07d7dc76] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_transaction_commit+0x8a) [0x7fde07d4287a] -> /usr/local/lib/dovecot/lib20_zlib_plugin.so(+0x49bc) [0x7fde06ec29bc] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x3d) [0x7fde07d2000d] -> dsync() [0x40fa68] -> dsync() [0x411631] -> dsync(main+0x66a) [0x406c7a] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7fde07301d8e] -> dsync() [0x406439] Aborted
-- Daniel
participants (3)
-
Daniel L. Miller
-
dmiller@amfes.com
-
Timo Sirainen