<html><head><meta http-equiv="Content-Type" content="text/html; charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">On 9. Sep 2020, at 11.14, Robert Nowotny <<a href="mailto:rnowotny1966@gmail.com" class="">rnowotny1966@gmail.com</a>> wrote:<br class=""><div><blockquote type="cite" class=""><br class="Apple-interchange-newline"><div class=""><div class=""><div dir="ltr" class=""><div class=""><blockquote type="cite" class="gmail-" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; text-decoration: none;"><div class="gmail-" style="overflow-wrap: break-word;"><div class="gmail-"><blockquote type="cite" class="gmail-"><div class="gmail-"><div dir="ltr" class="gmail-"><div class="gmail-moz-text-html" lang="x-unicode"><div class="gmail-moz-forward-container"><font class="gmail-" face="Courier New">Sep 3 08:33:25 lxc-imap dovecot: imap(mpaul)<48684><2/9E5mKuAezAqKjk>: Error: Mailbox Sent: UID=2171: read(zlib(/home/vmail/virtualmailboxes/mpaul/storage/m.119)) failed: read(/home/vmail/virtualmailboxes/mpaul/storage/m.119) failed: Broken pipe (FETCH BODY[])<br class="gmail-"></font></div></div></div></div></blockquote><div class="gmail-"><br class="gmail-"></div><div class="gmail-">Also this way you can see if the broken mail is actually xz or zstd or zlib. It would be nice to know if there are any zstd or zlib compressed mails that have problems. We did a lot of stress testing with zstd and also with xz, but haven't been able to reproduce any problems. It's also strange that it says taht the error is "Broken pipe" - that doesn't indicate that the mail is corrupted but that there is something more strange going on. So perhaps you don't actually have any mails written as corrupted, but Dovecot is just somehow having trouble reading the mails.</div></div></div></blockquote><br class="gmail-" style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"></div><div class="">I managed to reproduce this. The files aren't corrupted, it's just that reading is failing. The attached patch should fix the xz code and should make your files readable again.</div><div class=""><br class="gmail-"></div><div class=""><br class=""></div><div class="">Yes, it works ! I switched now to "zstd" compression and currently re-compressing all user imap folders (one by one)</div></div></div></div></blockquote><br class=""></div><div>Actually, with further testing it looks like the mails were written truncated. My patch simply hides the truncation when reading the mail. But it's anyway best that can be done about them.</div><div><br class=""></div><div>zstd also has a bug in writing compressed output, but it should always crash instead of writing broken output.</div><div><br class=""></div><div>We'll try to get fixes to these merged to git soon.</div><div><br class=""></div></body></html>