<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
</head>
<body>
<br>
<div class="moz-forward-container">
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<font face="Courier New">Dear Aki,<br>
I switched to "gz" now, since "zstd" also gave some errors on
writing to files.<br>
I dont know if "xz" compression or "zstd" shreddered my MDBOX
Files, but I lost 4 days of mail. (a couple of thousand mails).<br>
After restoring the backup (what was made after switching to
version 2.3.11.3) I still have some broken mdfiles, but not too
many.<br>
Interestingly always in the "Sent" Mailbox on a number of Users.<br>
<br>
I just can not go back to 20.08.2020 before I updated to </font><font
face="Courier New"><font face="Courier New">2.3.11.3</font> -
too many emails would have been lost.<br>
<br>
So - the current status is </font><font face="Courier New"><font
face="Courier New"><font face="Courier New">2.3.11.3</font></font>,
with "gz" compression.<br>
<br>
</font><font face="Courier New">I force-synced and re-indexed all
the mdbox files (250 GB), but still have some broken - please
how can I fix those ?<br>
<br>
You stated : <br>
</font><br>
<pre style="font-family: courier, "courier new", monospace; font-size: 14px; white-space: pre-wrap; overflow-wrap: break-word; margin: 0px; color: rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); text-decoration-style: initial; text-decoration-color: initial;">(In theory you could leave the existing mails xz-compressed, but best
would be to re-compress everything via dsync so old mails can be read
when we eventually remove xz support.)
</pre>
<br class="Apple-interchange-newline">
what is the optimal way to do that, expecially not loosing the
index (?) for outlook/thunderbird, for third party tools that rely
on some index/hash (dunno how exactly that works) ? <br>
<br>
<br>
<font face="Courier New">Sep 3 08:33:25 lxc-imap dovecot:
imap(mpaul)<48684><2/9E5mKuAezAqKjk>: Error: Mailbox
Sent: UID=2171:
read(zlib(/home/vmail/virtualmailboxes/mpaul/storage/m.119))
failed: read(/home/vmail/virtualmailboxes/mpaul/storage/m.119)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 08:35:26 lxc-imap dovecot:
imap(mpaul)<48089><YRio1GKuEdHAqKi3>: Error: Mailbox
Sent: UID=2171:
read(zlib(/home/vmail/virtualmailboxes/mpaul/storage/m.119))
failed: read(/home/vmail/virtualmailboxes/mpaul/storage/m.119)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 08:35:26 lxc-imap dovecot:
imap(mpaul)<49228><p/0g9WKuVdHAqKi3>: Error: Mailbox
Sent: UID=2171:
read(zlib(/home/vmail/virtualmailboxes/mpaul/storage/m.119))
failed: read(/home/vmail/virtualmailboxes/mpaul/storage/m.119)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 08:35:26 lxc-imap dovecot:
imap(mpaul)<49229><GMAm9WKuVtHAqKi3>: Error: Mailbox
Sent: UID=2171:
read(zlib(/home/vmail/virtualmailboxes/mpaul/storage/m.119))
failed: read(/home/vmail/virtualmailboxes/mpaul/storage/m.119)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 08:35:27 lxc-imap dovecot:
imap(mpaul)<49230><YYot9WKuV9HAqKi3>: Error: Mailbox
Sent: UID=2171:
read(zlib(/home/vmail/virtualmailboxes/mpaul/storage/m.119))
failed: read(/home/vmail/virtualmailboxes/mpaul/storage/m.119)
failed: Broken pipe (FETCH BODY[])<br>
...<br>
Sep 3 09:04:44 lxc-imap dovecot:
imap(cpotzinger)<49040></X+P72KuUNHAqKi3>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:04:51 lxc-imap dovecot:
imap(cpotzinger)<54382><eYT1XWOux9HAqKi3>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:04:59 lxc-imap dovecot:
imap(cpotzinger)<54396><nKllXmOuyNHAqKi3>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:05:06 lxc-imap dovecot:
imap(cpotzinger)<54409><m2TOXmOuydHAqKi3>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:05:12 lxc-imap dovecot:
imap(cpotzinger)<54422><IP86X2OuytHAqKi3>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
...<br>
Sep 3 09:08:58 lxc-imap dovecot:
imap(cpotzinger)<54867><BtGtbGOu49HAqKi3>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:19:15 lxc-imap dovecot:
imap(mpaul)<56030></kHNkWOuAO3AqKjk>: Error: Mailbox
Sent: UID=2171:
read(zlib(/home/vmail/virtualmailboxes/mpaul/storage/m.119))
failed: read(/home/vmail/virtualmailboxes/mpaul/storage/m.119)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:29:41 lxc-imap dovecot:
imap(cpotzinger)<57274><c4rCtWOuKuzAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:29:47 lxc-imap dovecot:
imap(cpotzinger)<57320><K3Uqt2OuLOzAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:29:54 lxc-imap dovecot:
imap(cpotzinger)<57333><e4aMt2OuLezAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:30:01 lxc-imap dovecot:
imap(cpotzinger)<57346><JEfzt2OuLuzAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:30:08 lxc-imap dovecot:
imap(cpotzinger)<57360><mH1YuGOuMOzAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:30:14 lxc-imap dovecot:
imap(cpotzinger)<57382><IzLBuGOuMezAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:30:21 lxc-imap dovecot:
imap(cpotzinger)<57397><q10kuWOuM+zAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:30:27 lxc-imap dovecot:
imap(cpotzinger)<57410><CSuJuWOuNOzAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:31:22 lxc-imap dovecot:
imap(mpaul)<57525><TfoOvWOuWO3AqKjk>: Error: Mailbox
Sent: UID=2171:
read(zlib(/home/vmail/virtualmailboxes/mpaul/storage/m.119))
failed: read(/home/vmail/virtualmailboxes/mpaul/storage/m.119)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:31:49 lxc-imap dovecot:
imap(cpotzinger)<57423><Be/ruWOuNuzAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:31:55 lxc-imap dovecot:
imap(cpotzinger)<57584><yvXOvmOuQuzAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:32:02 lxc-imap dovecot:
imap(cpotzinger)<57597><e/8tv2OuQ+zAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:32:08 lxc-imap dovecot:
imap(cpotzinger)<57611><BLSOv2OuROzAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:32:19 lxc-imap dovecot:
imap(cpotzinger)<57633><Ky0twGOuR+zAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:32:26 lxc-imap dovecot:
imap(cpotzinger)<57646><ljSRwGOuS+zAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:32:33 lxc-imap dovecot:
imap(cpotzinger)<57659><rn75wGOuT+zAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:32:39 lxc-imap dovecot:
imap(cpotzinger)<57672><GP9jwWOuUuzAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:33:45 lxc-imap dovecot:
imap(mpaul)<57795><2CEwxWOubu3AqKjk>: Error: Mailbox
Sent: UID=2171:
read(zlib(/home/vmail/virtualmailboxes/mpaul/storage/m.119))
failed: read(/home/vmail/virtualmailboxes/mpaul/storage/m.119)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:38:29 lxc-imap dovecot:
imap(mpaul)<58347><CKyX1mOuie3AqKjk>: Error: Mailbox
Sent: UID=2171:
read(zlib(/home/vmail/virtualmailboxes/mpaul/storage/m.119))
failed: read(/home/vmail/virtualmailboxes/mpaul/storage/m.119)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:38:32 lxc-imap dovecot:
imap(mpaul)<58352><osHU1mOuiu3AqKjk>: Error: Mailbox
Sent: UID=2171:
read(zlib(/home/vmail/virtualmailboxes/mpaul/storage/m.119))
failed: read(/home/vmail/virtualmailboxes/mpaul/storage/m.119)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:38:44 lxc-imap dovecot:
imap(cpotzinger)<54527><5ZpiYmOuBOfAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:38:51 lxc-imap dovecot:
imap(cpotzinger)<58378><kAuN12OumuzAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
Sep 3 09:38:57 lxc-imap dovecot:
imap(cpotzinger)<58392><xJLx12Oum+zAqKiU>: Error:
Mailbox Sent: UID=29534:
read(zlib(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703))
failed:
read(/home/vmail/virtualmailboxes/cpotzinger/storage/m.4703)
failed: Broken pipe (FETCH BODY[])<br>
...<br>
<br>
</font><br>
<div class="moz-cite-prefix">Am 26.08.2020 um 09:42 schrieb Robert
Nowotny:<br>
</div>
<blockquote type="cite"
cite="mid:c838588e-58b3-92dc-cb0a-d440c97ef226@rotek.at">
<meta http-equiv="Content-Type" content="text/html;
charset=UTF-8">
<font face="Courier New">I had 4 broken mdbox files for 4
different users.<br>
After deleting them, dovecot re-indexed, now everything is ok
again.<br>
<br>
I can try to update tonight again to 2.3.11.3 and see if some
broken files will appear again tomorrow.<br>
</font><br>
<div class="moz-cite-prefix">Am 25.08.2020 um 14:51 schrieb Aki
Tuomi:<br>
</div>
<blockquote type="cite"
cite="mid:1631103362.7712.1598359897279@appsuite-dev-gw2.open-xchange.com">
<blockquote type="cite">
<pre class="moz-quote-pre" wrap="">On 25/08/2020 14:35 Robert Nowotny <a class="moz-txt-link-rfc2396E" href="mailto:rnowotny@rotek.at" moz-do-not-send="true"><rnowotny@rotek.at></a> wrote:
I get ZLIB Errors after dovecot upgrade from 2.3.10.1 to 2.3.11.3
Aug 21 15:27:34 lxc-imap dovecot: imap(acsida)<63870><jZk...>: Error: Mailbox Sent: UID=40826: read(zlib(/home/vmail/virtualmailboxes/acsida/storage/m.2409)) failed: read(/home/vmail/virtualmailboxes/acsida/storage/m.2409) failed: Broken pipe (FETCH BODY[])....
many of those entries....
after installing2.3.10.1 those files are still broken - but new files are working again.
anything I can tweak or do ?
</pre>
</blockquote>
<pre class="moz-quote-pre" wrap="">Hi!
Is it possible your mdbox file is corrupted? Can you share doveconf -n?
Aki
</pre>
</blockquote>
<br>
</blockquote>
<br>
</div>
</body>
</html>