Now checks that field alignmentations are in indexes as they're expected. test78 crashed if it was wrong, earlier versions ignored the problem (and crashed with 64bit systems). Now if it's wrong, it prints error to log file and recreates the index. That means you probably should delete all dovecot.index files to avoid tons of errors in log files. Only mbox users need to do this.
- LSUB: Don't crash if .subscriptions file can't be opened. Also in general give proper "permission denied" error if LIST/LSUB failed because of permission problems.
- Maildir: Fix deadlocking when saving messages (noticeable with copying lots of messages with Thunderbird)
- LDAP: user_global_uid/gid wasn't working. Also now they support having user/group names from /etc/passwd instead of just numbers.
- passwd-file now supports variables in filename, so you can do eg. args = /etc/passwd.%d
- Open/close PAM session if -session option is given. Patch by Pasi Sjöholm.
- Added tb-extra-mailbox-sep workaround for Thunderbird+mbox problems.
On Fri, 22 Jul 2005 20:51:18 +0300 Timo Sirainen tss@iki.fi wrote:
: http://dovecot.org/test/ : : Now checks that field alignmentations are in indexes as they're : expected. test78 crashed if it was wrong, earlier versions ignored the : problem (and crashed with 64bit systems). Now if it's wrong, it prints : error to log file and recreates the index. That means you probably : should delete all dovecot.index files to avoid tons of errors in log : files. Only mbox users need to do this.
So far so good on OpenBSD/macppc. Imap on IPv4 (I'll test pop3 and ipv6 when I get home)
I downloaded the new version and it seems to work so far with the linuxconf directory structure. I just added the documentation for Linuxconf to the Wiki.
On Fri, Jul 22, 2005 at 08:51:18PM +0300, Timo Sirainen wrote:
Now checks that field alignmentations are in indexes as they're expected. test78 crashed if it was wrong, earlier versions ignored the problem (and crashed with 64bit systems). Now if it's wrong, it prints error to log file and recreates the index. That means you probably should delete all dovecot.index files to avoid tons of errors in log files. Only mbox users need to do this.
Seems OK, I deleted all the index files and it seems to work now without crashing.
However, I am now seeing hundreds of these messages as Apple Mail is redownloading all my mail:
dovecot: Jul 22 14:46:00 Error: IMAP(njr): UIDs broken with partial sync in mbox file /usr/home/njriley/mail/2004-05 dovecot: Jul 22 14:46:01 Error: IMAP(njr): UIDs broken with partial sync in mbox file /usr/home/njriley/mail/2004-05 dovecot: Jul 22 14:46:01 Error: IMAP(njr): UIDs broken with partial sync in mbox file /usr/home/njriley/mail/2004-05
There's no new mail coming into these mailboxes and (multiple copies of) Dovecot are the only things touching them. Is there something wrong with my configuration?
-- Nicholas Riley njriley@uiuc.edu | http://www.uiuc.edu/ph/www/njriley
On Fri, Jul 22, 2005 at 02:48:10PM -0500, Nicholas Riley wrote:
Seems OK, I deleted all the index files and it seems to work now without crashing.
However, I am now seeing hundreds of these messages as Apple Mail is redownloading all my mail:
dovecot: Jul 22 14:46:00 Error: IMAP(njr): UIDs broken with partial sync in mbox file /usr/home/njriley/mail/2004-05 dovecot: Jul 22 14:46:01 Error: IMAP(njr): UIDs broken with partial sync in mbox file /usr/home/njriley/mail/2004-05 dovecot: Jul 22 14:46:01 Error: IMAP(njr): UIDs broken with partial sync in mbox file /usr/home/njriley/mail/2004-05
There's no new mail coming into these mailboxes and (multiple copies of) Dovecot are the only things touching them. Is there something wrong with my configuration?
and the end of the resynchronization...
dovecot: Jul 22 15:38:05 Error: IMAP(njr): mbox sync: UID inserted in the middle of mailbox /usr/home/njriley/mail/2005-05 (218590 > 11) dovecot: Jul 22 15:38:05 Error: IMAP(njr): mbox sync: UID inserted in the middle of mailbox /usr/home/njriley/mail/2005-04 (228396 > 9) dovecot: Jul 22 15:38:05 Error: IMAP(njr): UIDs broken with partial sync in mbox file /usr/home/njriley/mail/2005-06 dovecot: Jul 22 15:38:05 Error: IMAP(njr): UIDs broken with partial sync in mbox file /usr/home/njriley/mail/2005-07 dovecot: Jul 22 15:38:07 Error: IMAP(njr): X-IMAPbase uid-last unexpectedly points outside mbox file /usr/home/njriley/mail/2005-05 dovecot: Jul 22 15:38:08 Error: IMAP(njr): X-IMAPbase uid-last unexpectedly points outside mbox file /usr/home/njriley/mail/2005-05
It'd be nice to have an "error message decoder" on the wiki or something. I really have no idea if I should be concerned or not.
-- Nicholas Riley njriley@uiuc.edu | http://www.uiuc.edu/ph/www/njriley
On Fri, 2005-07-22 at 15:42 -0500, Nicholas Riley wrote:
and the end of the resynchronization...
dovecot: Jul 22 15:38:05 Error: IMAP(njr): mbox sync: UID inserted in the middle of mailbox /usr/home/njriley/mail/2005-05 (218590 > 11) dovecot: Jul 22 15:38:05 Error: IMAP(njr): mbox sync: UID inserted in the middle of mailbox /usr/home/njriley/mail/2005-04 (228396 > 9) dovecot: Jul 22 15:38:05 Error: IMAP(njr): UIDs broken with partial sync in mbox file /usr/home/njriley/mail/2005-06 dovecot: Jul 22 15:38:05 Error: IMAP(njr): UIDs broken with partial sync in mbox file /usr/home/njriley/mail/2005-07 dovecot: Jul 22 15:38:07 Error: IMAP(njr): X-IMAPbase uid-last unexpectedly points outside mbox file /usr/home/njriley/mail/2005-05 dovecot: Jul 22 15:38:08 Error: IMAP(njr): X-IMAPbase uid-last unexpectedly points outside mbox file /usr/home/njriley/mail/2005-05
It'd be nice to have an "error message decoder" on the wiki or something. I really have no idea if I should be concerned or not.
These really shouldn't happen. Looking at your old mails you seem to have had similar problems before too. So you're running FreeBSD and everything is stored on local filesystems, no NFS? Client is OSX's Mail? 10.4?
Can you reproduce these problems? If you can, copy the mbox elsewhere, make it break with these errors, then try diffing the old mbox and the new one, did they change?
And from your other mail:
"First, I couldn't get my mailbox read/write locks, formerly set to "flock" to work at all; it just hung forever. So I replaced it with "dotlock fcntl", and now things seem to work"
It shouldn't make a difference if it's flock or dotlock/fcntl if Dovecot is the only thing changing the mbox, so I can't think of a reason why flock would be hanging.. You could check with ktrace. Your local delivery agent should be using the same locking of course. What LDA are you using? Is anything else ever touching these mboxes?
All this somehow sounds like a locking related problem. I've been running some pretty heavy load tests with multiple sessions reading/writing the same mbox, so I don't think this is at least a generic Dovecot problem.
Another possibility would be that there is something in those mboxes that Dovecot really doesn't like and it breaks every time with them. I could try if they'd break with me. You could put them through http://dovecot.org/tools/mboxcrypt.pl to hide most of the data and send them to me?
On Sat, 2005-07-23 at 00:04 +0300, Timo Sirainen wrote:
These really shouldn't happen. Looking at your old mails you seem to have had similar problems before too. So you're running FreeBSD and everything is stored on local filesystems, no NFS? Client is OSX's Mail? 10.4?
And do you use 64bit or non-x86 CPU?
On Sat, Jul 23, 2005 at 12:07:06AM +0300, Timo Sirainen wrote:
On Sat, 2005-07-23 at 00:04 +0300, Timo Sirainen wrote:
These really shouldn't happen. Looking at your old mails you seem to have had similar problems before too. So you're running FreeBSD and everything is stored on local filesystems, no NFS? Client is OSX's Mail? 10.4?
And do you use 64bit or non-x86 CPU?
You are correct, above. No special CPU, FreeBSD 4.10 on 32-bit x86, local filesystems, OS X Mail from 10.4.
I'll try to reproduce the problems now.
Thanks for your help,
-- Nicholas Riley njriley@uiuc.edu | http://www.uiuc.edu/ph/www/njriley
Hello.
Will have debian packages in the future in any repository for install directly?
Josep
Now checks that field alignmentations are in indexes as they're expected. test78 crashed if it was wrong, earlier versions ignored the problem (and crashed with 64bit systems). Now if it's wrong, it prints error to log file and recreates the index. That means you probably should delete all dovecot.index files to avoid tons of errors in log files. Only mbox users need to do this.
- LSUB: Don't crash if .subscriptions file can't be opened. Also in general give proper "permission denied" error if LIST/LSUB failed because of permission problems.
- Maildir: Fix deadlocking when saving messages (noticeable with copying lots of messages with Thunderbird)
- LDAP: user_global_uid/gid wasn't working. Also now they support having user/group names from /etc/passwd instead of just numbers.
- passwd-file now supports variables in filename, so you can do eg. args = /etc/passwd.%d
- Open/close PAM session if -session option is given. Patch by Pasi Sjöholm.
- Added tb-extra-mailbox-sep workaround for Thunderbird+mbox problems.
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
Hi :)
So far - so good. Works fine for me, but i still see the following messages in dovecot log (i removed all *dovecot* files today just after upgrade to test79)
dovecot: Jul 25 09:03:45 Error: IMAP(bfg@noviforum.si): Corrupted index cache file /export/mail/noviforum.si/bfg/dovecot.index.cache: Duplicated field in header: hdr.LIST-POST dovecot: Jul 25 09:03:49 Error: IMAP(bfg@noviforum.si): Corrupted index cache file /export/mail/noviforum.si/bfg/.Mailing liste.Amavis Users/dovecot.index.cache: Duplicated field in header: hdr.LIST-POST dovecot: Jul 25 09:13:20 Error: IMAP(bfg@noviforum.si): Corrupted index cache file /export/mail/noviforum.si/bfg/.Noviforum/dovecot.index.cache: Duplicated field in header: hdr.LIST-POST dovecot: Jul 25 09:13:21 Error: IMAP(bfg@noviforum.si): Corrupted index cache file /export/mail/noviforum.si/bfg/.Mailing liste.Postfix Users/dovecot.index.cache: Duplicated field in header: hdr.LIST-POST dovecot: Jul 25 09:18:01 Error: IMAP(bfg@noviforum.si): Corrupted index cache file /export/mail/noviforum.si/bfg/.Mailing liste.Bugtraq/dovecot.index.cache: Duplicated field in header: hdr.LIST-POST dovecot: Jul 25 09:35:24 Error: IMAP(bfg@noviforum.si): Corrupted index cache file /export/mail/noviforum.si/bfg/.Mailing liste.GnuPG Users/dovecot.index.cache: Duplicated fieldin header: hdr.LIST-POST dovecot: Jul 25 09:36:09 Error: IMAP(bfg@noviforum.si): Corrupted index cache file /export/mail/noviforum.si/bfg/.Mailing liste.HORDE Imp/dovecot.index.cache: Duplicated field in header: hdr.LIST-POST dovecot: Jul 25 09:38:15 Error: IMAP(bfg@noviforum.si): Corrupted index cache file /export/mail/noviforum.si/bfg/.Mailing liste.FreeBSD Slovenia/dovecot.index.cache: Duplicated field in header: hdr.LIST-POST dovecot: Jul 25 09:38:50 Error: IMAP(bfg@noviforum.si): Corrupted index cache file /export/mail/noviforum.si/bfg/.Mailing liste.Forensics/dovecot.index.cache: Duplicated field in header: hdr.LIST-POST dovecot: Jul 25 09:38:50 Error: IMAP(bfg@noviforum.si): Corrupted index cache file /export/mail/noviforum.si/bfg/.Mailing liste.Dovecot/dovecot.index.cache: Duplicated field in header: hdr.LIST-POST
...
Ideas?
Best regards,
Branko F. Gracnar Sistemski administrator za UNIX okolje Noviforum d.o.o., Stegne 31, SI-1000 Ljubljana Tel > +386 1 500 8528 , Fax > +386 1 519 73 88 e-mail > bfg@noviforum.si www.noviforum.si, www.najdi.si
To sporocilo, vkljucno z vsemi pripetimi dokumenti, je namenjeno izkljucno naslovniku sporocila, njegova vsebina pa je lahko zaupne narave in varovana kot poslovna skrivnost, osebni podatek ali kot avtorsko delo. Nepooblasceno posiljanje, spreminjanje ali razkritje vsebine tega sporocila je nezakonito. Ce prejmete sporocilo po pomoti, ga takoj izbrisite iz sistema. Vsebina tega sporocila, vkljucno z vsemi pripetimi dokumenti izraza stalisca avtorja oz. avtorjev in ne nujno tudi druzbe Noviforum d.o.o.
The information contained in this e-mail is confidential and property of Noviforum Ltd. and therefore may be subject to legal privilege. If you are not the intended recipient, you must not use, copy, distribute or disclose the e-mail or any part of its contents or take any action in reliance on it. If you have received this e-mail by error, please e-mail the sender by replying to this message. All reasonable precautions have been taken to ensure no viruses are present in this e-mail and the sender cannot accept responsibility for loss or damage arising from the use of this e-mail or attachments.
-----BEGIN PGP SIGNATURE-----
iD8DBQFC5JnJN7LHXgqRB4IRAouRAKCjspaxGiIjlt3Vh7AKU5fP879MWgCgoP8s us0s76ad2xXU94vqTZ0fFc8= =+OXL -----END PGP SIGNATURE-----
participants (6)
-
"Branko F. Gračnar"
-
Josep M.
-
Marc Perkel
-
Nicholas Riley
-
Peter Hessler
-
Timo Sirainen