[Dovecot] dovecot-1.0-beta3 in production
Hello there!
I've migrated our courier-imap production imap/pop server to dovecot 1.0-beta few days ago. In general dovecot performs excellent, but i've encountered several "bugs" in dovecot log:
--- snip ---
dovecot.log.1.gz:Feb 24 16:05:21 elfstone dovecot: imap(user3@domain.tld): Maildir /export/mail/domain.tld/user3 sync: UID inserted in the middle of mailbox (47681 > 47680, file = 1138960753.P9796Q0M642679.elfstone:2,T) dovecot.log.1.gz:Feb 24 16:20:48 elfstone dovecot: imap(user4@domain.tld): file mail-transaction-log-view.c: line 140 (mail_transaction_log_view_set): assertion failed: (min_file_seq != max_file_seq || min_file_offset <= max_file_offset) dovecot.log.1.gz:Feb 24 16:21:16 elfstone dovecot: imap(user4@domain.tld): file mail-transaction-log-view.c: line 140 (mail_transaction_log_view_set): assertion failed: (min_file_seq != max_file_seq || min_file_offset <= max_file_offset) dovecot.log.1.gz:Feb 24 16:21:49 elfstone dovecot: imap(user4@domain.tld): file mail-transaction-log-view.c: line 140 (mail_transaction_log_view_set): assertion failed: (min_file_seq != max_file_seq || min_file_offset <= max_file_offset) dovecot.log.1.gz:Feb 24 16:46:27 elfstone dovecot: imap(user1@domain.tld): Maildir /export/mail/domain.tld/user1 sync: UID < next_uid (1 < 199, file = 1122973973.V809Id001aafc.elfstone,S=8889:2,RS) dovecot.log.1.gz:Feb 24 16:47:31 elfstone dovecot: imap(user1@domain.tld): Maildir /export/mail/domain.tld/user1 sync: UID inserted in the middle of mailbox (183 > 181, file = 1140780283.P10326Q0M678892.elfstone:2,RS) dovecot.log.1.gz:Feb 24 16:54:47 elfstone dovecot: imap(user5@domain.tld): Corrupted index file /export/data/dovecot/domain.tld/user5/.Sent/dovecot.index: keywords_count larger than header size dovecot.log.1.gz:Feb 24 17:01:00 elfstone dovecot: imap(user1@domain.tld): Corrupted transaction log file /export/data/dovecot/domain.tld/user1/.Sent/dovecot.index.log: Append with UID 1, but next_uid = 4850 dovecot.log.1.gz:Feb 24 20:25:40 elfstone dovecot: imap(userX@domain2.tld): file mail-transaction-log-view.c: line 140 (mail_transaction_log_view_set): assertion failed: (min_file_seq != max_file_seq || min_file_offset <= max_file_offset) dovecot.log.10.gz:Feb 15 19:20:05 elfstone dovecot: imap(user2@domain.tld): stat(/export/mail/domain.tld/user2/.Trash.Cron/new) failed: No such file or directory
--- snip ---
I have multi-domain setup with several hundred users, emails are delivered using dovecot-deliver LDA, dovecot indexes are outside mailboxes, indexes and mailboxes are on local filesystem (xfs). I'm using linux 2.6 on slackware platform.
If you need any more info, just let me know.
Best regards, Brane
On Sat, 2006-02-25 at 17:22 +0100, Branko F. Gračnar wrote:
dovecot.log.1.gz:Feb 24 16:05:21 elfstone dovecot: imap(user3@domain.tld): Maildir /export/mail/domain.tld/user3 sync: UID inserted in the middle of mailbox (47681 > 47680, file = 1138960753.P9796Q0M642679.elfstone:2,T)
Well, this means that the file was lost, but then Dovecot saw it again later.
dovecot.log.1.gz:Feb 24 16:46:27 elfstone dovecot: imap(user1@domain.tld): Maildir /export/mail/domain.tld/user1 sync: UID < next_uid (1 < 199, file = 1122973973.V809Id001aafc.elfstone,S=8889:2,RS)
Same problem.
dovecot.log.1.gz:Feb 24 16:54:47 elfstone dovecot: imap(user5@domain.tld): Corrupted index file /export/data/dovecot/domain.tld/user5/.Sent/dovecot.index: keywords_count larger than header size dovecot.log.1.gz:Feb 24 17:01:00 elfstone dovecot: imap(user1@domain.tld): Corrupted transaction log file /export/data/dovecot/domain.tld/user1/.Sent/dovecot.index.log: Append with UID 1, but next_uid = 4850
These look almost like there's a problem with locking the indexes properly..
I have multi-domain setup with several hundred users, emails are delivered using dovecot-deliver LDA, dovecot indexes are outside mailboxes, indexes and mailboxes are on local filesystem (xfs). I'm using linux 2.6 on slackware platform.
Since the path contains /export, does it mean they're also exported to NFS?
I haven't seen any of these problems reported for a while, so I'd guess this has to be somehow specific to your system. One problem with Dovecot LDA is that it reads the configuration file by itself, so it might be possible that it reads for example the locking settings wrong.
Could you try running http://dovecot.org/tools/imaptest.c with some test account and see if it can make your Dovecot break? And if not, try sending mails to the test account with Dovecot LDA while running the imaptest?
On Sunday 26 February 2006 12:01, Timo Sirainen wrote:
dovecot.log.1.gz:Feb 24 16:05:21 elfstone dovecot: imap(user3@domain.tld): Maildir /export/mail/domain.tld/user3 sync: UID inserted in the middle of mailbox (47681 > 47680, file = 1138960753.P9796Q0M642679.elfstone:2,T)
Well, this means that the file was lost, but then Dovecot saw it again later.
No problem, then? :))
These look almost like there's a problem with locking the indexes properly..
Hm, can i help you in any way to resolve this issue?
Since the path contains /export, does it mean they're also exported to NFS?
No. It's mounted there just becouse of tradition ;)
I haven't seen any of these problems reported for a while, so I'd guess this has to be somehow specific to your system. One problem with Dovecot LDA is that it reads the configuration file by itself, so it might be possible that it reads for example the locking settings wrong.
Hm... i've got dovecot 1.0-beta3 and dovecot-deliver from cvs (~ 2 weeks ago)
Could you try running http://dovecot.org/tools/imaptest.c with some test account and see if it can make your Dovecot break? And if not, try sending mails to the test account with Dovecot LDA while running the imaptest?
imaptest:
--- snip ---
Auth Logi Sele Fetc Fet2 Stor Expu Appe Logo Disc 28 28 27 23 12 7 4 6 4 3 17 17 16 12 16 5 5 12 19 4 19 19 18 15 17 10 10 12 16 5 12 9 9 10 10 9 7 9 14 4 18 18 18 14 14 12 12 16 29 5 17 16 16 18 16 13 13 15 24 7 13 13 13 16 12 6 9 11 18 4 Error: APPEND failed: Sent only 66083 of 771156 29 28 27 21 20 14 9 16 33 12 8 8 8 10 11 9 8 6 8 4 16 15 14 14 14 10 9 13 14 9 Auth Logi Sele Fetc Fet2 Stor Expu Appe Logo Disc 21 21 19 16 14 8 9 11 24 11 Error: APPEND failed: Sent only 69084 of 855633 15 15 14 15 14 8 8 11 12 7 14 14 14 13 12 7 8 12 22 2 18 16 16 13 14 13 6 9 24 5 Error: APPEND failed: Sent only 66427 of 67229 Error: APPEND failed: Sent only 66019 of 879215 22 21 19 18 14 10 13 9 18 10 8 8 7 6 6 5 6 8 9 4 12 12 12 10 7 6 6 12 14 3 9 8 8 9 10 6 4 4 6 6 Error: APPEND failed: Sent only 117035 of 869884 16 14 14 15 13 6 6 11 18 6 10 9 8 11 12 11 9 11 8 4 Auth Logi Sele Fetc Fet2 Stor Expu Appe Logo Disc 10 8 8 7 6 2 5 10 12 2 Error: APPEND failed: Sent only 66122 of 832175 27 26 23 17 16 9 7 14 31 10 19 18 18 19 18 12 12 18 20 7 Error: APPEND failed: Sent only 66039 of 768333 22 19 16 17 18 10 12 13 22 9 4 4 3 4 4 6 6 5 4 2 14 14 13 8 6 3 3 10 16 6 4 4 4 5 5 6 7 3 2 3 Error: APPEND failed: Sent only 115938 of 786000 17 17 15 17 14 10 7 13 20 5 8 8 8 9 9 6 6 12 10 2 10 9 8 9 9 8 7 11 16 1 Error: APPEND failed: Sent only 67301 of 880520 Auth Logi Sele Fetc Fet2 Stor Expu Appe Logo Disc 26 24 22 17 18 13 11 15 22 12 16 16 17 15 11 8 7 12 20 6 Error: APPEND failed: Sent only 118739 of 862255 17 17 16 12 12 9 7 10 20 5 16 13 13 11 10 5 5 8 6 10 12 11 11 11 8 3 3 5 12 6 9 9 7 11 14 11 13 11 8 6 17 17 17 11 9 5 6 12 24 3 Error: APPEND failed: Sent only 134954 of 859016 24 21 20 18 13 10 8 14 27 9 10 9 9 10 8 5 7 10 10 5 15 15 14 13 16 7 7 4 12 3 Error: APPEND failed: Sent only 118454 of 859213 Auth Logi Sele Fetc Fet2 Stor Expu Appe Logo Disc 7 7 7 9 7 6 3 7 6 3 13 13 13 13 13 8 9 11 18 4 11 11 11 7 8 6 6 11 15 4 Error: APPEND failed: Sent only 66932 of 839404 11 11 11 13 12 8 9 9 14 2 22 20 20 17 14 12 12 17 28 7 11 11 10 11 11 9 8 11 14 4 Error: APPEND failed: Sent only 65947 of 776989 30 27 25 24 25 13 12 18 31 12 11 12 12 9 6 9 7 10 16 4 11 11 11 11 9 6 6 8 12 3 Error: APPEND failed: Sent only 65928 of 778562 11 10 10 9 9 5 7 6 12 3 Auth Logi Sele Fetc Fet2 Stor Expu Appe Logo Disc 8 8 6 7 7 4 5 7 8 4 11 10 10 12 9 7 5 10 10 5 7 7 7 6 6 3 2 5 6 2 1 1 1 2 4 2 2 4 2 0 Error: APPEND failed: Sent only 69230 of 888498 Error: APPEND failed: Sent only 69066 of 254129 24 23 21 19 17 11 10 9 20 8 15 15 15 8 8 6 8 11 11 6 22 19 17 20 15 8 7 17 18 14 Error: APPEND failed: Sent only 117723 of 871570 13 13 13 7 11 8 8 7 15 3 14 13 11 13 11 8 7 7 11 7 8 7 6 4 4 4 7 10 8 4 Auth Logi Sele Fetc Fet2 Stor Expu Appe Logo Disc 12 11 10 11 10 6 6 15 18 4 Error: APPEND failed: Sent only 114784 of 866485 9 9 8 6 8 5 0 3 7 3 13 13 11 12 10 8 9 11 11 8 22 21 18 19 17 10 9 13 17 14 11 11 10 7 4 3 3 4 14 2 7 7 7 8 6 4 5 5 8 2 Error: APPEND failed: Sent only 66431 of 857138 2 2 2 4 7 5 4 3 0 1 11 11 11 10 9 5 7 12 14 2 10 9 9 8 8 7 6 7 12 2 12 11 11 7 6 2 2 6 14 4 Auth Logi Sele Fetc Fet2 Stor Expu Appe Logo Disc 8 8 8 10 6 7 5 8 8 3 2 1 1 3 6 1 1 0 0 1 Error: APPEND failed: Sent only 99409 of 846800 2 2 2 3 4 4 2 1 1 1 6 6 6 5 5 2 6 7 6 2
--- snip ---
dovecot error messages:
--- snip ---
Feb 27 16:37:20 elfstone dovecot: imap(user1@domain.tld): Corrupted index cache file /export/data/dovecot/domain.tld/user1/.INBOX/dovecot.index.cache: record points outside file Feb 27 16:37:32 elfstone dovecot: imap(user1@domain.tld): Corrupted index cache file /export/data/dovecot/domain.tld/user1/.INBOX/dovecot.index.cache: invalid record size Feb 27 16:37:50 elfstone dovecot: imap(user1@domain.tld): Corrupted index cache file /export/data/dovecot/domain.tld/user1/.INBOX/dovecot.index.cache: record points outside file Feb 27 16:37:51 elfstone dovecot: imap(user1@domain.tld): Corrupted index cache file /export/data/dovecot/domain.tld/user1/.INBOX/dovecot.index.cache: record points outside file Feb 27 16:37:53 elfstone dovecot: imap(user1@domain.tld): Corrupted index cache file /export/data/dovecot/domain.tld/user1/.INBOX/dovecot.index.cache: record has invalid size Feb 27 16:37:53 elfstone dovecot: imap(user1@domain.tld): Corrupted index cache file /export/data/dovecot/domain.tld/user1/.INBOX/dovecot.index.cache: record points outside file
--- snip ---
System: compiler: (GCC) 3.2.3 binutils: GNU ld version 2.14.90.0.6 20030820 libc: GNU C Library stable release version 2.3.2, by Roland McGrath et al. kernel: linux 2.6.6 #1 SMP, i686 filesystem: xfs
Best regards, Brane
participants (2)
-
Branko F. Gračnar
-
Timo Sirainen