[Dovecot] constant mailbox rebuilding with dovecot 1.0.10

[Philip J. Hollenback]

I've recently upgraded to 1.0.10 in hopes that this problem would go
away but no luck.  I've got some users at my company with large
inboxes on maildir (say 22,000 messages).  Their mailboxes are hosted
on nfs and dovecot is configured to do dotlocking.  Still I see
messages like this continually in the logs (sometimes every hour or
so):

server dovecot: IMAP(user): dotlock /home/user/Maildir/dovecot.index.log.lock was immediately recreated under us
server dovecot: IMAP(user): file_dotlock_create() failed with file /home/user/Maildir/dovecot.index.log: No such file or directory
server dovecot: IMAP(user): Our dotlock file /home/user/Maildir/dovecot-uidlist.lock was overridden (kept it 0 secs)
server dovecot: IMAP(user): Duplicate file in uidlist file /home/user/Maildir/dovecot-uidlist: 1162416499.010493.mbox:2,Sa
server dovecot: IMAP(user): Maildir /home/user/Maildir sync: UID inserted in the middle of mailbox (48573 > 1, file = 1162416499.010493.mbox:2,Sa)

or this:

server dovecot: IMAP(user): dotlock /home/user/Maildir/dovecot.index.log.lock was immediately recreated under us
server dovecot: IMAP(user): file_dotlock_create() failed with file /home/user/Maildir/dovecot.index.log: No such file or directory
server dovecot: IMAP(user): Duplicate file in uidlist file /home/user/Maildir/dovecot-uidlist: 1167674195.83666_2.tandoori.schrodinger.com:2,Sklwv
server dovecot: IMAP(user): Maildir /home/user/Maildir sync: UID inserted in the middle of mailbox (34969 > 1, file = 1167674195.83666_2.server.com:2,Sklwv)
server dovecot: IMAP(user): Corrupted transaction log file /home/user/Maildir/dovecot.index.log.2: invalid indexid (1204046496 != 1204055346)


it seems that every time this sort of thing happens the mail client
(thunderbird) sits and rebuilds it's mailbox info for as long as 20-30
minutes, during which time it is unusable.  I suspect this happens
with other users as well but since they have smaller inboxes they
don't notice the long delays.

Also this is not linked to version 1.0.10, I've been seeing on and off
with the previous version (1.0rc17).

Here's the 'dovecot -n' output.  I should add that the default is for
users to use mbox but some users (like the above one) use maildir via
a separate dovecot.passwd file.  Server is FreeBSD 4.7.

# 1.0.10: /usr/local/etc/dovecot.conf
base_dir: /var/run/dovecot/
protocols: imaps
ssl_cert_file: /usr/local/openssl/certs/server.crt
ssl_key_file: /usr/local/openssl/private/server.key
login_dir: /var/run/dovecot//login
login_executable: /usr/local/libexec/dovecot/imap-login
login_greeting_capability: yes
verbose_proctitle: yes
first_valid_uid: 700
last_valid_uid: 9999
first_valid_gid: 100
last_valid_gid: 200
mail_extra_groups: mail
default_mail_env: mbox:%h/mail:INBOX=/var/mail/%u
mail_location: mbox:%h/mail:INBOX=/var/mail/%u
mmap_disable: yes
lock_method: dotlock
mbox_read_locks: dotlock
mbox_write_locks: dotlock
imap_client_workarounds: delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep
auth default:
  passdb:
    driver: pam
  passdb:
    driver: passwd-file
    args: /usr/local/etc/dovecot.passwd
  passdb:
    driver: passwd
  userdb:
    driver: passwd-file
    args: /usr/local/etc/dovecot.passwd
  userdb:
    driver: passwd


-- 
Phil Hollenback
hollenba at schrodinger.com
Schrodinger, Inc.