[Dovecot] Problem with rc10
I just upgraded our test server from rc6 to rc10...
ISSUE #1
I noticed that we no longer are getting two "From_" lines. However, the one that was good (had the original sender e-mail address) is now gone. The one with "dovecot.deliver" remains.
I attempted to add "-d test" to the mailbox_command line in main.cf as follows:
mailbox_command = /opt/dovecot/libexec/dovecot/deliver -d test
and things turned ugly and caused Postfix to defer messages:
Oct 17 16:31:50 hostname postfix/local[7230]: D14632C9C: to=someuser@somehost, relay=local, delay=3.6, delays=3/0.02/0/0.62, dsn=4.3.0, status=deferred (temporary failure)
I removed the "-d test" from the Postfix main.cf and the problem went away. So, how do I fix the "From_" lines?
ISSUE #2
After upgrading, messages cannot be moved from the INBOX to a folder. Thunderbird claims there was an internal error and to consule the server logs, but I see nothing in the dovecot logs that would indicate what's going on. For example, I attempted to move a message into my Trash folder which did not currently have any index files. Here is a Solaris truss output of that attempt:
poll(0x000B4C98, 2, 999) = 0 poll(0x000B4C98, 2, 0) = 0 poll(0x000B4C98, 2, 999) = 1 read(0, " D O N E\r\n", 3323) = 6 write(1, " 2 8 O K I d l e c".., 23) = 23 read(0, 0x000BC5BB, 3317) Err#11 EAGAIN poll(0x000B4C98, 2, 675) = 1 read(0, " 3 0 u i d c o p y ".., 3317) = 27 stat64("/home/sfs/Trash", 0xFFBFF5C8) = 0 alarm(120) = 0 fcntl(6, F_SETLKW64, 0xFFBFF308) = 0 alarm(0) = 120 stat64("/home/sfs/Trash", 0xFFBFF640) = 0 mkdir("/home/sfs/.imap/Trash", 0770) Err#17 EEXIST stat64("/home/sfs/.imap/Trash", 0xFFBFF4C0) = 0 stat64("/home/sfs/Trash", 0xFFBFF4C0) = 0 time() = 1161122396 open64("/home/sfs/.imap/Trash/dovecot.index", O_RDWR) Err#2 ENOENT open64("/home/sfs/.imap/Trash/dovecot.index", O_RDWR) Err#2 ENOENT write(1, " 3 0 N O I n t e r n".., 96) = 96 poll(0x000B4C98, 2, 588) = 0 poll(0x000B4C98, 2, 0) = 0 poll(0x000B4C98, 2, 410) = 0
Someone else using a different IMAP client caused these errors to occur (this is even after I wiped all of their dovecot index files):
Oct 17 16:43:11 earth.tc.umn.edu dovecot: IMAP(kor): Corrupted transaction log file /home/kor/.imap/INBOX/dovecot.index.log: invalid indexid (1161121145 != 1156185395) Oct 17 16:43:11 earth.tc.umn.edu dovecot: IMAP(kor): Corrupted transaction log file /home/kor/.imap/INBOX/dovecot.index.log: invalid new transaction log sequence (6 >= 6) Oct 17 16:47:09 earth.tc.umn.edu dovecot: IMAP(kor): Corrupted transaction log file /home/kor/.imap/INBOX/dovecot.index.log: invalid indexid (1161121145 != 1161120959) Oct 17 16:47:09 earth.tc.umn.edu dovecot: IMAP(kor): Corrupted transaction log file /home/kor/.imap/INBOX/dovecot.index.log: invalid new transaction log sequence (2 >= 2) Oct 17 17:05:59 earth.tc.umn.edu dovecot: IMAP(kor): Corrupted transaction log file /home/kor/.imap/INBOX/dovecot.index.log: invalid indexid (1161121145 != 1161120959) Oct 17 17:05:59 earth.tc.umn.edu dovecot: IMAP(kor): Corrupted transaction log file /home/kor/.imap/INBOX/dovecot.index.log: invalid new transaction log sequence (4 >= 4)
Here are our non-standard dovecot.conf items:
protocols = imap imaps pop3 pop3s shutdown_clients = no syslog_facility = local6 ssl_cert_file = /etc/opt/openssl/certs/dovecot.pem ssl_key_file = /etc/opt/openssl/private/dovecot.pem default_mail_env = mbox:~/:INBOX=/var/mail/%u # Default namespace namespace private { separator = / prefix = location = mbox:~/:INBOX=/var/mail/%u inbox = yes hidden = yes } mail_full_filesystem_access = yes first_valid_uid = 100 max_mail_processes = 8192 mbox_min_index_size = 128 imap_client_workarounds = delay-newmail outlook-idle tb-extra-mailbox-sep pop3_uidl_format = %08Xu%08Xv protocol lda { postmaster_address = postmaster@umn.edu mail_plugins = cmusieve } auth_verbose = yes auth_debug = yes auth default { passdb pam { args = session=yes * } }
I am now backing out to rc6 for now... we never saw this behavior on rc6.
--
Steven F. Siirila Office: Lind Hall, Room 130B Internet Services E-mail: sfs@umn.edu Office of Information Technology Voice: (612) 626-0244 University of Minnesota Fax: (612) 626-7593
On Tue, Oct 17, 2006 at 05:19:40PM -0500, Steven F Siirila wrote:
I just upgraded our test server from rc6 to rc10... . . .
ISSUE #2
After upgrading, messages cannot be moved from the INBOX to a folder. Thunderbird claims there was an internal error and to consule the server logs, but I see nothing in the dovecot logs that would indicate what's going on. For example, I attempted to move a message into my Trash folder which did not currently have any index files. Here is a Solaris truss output of that attempt: . . . I believe I have at least found part of the problem. It seems that RC10 makes an assumption in at least parts of the code that the index files exist for a given folder. In my environment, they only get created if they are > 128KB (mbox_min_index_size = 128). When I commented this out, I was able to copy/move messages to alternate folders...
At this point I'm not sure if the other problem with corrupted index files is related or not.
--
Steven F. Siirila Office: Lind Hall, Room 130B Internet Services E-mail: sfs@umn.edu Office of Information Technology Voice: (612) 626-0244 University of Minnesota Fax: (612) 626-7593
On Tue, Oct 17, 2006 at 05:19:40PM -0500, Steven F Siirila wrote:
I just upgraded our test server from rc6 to rc10...
ISSUE #1
I noticed that we no longer are getting two "From_" lines. However, the one that was good (had the original sender e-mail address) is now gone. The one with "dovecot.deliver" remains.
I attempted to add "-d test" to the mailbox_command line in main.cf as follows:
mailbox_command = /opt/dovecot/libexec/dovecot/deliver -d test
and things turned ugly and caused Postfix to defer messages:
Oct 17 16:31:50 hostname postfix/local[7230]: D14632C9C: to=someuser@somehost, relay=local, delay=3.6, delays=3/0.02/0/0.62, dsn=4.3.0, status=deferred (temporary failure)
I removed the "-d test" from the Postfix main.cf and the problem went away. So, how do I fix the "From_" lines? . . .
I'll now answer my own question. I should be using '-f <from>' instead. I haven't had a chance to test this yet, but I suspect I'll get different results. :)
Also, I should note that the "Usage:" message for deliver does not include the -f option, which of course is a recent addition.
--
Steven F. Siirila Office: Lind Hall, Room 130B Internet Services E-mail: sfs@umn.edu Office of Information Technology Voice: (612) 626-0244 University of Minnesota Fax: (612) 626-7593
On Tue, Oct 17, 2006 at 05:19:40PM -0500, Steven F Siirila wrote:
I just upgraded our test server from rc6 to rc10...
ISSUE #1
I noticed that we no longer are getting two "From_" lines. However, the one that was good (had the original sender e-mail address) is now gone. The one with "dovecot.deliver" remains.
I attempted to add "-d test" to the mailbox_command line in main.cf as follows:
mailbox_command = /opt/dovecot/libexec/dovecot/deliver -d test
and things turned ugly and caused Postfix to defer messages:
Oct 17 16:31:50 hostname postfix/local[7230]: D14632C9C: to=someuser@somehost, relay=local, delay=3.6, delays=3/0.02/0/0.62, dsn=4.3.0, status=deferred (temporary failure)
I removed the "-d test" from the Postfix main.cf and the problem went away. So, how do I fix the "From_" lines?
The final resolution for #1 was to use this in the Postfix main.cf file:
mailbox_command = /opt/dovecot/libexec/dovecot/deliver -f "$SENDER"
ISSUE #2
After upgrading, messages cannot be moved from the INBOX to a folder. Thunderbird claims there was an internal error and to consule the server logs, but I see nothing in the dovecot logs that would indicate what's going on. For example, I attempted to move a message into my Trash folder which did not currently have any index files. Here is a Solaris truss output of that attempt:
The workaround for #2, as mentioned earlier, was to make sure to index ALL mailboxes (using mbox_min_index_size = 0, which is the default). Until this is fixed, please know that you must have mbox_min_index_size set to 0 if you are using mbox format, perhaps others as well, in RC10. The problem did not exist in RC6. I don't know about the ones in between.
--
Steven F. Siirila Office: Lind Hall, Room 130B Internet Services E-mail: sfs@umn.edu Office of Information Technology Voice: (612) 626-0244 University of Minnesota Fax: (612) 626-7593
On October 26, 2006 10:54:39 AM -0500 Steven F Siirila sfs@tc.umn.edu wrote:
On Tue, Oct 17, 2006 at 05:19:40PM -0500, Steven F Siirila wrote:
I just upgraded our test server from rc6 to rc10...
ISSUE #1
I noticed that we no longer are getting two "From_" lines. However, the one that was good (had the original sender e-mail address) is now gone. The one with "dovecot.deliver" remains.
I attempted to add "-d test" to the mailbox_command line in main.cf as follows:
mailbox_command = /opt/dovecot/libexec/dovecot/deliver -d test
and things turned ugly and caused Postfix to defer messages:
Oct 17 16:31:50 hostname postfix/local[7230]: D14632C9C: to=someuser@somehost, relay=local, delay=3.6, delays=3/0.02/0/0.62, dsn=4.3.0, status=deferred (temporary failure)
I removed the "-d test" from the Postfix main.cf and the problem went away. So, how do I fix the "From_" lines?
The final resolution for #1 was to use this in the Postfix main.cf file:
mailbox_command = /opt/dovecot/libexec/dovecot/deliver -f "$SENDER"
If you recall, I replied to this thread earlier saying I had no problems with beta8 -- deliver (lda from cvs, for sieve) wrote a single From line into Maildir files and it was the envelope sender. That was with postfix-2.3.2 and mailbox_command = /path/to/deliver. (no options)
I just upgraded to rc15 and deliver (now from dovecot itself but with sieve plugin) with postfix-2.3.3 acts identically -- no problems.
-frank
participants (2)
-
Frank Cusack
-
Steven F Siirila