- dovecot - dovecot.org

[Dovecot] index corruption
by rosenfield＠users.sourceforge.net 06 Nov '07

06 Nov '07

Hi people Just switched to Dovecot yesterday, and I've already got about five reports of users with duplicate mail in their inbox :-/. Not as bad as lost email, mind you, but pretty annoying still. Checking the server log, it says: postfix/smtpd: disconnect from unknown deliver: msync() failed with index file maildir/dovecot.index: Input/output error unionfs: new lower inode mtime (bindex=0, name=maildir) dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error IMAP: Disconnected: Internal error occurred. Refer to server log for more information. This is dovecot version 1.0.3, the log presented here relates to only one user; user name snipped for anonymity purposes. Afterwards things just get worse and worse with the affected user: dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error deliver: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: Corrupted transaction log file maildir/.SPAM/dovecot.index.log: invalid new transaction log sequence (1 >= 1) dovecot: IMAP: fscking index file maildir/.SPAM/dovecot.index dovecot: IMAP: Transaction log file maildir/.SPAM/dovecot.index.log: marked corrupted dovecot: IMAP: Corrupted transaction log file maildir/.SPAM/dovecot.index.log: invalid new transaction log sequence (2 >= 2) dovecot: IMAP: fscking index file maildir/.SPAM/dovecot.index dovecot: IMAP: Corrupted transaction log file maildir/.Junk/dovecot.index.log: invalid new transaction log sequence (1 >= 1) dovecot: IMAP: fscking index file maildir/.Junk/dovecot.index dovecot: IMAP: Transaction log file maildir/.Junk/dovecot.index.log: marked corrupted dovecot: IMAP: Corrupted transaction log file maildir/.Junk/dovecot.index.log: invalid new transaction log sequence (2 >= 2) dovecot: IMAP: fscking index file maildir/.Junk/dovecot.index deliver: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error deliver: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error What could be the problem? How do I go about debugging an issue such as this?

2 2

[Dovecot] IMAP - Empty attachments error
by Tomáš Klandra 06 Nov '07

06 Nov '07

Hallo, I have one problem with the following configuration: - server: debian, dovecot used as an IMAP server, version 0.99.14. - stations: windows 2k/XP, mailer seamonky 1.1.4 Sometimes (let's say once in 20 attemptes) when saving attachments, they are empty (zero size files). Simple re-saving them helps. I was looking on mozilla forums if it's not a bug in SeaMonkey, which looked more likely to me, but didn't find anything, so I got the idea it could be a bug in dovecot. If someone saw this as well or have any ideas, I would really appreciate any help about it, as the error is really annoying. Thank you, Tom

2 1

[Dovecot] assertion failed with hg current
by Jakob Hirsch 06 Nov '07

06 Nov '07

Hi, I get a lot of these after updating to the current 1.1 hg version: > Nov 6 16:05:35 seba deliver(jh): file mail-cache-transaction.c: line 736 (mail_cache_header_add_field): assertion failed: (cache->field_file_map[field_idx] != (uint32_t)-1) > Nov 6 16:05:35 seba deliver(jh): Raw backtrace: /usr/local/libexec/dovecot/deliver(i_syslog_fatal_handler+0x2b) [0x80bbeab] -> /usr/local/libexec/dovecot/deliver [0x80bbd4c] -> /usr/local/libexec/dovecot/deliver(mail_cache_add+0x2d2) [0x8091da2] -> /usr/local/libexec/dovecot/deliver(index_mail_cache_add_idx+0x69) [0x8085629] -> /usr/local/libexec/dovecot/deliver [0x806f776] -> /usr/local/libexec/dovecot/deliver(mail_storage_copy+0x53) [0x80ab3b3] -> /usr/local/libexec/dovecot/deliver(maildir_copy+0x52) [0x8067802] -> /usr/local/libexec/dovecot/deliver(deliver_save+0xcf) [0x80592df] -> /usr/local/libexec/dovecot/deliver(main+0x1317) [0x805a7e7] -> /lib/libc.so.6(__libc_start_main+0xe0) [0x948f70] -> /usr/local/libexec/dovecot/deliver [0x8058541] Besides that, it seems to run fine.

2 1

[Dovecot] User keywords limit to 26
by Arthur Pétry 06 Nov '07

06 Nov '07

Hi, I'm planning to use dovecot 1.0.5 for a webmail using a lot of user- defined tags. Recently, I just saw the limit of 26 of them when messages are stored in maildir format. This is an important issue for me, since I didn't find how to remove a flag from the dovecot-keywords database. Is there any plan to get rid of the keywords limit ? Or perhaps the new dbox storage format can fix that ? By the way, the comportement of Dovecot when we try to add a new flag while the limit is exceeded is strange : (C: is client and S: Dovecot) The store of the flags is ok : C: RUBY0094 UID STORE 89 +FLAGS (test_0 test_1 test_2 test_3 test_4 test_5 test_6 test_7 test_8 test_9 test_10 test_11 test_12 test_13 test_14 test_15 test_16 test_17 test_18 test_19 test_20 test_21 test_22 test_23 test_24 test_25 test_26) S: * 81 FETCH (UID 89 FLAGS (\Seen test_1 test_2 test_3 test_4 test_5 test_6 test_7 test_8 test_9 test_10 test_11 test_12 test_13 test_14 test_15 test_16 test_17 test_18 test_19 test_20 test_21 test_22 test_23 test_24 test_25 test_26 test_0)) S: RUBY0094 OK Store completed. And then when we fetch them, dovecot reply 2 times. The first time with all the flags, and the second time with only the 26 flags stored in maildir. (I suppose Dovecot try to sync the flags when we fetch it) : C: RUBY0095 UID FETCH 89 FLAGS S: * 81 FETCH (FLAGS (\Seen test_1 test_2 test_3 test_4 test_5 test_6 test_7 test_8 test_9 test_10 test_11 test_12 test_13 test_14 test_15 test_16 test_17 test_18 test_19 test_20 test_21 test_22 test_23 test_24 test_25 test_26 test_0) UID 89) S: * 81 FETCH (FLAGS (\Seen test_1 test_2 test_3 test_4 test_5 test_6 test_7 test_8 test_9 test_10 test_11 test_12 test_13 test_14 test_15 test_16 test_17 test_18 test_19 test_20 test_21 test_22 test_23 test_24 test_25 test_0)) S: RUBY0095 OK Fetch completed.

2 1

[Dovecot] Sent vs Sent Items
by Ed W 06 Nov '07

06 Nov '07

Religious wars about which is "best" aside - some mail clients seem to default to using "Sent Items" folder for saving sent mail, and others (many) default to "Sent". Seems that in the interests of compatibility and "doing the right thing" (tm) that a symlink from one folder to the other name would ensure that either default would give the same result (in a mixed client setup)? However, I wonder if someone has already written a plugin to do something simple like this? More generally I guess it's folder aliasing, so that Sent == Sent Items and perhaps there are also synonyms for Drafts/Templates? Anyone got any thoughts on this simple idea? (The prob with sym links is a) creating them at mailbox setup time and b) what happens when someone tries to delete the folder...) Cheers Ed W

6 6

[Dovecot] MySQL-SSL
by xyon 06 Nov '07

06 Nov '07

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello all, I've been running dovecot authenticating against a local MySQL database, but it has come time to implement it with a remote database. Instead of using stunnel, I'd rather take advantage of MySQL's native SSL support. I didn't know if this was possible with dovecot, and if it was, what config changes I might need to get it going. I found the below page/patch from some time ago and tried to use the ssl_key and ssl_cert directives in /etc/dovecot-sql.conf, but it didn't seem to recognize them (perhaps I need to compile mysql-ssl support into dovecot manually?): http://www.dovecot.org/list/dovecot-cvs/2004-July/003003.html Also, I noticed a need for ssl_ca and ssl_ca_path but am unfamiliar with how to generate what's needed if these options are required. FYI, dovecot 1.0.7 is running on CentOS 4.5, using rpm from ATrpms: http://dl.atrpms.net/el4-i386/atrpms/stable/dovecot-1.0.7-0_63.el4.i386.rpm Thanks for any advice or documentation pointers you can provide. Have a great evening everyone! -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.7 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFHL85sJ6p9X8nw/2oRAr9JAJ9u5XTOXqqUvVFE5HqEAr4HzC2juwCgob5o 7usezyZdBjP44wEYQKUg/fQ= =tv5y -----END PGP SIGNATURE-----

1 0

[Dovecot] deliver to subfolder?
by Ralf Hildebrandt 06 Nov '07

06 Nov '07

Can dovecot's deliver deliver a mail to a certain subfolder within a user's mailbox? I was thinking of something along the lines of: deliver -m subfolder But what is the correct syntax to deliver to "spam", subfolder of INBOX? deliver -m spam < message.txt deliver -m INBOX.spam < message.txt -- Ralf Hildebrandt (Ralf.Hildebrandt(a)charite.de) plonk(a)charite.de Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de

2 1

[Dovecot] truncated messages / attachments
by Markus Stumpf 05 Nov '07

05 Nov '07

I am currently running dovecot-1.1.beta6 (at least beta5 also had the problem) Retrieving some messages via IMAP gets them truncated and it also happens with retrieving attachments (message is HTML part of multipart-alternative, attachments are at least some PDF files). A user reported she is rather sure one of the messages was ok, before moving it to some other folder. In the filesystem the messages are there in full length. It happens with Outlook as well as with Thunderbird. We're using Maildir. After upgrading from beta5 to beta6 I have removed all dovecot.index* files of a folder with a defect message. This didn't make a difference. (Thought it could be related to some indexing problem). Any one else seeing this? \Maex -- Markus Stumpf

2 2

[Dovecot] Couldn't init INBOX: Can't sync mailbox: Messages keep getting expunged
by Tom Sommer 05 Nov '07

05 Nov '07

After updating Dovecot, one of my servers keep spamming these errors in the log: dovecot: Nov 03 14:14:18 Error: POP3(foo(a)bar.com): Getting size of message UID=4402 failed dovecot: Nov 03 14:14:18 Error: POP3(foo(a)bar.com): Getting size of message UID=4402 failed dovecot: Nov 03 14:14:18 Error: POP3(foo(a)bar.com): Couldn't init INBOX: Can't sync mailbox: Messages keep getting expunged The funny thing is the mailbox is empty, there are no mails in the folder that should be needed to be parsed It was perfectly fine before I updated, and the permissions on the folder is correct. It only affects some mailboxes as well. Any ideas? // Tom

3 5

Re: [Dovecot] Dovecot write activity (mostly 1.1.x)
by mikkel＠euro123.dk 05 Nov '07

05 Nov '07

On Sun, November 4, 2007 4:32 pm, Timo Sirainen wrote: >> >> I didn't know that mail_nfs_index=yes resulted in a forced chown. >> How come that's necessary with NFS but not on local disks? >> > > It's used to flush NFS attribute cache. Enabling it allows you to use > multiple servers to access the same maildir at the same time while still > having attribute cache enabled (v1.0 required actime=0). If you don't need > this (and it's better if you don't), then just set the mail_nfs_* to "no" > and it works faster. > >> By the way I misinformed you about fsync_disable=yes. >> It was like that before i upgraded to v1.1, but v1.1 requires >> fsync_disable=no when mail_nfs_index=true so I had to disable it. > > So you use ZFS on the NFS server, but Dovecot is using NFS on client > side? The fsyncs then just mean that the data is sent to NFS server, not a > real fsync on ZFS. > Thanks a lot for the help - this changed a lot! Dist writes fell to about 1/3 of before. I guess the reason is that ZFS can now make use if it's caching capabilities. Delivers activity is completely random since it's impossible to load balance a connection based on the e-mail recipient, since only the ip is known at the load balancing point. Therefore I have fsync_disable=no for deliver. It's easy to force the clients using imap/pop3 to the same server since it can be based on the ip only. Therefore I have fsync_disable=yes for imap/pop3. This changed everything. Now there's a real performance gain upgrading from 1.0.x to 1.1.x. About two or three times less disk activity overall (reads were already improved) for both reads and writes. Thats pretty neat!

1 0