- dovecot - dovecot.org

[Dovecot] file mail-transaction-log-view.c: assertion failed (v1.0.12)
by Uldis Pakuls 20 Jul '08

20 Jul '08

Hi all. Looking at previous weeks logs I discovered strange errors: "file mail-transaction-log-view.c: assertion failed" dovecot v 1.0.12 Server is hosting more than 500 virtual users. It is compleate dovecot error log; only my own mailbox is affected ...and imap folder affected is "dovecots mailing list" :) While "Corrupted transaction log file" as far as I know is not error to care about much, "assertion failed" is something new. maibox are accessed only by dovecet and dovecot's LDA. -------sart of log --- dovecot: Jul 02 11:27:21 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19202, but next_uid = 19203 dovecot: Jul 02 11:27:21 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19202, but next_uid = 19203 dovecot: Jul 02 11:27:21 Error: IMAP(neko(a)it4u.lv): Transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: marked corrupted dovecot: Jul 02 11:27:22 Error: IMAP(neko(a)it4u.lv): Maildir /srv/vmail/it4u.lv/neko/.Listservers.Tech.Dovecot sync: UID inserted in the middle of mailbox (19203 > 19202, file = 1214987241.P26793Q0M308123.serv09,S=3912:2,) dovecot: Jul 02 11:39:34 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: invalid indexid (1214987242 != 1213863362) dovecot: Jul 02 11:39:34 Warning: IMAP(neko(a)it4u.lv): fscking index file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index dovecot: Jul 02 11:39:34 Error: IMAP(neko(a)it4u.lv): Transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: marked corrupted dovecot: Jul 02 11:39:34 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: invalid new transaction log sequence (4 >= 4) dovecot: Jul 02 11:39:34 Warning: IMAP(neko(a)it4u.lv): fscking index file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index dovecot: Jul 02 11:39:34 Error: IMAP(neko(a)it4u.lv): file mail-transaction-log-view.c: line 107 (mail_transaction_log_view_set): assertion failed: (min_file_seq <= max_file_seq) dovecot: Jul 02 11:39:34 Error: IMAP(neko(a)it4u.lv): Raw backtrace: imap [0x5555555bd66e] -> imap [0x5555555bd3ae] -> imap(mail_transaction_log_view_set+0x3b3) [0x5555555aba23] -> imap [0x5555555a6d1f] -> imap(mail_index_view_sync_begin+0x3f3) [0x5555555a73d3] -> imap(index_mailbox_sync_init+0xa1) [0x555555595fc1] -> imap(imap_sync_init+0x56) [0x555555575756] -> imap(cmd_sync+0x7b) [0x55555557588b] -> imap [0x55555556bb12] -> imap(cmd_fetch+0x28d) [0x55555556be1d] -> imap(cmd_uid+0x4a) [0x55555556e9ba] -> imap [0x55555556eec7] -> imap [0x55555556ef59] -> imap(_client_input+0x6f) [0x55555556f5ff] -> imap(io_loop_handler_run+0x108) [0x5555555c2ea8] -> imap(io_loop_run+0x18) [0x5555555c2068] -> imap(main+0x41b) [0x5555555770cb] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b75b43d9b54] -> imap [0x55555556a6e9] dovecot: Jul 02 11:39:34 Error: child 22307 (imap) killed with signal 6 dovecot: Jul 02 11:39:34 Error: IMAP(neko(a)it4u.lv): Transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: marked corrupted dovecot: Jul 02 12:13:21 Warning: IMAP(neko(a)it4u.lv): Unlinked a duplicate: 1214989937.P31578Q0M123879.serv09,S=4899:2, dovecot: Jul 02 12:48:57 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19209, but next_uid = 19210 dovecot: Jul 02 12:48:57 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19209, but next_uid = 19210 dovecot: Jul 02 12:48:57 Error: IMAP(neko(a)it4u.lv): Unexpected transaction log desync with index /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index dovecot: Jul 02 12:48:57 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19209, but next_uid = 19210 dovecot: Jul 02 12:48:57 Error: IMAP(neko(a)it4u.lv): Transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: marked corrupted dovecot: Jul 02 12:48:59 Error: IMAP(neko(a)it4u.lv): Maildir /srv/vmail/it4u.lv/neko/.Listservers.Tech.Dovecot sync: UID inserted in the middle of mailbox (19210 > 19209, file = 1214992136.P29477Q0M844419.serv09,S=6950:2,) dovecot: Jul 02 12:51:00 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: invalid indexid (1214992140 != 1214987242) dovecot: Jul 02 12:51:00 Warning: IMAP(neko(a)it4u.lv): fscking index file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index dovecot: Jul 02 12:51:00 Error: IMAP(neko(a)it4u.lv): Transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: marked corrupted dovecot: Jul 02 12:51:00 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: invalid new transaction log sequence (5 >= 5) dovecot: Jul 02 12:51:00 Warning: IMAP(neko(a)it4u.lv): fscking index file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index dovecot: Jul 02 12:51:00 Error: IMAP(neko(a)it4u.lv): file mail-transaction-log-view.c: line 107 (mail_transaction_log_view_set): assertion failed: (min_file_seq <= max_file_seq) dovecot: Jul 02 12:51:00 Error: IMAP(neko(a)it4u.lv): Raw backtrace: imap [0x5555555bd66e] -> imap [0x5555555bd3ae] -> imap(mail_transaction_log_view_set+0x3b3) [0x5555555aba23] -> imap [0x5555555a6d1f] -> imap(mail_index_view_sync_begin+0x3f3) [0x5555555a73d3] -> imap(index_mailbox_sync_init+0xa1) [0x555555595fc1] -> imap(imap_sync_init+0x56) [0x555555575756] -> imap(cmd_sync+0x7b) [0x55555557588b] -> imap [0x55555556bb12] -> imap(cmd_fetch+0x28d) [0x55555556be1d] -> imap(cmd_uid+0x4a) [0x55555556e9ba] -> imap [0x55555556eec7] -> imap [0x55555556ef59] -> imap(_client_input+0x6f) [0x55555556f5ff] -> imap(io_loop_handler_run+0x108) [0x5555555c2ea8] -> imap(io_loop_run+0x18) [0x5555555c2068] -> imap(main+0x41b) [0x5555555770cb] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b733287bb54] -> imap [0x55555556a6e9] dovecot: Jul 02 12:51:00 Error: child 4479 (imap) killed with signal 6 dovecot: Jul 02 12:51:00 Error: IMAP(neko(a)it4u.lv): Transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: marked corrupted dovecot: Jul 02 14:11:40 Warning: IMAP(neko(a)it4u.lv): Unlinked a duplicate: 1214987033.P23952Q0M811113.serv09,S=4807:2,S dovecot: Jul 04 12:25:20 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19272, but next_uid = 19273 dovecot: Jul 04 12:25:20 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19272, but next_uid = 19273 dovecot: Jul 04 12:25:20 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19272, but next_uid = 19273 dovecot: Jul 04 12:25:21 Error: IMAP(neko(a)it4u.lv): Transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: marked corrupted dovecot: Jul 04 12:25:21 Error: IMAP(neko(a)it4u.lv): Transaction log got desynced for index /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index dovecot: Jul 04 12:25:23 Warning: IMAP(neko(a)it4u.lv): Unlinked a duplicate: 1215162799.P18322Q0M736352.serv09,S=13262:2, dovecot: Jul 04 12:25:23 Error: IMAP(neko(a)it4u.lv): Transaction log got desynced for index /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index dovecot: Jul 04 12:25:28 Error: IMAP(neko(a)it4u.lv): Maildir /srv/vmail/it4u.lv/neko/.Listservers.Tech.Dovecot sync: UID inserted in the middle of mailbox (19273 > 19272, file = 1215163520.P28321Q0M199676.serv09,S=3477:2,) -------end of log ---

2 4

[Dovecot] Multiple auth client sockets
by Ulrich Zehl 20 Jul '08

20 Jul '08

I use two seperate Postfix instances as MSAs (so that different policies are simpler to configure), and both of them require Dovecot SASL support. Since Postfix' smtpd is chrooted (at least in the Debian package), the client socket needs to be somewhere under the instance's queue_directory. This means I need two different auth client socket paths. When I simply specify two "client { ... }" in dovecot.conf, the second takes precedence over the first. Besides using a second dovecot instance, which I'd like to avoid, what ways are there to run a second client socket? Ulrich

2 1

[Dovecot] [Help] quota_rule with LDAP backend, dovecot-1.1.1
by Zhang Huangbin 20 Jul '08

20 Jul '08

Hi, all. I use dovecot-1.1.1 with OpenLDAP as userdb. but i failed to convert quota value as expect. I set '10' as mail quota, and it should be '10M' as expect, but it's not effect, dovecot always uses 'quota_rule' setting in dovecot.conf. How can i fix this issue? 10*1047576? I have 'mailQuota' attr in ldap schema, such as: ----8<---- mailQuota: 10 # <- 10M ----8<---- My dovecot-ldap.conf: ----8<---- user_attrs = homeDirectory=home,mailMessageStore=maildir:mail,mailQuota=quota_rule=*:bytes=%$ ----8<---- And my dovecot.conf: ----8<---- plugin { quota = maildir # Quota rules. quota_rule = *:storage=10M } ----8<---- -- Best Regards. Zhang Huangbin - iRedMail: Mail Server Solution for Red Hat(R) Enterprise Linux & CentOS 5.x: http://iRedMail.googlecode.com/

2 1

[Dovecot] configuration query
by Michael Mounteney 20 Jul '08

20 Jul '08

Hello, please excuse my asking a question about simple configuration rather than something about a suspected bug or other detailed enquiry. I've set up dovecot (1.0.13, from http://www.blastwave.org) and when Thunderbird connects to it, all is well and I see folders as expected. When MacOS X mail connects however, it sees my home directory on the dovecot machine, not the mail directory. Now setting-aside the obvious rant about why MacOS has to be gratuitously different *again*, I would like to configure dovecot not to serve my home directory. I keeping saying I/my as this is just a personal set-up at home. This IMAP stuff is a bit involved but I thought namespaces would be the answer but it seems not. That is, I have namespace private { location = /var/marchive/%u inbox = yes } but even this still allows Mac Mail to see the home directory. What else should I do to stop dovecot serving my home directory ? I realise that there is also a problem with the client, that Mac Mail is *asking for* my home directory rather than the mail folder, but that's another problem, not for this list. Thanks in expectation.

2 1

[Dovecot] BUG: messages created with permissions not respecting umask
by Thomas Vander Stichele 20 Jul '08

20 Jul '08

Using dovecot 1.0rc15, together with postfix and dovecot-lda. umask is set to 0007. This should ensure directories and files get created with read/write permissions for both user and group. However, dovecot-lda writes files with 600 permissions, instead of 660. So dovecot does not seem to respect the umask configuration property for local mail delivery. In my particular case, I have vmail:vmail own the mail directories, and a backup user part of the vmail group. However the backup user cannot read the mails and thus back them up properly. Suggestions: - respect the umask for file delivery as well - alternatively, take the parent directory's permissions, strip executable bits, and apply to file Thanks Thomas

3 3

[Dovecot] Run script before delivery
by Juan Asensio Sánchez 20 Jul '08

20 Jul '08

Hi Is it possible to run one script before the "real" delivery of a message (with lda, or before the execution of the sieve scripts) but after the creation of necessary folders (Dovecot automatically creates the folders for virtual users)? I want to to this to manually create a fixed empty sieve script in each user home folder, so in the global sieve script include that personal script, because if personal script doesn't exists, global script is not executed, or am I wrong? Thanks in advance.

3 2

[Dovecot] Need suggestion regarding index file and Quota settings.
by Tim Chen 20 Jul '08

20 Jul '08

Dear All, My system has about 30,000 accounts and these accounts are created as unix system users. Each account has its own entry in /etc/passwd with different UID and home directory. We plan to deploy an Layer 4 switch as a load balancer. Proposed architecure is as the following: ---- internet ---- Layer 4 switch ---- mail server1 ---- NFS storage | | |--- mail server2 -----| Both mail servers will share the same storage which contains users' home with Maildir inside. Dovecot will be installed on the mail servers serving pop3 and imap4 protocols. Since the layer 4 switch will direct connection to backend mail server in random(or some of its algorithm), users can not guarantee which mail server to use. My first question is which kind of INDEX settings should I apply? 1) INDEX=MEMORY 2) INDEX=/nfs/%u 3) INDEX=/var/spool/%u Will INDEX stored on disk outperform INDEX stored in memory? If INDEX stored on NFS storage, we can be sure the consistency of INDEX file, but what about the performance and locking problem? If INDEX stored on local disk, since users may connect to different mail servers every time. Will that impose the problem of inconsistency? What kind of syndrome will happen if the INDEX became inconsistent to real maildir content? My second question is about quota. We use maildir as mail storage format. Our users were divided into 3-4 groups, each group of users with different quota size ranging from 100MB - 1G. To my best knowledge, dovecot's quota setting in config file supports only "one global configuration". (We are not using db, we use only /etc/passwd). dovecot.conf quota_rule = *:storage=10MB Since dovecot supports both fs and maildir++ quota, I would like to ask for your suggestion: 1. Should I use system quota instead? How about the comparision of performance? Is there any drawback/limitation using system quota? 2. Is there any settings of dovecot that could fullfil my situation? 3. My thought is to modify dovecot.conf, comment out quota_rule = *:storage=10MB and leave only the quota = maildir in the plugin { block. According to my experiment, dovecot will read the maildirsize file under user's home. Then I have to set the maildirsize file for every user individually! It seems to be a little crappy but works. Looking for your valuable suggestions! Thanks very much. Tim Chen

3 2

[Dovecot] Is it ok to upgrade to 1.1?
by Bjørn T Johansen 19 Jul '08

19 Jul '08

Or is it some issues left that need to be sorted out? Regards, BTJ -- ----------------------------------------------------------------------------------------------- Bjørn T Johansen btj(a)havleik.no ----------------------------------------------------------------------------------------------- Someone wrote: "I understand that if you play a Windows CD backwards you hear strange Satanic messages" To which someone replied: "It's even worse than that; play it forwards and it installs Windows" -----------------------------------------------------------------------------------------------

3 3

[Dovecot] OT: Deleting email
by Mauricio Tavares 19 Jul '08

19 Jul '08

I have a mail server running postfix and then using dovecot so others can reach it using imap. I go check mail using thunderbird and delete a few emails, emptying the trash afterwards. Then I quit it and access it using pine. The deleted emails are still there, marked as marked for deletion. I delete a few other emails within pine and quit. It asks to delete the marked emails, I tell go for it, and it does. When I go back to THunderbird all those emails are gone. Next I tell thunderbird to mark certain messages as spam and delete email I marked as spam. I quit it and go back to pine. The spam marked messages which thunderbird swore were deleted are still there. THis really does not seem to be a dovecot issue, but has someone seen that happen? If so, what is going on?

2 1

Re: [Dovecot] Problems with dovecot/sieve and vacation
by iaslanidis＠flumotion.com 19 Jul '08

19 Jul '08

Hello, Thank you for the reply. I will plan to do the upgrade some time soon, that is not questionable. Now back to this, I checked the following: # strings /usr/libexec/dovecot/deliver | grep sendmail /usr/lib/sendmail So, if I understand correctly, this is fine. What I have in maillog is the following: 614u19e82aed7fe5a435(a)mail.gmail.com> for <iaslanidis(a)flumotion.com> ORCPT=rfc822;iaslanidis(a)flumotion.com Jul 19 01:58:56 se01 spampd[9143]: clean message <ea440b1d0807181658s458ba614u19e82aed7fe5a435(a)mail.gmail.com> (0.28/3.50) from <aslanidis(a)gmail.com> for <iaslanidis(a)flumotion.com> ORCPT=rfc822;iaslanidis(a)flumotion.com in 0.04s, 1926 bytes. Jul 19 01:58:56 se01 clamsmtpd: 10C4A0: from=aslanidis(a)gmail.com, to=iaslanidis(a)flumotion.com, status=CLEAN Jul 19 01:58:56 se01 postfix/smtp[15494]: AC414250084: to=<iaslanidis(a)flumotion.com>, relay=127.0.0.1[127.0.0.1]:10025, delay=0.86, delays=0.55/0.01/0.06/0.24, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as 253AE250133) Jul 19 01:58:56 se01 deliver(iaslanidis(a)flumotion.com): execv(/usr/lib/sendmail) failed: Permission denied Jul 19 01:58:56 se01 deliver(iaslanidis(a)flumotion.com): Sendmail process terminated abnormally, exit status 89 Jul 19 01:58:56 se01 deliver(iaslanidis(a)flumotion.com): sieve runtime error: Vacation: Error sending mail Jul 19 01:58:57 se01 deliver(iaslanidis(a)flumotion.com): msgid=<ea440b1d0807181658s458ba614u19e82aed7fe5a435(a)mail.gmail.com>: saved mail to INBOX Jul 19 01:58:57 se01 deliver(iaslanidis(a)flumotion.com): msgid=<ea440b1d0807181658s458ba614u19e82aed7fe5a435(a)mail.gmail.com>: saved mail to INBOX Jul 19 01:58:57 se01 postfix/pipe[15529]: 253AE250133: to=<iaslanidis(a)flumotion.com>, relay=dovecot, delay=1.5, delays=0.24/0.01/0/1.2, dsn=2.0.0, status=sent (delivered via dovecot service) For what I see here, this could be a SELinux permission problem, am I right? Regards, Ioannis On Sat, 19 Jul 2008 02:35:11 +0300, Uldis Pakuls <neko(a)it4u.lv> wrote: > Vacation code calls 2 functions: first marks dupes (it seems working) , > then, if it success second function is called which actualy sends > vacation message. This action (success or failure) is loged in log file. > 1. wthat is in your log files? > 2. the only reason I can guess about failure in second function is > sendmail binary. default value of "sendmail_path" (hardcoded) is > /usr/lib/sendmail. You can verify this: "strings > /path/to/dovecot/deliver | grep sendmail" If default value is incorrect > try add sendmail_path variable in dovecot.conf

2 1