- dovecot - dovecot.org

[Dovecot] IMAP Panic
by Raphael Bittencourt S. Costa 20 Jul '08

20 Jul '08

Helo all, One of the users is havings problems when he tries to open .Sent folder. Only after I deleted dovecot-uidlist, dovecot.index.cache and dovecot.index.log the user could open the folder. Any idea? Squirrel: Query: SORT (TO) ISO-8859-1 ALL dovecot.log: Jul 11 13:23:01 mailserver03 dovecot: imap-login: Login: user=<smassaro(a)dialdata.com.br>, method=PLAIN, rip=10.0.4.2, lip=10.0.149.3 Jul 11 13:23:03 mailserver03 dovecot: Panic: IMAP(smassaro(a)dial.com): file index-sort-string.c: line 537 (index_sort_add_ids_range): assertion failed: (left_sort_id < right_sort_id) Jul 11 13:23:03 mailserver03 dovecot: IMAP(smassaro(a)dial.com): Raw backtrace: imap [0x4833d0] -> imap [0x483433] -> imap [0x482b16] -> imap(index_sort_list_finish_string+0xda1) [0x451eb1] -> imap(index_storage_search_next_nonblock+0x425) [0x44ebe5] -> imap(mailbox_search_next+0x21) [0x455ab1] -> imap(imap_sort+0xd6) [0x4208f6] -> imap(cmd_sort+0x2d7) [0x419c47] -> imap(cmd_uid+0x52) [0x41a692] -> imap [0x41b05c] -> imap [0x41b112] -> imap [0x41b8bf] -> imap(client_input+0x63) [0x41bae3] -> imap(io_loop_handler_run+0xf8) [0x489cc8] -> imap(io_loop_run+0x1d) [0x4891bd] -> imap(main+0x3ca) [0x422f2a] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b797d759154] -> imap [0x4158e9] Jul 11 13:23:47 mailserver03 dovecot: imap-login: Login: user=<smassaro(a)dial.com>, method=PLAIN, rip=10.0.4.2, lip=10.0.149.3 Jul 11 13:23:50 mailserver03 dovecot: Panic: IMAP(smassaro(a)dial.com): file index-sort-string.c: line 537 (index_sort_add_ids_range): assertion failed: (left_sort_id < right_sort_id) Jul 11 13:23:50 mailserver03 dovecot: IMAP(smassaro(a)dial.com): Raw backtrace: imap [0x4833d0] -> imap [0x483433] -> imap [0x482b16] -> imap(index_sort_list_finish_string+0xda1) [0x451eb1] -> imap(index_storage_search_next_nonblock+0x425) [0x44ebe5] -> imap(mailbox_search_next+0x21) [0x455ab1] -> imap(imap_sort+0xd6) [0x4208f6] -> imap(cmd_sort+0x2d7) [0x419c47] -> imap(cmd_uid+0x52) [0x41a692] -> imap [0x41b05c] -> imap [0x41b112] -> imap [0x41b8bf] -> imap(client_input+0x63) [0x41bae3] -> imap(io_loop_handler_run+0xf8) [0x489cc8] -> imap(io_loop_run+0x1d) [0x4891bd] -> imap(main+0x3ca) [0x422f2a] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b2e94286154] -> imap [0x4158e9] dovecot -n # 1.1.1: /etc/dovecot//dovecot.conf syslog_facility: local1 protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no shutdown_clients: no login_dir: /usr//var/run/dovecot/login login_executable(default): /usr//libexec/dovecot/imap-login login_executable(imap): /usr//libexec/dovecot/imap-login login_executable(pop3): /usr//libexec/dovecot/pop3-login login_process_per_connection: no login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_process_size: 128 login_processes_count: 30 login_max_processes_count: 1024 login_max_connections: 512 max_mail_processes: 10240 mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(pop3): 10 mail_uid: 1033 mail_gid: 1033 mail_location: maildir:%h/Maildir mail_executable(default): /usr//libexec/dovecot/imap mail_executable(imap): /usr//libexec/dovecot/imap mail_executable(pop3): /usr//libexec/dovecot/pop3 mail_plugins(default): quota imap_quota autocreate mail_plugins(imap): quota imap_quota autocreate mail_plugins(pop3): quota mail_plugin_dir(default): /usr//lib/dovecot/imap mail_plugin_dir(imap): /usr//lib/dovecot/imap mail_plugin_dir(pop3): /usr//lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %f pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: mechanisms: plain login passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: prefetch userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 438 plugin: quota: maildir quota_rule: *:bytes=10240 quota_rule2: *:messages=30000 quota_rule3: Trash:bytes=10%% autocreate: SPAM.E Spam autocreate2: SPAM []s, Raphael Costa

2 3

[Dovecot] file mail-transaction-log-view.c: assertion failed (v1.0.12)
by Uldis Pakuls 20 Jul '08

20 Jul '08

Hi all. Looking at previous weeks logs I discovered strange errors: "file mail-transaction-log-view.c: assertion failed" dovecot v 1.0.12 Server is hosting more than 500 virtual users. It is compleate dovecot error log; only my own mailbox is affected ...and imap folder affected is "dovecots mailing list" :) While "Corrupted transaction log file" as far as I know is not error to care about much, "assertion failed" is something new. maibox are accessed only by dovecet and dovecot's LDA. -------sart of log --- dovecot: Jul 02 11:27:21 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19202, but next_uid = 19203 dovecot: Jul 02 11:27:21 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19202, but next_uid = 19203 dovecot: Jul 02 11:27:21 Error: IMAP(neko(a)it4u.lv): Transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: marked corrupted dovecot: Jul 02 11:27:22 Error: IMAP(neko(a)it4u.lv): Maildir /srv/vmail/it4u.lv/neko/.Listservers.Tech.Dovecot sync: UID inserted in the middle of mailbox (19203 > 19202, file = 1214987241.P26793Q0M308123.serv09,S=3912:2,) dovecot: Jul 02 11:39:34 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: invalid indexid (1214987242 != 1213863362) dovecot: Jul 02 11:39:34 Warning: IMAP(neko(a)it4u.lv): fscking index file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index dovecot: Jul 02 11:39:34 Error: IMAP(neko(a)it4u.lv): Transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: marked corrupted dovecot: Jul 02 11:39:34 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: invalid new transaction log sequence (4 >= 4) dovecot: Jul 02 11:39:34 Warning: IMAP(neko(a)it4u.lv): fscking index file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index dovecot: Jul 02 11:39:34 Error: IMAP(neko(a)it4u.lv): file mail-transaction-log-view.c: line 107 (mail_transaction_log_view_set): assertion failed: (min_file_seq <= max_file_seq) dovecot: Jul 02 11:39:34 Error: IMAP(neko(a)it4u.lv): Raw backtrace: imap [0x5555555bd66e] -> imap [0x5555555bd3ae] -> imap(mail_transaction_log_view_set+0x3b3) [0x5555555aba23] -> imap [0x5555555a6d1f] -> imap(mail_index_view_sync_begin+0x3f3) [0x5555555a73d3] -> imap(index_mailbox_sync_init+0xa1) [0x555555595fc1] -> imap(imap_sync_init+0x56) [0x555555575756] -> imap(cmd_sync+0x7b) [0x55555557588b] -> imap [0x55555556bb12] -> imap(cmd_fetch+0x28d) [0x55555556be1d] -> imap(cmd_uid+0x4a) [0x55555556e9ba] -> imap [0x55555556eec7] -> imap [0x55555556ef59] -> imap(_client_input+0x6f) [0x55555556f5ff] -> imap(io_loop_handler_run+0x108) [0x5555555c2ea8] -> imap(io_loop_run+0x18) [0x5555555c2068] -> imap(main+0x41b) [0x5555555770cb] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b75b43d9b54] -> imap [0x55555556a6e9] dovecot: Jul 02 11:39:34 Error: child 22307 (imap) killed with signal 6 dovecot: Jul 02 11:39:34 Error: IMAP(neko(a)it4u.lv): Transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: marked corrupted dovecot: Jul 02 12:13:21 Warning: IMAP(neko(a)it4u.lv): Unlinked a duplicate: 1214989937.P31578Q0M123879.serv09,S=4899:2, dovecot: Jul 02 12:48:57 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19209, but next_uid = 19210 dovecot: Jul 02 12:48:57 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19209, but next_uid = 19210 dovecot: Jul 02 12:48:57 Error: IMAP(neko(a)it4u.lv): Unexpected transaction log desync with index /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index dovecot: Jul 02 12:48:57 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19209, but next_uid = 19210 dovecot: Jul 02 12:48:57 Error: IMAP(neko(a)it4u.lv): Transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: marked corrupted dovecot: Jul 02 12:48:59 Error: IMAP(neko(a)it4u.lv): Maildir /srv/vmail/it4u.lv/neko/.Listservers.Tech.Dovecot sync: UID inserted in the middle of mailbox (19210 > 19209, file = 1214992136.P29477Q0M844419.serv09,S=6950:2,) dovecot: Jul 02 12:51:00 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: invalid indexid (1214992140 != 1214987242) dovecot: Jul 02 12:51:00 Warning: IMAP(neko(a)it4u.lv): fscking index file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index dovecot: Jul 02 12:51:00 Error: IMAP(neko(a)it4u.lv): Transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: marked corrupted dovecot: Jul 02 12:51:00 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: invalid new transaction log sequence (5 >= 5) dovecot: Jul 02 12:51:00 Warning: IMAP(neko(a)it4u.lv): fscking index file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index dovecot: Jul 02 12:51:00 Error: IMAP(neko(a)it4u.lv): file mail-transaction-log-view.c: line 107 (mail_transaction_log_view_set): assertion failed: (min_file_seq <= max_file_seq) dovecot: Jul 02 12:51:00 Error: IMAP(neko(a)it4u.lv): Raw backtrace: imap [0x5555555bd66e] -> imap [0x5555555bd3ae] -> imap(mail_transaction_log_view_set+0x3b3) [0x5555555aba23] -> imap [0x5555555a6d1f] -> imap(mail_index_view_sync_begin+0x3f3) [0x5555555a73d3] -> imap(index_mailbox_sync_init+0xa1) [0x555555595fc1] -> imap(imap_sync_init+0x56) [0x555555575756] -> imap(cmd_sync+0x7b) [0x55555557588b] -> imap [0x55555556bb12] -> imap(cmd_fetch+0x28d) [0x55555556be1d] -> imap(cmd_uid+0x4a) [0x55555556e9ba] -> imap [0x55555556eec7] -> imap [0x55555556ef59] -> imap(_client_input+0x6f) [0x55555556f5ff] -> imap(io_loop_handler_run+0x108) [0x5555555c2ea8] -> imap(io_loop_run+0x18) [0x5555555c2068] -> imap(main+0x41b) [0x5555555770cb] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b733287bb54] -> imap [0x55555556a6e9] dovecot: Jul 02 12:51:00 Error: child 4479 (imap) killed with signal 6 dovecot: Jul 02 12:51:00 Error: IMAP(neko(a)it4u.lv): Transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: marked corrupted dovecot: Jul 02 14:11:40 Warning: IMAP(neko(a)it4u.lv): Unlinked a duplicate: 1214987033.P23952Q0M811113.serv09,S=4807:2,S dovecot: Jul 04 12:25:20 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19272, but next_uid = 19273 dovecot: Jul 04 12:25:20 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19272, but next_uid = 19273 dovecot: Jul 04 12:25:20 Error: IMAP(neko(a)it4u.lv): Corrupted transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: Append with UID 19272, but next_uid = 19273 dovecot: Jul 04 12:25:21 Error: IMAP(neko(a)it4u.lv): Transaction log file /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index.log: marked corrupted dovecot: Jul 04 12:25:21 Error: IMAP(neko(a)it4u.lv): Transaction log got desynced for index /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index dovecot: Jul 04 12:25:23 Warning: IMAP(neko(a)it4u.lv): Unlinked a duplicate: 1215162799.P18322Q0M736352.serv09,S=13262:2, dovecot: Jul 04 12:25:23 Error: IMAP(neko(a)it4u.lv): Transaction log got desynced for index /srv/vmail/.cache/it4u.lv/neko/.Listservers.Tech.Dovecot/dovecot.index dovecot: Jul 04 12:25:28 Error: IMAP(neko(a)it4u.lv): Maildir /srv/vmail/it4u.lv/neko/.Listservers.Tech.Dovecot sync: UID inserted in the middle of mailbox (19273 > 19272, file = 1215163520.P28321Q0M199676.serv09,S=3477:2,) -------end of log ---

2 4

[Dovecot] Multiple auth client sockets
by Ulrich Zehl 20 Jul '08

20 Jul '08

I use two seperate Postfix instances as MSAs (so that different policies are simpler to configure), and both of them require Dovecot SASL support. Since Postfix' smtpd is chrooted (at least in the Debian package), the client socket needs to be somewhere under the instance's queue_directory. This means I need two different auth client socket paths. When I simply specify two "client { ... }" in dovecot.conf, the second takes precedence over the first. Besides using a second dovecot instance, which I'd like to avoid, what ways are there to run a second client socket? Ulrich

2 1

[Dovecot] [Help] quota_rule with LDAP backend, dovecot-1.1.1
by Zhang Huangbin 20 Jul '08

20 Jul '08

Hi, all. I use dovecot-1.1.1 with OpenLDAP as userdb. but i failed to convert quota value as expect. I set '10' as mail quota, and it should be '10M' as expect, but it's not effect, dovecot always uses 'quota_rule' setting in dovecot.conf. How can i fix this issue? 10*1047576? I have 'mailQuota' attr in ldap schema, such as: ----8<---- mailQuota: 10 # <- 10M ----8<---- My dovecot-ldap.conf: ----8<---- user_attrs = homeDirectory=home,mailMessageStore=maildir:mail,mailQuota=quota_rule=*:bytes=%$ ----8<---- And my dovecot.conf: ----8<---- plugin { quota = maildir # Quota rules. quota_rule = *:storage=10M } ----8<---- -- Best Regards. Zhang Huangbin - iRedMail: Mail Server Solution for Red Hat(R) Enterprise Linux & CentOS 5.x: http://iRedMail.googlecode.com/

2 1

[Dovecot] configuration query
by Michael Mounteney 20 Jul '08

20 Jul '08

Hello, please excuse my asking a question about simple configuration rather than something about a suspected bug or other detailed enquiry. I've set up dovecot (1.0.13, from http://www.blastwave.org) and when Thunderbird connects to it, all is well and I see folders as expected. When MacOS X mail connects however, it sees my home directory on the dovecot machine, not the mail directory. Now setting-aside the obvious rant about why MacOS has to be gratuitously different *again*, I would like to configure dovecot not to serve my home directory. I keeping saying I/my as this is just a personal set-up at home. This IMAP stuff is a bit involved but I thought namespaces would be the answer but it seems not. That is, I have namespace private { location = /var/marchive/%u inbox = yes } but even this still allows Mac Mail to see the home directory. What else should I do to stop dovecot serving my home directory ? I realise that there is also a problem with the client, that Mac Mail is *asking for* my home directory rather than the mail folder, but that's another problem, not for this list. Thanks in expectation.

2 1

[Dovecot] BUG: messages created with permissions not respecting umask
by Thomas Vander Stichele 20 Jul '08

20 Jul '08

Using dovecot 1.0rc15, together with postfix and dovecot-lda. umask is set to 0007. This should ensure directories and files get created with read/write permissions for both user and group. However, dovecot-lda writes files with 600 permissions, instead of 660. So dovecot does not seem to respect the umask configuration property for local mail delivery. In my particular case, I have vmail:vmail own the mail directories, and a backup user part of the vmail group. However the backup user cannot read the mails and thus back them up properly. Suggestions: - respect the umask for file delivery as well - alternatively, take the parent directory's permissions, strip executable bits, and apply to file Thanks Thomas

3 3

[Dovecot] Run script before delivery
by Juan Asensio Sánchez 20 Jul '08

20 Jul '08

Hi Is it possible to run one script before the "real" delivery of a message (with lda, or before the execution of the sieve scripts) but after the creation of necessary folders (Dovecot automatically creates the folders for virtual users)? I want to to this to manually create a fixed empty sieve script in each user home folder, so in the global sieve script include that personal script, because if personal script doesn't exists, global script is not executed, or am I wrong? Thanks in advance.

3 2

[Dovecot] Need suggestion regarding index file and Quota settings.
by Tim Chen 20 Jul '08

20 Jul '08

Dear All, My system has about 30,000 accounts and these accounts are created as unix system users. Each account has its own entry in /etc/passwd with different UID and home directory. We plan to deploy an Layer 4 switch as a load balancer. Proposed architecure is as the following: ---- internet ---- Layer 4 switch ---- mail server1 ---- NFS storage | | |--- mail server2 -----| Both mail servers will share the same storage which contains users' home with Maildir inside. Dovecot will be installed on the mail servers serving pop3 and imap4 protocols. Since the layer 4 switch will direct connection to backend mail server in random(or some of its algorithm), users can not guarantee which mail server to use. My first question is which kind of INDEX settings should I apply? 1) INDEX=MEMORY 2) INDEX=/nfs/%u 3) INDEX=/var/spool/%u Will INDEX stored on disk outperform INDEX stored in memory? If INDEX stored on NFS storage, we can be sure the consistency of INDEX file, but what about the performance and locking problem? If INDEX stored on local disk, since users may connect to different mail servers every time. Will that impose the problem of inconsistency? What kind of syndrome will happen if the INDEX became inconsistent to real maildir content? My second question is about quota. We use maildir as mail storage format. Our users were divided into 3-4 groups, each group of users with different quota size ranging from 100MB - 1G. To my best knowledge, dovecot's quota setting in config file supports only "one global configuration". (We are not using db, we use only /etc/passwd). dovecot.conf quota_rule = *:storage=10MB Since dovecot supports both fs and maildir++ quota, I would like to ask for your suggestion: 1. Should I use system quota instead? How about the comparision of performance? Is there any drawback/limitation using system quota? 2. Is there any settings of dovecot that could fullfil my situation? 3. My thought is to modify dovecot.conf, comment out quota_rule = *:storage=10MB and leave only the quota = maildir in the plugin { block. According to my experiment, dovecot will read the maildirsize file under user's home. Then I have to set the maildirsize file for every user individually! It seems to be a little crappy but works. Looking for your valuable suggestions! Thanks very much. Tim Chen

3 2

[Dovecot] Is it ok to upgrade to 1.1?
by Bjørn T Johansen 19 Jul '08

19 Jul '08

Or is it some issues left that need to be sorted out? Regards, BTJ -- ----------------------------------------------------------------------------------------------- Bjørn T Johansen btj(a)havleik.no ----------------------------------------------------------------------------------------------- Someone wrote: "I understand that if you play a Windows CD backwards you hear strange Satanic messages" To which someone replied: "It's even worse than that; play it forwards and it installs Windows" -----------------------------------------------------------------------------------------------

3 3

[Dovecot] OT: Deleting email
by Mauricio Tavares 19 Jul '08

19 Jul '08

I have a mail server running postfix and then using dovecot so others can reach it using imap. I go check mail using thunderbird and delete a few emails, emptying the trash afterwards. Then I quit it and access it using pine. The deleted emails are still there, marked as marked for deletion. I delete a few other emails within pine and quit. It asks to delete the marked emails, I tell go for it, and it does. When I go back to THunderbird all those emails are gone. Next I tell thunderbird to mark certain messages as spam and delete email I marked as spam. I quit it and go back to pine. The spam marked messages which thunderbird swore were deleted are still there. THis really does not seem to be a dovecot issue, but has someone seen that happen? If so, what is going on?

2 1