- dovecot - dovecot.org

[Dovecot] Distributed indexes, maildir_copy_preserve_filename, and Microsoft
by Jack Stewart 22 Aug '08

22 Aug '08

Hi, I've just completed a migration from Courier to a Dovecot 1.0.7 (patched RHE 5) which is working great, except for this weirdness of an issue that is impacting a handful of users. My question is that will turning off maildir_copy_preserve_filename help or hurt in a situation where there are multiple servers with their own local INDEX files (uidlist is shared)? The problem is that a few users on a few versions of Microsoft Mail clients are not showing a few messages. They can see the messages just fine in webmail and other, more typical, E-mail clients. I know that the right solution is to upgrade to 1.1.2 and use shared indexes. The plan is to upgrade in a month or so. In my defense, this setup was not of my making, The two things issues that might have an impact are that we have shared (NFS) maildirs on multiple servers with their own local indexes and maildir_copy_preserve_file turned on. The uidlist (CONTROL) is shared and we have sticky connections turned on in our load balancer. The vast majority of clients do not have this issue. Quite frankly I have no idea these clients are ignoring the dovecot-uidlist. Would turning off maildir_copy_preserve_filename help with this setup? Another option might be easier is to delete the users INDEX and let the clients rebuild them. Since this is only a handful of users and we are migrating to 1.1.2 anyway, my preference is to make the bare minimum of changes to help address this problem. The changes need not be perfect nor anytime more than a suggestion or preference. I just want to make things better for a little while. Many thanks in advance. ---Jack P.S. The performance improvement is amazing - anywhere from 2X to 12X depending on what metrics you are looking at. It isn't an apples to apples comparison since we upgraded the servers as well but the "old" servers are pretty powerful beasts. -- Jack Stewart jstewart(a)caltech.edu / 626-395-4690 http://www.imss.caltech.edu

1 0

[Dovecot] Option to evaluate IMAP prefixes relative to $HOME, rather than the IMAP root?
by David McBride 22 Aug '08

22 Aug '08

Greetings, Is there a mechanism (or relatively small source-code change) which would cause Dovecot to evaluate IMAP prefixes relative to $HOME rather than the configured IMAP root? * * * Background: We're currently migrating from a WU-IMAP mailserver configuration which stores user mail in a global NFS-exported $HOME, and we've run into well-known issues handling client-specified IMAP prefixes. If a user specifies an IMAP prefix, Dovecot evaluates the path given relative to the IMAP root path specified in mail_location, rather than resolving it relative to the user's home directory as our old WU-IMAP installation would do. (For example: if a user has been keeping their mail in $HOME/foobar, and mail_location's folder path is set to %h/mail, then when that user comes to retrieve their mail with an IMAP prefix set to "~/foobar", then Dovecot will attempt to return the contents of the folder $HOME/mail/~/foobar -- which doesn't exist -- rather than $HOME/foobar.) At the moment, we have several hidden namespaces set up to support various common user-side variations -- "mail/", "Mail/", "~/Mail/", etc. -- each with a different custom mail_location string. Whilst this works for these common cases, it's fairly ugly, and results in extra empty directories appearing in users' $HOME. If there was some mechanism for telling Dovecot to evaluate IMAP prefixes relative to $HOME rather than the mail folder root specified in mail_location, that would provide us with a much neater and general-purpose solution. (I was hoping that setting full_filesystem_access=yes would do this, but it only relaxes the normal access permissions.) Cheers, David -- David McBride <dwm(a)tastycake.net>

2 1

[Dovecot] Dovecot not compiling with pam
by Jorge Ruao 22 Aug '08

22 Aug '08

Hi, I'm new here in the list so Hello to everyone! I'm compiling dovecot 1.0.10 with pam support in SLES 9 but i'm getting errors in config.log and it won't compile with pam support. Here are the results: s1:~/dovecot-1.0.10# ./configure --with-pam | grep pam checking for pam_start in -lpam... no and in config.log: configure:28830: checking for pam_start in -lpam configure:28865: gcc -o conftest -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast conftest.c -lpam >&5 /usr/lib/gcc-lib/i586-suse-linux/3.3.3/../../../../i586-suse-linux/bin/ld: cannot find -lpam I have all libpam libraries in /lib and ldconfig is giving ok: s1:~/dovecot-1.0.10# ldconfig -v | grep pam libpam.so.0 -> libpam.so.0.77 libpam_misc.so.0 -> libpam_misc.so.0.77 libpamc.so.0 -> libpamc.so.0.77 Any help or directions would be great! Thanks, Jorge

2 2

[Dovecot] assertion failed
by CJ Keist 22 Aug '08

22 Aug '08

I haven't heard anything on this bug. Is this a bug? I'm using dovecot 1.1.2 with the following patch applied: http://hg.dovecot.org/dovecot-1.1/rev/d674c05d725d Another section from my logs. I know the backtrace is just numbers, let me know how to compile to get more useful information if you need it. So far no one is beating down my door, so I don't think users are seeing any ill effects. But I would sleep better knowing why it's happening. Aug 21 16:19:17 goku dovecot: [ID 107833 mail.crit] Panic: IMAP(rhjohn): file index-sync.c: line 39 (index_mailbox_set_recent_uid): assertion failed: (seq_range_exists(&ibox->recent_flags, uid))Aug 21 16:19:17 goku dovecot: [ID 107833 mail.error] IMAP(rhjohn): Raw backtrace: 0x95f98 -> 0x959f8 -> 0x6278c -> 0x627d0 -> 0x48d14 -> 0x4981c -> 0x41db0 -> 0x72378 -> 0x637d8 -> 0x66200 -> 0x22594 -> 0x266f8 -> 0x277ec -> 0x277a8 -> 0x27b04 -> 0x27d04 -> 0x9d3f4 -> 0x9ccd4 -> 0x2ff58 -> 0x21398 Aug 21 16:19:17 goku dovecot: [ID 684838 mail.error] child 4805 (imap) killed with signal 6 Aug 21 16:19:17 goku postfix/smtpd[3421]: [ID 197553 mail.info] connect from unknown[190.152.60.9] Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] auth(default): client in: AUTH 1 PLAIN service=imap secured lip=129.82.224.16 rip=129.82.53.12 lport=993 rport=49269 Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] auth(default): client out: CONT 1 Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] auth(default): client in: CONT<hidden> Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] auth-worker(default): pam(rhjohn,129.82.53.12): lookup service=dovecot Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] auth-worker(default): pam(rhjohn,129.82.53.12): #1/1 style=1 msg=Password: Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] auth(default): client out: OK 1 user=rhjohn Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] auth(default): master in: REQUEST 45963 6520 1 Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] auth-worker(default): passwd(rhjohn,129.82.53.12): lookup Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] auth(default): master out: USER 45963 rhjohn system_user=rhjohn uid=19615 gid=21 home=/top/academic/Atmos/people/rhjohn/home Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] imap-login: Login: user=<rhjohn>, method=PLAIN, rip=129.82.53.12, lip=129.82.224.16, TLS Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] auth(default): client in: AUTH 1 PLAIN service=imap lip=129.82.224.16 rip=67.223.73.37 lport=143 rport=54470 resp=<hidden> Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] auth-worker(default): pam(dvivanco,67.223.73.37): lookup service=dovecot Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] auth-worker(default): pam(dvivanco,67.223.73.37): #1/1 style=1 msg=Password: Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] IMAP(rhjohn): Effective uid=19615, gid=21, home=/top/academic/Atmos/people/rhjohn/home Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] IMAP(rhjohn): mbox: data=/top/academic/Atmos/people/rhjohn/home/:INBOX=/userM/mail/rhjohn Aug 21 16:19:17 goku dovecot: [ID 107833 mail.info] IMAP(rhjohn): fs: root=/top/academic/Atmos/people/rhjohn/home, index=, control=, inbox=/userM/mail/rhjohn -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I just switched over to dovecot 1.1.2 on our live system last night. I'm seeing the following errors in the logs: Aug 19 10:01:03 goku dovecot: [ID 107833 mail.crit] Panic: IMAP(elevin): file in dex-sync.c: line 39 (index_mailbox_set_recent_uid): assertion failed: (seq_range _exists(&ibox->recent_flags, uid)) I did apply the assertion fix that Timo sent out. # 1.1.2: /userM/mail-services/dovecot/etc/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 3072). Either grow the limit or change login_max_processes_count and max_mail_processes settings base_dir: /userM/mail-services/dovecot/var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /userM/mail-services/dovecot/etc/ssl/dovecot.pem ssl_key_file: /userM/mail-services/dovecot/etc/ssl/privkey.pem ssl_parameters_regenerate: 0 ssl_cipher_list: MEDIUM:!LOW disable_plaintext_auth: no login_dir: /userM/mail-services/dovecot/var/run/dovecot/login login_executable(default): /userM/mail-services/dovecot/libexec/dovecot/imap-login login_executable(imap): /userM/mail-services/dovecot/libexec/dovecot/imap-login login_executable(pop3): /userM/mail-services/dovecot/libexec/dovecot/pop3-login login_greeting: Cyrus ready. login_max_processes_count: 1024 max_mail_processes: 1024 mail_location: mbox:~/:INBOX=/userM/mail/%u mail_debug: yes mmap_disable: yes mail_nfs_index: yes mail_executable(default): /userM/mail-services/dovecot/libexec/dovecot/imap mail_executable(imap): /userM/mail-services/dovecot/libexec/dovecot/imap mail_executable(pop3): /userM/mail-services/dovecot/libexec/dovecot/pop3 mail_plugin_dir(default): /userM/mail-services/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /userM/mail-services/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /userM/mail-services/dovecot/lib/dovecot/pop3 auth default: mechanisms: plain login verbose: yes debug: yes passdb: driver: pam passdb: driver: passwd args: blocking=yes userdb: driver: passwd args: blocking=yes socket: type: listen client: path: /var/lib/postfix/private/auth mode: 438 user: postfix group: postfix master: path: /userM/mail-services/dovecot/var/run/dovecot//auth-master mode: 384 - -- C. J. Keist Email: cj.keist(a)colostate.edu UNIX/Network Manager Phone: 970-491-0630 Engineering Network Services Fax: 970-491-5569 College of Engineering, CSU Ft. Collins, CO 80523-1301 All I want is a chance to prove 'Money can't buy happiness' -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIqvAiA29OFr7C6jcRAlbPAJsHSPO0JvyUHGOBUJ1E8NhuT9tM5wCgnOZ2 NW9OeL6tSORhGleWSX63uPI= =mw7Z -----END PGP SIGNATURE-----

2 3

[Dovecot] Dovecot from inetd, when it playing like LDA also
by mike＠mrgfd.org.ua 22 Aug '08

22 Aug '08

Hello Dovecot guys! I want to play with dovecot login processes invoked from inetd superserver, but cannot run auth worker for postfix sasl and deliver process in this case. Any ideas? WBR, mike

1 1

[Dovecot] Few problem with pop3
by Roberto Tagliaferri - Tosnet srl 22 Aug '08

22 Aug '08

Hi, i've upgraded from 1.0.5 to 1.1.2 on 2 server and work fine for user that grab email on client, but some customer (that leave the email on server) have 2 problems. Some client can't read new mail: dovecot: Aug 19 11:00:46 Info: pop3-login: Login: user=<agenzia>, method=PLAIN, rip=xxx, lip=91.102.48.12 dovecot: Aug 19 11:00:46 Info: POP3(agenzia): Disconnected: Logged out top=0/0, retr=0/0, del=0/21, size=1200006 dovecot: Aug 19 11:01:22 Info: pop3-login: Login: user=<agenzia>, method=PLAIN, rip=xxx, lip=91.102.48.12 dovecot: Aug 19 11:01:23 Info: POP3(agenzia): Disconnected: Logged out top=0/0, retr=0/0, del=0/22, size=1219860 dovecot: Aug 19 11:04:21 Info: pop3-login: Login: user=<agenzia>, method=PLAIN, rip=xxx, lip=91.102.48.12 dovecot: Aug 19 11:04:22 Info: POP3(agenzia): Disconnected: Logged out top=0/0, retr=0/0, del=0/25, size=1277510 other client reread old email dovecot: Aug 18 13:09:30 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=1/9885, del=0/28, size=270604 dovecot: Aug 18 13:21:15 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=1/9885, del=0/28, size=270604 dovecot: Aug 18 16:06:10 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=1/1218, del=0/28, size=270604 dovecot: Aug 18 16:09:08 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=1/1218, del=0/28, size=270604 dovecot: Aug 18 17:09:49 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=1/2479, del=0/29, size=298926 dovecot: Aug 18 17:12:18 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=2/2513, del=0/29, size=298926 dovecot: Aug 18 17:32:59 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=1/1321, del=0/29, size=298926 dovecot: Aug 18 17:58:46 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=1/1321, del=0/29, size=298926 Dovecot on linux, ext3 fs (the 2 server is similar, one with real users and one with virtual users on pgsql), only pop3 (with mbox file) root@mx:~# dovecot -n # 1.1.2: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/poplog info_log_path: /var/log/poplog protocols: pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/pop3-login login_processes_count: 4 verbose_proctitle: yes mail_access_groups: mail mail_location: mbox:/var/empty:INBOX=/var/spool/mail/%u:INDEX=MEMORY mail_executable: /usr/local/libexec/dovecot/pop3 mail_plugin_dir: /usr/local/lib/dovecot/pop3 pop3_client_workarounds: oe-ns-eoh outlook-no-nuls auth default: mechanisms: plain login verbose: yes passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postdrop root@smtp:~# dovecot -n # 1.1.2: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/poplog info_log_path: /var/log/poplog protocols: pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/pop3-login login_processes_count: 4 verbose_proctitle: yes mail_access_groups: mail mail_location: mbox:/var/empty:INBOX=/var/spool/mail/%u:INDEX=MEMORY mail_executable: /usr/local/libexec/dovecot/pop3 mail_plugin_dir: /usr/local/lib/dovecot/pop3 pop3_client_workarounds: oe-ns-eoh outlook-no-nuls auth default: mechanisms: plain login verbose: yes passdb: driver: shadow userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postdrop -- Roberto Tagliaferri Responsabile Progettazione & Produzione TosNet s.r.l. - Internet Service Provider r.tagliaferri(a)tosnet.it www.tosnet.it

2 5

Re: [Dovecot] dovecot-antispam has some kind of bug
by Johannes Berg 22 Aug '08

22 Aug '08

> My dspam users has the email as username somthing(a)domain.com and in > dovecot.conf i need to specify the user when training, is there a > way to get the resiptient address in the dovecot.conf? i am only able to > get %u ie the username ;-( > > Could you patch the antispam plugin to be able to take then resiptient > as dspam user? ie the mail address , you can have a option in dovecot > that says use resiptient address as user or something > > it would be great if you had time to check this out ;-) TBH, I don't, and I also don't see why you'd need the recipient address, can't you just build it like %u@%d or %u(a)example.com or something? johannes

2 9

[Dovecot] dovecot-antispam: Failed to read mail beginning, Next message unexpectedly lost
by Jiri Novosad 22 Aug '08

22 Aug '08

Hello, I'm trying to configure the dovecot-antispam plugin. Now I've run into a problem: whenever I try to move/copy a message in/from the spam mailbox, Thunderbird (and also Sylpheed, haven't tried anything else) says: The current command did not succeed. The mail server responded: Failed to read mail beginning. and in the logs I get: dovecot: Aug 07 10:41:23 Error: IMAP(username): Next message unexpectedly lost from 337928 dovecot: Aug 07 10:41:23 Error: IMAP(username): Next message unexpectedly lost from 337928 The message is not moved/copied. My config (dovecot -n): base_dir: /var/run/dovecot_test/ log_path: /var/log/dovecot/test_log info_log_path: /var/log/dovecot/test_info_log protocols: pop3s imaps pop3 imap listen(default): *:10143 listen(imap): *:10143 listen(pop3): *:10110 ssl_listen(default): *:10993 ssl_listen(imap): *:10993 ssl_listen(pop3): *:10995 ssl_cert_file: /etc/ssl/anxur.pem ssl_key_file: /etc/ssl/anxur.pem ssl_parameters_regenerate: 24 login_dir: /var/run/dovecot_test/login login_executable(default): /packages/run.64/dovecot-1.1.2/libexec/dovecot/imap-login login_executable(imap): /packages/run.64/dovecot-1.1.2/libexec/dovecot/imap-login login_executable(pop3): /packages/run.64/dovecot-1.1.2/libexec/dovecot/pop3-login login_greeting: HI! login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:/home/%u/mail/:INBOX=/var/mail/%u:INDEX=/home/%u/mail/.imap mail_debug: yes mail_full_filesystem_access: yes maildir_copy_with_hardlinks: no mbox_write_locks: fcntl mbox_dirty_syncs: no mbox_lazy_writes: no dbox_rotate_days: 0 mail_executable(default): /packages/run.64/dovecot-1.1.2/libexec/dovecot/imap mail_executable(imap): /packages/run.64/dovecot-1.1.2/libexec/dovecot/imap mail_executable(pop3): /packages/run.64/dovecot-1.1.2/libexec/dovecot/pop3 mail_plugins(default): antispam mail_plugins(imap): antispam mail_plugins(pop3): mail_plugin_dir(default): /packages/run.64/dovecot-1.1.2/lib/dovecot/imap mail_plugin_dir(imap): /packages/run.64/dovecot-1.1.2/lib/dovecot/imap mail_plugin_dir(pop3): /packages/run.64/dovecot-1.1.2//lib/dovecot/pop3 mail_log_max_lines_per_sec: 20 imap_max_line_length(default): 131072 imap_max_line_length(imap): 131072 imap_max_line_length(pop3): 65536 imap_client_workarounds(default): delay-newmail outlook-idle tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %08Xv%08Xu pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: gssapi plain executable: /packages/run.64/dovecot-1.1.2/libexec/dovecot/dovecot-auth krb5_keytab: /etc/krb5.imap verbose: yes debug: yes passdb: driver: pam args: dovecot userdb: driver: passwd plugin: antispam_spam: mailbox.spam antispam_trash: trash;Trash;Deleted Items antispam_mail_spam: spam(a)mysite.org antispam_mail_notspam: notspam(a)mysite.org antispam_mail_sendmail: /home/username/fake_sendmail Dovecot is version 1.1.2, dovecot-antispam is the latest snapshot. Running on Red Hat Enterprise Linux Server release 5.2, x86_64, filesystem is ext3 (on lvm). Attached is the strace -p of the session. The code seems to be this in i_stream_raw_mbox_read: if (stream->istream.v_offset - rstream->hdr_offset + new_pos > rstream->mail_size) { /* istream_raw_mbox_set_next_offset() used invalid cached next_offset? */ i_error("Next message unexpectedly lost from %"PRIuUOFF_T, rstream->hdr_offset + rstream->mail_size); rstream->eof = TRUE; rstream->corrupted = TRUE; return -1; } If I comment it out (after I backup my mail), everything seems to work as expected. Jiri Novosad epoll_wait(6, {{EPOLLIN, {u32=7035872, u64=7035872}}}, 4, 492) = 1 gettimeofday({1218008692, 930362}, NULL) = 0 gettimeofday({1218008692, 930446}, NULL) = 0 read(0, "452 uid copy 4 \"mailbox.", 24) = 24 gettimeofday({1218008692, 930610}, NULL) = 0 epoll_wait(6, {{EPOLLIN, {u32=7035872, u64=7035872}}}, 4, 423) = 1 gettimeofday({1218008692, 930806}, NULL) = 0 gettimeofday({1218008692, 930903}, NULL) = 0 read(0, "spam\"\r\n", 4087) = 7 stat("/home/username/mail/mailbox.spam", {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 stat("/home/username/mail/mailbox.spam", {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 stat("/home/username/mail/.imap/.imap/mailbox.spam", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 gettimeofday({1218008692, 931707}, NULL) = 0 access("/home/username/mail/mailbox.spam", R_OK|W_OK) = 0 open("/home/username/mail/.imap/.imap/mailbox.spam/dovecot.index.log", O_RDWR) = 10 fstat(10, {st_mode=S_IFREG|0600, st_size=10908, ...}) = 0 pread(10, "\1\0\30\0\373\264\226H\4\0\0\0\3\0\0\0\364\334\0\0|\"\230H", 24, 0) = 24 stat("/home/username/mail/.imap/.imap/mailbox.spam/dovecot.index.log.2", 0x7fffd3bb6f50) = -1 ENOENT (No such file or directory) open("/home/username/mail/.imap/.imap/mailbox.spam/dovecot.index", O_RDWR) = 11 alarm(120) = 0 fcntl(11, F_SETLKW, {type=F_RDLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0) = 120 fstat(11, {st_mode=S_IFREG|0600, st_size=1136, ...}) = 0 pread(11, "\7\2x\0x\1\0\0(\0\0\0\1\0\0\0\373\264\226H\0\0\0\0\373\264\226H\232\10\0\0"..., 4096, 0) = 1136 fcntl(11, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 stat("/home/username/mail/.imap/.imap/mailbox.spam/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=10908, ...}) = 0 fstat(10, {st_mode=S_IFREG|0600, st_size=10908, ...}) = 0 pread(10, "\200\200\200\204 \0\0\20P\0\4\0\322P\231H\200\200\200\204 \0\0\0200\0\4\0\232\10\0\0"..., 1024, 10204) = 704 pread(10, "", 1024, 10908) = 0 mkdir("/tmp/antispam-mail-GYlEb4", 0700) = 0 mkdir("/tmp/antispam-mail-Rb3HAN", 0700) = 0 gettimeofday({1218008692, 933917}, NULL) = 0 gettimeofday({1218008692, 934014}, NULL) = 0 stat("/home/username/mail/sent-mail", {st_mode=S_IFREG|0644, st_size=2143, ...}) = 0 gettimeofday({1218008692, 934308}, NULL) = 0 alarm(5) = 0 fcntl(19, F_SETLKW, {type=F_RDLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0) = 5 stat("/home/username/mail/sent-mail", {st_mode=S_IFREG|0644, st_size=2143, ...}) = 0 stat("/home/username/mail/.imap/.imap/sent-mail/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fstat(8, {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fstat(19, {st_mode=S_IFREG|0644, st_size=2143, ...}) = 0 pread(19, "\nFrom popel(a)mysite.org Thu Jul "..., 4096, 551) = 1592 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/home/username/mail/.imap/.imap/sent-mail/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fstat(8, {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 gettimeofday({1218008692, 935474}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 71, MSG_NOSIGNAL, NULL, 0) = 71 gettimeofday({1218008692, 936290}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 67, MSG_NOSIGNAL, NULL, 0) = 67 gettimeofday({1218008692, 937117}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 70, MSG_NOSIGNAL, NULL, 0) = 70 gettimeofday({1218008692, 937848}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 74, MSG_NOSIGNAL, NULL, 0) = 74 gettimeofday({1218008692, 938501}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 66, MSG_NOSIGNAL, NULL, 0) = 66 gettimeofday({1218008692, 939236}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 69, MSG_NOSIGNAL, NULL, 0) = 69 gettimeofday({1218008692, 939981}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 68, MSG_NOSIGNAL, NULL, 0) = 68 gettimeofday({1218008692, 940611}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 87, MSG_NOSIGNAL, NULL, 0) = 87 gettimeofday({1218008692, 941375}, NULL) = 0 gettimeofday({1218008692, 941511}, NULL) = 0 open("/home/username/mail/mailbox.spam", O_RDWR) = 12 fstat(12, {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 gettimeofday({1218008692, 941777}, NULL) = 0 alarm(5) = 0 fcntl(12, F_SETLKW, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0) = 5 stat("/home/username/mail/mailbox.spam", {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 stat("/home/username/mail/mailbox.spam", {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 alarm(180) = 0 fcntl(10, F_SETLKW, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0) = 180 stat("/home/username/mail/.imap/.imap/mailbox.spam/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=10908, ...}) = 0 fstat(10, {st_mode=S_IFREG|0600, st_size=10908, ...}) = 0 fcntl(10, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 stat("/home/username/mail/.imap/.imap/mailbox.spam/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=10908, ...}) = 0 fstat(10, {st_mode=S_IFREG|0600, st_size=10908, ...}) = 0 fstat(12, {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 lseek(12, 140168, SEEK_SET) = 140168 read(12, "\n", 1) = 1 fstat(12, {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 fstat(12, {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 pread(12, "\n", 4096, 140168) = 1 pread(12, "", 4095, 140169) = 0 pread(19, "Return-Path: <popel(a)mysite.org>\n"..., 4096, 600) = 1543 pread(19, "", 2553, 2143) = 0 pread(19, "", 2553, 2143) = 0 pread(19, "", 2553, 2143) = 0 write(12, "From popel(a)mysite.org Thu Jul 3"..., 1593) = 1593 pwrite(12, "\nContent-Length: 581", 20, 141159) = 20 creat("/tmp/antispam-mail-GYlEb4/0", 0600) = 13 lseek(13, 0, SEEK_CUR) = 0 fstat(13, {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 write(13, "\1\0\0\0", 4) = 4 pread(12, "From popel(a)mysite.org Thu Jul 3"..., 4095, 140169) = 1593 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 write(2, "\1ENext message unexpectedly lost"..., 45) = 45 pread(12, "\nFrom popel(a)mysite.org Thu Jul "..., 4096, 140168) = 1594 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 write(2, "\1ENext message unexpectedly lost"..., 45) = 45 close(13) = 0 close(13) = -1 EBADF (Bad file descriptor) rmdir("/tmp/antispam-mail-Rb3HAN") = 0 stat("/home/username/mail/.imap/.imap/sent-mail/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fstat(8, {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fcntl(19, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0) = 0 write(12, "\n", 1) = 1 ftruncate(12, 140169) = 0 fcntl(12, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0) = 0 unlink("/tmp/antispam-mail-GYlEb4/0") = 0 rmdir("/tmp/antispam-mail-GYlEb4") = 0 close(12) = 0 gettimeofday({1218008692, 946718}, NULL) = 0 write(1, "452 NO Failed to read mail begin"..., 38) = 38 gettimeofday({1218008692, 946937}, NULL) = 0 epoll_wait(6, {}, 4, 407) = 0 gettimeofday({1218008693, 353573}, NULL) = 0 gettimeofday({1218008693, 353660}, NULL) = 0 epoll_wait(6, {{EPOLLIN, {u32=7035872, u64=7035872}}}, 4, 5000) = 1 gettimeofday({1218008694, 161166}, NULL) = 0 gettimeofday({1218008694, 161210}, NULL) = 0 read(0, "453 IDLE\r\n", 4080) = 10 gettimeofday({1218008694, 161352}, NULL) = 0 inotify_add_watch(18, "/home/username/mail/sent-mail", IN_MODIFY|IN_CLOSE_WRITE|IN_CLOSE_NOWRITE|IN_MOVED_FROM|IN_MOVED_TO|IN_CREATE|IN_DELETE|IN_DELETE_SELF) = 123 epoll_ctl(6, EPOLL_CTL_ADD, 18, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=7144768, u64=7144768}}) = 0 stat("/home/username/mail/sent-mail", {st_mode=S_IFREG|0644, st_size=2143, ...}) = 0 gettimeofday({1218008694, 161636}, NULL) = 0 epoll_ctl(6, EPOLL_CTL_DEL, 0, {0, {u32=7035872, u64=7035872}}) = 0 epoll_ctl(6, EPOLL_CTL_ADD, 0, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=7035872, u64=7035872}}) = 0 gettimeofday({1218008694, 161895}, NULL) = 0 stat("/home/username/mail/sent-mail", {st_mode=S_IFREG|0644, st_size=2143, ...}) = 0 alarm(180) = 0 fcntl(8, F_SETLKW, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0) = 180 stat("/home/username/mail/.imap/.imap/sent-mail/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fstat(8, {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fcntl(8, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 mkdir("/tmp/antispam-mail-3WExWz", 0700) = 0 rmdir("/tmp/antispam-mail-3WExWz") = 0 stat("/home/username/mail/.imap/.imap/sent-mail/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fstat(8, {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 write(1, "+ idling\r\n", 10) = 10 gettimeofday({1218008694, 164036}, NULL) = 0 epoll_wait(6, {{EPOLLIN, {u32=7144768, u64=7144768}}}, 4, 4189) = 1 gettimeofday({1218008694, 164168}, NULL) = 0 read(18, "z\0\0\0\0\200\0\0\0\0\0\0\0\0\0\0", 32768) = 16 gettimeofday({1218008694, 164332}, NULL) = 0 gettimeofday({1218008694, 164400}, NULL) = 0 epoll_wait(6, ^C <unfinished ...>

3 7

[Dovecot] dovecot panic after upgrade 1.0.15 to 1.1.2
by Eric Rostetter 22 Aug '08

22 Aug '08

I recently upgraded dovecot from 1.0.15 to 1.1.2 and since then I am getting the following types of things in the logs: Aug 21 17:23:13 mail1 dovecot: imap-login: Login: user=<myuser>, method=PLAIN, rip=172.16.78.20, lip=172.16.78.22 Aug 21 17:24:01 mail1 dovecot: Panic: IMAP(myuser): file index-sync.c: line 39 (index_mailbox_set_recent_uid): assertion failed: (seq_range_exists(&ibox->recent_flags, uid)) Aug 21 17:24:01 mail1 dovecot: IMAP(myuser): Raw backtrace: imap [0x80d25bb] -> imap [0x80d2def] -> imap [0x80d2719] -> imap [0x809edb8] -> imap(index_mailbox_set_recent_seq+0x46) [0x809ee06] -> imap [0x8083183] -> imap [0x8083621] -> imap [0x8083c3c] -> imap(mbox_sync+0x25) [0x80840d5] -> imap [0x807b993] -> imap(mail_index_transaction_commit+0x51) [0x80aee31] -> imap(index_transaction_commit+0x52) [0x809fe32] -> imap(mailbox_transaction_commit_get_uids+0x34) [0x80a2874] -> imap(cmd_copy+0x16a) [0x805b19a] -> imap [0x806068e] -> imap [0x8060536] -> imap [0x80606ea] -> imap [0x8060791] -> imap(client_input+0x67) [0x8060897] -> imap(io_loop_handler_run+0x112) [0x80daa92] -> imap(io_loop_run+0x2f) [0x80d9e4f] -> imap(main+0x61) [0x8068d81] -> /lib/tls/libc.so.6(__libc_start_main+0xda) [0x12679a] -> imap(__fxstat64+0x6d) [0x8059ed1] Did I miss something in the upgrade process, or is this a bug that has yet to be fixed? This seems to be happening to many various users for various reasons. But I can verify for Andreas M. Kirchwitz who noted the other day that one of the easiest way to produce it seems to be "saving" or "moving" between folders in (Al)Pine... If Timo wants, I can send the dovecot.(index|index.cache|index.log) files for when this happens, but I would need to know what to send (both the folder being moved from and folder being moved to, or just one of them) and anything else needed, and the email to send them to. Sending the folder itself might be problematic, but might be possible. If we can't get this resolved by early next week, I might have to downgrade back to the previous version... -- Eric Rostetter The Department of Physics The University of Texas at Austin Go Longhorns!

2 5

[Dovecot] Simplest (static?) build & config for loopback access?
by FZiegler 22 Aug '08

22 Aug '08

I am installing Dovecot for the sole purpose of maintaining a local mail store that I could 1) manage with any client; 2) keep duplicated on several machines, using Unison; 3) hopefully, index using Spotlight (http://article.gmane.org/gmane.mail.mh-e.user/1308 ...). In particular, I have no intention to allow connections from anywhere but localhost. I've followed the instructions at http://wiki.dovecot.org/HowTo/Rootless and it all seems to work quite well, but I'm not sure about 3 things: 1) Initially Dovecot would not respond to Thunderbird ("Could not connect to server localhost; the connection was refused"). Eventually, a "Trying ::1..." in the telnet log (see below) made me find hidden pref "network.dns.disableIPv6" and set it to FALSE. Which solves the problem -- but is this really needed, or have I done something wrong? 2) The Dovecot I built on OS X 10.4 appears to work fine when copied on another Mac running 10.5. Now, I'd love to avoid installing developer tools on both machines, but I fear this an illusion (some libraries are changing under us, e.g. libiconv.2.2.0.dylib --> libiconv.2.4.0.dylib). Does this mean I should try a static build? If so, what are the flags and how do I go about specifying a minimal set of libraries to include for my purposes? 3) Probably offtopic here, but has anyone seen a better way to index mail in Spotlight than just as plain text? E.g. to hook up Apple's importer (Mail.mdimporter in /System/Library/Spotlight) or Thunderbird's (https://bugzilla.mozilla.org/show_bug.cgi?id=290057) which I guess can better deal with quoted-printable and other encodings? Thanks in advance; I include my compilation and config data below. Francois Z. ------------------ mini:~ fz$ curl -O http://www.dovecot.org/releases/1.1/dovecot-1.1.2.tar.gz mini:~ fz$ tar xzf dovecot-1.1.2.tar.gz mini:~ fz$ cd dovecot-1.1.2 mini:~/dovecot-1.1.2 fz$ ./configure --prefix=$HOME/sw mini:~/dovecot-1.1.2 fz$ make mini:~/dovecot-1.1.2 fz$ make install mini:~ fz$ cd mini:~ fz$ sw/sbin/dovecot Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 640). Either grow the limit or change login_max_processes_count and max_mail_processes settings mini:~ fz$ telnet localhost 10143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK Dovecot ready. . login fz ******** . OK Logged in. . list "" * * LIST (\HasNoChildren) "." "Drafts" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "INBOX" . OK List completed. . logout * BYE Logging out . OK Logout completed. Connection closed by foreign host. mini:~ fz$ sw/sbin/dovecot -n # 1.1.2: /Volumes/Home/FZ/sw/etc/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 640). Either grow the limit or change login_max_processes_count and max_mail_processes settings log_path: /Volumes/Home/FZ/Library/Logs/Dovecot/error.log info_log_path: /Volumes/Home/FZ/Library/Logs/Dovecot/info.log listen: localhost:10143 ssl_disable: yes disable_plaintext_auth: no login_dir: /Volumes/Home/FZ/sw/var/run/dovecot/login login_executable: /Volumes/Home/FZ/sw/libexec/dovecot/imap-login login_user: fz login_chroot: no mail_location: maildir:~/Library/Maildir auth default: user: fz passdb: driver: passwd-file args: /Volumes/Home/FZ/sw/etc/dovecot.passwd userdb: driver: passwd mini:~ fz$

4 4