August 2008 - dovecot

[Dovecot] Few problem with pop3
by Roberto Tagliaferri - Tosnet srl 22 Aug '08

22 Aug '08

Hi, i've upgraded from 1.0.5 to 1.1.2 on 2 server and work fine for user that grab email on client, but some customer (that leave the email on server) have 2 problems. Some client can't read new mail: dovecot: Aug 19 11:00:46 Info: pop3-login: Login: user=<agenzia>, method=PLAIN, rip=xxx, lip=91.102.48.12 dovecot: Aug 19 11:00:46 Info: POP3(agenzia): Disconnected: Logged out top=0/0, retr=0/0, del=0/21, size=1200006 dovecot: Aug 19 11:01:22 Info: pop3-login: Login: user=<agenzia>, method=PLAIN, rip=xxx, lip=91.102.48.12 dovecot: Aug 19 11:01:23 Info: POP3(agenzia): Disconnected: Logged out top=0/0, retr=0/0, del=0/22, size=1219860 dovecot: Aug 19 11:04:21 Info: pop3-login: Login: user=<agenzia>, method=PLAIN, rip=xxx, lip=91.102.48.12 dovecot: Aug 19 11:04:22 Info: POP3(agenzia): Disconnected: Logged out top=0/0, retr=0/0, del=0/25, size=1277510 other client reread old email dovecot: Aug 18 13:09:30 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=1/9885, del=0/28, size=270604 dovecot: Aug 18 13:21:15 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=1/9885, del=0/28, size=270604 dovecot: Aug 18 16:06:10 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=1/1218, del=0/28, size=270604 dovecot: Aug 18 16:09:08 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=1/1218, del=0/28, size=270604 dovecot: Aug 18 17:09:49 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=1/2479, del=0/29, size=298926 dovecot: Aug 18 17:12:18 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=2/2513, del=0/29, size=298926 dovecot: Aug 18 17:32:59 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=1/1321, del=0/29, size=298926 dovecot: Aug 18 17:58:46 Info: POP3(soggiorno): Disconnected: Logged out top=0/0, retr=1/1321, del=0/29, size=298926 Dovecot on linux, ext3 fs (the 2 server is similar, one with real users and one with virtual users on pgsql), only pop3 (with mbox file) root@mx:~# dovecot -n # 1.1.2: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/poplog info_log_path: /var/log/poplog protocols: pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/pop3-login login_processes_count: 4 verbose_proctitle: yes mail_access_groups: mail mail_location: mbox:/var/empty:INBOX=/var/spool/mail/%u:INDEX=MEMORY mail_executable: /usr/local/libexec/dovecot/pop3 mail_plugin_dir: /usr/local/lib/dovecot/pop3 pop3_client_workarounds: oe-ns-eoh outlook-no-nuls auth default: mechanisms: plain login verbose: yes passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postdrop root@smtp:~# dovecot -n # 1.1.2: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/poplog info_log_path: /var/log/poplog protocols: pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/pop3-login login_processes_count: 4 verbose_proctitle: yes mail_access_groups: mail mail_location: mbox:/var/empty:INBOX=/var/spool/mail/%u:INDEX=MEMORY mail_executable: /usr/local/libexec/dovecot/pop3 mail_plugin_dir: /usr/local/lib/dovecot/pop3 pop3_client_workarounds: oe-ns-eoh outlook-no-nuls auth default: mechanisms: plain login verbose: yes passdb: driver: shadow userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postdrop -- Roberto Tagliaferri Responsabile Progettazione & Produzione TosNet s.r.l. - Internet Service Provider r.tagliaferri(a)tosnet.it www.tosnet.it

2 5

Re: [Dovecot] dovecot-antispam has some kind of bug
by Johannes Berg 22 Aug '08

22 Aug '08

> My dspam users has the email as username somthing(a)domain.com and in > dovecot.conf i need to specify the user when training, is there a > way to get the resiptient address in the dovecot.conf? i am only able to > get %u ie the username ;-( > > Could you patch the antispam plugin to be able to take then resiptient > as dspam user? ie the mail address , you can have a option in dovecot > that says use resiptient address as user or something > > it would be great if you had time to check this out ;-) TBH, I don't, and I also don't see why you'd need the recipient address, can't you just build it like %u@%d or %u(a)example.com or something? johannes

2 9

[Dovecot] dovecot-antispam: Failed to read mail beginning, Next message unexpectedly lost
by Jiri Novosad 22 Aug '08

22 Aug '08

Hello, I'm trying to configure the dovecot-antispam plugin. Now I've run into a problem: whenever I try to move/copy a message in/from the spam mailbox, Thunderbird (and also Sylpheed, haven't tried anything else) says: The current command did not succeed. The mail server responded: Failed to read mail beginning. and in the logs I get: dovecot: Aug 07 10:41:23 Error: IMAP(username): Next message unexpectedly lost from 337928 dovecot: Aug 07 10:41:23 Error: IMAP(username): Next message unexpectedly lost from 337928 The message is not moved/copied. My config (dovecot -n): base_dir: /var/run/dovecot_test/ log_path: /var/log/dovecot/test_log info_log_path: /var/log/dovecot/test_info_log protocols: pop3s imaps pop3 imap listen(default): *:10143 listen(imap): *:10143 listen(pop3): *:10110 ssl_listen(default): *:10993 ssl_listen(imap): *:10993 ssl_listen(pop3): *:10995 ssl_cert_file: /etc/ssl/anxur.pem ssl_key_file: /etc/ssl/anxur.pem ssl_parameters_regenerate: 24 login_dir: /var/run/dovecot_test/login login_executable(default): /packages/run.64/dovecot-1.1.2/libexec/dovecot/imap-login login_executable(imap): /packages/run.64/dovecot-1.1.2/libexec/dovecot/imap-login login_executable(pop3): /packages/run.64/dovecot-1.1.2/libexec/dovecot/pop3-login login_greeting: HI! login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:/home/%u/mail/:INBOX=/var/mail/%u:INDEX=/home/%u/mail/.imap mail_debug: yes mail_full_filesystem_access: yes maildir_copy_with_hardlinks: no mbox_write_locks: fcntl mbox_dirty_syncs: no mbox_lazy_writes: no dbox_rotate_days: 0 mail_executable(default): /packages/run.64/dovecot-1.1.2/libexec/dovecot/imap mail_executable(imap): /packages/run.64/dovecot-1.1.2/libexec/dovecot/imap mail_executable(pop3): /packages/run.64/dovecot-1.1.2/libexec/dovecot/pop3 mail_plugins(default): antispam mail_plugins(imap): antispam mail_plugins(pop3): mail_plugin_dir(default): /packages/run.64/dovecot-1.1.2/lib/dovecot/imap mail_plugin_dir(imap): /packages/run.64/dovecot-1.1.2/lib/dovecot/imap mail_plugin_dir(pop3): /packages/run.64/dovecot-1.1.2//lib/dovecot/pop3 mail_log_max_lines_per_sec: 20 imap_max_line_length(default): 131072 imap_max_line_length(imap): 131072 imap_max_line_length(pop3): 65536 imap_client_workarounds(default): delay-newmail outlook-idle tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %08Xv%08Xu pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: gssapi plain executable: /packages/run.64/dovecot-1.1.2/libexec/dovecot/dovecot-auth krb5_keytab: /etc/krb5.imap verbose: yes debug: yes passdb: driver: pam args: dovecot userdb: driver: passwd plugin: antispam_spam: mailbox.spam antispam_trash: trash;Trash;Deleted Items antispam_mail_spam: spam(a)mysite.org antispam_mail_notspam: notspam(a)mysite.org antispam_mail_sendmail: /home/username/fake_sendmail Dovecot is version 1.1.2, dovecot-antispam is the latest snapshot. Running on Red Hat Enterprise Linux Server release 5.2, x86_64, filesystem is ext3 (on lvm). Attached is the strace -p of the session. The code seems to be this in i_stream_raw_mbox_read: if (stream->istream.v_offset - rstream->hdr_offset + new_pos > rstream->mail_size) { /* istream_raw_mbox_set_next_offset() used invalid cached next_offset? */ i_error("Next message unexpectedly lost from %"PRIuUOFF_T, rstream->hdr_offset + rstream->mail_size); rstream->eof = TRUE; rstream->corrupted = TRUE; return -1; } If I comment it out (after I backup my mail), everything seems to work as expected. Jiri Novosad epoll_wait(6, {{EPOLLIN, {u32=7035872, u64=7035872}}}, 4, 492) = 1 gettimeofday({1218008692, 930362}, NULL) = 0 gettimeofday({1218008692, 930446}, NULL) = 0 read(0, "452 uid copy 4 \"mailbox.", 24) = 24 gettimeofday({1218008692, 930610}, NULL) = 0 epoll_wait(6, {{EPOLLIN, {u32=7035872, u64=7035872}}}, 4, 423) = 1 gettimeofday({1218008692, 930806}, NULL) = 0 gettimeofday({1218008692, 930903}, NULL) = 0 read(0, "spam\"\r\n", 4087) = 7 stat("/home/username/mail/mailbox.spam", {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 stat("/home/username/mail/mailbox.spam", {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 stat("/home/username/mail/.imap/.imap/mailbox.spam", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 gettimeofday({1218008692, 931707}, NULL) = 0 access("/home/username/mail/mailbox.spam", R_OK|W_OK) = 0 open("/home/username/mail/.imap/.imap/mailbox.spam/dovecot.index.log", O_RDWR) = 10 fstat(10, {st_mode=S_IFREG|0600, st_size=10908, ...}) = 0 pread(10, "\1\0\30\0\373\264\226H\4\0\0\0\3\0\0\0\364\334\0\0|\"\230H", 24, 0) = 24 stat("/home/username/mail/.imap/.imap/mailbox.spam/dovecot.index.log.2", 0x7fffd3bb6f50) = -1 ENOENT (No such file or directory) open("/home/username/mail/.imap/.imap/mailbox.spam/dovecot.index", O_RDWR) = 11 alarm(120) = 0 fcntl(11, F_SETLKW, {type=F_RDLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0) = 120 fstat(11, {st_mode=S_IFREG|0600, st_size=1136, ...}) = 0 pread(11, "\7\2x\0x\1\0\0(\0\0\0\1\0\0\0\373\264\226H\0\0\0\0\373\264\226H\232\10\0\0"..., 4096, 0) = 1136 fcntl(11, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 stat("/home/username/mail/.imap/.imap/mailbox.spam/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=10908, ...}) = 0 fstat(10, {st_mode=S_IFREG|0600, st_size=10908, ...}) = 0 pread(10, "\200\200\200\204 \0\0\20P\0\4\0\322P\231H\200\200\200\204 \0\0\0200\0\4\0\232\10\0\0"..., 1024, 10204) = 704 pread(10, "", 1024, 10908) = 0 mkdir("/tmp/antispam-mail-GYlEb4", 0700) = 0 mkdir("/tmp/antispam-mail-Rb3HAN", 0700) = 0 gettimeofday({1218008692, 933917}, NULL) = 0 gettimeofday({1218008692, 934014}, NULL) = 0 stat("/home/username/mail/sent-mail", {st_mode=S_IFREG|0644, st_size=2143, ...}) = 0 gettimeofday({1218008692, 934308}, NULL) = 0 alarm(5) = 0 fcntl(19, F_SETLKW, {type=F_RDLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0) = 5 stat("/home/username/mail/sent-mail", {st_mode=S_IFREG|0644, st_size=2143, ...}) = 0 stat("/home/username/mail/.imap/.imap/sent-mail/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fstat(8, {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fstat(19, {st_mode=S_IFREG|0644, st_size=2143, ...}) = 0 pread(19, "\nFrom popel(a)mysite.org Thu Jul "..., 4096, 551) = 1592 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/home/username/mail/.imap/.imap/sent-mail/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fstat(8, {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 gettimeofday({1218008692, 935474}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 71, MSG_NOSIGNAL, NULL, 0) = 71 gettimeofday({1218008692, 936290}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 67, MSG_NOSIGNAL, NULL, 0) = 67 gettimeofday({1218008692, 937117}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 70, MSG_NOSIGNAL, NULL, 0) = 70 gettimeofday({1218008692, 937848}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 74, MSG_NOSIGNAL, NULL, 0) = 74 gettimeofday({1218008692, 938501}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 66, MSG_NOSIGNAL, NULL, 0) = 66 gettimeofday({1218008692, 939236}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 69, MSG_NOSIGNAL, NULL, 0) = 69 gettimeofday({1218008692, 939981}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 68, MSG_NOSIGNAL, NULL, 0) = 68 gettimeofday({1218008692, 940611}, NULL) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 sendto(7, "<14>Aug 6 09:44:52 imap: antisp"..., 87, MSG_NOSIGNAL, NULL, 0) = 87 gettimeofday({1218008692, 941375}, NULL) = 0 gettimeofday({1218008692, 941511}, NULL) = 0 open("/home/username/mail/mailbox.spam", O_RDWR) = 12 fstat(12, {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 gettimeofday({1218008692, 941777}, NULL) = 0 alarm(5) = 0 fcntl(12, F_SETLKW, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0) = 5 stat("/home/username/mail/mailbox.spam", {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 stat("/home/username/mail/mailbox.spam", {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 alarm(180) = 0 fcntl(10, F_SETLKW, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0) = 180 stat("/home/username/mail/.imap/.imap/mailbox.spam/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=10908, ...}) = 0 fstat(10, {st_mode=S_IFREG|0600, st_size=10908, ...}) = 0 fcntl(10, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 stat("/home/username/mail/.imap/.imap/mailbox.spam/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=10908, ...}) = 0 fstat(10, {st_mode=S_IFREG|0600, st_size=10908, ...}) = 0 fstat(12, {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 lseek(12, 140168, SEEK_SET) = 140168 read(12, "\n", 1) = 1 fstat(12, {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 fstat(12, {st_mode=S_IFREG|0644, st_size=140169, ...}) = 0 pread(12, "\n", 4096, 140168) = 1 pread(12, "", 4095, 140169) = 0 pread(19, "Return-Path: <popel(a)mysite.org>\n"..., 4096, 600) = 1543 pread(19, "", 2553, 2143) = 0 pread(19, "", 2553, 2143) = 0 pread(19, "", 2553, 2143) = 0 write(12, "From popel(a)mysite.org Thu Jul 3"..., 1593) = 1593 pwrite(12, "\nContent-Length: 581", 20, 141159) = 20 creat("/tmp/antispam-mail-GYlEb4/0", 0600) = 13 lseek(13, 0, SEEK_CUR) = 0 fstat(13, {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 write(13, "\1\0\0\0", 4) = 4 pread(12, "From popel(a)mysite.org Thu Jul 3"..., 4095, 140169) = 1593 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 write(2, "\1ENext message unexpectedly lost"..., 45) = 45 pread(12, "\nFrom popel(a)mysite.org Thu Jul "..., 4096, 140168) = 1594 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2246, ...}) = 0 write(2, "\1ENext message unexpectedly lost"..., 45) = 45 close(13) = 0 close(13) = -1 EBADF (Bad file descriptor) rmdir("/tmp/antispam-mail-Rb3HAN") = 0 stat("/home/username/mail/.imap/.imap/sent-mail/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fstat(8, {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fcntl(19, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0) = 0 write(12, "\n", 1) = 1 ftruncate(12, 140169) = 0 fcntl(12, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0) = 0 unlink("/tmp/antispam-mail-GYlEb4/0") = 0 rmdir("/tmp/antispam-mail-GYlEb4") = 0 close(12) = 0 gettimeofday({1218008692, 946718}, NULL) = 0 write(1, "452 NO Failed to read mail begin"..., 38) = 38 gettimeofday({1218008692, 946937}, NULL) = 0 epoll_wait(6, {}, 4, 407) = 0 gettimeofday({1218008693, 353573}, NULL) = 0 gettimeofday({1218008693, 353660}, NULL) = 0 epoll_wait(6, {{EPOLLIN, {u32=7035872, u64=7035872}}}, 4, 5000) = 1 gettimeofday({1218008694, 161166}, NULL) = 0 gettimeofday({1218008694, 161210}, NULL) = 0 read(0, "453 IDLE\r\n", 4080) = 10 gettimeofday({1218008694, 161352}, NULL) = 0 inotify_add_watch(18, "/home/username/mail/sent-mail", IN_MODIFY|IN_CLOSE_WRITE|IN_CLOSE_NOWRITE|IN_MOVED_FROM|IN_MOVED_TO|IN_CREATE|IN_DELETE|IN_DELETE_SELF) = 123 epoll_ctl(6, EPOLL_CTL_ADD, 18, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=7144768, u64=7144768}}) = 0 stat("/home/username/mail/sent-mail", {st_mode=S_IFREG|0644, st_size=2143, ...}) = 0 gettimeofday({1218008694, 161636}, NULL) = 0 epoll_ctl(6, EPOLL_CTL_DEL, 0, {0, {u32=7035872, u64=7035872}}) = 0 epoll_ctl(6, EPOLL_CTL_ADD, 0, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=7035872, u64=7035872}}) = 0 gettimeofday({1218008694, 161895}, NULL) = 0 stat("/home/username/mail/sent-mail", {st_mode=S_IFREG|0644, st_size=2143, ...}) = 0 alarm(180) = 0 fcntl(8, F_SETLKW, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0) = 180 stat("/home/username/mail/.imap/.imap/sent-mail/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fstat(8, {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fcntl(8, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 mkdir("/tmp/antispam-mail-3WExWz", 0700) = 0 rmdir("/tmp/antispam-mail-3WExWz") = 0 stat("/home/username/mail/.imap/.imap/sent-mail/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 fstat(8, {st_mode=S_IFREG|0600, st_size=2088, ...}) = 0 write(1, "+ idling\r\n", 10) = 10 gettimeofday({1218008694, 164036}, NULL) = 0 epoll_wait(6, {{EPOLLIN, {u32=7144768, u64=7144768}}}, 4, 4189) = 1 gettimeofday({1218008694, 164168}, NULL) = 0 read(18, "z\0\0\0\0\200\0\0\0\0\0\0\0\0\0\0", 32768) = 16 gettimeofday({1218008694, 164332}, NULL) = 0 gettimeofday({1218008694, 164400}, NULL) = 0 epoll_wait(6, ^C <unfinished ...>

3 7

[Dovecot] dovecot panic after upgrade 1.0.15 to 1.1.2
by Eric Rostetter 22 Aug '08

22 Aug '08

I recently upgraded dovecot from 1.0.15 to 1.1.2 and since then I am getting the following types of things in the logs: Aug 21 17:23:13 mail1 dovecot: imap-login: Login: user=<myuser>, method=PLAIN, rip=172.16.78.20, lip=172.16.78.22 Aug 21 17:24:01 mail1 dovecot: Panic: IMAP(myuser): file index-sync.c: line 39 (index_mailbox_set_recent_uid): assertion failed: (seq_range_exists(&ibox->recent_flags, uid)) Aug 21 17:24:01 mail1 dovecot: IMAP(myuser): Raw backtrace: imap [0x80d25bb] -> imap [0x80d2def] -> imap [0x80d2719] -> imap [0x809edb8] -> imap(index_mailbox_set_recent_seq+0x46) [0x809ee06] -> imap [0x8083183] -> imap [0x8083621] -> imap [0x8083c3c] -> imap(mbox_sync+0x25) [0x80840d5] -> imap [0x807b993] -> imap(mail_index_transaction_commit+0x51) [0x80aee31] -> imap(index_transaction_commit+0x52) [0x809fe32] -> imap(mailbox_transaction_commit_get_uids+0x34) [0x80a2874] -> imap(cmd_copy+0x16a) [0x805b19a] -> imap [0x806068e] -> imap [0x8060536] -> imap [0x80606ea] -> imap [0x8060791] -> imap(client_input+0x67) [0x8060897] -> imap(io_loop_handler_run+0x112) [0x80daa92] -> imap(io_loop_run+0x2f) [0x80d9e4f] -> imap(main+0x61) [0x8068d81] -> /lib/tls/libc.so.6(__libc_start_main+0xda) [0x12679a] -> imap(__fxstat64+0x6d) [0x8059ed1] Did I miss something in the upgrade process, or is this a bug that has yet to be fixed? This seems to be happening to many various users for various reasons. But I can verify for Andreas M. Kirchwitz who noted the other day that one of the easiest way to produce it seems to be "saving" or "moving" between folders in (Al)Pine... If Timo wants, I can send the dovecot.(index|index.cache|index.log) files for when this happens, but I would need to know what to send (both the folder being moved from and folder being moved to, or just one of them) and anything else needed, and the email to send them to. Sending the folder itself might be problematic, but might be possible. If we can't get this resolved by early next week, I might have to downgrade back to the previous version... -- Eric Rostetter The Department of Physics The University of Texas at Austin Go Longhorns!

2 5

[Dovecot] Simplest (static?) build & config for loopback access?
by FZiegler 22 Aug '08

22 Aug '08

I am installing Dovecot for the sole purpose of maintaining a local mail store that I could 1) manage with any client; 2) keep duplicated on several machines, using Unison; 3) hopefully, index using Spotlight (http://article.gmane.org/gmane.mail.mh-e.user/1308 ...). In particular, I have no intention to allow connections from anywhere but localhost. I've followed the instructions at http://wiki.dovecot.org/HowTo/Rootless and it all seems to work quite well, but I'm not sure about 3 things: 1) Initially Dovecot would not respond to Thunderbird ("Could not connect to server localhost; the connection was refused"). Eventually, a "Trying ::1..." in the telnet log (see below) made me find hidden pref "network.dns.disableIPv6" and set it to FALSE. Which solves the problem -- but is this really needed, or have I done something wrong? 2) The Dovecot I built on OS X 10.4 appears to work fine when copied on another Mac running 10.5. Now, I'd love to avoid installing developer tools on both machines, but I fear this an illusion (some libraries are changing under us, e.g. libiconv.2.2.0.dylib --> libiconv.2.4.0.dylib). Does this mean I should try a static build? If so, what are the flags and how do I go about specifying a minimal set of libraries to include for my purposes? 3) Probably offtopic here, but has anyone seen a better way to index mail in Spotlight than just as plain text? E.g. to hook up Apple's importer (Mail.mdimporter in /System/Library/Spotlight) or Thunderbird's (https://bugzilla.mozilla.org/show_bug.cgi?id=290057) which I guess can better deal with quoted-printable and other encodings? Thanks in advance; I include my compilation and config data below. Francois Z. ------------------ mini:~ fz$ curl -O http://www.dovecot.org/releases/1.1/dovecot-1.1.2.tar.gz mini:~ fz$ tar xzf dovecot-1.1.2.tar.gz mini:~ fz$ cd dovecot-1.1.2 mini:~/dovecot-1.1.2 fz$ ./configure --prefix=$HOME/sw mini:~/dovecot-1.1.2 fz$ make mini:~/dovecot-1.1.2 fz$ make install mini:~ fz$ cd mini:~ fz$ sw/sbin/dovecot Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 640). Either grow the limit or change login_max_processes_count and max_mail_processes settings mini:~ fz$ telnet localhost 10143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK Dovecot ready. . login fz ******** . OK Logged in. . list "" * * LIST (\HasNoChildren) "." "Drafts" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "INBOX" . OK List completed. . logout * BYE Logging out . OK Logout completed. Connection closed by foreign host. mini:~ fz$ sw/sbin/dovecot -n # 1.1.2: /Volumes/Home/FZ/sw/etc/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 640). Either grow the limit or change login_max_processes_count and max_mail_processes settings log_path: /Volumes/Home/FZ/Library/Logs/Dovecot/error.log info_log_path: /Volumes/Home/FZ/Library/Logs/Dovecot/info.log listen: localhost:10143 ssl_disable: yes disable_plaintext_auth: no login_dir: /Volumes/Home/FZ/sw/var/run/dovecot/login login_executable: /Volumes/Home/FZ/sw/libexec/dovecot/imap-login login_user: fz login_chroot: no mail_location: maildir:~/Library/Maildir auth default: user: fz passdb: driver: passwd-file args: /Volumes/Home/FZ/sw/etc/dovecot.passwd userdb: driver: passwd mini:~ fz$

4 4

[Dovecot] POP3 UID file problem
by naslov naslov 22 Aug '08

22 Aug '08

Hello. I upgraded from RHRL4 to RHEL5 and my dovecot version changed from dovecot-0.99.11-8.EL4 to dovecot-1.0.7-2.el5. I also transferred all /home directories of users. The problem is that users have POP3 mail client set that it leaves mail on mailserver for 30 days. When they try to download messages from new server, client (Thinderbird) want to download all messages for those 30 days (he of course already has all those messages..). I suspect UID POP3 database index file format has changed.. How to "convert" dovecot 0.99 POP3 UID files to those used in newer version or how to go around that? Thanks for answering, naslov [root@mercury5 INBOX]# dovecot -n # 1.0.7: /etc/dovecot.conf protocols: imap pop3 pop3s ssl_cert_file: /etc/httpd/conf/ssl.crt/server.crt ssl_key_file: /etc/httpd/conf/ssl.key/server.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd

2 1

[Dovecot] Quota plugin
by Thiago Monaco Papageorgiou 22 Aug '08

22 Aug '08

Hi! I have some questions about quota plugin. I have taken quota-maildir as example. What does the function maildir_quota_root_get_resources? When it is called? I have tested including some log messages, but it wasn't appears in the log file. When dovecot calls this function? It is an important function? Regards / / -- Thiago Monaco Papageorgiou <thiago.monaco(a)corp.terra.com.br> ________________________ Terra Networks Brasil S/A Tel: +55 (51) 3284-4274

2 1

Re: [Dovecot] Experience moving mailboxes from Dovecot 0.99.14 to Dovecot 1.07 => Improvement possible
by Eric Rostetter 22 Aug '08

22 Aug '08

Quoting Axel Thimm <Axel.Thimm(a)ATrpms.net>: Just to keep the list up-to-date in case any one is cruising the archives... > On Thu, Aug 07, 2008 at 11:02:57AM -0500, Eric Rostetter wrote: >> Quoting Axel Thimm <Axel.Thimm(a)ATrpms.net>: >> >>>> Anyone know about Dovecot 1.1.x rpms for Centos/RHEL 3.x? I still have not found any, but I was able to rebuild them (see below). >>> You could try to rebuild from ATrpms' src.rpm, but to spare some >>> trouble this is what I had with 1.1.rc4 4 months ago: >> >> I tried this, and it failed due to incompatible tools versions (autoconf, >> libtool, etc). After upgrading the tools to: automake14-1.4p6 automake-1.9.2 automake15-1.5 autoconf-2.59 libtool-1.5.6 libtool-libs-1.5.6 And disabling a few features I don't use (MySQL, etc) I was able to get the ATrpms Centos 4 dovecot 1.1.2 to build and run on CentOS 3. See my next message for the nasty results of doing so... -- Eric Rostetter The Department of Physics The University of Texas at Austin Go Longhorns!

1 0

Re: [Dovecot] How Can I Tell How Dovecot Was Installed?
by Blake Carver 21 Aug '08

21 Aug '08

Thanks Kenneth On Tue, Aug 19, 2008 at 10:02 PM, Kenneth Porter <shiva(a)sewingwitch.com> wrote: >The best you can do here is to query the database to see if the > files it knows about match those on the disk. For that, use "rpm -V -v > dovecot". That does a verbose verify and tells you what files it knows about > have been changed in some way. I guess I'm not quite sure how to interpret this to help me figure out my problem, there are changes rpm reports, does this mean that an RPM was installed but so was a source package? rpm -V -v dovecot ........ c /etc/dovecot.conf ........ c /etc/pam.d/dovecot ........ c /etc/pki/dovecot/dovecot-openssl.cnf S.5....T c /etc/rc.d/init.d/dovecot ........ /usr/lib/dovecot ........ /usr/lib/dovecot/imap ........ /usr/lib/dovecot/imap/lib01_acl_plugin.so ........ /usr/lib/dovecot/imap/lib01_convert_plugin.so ........ /usr/lib/dovecot/imap/lib01_quota_plugin.so ........ /usr/lib/dovecot/imap/lib01_zlib_plugin.a ........ /usr/lib/dovecot/imap/lib01_zlib_plugin.la ........ /usr/lib/dovecot/imap/lib01_zlib_plugin.so ........ /usr/lib/dovecot/imap/lib02_imap_quota_plugin.a ........ /usr/lib/dovecot/imap/lib02_imap_quota_plugin.la ........ /usr/lib/dovecot/imap/lib02_imap_quota_plugin.so ........ /usr/lib/dovecot/imap/lib02_trash_plugin.so ........ /usr/lib/dovecot/lda ........ /usr/lib/dovecot/lda/lib01_acl_plugin.so ........ /usr/lib/dovecot/lda/lib01_convert_plugin.so ........ /usr/lib/dovecot/lda/lib01_quota_plugin.so ........ /usr/lib/dovecot/lda/lib02_trash_plugin.so ........ /usr/lib/dovecot/lib01_acl_plugin.a ........ /usr/lib/dovecot/lib01_acl_plugin.la ........ /usr/lib/dovecot/lib01_acl_plugin.so ........ /usr/lib/dovecot/lib01_convert_plugin.a ........ /usr/lib/dovecot/lib01_convert_plugin.la ........ /usr/lib/dovecot/lib01_convert_plugin.so ........ /usr/lib/dovecot/lib01_quota_plugin.a ........ /usr/lib/dovecot/lib01_quota_plugin.la ........ /usr/lib/dovecot/lib01_quota_plugin.so ........ /usr/lib/dovecot/lib02_trash_plugin.a ........ /usr/lib/dovecot/lib02_trash_plugin.la ........ /usr/lib/dovecot/lib02_trash_plugin.so ........ /usr/lib/dovecot/pop3 ........ /usr/lib/dovecot/pop3/lib01_convert_plugin.so ........ /usr/lib/dovecot/pop3/lib01_quota_plugin.so ........ /usr/libexec/dovecot ........ /usr/libexec/dovecot/checkpassword-reply ........ /usr/libexec/dovecot/deliver prelink: /usr/libexec/dovecot/dict: at least one of file's dependencies has changed since prelinking S.?..... /usr/libexec/dovecot/dict prelink: /usr/libexec/dovecot/dovecot-auth: at least one of file's dependencies has changed since prelinking S.?..... /usr/libexec/dovecot/dovecot-auth ........ /usr/libexec/dovecot/gdbhelper ........ /usr/libexec/dovecot/imap prelink: /usr/libexec/dovecot/imap-login: at least one of file's dependencies has changed since prelinking S.?..... /usr/libexec/dovecot/imap-login ........ /usr/libexec/dovecot/pop3 prelink: /usr/libexec/dovecot/pop3-login: at least one of file's dependencies has changed since prelinking S.?..... /usr/libexec/dovecot/pop3-login ........ /usr/libexec/dovecot/rawlog prelink: /usr/libexec/dovecot/ssl-build-param: at least one of file's dependencies has changed since prelinking S.?..... /usr/libexec/dovecot/ssl-build-param ........ /usr/sbin/dovecot prelink: /usr/sbin/dovecotpw: at least one of file's dependencies has changed since prelinking S.?..... /usr/sbin/dovecotpw ........ /usr/share/doc/dovecot-1.0 ........ d /usr/share/doc/dovecot-1.0/REDHAT-FAQ.txt ........ d /usr/share/doc/dovecot-1.0/USE-WIKI-INSTEAD ........ /usr/share/doc/dovecot-1.0/UW-to-Dovecot-Migration ........ d /usr/share/doc/dovecot-1.0/UW-to-Dovecot-Migration/maildir-migration.txt ........ d /usr/share/doc/dovecot-1.0/UW-to-Dovecot-Migration/migrate-folders ........ d /usr/share/doc/dovecot-1.0/UW-to-Dovecot-Migration/migrate-users ........ d /usr/share/doc/dovecot-1.0/UW-to-Dovecot-Migration/perfect_maildir.pl ........ d /usr/share/doc/dovecot-1.0/auth-protocol.txt ........ d /usr/share/doc/dovecot-1.0/auth.txt ........ d /usr/share/doc/dovecot-1.0/configuration.txt ........ d /usr/share/doc/dovecot-1.0/design.txt ........ /usr/share/doc/dovecot-1.0/examples ........ d /usr/share/doc/dovecot-1.0/examples/dovecot-ldap.conf ........ d /usr/share/doc/dovecot-1.0/examples/dovecot-sql.conf ........ d /usr/share/doc/dovecot-1.0/examples/mkcert.sh ........ d /usr/share/doc/dovecot-1.0/index.txt ........ d /usr/share/doc/dovecot-1.0/mail-storages.txt ........ d /usr/share/doc/dovecot-1.0/multiaccess.txt ........ d /usr/share/doc/dovecot-1.0/nfs.txt ........ d /usr/share/doc/dovecot-1.0/securecoding.txt ........ d /usr/share/doc/dovecot-1.0/variables.txt ........ /var/lib/dovecot ........ /var/run/dovecot ........ /var/run/dovecot/login

4 3

[Dovecot] dovecot bug - kevent(EV_DELETE, 9)
by Mail.ru 21 Aug '08

21 Aug '08

Sorry for my english. FreeBSD 7.0-STABLE dovecot-1.1.2_1 (from ports with LDAP) AD LDAP на Win 2003 SP2 (work via GK) CPU 2xIntel XEON NFS not used LDAP part of dovecot.conf (if you need all file, l'll send it): auth default { mechanisms = plain login passdb ldap { args = /usr/local/etc/dovecot-ldap.conf } userdb ldap { args = /usr/local/etc/dovecot-ldap.conf } user = nobody count = 1 ssl_require_client_cert = no ssl_username_from_cert = no #Postfix Auth socket listen { client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } } Whole dovecot-ldap.conf: hosts = 192.168.8.5:3268 192.168.8.6:3268 dn = CN=SomeUser,OU=SomeOU,DC=domain,DC=ru dnpass = password tls = no debug_level = 0 auth_bind = yes ldap_version = 3 base = DC=domain,DC=ru deref = never scope = subtree user_filter = (&(mail=%u)(objectclass=user)(memberOf=CN=Mail,OU=SomeOU,DC=domain,DC=ru)) pass_filter = (&(mail=%u)(objectclass=user)(memberOf=CN=Mail,OU=SomeOU,DC=domain,DC=ru)) default_pass_scheme = CRYPT My problem. dovecot works fine with AD! but i have this in logs (This not nice, but no more): Aug 14 02:21:03 somecomp dovecot: auth(default): LDAP: Connection lost to LDAP server, reconnecting Aug 14 02:21:03 somecomp dovecot: auth(default): kevent(EV_DELETE, 9) failed: Bad file descriptor Aug 14 02:36:04 somecomp dovecot: auth(default): LDAP: Connection lost to LDAP server, reconnecting Aug 14 02:36:04 somecomp dovecot: auth(default): kevent(EV_DELETE, 9) failed: Bad file descriptor Aug 14 02:51:04 somecomp dovecot: auth(default): LDAP: Connection lost to LDAP server, reconnecting Aug 14 02:51:04 somecomp dovecot: auth(default): kevent(EV_DELETE, 9) failed: Bad file descriptor Aug 14 03:06:05 somecomp dovecot: auth(default): LDAP: Connection lost to LDAP server, reconnecting Aug 14 03:06:05 somecomp dovecot: auth(default): kevent(EV_DELETE, 9) failed: Bad file descriptor Aug 14 03:21:05 somecomp dovecot: auth(default): LDAP: Connection lost to LDAP server, reconnecting Aug 14 03:21:05 somecomp dovecot: auth(default): kevent(EV_DELETE, 9) failed: Bad file descriptor Aug 14 03:36:06 somecomp dovecot: auth(default): LDAP: Connection lost to LDAP server, reconnecting Aug 14 03:36:06 somecomp dovecot: auth(default): kevent(EV_DELETE, 9) failed: Bad file descriptor docecot was launched with debug_level = -1 in dovecot.conf. If you need this log (it's very big) - i send it too. But i don't see in it something new (dovecot check connection when it lost and succesefully reconnecting to AD LDAP). I want to know: What this event means? Can i fix it and what to fix?

2 3