- dovecot - dovecot.org

[Dovecot] Dovecot 1.1.2, index_mailbox_set_recent_seq crash again
by Andreas M. Kirchwitz 02 Sep '08

02 Sep '08

Hi folks, after about 3 weeks without any problems, I've found this crash in yesterday's logfile (again related to index_mailbox_set_recent_seq): Aug 16 03:39:58 linux dovecot: IMAP(user1): Raw backtrace: imap [0x80cf8e0] -> imap [0x80cf93a] -> imap [0x80cf26c] -> imap [0x809d11a] -> imap(index_mailbox_set_recent_seq+0x3e) [0x809d15e] -> imap(mbox_sync+0x105d) [0x80823fd] -> imap [0x807a454] -> imap(index_transaction_commit+0x4e) [0x809ddfe] -> imap(cmd_copy+0x35f) [0x805b26f] -> imap(cmd_uid+0x59) [0x805f3d9] -> imap [0x805fd7c] -> imap [0x805fe25] -> imap [0x80605e5] -> imap(client_input+0x5e) [0x80607fe] -> imap(io_loop_handler_run+0x100) [0x80d7230] -> imap(io_loop_run+0x28) [0x80d63c8] -> imap(main+0x4a1) [0x8068321] -> /lib/libc.so.6(__libc_start_main+0xe0) [0x149390] -> imap [0x805a101] I don't know what IMAP operation caused that crash. The client (Thunderbird 2.0.0.16) silently reconnected without any notification. No obvious problems since yesterday. Dovecot 1.1.2 is running on Fedora 8 Linux 32 Bit with all patches and custom OpenSSL 0.9.8h. [ output of "dovecot -n" ] # 1.1.2: /usr/local/dovecot/etc/dovecot.conf ssl_cert_file: /usr/local/dovecot/etc/dovecot.crt ssl_key_file: /usr/local/dovecot/etc/dovecot.key login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable: /usr/local/dovecot/libexec/dovecot/imap-login mail_location: mbox:~/Mail:INBOX=/var/spool/mail/%u auth default: mechanisms: plain login digest-md5 cram-md5 passdb: driver: passwd-file args: /usr/local/dovecot/etc/dovecot.passwd userdb: driver: passwd-file args: /usr/local/dovecot/etc/dovecot.passwd Greetings, Andreas

3 6

[Dovecot] tcp-wrapper patch for managesieve
by Edgar Fuß 02 Sep '08

02 Sep '08

Is there a place to store unofficial patches to ManageSieve? The attached patch is supposed to make ManageSieve (more precisely, managesieve-login) co-operate with a libwrapped (http://www.dovecot.org/patches/1.1/tcp-wrappers.patch) dovecot.

1 0

[Dovecot] "pam_start() failed: system error" with dovecot 1.1.2, cause unknown
by Adam McDougall 02 Sep '08

02 Sep '08

I would guess this is unlikely to be dovecot's fault, but I'm wondering if anyone has any ideas of what might have happened based on the evidence. My best guess is some kind of resource limit was reached but I don't see any evidence in the logs, and the condition is now gone. Suddenly this morning, one (and only one) of my dovecot servers decided to start failing all logins since 08:25:04 until we restarted dovecot, at which point they were working fine. The number of imap-login processes was under the limit, but there were some obvious PAM errors at the time. My account could still ssh to the system so I don't think it was a problem general authentication, and NIS on other systems was working fine. No one was logged into that server at the time the problems occurred, and I don't think anything happened to the actual pam libraries to make them missing since dovecot worked after a restart. I should have used other means to prevent people from using that dovecot instance rather than stopping it, and I'll do so if it happens again in hopes of further debugging. /var/log/maillog: Sep 2 08:25:01 hill dovecot: imap-login: Login: user=<userA>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Sep 2 08:25:01 hill dovecot: IMAP(userA): Disconnected: Logged out bytes=127/568 Sep 2 08:25:01 hill dovecot: imap-login: Login: user=<userA>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Sep 2 08:25:01 hill dovecot: IMAP(userA): Disconnected: Logged out bytes=282/9641 Sep 2 08:25:04 hill dovecot: imap-login: Login: user=<userA>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Sep 2 08:25:04 hill dovecot: IMAP(userA): Disconnected: Logged out bytes=46/543 ***problem started here Sep 2 08:25:04 hill dovecot: auth-worker(default): pam(userA,127.0.0.1): pam_start() failed: system error Sep 2 08:25:04 hill dovecot: auth-worker(default): pam(userB,35.9.37.164): pam_start() failed: system error Sep 2 08:25:05 hill dovecot: auth-worker(default): pam(userC,35.9.37.164): pam_start() failed: system error Sep 2 08:25:06 hill dovecot: imap-login: Aborted login (auth failed, 1 attempts): user=<userB>, method=PLAIN, rip=35.9.37.164, lip=35.9.37.190, TLS Sep 2 08:25:06 hill dovecot: imap-login: Aborted login (auth failed, 1 attempts): user=<userA>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Sep 2 08:25:07 hill dovecot: imap-login: Aborted login (auth failed, 1 attempts): user=<userC>, method=PLAIN, rip=35.9.37.164, lip=35.9.37.190, TLS ..... /var/log/messages: Sep 2 08:25:04 hill dovecot-auth: in openpam_load_module(): no pam_permit.so found Sep 2 08:25:04 hill dovecot-auth: in openpam_load_module(): no pam_login_access.so found Sep 2 08:25:05 hill dovecot-auth: in openpam_load_module(): no pam_nologin.so found Sep 2 08:25:10 hill dovecot-auth: in openpam_load_module(): no pam_unix.so found Sep 2 08:25:11 hill dovecot-auth: in openpam_load_module(): no pam_unix.so found Sep 2 08:25:20 hill dovecot-auth: in openpam_load_module(): no pam_opieaccess.so found Sep 2 08:25:20 hill dovecot-auth: in openpam_load_module(): no pam_opie.so found Sep 2 08:25:51 hill kernel: Sep 2 08:25:51 hill last message repeated 12 times Sep 2 08:27:52 hill kernel: Sep 2 08:27:52 hill last message repeated 37 times Sep 2 08:38:01 hill kernel: Sep 2 08:38:01 hill last message repeated 144 times Sep 2 08:48:06 hill kernel: Sep 2 08:48:06 hill last message repeated 129 times Sep 2 08:53:36 hill kernel: Sep 2 08:52:51 hill last message repeated 51 times

2 1

[Dovecot] Bad file descriptor with maildir and bzip2 files
by Chris Burton 02 Sep '08

02 Sep '08

Hi, I'm using the zlib plugin with dovecot 1.1.2 (on Centos 4.5, x86, ext3) and some bzip2 (version 1.0.2) compressed mail files are causing the following error to show in the logs when I click on the folder in outlook express. Aug 27 11:39:15 server-2 dovecot: IMAP(marchive): fstat(maildir) failed: Bad file descriptor Aug 27 11:39:17 Info: IMAP(marchive): Loading modules from directory: /usr/local/lib/dovecot/imap/ Aug 27 11:39:17 Info: IMAP(marchive): Module loaded: /usr/local/lib/dovecot/imap//lib20_zlib_plugin.so Aug 27 11:39:17 Info: IMAP(marchive): Effective uid=606, gid=609, home=/home/marchive Aug 27 11:39:17 Info: IMAP(marchive): maildir: data=/var/spool/maildir/marchive Aug 27 11:39:17 Info: IMAP(marchive): maildir++: root=/var/spool/maildir/marchive, index=, control=, inbox=/var/spool/maildir/marchive Aug 27 11:39:18 Info: IMAP(marchive): Disconnected: Internal error occurred. Refer to server log for more information. [20 08-08-27 11:39:18] bytes=246/1040 I attached strace to it and got the following: 11:39:18.193667 open("/var/spool/maildir/marchive/.2003.INBOX.Charlie.Old.OldInbox.2004/cur/1169027932.P30745Q17M499928.server-2:2,S=103418,Z", O_RDONLY|O_LARGEFILE) = 11 11:39:18.194130 fstat64(11, {st_mode=S_IFREG|0644, st_size=47637, ...}) = 0 11:39:18.194494 pread64(11, "BZh91AY&SY\231\206Z\257\0S\360\377\200\177\3746,U\357\377\377\377\377\377\360\277"..., 4096, 0) = 4096 11:39:18.200204 dup(11) = 12 11:39:18.200557 close(11) = 0 11:39:18.200916 fcntl64(12, F_GETFL) = 0x8000 (flags O_RDONLY|O_LARGEFILE) 11:39:18.200971 fstat64(12, {st_mode=S_IFREG|0644, st_size=47637, ...}) = 0 11:39:18.201104 mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7ff2000 11:39:18.201216 _llseek(12, 0, [0], SEEK_CUR) = 0 11:39:18.201355 fstat64(12, {st_mode=S_IFREG|0644, st_size=47637, ...}) = 0 11:39:18.201478 brk(0x9e61000) = 0x9e61000 11:39:18.201612 read(12, "BZh91AY&SY\231\206Z\257\0S\360\377\200\177\3746,U\357\377\377\377\377\377\360\277"..., 4096) = 4096 11:39:18.201694 read(12, "\277\217\261\0g!\273\')/3\343V\336\276}\273/\210I\26^\255\304\323\r\275Wts\3773"..., 4096) = 4096 11:39:18.201793 mmap2(NULL, 3600384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7c68000 11:39:18.205993 read(12, "~\214\261E*@[\200\245\302\232\201\334\331\272\225NQ\244\260\371\3473cc\312\255\326\246\17\'\222"..., 4096) = 4096 < continues reading from the file > 11:39:18.225970 read(12, "+:E\225\7\217W\264\367\27\226\262i9\34\227=\350\250BcmF\306\'\231m\265\233\337\343\237"..., 4096) = 2581 11:39:18.226040 read(12, "", 4096) = 0 < 26x more of this read > 11:39:18.233913 munmap(0xb7c68000, 3600384) = 0 11:39:18.234070 close(12) = 0 11:39:18.234120 munmap(0xb7ff2000, 4096) = 0 11:39:18.234184 fcntl64(12, F_GETFL) = -1 EBADF (Bad file descriptor) 11:39:18.234255 fstat64(12, 0xbff0a9a0) = -1 EBADF (Bad file descriptor) 11:39:18.234347 write(2, "\1Efstat(maildir) failed: Bad fil"..., 45) = 45 To me it looks like its trying to call fcntl on the handle its just closed? I've since decompressed these files and recompressed with "gzip -9" and they seem to be opening OK. dovecot -n gives: # 1.1.2: /usr/local/etc/dovecot.conf info_log_path: /var/log/dovecot.log protocols: imap imaps pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_location: maildir:/var/spool/maildir/%u mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins: zlib mail_plugin_dir(default): /usr/local/lib/dovecot/imap/ mail_plugin_dir(imap): /usr/local/lib/dovecot/imap/ mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3/ imap_client_workarounds(default): delay-newmail imap_client_workarounds(imap): delay-newmail imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls auth default: passdb: driver: pam userdb: driver: passwd ChrisB.

3 6

[Dovecot] sieve plugin
by Андрей 02 Sep '08

02 Sep '08

I try to cinfigure dovecot run sieve scripts on incoming mail. In my dovecot.conf: <...> protocol lda { # Address to use when sending rejection mails. postmaster_address = root(a)vpcit.ru # Hostname to use in various parts of sent mails, eg. in Message-Id. # Default is the system's real hostname. hostname = vpcit.ru # Support for dynamically loadable plugins. mail_plugins is a space separated # list of plugins to load. #mail_plugins = mail_plugin_dir = /usr/lib/dovecot/modules/lda # Binary to use for sending mails. #sendmail_path = /usr/lib/sendmail # UNIX socket path to master authentication server to find users. auth_socket_path = /var/run/dovecot/auth-master # Enabling Sieve plugin for server-side mail filtering mail_plugins = cmusieve } <...> plugin { sieve = /var/mail/%d/%1n/%n/.dovecot.sieve } Then i set experiments on my maildir. In /var/mail/vpcit.ru/d/dukenukem i created script .dovecot.sieve: require "fileinto"; if header :comparator "i;ascii-casemap" :contains "Subject" "sieve check" { fileinto "Trash"; stop; } Permissions on /var/mail/vpcit.ru/d/dukenukem are: drwx------ 5000 mail So script should put every message that has "sieve check" subject into Trash folder. 1) Trash folder isn't created, should i create it manually? 2) Even when i create Trash folder and make 777 permissions to maildir, nothing happens (message is dropped into inbox dir) 3) Should i configure my Kontact (KMail) e-mail client some way? 4) What i've done incorrect? The mail system works fine at the moment for receive and send, trouble only with sieve scripting. Yours faithfully, Andrey.

3 4

[Dovecot] question about OpenSSL with DC
by Stewart Dean 02 Sep '08

02 Sep '08

IBM recently changed both its delivery package for OpenSSL and the locations it put things. Luckily, I have a second machine other than my mail server that I can test things on and DC 1.0.15 seems to be be running OK (thus I got all the configure/compilation tweaks right), but.....is there anyway to check the DC binaries to determine where it's getting its OpenSSl binaries and libraries (needed at runtime)? -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

3 2

[Dovecot] Virtual users, postfix and dovecot deliver LDA
by Petri Asikainen 02 Sep '08

02 Sep '08

Hi, I have question about how to setup ldap-lookups in dovecot. I have done my homework by googling and reading documention and sample configuration files. But cant resolve this issue. Background: I have setup postfix and dovecot. Postix is configured to ldap alias maps and is delivering mails to /var/spool/vmail/username/Maildir correctly . Username is ldap attribute sAMAccountName from active directory. Goal: To use dovecots sieve plugin I have to setup postfix to use dovecots deliver. Changed postfix main.cf to virtual_transport = dovecot and master.cf to include lines: dovecot unix - n n - - pipe flags=DRhu user=vmail:mail argv=/usr/lib/dovecot/lda/deliver -d ${recipient} Problem is that mail get delivered to /var/spool/vmail/users.email@address , not folder named as ldap attribute sAMAccountNameas it should. The question is: How I can configure deliver to do map email address to ldap attribute sAMAccountName? Second question is can I use ldap groups as distribution lists whit deliver? Dovecot version is 1.1.2 and postfix 2.5.1 Cheers, Petri

2 11

[Dovecot] Read-only FS
by Radomir Zoltowski 01 Sep '08

01 Sep '08

Hi all, Imagine an NFS mounted read-only file system containing directories full of plain mboxes. Any recommendations on how to approach the access with dovecot? I believe all NFS recommended options apply, how about index/cache files though? Can I switch them off deliberately for good? Performance degradation is not an issue. Thanks, R. -- _________________________________________________________ Radomir Zoltowski <Radomir.Zoltowski(a)s3group.com> Applications Engineer Silicon & Software Systems Ltd., IT Department South County Business Park, Leopardstown, Dublin 18, IRELAND Tel.: +353 1 291 1224, Fax: +353 1 291 1001 _________________________________________________________ The information contained in this e-mail and in any attachments is confidential and is designated solely for the attention of the intended recipient(s). If you are not an intended recipient, you must not use, disclose, copy, distribute or retain this e-mail or any part thereof. If you have received this e-mail in error, please notify the sender by return e-mail and delete all copies of this e-mail from your computer system(s). Please direct any additional queries to: communications(a)s3group.com. Thank You. Silicon and Software Systems Limited. Registered in Ireland no. 378073. Registered Office: South County Business Park, Leopardstown, Dublin 18

2 2

[Dovecot] Dovecot 1.1.1 + zlib plugin + mbox crash
by Chris Wakelin 01 Sep '08

01 Sep '08

I've tried this on both Solaris 8 and SuSE Enterprise 9 (64-bit). I get a assert-crash when using a gzipped mbox folder . OK Logged in. . SELECT test.gz * FLAGS (\Answered \Flagged \Deleted \Seen \Draft $Label4 $Label2 $Label1 $Label3 $Label5) * OK [PERMANENTFLAGS ()] Read-only mailbox. * 167 EXISTS * 0 RECENT * OK [UNSEEN 2] First unseen. * OK [UIDVALIDITY 1096038620] UIDs valid * OK [UIDNEXT 42890] Predicted next UID . OK [READ-ONLY] Select completed. . FETCH 167 FULL * 167 FETCH (FLAGS () INTERNALDATE "05-Jan-2003 07:05:37 +0000" RFC822.SIZE 4693 ENVELOPE ("Sat, 04 Jan 2003 21:05:48 -0800" "[xxxxxxx] xx: xxxx xxxxxxxxxxx" (("xxxxx xxxxxxxx" NIL "xxxxxxxxxxxx" "xxxxx.xxx")) ((NIL NIL "xxxxxxx-xxxxxx" "xxxxxxxxxx.xx")) (("xxxxx xxxxxxxx" NIL "xxxxxxxxxxxx" "xxxxx.xxx")) (("xxxxxxx xxxx xxxx" NIL "xxxxxxx" "xxxxxxxxxx.xx")) NIL NIL NIL "<xxxxxxxx.xxxxxxx(a)xxxxx.xxx>") BODY ("text" "plain" ("charset" "us-ascii" "format" "flowed") NIL NIL "7bit" 3408 35)) . OK Fetch completed. . FETCH 167 BODY[] Connection closed by foreign host. dovecot: Jul 23 15:35:39 Info: imap-login: Login: user=<xxxxxxxx>, method=PLAIN, rip=xxx.xxx.xxx.xxx, lip=xxx.xxx.xxx.xxx dovecot: Jul 23 15:35:39 Info: auth(default): new auth connection: pid=841 dovecot: Jul 23 15:35:54 Panic: IMAP 888 xxxxxxxx xxx.xxx.xxx.xxx : file istream-raw-mbox.c: line 363 (i_stream_create_raw_mbox): assertion failed: (input->v_offset == 0) dovecot: Jul 23 15:35:54 Error: IMAP 888 xxxxxxxx xxx.xxx.xxx.xxx : Raw backtrace: imap [0x4833b8] -> imap [0x483413] -> imap [0x482e46] -> imap [0x43ce47] -> imap(mbox_file_open_stream+0x40) [0x434f40] -> imap [0x4363c1] -> imap [0x436778] -> imap(mail_get_stream+0xa) [0x4547ea] -> imap(index_mail_set_seq+0x144) [ 0x44b444] -> imap [0x436a79] -> imap(mail_set_seq+0x7) [0x454697] -> imap(index_storage_search_next_nonblock+0xd7) [0x44ef07] -> imap(mailbox_search_next_non block+0x10) [0x455ef0] -> imap(mailbox_search_next+0x20) [0x455f20] -> imap(imap_fetch+0x87) [0x41d457] -> imap(cmd_fetch+0x1f4) [0x4174b4] -> imap [0x41b2e4 ] -> imap [0x41b2d8] -> imap [0x41bc91] -> imap(client_input+0x5f) [0x41bdaf] -> imap(io_loop_handler_run+0xf7) [0x489d97] -> imap(io_loop_run+0x28) [0x48906 8] -> imap(main+0x462) [0x4233b2] -> /lib64/tls/libc.so.6(__libc_start_main+0xea) [0x2a9578caaa] -> imap(__ctype_b_loc+0x4a) [0x415b3a] dovecot: Jul 23 15:35:54 Error: child 888 (imap) killed with signal 6 dovecot -n output: # 1.1.1: /opt/RDGdovect/etc/dovecot.conf base_dir: /opt/RDGdovect/var/run/ log_path: /opt/RDGdovect/var/log/dovecot.log info_log_path: /opt/RDGdovect/var/log/dovecot.log protocols: imap listen: *:143 ssl_disable: yes disable_plaintext_auth: no shutdown_clients: no login_dir: /opt/RDGdovect/var/run/login login_executable: /opt/RDGdovect/libexec/dovecot/imap-login login_greeting: University of Reading IMAP test1.1 ready. login_process_per_connection: no verbose_proctitle: yes mail_location: mbox:/export/folders/%13.h/mail/:INBOX=/export/mail/%13.h/INBOX:INDEX=/export/indexes/%13.h mbox_very_dirty_syncs: yes mail_drop_priv_before_exec: yes mail_plugins: zlib mail_log_prefix: %Us %p %u %r : imap_client_workarounds: outlook-idle delay-newmail auth default: mechanisms: plain login username_format: %Ln verbose: yes debug: yes passdb: driver: ldap args: /opt/RDGdovect/etc/dovecot-ldap.conf userdb: driver: passwd-file args: /opt/RDGdovect/etc/userdb I've attached the relevant test.gz file (anonymised for the test) Has anybody else got it working? Best Wishes, Chris -- --+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+- Christopher Wakelin, c.d.wakelin(a)reading.ac.uk IT Services Centre, The University of Reading, Tel: +44 (0)118 378 8439 Whiteknights, Reading, RG6 2AF, UK Fax: +44 (0)118 975 3094

3 16

Re: [Dovecot] Authentication problems
by Rodti MacLeary 01 Sep '08

01 Sep '08

On Mon, 01 Sep 2008 17:17:27 +0300, Timo Sirainen <tss(a)iki.fi> wrote: >> Extracts of /var/log/mail.log attached below. Nothing new in mail.err. > > Those are only Postfix's logs. See Dovecot's logs. > http://wiki.dovecot.org/Logging Sorry, I pulled these from syslog: Sep 1 13:52:36 localhost dovecot: imap-login: Login: user=<user(a)domain.tld>, method=PLAIN, rip=xxx.xxx.xxx.xxx, lip=xxx.xxx.xxx.xxx, TLS Sep 1 13:52:57 localhost dovecot: imap-login: Login: user=<user(a)domain.tld>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Sep 1 13:52:57 localhost dovecot: IMAP(user(a)domain.tld): Disconnected: Logged out Sep 1 13:53:01 localhost dovecot: imap-login: Login: user=<user(a)domain.tld>, method=PLAIN, rip=xxx.xxx.xxx.xxx, lip=xxx.xxx.xxx.xxx, TLS Sep 1 13:53:08 localhost postfix/smtpd[6047]: connect from unknown[xxx.xxx.xxx.xxx] Sep 1 13:53:09 localhost postfix/smtpd[6047]: lost connection after EHLO from unknown[xxx.xxx.xxx.xxx] Sep 1 13:53:09 localhost postfix/smtpd[6047]: disconnect from unknown[xxx.xxx.xxx.xxx] Sep 1 13:53:12 localhost postfix/smtpd[6047]: connect from unknown[xxx.xxx.xxx.xxx]

1 0