November 2005 - dovecot

[Dovecot] Hang in 1.0.alpha4
by Mark Plaksin 26 Jan '06

26 Jan '06

My IMAP client hangs intermittently. When it does, Dovecot has prematurely stopped sending a response and entered the poll loop. My client is waiting for more data and Dovecot is waiting for an IMAP command. This problem seems to occur when I connect to the dovecot process over the network and when I run the imap binary directly via an SSH tunnel. Below is truss output from the imap process for one of the hangs. It is responding to a FETCH, gets EAGAIN, and then seems to give up sending the rest of the message and enters the poll loop. Below that is the log from my IMAP client to show its side of the story. Nothing shows up in the normal Dovecot log. I haven't caught it in the act recently when running with rawlog. But rawlog output from before I was running with truss shows that Dovecot does not think it has finished sending its response. truss output: 12951: stat64("/home/happy/Mail/banner-ss", 0xFFBFF200) = 0 12951: fstat64(12, 0xFFBFF388) = 0 12951: stat64("/home/happy/Mail/.imap/banner-ss/dovecot.index", 0xFFBFF2F0) = 0 12951: fstat64(18, 0xFFBFF388) = 0 12951: pread64(18, "\n F r o m b e v e r l".., 4096, 1592560) = 4096 12951: pread64(18, " S u n G a r d * S C".., 4094, 1596656) = 4094 12951: pread64(18, " M i c r o s o f t S a".., 4094, 1600750) = 4094 12951: pread64(18, " r g a r e t . d i l l a".., 4094, 1604844) = 3720 12951: pread64(18, 0x0025EEA2, 374, 1608564) = 0 12951: pread64(18, 0x0025EEA2, 374, 1608564) = 0 12951: pread64(18, " R e t u r n - P a t h :".., 4096, 1592616) = 4096 12951: write(1, " * 2 5 0 F E T C H ".., 4073) = 4073 12951: pread64(18, " a l v e r n , P A ".., 4095, 1596712) = 4095 12951: write(1, "\n W i l l i a m B . ".., 4060) = 4060 12951: pread64(18, " l ( i n c l u d i n g".., 4095, 1600807) = 4095 12951: write(1, "\n & # 8 2 2 6 ; < / b".., 4069) = 4069 12951: pread64(18, " m o z - t x t - l i n k".., 4095, 1604902) = 3662 12951: write(1, "\n ".., 4079) Err#11 EAGAIN 12951: write(1, "\n ".., 4096) Err#11 EAGAIN 12951: poll(0x000A0AD0, 3, 533) = 1 12951: write(1, "\n ".., 4096) = 4096 12951: poll(0x000A0AD0, 2, 532) = 0 12951: poll(0x000A0AD0, 2, 0) = 0 12951: poll(0x000A0AD0, 2, 999) (sleeping...) 12951: poll(0x000A0AD0, 2, 999) = 0 Here's the log from my IMAP client. I removed email addresses and most of the body of the message to protect the innocent. The "BYE" was caused by me running 'kill $PID' on the imap process. 3551 OK Fetch completed.! 3552 UID FETCH 252 BODY.PEEK[] * 250 FETCH (UID 252 BODY[] {16341}! Return-Path: <abc(a)usg.edu>! Received: from usg.edu (abc.usg.edu [1.2.8.1])! by abc.usg.edu (8.12.11/8.12.11) with ESMTP id j9KFqoga012884! for <abc(a)USG.EDU>; Thu, 20 Oct 2005 11:52:50 -0400 (EDT)! Message-ID: <4357BD52.1020506(a)usg.edu>! Date: Thu, 20 Oct 2005 11:52:50 -0400! From: abc <abc(a)usg.edu>! User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax)! X-Accept-Language: en-us, en! MIME-Version: 1.0! To: abc(a)usg.edu! Subject: [Fwd: [Fwd: Fw: Java Library Problem]] - URGENT, I'm sorry...! Content-Type: multipart/mixed;! boundary="------------010604070704040405060605"! X-USG-MailScanner: Found to be clean! X-USG-MailScanner-SpamCheck: ! X-MailScanner-From: abc(a)usg.edu! ! This is a multi-part message in MIME format.! --------------010604070704040405060605! Content-Type: multipart/alternative;! boundary="------------040009050704020209010709"! ! ! --------------040009050704020209010709! Content-Type: text/plain; charset=us-ascii; format=flowed! Content-Transfer-Encoding: 7bit! ! Guys,! Please create a ssh login on... from ! 24 hours now) with testing. His account should look like Patrick ! I've requested a static IP from Dan.! ! ...! </pre>! </body>! </html>! ! --------------040009050704020209010709--! ! --------------010604070704040405060605! Content-Type: text/x-vcard;! Content-Transfer-Encoding: 7bit! Content-Disposition: attachment;! ! begin:vcard! ...! tel;work:(xxx) xxx-2000! tel;fax:(xxx) xxx-xxxx! url:http://www.u* BYE Server shutting down.! imap(happy): Warning: Killed with signal 15 ------------------------------------------------------------------------------ The mail message in question actually ends like this: tel;work:(xxx) xxx-2000 tel;fax:(xxx) 583xxx-xxxx url:http://www.usg.edu version:2.1 end:vcard --------------010604070704040405060605--

4 12

[Dovecot] How to disable keywords?
by Sebastjan Trepca 30 Dec '05

30 Dec '05

Hi, is there a quick way to disable keyword feature in dovecot? Thanks, Sebastjan

2 4

[Dovecot] messages_count too large (2578 > 2566) Help!
by Rob Frohne 20 Dec '05

20 Dec '05

Hi, I'm having trouble as of about noon today. I noticed I wasn't getting any new messages in Thunderbird. I restarted it and still nothing. I looked at the log, and found nothing from dovecot for a long time (since perhaps noon today). I restarted dovecot, but still it didn't get me new mail. I finally removed dovecot.* in my Maildir folder and restarted dovecot. I'm using 1.0alpha4. Now I'm still not able to get the new mail, and I get the following messages: Nov 20 20:49:59 cubex-wwc-edu dovecot: imap-login: Login: user=<frohro>, method=plain, rip=172.17.128.191, lip=10.7.3.11 Nov 20 20:49:59 cubex-wwc-edu dovecot: imap(frohro): Effective uid=501, gid=20 Nov 20 20:49:59 cubex-wwc-edu dovecot: imap(frohro): maildir: data=/Users/frohro/Maildir Nov 20 20:49:59 cubex-wwc-edu dovecot: imap(frohro): maildir: root=/Users/frohro/Maildir, index=/Users/frohro/Maildir, control=, inbox= Nov 20 20:50:00 cubex-wwc-edu dovecot: imap(frohro): Corrupted index file /Users/frohro/Maildir/dovecot.index: messages_count too large (2578 > 2566) Nov 20 20:50:00 cubex-wwc-edu dovecot: imap(frohro): Corrupted index file /Users/frohro/Maildir/dovecot.index: messages_count too large (2578 > 2566) Nov 20 20:50:08 cubex-wwc-edu dovecot: imap(frohro): Corrupted index file /Users/frohro/Maildir/dovecot.index: messages_count too large (2588 > 2576) Nov 20 20:50:25 cubex-wwc-edu dovecot: imap-login: Login: user=<frohro>, method=plain, rip=172.17.128.191, lip=10.7.3.11 Nov 20 20:50:25 cubex-wwc-edu dovecot: imap(frohro): Effective uid=501, gid=20 Nov 20 20:50:25 cubex-wwc-edu dovecot: imap(frohro): maildir: data=/Users/frohro/Maildir Nov 20 20:50:25 cubex-wwc-edu dovecot: imap(frohro): maildir: root=/Users/frohro/Maildir, index=/Users/frohro/Maildir, control=, inbox= Nov 20 20:50:25 cubex-wwc-edu dovecot: imap(frohro): Corrupted index file /Users/frohro/Maildir/dovecot.index: messages_count too large (2588 > 2576) Nov 20 20:50:25 cubex-wwc-edu dovecot: imap(frohro): Corrupted index file /Users/frohro/Maildir/dovecot.index: messages_count too large (2588 > 2576) Nov 20 20:50:26 cubex-wwc-edu dovecot: imap(frohro): Corrupted index file /Users/frohro/Maildir/dovecot.index: messages_count too large (2588 > 2576) I guess I won't be able to read any answers to this in my mailbox, but I should be able to read the archive on the web. Please help! Thanks, Rob -- Rob Frohne, Ph.D., P.E. E.F. Cross School of Engineering Walla Walla College 100 SW 4th Street College Place, WA 99324 (509) 527-2075 http://www.wwc.edu/~frohro

3 3

[Dovecot] checkpassword authentication
by Florian Füessl 14 Dec '05

14 Dec '05

Hi, does anyone already use the checkpassword authentication scheme? I have not found any description how I have to configure dovecot in order to work together with qmails checkpassword. Enabling passdb = checkpassword /bin/checkpassword in dovecot.conf starts /bin/checkpassword for every authentication request, but the result does not seem to matter for the authentication. Without enabling a userdb entry, dovecot claims not to be able to find out the uid, gid and home of the user, although checkpassword replies these values. Setting static values with "userdb = static uid=$fixed_mail_uid gid=$fixed_mail_gid home=/maildata/%d/%n" results in being every login successful, no matter if the checkpassword authentication is ok, or not. I'm using the latest dovecot nightly build from 22. Nov. 2005. - Florian

3 2

[Dovecot] Is Timo OK?
by Udo Rader 12 Dec '05

12 Dec '05

Hi, does anyone know where Timo is around lately? I haven't seen a post from him for some weeks now and "normally" Timo is quite active when it comes to supporting his 'dovecot' warp drive :-) Udo Rader -- bestsolution.at EDV Systemhaus GmbH http://www.bestsolution.at

18 40

[Dovecot] ioloop-select bug in alpha 4
by Kevin Van Vechten 12 Dec '05

12 Dec '05

Howdy, Forgive me if this issue has been more recently addressed in CVS, but a quick scan of the archives didn't turn up any other reports. There appears to be a small typo in src/lib/ioloop-select.c: --- dovecot-1.0.alpha4/src/lib/ioloop-select.c.orig 2005-11-06 22:06:53.000000000 -0800 +++ dovecot-1.0.alpha4/src/lib/ioloop-select.c 2005-11-06 22:07:13.000000000 -0 800 @@ -113,7 +113,7 @@ sizeof(fd_set)); memcpy(&tmp_write_fds, &ioloop->handler_context->write_fds, sizeof(fd_set)); - memcpy(&tmp_except_fds, &ioloop->handler_data->except_fds, + memcpy(&tmp_except_fds, &ioloop->handler_context->except_fds, sizeof(fd_set)); ret = select(ioloop->handler_context->highest_fd + 1, Thanks, Kevin

3 2

[Dovecot] "Out of memory" error in 1.0alpha3
by Sergey A. Lipnevich 10 Dec '05

10 Dec '05

Hi All, I have Dovecot 1.0 Alpha3 running on x86_64 Linux 2.6 multi-CPU box using Maildir folders. Moving messages from one folder to another in Thunderbird 1.0.7, regardless of their size (usually small), produced error 83, "Out of memory", when both of these parameters were unset (default): mail_read_mmaped, mmap_disable. The log line before the error was pool_system_malloc(): Out of memory. I initially changed mmap_disable to "yes", the error stopped, but it still wasn't moving messages reliably. I then set MM parameters more aggressively: mail_read_mmaped = yes, mmap_disable = no (and the third of the series, mmap_no_write, is left unset). The error stopped popping up, and the moving works speedily. Maybe the default for mail_read_mmaped should be "yes?" Thank you! Sergey.

5 10

[Dovecot] Dovecot auth patch updated for Postfix 2.3-20051121
by /dev/rob0 09 Dec '05

09 Dec '05

Once again I have updated Timo's auth patch for Postfix 2.2.1 to work with a 2.3 snapshot. It applied cleanly and compiled and is running for me, but is not really tested. This is Timo's code, not mine. All I did was manually edit in the rejects from the old patch. Find it here if you're interested: http://www.nodns4.us/postfix-2.3-20051121-dovecot-auth.patch.gz md5sum: 6f01782a118f5407f1ed40f4714504cd postfix-2.3-20051121-dovecot-auth.patch.gz The original patch is here: http://dovecot.org/patches/postfix/postfix-2.2.1-dovecot-auth.patch -- mail to this address is discarded unless "/dev/rob0" or "not-spam" is in Subject: header

2 2

[Dovecot] Dovecot login hangs often
by P P Anwar 08 Dec '05

08 Dec '05

Hi - We have dovecot version : 0.99.11 release : 2.EL4.1 on Centos 4.2, with an LDAP backend (Samba PDC) and pam set to authenticate against LDAP. Dovecot is set to use pam for authentication. It uses mbox, and the machine has very little load (95% idle, no memory pressure). Every 36 hours or so, no users are able to login to imap (we have only imap enabled). Other services that use the same backend are working fine (like squid and ssh logins) even while this is happening. So we are not sure if we can blame this on pam/ldap problems. When this happens, we tried a "service dovecot restart", and that results in saying the "address is in use". About 10 "imap-login" processes seem to lurk around holding on to the imap port. We can get dovecot service to start again, only after a "killall -9 imap-login". What kind of debug should we enable so that you all can diagnose this further ? Any other configuration things that we should try ? We prefer to stay with Redhat/Centos releases, but if this is already reportedly fixed in one of the later builds, we are open to trying one. Regards, Anwar.

1 1

[Dovecot] Pop-before-smtp and MySQL?
by Matteo Garofano 07 Dec '05

07 Dec '05

Hi, I found that dovecot have many nice features. Now I write because I'm tring to setup the dovecot server, I would substitute a qpopper daemon (patched for mysql authentication) The problem I find is to set up the pop-before-smtp using sql (mysq) as written in http://wiki.dovecot.org/moin.cgi/PopBSMTPAndDovecot (Waiting for post_login ;-) I would use the script popbsmtp.sh and not a perl pig. (I'm using qpopper patched to store the relay IP in mysql and it works) I set .my.cnf in /root What happen is that the $3 don't contain the IP that should be written to the DB. Is there something I miss ? I tried to modify the dovecot.conf file like this mail_executable = /usr/local/libexec/dovecot/popbsmtp.sh /usr/local/libexec/dovecot/pop3 %r "%r" and it write to the db the litteral value %r and not the ip, otherwise it write nothing. the connection with mysql works and any other operation on it works. this should be the last step for my setting. Have you any hint? Thanks in advance and best regards Matteo Garofano

7 16