September 2006 - dovecot

[Dovecot] Dovecot behaviour when the server's file system fails (possible feature request)
by Timo Neuvonen 09 Oct '06

09 Oct '06

I've met a couple of times a situation, that there is something wrong with the mail server's operating system / file system, but Dovecot is still working, although it cannot any more access the mailbox files. The result is, that the imap mail client in the workstation automatically synchronises with the improperly empty-looking mailbox, effectively deleting everything previously loaded into the workstation's mail client (eg. Outlook Express) when using imap protocol. This is very annoying, especially when the workstation isn't connected with a high-speed-enough connection, since after the server is properly brought up again, reloading all the contents of the improperly emptied mail client may take considerable amount of time. This is especially the case, if the workstation has kind of mobile connection (eg. gprs) with very limited bandwith -in that case the sychronizing of eg. 20MB account may take at least from half an hour to more than one hour, and in some cases (eg. gprs roaming) also cost considerable amount of money (gprs data transfer may cost from eg. 5 to over 10 euros or dollars per megabyte, when roaming outside the phone operator's own network). So, is there currently a way to configure Dovecot in a way it would recognize that the mailbox actually is not accessible, and in that case it would return an error message to the mail client instead of returning "empty mailbox"? Of course, a smart enough mail client might also ask something from the user, but that seems not be the case either... If this behavious cannot be changed with the current configuration options, then a kind feature request to the developer: Would it be possible to change the behaviour of Dovecot when it actually can not access the mailbox files? Although the actual problem in this case is outside Dovecot, this kind of improvement would greatly improve the error tolerance of the whole system. -- TiN

2 1

[Dovecot] fd leak in 1.0rc7?
by Quentin Garnier 09 Oct '06

09 Oct '06

Hi, I just upgraded a 0.99 installation to 1.0rc7 (going from mbox to maildir along the way, but that's another story), and I'm seeing a rather fast fd quick; I already had to restart dovecot once, after a few hours. What is leaked are pipes, left open on the master dovecot process while the other end is long gone. I can't tell right now if it happens for every single login process spawned (either pop3 or imap), but at least a lot of them. FWIW, I'm running dovecot 1.0rc7 on NetBSD 2.0.3_STABLE. I'll try debugging tomorrow, but if anyone has an idea what happens in the meantime, I'm all hears. -- Quentin Garnier - cube(a)cubidou.net - cube(a)NetBSD.org "When I find the controls, I'll go where I like, I'll know where I want to be, but maybe for now I'll stay right here on a silent sea." KT Tunstall, Silent Sea, Eye to the Telescope, 2004.

2 3

[Dovecot] Pop3s duplicates
by Mark Adams 09 Oct '06

09 Oct '06

Hi, dovecot 1.0 rc6 Can someone please advise on my interpretation of the following logs, Users are reporting duplicate email coming through to their inbox. (user@domain replaced actual username and domain) There are also reports of the connection seemingly freezing whilst the emails are being downloaded (pausing at a certain amount of kB then continuing after a minute or 2). info: pop3-login: Login: user=<user@domain>, method=PLAIN, rip=89.192.*.**, lip=172.16.22.10, TLS info: POP3(user@domain): Disconnected top=0/0, retr=4/183443, del=0/313, size=83779942 info: pop3-login: Login: user=<user@domain>, method=PLAIN, rip=89.192.*.**, lip=172.16.22.10, TLS info: POP3(user@domain): Disconnected top=0/0, retr=3/183443, del=0/322, size=84201570 In the first instance the user downloaded 4 emails totalling 183443 bytes leaving 313 messages on the server. (outlook 2003 set to leave a copy of messages on the server) second instance user downloaded 3 emails, exactly the same amount of bytes and left 322 messages on the server. Does this mean the users connection was interrupted when downloading the original emails and they attempted to be sent again a second time? how could it be that there are 9 emails left on the server if only 3 extra were downloaded? Any help on this would be much appreciated. Thanks, Mark

3 5

[Dovecot] coding techniques
by David Lee 09 Oct '06

09 Oct '06

Whilst debugging a problem in dovecot LDA over the last few days, I came across two different issues in coding techniques. (Note: Please don't take this negatively; my intent is both positive and constructive!) The front page of the website www.dovecot.org says: "it uses several coding techniques to avoid most of the common pitfalls" So I hope it is OK to follow the spirit of that with some suggestions. The two issues I encountered both seem to be fairly easy holes to fall into, and yet equally easy to avoid in the first place by using established C practices. Firstly, many 'if' statements having a single statement (whether in then or else part) are currently written in a short-cut fashion: if (condition) statement 1; else statement 2; This, though technically legal, is potentially lethal when inserting (say) debugging statements. Without diligence it is all to easy to produce: if (condition) debug 1a; statement 1; debug 1b; else debug 2a; statement 2; debug 2b; A simple edit that looks, layout-wise, as if it would do the right thing (and do in Python!); but actually radically changes the execution flow. (This is left as an exercise to the reader... to demonstrate the point.) Could I suggest that the relevant brackets be always used as a matter of course? Something like: if (condition) { statement 1; } else { statement 2; } Then the insertion of debug statements doesn't inflict surprise. (No, I didn't fall into this hole. But it is a trap waiting to happen.) Secondly, code duplication. To give one example: 'get_var_expand_table()' appears in both 'deliver/deliver.c' and 'master/mail-process.c'. (There is also a similar looking function in 'auth/auth-request.c'.) Perhaps consideration should be given to merging such instances. For instance, my woes with "%i"-expansion being treated differently in mail-reading and mail-delivery would likely never have arisen if common code had been used. I hope that helps (constructively!). Best wishes. -- : David Lee I.T. Service : : Senior Systems Programmer Computer Centre : : Durham University : : http://www.dur.ac.uk/t.d.lee/ South Road : : Durham DH1 3LE : : Phone: +44 191 334 2752 U.K. :

2 1

[Dovecot] rc7 crashing under heavy load
by Jeff A. Earickson 09 Oct '06

09 Oct '06

Help! Our students are back and they are pounding my dovecot server to death (ie "Login process died too early - shutting down" or "too many open files" type crash). I've had my third crash today. My setup: Solaris 10, imap and imaps, 3K users coming in via horde webmail. My current connection settings are: login_max_processes_count = 2048 login_max_connections = 4096 Q: Does raising these limits actually make my problem worse or better? Are there any other variables that I should change to prevent the "too many open files"? Suggestions? Jeff Earickson Colby College

6 9

[Dovecot] Dovecot hang
by Catalin Constantin 08 Oct '06

08 Oct '06

Hello, We run dovecot 1.0.rc6-1 on a debian system. The user auth db is postgresql and the storage folders are on a NFS partition. Latelly every 2 days the authentification hangs and i see in the logs: Sep 21 10:04:22 c005 dovecot: login: tried to change state 0 -> 17808 (if you can't login at all, see src/lib/fdpass.c) What is the problem ? What can i do ? Thank you ! -- Catalin Constantin Bounce Software http://www.bounce-software.com http://www.cabanova.ro

2 1

Re: [Dovecot] LIST command ignores "hidden=yes" for default namespace
by Bill Boebel 08 Oct '06

08 Oct '06

On Sun, August 6, 2006 7:57 pm, Timo Sirainen <tss(a)iki.fi> said: > On Wed, 2006-07-05 at 12:04 -0400, Bill Boebel wrote: >> On Sun, June 11, 2006 1:51 pm, Timo Sirainen <tss(a)iki.fi> said: >> > On Mon, 2006-05-08 at 22:03 -0400, Bill Boebel wrote: >> >I'm not sure if this is a bug or just an undesirable feature, but when I >> >have our namespace configured to match Courier's "INBOX." functionality, >> >Dovecot forces me to also define a default namespace (with no prefix). >> >Without the default namespace defined I get "NO Unknown namespace." errors >> >when trying to subscribe or unsubscribe folders. >> > >> > It was a bug when tb-extra-mailbox-sep workaround was enabled. Fixed: >> > http://dovecot.org/list/dovecot-cvs/2006-June/005709.html >> > >> >> The second part of this still seems to be the case with RC2... the LIST command >> ignores "hidden=yes". > > hidden=yes only means it's not listed in NAMESPACE command's reply and > that the namespace prefix isn't shown as a mailbox in LIST replies. > Since the prefix is empty and you're listing the mailboxes from root, it > shows the mailboxes as it should.. > > Correct way would be to just use one namespace and fix the problems > related to it. Could you test with RC6 and show me what commands give > the unknown namespace errors? Subscribing and unsubscribing worked fine > with me. Although INBOX subscription causes some problems with LSUB. > I finally got around to testing this. I tested with RC7 CSV 20060924. And I am testing with just one namespace: namespace private { separator = . prefix = INBOX. inbox = yes } I no longer get the unknown namespace errors. However, INBOX is listed twice in the LIST command: 2 list "" "*" * LIST (\HasChildren) "." "INBOX" * LIST (\HasChildren) "." "INBOX.RSS" * LIST (\HasNoChildren) "." "INBOX.Sent" * LIST (\HasNoChildren) "." "INBOX.Test" * LIST (\HasNoChildren) "." "INBOX.spam" * LIST (\HasNoChildren) "." "INBOX.Trash" * LIST (\HasNoChildren) "." "INBOX.Drafts" * LIST (\HasNoChildren) "." "INBOX" * LIST (\HasNoChildren) "." "INBOX.RSS.Kevin Minnick" If I change the namespace's inbox setting to "inbox = no" it only lists the INBOX once, however subscribing to the INBOX gives the "Unknown namespace." error. 2 list "" "*" * LIST (\HasChildren) "." "INBOX" * LIST (\HasChildren) "." "INBOX.RSS" * LIST (\HasNoChildren) "." "INBOX.Sent" * LIST (\HasNoChildren) "." "INBOX.Test" * LIST (\HasNoChildren) "." "INBOX.spam" * LIST (\HasNoChildren) "." "INBOX.Trash" * LIST (\HasNoChildren) "." "INBOX.Drafts" * LIST (\HasNoChildren) "." "INBOX.RSS.Kevin Minnick" 2 OK List completed. 4 subscribe INBOX 4 NO Unknown namespace.

2 1

[Dovecot] Cache fields
by Tony Kay 08 Oct '06

08 Oct '06

Hi, We are using Dovecot with maildir, and the mail client requests flags, internaldate, and uid for all messages on folder open, which on average takes 3 seconds, but for large folders is much longer. It seems like I want mail_cache_fields to include "flags", but which date corresponds to internaldate? date.received? Is UID always cached for messages, or does it have to read through the directory to get them? Are there other optimizations I can do that will improve the speed of folder opens? -- Anthony Kay University Computing Center (541) 346-1719 GPG Fingerprint: B0DB D46A 60AF FAE7 A94A 5075 0CB4 4D88 9F4F 7F09 This isn't right. This isn't even wrong. Wolfgang Pauli

2 1

[Dovecot] Date Received question
by Timothy Martin 08 Oct '06

08 Oct '06

I migrated from Courier to Dovecot, and today I notice that all my "date received" fields in my client (apple mail) show as the approx date/time of the migration rather than when the emails were received from the smtp server. Is this expected behavior? I normally sort by received date rather than sent -- since I don't care when someone sends something as much as when i get it. But those fields are totally bogus now. .tim

2 1

[Dovecot] Tru64 Unix and SIA
by Simon L Jackson 08 Oct '06

08 Oct '06

I have recently written a (minimal) Tru64 Unix SIA password module for Dovecot as part of testing a Dovecot installation. Has anyone else written a Tru64 Unix SIA module? Is anyone else interested in such a module? If so, how might I/we go about getting this/such a module into the main Dovecot source? Thanks -- Simon L Jackson Carringbush.Net +- Carringbush.Net Hosting * Development * Advice Web: www.carringbush.net <http://www.carringbush.net/> Email: simon.jackson(a)carringbush.net <mailto:simon.jackson@carringbush.net> Office: +61 3 9411 4400 Support: +61 3 9411 4444 Fax: +61 3 9411 4499 Level 1 15 Bedford Street Collingwood VIC 3066 Australia P.O. Box 1464 Collingwood VIC 3066 Australia +-

3 5