- dovecot - dovecot.org

[Dovecot] v2.1.rc5 released
by Timo Sirainen 27 Jan '12

27 Jan '12

http://dovecot.org/releases/2.1/rc/dovecot-2.1.rc5.tar.gz http://dovecot.org/releases/2.1/rc/dovecot-2.1.rc5.tar.gz.sig I'm still lagging behind reading emails. v2.1.0 will be released after I've finished that. RC5 is already stable and used in production, but I want to make sure that I haven't missed anything important that was reported previously. Most of the recent fixed bugs existed also in v2.0 series. Changes since rc3: * Temporary authentication failures sent to IMAP/POP3 clients now includes the server's hostname and timestamp. This makes it easier to find the error message from logs. + auth: Implemented support for Postfix's "TCP map" sockets for user existence lookups. + auth: Idling auth worker processes are now stopped. This reduces error messages about MySQL disconnections. - director: With >2 directors ring syncing might have stalled during director connect/disconnect, causing logins to fail. - LMTP client/proxy: Fixed potential hanging when sending (big) mails - Compressed mails with external attachments (dbox + SIS + zlib) failed sometimes with bogus "cached message size wrong" errors. (I skipped rc4 release, because I accidentally tagged it too early in hg.)

5 8

Re: [Dovecot] auth-worker temporary failures causing lmtp 500 rejection
by Mark Zealey 26 Jan '12

26 Jan '12

Hi Timo thanks for the patch; I have now analyzed network dumps & discovered that the cause is actually our frontend mail servers not dovecot - we were delivering to the wrong lmtp port which we then use in the mysql query hence getting empty records. Sorry about this! Mark ________________________________________ From: Mark Zealey Sent: 26 January 2012 14:37 To: Timo Sirainen Cc: dovecot(a)dovecot.org Subject: RE: [Dovecot] auth-worker temporary failures causing lmtp 500 rejection I've tried reproducing by having long running auth queries in the sql and KILLing them on the server, restarting the mysql service, and setting max auth workers to 1 and running 2 sessions at the same time (with long-running auth queries), but to no effect. There must be something else going on here; I saw it in particular when exim on our frontend servers had queued a large number of messages and suddenly released them all at once hence the auth-worker hypothesis although the log messages do not support this. I'll try to see if I can trigger this manually although we have been doing some massively parallel testing previously and not seen this. Mark ________________________________________ From: Timo Sirainen [tss(a)iki.fi] Sent: 26 January 2012 12:31 To: Mark Zealey Cc: dovecot(a)dovecot.org Subject: Re: [Dovecot] auth-worker temporary failures causing lmtp 500 rejection On 26.1.2012, at 12.14, Mark Zealey wrote: > I'm using dovecot 2.0.16 with a mysql user database. From time to time when we have a big influx of messages (perhaps more than 30 concurrent rcpt to:<> sessions at the same time so no auth-workers free?) or when we have a transient issue connecting to the database server, we see the message: > > Jan 25 16:38:23 mailbox dovecot: auth-worker: sql(foo(a)bar.com,1.2.3.4): Unknown user This happens only when the SQL query doesn't return any rows, but does return success. > and the lmtp process returns: > > 550 5.1.1 <foo(a)bar.com> User doesn't exist: foo(a)bar.com > > This would be correct for a permanent error where the user doesn't exist in our database, however it seems to be doing this on transient errors too. Is this an issue with the code or perhaps some setting I have missed? The problem is that temporary errors are returning "unknown user". Can you reproduce this somehow? Like if you stop MySQL it always returns that "Unknown user"?

1 0

[Dovecot] auth-worker temporary failures causing lmtp 500 rejection
by Mark Zealey 26 Jan '12

26 Jan '12

Hi there, I'm using dovecot 2.0.16 with a mysql user database. From time to time when we have a big influx of messages (perhaps more than 30 concurrent rcpt to:<> sessions at the same time so no auth-workers free?) or when we have a transient issue connecting to the database server, we see the message: Jan 25 16:38:23 mailbox dovecot: auth-worker: sql(foo(a)bar.com,1.2.3.4): Unknown user and the lmtp process returns: 550 5.1.1 <foo(a)bar.com> User doesn't exist: foo(a)bar.com This would be correct for a permanent error where the user doesn't exist in our database, however it seems to be doing this on transient errors too. Is this an issue with the code or perhaps some setting I have missed? Thanks, Mark

4 4

[Dovecot] Persistence of UIDs
by Jean-Daniel Beaubien 26 Jan '12

26 Jan '12

Hi everyone, I have a question concerning UIDs. How persistant are they? I am thinking about building some form of webmail specialized for some specific business purpose and I am thinking of building a sort of cache in a DB by storing the email addr, date, subject and UID for quick lookups and search of correspondance. I am doing this because I am having issue with multiple people searching thru email folders that have 100k+ emails (which is another problem in itself, searches don't seem to scale well when folder goes above 60k emails). So to come back to my question, can I store the UIDs and reuse those UIDs later on to obtain the body of the email??? Or can the UIDs change on the server and they will not be valid anymore?. My setup is: - dovecot 1.x (will migrate to 2.x soon) - maildir - everything stored on an intel 320 SSD (index and maildir folder) Thanks, -JD

4 8

Re: [Dovecot] Imap Quota Exceeded - But Still Receiving Emails?
by Daniel L. Miller 26 Jan '12

26 Jan '12

On 1/25/2012 2:01 AM, Palatine Web Support wrote: > On 2012-01-25 05:38, Daniel L. Miller wrote: >> On 1/24/2012 8:35 AM, Palatine Web Support wrote: >>> >>> Here is my dovecot config: >>> >>> plugin { >>> quota = maildir:User Quota >>> quota_rule2 = Trash:storage=+100M >>> } >> [..] >>> >>> So it picks up my set quota of 3MB but dovecot is not rejecting >>> emails if I am over my quota. >>> >>> Can anyone help? >>> >> Is the quota plugin being loaded? What is the output of: >> >> doveconf | grep -B 2 plug > > The modules are being loaded. From the log file with debugging enabled: > > Jan 25 09:59:58 mail dovecot: IMAP(xxx(a)xxx.com): Loading modules from > directory: /usr/lib/dovecot/modules/imap > Jan 25 09:59:58 mail dovecot: IMAP(xxx(a)xxx.com): Module loaded: > /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so > Jan 25 09:59:58 mail dovecot: IMAP(xxx(a)xxx.com): Module loaded: > /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so > Jan 25 09:59:58 mail dovecot: IMAP(xxx(a)xxx.com): Effective uid=150, > gid=8, home=/var/vmail/xxx.com/support > Jan 25 09:59:58 mail dovecot: IMAP(xxx(a)xxx.com): Quota root: name=User > Quota backend=dirsize args= > Jan 25 09:59:58 mail dovecot: IMAP(xxx(a)xxx.com): Quota rule: root=User > Quota mailbox=* bytes=3145728 messages=0 > Jan 25 09:59:58 mail dovecot: IMAP(xxx(a)xxx.com): Quota rule: root=User > Quota mailbox=Trash bytes=104857600 messages=0 > Jan 25 09:59:58 mail dovecot: IMAP(xxx(a)xxx.com): maildir: > data=/var/vmail/xxx.com/support > Jan 25 09:59:58 mail dovecot: IMAP(xxx(a)xxx.com): maildir++: > root=/var/vmail/xxx.com/support, index=, control=, > inbox=/var/vmail/xxx.com/support > Jan 25 09:59:58 mail dovecot: IMAP(xxx(a)xxx.com): Namespace : Using > permissions from /var/vmail/xxx.com/support: mode=0700 gid=-1 > Jan 25 09:59:58 mail dovecot: IMAP(xxx(a)xxx.com): Disconnected: Logged > out bytes=82/573 > Jan 25 09:59:58 mail dovecot: IMAP(xxx(a)xxx.com): Disconnected: Logged > out bytes=269/8243 > I don't know if it makes any difference, but in your config file, try changing: plugin { quota = maildir:User Quota to plugin { quota = maildir:User quota (lowercase the "quota") -- Daniel

2 1

Re: [Dovecot] dovecot Digest, Vol 105, Issue 57
by Arun Gupta 26 Jan '12

26 Jan '12

Dear Sir, Thanks for your reply and I really agreed your point about 'reject mail for users over quota', but I don't want to do it if it is possible to without reject mails to deliver mails from spool to user's home directory automatically, kindly provide solution. I will be highly obliged all of you. -- Thanks & Regards, Arun Kumar Gupta > formate) automatically > Message-ID: <alpine.DEB.1.10.1201251327580.7664(a)flfnqz.fnat.pqnp.va> > Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII > > > Hi, > > I am using dovecot 2.0.16, and assigend globally procmailrc > (/etc/procmailrc) which delivers mails to user's home directory in maildir > formate. Also I assined quota to User through setquota (edquota) command, > If the quota excedded then this case user's mail store to > /var/spool/mail/user. After incresing quota how to delivered these mails > to user's home dir in maildir formate automatically. > > Thanks & Regards, > > Arun Kumar Gupta > Best practice is to reject mail for users over quota (as long as you do this during the smtp transaction... Otherwise, whats the point? (they can still fill up your server)... -- Best regards, Charles -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.

1 0

[Dovecot] Crash on mail folder delete
by Daniel L. Miller 26 Jan '12

26 Jan '12

Attempting to delete a folder from within the trash folder using Thunderbird. I see the following in the log: Jan 25 15:36:22 bubba dovecot: imap(dmiller(a)amfes.com): Panic: file mailbox-list-fs.c: line 156 (fs_list_get_path): assertion failed: (mailbox_list_is_valid_pattern(_list, name)) Jan 25 15:36:22 bubba dovecot: imap(dmiller(a)amfes.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3efba) [0x7f5fe9f86fba] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3f006) [0x7f5fe9f87006] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x17f5a) [0x7f5fe9f5ff5a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x47287) [0x7f5fea214287] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0x6c71) [0x7f5fe8b9cc71] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0x6d47) [0x7f5fe8b9cd47] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(acl_mailbox_allocated+0x9e) [0x7f5fe8ba061e] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(hook_mailbox_allocated+0x62) [0x7f5fea2085b2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_alloc+0xb2) [0x7f5fea2073d2] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete](cmd_delete+0x72) [0x409922] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete](command_exec+0x3d) [0x4109ad] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete]() [0x40f97e] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete]() [0x40fa5d] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete](client_handle_input+0x135) [0x40fc85] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete](client_input+0x5f) [0x4105af] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f5fe9f93406] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f5fe9f9448f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f5fe9f933a8] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f5fe9f803b3] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete](main+0x301) [0x418a61] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7f5fe9be3d8e] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete]() [0x4083f9] Jan 25 15:36:23 bubba dovecot: imap(dmiller(a)amfes.com): Panic: file mailbox-list-fs.c: line 156 (fs_list_get_path): assertion failed: (mailbox_list_is_valid_pattern(_list, name)) Jan 25 15:36:23 bubba dovecot: imap(dmiller(a)amfes.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3efba) [0x7f33673dafba] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3f006) [0x7f33673db006] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x17f5a) [0x7f33673b3f5a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x47287) [0x7f3367668287] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0x6c71) [0x7f3365ff0c71] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0x6d47) [0x7f3365ff0d47] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(acl_mailbox_allocated+0x9e) [0x7f3365ff461e] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(hook_mailbox_allocated+0x62) [0x7f336765c5b2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_alloc+0xb2) [0x7f336765b3d2] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete](cmd_delete+0x72) [0x409922] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete](command_exec+0x3d) [0x4109ad] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete]() [0x40f97e] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete]() [0x40fa5d] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete](client_handle_input+0x135) [0x40fc85] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete](client_input+0x5f) [0x4105af] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f33673e7406] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f33673e848f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f33673e73a8] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f33673d43b3] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete](main+0x301) [0x418a61] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7f3367037d8e] -> dovecot/imap [dmiller(a)amfes.com 192.168.0.91 delete]() [0x4083f9] Jan 25 15:36:23 bubba dovecot: imap(dmiller(a)amfes.com): Fatal: master: service(imap): child 6074 killed with signal 6 (core dumps disabled) Jan 25 15:36:23 bubba dovecot: imap(dmiller(a)amfes.com): Fatal: master: service(imap): child 6589 killed with signal 6 (core dumps disabled) -- Daniel

2 2

[Dovecot] FOSDEM
by Timo Sirainen 26 Jan '12

26 Jan '12

I'll be in FOSDEM giving a small lightning talk about Dovecot: http://fosdem.org/2012/schedule/event/dovecot I'll also be around in FOSDEM the whole time, so if you're there and want to talk to me about anything, send me an email at some point. Poll to dovecot-news list people: Do you want to see these kind of news about my upcoming talks sent to the list? Probably happens a few times/year. A simple "yes" or "no" reply to this mail privately to me is enough.

2 1

[Dovecot] Dovecot antispam plugint got an empty message
by Petr Bravenec 25 Jan '12

25 Jan '12

Few weeks ago I upgraded dovecot from 1.2 to 2.0.16 and antispam plugin to 2.0_pre20101222. Since the upgrade I'm not able to move messages to my Junk folder. In the maillog I have found this message: dspam[25060]: empty message (no data received) Message is copied from my INBOX to Junk folder, but dspam got an empty message and sent an error return code. So the moving operation is not successfull and the original message in INBOX was not deleted. The dspam was not trained (got an empty message). Looking to source code of dspam and antispam plugin I suspect the dovecot not to sending any content to plugin. Can you help me, please? Petr Bravenec

3 2

Re: [Dovecot] Imap Quota Exceeded - But Still Receiving Emails?
by Daniel L. Miller 25 Jan '12

25 Jan '12

On 1/25/2012 1:39 AM, Palatine Web Support wrote: > On 2012-01-25 05:38, Daniel L. Miller wrote: >> On 1/24/2012 8:35 AM, Palatine Web Support wrote: >>> >>> Here is my dovecot config: >>> >>> plugin { >>> quota = maildir:User Quota >>> quota_rule2 = Trash:storage=+100M >>> } >> [..] >>> >>> So it picks up my set quota of 3MB but dovecot is not rejecting >>> emails if I am over my quota. >>> >>> Can anyone help? >>> >> Is the quota plugin being loaded? What is the output of: >> >> doveconf | grep -B 2 plug > > Hi Daniel > > I tried the command and it returned the command was not found. I have > installed: > > apt-get install dovecot-common > apt-get install dovecot-dev > apt-get install dovecot-imapd > > > Which package does the binary doveconf come from? You need to make sure to reply to the list - not just to me. If you don't have doveconf...what version of Dovecot are you using? -- Daniel

1 0