From dovecot.user at seibercom.net Thu Dec 1 00:14:06 2011 From: dovecot.user at seibercom.net (Jerry) Date: Wed, 30 Nov 2011 17:14:06 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: <20111130171406.7ac37cbf@scorpio> On Wed, 30 Nov 2011 15:36:46 -0500 Terry Carmen articulated: > I need to make the IMAP interface of an Exchange 2000 server > available on the net, however I would like to give it a little > protection, and believe Dovecot's IMAP proxy might be appropriate. > > Does anybody have a *really simple* config that would allow IMAP > pass-through to a single Exchange server? > > The examples I've seen all assume some sort of load balancing, which > isn't an issue here, so I'd like to eliminate the need for an > unnecessary database server. > > Does Dovecot do any cleanup of the IMAP commands that would be > useful in protecting Exchange (from this, > http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I > barking up the wrong tree? > > If Dovecot isn't helpful for this, can anybody point me to a better > resource? An Exchange 2000 server is ancient. I wouldn't waste time with it unless there was no possible way to get an updated version; ie, Exchange server 2010. -- Jerry ? Dovecot.user at seibercom.net Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From terry at cnysupport.com Thu Dec 1 02:00:39 2011 From: terry at cnysupport.com (Terry Carmen) Date: Wed, 30 Nov 2011 19:00:39 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130171406.7ac37cbf@scorpio> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130171406.7ac37cbf@scorpio> Message-ID: <20111130190039.Horde.A1m8eleGiNBO1sOnioewmHA@www.cnysupport.com> ----- Message from Jerry --------- Date: Wed, 30 Nov 2011 17:14:06 -0500 From: Jerry Reply-To: dovecot at dovecot.org Subject: Re: [Dovecot] MS Exchange IMAP Proxy To: dovecot at dovecot.org > On Wed, 30 Nov 2011 15:36:46 -0500 > Terry Carmen articulated: > >> I need to make the IMAP interface of an Exchange 2000 server >> available on the net, however I would like to give it a little >> protection, and believe Dovecot's IMAP proxy might be appropriate. >> >> Does anybody have a *really simple* config that would allow IMAP >> pass-through to a single Exchange server? >> >> The examples I've seen all assume some sort of load balancing, which >> isn't an issue here, so I'd like to eliminate the need for an >> unnecessary database server. >> >> Does Dovecot do any cleanup of the IMAP commands that would be >> useful in protecting Exchange (from this, >> http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I >> barking up the wrong tree? >> >> If Dovecot isn't helpful for this, can anybody point me to a better >> resource? > > An Exchange 2000 server is ancient. I wouldn't waste time with it > unless there was no possible way to get an updated version; ie, Exchange > server 2010. The client won't pay for an Exchange update just to support a handful of external IMAP users. It works perfectly well internally, using a Postfix relayhost. Terry From seandarcy2 at gmail.com Thu Dec 1 02:15:33 2011 From: seandarcy2 at gmail.com (sean darcy) Date: Wed, 30 Nov 2011 19:15:33 -0500 Subject: [Dovecot] can not get t'bird to create folder In-Reply-To: References: Message-ID: On 11/28/2011 06:50 PM, sean darcy wrote: > dovecot-2.0.16 on Fedora 15. > > thunderbird-8.0 > > I can access dovecot from thunderbird, imap maildir. But when I try to > create a new folder, nothing happens. > > I'm not using LAYOUT=fs, so I have added, tb-extra-mailbox-sep, which > didn't seem relevant anyhow. > > Any help appreciated. > > sean > > The problem was that the antispam plugin was for 2.0.15 - and I'm using 2.0.16. It seems that if a plugin can't be loaded, dovecot can't do anything else. sean From ghandidrivesahumvee at rocketfish.com Thu Dec 1 04:30:31 2011 From: ghandidrivesahumvee at rocketfish.com (Dovecot-GDH) Date: Wed, 30 Nov 2011 18:30:31 -0800 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130190039.Horde.A1m8eleGiNBO1sOnioewmHA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130171406.7ac37cbf@scorpio> <20111130190039.Horde.A1m8eleGiNBO1sOnioewmHA@www.cnysupport.com> Message-ID: >> An Exchange 2000 server is ancient. I wouldn't waste time with it >> unless there was no possible way to get an updated version; ie, Exchange >> server 2010. > > > The client won't pay for an Exchange update just to support a handful of external IMAP users. > > It works perfectly well internally, using a Postfix relayhost. > > Terry If the client is inept enough to run Exchange 2000 for only a handful of users, you're probably wasting your time attempting to sanitize IMAP commands. If your contract with them mandates that you secure their server, you'll most likely have to replace their broken software. From seandarcy2 at gmail.com Thu Dec 1 04:37:59 2011 From: seandarcy2 at gmail.com (sean darcy) Date: Wed, 30 Nov 2011 21:37:59 -0500 Subject: [Dovecot] can't get sieve to sort virus into spam In-Reply-To: <4ED49127.6020000@rename-it.nl> References: <1266621424.20111129030956@gmail.com> <4ED49127.6020000@rename-it.nl> Message-ID: On 11/29/2011 03:00 AM, Stephan Bosch wrote: > On 11/29/2011 4:09 AM, Duane Hill wrote: >> On Tuesday, November 29, 2011 at 02:28:29 UTC, seandarcy2 at gmail.com >> confabulated: >> >>> I can't get sieve to put virus files in the SPAM folder. > >>> does not end up into SPAM, or anyplace else, including inbox. > >>> How do I make this work? >> What gets logged? If sieve has an issue storing something, it is >> logged. > > The message must be stored somewhere, even if Sieve fails entirely. If > your Dovecot logs provide no indication that a message was handled, are > you even sure that LTMP is getting a message at all? In this regard your > MTA's logs are of importance as well. > > Regards, > > Stephan. > Thanks for your response. I solved the disappearing problem: the message is being put into the INBOX. There are no user sieve scripts. Is there a way to disable any that could occur? Here are the headers: Content-Type: multipart/alternative; boundary=000e0cd5712cced62c04b2fe370e X-DSPAM-Result: Virus X-DSPAM-Processed: Wed Nov 30 21:00:35 2011 X-DSPAM-Confidence: 1.0000 X-DSPAM-Probability: 1.0000 X-DSPAM-Signature: 4ed6dfc341474953737117 --000e0cd5712cced62c04b2fe370e Content-Type: text/plain; charset=ISO-8859-1 X5O!P%@AP[4\PZX54(P^)7CC)7}$EICAR-STANDARD-ANTIVIRUS-TEST-FILE!$H+H* Here's default.sieve: cat /var/lib/dovecot/sieve/default.sieve require "fileinto"; if header :contains "X-DSPAM-Result" "Virus" { fileinto "Virus"; } if header :contains "X-DSPAM-Result" "Spam" { fileinto "SPAM"; } From dovecot-info.log: Nov 30 21:25:43 auth: Debug: master in: USER 1 firstlast@<>.com service=lmtp lip=127.0.0.1 lport=24 rip=127. 0.0.1 rport=35594 Nov 30 21:25:43 auth: Debug: passwd(firstlast@<>,127.0.0.1): lookup Nov 30 21:25:43 auth: Info: passwd(firstlast@<>,127.0.0.1): unknown user Nov 30 21:25:43 auth: Debug: passwd-file(firstlast@<>.com,127.0.0.1): lookup: user=firstlast@<>.com file=/etc/dovecot/users Nov 30 21:25:43 auth: Debug: master out: USER 1 firstlast@<>.com uid=504 gid=504 home=/home/vmail/<>.com/firstlas t Nov 30 21:25:43 lmtp(12609, firstlast@<>.com): Info: Av/jFKfl1k5BMQAABoXEcA: msgid=: saved mail to INBOX sean From tss at iki.fi Thu Dec 1 04:47:30 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 1 Dec 2011 04:47:30 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: On 30.11.2011, at 22.36, Terry Carmen wrote: > Does Dovecot do any cleanup of the IMAP commands that would be useful in protecting Exchange (from this, http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I barking up the wrong tree? v2.1 with imapc backend can be used to do this. There's not really documentation for it beyond this mailing list though. From terry at cnysupport.com Thu Dec 1 06:03:24 2011 From: terry at cnysupport.com (Terry Carmen) Date: Wed, 30 Nov 2011 23:03:24 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Thu, 1 Dec 2011 04:47:30 +0200 From: Timo Sirainen Subject: Re: [Dovecot] MS Exchange IMAP Proxy To: Terry Carmen Cc: dovecot at dovecot.org > On 30.11.2011, at 22.36, Terry Carmen wrote: > >> Does Dovecot do any cleanup of the IMAP commands that would be >> useful in protecting Exchange (from this, >> http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I >> barking up the wrong tree? > > v2.1 with imapc backend can be used to do this. There's not really > documentation for it beyond this mailing list though. I'd be happy to give it a try. I have an absolutely dead-simple setup. All it has to do is sit between the internet and the IMAP port on an Exchange server. Any hints on how to set it up? Thanks! Terry From terry at cnysupport.com Thu Dec 1 06:17:39 2011 From: terry at cnysupport.com (Terry Carmen) Date: Wed, 30 Nov 2011 23:17:39 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130171406.7ac37cbf@scorpio> <20111130190039.Horde.A1m8eleGiNBO1sOnioewmHA@www.cnysupport.com> Message-ID: <20111130231739.Horde.rzH2TleGiNBO1v-jWdQQmLA@www.cnysupport.com> > If the client is inept enough to run Exchange 2000 for only a > handful of users, you're probably wasting your time attempting to > sanitize IMAP commands. > > If your contract with them mandates that you secure their server, > you'll most likely have to replace their broken software. There are over 500 users on the server, however there are only a few external users. I'm really not trying to justify a business case here, I'm just trying to get an IMAP connection. Terry From stan at hardwarefreak.com Thu Dec 1 06:44:35 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Wed, 30 Nov 2011 22:44:35 -0600 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: <4ED70633.3000406@hardwarefreak.com> On 11/30/2011 2:36 PM, Terry Carmen wrote: > I need to make the IMAP interface of an Exchange 2000 server available > on the net, however I would like to give it a little protection, and > believe Dovecot's IMAP proxy might be appropriate. > > Does anybody have a *really simple* config that would allow IMAP > pass-through to a single Exchange server? > > The examples I've seen all assume some sort of load balancing, which > isn't an issue here, so I'd like to eliminate the need for an > unnecessary database server. > > Does Dovecot do any cleanup of the IMAP commands that would be useful in > protecting Exchange (from this, > http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I > barking up the wrong tree? > > If Dovecot isn't helpful for this, can anybody point me to a better > resource? Look into the SM IMAP Proxy. It was designed for a different purpose, but may work well for your scenario: http://imapproxy.org/index.html -- Stan From stephan at rename-it.nl Thu Dec 1 09:27:36 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 01 Dec 2011 08:27:36 +0100 Subject: [Dovecot] can't get sieve to sort virus into spam In-Reply-To: References: <1266621424.20111129030956@gmail.com> <4ED49127.6020000@rename-it.nl> Message-ID: <4ED72C68.5040001@rename-it.nl> On 12/1/2011 3:37 AM, sean darcy wrote: > On 11/29/2011 03:00 AM, Stephan Bosch wrote: >> On 11/29/2011 4:09 AM, Duane Hill wrote: >>> On Tuesday, November 29, 2011 at 02:28:29 UTC, seandarcy2 at gmail.com >>> confabulated: >>> >>>> I can't get sieve to put virus files in the SPAM folder. >> >>>> does not end up into SPAM, or anyplace else, including inbox. >> >>>> How do I make this work? >>> What gets logged? If sieve has an issue storing something, it is >>> logged. >> >> The message must be stored somewhere, even if Sieve fails entirely. If >> your Dovecot logs provide no indication that a message was handled, are >> you even sure that LTMP is getting a message at all? In this regard your >> MTA's logs are of importance as well. >> >> Regards, >> >> Stephan. >> > > Thanks for your response. I solved the disappearing problem: the > message is being put into the INBOX. > > There are no user sieve scripts. Is there a way to disable any that > could occur? [...] > Nov 30 21:25:43 auth: Debug: master in: USER 1 > firstlast@<>.com service=lmtp lip=127.0.0.1 > lport=24 rip=127. > 0.0.1 rport=35594 > Nov 30 21:25:43 auth: Debug: passwd(firstlast@<>,127.0.0.1): lookup > Nov 30 21:25:43 auth: Info: passwd(firstlast@<>,127.0.0.1): unknown user > Nov 30 21:25:43 auth: Debug: passwd-file(firstlast@<>.com,127.0.0.1): > lookup: user=firstlast@<>.com file=/etc/dovecot/users > Nov 30 21:25:43 auth: Debug: master out: USER 1 > firstlast@<>.com uid=504 gid=504 home=/home/vmail/<>.com/firstlas > t > Nov 30 21:25:43 lmtp(12609, firstlast@<>.com): Info: > Av/jFKfl1k5BMQAABoXEcA: > msgid= mail.gmail.com>: saved mail to INBOX Apparently, the Sieve plugin is not active or not loaded. The message is stored by lmtp, because otherwise that final log line would have a `sieve: ' prefix somewhere. Do you see any sieve-related log lines when mail_debug=yes? Regards, Stephan. From hs at schlittermann.de Thu Dec 1 10:19:58 2011 From: hs at schlittermann.de (Heiko Schlittermann) Date: Thu, 1 Dec 2011 09:19:58 +0100 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: <20111201081958.GB30720@jumper.schlittermann.de> Terry Carmen (Mi 30 Nov 2011 21:36:46 CET): > useful in protecting Exchange (from this, > http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I > barking up the wrong tree? > > If Dovecot isn't helpful for this, can anybody point me to a better resource? Some time ago wie used "perdition", but I do not know, if it has sanitizing features beyond just being a proxy for the IMAP protocol. -- Heiko :: dresden : linux : SCHLITTERMANN.de GPG Key 48D0359B : 3061 CFBF 2D88 F034 E8D2 7E92 EE4E AC98 48D0 359B -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From wek at andatra.kiev.ua Thu Dec 1 10:33:20 2011 From: wek at andatra.kiev.ua (Yaroslav Boychuk) Date: Thu, 01 Dec 2011 10:33:20 +0200 Subject: [Dovecot] dsync(root): Fatal: execvp() failed: No such file or directory Message-ID: <4ED73BD0.2030302@andatra.kiev.ua> Hi everybody, I try to convert mbox to maildir using local locations /root/mail is a dir with mboxes /root/INBOX is mbox file h=/root dsync -f -v mirror \ mbox:$h/mail:INBOX=$h/INBOX \ maildir:$h/Maildir:CONTROL=$h/dovecot:INDEX=$h/dovecot \ as result I have dsync(root): Fatal: execvp(mbox:/root/mail:INBOX=/root/INBOX) failed: No such file or directory dsync-local(root): Error: read() from worker server failed: EOF thank you for any help FreeBSD, dovecot 2.0.15 From tss at iki.fi Thu Dec 1 15:00:03 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 1 Dec 2011 15:00:03 +0200 Subject: [Dovecot] dsync(root): Fatal: execvp() failed: No such file or directory In-Reply-To: <4ED73BD0.2030302@andatra.kiev.ua> References: <4ED73BD0.2030302@andatra.kiev.ua> Message-ID: On 1.12.2011, at 10.33, Yaroslav Boychuk wrote: > dsync -f -v mirror \ > mbox:$h/mail:INBOX=$h/INBOX \ > maildir:$h/Maildir:CONTROL=$h/dovecot:INDEX=$h/dovecot \ dsync -f -v mirror \ -o mail=mbox:$h/mail:INBOX=$h/INBOX \ maildir:$h/Maildir:CONTROL=$h/dovecot:INDEX=$h/dovecot \ From eray.aslan at caf.com.tr Thu Dec 1 18:15:28 2011 From: eray.aslan at caf.com.tr (Eray Aslan) Date: Thu, 1 Dec 2011 18:15:28 +0200 Subject: [Dovecot] v2.1.rc1 missing SnowballAnalyzer.h Message-ID: <20111201161528.GI3177@zptr-nb18.caf.local> While trying to test v.2.1.rc1 with configure \ --with-lucene \ --without-stemmer \ [...] I get the following error: [...] /bin/sh ../../../libtool --tag=CXX --mode=compile i686-pc-linux-gnu-g++ -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-index -I../../../src/lib-storage -I../../../src/plugins/fts -I../../../src/doveadm -O2 -march=i686 -pipe -c -o lucene-wrapper.lo lucene-wrapper.cc libtool: compile: i686-pc-linux-gnu-g++ -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-index -I../../../src/lib-storage -I../../../src/plugins/fts -I../../../src/doveadm -O2 -march=i686 -pipe -c lucene-wrapper.cc -fPIC -DPIC -o .libs/lucene-wrapper.o lucene-wrapper.cc:26:30: fatal error: SnowballAnalyzer.h: No such file or directory compilation terminated. make[4]: *** [lucene-wrapper.lo] Error 1 The offending line in lucene-wrapper.cc is: #include "SnowballAnalyzer.h" Sure enough, there is no SnowballAnalyzer.h in the tarball. Looks like a missing a backslash in src/plugins/fts-lucene/Makefile.am: [...] noinst_HEADERS = \ fts-lucene-plugin.h \ lucene-wrapper.h SnowballAnalyzer.h \ SnowballFilter.h -- Eray Aslan From terry at cnysupport.com Thu Dec 1 18:24:10 2011 From: terry at cnysupport.com (Terry Carmen) Date: Thu, 01 Dec 2011 11:24:10 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <4ED70633.3000406@hardwarefreak.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <4ED70633.3000406@hardwarefreak.com> Message-ID: <20111201112410.Horde.HODzRVeGiNBO16oqSOuXAfA@www.cnysupport.com> Thanks! I'll take a look. Terry ----- Message from Stan Hoeppner --------- Date: Wed, 30 Nov 2011 22:44:35 -0600 From: Stan Hoeppner Reply-To: stan at hardwarefreak.com Subject: Re: [Dovecot] MS Exchange IMAP Proxy To: dovecot at dovecot.org > On 11/30/2011 2:36 PM, Terry Carmen wrote: >> I need to make the IMAP interface of an Exchange 2000 server available >> on the net, however I would like to give it a little protection, and >> believe Dovecot's IMAP proxy might be appropriate. >> >> Does anybody have a *really simple* config that would allow IMAP >> pass-through to a single Exchange server? >> >> The examples I've seen all assume some sort of load balancing, which >> isn't an issue here, so I'd like to eliminate the need for an >> unnecessary database server. >> >> Does Dovecot do any cleanup of the IMAP commands that would be useful in >> protecting Exchange (from this, >> http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I >> barking up the wrong tree? >> >> If Dovecot isn't helpful for this, can anybody point me to a better >> resource? > > Look into the SM IMAP Proxy. It was designed for a different purpose, > but may work well for your scenario: > > http://imapproxy.org/index.html > > -- > Stan ----- End message from Stan Hoeppner ----- -- Terry Carmen CNY Support, LLC https://www.cnysupport.com From sbbowman at gmail.com Thu Dec 1 19:26:43 2011 From: sbbowman at gmail.com (Stephen Bowman) Date: Thu, 1 Dec 2011 12:26:43 -0500 Subject: [Dovecot] LDAP Authentication - Home Directory Creation Message-ID: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> How does everyone handle this case? Users are authenticated by LDAP, and do not have accounts on the IMAP/dovecot server. When a new user is added to LDAP, the home directory (/home/newuser) needs to be created on the IMAP/dovecot server so dovecot can create the mail directories inside it (/home/newuser/mail/). Obviously I can come up with a few custom solutions, utilizing cron, but I feel like there's a cleaner solution out there. Thanks! From tom at whyscream.net Thu Dec 1 19:51:11 2011 From: tom at whyscream.net (Tom Hendrikx) Date: Thu, 01 Dec 2011 18:51:11 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> Message-ID: <4ED7BE8F.4000609@whyscream.net> On 01-12-11 18:26, Stephen Bowman wrote: > How does everyone handle this case? > > Users are authenticated by LDAP, and do not have accounts on the > IMAP/dovecot server. When a new user is added to LDAP, the home > directory (/home/newuser) needs to be created on the IMAP/dovecot > server so dovecot can create the mail directories inside it > (/home/newuser/mail/). > > Obviously I can come up with a few custom solutions, utilizing cron, > but I feel like there's a cleaner solution out there. How about http://wiki.dovecot.org/PostLoginScripting and something containing 'mkdir -p' ? -- Tom From tss at iki.fi Thu Dec 1 22:48:11 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 1 Dec 2011 22:48:11 +0200 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> Message-ID: On 1.12.2011, at 19.26, Stephen Bowman wrote: > How does everyone handle this case? > > Users are authenticated by LDAP, and do not have accounts on the IMAP/dovecot server. When a new user is added to LDAP, the home directory (/home/newuser) needs to be created on the IMAP/dovecot server so dovecot can create the mail directories inside it (/home/newuser/mail/). Dovecot creates the home directory automatically if it has permissions to do it. So I guess in your case the mail user doesn't have permissions to do it and only root can create it? From micah at riseup.net Thu Dec 1 23:42:34 2011 From: micah at riseup.net (Micah Anderson) Date: Thu, 01 Dec 2011 16:42:34 -0500 Subject: [Dovecot] dovecot-lda quota rule References: <874nybztuz.fsf@algae.riseup.net> <1321388840.21919.520.camel@hurina> <87ehx8gic7.fsf@algae.riseup.net> <87zkfek37g.fsf@algae.riseup.net> Message-ID: <87ty5khstx.fsf@algae.riseup.net> micah anderson writes: > On Wed, 16 Nov 2011 11:09:12 -0500, micah anderson wrote: >> On Tue, 15 Nov 2011 22:27:20 +0200, Timo Sirainen wrote: >> > On Thu, 2011-11-10 at 13:59 -0500, Micah Anderson wrote: >> > > I really like the feature where you can define quota rules with percents >> > > which trigger off of the default values[0] (so you can set the Trash to >> > > allow for 10% more of the user's quota for example). >> > > >> > > What I would really love in dovecot would be for the ability to >> > > configure a quota rule for dovecot-lda. I would like to configure things >> > > so we don't bounce emails for users until they are well over quota, the >> > > IMAP quota plugin is a really great way to notify people that they are >> > > over quota because it fails to write to other folders.... that should be >> > > enough to get people's attention that they need to deal with things, but >> > > bouncing is harsh. >> > >> > You can give LDA-specific quota settings. Like maybe: >> > >> > protocol lda { >> > plugin { >> > quota_rule2 = INBOX:storage=200% >> > } >> > } > > I just tried doing this, and I started bouncing mail for everyone > because they were over quota (even when they arent), so I am clearly > missing something in how I have it configured. This is what I have: Solved, thanks to tss on irc... My problem was the dovecot-lda invocation was not passing the -d parameter, so no userdb quota rules were being applied. micah From sven at svenhartge.de Fri Dec 2 00:41:43 2011 From: sven at svenhartge.de (Sven Hartge) Date: Thu, 1 Dec 2011 23:41:43 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> Message-ID: <58cbklct2vv8@mids.svenhartge.de> Stephen Bowman wrote: > How does everyone handle this case? > Users are authenticated by LDAP, and do not have accounts on the > IMAP/dovecot server. When a new user is added to LDAP, the home > directory (/home/newuser) needs to be created on the IMAP/dovecot > server so dovecot can create the mail directories inside it > (/home/newuser/mail/). chmod /home to 1777 and let dovecot create the directory. Or switch to a virtual setup, where the users don't get real users on the imap server (they can't log in, so they don't need any real user on that server) and every mail is owned by your virtual mail user. Gr??e, Sven. -- Sigmentation fault. Core dumped. From tss at iki.fi Fri Dec 2 00:52:58 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 00:52:58 +0200 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <58cbklct2vv8@mids.svenhartge.de> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> <58cbklct2vv8@mids.svenhartge.de> Message-ID: On 2.12.2011, at 0.41, Sven Hartge wrote: > Or switch to a > virtual setup, where the users don't get real users on the imap server > (they can't log in, so they don't need any real user on that server) and > every mail is owned by your virtual mail user. Well, it of course makes things easier, but from security point of view it's worse.. I hope some day there won't be any problems with Dovecot using multiple UIDs. From sven at svenhartge.de Fri Dec 2 01:03:36 2011 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 2 Dec 2011 00:03:36 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> <58cbklct2vv8@mids.svenhartge.de> Message-ID: <68cbluut2vv8@mids.svenhartge.de> Timo Sirainen wrote: > On 2.12.2011, at 0.41, Sven Hartge wrote: >> Or switch to a virtual setup, where the users don't get real users on >> the imap server (they can't log in, so they don't need any real user >> on that server) and every mail is owned by your virtual mail user. > Well, it of course makes things easier, but from security point of > view it's worse.. Of course. But using real users only works if every user is a PosixUser in LDAP (i.e. has a uidNumber and gidNumber). If this is not the case, then you are forced to use a virtual mail user setup. > I hope some day there won't be any problems with Dovecot using > multiple UIDs. Meaning? Gr??e, Sven. -- Sigmentation fault. Core dumped. From tss at iki.fi Fri Dec 2 01:10:28 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 01:10:28 +0200 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <68cbluut2vv8@mids.svenhartge.de> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> <58cbklct2vv8@mids.svenhartge.de> <68cbluut2vv8@mids.svenhartge.de> Message-ID: On 2.12.2011, at 1.03, Sven Hartge wrote: > Timo Sirainen wrote: >> On 2.12.2011, at 0.41, Sven Hartge wrote: > >>> Or switch to a virtual setup, where the users don't get real users on >>> the imap server (they can't log in, so they don't need any real user >>> on that server) and every mail is owned by your virtual mail user. > >> Well, it of course makes things easier, but from security point of >> view it's worse.. > > Of course. But using real users only works if every user is a PosixUser > in LDAP (i.e. has a uidNumber and gidNumber). If this is not the case, > then you are forced to use a virtual mail user setup. Currently at least. This could be automated in a few ways.. Like simplest: uid = 1000 + md5sum(username) mod 64000. That won't necessarily be unique of course, but it's still better than mod 1. :) >> I hope some day there won't be any problems with Dovecot using >> multiple UIDs. > > Meaning? There are different problems with multiple UIDs that are more difficult to solve than with a single UID. How to manage them, how to handle shared mailboxes, how to create home dirs automatically, probably other things. There are ways to solve these problems in one way or another. From sven at svenhartge.de Fri Dec 2 01:24:24 2011 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 2 Dec 2011 00:24:24 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> <58cbklct2vv8@mids.svenhartge.de> <68cbluut2vv8@mids.svenhartge.de> Message-ID: <88cbn47t2vv8@mids.svenhartge.de> Timo Sirainen wrote: > On 2.12.2011, at 1.03, Sven Hartge wrote: >> Timo Sirainen wrote: >>> I hope some day there won't be any problems with Dovecot using >>> multiple UIDs. >> >> Meaning? > There are different problems with multiple UIDs that are more > difficult to solve than with a single UID. How to manage them, how to > handle shared mailboxes, how to create home dirs automatically, > probably other things. There are ways to solve these problems in one > way or another. Ah, yes, shared folders. I remember now, this is why we changed from using real users to a virtual user in the beginning (using Courier), because implementing this feature with real users was real pain in the lower backside. Gr??e, Sven. -- Sigmentation fault. Core dumped. From amateo at um.es Fri Dec 2 10:07:38 2011 From: amateo at um.es (Angel L. Mateo) Date: Fri, 02 Dec 2011 09:07:38 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> Message-ID: <4ED8874A.3090408@um.es> El 01/12/11 18:26, Stephen Bowman escribi?: > How does everyone handle this case? > > Users are authenticated by LDAP, and do not have accounts on the IMAP/dovecot server. When a new user is added to LDAP, the home directory (/home/newuser) needs to be created on the IMAP/dovecot server so dovecot can create the mail directories inside it (/home/newuser/mail/). > > Obviously I can come up with a few custom solutions, utilizing cron, but I feel like there's a cleaner solution out there. > Are you authenticating directly by LDAP or are you using pam? If you were using pam, you could use pam_mkhomedir module. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica _(___V Tfo: 868887590 Fax: 868888337 From rainer.frey at inxmail.de Fri Dec 2 12:38:53 2011 From: rainer.frey at inxmail.de (Rainer Frey) Date: Fri, 2 Dec 2011 11:38:53 +0100 Subject: [Dovecot] Authentication listener configuration In-Reply-To: <22BC7966-5C73-4085-AB63-3B5E20FCE335@inxmail.de> References: <22BC7966-5C73-4085-AB63-3B5E20FCE335@inxmail.de> Message-ID: <681352ED-B7A4-47EE-B4D8-7A6B5D2E115F@inxmail.de> On 29.11.2011, at 08:19, Rainer Frey wrote: > Hi, > > I'm wondering about the authentication listeners that dovecot uses. In many configurations I see: > service auth { > unix_listener auth-userdb { > > Does any component of dovecot use this listener internally (lmtp, lda ...) and does that read the config and search for the listener, or is the exact name "auth-userdb" expected? Is this maybe dependent on the userdb? Which ones need it? And if I want to use postfix SMTP auth, should I define a second listener, or just re-configure that default one to postfix's needs? I mean, specifically if I use ldaand/or lmtp as well ... Thanks Rainer From wek at andatra.kiev.ua Fri Dec 2 12:53:34 2011 From: wek at andatra.kiev.ua (Yaroslav Boychuk) Date: Fri, 02 Dec 2011 12:53:34 +0200 Subject: [Dovecot] dsync(root): Fatal: execvp() failed: No such file or directory In-Reply-To: References: <4ED73BD0.2030302@andatra.kiev.ua> Message-ID: <4ED8AE2E.6060605@andatra.kiev.ua> thank you Timo, I have moved "mirror" after "options" and add namespace { separator = / prefix = inbox = yes } to 10-mail.conf thank you 01.12.2011 15:00, Timo Sirainen ???????(??): > > dsync -f -v mirror \ > -o mail=mbox:$h/mail:INBOX=$h/INBOX \ > maildir:$h/Maildir:CONTROL=$h/dovecot:INDEX=$h/dovecot \ From rainer.frey at inxmail.de Fri Dec 2 15:39:51 2011 From: rainer.frey at inxmail.de (Rainer Frey) Date: Fri, 2 Dec 2011 14:39:51 +0100 Subject: [Dovecot] Authentication listener configuration In-Reply-To: <681352ED-B7A4-47EE-B4D8-7A6B5D2E115F@inxmail.de> References: <22BC7966-5C73-4085-AB63-3B5E20FCE335@inxmail.de> <681352ED-B7A4-47EE-B4D8-7A6B5D2E115F@inxmail.de> Message-ID: > On 29.11.2011, at 08:19, Rainer Frey wrote: >> I'm wondering about the authentication listeners that dovecot uses. In many configurations I see: >> service auth { >> unix_listener auth-userdb { >> >> Does any component of dovecot use this listener internally (lmtp, lda ...) and does that read the config and search for the listener, or is the exact name "auth-userdb" expected? Is this maybe dependent on the userdb? Which ones need it? And if I want to use postfix SMTP auth, should I define a second listener, or just re-configure that default one to postfix's needs? > > I mean, specifically if I use lda and/or lmtp as well ... Sorry for the noise, found it commented in the example configuration - it's configured in auth_socket_path. I didn't have a dovecot installation handy, so I only looked online. For dovecot 1.x, the wiki contains the full configuration file with all comments. Couldn't anything like that be done for 2.x as well (even though it's more complicated)? Rainer From pw at wk-serv.de Fri Dec 2 16:30:43 2011 From: pw at wk-serv.de (Patrick Westenberg) Date: Fri, 02 Dec 2011 15:30:43 +0100 Subject: [Dovecot] Plugin for munin Message-ID: <4ED8E113.9050908@wk-serv.de> Hi there, is anyone using munin to monitor connections to dovecot? If someone does, which plugin is used? Regards Patrick From ecasarero at gmail.com Fri Dec 2 16:49:12 2011 From: ecasarero at gmail.com (Eduardo Casarero) Date: Fri, 2 Dec 2011 11:49:12 -0300 Subject: [Dovecot] Plugin for munin In-Reply-To: <4ED8E113.9050908@wk-serv.de> References: <4ED8E113.9050908@wk-serv.de> Message-ID: 2011/12/2 Patrick Westenberg > Hi there, > > is anyone using munin to monitor connections to dovecot? > If someone does, which plugin is used? > > Regards > Patrick > I've written a very small script to monitor the amount of users conected to dovecot using imap, so i can get an idea of real usage. The problem is that i wrote it for Nagios, i don't know if you can tune it to work with munin. Regards, Edurardo. From tss at iki.fi Fri Dec 2 17:12:21 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 17:12:21 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension Message-ID: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> It's implemented now in dovecot-2.1 hg. It also deprecates autocreate plugin (but it still works the old way). The idea is that you can now do e.g.: mailbox Trash { auto = no special_use = \Trash } mailbox Drafts { auto = no special_use = \Drafts } mailbox Sent { auto = subscribe # autocreate, autosubscribe special_use = \Sent } mailbox Spam { auto = create # autocreate, but don't autosubscribe special_use = \Junk } mailbox virtual/All { # if you have a virtual "All messages" mailbox auto = no special_use = \All } The mailbox names require a namespace prefix, so if you use e.g. "INBOX." prefix you'll need to use: mailbox INBOX.Trash { ..etc.. From tss at iki.fi Fri Dec 2 23:19:01 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 23:19:01 +0200 Subject: [Dovecot] can not get t'bird to create folder In-Reply-To: References: Message-ID: <655038FA-90B5-4F7A-9C06-23C91EA14701@iki.fi> On 1.12.2011, at 2.15, sean darcy wrote: > The problem was that the antispam plugin was for 2.0.15 - and I'm using 2.0.16. > > It seems that if a plugin can't be loaded, dovecot can't do anything else. Yes. Nowadays I keep stable APIs between micro versions (vX.Y.*), but stable ABIs would require to be a lot more careful. So it's not really worth the trouble, since Dovecot logs about the plugin version mismatch anyway and you can just recompile the plugin it to make it work again. From tss at iki.fi Fri Dec 2 23:22:24 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 23:22:24 +0200 Subject: [Dovecot] lda/sieve ignores quota from ldap In-Reply-To: <20111130190416.641ede1f@meissner.pentament.dyndns.org> References: <20111130190416.641ede1f@meissner.pentament.dyndns.org> Message-ID: <9DCC9F03-5CBC-45E7-A12B-7365565C4067@iki.fi> On 30.11.2011, at 20.04, Jens Mei?ner wrote: > I'm using Dovecot 2.0 with Sieve as MDA and Postfix as MTA. The > Postfix delivery command is /usr/lib/dovecot/dovecot-lda -f "$SENDER" > -a "$RECIPIENT". I have set a default quota with quota_rule = *:storage=1G. > Some users should have a larger quota. This is defined in a ldap > directory and I have set .. You need to use dovecot-lda's -d parameter or it doesn't do a userdb lookup, so it won't see the per-user quota from ldap. From tss at iki.fi Fri Dec 2 23:29:23 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 23:29:23 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> Message-ID: <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> On 1.12.2011, at 6.03, Terry Carmen wrote: >> On 30.11.2011, at 22.36, Terry Carmen wrote: >> >>> Does Dovecot do any cleanup of the IMAP commands that would be useful in protecting Exchange (from this, http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I barking up the wrong tree? >> >> v2.1 with imapc backend can be used to do this. There's not really documentation for it beyond this mailing list though. > > I'd be happy to give it a try. > > I have an absolutely dead-simple setup. All it has to do is sit between the internet and the IMAP port on an Exchange server. > > Any hints on how to set it up? Without SSL it works like this: mail_location = imapc:~/imapc imapc_host = imap.elsewhere.com imapc_port = 143 passdb { driver = imap args = host=imap.elsewhere.com default_fields = userdb_imapc_user=%u userdb_imapc_password=%w } userdb { driver = prefetch } mail_home = /home/tss And about other IMAP proxies: Before login they provide almost comparable security to Dovecot, the main exception being that Dovecot don't by default allow all characters in username (auth_username_chars setting). Post-login all of the IMAP proxies are equivalent. But imapc backend isn't really a proxy, so it does more: The imapc mainly gives protection for post-login commands, which the other proxies don't even attempt to sanitize in any way. But you probably trust your authorized users enough that they won't attempt to break into your mail server.. But then again, users might be running viruses and whatever other things that automate breaking into mail server without even knowing about it (but currently that's rather rare I think). From terry at cnysupport.com Sat Dec 3 00:39:09 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 02 Dec 2011 17:39:09 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> Message-ID: <20111202173909.Horde.tLmudleGiNBO2VONl9B1xPA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Fri, 2 Dec 2011 23:29:23 +0200 From: Timo Sirainen Subject: Re: [Dovecot] MS Exchange IMAP Proxy To: Terry Carmen Cc: dovecot at dovecot.org > On 1.12.2011, at 6.03, Terry Carmen wrote: > >>> On 30.11.2011, at 22.36, Terry Carmen wrote: >>> >>>> Does Dovecot do any cleanup of the IMAP commands that would be >>>> useful in protecting Exchange (from this, >>>> http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am >>>> I barking up the wrong tree? >>> >>> v2.1 with imapc backend can be used to do this. There's not really >>> documentation for it beyond this mailing list though. >> >> I'd be happy to give it a try. >> >> I have an absolutely dead-simple setup. All it has to do is sit >> between the internet and the IMAP port on an Exchange server. >> >> Any hints on how to set it up? > > > Without SSL it works like this: > > mail_location = imapc:~/imapc > imapc_host = imap.elsewhere.com > imapc_port = 143 > > passdb { > driver = imap > args = host=imap.elsewhere.com > default_fields = userdb_imapc_user=%u userdb_imapc_password=%w > } > userdb { > driver = prefetch > } > mail_home = /home/tss My dovecot.conf file contains: ///////////////////////////////////////// protocols = imap listen = *, :: mail_location = imapc:~/imapc imapc_host = exchangeserver.example.com imapc_port = 143 passdb { driver = imap args = host=exchangeserver.example.com default_fields = userdb_imapc_user=%u userdb_imapc_password=%w } userdb { driver = prefetch } mail_home = /home/tss !include conf.d/* ///////////////////////////////////////// Dovecot starts without complaints, but when I try a LOGIN, I get: dovecot: auth: Fatal: passdb imap: Unknown parameter: exchangeserver.example.com in the maillog file. Any thoughts? Terry From terry at cnysupport.com Sat Dec 3 01:42:38 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 02 Dec 2011 18:42:38 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> Message-ID: <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> OK, I'm making headway. it didn't like the config because there were no quotes around the Exchange server's FQDN, however when I added the quotes, I got: Dec 2 18:26:33 host dovecot: auth: Error: imapc('exchangeserver.example.com':143): dns_lookup('exchangeserver.example.com') failed: Name or service not known The name *does* resolve correctly using the "host" command. I then replaced the FQDN with the Exchange server's IP address, which works much better, but now I get: Dec 2 18:35:09 host dovecot: imap(myusername): Error: user myusername: Couldn't drop privileges: User is missing UID (see mail_uid setting) "myusername" is not a local user, but exists only on the exchange server. Any thoughts? Thanks! Terry From tss at iki.fi Sat Dec 3 03:04:10 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 3 Dec 2011 03:04:10 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> Message-ID: <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> On 3.12.2011, at 1.42, Terry Carmen wrote: > Dec 2 18:35:09 host dovecot: imap(myusername): Error: user myusername: Couldn't drop privileges: User is missing UID (see mail_uid setting) > > "myusername" is not a local user, but exists only on the exchange server. Any thoughts? You still need a mail user. For example you could create a "vmail" user and set mail_uid=vmail. Or whatever else user. From terry at cnysupport.com Sat Dec 3 04:55:12 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 02 Dec 2011 21:55:12 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> Message-ID: <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> > On 3.12.2011, at 1.42, Terry Carmen wrote: > >> Dec 2 18:35:09 host dovecot: imap(myusername): Error: user >> myusername: Couldn't drop privileges: User is missing UID (see >> mail_uid setting) >> >> "myusername" is not a local user, but exists only on the exchange >> server. Any thoughts? > > You still need a mail user. For example you could create a "vmail" > user and set mail_uid=vmail. Or whatever else user. Several other configuration problems later . . . I'm getting much closer, but not quite there. The latest message is: dovecot: imap(username): Error: user username: Initialization failed: Initializing mail storage from mail_location setting failed: Home directory not set for user. Can't expand ~/ for mail root dir in: ~/imapc The users who will be using the proxy don't actually have any mail on the box running dovecot and (currently) don't have any accounts or home directories. Right now they only exist on the Exchhange server. Is there a config option I need to create/change so that Dovecot doesn't look for a directory for each user, or does it till ened one even though the users aren't local and there won't be a mail store on the box running dovecot? Thanks again for all your help! When I get this all working, I'll write up a Wiki page for it. Terry From me at junc.org Sat Dec 3 05:35:05 2011 From: me at junc.org (Benny Pedersen) Date: Sat, 03 Dec 2011 04:35:05 +0100 Subject: [Dovecot] MUAs creating different "Sent" folders In-Reply-To: <20111129214256.GL14970@charite.de> References: <20111129214256.GL14970@charite.de> Message-ID: <92d9bf78c8e3ec525b7f3f4c46ce9972@junc.org> On Tue, 29 Nov 2011 22:42:56 +0100, Ralf Hildebrandt wrote: > While our webmail installation creates "Sent" as a Sent-Items Folder, > Apple Mail creates "Sent Messages". open source standards :-) > Is there a way of "mapping" foldernames e.g. > > map "Sent Messages" to "Sent" > map "Deletes Messages" to "Trash" would be nice yes, it was talked about a way to solve it via a plugin > and so on? none mua have it hardcoded folder names, just diff defaults :( From heptalium at gmx.de Sat Dec 3 13:17:51 2011 From: heptalium at gmx.de (Jens =?UTF-8?B?TWVpw59uZXI=?=) Date: Sat, 3 Dec 2011 12:17:51 +0100 Subject: [Dovecot] lda/sieve ignores quota from ldap In-Reply-To: <9DCC9F03-5CBC-45E7-A12B-7365565C4067@iki.fi> References: <20111130190416.641ede1f@meissner.pentament.dyndns.org> <9DCC9F03-5CBC-45E7-A12B-7365565C4067@iki.fi> Message-ID: <20111203121751.73753b7e@meissner.pentament.dyndns.org> Am Fri, 2 Dec 2011 23:22:24 +0200 schrieb Timo Sirainen : > On 30.11.2011, at 20.04, Jens Mei?ner wrote: > >> I'm using Dovecot 2.0 with Sieve as MDA and Postfix as MTA. The >> Postfix delivery command is /usr/lib/dovecot/dovecot-lda -f >> "$SENDER" -a "$RECIPIENT". I have set a default quota with >> quota_rule = *:storage=1G. Some users should have a larger quota. >> This is defined in a ldap directory and I have set > .. > > You need to use dovecot-lda's -d parameter or it doesn't do a userdb > lookup, so it won't see the per-user quota from ldap. Thanks, it works well. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: not available URL: From dovecot at digitalforplay.com Fri Dec 2 20:47:16 2011 From: dovecot at digitalforplay.com (A Dovecot User) Date: Fri, 02 Dec 2011 12:47:16 -0600 Subject: [Dovecot] Panic when attempting index with Apache Solr : fts_solr plugin Message-ID: <4ED91D34.3050906@digitalforplay.com> Dovecot version: 2.1.rc1 Expat version: expat-2.0.1-10 Libcurl version: libcurl-7.21.0-10 OS: Fedora 14 i686 Configure command: ./configure --with-solr Solr version: 1.4.1 (also tried 3.5.0) Java version: java-1.6.0-openjdk-1.6.0.0-55.1.9.10 (also tried Oracle Java 6u29) [root at mymailserver ~]# doveadm -D index -u username mailbox inbox doveadm(username): Info: INBOX: Caching mails seq=1..466 doveadm(username): Panic: file solr-connection.c: line 545 (solr_connection_post_more): assertion failed: (maxfd >= 0) doveadm(username): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3b9b1) [0x14b9b1] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x47) [0x14bac7] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x1211ae] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x293) [0xb1a7d3] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x2599) [0xb16599] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_build_more+0x31) [0x2273f1] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x3b2) [0x228272] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xa74e) [0x22d74e] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_precache+0xf) [0x937a6f] -> doveadm() [0x80520b6] -> doveadm() [0x804f4b5] -> doveadm(doveadm_mail_single_user+0x5b) [0x804f8db] -> doveadm() [0x804fd3f] -> doveadm(doveadm_mail_try_run+0x12e) [0x805019e] -> doveadm(main+0x3a4) [0x8056444] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x729e36] -> doveadm() [0x804f2c1] ---------------------- mail_plugins = acl antispam fts fts_solr plugin { fts = solr fts_solr = break-imap-search debug url=http://127.0.0.1:8983/solr/ } From terry at cnysupport.com Sat Dec 3 18:10:22 2011 From: terry at cnysupport.com (Terry Carmen) Date: Sat, 03 Dec 2011 11:10:22 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> Message-ID: <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> It's working! I'll post a writeup on the wiki on monday. The last problem was it seems to need a writable home directory for mail_home even though all the mail is pass-through.This was included in Timo's original config, although I had accidentally removed it. In any case many thanks to Timo and everybody else who helped! Terry From maria_arrea at gmx.com Sat Dec 3 22:30:53 2011 From: maria_arrea at gmx.com (Maria Arrea) Date: Sat, 03 Dec 2011 21:30:53 +0100 Subject: [Dovecot] Questions about single intance storage Message-ID: <20111203203053.201510@gmx.com> Hello We are using dovecot 2.0.16 with mdbox+zlib. We are now testing SiS (Single Instance Storage) and I have 5 questions: 1? Is possible to "dedup" existing mdboxes? 2? Are attachments compressed with zlib if mdboxes already use zlib? 3? I have plenty CPU to spare, should I use a low value of mail_attachment_min_size , like 16KB ? 4? Can I "undo" SiS if I have problems? 5? We use bacula to save indexes & mdboxes, and we recover mailboxes using doveadm import when a user "makes a fatal mistake" wiping all her Inbox. If we enable SiS I am not really sure how can we safely restore a user's INBOX if that user has SiS attachments. Thank you for your (great) support. Maria From tss at iki.fi Sat Dec 3 23:00:58 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 3 Dec 2011 23:00:58 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111203203053.201510@gmx.com> References: <20111203203053.201510@gmx.com> Message-ID: On 3.12.2011, at 22.30, Maria Arrea wrote: > We are using dovecot 2.0.16 with mdbox+zlib. We are now testing SiS (Single Instance Storage) and I have 5 questions: > > 1? Is possible to "dedup" existing mdboxes? You can dsync the mailbox elsewhere and then replace the original with the new copy. > 2? Are attachments compressed with zlib if mdboxes already use zlib? Currently attachments don't support zlib at all. > 3? I have plenty CPU to spare, should I use a low value of mail_attachment_min_size , like 16KB ? It wastes disk seeks since it now has to read mail from 2 (or more) places in filesystem, so probably not a good idea. So in any case SiS most likely increases your disk IOPS usage. > 4? Can I "undo" SiS if I have problems? dsync will help the other way around too. > 5? We use bacula to save indexes & mdboxes, and we recover mailboxes using doveadm import when a user "makes a fatal mistake" wiping all her Inbox. If we enable SiS I am not really sure how can we safely restore a user's INBOX if that user has SiS attachments. Hm. Yes, that is problematic.. Even if you knew what SIS files were used, there's no simple way to restore those with proper refcounts. I think what really should be done is writing a tool that can create/restore backups, possibly de-SISing the attachments.. From tlx at leuxner.net Sun Dec 4 08:39:14 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Sun, 4 Dec 2011 07:39:14 +0100 Subject: [Dovecot] Core Dump upon IMAP Login with latest HG (2.1) c067025026ed Message-ID: <58C7F575-17FB-47EF-90BC-83C52AAF56D5@leuxner.net> Dec 4 07:27:41 spectre dovecot: imap-login: Login: user=, method=PLAIN, rip=84.58.184.122, lip=1.2.3.4, mpid=30987, TLS Dec 4 07:27:42 spectre dovecot: imap-login: Login: user=, method=PLAIN, rip=84.58.184.122, lip=1.2.3.4, mpid=30990, TLS Dec 4 07:27:42 spectre dovecot: master: Error: service(imap): child 30990 killed with signal 11 (core dumped) Dec 4 07:27:48 spectre dovecot: imap(tlx at leuxner.net): Connection closed in=142 out=410 Dec 4 07:27:48 spectre dovecot: imap-login: Login: user=, method=PLAIN, rip=84.58.184.122, lip=1.2.3.4, mpid=30992, TLS Dec 4 07:27:48 spectre dovecot: master: Warning: Killed with signal 15 (by pid=31013 uid=0 code=kill) [ GDB Backtrace] #0 0x00007fa68d36f978 in mailbox_settings_find (user=0x22162f0, vname=0x21ec318 "INBOX") at mail-storage.c:610 box_set__foreach_end = box_set = #1 0x00007fa68d371003 in mailbox_alloc (list=, vname=0x21ec318 "INBOX", flags=MAILBOX_FLAG_DROP_RECENT) at mail-storage.c:643 _data_stack_cur_id = 4 new_list = 0x22149b0 storage = 0x221b760 box = 0x222a9f0 __FUNCTION__ = "mailbox_alloc" #2 0x000000000040d8de in select_open (cmd=0x22259c0, readonly=false) at cmd-select.c:285 client = 0x2224e30 status = {messages = 2808, recent = 0, unseen = 0, uidvalidity = 0, uidnext = 0, first_unseen_seq = 0, first_recent_uid = 0, last_cached_seq = 0, highest_modseq = 834, keywords = 0x0, permanent_flags = 0, nonpermanent_modseqs = 0, permanent_keywords = 0, allow_new_keywords = 0} flags = 8 ret = #3 cmd_select_full (cmd=0x22259c0, readonly=false) at cmd-select.c:419 client = 0x2224e30 ctx = args = 0x2228218 list_args = 0x7fffbe1e9a58 mailbox = 0x21ec318 "INBOX" ret = __FUNCTION__ = "cmd_select_full" #4 0x000000000041134d in command_exec (cmd=0x22259c0) at imap-commands.c:147 hook = 0x21f5b40 ret = #5 0x000000000041031e in client_command_input (cmd=0x22259c0) at imap-client.c:673 client = 0x2224e30 command = __FUNCTION__ = "client_command_input" #6 0x00000000004103fd in client_command_input (cmd=0x22259c0) at imap-client.c:724 client = 0x2224e30 command = 0x0 __FUNCTION__ = "client_command_input" #7 0x0000000000410625 in client_handle_next_command (client=0x2224e30) at imap-client.c:765 size = 18 #8 client_handle_input (client=0x2224e30) at imap-client.c:777 _data_stack_cur_id = 3 ret = false remove_io = handled_commands = false __FUNCTION__ = "client_handle_input" #9 0x0000000000410f4f in client_input (client=0x2224e30) at imap-client.c:816 cmd = output = 0x2225828 bytes = __FUNCTION__ = "client_input" #10 0x00007fa68d0fbf36 in io_loop_call_io (io=0x22258d0) at ioloop.c:377 ioloop = 0x21f4630 t_id = 2 #11 0x00007fa68d0fcf6f in io_loop_handler_run (ioloop=) at ioloop-epoll.c:213 ctx = 0x21f4850 event = 0x21f48c0 list = 0x2225920 io = 0x22162f0 tv = {tv_sec = 29, tv_usec = 928551} msecs = ret = i = 0 call = false #12 0x00007fa68d0fbed8 in io_loop_run (ioloop=0x21f4630) at ioloop.c:396 No locals. #13 0x00007fa68d0e9433 in master_service_run (service=0x21f44f0, callback=0x21ec318) at master-service.c:499 No locals. #14 0x0000000000419141 in main (argc=1, argv=0x21f4370) at main.c:375 set_roots = {0x41c020, 0x0} service_flags = storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT postlogin_socket_path = 0x0 username = 0x0 c = [ doveconf -n ] # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 auth_cache_size = 16 k auth_verbose = yes mail_location = mdbox:~/mdbox mail_plugins = acl quota stats namespace { hidden = no inbox = yes location = prefix = separator = / type = private } namespace { list = yes location = mdbox:/var/vmail/public prefix = Public/ separator = / subscriptions = no type = public } passdb { args = username_format=%u /var/vmail/auth.d/%d/passwd driver = passwd-file } plugin { acl = vfile:/var/vmail/conf.d/%d/acls:cache_secs=300 mail_log_events = expunge mailbox_delete quota = dict:user::file:%h/mdbox/dovecot-quota quota_rule = *:storage=1GB quota_rule2 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/vmail/conf.d/%d/sieve stats_refresh = 30s stats_track_cmds = yes } protocols = imap lmtp quota_full_tempfail = yes service auth-worker { user = doveauth } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = doveauth } service imap-login { inet_listener imap { address = 1.2.3.4 port = 143 } inet_listener imaps { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_ca = From alec at alec.pl Sun Dec 4 10:00:52 2011 From: alec at alec.pl (A.L.E.C) Date: Sun, 04 Dec 2011 09:00:52 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> Message-ID: <4EDB28B4.4010606@alec.pl> On 2011-12-02 16:12, Timo Sirainen wrote: > It's implemented now in dovecot-2.1 hg. It also deprecates autocreate plugin (but it still works the old way). The idea is that you can now do e.g.: > mailbox Spam { > auto = create # autocreate, but don't autosubscribe > special_use = \Junk This looks very nice. Thanks Timo. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From maria_arrea at gmx.com Sun Dec 4 16:10:58 2011 From: maria_arrea at gmx.com (Maria Arrea) Date: Sun, 04 Dec 2011 15:10:58 +0100 Subject: [Dovecot] Questions about single intance storage Message-ID: <20111204141058.201500@gmx.com> Hello Timo. If we can not safely restore from backup a user's mailbox with SiS enabled, we can not enable SiS. Any plan to include this backup recovery tool in dovecot 2.0.X or 2.1? Regards Maria > 5? We use bacula to save indexes & mdboxes, and we recover mailboxes using doveadm import when a user "makes a fatal mistake" wiping all her Inbox. If we enable SiS I am not really sure how can we safely restore a user's INBOX if that user has SiS attachments. Hm. Yes, that is problematic.. Even if you knew what SIS files were used, there's no simple way to restore those with proper refcounts. I think what really should be done is writing a tool that can create/restore backups, possibly de-SISing the attachments.. From tss at iki.fi Sun Dec 4 19:21:55 2011 From: tss at iki.fi (Timo Sirainen) Date: Sun, 4 Dec 2011 19:21:55 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111204141058.201500@gmx.com> References: <20111204141058.201500@gmx.com> Message-ID: On 4.12.2011, at 16.10, Maria Arrea wrote: > If we can not safely restore from backup a user's mailbox with SiS enabled, we can not enable SiS. Any plan to include this backup recovery tool in dovecot 2.0.X or 2.1? I'd first have to design it. And before designing it I'd need to look into how the backup softwares usually work.. If anyone has any ideas about this, I'd like to hear. From terry at cnysupport.com Sun Dec 4 19:41:29 2011 From: terry at cnysupport.com (Terry Carmen) Date: Sun, 04 Dec 2011 12:41:29 -0500 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> Message-ID: <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> >> If we can not safely restore from backup a user's mailbox with SiS >> enabled, we can not enable SiS. Any plan to include this backup >> recovery tool in dovecot 2.0.X or 2.1? > > I'd first have to design it. And before designing it I'd need to > look into how the backup softwares usually work.. If anyone has any > ideas about this, I'd like to hear. BackupPC uses rsync by default for *nix boxes. No idea what SiS is, but I'm guessing you're running into the same problem as backing up any other open file with changing internal data that may be inconsistent. This is exactly what it's difficult (and pointless) to backup an open MySQL database or a SQL Server database. The snapshot of what's in memory doesn't always match what's on disk. The only ways I know around this are to periodically create a backup copy that *is* consistent and restorable and a utility to restore the backup back to the "live" storage format, or create a method for the software to flush it's buffers to disk then disconnect from the data file while the backup process is running. The first option takes ~2x the storage space, while the second option makes the user's data inaccessible during the backup. My apologies if I'm misunderstanding the problem and have been rambling for no purpose. 8-) Terry From tss at iki.fi Sun Dec 4 20:16:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Sun, 4 Dec 2011 20:16:20 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> Message-ID: On 4.12.2011, at 19.41, Terry Carmen wrote: >>> If we can not safely restore from backup a user's mailbox with SiS enabled, we can not enable SiS. Any plan to include this backup recovery tool in dovecot 2.0.X or 2.1? >> >> I'd first have to design it. And before designing it I'd need to look into how the backup softwares usually work.. If anyone has any ideas about this, I'd like to hear. > > BackupPC uses rsync by default for *nix boxes. > > No idea what SiS is, but I'm guessing you're running into the same problem as backing up any other open file with changing internal data that may be inconsistent. Inconsistency is an issue, but it's not the biggest problem. It would be possible to write a tool that scans through all mails and makes sure everything is consistent after a restore. dbox mostly does this automatically already, but SIS would need a separate program to ensure its consistency. SIS is anyway a single instance attachment storage. So that lets say you send one 100 MB pdf to 10 people, and it's stored only once in disk under /attachments/aa/bb/aabccddeeff-etc. Each people would have their own unique link under /attachments/, but all of them would be hard linked to a common file. So the problem is mainly about restoring a single user's mails. The mail files are simple to restore, but then you need to figure out which attachments to restore. There's no simple way to know which attachment files belong to which users, so you need to scan through the mail files and see what attachments are referred to. Also backing up the attachment links could be problematic if the backup system doesn't support hard links. Each attachment always has at least 2 links, so if the backup doesn't realize that it at minimum duplicates the space used by attachments. So I was thinking that there probably could be some tool that during a user's backup it would write the attachments among the user's other files, so it would be easy to find all of the files needed for a restore. This would of course mean that backups can take a lot more space, because there's no SIS. Perhaps there could be some other alternatives .. like maybe not storing the attachments directly to backups, but add symlinks to them so they can be used to figure out what to restore. Or maybe the backing up wouldn't need a special tool, but the restoring tool could just read through the dbox files to see what attachments are also needed and write a list of them somewhere so they can be taken from backups as well. I'm not really sure what is the best way. From micah at riseup.net Sun Dec 4 21:03:55 2011 From: micah at riseup.net (Micah Anderson) Date: Sun, 04 Dec 2011 14:03:55 -0500 Subject: [Dovecot] Plugin for munin References: <4ED8E113.9050908@wk-serv.de> Message-ID: <877h2ci2g4.fsf@algae.riseup.net> Eduardo Casarero writes: > 2011/12/2 Patrick Westenberg > >> Hi there, >> >> is anyone using munin to monitor connections to dovecot? >> If someone does, which plugin is used? I'm using the one from nagiosexchange, but I modified it for dovecot2: #!/bin/sh # # Munin Plugin # to count logins to your dovecot mailserver # # Created by Dominik Schulz # http://developer.gauner.org/munin/ # Contributions by: # - Stephane Enten # - Micah Anderson (updated for dovecot2) # # Parameters understood: # # config (required) # autoconf (optional - used by munin-config) # # Config variables: # # logfile - Where to find the syslog file # # Add the following line to a file in /etc/munin/plugin-conf.d: # env.logfile /var/log/your/logfile.log # # Magic markers (optional - used by munin-config and installation scripts): # #%# family=auto #%# capabilities=autoconf ###################### # Configuration ###################### STAT_FILE=/var/lib/munin/plugin-state/plugin-dovecot.state EXPR_BIN=/usr/bin/expr LOGFILE=${logfile:-/var/log/mail.log} ###################### if [ "$1" = "autoconf" ]; then echo yes exit 0 fi if [ "$1" = "config" ]; then echo 'graph_title Dovcecot Logins' echo 'graph_args --base 1000 -l 0' echo 'graph_vlabel Login Counters' echo 'login_total.label Total Logins' echo 'login_tls.label TLS Logins' echo 'login_ssl.label SSL Logins' echo 'login_imap.label IMAP Logins' echo 'login_pop3.label POP3 Logins' echo 'connected.label Connected Users' exit 0 fi ############################# # Initialization ############################# if [ ! -r $STAT_FILE ]; then echo "TOTAL=0" > $STAT_FILE echo "TLS=0" >> $STAT_FILE echo "SSL=0" >> $STAT_FILE echo "IMAP=0" >> $STAT_FILE echo "POP3=0" >> $STAT_FILE fi ############################# ###################### # Total Logins ###################### /bin/echo -en "login_total.value " NEW_TOTAL=$(egrep 'dovecot.*Login' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_TOTAL=$(grep TOTAL $STAT_FILE | cut -f2 -d '=') TOTAL=$($EXPR_BIN $NEW_TOTAL - $OLD_TOTAL) if [ $TOTAL -gt 0 ]; then echo "$TOTAL" else echo "0" fi echo -n ###################### # Connected Users ###################### CONNECTS=$(doveadm -f flow who -1 |wc -l) /bin/echo -en "connected.value " echo $CONNECTS echo -n ###################### # TLS Logins ###################### /bin/echo -en "login_tls.value " NEW_TLS=$(egrep 'dovecot.*Login.*TLS' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_TLS=$(grep TLS $STAT_FILE | cut -f2 -d '=') TLS=$($EXPR_BIN $NEW_TLS - $OLD_TLS) if [ $TLS -gt 0 ]; then echo "$TLS" else echo "0" fi echo -n ###################### # SSL Logins ###################### /bin/echo -en "login_ssl.value " NEW_SSL=$(egrep 'dovecot.*Login.*SSL' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_SSL=$(grep SSL $STAT_FILE | cut -f2 -d '=') SSL=$($EXPR_BIN $NEW_SSL - $OLD_SSL) if [ $SSL -gt 0 ]; then echo "$SSL" else echo "0" fi echo -n ###################### # IMAP Logins ###################### /bin/echo -en "login_imap.value " NEW_IMAP=$(egrep 'dovecot.*imap.*Login' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_IMAP=$(grep IMAP $STAT_FILE | cut -f2 -d '=') IMAP=$($EXPR_BIN $NEW_IMAP - $OLD_IMAP) if [ $IMAP -gt 0 ]; then echo "$IMAP" else echo "0" fi echo -n ###################### # POP3 Logins ###################### /bin/echo -en "login_pop3.value " NEW_POP3=$(egrep 'dovecot.*pop3.*Login' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_POP3=$(grep POP3 $STAT_FILE | cut -f2 -d '=') POP3=$($EXPR_BIN $NEW_POP3 - $OLD_POP3) if [ $POP3 -gt 0 ]; then echo "$POP3" else echo "0" fi echo -n ###################### # Save the new values ###################### echo "TOTAL=$NEW_TOTAL" > $STAT_FILE echo "TLS=$NEW_TLS" >> $STAT_FILE echo "SSL=$NEW_SSL" >> $STAT_FILE echo "IMAP=$NEW_IMAP" >> $STAT_FILE echo "POP3=$NEW_POP3" >> $STAT_FILE From terry at cnysupport.com Sun Dec 4 22:16:02 2011 From: terry at cnysupport.com (Terry Carmen) Date: Sun, 04 Dec 2011 15:16:02 -0500 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> Message-ID: <20111204151602.Horde.tWy1GVeGiNBO29UCBMPVY2A@www.cnysupport.com> > So I was thinking that there probably could be some tool that during > a user's backup it would write the attachments among the user's > other files, so it would be easy to find all of the files needed for > a restore. This would of course mean that backups can take a lot > more space, because there's no SIS. Perhaps there could be some other I see. Instead of writing the links directly to the filesystem, why not keep a links list (not a linked list 8-)) file in each directory that contains the information for the links that should be there (source, dest, attributes), then add an inotify hook in Dovecot to create/update/delete the hard links in the directory so they match the links list? The links list would only need to be opened when there's a change and could remain closed (and backup-able) at all other times, and restoring a links list would immediately trigger the inotify hook and regenerate all the required links. Terry From dovecot.fdop at tagged.lorens.org Mon Dec 5 00:07:05 2011 From: dovecot.fdop at tagged.lorens.org (Lorens Kockum) Date: Sun, 4 Dec 2011 23:07:05 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> Message-ID: <20111204220705.GA23867@tagged.lorens.org> Timo Sirainen wrote: > And before designing it I'd need to look into how the backup > softwares usually work.. If anyone has any ideas about this, > I'd like to hear. Simple or even moderately efficient backup programs like rsync copy all the files. Of course, if the program copies directories A B C in that order, then while B is being backed up, a file A/x could be created, and a file C/index could be modified to reflect that A/x exists. C/index would be backed up, but A/x would not be. The way around that is with snapshots. Linux supports this with LVM, FreeBSD with UFS and ZFS file systems, Windows with VSS, and all selfcontained disk arrays I know of implement snapshots. The application quiesces its disk writes, flushes buffers to disk, triggers a snapshot, and resumes work as usual. > Also backing up the attachment links could be problematic if > the backup system doesn't support hard links. Each attachment > always has at least 2 links, so if the backup doesn't realize > that it at minimum duplicates the space used by attachments. rsync recognizes hard links with option -H, but at a very noticeable performance cost when dealing with millions of files. If the aa/bb/aabccddeeff-etc is unique across the whole mailstore, it would be easy to replace the hard link with a symlink, as you said: > maybe not storing the attachments directly to backups, but add > symlinks to them so they can be used to figure out what to > restore. Or maybe the backing up wouldn't need a special tool, > but the restoring tool could just read through the dbox files > to see what attachments are also needed and write a list of > them somewhere so they can be taken from backups as well. In the second way, you would have a separate hierarchy for multiple-recipient attachments, or would the attachment be "really" stored in the box of a recipient chosen at random? Just some random thoughts: professionally, I use Zimbra. Messages are stored in Maildir-equivalents. The time it takes to backup is a quite severe constraint on the backup technique. For example, compressing the backup files takes too long, so the zip files are not compressed. Instead, the individual mails are stored compressed on disk. Each backup zips up the mails in a few big backup files. An improvement could be to sort mails into backup zip files so that once a zip file is made, it stays the same. After all, if a mail is not deleted a month after it is read, then it will probably stay in the same state forever, or at least until the user starts a keep-me-under-quota cleaning-up spree. During this time, backing up that big zip file can just be a check to see if it is already OK in the backup, which is much quicker. I have no idea if this could be applied to Dovecot, but who knows. From alepivain at lagoon.nc Mon Dec 5 01:17:54 2011 From: alepivain at lagoon.nc (Amaury Le Pivain) Date: Mon, 05 Dec 2011 10:17:54 +1100 Subject: [Dovecot] Dovecot crash non stop: "uid 0: exited on signal 11" Message-ID: <4EDBFFA2.2020701@lagoon.nc> Hi all, I have an old physical freebsd 6.2 server running Dovecot 1.0.7. I wanted to virtualised it. So, I did a dd from the physical server and then I restored it on then now Virtual Machine. I booted the server, all services are running just fine excepted Dovecot. I tried to investigate the log as much as I can but i'm not getting any usefull pieces of information. The only entries I have in the log files are the following: /*log: /var/log/messages:*/ /Dec 5 09:53:35 hostname kernel: pid 33815 (imap), uid 0: exited on signal 11 Dec 5 09:53:39 hostname kernel: pid 33820 (imap), uid 0: exited on signal 11 Dec 5 09:54:22 hostname kernel: pid 33910 (pop3), uid 0: exited on signal 11 Dec 5 09:55:22 hostname kernel: pid 34071 (pop3), uid 0: exited on signal 11 Dec 5 09:55:47 hostname kernel: pid 34103 (imap), uid 0: exited on signal 11 Dec 5 09:56:13 hostname kernel: pid 34143 (pop3), uid 0: exited on signal 11 Dec 5 09:56:21 hostname kernel: pid 34164 (pop3), uid 0: exited on signal 11 Dec 5 09:56:26 hostname kernel: pid 34180 (imap), uid 0: exited on signal 11 Dec 5 09:56:40 hostname kernel: pid 34201 (imap), uid 0: exited on signal 11 Dec 5 09:56:49 hostname kernel: pid 34227 (imap), uid 0: exited on signal 11/ /*log: /mail/log/dovecot.log:* dovecot: Dec 05 10:13:46 Info: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot: Dec 05 10:13:46 Error: child 36621 (imap) killed with signal 11/ I'm also running a squirrelmail as a webmail and here when I refresh a folder content 3/5 times I'm getting an error: /Error: Connection dropped by IMAP server Query: SELECT "INBOX.Corbeille"/ I'm using Dovecot version 1.0.7 on a freebsd 6.2 and my dovecot.conf is: dovecot -n /# 1.0.7: /usr/local/etc/dovecot.conf base_dir: /mail/ log_path: /mail/log/dovecot.log protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /mail//login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: POP3/IMAP ready. verbose_proctitle: yes first_valid_gid: 0 mail_extra_groups: mail mail_location: maildir:~/Maildir fsync_disable: yes maildir_copy_with_hardlinks: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota trash mail_plugins(imap): quota imap_quota trash mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: default_realm: tropik.nc passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen master: path: /mail/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir trash: /usr/local/etc/dovecot-trash.conf/ Thank you for your help! Sincerely, -- Amaury Le Pivain Offratel/Lagoon Tel: 28.88.99 From tss at iki.fi Mon Dec 5 01:40:54 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 01:40:54 +0200 Subject: [Dovecot] Dovecot crash non stop: "uid 0: exited on signal 11" In-Reply-To: <4EDBFFA2.2020701@lagoon.nc> References: <4EDBFFA2.2020701@lagoon.nc> Message-ID: On 5.12.2011, at 1.17, Amaury Le Pivain wrote: > I have an old physical freebsd 6.2 server running Dovecot 1.0.7. I wanted to virtualised it. > > So, I did a dd from the physical server and then I restored it on then now Virtual Machine. > > I booted the server, all services are running just fine excepted Dovecot. > > I tried to investigate the log as much as I can but i'm not getting any usefull pieces of information. The only entries I have in the log files are the following: > > /*log: /var/log/messages:*/ > > /Dec 5 09:53:35 hostname kernel: pid 33815 (imap), uid 0: exited on signal 11 This means it crashes. A gdb backtrace might tell why... But I think it would be less trouble to simply upgrade Dovecot to a newer version (at least v1.2.x) where there's a good chance that this has already been fixed. From tss at iki.fi Mon Dec 5 01:51:05 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 01:51:05 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111204220705.GA23867@tagged.lorens.org> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204220705.GA23867@tagged.lorens.org> Message-ID: <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> On 5.12.2011, at 0.07, Lorens Kockum wrote: > Timo Sirainen wrote: >> And before designing it I'd need to look into how the backup >> softwares usually work.. If anyone has any ideas about this, >> I'd like to hear. > > Simple or even moderately efficient backup programs like rsync > copy all the files. I'm mainly wondering if it's common for backup programs to support using a separate program to generate the backups. For example if there was a "dovecot-backup" binary that just dumps all (or new-since-last-backup) of the users' mails into stdout, which the backup program can use. Or perhaps in that case there wouldn't really be much of anything for the backup to do except to write it to tape.. >> Also backing up the attachment links could be problematic if >> the backup system doesn't support hard links. Each attachment >> always has at least 2 links, so if the backup doesn't realize >> that it at minimum duplicates the space used by attachments. > > rsync recognizes hard links with option -H, but at a very > noticeable performance cost when dealing with millions of > files. If the aa/bb/aabccddeeff-etc is unique across the whole > mailstore, it would be easy to replace the hard link with a > symlink, as you said: SIS was designed to work with hard links. They couldn't be replaced with symlinks without a redesign (which would be less efficient in normal operation). >> maybe not storing the attachments directly to backups, but add >> symlinks to them so they can be used to figure out what to >> restore. Or maybe the backing up wouldn't need a special tool, >> but the restoring tool could just read through the dbox files >> to see what attachments are also needed and write a list of >> them somewhere so they can be taken from backups as well. > > In the second way, you would have a separate hierarchy for > multiple-recipient attachments, or would the attachment be > "really" stored in the box of a recipient chosen at random? I meant that SIS would work exactly like it works now, with hard links and everything, but on top of that it would also create symlinks to the used files simply to make it easier to find what files are used. The annoying thing about that is that in error situations the symlinks can get out of sync with the reality. > Just some random thoughts: professionally, I use > Zimbra. Messages are stored in Maildir-equivalents. The time > it takes to backup is a quite severe constraint on the backup > technique. For example, compressing the backup files takes > too long, so the zip files are not compressed. Instead, the > individual mails are stored compressed on disk. Each backup > zips up the mails in a few big backup files. You mean you first create uncompressed zip files (why not just tar?) of all the mails to the filesystem and the backup software then backups those zip files? > An improvement > could be to sort mails into backup zip files so that once a > zip file is made, it stays the same. After all, if a mail is not > deleted a month after it is read, then it will probably stay > in the same state forever, or at least until the user starts a > keep-me-under-quota cleaning-up spree. During this time, backing > up that big zip file can just be a check to see if it is already > OK in the backup, which is much quicker. I have no idea if this > could be applied to Dovecot, but who knows. Dovecot's mdbox files already contain multiple messages in each file, so it should be a lot more efficient to do backups on those. And each message in an mdbox file can be compressed if zlib plugin is enabled. So I think that sounds quite a lot like what you propose. From stan at hardwarefreak.com Mon Dec 5 03:03:32 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sun, 04 Dec 2011 19:03:32 -0600 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> Message-ID: <4EDC1864.60703@hardwarefreak.com> On 12/4/2011 12:16 PM, Timo Sirainen wrote: > On 4.12.2011, at 19.41, Terry Carmen wrote: > >>>> If we can not safely restore from backup a user's mailbox with SiS enabled, we can not enable SiS. Any plan to include this backup recovery tool in dovecot 2.0.X or 2.1? >>> >>> I'd first have to design it. And before designing it I'd need to look into how the backup softwares usually work.. If anyone has any ideas about this, I'd like to hear. >> >> BackupPC uses rsync by default for *nix boxes. >> >> No idea what SiS is, but I'm guessing you're running into the same problem as backing up any other open file with changing internal data that may be inconsistent. > > Inconsistency is an issue, but it's not the biggest problem. It would be possible to write a tool that scans through all mails and makes sure everything is consistent after a restore. dbox mostly does this automatically already, but SIS would need a separate program to ensure its consistency. > > SIS is anyway a single instance attachment storage. So that lets say you send one 100 MB pdf to 10 people, and it's stored only once in disk under /attachments/aa/bb/aabccddeeff-etc. Each people would have their own unique link under /attachments/, but all of them would be hard linked to a common file. > > So the problem is mainly about restoring a single user's mails. The mail files are simple to restore, but then you need to figure out which attachments to restore. There's no simple way to know which attachment files belong to which users, so you need to scan through the mail files and see what attachments are referred to. > > Also backing up the attachment links could be problematic if the backup system doesn't support hard links. Each attachment always has at least 2 links, so if the backup doesn't realize that it at minimum duplicates the space used by attachments. > > So I was thinking that there probably could be some tool that during a user's backup it would write the attachments among the user's other files, so it would be easy to find all of the files needed for a restore. This would of course mean that backups can take a lot more space, because there's no SIS. Perhaps there could be some other alternatives .. like maybe not storing the attachments directly to backups, but add symlinks to them so they can be used to figure out what to restore. Or maybe the backing up wouldn't need a special tool, but the restoring tool could just read through the dbox files to see what attachments are also needed and write a list of them somewhere so they can be taken from backups as well. > > I'm not really sure what is the best way. Backup and restore user hard links to SiS files, but not the files themselves. A single user "Oops" isn't going to delete the shared SiS files (they're already read only until the "last user" aren't they?). Thus we can assume the SiS files are always intact but for catastrophic failure. To cope with catastrophic failure, create a "special" Dovecot administrator only mailbox (real/virtual/whatever) that "contains" all of the SiS files, a special Dovecot index. Back this mailbox up separately, just like you would any mailbox--i.e. backup the SiS mailbox independently from individual user backups. In the event of catastrophic failure, restore the SiS mailbox first, then user mailboxes, so user mailbox hard link creation during restore succeeds. I would think something like this should maintain compatibility with standard IMAP backup software. I don't know if this could be done directly at the filesystem level. If this special mailbox simply contained hard links to the SiS files, would a restore operation at the filesystem level simply attempt to (re)create the hard links, or would it actually writes the files to their original filesystem locations? If only the former, then this proposed solution would only work with IMAP based backup/restore. Just thinking out loud. There are probably better ways to do this. -- Stan From tss at iki.fi Mon Dec 5 03:45:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 03:45:19 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EDC1864.60703@hardwarefreak.com> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> Message-ID: On 5.12.2011, at 3.03, Stan Hoeppner wrote: > To cope with catastrophic failure, create a "special" Dovecot > administrator only mailbox (real/virtual/whatever) that "contains" all > of the SiS files, a special Dovecot index. I'm not thinking about a catastrophe. For that a regular full filesystem backup+restore would work mostly okay (a snapshot would be perfect, without snapshot some extra work would be needed). The problem is that people want to recover only one specific user's mails from some older backup, because they accidentally deleted the mails.. This needs to be somewhat easy to implement with SIS, but it isn't. From dovecot.fdop at tagged.lorens.org Mon Dec 5 09:19:27 2011 From: dovecot.fdop at tagged.lorens.org (Lorens Kockum) Date: Mon, 5 Dec 2011 08:19:27 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204220705.GA23867@tagged.lorens.org> <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> Message-ID: <20111205071927.GA20731@tagged.lorens.org> On Mon, Dec 05, 2011 at 01:51:05AM +0200, Timo Sirainen wrote: > I'm mainly wondering if it's common for backup programs to > support using a separate program to generate the backups. For > example if there was a "dovecot-backup" binary that just > dumps all (or new-since-last-backup) of the users' mails into > stdout, which the backup program can use. Or perhaps in that > case there wouldn't really be much of anything for the backup > to do except to write it to tape.. For databases, most commercial programs use some kind of application-specific plugins. Bakula has "Client Run Before Job" which permits indicating a command to be run before proceeding with the backup, maybe there is more. However I have not heard of any standardized way of doing it so that the application provider could provide a way to interact with multiple backup programs. It's more like each backup vendor boasting that his backup software can backup application XXX without downtime. > SIS was designed to work with hard links. They couldn't be > replaced with symlinks without a redesign (which would be less > efficient in normal operation). Right, but if the backup program recognized this then maybe the replacement by a symlink could be done only in the backup. rsync has to keep in memory all the inodes and check the list every time a hard link is found. If it knew that "a hard link in attachments should link to an identical file name in the common attachment SiS store. > [Zimbra] > > You mean you first create uncompressed zip files (why not > just tar?) of all the mails to the filesystem and the backup > software then backups those zip files? Well, not I, this is Zimbra's backup system :-) The backups are the destination zips. Maybe zip is used because the extension and extraction method is the same whether compressed or not; that way compression is just an option to the backup program to be turned on or off. > Dovecot's mdbox files already contain multiple messages in > each file, so it should be a lot more efficient to do backups > on those. And each message in an mdbox file can be compressed > if zlib plugin is enabled. So I think that sounds quite a lot > like what you propose. Is that combined or combinable with SiS? If attachments are in separate files, that means they are aligned on block boundaries, which make block-level SiS (like NetApp's) much more efficient. Think of an attachment sent to all department heads, all of whom forward the attachment to all their subordinates. From Mark.Zealey at webfusion.com Mon Dec 5 11:01:55 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Mon, 5 Dec 2011 09:01:55 +0000 Subject: [Dovecot] (no subject) Message-ID: From janfrode at tanso.net Mon Dec 5 11:36:24 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 5 Dec 2011 10:36:24 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204220705.GA23867@tagged.lorens.org> <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> Message-ID: <20111205093624.GA18025@dibs.tanso.net> On Mon, Dec 05, 2011 at 01:51:05AM +0200, Timo Sirainen wrote: > > I'm mainly wondering if it's common for backup programs to support using a separate program to generate the backups. For example if there was a "dovecot-backup" binary that just dumps all (or new-since-last-backup) of the users' mails into stdout, which the backup program can use. Or perhaps in that case there wouldn't really be much of anything for the backup to do except to write it to tape.. I know at least tivoli storage manager (TSM) should be able to handle such lists. AFAIK this is how GPFS's "mmbackup" utility works. It utilizes a fast inode scan API to find all candidate files, and will be much more efficient than a normal backup client that traverses the whole fs. https://www-304.ibm.com/support/docview.wss?uid=swg21305169 But in addition to new-since-last-backup, we would probably also need a deleted-since-last-backup feature. -jf From xavier.pons at uib.es Mon Dec 5 16:26:54 2011 From: xavier.pons at uib.es (Xavier Pons) Date: Mon, 05 Dec 2011 15:26:54 +0100 Subject: [Dovecot] lmtp panic in proxy lmtp director Message-ID: <4EDCD4AE.8030607@uib.es> Hi, we are getting some core dumps with signal 6 in ltmp on a dovecot director proxy server, like this: Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Panic: file lmtp-proxy.c: line 376 (lmtp_proxy_output_timeout): assertion failed: (proxy->data_input->eof) Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x363323d99a] -> /usr/lib64/dovecot/libdovecot.so.0() [0x363323d9e6] -> /usr/lib64/dovecot/libdovecot.so.0(i_error+0) [0x3633216f8f] -> dovecot/lmtp() [0x406e57] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xd4) [0x3633248ff4] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x5b) [0x3633249bdb] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x3633248c58] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x3633236fc3] -> dovecot/lmtp(main+0x154) [0x403f84] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x373cc1ec5d] -> dovecot/lmtp() [0x403d69] Dec 5 14:31:51 sproxy1 abrt[30067]: saved core dump of pid 29999 (/usr/libexec/dovecot/lmtp) to /var/spool/abrt/ccpp-1323091911-29999.new/coredump (1368064 bytes) Dec 5 14:31:51 sproxy1 dovecot: master: Error: service(lmtp): child 29999 killed with signal 6 (core dumped) we have something misconfigured or it's a bug on this dovecot version? our doveconf -n is: # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-71.29.1.el6.x86_64 x86_64 CentOS Linux release 6.0 (Final) auth_cache_size = 3 k auth_cache_ttl = 15 mins auth_verbose = yes base_dir = /var/run/dovecot/ default_client_limit = 30000 default_process_limit = 5000 director_doveadm_port = 990 director_mail_servers = 10.80.82.21 10.80.82.22 director_servers = 10.80.82.11 10.80.82.12 doveadm_proxy_port = 24245 lmtp_proxy = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = proxy=y nopassword=y starttls=any-cert driver = static } postmaster_address = xavier.pons at uib.es protocols = imap pop3 lmtp sieve service auth { client_limit = 27048 unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = dovecot mode = 0660 } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 991 } inet_listener director-doveadm { port = 990 } unix_listener director-userdb { mode = 0660 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap-login { executable = imap-login director inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { port = 30025 } } service managesieve-login { executable = managesieve-login director } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_cert = Hello, Could you confirm that the SIS is integrated and functional in the latest version of Dovecot? Regards Guy From terry at cnysupport.com Mon Dec 5 19:16:47 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 12:16:47 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> Message-ID: <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> It's working beautifully! Is there any way to get it to log failed login attempts with the user's IP address? I'd like to setup fail2ban to stop dictionary attacks, however even with debugging, the most I've been able to get it to say is: Dec 5 12:11:30 machinename dovecot: auth: Debug: client out: FAIL#0111#011user=username Is there any possibility of getting the remote IP in there somewhere, or is there a different setting specifically to enable logging auth failures? Thanks! From janfrode at tanso.net Mon Dec 5 20:06:37 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 5 Dec 2011 19:06:37 +0100 Subject: [Dovecot] lmtp panic in proxy lmtp director In-Reply-To: <4EDCD4AE.8030607@uib.es> References: <4EDCD4AE.8030607@uib.es> Message-ID: <20111205180637.GA27400@dibs.tanso.net> On Mon, Dec 05, 2011 at 03:26:54PM +0100, Xavier Pons wrote: > Hi, we are getting some core dumps with signal 6 in ltmp on a > dovecot director proxy server, like this: http://dovecot.org/list/dovecot/2011-September/060830.html http://www.dovecot.org/list/dovecot/2011-September/061395.html > we have something misconfigured or it's a bug on this dovecot version? I believe there's too short LMTP_PROXY_DATA_INPUT_TIMEOUT_MSECS in lmtp-proxy.c. -jf From ghandidrivesahumvee at rocketfish.com Mon Dec 5 20:17:57 2011 From: ghandidrivesahumvee at rocketfish.com (Dovecot-GDH) Date: Mon, 5 Dec 2011 10:17:57 -0800 Subject: [Dovecot] lmtp panic in proxy lmtp director In-Reply-To: <4EDCD4AE.8030607@uib.es> References: <4EDCD4AE.8030607@uib.es> Message-ID: This happens when the LMTP proxy doesn't receive feedback from the back-end LMTP process for a certain amount of time. This typically happens either because of very low I/O performance or NFS locks. Do an strace on your back-end LMTP processes. If you see that these processes are waiting on NFS locks ande you are using NFSv3, you should move over to NFSv4. On Dec 5, 2011, at 6:26 AM, Xavier Pons wrote: > Hi, we are getting some core dumps with signal 6 in ltmp on a dovecot director proxy server, > like this: > > Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Panic: file lmtp-proxy.c: line 376 (lmtp_proxy_output_timeout): assertion failed: (proxy->data_input->eof) > Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x363323d99a] -> /usr/lib64/dovecot/libdovecot.so.0() [0x363323d9e6] -> /usr/lib64/dovecot/libdovecot.so.0(i_error+0) [0x3633216f8f] -> dovecot/lmtp() [0x406e57] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xd4) [0x3633248ff4] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x5b) [0x3633249bdb] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x3633248c58] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x3633236fc3] -> dovecot/lmtp(main+0x154) [0x403f84] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x373cc1ec5d] -> dovecot/lmtp() [0x403d69] > Dec 5 14:31:51 sproxy1 abrt[30067]: saved core dump of pid 29999 (/usr/libexec/dovecot/lmtp) to /var/spool/abrt/ccpp-1323091911-29999.new/coredump (1368064 bytes) > Dec 5 14:31:51 sproxy1 dovecot: master: Error: service(lmtp): child 29999 killed with signal 6 (core dumped) > > we have something misconfigured or it's a bug on this dovecot version? > > our doveconf -n is: > # 2.0.15: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-71.29.1.el6.x86_64 x86_64 CentOS Linux release 6.0 (Final) > auth_cache_size = 3 k > auth_cache_ttl = 15 mins > auth_verbose = yes > base_dir = /var/run/dovecot/ > default_client_limit = 30000 > default_process_limit = 5000 > director_doveadm_port = 990 > director_mail_servers = 10.80.82.21 10.80.82.22 > director_servers = 10.80.82.11 10.80.82.12 > doveadm_proxy_port = 24245 > lmtp_proxy = yes > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave > passdb { > args = proxy=y nopassword=y starttls=any-cert > driver = static > } > postmaster_address = xavier.pons at uib.es > protocols = imap pop3 lmtp sieve > service auth { > client_limit = 27048 > unix_listener /var/spool/postfix/private/auth { > mode = 0666 > } > unix_listener auth-userdb { > group = dovecot > mode = 0660 > } > } > service director { > fifo_listener login/proxy-notify { > mode = 0666 > } > inet_listener { > port = 991 > } > inet_listener director-doveadm { > port = 990 > } > unix_listener director-userdb { > mode = 0660 > } > unix_listener login/director { > mode = 0666 > } > } > service doveadm { > inet_listener { > port = 24245 > } > } > service imap-login { > executable = imap-login director > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > service lmtp { > inet_listener lmtp { > port = 30025 > } > } > service managesieve-login { > executable = managesieve-login director > } > service pop3-login { > executable = pop3-login director > inet_listener pop3 { > port = 110 > } > inet_listener pop3s { > port = 995 > ssl = yes > } > } > ssl = required > ssl_cert = ssl_key = syslog_facility = local1 > verbose_proctitle = yes > protocol lmtp { > auth_socket_path = director-userdb > passdb { > args = /etc/dovecot/dovecot-ldap-pass.conf.lmtp > driver = ldap > } > } > protocol doveadm { > auth_socket_path = director-userdb > } > protocol imap { > mail_max_userip_connections = 20 > } > protocol pop3 { > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > } > > Xavier > > -- > xavier.pons at uib.es > Centre de Tecnologies de la Informaci? > Universitat Illes Balears > > From janfrode at tanso.net Mon Dec 5 21:14:40 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 5 Dec 2011 20:14:40 +0100 Subject: [Dovecot] Strange quota problem Message-ID: <20111205191440.GA28330@dibs.tanso.net> I have a strange problems with quota on v2.0.14. We have an ldap user directory, and all users should have a mailQuota defined there. My problem is that some users gets the quota enforced, while others don't, and "doveadm user" doesn't seem to agree with "doveadm quota ge gett" Ref: $ doveadm user janfrode at example.net userdb: janfrode at example.net home : /usr/local/atmail/users/j/a/janfrode at example.net mailQuota : quota_rule=*:storage=2100000 $ doveadm -f tab quota get -u janfrode at example.net Quota name Type Value Limit % UserQuota STORAGE 760 1000000 0 UserQuota MESSAGE 62 - 0 Why limit 1000000 instead of 2100000 ? $ doveadm user omar at example.net userdb: omar at example.net home : /usr/local/atmail/users/o/m/omar at example.net mailQuota : quota_rule=*:storage=1000000 $ sudo doveadm -f tab quota get -u omar at example.net Quota name Type Value Limit % UserQuota STORAGE 0 - 0 UserQuota MESSAGE 0 - 0 $ doveadm user testkunde at example.net userdb: testkunde at example.net home : /usr/local/atmail/users/t/e/testkunde at example.net mailQuota : quota_rule=*:storage=1000000 $ doveadm -f tab quota get -u testkunde at example.net Quota name Type Value Limit % UserQuota STORAGE 33918 - 0 UserQuota MESSAGE 137 - 0 Why no storage limit ? Config below: ------------------------------------------------------------------ $ grep -v ^# /etc/dovecot/dovecot-ldap.conf.ext |grep -v ^$ hosts = ldapm1.example.net:389 ldapm2.example.net:389 auth_bind = yes auth_bind_userdn = uid=%n,ou=people,o=%d,o=ISP,o=example,c=NET base = ou=people,o=%d,o=ISP,o=example,c=NET deref = never scope = onelevel user_attrs = mailMessageStore=home, mailLocation=mail, mailQuota=mailQuota=quota_rule=*:storage=%$ user_filter = (&(objectClass=examplePerson)(uid=%n)) $ doveconf -n # 2.0.14: /etc/dovecot/dovecot.conf doveconf: Warning: service auth { client_limit=4396 } is lower than required under max. load (4521) # OS: x86_64 Red Hat Enterprise Linux Server release 5.x (Tikanga) auth_verbose = yes auth_verbose_passwords = sha1 disable_plaintext_auth = no mail_gid = 3000 mail_location = maildir:~/:INDEX=/indexes/%1u/%1.1u/%u mail_plugins = quota mail_uid = 3000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { quota = maildir:UserQuota sieve = /sieve/%1u/%1.1u/%u/.dovecot.sieve sieve_dir = /sieve/%1u/%1.1u/%u sieve_max_script_size = 1M } protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { client_limit = 4396 } service imap-login { inet_listener imap { address = * port = 143 } } service imap-postlogin { executable = script-login /usr/local/sbin/imap-postlogin.sh } service imap { executable = imap imap-postlogin process_limit = 2048 } service lmtp { client_limit = 1 inet_listener lmtp { address = * port = 24 } process_limit = 25 } service managesieve-login { inet_listener sieve { address = * port = 4190 } service_count = 1 } service pop3-login { inet_listener pop3 { address = * port = 110 } } service pop3-postlogin { executable = script-login /usr/local/sbin/pop3-postlogin.sh } service pop3 { executable = pop3 pop3-postlogin process_limit = 2048 } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = quota sieve } protocol imap { imap_client_workarounds = delay-newmail mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = UID%u-%v } protocol sieve { managesieve_logout_format = bytes=%i/%o } ------------------------------------------------------------------ -jf From tss at iki.fi Mon Dec 5 21:48:08 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 21:48:08 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> Message-ID: On 3.12.2011, at 18.10, Terry Carmen wrote: > I'll post a writeup on the wiki on monday. I moved it to http://wiki2.dovecot.org/HowTo/ImapcProxy From tss at iki.fi Mon Dec 5 21:49:15 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 21:49:15 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> Message-ID: <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> On 5.12.2011, at 19.16, Terry Carmen wrote: > It's working beautifully! > > Is there any way to get it to log failed login attempts with the user's IP address? auth_verbose=yes > I'd like to setup fail2ban to stop dictionary attacks, however even with debugging, the most I've been able to get it to say is: > > Dec 5 12:11:30 machinename dovecot: auth: Debug: client out: FAIL#0111#011user=username If you enabled auth_debug, it enabled auth_verbose also.. So you should have those log messages. Maybe they're being logged to a different file? From tss at iki.fi Mon Dec 5 21:50:32 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 21:50:32 +0200 Subject: [Dovecot] Strange quota problem In-Reply-To: <20111205191440.GA28330@dibs.tanso.net> References: <20111205191440.GA28330@dibs.tanso.net> Message-ID: On 5.12.2011, at 21.14, Jan-Frode Myklebust wrote: > userdb: janfrode at example.net > home : /usr/local/atmail/users/j/a/janfrode at example.net > mailQuota : quota_rule=*:storage=2100000 it should say: quota_rule: *:storage=2100000 So, fix user_attrs: user_attrs = mailMessageStore=home, mailLocation=mail, mailQuota=quota_rule=*:storage=%$ From terry at cnysupport.com Mon Dec 5 22:27:58 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 15:27:58 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> Message-ID: <20111205152758.Horde.bmYUeVeGiNBO3SlOSgojj2A@www.cnysupport.com> >> I'll post a writeup on the wiki on monday. > > I moved it to http://wiki2.dovecot.org/HowTo/ImapcProxy Thanks! I didn't realize I was in the wrong wiki. Terry From janfrode at tanso.net Mon Dec 5 23:05:19 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 5 Dec 2011 22:05:19 +0100 Subject: [Dovecot] Strange quota problem In-Reply-To: References: <20111205191440.GA28330@dibs.tanso.net> Message-ID: <20111205210519.GA30303@dibs.tanso.net> On Mon, Dec 05, 2011 at 09:50:32PM +0200, Timo Sirainen wrote: > On 5.12.2011, at 21.14, Jan-Frode Myklebust wrote: > > > userdb: janfrode at example.net > > home : /usr/local/atmail/users/j/a/janfrode at example.net > > mailQuota : quota_rule=*:storage=2100000 > > it should say: > > quota_rule: *:storage=2100000 Oh, I had mailQuota=mailQuota=quota_rule=*:storage=%$ > So, fix user_attrs: > > user_attrs = mailMessageStore=home, mailLocation=mail, mailQuota=quota_rule=*:storage=%$ Thanks! -jf From terry at cnysupport.com Mon Dec 5 23:05:08 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 16:05:08 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> Message-ID: <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Mon, 5 Dec 2011 21:49:15 +0200 From: Timo Sirainen Reply-To: Dovecot Mailing List Subject: Re: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) To: Terry Carmen Cc: dovecot at dovecot.org > On 5.12.2011, at 19.16, Terry Carmen wrote: > >> It's working beautifully! >> >> Is there any way to get it to log failed login attempts with the >> user's IP address? > > auth_verbose=yes Got it. syslog_facility = mail auth_verbose = yes auth_verbose_passwords = plain auth_debug = yes mail_debug = yes I'm sure they're not all necessary. I was turning on all the logging I could find. 8-) The log looks like this: Dec 5 15:29:49 it dovecot: auth: Debug: auth client connected (pid=12028) Dec 5 15:30:03 it dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011lip=10.1.2.3#011rip=123.123.123.123#011lport=143#011rport=40816#011resp= Dec 5 15:30:03 it dovecot: auth: Debug: imap(username,123.123.123.123): lookup host=10.1.16.226 port=143 Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.2.3:143): Looking up IP address Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.2.3:143): Connecting to 10.1.2.3:143 Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.2.3:143): Server capabilities: IMAP4 IMAP4rev1 IDLE LOGIN-REFERRALS MAILBOX-REFERRALS NAMESPACE LITERAL+ UIDPLUS CHILDREN AUTH=NTLM Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.2.3:143): Authenticating as username Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.16.226:143): Disconnected Dec 5 15:30:05 it dovecot: auth: Debug: client out: FAIL#0111#011user=username The last line *almost* gets me enough for a fail2ban filter, but not quite, since there's no IP address. Is there something else I can turn on? Thanks, Terry From miha.vrhovnik at cordia.si Mon Dec 5 23:21:47 2011 From: miha.vrhovnik at cordia.si (Miha Vrhovnik) Date: Mon, 5 Dec 2011 22:21:47 +0100 Subject: [Dovecot] =?iso-8859-1?q?MS_Exchange_IMAP_Proxy_=28Logging_Auth_F?= =?iso-8859-1?q?ailures=3F=29?= In-Reply-To: <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> Message-ID: <20111205222148.9047A6F8E8D@miha> "Terry Carmen" wrote on 5.12.2011 22:05:08: ...cut ... >Dec 5 15:30:05 it dovecot: auth: Debug: client out: >FAIL#0111#011user=username > >The last line *almost* gets me enough for a fail2ban filter, but not >quite, since there's no IP address. > >Is there something else I can turn on? It's probably dfferent for proxy, but without it and with auth_verbose = yes as suggested by Timo I get Dec 5 15:02:32 mailstore dovecot: pop3-login: Disconnected (auth failed, 1 attempts): user=, method=PLAIN, rip=x.x.x.x, lip=y.y.y.y Regards, M From tss at iki.fi Mon Dec 5 23:24:23 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 23:24:23 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> Message-ID: <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> On 5.12.2011, at 23.05, Terry Carmen wrote: > The log looks like this: .. All of the lines are "debug" level. Find the "info" log. "doveadm log find" usually finds it for you. From terry at cnysupport.com Tue Dec 6 00:39:26 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 17:39:26 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> Message-ID: <20111205173926.Horde.1M-cPleGiNBO3Uge0ooC9NA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Mon, 5 Dec 2011 23:24:23 +0200 From: Timo Sirainen Reply-To: Dovecot Mailing List Subject: Re: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) To: Terry Carmen Cc: dovecot at dovecot.org > On 5.12.2011, at 23.05, Terry Carmen wrote: > >> The log looks like this: > .. > > All of the lines are "debug" level. Find the "info" log. "doveadm > log find" usually finds it for you. [root at server conf.d]# doveadm log find Looking for log files from /var/log Debug: /var/log/maillog Info: /var/log/maillog Warning: /var/log/maillog Error: /var/log/maillog Fatal: /var/log/maillog The successful logins look good. For example: Dec 5 17:01:50 it dovecot: imap-login: Login: user=, method=PLAIN, rip=123.123.123.123, lip=10.1.2.3, mpid=12277, TLS However there's nothing similar for the failed logins: Dec 5 17:01:36 it dovecot: auth: Debug: imapc(10.1.2.3:143): Authenticating as username Dec 5 17:01:36 it dovecot: auth: Debug: imapc(10.1.2.3:143): Disconnected Dec 5 17:01:38 it dovecot: auth: Debug: client out: FAIL#0111#011user=username Dec 5 17:01:46 it dovecot: auth: Debug: client in: AUTH#0112#011PLAIN#011service=imap#011secured#011lip=10.1.20.52#011rip=123.123.123.123#011lport=143#011rport=41748#011resp= I checked lib-imap-client/imapc-connection.c and found where the "Authenticating as" message comes from, but don't see anyplace where the I believe I found the section of code that does the imapc authentication, but don't see anyplace where auth failures are logged: Any thoughts? Terry From tss at iki.fi Tue Dec 6 00:48:02 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 6 Dec 2011 00:48:02 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <20111205173926.Horde.1M-cPleGiNBO3Uge0ooC9NA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> <20111205173926.Horde.1M-cPleGiNBO3Uge0ooC9NA@www.cnysupport.com> Message-ID: On 6.12.2011, at 0.39, Terry Carmen wrote: > I checked lib-imap-client/imapc-connection.c and found where the "Authenticating as" message comes from, but don't see anyplace where the > > I believe I found the section of code that does the imapc authentication, but don't see anyplace where auth failures are logged: Oh, right, passdb imapc doesn't log about failed authentication. I'll add it tomorrow. From terry at cnysupport.com Tue Dec 6 01:00:33 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 18:00:33 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> <20111205173926.Horde.1M-cPleGiNBO3Uge0ooC9NA@www.cnysupport.com> Message-ID: <20111205180033.Horde.U3wkEFeGiNBO3U0RY5KS9SA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Tue, 6 Dec 2011 00:48:02 +0200 From: Timo Sirainen Subject: Re: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) To: Terry Carmen Cc: dovecot at dovecot.org > On 6.12.2011, at 0.39, Terry Carmen wrote: > >> I checked lib-imap-client/imapc-connection.c and found where the >> "Authenticating as" message comes from, but don't see anyplace >> where the >> >> I believe I found the section of code that does the imapc >> authentication, but don't see anyplace where auth failures are >> logged: > > Oh, right, passdb imapc doesn't log about failed authentication. > I'll add it tomorrow. That's awesome! I really, really appreciate your help. Terry From ales.sevsek at gmail.com Tue Dec 6 10:52:56 2011 From: ales.sevsek at gmail.com (=?iso-8859-2?B?QWxluSBTRVapRUs=?=) Date: Tue, 6 Dec 2011 09:52:56 +0100 Subject: [Dovecot] Outlook double attachments Message-ID: <001e01ccb3f4$73741000$5a5c3000$@gmail.com> Hi! I wonder, have you managed to solve the problem. I have the same one (regarding double attachmets). Thanks for your help. BR Ale? SEV?EK __________________ Izjava o omejitvi odgovornosti: To elektronsko sporo?ilo in vse njegove morebitne priloge lahko vsebujejo zaupne in/ali privilegirane informacijeter namenjene izklju?no naslovniku. ?e ste sporo?ilo prejeli pomotoma, Vas prosimo, da o tem obvestite po?iljatelja, sporo?ilo pa takoj uni?ite. Kakr?nokoli nepoobla??eno razkritje, distribucija ali kopiranje vsebine sporo?ila je izrecno prepovedano. Legal disclaimer statement: This e-mail and any attachments may contain confidential and/or privileged information and is intended solely for the addressee. If you are not the intended recipient (or have received this e-mail by mistake), please notify the sender immediately and delete this e-mail. Any unauthorized reproduction, disclosure or distribution of the material in this e-mail is strictly forbidden. From apm at one.com Tue Dec 6 11:39:44 2011 From: apm at one.com (Peter Mogensen) Date: Tue, 06 Dec 2011 10:39:44 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: Message-ID: <4EDDE2E0.8070202@one.com> On 2011-12-02 22:22, dovecot-request at dovecot.org wrote: > It's implemented now in dovecot-2.1 hg. It also deprecates autocreate > plugin (but it still works the old way). The idea is that you can now > do e.g.: > > mailbox Trash { > auto = no > special_use = \Trash > } > ... This is great Timo. But for solving the localization problem for special-use folders, it's only half the way. Are there any plans to support RFC5464 SETMETADATA, so individual users can name their "\Trash" folder "Skraldspand" in danish or what ever they prefer? /Peter From p at state-of-mind.de Tue Dec 6 12:29:27 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 06 Dec 2011 11:29:27 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDDE2E0.8070202@one.com> References: <4EDDE2E0.8070202@one.com> Message-ID: <4EDDEE87.7090900@state-of-mind.de> Am 06.12.2011 10:39, schrieb Peter Mogensen: > On 2011-12-02 22:22, dovecot-request at dovecot.org wrote: > > It's implemented now in dovecot-2.1 hg. It also deprecates autocreate > > plugin (but it still works the old way). The idea is that you can now > > do e.g.: > > > > mailbox Trash { > > auto = no > > special_use = \Trash > > } > > ... > > This is great Timo. > But for solving the localization problem for special-use folders, it's > only half the way. > > Are there any plans to support RFC5464 SETMETADATA, so individual > users can name their "\Trash" folder "Skraldspand" in danish or what > ever they prefer? I believe setting the name should be a mapping that takes place in the MUA. p@ > > /Peter -- state of mind () Digitale Kommunikation www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5372 bytes Desc: S/MIME Cryptographic Signature URL: From alec at alec.pl Tue Dec 6 13:45:40 2011 From: alec at alec.pl (A.L.E.C) Date: Tue, 06 Dec 2011 12:45:40 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDDEE87.7090900@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> Message-ID: <4EDE0064.7040509@alec.pl> On 06.12.2011 11:29, Patrick Ben Koetter wrote: >> Are there any plans to support RFC5464 SETMETADATA, so individual >> users can name their "\Trash" folder "Skraldspand" in danish or what >> ever they prefer? Now I see in the hg that Timo doesn't implemented this nor CREATE-SPECIAL-USE. So, it's not so nice as I thought ;) There is metadata plugin. Should it be extended to support this? > I believe setting the name should be a mapping that takes place in the MUA. We have RFC6154 for this, don't try to be smarter. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From p at state-of-mind.de Tue Dec 6 14:43:03 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 13:43:03 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDE0064.7040509@alec.pl> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> Message-ID: <20111206124303.GA11375@state-of-mind.de> * A.L.E.C : > On 06.12.2011 11:29, Patrick Ben Koetter wrote: > > >> Are there any plans to support RFC5464 SETMETADATA, so individual > >> users can name their "\Trash" folder "Skraldspand" in danish or what > >> ever they prefer? > > Now I see in the hg that Timo doesn't implemented this nor > CREATE-SPECIAL-USE. So, it's not so nice as I thought ;) There is > metadata plugin. Should it be extended to support this? > > > I believe setting the name should be a mapping that takes place in the MUA. > > We have RFC6154 for this, don't try to be smarter. >From my understanding RFC 6154 serves to flag some IMAP mailboxes in order to indicate they should be used for special use e.g. as trash folder etc. I fail to see how RFC 6154 would help displaying localized mailbox names. Please point out. p at rick -- state of mind () Digitale Kommunikation http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From alec at alec.pl Tue Dec 6 14:45:28 2011 From: alec at alec.pl (A.L.E.C) Date: Tue, 06 Dec 2011 13:45:28 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206124303.GA11375@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> Message-ID: <4EDE0E68.2020305@alec.pl> On 06.12.2011 13:43, Patrick Ben Koetter wrote: > From my understanding RFC 6154 serves to flag some IMAP mailboxes in order to > indicate they should be used for special use e.g. as trash folder etc. > > I fail to see how RFC 6154 would help displaying localized mailbox names. Ok. It will not help for existing folders, but will allow creation of special-use folders with any name. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From p at state-of-mind.de Tue Dec 6 15:07:00 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 14:07:00 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDE0E68.2020305@alec.pl> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> Message-ID: <20111206130659.GB11375@state-of-mind.de> * A.L.E.C : > On 06.12.2011 13:43, Patrick Ben Koetter wrote: > > > From my understanding RFC 6154 serves to flag some IMAP mailboxes in order to > > indicate they should be used for special use e.g. as trash folder etc. > > > > I fail to see how RFC 6154 would help displaying localized mailbox names. > > Ok. It will not help for existing folders, but will allow creation of > special-use folders with any name. Yes. And on top of that a MUA should detect these SPECIAL-USE folders and automagically map its special folders (trash, archive, sent, drafts, etc.) to the servers SPECIAL-USE mailboxes. This should take place transparently and the special folders should carry localized mailbox names e.g. "Sent" or "Gesendet" or "..." At least that was my motivation to initiate that RFC about two years ago and getting closer to that goal was the reason to sponsor this feature in Dovecot 2.1. p at rick -- state of mind () Digitale Kommunikation http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From selcuk.yazar at gmail.com Tue Dec 6 15:07:06 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Tue, 6 Dec 2011 15:07:06 +0200 Subject: [Dovecot] Log/Process users pop3 plain password Message-ID: Hi, I have Postfix + OpenLdap + DoveCot configuration, and it's running succesfuly, i wantto convert users pop3 password NTPassword and LMPassword, so i ne plain passwor dof users, how can i do that. (Normaly using perl's ntlmgen function i convert password , but in plain) thanks in advance -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From thierry at mailhub.co.za Tue Dec 6 15:35:04 2011 From: thierry at mailhub.co.za (Thierry de Montaudry) Date: Tue, 6 Dec 2011 14:35:04 +0100 Subject: [Dovecot] MUAs creating different "Sent" folders In-Reply-To: <20111129214256.GL14970@charite.de> References: <20111129214256.GL14970@charite.de> Message-ID: <3B11D302-945B-4C13-B1F3-1558D564FF3C@mailhub.co.za> Hi, I know this might be a bit off topic, but having just fixed the problem on my machine, I though I might share it: on Mac OS Lion, with Apple Mail, you can change the system folders by editing the file ~/Library/Mail/V2/MailData/Accounts.plist (path might differ with older version of Mac OS). For each accounts it has 3 entries (DraftMailboxName, JunkMailboxName and SentMessagesMailboxName) that can be changed to any value you want. Quite useful when you are IMAPing your account from different systems. Just don't forget to close Mail while editing this file, and don't do it if you don't have a proper plist editor. This can be done as well in iOS, from the Mail settings, in the account advanced settings. But folders (Trash, Spam...) have to be created before. Regards, Thierry On 29 Nov 2011, at 22:42, Ralf Hildebrandt wrote: > While our webmail installation creates "Sent" as a Sent-Items Folder, > Apple Mail creates "Sent Messages". > > Is there a way of "mapping" foldernames e.g. > > map "Sent Messages" to "Sent" > map "Deletes Messages" to "Trash" > and so on? > > -- > Ralf Hildebrandt > Gesch?ftsbereich IT | Abteilung Netzwerk > Charit? - Universit?tsmedizin Berlin > Campus Benjamin Franklin > Hindenburgdamm 30 | D-12203 Berlin > Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 > ralf.hildebrandt at charite.de | http://www.charite.de > From patrickdk at patrickdk.com Tue Dec 6 17:00:34 2011 From: patrickdk at patrickdk.com (Patrick Domack) Date: Tue, 06 Dec 2011 10:00:34 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206130659.GB11375@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> Message-ID: <20111206100034.Horde.RaGtXpLnE6FO3i4SLvRDR2A@kishi.patrickdk.com> Guess the next nice step would be to get sieve scripts to be able to use the aliased special use folders. So you can just say, fileinto \Spam; Quoting Patrick Ben Koetter

: > * A.L.E.C : >> On 06.12.2011 13:43, Patrick Ben Koetter wrote: >> >> > From my understanding RFC 6154 serves to flag some IMAP mailboxes >> in order to >> > indicate they should be used for special use e.g. as trash folder etc. >> > >> > I fail to see how RFC 6154 would help displaying localized mailbox names. >> >> Ok. It will not help for existing folders, but will allow creation of >> special-use folders with any name. > > Yes. And on top of that a MUA should detect these SPECIAL-USE folders and > automagically map its special folders (trash, archive, sent, drafts, etc.) to > the servers SPECIAL-USE mailboxes. > > This should take place transparently and the special folders should carry > localized mailbox names e.g. "Sent" or "Gesendet" or "..." > > At least that was my motivation to initiate that RFC about two years ago and > getting closer to that goal was the reason to sponsor this feature in Dovecot > 2.1. > > p at rick > > -- > state of mind () > Digitale Kommunikation > > http://www.state-of-mind.de > > Franziskanerstra?e 15 Telefon +49 89 3090 4664 > 81669 M?nchen Telefax +49 89 3090 4666 > > Amtsgericht M?nchen Partnerschaftsregister PR 563 From stephan at rename-it.nl Tue Dec 6 17:50:03 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 06 Dec 2011 16:50:03 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206100034.Horde.RaGtXpLnE6FO3i4SLvRDR2A@kishi.patrickdk.com> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206100034.Horde.RaGtXpLnE6FO3i4SLvRDR2A@kishi.patrickdk.com> Message-ID: <4EDE39AB.6050103@rename-it.nl> Op 6-12-2011 16:00, Patrick Domack schreef: > Guess the next nice step would be to get sieve scripts to be able to > use the aliased special use folders. So you can just say, fileinto \Spam; Hmm, yeah. This will require some standardization efforts though. Your example is a bit problematic: - First, syntax-wise, the argument should be enclosed in double quotes; the grammar of the Sieve language is a bit sacred. :) - From what I've read, those SPECIAL-USE flags are not guaranteed to be unique, so the delivery may become ambiguous. So, it is not really an alias. - Making the bare fileinto command accept a SPECIAL-USE flag as an alternative to a regular folder name may be unwise (potentially causing naming conflicts, albeit unlikely). Some sort of :special_use tag would be in order. The ability to query which folder(s) are used for special purposes could be an alternative, although that is not ideal either. I am not sure how to approach this right now. Regards, Stephan. From wgillespie+dovecot at es2eng.com Tue Dec 6 20:14:44 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Tue, 06 Dec 2011 11:14:44 -0700 Subject: [Dovecot] MUAs creating different "Sent" folders In-Reply-To: <3B11D302-945B-4C13-B1F3-1558D564FF3C@mailhub.co.za> References: <20111129214256.GL14970@charite.de> <3B11D302-945B-4C13-B1F3-1558D564FF3C@mailhub.co.za> Message-ID: <4EDE5B94.3010308@es2eng.com> On 12/06/2011 06:35 AM, Thierry de Montaudry wrote: > Hi, > > I know this might be a bit off topic, but having just fixed the problem on my machine, I though I might share it: on Mac OS Lion, with Apple Mail, you can change the system folders by editing the file ~/Library/Mail/V2/MailData/Accounts.plist (path might differ with older version of Mac OS). > For each accounts it has 3 entries (DraftMailboxName, JunkMailboxName and SentMessagesMailboxName) that can be changed to any value you want. Quite useful when you are IMAPing your account from different systems. Just don't forget to close Mail while editing this file, and don't do it if you don't have a proper plist editor. This can also be done via the GUI in Apple Mail. - Click on the mailbox you want. - Mailbox > Use this mailbox for > (whatever) From patrickdk at patrickdk.com Tue Dec 6 21:18:38 2011 From: patrickdk at patrickdk.com (Patrick Domack) Date: Tue, 06 Dec 2011 14:18:38 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDE39AB.6050103@rename-it.nl> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206100034.Horde.RaGtXpLnE6FO3i4SLvRDR2A@kishi.patrickdk.com> <4EDE39AB.6050103@rename-it.nl> Message-ID: <20111206141838.Horde.VeXRY5LnE6FO3mqO69Xj0MA@kishi.patrickdk.com> Yep, I only meant it in the crudest of forms. I'm sure defining the correct syntax will be the hard part. Quoting Stephan Bosch : > Op 6-12-2011 16:00, Patrick Domack schreef: >> Guess the next nice step would be to get sieve scripts to be able >> to use the aliased special use folders. So you can just say, >> fileinto \Spam; > > Hmm, yeah. This will require some standardization efforts though. > > Your example is a bit problematic: > - First, syntax-wise, the argument should be enclosed in double > quotes; the grammar of the Sieve language is a bit sacred. :) > - From what I've read, those SPECIAL-USE flags are not guaranteed > to be unique, so the delivery may become ambiguous. So, it is not > really an alias. > - Making the bare fileinto command accept a SPECIAL-USE flag as an > alternative to a regular folder name may be unwise (potentially > causing naming conflicts, albeit unlikely). Some sort of > :special_use tag would be in order. > > The ability to query which folder(s) are used for special purposes > could be an alternative, although that is not ideal either. I am not > sure how to approach this right now. > > > Regards, > > Stephan. From tss at iki.fi Wed Dec 7 00:13:54 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 07 Dec 2011 00:13:54 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> Message-ID: <1323209634.15365.6.camel@hurina> On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > The mailbox names require a namespace prefix, so if you use e.g. "INBOX." prefix you'll need to use: I changed these so that they are inside namespace {} section and don't require namespace prefix in the name. That way I can include common mailbox definitions in example-config and still allow the namespace prefix to be easily changed. I'm anyway now wondering what the defaults should be? Could someone check what these defaults are for Outlook and any other clients you have: * "Drafts" is used by all clients * "Trash" is used by all clients * "Junk" is used by all clients? Or is "Spam" used by some? * "Sent" is used by Thunderbird, Evolution * "Sent Messages" is used by Apple Mail So I'm mainly wondering about "Sent" vs. "Sent Messages". From p at state-of-mind.de Wed Dec 7 00:26:09 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 23:26:09 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323209634.15365.6.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> Message-ID: <20111206222608.GC2292@state-of-mind.de> * Timo Sirainen : > On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > > > The mailbox names require a namespace prefix, so if you use e.g. "INBOX." prefix you'll need to use: > > I changed these so that they are inside namespace {} section and don't > require namespace prefix in the name. That way I can include common > mailbox definitions in example-config and still allow the namespace > prefix to be easily changed. > > I'm anyway now wondering what the defaults should be? Could someone > check what these defaults are for Outlook and any other clients you > have: > > * "Drafts" is used by all clients > * "Trash" is used by all clients > * "Junk" is used by all clients? Or is "Spam" used by some? > * "Sent" is used by Thunderbird, Evolution > * "Sent Messages" is used by Apple Mail > > So I'm mainly wondering about "Sent" vs. "Sent Messages". Are you looking for US-English mailbox names only? p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From slusarz at curecanti.org Wed Dec 7 00:27:22 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 06 Dec 2011 15:27:22 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206130659.GB11375@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> Message-ID: <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> Quoting Patrick Ben Koetter

: > * A.L.E.C : >> On 06.12.2011 13:43, Patrick Ben Koetter wrote: >> >> > From my understanding RFC 6154 serves to flag some IMAP mailboxes >> in order to >> > indicate they should be used for special use e.g. as trash folder etc. >> > >> > I fail to see how RFC 6154 would help displaying localized mailbox names. >> >> Ok. It will not help for existing folders, but will allow creation of >> special-use folders with any name. > > Yes. And on top of that a MUA should detect these SPECIAL-USE folders and > automagically map its special folders (trash, archive, sent, drafts, etc.) to > the servers SPECIAL-USE mailboxes. > > This should take place transparently and the special folders should carry > localized mailbox names e.g. "Sent" or "Gesendet" or "..." Except the localization conversions should be done on the MUA level, not the mailstore level (see, e.g., INBOX). As Timo noted in another message in this thread, for the most part there has been a informal standardization of special mailbox names to their English equivalents. There is really no reason to move away from this standardization, especially for MUAs that do not yet support RFC 6154 but may support a form auto-detection of common special mailbox names. michael From p at state-of-mind.de Wed Dec 7 00:34:51 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 23:34:51 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> Message-ID: <20111206223451.GD2292@state-of-mind.de> * Michael M Slusarz : > Quoting Patrick Ben Koetter

: > > >* A.L.E.C : > >>On 06.12.2011 13:43, Patrick Ben Koetter wrote: > >> > >>> From my understanding RFC 6154 serves to flag some IMAP > >>mailboxes in order to > >>> indicate they should be used for special use e.g. as trash folder etc. > >>> > >>> I fail to see how RFC 6154 would help displaying localized mailbox names. > >> > >>Ok. It will not help for existing folders, but will allow creation of > >>special-use folders with any name. > > > >Yes. And on top of that a MUA should detect these SPECIAL-USE folders and > >automagically map its special folders (trash, archive, sent, drafts, etc.) to > >the servers SPECIAL-USE mailboxes. > > > >This should take place transparently and the special folders should carry > >localized mailbox names e.g. "Sent" or "Gesendet" or "..." > > Except the localization conversions should be done on the MUA level, > not the mailstore level (see, e.g., INBOX). I believe that is exactly what I said in my lines above. > As Timo noted in another message in this thread, for the most part > there has been a informal standardization of special mailbox names > to their English equivalents. There is really no reason to move > away from this standardization, especially for MUAs that do not yet Where in my posting did I say I want to move away from that standard? > support RFC 6154 but may support a form auto-detection of common > special mailbox names. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From tss at iki.fi Wed Dec 7 00:35:54 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 07 Dec 2011 00:35:54 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206222608.GC2292@state-of-mind.de> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> Message-ID: <1323210956.15365.11.camel@hurina> On Tue, 2011-12-06 at 23:26 +0100, Patrick Ben Koetter wrote: > > I'm anyway now wondering what the defaults should be? Could someone > > check what these defaults are for Outlook and any other clients you > > have: > > > > * "Drafts" is used by all clients > > * "Trash" is used by all clients > > * "Junk" is used by all clients? Or is "Spam" used by some? > > * "Sent" is used by Thunderbird, Evolution > > * "Sent Messages" is used by Apple Mail > > > > So I'm mainly wondering about "Sent" vs. "Sent Messages". > > Are you looking for US-English mailbox names only? Yeah, just some defaults that most people could use without changes. Although maybe if all of them were set with autocreate=no there could be alternatives added. Like: mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } This way whichever mailbox the first client creates would be used as \Sent. Although if different clients create both of them there would then be two \Sent mailboxes. But the user would probably delete one of them and all would be good again. From slusarz at curecanti.org Wed Dec 7 00:40:57 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 06 Dec 2011 15:40:57 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206223451.GD2292@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> <20111206223451.GD2292@state-of-mind.de> Message-ID: <20111206154057.Horde.Ky5VRIF5lbhO3pn5gMOEWMA@bigworm.curecanti.org> Quoting Patrick Ben Koetter

: > * Michael M Slusarz : >> Quoting Patrick Ben Koetter

: >> >> >* A.L.E.C : >> >>On 06.12.2011 13:43, Patrick Ben Koetter wrote: >> >> >> >>> From my understanding RFC 6154 serves to flag some IMAP >> >>mailboxes in order to >> >>> indicate they should be used for special use e.g. as trash folder etc. >> >>> >> >>> I fail to see how RFC 6154 would help displaying localized >> mailbox names. >> >> >> >>Ok. It will not help for existing folders, but will allow creation of >> >>special-use folders with any name. >> > >> >Yes. And on top of that a MUA should detect these SPECIAL-USE folders and >> >automagically map its special folders (trash, archive, sent, >> drafts, etc.) to >> >the servers SPECIAL-USE mailboxes. >> > >> >This should take place transparently and the special folders should carry >> >localized mailbox names e.g. "Sent" or "Gesendet" or "..." >> >> Except the localization conversions should be done on the MUA level, >> not the mailstore level (see, e.g., INBOX). > > I believe that is exactly what I said in my lines above. > > >> As Timo noted in another message in this thread, for the most part >> there has been a informal standardization of special mailbox names >> to their English equivalents. There is really no reason to move >> away from this standardization, especially for MUAs that do not yet > > Where in my posting did I say I want to move away from that standard? The combination of the original author's comment, and your response which did not seem to disagree with him at all, made it ambiguous at best whether you were referring to localized mailbox names being stored on the server or being translated on the client. Looking through the entire thread, and seeing your previous message, I see that this was an incorrect assumption. I apologize for any misunderstanding. michael From p at state-of-mind.de Wed Dec 7 00:46:59 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 23:46:59 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206154057.Horde.Ky5VRIF5lbhO3pn5gMOEWMA@bigworm.curecanti.org> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> <20111206223451.GD2292@state-of-mind.de> <20111206154057.Horde.Ky5VRIF5lbhO3pn5gMOEWMA@bigworm.curecanti.org> Message-ID: <20111206224658.GE2292@state-of-mind.de> * Michael M Slusarz : > The combination of the original author's comment, and your response > which did not seem to disagree with him at all, made it ambiguous at > best whether you were referring to localized mailbox names being > stored on the server or being translated on the client. Looking > through the entire thread, and seeing your previous message, I see > that this was an incorrect assumption. I apologize for any > misunderstanding. Thank you. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From slusarz at curecanti.org Wed Dec 7 00:48:38 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 06 Dec 2011 15:48:38 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323210956.15365.11.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> Message-ID: <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> Quoting Timo Sirainen : > On Tue, 2011-12-06 at 23:26 +0100, Patrick Ben Koetter wrote: >> > I'm anyway now wondering what the defaults should be? Could someone >> > check what these defaults are for Outlook and any other clients you >> > have: >> > >> > * "Drafts" is used by all clients >> > * "Trash" is used by all clients >> > * "Junk" is used by all clients? Or is "Spam" used by some? 'Spam' is also used. This one is probably a bit more site-specific. >> > * "Sent" is used by Thunderbird, Evolution >> > * "Sent Messages" is used by Apple Mail >> > >> > So I'm mainly wondering about "Sent" vs. "Sent Messages". IIRC, at least some versions of Exchange use(d) "Sent Items". > This way whichever mailbox the first client creates would be used as > \Sent. Although if different clients create both of them there would > then be two \Sent mailboxes. But the user would probably delete one of > them and all would be good again. This will continue to be an issue until more clients support the RFC. michael From tss at iki.fi Wed Dec 7 00:49:49 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 07 Dec 2011 00:49:49 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323210956.15365.11.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> Message-ID: <1323211790.15365.12.camel@hurina> On Wed, 2011-12-07 at 00:35 +0200, Timo Sirainen wrote: > Yeah, just some defaults that most people could use without changes. > Although maybe if all of them were set with autocreate=no there could be > alternatives added. Like: > > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } I did this: http://hg.dovecot.org/dovecot-2.1/rev/9b9a206395f7 From bill-dovecot at carpenter.org Wed Dec 7 00:58:04 2011 From: bill-dovecot at carpenter.org (WJCarpenter) Date: Tue, 06 Dec 2011 14:58:04 -0800 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323209634.15365.6.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> Message-ID: <4EDE9DFC.4010101@carpenter.org> > On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > > I'm anyway now wondering what the defaults should be? Could someone > check what these defaults are for Outlook and any other clients you > have: > > * "Drafts" is used by all clients > * "Trash" is used by all clients > * "Junk" is used by all clients? Or is "Spam" used by some? > * "Sent" is used by Thunderbird, Evolution > * "Sent Messages" is used by Apple Mail > SquirrelMail (http://www.squirrelmail.org) and Hastymail2 (http://www.hastymail.org) webmail clients let you customize draft/trash/sent, but the defaults for both are Drafts, Trash, and Sent. From simon.brereton at buongiorno.com Wed Dec 7 01:02:47 2011 From: simon.brereton at buongiorno.com (Simon Brereton) Date: Tue, 6 Dec 2011 18:02:47 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> Message-ID: On 6 December 2011 17:48, Michael M Slusarz wrote: > Quoting Timo Sirainen : > >> On Tue, 2011-12-06 at 23:26 +0100, Patrick Ben Koetter wrote: >>> >>> > I'm anyway now wondering what the defaults should be? Could someone >>> > check what these defaults are for Outlook and any other clients you >>> > have: >>> > >>> > ?* "Drafts" is used by all clients >>> > ?* "Trash" is used by all clients >>> > ?* "Junk" is used by all clients? Or is "Spam" used by some? > > > 'Spam' is also used. ?This one is probably a bit more site-specific. > >>> > ?* "Sent" is used by Thunderbird, Evolution >>> > ?* "Sent Messages" is used by Apple Mail >>> > >>> > So I'm mainly wondering about "Sent" vs. "Sent Messages". > > > IIRC, at least some versions of Exchange use(d) "Sent Items". Certainly mine does, although I couldn't tell you which version. But then I've never seen an Exchange server that doesn't use that. Simon From tss at iki.fi Wed Dec 7 01:14:14 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 07 Dec 2011 01:14:14 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> Message-ID: <1323213254.15365.13.camel@hurina> On Tue, 2011-12-06 at 18:02 -0500, Simon Brereton wrote: > >>> > * "Sent" is used by Thunderbird, Evolution > >>> > * "Sent Messages" is used by Apple Mail > >>> > > >>> > So I'm mainly wondering about "Sent" vs. "Sent Messages". > > > > > > IIRC, at least some versions of Exchange use(d) "Sent Items". > > Certainly mine does, although I couldn't tell you which version. But > then I've never seen an Exchange server that doesn't use that. Exchange doesn't matter, but Outlook does. Does Outlook with IMAP also use "Sent Items" by default? From simon.brereton at buongiorno.com Wed Dec 7 01:30:05 2011 From: simon.brereton at buongiorno.com (Simon Brereton) Date: Tue, 6 Dec 2011 18:30:05 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323213254.15365.13.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> <1323213254.15365.13.camel@hurina> Message-ID: On 6 December 2011 18:14, Timo Sirainen wrote: > On Tue, 2011-12-06 at 18:02 -0500, Simon Brereton wrote: >> >>> > ?* "Sent" is used by Thunderbird, Evolution >> >>> > ?* "Sent Messages" is used by Apple Mail >> >>> > >> >>> > So I'm mainly wondering about "Sent" vs. "Sent Messages". >> > >> > >> > IIRC, at least some versions of Exchange use(d) "Sent Items". >> >> Certainly mine does, although I couldn't tell you which version. ?But >> then I've never seen an Exchange server that doesn't use that. > > Exchange doesn't matter, but Outlook does. Does Outlook with IMAP also > use "Sent Items" by default? It would appear to. But then I have a weird set-up, so may be it doesn't. On the Outlook I use at Work with Gmail a Sent Items is present. At home, with dovecot, it is not. Simon From robert at schetterer.org Wed Dec 7 08:45:53 2011 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 07 Dec 2011 07:45:53 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> Message-ID: <4EDF0BA1.605@schetterer.org> Am 06.12.2011 23:48, schrieb Michael M Slusarz: > Quoting Timo Sirainen : > >> On Tue, 2011-12-06 at 23:26 +0100, Patrick Ben Koetter wrote: >>> > I'm anyway now wondering what the defaults should be? Could someone >>> > check what these defaults are for Outlook and any other clients you >>> > have: >>> > >>> > * "Drafts" is used by all clients >>> > * "Trash" is used by all clients >>> > * "Junk" is used by all clients? Or is "Spam" used by some? > > 'Spam' is also used. This one is probably a bit more site-specific. > >>> > * "Sent" is used by Thunderbird, Evolution >>> > * "Sent Messages" is used by Apple Mail >>> > >>> > So I'm mainly wondering about "Sent" vs. "Sent Messages". > > IIRC, at least some versions of Exchange use(d) "Sent Items". at last , at now there is no way at outlook 2010 to configure default imap junk folder ( only with reg patches, or filters ) cause this folder is special used by some antispam detection internal outlook,i guess, hope this may change by MS someday > >> This way whichever mailbox the first client creates would be used as >> \Sent. Although if different clients create both of them there would >> then be two \Sent mailboxes. But the user would probably delete one of >> them and all would be good again. > > This will continue to be an issue until more clients support the RFC. > > michael > -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From robert at schetterer.org Wed Dec 7 08:48:34 2011 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 07 Dec 2011 07:48:34 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> <1323213254.15365.13.camel@hurina> Message-ID: <4EDF0C42.800@schetterer.org> Am 07.12.2011 00:30, schrieb Simon Brereton: > On 6 December 2011 18:14, Timo Sirainen wrote: >> On Tue, 2011-12-06 at 18:02 -0500, Simon Brereton wrote: >>>>>>> * "Sent" is used by Thunderbird, Evolution >>>>>>> * "Sent Messages" is used by Apple Mail >>>>>>> >>>>>>> So I'm mainly wondering about "Sent" vs. "Sent Messages". >>>> >>>> >>>> IIRC, at least some versions of Exchange use(d) "Sent Items". >>> >>> Certainly mine does, although I couldn't tell you which version. But >>> then I've never seen an Exchange server that doesn't use that. >> >> Exchange doesn't matter, but Outlook does. Does Outlook with IMAP also >> use "Sent Items" by default? > > It would appear to. But then I have a weird set-up, so may be it > doesn't. On the Outlook I use at Work with Gmail a Sent Items is > present. At home, with dovecot, it is not. > > Simon there is no outlook, speak of outlook versions and patchlevels, outlook versions are much different ! i would only concentrate only on the newest version -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From janfrode at tanso.net Wed Dec 7 12:11:43 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Wed, 7 Dec 2011 11:11:43 +0100 Subject: [Dovecot] master user only for sieve Message-ID: <20111207101143.GA19363@dibs.tanso.net> Changes in SOGo is forcing me to define a master user, so that SOGo can disable sieve out-of-office processing on a given date. I'm not too happy about having master users that are allowed to read the users messages, so is it possible to define a master user that can only log in trough manage-sieve? -jf From Yann.Dupont at univ-nantes.fr Wed Dec 7 12:25:20 2011 From: Yann.Dupont at univ-nantes.fr (Yann Dupont) Date: Wed, 07 Dec 2011 11:25:20 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> Message-ID: <4EDF3F10.1090604@univ-nantes.fr> Le 05/12/2011 02:45, Timo Sirainen a ?crit : > On 5.12.2011, at 3.03, Stan Hoeppner wrote: > >> To cope with catastrophic failure, create a "special" Dovecot >> administrator only mailbox (real/virtual/whatever) that "contains" all >> of the SiS files, a special Dovecot index. > > I'm not thinking about a catastrophe. For that a regular full filesystem backup+restore would work mostly okay (a snapshot would be perfect, without snapshot some extra work would be needed). The problem is that people want to recover only one specific user's mails from some older backup, because they accidentally deleted the mails.. This needs to be somewhat easy to implement with SIS, but it isn't. > > Other problem I'm thinking of, because I'd like to use SIS on our production servers ; but right now I think I can't . We have lots of users (+5000 teachers/engineers) on our first setup, +70000 students on our 2nd setup. The user base is on LDAP, and move on a daily basis. When a user leave the university, he has right to use mailbox for a certain time and then we close the account. Right now, we archive and then delete the mailbox directories (we don't use special dovecot mecanism : we migrated from another system not long time ago and we had special scripts for that). If we use SIS, what happen to the attachements ? The usage count will never go to 0, and the attachements will stay there forever. In that situation, I think we have no means to correct the attachement usage count ? -- Yann Dupont - Service IRTS, DSI Universit? de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont at univ-nantes.fr From Yann.Dupont at univ-nantes.fr Wed Dec 7 13:02:22 2011 From: Yann.Dupont at univ-nantes.fr (Yann Dupont) Date: Wed, 07 Dec 2011 12:02:22 +0100 Subject: [Dovecot] problems when using dsync between servers Message-ID: <4EDF47BE.8080703@univ-nantes.fr> Hello, I'm trying to migrate from maildir++ to mdbox. The maildir++ is a leftover of our previous setup (was using courier) We have 3 virtuals servers for our +70000 accounts. Now, I'd like to use mdbox, so I'm trying using dsync for that. I setup a new virtual server, configured for mdbox. 1st, I tried a basic setup: I established a file with all my accounts (taken from LDAP) and then I use this script : FILENAME=$1 while read LINE do dsync -u $LINE backup $LINE at my_new_server done < $FILENAME But it's quite slow and dsync hangs. So I tried another approach using multi threaded python. Much faster (using all the cores), but dsync still hangs on some accounts. After a certain time dsync exit with an error like that : Panic: file dsync-worker-local.c: line 1688 (local_worker_save_msg_continue): assertion failed: (ret == -1) dsync-remote(E072184L): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x3fd8a) [0x7f34fc577d8a] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f34fc577e72] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f34fc55119f] -> dsync() [0x40ff0b] -> dsync() [0x410142] -> dsync(dsync_worker_msg_save+0x99) [0x40f639] -> dsync() [0x40e24a] -> dsync() [0x40d8ef] -> dsync() [0x40dbfc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x48) [0x7f34fc5830d8] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f34fc58403f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f34fc583068] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f34fc5713a3] -> dsync(main+0x9e1) [0x4078b1] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f34fbde9c4d] -> dsync() [0x406cf9] This is on a RUNNNING server. My aim was to make some pass on the running server, then stop it and make a last pass to finish the process. Is dsync supposed to run only on a stopped server ? Is my approach totally wrong ? -- Yann Dupont - Service IRTS, DSI Universit? de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont at univ-nantes.fr From stephan at rename-it.nl Wed Dec 7 13:32:21 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 07 Dec 2011 12:32:21 +0100 Subject: [Dovecot] master user only for sieve In-Reply-To: <20111207101143.GA19363@dibs.tanso.net> References: <20111207101143.GA19363@dibs.tanso.net> Message-ID: <4EDF4EC5.9000302@rename-it.nl> Op 7-12-2011 11:11, Jan-Frode Myklebust schreef: > Changes in SOGo is forcing me to define a master user, so that SOGo can > disable sieve out-of-office processing on a given date. I'm not too > happy about having master users that are allowed to read the users > messages, so is it possible to define a master user that can only log in > trough manage-sieve? I must say I don't really know about that. However, I do have a suggestion for a different approach. You can define a vacation response action with an expiry date, as follows: require ["date", "relational", "vacation"]; if currentdate :value "le" "date" "2011-12-09" { vacation "I'm out of office this week. I'll be back on Saturday 10th to reply to your e-mails."; } This means that there is no need to remove the vacation rule explicitly. It is inactive and can be removed at a (much) later time. You can also plan vacation responses in the future using the same method. Of course, the question is whether the SoGo GUI supports something like this, but I think it should. Regards, Stephan. From janfrode at tanso.net Wed Dec 7 13:57:13 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Wed, 7 Dec 2011 12:57:13 +0100 Subject: [Dovecot] master user only for sieve In-Reply-To: <4EDF4EC5.9000302@rename-it.nl> References: <20111207101143.GA19363@dibs.tanso.net> <4EDF4EC5.9000302@rename-it.nl> Message-ID: <20111207115713.GA21832@dibs.tanso.net> On Wed, Dec 07, 2011 at 12:32:21PM +0100, Stephan Bosch wrote: > > However, I do have a suggestion for a different approach. You can > define a vacation response action with an expiry date, as follows: > > require ["date", "relational", "vacation"]; > > if currentdate :value "le" "date" "2011-12-09" { > vacation "I'm out of office this week. I'll be back on > Saturday 10th to reply to your e-mails."; > } Thanks! I was looking for something like this, but don't know sieve enough to find it myself. This is a much nicer approach. I'll suggest it to the sogo developers. -jf From CMarcus at Media-Brokers.com Wed Dec 7 13:46:26 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 07 Dec 2011 06:46:26 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323209634.15365.6.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> Message-ID: <4EDF5212.7070501@Media-Brokers.com> On 2011-12-06 5:13 PM, Timo Sirainen wrote: > * "Trash" is used by all clients Outlook uses 'Deleted Items', not 'Trash'... -- Best regards, Charles From ef at math.uni-bonn.de Wed Dec 7 13:47:14 2011 From: ef at math.uni-bonn.de (Edgar =?iso-8859-1?B?RnXf?=) Date: Wed, 7 Dec 2011 12:47:14 +0100 Subject: [Dovecot] master user only for sieve In-Reply-To: <20111207101143.GA19363@dibs.tanso.net> References: <20111207101143.GA19363@dibs.tanso.net> Message-ID: <20111207114714.GF25413@gumme.math.uni-bonn.de> I have the following for 1.2. You may search the list archive, I asked that question about halv a year ago and Timo answererd it for both 1.2 and 2.0. auth default { [...] # Master-Benutzer f?r Sieve. # Wirkt nur f?r Sieve, weil es master.imap und master.pop nicht gibt. passdb passwd-file { master = yes args = DOVECOT_CONFDIR/master.%s # kein pass = yes, weil das bei LDAP-Authentication-Binds nicht geht. } [...] } And a master.sieve file containing sievemaster:{SHA}...... From CMarcus at Media-Brokers.com Wed Dec 7 14:08:42 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 07 Dec 2011 07:08:42 -0500 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EDF3F10.1090604@univ-nantes.fr> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> <4EDF3F10.1090604@univ-nantes.fr> Message-ID: <4EDF574A.3060100@Media-Brokers.com> On 2011-12-07 5:25 AM, Yann Dupont wrote: > > Right now, we archive and then delete the mailbox directories (we don't > use special dovecot mecanism : we migrated from another system not long > time ago and we had special scripts for that). > > If we use SIS, what happen to the attachements ? The usage count will > never go to 0, and the attachements will stay there forever. ? Attachment count for any messages that were *only* in those deleted mailbox directories would go to zero after you delete them, and then the attachments would be deleted. Dovecot wouldn't know about any that were archived outside of dovecots knowledge. -- Best regards, Charles From arne at drlinux.no Wed Dec 7 15:28:18 2011 From: arne at drlinux.no (Arne K. Haaje) Date: Wed, 07 Dec 2011 14:28:18 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDE9DFC.4010101@carpenter.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> Message-ID: <2028924.r07FOCeGlj@trillian> Tirsdag 6. desember 2011 14.58.04 skrev WJCarpenter: > > On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > > > > I'm anyway now wondering what the defaults should be? Could someone > > check what these defaults are for Outlook and any other clients you > > > > have: > > * "Drafts" is used by all clients > > * "Trash" is used by all clients > > * "Junk" is used by all clients? Or is "Spam" used by some? > > * "Sent" is used by Thunderbird, Evolution > > * "Sent Messages" is used by Apple Mail > > SquirrelMail (http://www.squirrelmail.org) and Hastymail2 > (http://www.hastymail.org) webmail clients let you customize > draft/trash/sent, but the defaults for both are Drafts, Trash, and Sent. Thunderbird also use a Templates folder. Arne -- Arne K. Haaje - Dr Linux http://www.drlinux.no/ LinkedIn: http://no.linkedin.com/pub/arne-haaje/27/189/bb From user+dovecot at localhost.localdomain.org Wed Dec 7 15:55:09 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Wed, 07 Dec 2011 14:55:09 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <2028924.r07FOCeGlj@trillian> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> <2028924.r07FOCeGlj@trillian> Message-ID: <4EDF703D.2090505@localhost.localdomain.org> On 12/07/2011 02:28 PM Arne K. Haaje wrote: > Thunderbird also use a Templates folder. Yes, I also noticed that. But http://tools.ietf.org/html/rfc6154#section-2 doesn't mention a mailbox for templates. Regards, Pascal -- The trapper recommends today: face1e55.1134114 at localdomain.org From tss at iki.fi Wed Dec 7 16:15:35 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 7 Dec 2011 16:15:35 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EDF3F10.1090604@univ-nantes.fr> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> <4EDF3F10.1090604@univ-nantes.fr> Message-ID: On 7.12.2011, at 12.25, Yann Dupont wrote: > Other problem I'm thinking of, because I'd like to use SIS on our production servers ; but right now I think I can't . > > We have lots of users (+5000 teachers/engineers) on our first setup, +70000 students on our 2nd setup. > > The user base is on LDAP, and move on a daily basis. When a user leave the university, he has right to use mailbox for a certain time and then we close the account. > > Right now, we archive and then delete the mailbox directories (we don't use special dovecot mecanism : we migrated from another system not long time ago and we had special scripts for that). > > If we use SIS, what happen to the attachements ? The usage count will never go to 0, and the attachements will stay there forever. > > In that situation, I think we have no means to correct the attachement usage count ? You'll need to change the deletion script then. Run: doveadm expunge -u user mailbox '*' all before doing rm -rf for the user's mails. And in the archiving step you should do it with dsync with mail_attachment_dir disabled in the destination storage, so the the attachments get written to the archive directly instead of only referencing SIS. From tss at iki.fi Wed Dec 7 16:22:01 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 7 Dec 2011 16:22:01 +0200 Subject: [Dovecot] v2.x services documentation Message-ID: <04D662E7-2A0A-448B-BA21-1E337A400CA6@iki.fi> If you've ever wanted to know everything about the service {} blocks, this should be quite helpful: http://wiki2.dovecot.org/Services From p at state-of-mind.de Wed Dec 7 16:35:00 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 7 Dec 2011 15:35:00 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDF703D.2090505@localhost.localdomain.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> <2028924.r07FOCeGlj@trillian> <4EDF703D.2090505@localhost.localdomain.org> Message-ID: <20111207143500.GB5185@state-of-mind.de> * Pascal Volk : > On 12/07/2011 02:28 PM Arne K. Haaje wrote: > > Thunderbird also use a Templates folder. > > Yes, I also noticed that. But > http://tools.ietf.org/html/rfc6154#section-2 doesn't mention a mailbox > for templates. IIRC IETF allows to register new SPECIAL-USE mailboxes. 'templates' might be a good candidate. p at rick -- state of mind () Digitale Kommunikation http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From robert at schetterer.org Wed Dec 7 16:49:20 2011 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 07 Dec 2011 15:49:20 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111207143500.GB5185@state-of-mind.de> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> <2028924.r07FOCeGlj@trillian> <4EDF703D.2090505@localhost.localdomain.org> <20111207143500.GB5185@state-of-mind.de> Message-ID: <4EDF7CF0.2030403@schetterer.org> Am 07.12.2011 15:35, schrieb Patrick Ben Koetter: > * Pascal Volk : >> On 12/07/2011 02:28 PM Arne K. Haaje wrote: >>> Thunderbird also use a Templates folder. >> >> Yes, I also noticed that. But >> http://tools.ietf.org/html/rfc6154#section-2 doesn't mention a mailbox >> for templates. > > IIRC IETF allows to register new SPECIAL-USE mailboxes. 'templates' might be a > good candidate. > > p at rick > TB also has a archives folder as default -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From CMarcus at Media-Brokers.com Wed Dec 7 17:02:52 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 07 Dec 2011 10:02:52 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDF703D.2090505@localhost.localdomain.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> <2028924.r07FOCeGlj@trillian> <4EDF703D.2090505@localhost.localdomain.org> Message-ID: <4EDF801C.9090508@Media-Brokers.com> On 2011-12-07 8:55 AM, Pascal Volk wrote: > On 12/07/2011 02:28 PM Arne K. Haaje wrote: >> > Thunderbird also use a Templates folder. > Yes, I also noticed that. But > http://tools.ietf.org/html/rfc6154#section-2 doesn't mention a mailbox > for templates. Nevertheless, it is very handy functionality... it isn't just a folder. -- Best regards, Charles From sacha.xxxx at omnitechweb.it Wed Dec 7 16:02:23 2011 From: sacha.xxxx at omnitechweb.it (Sacha xxxx) Date: Wed, 7 Dec 2011 15:02:23 +0100 Subject: [Dovecot] dovecot 2.0 sieve if working, managesieve not. Message-ID: <9DD2BA39-3F7E-4612-8A8F-37967E4491C4@omnitechweb.it> Hi, this is my configuration # OS: Linux 2.6.32-131.0.15.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.1 (Santiago) ext4 auth_debug = yes auth_master_user_separator = * auth_username_format = %Lu auth_verbose = yes disable_plaintext_auth = no info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Dovecot ready mail_debug = yes mail_gid = 999 mail_home = /MAIL/%d/%n/ mail_location = maildir:/MAIL/%d/%n/ mail_log_prefix = "%Us(%u): " mail_plugins = " quota" mail_privileged_group = mail mail_uid = 999 passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes pass = yes } plugin { quota = maildir:User quota quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/sieve/dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve service auth { unix_listener auth-userdb { group = mail mode = 0660 user = postfix } } service managesieve-login { executable = /usr/libexec/dovecot/managesieve-login inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = mail mode = 0666 user = mail } user = mail } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.user driver = ldap } doveconf: Error: protocols: Unknown protocol: sieve doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: protocols: Unknown protocol: sieve I get the error Unknown protocol: sieve The installed rpm package is this: dovecot-2.0.9-2.el6.x86_64 The sieve filtering is working: 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: opening script /MAIL/***/user//sieve/dovecot.sieve 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: script /MAIL/***/user//sieve/dovecot.sieve successfully compiled 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: executing script from /MAIL/***/utente01//sieve/dovecot.sieve 2011-12-07 12:12:29 LDA(utente01@***): Info: sieve: msgid=<4EDF4A1C.9010509@***>: stored mail into mailbox 'INBOX' But the manage sieve won't work. It seems that pigeonhole is installed because /usr/libexec/dovecot/managesieve-login exist and is not empty. Can you help me? Thank You Sushi. From wgillespie+dovecot at es2eng.com Wed Dec 7 17:45:31 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Wed, 07 Dec 2011 08:45:31 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323209634.15365.6.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> Message-ID: <4EDF8A1B.3050105@es2eng.com> On 12/06/2011 03:13 PM, Timo Sirainen wrote: > On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > >> The mailbox names require a namespace prefix, so if you use e.g. "INBOX." prefix you'll need to use: > > I changed these so that they are inside namespace {} section and don't > require namespace prefix in the name. That way I can include common > mailbox definitions in example-config and still allow the namespace > prefix to be easily changed. > > I'm anyway now wondering what the defaults should be? Could someone > check what these defaults are for Outlook and any other clients you > have: > > * "Drafts" is used by all clients > * "Trash" is used by all clients > * "Junk" is used by all clients? Or is "Spam" used by some? > * "Sent" is used by Thunderbird, Evolution > * "Sent Messages" is used by Apple Mail > > So I'm mainly wondering about "Sent" vs. "Sent Messages". Outlook 2010 lets you select a mailbox for Trash and Sent (version 2007 only lets you select a mailbox for Sent messages). Outlook default names for Trash is "Deleted Items" (as someone pointed out) and for junk is "Junk E-mail". Willie From tss at iki.fi Wed Dec 7 17:56:24 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 7 Dec 2011 17:56:24 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDF8A1B.3050105@es2eng.com> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDF8A1B.3050105@es2eng.com> Message-ID: On 7.12.2011, at 17.45, Willie Gillespie wrote: > Outlook 2010 lets you select a mailbox for Trash and Sent (version 2007 only lets you select a mailbox for Sent messages). > Outlook default names for Trash is "Deleted Items" (as someone pointed out) and for junk is "Junk E-mail". And the default name for Sent is "Sent Items"? Wonder if I should add those also to the example config.. From Yann.Dupont at univ-nantes.fr Wed Dec 7 18:02:51 2011 From: Yann.Dupont at univ-nantes.fr (Yann Dupont) Date: Wed, 07 Dec 2011 17:02:51 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> <4EDF3F10.1090604@univ-nantes.fr> Message-ID: <4EDF8E2B.7020204@univ-nantes.fr> Le 07/12/2011 15:15, Timo Sirainen a ?crit : > On 7.12.2011, at 12.25, Yann Dupont wrote: > doveadm expunge -u user mailbox '*' all > > before doing rm -rf for the user's mails. And in the archiving step you should do it with dsync with mail_attachment_dir disabled in the destination storage, so the the attachments get written to the archive directly instead of only referencing SIS. > > Yes, I understand, it will work. But, if case of any error (even our fault : premature end of script, for example) you can still end up with attachement forever lost on the filesystem. Right, it SHOULD not happen, and it probably won't represent a big volume. But Still, it could happen under specific circonstances. In that case, I don't see any simple way to detect that kind of files ? Do you see how a script could detect some orphaned links ?? For the archiving, good idea to use dsync, thanks for your answer. -- Yann Dupont - Service IRTS, DSI Universit? de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont at univ-nantes.fr From Juergen.Obermann at hrz.uni-giessen.de Wed Dec 7 18:12:03 2011 From: Juergen.Obermann at hrz.uni-giessen.de (=?iso-8859-1?b?SvxyZ2Vu?= Obermann) Date: Wed, 07 Dec 2011 17:12:03 +0100 Subject: [Dovecot] lazy_expunge plugin and folder subscription trouble Message-ID: <20111207171203.32263dknm9tyodgc@webmail.hrz.uni-giessen.de> Hello, I wanted to test the lazy expunge plugin together with mdbox. It seems to me that the folder subscriptions file in the mdbox directory was overwritten with only a few folder names every time I added or removed something in the list of subscribed folders, or even if I turned the imap folder subscription feature off and on. Here is my setup: # 2.0.16: /opt/local/etc/dovecot/dovecot.conf # OS: SunOS 5.10 sun4v mail_location = mdbox:~/mdbox mail_plugins = mail_log notify quota lazy_expunge zlib mdbox_rotate_interval = 1 days mdbox_rotate_size = 16 M namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes list = no location = prefix = Mail/ separator = / subscriptions = yes type = private } namespace { location = maildir:/var/mail/public:CONTROL=~/Maildir/public:INDEX=~/Maildir/public prefix = Public/ separator = / subscriptions = no type = public } namespace { location = mdbox:~/mdbox:MAILBOXDIR=expunged prefix = .EXPUNGED/ separator = / } plugin { autocreate = Trash autocreate2 = caughtspam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = caughtspam autosubscribe3 = Sent autosubscribe4 = Drafts fts = squat lazy_expunge = .EXPUNGED/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = fs:Home-Verzeichnis:noenforcing sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 3 } protocols = imap pop3 lmtp sieve quota_full_tempfail = yes sendmail_path = /usr/lib/sendmail service auth { client_limit = 11120 } service imap-login { process_min_avail = 16 service_count = 0 vsz_limit = 640 M } service imap { process_limit = 4096 vsz_limit = 1 G } ssl_cert = refcount > 0) Message-ID: <4EDF9185.7060805@localhost.localdomain.org> Hi Timo, right after delivering the message to the INBOX the lmtp crashes. I wonder about the "Sent" in the attached backtrace. Regards, Pascal -- The trapper recommends today: c01dcofe.1134117 at localdomain.org -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: doveconf.txt URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: lmtp.bt URL: From wgillespie+dovecot at es2eng.com Wed Dec 7 18:29:20 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Wed, 07 Dec 2011 09:29:20 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDF8A1B.3050105@es2eng.com> Message-ID: <4EDF9460.4060409@es2eng.com> On 12/07/2011 08:56 AM, Timo Sirainen wrote: > On 7.12.2011, at 17.45, Willie Gillespie wrote: > >> Outlook 2010 lets you select a mailbox for Trash and Sent (version 2007 only lets you select a mailbox for Sent messages). >> Outlook default names for Trash is "Deleted Items" (as someone pointed out) and for junk is "Junk E-mail". > > And the default name for Sent is "Sent Items"? Yes From sacha.xxxx at omnitechweb.it Wed Dec 7 18:31:29 2011 From: sacha.xxxx at omnitechweb.it (Sacha xxxx) Date: Wed, 7 Dec 2011 17:31:29 +0100 Subject: [Dovecot] dovecot 2.0 sieve if working, managesieve not. In-Reply-To: <9DD2BA39-3F7E-4612-8A8F-37967E4491C4@omnitechweb.it> References: <9DD2BA39-3F7E-4612-8A8F-37967E4491C4@omnitechweb.it> Message-ID: I solved installing dovecot-pigeonhole-2.0.9-2.el6.x86_64.rpm Thank you Il giorno 07/dic/2011, alle ore 15:02, Sacha xxxx ha scritto: > Hi, > this is my configuration > > # OS: Linux 2.6.32-131.0.15.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.1 (Santiago) ext4 > auth_debug = yes > auth_master_user_separator = * > auth_username_format = %Lu > auth_verbose = yes > disable_plaintext_auth = no > info_log_path = /var/log/dovecot-info.log > log_path = /var/log/dovecot.log > log_timestamp = "%Y-%m-%d %H:%M:%S " > login_greeting = Dovecot ready > mail_debug = yes > mail_gid = 999 > mail_home = /MAIL/%d/%n/ > mail_location = maildir:/MAIL/%d/%n/ > mail_log_prefix = "%Us(%u): " > mail_plugins = " quota" > mail_privileged_group = mail > mail_uid = 999 > passdb { > args = /etc/dovecot/dovecot-ldap.conf > driver = ldap > } > passdb { > args = /etc/dovecot/passwd.masterusers > driver = passwd-file > master = yes > pass = yes > } > plugin { > quota = maildir:User quota > quota_warning = storage=95%% quota-warning 95 %u > quota_warning2 = storage=80%% quota-warning 80 %u > sieve = ~/sieve/dovecot.sieve > sieve_dir = ~/sieve > } > protocols = imap pop3 sieve > service auth { > unix_listener auth-userdb { > group = mail > mode = 0660 > user = postfix > } > } > service managesieve-login { > executable = /usr/libexec/dovecot/managesieve-login > inet_listener sieve { > port = 4190 > } > } > service quota-warning { > executable = script /usr/local/bin/quota-warning.sh > unix_listener quota-warning { > group = mail > mode = 0666 > user = mail > } > user = mail > } > ssl = no > userdb { > args = /etc/dovecot/dovecot-ldap.user > driver = ldap > } > doveconf: Error: protocols: Unknown protocol: sieve > doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: protocols: Unknown protocol: sieve > > I get the error Unknown protocol: sieve > > The installed rpm package is this: > dovecot-2.0.9-2.el6.x86_64 > > The sieve filtering is working: > > 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: opening script /MAIL/***/user//sieve/dovecot.sieve > 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: script /MAIL/***/user//sieve/dovecot.sieve successfully compiled > 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: executing script from /MAIL/***/utente01//sieve/dovecot.sieve > 2011-12-07 12:12:29 LDA(utente01@***): Info: sieve: msgid=<4EDF4A1C.9010509@***>: stored mail into mailbox 'INBOX' > > But the manage sieve won't work. > It seems that pigeonhole is installed because /usr/libexec/dovecot/managesieve-login exist and is not empty. > > Can you help me? > > Thank You > > Sushi. > Sacha xxxx Security Consultant ----------------------------------------------------------------- xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxx Questo messaggio ? destinato alle sole persone indicate e pu? contenere informazioni riservate. Se ricevuto per errore, si prega di avvisare immediatam From listen at constabel.net Wed Dec 7 19:05:05 2011 From: listen at constabel.net (Mike Constabel) Date: Wed, 7 Dec 2011 18:05:05 +0100 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts Message-ID: <20111207170505.GI22136@herakles.constabel-it.de> Hi, if I try to crate a folder in Thunderbird 8 which contains umlauts this happens: - Create folder "T?r" - Thunderbird show T&APw-r in folder list In log: Dec 07 17:45:39 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 # ll /mailspool1/in-preetz.de/test1/mdbox/mailboxes/ insgesamt 32K drwx------ 8 vmail vmail 4,0K 7. Dez 17:45 . drwx------ 4 vmail vmail 4,0K 7. Dez 17:45 .. drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Drafts drwx------ 3 vmail vmail 4,0K 29. Nov 11:04 INBOX drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Junk drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Sent drwx------ 3 vmail vmail 4,0K 7. Dez 17:45 T&APw-r drwx------ 4 vmail vmail 4,0K 7. Dez 17:44 Trash If I click in TB on the folder, TB gives an empty message, the log shows: Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: Effective uid=1000, gid=1000, home=/mailspool1/in-preetz.de/test1 Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: quota: No quota setting - plugin disabled Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mdbox Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: fs: root=/mailspool1/in-preetz.de/test1/mdbox, index=, control=, inbox=, alt= Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:43:02 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/&ANY-de doesn't exist yet, using default permissions Dec 07 17:43:02 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:44:19 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/&-ANY-de doesn't exist yet, using default permissions Dec 07 17:44:19 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:44:19 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/Trash/&-ANY-de doesn't exist yet, using default permissions Dec 07 17:44:24 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/Trash/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 On another server with # 2.0.13 (537d4b6d9a7a): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.2 an an server with # 1.2.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 5.0.9 umlauts are working. Is there an problem with my config or with the rc1? thanks, Mike dovecot -n for not working 2.1.rc1: # 2.1.rc1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 6.0.3 auth_cache_size = 1 M auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login cram-md5 auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot/dovecot-debug.log default_client_limit = 2600 disable_plaintext_auth = no hostname = mx4.constabel-it.de info_log_path = /var/log/dovecot/dovecot-info.log log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_location = mdbox:~/mdbox mail_plugins = quota notify mail_log mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = prefix = separator = / type = private } passdb { args = scheme=PLAIN username_format=%u /etc/imap.userdb driver = passwd-file } plugin { autocreate = Trash autocreate2 = Junk autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Sent autosubscribe4 = Drafts sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at localhost protocols = " imap lmtp sieve pop3" service auth { inet_listener { address = 192.168.10.117 port = 12345 } } service imap-login { inet_listener imap { address = 192.168.10.117 port = 143 } inet_listener imaps { address = 192.168.10.117 port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = 192.168.10.117 port = 24 } } service managesieve-login { inet_listener sieve { address = 192.168.10.117 port = 4190 } } service pop3-login { inet_listener pop3 { address = 192.168.10.117 port = 110 } inet_listener pop3s { address = 192.168.10.117 port = 995 ssl = yes } } ssl_ca = I've got my users in a replicated database setup and dovecot configured with two connect lines in dovecot-sql.conf: connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass connect = host=127.0.0.2 port=3306 dbname=users user=user password=pass this works really well to help balance the load. However, when a new user is created, the replication information sometimes has not made it to the slave database before my user creation process tries to send that new user an email about their new email account. If it hasn't and the email gets sent, then it bounces because postfix thinks the user doesn't exist yet. Replication usually happens within seconds, but could be delayed due to problems. I would like a way to see if the new user's information has been replicated yet before sending the email. I was thinking I could use 'doveadm user' to lookup the user, but I am not sure that I can specify one of the specific 'connect' lines in my configuration to check. Is there a way to override that configuration variable to do this test? I tried various incarnations of passing '-o connect=host='... but doveadm user would just ignore them. thanks for any suggestions! micah ps - yes, I can make my user creation process just 'sleep' for an arbitrary amount of time and by that time the replication should have occured, but that is a bit of a shot in the dark, and doesn't handle longer replication delays that could potentially happen. -- -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 835 bytes Desc: not available URL: From mark.zealey at webfusion.com Wed Dec 7 20:38:29 2011 From: mark.zealey at webfusion.com (Mark Zealey) Date: Wed, 07 Dec 2011 20:38:29 +0200 Subject: [Dovecot] sql dict: commit failed: MySQL server has gone away Message-ID: <4EDFB2A5.9090303@webfusion.com> Following on from this thread: http://www.dovecot.org/list/dovecot/2010-September/052704.html in 2.0.16 I am seeing the same issues. I believe this would be related to some timeouts set on our mysql servers which are pretty low (30 or 60 seconds or so to drop idle connections). This is happening for imap, pop and lmtp processes when they try to update quotas stored in a mysql database; presumably it is the dict process that actually has these issues - the lmtp delivery isn't lasting longer than 1 second so shouldn't be seeing any timeouts there. This is always followed by the "Error: dict quota: Quota update failed, it's now desynced" line; presumably it is telling the truth but I'm not sure how I could tell. We are also seeing this "MySQL server has gone away" issue in login processes but it isn't causing an issue there as presumably dovecot transparently retries rather than just giving up as it seems to in the quota updates. Any thoughts or advice would be appreciated. Mark From selcuk.yazar at gmail.com Wed Dec 7 21:57:32 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Wed, 7 Dec 2011 21:57:32 +0200 Subject: [Dovecot] postlogin script Message-ID: Hi, I have Postfix + OpenLdap + DoveCot configuration, and it's running succesfuly, i wantto convert users pop3 password NTPassword and LMPassword, so i ne plain passwor dof users, how can i do that. (Normaly using perl's ntlmgen function i convert password , but in plain) thanks in advance From jtam.home at gmail.com Thu Dec 8 04:00:43 2011 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 7 Dec 2011 18:00:43 -0800 (PST) Subject: [Dovecot] doveadm fetch vs search+fetch Message-ID: What's the pactical difference between using "doveadm fetch" rather than using "doveadm search" in conjunction with "doveadm fetch", as the man pages suggest? It seems "doveadm fetch" functionally supercedes "doveadm search" making the latter obsolete. It can even be closely simulated with "doveadm -f tab fetch ... 'mailbox-guid uid' search-query ...". Joseph Tam From tss at iki.fi Thu Dec 8 05:19:42 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 05:19:42 +0200 Subject: [Dovecot] doveadm fetch vs search+fetch In-Reply-To: References: Message-ID: <1323314382.15365.45.camel@hurina> On Wed, 2011-12-07 at 18:00 -0800, Joseph Tam wrote: > What's the pactical difference between using "doveadm fetch" rather > than using "doveadm search" in conjunction with "doveadm fetch", as the > man pages suggest? > > It seems "doveadm fetch" functionally supercedes "doveadm search" > making the latter obsolete. It can even be closely simulated > with "doveadm -f tab fetch ... 'mailbox-guid uid' search-query ...". If you want to fetch message headers/bodies separately for multiple messages, then doveadm search is useful. With "doveadm fetch" you can't really know where one message ends and another one begins (although the ^L character between messages is a good indicator, it's not 100% reliable). And in any case it's more difficult to use for separating messages in a shell script. From jtam.home at gmail.com Thu Dec 8 05:56:01 2011 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 7 Dec 2011 19:56:01 -0800 (PST) Subject: [Dovecot] doveadm fetch vs search+fetch In-Reply-To: <1323314382.15365.45.camel@hurina> References: <1323314382.15365.45.camel@hurina> Message-ID: On Thu, 8 Dec 2011, Timo Sirainen wrote: >> It seems "doveadm fetch" functionally supercedes "doveadm search" >> making the latter obsolete. It can even be closely simulated >> with "doveadm -f tab fetch ... 'mailbox-guid uid' search-query ...". > > If you want to fetch message headers/bodies separately for multiple > messages, then doveadm search is useful. With "doveadm fetch" you can't > really know where one message ends and another one begins (although the > ^L character between messages is a good indicator, it's not 100% > reliable). And in any case it's more difficult to use for separating > messages in a shell script. You could use, as I suggested, doveadm -f tab fetch -u bob 'mailbox-guid uid' ... | \ while read guid uid; do ... done which pretty much does the same thing (but you have to dump the first line, ugh!). It doesn't matter all that much except some extra man page reading, but it will save you the bother of having to maintain a separate binary, man page, etc. for what is essentially a duplicate. Joseph Tam From tss at iki.fi Thu Dec 8 06:03:25 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:03:25 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EDF8E2B.7020204@univ-nantes.fr> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> <4EDF3F10.1090604@univ-nantes.fr> <4EDF8E2B.7020204@univ-nantes.fr> Message-ID: <1323317006.15365.52.camel@hurina> On Wed, 2011-12-07 at 17:02 +0100, Yann Dupont wrote: > > before doing rm -rf for the user's mails. And in the archiving step you should do it with dsync with mail_attachment_dir disabled in the destination storage, so the the attachments get written to the archive directly instead of only referencing SIS. > > > Yes, I understand, it will work. But, if case of any error (even our > fault : premature end of script, for example) you can still end up with > attachement forever lost on the filesystem. > > Right, it SHOULD not happen, and it probably won't represent a big > volume. But Still, it could happen under specific circonstances. In that > case, I don't see any simple way to detect that kind of files ? > > Do you see how a script could detect some orphaned links ?? It wouldn't be simple. The only safe way would be to: 1. Scan through all the attachment HASH-GUID names and save them. This scanning step could already detect some orphaned attachments, where the hashes/HASH file exists with nlink=1 (i.e. HASH-GUID* files have been deleted, but the HASH itself hasn't been for some reason). 2. Read through all users' all dboxes contents and get a list of all referenced attachment HASH-GUIDs. 3. Delete all attachments that exist in list 1, but not in list 2. I guess there should be a "doveadm sis rescan" command that does this. From tss at iki.fi Thu Dec 8 06:11:44 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:11:44 +0200 Subject: [Dovecot] 2.1.rc1 (1e118913348b): Panic: file mail-user.c: line 128 (mail_user_ref): assertion failed: (user->refcount > 0) In-Reply-To: <4EDF9185.7060805@localhost.localdomain.org> References: <4EDF9185.7060805@localhost.localdomain.org> Message-ID: <1323317504.15365.53.camel@hurina> On Wed, 2011-12-07 at 17:17 +0100, Pascal Volk wrote: > right after delivering the message to the INBOX the lmtp crashes. > I wonder about the "Sent" in the attached backtrace. http://hg.dovecot.org/dovecot-2.1/rev/3b70254e0596 should fix it. From tss at iki.fi Thu Dec 8 06:13:40 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:13:40 +0200 Subject: [Dovecot] doveadm fetch vs search+fetch In-Reply-To: References: <1323314382.15365.45.camel@hurina> Message-ID: <1323317620.15365.55.camel@hurina> On Wed, 2011-12-07 at 19:56 -0800, Joseph Tam wrote: > > If you want to fetch message headers/bodies separately for multiple > > messages, then doveadm search is useful. With "doveadm fetch" you can't > > really know where one message ends and another one begins (although the > > ^L character between messages is a good indicator, it's not 100% > > reliable). And in any case it's more difficult to use for separating > > messages in a shell script. > > You could use, as I suggested, > > doveadm -f tab fetch -u bob 'mailbox-guid uid' ... | \ Oh, you meant this. > while read guid uid; do > ... > done > > which pretty much does the same thing (but you have to dump the first > line, ugh!). It doesn't matter all that much except some extra man > page reading, but it will save you the bother of having to maintain a > separate binary, man page, etc. for what is essentially a duplicate. Yeah, but it's more effort to remove it than to keep it as it is :) Also a "search" is somewhat simpler and prettier to use. From tss at iki.fi Thu Dec 8 06:18:17 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:18:17 +0200 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <20111207170505.GI22136@herakles.constabel-it.de> References: <20111207170505.GI22136@herakles.constabel-it.de> Message-ID: <1323317897.15365.58.camel@hurina> On Wed, 2011-12-07 at 18:05 +0100, Mike Constabel wrote: > if I try to crate a folder in Thunderbird 8 which contains > umlauts this happens: > > - Create folder "T?r" > - Thunderbird show T&APw-r in folder list I can't reproduce. Is it possible this is a TB bug? Try talking IMAP protocol directly: /usr/local/libexec/dovecot/imap -u user at domain a list "" T* If it lists: * LIST (\HasNoChildren) "." "T&APw-r" Then Dovecot is working correctly. > drwx------ 3 vmail vmail 4,0K 7. Dez 17:45 T&APw-r This is correct. > On another server with > > # 2.0.13 (537d4b6d9a7a): /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-5-686 i686 Debian 6.0.2 > > an an server with > > # 1.2.16: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 5.0.9 > > umlauts are working. It wouldn't be impossible for TB to be simply confused with this setup for some reason :) From tss at iki.fi Thu Dec 8 06:22:58 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:22:58 +0200 Subject: [Dovecot] overriding userdb connection host for doveadm-user In-Reply-To: <87aa742rbo.fsf@algae.riseup.net> References: <87aa742rbo.fsf@algae.riseup.net> Message-ID: <1323318179.15365.62.camel@hurina> On Wed, 2011-12-07 at 13:02 -0500, Micah Anderson wrote: > I've got my users in a replicated database setup and dovecot configured > with two connect lines in dovecot-sql.conf: > > connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass > connect = host=127.0.0.2 port=3306 dbname=users user=user password=pass > > this works really well to help balance the load. If you actually have it like that, it should only be using 127.0.0.2, as the second connect setting overrides the first one.. The right way would have been: connect = host=127.0.0.1 host=127.0.0.2 port=... > I would like a way to see if the new user's information has been > replicated yet before sending the email. I was thinking I could use > 'doveadm user' to lookup the user, but I am not sure that I can specify > one of the specific 'connect' lines in my configuration to check. Is > there a way to override that configuration variable to do this test? I > tried various incarnations of passing '-o connect=host='... but doveadm > user would just ignore them. doveadm does the lookup via auth-userdb socket. You have two possibilities: a) Have doveadm use another auth-userdb socket that points to another dovecot installation with different configuration. b) Use a different userdb configuration for doveadm: protocol !doveadm { userdb { driver = sql args = /.../dovecot-sql.conf.ext } } protocol doveadm { userdb { driver = sql args = /.../dovecot-sql-slave.conf.ext } } From tss at iki.fi Thu Dec 8 07:03:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:03:12 +0200 Subject: [Dovecot] sql dict: commit failed: MySQL server has gone away In-Reply-To: <4EDFB2A5.9090303@webfusion.com> References: <4EDFB2A5.9090303@webfusion.com> Message-ID: <1323320593.15365.65.camel@hurina> On Wed, 2011-12-07 at 20:38 +0200, Mark Zealey wrote: > Following on from this thread: > http://www.dovecot.org/list/dovecot/2010-September/052704.html > > in 2.0.16 I am seeing the same issues. I believe this would be related > to some timeouts set on our mysql servers which are pretty low (30 or 60 > seconds or so to drop idle connections). Yes, most likely. But it only happens if the quota isn't enforced (e.g. unlimited quota), because otherwise the previous "current quota usage" lookup would have automatically reconnected. > This is happening for imap, pop > and lmtp processes when they try to update quotas stored in a mysql > database; presumably it is the dict process that actually has these > issues - the lmtp delivery isn't lasting longer than 1 second so > shouldn't be seeing any timeouts there. This is always followed by the > "Error: dict quota: Quota update failed, it's now desynced" line; > presumably it is telling the truth but I'm not sure how I could tell. Yes. All sql dict updates go through dict process, which keeps a long running sql connection open. > We are also seeing this "MySQL server has gone away" issue in login > processes but it isn't causing an issue there as presumably dovecot > transparently retries rather than just giving up as it seems to in the > quota updates. Any thoughts or advice would be appreciated. You mean auth processes. In case of auth the lookup is retried though. Anyway, v2.1 now retries the commit: http://hg.dovecot.org/dovecot-2.1/rev/782f09d13ece From tss at iki.fi Thu Dec 8 07:06:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:06:12 +0200 Subject: [Dovecot] postlogin script In-Reply-To: References: Message-ID: <1323320772.15365.68.camel@hurina> On Wed, 2011-12-07 at 21:57 +0200, Selcuk Yazar wrote: > Hi, > > I have Postfix + OpenLdap + DoveCot configuration, and it's running > succesfuly, > > i wantto convert users pop3 password NTPassword and LMPassword, so i ne > plain passwor dof users, > > how can i do that. (Normaly using perl's ntlmgen function i convert > password , but in plain) 1) You need to enable userdb prefetch and make it work: http://wiki2.dovecot.org/UserDatabase/Prefetch 2) Once you can successfully log in with userdb prefetch enabled, add another field to pass_attrs: pass_attrs = ..., =userdb_plaintext_pass=%w 3) Now in your post-login script you should have PLAINTEXT_PASS environment containing the password. From tss at iki.fi Thu Dec 8 07:11:01 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:11:01 +0200 Subject: [Dovecot] lazy_expunge plugin and folder subscription trouble In-Reply-To: <20111207171203.32263dknm9tyodgc@webmail.hrz.uni-giessen.de> References: <20111207171203.32263dknm9tyodgc@webmail.hrz.uni-giessen.de> Message-ID: <1323321061.15365.70.camel@hurina> On Wed, 2011-12-07 at 17:12 +0100, J?rgen Obermann wrote: > Hello, > I wanted to test the lazy expunge plugin together with mdbox. It seems > to me that the folder subscriptions file in the mdbox directory was > overwritten with only a few folder names every time I added or removed > something in the list of subscribed folders, or even if I turned the > imap folder subscription feature off and on. Here is my setup: .. > namespace { > location = mdbox:~/mdbox:MAILBOXDIR=expunged > prefix = .EXPUNGED/ > separator = / > } Right, with this it thinks that it owns the ~/mdbox/subscriptions file, but that is the same path as for the inbox namespace. I think with subscriptions=no it should have worked ok, but if not, use a different subscriptions filename: location = mdbox:~/mdbox:MAILBOXDIR=expunged:SUBSCRIPTIONS=subscriptions-expunged From tss at iki.fi Thu Dec 8 07:15:13 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:15:13 +0200 Subject: [Dovecot] problems when using dsync between servers In-Reply-To: <4EDF47BE.8080703@univ-nantes.fr> References: <4EDF47BE.8080703@univ-nantes.fr> Message-ID: <1323321313.15365.72.camel@hurina> On Wed, 2011-12-07 at 12:02 +0100, Yann Dupont wrote: > Much faster (using all the cores), but dsync still hangs on some > accounts. After a certain time dsync exit with an error like that : > > Panic: file dsync-worker-local.c: line 1688 > (local_worker_save_msg_continue): assertion failed: (ret == -1) Unfortunately there are still some bugs in dsync.. But you could work around this by checking if dsync returned failure, and if it did just retry the user. > This is on a RUNNNING server. > > My aim was to make some pass on the running server, then stop it and > make a last pass to finish the process. That should work. > Is dsync supposed to run only on a stopped server ? No. From tss at iki.fi Thu Dec 8 07:22:22 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:22:22 +0200 Subject: [Dovecot] Panic when attempting index with Apache Solr : fts_solr plugin In-Reply-To: <4ED91D34.3050906@digitalforplay.com> References: <4ED91D34.3050906@digitalforplay.com> Message-ID: <1323321743.15365.74.camel@hurina> On Fri, 2011-12-02 at 12:47 -0600, A Dovecot User wrote: > [root at mymailserver ~]# doveadm -D index -u username mailbox inbox The "mailbox" isn't necessary above. > doveadm(username): Info: INBOX: Caching mails seq=1..466 > doveadm(username): Panic: file solr-connection.c: line 545 > (solr_connection_post_more): assertion failed: (maxfd >= 0) This happens every time? It can't index any mails at all? Have you tried with Dovecot v2.0? I can't reproduce it. Anyway I guess either I'm using libcurl wrong somehow, or there's a bug in libcurl.. From tss at iki.fi Thu Dec 8 07:23:48 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:23:48 +0200 Subject: [Dovecot] v2.1.rc1 missing SnowballAnalyzer.h In-Reply-To: <20111201161528.GI3177@zptr-nb18.caf.local> References: <20111201161528.GI3177@zptr-nb18.caf.local> Message-ID: <1323321828.15365.75.camel@hurina> On Thu, 2011-12-01 at 18:15 +0200, Eray Aslan wrote: > Sure enough, there is no SnowballAnalyzer.h in the tarball. > Looks like a missing a backslash in src/plugins/fts-lucene/Makefile.am: > [...] > noinst_HEADERS = \ > fts-lucene-plugin.h \ > lucene-wrapper.h > SnowballAnalyzer.h \ > SnowballFilter.h Yes, thanks, will be fixed in rc2. From tss at iki.fi Thu Dec 8 07:27:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:27:12 +0200 Subject: [Dovecot] Questions about Proxy/Director In-Reply-To: <4ED4EB16.1030704@wk-serv.de> References: <1321472837.21919.598.camel@hurina> <4ECAC68D.3060007@wk-serv.de> <20111122071624.GA6110@dibs.tanso.net> <4ECB76A8.80208@wk-serv.de> <20111122104547.GA10680@dibs.tanso.net> <2094e82e55c67f5591540ca7c800b92c@wk-serv.de> <20111124104709.GB24297@dibs.tanso.net> <4ECE483B.5090208@wk-serv.de> <20111124143321.GB28600@dibs.tanso.net> <4ECECBF9.5070507@wk-serv.de> <20111125081715.GA24352@dibs.tanso.net> <4ED4EB16.1030704@wk-serv.de> Message-ID: <1323322033.15365.76.camel@hurina> On Tue, 2011-11-29 at 15:24 +0100, Patrick Westenberg wrote: > I have a working test environment not but I don't feel very comfortable > with a non encrypted connection between the proxy/director and the > backend servers. > > If I set ssl = required on my backend server I get this error: > imap-login: Disconnected (tried to use disabled plaintext auth) > > Is there a chance to encrypt this connection? See the ssl stuff in http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy From tss at iki.fi Thu Dec 8 07:31:53 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:31:53 +0200 Subject: [Dovecot] POP3/IMAP crash signal 10 In-Reply-To: <0D810DB78132A8488DE17E655BF29B685C5EAA5C@TUPSDC01.tups.net.au> References: <0D810DB78132A8488DE17E655BF29B685C5EAA5C@TUPSDC01.tups.net.au> Message-ID: <1323322313.15365.80.camel@hurina> On Mon, 2011-11-28 at 03:24 +0000, Patrick Wood wrote: > Nov 28 14:11:02 mailserver dovecot: [ID 583609 mail.error] master: Error: service(pop3-login): child 28277 killed with signal 10 (core not dumped - set service pop3-log > in { drop_priv_before_exec=yes }) You can easily reproduce this? gdb backtrace is needed to get anything useful out of this crash. Try with: service pop3-login { executable = pop3-login -D drop_priv_before_exec = yes } Now when it crashes, it hopefully says that it's dumping a core (to /usr/local/var/run/dovecot/login/core)? If not, try attaching gdb directly to the process: service pop3-login { process_min_avail = 1 service_count = 0 } gdb /usr/local/libexec/dovecot/pop3-login cont bt full From tss at iki.fi Thu Dec 8 07:37:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:37:20 +0200 Subject: [Dovecot] Assertion failure in 2.0.16 - SEARCH () In-Reply-To: References: Message-ID: <1323322640.15365.81.camel@hurina> On Fri, 2011-11-25 at 22:36 -0800, Daniel Colascione wrote: > Nov 25 22:25:59 dancol dovecot: imap(dancol): Panic: file mail-search-build.c: > line 59 (mail_search_build_key_int): assertion failed: (sarg->value.subargs != > NULL) Thanks, fixed: http://hg.dovecot.org/dovecot-2.0/rev/ba68f9be07c4 From tss at iki.fi Thu Dec 8 07:53:57 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:53:57 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <4ED114DA.7030707@webfusion.com> References: <4ED114DA.7030707@webfusion.com> Message-ID: <1323323637.15365.85.camel@hurina> On Sat, 2011-11-26 at 18:33 +0200, Mark Zealey wrote: > We're trying to convert users from Maildir to sdbox at present; I'm > using dsync to achieve this (2.0.16) however when the user's have been > converted we only get minimal information in the caching files. Is there > some way to preserve all the caching decisions that were previously made > so that when the user logs in to the new mailbox we don't have to cause > an io storm rebuilding the cache that we know was good? Dovecot seems to > be partially doing this - if i remove the logs/cache from the source > mailbox no cache files are built in the conversion; if i put them back > then we get a cache file built but it only contains a few bits of > information (guid, date.save). Looking into this a bit further i find > that when the caches are present at source the fields are preserved but > the 'last used' date and caching decisions are not which I suspect means > dsync doesn't bother caching on import - only fields with a yes decision > in the source are copied (but their decision is only copied as a tmp > with the date of import). For example: How are you calling dsync? Does the destination already exist? I tried with: rm -rf /tmp/foo; dsync -u tss -m INBOX mirror sdbox:/tmp/foo It sets all of the cache fields with "yes" or "tmp" decision, as it should. But yes, the "last used" field should probably be copied as well. Perhaps the problem with you is that dsync actually writes all of the cache fields, but then it does a "cache compression" at the end, which sees that the "last used" fields are so old, so it deletes them. But yes, it is a problem that dsync doesn't update caching decisions.. Hmm. I guess I'll have to fix that for v2.1. From Mark.Zealey at webfusion.com Thu Dec 8 09:10:18 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 07:10:18 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323323637.15365.85.camel@hurina> References: <4ED114DA.7030707@webfusion.com>, <1323323637.15365.85.camel@hurina> Message-ID: Apologies for top-posting but I can't figure out how to make this client do inline... I am seeing on the first run (we are using 'backup') we don't get any of the cache copied just the index files created. On the second run (ie when dest exists); a cache file is created and populated with the bits that are required for the sync presumably - guid. As you say the yes/tmp caching decisions are copied over (and visible in the cache file) but because the last used date is not copied; these fields are not activated for any of the messages so none of their data actually gets cached. I'm not seeing a compression at the end as the tmp etc fields are still there (mostly don't have any yes fields in our source caches) but as I say, because they don't have a last used date then the none of them are ever actually used until the client requests them via pop/imap. Mark ________________________________________ From: Timo Sirainen [tss at iki.fi] Sent: 08 December 2011 05:53 To: Mark Zealey Cc: Dovecot Mailing List Subject: Re: [Dovecot] using dsync to convert mailboxes looses caching options On Sat, 2011-11-26 at 18:33 +0200, Mark Zealey wrote: > We're trying to convert users from Maildir to sdbox at present; I'm > using dsync to achieve this (2.0.16) however when the user's have been > converted we only get minimal information in the caching files. Is there > some way to preserve all the caching decisions that were previously made > so that when the user logs in to the new mailbox we don't have to cause > an io storm rebuilding the cache that we know was good? Dovecot seems to > be partially doing this - if i remove the logs/cache from the source > mailbox no cache files are built in the conversion; if i put them back > then we get a cache file built but it only contains a few bits of > information (guid, date.save). Looking into this a bit further i find > that when the caches are present at source the fields are preserved but > the 'last used' date and caching decisions are not which I suspect means > dsync doesn't bother caching on import - only fields with a yes decision > in the source are copied (but their decision is only copied as a tmp > with the date of import). For example: How are you calling dsync? Does the destination already exist? I tried with: rm -rf /tmp/foo; dsync -u tss -m INBOX mirror sdbox:/tmp/foo It sets all of the cache fields with "yes" or "tmp" decision, as it should. But yes, the "last used" field should probably be copied as well. Perhaps the problem with you is that dsync actually writes all of the cache fields, but then it does a "cache compression" at the end, which sees that the "last used" fields are so old, so it deletes them. But yes, it is a problem that dsync doesn't update caching decisions.. Hmm. I guess I'll have to fix that for v2.1. From Mark.Zealey at webfusion.com Thu Dec 8 09:14:05 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 07:14:05 +0000 Subject: [Dovecot] sql dict: commit failed: MySQL server has gone away In-Reply-To: <1323320593.15365.65.camel@hurina> References: <4EDFB2A5.9090303@webfusion.com>, <1323320593.15365.65.camel@hurina> Message-ID: Correct we're not enforcing the quotas at present just want an easy way to monitor everyone's mailbox usage. Thanks for the patch; will it work ok against 2.0.16? if so I'll recompile and give it a test today. Mark ________________________________________ From: Timo Sirainen [tss at iki.fi] Sent: 08 December 2011 05:03 To: Mark Zealey Cc: dovecot at dovecot.org Subject: Re: [Dovecot] sql dict: commit failed: MySQL server has gone away On Wed, 2011-12-07 at 20:38 +0200, Mark Zealey wrote: > Following on from this thread: > http://www.dovecot.org/list/dovecot/2010-September/052704.html > > in 2.0.16 I am seeing the same issues. I believe this would be related > to some timeouts set on our mysql servers which are pretty low (30 or 60 > seconds or so to drop idle connections). Yes, most likely. But it only happens if the quota isn't enforced (e.g. unlimited quota), because otherwise the previous "current quota usage" lookup would have automatically reconnected. > This is happening for imap, pop > and lmtp processes when they try to update quotas stored in a mysql > database; presumably it is the dict process that actually has these > issues - the lmtp delivery isn't lasting longer than 1 second so > shouldn't be seeing any timeouts there. This is always followed by the > "Error: dict quota: Quota update failed, it's now desynced" line; > presumably it is telling the truth but I'm not sure how I could tell. Yes. All sql dict updates go through dict process, which keeps a long running sql connection open. > We are also seeing this "MySQL server has gone away" issue in login > processes but it isn't causing an issue there as presumably dovecot > transparently retries rather than just giving up as it seems to in the > quota updates. Any thoughts or advice would be appreciated. You mean auth processes. In case of auth the lookup is retried though. Anyway, v2.1 now retries the commit: http://hg.dovecot.org/dovecot-2.1/rev/782f09d13ece From tss at iki.fi Thu Dec 8 09:33:44 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 09:33:44 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323323637.15365.85.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina> Message-ID: <1323329624.15365.87.camel@hurina> On Thu, 2011-12-08 at 07:53 +0200, Timo Sirainen wrote: > But yes, it is a problem that dsync doesn't update caching decisions.. > Hmm. I guess I'll have to fix that for v2.1. Could you try if the attached patch fixes your problems when patching against latest v2.1 hg? It's annoyingly large, and it makes v2.1 dsync incompatible with v2.0, but maybe it's better to do it sooner than later.. -------------- next part -------------- A non-text attachment was scrubbed... Name: dsync.diff Type: text/x-patch Size: 27825 bytes Desc: not available URL: From Yann.Dupont at univ-nantes.fr Thu Dec 8 09:47:16 2011 From: Yann.Dupont at univ-nantes.fr (Yann Dupont) Date: Thu, 08 Dec 2011 08:47:16 +0100 Subject: [Dovecot] problems when using dsync between servers In-Reply-To: <1323321313.15365.72.camel@hurina> References: <4EDF47BE.8080703@univ-nantes.fr> <1323321313.15365.72.camel@hurina> Message-ID: <4EE06B84.2030302@univ-nantes.fr> Le 08/12/2011 06:15, Timo Sirainen a ?crit : > On Wed, 2011-12-07 at 12:02 +0100, Yann Dupont wrote: > >> Much faster (using all the cores), but dsync still hangs on some >> accounts. After a certain time dsync exit with an error like that : >> >> Panic: file dsync-worker-local.c: line 1688 >> (local_worker_save_msg_continue): assertion failed: (ret == -1) > > Unfortunately there are still some bugs in dsync.. But you could work > around this by checking if dsync returned failure, and if it did just > retry the user. > ok will try this. >> This is on a RUNNNING server. >> >> My aim was to make some pass on the running server, then stop it and >> make a last pass to finish the process. > > That should work. > >> Is dsync supposed to run only on a stopped server ? > > No. > OK, thanks for your answer, -- Yann Dupont - Service IRTS, DSI Universit? de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont at univ-nantes.fr From selcuk.yazar at gmail.com Thu Dec 8 10:40:26 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Thu, 8 Dec 2011 10:40:26 +0200 Subject: [Dovecot] postlogin script In-Reply-To: <1323320772.15365.68.camel@hurina> References: <1323320772.15365.68.camel@hurina> Message-ID: Hi, i applied settingsin below but dovecot says that " prefetch(.. at ....edu.tr,IP_ADDRESS): passdb didn't return userdb entries, trying the next userdb " so PLAINTEXT_PASS is empty thanks in advance. > 1) You need to enable userdb prefetch and make it work: > http://wiki2.dovecot.org/UserDatabase/Prefetch > > 2) Once you can successfully log in with userdb prefetch enabled, add > another field to pass_attrs: > > pass_attrs = ..., =userdb_plaintext_pass=%w > > 3) Now in your post-login script you should have PLAINTEXT_PASS > environment containing the password. > > -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From tss at iki.fi Thu Dec 8 10:55:17 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 10:55:17 +0200 Subject: [Dovecot] postlogin script In-Reply-To: References: <1323320772.15365.68.camel@hurina> Message-ID: <1323334517.15365.88.camel@hurina> On Thu, 2011-12-08 at 10:40 +0200, Selcuk Yazar wrote: > Hi, > > i applied settingsin below but dovecot says that > > " prefetch(.. at ....edu.tr,IP_ADDRESS): passdb didn't return userdb entries, > trying the next userdb > " That's why I said make the userdb prefetch work first, the way described in: > > http://wiki2.dovecot.org/UserDatabase/Prefetch You'll need to add stuff to your pass_attrs. It doesn't work automatically. From listen at constabel.net Thu Dec 8 10:55:14 2011 From: listen at constabel.net (Mike Constabel) Date: Thu, 8 Dec 2011 09:55:14 +0100 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <1323317897.15365.58.camel@hurina> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> Message-ID: <20111208085514.GJ22136@herakles.constabel-it.de> Hi, Timo Sirainen schrieb am Thursday, den 08. December 2011: > On Wed, 2011-12-07 at 18:05 +0100, Mike Constabel wrote: > > > if I try to crate a folder in Thunderbird 8 which contains > > umlauts this happens: > > > > - Create folder "T?r" > > - Thunderbird show T&APw-r in folder list > > I can't reproduce. Is it possible this is a TB bug? Try talking IMAP > protocol directly: > > /usr/local/libexec/dovecot/imap -u user at domain > a list "" T* > > If it lists: > > * LIST (\HasNoChildren) "." "T&APw-r" > > Then Dovecot is working correctly. I get: # /usr/lib/dovecot/imap -u test1 at in-preetz.de Debug: Loading modules from directory: /usr/lib/dovecot/modules Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Debug: auth input: test1 at in-preetz.de uid=1000 gid=1000 home=/mailspool1/in-preetz.de/test1 quota_rule=*:storage=500M Debug: Added userdb setting: plugin/quota_rule=*:storage=500M Debug: Effective uid=1000, gid=1000, home=/mailspool1/in-preetz.de/test1 Debug: quota: No quota setting - plugin disabled Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mdbox Debug: fs: root=/mailspool1/in-preetz.de/test1/mdbox, index=, control=, inbox=, alt= Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS FUZZY SPECIAL-USE QUOTA] Logged in as test1 at in-preetz.de a list "" T* * LIST (\HasNoChildren) "/" "T&-APw-r" * LIST (\HasChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "Trash/T&-APw-r" a OK List completed. As you see there is a second "-" in the name: "T&APw-r" != "T&-APw-r" With my old server: # telnet 192.168.10.102 143 Trying 192.168.10.102... Connected to 192.168.10.102. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5] Dovecot ready. A login aaa bbb A OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk QUOTA] Logged in a list "" T* * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "Test-1" * LIST (\HasNoChildren) "/" "T&APw-r" a OK List completed. Mike From selcuk.yazar at gmail.com Thu Dec 8 10:58:03 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Thu, 8 Dec 2011 10:58:03 +0200 Subject: [Dovecot] postlogin script In-Reply-To: <1323334517.15365.88.camel@hurina> References: <1323320772.15365.68.camel@hurina> <1323334517.15365.88.camel@hurina> Message-ID: Hi, i 'sorry, my mistake, it shold be pass_attrs = uid=user,userPassword=password, *=userdb_plaintext_pass=%w* as you said it must contain *equal sign* before userdb_plaintext_pass=%w, i missed it. thank you very much it works.! sel?uk On Thu, Dec 8, 2011 at 10:55 AM, Timo Sirainen wrote: > On Thu, 2011-12-08 at 10:40 +0200, Selcuk Yazar wrote: > > Hi, > > > > i applied settingsin below but dovecot says that > > > > " prefetch(.. at ....edu.tr,IP_ADDRESS): passdb didn't return userdb > entries, > > trying the next userdb > > " > > That's why I said make the userdb prefetch work first, the way described > in: > > > > http://wiki2.dovecot.org/UserDatabase/Prefetch > > You'll need to add stuff to your pass_attrs. It doesn't work > automatically. > > > -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From tss at iki.fi Thu Dec 8 11:19:41 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 11:19:41 +0200 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <20111208085514.GJ22136@herakles.constabel-it.de> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> Message-ID: <1323335981.15365.90.camel@hurina> On Thu, 2011-12-08 at 09:55 +0100, Mike Constabel wrote: > As you see there is a second "-" in the name: > > "T&APw-r" != "T&-APw-r" Oh, right, it's broken in the "fs" layout. With "maildir++" layout it works. And looks like this isn't going to be an easy fix. The fs layout listing code is horrible.. Maybe I'll just try rewriting it. From Mark.Zealey at webfusion.com Thu Dec 8 11:19:47 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 09:19:47 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323329624.15365.87.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> Message-ID: OK now it's copying the timestamp fields for tmp ones. However: 1) hdr.* fields are not being copied at all (unlike in previous releases) 2) although the decisions are now being recorded; the items are not actually being put into the cache for previously sync'd mails. New mails are having all the cache information produced however. Note: this is only when using the -f option to dsync; when not using -f it doesnt even get round to generating a cache so no fields are put there. Perhaps this should be activated by a new option to dsync; if people are using this for backup (rather than conversion) caches could get relatively large? Mark ________________________________________ From: Timo Sirainen [tss at iki.fi] Sent: 08 December 2011 07:33 To: Dovecot Mailing List Cc: Mark Zealey Subject: Re: [Dovecot] using dsync to convert mailboxes looses caching options On Thu, 2011-12-08 at 07:53 +0200, Timo Sirainen wrote: > But yes, it is a problem that dsync doesn't update caching decisions.. > Hmm. I guess I'll have to fix that for v2.1. Could you try if the attached patch fixes your problems when patching against latest v2.1 hg? It's annoyingly large, and it makes v2.1 dsync incompatible with v2.0, but maybe it's better to do it sooner than later.. From tss at iki.fi Thu Dec 8 11:27:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 11:27:20 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> Message-ID: <1323336440.15365.95.camel@hurina> On Thu, 2011-12-08 at 09:19 +0000, Mark Zealey wrote: > OK now it's copying the timestamp fields for tmp ones. However: > > 1) hdr.* fields are not being copied at all (unlike in previous releases) They are in my tests.. This also happens if the destination doesn't exist? > 2) although the decisions are now being recorded; the items are not actually being put into the cache for previously sync'd mails. New mails are having all the cache information produced however. This is intentional. Doing anything else would be horribly inefficient. Note that dsync isn't *copying* cached data. It's simply setting the caching decisions, and the mail saving code parses the mails and updates cache. > Perhaps this should be activated by a new option to dsync; if people are using this for backup (rather than conversion) caches could get relatively large? Hm. Maybe.. From Mark.Zealey at webfusion.com Thu Dec 8 11:35:04 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 09:35:04 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323336440.15365.95.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> Message-ID: OK I'll test the header copying more fully. The reason we want to preserve caching decisions is to avoid an IO storm when users log in to their mailboxes after an sdbox upgrade so it would be great to be able to have some way to warm caches. Mark ________________________________________ From: Timo Sirainen [tss at iki.fi] Sent: 08 December 2011 09:27 To: Mark Zealey Cc: Dovecot Mailing List Subject: RE: [Dovecot] using dsync to convert mailboxes looses caching options On Thu, 2011-12-08 at 09:19 +0000, Mark Zealey wrote: > OK now it's copying the timestamp fields for tmp ones. However: > > 1) hdr.* fields are not being copied at all (unlike in previous releases) They are in my tests.. This also happens if the destination doesn't exist? > 2) although the decisions are now being recorded; the items are not actually being put into the cache for previously sync'd mails. New mails are having all the cache information produced however. This is intentional. Doing anything else would be horribly inefficient. Note that dsync isn't *copying* cached data. It's simply setting the caching decisions, and the mail saving code parses the mails and updates cache. > Perhaps this should be activated by a new option to dsync; if people are using this for backup (rather than conversion) caches could get relatively large? Hm. Maybe.. From knud.dombrowsky at graband.de Thu Dec 8 13:20:16 2011 From: knud.dombrowsky at graband.de (Knud Dombrowsky) Date: Thu, 08 Dec 2011 12:20:16 +0100 Subject: [Dovecot] noaclright Message-ID: <4EE09D70.3080909@graband.de> Hi, I recently upgraded to openSuse 12.1 which comes with dovecot 2.0.14. Because of mail-client-problems I am running one dovecot which requires authentication via a client-certificate and another one which can be used without a certificate. (Configurations can be found below.) Since the upgrade our shared mailbox is no longer visible. I tried to repair this by setting the ACLs once again (using imap-acl in Thunderbird) but every time I try to set a new ACL the tool says "noaclright" and dovecot logs the following messages: Dec 7 14:31:14 mailbox dovecot: imap(): Error: fstat(/home//Maildir/./dovecot-acl.lock) failed: No such file or directory Dec 7 14:31:14 mailbox dovecot: imap(): Error: file_dotlock_open(/home//Maildir/./dovecot-acl) failed: No such file or directory Needless to say the file exists and its contents looks like it should. (Every line is an ACL like "user=testuser ilrws") I took a look at the changelog from 2.0.14 onwards and since it says nothing about my problem I am not looking forward to compiling dovecot myself and installing it. Any ideas why this is happening? Is this a known problem? Any help is appreciated, Knud ------------Dovecot-on-port-992----------------------------------------- mailbox:~ # dovecot -n # 2.0.14: /etc/dovecot/dovecot.conf # OS: Linux 3.1.0-1.2-desktop x86_64 openSUSE 12.1 (x86_64) auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-master default_client_limit = 1600 default_process_limit = 512 listen = * mail_location = maildir:~/Maildir:INBOX=~/Maildir/.INBOX managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { driver = pam } plugin { acl = vfile:/etc/dovecot/acls:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes quota = maildir:alle Nutzer quota_rule = *:storage=1GB sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 992 ssl = yes } } ssl_ca = refcount > 0) In-Reply-To: <1323317504.15365.53.camel@hurina> References: <4EDF9185.7060805@localhost.localdomain.org> <1323317504.15365.53.camel@hurina> Message-ID: <4EE09D7B.7090604@localhost.localdomain.org> On 12/08/2011 05:11 AM Timo Sirainen wrote: > On Wed, 2011-12-07 at 17:17 +0100, Pascal Volk wrote: >> right after delivering the message to the INBOX the lmtp crashes. > http://hg.dovecot.org/dovecot-2.1/rev/3b70254e0596 should fix it. Thanks, that fixed the problem for me. Also thanks for http://hg.dovecot.org/dovecot-2.1/rev/8c803201651e Regards, Pascal -- The trapper recommends today: f007ba11.1134212 at localdomain.org From dovecot at digitalforplay.com Thu Dec 8 14:36:03 2011 From: dovecot at digitalforplay.com (A Dovecot User) Date: Thu, 08 Dec 2011 06:36:03 -0600 Subject: [Dovecot] =?utf-8?q?Panic_when_attempting_index_with_Apache_Solr_?= =?utf-8?q?=3A_fts=5Fsolr_plugin?= In-Reply-To: <1323321743.15365.74.camel@hurina> References: <4ED91D34.3050906@digitalforplay.com> <1323321743.15365.74.camel@hurina> Message-ID: <36a30195798e4f5ad24e7f6a365af649@localhost> It happens every time. Also, I just recompiled for version 2.0.16 and it gives me the same error (pasted below). I'll be updating the OS on this machine soon, which will update libcurl as well. Panic: file solr-connection.c: line 501 (solr_connection_post_more): assertion failed: (maxfd >= 0) Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3aa41) [0xbd5a41] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x47) [0xbd5b57] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xbab8de] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x293) [0x191d53] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x2723) [0x18f723] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_build_more+0x1f) [0x45d2ff] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x5515) [0x460515] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x5928) [0x460928] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_deinit+0x3a) [0xf3d03a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x55) [0xf3d0f5] -> doveadm() [0x805184d] -> doveadm() [0x804ef55] -> doveadm(doveadm_mail_single_user+0x5b) [0x804f3ab] -> doveadm() [0x804f813] -> doveadm(doveadm_mail_try_run+0x12e) [0x804fc6e] -> doveadm(main+0x3a4) [0x8055b64] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x729e36] -> doveadm() [0x804ed61] On Thu, 08 Dec 2011 07:22:22 +0200, Timo Sirainen wrote: > On Fri, 2011-12-02 at 12:47 -0600, A Dovecot User wrote: >> [root at mymailserver ~]# doveadm -D index -u username mailbox inbox > > The "mailbox" isn't necessary above. > >> doveadm(username): Info: INBOX: Caching mails seq=1..466 >> doveadm(username): Panic: file solr-connection.c: line 545 >> (solr_connection_post_more): assertion failed: (maxfd >= 0) > > This happens every time? It can't index any mails at all? Have you tried > with Dovecot v2.0? > > I can't reproduce it. Anyway I guess either I'm using libcurl wrong > somehow, or there's a bug in libcurl.. From micah at riseup.net Thu Dec 8 15:58:30 2011 From: micah at riseup.net (micah anderson) Date: Thu, 08 Dec 2011 08:58:30 -0500 Subject: [Dovecot] overriding userdb connection host for doveadm-user In-Reply-To: <1323318179.15365.62.camel@hurina> References: <87aa742rbo.fsf@algae.riseup.net> <1323318179.15365.62.camel@hurina> Message-ID: <87r50f17y1.fsf@algae.riseup.net> On Thu, 08 Dec 2011 06:22:58 +0200, Timo Sirainen wrote: > On Wed, 2011-12-07 at 13:02 -0500, Micah Anderson wrote: > > I've got my users in a replicated database setup and dovecot configured > > with two connect lines in dovecot-sql.conf: > > > > connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass > > connect = host=127.0.0.2 port=3306 dbname=users user=user password=pass > > > > this works really well to help balance the load. > > If you actually have it like that, it should only be using 127.0.0.2, as > the second connect setting overrides the first one.. What I actually have is: connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass connect = host=127.0.0.1 port=3307 dbname=users user=user password=pass two different port configurations (I'm running stunnel), rather than two different host entries[0]. >The right way would have been: > > connect = host=127.0.0.1 host=127.0.0.2 port=... So, if I just have two different ports, would the right way be: connect = host=127.0.0.1 port=3306 port=3307 dbname... ? micah 0. When I was anonymizing the db connection information in the original post, I accidentally changed the ip and decided it didn't matter for the question I was asking, so just left it. Now I see that might be confusing. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 835 bytes Desc: not available URL: From Mark.Zealey at webfusion.com Thu Dec 8 16:45:12 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 14:45:12 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina>, <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> Message-ID: With 2.0.16 hdr.xxx fields get copied fine (but of course without timestamp). With the patch you provided they don't get copied whether using mirror or backup & starting from scratch. I'm doing a Maildir to sdbox migration otherwise don't think I'm doing anytihng strange. Mark ________________________________________ From: Mark Zealey Sent: 08 December 2011 09:35 To: Timo Sirainen Cc: Dovecot Mailing List Subject: RE: [Dovecot] using dsync to convert mailboxes looses caching options OK I'll test the header copying more fully. The reason we want to preserve caching decisions is to avoid an IO storm when users log in to their mailboxes after an sdbox upgrade so it would be great to be able to have some way to warm caches. Mark From Mark.Zealey at webfusion.com Thu Dec 8 17:41:29 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 15:41:29 +0000 Subject: [Dovecot] sql dict: commit failed: MySQL server has gone away In-Reply-To: <420B5E34BFEE9646B7198438F9978AE223E32092@mail01.internal.webfusion.com> References: <4EDFB2A5.9090303@webfusion.com>, <1323320593.15365.65.camel@hurina>, <420B5E34BFEE9646B7198438F9978AE223E32092@mail01.internal.webfusion.com> Message-ID: Thanks Timo, this patch applied clean against 2.0.16 just running it on live for the past few minutes & seems to have fixed the issues. Mark ________________________________________ From: Mark Zealey Sent: 08 December 2011 07:14 To: Timo Sirainen Cc: dovecot at dovecot.org Subject: RE: [Dovecot] sql dict: commit failed: MySQL server has gone away Correct we're not enforcing the quotas at present just want an easy way to monitor everyone's mailbox usage. Thanks for the patch; will it work ok against 2.0.16? if so I'll recompile and give it a test today. Mark From Mark.Zealey at webfusion.com Thu Dec 8 18:10:15 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 16:10:15 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323336440.15365.95.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> Message-ID: By the way, another bug I noticed with dsync is that when converting from Maildir to sdbox is that the date.saved field is not preserved - it's just the time when the first dsync command happened. Presumably it should be the mtime of the Maildir message file Mark From user+dovecot at localhost.localdomain.org Thu Dec 8 18:37:23 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Thu, 08 Dec 2011 17:37:23 +0100 Subject: [Dovecot] Wish list item: %g/%{gid} variable Message-ID: <4EE0E7C3.2010101@localhost.localdomain.org> I think it would be very useful to have a user's GID in a variable. So i could use for example: mail_attachment_dir = /srv/mail/.SiS/%{gid} I use one GID per domain and the aliases fqhns of the domain. When for example example.com would be an alias for exmaple.net (gid: 12345), the attachments would be stored inside /srv/mail/.SiS/12345/, no matter if a message was sent to john.doe at example.com or to john.doe at example.net. "quota = dict:domain:%{gid}:proxy::quota" would then also work. Regards, Pascal -- The trapper recommends today: c01dcofe.1134217 at localdomain.org From hsehic at econtec.de Fri Dec 9 00:51:53 2011 From: hsehic at econtec.de (Sehic, Haris) Date: Thu, 8 Dec 2011 23:51:53 +0100 (CET) Subject: [Dovecot] Per-User MySQL Quota (postfixadmin) Message-ID: <30505072.4022.1323384713873.JavaMail.open-xchange@mail02.econtec.de> Hi, ? need some help setting per-user quota and postfixadmin.?Setup is working on 1.2 dovecot. Tryin 2.1 dovecot now,? quota is working but overriden quota rule set by 'user_query =' in /etc/dovecot/dovecot-sql.conf.ext takes no efffekt. What's wrong here? ? Greets ? Haris -------------- next part -------------- # 2.1.rc1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 nfs auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain dict { quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } disable_plaintext_auth = no first_valid_uid = 150 last_valid_uid = 150 login_trusted_networks = 127.0.0.1 10.213.1.0/24 mail_debug = yes mail_gid = 8 mail_home = /var/vmail/%d/%u mail_location = maildir:/var/vmail/%d/%u mail_nfs_storage = yes mail_plugins = " quota imap_quota imap_acl" mail_uid = 150 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:/var/vmail/%%d/%%u:INDEX=/var/vmail/%%d/%%u/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_anyone = allow acl_shared_dict = file:/var/vmail/shared-mailboxes.db mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:user quota::noenforcing:proxy::quotadict quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=90%% quota-warning 90 %u quota_warning3 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = hsehic at econtec.de protocols = imap sieve pop3 lmtp sieve quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = mail mode = 0600 user = vmail } } service dict { unix_listener dict { group = mail mode = 0600 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl_cert = -------------- next part -------------- connect = host=localhost dbname=postfixadmindb user=mailusr password=12345678 map { pattern = priv/quota/storage table = quota2 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota2 username_field = username value_field = messages } From maciej.przybecki at gmail.com Fri Dec 9 07:52:59 2011 From: maciej.przybecki at gmail.com (Maciej Przybecki) Date: Fri, 9 Dec 2011 06:52:59 +0100 Subject: [Dovecot] Per-User MySQL Quota (postfixadmin) In-Reply-To: <30505072.4022.1323384713873.JavaMail.open-xchange@mail02.econtec.de> References: <30505072.4022.1323384713873.JavaMail.open-xchange@mail02.econtec.de> Message-ID: I faced the same problem and digged for 2 days with no luck. It occurred, that I have userdb { ...} section defined as static values, so user_query has never been queried :-). So you must check your userdb section of your config. -Maciej Wys?ane z iPhone'a Dnia 8 gru 2011 o godz. 23:51 "Sehic, Haris" napisa?(a): > Hi, > > need some help setting per-user quota and postfixadmin. Setup is working on 1.2 > dovecot. Tryin 2.1 dovecot now, quota is working but overriden quota rule set > by 'user_query =' in /etc/dovecot/dovecot-sql.conf.ext takes no efffekt. What's > wrong here? > > Greets > > Haris > > > From florent at coppint.com Fri Dec 9 16:30:20 2011 From: florent at coppint.com (florent at coppint.com) Date: Fri, 09 Dec 2011 15:30:20 +0100 Subject: [Dovecot] Error: Corrupted index cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid record size Message-ID: Hi all, I got a problem with a Dovecot IMAP/POP installation. Since a recent failure of our distributed file system (no loss of data btw), Dovecot seems to have a problem with index cache files. For a lot of accounts, I have this error in logs: Error: Corrupted index cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid record size If I delete all files from /indexes/ directory, it still occurs... Do you see what can cause this problem ? Or what information can I provide to help ? Our distributed FS is MooseFS. Dovecot is configured like if it was NFS (no mmap, etc...). Thank you for your help :) Flo From terry at cnysupport.com Fri Dec 9 18:24:32 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 09 Dec 2011 11:24:32 -0500 Subject: [Dovecot] "Unstable" vs "Development" vs "Nightly" Message-ID: <4EE23640.6020009@cnysupport.com> I'm currently running v2.1rc1, but have been seeing errors like: Dec 8 11:31:55 it kernel: auth[18914]: segfault at 48 ip 00fe2f74 sp bfcaccd0 error 4 in libauthdb_imap.so[fdd000+f000] The unstable and nightly builds are newer, but are they likely to be more or less stable than the version I'm currently running? I'd like to install a newer version, but am trying to get a feel for how usable they're likely to be. Thanks, Terry From tss at iki.fi Fri Dec 9 18:43:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 9 Dec 2011 18:43:06 +0200 Subject: [Dovecot] "Unstable" vs "Development" vs "Nightly" In-Reply-To: <4EE23640.6020009@cnysupport.com> References: <4EE23640.6020009@cnysupport.com> Message-ID: On 9.12.2011, at 18.24, Terry Carmen wrote: > I'm currently running v2.1rc1, but have been seeing errors like: > > Dec 8 11:31:55 it kernel: auth[18914]: segfault at 48 ip 00fe2f74 sp bfcaccd0 error 4 in libauthdb_imap.so[fdd000+f000] It would be useful to get gdb backtrace from this. You should be able to get core dumps by adding to dovecot.conf: service auth { user = root } Run "ulimit -c unlimited" before starting dovecot. Then when it crashes there should be a core file in your base_dir (e.g. /var/run/dovecot), and you can do: gdb /usr/local/libexec/dovecot/auth /var/run/dovecot/core bt full > The unstable and nightly builds are newer, but are they likely to be more or less stable than the version I'm currently running? > > I'd like to install a newer version, but am trying to get a feel for how usable they're likely to be. The newer hg versions generally should be more stable, since I've mainly been trying to fix bugs instead of add new features.. The exception being this week, since I've needed to do a few bigger changes. From tss at iki.fi Fri Dec 9 18:53:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 9 Dec 2011 18:53:19 +0200 Subject: [Dovecot] Error: Corrupted index cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid record size In-Reply-To: References: Message-ID: <29C5867E-E95A-4A0D-8B9B-8734EDFD3A9A@iki.fi> On 9.12.2011, at 16.30, florent at coppint.com wrote: > Since a recent failure of our distributed file system (no loss of data > btw), Dovecot seems to have a problem with index cache files. > > For a > lot of accounts, I have this error in logs: > > Error: Corrupted index > cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid > record size Broken cache files aren't visible to users. Are there other errors? > If I delete all files from /indexes/ directory, it still > occurs... When that error happens, the cache is automatically deleted. But if it keeps happening over and over again, something's broken. > Do you see what can cause this problem ? Or what information > can I provide to help ? You said it worked fine until the distributed filesystem somehow failed, and after that it just keeps on failing? It doesn't really sound like it's Dovecot's fault. Also what Dovecot version is this? From terry at cnysupport.com Fri Dec 9 18:59:33 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 09 Dec 2011 11:59:33 -0500 Subject: [Dovecot] "Unstable" vs "Development" vs "Nightly" In-Reply-To: References: <4EE23640.6020009@cnysupport.com> Message-ID: <4EE23E75.6040102@cnysupport.com> On 12/09/2011 11:43 AM, Timo Sirainen wrote: > On 9.12.2011, at 18.24, Terry Carmen wrote: > >> I'm currently running v2.1rc1, but have been seeing errors like: >> >> Dec 8 11:31:55 it kernel: auth[18914]: segfault at 48 ip 00fe2f74 sp bfcaccd0 error 4 in libauthdb_imap.so[fdd000+f000] > It would be useful to get gdb backtrace from this. You should be able to get core dumps by adding to dovecot.conf: > > service auth { > user = root > } > > Run "ulimit -c unlimited" before starting dovecot. Then when it crashes there should be a core file in your base_dir (e.g. /var/run/dovecot), and you can do: > > gdb /usr/local/libexec/dovecot/auth /var/run/dovecot/core > bt full > >> The unstable and nightly builds are newer, but are they likely to be more or less stable than the version I'm currently running? >> >> I'd like to install a newer version, but am trying to get a feel for how usable they're likely to be. > The newer hg versions generally should be more stable, since I've mainly been trying to fix bugs instead of add new features.. The exception being this week, since I've needed to do a few bigger changes. Thanks! I'll wait until next week, then upgrade to the current hg version, and see if it goes away, before taking up more of your time on stuff that might already be fixed. Terry From tss at iki.fi Fri Dec 9 19:01:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 9 Dec 2011 19:01:12 +0200 Subject: [Dovecot] Wish list item: %g/%{gid} variable In-Reply-To: <4EE0E7C3.2010101@localhost.localdomain.org> References: <4EE0E7C3.2010101@localhost.localdomain.org> Message-ID: <2EFEE782-4715-4494-B291-521A00FDF9AA@iki.fi> On 8.12.2011, at 18.37, Pascal Volk wrote: > I think it would be very useful to have a user's GID in a variable. > > So i could use for example: mail_attachment_dir = /srv/mail/.SiS/%{gid} This was simple enough :) http://hg.dovecot.org/dovecot-2.1/rev/8a63f621bd2e http://hg.dovecot.org/dovecot-2.0/rev/af6d0858e64b From djonas at vitalwerks.com Fri Dec 9 21:16:19 2011 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 09 Dec 2011 11:16:19 -0800 Subject: [Dovecot] Make entire mailbox read-only (ACLs?) Message-ID: <4EE25E83.1090700@vitalwerks.com> Hello, Is there a way of locking a mailbox, effectively making it read-only to IMAP clients? I've read through http://wiki2.dovecot.org/ACL. I created dovecot-acl with the content "owner lr" in .INBOX which seems to keep me from copying messages into the folder, but not out. I have the plugin configured correctly, it seems, since MYRIGHTS command shows the correct value: 30 MYRIGHTS "INBOX" * MYRIGHTS "INBOX" lr Am I barking up the wrong tree? Is there an easier way to lock a mailbox? post-login scripting perhaps? Thanks! From brad at omnis.com Fri Dec 9 22:13:19 2011 From: brad at omnis.com (Brad Schuetz) Date: Fri, 09 Dec 2011 12:13:19 -0800 Subject: [Dovecot] Two recent issues Message-ID: <4EE26BDF.4080500@omnis.com> I've been using dovecot for years, been working great. However recently I've come across two issues. The first issue unfortunately I have little information on, mail_debug hasn't provided anything useful either (in fact it looks like the login request that fails doesn't even get logged at all). During the morning rush of email, this server has around 11k mailboxes on it, it *appears* that one of the auth processes dies resulting in "dovecot: imap-login: Error: read(imap) failed: Connection reset by peer" errors followed by "dovecot: imap-login: Internal login failure ..." in the logs. I've yet to get any useful debugging information on this error so I'm not expecting much/any help on this one, but if anyone has any ideas on how I can get more debug besides running strace 24/7 in the hopes it catches something before the hard drive is full of strace output I'd love to hear it. The best I've gotten was a lucky strace once (at the time I didn't realize it was so lucky or I would have saved the output) that indicated the imap-login daemon was failing to connect to the auth process. The second issue is lmtp/lda (tried both) delivery to a mailbox that has filesystem quotas enabled and the group quota is maxed is resulting in the below panic and crash. This issue happens with 2.0.13, 2.0.15 and 2.0.16. Here's the logs showing that it knows the disk quota is exceeded and then a subsequent zlib panic. Like it's trying to deliver it anyway. --------------------- 11:21:07 [err] dovecot: lmtp(29691, admin@[redacted].com): Error: o_stream_send_istream(/email/d/r/[redacted]/[redacted]/admin/Maildir/tmp/1323458467.M245978P29691.fenrir.omnis.com) failed: Disk quota exceeded 11:21:07 [crit] dovecot: lmtp(29691, admin@[redacted].com): Panic: file ostream-zlib.c: line 144 (o_stream_zlib_send_flush): assertion failed: (zs->avail_in == 0) 11:21:07 [err] dovecot: lmtp(29691, admin@[redacted].com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 [0x345443ca90] -> /usr/lib64/dovecot/libdovecot.so.0 [0x345443cae6] -> /usr/lib64/dovecot/libdovecot.so.0 [0x345443c4a3] -> /usr/lib64/dovecot/lib20_zlib_plugin.so [0x2ba2d31547f6] -> /usr/lib64/dovecot/lib20_zlib_plugin.so [0x2ba2d315481b] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_flush+0x2a) [0x345444f0ea] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_save_finish+0x6b) [0x3451c63b6b] -> /usr/lib64/dovecot/lib10_quota_plugin.so [0x2ba2d2f4ce7a] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_save_finish+0x30) [0x3451c2fbb0] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xb3) [0x3451c2aae3] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_copy+0x56) [0x3451c6fd36] -> /usr/lib64/dovecot/lib10_quota_plugin.so [0x2ba2d2f4d0ba] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5a) [0x3451c301ba] -> /usr/lib64/dovecot/li 11:21:07 [err] dovecot: master: Error: service(lmtp): child 29691 killed with signal 6 (core dumps disabled) --------------------- Attached is the current "doveadm config" output. -- Brad Schuetz -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: dovecot.config URL: From hsehic at econtec.de Fri Dec 9 23:52:40 2011 From: hsehic at econtec.de (Sehic, Haris) Date: Fri, 9 Dec 2011 22:52:40 +0100 (CET) Subject: [Dovecot] Per-User MySQL Quota (postfixadmin) In-Reply-To: References: <30505072.4022.1323384713873.JavaMail.open-xchange@mail02.econtec.de> Message-ID: <11181131.4211.1323467560596.JavaMail.open-xchange@mail02.econtec.de> Hi Maciej, ? thanks for the hint! ? http://wiki2.dovecot.org/UserDatabase/Prefetch ? did the trick!? ? Greets ? Haris? ? ? Maciej Przybecki hat am 9. Dezember 2011 um 06:52 geschrieben: > I faced the same problem and digged for 2 days with no luck. It occurred, that > I have userdb { ...} section defined as static values, so user_query has never > been queried :-). > So you must check your userdb section of your config. > -Maciej > > > Wys?ane z iPhone'a > > Dnia 8 gru 2011 o godz. 23:51 "Sehic, Haris" napisa?(a): > > > Hi, > >? > > need some help setting per-user quota and postfixadmin. Setup is working on > > 1.2 > > dovecot. Tryin 2.1 dovecot now,? quota is working but overriden quota rule > > set > > by 'user_query =' in /etc/dovecot/dovecot-sql.conf.ext takes no efffekt. > > What's > > wrong here? > >? > > Greets > >? > > Haris > > > > > > > -- Haris Sehic, Econtec GmbH Office Phone: +49 9129 29419-36 Office Fax:? ? ? ? ? ? ? ? ?-99 ----------------------------------------------------------------------------- Econtec GmbH Nibelungenstrasse 5 90530 Wendelstein Germany Tel.: 0049 - 9129 - 29 419 0 Fax : 0049 - 9129 - 29 419 99 e-mail: info at econtec.de Gesch?ftsf?hrer Herr Roland Borst HRB 15208, N?rnberg UID-Nr. : DE190650537 Steuer-Nr.: 241/125/20496 From brad at omnis.com Sat Dec 10 02:12:30 2011 From: brad at omnis.com (Brad Schuetz) Date: Fri, 09 Dec 2011 16:12:30 -0800 Subject: [Dovecot] Major bug with hardlinks and lmtp Message-ID: <4EE2A3EE.6060503@omnis.com> In working on trying to fix the crash issue from my last email I had enabled LMTP delivery to try it out instead of using the LDA. I have discovered that when a single piece of email is to be delivered to multiple users the message is being hard linked instead of copied into each mail box. This is a major problem that makes LMTP unusable in an environment where each mailbox has it's own UID since the hard linked file will only be readable by one of the users. I assume this is related to "maildir_copy_with_hardlinks=yes", however this setting doesn't say anything about hardlinking across different email accounts. -- Brad Schuetz From user+dovecot at localhost.localdomain.org Sat Dec 10 05:35:56 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 10 Dec 2011 04:35:56 +0100 Subject: [Dovecot] 2.1.rc1 (8a63f621bd2e): SiS permission issue + crash Message-ID: <4EE2D39C.2030106@localhost.localdomain.org> Since changeset 8a63f621bd2e I'm one step closer to the perfect working setup. I'm sharing one GID per domain, all it's alias names and accounts. So I can use: mail_attachment_dir = /srv/mail/.SiS/%{gid} In order to avoid permission trouble I've set fs ACL on the .SiS dir: ,--[ getfacl srv/mail/.SiS ]-- | # file: srv/mail/.SiS | # owner: root | # group: root | user::rwx | group::--x | mask::--x | other::-wx | default:user::rwx | default:group::rwx | default:mask::rwx | default:other::--- `-- OK, lets test the setup: dsync -u test-0 at example.com mirror maildir:/tmp/Maildir rm -rf Maildir && cp -a Maildir_org Maildir && chown -R 70010:70002 Maildir dsync -vu test-1 at example.com mirror maildir:/tmp/Maildir dsync(test-1 at example.com): Info: Drafts: only in dest (guid=b6a53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Info: Sent: only in dest (guid=b7a53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Info: Junk-E-Mail: only in dest (guid=b8a53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Info: Trash: only in dest (guid=b9a53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Info: INBOX: only in dest (guid=baa53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Error: stat(/srv/mail/.SiS/70002/a2/7b/.temp.blau.819.4f06409857c627e0) failed: Permission denied dsync(test-1 at example.com): Error: safe_mkstemp(/srv/mail/.SiS/70002/a2/7b/.temp.blau.819.) failed: Permission denied dsync(test-1 at example.com): Panic: file dsync-worker-local.c: line 1644 (local_worker_save_msg_continue): assertion failed: (ret == -1) dsync(test-1 at example.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x4faf1) [0x7f4db31f4af1] -> /usr/local/lib/dovecot/libdovecot.so.0(default_error_handler+0) [0x7f4db31f4b7d] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4db31f4e01] -> dsync() [0x416af8] -> dsync() [0x416e46] -> dsync(dsync_worker_msg_save+0x82) [0x412cb2] -> dsync() [0x40b7e0] -> dsync() [0x417286] -> dsync() [0x417324] -> dsync(dsync_worker_msg_get+0xa8) [0x412dd4] -> dsync() [0x40bbf3] -> dsync() [0x40bd62] -> dsync() [0x40c106] -> dsync() [0x40c318] -> dsync(dsync_brain_msg_sync_new_msgs+0x1c) [0x40c336] -> dsync(dsync_brain_msg_sync_more+0x1ae) [0x40b15e] -> dsync() [0x409b88] -> dsync(dsync_brain_sync+0x231) [0x40a074] -> dsync() [0x4084fb] -> dsync() [0x408729] -> dsync(dsync_brain_sync+0x1a7) [0x409fea] -> dsync() [0x408238] -> dsync() [0x408388] -> dsync(dsync_brain_sync+0x10b) [0x409f4e] -> dsync(dsync_brain_sync_all+0x24) [0x40a16b] -> dsync(main+0x680) [0x407b2b ] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f4db2e3fead] -> dsync() [0x406e09] Aborted (core dumped) Looks like Dovecot ignores the ACL. I think a mail_attachment_dir_mode setting could help to work around this problem. Dunno what would be a good default value. But I would set mail_attachment_dir_mode = 0770 The attachment files have mode 0660, that's perfect in my setup. Regards, Pascal -- The trapper recommends today: c01dcafe.1134404 at localdomain.org -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: doveconf.txt URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: dsync_bt.txt URL: From tss at iki.fi Sat Dec 10 07:08:28 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 07:08:28 +0200 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <1323335981.15365.90.camel@hurina> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> <1323335981.15365.90.camel@hurina> Message-ID: <1323493708.15365.103.camel@hurina> On Thu, 2011-12-08 at 11:19 +0200, Timo Sirainen wrote: > On Thu, 2011-12-08 at 09:55 +0100, Mike Constabel wrote: > > > As you see there is a second "-" in the name: > > > > "T&APw-r" != "T&-APw-r" > > Oh, right, it's broken in the "fs" layout. With "maildir++" layout it > works. And looks like this isn't going to be an easy fix. The fs layout > listing code is horrible.. Maybe I'll just try rewriting it. OK, this should do it, hopefully without breaking anything: http://hg.dovecot.org/dovecot-2.1/rev/ab696ead12cc From tss at iki.fi Sat Dec 10 07:11:34 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 07:11:34 +0200 Subject: [Dovecot] Major bug with hardlinks and lmtp In-Reply-To: <4EE2A3EE.6060503@omnis.com> References: <4EE2A3EE.6060503@omnis.com> Message-ID: <1323493894.15365.105.camel@hurina> On Fri, 2011-12-09 at 16:12 -0800, Brad Schuetz wrote: > I have discovered that when a single piece of email is to be delivered > to multiple users the message is being hard linked instead of copied > into each mail box. This is a major problem that makes LMTP unusable in > an environment where each mailbox has it's own UID since the hard linked > file will only be readable by one of the users. This happens only if the users share the same GID. I already fixed this, but since it's a rather large change it's only in v2.1. From tss at iki.fi Sat Dec 10 07:13:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 07:13:06 +0200 Subject: [Dovecot] Make entire mailbox read-only (ACLs?) In-Reply-To: <4EE25E83.1090700@vitalwerks.com> References: <4EE25E83.1090700@vitalwerks.com> Message-ID: <1323493986.15365.107.camel@hurina> On Fri, 2011-12-09 at 11:16 -0800, David Jonas wrote: > Is there a way of locking a mailbox, effectively making it read-only to > IMAP clients? By "mailbox" you mean the user's all folders? This isn't possible currently, except by modifying filesystem permissions. A "default ACL for entire namespace" would be a nice feature, but it's just not done yet.. From tss at iki.fi Sat Dec 10 07:58:16 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 07:58:16 +0200 Subject: [Dovecot] Two recent issues In-Reply-To: <4EE26BDF.4080500@omnis.com> References: <4EE26BDF.4080500@omnis.com> Message-ID: <1323496696.15365.124.camel@hurina> On Fri, 2011-12-09 at 12:13 -0800, Brad Schuetz wrote: > I've been using dovecot for years, been working great. However recently > I've come across two issues. > > The first issue unfortunately I have little information on, mail_debug > hasn't provided anything useful either (in fact it looks like the login > request that fails doesn't even get logged at all). The *_debug settings aren't very helpful in debugging random failures. > During the morning rush of email, this server has around 11k mailboxes > on it, it *appears* that one of the auth processes dies resulting in > "dovecot: imap-login: Error: read(imap) failed: Connection reset by > peer" errors followed by "dovecot: imap-login: Internal login failure > ..." in the logs. If auth process dies unexpectedly, master always logs an error, such as: Dec 10 07:15:34 auth: Fatal: master: service(auth): child 27895 killed with signal 11 (core dumped) Anyway, "read(imap) failed: Connection reset by peer" can happen if you reach the service imap { process_limit }. But then there should be a warning logged about it also: Dec 10 07:17:39 master: Warning: service(imap): process_limit reached, client connections are being dropped So, that error message alone shouldn't be happening.. > The best I've gotten was a lucky strace once (at the time I didn't > realize it was so lucky or I would have saved the output) that indicated > the imap-login daemon was failing to connect to the auth process. If that happens, there would also be an error message logged about it. One thing that v2.0 doesn't log about is if auth socket gets disconnected, but that would result in different problems. v2.1 logs about that too. > The second issue is lmtp/lda (tried both) delivery to a mailbox that has > filesystem quotas enabled and the group quota is maxed is resulting in > the below panic and crash. > > 11:21:07 [err] dovecot: lmtp(29691, admin@[redacted].com): Error: > o_stream_send_istream(/email/d/r/[redacted]/[redacted]/admin/Maildir/tmp/1323458467.M245978P29691.fenrir.omnis.com) > failed: Disk quota exceeded > 11:21:07 [crit] dovecot: lmtp(29691, admin@[redacted].com): Panic: file > ostream-zlib.c: line 144 (o_stream_zlib_send_flush): assertion failed: > (zs->avail_in == 0) I couldn't reproduce this with my tests, but http://hg.dovecot.org/dovecot-2.0/rev/75daa638281b should fix it. From djonas at vitalwerks.com Sat Dec 10 08:00:04 2011 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 09 Dec 2011 22:00:04 -0800 Subject: [Dovecot] Make entire mailbox read-only (ACLs?) In-Reply-To: <1323493986.15365.107.camel@hurina> References: <4EE25E83.1090700@vitalwerks.com> <1323493986.15365.107.camel@hurina> Message-ID: <4EE2F564.9090405@vitalwerks.com> On 12/9/11 9:13 PM, Timo Sirainen wrote: > On Fri, 2011-12-09 at 11:16 -0800, David Jonas wrote: > >> Is there a way of locking a mailbox, effectively making it read-only to >> IMAP clients? > By "mailbox" you mean the user's all folders? This isn't possible > currently, except by modifying filesystem permissions. A "default ACL > for entire namespace" would be a nice feature, but it's just not done > yet.. Looks like changing the filesystem permissions gets me what I'm looking for. I simply removed write permissions for {cur,tmp,new}. Mailbox access seems to work just fine. Thunderbird shows the server responding with "SERVERBUG" and I get a "Permission denied" error in the logs, though. Not a big deal, the users will be notified before hand. Thanks! From tss at iki.fi Sat Dec 10 08:03:25 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 08:03:25 +0200 Subject: [Dovecot] Make entire mailbox read-only (ACLs?) In-Reply-To: <4EE2F564.9090405@vitalwerks.com> References: <4EE25E83.1090700@vitalwerks.com> <1323493986.15365.107.camel@hurina> <4EE2F564.9090405@vitalwerks.com> Message-ID: <1323497005.15365.126.camel@hurina> On Fri, 2011-12-09 at 22:00 -0800, David Jonas wrote: > On 12/9/11 9:13 PM, Timo Sirainen wrote: > > On Fri, 2011-12-09 at 11:16 -0800, David Jonas wrote: > > > >> Is there a way of locking a mailbox, effectively making it read-only to > >> IMAP clients? > > By "mailbox" you mean the user's all folders? This isn't possible > > currently, except by modifying filesystem permissions. A "default ACL > > for entire namespace" would be a nice feature, but it's just not done > > yet.. > Looks like changing the filesystem permissions gets me what I'm looking > for. I simply removed write permissions for {cur,tmp,new}. Mailbox > access seems to work just fine. Thunderbird shows the server responding > with "SERVERBUG" and I get a "Permission denied" error in the logs, > though. Not a big deal, the users will be notified before hand. Thanks! If you remove the write permissions also from the parent Maildir (or possibly some other files too), it shouldn't send SERVERBUG. From tss at iki.fi Sat Dec 10 08:17:27 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 08:17:27 +0200 Subject: [Dovecot] 2.1.rc1 (8a63f621bd2e): SiS permission issue + crash In-Reply-To: <4EE2D39C.2030106@localhost.localdomain.org> References: <4EE2D39C.2030106@localhost.localdomain.org> Message-ID: <1323497848.15365.128.camel@hurina> On Sat, 2011-12-10 at 04:35 +0100, Pascal Volk wrote: > dsync(test-1 at example.com): Panic: file dsync-worker-local.c: line 1644 (local_worker_save_msg_continue): assertion failed: (ret == -1) I'll see about this crash later.. > Looks like Dovecot ignores the ACL. I think a mail_attachment_dir_mode > setting could help to work around this problem. Dunno what would be a > good default value. But I would set mail_attachment_dir_mode = 0770 > The attachment files have mode 0660, that's perfect in my setup. With http://hg.dovecot.org/dovecot-2.1/rev/fcceee891448 you can do: mail_attachment_fs = sis posix:mode=0660 The dirs get created with 0770 then. From tss at iki.fi Sat Dec 10 08:27:02 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 08:27:02 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> Message-ID: <1323498422.15365.129.camel@hurina> On Thu, 2011-12-08 at 16:10 +0000, Mark Zealey wrote: > By the way, another bug I noticed with dsync is that when converting from Maildir to sdbox is that the date.saved field is not preserved - it's just the time when the first dsync command happened. Presumably it should be the mtime of the Maildir message file With Maildir the date.saved is taken from the mail file's ctime (yes, it's not perfect, but it's good enough for what it's used for). It's preserved in my tests. From tss at iki.fi Sat Dec 10 08:28:27 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 08:28:27 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> Message-ID: <1323498507.15365.130.camel@hurina> On Thu, 2011-12-08 at 14:45 +0000, Mark Zealey wrote: > With 2.0.16 hdr.xxx fields get copied fine (but of course without timestamp). With the patch you provided they don't get copied whether using mirror or backup & starting from scratch. I'm doing a Maildir to sdbox migration otherwise don't think I'm doing anytihng strange. Show the whole list of cache decisions in source and destination? From tss at iki.fi Sat Dec 10 11:16:09 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 11:16:09 +0200 Subject: [Dovecot] lmtp panic in proxy lmtp director In-Reply-To: <4EDCD4AE.8030607@uib.es> References: <4EDCD4AE.8030607@uib.es> Message-ID: <1323508572.15365.141.camel@hurina> On Mon, 2011-12-05 at 15:26 +0100, Xavier Pons wrote: > Hi, we are getting some core dumps with signal 6 in ltmp on a dovecot > director proxy server, > like this: > > Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Panic: file lmtp-proxy.c: > line 376 (lmtp_proxy_output_timeout): assertion failed: > (proxy->data_input->eof) I think the way I originally planned LMTP proxying to work is simply too complex to work reliably, perhaps even if the code was bug-free. So instead of reading+writing DATA at the same time, this patch changes the DATA to be first read into memory or temp file, and then from there read and sent to the LMTP backends: http://hg.dovecot.org/dovecot-2.1/raw-rev/51d87deb5c26 The patch applies on top of v2.0 also. I tested that it appears to work, but more testing wouldn't hurt to make sure it won't corrupt large mails when sending them to multiple backends (one mail with multiple RCPT TOs sent to multiple different backends).. From tss at iki.fi Sat Dec 10 11:35:23 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 11:35:23 +0200 Subject: [Dovecot] overriding userdb connection host for doveadm-user In-Reply-To: <87r50f17y1.fsf@algae.riseup.net> References: <87aa742rbo.fsf@algae.riseup.net> <1323318179.15365.62.camel@hurina> <87r50f17y1.fsf@algae.riseup.net> Message-ID: <1323509723.15365.156.camel@hurina> On Thu, 2011-12-08 at 08:58 -0500, micah anderson wrote: > On Thu, 08 Dec 2011 06:22:58 +0200, Timo Sirainen wrote: > > On Wed, 2011-12-07 at 13:02 -0500, Micah Anderson wrote: > > > I've got my users in a replicated database setup and dovecot configured > > > with two connect lines in dovecot-sql.conf: > > > > > > connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass > > > connect = host=127.0.0.2 port=3306 dbname=users user=user password=pass > > > > > > this works really well to help balance the load. > > > > If you actually have it like that, it should only be using 127.0.0.2, as > > the second connect setting overrides the first one.. > > What I actually have is: > > connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass > connect = host=127.0.0.1 port=3307 dbname=users user=user password=pass > > two different port configurations (I'm running stunnel), rather than two > different host entries[0]. The only port Dovecot should be connecting with the above config is 3307. > >The right way would have been: > > > > connect = host=127.0.0.1 host=127.0.0.2 port=... > > So, if I just have two different ports, would the right way be: > > connect = host=127.0.0.1 port=3306 port=3307 dbname... > > ? There's actually no way to load balance between multiple ports. If there were, the config would probably have to be changed to something like host=127.0.0.1:3306 host=127.0.0.1:3307, because otherwise it would be confusing what should happen when there are multiple hosts and multiple ports. Anyway, maybe you could use multiple IPs instead of multiple ports? "host=127.0.0.1 host=127.0.0.2". From tss at iki.fi Sat Dec 10 11:41:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 11:41:19 +0200 Subject: [Dovecot] noaclright In-Reply-To: <4EE09D70.3080909@graband.de> References: <4EE09D70.3080909@graband.de> Message-ID: <1323510081.15365.159.camel@hurina> On Thu, 2011-12-08 at 12:20 +0100, Knud Dombrowsky wrote: > Hi, > I recently upgraded to openSuse 12.1 which comes with dovecot 2.0.14. What was the old Dovecot version? > Dec 7 14:31:14 mailbox dovecot: imap(): Error: > fstat(/home//Maildir/./dovecot-acl.lock) > failed: No such file or directory This should never happen. fstat() simply cannot fail with ENOENT. It's a kernel bug (or "feature") if it does. What filesystem do you use? Do you have SELinux/apparmor enabled? BTW. There's "doveadm acl" command that may be helpful to you. From tss at iki.fi Sat Dec 10 11:52:24 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 11:52:24 +0200 Subject: [Dovecot] POP - preventing re-download with server move In-Reply-To: <710C58696EA3BC42B425E4DBB39C1D5E48552AAE@MAIL-MBX2.ad.csbsju.edu> References: <710C58696EA3BC42B425E4DBB39C1D5E48552AAE@MAIL-MBX2.ad.csbsju.edu> Message-ID: <1323510745.15365.161.camel@hurina> On Thu, 2011-11-24 at 14:46 +0000, Trutwin, Joshua wrote: > So now I have to move my sites to a new server and I'm trying to > avoid having all these messages re-downloaded by POP clients. http://wiki2.dovecot.org/Migration#POP3_migration explains this. > The mail is stored in Maildirs - a sample file: 1280409166.23580.foo:2,S > > If I move this to server "bar" would renaming the file to > 1280409166.23580.bar:2,S prevent this somehow? That can only make things worse. From nick.z.edwards at gmail.com Sat Dec 10 12:07:48 2011 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Sat, 10 Dec 2011 20:07:48 +1000 Subject: [Dovecot] database failover Message-ID: Trying to get dovecot to _only_ use local copy of database, only querying another database server (same database, just replicated) if local copy is not responding, I have google fu'd a bit and found my only answer in so far as dovecot did this once upon as time, but it was only due to a dovecot bug, that has since been fixed, is that so? The wiki shows no information of failover, just load sharing, or is it an undocumented feature, or can dovecot not do failover, if not, can it be made so? Trying to cut down on network traffic, postfix does this nicely, I thought dovecot did too. From robert at schetterer.org Sat Dec 10 12:18:52 2011 From: robert at schetterer.org (Robert Schetterer) Date: Sat, 10 Dec 2011 11:18:52 +0100 Subject: [Dovecot] database failover In-Reply-To: References: Message-ID: <4EE3320C.2050607@schetterer.org> Am 10.12.2011 11:07, schrieb Nick Edwards: > Trying to get dovecot to _only_ use local copy of database, only querying > another database server (same database, just replicated) if local copy is > not responding, I have google fu'd a bit and found my only answer in so far > as dovecot did this once upon as time, but it was only due to a dovecot > bug, that has since been fixed, is that so? > The wiki shows no information of failover, just load sharing, or is it an > undocumented feature, or can dovecot not do failover, if not, can it be > made so? > > Trying to cut down on network traffic, postfix does this nicely, I thought > dovecot did too. > as far i know recent dovecot cant do it youre right postfix does you can do a master-master setup i.e with mysql solving this works nice here, but might not be the best solution perhaps ldap, or other databases are better -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From tss at iki.fi Sat Dec 10 12:26:09 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 12:26:09 +0200 Subject: [Dovecot] database failover In-Reply-To: References: Message-ID: <994B8A50-1BF9-47D3-8DB1-2E150E975E05@iki.fi> On 10.12.2011, at 12.07, Nick Edwards wrote: > Trying to get dovecot to _only_ use local copy of database, only querying > another database server (same database, just replicated) if local copy is > not responding, I have google fu'd a bit and found my only answer in so far > as dovecot did this once upon as time, but it was only due to a dovecot > bug, that has since been fixed, is that so? > The wiki shows no information of failover, just load sharing, or is it an > undocumented feature, or can dovecot not do failover, if not, can it be > made so? > > Trying to cut down on network traffic, postfix does this nicely, I thought > dovecot did too. You could add two passdbs + userdbs with different configs. The second dbs would be used when first db is down, but also for unknown users / wrong authentications. But yeah, the load balancing should be optional. There are just so many other things to do as well.. From mark.zealey at webfusion.com Sat Dec 10 12:55:28 2011 From: mark.zealey at webfusion.com (Mark Zealey) Date: Sat, 10 Dec 2011 12:55:28 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323498422.15365.129.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> <1323498422.15365.129.camel@hurina> Message-ID: <4EE33AA0.7050807@webfusion.com> 10-12-2011 08:27, Timo Sirainen yazm??: > On Thu, 2011-12-08 at 16:10 +0000, Mark Zealey wrote: >> By the way, another bug I noticed with dsync is that when converting from Maildir to sdbox is that the date.saved field is not preserved - it's just the time when the first dsync command happened. Presumably it should be the mtime of the Maildir message file > With Maildir the date.saved is taken from the mail file's ctime (yes, > it's not perfect, but it's good enough for what it's used for). It's > preserved in my tests. It could well be because of the conversion to sdbox then - the ctime/mtime of the files are not being preserved by dsync (in stock 2.0.16). The date.saved timestamp is only put into the cache on the second dsync run; presumably therefore it picks it up from the filesystem. Mark From mark.zealey at webfusion.com Sat Dec 10 13:03:42 2011 From: mark.zealey at webfusion.com (Mark Zealey) Date: Sat, 10 Dec 2011 13:03:42 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323498507.15365.130.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> <1323498507.15365.130.camel@hurina> Message-ID: <4EE33C8E.9050005@webfusion.com> 10-12-2011 08:28, Timo Sirainen yazm??: > On Thu, 2011-12-08 at 14:45 +0000, Mark Zealey wrote: >> With 2.0.16 hdr.xxx fields get copied fine (but of course without timestamp). With the patch you provided they don't get copied whether using mirror or backup& starting from scratch. I'm doing a Maildir to sdbox migration otherwise don't think I'm doing anytihng strange. > Show the whole list of cache decisions in source and destination? Ah-ha it's doing the same in 2.0.16 - looking deeper it's because i havn't accessed the tmp fields in a week or two so I guess the decision has been taken not to migrate them. Mark From tss at iki.fi Sat Dec 10 13:07:08 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 13:07:08 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <4EE33C8E.9050005@webfusion.com> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> <1323498507.15365.130.camel@hurina> <4EE33C8E.9050005@webfusion.com> Message-ID: On 10.12.2011, at 13.03, Mark Zealey wrote: > Ah-ha it's doing the same in 2.0.16 - looking deeper it's because i havn't accessed the tmp fields in a week or two so I guess the decision has been taken not to migrate them. Yes, most likely the reason. Could this also explain the date.saved? > It could well be because of the conversion to sdbox then - the ctime/mtime of the files are not being preserved by dsync (in stock 2.0.16). The date.saved timestamp is only put into the cache on the second dsync run; presumably therefore it picks it up from the filesystem. With sdbox the file's mtime isn't even tried to be preserved. The received-time and saved-time are written to the metadata block inside the file. From mark.zealey at webfusion.com Sat Dec 10 13:32:23 2011 From: mark.zealey at webfusion.com (Mark Zealey) Date: Sat, 10 Dec 2011 13:32:23 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> <1323498507.15365.130.camel@hurina> <4EE33C8E.9050005@webfusion.com> Message-ID: <4EE34347.7040007@webfusion.com> 10-12-2011 13:07, Timo Sirainen yazm??: >> It could well be because of the conversion to sdbox then - the ctime/mtime of the files are not being preserved by dsync (in stock 2.0.16). The date.saved timestamp is only put into the cache on the second dsync run; presumably therefore it picks it up from the filesystem. > With sdbox the file's mtime isn't even tried to be preserved. The received-time and saved-time are written to the metadata block inside the file. Ah yes; I saw the R metadata but not the C header key. Looking deeper at this I think I was expecting the date.save time to be about the same as the date.receive; however the ctime for these files is quite recent presumably affected by setting of message flags in a maildir or something (we're using nfs). The source cache says: - date.received: 1301978447 (4f9d9a4d) - date.save: 1322465550 (0e39d34e) The message file itself has mtime 1301978447 and ctime 1323514077; and in the sdbox header/metadata we have: C4ee3391a R4d9a9d4f so ctime/sdbox C entry are close enough by my calculations (not sure where the 61 seconds of difference comes from though). It is a bit strange you wouldn't use the source cache's value for date.save if it is available as ctime can be pretty unreliable? Mark From tss at iki.fi Sat Dec 10 14:13:57 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 14:13:57 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <4EE34347.7040007@webfusion.com> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> <1323498507.15365.130.camel@hurina> <4EE33C8E.9050005@webfusion.com> <4EE34347.7040007@webfusion.com> Message-ID: <8A79B07C-80A5-4535-BD0A-58BB0D7D4A36@iki.fi> On 10.12.2011, at 13.32, Mark Zealey wrote: > 10-12-2011 13:07, Timo Sirainen yazm??: >>> It could well be because of the conversion to sdbox then - the ctime/mtime of the files are not being preserved by dsync (in stock 2.0.16). The date.saved timestamp is only put into the cache on the second dsync run; presumably therefore it picks it up from the filesystem. >> With sdbox the file's mtime isn't even tried to be preserved. The received-time and saved-time are written to the metadata block inside the file. > > Ah yes; I saw the R metadata but not the C header key. The C is the file's create time. It's not actually use for anything. > Looking deeper at this I think I was expecting the date.save time to be about the same as the date.receive; however the ctime for these files is quite recent presumably affected by setting of message flags in a maildir or something (we're using nfs). Yes, maildir flag changes change the ctime, which also changes the save date if it's not already cached. > so ctime/sdbox C entry are close enough by my calculations (not sure where the 61 seconds of difference comes from though). It is a bit strange you wouldn't use the source cache's value for date.save if it is available as ctime can be pretty unreliable? It is using the the cached value. Anyway, I remembered wrong how sdbox's save date is looked up. It's taken from the sdbox file's ctime. The reason is similar to maildir: The save date is used mainly to figure out when to automatically expunge messages from Trash after it's been there for n days. So if you copy 1 year old message to Trash, you don't want it expunged immediately (based on mtime or some metadata inside the file), you want it expunged n days since the move. And ctime is really the only nice way to do it automatically, because copying a message with sdbox is done with hard linking. mdbox stores the save date in the index file. sdbox could do it too, but that's just extra work and probably not worth the trouble. And unlink atime/mtime, ctime can't be changed using any syscalls (except to current time). So, I think everything here works as intended, although not really as expected. :) From listen at constabel.net Sat Dec 10 16:10:31 2011 From: listen at constabel.net (Mike Constabel) Date: Sat, 10 Dec 2011 15:10:31 +0100 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <1323493708.15365.103.camel@hurina> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> <1323335981.15365.90.camel@hurina> <1323493708.15365.103.camel@hurina> Message-ID: <20111210141031.GL22136@herakles.constabel-it.de> Hi, Timo Sirainen schrieb am Saturday, den 10. December 2011: > On Thu, 2011-12-08 at 11:19 +0200, Timo Sirainen wrote: > > On Thu, 2011-12-08 at 09:55 +0100, Mike Constabel wrote: > > > > > As you see there is a second "-" in the name: > > > > > > "T&APw-r" != "T&-APw-r" > > > > Oh, right, it's broken in the "fs" layout. With "maildir++" layout it > > works. And looks like this isn't going to be an easy fix. The fs layout > > listing code is horrible.. Maybe I'll just try rewriting it. > > OK, this should do it, hopefully without breaking anything: > http://hg.dovecot.org/dovecot-2.1/rev/ab696ead12cc > This works for me with a litte problem. If I create in TB folder like "moe" (without special chars) the folder will be created, subscribed and TB shows the folder instantly. But if I create a folder like "m?" (with special chars) the folder will be created, subscribed and *TB doesn't show the folder*. I must unsubscribe and subscribe it in TB to show it in folder pane. Mike From user+dovecot at localhost.localdomain.org Sat Dec 10 17:39:26 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 10 Dec 2011 16:39:26 +0100 Subject: [Dovecot] 2.1.rc1 (51d87deb5c26): %{gid} modification problem Message-ID: <4EE37D2E.9020700@localhost.localdomain.org> I tried to apply the X modifier to the %{gid} variable: 'mail_attachment_dir = /srv/mail/.SiS/%X{gid}'. But the name of the created directory is '0', instead of '11172'. Regards, Pascal -- The trapper recommends today: c01dcofe.1134416 at localdomain.org From user+dovecot at localhost.localdomain.org Sat Dec 10 18:09:07 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 10 Dec 2011 17:09:07 +0100 Subject: [Dovecot] 2.1.rc1 (51d87deb5c26): %{gid} modification problem In-Reply-To: <4EE37D2E.9020700@localhost.localdomain.org> References: <4EE37D2E.9020700@localhost.localdomain.org> Message-ID: <4EE38423.3010604@localhost.localdomain.org> On 12/10/2011 04:39 PM Pascal Volk wrote: > But the name of the created directory is '0', instead of '11172'. 0 was the hex version of a empty string. For now I've reverted changeset 499e4916bed5. This brings the content of %{gid} back and %X{gid} works now as expected. Regards, Pascal -- The trapper recommends today: beeffeed.1134417 at localdomain.org From user+dovecot at localhost.localdomain.org Sat Dec 10 18:46:31 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 10 Dec 2011 17:46:31 +0100 Subject: [Dovecot] 2.1.rc1 (51d87deb5c26): %{gid} modification problem In-Reply-To: <4EE38423.3010604@localhost.localdomain.org> References: <4EE37D2E.9020700@localhost.localdomain.org> <4EE38423.3010604@localhost.localdomain.org> Message-ID: <4EE38CE7.8010405@localhost.localdomain.org> On 12/10/2011 05:09 PM Pascal Volk wrote: > ? For now I've reverted changeset 499e4916bed5. OK, I found the problem. You forgot to append the GID to the var_expand_table before returning it. The attached patch works fine for me. It also adds the short variable %g. I hope that's OK. Regards, Pascal -- The trapper recommends today: beeffeed.1134417 at localdomain.org -------------- next part -------------- A non-text attachment was scrubbed... Name: lib-storage.patch Type: text/x-patch Size: 1590 bytes Desc: not available URL: From dieterknopf at googlemail.com Mon Dec 12 02:42:48 2011 From: dieterknopf at googlemail.com (Dieter Knopf) Date: Mon, 12 Dec 2011 01:42:48 +0100 Subject: [Dovecot] Refiltering mails without loosing flags Message-ID: Hello, is there a way to refilter all mails in a folder without loosing all flags and moving all messages in a different folder? I have >10k mails in my Inbox and need to create new filterrules from time to time. But there is no way to refilter my inbox without moving. Atm i need to move all mails in a folder like "refilter" and then run getmail/... to refilter the mails. It would be really nice to refilter a existing folder and just move mails with hits in the filter list. Thanks Dieter From tss at iki.fi Mon Dec 12 06:39:38 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 06:39:38 +0200 Subject: [Dovecot] 2.1.rc1 (51d87deb5c26): %{gid} modification problem In-Reply-To: <4EE38CE7.8010405@localhost.localdomain.org> References: <4EE37D2E.9020700@localhost.localdomain.org> <4EE38423.3010604@localhost.localdomain.org> <4EE38CE7.8010405@localhost.localdomain.org> Message-ID: <1323664781.15365.174.camel@hurina> On Sat, 2011-12-10 at 17:46 +0100, Pascal Volk wrote: > On 12/10/2011 05:09 PM Pascal Volk wrote: > > ? For now I've reverted changeset 499e4916bed5. > > OK, I found the problem. You forgot to append the GID to the > var_expand_table before returning it. The attached patch works fine for me. Yes, fixed that :) > It also adds the short variable %g. I hope that's OK. I think %{gid} is used so rarely that it doesn't really need a short variable. It probably would be better in future to avoid short variables entirely in most places. I also did larger changes to mail-storage-service.c so that in situations when %var expansion is done while running as root, the uid/gid expand properly instead of expanding to 0. This probably happens with some doveadm -A commands or something.. From tss at iki.fi Mon Dec 12 06:53:49 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 06:53:49 +0200 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <20111210141031.GL22136@herakles.constabel-it.de> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> <1323335981.15365.90.camel@hurina> <1323493708.15365.103.camel@hurina> <20111210141031.GL22136@herakles.constabel-it.de> Message-ID: <1323665629.15365.176.camel@hurina> On Sat, 2011-12-10 at 15:10 +0100, Mike Constabel wrote: > > OK, this should do it, hopefully without breaking anything: > > http://hg.dovecot.org/dovecot-2.1/rev/ab696ead12cc > > > > This works for me with a litte problem. > > > If I create in TB folder like "moe" (without special chars) the > folder will be created, subscribed and TB shows the folder > instantly. > > But if I create a folder like "m?" (with special chars) the > folder will be created, subscribed and *TB doesn't show the > folder*. I must unsubscribe and subscribe it in TB to show it in > folder pane. http://hg.dovecot.org/dovecot-2.1/rev/b9fcac239aed should fix it. From listen at constabel.net Mon Dec 12 10:41:04 2011 From: listen at constabel.net (Mike Constabel) Date: Mon, 12 Dec 2011 09:41:04 +0100 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <1323665629.15365.176.camel@hurina> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> <1323335981.15365.90.camel@hurina> <1323493708.15365.103.camel@hurina> <20111210141031.GL22136@herakles.constabel-it.de> <1323665629.15365.176.camel@hurina> Message-ID: <20111212084103.GB6838@herakles.constabel-it.de> On Mon, 12 Dec 2011, Timo Sirainen wrote: > On Sat, 2011-12-10 at 15:10 +0100, Mike Constabel wrote: > > > OK, this should do it, hopefully without breaking anything: > > > http://hg.dovecot.org/dovecot-2.1/rev/ab696ead12cc > > > > > > > This works for me with a litte problem. > > > > > > If I create in TB folder like "moe" (without special chars) the > > folder will be created, subscribed and TB shows the folder > > instantly. > > > > But if I create a folder like "m?" (with special chars) the > > folder will be created, subscribed and *TB doesn't show the > > folder*. I must unsubscribe and subscribe it in TB to show it in > > folder pane. > > http://hg.dovecot.org/dovecot-2.1/rev/b9fcac239aed should fix it. > Yes, it works. Thanks. Mike From listen at constabel.net Mon Dec 12 11:46:15 2011 From: listen at constabel.net (Mike Constabel) Date: Mon, 12 Dec 2011 10:46:15 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts Message-ID: <20111212094615.GD6838@herakles.constabel-it.de> Hi, now the umlauts problem with sieve: # cat /mailspool1/in-preetz.de/test1/.dovecot.sieve ## Generated by Roundcube Webmail SieveRules Plugin ## require ["fileinto"]; # rule:[Test] if anyof (header :contains "Subject" "test") { fileinto "m&APY-"; } Error: DBBjDsXL5U7mIAAA/TNBsA: sieve: execution of script /mailspool1/in-preetz.de/test1/.dovecot.sieve failed, but implicit keep was successful (user logfile /mailspool1/in-preetz.de/test1/.dovecot.sieve.log may reveal additional details) # cat /mailspool1/in-preetz.de/test1/.dovecot.sieve.log sieve: info: started log at Dec 12 10:40:04. error: msgid=<20111212094004.DB86918594 at mx4.constabel-it.de>: failed to store into mailbox 'm&APY-': Mailbox doesn't exist: m&-APY-. Here the same: 'm&APY-' != "m&-APY-" Mike From tss at iki.fi Mon Dec 12 11:58:51 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 11:58:51 +0200 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <20111212094615.GD6838@herakles.constabel-it.de> References: <20111212094615.GD6838@herakles.constabel-it.de> Message-ID: <10C93BD1-CE99-423E-BB13-3DD5C28A83E7@iki.fi> On 12.12.2011, at 11.46, Mike Constabel wrote: > now the umlauts problem with sieve: .. > ## Generated by Roundcube Webmail SieveRules Plugin ## Roundcube bug/"feature". > fileinto "m&APY-"; Sieve uses UTF-8 mailbox names. The reason why Roundcube doesn't use them, is because some old Cyrus Sieve versions didn't use UTF-8. From stephan at rename-it.nl Mon Dec 12 12:00:23 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 12 Dec 2011 11:00:23 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <20111212094615.GD6838@herakles.constabel-it.de> References: <20111212094615.GD6838@herakles.constabel-it.de> Message-ID: <4EE5D0B7.8000208@rename-it.nl> Op 12/12/2011 10:46 AM, Mike Constabel schreef: > Hi, > > now the umlauts problem with sieve: > > # cat /mailspool1/in-preetz.de/test1/.dovecot.sieve > ## Generated by Roundcube Webmail SieveRules Plugin ## > require ["fileinto"]; > > # rule:[Test] > if anyof (header :contains "Subject" "test") > { > fileinto "m&APY-"; > } And here it is actually correct. Sieve fileinto expects the argument to be in utf8 and you are passing the IMAP mutf7. Use fileinto "m?"; instead. Regards, Stephan. From listen at constabel.net Mon Dec 12 12:08:22 2011 From: listen at constabel.net (Mike Constabel) Date: Mon, 12 Dec 2011 11:08:22 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <10C93BD1-CE99-423E-BB13-3DD5C28A83E7@iki.fi> References: <20111212094615.GD6838@herakles.constabel-it.de> <10C93BD1-CE99-423E-BB13-3DD5C28A83E7@iki.fi> Message-ID: <20111212100822.GA27466@herakles.constabel-it.de> Hello, On 2011-12-12 at 10:58 CET Timo Sirainen wrote: > On 12.12.2011, at 11.46, Mike Constabel wrote: > > > now the umlauts problem with sieve: > .. > > ## Generated by Roundcube Webmail SieveRules Plugin ## > > Roundcube bug/"feature". > > > fileinto "m&APY-"; > > Sieve uses UTF-8 mailbox names. The reason why Roundcube doesn't use them, is because some old Cyrus Sieve versions didn't use UTF-8. Ok, good to know. I found the setting in the roundcube sieverules plugin. After setting this to UTF-8 it works. Thanks for the hint. Mike From listen at constabel.net Mon Dec 12 12:10:10 2011 From: listen at constabel.net (Mike Constabel) Date: Mon, 12 Dec 2011 11:10:10 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <4EE5D0B7.8000208@rename-it.nl> References: <20111212094615.GD6838@herakles.constabel-it.de> <4EE5D0B7.8000208@rename-it.nl> Message-ID: <20111212101010.GB27466@herakles.constabel-it.de> Hello Stephan, On 2011-12-12 at 11:00 CET Stephan Bosch wrote: > Op 12/12/2011 10:46 AM, Mike Constabel schreef: > >Hi, > > > >now the umlauts problem with sieve: > > > ># cat /mailspool1/in-preetz.de/test1/.dovecot.sieve > >## Generated by Roundcube Webmail SieveRules Plugin ## > >require ["fileinto"]; > > > ># rule:[Test] > >if anyof (header :contains "Subject" "test") > >{ > > fileinto "m&APY-"; > >} > > And here it is actually correct. Sieve fileinto expects the argument > to be in utf8 and you are passing the IMAP mutf7. > > Use > > fileinto "m?"; > > instead. Thanks for the hint, now it works. :) Mike From stephan at rename-it.nl Mon Dec 12 12:25:29 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 12 Dec 2011 11:25:29 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <20111212100822.GA27466@herakles.constabel-it.de> References: <20111212094615.GD6838@herakles.constabel-it.de> <10C93BD1-CE99-423E-BB13-3DD5C28A83E7@iki.fi> <20111212100822.GA27466@herakles.constabel-it.de> Message-ID: <4EE5D699.4020805@rename-it.nl> Op 12/12/2011 11:08 AM, Mike Constabel schreef: > Hello, > > On 2011-12-12 at 10:58 CET Timo Sirainen wrote: >> On 12.12.2011, at 11.46, Mike Constabel wrote: >>> ## Generated by Roundcube Webmail SieveRules Plugin ## >> Roundcube bug/"feature". >>> fileinto "m&APY-"; >> Sieve uses UTF-8 mailbox names. The reason why Roundcube doesn't use them, is because some old Cyrus Sieve versions didn't use UTF-8. > Ok, good to know. I found the setting in the roundcube sieverules > plugin. After setting this to UTF-8 it works. For posterity: The following setting of the Roundcube Sieverules plugin is relevant to solve this issue (from config.inc.php.dist): // Sieve RFC says that we should use UTF-8 encoding for mailbox names, // but some implementations does not covert UTF-8 to modified UTF-7. // set to null for default behaviour $rcmail_config['sieverules_folder_encoding'] = null; Setting it to 'UTF-8' resolves the issue. Regards, Stephan. From nick.z.edwards at gmail.com Mon Dec 12 13:25:14 2011 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Mon, 12 Dec 2011 21:25:14 +1000 Subject: [Dovecot] database failover In-Reply-To: <4EE3320C.2050607@schetterer.org> References: <4EE3320C.2050607@schetterer.org> Message-ID: Thanks, we considered options, ruled out master-master for security, and since everything is with mysql (AAA) we decided not to introduce another database type, we only use a few servers, so we might use a cron job every minute to test for db response and if fails drop interface, returns up interface, as we use linux HA solution, so if the heartbeat fails it ignores it, and other alerting will notify us eventually if it stays down, not optimum I know, in fact darn right messy, but it'll suffice until Dovecot offers such a solution. On Sat, Dec 10, 2011 at 8:18 PM, Robert Schetterer wrote: > Am 10.12.2011 11:07, schrieb Nick Edwards: > > Trying to get dovecot to _only_ use local copy of database, only querying > > another database server (same database, just replicated) if local copy is > > not responding, I have google fu'd a bit and found my only answer in so > far > > as dovecot did this once upon as time, but it was only due to a dovecot > > bug, that has since been fixed, is that so? > > The wiki shows no information of failover, just load sharing, or is it an > > undocumented feature, or can dovecot not do failover, if not, can it be > > made so? > > > > Trying to cut down on network traffic, postfix does this nicely, I > thought > > dovecot did too. > > > > as far i know recent dovecot cant do it > youre right postfix does > > you can do a master-master setup i.e with mysql > solving this > works nice here, but might not be the best solution > perhaps ldap, or other databases are better > -- > Best Regards > > MfG Robert Schetterer > > Germany/Munich/Bavaria > From nick.z.edwards at gmail.com Mon Dec 12 13:26:31 2011 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Mon, 12 Dec 2011 21:26:31 +1000 Subject: [Dovecot] database failover In-Reply-To: <994B8A50-1BF9-47D3-8DB1-2E150E975E05@iki.fi> References: <994B8A50-1BF9-47D3-8DB1-2E150E975E05@iki.fi> Message-ID: Hello Timo, On Sat, Dec 10, 2011 at 8:26 PM, Timo Sirainen wrote: > On 10.12.2011, at 12.07, Nick Edwards wrote: > > > Trying to get dovecot to _only_ use local copy of database, only querying > > another database server (same database, just replicated) if local copy is > > not responding, I have google fu'd a bit and found my only answer in so > far > > as dovecot did this once upon as time, but it was only due to a dovecot > > bug, that has since been fixed, is that so? > > The wiki shows no information of failover, just load sharing, or is it an > > undocumented feature, or can dovecot not do failover, if not, can it be > > made so? > > > > Trying to cut down on network traffic, postfix does this nicely, I > thought > > dovecot did too. > > You could add two passdbs + userdbs with different configs. The second dbs > would be used when first db is down, but also for unknown users / wrong > authentications. > > But yeah, the load balancing should be optional. There are just so many > other things to do as well.. > > Yes, it would be nice, but I understand you have many things on your todo list. From stephan at rename-it.nl Mon Dec 12 13:43:59 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 12 Dec 2011 12:43:59 +0100 Subject: [Dovecot] Refiltering mails without loosing flags In-Reply-To: References: Message-ID: <4EE5E8FF.8080306@rename-it.nl> Op 12/12/2011 1:42 AM, Dieter Knopf schreef: > is there a way to refilter all mails in a folder without loosing all > flags and moving all messages in a different folder? > > I have>10k mails in my Inbox and need to create new filterrules from > time to time. But there is no way to refilter my inbox without moving. > > Atm i need to move all mails in a folder like "refilter" and then run > getmail/... to refilter the mails. It would be really nice to refilter > a existing > folder and just move mails with hits in the filter list. Since last week, the new sieve-filter command line tool, which is intended for just such a task, is part of the normal compile output for Pigeonhole 0.3.x for Dovecot v2.1. Unfortunately, it is not released yet, so I guess you're stuck with your old getmail-based solution for now. The tool is still experimental and I must say that I have not tested the preservation of flags for some time and many changes were performed since then. I will verify that later today. Also, the interaction with the new editheader extension needs attention. Regards, Stephan. From janfrode at tanso.net Mon Dec 12 13:44:20 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 12 Dec 2011 12:44:20 +0100 Subject: [Dovecot] database failover In-Reply-To: References: <4EE3320C.2050607@schetterer.org> Message-ID: <20111212114420.GA14077@dibs.tanso.net> On Mon, Dec 12, 2011 at 09:25:14PM +1000, Nick Edwards wrote: > Thanks, we considered options, ruled out master-master for security, and > since everything is with mysql (AAA) we decided not to introduce another > database type, But LDAP master-master is sooo nice :-) and once you have your users in LDAP it's triviall to re-use it as user source in lots of services (postfix lookups, authenticated smtp, apache basic auth, dovecot, etc..). To get away from our SPoF mysql userdatabase I wrote some scripts that checkes for changes in the mysql userdatabase, and push these to LDAP every x minutes. The mysql-database is still our master user source, but I'm looking forward to getting rid of it completely real soon now. -jf From marcio.merlone at a1.ind.br Mon Dec 12 13:57:40 2011 From: marcio.merlone at a1.ind.br (Marcio Merlone) Date: Mon, 12 Dec 2011 09:57:40 -0200 Subject: [Dovecot] Documentation clarifiction on mmap_disable Message-ID: <4EE5EC34.5020803@a1.ind.br> Greetings, On http://wiki.dovecot.org/MainConfig I read: "mmap_disable = no Don't use mmap() at all. This is required if you store indexes to shared filesystems (NFS or clustered filesystem). " Does that mean: 1. mmap is required when using NFS or 2. it is required to don't use mmap at all when using NFS? Sorry if this is obvious. Best regards. -- *Marcio Merlone* From tss at iki.fi Mon Dec 12 14:21:02 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 14:21:02 +0200 Subject: [Dovecot] Documentation clarifiction on mmap_disable In-Reply-To: <4EE5EC34.5020803@a1.ind.br> References: <4EE5EC34.5020803@a1.ind.br> Message-ID: <9FFD4EC1-791C-43B8-B80B-F53FE891AFDA@iki.fi> On 12.12.2011, at 13.57, Marcio Merlone wrote: > On http://wiki.dovecot.org/MainConfig I read: > > "mmap_disable = no > Don't use mmap() at all. This is required if you store indexes to > shared filesystems (NFS or clustered filesystem). " The wording is a bit too strong, but..: > Does that mean: > > 1. mmap is required when using NFS or > 2. it is required to don't use mmap at all when using NFS? It's better not to use mmap() with NFS. 1. mmap_disable=yes is required if you attempt to access the same mailbox from more than one Dovecot server, otherwise index files get corrupted really easily. But even with this setting this setup isn't safe! http://wiki2.dovecot.org/NFS explains the problems. 2. mmap_disable=yes is a good idea with NFS even if there's only one Dovecot server, since it should be more optimal and also failures are handled better. 3. mmap_disable=yes is a good idea with cluster filesystems, since it should make the performance better. 4. With local filesystems mmap_disable=no should be faster. From scott_the_musician at yahoo.com.au Mon Dec 12 15:02:05 2011 From: scott_the_musician at yahoo.com.au (Scott Lewis) Date: Mon, 12 Dec 2011 05:02:05 -0800 (PST) Subject: [Dovecot] simultaneous scripts not running via sieve_before Message-ID: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> Hi again everyone, So I've finally got sieve integration happening on my? REHL Postfix/Dovecot server, with private user scripts happily running when users create them. (we user SquirrelMail, so the avelsieve plugin runs the sieve integration). Now I'd like to utilise additional per-user scripts (probably via sieve_before), but I've not been able to get my additional scripts to execute. I am doing the following: a) getting avelsieve to write my redirect script (ie. logging on as user, completing private script wizard, and activating it) b) compiling .dovecot.sieve with sievec c) copying the resultant .dovecot.svbin to sieve/ directory (and renaming it eg redirect.svbin still, it appears that each /home/%u/.dovecot.sieve file is the only one taking effect. Any thoughts on how to make the other ones active? (The idea behind this is to automatically forward all of joeuser at mydomain's incoming mail to somewhere like joeusersbackup at gmail.com, for backup reasons. One day, I'll work out how to configure postfix to do this for all outgoing email too, but that's for another day :) Below are what my .conf files look like. Thanks in advance, Scott /etc/dovecot.conf: [code] protocols = imap imaps managesieve listen = * protocol imap { #mail_plugins = sieve quota } ## ## ManageSieve specific settings ## protocol managesieve { # debugging mail_debug = yes #login_executable = /usr/libexec/dovecot/managesieve-login ?#mail_executable = /usr/libexec/dovecot/managesieve #managesieve_max_line_length = 65536 #managesieve_logout_format = bytes ( in=%i : out=%o ) #managesieve_implementation_string = Cyrus timsieved v2.2.13 } protocol lda { mail_plugins = sieve quota sieve=~/.dovecot.sieve sieve_extentions = +include sieve_dir=~/sieve sieve_before = /home/%u/sieve/redirect.svbin sieve_global_path = /etc/globalsieverc.svbin [/code] From ajb2 at mssl.ucl.ac.uk Mon Dec 12 15:22:50 2011 From: ajb2 at mssl.ucl.ac.uk (Alan Brown) Date: Mon, 12 Dec 2011 13:22:50 +0000 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: Message-ID: <4EE6002A.1000302@mssl.ucl.ac.uk> > Date: Wed, 07 Dec 2011 00:49:49 +0200 > From: Timo Sirainen > Subject: Re: [Dovecot] IMAP SPECIAL-USE extension > > I did this: http://hg.dovecot.org/dovecot-2.1/rev/9b9a206395f7 Just to add to the confusion: Pine/Alpine uses "sent-mail" :( From selcuk.yazar at gmail.com Mon Dec 12 15:49:36 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Mon, 12 Dec 2011 15:49:36 +0200 Subject: [Dovecot] postlogin script In-Reply-To: References: <1323320772.15365.68.camel@hurina> <1323334517.15365.88.camel@hurina> Message-ID: Hi again, show plain passwrod works perfectly. But i have little problem about prefetch. we have users inda openldap username at domain.edu.tr, so, users login their user name to check their emails. after I opened prefetc property, users cannot acceees maildir directory, they use username at domain.edu.trdirectories and they cannot see emails on web (squireel mail). (becouse we migrate our server) our structure domain\username\Maildir, but after prefetch thay try to look in webmail ( also outlook etc. client download email again) domain\username at domain.edu.tr\cur,new etc can we fix this ? thanks. On Thu, Dec 8, 2011 at 10:58 AM, Selcuk Yazar wrote: > Hi, > > i 'sorry, my mistake, it shold be > pass_attrs = uid=user,userPassword=password, *=userdb_plaintext_pass=%w* > > as you said it must contain *equal sign* before userdb_plaintext_pass=%w, > i missed it. > > thank you very much it works.! > > sel?uk > > > On Thu, Dec 8, 2011 at 10:55 AM, Timo Sirainen wrote: > >> On Thu, 2011-12-08 at 10:40 +0200, Selcuk Yazar wrote: >> > Hi, >> > >> > i applied settingsin below but dovecot says that >> > >> > " prefetch(.. at ....edu.tr,IP_ADDRESS): passdb didn't return userdb >> entries, >> > trying the next userdb >> > " >> >> That's why I said make the userdb prefetch work first, the way described >> in: >> >> > > http://wiki2.dovecot.org/UserDatabase/Prefetch >> >> You'll need to add stuff to your pass_attrs. It doesn't work >> automatically. >> >> >> > > > -- > Sel?uk YAZAR > http://www.selcukyazar.blogspot.com > -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From duihi77 at gmail.com Mon Dec 12 15:57:59 2011 From: duihi77 at gmail.com (Duane Hill) Date: Mon, 12 Dec 2011 13:57:59 +0000 Subject: [Dovecot] simultaneous scripts not running via sieve_before In-Reply-To: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> References: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> Message-ID: <1329235723.20111212135759@gmail.com> On Monday, December 12, 2011 at 13:02:05 UTC, scott_the_musician at yahoo.com.au confabulated: > Hi again everyone, > So I've finally got sieve integration happening on my? REHL > Postfix/Dovecot server, with private user scripts happily running > when users create them. (we user SquirrelMail, so the avelsieve > plugin runs the sieve integration). > Now I'd like to utilise additional per-user scripts (probably via > sieve_before), but I've not been able to get my additional scripts to execute. > I am doing the following: > a) getting avelsieve to write my redirect script (ie. logging on as > user, completing private script wizard, and activating it) > b) compiling .dovecot.sieve with sievec > c) copying the resultant .dovecot.svbin to sieve/ directory (and renaming it eg redirect.svbin > still, it appears that each /home/%u/.dovecot.sieve file is the > only one taking effect. Any thoughts on how to make the other ones > active? (The idea behind this is to automatically forward all of > joeuser at mydomain's incoming mail to somewhere like > joeusersbackup at gmail.com, for backup reasons. One day, I'll work out > how to configure postfix to do this for all outgoing email too, but that's for another day :) > Below are what my .conf files look like. Thanks in advance, > Scott > /etc/dovecot.conf: > [code] > protocols = imap imaps managesieve > listen = * > protocol imap { > #mail_plugins = sieve quota > } > ## > ## ManageSieve specific settings > ## > protocol managesieve { > # debugging > mail_debug = yes > #login_executable = /usr/libexec/dovecot/managesieve-login > ?#mail_executable = /usr/libexec/dovecot/managesieve > #managesieve_max_line_length = 65536 > #managesieve_logout_format = bytes ( in=%i : out=%o ) > #managesieve_implementation_string = Cyrus timsieved v2.2.13 > } > protocol lda { > mail_plugins = sieve quota > sieve=~/.dovecot.sieve > sieve_extentions = +include > sieve_dir=~/sieve > sieve_before = /home/%u/sieve/redirect.svbin > sieve_global_path = /etc/globalsieverc.svbin > [/code] sieve_before and sieve_after are directories where extra scripts are run sequentially before user scripts and after user scripts. See: http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration -- If at first you don't succeed, so much for skydiving. From knud.dombrowsky at graband.de Mon Dec 12 18:25:15 2011 From: knud.dombrowsky at graband.de (Knud Dombrowsky) Date: Mon, 12 Dec 2011 17:25:15 +0100 Subject: [Dovecot] Syncing shared mailboxes Message-ID: <4EE62AEB.2020607@graband.de> Hi, while trying to sync the mailboxes of several users who use and share their mailboxes dsync prints this message: dsync-local(): Warning: Subscriptions file /home//Maildir/subscriptions: Removing invalid entry: shared// The problem is: Every user has to subscribe the shared folder again after each run of dsync... Is dsync capable of syncing shared mailboxes? Are there any preliminaries to do so? thanks in advance, Knud From stephan at rename-it.nl Mon Dec 12 18:25:33 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 12 Dec 2011 17:25:33 +0100 Subject: [Dovecot] simultaneous scripts not running via sieve_before In-Reply-To: <1329235723.20111212135759@gmail.com> References: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> <1329235723.20111212135759@gmail.com> Message-ID: <4EE62AFD.90700@rename-it.nl> Op 12/12/2011 2:57 PM, Duane Hill schreef: > On Monday, December 12, 2011 at 13:02:05 UTC, scott_the_musician at yahoo.com.au confabulated: >> protocol lda { >> mail_plugins = sieve quota >> sieve=~/.dovecot.sieve >> sieve_extentions = +include >> sieve_dir=~/sieve >> sieve_before = /home/%u/sieve/redirect.svbin >> sieve_global_path = /etc/globalsieverc.svbin >> [/code] > sieve_before and sieve_after are directories where extra scripts are > run sequentially before user scripts and after user scripts. See: > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration It can be a file, but then it must point to the sieve script (in this case redirect.sieve) and not to the compiled binary (redirect.svbin in this case). Regards, Stephan. From selcuk.yazar at gmail.com Mon Dec 12 18:34:07 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Mon, 12 Dec 2011 18:34:07 +0200 Subject: [Dovecot] Prevent re-download mails Message-ID: Hi, today we have a problem our mail server about user accounts. (something about prefetch) anyway i corrected, but some clients re-download emails again. how can i stop this .I've read about some forums about UIDVALIDITY ? is it posibble prevent clients redownload emails with pop3 ? thanks in advance. -- Sel?uk YAZAR From tss at iki.fi Mon Dec 12 19:04:40 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 19:04:40 +0200 Subject: [Dovecot] Prevent re-download mails In-Reply-To: References: Message-ID: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> On 12.12.2011, at 18.34, Selcuk Yazar wrote: > today we have a problem our mail server about user accounts. (something > about prefetch) anyway i corrected, but some clients re-download emails > again. > how can i stop this .I've read about some forums about UIDVALIDITY ? This isn't enough information to give a useful answer. > is it posibble prevent clients redownload emails with pop3 ? http://wiki2.dovecot.org/Migration#POP3_migration basically explains the redownloading.. From wgrcunha at gmail.com Mon Dec 12 19:11:43 2011 From: wgrcunha at gmail.com (Francisco Wagner C. Freire) Date: Mon, 12 Dec 2011 15:11:43 -0200 Subject: [Dovecot] Prevent re-download mails In-Reply-To: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> References: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> Message-ID: Hello, I got the same problem today, anyone have the this problem? Started few minutes ago. My pop3 server have this uidl setting: pop3_uidl_format = %f and the version 2.0.12, not changed anything in the last monts and got today this problem with lots of clients. Looking for more info. On Mon, Dec 12, 2011 at 3:04 PM, Timo Sirainen wrote: > On 12.12.2011, at 18.34, Selcuk Yazar wrote: > > > today we have a problem our mail server about user accounts. (something > > about prefetch) anyway i corrected, but some clients re-download emails > > again. > > how can i stop this .I've read about some forums about UIDVALIDITY ? > > This isn't enough information to give a useful answer. > > > is it posibble prevent clients redownload emails with pop3 ? > > http://wiki2.dovecot.org/Migration#POP3_migration basically explains the > redownloading.. > > From oni-neko at gmx.net Mon Dec 12 19:18:18 2011 From: oni-neko at gmx.net (oni-neko at gmx.net) Date: Mon, 12 Dec 2011 18:18:18 +0100 Subject: [Dovecot] question regarding postfixadmin Message-ID: <20111212171818.266530@gmx.net> Hello! I hope someone here is already using postfixadmin with dovecot and can help me out =) the install-readme for postfixadmin mentions, that the mail-home should be set to default_mail_env = maildir:/var/mail/vmail/%u/ but my dovecot is already installed and working with another config, namely mail_location = maildir:/var/dovecotmail/%n/Maildir. Do i have to change this, or is postfixadmin able to read this or can i set this value in postfixadmin somewhere? i?d rather avoid moving all mailfolders around just because of that, and unfortunately the paths don?t really lend themself to an easy solution via symlink ^_^ thanks for any replies best regards sil -- Empfehlen Sie GMX DSL Ihren Freunden und Bekannten und wir belohnen Sie mit bis zu 50,- Euro! https://freundschaftswerbung.gmx.de From wgrcunha at gmail.com Mon Dec 12 19:18:28 2011 From: wgrcunha at gmail.com (Francisco Wagner C. Freire) Date: Mon, 12 Dec 2011 15:18:28 -0200 Subject: [Dovecot] Prevent re-download mails In-Reply-To: <00a201ccb8f1$b58e9030$20abb090$@vdschagt.com> References: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> <00a201ccb8f1$b58e9030$20abb090$@vdschagt.com> Message-ID: Hello, The clients re-download the messages on every connection, i current looking for the client versions with this problem. On Mon, Dec 12, 2011 at 3:15 PM, Wouter van der Schagt wrote: > > Looking for more info. > > Even with the same UIDL values, some e-mail clients will still redownload > the messages if a hostname changed. > > Anyway, annoying as it is, after the second download it will stop, you can > ask your users to simply delete the duplicates, it won't download a 3rd > time. > > - WS > > From andrew at oc384.net Mon Dec 12 22:17:12 2011 From: andrew at oc384.net (Andrew M) Date: Mon, 12 Dec 2011 14:17:12 -0600 Subject: [Dovecot] Saving archive copy of all mail sent/received w/Dovecot+Postfix? Message-ID: <4EE66148.2000904@oc384.net> I'm running Dovecot 2.0.15 and Postfix 2.7.7 with postfix handing off to Dovecot's LDA. I am hosting multiple virtual domains with multiple users and everything is working. I would now like to create a permanent archive of all sent/received mail with each virtual user's mail saved to its own sent file and received file. This needs to be independent of the user's regular Maildir store since he can't delete or modify the permanent archive. Any suggestions on how to best accomplish this either via postfix or dovecot? Postfix has in main.cf virtual_transport = dovecot and in master.cf dovecot unix - n n - - pipe flags=DRhu user=virtual:virtual argv=/usr/libexec/dovecot /dovecot-lda -d ${recipient} -f ${sender} dovecot uses this: [root at xxx andrew]# dovecot -n # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.35.14-103.fc14.x86_64 x86_64 Fedora release 14 (Laughlin) ext4 auth_mechanisms = plain login cram-md5 disable_plaintext_auth = no mail_location = maildir:/home/vmail/%d/%n/Maildir mbox_write_locks = fcntl passdb { args = scheme=plain username_format=%u /etc/postfix/passwd driver = passwd-file } protocols = imap lmtp service auth { inet_listener { port = 12345 } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0666 } } ssl_cert = Hi, TLS on imap port 143 works. But if I try TLS on managesieve port 4190, I get no connection. Dec 12 21:16:10 managesieve-login: Info: Disconnected (no auth attempts in 5 secs): rip=192.168.10.117, lip=192.168.10.117, secured Dec 12 21:16:20 managesieve-login: Info: Disconnected (no auth attempts in 5 secs): rip=192.168.10.117, lip=192.168.10.117, TLS handshaking: Disconnected # gnutls-cli --starttls -p 4190 192.168.10.117 Resolving '192.168.10.117'... Connecting to '192.168.10.117:4190'... - Simple Client Mode: "IMPLEMENTATION" "Dovecot Pigeonhole" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave" "NOTIFY" "mailto" "SASL" "PLAIN LOGIN CRAM-MD5" "STARTTLS" "VERSION" "1.0" OK "Dovecot ready." STARTTLS NO "Begin TLS negotiation now." ^ There is a NO and not an OK... Possible something wrong with my config, but I cannot find something... # doveconf -n # 2.1.rc1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 6.0.3 auth_cache_size = 1 M auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login cram-md5 auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot/dovecot-debug.log default_client_limit = 2600 dict { expire = sqlite:/etc/dovecot/dovecot-dict-expire.conf.ext } disable_plaintext_auth = no hostname = mx4.constabel-it.de info_log_path = /var/log/dovecot/dovecot-info.log log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_location = mdbox:~/mdbox mail_plugins = quota notify mail_log expire acl mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Archive/2011 { auto = subscribe } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = scheme=PLAIN username_format=%u /etc/imap.userdb driver = passwd-file } plugin { expire = Trash expire2 = Trash/* expire3 = Spam expire_dict = proxy::expire quota = dict:User quota::file:/mailspool1/%d/%n/dovecot-quota quota_rule = *:storage=9000M:messages=1000000 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at localhost protocols = " imap lmtp sieve pop3" service auth { inet_listener { address = 192.168.10.117 port = 12345 } } service dict { unix_listener dict { group = vmail mode = 0666 } } service imap-login { inet_listener imap { address = 192.168.10.117 port = 143 } inet_listener imaps { address = 192.168.10.117 port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = 192.168.10.117 port = 24 } } service managesieve-login { inet_listener sieve { address = 192.168.10.117 port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { address = 192.168.10.117 port = 110 } inet_listener pop3s { address = 192.168.10.117 port = 995 ssl = yes } } ssl_ca = References: <20111212203055.GC27466@herakles.constabel-it.de> Message-ID: <4EE66C2E.6050001@rename-it.nl> On 12/12/2011 9:30 PM, Mike Constabel wrote: > Hi, > > > TLS on imap port 143 works. > > But if I try TLS on managesieve port 4190, I get no connection. > > Dec 12 21:16:10 managesieve-login: Info: Disconnected (no auth attempts in 5 secs): rip=192.168.10.117, lip=192.168.10.117, secured > Dec 12 21:16:20 managesieve-login: Info: Disconnected (no auth attempts in 5 secs): rip=192.168.10.117, lip=192.168.10.117, TLS handshaking: Disconnected [..] > NO "Begin TLS negotiation now." My bad. By the looks of things you are using the automatic Debian repository. Currently, these builds are a bit tainted by a couple of patches of mine, which apparently caused problems once more. As not to frustrate generic debugging any further, I have removed these patches from the normal v2.1 builds. I did fix this bug, but I'll start a separate builder for the patched packages that I need for a project of mine. If all goes well, new untainted packages should roll out within the hour. Regards, Stephan. From selcuk.yazar at gmail.com Mon Dec 12 23:19:53 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Mon, 12 Dec 2011 23:19:53 +0200 Subject: [Dovecot] Prevent re-download mails In-Reply-To: References: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> <00a201ccb8f1$b58e9030$20abb090$@vdschagt.com> Message-ID: Hi, i give more detail our problem, i edited configuration dovecot for show plain text password(and use postlogin feature), after that, maildir location property (it comes from ldap attribute) changed with domain extension. so some client can't show mails on web interface (squirrel), after that i disabled showing-logging plaintext password, and some client download mails again. in conf file we have %u property , if i sould this change with %n , we don't have this problem :) . now if i change this uidl format can i prevent re-download mails again ? sorry for my english thanks in advance. On Mon, Dec 12, 2011 at 7:18 PM, Francisco Wagner C. Freire < wgrcunha at gmail.com> wrote: > Hello, > > The clients re-download the messages on every connection, i current looking > for the client versions with this problem. > > On Mon, Dec 12, 2011 at 3:15 PM, Wouter van der Schagt > wrote: > > > > Looking for more info. > > > > Even with the same UIDL values, some e-mail clients will still redownload > > the messages if a hostname changed. > > > > Anyway, annoying as it is, after the second download it will stop, you > can > > ask your users to simply delete the duplicates, it won't download a 3rd > > time. > > > > - WS > > > > > -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From dovecot at digitalforplay.com Tue Dec 13 01:49:22 2011 From: dovecot at digitalforplay.com (A Dovecot User) Date: Mon, 12 Dec 2011 17:49:22 -0600 Subject: [Dovecot] Panic when attempting index with Apache Solr : fts_solr plugin In-Reply-To: <1323321743.15365.74.camel@hurina> References: <4ED91D34.3050906@digitalforplay.com> <1323321743.15365.74.camel@hurina> Message-ID: <4EE69302.5050705@digitalforplay.com> Over the weekend I updated the OS on the machine in question to Fedora 15, which should have updated libcurl in the process, and I'm still getting the same error message. I also moved Solr to another server instead of trying to use it on the local box, but that didn't seem to make a difference. On 12/07/2011 11:22 PM, Timo Sirainen wrote: > On Fri, 2011-12-02 at 12:47 -0600, A Dovecot User wrote: >> [root at mymailserver ~]# doveadm -D index -u username mailbox inbox > The "mailbox" isn't necessary above. > >> doveadm(username): Info: INBOX: Caching mails seq=1..466 >> doveadm(username): Panic: file solr-connection.c: line 545 >> (solr_connection_post_more): assertion failed: (maxfd >= 0) > This happens every time? It can't index any mails at all? Have you tried > with Dovecot v2.0? > > I can't reproduce it. Anyway I guess either I'm using libcurl wrong > somehow, or there's a bug in libcurl.. > > From erang at jungo.com Mon Dec 12 20:30:13 2011 From: erang at jungo.com (Eran Guy) Date: Mon, 12 Dec 2011 18:30:13 +0000 (UTC) Subject: [Dovecot] =?utf-8?q?mail=5Fmax=5Fuserip=5Fconnections=3D10?= References: <002d01cc76a5$ff88f970$fe9aec50$@elysium.ltd.uk> <2ED64BFB-87F1-40B2-A489-226031A4633C@iki.fi> Message-ID: Timo Sirainen iki.fi> writes: > > On 19.9.2011, at 11.27, Tom Clark wrote: > > > Is there anyway of whitelisting an IP so that it can ignore > > mail_max_userip_connections=10? > > With v2.0 in theory: > > remote 1.2.3.4 { > mail_max_userip_connections = 0 > } > > I don't know if it actually works. Not sure I follow- in which conf file would it be appropriate to place this? Is it possible to maintain separate values for the same config directive? (I'm having a similar problem with iOS devices connecting to our server- they seem to open multiple connections, easily going over 10 if they have many subscribed directories). Thanks, -E- From joseba.torre at ehu.es Tue Dec 13 10:50:00 2011 From: joseba.torre at ehu.es (Joseba Torre) Date: Tue, 13 Dec 2011 09:50:00 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111204151602.Horde.tWy1GVeGiNBO29UCBMPVY2A@www.cnysupport.com> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204151602.Horde.tWy1GVeGiNBO29UCBMPVY2A@www.cnysupport.com> Message-ID: <4EE711B8.2040201@ehu.es> El 04/12/11 21:16, Terry Carmen escribi?: >> So I was thinking that there probably could be some tool that during a >> user's backup it would write the attachments among the user's other >> files, so it would be easy to find all of the files needed for a >> restore. This would of course mean that backups can take a lot more >> space, because there's no SIS. Perhaps there could be some other > > > I see. > > Instead of writing the links directly to the filesystem, why not keep a > links list (not a linked list 8-)) file in each directory that contains > the information for the links that should be there (source, dest, > attributes), then add an inotify hook in Dovecot to create/update/delete > the hard links in the directory so they match the links list? > > The links list would only need to be opened when there's a change and > could remain closed (and backup-able) at all other times, and restoring > a links list would immediately trigger the inotify hook and regenerate > all the required links. > > Terry Sorry for joining late this thread, but this is a very important issue for us. Terry's solution feels great: just a little modification of the mdbox, adding a ?text? file with the list of attachment files, that is modified every time an attachment is added/deleted. With that, it seems quite easy to modify our mailbox recovery script to something like: - recover the mailbox as now - recover every attachment file that file points to. Other option: a new doveadm option that could generate this list, and then recover the mailbox, generate the list, recover the attachments. Also: no change needed to the backup process itself, and that's good news. From tss at iki.fi Tue Dec 13 10:56:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 13 Dec 2011 10:56:20 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EE711B8.2040201@ehu.es> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204151602.Horde.tWy1GVeGiNBO29UCBMPVY2A@www.cnysupport.com> <4EE711B8.2040201@ehu.es> Message-ID: On 13.12.2011, at 10.50, Joseba Torre wrote: > Terry's solution feels great: just a little modification of the mdbox, adding a ?text? file with the list of attachment files, that is modified every time an attachment is added/deleted. I'd rather not implement that. It makes dbox more fragile and less efficient. > With that, it seems quite easy to modify our mailbox recovery script to something like: > - recover the mailbox as now > - recover every attachment file that file points to. > > Other option: a new doveadm option that could generate this list, and then recover the mailbox, generate the list, recover the attachments. That would be possible. You could actually already do it with v2.1's "doveadm dump", which outputs dbox file's metadata. From Juergen.Obermann at hrz.uni-giessen.de Tue Dec 13 12:47:01 2011 From: Juergen.Obermann at hrz.uni-giessen.de (=?iso-8859-1?b?SvxyZ2Vu?= Obermann) Date: Tue, 13 Dec 2011 11:47:01 +0100 Subject: [Dovecot] dsync error Mailbox has children, delete them first Message-ID: <20111213114701.185112l8l37ih0yo@webmail.hrz.uni-giessen.de> Hi, I use dsync to backup mailboxes from mbox format to mdbox on a remote system. The first run for a user with dsync is OK, but during the second there are lots of the following errors: dsync-remote(user): Error: Can't delete mailbox directory Example: Mailbox has children, delete them first I see no way how I could influence the order dsync deletes mailboxes. This happens with dovecot version 2.0.16 Thank you, Juergen Obermann From leolistas at solutti.com.br Tue Dec 13 13:39:52 2011 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Tue, 13 Dec 2011 09:39:52 -0200 Subject: [Dovecot] dovecot penalties and anvil Message-ID: <4EE73988.1090000@solutti.com.br> Hi, I'm strugling to find some documentation on dovecot's anvil service and/or its penalties (that can be checked with doveadm penalty) ... but i'm not finding anything on that. is there any documentation on anvil/penalties that i should check other than a few messages on the mailing list archive ? thanks ! -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From asai at globalchangemusic.org Wed Dec 14 01:21:09 2011 From: asai at globalchangemusic.org (Asai) Date: Tue, 13 Dec 2011 16:21:09 -0700 Subject: [Dovecot] Backing Up To Windows File Server Message-ID: <4EE7DDE5.3070605@globalchangemusic.org> Greetings, Working with dsync and setting up backups to a Windows file server. Problem seems to be that Windows is renaming the dovecot mail files (maildir) to Windows friendly filenames, and losing the Dovecot name. For example, 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S becomes 1AETPH~X. Does anyone have any ideas about how to tell Windows to not do this? Or is it not possible? -- --asai From dovecot at r.paypc.com Wed Dec 14 01:50:19 2011 From: dovecot at r.paypc.com (Robin) Date: Tue, 13 Dec 2011 15:50:19 -0800 Subject: [Dovecot] Dovecot 2.1rc1 + 2.0.16 woes regarding fts_squat Message-ID: <4EE7E4BB.2040008@r.paypc.com> I can confirm the report posted in http://dovecot.org/list/dovecot/2011-November/062263.html that fts_squat no longer seems to be used after moving from 2.0.16->2.1 rc 1. I don't see crash reports in the logs, just "0 messages indexed". My search test tool just does a normal IMAP SEARCH for a long non-existent string. If there's another way to trigger re-indexing in 2.1, I don't see anything in the documentation for it. I've enabled mail_debug, but no log entries that shed light on the problem are available. Has the configuration for fts_squat changed? If anyone has a working fts_squat setup with Dovecot 2.1rc1, I'd appreciate hearing how you have it setup and working. During a large mail import with 2.0.16 today, I ran across a worrying message in the logs during an fts_squat reindex: out of memory. The plugin doesn't obey the mmap_disable configuration directive, which I've confirmed in the plugin source. The mailbox in question has only 17GB (mdbox style), with about 90,000 emails in it. Its "index" (for the purposes of normal IMAP retrieval as opposed to IMAP TEXT/BODY searching) is fine and uncorrupted. I freshly import these mailboxes between test iterations and any version changes anyway, so if there's corruption, it's happening within dovecot only. I'm using use Mail::IMAPClient to create + append mail over localhost, not any direct mdbox conversion trickery. In looking through the code, I see that mmap() is called for the *ENTIRE FILE*, which is guaranteed to fail on large indexes. I assume this was done out of expedience, but it's a "risky" sort of thing to do in a server process, even if 8GB RAM systems do seem to grow on trees. I intend to put this to work in a large installation (>10K users), so this IS of some concern for me in the long-term. Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: mremap_anon(188084224) failed: Cannot allocate memory Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: read(.../mdbox/mailboxes/INBOX2010/dbox-Mails/dovecot.index.search.uids) failed: Cannot allocate memory Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: mremap_anon(188280832) failed: Cannot allocate memory Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: read(.../mdbox/mailboxes/INBOX2010/dbox-Mails/dovecot.index.search.uids) failed: Cannot allocate memory Dec 12 22:50:47 linuxcode dovecot: imap(user1001): Error: Corrupted squat uidlist file .../mdbox/mailboxes/INBOX2010/dbox-Mails/dovecot.index.search.uids: uidlist not found ================ dovecot -n output: # 2.0.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.35.7-smp i686 Slackware 13.1.0 auth_mechanisms = plain cram-md5 digest-md5 apop default_vsz_limit = 192 M disable_plaintext_auth = no first_valid_gid = 100 hostname = linuxcode info_log_path = /tmp/dovecot.log last_valid_gid = 60000 last_valid_uid = 60000 listen = * mail_location = mdbox:~/mdbox mail_plugins = " zlib acl" mdbox_preallocate_space = yes mdbox_rotate_interval = 1 days mmap_disable = yes passdb { args = scheme=plain /etc/cram-md5.pwd driver = passwd-file } plugin { acl = vfile } postmaster_address = postmaster at linuxcode quota_full_tempfail = yes service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 0 vsz_limit = 64 M } service imap { vsz_limit = 512 M } service lmtp { unix_listener lmtp { mode = 0666 } } ssl = no userdb { args = blocking=no driver = passwd } protocol lmtp { mail_plugins = " zlib acl" } protocol imap { mail_plugins = " zlib acl fts fts_squat imap_acl imap_zlib" plugin { fts = squat fts_squat = partial=4 full=10 } } ================ CONFIGURE ================ LIBS=-lnsl CFLAGS='-O2 -march=core2 -mtune=core2 -fstack-protector -fomit-frame-pointer' \ CXXFLAGS='-O2 -march=core2 -mtune=core2 -fstack-protector -fomit-frame-pointer' \ LDFLAGS=-s ./configure --prefix=/usr --sysconfdir=/etc \ --with-mysql --with-sqlite --with-pgsql --without-pam --with-sql \ --with-libwrap --with-libcap -with-ssl=openssl --with-solr \ --with-mem-align=16 --with-bzlib --with-zlib --localstatedir=/var ================ OS: Slackware 13.1 (32-bit, 2GB physical RAM, kernel setup for 2G/2G split) fully patched up =R= From jerry at seibercom.net Wed Dec 14 02:34:38 2011 From: jerry at seibercom.net (Jerry) Date: Tue, 13 Dec 2011 19:34:38 -0500 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE7DDE5.3070605@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> Message-ID: <20111213193438.69c57904@scorpio> On Tue, 13 Dec 2011 16:21:09 -0700 Asai articulated: > Working with dsync and setting up backups to a Windows file server. > Problem seems to be that Windows is renaming the dovecot mail files > (maildir) to Windows friendly filenames, and losing the Dovecot name. > For example, > 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > becomes 1AETPH~X. > > Does anyone have any ideas about how to tell Windows to not do this? > Or is it not possible? I have backed up files to a Windows server before but have never experienced the problems you are describing. Could you please list the Windows Server specifics, ie. version, etc. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From duihi77 at gmail.com Wed Dec 14 03:16:33 2011 From: duihi77 at gmail.com (Duane Hill) Date: Wed, 14 Dec 2011 01:16:33 +0000 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE7DDE5.3070605@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> Message-ID: <341320.20111214011633@gmail.com> On Tuesday, December 13, 2011 at 23:21:09 UTC, asai at globalchangemusic.org confabulated: > Greetings, > Working with dsync and setting up backups to a Windows file server. > Problem seems to be that Windows is renaming the dovecot mail files > (maildir) to Windows friendly filenames, and losing the Dovecot name. > For example, > 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > becomes 1AETPH~X. > Does anyone have any ideas about how to tell Windows to not do this? Or > is it not possible? AFAIK, the colon is not valid in a windows file name. -- If at first you don't succeed, so much for skydiving. From brad at omnis.com Wed Dec 14 03:41:54 2011 From: brad at omnis.com (Brad Schuetz) Date: Tue, 13 Dec 2011 17:41:54 -0800 Subject: [Dovecot] Two recent issues In-Reply-To: <1323496696.15365.124.camel@hurina> References: <4EE26BDF.4080500@omnis.com> <1323496696.15365.124.camel@hurina> Message-ID: <4EE7FEE2.6040701@omnis.com> On 12/09/2011 09:58 PM, Timo Sirainen wrote: > If auth process dies unexpectedly, master always logs an error, such as: > > Dec 10 07:15:34 auth: Fatal: master: service(auth): child 27895 killed with signal 11 (core dumped) > > Anyway, "read(imap) failed: Connection reset by peer" can happen if you > reach the service imap { process_limit }. But then there should be a > warning logged about it also: > > Dec 10 07:17:39 master: Warning: service(imap): process_limit reached, client connections are being dropped > > So, that error message alone shouldn't be happening.. Interesting, the log entries I provided were the only ones that did exist. > If that happens, there would also be an error message logged about it. > One thing that v2.0 doesn't log about is if auth socket gets > disconnected, but that would result in different problems. v2.1 logs > about that too. The problem has vanished in the last couple of days. When 2.1 comes out I will upgrade and if the problem returns I'll see if it's logs have any further information. >> The second issue is lmtp/lda (tried both) delivery to a mailbox that has >> filesystem quotas enabled and the group quota is maxed is resulting in >> the below panic and crash. >> >> 11:21:07 [err] dovecot: lmtp(29691, admin@[redacted].com): Error: >> o_stream_send_istream(/email/d/r/[redacted]/[redacted]/admin/Maildir/tmp/1323458467.M245978P29691.fenrir.omnis.com) >> failed: Disk quota exceeded >> 11:21:07 [crit] dovecot: lmtp(29691, admin@[redacted].com): Panic: file >> ostream-zlib.c: line 144 (o_stream_zlib_send_flush): assertion failed: >> (zs->avail_in == 0) > > I couldn't reproduce this with my tests, but > http://hg.dovecot.org/dovecot-2.0/rev/75daa638281b should fix it. > This patch has corrected the issue I was seeing. Thank you very much. From lists at luigirosa.com Wed Dec 14 07:38:07 2011 From: lists at luigirosa.com (Luigi Rosa) Date: Wed, 14 Dec 2011 06:38:07 +0100 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE7DDE5.3070605@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> Message-ID: <4EE8363F.30303@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Asai said the following on 14/12/11 00:21: > Working with dsync and setting up backups to a Windows file server. > Problem seems to be that Windows is renaming the dovecot mail files > (maildir) to Windows friendly filenames, and losing the Dovecot name. For > example, > 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > > becomes 1AETPH~X. > > Does anyone have any ideas about how to tell Windows to not do this? Or is > it not possible? Got same problem rsync-ing to some low cost NAS and, of course, windows share. My solution is to tar.gz before copying to Windows. Ciao, luigi - -- / +--[Luigi Rosa]-- \ Ask ten different scientists about the environment, population control, genetics, and you'll get ten different answers, but there's one thing every scientist on the planet agrees on. Whether it happens in a hundred years or a thousand years or a million years, eventually our Sun will grow cold and go out. When that happens, it won't just take us. It'll take Marilyn Monroe, and Lao-Tzu, and Einstein, and Morobuto, and Buddy Holly, and Aristophanes... [and] all of this... all of this... was for nothing. Unless we go to the stars. --Jeffrey Sinclair, "Infection" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk7oNjYACgkQ3kWu7Tfl6ZTaBACaAmu1MtZkcBEGxMM3iXfezLpr KEsAnjczFO4QVnIcHtvC2MbWGbU7AuO2 =cGog -----END PGP SIGNATURE----- From nmilas at noa.gr Wed Dec 14 12:47:05 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Wed, 14 Dec 2011 12:47:05 +0200 Subject: [Dovecot] Quota warnings not being sent Message-ID: <4EE87EA9.5050503@noa.gr> Hello, I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7 with the config shown below. All accounts are virtual, hosted on LDAP Server. My problem is that the quota warning mail is not sent as expected. For example, in the logs I get: Dec 12 08:42:40 vmail dovecot: lda(imaptester): Error: quota: net_connect_unix(/var/run/dovecot/quota-warning) failed: Permission denied (euid=500(vmail) egid=500(vmail) missing +r perm: /var/run/dovecot/quota-warning, euid is not dir owner) Here is /var/run/dovecot/: # ls -la /var/run/dovecot/ total 32 drwxr-xr-x 4 root dovecot 4096 Dec 9 21:27 . drwxr-xr-x 23 root root 4096 Dec 14 12:27 .. srw------- 1 root root 0 Dec 9 21:27 anvil srw------- 1 root root 0 Dec 9 21:27 anvil-auth-penalty srw------- 1 root root 0 Dec 9 21:27 auth-client srw------- 1 dovecot root 0 Dec 9 21:27 auth-login srw-rw---- 1 vmail vmail 0 Dec 9 21:27 auth-master srw------- 1 root root 0 Dec 9 21:27 auth-userdb srw------- 1 dovecot root 0 Dec 9 21:27 auth-worker srw------- 1 root root 0 Dec 9 21:27 config srw------- 1 root root 0 Dec 9 21:27 dict srw------- 1 root root 0 Dec 9 21:27 director-admin srw-rw-rw- 1 root root 0 Dec 9 21:27 dns-client srw------- 1 root root 0 Dec 9 21:27 doveadm-server lrwxrwxrwx 1 root root 25 Dec 9 21:27 dovecot.conf -> /etc/dovecot/dovecot.conf drwxr-xr-x 2 root root 4096 May 17 2011 empty drwxr-x--- 2 root dovenull 4096 Dec 9 21:27 login -rw------- 1 root root 5 Dec 9 21:27 master.pid srw------- 1 root root 0 Dec 9 21:27 quota-warning Follows my config (at the end of this message). How should I change permissions to resolve the issue? Would it be enough to change ownership of the whole directory /var/run/dovecot/ and its contents to vmail:vmail? What configuration directives determine the ownership and the access permissions for these sockets? Please advise. Thanks in advance, Nick ------------------------------------------ # 2.0.13: dovecot.conf protocols = imap pop3 mail_location = maildir:~/Maildir/ mail_gid = 500 mail_uid = 500 auth_mechanisms = plain login auth_username_format = %Lu auth_verbose = yes disable_plaintext_auth = no mail_plugins = quota protocol imap { imap_client_workarounds = "delay-newmail " mail_plugins = quota imap_quota } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = log_path = mail_plugins = quota postmaster_address = sysadmin at example.com sendmail_path = /usr/lib/sendmail } userdb { args = /etc/dovecot/dovecot-usrdb-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-passdb-ldap.conf driver = ldap } plugin { quota = maildir:User quota quota_rule = *:storage=4G quota_rule2 = Trash:storage=+3%% quota_warning = storage=75%% quota-warning 75 %u quota_warning2 = storage=90%% quota-warning 90 %u } service quota-warning { executable = script /opt/mail1.sh user = root unix_listener quota-warning { } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service imap-login { service_count = 1 vsz_limit = 64 M } service pop3-login { service_count = 1 vsz_limit = 64 M } ssl_ca = From tlx at leuxner.net Wed Dec 14 13:06:00 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Wed, 14 Dec 2011 12:06:00 +0100 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE87EA9.5050503@noa.gr> References: <4EE87EA9.5050503@noa.gr> Message-ID: <20111214110559.GA15164@nihlus.leuxner.net> On Wed, Dec 14, 2011 at 12:47:05PM +0200, Nikolaos Milas wrote: > For example, in the logs I get: > Dec 12 08:42:40 vmail dovecot: lda(imaptester): Error: quota: > net_connect_unix(/var/run/dovecot/quota-warning) failed: Permission > denied (euid=500(vmail) egid=500(vmail) missing +r perm: > /var/run/dovecot/quota-warning, euid is not dir owner) service quota-warning { executable = script /opt/mail1.sh user = vmail unix_listener quota-warning { } } I'd guess setting the user to 'vmail' here solves the problem: http://wiki2.dovecot.org/Quota/Configuration Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From nmilas at noa.gr Wed Dec 14 13:40:19 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Wed, 14 Dec 2011 13:40:19 +0200 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <20111214110559.GA15164@nihlus.leuxner.net> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> Message-ID: <4EE88B23.90609@noa.gr> On 14/12/2011 1:06 ??, Thomas Leuxner wrote: > I'd guess setting the user to 'vmail' here solves the problem Thank you for the reply. No, this did not solve the problem. I changed to vmail service quota-warning { executable = script /opt/mail1.sh user = vmail unix_listener quota-warning { } } and did a full restart: # service dovecot restart Again: Dec 14 13:30:11 vmail dovecot: lda(tester): Error: quota: net_connect_unix(/var/run/dovecot/quota-warning) failed: Permission denied (euid=500(vmail) egid=500(v mail) missing +r perm: /var/run/dovecot/quota-warning, euid is not dir owner) And still, the socket is owned by root: # ls -la /var/run/dovecot/ total 32 drwxr-xr-x 4 root dovecot 4096 Dec 14 13:20 . drwxr-xr-x 23 root root 4096 Dec 14 13:27 .. ... srw------- 1 root root 0 Dec 14 13:20 quota-warning Any suggestions? Thanks, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From pw at wk-serv.de Wed Dec 14 14:24:31 2011 From: pw at wk-serv.de (Patrick Westenberg) Date: Wed, 14 Dec 2011 13:24:31 +0100 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE88B23.90609@noa.gr> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> Message-ID: <4EE8957F.8090101@wk-serv.de> Nikolaos Milas schrieb: > No, this did not solve the problem. I changed to vmail > > service quota-warning { > executable = script /opt/mail1.sh > user = vmail > unix_listener quota-warning { > } > } This is what works for me: service quota-warning { executable = script /usr/local/etc/dovecot/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } From leolistas at solutti.com.br Wed Dec 14 14:33:14 2011 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Wed, 14 Dec 2011 10:33:14 -0200 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE8957F.8090101@wk-serv.de> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> <4EE8957F.8090101@wk-serv.de> Message-ID: <4EE8978A.2030409@solutti.com.br> Em 14/12/11 10:24, Patrick Westenberg escreveu: > > This is what works for me: > > service quota-warning { > executable = script /usr/local/etc/dovecot/quota-warning.sh > unix_listener quota-warning { > user = vmail > } > user = vmail > } My configurations are similar to Patrick ones and works just fine: service quota-warning { executable = script /etc/dovecot/aviso-quota.sh user = dovecot unix_listener quota-warning { user = mail } } plugin { quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=85%% quota-warning 85 %u quota_warning3 = storage=70%% quota-warning 70 %u quota_exceeded_message = Quota excedida (caixa postal cheia) / Quota exceeded (mailbox is full) } -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From tlx at leuxner.net Wed Dec 14 15:02:37 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Wed, 14 Dec 2011 14:02:37 +0100 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE8978A.2030409@solutti.com.br> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> <4EE8957F.8090101@wk-serv.de> <4EE8978A.2030409@solutti.com.br> Message-ID: <20111214130237.GB15164@nihlus.leuxner.net> On Wed, Dec 14, 2011 at 10:33:14AM -0200, Leonardo Rodrigues wrote: > service quota-warning { > executable = script /etc/dovecot/aviso-quota.sh > user = dovecot > unix_listener quota-warning { > user = mail > } > } Right, looks like the Wiki Example needs to be revamped... [ 90-quota.conf ] matches the real life examples posted: # Example quota-warning service. The unix listener's permissions should be # set in a way that mail processes can connect to it. Below example assumes # that mail processes run as vmail user. If you use mode=0666, all system users # can generate quota warnings to anyone. #service quota-warning { # executable = script /usr/local/bin/quota-warning.sh # user = dovecot # unix_listener quota-warning { # user = vmail # } #} From forall at stalowka.info Wed Dec 14 14:49:39 2011 From: forall at stalowka.info (For@ll) Date: Wed, 14 Dec 2011 13:49:39 +0100 Subject: [Dovecot] Autosubscribe new folders Message-ID: Hi, I have a sieve filter: require ["fileinto","reject","body"]; if header :contains "subject" "NOTE" { if body :content "application/pdf" :contains "" { redirect "notes at domena.com"; } else { reject text: Lack attachment PDF! . ; stop; } } When I get a new message, in user folder is automaticly created folder like subject but is not subscribed. What I must settings in dovecot to automaticly subscribe folders to subscriptions files.? From dg at dguhl.org Wed Dec 14 18:20:00 2011 From: dg at dguhl.org (Dennis Guhl) Date: Wed, 14 Dec 2011 17:20:00 +0100 Subject: [Dovecot] Autosubscribe new folders In-Reply-To: References: Message-ID: <20111214161958.GA2843@PC211.ikt.de> On Wed, Dec 14, 2011 at 01:49:39PM +0100, For at ll wrote: > Hi, [..] > When I get a new message, in user folder is automaticly created > folder like subject but is not subscribed. What I must settings in > dovecot to automaticly subscribe folders to subscriptions files.? Add lda_mailbox_autosubscribe = yes to 15-lda.conf (or wherever you defined lda_mailbox_autocreate = yes). Dennis From asai at globalchangemusic.org Wed Dec 14 19:17:58 2011 From: asai at globalchangemusic.org (Asai) Date: Wed, 14 Dec 2011 10:17:58 -0700 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <20111213193438.69c57904@scorpio> References: <4EE7DDE5.3070605@globalchangemusic.org> <20111213193438.69c57904@scorpio> Message-ID: <4EE8DA46.5090003@globalchangemusic.org> On 12/13/2011 5:34 PM, Jerry wrote: > On Tue, 13 Dec 2011 16:21:09 -0700 > Asai articulated: > >> Working with dsync and setting up backups to a Windows file server. >> Problem seems to be that Windows is renaming the dovecot mail files >> (maildir) to Windows friendly filenames, and losing the Dovecot name. >> For example, >> 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S >> becomes 1AETPH~X. >> >> Does anyone have any ideas about how to tell Windows to not do this? >> Or is it not possible? > I have backed up files to a Windows server before but have never > experienced the problems you are describing. Could you please list the > Windows Server specifics, ie. version, etc. This is a Win 2008 R2 server with NFS shares enabled. I initially copied the backups from my former backup server to this Windows box, and that's when I noticed the file names had been changed. From jerry at seibercom.net Wed Dec 14 19:24:03 2011 From: jerry at seibercom.net (Jerry) Date: Wed, 14 Dec 2011 12:24:03 -0500 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE8DA46.5090003@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> <20111213193438.69c57904@scorpio> <4EE8DA46.5090003@globalchangemusic.org> Message-ID: <20111214122403.17d6af91@scorpio> On Wed, 14 Dec 2011 10:17:58 -0700 Asai articulated: > On 12/13/2011 5:34 PM, Jerry wrote: > > On Tue, 13 Dec 2011 16:21:09 -0700 > > Asai articulated: > > > >> Working with dsync and setting up backups to a Windows file server. > >> Problem seems to be that Windows is renaming the dovecot mail files > >> (maildir) to Windows friendly filenames, and losing the Dovecot > >> name. For example, > >> 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > >> becomes 1AETPH~X. > >> > >> Does anyone have any ideas about how to tell Windows to not do > >> this? Or is it not possible? > > I have backed up files to a Windows server before but have never > > experienced the problems you are describing. Could you please list > > the Windows Server specifics, ie. version, etc. > This is a Win 2008 R2 server with NFS shares enabled. I initially > copied the backups from my former backup server to this Windows box, > and that's when I noticed the file names had been changed. IMHO, I think you might be better served by posting your inquiry to a Microsoft forum dedicated to the 2008 server framework. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From lists at luigirosa.com Wed Dec 14 19:34:52 2011 From: lists at luigirosa.com (Luigi Rosa) Date: Wed, 14 Dec 2011 18:34:52 +0100 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE8D467.3030904@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> <4EE8363F.30303@luigirosa.com> <4EE8D467.3030904@globalchangemusic.org> Message-ID: <4EE8DE3C.1010507@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Asai said the following on 14/12/11 17:52: > Thanks, Luigi, I may fall back to that. Should you need it, here's the script I use to do it. In my configurations /var/spool/mail contains one dir for each domain and each of that dir contains a maildir for each domain. So the email of foobar at acme.com is in /var/spool/mail/acme.com/foobar/ The 4th line checks lost&found because /bar/spool/mail is a different file system. I create the .tgz file on local /tmp for performance reasons. TARGET=/backup for DOMAINPATH in /var/spool/mail/* do if [ "${DOMAINPATH}" != "/var/spool/mail/lost+found" ] then DOMAIN=`echo $DOMAINPATH | cut -d '/' -f 5` for USERPATH in ${DOMAINPATH}/* do USER=`echo $USERPATH | cut -d '/' -f 6` tar cvzf /tmp/$DOMAIN-$USER.tgz $USERPATH > /dev/null cp -f /tmp/$DOMAIN-$USER.tgz $TARGET/mail rm -f /tmp/$DOMAIN-$USER.tgz done fi done Ciao, luigi - -- / +--[Luigi Rosa]-- \ I don't think we have the right or the wisdom to interfere, however a planet is evolving. --James Kirk, "The Omega Glory" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk7o3jYACgkQ3kWu7Tfl6ZSfpQCgvzhOJH6mnJMu8ZzvKu5y8um+ 46wAoKd0eXxBNPad9EZao7VKjZBkACer =dhk0 -----END PGP SIGNATURE----- From nmilas at noa.gr Wed Dec 14 19:52:24 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Wed, 14 Dec 2011 19:52:24 +0200 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE8978A.2030409@solutti.com.br> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> <4EE8957F.8090101@wk-serv.de> <4EE8978A.2030409@solutti.com.br> Message-ID: <4EE8E258.2080801@noa.gr> Thank you all for your help. Changing from: unix_listener quota-warning { } to: unix_listener quota-warning { user = vmail } solved the problem! Now my quota warning message is being sent successfully. I think I'll now open a new thread on how to send rich/UTF-8 mail warnings. Thanks again, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From leolistas at solutti.com.br Wed Dec 14 21:10:26 2011 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Wed, 14 Dec 2011 17:10:26 -0200 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE8E258.2080801@noa.gr> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> <4EE8957F.8090101@wk-serv.de> <4EE8978A.2030409@solutti.com.br> <4EE8E258.2080801@noa.gr> Message-ID: <4EE8F4A2.8060507@solutti.com.br> Em 14/12/11 15:52, Nikolaos Milas escreveu: > > I think I'll now open a new thread on how to send rich/UTF-8 mail > warnings. > > Probably you just need to format/encode it properly ... no big deal on that. -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From maria_arrea at gmx.com Wed Dec 14 23:10:36 2011 From: maria_arrea at gmx.com (Maria Arrea) Date: Wed, 14 Dec 2011 22:10:36 +0100 Subject: [Dovecot] Question about index reset in dovecot 2.0.15 Message-ID: <20111214211036.55980@gmx.com> I have seen some strange error log messages in our dovecot server (2.0.15, RHEL 5.7x64, mdbox+zlib, local storage, high load) Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Dec 14 20:56:46 buzon dovecot: imap(rcam): Error: Corrupted index cache file /indices_dovecot/indices/03/6b/rcam/mailboxes/INBOX/dovecot.index.cache: Broken virtual size for mail UID 132197 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox INBOX I have been googling without luck, why does this happen? I have tried with doveadm force-resync, maybe this could solve this issues. doveconf -n output # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-274.7.1.el5 x86_64 Red Hat Enterprise Linux Server release 5.7 (Tikanga) ext4 auth_cache_negative_ttl = 10 secs auth_cache_size = 10 M auth_cache_ttl = 2 mins auth_master_user_separator = * auth_mechanisms = plain login auth_worker_max_count = 3500 base_dir = /var/run/dovecot/ default_client_limit = 5000 default_process_limit = 6500 disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep delay-newmail tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_fsync = never mail_gid = entrega mail_home = /buzones/domain/%2.26Hn/%2.200Hn/%n/home_usuario/ mail_location = mdbox:/buzones/domain/%2.26Hn/%2.200Hn/%n:INDEX=/indices_dovecot/indices/%2.26Hn/%2.200Hn/%n mail_max_userip_connections = 15000 mail_plugins = " zlib acl quota autocreate" mail_uid = entrega managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mdbox_rotate_interval = 1 days mdbox_rotate_size = 60 M passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/usuario_maestro.txt driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile autocreate = SPAM autocreate2 = Sent autocreate3 = Drafts autocreate4 = Trash autosubscribe = SPAM autosubscribe2 = Sent autosubscribe3 = Drafts autosubscribe4 = Trash lda_mailbox_autosubscribe = yes quota = dict:Cuota de usuario::file:/buzones/cuotas/%n quota_rule2 = Trash:storage=+10%% quota_warning = storage=90%% aviso_cuota 90 %u sieve = /buzones/domain/%2.26Hn/%2.200Hn/%n/home_usuario/dovecot.sieve sieve_dir = /buzones/domain/%2.26Hn/%2.200Hn/%n/home_usuario/sieve/ zlib_save = gz zlib_save_level = 9 } pop3_no_flag_updates = yes protocols = pop3 imap sieve service anvil { client_limit = 25000 } service auth { client_limit = 28000 unix_listener auth-master { user = entrega } unix_listener auth-userdb { user = entrega } user = root } service aviso_cuota { executable = script /usr/local/bin/quota-warning.sh unix_listener aviso_cuota { mode = 0666 } user = entrega } service imap-login { executable = /usr/libexec/dovecot/imap-login group = dovenull service_count = 0 vsz_limit = 1 G } service imap { executable = /usr/libexec/dovecot/imap process_limit = 6000 } service managesieve-login { executable = /usr/libexec/dovecot/managesieve-login inet_listener sieve { port = 2000 } process_limit = 2000 vsz_limit = 1 G } service managesieve { executable = /usr/libexec/dovecot/managesieve process_limit = 5000 } service pop3-login { executable = /usr/libexec/dovecot/pop3-login process_limit = 4000 service_count = 0 vsz_limit = 1 G } service pop3 { executable = /usr/libexec/dovecot/pop3 process_limit = 4000 } ssl_ca = I'm trying to get the pipe backend to work with the new dovecot-antispam (I was very pleased to see the new version, thanks Johannes!) Before I would run the following over the maildir: spamc -d 10.0.1.109 -L ham < $file 2>&1 > /dev/null now, i'm using dovecot-antispam and mdbox and have the following configured: antispam_backend = pipe antispam_signature = X-Spam-Flag antispam_signature_missing = error antispam_trash_pattern = trash;Trash;Deleted * antispam_spam_pattern_ignorecase = SPAM antispam_pipe_tmpdir = /var/tmp antispam_pipe_program_spam_arg = -L spam antispam_pipe_program_notspam_arg = -L ham antispam_pipe_program = /usr/bin/spamc antispam_pipe_program_args = -d 10.0.1.109 Now, when I move a message to Spam, dovecot-antispam detects it and attempts to run, but it fails: Dec 14 16:22:45 grosbeak [username 10.0.1.74 uid]: antispam: run program failed with exit code 64 Exit code 64 is spamc's exit code for "command line usage error" - but I can't see exactly the command that is being constructed by dovecot-antispam to know where the error is. Any ideas? micah -- -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 835 bytes Desc: not available URL: From janm-dovecot at transactionware.com Thu Dec 15 03:05:42 2011 From: janm-dovecot at transactionware.com (Jan Mikkelsen) Date: Thu, 15 Dec 2011 12:05:42 +1100 Subject: [Dovecot] Building 2.1.rc1 with cluence, but without libstemmer Message-ID: Hi, I'm testing out 2.1.rc1, building against clucene 2.3.3.4. Without libstemmber, the build fails because it attempts to include SnowballAnalyzer.h which is not part of "core" clucene. Simple patch below to make dovecot 2.1.rc1 build with clucene but without libstemmer (or textcat). Looking at libstemmer itself, there are multiple versions. The version in clucene is put into libclucene-contribs-lib.so, but that version is older than libstemmer_c, which generates libstemmer.a, tested for in the dovecot 2.1.rc1 configure script. The dovecot code uses SnowballAnalyzer.h as a C++ wrapper around libstemmer. What versions of libstemmer, clucene and libtextcat is dovecot 2.1.rc1 intended to be used against? Is it worth bringing the wrapper class around libstemmer into dovecot to avoid funny dependencies against clucene and so that the -lstemmer test in configure is enough? For reference, I'm building on FreeBSD 9.0-RC3, system gcc. Regards, Jan Mikkelsen. diff -u -d -r dovecot-2.1.rc1/src/plugins/fts-lucene/lucene-wrapper.cc dovecot-2.1.rc1.patched/src/plugins/fts-lucene/lucene-wrapper.cc --- dovecot-2.1.rc1/src/plugins/fts-lucene/lucene-wrapper.cc 2011-11-09 08:45:26.000000000 +1100 +++ dovecot-2.1.rc1.patched/src/plugins/fts-lucene/lucene-wrapper.cc 2011-12-14 23:36:54.319796535 +1100 @@ -23,7 +23,9 @@ #include #include #include +#if defined(HAVE_LUCENE_STEMMER) || defined(HAVE_LUCENE_TEXTCAT) #include "SnowballAnalyzer.h" +#endif /* Lucene's default is 10000. Use it here also.. */ #define MAX_TERMS_PER_DOCUMENT 10000 From dmiller at amfes.com Thu Dec 15 05:27:06 2011 From: dmiller at amfes.com (Daniel L. Miller) Date: Wed, 14 Dec 2011 19:27:06 -0800 Subject: [Dovecot] doveadm index Message-ID: Does "doveadm index -A INBOX" reindex everything? What about users with multiple folders, both subbed & not subbed under INBOX? -- Daniel From adis at linux.org.ba Thu Dec 15 10:37:58 2011 From: adis at linux.org.ba (Adis Nezirovic) Date: Thu, 15 Dec 2011 09:37:58 +0100 Subject: [Dovecot] Quota PostgreSQL INSERT trigger Message-ID: Wiki instructions for creating insert trigger for PostgreSQL are wrong http://wiki.dovecot.org/Quota/Dict Calling INSERT on the table from within BEFORE INSERT trigger creates cascading trigger. http://www.postgresql.org/docs/current/interactive/trigger-definition.html Instead, one should return NEW record from the trigger, and it will be inserted after trigger execution. --- CREATE OR REPLACE FUNCTION merge_quota2() RETURNS TRIGGER AS $$ BEGIN IF NEW.messages < 0 OR NEW.messages IS NULL THEN -- ugly kludge: we came here from this function, really do try to insert IF NEW.messages IS NULL THEN NEW.messages = 0; ELSE NEW.messages = -NEW.messages; END IF; return NEW; END IF; LOOP UPDATE quota2 SET bytes = bytes + NEW.bytes, messages = messages + NEW.messages WHERE username = NEW.username; IF found THEN RETURN NULL; END IF; BEGIN IF NEW.messages = 0 THEN RETURN NEW; ELSE NEW.messages = - NEW.messages; RETURN NEW; END IF; EXCEPTION WHEN unique_violation THEN -- someone just inserted the record, update it END; END LOOP; END; $$ LANGUAGE plpgsql; DROP TRIGGER IF EXISTS mergequota2 ON quota2; CREATE TRIGGER mergequota2 BEFORE INSERT ON quota2 FOR EACH ROW EXECUTE PROCEDURE merge_quota2(); --- Best regards, Adis From tom at whyscream.net Thu Dec 15 12:55:19 2011 From: tom at whyscream.net (Tom Hendrikx) Date: Thu, 15 Dec 2011 11:55:19 +0100 Subject: [Dovecot] dovecot-antispam: pipe backend with spamc failing to parse args In-Reply-To: <87k45yllf3.fsf@algae.riseup.net> References: <87k45yllf3.fsf@algae.riseup.net> Message-ID: <4EE9D217.5060006@whyscream.net> On 15/12/11 01:37, Micah Anderson wrote: > > I'm trying to get the pipe backend to work with the new > dovecot-antispam (I was very pleased to see the new version, thanks > Johannes!) > > antispam_pipe_program_spam_arg = -L spam > antispam_pipe_program_notspam_arg = -L ham > antispam_pipe_program = /usr/bin/spamc > antispam_pipe_program_args = -d 10.0.1.109 > > Now, when I move a message to Spam, dovecot-antispam detects it and > attempts to run, but it fails: > > Dec 14 16:22:45 grosbeak [username 10.0.1.74 uid]: antispam: run program > failed with exit code 64 > > Exit code 64 is spamc's exit code for "command line usage error" - but I > can't see exactly the command that is being constructed by > dovecot-antispam to know where the error is. I use dspam as backend, but multiple args need to be specified separated by semicolons (';') if spaces aare needed on the original commandline. i.e.: antispam_pipe_program_spam_arg = -L;spam antispam_pipe_program_notspam_arg = -L;ham antispam_pipe_program = /usr/bin/spamc antispam_pipe_program_args = -d;10.0.1.109 Note that this is the fork from Eugene as documented on the wiki, which is based on the same code. Did I miss the announcement from Johannes somewhere?:) -- Regards, Tom From forall at stalowka.info Thu Dec 15 16:03:40 2011 From: forall at stalowka.info (For@ll) Date: Thu, 15 Dec 2011 15:03:40 +0100 Subject: [Dovecot] Autosubscribe new folders In-Reply-To: <20111214161958.GA2843@PC211.ikt.de> References: <20111214161958.GA2843@PC211.ikt.de> Message-ID: W dniu 14.12.2011 17:20, Dennis Guhl pisze: > On Wed, Dec 14, 2011 at 01:49:39PM +0100, For at ll wrote: >> Hi, > > [..] > >> When I get a new message, in user folder is automaticly created >> folder like subject but is not subscribed. What I must settings in >> dovecot to automaticly subscribe folders to subscriptions files.? > > Add > > lda_mailbox_autosubscribe = yes > > to 15-lda.conf (or wherever you defined lda_mailbox_autocreate = yes). > > Dennis > It doesn't work. This is a part of config file about lda: protocol lda { log_path = /var/log/dovecot-deliver.log auth_socket_path = /var/run/dovecot/auth-master postmaster_address = postmaster at i-bs.pl mail_plugins = sieve # global_script_path = /home/vmail/globalsieverc lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes } I have dovecot 1.2.15 From dg at dguhl.org Thu Dec 15 17:46:35 2011 From: dg at dguhl.org (Dennis Guhl) Date: Thu, 15 Dec 2011 16:46:35 +0100 Subject: [Dovecot] Autosubscribe new folders In-Reply-To: References: <20111214161958.GA2843@PC211.ikt.de> Message-ID: <20111215154634.GB11853@PC211.ikt.de> On Thu, Dec 15, 2011 at 03:03:40PM +0100, For at ll wrote: > W dniu 14.12.2011 17:20, Dennis Guhl pisze: > >On Wed, Dec 14, 2011 at 01:49:39PM +0100, For at ll wrote: > >>Hi, [..] > It doesn't work. This is a part of config file about lda: > protocol lda { [..] > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > } > I have dovecot 1.2.15 This are directives from 2.0 which won't work with dovecot 1.2. IIRC dovecot 1.2 can only automatically create and subscribe administratively defined folders on first login. Dennis -- Dennis Guhl () ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments From e-frog at gmx.de Thu Dec 15 19:17:05 2011 From: e-frog at gmx.de (e-frog) Date: Thu, 15 Dec 2011 18:17:05 +0100 Subject: [Dovecot] Autosubscribe new folders In-Reply-To: <20111215154634.GB11853@PC211.ikt.de> References: <20111214161958.GA2843@PC211.ikt.de> <20111215154634.GB11853@PC211.ikt.de> Message-ID: <4EEA2B91.9050306@gmx.de> Am 15.12.2011 16:46, schrieb Dennis Guhl: > On Thu, Dec 15, 2011 at 03:03:40PM +0100, For at ll wrote: >> W dniu 14.12.2011 17:20, Dennis Guhl pisze: >>> On Wed, Dec 14, 2011 at 01:49:39PM +0100, For at ll wrote: >>>> Hi, > > [..] > >> It doesn't work. This is a part of config file about lda: >> protocol lda { > > [..] > >> lda_mailbox_autocreate = yes >> lda_mailbox_autosubscribe = yes >> } >> I have dovecot 1.2.15 > > This are directives from 2.0 which won't work with dovecot 1.2. > > IIRC dovecot 1.2 can only automatically create and subscribe > administratively defined folders on first login. > > Dennis http://wiki1.dovecot.org/LDA#Parameters Look for the -s switch /e-frog From Juergen.Obermann at hrz.uni-giessen.de Fri Dec 16 00:00:05 2011 From: Juergen.Obermann at hrz.uni-giessen.de (=?UTF-8?Q?J=C3=BCrgen_Obermann?=) Date: Thu, 15 Dec 2011 23:00:05 +0100 Subject: [Dovecot] dsync panic Message-ID: <3a8f9df5e523c0391c41964ae3d09d1b@imapproxy.hrz> Hello, when I try to convert from mbox to mdbox with dsync with one user it always panics: # /opt/local/bin/dsync -v -u userxy backup ssh root at minerva1 /opt/local/bin/dsync -v -u userxy dsync-local(userxy): Info: Papierkorb: uidnext changed: 161 != 1 dsync-local(userxy): Info: INBOX: uidnext changed: 9139 != 9105 dsync-local(userxy): Info: Trash: uidnext changed: 3924 != 3915 dsync-local(userxy): Info: Drafts: uidnext changed: 1563 != 1 dsync-local(userxy): Info: Gesendet: uidnext changed: 369 != 1 dsync-local(userxy): Info: Sent: uidnext changed: 1955 != 1 dsync-remote(userxy): Panic: Trying to allocate 2147483648 bytes dsync-remote(userxy): Error: Raw backtrace: 0xff14bc30 -> 0xff1658c0 -> 0xff15744c -> 0xff157520 -> 0xff159d90 -> 0xff156540 -> 0xff15cf5c -> 0xff156540 -> 0xff157100 -> 0xff16d158 -> 0xff16cfe8 -> 0xff26e350 -> 0x251c4 -> 0x2547c -> 0x21110 -> 0x20494 -> 0x1f230 -> 0x1f3d4 -> 0xff15e46c -> 0xff15f738 -> 0xff15e530 -> 0xff140ec8 -> 0x1525c -> 0x14608 Abort dsync-local(userxy): Error: read() from worker server failed: EOF dsync-local(userxy): Error: Unexpected reply from server: My local configuration is: # /opt/local/bin/doveconf -n # 2.0.16: /opt/local/etc/dovecot/dovecot.conf # OS: SunOS 5.10 sun4v auth_verbose = yes disable_plaintext_auth = no lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = imap.hrz.uni-giessen.de localhost mail_fsync = always mail_location = mbox:~/Mail:INBOX=/var/mail/%u mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = mail_log notify zlib managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes list = no location = prefix = Mail/ separator = / subscriptions = yes type = private } passdb { driver = pam } passdb { args = /opt/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { autocreate = Trash autocreate2 = caughtspam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = caughtspam autosubscribe3 = Sent autosubscribe4 = Drafts mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at hrz.uni-giessen.de quota_full_tempfail = yes sendmail_path = /usr/lib/sendmail service auth { client_limit = 11120 } service imap-login { process_min_avail = 16 service_count = 0 vsz_limit = 640 M } service imap { process_limit = 4096 vsz_limit = 1 G } ssl_cert = Hello, I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7. All accounts are virtual, hosted on LDAP Server. My problem is that the command: doveadm quota get -A stopped listing all accounts. I think this problem started after I changed in LDAP lookup configuration from "scope = subtree" to "scope = onelevel", because it did not occur before (I did no other changes). Now, the above command only lists 12 accounts. If I query for a particular user: doveadm quota get -u userx this works fine, but userx (and all users except those 12) is NOT listed when trying to display all users. How can I run the above command without problems again? Thanks in advance, Nick From nmilas at noa.gr Fri Dec 16 00:25:40 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Fri, 16 Dec 2011 00:25:40 +0200 Subject: [Dovecot] DKIM Verification failures Message-ID: <4EEA73E4.6080305@noa.gr> Hi, -- This message refers to the maillist itself rather than to dovecot software -- I have noticed that when I post to this list (only), I get DKIM Verification failure reports from: root at moncton.sidefx.com (e.g. for my last post: "DKIM failure report for job 4D27B5DC4E on mail.sidefx.com") root at mail.rmacd.com (e.g. for my last post: "DKIM failure report for job B69B3187F1 on mail.rmacd.com") root at mx0.roessner-net.de (e.g. for my last post: "DKIM failure report for job 6103B52092 on mx0.roessner-net.de") I have not had other DKIM failure reports from anywhere and I know that we should not have issues with it. An example from gmail: Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of nmilas at noa.gr designates 195.251.204.235 as permitted sender) smtp.mail=nmilas at noa.gr; dkim=pass header.i=@noa.gr So, whom should I contact to investigate this problem? Thanks, Nick From robert at schetterer.org Fri Dec 16 00:54:21 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 15 Dec 2011 23:54:21 +0100 Subject: [Dovecot] DKIM Verification failures In-Reply-To: <4EEA73E4.6080305@noa.gr> References: <4EEA73E4.6080305@noa.gr> Message-ID: <4EEA7A9D.9070101@schetterer.org> Am 15.12.2011 23:25, schrieb Nikolaos Milas: > Hi, > > -- This message refers to the maillist itself rather than to dovecot > software -- > > I have noticed that when I post to this list (only), I get DKIM > Verification failure reports from: > > root at moncton.sidefx.com (e.g. for my last post: "DKIM failure report > for job 4D27B5DC4E on mail.sidefx.com") > root at mail.rmacd.com (e.g. for my last post: "DKIM failure report for job > B69B3187F1 on mail.rmacd.com") > root at mx0.roessner-net.de (e.g. for my last post: "DKIM failure report > for job 6103B52092 on mx0.roessner-net.de") whois roessner-net.de and search the list archive for roessner mail address, guess it will no problem to contact and debug > > I have not had other DKIM failure reports from anywhere and I know that > we should not have issues with it. An example from gmail: > > Authentication-Results: mx.google.com; spf=pass (google.com: best guess > record for domain of nmilas at noa.gr designates 195.251.204.235 as > permitted sender) smtp.mail=nmilas at noa.gr; dkim=pass header.i=@noa.gr > > So, whom should I contact to investigate this problem? > > Thanks, > Nick From ml at smtp.fakessh.eu Fri Dec 16 03:56:55 2011 From: ml at smtp.fakessh.eu (ml) Date: Fri, 16 Dec 2011 02:56:55 +0100 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EEA6DF0.3080909@noa.gr> References: <4EEA6DF0.3080909@noa.gr> Message-ID: <20b427c7163c0ebb3e8c90603f460b5a@roundcube.fakessh.eu> Le 2011-12-15 23:00, Nikolaos Milas a ?crit?: > Hello, > > I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7. > > All accounts are virtual, hosted on LDAP Server. > > My problem is that the command: > > doveadm quota get -A > > stopped listing all accounts. I think this problem started after I > changed in LDAP lookup configuration from "scope = subtree" to "scope > = onelevel", because it did not occur before (I did no other > changes). > > Now, the above command only lists 12 accounts. If I query for a > particular user: > > doveadm quota get -u userx > > this works fine, but userx (and all users except those 12) is NOT > listed when trying to display all users. > > How can I run the above command without problems again? > > Thanks in advance, > Nick upgrade to the latest rpm i any problem with the last release -- http://pgp.mit.edu:11371/pks/lookup?op=get&search=0x092164A7 gpg --keyserver pgp.mit.edu --recv-key 092164A7 http://urlshort.eu fakessh @ http://gplus.to/sshfake http://gplus.to/sshswilting http://gplus.to/john.swilting From nmilas at noa.gr Fri Dec 16 10:30:28 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Fri, 16 Dec 2011 10:30:28 +0200 Subject: [Dovecot] DKIM Verification failures In-Reply-To: <4EEA7A9D.9070101@schetterer.org> References: <4EEA73E4.6080305@noa.gr> <4EEA7A9D.9070101@schetterer.org> Message-ID: <4EEB01A4.3030507@noa.gr> On 16/12/2011 12:54 ??, Robert Schetterer wrote: > whois roessner-net.de > > and search the list archive for > > roessner mail address, guess it will no problem to contact and debug Thanks, I've found and privately emailed the affected members. Nick From nmilas at noa.gr Fri Dec 16 11:09:39 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Fri, 16 Dec 2011 11:09:39 +0200 Subject: [Dovecot] Calculation of suggested vsz_limit values Message-ID: <4EEB0AD3.20001@noa.gr> Hello, I would like to ask on suggested vsz_limit values. Is there any way of calculating such values? How should we determine them? I don't want to risk wrong values (and possible errors) on a production system, if I upgrade to 2.0.16 where vsz_limit values are enforced (I read release notes)! If there is no standard way of calculation, could someone please check the following info and suggest some values? I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7 (as a VM on a KVM Host). All accounts are virtual, hosted on LDAP Server. We have about 250 mailboxes of 4GB each (in practice, only a couple of mailboxes ever reach 1GB so we are "over-booking"). It is a relatively low-load server. Memory status and config follows below. Thanks, Nick The server memory condition is as follows: # vmstat procs -----------memory---------- ---swap-- -----io---- --system-- -----cpu------ r b swpd free buff cache si so bi bo in cs us sy id wa st 0 0 92 62400 212324 1299604 0 0 397 235 70 39 4 2 89 4 0 # free -m total used free shared buffers cached Mem: 2010 1951 59 0 207 1269 -/+ buffers/cache: 474 1536 Swap: 2015 0 2015 ---------- Config Start ------------- # 2.0.13: dovecot.conf protocols = imap pop3 mail_location = maildir:~/Maildir/ mail_gid = 500 mail_uid = 500 auth_mechanisms = plain login auth_username_format = %Lu auth_verbose = yes disable_plaintext_auth = no mail_plugins = quota protocol imap { imap_client_workarounds = "delay-newmail " mail_plugins = quota imap_quota } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = log_path = mail_plugins = quota postmaster_address = sysadmin at example.com sendmail_path = /usr/lib/sendmail } userdb { args = /etc/dovecot/dovecot-usrdb-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-passdb-ldap.conf driver = ldap } plugin { quota = maildir:User quota quota_rule = *:storage=4G quota_rule2 = Trash:storage=+3%% quota_warning = storage=75%% quota-warning 75 %u quota_warning2 = storage=90%% quota-warning 90 %u } service quota-warning { executable = script /opt/mail1.sh user = vmail unix_listener quota-warning { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service imap-login { service_count = 1 vsz_limit = 64 M } service pop3-login { service_count = 1 vsz_limit = 64 M } ssl_ca = Hi, I'm working for tuning a busy cluster of dovecot servers. Heach server as 4 core, 8GB of RAM and provide POP3 and IMAP access to mailbox. OS is Debian 6.0 and dovecot version is 1.2.15. I am unsure how to set "login_max_processes_count" and "login_max_connections" for reach the best situation when login_process_per_connection is set to no. I don't know what value to set login_max_processes_count. For example is better the first or the second configuration? login_process_per_connection=no login_processes_count=4 login_max_processes_count=8 login_max_connections=512 login_process_size=128 login_process_per_connection=no login_processes_count=4 login_max_processes_count=16 login_max_connections=256 login_process_size=128 Which is a suggested ratio from login_max_processes_count and login_max_connections ? Other values are correct? Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it @ LOLUG -> Socio http://www.lolug.net From scott_the_musician at yahoo.com.au Fri Dec 16 15:24:08 2011 From: scott_the_musician at yahoo.com.au (Scott Lewis) Date: Fri, 16 Dec 2011 05:24:08 -0800 (PST) Subject: [Dovecot] simultaneous scripts not running via sieve_before In-Reply-To: <4EE62AFD.90700@rename-it.nl> References: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> <1329235723.20111212135759@gmail.com> <4EE62AFD.90700@rename-it.nl> Message-ID: <1324041848.73103.YahooMailNeo@web130103.mail.mud.yahoo.com> Thanks for the advise - it worked a treat! Glad to finally have this sieve stuff under control, after weeks of trying to get it working :) ________________________________ From: Stephan Bosch To: Duane Hill Cc: dovecot at dovecot.org Sent: Tuesday, 13 December 2011 3:25 AM Subject: Re: [Dovecot] simultaneous scripts not running via sieve_before Op 12/12/2011 2:57 PM, Duane Hill schreef: > On Monday, December 12, 2011 at 13:02:05 UTC, scott_the_musician at yahoo.com.au confabulated: >> protocol lda { >> mail_plugins = sieve quota >> sieve=~/.dovecot.sieve >> sieve_extentions = +include >> sieve_dir=~/sieve >> sieve_before = /home/%u/sieve/redirect.svbin >> sieve_global_path = /etc/globalsieverc.svbin >> [/code] > sieve_before? and? sieve_after are directories where extra scripts are > run sequentially before user scripts and after user scripts. See: > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration It can be a file, but then it must point to the sieve script (in this case redirect.sieve) and not to the compiled binary (redirect.svbin in this case). Regards, Stephan. From carloswill at gmail.com Fri Dec 16 18:15:42 2011 From: carloswill at gmail.com (Carlos Mennens) Date: Fri, 16 Dec 2011 11:15:42 -0500 Subject: [Dovecot] Strange Login / Timeout Sessions Message-ID: I have my webmail application tied to Postfix / Dovecot server & now for some reason the IMAP sessions oddly time out throughout the day and then logging back into the mail system over the web is painfully slow. The only thing I've seen that fixes it is to reload the Dovecot daemon in Linux: /etc/init.d/dovecot reload Once that command is ran, my webmail login is super fast and moving from folder to folder is extremely fast again. Then in about a few hours, the session will time out and this problem repeats. The problem is the same for everyone and not just a few user accounts. Anyone have any idea what I should be looking for or looking at? My Dovecot logs or mixed in /var/log/maillog which is extremely hard to watch live & gets mixed with Postfix, Amavisd, and Postgrey. Any ideas or suggestions to narrow this problem out? I'm running Dovecot-1.0.7-7.el5_7.1. I saw this load on the console today: Error: Dovecot is already running with PID 2334 (read from /var/run/dovecot/master.pid) Fatal: Invalid configuration in /etc/dovecot.conf Below is my configuration file: [root at mail ~]# dovecot -n # 1.0.7: /etc/dovecot.conf protocols: imap ssl_ca_file: /etc/ssl/certs/digicert.crt ssl_cert_file: ***OMIT*** ssl_key_file: ***OMIT*** login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:~/Maildir auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix From john at adeptivesw.com Fri Dec 16 21:20:17 2011 From: john at adeptivesw.com (John Brock) Date: Fri, 16 Dec 2011 12:20:17 -0700 Subject: [Dovecot] logging deletion of emails through IMAP? Message-ID: <4EEB99F1.7040702@adeptivesw.com> Version 1.2.16: Is there some way to enable logging for when emails are deleted via IMAP? All I see are log entries for users logging in/logging out. It would be nice to know when an email is deleted, and from which IP address the user was logged in when s/he deleted the email. -- John Brock Adeptive Software 303-554-0301 x1 From e-frog at gmx.de Fri Dec 16 21:29:45 2011 From: e-frog at gmx.de (e-frog) Date: Fri, 16 Dec 2011 20:29:45 +0100 Subject: [Dovecot] logging deletion of emails through IMAP? In-Reply-To: <4EEB99F1.7040702@adeptivesw.com> References: <4EEB99F1.7040702@adeptivesw.com> Message-ID: <4EEB9C29.10607@gmx.de> On 16.12.2011 20:20, wrote John Brock: > Version 1.2.16: Is there some way to enable logging for when emails are > deleted via IMAP? All I see are log entries for users logging in/logging > out. It would be nice to know when an email is deleted, and from which > IP address the user was logged in when s/he deleted the email. > The maillog plugin is what you are looking for: http://wiki1.dovecot.org/Plugins/MailLog From stephan at rename-it.nl Sat Dec 17 01:25:21 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 17 Dec 2011 00:25:21 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features Message-ID: <4EEBD361.2090809@rename-it.nl> Hello Dovecot users, Pigeonhole v0.3 for Dovecot v2.1 has two new features I would like you to play with before I make a first release: 1) The new Sieve editheader extension (http://tools.ietf.org/html/rfc5293). This allows modifying the headers of the message before delivery. This is actually the first implemented extension that can modify the message itself in any way. This feature adds quite a bit of new code that I'd like to see tested more thoroughly. 2) The new sieve-filter tool (documented in the sieve-filter(1) man page upon installation). This allows (re-)filtering messages that are already stored in a particular mailbox. It preserves the assigned IMAP flags and keywords and using the imap4flags extension these can also be modified. It also plays nice with the editheader extension. Judging by postings in this mailing list from the last few years, this is a highly-demanded feature and I'm glad that I finally got around to finish this thing. If the new sieve-filter tool is lacking certain features in your opinion, just let me know. Needless to say: read the man page carefully and watch out with important mail. This is currently only available from the mercurial repository, but if you prefer to have an .rc1 release first, just tell me and I'll make one. The automatic Debian repository already includes these features. Regards, Stephan. From robert at schetterer.org Sat Dec 17 02:13:20 2011 From: robert at schetterer.org (Robert Schetterer) Date: Sat, 17 Dec 2011 01:13:20 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features In-Reply-To: <4EEBD361.2090809@rename-it.nl> References: <4EEBD361.2090809@rename-it.nl> Message-ID: <4EEBDEA0.7000004@schetterer.org> Am 17.12.2011 00:25, schrieb Stephan Bosch: > Hello Dovecot users, > > Pigeonhole v0.3 for Dovecot v2.1 has two new features I would like you > to play with before I make a first release: dove 2.1 only? > > 1) The new Sieve editheader extension > (http://tools.ietf.org/html/rfc5293). This allows modifying the headers > of the message before delivery. This is actually the first implemented > extension that can modify the message itself in any way. This feature > adds quite a bit of new code that I'd like to see tested more thoroughly. > > 2) The new sieve-filter tool (documented in the sieve-filter(1) man page > upon installation). is there an online version ? This allows (re-)filtering messages that are already > stored in a particular mailbox. It preserves the assigned IMAP flags and > keywords and using the imap4flags extension these can also be modified. > It also plays nice with the editheader extension. Judging by postings in > this mailing list from the last few years, this is a highly-demanded > feature and I'm glad that I finally got around to finish this thing. If > the new sieve-filter tool is lacking certain features in your opinion, > just let me know. Needless to say: read the man page carefully and watch > out with important mail. > > This is currently only available from the mercurial repository, but if > you prefer to have an .rc1 release first, just tell me and I'll make > one. The automatic Debian repository already includes these features. thats fine > > Regards, > > Stephan. > > > > > > From stephan at rename-it.nl Sat Dec 17 02:48:20 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 17 Dec 2011 01:48:20 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features In-Reply-To: <4EEBDEA0.7000004@schetterer.org> References: <4EEBD361.2090809@rename-it.nl> <4EEBDEA0.7000004@schetterer.org> Message-ID: <4EEBE6D4.5030304@rename-it.nl> On 12/17/2011 1:13 AM, Robert Schetterer wrote: > Am 17.12.2011 00:25, schrieb Stephan Bosch: >> Hello Dovecot users, >> >> Pigeonhole v0.3 for Dovecot v2.1 has two new features I would like you >> to play with before I make a first release: > dove 2.1 only? Yes. >> 1) The new Sieve editheader extension >> (http://tools.ietf.org/html/rfc5293). This allows modifying the headers >> of the message before delivery. This is actually the first implemented >> extension that can modify the message itself in any way. This feature >> adds quite a bit of new code that I'd like to see tested more thoroughly. >> >> 2) The new sieve-filter tool (documented in the sieve-filter(1) man page >> upon installation). > is there an online version ? Well, now there is: I've produced html output for the current version of the man pages: http://pigeonhole.dovecot.org/doc/man1/sieve-filter.1.html Regards, Stephan. From robert at schetterer.org Sat Dec 17 08:42:13 2011 From: robert at schetterer.org (Robert Schetterer) Date: Sat, 17 Dec 2011 07:42:13 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features In-Reply-To: <4EEBE6D4.5030304@rename-it.nl> References: <4EEBD361.2090809@rename-it.nl> <4EEBDEA0.7000004@schetterer.org> <4EEBE6D4.5030304@rename-it.nl> Message-ID: <4EEC39C5.8010404@schetterer.org> Am 17.12.2011 01:48, schrieb Stephan Bosch: > On 12/17/2011 1:13 AM, Robert Schetterer wrote: >> Am 17.12.2011 00:25, schrieb Stephan Bosch: >>> Hello Dovecot users, >>> >>> Pigeonhole v0.3 for Dovecot v2.1 has two new features I would like you >>> to play with before I make a first release: >> dove 2.1 only? > > Yes. > >>> 1) The new Sieve editheader extension >>> (http://tools.ietf.org/html/rfc5293). This allows modifying the headers >>> of the message before delivery. This is actually the first implemented >>> extension that can modify the message itself in any way. This feature >>> adds quite a bit of new code that I'd like to see tested more >>> thoroughly. >>> >>> 2) The new sieve-filter tool (documented in the sieve-filter(1) man page >>> upon installation). >> is there an online version ? > > Well, now there is: I've produced html output for the current version of > the man pages: > > http://pigeonhole.dovecot.org/doc/man1/sieve-filter.1.html > > Regards, > > Stephan. > > thx Stephan -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From c at roessner-network-solutions.com Sun Dec 18 18:14:45 2011 From: c at roessner-network-solutions.com (Christian =?ISO-8859-1?B?UvbfbmVy?=) Date: Sun, 18 Dec 2011 17:14:45 +0100 Subject: [Dovecot] DKIM Verification failures In-Reply-To: <4EEA7A9D.9070101@schetterer.org> Message-ID: Hello, First of all: I am really, really sorry for all of you that got DKIM failure reports from my server! That was never my intention! I had some feedback from one of the Dovecot's users who contacted me and informed me about this circumstances. As soon as I new about it, I disabled the reports feature. It seems that there do exist problems with DKIM and some mailing lists. Not only with my mail server. I have found several SSL errors, when OpenDKIM tries to verify signatures that came from a mailing list. And in turn my MTA tried to send a report to focus on that problem. Yet I can not say, what is going wrong here, but OpenDKIM is really sensitive, if something is wrong with a signature. So as of writing this, you do not get any further report messages. For those of you, who would like to find out, what caused these reports are welcome to contact me. Maybe we can find the problem and eliminate it (maybe a bug in OpenDKIM, mailman, whatever. I don't think it's part of my configuration and therefor several other people might have this problem as well). Thanks in advance Christian Roessner Am 15.12.11 23:54 schrieb "Robert Schetterer" unter : >Am 15.12.2011 23:25, schrieb Nikolaos Milas: >> Hi, >> >> -- This message refers to the maillist itself rather than to dovecot >> software -- >> >> I have noticed that when I post to this list (only), I get DKIM >> Verification failure reports from: >> >> root at moncton.sidefx.com (e.g. for my last post: "DKIM failure report >> for job 4D27B5DC4E on mail.sidefx.com") >> root at mail.rmacd.com (e.g. for my last post: "DKIM failure report for job >> B69B3187F1 on mail.rmacd.com") > >> root at mx0.roessner-net.de (e.g. for my last post: "DKIM failure report >> for job 6103B52092 on mx0.roessner-net.de") > > > > > >whois roessner-net.de > >and search the list archive for > >roessner mail address, guess it will no problem to contact and debug > >> >> I have not had other DKIM failure reports from anywhere and I know that >> we should not have issues with it. An example from gmail: >> >> Authentication-Results: mx.google.com; spf=pass (google.com: best guess >> record for domain of nmilas at noa.gr designates 195.251.204.235 as >> permitted sender) smtp.mail=nmilas at noa.gr; dkim=pass header.i=@noa.gr >> >> So, whom should I contact to investigate this problem? >> >> Thanks, >> Nick > From profymath at yahoo.com Sun Dec 18 21:05:38 2011 From: profymath at yahoo.com (I M) Date: Sun, 18 Dec 2011 11:05:38 -0800 (PST) Subject: [Dovecot] One important question! Message-ID: <1324235138.51268.YahooMailClassic@web125604.mail.ne1.yahoo.com> Hello!Please, give me a feedback as soon as you can! I need some advice regarding ?"dovecot?self signed certificate" configuration!If you have any experience in working with php IMAP-module that would be useful for me to know what would you say about below: ? Problem: I can connect to my INBOX through telnet, but I cannot do it through imap-functions (Certificate failure for ...)? My best,Edward. From user+dovecot at localhost.localdomain.org Sun Dec 18 21:12:07 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sun, 18 Dec 2011 20:12:07 +0100 Subject: [Dovecot] OT: PHP imap_open [was: One important question!] In-Reply-To: <1324235138.51268.YahooMailClassic@web125604.mail.ne1.yahoo.com> References: <1324235138.51268.YahooMailClassic@web125604.mail.ne1.yahoo.com> Message-ID: <4EEE3B07.4070907@localhost.localdomain.org> On 12/18/2011 08:05 PM I M wrote: > Hello!Please, give me a feedback as soon as you can! > I need some advice regarding "dovecot self signed certificate" configuration!If you have any experience in working with php IMAP-module that would be useful for me to know what would you say about below: > Problem: I can connect to my INBOX through telnet, but I cannot do it through imap-functions (Certificate failure for ...)? > My best,Edward. http://php.net/manual/en/function.imap-open.php#refsect1-function.imap-open-parameters ? /novalidate-cert do not validate certificates from TLS/SSL server, needed if server uses self-signed certificates ? Regards, Pascal -- The trapper recommends today: 5e1f1e55.1135220 at localdomain.org From cor at xs4all.nl Mon Dec 19 01:32:43 2011 From: cor at xs4all.nl (Cor Bosman) Date: Mon, 19 Dec 2011 00:32:43 +0100 Subject: [Dovecot] crashes on 2.0.16 Message-ID: Hey all, I upgraded some servers today from Debian Lenny to Debian Squeeze, and after the upgrade I started getting dovecot crashes. I was on 2.0.13 but got these there as well, and hoped upgrading to 2.0.16 would help. It didn't. Anyone have an idea? Cor Dec 18 23:32:21 userimap1 kernel: [263492.245530] __ratelimit: 122 callbacks suppressed Dec 18 23:32:21 userimap1 kernel: [263492.245536] imap[19665]: segfault at 7f108efb7f60 ip 00007f108ecd37e0 sp 00007fff73c3d658 error 5 in libc-2.11.2.so[7f108ec5d000+158000] Dec 18 23:32:21 userimap1 kernel: [263492.245663] BUG: Bad page map in process imap pte:00000001 pmd:09767067 Dec 18 23:32:21 userimap1 kernel: [263492.252563] page:ffffea0000000000 flags:(null) count:-84 mapcount:-84 mapping:(null) index:0 Dec 18 23:32:21 userimap1 kernel: [263492.261186] addr:00007f108ef46000 vm_flags:08000070 anon_vma:(null) mapping:ffff88012b6e5238 index:2e9 Dec 18 23:32:21 userimap1 kernel: [263492.270804] vma->vm_ops->fault: filemap_fault+0x0/0x460 Dec 18 23:32:21 userimap1 kernel: [263492.276172] vma->vm_file->f_op->mmap: generic_file_mmap+0x0/0x60 Dec 18 23:32:21 userimap1 kernel: [263492.282424] Pid: 19665, comm: imap Tainted: G B 2.6.32.36-xsserver #1 Dec 18 23:32:21 userimap1 kernel: [263492.282429] Call Trace: Dec 18 23:32:21 userimap1 kernel: [263492.282441] [] print_bad_pte+0x1d5/0x280 Dec 18 23:32:21 userimap1 kernel: [263492.282448] [] unmap_vmas+0xa1a/0xa20 Dec 18 23:32:21 userimap1 kernel: [263492.282458] [] ? sch_direct_xmit+0x81/0x1d0 Dec 18 23:32:21 userimap1 kernel: [263492.282465] [] exit_mmap+0xbd/0x190 Dec 18 23:32:21 userimap1 kernel: [263492.282473] [] mmput+0x4d/0x120 Dec 18 23:32:21 userimap1 kernel: [263492.282481] [] exit_mm+0x112/0x150 Dec 18 23:32:21 userimap1 kernel: [263492.282488] [] do_exit+0x13d/0x800 Dec 18 23:32:21 userimap1 kernel: [263492.282496] [] ? __dequeue_signal+0xe1/0x200 Dec 18 23:32:21 userimap1 kernel: [263492.282503] [] do_group_exit+0x55/0xd0 Dec 18 23:32:21 userimap1 kernel: [263492.282510] [] get_signal_to_deliver+0x1e1/0x3e0 Dec 18 23:32:21 userimap1 kernel: [263492.282517] [] do_signal+0x75/0x7d0 Dec 18 23:32:21 userimap1 kernel: [263492.282523] [] ? print_vma_addr+0xb3/0x120 Dec 18 23:32:21 userimap1 kernel: [263492.282533] [] ? printk+0x41/0x43 Dec 18 23:32:21 userimap1 kernel: [263492.282541] [] ? __bad_area_nosemaphore+0xf6/0x1e0 Dec 18 23:32:21 userimap1 kernel: [263492.282547] [] ? bad_area_access_error+0x4e/0x60 Dec 18 23:32:21 userimap1 kernel: [263492.282553] [] do_notify_resume+0x57/0x60 Dec 18 23:32:21 userimap1 kernel: [263492.282559] [] retint_signal+0x48/0x8c # 2.0.16: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 auth_cache_size = 1 M auth_verbose = yes base_dir = /var/run/dovecot/ default_vsz_limit = 2 G disable_plaintext_auth = no first_valid_uid = 20 lock_method = dotlock login_greeting = User-IMAP ready. login_trusted_networks = 194.109.26.128/27 mail_fsync = always mail_nfs_index = yes mail_nfs_storage = yes mailbox_idle_check_interval = 1 mins maildir_stat_dirs = yes mmap_disable = yes namespace { inbox = yes location = maildir:%Nu:INDEX=/var/spool/mail/dovecot-control/indexes/%1u/%2u/%u:INBOX=%Nu:CONTROL=/var/spool/mail/dovecot-control/%1u/%2u/%u/INBOX prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot.masterusers driver = passwd-file master = yes } passdb { args = cache_key=%u%r dovecot driver = pam } plugin { quota = fs:User quota } protocols = imap service auth { client_limit = 5000 } service imap-login { process_min_avail = 8 service_count = 0 vsz_limit = 2 G } service imap { process_limit = 4096 vsz_limit = 2 G } shutdown_clients = no ssl_cert = References: Message-ID: <1324256311.8138.5.camel@tardis> Have you tried using a modern kernel? that one is about 2 years old. On Mon, 2011-12-19 at 00:32 +0100, Cor Bosman wrote: > Hey all, I upgraded some servers today from Debian Lenny to Debian Squeeze, and after the upgrade I started getting dovecot crashes. I was on 2.0.13 but got these there as well, and hoped upgrading to 2.0.16 would help. It didn't. Anyone have an idea? > > Cor > # 2.0.16: /usr/local/etc/dovecot/dovecot.conf > # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From sven at svenhartge.de Mon Dec 19 03:32:20 2011 From: sven at svenhartge.de (Sven Hartge) Date: Mon, 19 Dec 2011 02:32:20 +0100 Subject: [Dovecot] crashes on 2.0.16 References: <1324256311.8138.5.camel@tardis> Message-ID: Noel Butler wrote: > On Mon, 2011-12-19 at 00:32 +0100, Cor Bosman wrote: >> # 2.0.16: /usr/local/etc/dovecot/dovecot.conf >> # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 > Have you tried using a modern kernel? that one is about 2 years old. Well, this _is_ the kernel from Debian Stable and based on the Long-Term-Release from the kernel maintainers. Besides, from the suffix i assume this may be a virtual server, so it may be not possible for Cor to even change the kernel himself. Gr??e, Sven. -- Sigmentation fault. Core dumped. From noel.butler at ausics.net Mon Dec 19 05:13:58 2011 From: noel.butler at ausics.net (Noel Butler) Date: Mon, 19 Dec 2011 13:13:58 +1000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: <1324256311.8138.5.camel@tardis> Message-ID: <1324264438.11142.9.camel@tardis> On Mon, 2011-12-19 at 02:32 +0100, Sven Hartge wrote: > Noel Butler wrote: > > On Mon, 2011-12-19 at 00:32 +0100, Cor Bosman wrote: > > >> # 2.0.16: /usr/local/etc/dovecot/dovecot.conf > >> # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 > > > Have you tried using a modern kernel? that one is about 2 years old. > > Well, this _is_ the kernel from Debian Stable and based on the > Long-Term-Release from the kernel maintainers. So what? It is not anything current, that the kernel dev team would waste their time on. Please remember, there is a massive difference between the kernel maintainers, and the debian kernel package maintainers, do not confuse the two, because the later have nothing to do with the former. > > Besides, from the suffix i assume this may be a virtual server, so it > may be not possible for Cor to even change the kernel himself. > Given who Cor is, I'd be actually horrified if he was running any of his plethora of mail servers on a virtual server. hint: don't read too much into the uname value. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From nmilas at noa.gr Mon Dec 19 09:31:45 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Mon, 19 Dec 2011 09:31:45 +0200 Subject: [Dovecot] Calculation of suggested vsz_limit values In-Reply-To: <4EEB0AD3.20001@noa.gr> References: <4EEB0AD3.20001@noa.gr> Message-ID: <4EEEE861.2010503@noa.gr> Hi, No hints about vsz_limit values? Anyone? Thanks, Nick On 16/12/2011 11:09 ??, Nikolaos Milas wrote: > Hello, > > I would like to ask on suggested vsz_limit values. > > Is there any way of calculating such values? How should we determine > them? I don't want to risk wrong values (and possible errors) on a > production system, if I upgrade to 2.0.16 where vsz_limit values are > enforced (I read release notes)! > > If there is no standard way of calculation, could someone please check > the following info and suggest some values? > > I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7 (as a > VM on a KVM Host). > > All accounts are virtual, hosted on LDAP Server. We have about 250 > mailboxes of 4GB each (in practice, only a couple of mailboxes ever > reach 1GB so we are "over-booking"). It is a relatively low-load server. > > Memory status and config follows below. > > Thanks, > Nick > > The server memory condition is as follows: > > # vmstat > procs -----------memory---------- ---swap-- -----io---- --system-- > -----cpu------ > r b swpd free buff cache si so bi bo in cs us > sy id wa st > 0 0 92 62400 212324 1299604 0 0 397 235 70 39 4 > 2 89 4 0 > > # free -m > total used free shared buffers cached > Mem: 2010 1951 59 0 207 1269 > -/+ buffers/cache: 474 1536 > Swap: 2015 0 2015 > > ---------- Config Start ------------- > > # 2.0.13: dovecot.conf > > protocols = imap pop3 > > mail_location = maildir:~/Maildir/ > mail_gid = 500 > mail_uid = 500 > > auth_mechanisms = plain login > auth_username_format = %Lu > auth_verbose = yes > disable_plaintext_auth = no > > mail_plugins = quota > > protocol imap { > imap_client_workarounds = "delay-newmail " > mail_plugins = quota imap_quota > } > > protocol pop3 { > mail_max_userip_connections = 3 > mail_plugins = quota > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > pop3_uidl_format = %08Xu%08Xv > } > > protocol lda { > auth_socket_path = /var/run/dovecot/auth-master > info_log_path = > log_path = > mail_plugins = quota > postmaster_address = sysadmin at example.com > sendmail_path = /usr/lib/sendmail > } > > userdb { > args = /etc/dovecot/dovecot-usrdb-ldap.conf > driver = ldap > } > > passdb { > args = /etc/dovecot/dovecot-passdb-ldap.conf > driver = ldap > } > > plugin { > quota = maildir:User quota > quota_rule = *:storage=4G > quota_rule2 = Trash:storage=+3%% > quota_warning = storage=75%% quota-warning 75 %u > quota_warning2 = storage=90%% quota-warning 90 %u > } > > service quota-warning { > executable = script /opt/mail1.sh > user = vmail > unix_listener quota-warning { > user = vmail > } > } > > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-master { > group = vmail > mode = 0660 > user = vmail > } > user = root > } > > service imap-login { > service_count = 1 > vsz_limit = 64 M > } > > service pop3-login { > service_count = 1 > vsz_limit = 64 M > } > > ssl_ca = ssl_cert = ssl_key = > syslog_facility = local1 > > ---------- Config End ------------- > > From bigmoozer at gmail.com Mon Dec 19 11:27:18 2011 From: bigmoozer at gmail.com (moozer) Date: Mon, 19 Dec 2011 10:27:18 +0100 Subject: [Dovecot] IMAP and sieve Message-ID: <4EEF0376.404@gmail.com> I am currently setting up an IMAP server for archiving purposes. The goal is to drag an email to the IMAP folder, and then have a server-side sieve script to put it in the right folder. One of the sources used was this wiki entry http://wiki.dovecot.org/LDA/Sieve/Dovecot I added the mail_plugins = sieve to /etc/dovecot/15-lda.conf and after some exim4 fiddling, mails delivered are filtered by my sieve script. Doing the same for imap delivery (in /etc/dovecot/20-imap.conf) give the following error Dec 19 10:22:09 leon dovecot: imap: Error: dlopen(/usr/lib/dovecot/modules/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_save_open Dec 19 10:22:09 leon dovecot: imap: Error: Can't load plugin sieve_plugin: Plugin is intended to be used only by binaries: lda lmtp (we're imap) Dec 19 10:22:09 leon dovecot: imap: Fatal: Couldn't load required plugins Dec 19 10:22:10 leon dovecot: imap: Error: dlopen(/usr/lib/dovecot/modules/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_save_open Dec 19 10:22:10 leon dovecot: imap: Error: Can't load plugin sieve_plugin: Plugin is intended to be used only by binaries: lda lmtp (we're imap) Dec 19 10:22:10 leon dovecot: imap: Fatal: Couldn't load required plugins I notice this part: "plugin is intended to be used only by binaries: lda lmtp (we're imap)" So the question is if it is possible to run sieve server-side sieve scripts on emails copied using IMAP. Suggestions are most welcome. Moozer -- I am running debian testing # dovecot --version 2.0.15 From stephan at rename-it.nl Mon Dec 19 11:45:18 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 19 Dec 2011 10:45:18 +0100 Subject: [Dovecot] IMAP and sieve In-Reply-To: <4EEF0376.404@gmail.com> References: <4EEF0376.404@gmail.com> Message-ID: <4EEF07AE.3010503@rename-it.nl> On 12/19/2011 10:27 AM, moozer wrote: > I am currently setting up an IMAP server for archiving purposes. The > goal is to drag an email to the IMAP folder, and then have a server-side > sieve script to put it in the right folder. [...] > I notice this part: > "plugin is intended to be used only by binaries: lda lmtp (we're imap)" > > So the question is if it is possible to run sieve server-side sieve > scripts on emails copied using IMAP. Not directly. There is some standardization effort done to achieve something like that: http://tools.ietf.org/html/draft-ietf-sieve-imap-sieve-02 But this is not implemented so far. > Suggestions are most welcome. What you can do is run the Sieve filter in some (in)cron job (or by means of some other trigger). For Dovecot v2.1 there is now a special sieve-filter command line tool to perform the filtering on a folder. However, it is not released yet. For older Dovecot versions you can use this recipe to re-filter mail: http://wiki2.dovecot.org/HowTo/RefilterMail Regards, Stephan. From bigmoozer at gmail.com Mon Dec 19 11:56:57 2011 From: bigmoozer at gmail.com (moozer) Date: Mon, 19 Dec 2011 10:56:57 +0100 Subject: [Dovecot] IMAP and sieve In-Reply-To: <4EEF07AE.3010503@rename-it.nl> References: <4EEF0376.404@gmail.com> <4EEF07AE.3010503@rename-it.nl> Message-ID: <4EEF0A69.7040105@gmail.com> On 2011-12-19 10:45, Stephan Bosch wrote: > On 12/19/2011 10:27 AM, moozer wrote: >> I am currently setting up an IMAP server for archiving purposes. The >> goal is to drag an email to the IMAP folder, and then have a server-side >> sieve script to put it in the right folder. > [...] >> I notice this part: >> "plugin is intended to be used only by binaries: lda lmtp (we're imap)" >> >> So the question is if it is possible to run sieve server-side sieve >> scripts on emails copied using IMAP. > > Not directly. There is some standardization effort done to achieve > something like that: > > http://tools.ietf.org/html/draft-ietf-sieve-imap-sieve-02 > > But this is not implemented so far. > This is the exact thing I was looking for. Too bad that I am ahead of my time :-) >> Suggestions are most welcome. > > What you can do is run the Sieve filter in some (in)cron job (or by > means of some other trigger). For Dovecot v2.1 there is now a special > sieve-filter command line tool to perform the filtering on a folder. > However, it is not released yet. > > For older Dovecot versions you can use this recipe to re-filter mail: > > http://wiki2.dovecot.org/HowTo/RefilterMail > At first glance it looks like using dovecot as a generic IMAP server, fetch mail, run filters and ask the IMAP server to move the mail. It could work also. > Regards, > > Stephan. > > Thank you for a good answer. I will reevaluate my plan based on this. moozer From alec at alec.pl Mon Dec 19 12:06:35 2011 From: alec at alec.pl (A.L.E.C) Date: Mon, 19 Dec 2011 11:06:35 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features In-Reply-To: <4EEBD361.2090809@rename-it.nl> References: <4EEBD361.2090809@rename-it.nl> Message-ID: <4EEF0CAB.4080307@alec.pl> On 17.12.2011 00:25, Stephan Bosch wrote: > 2) The new sieve-filter tool (documented in the sieve-filter(1) man page > upon installation). This allows (re-)filtering messages that are already > stored in a particular mailbox. This is really nice. I'd love to see this tool integrated with IMAP (or MANAGESIEVE) protocol somehow. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From profymath at yahoo.com Mon Dec 19 20:19:07 2011 From: profymath at yahoo.com (I M) Date: Mon, 19 Dec 2011 10:19:07 -0800 (PST) Subject: [Dovecot] OT: PHP imap_open [was: One important question!] In-Reply-To: <4EEE3B07.4070907@localhost.localdomain.org> Message-ID: <1324318747.92715.YahooMailClassic@web125606.mail.ne1.yahoo.com> Thank you for the response,?Pascal!But I have read the all flags and functions that might be useful for this problem before sending this letter.Please, find one more minute to know what I've done yet! 1. I installed MTA (sendmail) first. Then tuned it for receiving and sending emails outside of localhost. As for MDA I used "MAILER(`local')" as dovecot has built in one!?2. I installed IMAP Server (dovecot). I made it working in PLAIN ?LOGIN mode on imap protocol. But as you know it doesn't mean that dovecot won't use SSL/TLS. So we are going to transmit out data as a plain text inside SSL/TLS. (see http://wiki1.dovecot.org/SSL, "...?Some clients unfortunately try to do plaintext authentication without STARTTLS, even when IMAP server has told the client that it won't work." ). So when you try to disable ssl-support in dovecot.conf, you are going to get the message "SECURITY PROBLEM: insecure server advertised AUTH=PLAIN ...". The same message you get when putting "/notls" flag. That why I thought It might be a certificate configuration problem on the client side! Cause when I tried to put the /novalidate-cert flag in string "$mbox = imap_open("{XXXXXX.com:143/novalidate-cert}","user_name","user_password");" I immediately got the ?message: "Undefined variable: mbox in ...". Also keep in mind that the connection to imap server (dovecot) can be established through telnet. So my guess is around misconfiguration of php5-imap module! I've also checked apache-server configuration cause it could also be a problem as I use php-functions on webserver environment. So what would you say?Please, correct me if I am wrong.Thanks again for the response and, please give me a feedback as soon as you can! My best,Edward. ? --- On?Sun, 12/18/11, Pascal Volk?wrote: From: Pascal Volk Subject: [Dovecot] OT: PHP imap_open [was: One important question!] To: "Dovecot Mailing List" Date: Sunday, December 18, 2011, 2:12 PM On 12/18/2011 08:05 PM I M wrote: > Hello!Please, give me a feedback as soon as you can! > I need some advice regarding? "dovecot self signed certificate" configuration!If you have any experience in working with php IMAP-module that would be useful for me to know what would you say about below:?? > Problem: I can connect to my INBOX through telnet, but I cannot do it through imap-functions (Certificate failure for ...)? > My best,Edward. http://php.net/manual/en/function.imap-open.php#refsect1-function.imap-open-parameters ? /novalidate-cert ??? do not validate certificates from TLS/SSL server, needed if ??? server uses self-signed certificates ? Regards, Pascal --? The trapper recommends today:5e1f1e55.1135220 at localdomain.org --- On Sun, 12/18/11, Pascal Volk wrote: From: Pascal Volk Subject: [Dovecot] OT: PHP imap_open [was: One important question!] To: "Dovecot Mailing List" Date: Sunday, December 18, 2011, 2:12 PM On 12/18/2011 08:05 PM I M wrote: > Hello!Please, give me a feedback as soon as you can! > I need some advice regarding? "dovecot self signed certificate" configuration!If you have any experience in working with php IMAP-module that would be useful for me to know what would you say about below:? > Problem: I can connect to my INBOX through telnet, but I cannot do it through imap-functions (Certificate failure for ...)? > My best,Edward. http://php.net/manual/en/function.imap-open.php#refsect1-function.imap-open-parameters ? /novalidate-cert ??? do not validate certificates from TLS/SSL server, needed if ??? server uses self-signed certificates ? Regards, Pascal -- The trapper recommends today: 5e1f1e55.1135220 at localdomain.org From CMarcus at Media-Brokers.com Mon Dec 19 21:28:37 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 19 Dec 2011 14:28:37 -0500 Subject: [Dovecot] OT: PHP imap_open [was: One important question!] In-Reply-To: <1324318747.92715.YahooMailClassic@web125606.mail.ne1.yahoo.com> References: <1324318747.92715.YahooMailClassic@web125606.mail.ne1.yahoo.com> Message-ID: <4EEF9065.9090406@Media-Brokers.com> Your emails are extremely poorly formatted and too much trouble to try to read. If you want to get help, you should learn how to properly compose an email. On 2011-12-19 1:19 PM, I M wrote: > Thank you for the response, Pascal!But I have read the all flags and functions that might be useful for this problem before sending this letter.Please, find one more minute to know what I've done yet! > 1. I installed MTA (sendmail) first. Then tuned it for receiving and sending emails outside of localhost. As for MDA I used "MAILER(`local')" as dovecot has built in one! 2. I installed IMAP Server (dovecot). I made it working in PLAIN LOGIN mode on imap protocol. But as you know it doesn't mean that dovecot won't use SSL/TLS. So we are going to transmit out data as a plain text inside SSL/TLS. (see http://wiki1.dovecot.org/SSL, "... Some clients unfortunately try to do plaintext authentication without STARTTLS, even when IMAP server has told the client that it won't work." ). So when you try to disable ssl-support in dovecot.conf, you are going to get the message "SECURITY PROBLEM: insecure server advertised AUTH=PLAIN ...". The same message you get when putting "/notls" flag. That why I thought It might be a certificate configuration problem on the client side! Cause when I tried to put the /novalidate-cert flag in string "$mbox = > imap_open("{XXXXXX.com:143/novalidate-cert}","user_name","user_password");" I immediately got the message: "Undefined variable: mbox in ...". Also keep in mind that the connection to imap server (dovecot) can be established through telnet. So my guess is around misconfiguration of php5-imap module! I've also checked apache-server configuration cause it could also be a problem as I use php-functions on webserver environment. > So what would you say?Please, correct me if I am wrong.Thanks again for the response and, please give me a feedback as soon as you can! > My best,Edward. -- Best regards, Charles From forrie at gmail.com Mon Dec 19 19:35:00 2011 From: forrie at gmail.com (Forrest Aldrich) Date: Mon, 19 Dec 2011 12:35:00 -0500 Subject: [Dovecot] Using Amazon S3 storage for Maildir ? Message-ID: <4EEF75C4.9040005@gmail.com> I wonder if anyone has tried using an IMAP server with Amazon S3 as a backend. There would be many factors to consider (speed, etc). However, moreso, I don't know that Maildir(++) would support multiple folders that might be linked into the cloud. For example, higher-I/O local incoming mail is on disk, some folders archived on S3. Could be easily done by simply creating another account and storing its Maildir in S3 -- Curious.... From tss at iki.fi Tue Dec 20 07:26:26 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:26:26 +0200 Subject: [Dovecot] Calculation of suggested vsz_limit values In-Reply-To: <4EEB0AD3.20001@noa.gr> References: <4EEB0AD3.20001@noa.gr> Message-ID: <352FB226-243B-4916-AB21-97D6990AC0BD@iki.fi> On 16.12.2011, at 11.09, Nikolaos Milas wrote: > I would like to ask on suggested vsz_limit values. > > Is there any way of calculating such values? Not really. For mail related processes (imap, pop3, lmtp) you could find the largest dovecot.index.cache file and make sure that vsz_limit is at least 3 times that. > How should we determine them? I don't want to risk wrong values (and possible errors) on a production system, if I upgrade to 2.0.16 where vsz_limit values are enforced (I read release notes)! If you're very worried, you can simply disable the vsz limits by setting them to 0. The default 256 MB limit is good enough for most uses though. From tss at iki.fi Tue Dec 20 07:27:55 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:27:55 +0200 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: Message-ID: On 19.12.2011, at 1.32, Cor Bosman wrote: > Hey all, I upgraded some servers today from Debian Lenny to Debian Squeeze, and after the upgrade I started getting dovecot crashes. I was on 2.0.13 but got these there as well, and hoped upgrading to 2.0.16 would help. It didn't. Anyone have an idea? > > Dec 18 23:32:21 userimap1 kernel: [263492.245536] imap[19665]: segfault at 7f108efb7f60 ip 00007f108ecd37e0 sp 00007fff73c3d658 error 5 in libc-2.11.2.so[7f108ec5d000+158000] gdb backtrace of the crash would be helpful: http://dovecot.org/bugreport.html > Dec 18 23:32:21 userimap1 kernel: [263492.245663] BUG: Bad page map in process imap pte:00000001 pmd:09767067 Looks more like a kernel bug though. From tss at iki.fi Tue Dec 20 07:29:22 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:29:22 +0200 Subject: [Dovecot] Using Amazon S3 storage for Maildir ? In-Reply-To: <4EEF75C4.9040005@gmail.com> References: <4EEF75C4.9040005@gmail.com> Message-ID: On 19.12.2011, at 19.35, Forrest Aldrich wrote: > I wonder if anyone has tried using an IMAP server with Amazon S3 as a backend. There would be many factors to consider (speed, etc). However, moreso, I don't know that Maildir(++) would support multiple folders that might be linked into the cloud. For example, higher-I/O local incoming mail is on disk, some folders archived on S3. Could be easily done by simply creating another account and storing its Maildir in S3 -- Maybe [sm]dbox with alt storage set to S3? http://wiki2.dovecot.org/MailboxFormat/dbox#Alternate_storage From tss at iki.fi Tue Dec 20 07:32:27 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:32:27 +0200 Subject: [Dovecot] Tuning Login processes for High-performance Mode In-Reply-To: <4EEB3443.4030104@skye.it> References: <4EEB3443.4030104@skye.it> Message-ID: <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> On 16.12.2011, at 14.06, Alessio Cecchi wrote: > I'm working for tuning a busy cluster of dovecot servers. Heach server as 4 core, 8GB of RAM and provide POP3 and IMAP access to mailbox. OS is Debian 6.0 and dovecot version is 1.2.15. > > I am unsure how to set "login_max_processes_count" and "login_max_connections" for reach the best situation when login_process_per_connection is set to no. They need to be high enough to handle all the concurrent login / SSL connections. > I don't know what value to set login_max_processes_count. This doesn't matter so much as login_processes_count. In normal operation the login_processes_count should be around 1-2x of the number of CPU cores. There's no reason to create more processes, so the login_max_process_count might as well be the same as login_processes_count. The login_max_connections then just needs to be high enough. From tss at iki.fi Tue Dec 20 07:36:53 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:36:53 +0200 Subject: [Dovecot] Strange Login / Timeout Sessions In-Reply-To: References: Message-ID: <21AE7D9C-D533-4C7E-B7BC-E8109D8F6C2D@iki.fi> On 16.12.2011, at 18.15, Carlos Mennens wrote: > I have my webmail application tied to Postfix / Dovecot server & now > for some reason the IMAP sessions oddly time out throughout the day > and then logging back into the mail system over the web is painfully > slow. The only thing I've seen that fixes it is to reload the Dovecot > daemon in Linux: .. > I'm running Dovecot-1.0.7-7.el5_7.1. That's rather old. Might get solved simply by upgrading. You could try if using high-performance mode of login processes helps: http://wiki.dovecot.org/LoginProcess Another reason might be your PAM setup. From tss at iki.fi Tue Dec 20 07:41:32 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:41:32 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EEA6DF0.3080909@noa.gr> References: <4EEA6DF0.3080909@noa.gr> Message-ID: On 16.12.2011, at 0.00, Nikolaos Milas wrote: > I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7. > > All accounts are virtual, hosted on LDAP Server. > > My problem is that the command: > > doveadm quota get -A > > stopped listing all accounts. I think this problem started after I changed in LDAP lookup configuration from "scope = subtree" to "scope = onelevel", because it did not occur before (I did no other changes). Can you try if changing it back helps? Or by running the same LDAP query using ldapsearch. Is there a reason why you changed the scope? (I'm not entirely sure what the LDAP schemes usually look like..) Also to make sure the problem is listing instead of something quota related, list the users: doveadm user '*' From tss at iki.fi Tue Dec 20 07:45:34 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:45:34 +0200 Subject: [Dovecot] dsync panic In-Reply-To: <3a8f9df5e523c0391c41964ae3d09d1b@imapproxy.hrz> References: <3a8f9df5e523c0391c41964ae3d09d1b@imapproxy.hrz> Message-ID: <677F82FE-850B-43EC-86C1-6B99ED74642A@iki.fi> On 16.12.2011, at 0.00, J?rgen Obermann wrote: > Hello, > when I try to convert from mbox to mdbox with dsync with one user it always panics: > > # /opt/local/bin/dsync -v -u userxy backup ssh root at minerva1 /opt/local/bin/dsync -v -u userxy > dsync-remote(userxy): Panic: Trying to allocate 2147483648 bytes Well, this is clearly the problem.. But it's difficult to guess where it's allocating that. I'd need a gdb backtrace. Does it write a core file to userxy's home dir? If not, try replacing dsync with a script that runs "ulimit -c unlimited" first and then execs dsync. http://dovecot.org/bugreport.html tells what to do with core once you have it. Alternative idea: Does it crash also when dsyncing locally? gdb --args dsync -u userxy backup mdbox:/tmp/foobar run bt full From dovecot at r.paypc.com Tue Dec 20 08:45:50 2011 From: dovecot at r.paypc.com (Robin) Date: Mon, 19 Dec 2011 22:45:50 -0800 Subject: [Dovecot] Calculation of suggested vsz_limit values In-Reply-To: <352FB226-243B-4916-AB21-97D6990AC0BD@iki.fi> References: <4EEB0AD3.20001@noa.gr> <352FB226-243B-4916-AB21-97D6990AC0BD@iki.fi> Message-ID: <4EF02F1E.6020701@r.paypc.com> Timo wrote: > Not really. For mail related processes (imap, pop3, lmtp) you could > find the largest dovecot.index.cache file and make sure that > vsz_limit is at least 3 times that. Yikes. Aside from forcing users to "prune" mailboxes, what do you suggest when vsz_limit exceeds available host RAM? I ran across another "RAM only" process in fts_squat for a large, but not *HUGE* mailbox when the size of the dovecot.index.search.uids file got larger than 600MB. There's no mitigation for these problems other than "buying more RAM" or getting users to delete/file their emails? I was quite shocked to hit these limits so early - there was no mention of RAM resource requirements in the Dovecot documentation I'd perused. :( =R= From tss at iki.fi Tue Dec 20 08:53:37 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 08:53:37 +0200 Subject: [Dovecot] Calculation of suggested vsz_limit values In-Reply-To: <4EF02F1E.6020701@r.paypc.com> References: <4EEB0AD3.20001@noa.gr> <352FB226-243B-4916-AB21-97D6990AC0BD@iki.fi> <4EF02F1E.6020701@r.paypc.com> Message-ID: <1324364017.3597.14.camel@innu> On Mon, 2011-12-19 at 22:45 -0800, Robin wrote: > Timo wrote: > > > Not really. For mail related processes (imap, pop3, lmtp) you could > > find the largest dovecot.index.cache file and make sure that > > vsz_limit is at least 3 times that. > > Yikes. Aside from forcing users to "prune" mailboxes, what do you > suggest when vsz_limit exceeds available host RAM? vsz_limit isn't about actually using that much memory, but about how much address space can be allocated. Just because Dovecot mmap()s a 1 GB dovecot.index.cache file doesn't mean that it physically uses more than a few kilobytes of memory. > I ran across another "RAM only" process in fts_squat for a large, but > not *HUGE* mailbox when the size of the dovecot.index.search.uids file > got larger than 600MB. I suggest switching to fts-lucene in Dovecot v2.1. From alessio at skye.it Tue Dec 20 09:24:16 2011 From: alessio at skye.it (Alessio Cecchi) Date: Tue, 20 Dec 2011 08:24:16 +0100 Subject: [Dovecot] Tuning Login processes for High-performance Mode In-Reply-To: <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> References: <4EEB3443.4030104@skye.it> <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> Message-ID: <4EF03820.4000406@skye.it> Il 20/12/2011 06:32, Timo Sirainen ha scritto: > On 16.12.2011, at 14.06, Alessio Cecchi wrote: > >> I'm working for tuning a busy cluster of dovecot servers. Heach server as 4 core, 8GB of RAM and provide POP3 and IMAP access to mailbox. OS is Debian 6.0 and dovecot version is 1.2.15. >> >> I am unsure how to set "login_max_processes_count" and "login_max_connections" for reach the best situation when login_process_per_connection is set to no. > > They need to be high enough to handle all the concurrent login / SSL connections. > >> I don't know what value to set login_max_processes_count. > > This doesn't matter so much as login_processes_count. In normal operation the login_processes_count should be around 1-2x of the number of CPU cores. There's no reason to create more processes, so the login_max_process_count might as well be the same as login_processes_count. The login_max_connections then just needs to be high enough. > Thanks Timo, I had read on wiki the ratio from core and login_processes_count, but I did not understand the ratio from login_processes_count and login_max_processes_count. So, if I have 4 core and want to serve up to 1024 users, an example of configuration can be: login_processes_count = 4 login_max_processes_count = 8 login_max_connections = 128 Right? -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it @ LOLUG -> Socio http://www.lolug.net From tss at iki.fi Tue Dec 20 09:39:49 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 09:39:49 +0200 Subject: [Dovecot] Tuning Login processes for High-performance Mode In-Reply-To: <4EF03820.4000406@skye.it> References: <4EEB3443.4030104@skye.it> <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> <4EF03820.4000406@skye.it> Message-ID: <1324366789.3597.21.camel@innu> On Tue, 2011-12-20 at 08:24 +0100, Alessio Cecchi wrote: > I had read on wiki the ratio from core and login_processes_count, but I > did not understand the ratio from login_processes_count and > login_max_processes_count. Just set login_max_processes_count to same as login_processes_count and you don't have to wonder about it. I don't know if any other values make much sense anyway. From alessio at skye.it Tue Dec 20 09:41:46 2011 From: alessio at skye.it (Alessio Cecchi) Date: Tue, 20 Dec 2011 08:41:46 +0100 Subject: [Dovecot] Tuning Login processes for High-performance Mode In-Reply-To: <1324366789.3597.21.camel@innu> References: <4EEB3443.4030104@skye.it> <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> <4EF03820.4000406@skye.it> <1324366789.3597.21.camel@innu> Message-ID: <4EF03C3A.5030304@skye.it> Il 20/12/2011 08:39, Timo Sirainen ha scritto: > On Tue, 2011-12-20 at 08:24 +0100, Alessio Cecchi wrote: > >> I had read on wiki the ratio from core and login_processes_count, but I >> did not understand the ratio from login_processes_count and >> login_max_processes_count. > > Just set login_max_processes_count to same as login_processes_count and > you don't have to wonder about it. I don't know if any other values make > much sense anyway. > > Ok, thanks for this suggestion. Bye -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it @ LOLUG -> Socio http://www.lolug.net From nmilas at noa.gr Tue Dec 20 10:10:46 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 10:10:46 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: References: <4EEA6DF0.3080909@noa.gr> Message-ID: <4EF04306.4090804@noa.gr> On 20/12/2011 7:41 ??, Timo Sirainen wrote: > Can you try if changing it back helps? Or by running the same LDAP query using ldapsearch. Is there a reason why you changed the scope? (I'm not entirely sure what the LDAP schemes usually look like..) Hi Timo, The same query, using ldapsearch (with the same binddn, same scope, same filter) returns 247 entries. The command is (all searches are against localhost - it's a local replication slave [openldap syncrepl consumer]): /usr/local/openldap/bin/ldapsearch -x -W -vv -D "uid=authenticate,ou=System,dc=noa,dc=gr" -s one -b "ou=people,dc=example,dc=com" uid doveadm user '*' and doveadm quota get -A both return the same 30 entries. I noticed that most of them are the LDAP user entries most recently updated in the LDAP Server (although it doesn't make any sense to me why it so happens). I changed the scope in the search because my "ou=people,dc=example,dc=com" branch has some new sub-branches which contain user accounts not related with mailboxes and I didn't want them to be returned by the Dovecot search (they were useless). I only now tried changing the scope back to subtree and again to onelevel and found that nothing changes (again 30 entries are returned). For reference: /etc/dovecot/dovecot-userdb-ldap.conf (identical to dovecot-passdb-ldap.conf): hosts = localhost tls = no base = ou=people, dc=example, dc=com scope = onelevel ldap_version = 3 dn = uid=authenticate,ou=System,dc=example,dc=com dnpass = secret auth_bind = yes user_filter = (uid=%u) pass_filter = (uid=%u) pass_attrs = uid=user,userPassword=password auth_bind_userdn = uid=%u,ou=people,dc=example,dc=com user_attrs = roomNumber=quota_rule=*:bytes=%$,uid=home=/home/vmail/%u I have not managed yet to upgrade to 2.0.16 to see what happens... Thank you for your assistance, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From nmilas at noa.gr Tue Dec 20 10:14:11 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 10:14:11 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: References: <4EEA6DF0.3080909@noa.gr> Message-ID: <4EF043D3.7000006@noa.gr> I resend, because I forgot to change the true domain once and the previous message would appear to include inconsistencies... Sorry for this... On 20/12/2011 7:41 ??, Timo Sirainen wrote: > Can you try if changing it back helps? Or by running the same LDAP query using ldapsearch. Is there a reason why you changed the scope? (I'm not entirely sure what the LDAP schemes usually look like..) Hi Timo, The same query, using ldapsearch (with the same binddn, same scope, same filter) returns 247 entries. The command is (all searches are against localhost - it's a local replication slave [openldap syncrepl consumer]): /usr/local/openldap/bin/ldapsearch -x -W -vv -D "uid=authenticate,ou=System,dc=example,dc=com" -s one -b "ou=people,dc=example,dc=com" uid doveadm user '*' and doveadm quota get -A both return the same 30 entries. I noticed that most of them are the LDAP user entries most recently updated in the LDAP Server (although it doesn't make any sense to me why it so happens). I changed the scope in the search because my "ou=people,dc=example,dc=com" branch has some new sub-branches which contain user accounts not related with mailboxes and I didn't want them to be returned by the Dovecot search (they were useless). I only now tried changing the scope back to subtree and again to onelevel and found that nothing changes (again 30 entries are returned). For reference: /etc/dovecot/dovecot-userdb-ldap.conf (identical to dovecot-passdb-ldap.conf): hosts = localhost tls = no base = ou=people, dc=example, dc=com scope = onelevel ldap_version = 3 dn = uid=authenticate,ou=System,dc=example,dc=com dnpass = secret auth_bind = yes user_filter = (uid=%u) pass_filter = (uid=%u) pass_attrs = uid=user,userPassword=password auth_bind_userdn = uid=%u,ou=people,dc=example,dc=com user_attrs = roomNumber=quota_rule=*:bytes=%$,uid=home=/home/vmail/%u I have not managed yet to upgrade to 2.0.16 to see what happens... Thank you for your assistance, Nick From tss at iki.fi Tue Dec 20 10:15:21 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 10:15:21 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EF04306.4090804@noa.gr> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> Message-ID: <1324368921.3597.23.camel@innu> On Tue, 2011-12-20 at 10:10 +0200, Nikolaos Milas wrote: > On 20/12/2011 7:41 ??, Timo Sirainen wrote: > > > Can you try if changing it back helps? Or by running the same LDAP query using ldapsearch. Is there a reason why you changed the scope? (I'm not entirely sure what the LDAP schemes usually look like..) > > The same query, using ldapsearch (with the same binddn, same scope, same > filter) returns 247 entries. The command is (all searches are against > localhost - it's a local replication slave [openldap syncrepl consumer]): > > /usr/local/openldap/bin/ldapsearch -x -W -vv -D > "uid=authenticate,ou=System,dc=noa,dc=gr" -s one -b > "ou=people,dc=example,dc=com" uid > > doveadm user '*' and doveadm quota get -A both return the same 30 > entries. I noticed that most of them are the LDAP user entries most > recently updated in the LDAP Server (although it doesn't make any sense > to me why it so happens). Try adding (objectClass=posixAccount) as filter in the ldapsearch. That's the default iterate_filter. From nmilas at noa.gr Tue Dec 20 10:47:21 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 10:47:21 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324368921.3597.23.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> Message-ID: <4EF04B99.1030201@noa.gr> On 20/12/2011 10:15 ??, Timo Sirainen wrote: > Try adding (objectClass=posixAccount) as filter in the ldapsearch. > That's the default iterate_filter. We've caught it! Only the returned (30) accounts include the posixAccount objectClass! So I added in the LDAP setup: iterate_filter = (objectClass=*) and now everything works fine! Perhaps page: http://wiki2.dovecot.org/Tools/Doveadm/Altmove should explicitly state which is the default iterate_filter value, because in most LDAP applications (objectClass=*) is the default filter. Thanks very much Timo. All the best, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Tue Dec 20 10:57:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 10:57:19 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EF04B99.1030201@noa.gr> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> Message-ID: <1324371439.3597.25.camel@innu> On Tue, 2011-12-20 at 10:47 +0200, Nikolaos Milas wrote: > On 20/12/2011 10:15 ??, Timo Sirainen wrote: > > > Try adding (objectClass=posixAccount) as filter in the ldapsearch. > > That's the default iterate_filter. > > We've caught it! Only the returned (30) accounts include the > posixAccount objectClass! > > So I added in the LDAP setup: > > iterate_filter = (objectClass=*) > > and now everything works fine! Isn't that basically the same as an empty filter? What other types of objectClasses are there with user accounts? Perhaps the default should be changed to empty, or maybe to (uid=*) From cor at xs4all.nl Tue Dec 20 11:11:10 2011 From: cor at xs4all.nl (Cor Bosman) Date: Tue, 20 Dec 2011 10:11:10 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: Message-ID: <20111220091110.GA19728@xs4all.nl> I installed a newer kernel on these boxes, and it's fixed. Seems to be a problem with the stock debian squeeze kernel. Not a dovecot issue, but others with a stable squeeze box might see similar problems so good to have it in the archive :) regards, Cor From ronleach at tesco.net Tue Dec 20 11:49:06 2011 From: ronleach at tesco.net (Ron Leach) Date: Tue, 20 Dec 2011 09:49:06 +0000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <20111220091110.GA19728@xs4all.nl> References: <20111220091110.GA19728@xs4all.nl> Message-ID: <4EF05A12.7010502@tesco.net> On 20/12/2011 09:11, Cor Bosman wrote: > I installed a newer kernel on these boxes, and it's fixed. Seems to be > a problem with the stock debian squeeze kernel. Not a dovecot issue, but > others with a stable squeeze box might see similar problems so good > to have it in the archive :) Indeed; very many of us use Debian stable. Which kernel did you install that is 2.0.16-friendly, and was this from Debian stable's updates system? regards, Ron From nmilas at noa.gr Tue Dec 20 12:06:11 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 12:06:11 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324371439.3597.25.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> Message-ID: <4EF05E13.3000704@noa.gr> On 20/12/2011 10:57 ??, Timo Sirainen wrote: > On Tue, 2011-12-20 at 10:47 +0200, Nikolaos Milas wrote: >> So I added in the LDAP setup: >> >> iterate_filter = (objectClass=*) >> >> and now everything works fine! > Isn't that basically the same as an empty filter? What other types of > objectClasses are there with user accounts? Perhaps the default should > be changed to empty, or maybe to (uid=*) > I agree that the default should be changed to empty. There are various ObjectClasses available. For example, for normal user accounts (physical persons) the main objectClass we use is inetOrgPerson (with its parents: organizationalPerson, person) and for other, non-personal accounts we use objectClass: account. posixAccount objectClass is added to particular accounts when we want to assign further access privileges, mainly shell and FTP. Best regards, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Tue Dec 20 12:13:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:13:19 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EF05E13.3000704@noa.gr> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> <4EF05E13.3000704@noa.gr> Message-ID: <1324375999.3597.35.camel@innu> On Tue, 2011-12-20 at 12:06 +0200, Nikolaos Milas wrote: > > Isn't that basically the same as an empty filter? What other types of > > objectClasses are there with user accounts? Perhaps the default should > > be changed to empty, or maybe to (uid=*) > > > > I agree that the default should be changed to empty. But that also returns non-user results, like at least in my test setup it returns an organization and admin. > There are various ObjectClasses available. > > For example, for normal user accounts (physical persons) the main > objectClass we use is inetOrgPerson (with its parents: > organizationalPerson, person) and for other, non-personal accounts we > use objectClass: account. So you can have Dovecot accounts that aren't "person"s? Perhaps: iterate_filter = (uid=*) From tss at iki.fi Tue Dec 20 12:15:23 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:15:23 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324375999.3597.35.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> <4EF05E13.3000704@noa.gr> <1324375999.3597.35.camel@innu> Message-ID: <1324376123.3597.37.camel@innu> On Tue, 2011-12-20 at 12:13 +0200, Timo Sirainen wrote: > > I agree that the default should be changed to empty. > > But that also returns non-user results, like at least in my test setup > it returns an organization and admin. .. > Perhaps: iterate_filter = (uid=*) Actually, the current default iterate_filter is fine, if you look at the default pass/user filters: #user_filter = (&(objectClass=posixAccount)(uid=%u)) #pass_filter = (&(objectClass=posixAccount)(uid=%u)) From nmilas at noa.gr Tue Dec 20 12:16:12 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 12:16:12 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324371439.3597.25.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> Message-ID: <4EF0606C.7050908@noa.gr> On 20/12/2011 10:57 ??, Timo Sirainen wrote: > On Tue, 2011-12-20 at 10:47 +0200, Nikolaos Milas wrote: >> So I added in the LDAP setup: >> >> iterate_filter = (objectClass=*) >> >> and now everything works fine! > Isn't that basically the same as an empty filter? And I forgot to answer: Yes, (objectClass=*) is the same as an empty filter. An empty filter defaults to: (objectClass=*) Nick From tss at iki.fi Tue Dec 20 12:18:45 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:18:45 +0200 Subject: [Dovecot] doveadm index In-Reply-To: References: Message-ID: <1324376325.3597.39.camel@innu> On Wed, 2011-12-14 at 19:27 -0800, Daniel L. Miller wrote: > Does "doveadm index -A INBOX" reindex everything? What about users with > multiple folders, both subbed & not subbed under INBOX? It indexes INBOX (only) for all users. And it doesn't "reindex" anything, it just adds any missing stuff. From tss at iki.fi Tue Dec 20 12:24:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:24:06 +0200 Subject: [Dovecot] Quota PostgreSQL INSERT trigger In-Reply-To: References: Message-ID: <1324376646.3597.42.camel@innu> On Thu, 2011-12-15 at 09:37 +0100, Adis Nezirovic wrote: > Wiki instructions for creating insert trigger for PostgreSQL are wrong > http://wiki.dovecot.org/Quota/Dict > > Calling INSERT on the table from within BEFORE INSERT trigger creates > cascading trigger. Yes.. > Instead, one should return NEW record from the trigger, and it will be > inserted after trigger execution. But does this handle race conditions when a record is inserted/deleted while the trigger is being run? That's the reason this trigger is so complex. > BEGIN > IF NEW.messages = 0 THEN > RETURN NEW; > ELSE > NEW.messages = - NEW.messages; > RETURN NEW; > END IF; > EXCEPTION WHEN unique_violation THEN > -- someone just inserted the record, update it > END; I'd guess the unique_violation is never caught here, and instead the whole INSERT fails? From nmilas at noa.gr Tue Dec 20 12:30:57 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 12:30:57 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324376123.3597.37.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> <4EF05E13.3000704@noa.gr> <1324375999.3597.35.camel@innu> <1324376123.3597.37.camel@innu> Message-ID: <4EF063E1.6050404@noa.gr> On 20/12/2011 12:15 ??, Timo Sirainen wrote: > > Perhaps: iterate_filter = (uid=*) > > Actually, the current default iterate_filter is fine, if you look at the > default pass/user filters: > > #user_filter = (&(objectClass=posixAccount)(uid=%u)) > #pass_filter = (&(objectClass=posixAccount)(uid=%u)) This means that default values for all these settings are compatible. I would say that it would be enough to explicitly state the default value for iterate_filter in the documentation. I guess the filter uid=* might probably also return all entries, because in many cases uid is part of the DN, so it is included in all entries. But this is not always the case. Nick From tss at iki.fi Tue Dec 20 12:35:24 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:35:24 +0200 Subject: [Dovecot] Building 2.1.rc1 with cluence, but without libstemmer In-Reply-To: References: Message-ID: <1324377324.3597.47.camel@innu> On Thu, 2011-12-15 at 12:05 +1100, Jan Mikkelsen wrote: > I'm testing out 2.1.rc1, building against clucene 2.3.3.4. > > Without libstemmber, the build fails because it attempts to include SnowballAnalyzer.h which is not part of "core" clucene. It was actually supposed to be distributed with Dovecot, but it got left out from the tarball. > What versions of libstemmer, http://snowball.tartarus.org/ this one. > clucene 2.3.3.4 > and libtextcat is dovecot 2.1.rc1 intended to be used against? http://www.let.rug.nl/vannoord/TextCat/ probably.. Basically I've just used the libstemmer and libtextcat that are in Debian. > Is it worth bringing the wrapper class around libstemmer into dovecot > to avoid funny dependencies against clucene and so that the -lstemmer > test in configure is enough? I'm hoping for a new CLucene release where I don't need libstemmer anymore. From tss at iki.fi Tue Dec 20 12:49:18 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:49:18 +0200 Subject: [Dovecot] Question about index reset in dovecot 2.0.15 In-Reply-To: <20111214211036.55980@gmx.com> References: <20111214211036.55980@gmx.com> Message-ID: <1324378158.6987.7.camel@innu> On Wed, 2011-12-14 at 22:10 +0100, Maria Arrea wrote: > I have seen some strange error log messages in our dovecot server (2.0.15, RHEL 5.7x64, mdbox+zlib, local storage, high load) > > Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent These messages shouldn't appear alone. Is there anything else logged about them? > Dec 14 20:56:46 buzon dovecot: imap(rcam): Error: Corrupted index cache file /indices_dovecot/indices/03/6b/rcam/mailboxes/INBOX/dovecot.index.cache: Broken virtual size for mail UID 132197 Possibly related to zlib.. Again it should have logged another error message just before this. > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox INBOX Possibly related to other errors. So .. none of the errors above really were what I'd call the actual cause of the problems. They were just after effects. > I have been googling without luck, why does this happen? I have tried with doveadm force-resync, maybe this could solve this issues. All of those should be fixed automatically. Do they keep happening if you don't do force-resync? How often do they happen anyway? Do they happen at any specific times (e.g. during doveadm purge)? From tss at iki.fi Tue Dec 20 12:54:50 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:54:50 +0200 Subject: [Dovecot] Dovecot 2.1rc1 + 2.0.16 woes regarding fts_squat In-Reply-To: <4EE7E4BB.2040008@r.paypc.com> References: <4EE7E4BB.2040008@r.paypc.com> Message-ID: <1324378490.6987.9.camel@innu> On Tue, 2011-12-13 at 15:50 -0800, Robin wrote: > I can confirm the report posted in > http://dovecot.org/list/dovecot/2011-November/062263.html that > fts_squat no longer seems to be used after moving from 2.0.16->2.1 rc > 1. I don't see crash reports in the logs, just "0 messages indexed". > My search test tool just does a normal IMAP SEARCH for a long > non-existent string. If there's another way to trigger re-indexing in > 2.1, I don't see anything in the documentation for it. Maybe it was buggy in v2.1.rc1 .. at least in my tests now it works with latest v2.1 hg. I should release rc2 soon I guess. > During a large mail import with 2.0.16 today, I ran across a worrying > message in the logs during an fts_squat reindex: out of memory. I'm not planning on doing any changes to fts-squat anymore. With v2.1 you can use fts-lucene instead. From tss at iki.fi Tue Dec 20 12:59:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:59:06 +0200 Subject: [Dovecot] dovecot penalties and anvil In-Reply-To: <4EE73988.1090000@solutti.com.br> References: <4EE73988.1090000@solutti.com.br> Message-ID: <1324378746.6987.13.camel@innu> On Tue, 2011-12-13 at 09:39 -0200, Leonardo Rodrigues wrote: > I'm strugling to find some documentation on dovecot's anvil service > and/or its penalties (that can be checked with doveadm penalty) ... but > i'm not finding anything on that. > > is there any documentation on anvil/penalties that i should check > other than a few messages on the mailing list archive ? Nope. Basically: * Each failed attempt doubles the penalty for next login attempt from that specific IP * Penalty is maxed out at 30 seconds * Each successful login (after waiting for penalty) will clear the penalty for that IP * You can disable the penalty entirely with: service anvil { unix_listener anvil-auth-penalty { mode = 0 } } I don't really like this penalty stuff. Maybe it's better than nothing, maybe not. Maybe there's a better way to do it. Not very useful for IPv6. From marco at carcano.ch Tue Dec 20 13:46:16 2011 From: marco at carcano.ch (Marco Carcano) Date: Tue, 20 Dec 2011 12:46:16 +0100 Subject: [Dovecot] Mail lost - maybe a bug??? In-Reply-To: <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> Message-ID: <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> Hello Timo and Urban I took quite a long time to reply, but as I told you this issue does not verify very often, so I had enabled verbose logging and just waited .. I summarize the situation - user mmanzoni sometimes does not receive a message - it does not matter if he is the only recipient or if there are others its outlook 2010 is configured for POP3 mail and to leave all messages on the server, and setup to never delete them (neither after a few days, neither when he deletes from his trash folder). There are not any other client that log to that mail account: this is the only one client that download messages the following extract of the LDA log shows what happened: the message was sent to 4 users (I report just 2 of them: criva, that received it, and mmanzoni, who didn't) ################CRIVA##################### Dec 12 10:51:24 srv001 dovecot: lda: Debug: Loading modules from directory: /usr/lib64/dovecot Dec 12 10:51:24 srv001 dovecot: lda: Debug: Module loaded: /usr/lib64/ dovecot/lib10_quota_plugin.so Dec 12 10:51:24 srv001 dovecot: lda: Debug: Module loaded: /usr/lib64/ dovecot/lib90_sieve_plugin.so Dec 12 10:51:24 srv001 dovecot: lda: Debug: auth input: criva home=/ home/criva 499=criva quota_rule=*:storage=8192M Dec 12 10:51:24 srv001 dovecot: lda: Debug: Added userdb setting: plugin/499=criva Dec 12 10:51:24 srv001 dovecot: lda: Debug: Added userdb setting: plugin/quota_rule=*:storage=8192M Dec 12 10:51:24 srv001 dovecot: lda(criva): Debug: Effective uid=499, gid=499, home=/home/criva Dec 12 10:51:24 srv001 dovecot: lda(criva): Debug: Quota root: name=User quota backend=maildir args= Dec 12 10:51:24 srv001 dovecot: lda(criva): Debug: Quota rule: root=User quota mailbox=* bytes=8589934592 messages=0 Dec 12 10:51:24 srv001 dovecot: lda(criva): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1048576000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=6871947673 (80%) messages=0 reverse=no command=quota-warning 80 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=7730941132 (90%) messages=0 reverse=no command=quota-warning 90 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=8160437862 (95%) messages=0 reverse=no command=quota-warning 95 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota root: name=Shared quota backend=maildir args=ns=Public/ Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota rule: root=Shared quota mailbox=* bytes=20971520000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mailboxstore/criva/Maildir Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: maildir++: root=/ home/mailboxstore/criva/Maildir, index=, control=, inbox=/home/ mailboxstore/criva/Maildir Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Namespace : type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:/home/mailboxstore/ %Lu/Maildir:INDEX=/home/mailboxstore/criva/Maildir/shared/%Lu Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: shared: root=/var/ run/dovecot, index=, control=, inbox= Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Namespace : type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:/home/mailboxstore/public Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: maildir++: root=/ home/mailboxstore/public, index=, control=, inbox= Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota root: name=User quota backend=maildir args= Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota rule: root=User quota mailbox=* bytes=14680064000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1048576000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=11744051200 (80%) messages=0 reverse=no command=quota-warning 80 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=13212057600 (90%) messages=0 reverse=no command=quota-warning 90 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=13946060800 (95%) messages=0 reverse=no command=quota-warning 95 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota root: name=Shared quota backend=maildir args=ns=Public/ Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota rule: root=Shared quota mailbox=* bytes=20971520000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: none: root=, index=, control=, inbox= Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: sieve: user's script path /home/mailboxstore/criva/.dovecot.sieve doesn't exist (using global script path in stead) Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: sieve: user has no valid personal script Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: sieve: no scripts to execute: reverting to default delivery. Dec 12 10:51:27 srv001 dovecot: lda(criva): msgid=<1888520041-1323683477-cardhu_decombobulator_blackberry.rim.net-2066152169- at b12.c13.bise7.blackberry >: saved mail to INBOX #################MMANZONI############### Dec 12 10:51:28 srv001 dovecot: lda: Debug: Loading modules from directory: /usr/lib64/dovecot Dec 12 10:51:28 srv001 dovecot: lda: Debug: Module loaded: /usr/lib64/ dovecot/lib10_quota_plugin.so Dec 12 10:51:28 srv001 dovecot: lda: Debug: Module loaded: /usr/lib64/ dovecot/lib90_sieve_plugin.so Dec 12 10:51:28 srv001 dovecot: lda: Debug: auth input: mmanzoni home=/ home/mmanzoni 499=mmanzoni quota_rule=*:storage=8192M Dec 12 10:51:28 srv001 dovecot: lda: Debug: Added userdb setting: plugin/499=mmanzoni Dec 12 10:51:28 srv001 dovecot: lda: Debug: Added userdb setting: plugin/quota_rule=*:storage=8192M Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Effective uid=499, gid=499, home=/home/mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota root: name=User quota backend=maildir args= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=User quota mailbox=* bytes=8589934592 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1048576000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=6871947673 (80%) messages=0 reverse=no command=quota-warning 80 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=7730941132 (90%) messages=0 reverse=no command=quota-warning 90 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=8160437862 (95%) messages=0 reverse=no command=quota-warning 95 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota root: name=Shared quota backend=maildir args=ns=Public/ Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=Shared quota mailbox=* bytes=20971520000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mailboxstore/mmanzoni/Maildir Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: maildir++: root=/ home/mailboxstore/mmanzoni/Maildir, index=, control=, inbox=/home/ mailboxstore/mmanzoni/Maildir Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Namespace : type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:/home/mailboxstore/ %Lu/Maildir:INDEX=/home/mailboxstore/mmanzoni/Maildir/shared/%Lu Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: shared: root=/ var/run/dovecot, index=, control=, inbox= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Namespace : type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:/home/mailboxstore/public Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: maildir++: root=/ home/mailboxstore/public, index=, control=, inbox= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota root: name=User quota backend=maildir args= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=User quota mailbox=* bytes=14680064000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1048576000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=11744051200 (80%) messages=0 reverse=no command=quota-warning 80 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=13212057600 (90%) messages=0 reverse=no command=quota-warning 90 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=13946060800 (95%) messages=0 reverse=no command=quota-warning 95 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota root: name=Shared quota backend=maildir args=ns=Public/ Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=Shared quota mailbox=* bytes=20971520000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: none: root=, index=, control=, inbox= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: sieve: user's script path /home/mailboxstore/mmanzoni/.dovecot.sieve doesn't exist (using global script path in stead) Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: sieve: user has no valid personal script Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: sieve: no scripts to execute: reverting to default delivery. Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): msgid=<1888520041-1323683477-cardhu_decombobulator_blackberry.rim.net-2066152169- at b12.c13.bise7.blackberry >: saved mail to INBOX ######################################### I know it seems absurd, but mmanzoni has not received the message - I tried also "grepping" for the object in the maildir, but haven't been able to get it what do you think about this? I really do not know where this issue can be - the only componet I suppose could have some kind of problem is in the LDA phase, but I'm just supposing do you want to give a look to my config files? If so, which one could be interesting to post? kind regards Marco Carcano Il giorno 17/nov/11, alle ore 18:34, Timo Sirainen ha scritto: > On 17.11.2011, at 18.47, Marco Carcano wrote: > >>>> Oct 27 11:20:34 srv001 dovecot: lda(user3): msgid=>>>> : saved mail to INBOX >>> >>> If Dovecot logs this, then the message definitely was saved to >>> INBOX. >> >> it is exactly what I told to my colleagues, but belive me, sometime >> some mail get lost - > > Most likely reason for this is that the user's client deletes the > message. Possibly an automatic client side filter or some UI issue > that causes user to accidentally delete a mail. The mail_log > plugin's logging would have showed if this was the case. > >> I suspect however that could be mine misconfiguration somewhere, so >> that lda sometimes write the email not in the right place, but >> elsewhere, and just write the phrase " saved mail to INBOX in the >> logs (however I'm wondering why sometimes?!?) > > I can't think of any reason why it would randomly write to a wrong > place. > >> I tried to find the missed email in the Maildir, but have not been >> able to get it - the commands used are >> >> cd /home/mailboxstore/theuser/Maildir >> >> grep "6000029222" */* |grep "RE:" >> grep "6000029222" .Drafts/* |grep "RE:" >> grep "6000029222" .Drafts/*/* |grep "RE:" >> grep "6000029222" .Junk/* |grep "RE:" >> grep "6000029222" .Posta\ eliminata/* |grep "RE:" >> grep "6000029222" .Posta\ indesiderata/* |grep "RE:" >> grep "6000029222" .Posta\ inviata/* |grep "RE:" >> grep "6000029222" .Sent/* |grep "RE:" >> grep "6000029222" .Templates/* |grep "RE:" >> grep "6000029222" .Trash/* |grep "RE:" > > Only the grep "6000029222" .Drafts/*/* |grep "RE:" was grepping from > mail files. Easier would be just: > > grep -r "RE:.*6000029222" . > >> I really think is some kind of misconfiguration of mine, may you >> help me, please? Just tell me what pieces of config to show (just >> not to flood the whole config) > > I doubt this is related to configuration. > > But you could enable http://wiki2.dovecot.org/Plugins/Lazyexpunge so > that messages won't be lost if they are expunged. The next time a > message is lost, you would most likely find it from the lazy-expunge > namespace. (Then you could write a script that deletes e.g. >1 week > old files nightly.) From drum.lucas at gmail.com Tue Dec 20 14:26:00 2011 From: drum.lucas at gmail.com (drum.lucas at gmail.com) Date: Tue, 20 Dec 2011 10:26:00 -0200 Subject: [Dovecot] v2.x services documentation In-Reply-To: <04D662E7-2A0A-448B-BA21-1E337A400CA6@iki.fi> References: <04D662E7-2A0A-448B-BA21-1E337A400CA6@iki.fi> Message-ID: Well I've got some servers running 1.0 with dovecot, however, I make the installation of Dovecot 2.0 and would like to understand better the way it works. It uses the files in / etc / dovecot / conf.d right? Example: protocol pop3 protocol imap {{or is everything in / etc/dovecot/conf.d/10-master.conf? Or the directory conf.d it is only for examples and everything is still done in dovecot.conf? Thanks Lucas Possamai 2011/12/7 Timo Sirainen > If you've ever wanted to know everything about the service {} blocks, this > should be quite helpful: http://wiki2.dovecot.org/Services > > -- *Lucas Possamai* taekwondo facebook vivaolinux work blog funny From maria_arrea at gmx.com Tue Dec 20 14:48:12 2011 From: maria_arrea at gmx.com (Maria Arrea) Date: Tue, 20 Dec 2011 13:48:12 +0100 Subject: [Dovecot] Question about index reset in dovecot 2.0.15 Message-ID: <20111220124812.55990@gmx.com> Hello Timo, thank you in advance. Full log here (1 hour time range) Dec 14 21:19:43 buzon postfix/pipe[27103]: 4423BC7C31: to=, relay=dovecot, delay=0.24, delays=0.03 /0/0/0.2, dsn=2.0.0, status=sent (delivered via dovecot service) Dec 14 21:20:59 buzon dovecot: imap(fmcarrasco): Disconnected: Logged out bytes=556/2245 Dec 14 21:44:30 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 21:44:30 buzon dovecot: imap(fmcarrasco): Disconnected: IMAP session state is inconsistent, please relogin. bytes=42402/3153543 Dec 14 21:45:30 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=20035, TLS Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Disconnected: IMAP session state is inconsistent, please relogin. bytes=343/8671 Dec 14 22:02:58 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=2685, TLS Dec 14 22:13:46 buzon dovecot: lda(fmcarrasco): sieve: msgid=: stored mail into mailbox 'INBOX' Dec 14 22:13:46 buzon postfix/pipe[21152]: AAD36C8501: to=, relay=dovecot, delay=0.34, delays=0.03/0.01/0/0.31, dsn=2.0.0, status=sent (delivered via dovecot service) The other one: Dec 14 20:53:38 buzon dovecot: pop3(cfp): Connection closed top=0/0, retr=0/0, del=0/3605, size=446902389 Dec 14 21:38:34 buzon postfix/qmgr[4015]: A90CFC7C31: from=, size=23256, nrcpt=1 (queue active) Dec 14 21:43:00 buzon postfix/qmgr[4015]: E7E61C7DED: from=, size=23244, nrcpt=1 (queue active) Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=32118/127014 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox Trash Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Trash/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=38097/309083 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox Preinscripcion Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Preinscripcion/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=33263/164275 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Emagister/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=35437/111594 Dec 14 21:50:38 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=24811, TLS Dec 14 21:50:39 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=24822, TLS Dec 14 21:52:12 buzon postfix/cleanup[21212]: 9A22CC816C: message-id= Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=554/169764 Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Trash/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=533/10963 Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Preinscripcion/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=629/39790 Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=613/496956 Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=464, TLS Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=465, TLS Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=466, TLS Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=467, TLS Dec 14 22:30:28 buzon dovecot: pop3-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=25194 I do not see any pattern about this problem of index reset, logs from other day, maybe the problem is I/O load based: Dec 15 13:16:06 buzon dovecot: imap(ehlers): Connection closed bytes=357/20249 Dec 15 13:16:06 buzon dovecot: imap(ehlers): Connection closed bytes=70/12804 Dec 15 13:16:12 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=1005 Dec 15 13:16:12 buzon dovecot: imap(ehlers): Connection closed bytes=103/818 Dec 15 13:16:19 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=1419 Dec 15 13:16:19 buzon dovecot: imap(ehlers): Error: Mailbox Archivador/Facultad/curso whiteboard: Corrupted index, uidvalidity=0 Dec 15 13:16:19 buzon dovecot: imap(ehlers): Warning: mdbox /buzones/domain/11/53/ehlers/storage: rebuilding indexes Dec 15 13:16:19 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=1426 Dec 15 13:16:19 buzon dovecot: imap(ehlers): Connection closed bytes=459/3205 Dec 15 13:16:32 buzon dovecot: imap(ehlers): Error: /indices_dovecot/indices/11/53/ehlers/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 15 13:16:32 buzon dovecot: imap(ehlers): Disconnected: IMAP session state is inconsistent, please relogin. bytes=195/963 Dec 15 13:16:32 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=2006 Dec 15 13:16:32 buzon dovecot: imap(ehlers): Connection closed bytes=274/80860 Dec 15 13:16:49 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=2735 Any idea? Regards Maria On Wed, 2011-12-14 at 22:10 +0100, Maria Arrea wrote: > I have seen some strange error log messages in our dovecot server (2.0.15, RHEL 5.7x64, mdbox+zlib, local storage, high load) > > Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent These messages shouldn't appear alone. Is there anything else logged about them? > Dec 14 20:56:46 buzon dovecot: imap(rcam): Error: Corrupted index cache file /indices_dovecot/indices/03/6b/rcam/mailboxes/INBOX/dovecot.index.cache: Broken virtual size for mail UID 132197 Possibly related to zlib.. Again it should have logged another error message just before this. > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox INBOX Possibly related to other errors. So .. none of the errors above really were what I'd call the actual cause of the problems. They were just after effects. > I have been googling without luck, why does this happen? I have tried with doveadm force-resync, maybe this could solve this issues. All of those should be fixed automatically. Do they keep happening if you don't do force-resync? How often do they happen anyway? Do they happen at any specific times (e.g. during doveadm purge)? From tss at iki.fi Tue Dec 20 15:37:29 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 15:37:29 +0200 Subject: [Dovecot] Mail lost - maybe a bug??? In-Reply-To: <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> Message-ID: <1324388249.6987.32.camel@innu> On Tue, 2011-12-20 at 12:46 +0100, Marco Carcano wrote: > Hello Timo and Urban > > I took quite a long time to reply, but as I told you this issue does > not verify very often, so I had enabled verbose logging and just > waited .. Enabling mail_log plugin and/or lazy_expunge plugin would have helped more (both mentioned in my previous mail). > I summarize the situation - user mmanzoni sometimes does not receive a > message - it does not matter if he is the only recipient or if there > are others > > its outlook 2010 is configured for POP3 mail and to leave all messages > on the server, and setup to never delete them (neither after a few > days, neither when he deletes from his trash folder). There are not > any other client that log to that mail account: this is the only one > client that download messages > > the following extract of the LDA log shows what happened: the message > was sent to 4 users (I report just 2 of them: criva, that received it, > and mmanzoni, who didn't) There's really nothing in the LDA log that could explain why the message gets lost. It most likely was successfully delivered by LDA, but got deleted afterwards for some reason. You mean that this user's mails are never supposed to be deleted via POP3? Verify that with: grep 'pop3.*mmanzoni.*del=[^0]' /var/log/dovecot.log or wherever those POP3 disconnection messages are logged, i.e. you should find lots of messages with: grep 'pop3.*mmanzoni.*del=0' /var/log/dovecot.log From tss at iki.fi Tue Dec 20 15:40:42 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 15:40:42 +0200 Subject: [Dovecot] v2.x services documentation In-Reply-To: References: <04D662E7-2A0A-448B-BA21-1E337A400CA6@iki.fi> Message-ID: <1324388442.6987.35.camel@innu> On Tue, 2011-12-20 at 10:26 -0200, drum.lucas at gmail.com wrote: > Well I've got some servers running 1.0 with dovecot, however, I make the > installation of Dovecot 2.0 and would like to understand better the way it > works. > > It uses the files in / etc / dovecot / conf.d right? > > Example: protocol pop3 protocol imap {{or > is everything in / etc/dovecot/conf.d/10-master.conf? > > Or the directory conf.d it is only for examples and everything is still > done in dovecot.conf? It still uses dovecot.conf just like before. It's just that the new included example dovecot.conf has an "!include conf.d/*.conf" line, and the example configuration is split in those files. So if you want to do it like the new example config does, you need to modify the conf.d/* files. (But all of this could have been done this way in v1.x already, so it's not really any different in that way.) From janfrode at tanso.net Tue Dec 20 16:38:15 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Tue, 20 Dec 2011 15:38:15 +0100 Subject: [Dovecot] Sieve too rfc compliant ;-) Message-ID: <20111220143815.GA2236@dibs.tanso.net> It seems we have a few email addresses that are not RFC 5322 compliant, and now that we've started using sieve these are failing. The problem is that we have a few addresses with leading, trailing or double dots in the local part: jan..frode at tanso.net .janfrode at tanso.net janfrode. at tanso.net I believe these has been working fine with everything else in dovecot (lda, lmtp, imap, pop), but that sieve is more strict. I think it's fair enough that it's strict with messages generated by sieve scripts, but it would be nice if it could be more tolerant with messages addressed for the sieve script. So, is there any setting for making it more tolerant ? -jf From tss at iki.fi Tue Dec 20 16:45:47 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 16:45:47 +0200 Subject: [Dovecot] Question about index reset in dovecot 2.0.15 In-Reply-To: <20111220124812.55990@gmx.com> References: <20111220124812.55990@gmx.com> Message-ID: <1324392347.6987.46.camel@innu> On Tue, 2011-12-20 at 13:48 +0100, Maria Arrea wrote: > Hello Timo, thank you in advance. Full log here (1 hour time range) It could be useful to have all error/warning messages logged to their own file, so you could quickly see a list of all errors from the last day or two. That's also the log I'd be more interested in seeing. What things do you have accessing mailboxes? * imap * pop3 * dovecot-lda * doveadm purge Nothing else? No dsync for example? > Dec 14 21:44:30 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent I think these should happen only when dbox is being rebuilt by another process at the same time.. But it's a bit strange that it happens again in another session: > Dec 14 21:45:30 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=20035, TLS > Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Kind of looks as if it isn't fixing itself?.. Also it might be helpful to have PID in the log lines: mail_log_prefix = %s(%u %p): > The other one: > > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Again it's strange how this begins. > Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=32118/127014 > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox Trash > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Trash/dovecot.index reset, view is now inconsistent > Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=38097/309083 > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox Preinscripcion > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Preinscripcion/dovecot.index reset, view is now inconsistent > Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=33263/164275 > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Emagister/dovecot.index reset, view is now inconsistent > Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=35437/111594 > Dec 14 21:50:38 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=24811, TLS > Dec 14 21:50:39 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=24822, TLS > Dec 14 21:52:12 buzon postfix/cleanup[21212]: 9A22CC816C: message-id= > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=554/169764 > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Trash/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=533/10963 > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Preinscripcion/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=629/39790 > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/INBOX/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=613/496956 But all of the rest of this is quite clearly caused by the first problem. > I do not see any pattern about this problem of index reset, logs from other day, maybe the problem is I/O load based: > > Dec 15 13:16:19 buzon dovecot: imap(ehlers): Error: Mailbox Archivador/Facultad/curso whiteboard: Corrupted index, uidvalidity=0 This is clearly an originating error. But perhaps this is a newly created mailbox? I just noticed that this can happen if a mailbox creation is slow, and another session opens the mailbox before its creation has been finished. Check with: doveadm dump ".../mdbox/mailboxes/Mailbox Archivador/Facultad/curso whiteboard/dbox-Mails" The interesting lines in the output are: index id ................. = 1324032275 (2011-12-16 12:44:35) uid validity ............. = 1324032275 (2011-12-16 12:44:35) > Dec 15 13:16:19 buzon dovecot: imap(ehlers): Warning: mdbox /buzones/domain/11/53/ehlers/storage: rebuilding indexes This then caused all of the user's other existing processes to fail with: > Dec 15 13:16:32 buzon dovecot: imap(ehlers): Error: /indices_dovecot/indices/11/53/ehlers/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Perhaps the other users' problems began with similar errors? From marco at carcano.ch Tue Dec 20 16:52:21 2011 From: marco at carcano.ch (Marco Carcano) Date: Tue, 20 Dec 2011 15:52:21 +0100 Subject: [Dovecot] Mail lost - maybe a bug??? In-Reply-To: <1324388249.6987.32.camel@innu> References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> <1324388249.6987.32.camel@innu> Message-ID: Hello Timo and thanks again for the ultra quick reply! > Enabling mail_log plugin and/or lazy_expunge plugin would have helped > more (both mentioned in my previous mail). Sorry - I thought I have enabled it, but maybe I did something wrong with the configuration and it was not enabled: here is what I did in order to enable mail_log: syslog_facility = local5 mail_debug = yes plugin { # Events to log. Also available: flag_change append mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename # Group events within a transaction to one line. #mail_log_group_events = no # Available fields: uid, box, msgid, from, subject, size, vsize, flags # size and vsize are available only for expunge and copy events. #mail_log_fields = uid box msgid size } > > There's really nothing in the LDA log that could explain why the > message > gets lost. It most likely was successfully delivered by LDA, but got > deleted afterwards for some reason. > > You mean that this user's mails are never supposed to be deleted via > POP3? Verify that with: yes, you got it - it is never supposed only because we are debugging ;O) > > grep 'pop3.*mmanzoni.*del=[^0]' /var/log/dovecot.log > > or wherever those POP3 disconnection messages are logged, i.e. you > should find lots of messages with: > > grep 'pop3.*mmanzoni.*del=0' /var/log/dovecot.log > > OK, tried the following - I have varoius log files grep 'pop3.*mmanzoni.*del=[^0]' deliver.log* and got nothing grep 'pop3.*criva.*del=[^0]' deliver.log* and got deliver.log.1:Dec 15 12:26:16 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=1/8147, del=1613/1613, size=619997598 deliver.log.1:Dec 15 12:27:39 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=200/50212479, del=200/200, size=50208702 deliver.log.1:Dec 15 12:29:08 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=600/203527129, del=600/600, size=203515938 deliver.log.1:Dec 15 12:30:49 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=1000/310592896, del=1000/1000, size=310574037 deliver.log.1:Dec 15 12:31:10 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=399/44426198, del=399/399, size=44418942 deliver.log.2:Dec 15 00:11:09 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=10530/1684049964, del=10530/10530, size=1683854308 so yes, I'm pretty sure that mmanzoni never deletes messages belive to me - usually I try to solve problems myself without disturbing anyone else, but this time is really hard and I do not know if I could face it alone I hope you can help kind regards Marco Carcano From stephan at rename-it.nl Tue Dec 20 17:46:33 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 20 Dec 2011 16:46:33 +0100 Subject: [Dovecot] Sieve too rfc compliant ;-) In-Reply-To: <20111220143815.GA2236@dibs.tanso.net> References: <20111220143815.GA2236@dibs.tanso.net> Message-ID: <4EF0ADD9.6090704@rename-it.nl> On 12/20/2011 3:38 PM, Jan-Frode Myklebust wrote: > It seems we have a few email addresses that are not RFC 5322 compliant, > and now that we've started using sieve these are failing. The problem is > that we have a few addresses with leading, trailing or double dots in > the local part: > > jan..frode at tanso.net > .janfrode at tanso.net > janfrode. at tanso.net > > I believe these has been working fine with everything else in dovecot > (lda, lmtp, imap, pop), but that sieve is more strict. I think it's fair > enough that it's strict with messages generated by sieve scripts, but it > would be nice if it could be more tolerant with messages addressed for > the sieve script. > > So, is there any setting for making it more tolerant ? Could you indicate exactly in what situations these examples cause trouble? What does Sieve log? Then I'll give it a look. Regards, Stephan. From tss at iki.fi Tue Dec 20 18:48:57 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 18:48:57 +0200 Subject: [Dovecot] Mail lost - maybe a bug??? In-Reply-To: References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> <1324388249.6987.32.camel@innu> Message-ID: On 20.12.2011, at 16.52, Marco Carcano wrote: >> Enabling mail_log plugin and/or lazy_expunge plugin would have helped >> more (both mentioned in my previous mail). > > Sorry - I thought I have enabled it, but maybe I did something wrong with the configuration and it was not enabled: > > here is what I did in order to enable mail_log: > > syslog_facility = local5 > > mail_debug = yes > > plugin { > # Events to log. Also available: flag_change append > mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename > # Group events within a transaction to one line. > #mail_log_group_events = no > # Available fields: uid, box, msgid, from, subject, size, vsize, flags > # size and vsize are available only for expunge and copy events. > #mail_log_fields = uid box msgid size > } You're missing: mail_plugins = mail_log >> grep 'pop3.*mmanzoni.*del=[^0]' /var/log/dovecot.log >> >> or wherever those POP3 disconnection messages are logged, i.e. you >> should find lots of messages with: >> >> grep 'pop3.*mmanzoni.*del=0' /var/log/dovecot.log >> >> > > OK, tried the following - I have varoius log files > > grep 'pop3.*mmanzoni.*del=[^0]' deliver.log* > > and got nothing But with: grep 'pop3.*mmanzoni.*del=0' deliver.log* There are log entries listed since December 12? (So they haven't gotten deleted from the logs already?) Also what kind of tools are ever accessing mails? Is it just Dovecot LDA + IMAP + POP3? No doveadm or any external tools? From profymath at yahoo.com Tue Dec 20 20:16:08 2011 From: profymath at yahoo.com (I M) Date: Tue, 20 Dec 2011 10:16:08 -0800 (PST) Subject: [Dovecot] Why imap_open doesn't work as is expected to? Message-ID: <1324404968.11869.YahooMailClassic@web125602.mail.ne1.yahoo.com> Hi, everybody! Question: Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? Note:?imap.so is loaded!?imap.ini is parsed!? From profymath at yahoo.com Tue Dec 20 21:20:21 2011 From: profymath at yahoo.com (I M) Date: Tue, 20 Dec 2011 11:20:21 -0800 (PST) Subject: [Dovecot] Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? Message-ID: <1324408821.52360.YahooMailClassic@web125603.mail.ne1.yahoo.com> Hi, everybody! Question: Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? Note:?imap.so is loaded!?imap.ini is parsed!php flags is checked! Is it a bug? From leolistas at solutti.com.br Tue Dec 20 21:46:28 2011 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Tue, 20 Dec 2011 17:46:28 -0200 Subject: [Dovecot] Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? In-Reply-To: <1324408821.52360.YahooMailClassic@web125603.mail.ne1.yahoo.com> References: <1324408821.52360.YahooMailClassic@web125603.mail.ne1.yahoo.com> Message-ID: <4EF0E614.5090209@solutti.com.br> if it works through telnet, so dovecot is working and you probably have a PHP problem, which should be probably pointed to a PHP related mailing list. Em 20/12/11 17:20, I M escreveu: > Hi, everybody! > Question: Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? > Note: imap.so is loaded! imap.ini is parsed!php flags is checked! > Is it a bug? -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From dmiller at amfes.com Tue Dec 20 22:02:34 2011 From: dmiller at amfes.com (Daniel L. Miller) Date: Tue, 20 Dec 2011 12:02:34 -0800 Subject: [Dovecot] doveadm index In-Reply-To: <1324376325.3597.39.camel@innu> References: <4EE9690A.7040308@amfes.com> <1324376325.3597.39.camel@innu> Message-ID: On 12/20/2011 2:18 AM, Timo Sirainen wrote: > On Wed, 2011-12-14 at 19:27 -0800, Daniel L. Miller wrote: >> Does "doveadm index -A INBOX" reindex everything? What about users with >> multiple folders, both subbed& not subbed under INBOX? > It indexes INBOX (only) for all users. And it doesn't "reindex" > anything, it just adds any missing stuff. > > Ok - IS there a command that will ... fully update ... all folders for all users? Will something like "doveadm search -A text zyxabcxyz > /dev/null" work? -- Daniel From pete at linuxbox.co.uk Wed Dec 21 01:08:14 2011 From: pete at linuxbox.co.uk (Peter Smith) Date: Tue, 20 Dec 2011 23:08:14 -0000 (GMT) Subject: [Dovecot] APOP and AuthDatabase/SQL Message-ID: <403888bda02b86bbf1d557c344d2191f.squirrel@linuxbox.co.uk> Hi, We're running dovecot 1.2.15 and use SQL authentication. We'd like to be able to support APOP, but can't see how this would fit in with SQL auth. Currently we have: password_query = SELECT email as user, password FROM virtual_users WHERE email='%u' or (email LIKE '%n@%%' AND unhashed='%w') It seems that in order to auth APOP logins, we'd need to access variables containing the authentication string sent by the client, and also variables containing the auth string sent in the POP3 greeting. Incidentally, the RFC (1939) suggests using: for the greeting, but it looks as if dovecot uses something else? I'm seeing greetings such as: +OK Dovecot ready. <260f.4abcc.4ef11550.cJD6sQSUSnmPS1B/5RGF0Q==@myhostname.com> base64 encoding? Thanks in advance, Peter Smith From gchodos at gmail.com Wed Dec 21 06:09:17 2011 From: gchodos at gmail.com (Gary Chodos) Date: Tue, 20 Dec 2011 23:09:17 -0500 Subject: [Dovecot] lmtp logging incomplete (does not tell what mailbox mail is actually being saved to!) Message-ID: We created a new virtual domain and created a user in that domain in our pgsql database. Instead of creating any directory structure in /home/virtual/mail//, I just sent a test email to see if dovecot's lmtp would autocreate. And it did! And mail appears to be delivered to an inbox.. but, logging is weird and I'm not sure everything is working as it should because: Dec 20 23:01:28 mx dovecot: lmtp(21458, user at example.com): lUDFG8tZ8U7SUwAAO3tENA: msgid=<20111221040122.GP13367 at hostname.example.org>: saved mail to . so why doesn't dovecot log where mail is stored/saved? thanks, Gary From p at state-of-mind.de Wed Dec 21 07:18:03 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 21 Dec 2011 06:18:03 +0100 Subject: [Dovecot] Problem listing SPECIAL-USE flags Message-ID: <20111221051802.GB2286@state-of-mind.de> Timo, we want to implement SPECIAL-USE in Thunderbird (TB), but we've run into problems. I believe you could help change that. Here's the problem: By default TB only lists subscribed (LSUB) folders when it accesses an IMAP server. However when I do a LSUB on recent Dovecot 2.1 code from mercurial I don't get to see the SPECIAL-USE flags. Therefore TB fails to identify which folders it should use and map to until someone tells it to list all folders (LIST) manually. Central part of the SPECIAL-USE idea was/is to require as little user interaction as possible to automatically setup a MUA to do the right thing. Speculating that probably most MUAs will do a LSUB by default and never will get to see SPECIAL-USE flags I think it is easier to have the server-side promote the flags. Do you think that would be possible? Just to verify I configured Dovecot as you would expect for SPECIAL-USE: I've set Dovecot 2.1 to autocreate and autosubscribe SPECIAL-USE mailboxes like this: namespace inbox { ... mailbox AltDrafts { special_use = \Drafts auto = subscribe } ... } This is what I get: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5] Dovecot 2.1 ready. t1 login alice at example.com secret t1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS FUZZY SPECIAL-USE] Logged in t2 LSUB "" "%" * LSUB () "." "Trash" * LSUB () "." "AltDrafts" * LSUB () "." "AltSent" * LSUB () "." "Archives" * LSUB () "." "AltTrash" * LSUB () "." "AltJunk" * LSUB () "." "AltArchive" * LSUB () "." "Junk" t2 OK Lsub completed. t3 LIST "" "%" * LIST (\HasNoChildren \Sent) "." "AltSent" * LIST (\HasChildren) "." "Archives" * LIST (\HasNoChildren \Archive) "." "AltArchive" * LIST (\HasNoChildren \Junk) "." "AltJunk" * LIST (\HasNoChildren) "." "Junk" * LIST (\HasNoChildren \Trash) "." "AltTrash" * LIST (\HasNoChildren \Drafts) "." "AltDrafts" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "INBOX" t3 OK List completed. t4 logout * BYE Logging out t4 OK Logout completed. Connection closed by foreign host. Thanks, p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From slusarz at curecanti.org Wed Dec 21 08:24:44 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 20 Dec 2011 23:24:44 -0700 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111221051802.GB2286@state-of-mind.de> References: <20111221051802.GB2286@state-of-mind.de> Message-ID: <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> Quoting Patrick Ben Koetter

: > we want to implement SPECIAL-USE in Thunderbird (TB), but we've run into > problems. I believe you could help change that. > > Here's the problem: > > By default TB only lists subscribed (LSUB) folders when it accesses an IMAP > server. However when I do a LSUB on recent Dovecot 2.1 code from mercurial I > don't get to see the SPECIAL-USE flags. Therefore TB fails to identify which > folders it should use and map to until someone tells it to list all folders > (LIST) manually. > > Central part of the SPECIAL-USE idea was/is to require as little user > interaction as possible to automatically setup a MUA to do the right thing. > > Speculating that probably most MUAs will do a LSUB by default and never will > get to see SPECIAL-USE flags I think it is easier to have the server-side > promote the flags. Except you never, never, never, never, never can rely on LSUB for mailbox attributes. It says so right in RFC 3501 [6.3.9]: The returned untagged LSUB response MAY contain different mailbox flags from a LIST untagged response. If this should happen, the flags in the untagged LIST are considered more authoritative. See also RFC 5258 [3.1], which discusses the difference between the base RFC 3501 LSUB command and the LIST-EXTENDED SUBSCRIBED option: This option is intended to supplement the LSUB command. Of particular note are the mailbox attributes as returned by this option, compared with what is returned by LSUB. With the latter, the attributes returned may not reflect the actual attribute status on the mailbox name, and the \NoSelect attribute has a second special meaning (it indicates that this mailbox is not, itself, subscribed, but that it has descendant mailboxes that are). With the SUBSCRIBED selection option described here, the attributes are accurate and complete, and have no special meanings. "LSUB" and "LIST (SUBSCRIBED)" are, thus, not the same thing, and some servers must do significant extra work to respond to "LIST (SUBSCRIBED)". Because of this, clients SHOULD continue to use "LSUB" unless they specifically want the additional information offered by "LIST (SUBSCRIBED)". Even if Timo changes things on Dovecot, you still can't rely on the flags returned from an LSUB command because other servers are not guaranteed to act the same way. That's just the reality of IMAP. LSUB is only useful for grabbing the list of subscribed mailboxes (I *really* hope TB is not using flags from the LSUB response for any meaningful purpose - that is simply badly broken behavior). In conclusion, there are 2 ways of handling special-use flags: 1. If the server that supports SPECIAL-USE also supports LIST-EXTENDED (RFC 5258), you are in luck. You can then use LIST-EXTENDED which can accurately retrieve both the list of subscribed mailboxes and special-use flags in a single command. 2. If the server supports SPECIAL-USE but does NOT support LIST-EXTENDED, you MUST make a LIST call. A LSUB call is not sufficient. It's inefficient, but that's the only way to be 100% sure the information in the response is accurate. michael From tss at iki.fi Wed Dec 21 08:26:42 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 08:26:42 +0200 Subject: [Dovecot] doveadm index In-Reply-To: References: <4EE9690A.7040308@amfes.com> <1324376325.3597.39.camel@innu> Message-ID: <34DB33F4-27C1-41DA-91F5-46F0AA712C78@iki.fi> On 20.12.2011, at 22.02, Daniel L. Miller wrote: > On 12/20/2011 2:18 AM, Timo Sirainen wrote: >> On Wed, 2011-12-14 at 19:27 -0800, Daniel L. Miller wrote: >>> Does "doveadm index -A INBOX" reindex everything? What about users with >>> multiple folders, both subbed& not subbed under INBOX? >> It indexes INBOX (only) for all users. And it doesn't "reindex" >> anything, it just adds any missing stuff. >> >> > Ok - IS there a command that will ... fully update ... all folders for all users? Will something like "doveadm search -A text zyxabcxyz > /dev/null" work? For updating full text search indexes, I guess you could do a "doveadm fetch uid text asdfasf > /dev/null".. But some day doveadm index (and several other commands) should allow wildcards in mailbox names, so you could just do doveadm index -A '*' From tss at iki.fi Wed Dec 21 08:28:42 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 08:28:42 +0200 Subject: [Dovecot] APOP and AuthDatabase/SQL In-Reply-To: <403888bda02b86bbf1d557c344d2191f.squirrel@linuxbox.co.uk> References: <403888bda02b86bbf1d557c344d2191f.squirrel@linuxbox.co.uk> Message-ID: <4F901E30-3A93-4C88-87A7-0E8342C1A3A2@iki.fi> On 21.12.2011, at 1.08, Peter Smith wrote: > We're running dovecot 1.2.15 and use SQL authentication. We'd like to > be able to support APOP, but can't see how this would fit in with SQL > auth. > > Currently we have: > > password_query = SELECT email as user, password FROM virtual_users > WHERE email='%u' or (email LIKE '%n@%%' AND unhashed='%w') > > It seems that in order to auth APOP logins, we'd need to access > variables containing the authentication string sent by the client, and > also variables containing the auth string sent in the POP3 greeting. The only way to get it working is to have the password_query return the password in plaintext, so Dovecot can do the APOP check. There's no way to get the APOP greeting string. From tss at iki.fi Wed Dec 21 08:29:43 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 08:29:43 +0200 Subject: [Dovecot] lmtp logging incomplete (does not tell what mailbox mail is actually being saved to!) In-Reply-To: References: Message-ID: On 21.12.2011, at 6.09, Gary Chodos wrote: > We created a new virtual domain and created a user in that domain in > our pgsql database. Instead of creating any directory structure in > /home/virtual/mail//, I just sent a test email to see if > dovecot's lmtp would autocreate. And it did! And mail appears to be > delivered to an inbox.. but, logging is weird and I'm not sure > everything is working as it should because: > > Dec 20 23:01:28 mx dovecot: lmtp(21458, user at example.com): > lUDFG8tZ8U7SUwAAO3tENA: > msgid=<20111221040122.GP13367 at hostname.example.org>: saved mail to > > . so why doesn't dovecot log where mail is stored/saved? That's a bug. Fixed by http://hg.dovecot.org/dovecot-2.0/rev/6d188f4e8e6a The empty string anyway means INBOX. From tss at iki.fi Wed Dec 21 08:38:51 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 08:38:51 +0200 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> Message-ID: <7151089E-C041-4A17-BA68-97615EED6BEC@iki.fi> On 21.12.2011, at 8.24, Michael M Slusarz wrote: > That's just the reality of IMAP. LSUB is only useful for grabbing the list of subscribed mailboxes (I *really* hope TB is not using flags from the LSUB response for any meaningful purpose - that is simply badly broken behavior). It does: # tb-lsub-flags: # Show \Noselect flags for LSUB replies with LAYOUT=fs (e.g. mbox). # This makes Thunderbird realize they aren't selectable and show them # greyed out, instead of only later giving "not selectable" popup error. > In conclusion, there are 2 ways of handling special-use flags: > > 1. If the server that supports SPECIAL-USE also supports LIST-EXTENDED (RFC 5258), you are in luck. You can then use LIST-EXTENDED which can accurately retrieve both the list of subscribed mailboxes and special-use flags in a single command. > 2. If the server supports SPECIAL-USE but does NOT support LIST-EXTENDED, you MUST make a LIST call. A LSUB call is not sufficient. It's inefficient, but that's the only way to be 100% sure the information in the response is accurate. Agreed. I thought about adding the flags to LSUB, but then thought that other servers probably won't do it either. Note how GMail sends them with XLIST command, but there is no XLSUB command. From marco at carcano.ch Wed Dec 21 10:54:05 2011 From: marco at carcano.ch (marco at carcano.ch) Date: Wed, 21 Dec 2011 09:54:05 +0100 Subject: [Dovecot] =?utf-8?q?Mail_lost_-_maybe_a_bug=3F=3F=3F?= In-Reply-To: References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> <1324388249.6987.32.camel@innu> Message-ID: <23a86409a8afc748266069adfd1bc17b@localhost> Hello Timo of course we have entries: grep 'pop3.*mmanzoni.*del=0.*' deliver.log* |grep "Dec 12" deliver.log.2:Dec 12 13:13:19 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=23/2025701, del=0/3920, size=700800292 deliver.log.2:Dec 12 13:46:02 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=1/475746, del=0/3921, size=701276018 deliver.log.2:Dec 12 14:58:08 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=8/911587, del=0/3929, size=702187446 deliver.log.2:Dec 12 14:58:09 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3929, size=702187446 deliver.log.2:Dec 12 15:55:24 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=1/936418, del=0/3930, size=703123844 deliver.log.2:Dec 12 16:40:59 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=1/421415, del=0/3931, size=703545240 deliver.log.2:Dec 12 16:43:23 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 deliver.log.2:Dec 12 17:37:21 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 deliver.log.2:Dec 12 17:44:38 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 deliver.log.2:Dec 12 18:14:29 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 deliver.log.2:Dec 12 18:17:50 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 Also what kind of tools are ever accessing mails? Is it just Dovecot LDA + IMAP + POP3? No doveadm or any external tools? yes, only LDA + IMAP + POP3, no external tools I hope you have some ideas Kind regards Marco carcano From jtam.home at gmail.com Wed Dec 21 11:10:58 2011 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 21 Dec 2011 01:10:58 -0800 (PST) Subject: [Dovecot] Why imap_open doesn't work as is expected to? In-Reply-To: References: Message-ID: I M writes: > Question: Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? > Note:?imap.so is loaded!?imap.ini is parsed!? After the imap_open() invocation, you should check for error messages in your PHP logs, or dump all the errors using imap_errors(); Without more details, I would say you dropped one of those /option-flags or got the mailbox argument syntax wrong. Joseph Tam From lars at nulogic.net Wed Dec 21 16:11:36 2011 From: lars at nulogic.net (Lars Larsen) Date: Wed, 21 Dec 2011 14:11:36 +0000 (UTC) Subject: [Dovecot] Sieve filter not working Message-ID: Hi, Dovecot, the "deliver" LDA and managesieve are all working. However, the sieve rules do not seem to work: System info: CenOS 2.6.32-131.21.1.el6.x86_64 #1 SMP dovecot-pigeonhole-2.0.9-2.el6_1.1.x86_64 dovecot-2.0.9-2.el6_1.1.x86_64 /etc/dovecot/dovecot.conf: mbox_write_locks = fcntl protocols = imap pop3 sieve passdb { driver = pam } ssl_cert = I suspect, that dovecot v2.0.16 under Linux (tested on Gentoo 3.0.4 Hardened, Gentoo 3.0.6, Gentoo 3.1.4) causes 100% cpu utilization when index.cache is broken and doveadm is lanched. Dovecot uses LDAP as the userdb and provides IMAP and LDA. Because each user has a quota, the doveadm's expunge functionality is used to get rid of old trashed mail. The mail log: Dec 12 07:38:59 www dovecot: imap(user): Error: Corrupted index cache file /var/data/mail/domain.tld/user/mail/dovecot.index.cache: invalid record size Doveadm is launched as: doveadm -D expunge -A mailbox Trash savedbefore 1w Mail is stored on ext4 and flush will use all of the CPU capacity like this: load average: 4.00, 4.01, 4.05 ps: root 26401 98.2 0.0 0 0 ? R Dec20 1369:49 [flush-253:1] lsblk: vg_data-mail (dm-1) 253:1 0 500M 0 /var/data/mail dovecot -n: # 2.0.16: /etc/dovecot/dovecot.conf # OS: Linux 3.0.4-hardened-r5 x86_64 Gentoo Base System release 2.0.3 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes hostname = mail.domain.tld lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * mail_debug = yes mail_gid = vmail mail_home = /var/data/mail/domain.tld/%n mail_location = maildir:~/mail mail_plugins = " mail_log notify zlib quota" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { autocreate = Sent autocreate2 = Trash autocreate3 = Spam autosubscribe = Sent autosubscribe2 = Trash autosubscribe3 = Spam fts = squat fts_squat = partial=4 full=10 quota = maildir:User quota quota_rule = *:storage=100M quota_rule2 = Trash:ignore quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_quota_max_scripts = 5 sieve_quota_max_storage = 5M } postmaster_address = postmaster at domain.tld protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service quota-warning { executable = script /etc/dovecot/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl_cert = Hi all, Is there an option to disable (server-side) the deletion of read mails after fetching them via POP3, regardless of the MUA config? Here are the issues I'm facing: - my boss wants to force everyone into a server-side "no delete message"-policy, for archiving, auditing and backup&recovery purposes - the requisite here is pop3, so imap is out - the mailusers are virtual users (held in a mysql db) - don't have the budget to set up a separate mail-arvhing server - don't want to use shaggy ways (aka immutable flag, r/w permissions for Maildirs, etc) dovecot --version 2.0.15 Help? Thanks! From rick at havokmon.com Wed Dec 21 19:01:17 2011 From: rick at havokmon.com (Rick Romero) Date: Wed, 21 Dec 2011 11:01:17 -0600 Subject: [Dovecot] Can I block dovecot from deleting read messages, after being fetched? In-Reply-To: References: Message-ID: <20111221110117.Horde.EM4JIW2tkQ9O8hDd7J0hY5Q@beta.vfemail.net> The policy apparently doesn't cover archiving outgoing email ? Typically you set up your SMTP service to 'BCC' an archive mailbox to achieve a complete archive of both incoming and outgoing mail. Rick Quoting Vasiliu Adrian : > Hi all, > Is there an option to disable (server-side) the deletion of read mails > after fetching them via POP3, regardless of the MUA config? > > Here are the issues I'm facing: > > - my boss wants to force everyone into a server-side "no delete > message"-policy, for archiving, auditing and backup&recovery purposes > - the requisite here is pop3, so imap is out > - the mailusers are virtual users (held in a mysql db) > - don't have the budget to set up a separate mail-arvhing server > - don't want to use shaggy ways (aka immutable flag, r/w permissions for > Maildirs, etc) > > dovecot --version > 2.0.15 > > Help? > Thanks! From miquels at cistron.nl Wed Dec 21 19:10:40 2011 From: miquels at cistron.nl (Miquel van Smoorenburg) Date: Wed, 21 Dec 2011 18:10:40 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <1324264438.11142.9.camel@tardis> References: <1324256311.8138.5.camel@tardis> <1324264438.11142.9.camel@tardis> Message-ID: <4EF21310.9010302@cistron.nl> On 19-12-11 4:13 AM, Noel Butler wrote: > On Mon, 2011-12-19 at 02:32 +0100, Sven Hartge wrote: > >> Noel Butler wrote: >>> On Mon, 2011-12-19 at 00:32 +0100, Cor Bosman wrote: >> >>>> # 2.0.16: /usr/local/etc/dovecot/dovecot.conf >>>> # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 >> >>> Have you tried using a modern kernel? that one is about 2 years old. >> >> Well, this _is_ the kernel from Debian Stable and based on the >> Long-Term-Release from the kernel maintainers. > > > So what? It is not anything current, that the kernel dev team would > waste their time on. The kernel developers actually do "waste their time" on the 2.6.32.x kernel. It's a long-term stable kernel, there are frequent releases on kernel.org (I admit, .36 is a bit long in the tooth, latest is .50, released about 2 weeks ago). Mike. From tss at iki.fi Wed Dec 21 19:14:44 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 19:14:44 +0200 Subject: [Dovecot] Can I block dovecot from deleting read messages, after being fetched? In-Reply-To: References: Message-ID: <7DB25AB3-9942-4A30-9634-1C1FC6627E25@iki.fi> On 21.12.2011, at 18.51, Vasiliu Adrian wrote: > Is there an option to disable (server-side) the deletion of read mails > after fetching them via POP3, regardless of the MUA config? Global ACL for INBOX that gives owner a read-only access would do it. Or maybe http://wiki2.dovecot.org/Plugins/Lazyexpunge? That would work better if the POP3 client can't handle keeping mails on the server (but instead keeps on redownloading them). From tss at iki.fi Wed Dec 21 19:16:52 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 19:16:52 +0200 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: Message-ID: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> On 21.12.2011, at 18.38, hydra wrote: > I suspect, that dovecot v2.0.16 under Linux (tested on Gentoo 3.0.4 > Hardened, Gentoo 3.0.6, Gentoo 3.1.4) causes 100% cpu utilization when > index.cache is broken and doveadm is lanched. Dovecot uses LDAP as the > userdb and provides IMAP and LDA. Because each user has a quota, the > doveadm's expunge functionality is used to get rid of old trashed mail. > > The mail log: > Dec 12 07:38:59 www dovecot: imap(user): Error: Corrupted index cache file > /var/data/mail/domain.tld/user/mail/dovecot.index.cache: invalid record size OK.. > Mail is stored on ext4 and flush will use all of the CPU capacity like this: > load average: 4.00, 4.01, 4.05 > > ps: > root 26401 98.2 0.0 0 0 ? R Dec20 1369:49 > [flush-253:1] That's a kernel process.. > I suspect, that this is something to do with Dovecot, because after > deleting the dovecot.index.cache file, everything went back to normal. When > this happens, I cannot unmount the drive nor a system reboot works. That's a kernel bug.. I think you're thinking it the wrong way: Dovecot isn't causing your system to break. Your system is causing Dovecot to break. Faulty hardware or faulty kernel. From e-frog at gmx.de Wed Dec 21 19:35:51 2011 From: e-frog at gmx.de (e-frog) Date: Wed, 21 Dec 2011 18:35:51 +0100 Subject: [Dovecot] doveadm index In-Reply-To: <34DB33F4-27C1-41DA-91F5-46F0AA712C78@iki.fi> References: <4EE9690A.7040308@amfes.com> <1324376325.3597.39.camel@innu> <34DB33F4-27C1-41DA-91F5-46F0AA712C78@iki.fi> Message-ID: <4EF218F7.2050709@gmx.de> On 21.12.2011 07:26, wrote Timo Sirainen: > On 20.12.2011, at 22.02, Daniel L. Miller wrote: > >> On 12/20/2011 2:18 AM, Timo Sirainen wrote: >>> On Wed, 2011-12-14 at 19:27 -0800, Daniel L. Miller wrote: >>>> Does "doveadm index -A INBOX" reindex everything? What about users with >>>> multiple folders, both subbed& not subbed under INBOX? >>> It indexes INBOX (only) for all users. And it doesn't "reindex" >>> anything, it just adds any missing stuff. >>> >>> >> Ok - IS there a command that will ... fully update ... all folders for all users? Will something like "doveadm search -A text zyxabcxyz> /dev/null" work? > > For updating full text search indexes, I guess you could do a "doveadm fetch uid text asdfasf> /dev/null".. > > But some day doveadm index (and several other commands) should allow wildcards in mailbox names, so you could just do doveadm index -A '*' Actually I'm using doveadm index -A '*' in a daily cron job and it seems to work for me. At least the timestamps of the dovecot.index.search and dovecot.index.search.uids files equal or close to the cron job start time in every folder. Is there a way to examine the search index? Doveadm dump doesn't seem to like it. $: doveadm dump dovecot.index.search $: doveadm(vmail): Fatal: Can't autodetect file type: dovecot.index.search Thanks, e-frog From newsl at aradriel.de Wed Dec 21 21:23:22 2011 From: newsl at aradriel.de (Julien Lacroix) Date: Wed, 21 Dec 2011 20:23:22 +0100 Subject: [Dovecot] compile dovecot-sieve for dovecot 1.2.9 (ubuntu pkg) Message-ID: <4EF2322A.6040806@aradriel.de> Cheers, I've a running Dovecot 1.2.9, installed from the ubuntu 10.04 Lucid LTS repository and trying to get the dovecot-sieve plugin (which seems to be not included in the lucid repo) compiled. Method 1 listed in http://wiki.dovecot.org/LDA/Sieve/Dovecot wont work, seems the rpm was build without --enable-header-install Is it sufficient to download the sources from http://archive.ubuntu.com/ubuntu/pool/main/d/dovecot/dovecot_1.2.9.orig.tar.gz and use them for ./configure --with-dovecot=$path ? thanks and happy holidays julien From p at state-of-mind.de Wed Dec 21 21:42:48 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 21 Dec 2011 20:42:48 +0100 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> Message-ID: <20111221194248.GB2293@state-of-mind.de> * Michael M Slusarz : > Quoting Patrick Ben Koetter

: > >we want to implement SPECIAL-USE in Thunderbird (TB), but we've run into > >problems. I believe you could help change that. > > > >Here's the problem: > > > >By default TB only lists subscribed (LSUB) folders when it accesses an IMAP > >server. However when I do a LSUB on recent Dovecot 2.1 code from mercurial I > >don't get to see the SPECIAL-USE flags. Therefore TB fails to identify which > >folders it should use and map to until someone tells it to list all folders > >(LIST) manually. > > > >Central part of the SPECIAL-USE idea was/is to require as little user > >interaction as possible to automatically setup a MUA to do the right thing. > > > >Speculating that probably most MUAs will do a LSUB by default and never will > >get to see SPECIAL-USE flags I think it is easier to have the server-side > >promote the flags. > > Except you never, never, never, never, never can rely on LSUB for > mailbox attributes. It says so right in RFC 3501 [6.3.9]: > > The returned untagged LSUB response MAY contain different mailbox > flags from a LIST untagged response. If this should happen, the > flags in the untagged LIST are considered more authoritative. > > See also RFC 5258 [3.1], which discusses the difference between the > base RFC 3501 LSUB command and the LIST-EXTENDED SUBSCRIBED option: > > This option is > intended to supplement the LSUB command. Of particular note are > the mailbox attributes as returned by this option, compared with > what is returned by LSUB. With the latter, the attributes > returned may not reflect the actual attribute status on the > mailbox name, and the \NoSelect attribute has a second special > meaning (it indicates that this mailbox is not, itself, > subscribed, but that it has descendant mailboxes that are). With > the SUBSCRIBED selection option described here, the attributes are > accurate and complete, and have no special meanings. "LSUB" and > "LIST (SUBSCRIBED)" are, thus, not the same thing, and some > servers must do significant extra work to respond to "LIST > (SUBSCRIBED)". Because of this, clients SHOULD continue to use > "LSUB" unless they specifically want the additional information > offered by "LIST (SUBSCRIBED)". Thanks for the clarification. I did some reading to get a better understanding. We'll probably stick with this and may go for LIST if the server does not announce LIST-EXTENTED: t2 LIST "" "%" RETURN (SPECIAL-USE) * LIST (\Sent) "." "AltSent" * LIST () "." "Archives" * LIST (\Archive) "." "AltArchive" * LIST (\Junk) "." "AltJunk" * LIST () "." "Junk" * LIST (\Trash) "." "AltTrash" * LIST (\Drafts) "." "AltDrafts" * LIST () "." "Trash" * LIST () "." "INBOX" t2 OK List completed. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From CMarcus at Media-Brokers.com Wed Dec 21 21:45:19 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 21 Dec 2011 14:45:19 -0500 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111221194248.GB2293@state-of-mind.de> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> <20111221194248.GB2293@state-of-mind.de> Message-ID: <4EF2374F.7010300@Media-Brokers.com> On 2011-12-21 2:42 PM, Patrick Ben Koetter

wrote: > Thanks for the clarification. I did some reading to get a better > understanding. We'll probably stick with this and may go for LIST if the > server does not announce LIST-EXTENTED So... out of curoisity, does dovecot support LIST-EXTENDED? -- Best regards, Charles From p at state-of-mind.de Wed Dec 21 21:50:55 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 21 Dec 2011 20:50:55 +0100 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <4EF2374F.7010300@Media-Brokers.com> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> <20111221194248.GB2293@state-of-mind.de> <4EF2374F.7010300@Media-Brokers.com> Message-ID: <20111221195055.GC2293@state-of-mind.de> * Charles Marcus : > On 2011-12-21 2:42 PM, Patrick Ben Koetter

wrote: > >Thanks for the clarification. I did some reading to get a better > >understanding. We'll probably stick with this and may go for LIST if the > >server does not announce LIST-EXTENTED > > So... out of curoisity, does dovecot support LIST-EXTENDED? Yes, it does. See the full session below: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5] Dovecot 2.1 ready. 1 login alice at example.com secret 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS FUZZY SPECIAL-USE] Logged in t2 LIST "" "%" RETURN (SPECIAL-USE) * LIST (\Sent) "." "AltSent" * LIST () "." "Archives" * LIST (\Archive) "." "AltArchive" * LIST (\Junk) "." "AltJunk" * LIST () "." "Junk" * LIST (\Trash) "." "AltTrash" * LIST (\Drafts) "." "AltDrafts" * LIST () "." "Trash" * LIST () "." "INBOX" t2 OK List completed. t3 logout * BYE Logging out t3 OK Logout completed. -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From p at state-of-mind.de Wed Dec 21 21:56:05 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 21 Dec 2011 20:56:05 +0100 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111221195055.GC2293@state-of-mind.de> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> <20111221194248.GB2293@state-of-mind.de> <4EF2374F.7010300@Media-Brokers.com> <20111221195055.GC2293@state-of-mind.de> Message-ID: <20111221195605.GE2293@state-of-mind.de> Timo, if I read the specs correctly http://tools.ietf.org/html/rfc6154#section-5.2 says the following command should work too: C: t3 LIST (SPECIAL-USE) "" "*" S: * LIST (\Sent) "/" SentMail S: * LIST (\Marked \Drafts) "/" MyDrafts S: * LIST (\Trash) "/" Trash S: t3 OK done However if I send that command it fails: t2 LIST (SPECIAL-USE) "" "*" t2 BAD Error in IMAP command LIST: Unknown select options Is that a bug or was a decision on purpose? p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From tss at iki.fi Wed Dec 21 21:59:53 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 21:59:53 +0200 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111221195605.GE2293@state-of-mind.de> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> <20111221194248.GB2293@state-of-mind.de> <4EF2374F.7010300@Media-Brokers.com> <20111221195055.GC2293@state-of-mind.de> <20111221195605.GE2293@state-of-mind.de> Message-ID: On 21.12.2011, at 21.56, Patrick Ben Koetter wrote: > if I read the specs correctly http://tools.ietf.org/html/rfc6154#section-5.2 > says the following command should work too: > > C: t3 LIST (SPECIAL-USE) "" "*" Yes. > However if I send that command it fails: > > t2 LIST (SPECIAL-USE) "" "*" > t2 BAD Error in IMAP command LIST: Unknown select options > > Is that a bug or was a decision on purpose? I forgot that existed. I'll add it. From xchris89x at googlemail.com Thu Dec 22 01:15:09 2011 From: xchris89x at googlemail.com (Christopher Stolzenberg) Date: Thu, 22 Dec 2011 00:15:09 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <4EF05A12.7010502@tesco.net> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> Message-ID: 2011/12/20 Ron Leach : > On 20/12/2011 09:11, Cor Bosman wrote: >> >> I installed a newer kernel on these boxes, and it's fixed. Seems to be >> a problem with the stock debian squeeze kernel. Not a dovecot issue, but >> others with a stable squeeze box might see similar problems so good >> to have it in the archive :) > > > Indeed; very many of us use Debian stable. ?Which kernel did you install > that is 2.0.16-friendly, and was this from Debian stable's updates system? > > regards, Ron Debian for production servers??? That sounds dangerous. -- Chris From jk at jkart.de Thu Dec 22 01:26:35 2011 From: jk at jkart.de (Jim Knuth) Date: Thu, 22 Dec 2011 00:26:35 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> Message-ID: <4EF26B2B.1090507@jkart.de> am 22.12.11 00:15 schrieb Christopher Stolzenberg : >> Indeed; very many of us use Debian stable. Which kernel did you install >> that is 2.0.16-friendly, and was this from Debian stable's updates system? >> >> regards, Ron > > Debian for production servers??? That sounds dangerous. sorry, but that`s absolutely bulls*it. *lol* Where have you read then THIS? > > -- > Chris -- Mit freundlichen Gr??en, with kind regards, Jim Knuth From xchris89x at googlemail.com Thu Dec 22 01:49:52 2011 From: xchris89x at googlemail.com (Christopher Stolzenberg) Date: Thu, 22 Dec 2011 00:49:52 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <4EF26B2B.1090507@jkart.de> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> Message-ID: 2011/12/22 Jim Knuth : > am 22.12.11 00:15 schrieb Christopher Stolzenberg > > : > > >>> Indeed; very many of us use Debian stable. ?Which kernel did you install >>> that is 2.0.16-friendly, and was this from Debian stable's updates >>> system? >>> >>> regards, Ron >> >> >> Debian for production servers??? That sounds dangerous. > > > sorry, but that`s absolutely bulls*it. *lol* > Where have you read then THIS? My own experience! Reasons against Debian: - No LSB certification (Linux Standard Base) - No hardware certification (IBM, Dell, HP ...) - Incompatible with some Broadcom NICs - Full of bugs - Free Kernel (non-free firmware removed... lol) - Obsolete kernel (incompatible with new hardware) - Obsolete packages - Only one year support for oldstable *lol* - Long delay for security updates -- Chris From mcbdovecot at robuust.nl Thu Dec 22 01:54:50 2011 From: mcbdovecot at robuust.nl (Maarten Bezemer) Date: Thu, 22 Dec 2011 00:54:50 +0100 (CET) Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: Message-ID: On Mon, 19 Dec 2011, Cor Bosman wrote: > # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 Are you sure you didn't roll your own kernel? Debian kernels I know don't use the ".36" suffix, but ship as 2.6.32-something and use their own internal version numbering. For example, I found this on packages.debian.org: linux-image-2.6.32-5-amd64 (2.6.32-38) According to changelog, this actually carries patches from 2.6.32.46, yet only shows in uname as 2.6.32-5-amd64. Also a friendly reminder for the question asked by Ron Leach: which kernel version did you install that appears to be Dovecot-friendlier? Would be very useful to have that in the archives as well. By the way, happy holidays to everyone ;-) -- Maarten From djonas at vitalwerks.com Thu Dec 22 03:52:59 2011 From: djonas at vitalwerks.com (David Jonas) Date: Wed, 21 Dec 2011 17:52:59 -0800 Subject: [Dovecot] Maildir migration and uids Message-ID: <4EF28D7B.8050601@vitalwerks.com> I'm in the process of migrating a large number of maildirs to a 3rd party dovecot server (from a dovecot server). Tests have shown that using imap to sync the accounts doesn't preserve the uidl for pop3 access. My current attempt is to convert the maildir to mbox and add an X-UIDL header in the process. Run a second dovecot that serves the converted mbox. But dovecot's docs say, "None of these headers are sent to IMAP/POP3 clients when they read the mail". Is there any way to sync these maildirs to the new server and maintain the uids? The real goal is keep customers email clients happy when they are pointed at the new server. Am I just wishing? From noel.butler at ausics.net Thu Dec 22 04:13:22 2011 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 22 Dec 2011 12:13:22 +1000 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> Message-ID: <1324520002.7098.14.camel@tardis> On Thu, 2011-12-22 at 00:49 +0100, Christopher Stolzenberg wrote: > 2011/12/22 Jim Knuth : > > am 22.12.11 00:15 schrieb Christopher Stolzenberg > > > > : > > > > > >>> Indeed; very many of us use Debian stable. Which kernel did you install > >>> that is 2.0.16-friendly, and was this from Debian stable's updates > >>> system? > >>> > >>> regards, Ron > >> > >> > >> Debian for production servers??? That sounds dangerous. > > > > > > sorry, but that`s absolutely bulls*it. *lol* > > Where have you read then THIS? > > My own experience! > > Reasons against Debian: > > - No LSB certification (Linux Standard Base) > - No hardware certification (IBM, Dell, HP ...) > - Incompatible with some Broadcom NICs > - Full of bugs > - Free Kernel (non-free firmware removed... lol) > - Obsolete kernel (incompatible with new hardware) > - Obsolete packages > - Only one year support for oldstable *lol* > - Long delay for security updates > > -- > Chris Reasons for debian: They have largest number of packages! ... oh Wait! thats because they break up simple packages into 8-10 sub packages where as other distros use single or split in two .. yeah, scratch that... you're right, no pro's that I can think of ;) Ahhh just before I hit send I remember one, debian, like windows, is an ideal distro on a server in a Colo that charges for remote hands (incl reboots), cause they have the highest fail rate. Most stable OS's from colo are freebsd, slackware, RHEL, CentOS (ok same thing) and SuSE, and surprisingly, we once had a customer with an old win2K box back in mid 00's, that was very well behaved, and it was busy, they ran a concert/band/event ticketing site on it, truly amazed me that box. Worse OS's would be netbsd, fedora, debian, ubuntu, mint, windows* .. but very very nice money earners for remote hands :P -------------- next part -------------- A non-text attachment was scrubbed... Name: face-raspberry.png Type: image/png Size: 865 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: face-wink.png Type: image/png Size: 876 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From gchodos at gmail.com Thu Dec 22 05:12:40 2011 From: gchodos at gmail.com (Gary Chodos) Date: Wed, 21 Dec 2011 22:12:40 -0500 Subject: [Dovecot] lmtp logging incomplete (does not tell what mailbox mail is actually being saved to!) In-Reply-To: References: Message-ID: On Wed, Dec 21, 2011 at 1:29 AM, Timo Sirainen wrote: > On 21.12.2011, at 6.09, Gary Chodos wrote: > >> We created a new virtual domain and created a user in that domain in >> our pgsql database. ?Instead of creating any directory structure in >> /home/virtual/mail//, I just sent a test email to see if >> dovecot's lmtp would autocreate. ?And it did! ?And mail appears to be >> delivered to an inbox.. but, logging is weird and I'm not sure >> everything is working as it should because: >> >> Dec 20 23:01:28 mx dovecot: lmtp(21458, user at example.com): >> lUDFG8tZ8U7SUwAAO3tENA: >> msgid=<20111221040122.GP13367 at hostname.example.org>: saved mail to >> >> . so why doesn't dovecot log where mail is stored/saved? > > That's a bug. Fixed by http://hg.dovecot.org/dovecot-2.0/rev/6d188f4e8e6a > > The empty string anyway means INBOX. ahhhh, thanks Timo! From simon.brereton at buongiorno.com Thu Dec 22 06:18:54 2011 From: simon.brereton at buongiorno.com (Simon Brereton) Date: Wed, 21 Dec 2011 23:18:54 -0500 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <1324520002.7098.14.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> Message-ID: On Dec 21, 2011 9:13 PM, "Noel Butler" wrote: > > On Thu, 2011-12-22 at 00:49 +0100, Christopher Stolzenberg wrote: > > > 2011/12/22 Jim Knuth : > > > am 22.12.11 00:15 schrieb Christopher Stolzenberg > > > > > > : > > > > > > > > >>> Indeed; very many of us use Debian stable. Which kernel did you install > > >>> that is 2.0.16-friendly, and was this from Debian stable's updates > > >>> system? > > >>> > > >>> regards, Ron > > >> > > >> > > >> Debian for production servers??? That sounds dangerous. > > > > > > > > > sorry, but that`s absolutely bulls*it. *lol* > > > Where have you read then THIS? > > > > My own experience! > > > > Reasons against Debian: > > > > - No LSB certification (Linux Standard Base) > > - No hardware certification (IBM, Dell, HP ...) > > - Incompatible with some Broadcom NICs > > - Full of bugs > > - Free Kernel (non-free firmware removed... lol) > > - Obsolete kernel (incompatible with new hardware) > > - Obsolete packages > > - Only one year support for oldstable *lol* > > - Long delay for security updates I'm with Jim. Debian has served me well for years. This is just distro-bias. Sure, you need modicum more sense and hands on experience, but that's not bad thing in a production environment.. It would be interesting to chart the number of threads caused by each distro. I don't know who would have the least, but I suspect gentoo and centos would be out in front, with Ubuntu panting along behind.. Simon > > Reasons for debian: > They have largest number of packages! ... oh Wait! thats because they > break up simple packages into 8-10 sub packages where as other distros > use single or split in two .. yeah, scratch that... you're right, no > pro's that I can think of ;) > > Ahhh just before I hit send I remember one, debian, like windows, is an > ideal distro on a server in a Colo that charges for remote hands (incl > reboots), cause they have the highest fail rate. > > Most stable OS's from colo are freebsd, slackware, RHEL, CentOS (ok same > thing) and SuSE, and surprisingly, we once had a customer with an old > win2K box back in mid 00's, that was very well behaved, and it was busy, > they ran a concert/band/event ticketing site on it, truly amazed me that > box. > > Worse OS's would be netbsd, fedora, debian, ubuntu, mint, windows* .. > but very very nice money earners for remote hands :P > From robert at schetterer.org Thu Dec 22 09:06:36 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 08:06:36 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> Message-ID: <4EF2D6FC.9070207@schetterer.org> Am 22.12.2011 00:15, schrieb Christopher Stolzenberg: > 2011/12/20 Ron Leach : >> On 20/12/2011 09:11, Cor Bosman wrote: >>> >>> I installed a newer kernel on these boxes, and it's fixed. Seems to be >>> a problem with the stock debian squeeze kernel. Not a dovecot issue, but >>> others with a stable squeeze box might see similar problems so good >>> to have it in the archive :) >> >> >> Indeed; very many of us use Debian stable. Which kernel did you install >> that is 2.0.16-friendly, and was this from Debian stable's updates system? >> >> regards, Ron > > Debian for production servers??? That sounds dangerous. nonsense, Debian and clones are widly used for massive big server Farms > > -- > Chris -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From robert at schetterer.org Thu Dec 22 09:08:06 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 08:08:06 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> Message-ID: <4EF2D756.6000107@schetterer.org> Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: > 2011/12/22 Jim Knuth : >> am 22.12.11 00:15 schrieb Christopher Stolzenberg >> >> : >> >> >>>> Indeed; very many of us use Debian stable. Which kernel did you install >>>> that is 2.0.16-friendly, and was this from Debian stable's updates >>>> system? >>>> >>>> regards, Ron >>> >>> >>> Debian for production servers??? That sounds dangerous. >> >> >> sorry, but that`s absolutely bulls*it. *lol* >> Where have you read then THIS? > > My own experience! > > Reasons against Debian: > > - No LSB certification (Linux Standard Base) > - No hardware certification (IBM, Dell, HP ...) > - Incompatible with some Broadcom NICs > - Full of bugs > - Free Kernel (non-free firmware removed... lol) > - Obsolete kernel (incompatible with new hardware) > - Obsolete packages > - Only one year support for oldstable *lol* > - Long delay for security updates > > -- > Chris dont feed trolls -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From noel.butler at ausics.net Thu Dec 22 09:23:36 2011 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 22 Dec 2011 17:23:36 +1000 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> Message-ID: <1324538616.14607.12.camel@tardis> On Wed, 2011-12-21 at 23:18 -0500, Simon Brereton wrote: > > I'm with Jim. Debian has served me well for years. This is just > distro-bias. Sure, you need modicum more sense and hands on experience, distro holy ways will outlast the real world holy wars, we each have a distro we all stand by, else there would only be one distro. > but that's not bad thing in a production environment.. > > It would be interesting to chart the number of threads caused by each > distro. I don't know who would have the least, but I suspect gentoo and > centos would be out in front, with Ubuntu panting along behind.. > > Simon I'm yet to meet a debian based admin who uses source, they only seem to think that apt is only way of installing stuff. They are scared of conflicts, who knows. Most the servers in the DC's I've run or worked in are all either freebsd, RHEL, slackware or gentoo, the later two being my personal favourites, that said, I do use ubuntu LTS on pc's/laptop, if there was no LTS however, I'd likely go back to fedora. > > Ahhh just before I hit send I remember one, debian, like windows, is an > > ideal distro on a server in a Colo that charges for remote hands (incl > > reboots), cause they have the highest fail rate. > > > > Most stable OS's from colo are freebsd, slackware, RHEL, CentOS (ok same > > thing) and SuSE, and surprisingly, we once had a customer with an old > > win2K box back in mid 00's, that was very well behaved, and it was busy, > > they ran a concert/band/event ticketing site on it, truly amazed me that > > box. > > > > Worse OS's would be netbsd, fedora, debian, ubuntu, mint, windows* .. > > but very very nice money earners for remote hands :P > > -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From noel.butler at ausics.net Thu Dec 22 09:27:04 2011 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 22 Dec 2011 17:27:04 +1000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <4EF2D756.6000107@schetterer.org> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> Message-ID: <1324538824.14607.16.camel@tardis> On Thu, 2011-12-22 at 08:08 +0100, Robert Schetterer wrote: > Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: > > 2011/12/22 Jim Knuth : > >> am 22.12.11 00:15 schrieb Christopher Stolzenberg > >> > >> : > >> > >> > >>>> Indeed; very many of us use Debian stable. Which kernel did you install > >>>> that is 2.0.16-friendly, and was this from Debian stable's updates > >>>> system? > >>>> > >>>> regards, Ron > >>> > >>> > >>> Debian for production servers??? That sounds dangerous. > >> > >> > >> sorry, but that`s absolutely bulls*it. *lol* > >> Where have you read then THIS? > > > > My own experience! > > > > Reasons against Debian: > > > > - No LSB certification (Linux Standard Base) > > - No hardware certification (IBM, Dell, HP ...) > > - Incompatible with some Broadcom NICs > > - Full of bugs > > - Free Kernel (non-free firmware removed... lol) > > - Obsolete kernel (incompatible with new hardware) > > - Obsolete packages > > - Only one year support for oldstable *lol* > > - Long delay for security updates > > > > -- > > Chris > > dont feed trolls > Why is it when someone disagrees with someone's opinion they are labelled a troll, maybe because it hits a raw nerve huh? I dunno, and frankly don't care, but you have no right to do so just because you don't agree with Christophers statements. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From robert at schetterer.org Thu Dec 22 09:34:30 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 08:34:30 +0100 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <1324538616.14607.12.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <1324538616.14607.12.camel@tardis> Message-ID: <4EF2DD86.8070609@schetterer.org> Am 22.12.2011 08:23, schrieb Noel Butler: > On Wed, 2011-12-21 at 23:18 -0500, Simon Brereton wrote: > >> >> I'm with Jim. Debian has served me well for years. This is just >> distro-bias. Sure, you need modicum more sense and hands on experience, > > > distro holy ways will outlast the real world holy wars, we each have a > distro we all stand by, else there would only be one distro. > > >> but that's not bad thing in a production environment.. >> >> It would be interesting to chart the number of threads caused by each >> distro. I don't know who would have the least, but I suspect gentoo and >> centos would be out in front, with Ubuntu panting along behind.. >> >> Simon > > > I'm yet to meet a debian based admin who uses source, they only seem to > think that apt is only way of installing stuff. > They are scared of conflicts, who knows. Most the servers in the DC's > I've run or worked in are all either freebsd, RHEL, slackware or gentoo, > the later two being my personal favourites, that said, I do use ubuntu > LTS on pc's/laptop, if there was no LTS however, I'd likely go back to > fedora. > X-mas is comming, we are waiting to get the perfect OS presented, so lets pray *g by the way ,where is the match to the dovecot list topic anyone identified the kernel bug? > > >>> Ahhh just before I hit send I remember one, debian, like windows, is an >>> ideal distro on a server in a Colo that charges for remote hands (incl >>> reboots), cause they have the highest fail rate. >>> >>> Most stable OS's from colo are freebsd, slackware, RHEL, CentOS (ok same >>> thing) and SuSE, and surprisingly, we once had a customer with an old >>> win2K box back in mid 00's, that was very well behaved, and it was busy, >>> they ran a concert/band/event ticketing site on it, truly amazed me that >>> box. >>> >>> Worse OS's would be netbsd, fedora, debian, ubuntu, mint, windows* .. >>> but very very nice money earners for remote hands :P >>> > > > -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From robert at schetterer.org Thu Dec 22 09:42:30 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 08:42:30 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <1324538824.14607.16.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> Message-ID: <4EF2DF66.4060408@schetterer.org> Am 22.12.2011 08:27, schrieb Noel Butler: > On Thu, 2011-12-22 at 08:08 +0100, Robert Schetterer wrote: > >> Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: >>> 2011/12/22 Jim Knuth : >>>> am 22.12.11 00:15 schrieb Christopher Stolzenberg >>>> >>>> : >>>> >>>> >>>>>> Indeed; very many of us use Debian stable. Which kernel did you install >>>>>> that is 2.0.16-friendly, and was this from Debian stable's updates >>>>>> system? >>>>>> >>>>>> regards, Ron >>>>> >>>>> >>>>> Debian for production servers??? That sounds dangerous. >>>> >>>> >>>> sorry, but that`s absolutely bulls*it. *lol* >>>> Where have you read then THIS? >>> >>> My own experience! >>> >>> Reasons against Debian: >>> >>> - No LSB certification (Linux Standard Base) >>> - No hardware certification (IBM, Dell, HP ...) >>> - Incompatible with some Broadcom NICs >>> - Full of bugs >>> - Free Kernel (non-free firmware removed... lol) >>> - Obsolete kernel (incompatible with new hardware) >>> - Obsolete packages >>> - Only one year support for oldstable *lol* >>> - Long delay for security updates >>> >>> -- >>> Chris >> >> dont feed trolls >> > > > Why is it when someone disagrees with someone's opinion they are > labelled a troll, maybe because it hits a raw nerve huh? > I dunno, and frankly don't care, but you have no right to do so just > because you don't agree with Christophers statements. > > > Hi Noel. this has left the topic of the dovecot list, after all , everyone is free to use what he likes and what fits best to solute the tec problem/task he/she likes to solve these everlasting os discussions are leading to nirvana are heavy boring, doesnt help on fixing the asked tec problem -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From noel.butler at ausics.net Thu Dec 22 09:52:28 2011 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 22 Dec 2011 17:52:28 +1000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <4EF2DF66.4060408@schetterer.org> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> Message-ID: <1324540348.16562.11.camel@tardis> On Thu, 2011-12-22 at 08:42 +0100, Robert Schetterer wrote: > Am 22.12.2011 08:27, schrieb Noel Butler: > > On Thu, 2011-12-22 at 08:08 +0100, Robert Schetterer wrote: > > > >> Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: > >>> 2011/12/22 Jim Knuth : > >>>> am 22.12.11 00:15 schrieb Christopher Stolzenberg > >>>> > >>>> : > >>>> > >>>> > >>>>>> Indeed; very many of us use Debian stable. Which kernel did you install > >>>>>> that is 2.0.16-friendly, and was this from Debian stable's updates > >>>>>> system? > >>>>>> > >>>>>> regards, Ron > >>>>> > >>>>> > >>>>> Debian for production servers??? That sounds dangerous. > >>>> > >>>> > >>>> sorry, but that`s absolutely bulls*it. *lol* > >>>> Where have you read then THIS? > >>> > >>> My own experience! > >>> > >>> Reasons against Debian: > >>> > >>> - No LSB certification (Linux Standard Base) > >>> - No hardware certification (IBM, Dell, HP ...) > >>> - Incompatible with some Broadcom NICs > >>> - Full of bugs > >>> - Free Kernel (non-free firmware removed... lol) > >>> - Obsolete kernel (incompatible with new hardware) > >>> - Obsolete packages > >>> - Only one year support for oldstable *lol* > >>> - Long delay for security updates > >>> > >>> -- > >>> Chris > >> > >> dont feed trolls > >> > > > > > > Why is it when someone disagrees with someone's opinion they are > > labelled a troll, maybe because it hits a raw nerve huh? > > I dunno, and frankly don't care, but you have no right to do so just > > because you don't agree with Christophers statements. > > > > > > > > Hi Noel. this has left the topic of the dovecot list, > after all , everyone is free to use what he likes and what fits best to > solute the tec problem/task he/she likes to solve > these everlasting os discussions are leading to nirvana > are heavy boring, doesnt help on fixing the asked tec problem > > Still, everyone is entitled to their opinion, including Christopher, perhaps it was not the right place for his comment, but none the less he made it, so he must feel that way, we should respect that without placing labels on him. This also is not the kernel list, since updating to a kernel released in the 21st century Cor's issue has gone away, so this thread is now rather entirely pointless on the Dovecot list. So I'll my participation in this thread, since its nearly 6pm, and tonight we have lots of prawns and lots and lots of beer and bourbon ;) Merry Christmas to those who celebrate it. -------------- next part -------------- A non-text attachment was scrubbed... Name: face-wink.png Type: image/png Size: 876 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From robert at schetterer.org Thu Dec 22 10:03:24 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 09:03:24 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <1324540348.16562.11.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> <1324540348.16562.11.camel@tardis> Message-ID: <4EF2E44C.60307@schetterer.org> On 22.12.2011 08:52, Noel Butler wrote: > On Thu, 2011-12-22 at 08:42 +0100, Robert Schetterer wrote: > >> Am 22.12.2011 08:27, schrieb Noel Butler: >>> On Thu, 2011-12-22 at 08:08 +0100, Robert Schetterer wrote: >>> >>>> Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: >>>>> 2011/12/22 Jim Knuth : >>>>>> am 22.12.11 00:15 schrieb Christopher Stolzenberg >>>>>> >>>>>> : >>>>>> >>>>>> >>>>>>>> Indeed; very many of us use Debian stable. Which kernel did you install >>>>>>>> that is 2.0.16-friendly, and was this from Debian stable's updates >>>>>>>> system? >>>>>>>> >>>>>>>> regards, Ron >>>>>>> >>>>>>> >>>>>>> Debian for production servers??? That sounds dangerous. >>>>>> >>>>>> >>>>>> sorry, but that`s absolutely bulls*it. *lol* >>>>>> Where have you read then THIS? >>>>> >>>>> My own experience! >>>>> >>>>> Reasons against Debian: >>>>> >>>>> - No LSB certification (Linux Standard Base) >>>>> - No hardware certification (IBM, Dell, HP ...) >>>>> - Incompatible with some Broadcom NICs >>>>> - Full of bugs >>>>> - Free Kernel (non-free firmware removed... lol) >>>>> - Obsolete kernel (incompatible with new hardware) >>>>> - Obsolete packages >>>>> - Only one year support for oldstable *lol* >>>>> - Long delay for security updates >>>>> >>>>> -- >>>>> Chris >>>> >>>> dont feed trolls >>>> >>> >>> >>> Why is it when someone disagrees with someone's opinion they are >>> labelled a troll, maybe because it hits a raw nerve huh? >>> I dunno, and frankly don't care, but you have no right to do so just >>> because you don't agree with Christophers statements. >>> >>> >>> >> >> Hi Noel. this has left the topic of the dovecot list, >> after all , everyone is free to use what he likes and what fits best to >> solute the tec problem/task he/she likes to solve >> these everlasting os discussions are leading to nirvana >> are heavy boring, doesnt help on fixing the asked tec problem >> >> > > > > Still, everyone is entitled to their opinion, including Christopher, > perhaps it was not the right place for his comment, but none the less he > made it, so he must feel that way, we should respect that without > placing labels on him. > This also is not the kernel list, since updating to a kernel released in > the 21st century Cor's issue has gone away, so this thread is now rather > entirely pointless on the Dovecot list. So I'll my participation in > this thread, since its nearly 6pm, and tonight we have lots of prawns > and lots and lots of beer and bourbon ;) jeppa no need to flame ever cheers ! > > Merry Christmas to those who celebrate it. celebrate ,is a good idea, anytime > > > > -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From cor at xs4all.nl Thu Dec 22 10:22:07 2011 From: cor at xs4all.nl (Cor Bosman) Date: Thu, 22 Dec 2011 09:22:07 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <1324540348.16562.11.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> <1324540348.16562.11.camel@tardis> Message-ID: <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> > This also is not the kernel list, since updating to a kernel released in > the 21st century Cor's issue has gone away, so this thread is now rather > entirely pointless on the Dovecot list. So I'll my participation in Actually, it hasn't. For the last few days we've been trying to pinpoint the problem by running half a dozen servers with different kernels and options. This 'kernel released in the 20th century' we have this problem with is the current stable kernel for debian. So instead of starting a distro war (and I thought canon/nikon, mac/pc were bad), lets be a bit more constructive. Plenty of people use the stable debian release. It's happening on about half of our imap servers (20 or so), but on none of our other debian servers (hundreds). So it's not so weird to suspect a dovecot link. But it looks like it may be a driver issue on a specific range of hardware we use. Once we find the issue, i'll report back. Until then, this doesn't look like a dovecot problem. Cor From wgillespie+dovecot at es2eng.com Thu Dec 22 10:30:38 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Thu, 22 Dec 2011 01:30:38 -0700 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE7DDE5.3070605@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> Message-ID: <4EF2EAAE.9090705@es2eng.com> On 12/13/2011 04:21 PM, Asai wrote: > Greetings, > > Working with dsync and setting up backups to a Windows file server. > Problem seems to be that Windows is renaming the dovecot mail files > (maildir) to Windows friendly filenames, and losing the Dovecot name. > For example, > 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > becomes 1AETPH~X. > > Does anyone have any ideas about how to tell Windows to not do this? Or > is it not possible? Don't have any answers for you, but I know that : is an invalid character in Windows filenames, so that could have something to do with it. From wgillespie+dovecot at es2eng.com Thu Dec 22 10:32:24 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Thu, 22 Dec 2011 01:32:24 -0700 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EF2EAAE.9090705@es2eng.com> References: <4EE7DDE5.3070605@globalchangemusic.org> <4EF2EAAE.9090705@es2eng.com> Message-ID: <4EF2EB18.1090102@es2eng.com> On 12/22/2011 01:30 AM, Willie Gillespie wrote: > On 12/13/2011 04:21 PM, Asai wrote: >> Greetings, >> >> Working with dsync and setting up backups to a Windows file server. >> Problem seems to be that Windows is renaming the dovecot mail files >> (maildir) to Windows friendly filenames, and losing the Dovecot name. >> For example, >> 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S >> >> becomes 1AETPH~X. >> >> Does anyone have any ideas about how to tell Windows to not do this? Or >> is it not possible? > > Don't have any answers for you, but I know that : is an invalid > character in Windows filenames, so that could have something to do with it. Whoops, should have finished going through the old thread. Seems like MyBSD already answered. From dg at dguhl.org Thu Dec 22 11:27:33 2011 From: dg at dguhl.org (Dennis Guhl) Date: Thu, 22 Dec 2011 10:27:33 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> <1324540348.16562.11.camel@tardis> <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> Message-ID: <20111222092732.GA6678@PC211.ikt.de> On Thu, Dec 22, 2011 at 09:22:07AM +0100, Cor Bosman wrote: [..] > Actually, it hasn't. For the last few days we've been trying to > pinpoint the problem by running half a dozen servers with different In your initial posting you mentioned this happens on a machine wich was updated from Lenny to Squeeze. Did you try a fresh install? Sometimes I had some kernel related troubles in case of updateting releases. [..] > Once we find the issue, i'll report back. Until then, this doesn't > look like a dovecot problem. Most likely it will be best to ask on a debian list. Dennis From arnaud.lenorcy at univ-orleans.fr Thu Dec 22 12:31:40 2011 From: arnaud.lenorcy at univ-orleans.fr (LE NORCY Arnaud) Date: Thu, 22 Dec 2011 11:31:40 +0100 Subject: [Dovecot] file_dotlock_create(~/.dovecot.lda-dupes) failed: No such file or directory ... Message-ID: <4EF3070C.1040704@univ-orleans.fr> Hello, i get this message every time that a user has enabled the vacation script (into Horde webmail) in my mail.err log file: Dec 22 10:18:16 mailserver dovecot: deliver(user324): file_dotlock_create(~/.dovecot.lda-dupes) failed: No such file or directory normally the reply is sent only once in the number of configured days.. but for all users the reply is sent every time... the day variable is "ignored.." because the file "dovecot.lda-dupes" is not wrotten i think.. ~# dpkg -l | grep dovecot ii dovecot-common 1:1.2.15-4 secure mail server that supports mbox and maildir mailboxes ii dovecot-imapd 1:1.2.15-4 secure IMAP server that supports mbox and maildir mailboxes ii dovecot-pop3d 1:1.2.15-4 secure POP3 server that supports mbox and maildir mailboxes dovecot.conf : protocols = imap imaps pop3s managesieve mail_location = maildir:/ext/spool/imap/%1Mu/%u mail_uid = vmail mail_gid = vmail protocol lda { mail_plugins = quota sieves.fr } .. plugin { .. sieve_dir = /ext/spool/sieve/%1Mu/%u sieve = /ext/spool/sieve/%1Mu/%u/dovecot.sieve } rights are OK for user "vmail" in /ext/spool/sieve/%1Mu/%u/ ....; for example : /ext/spool/sieve/d/user324# ls -la total 20 drwxr-x--- 3 vmail vmail 4096 20 d?c. 19:15 . drwxr-x--- 43 vmail vmail 4096 17 nov. 10:14 .. lrwxrwxrwx 1 vmail vmail 10 20 d?c. 18:38 dovecot.sieve -> ingo.sieve -rw-r----- 1 vmail vmail 65 20 d?c. 19:15 dovecot.svbin -rw-r----- 1 vmail vmail 88 20 d?c. 18:38 ingo.sieve drwxr-x--- 2 vmail vmail 4096 20 d?c. 18:38 tmp any ideas?thanks Arnaud, From CMarcus at Media-Brokers.com Thu Dec 22 13:13:36 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 22 Dec 2011 06:13:36 -0500 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> Message-ID: <4EF310E0.6030006@Media-Brokers.com> On 2011-12-21 11:18 PM, Simon Brereton wrote: > It would be interesting to chart the number of threads caused by each > distro. I don't know who would have the least, but I suspect gentoo and > centos would be out in front, Been using gentoo since about 2003 and never looked back... best and easiest distro to maintain, bar none, and the best support and documentation too. -- Best regards, Charles From tlx at leuxner.net Thu Dec 22 13:29:08 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Thu, 22 Dec 2011 12:29:08 +0100 Subject: [Dovecot] Global Sieve Script Includes no longer works with 056934abd2ef Message-ID: Latest Dovecot Auto-Build 2.1.rc1-0~auto+42 (056934abd2ef) fails to include global Sieve Scripts. Not sure this is specific to Stephan's Repository. Rolling back to older version restores functionality. ==> /var/log/dovecot/dovecot.log <== Dec 22 12:13:52 spectre dovecot: lmtp(32246): Connect from local Dec 22 12:13:52 spectre dovecot: lmtp(32246, tlx at leuxner.net): Error: jo99GvAQ8072fQAAqZii3w: sieve: failed to open script /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve (view user logfile /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve.log for more information) Dec 22 12:13:52 spectre dovecot: lmtp(32246, tlx at leuxner.net): jo99GvAQ8072fQAAqZii3w: msgid=<4EF310E0.6030006 at Media-Brokers.com>: saved mail to INBOX $ cat /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve.log sieve: info: started log at Dec 22 12:13:52. main_script: line 2: error: included global script 'global.sieve' does not exist. main_script: error: validation failed. [ Script Calling Global ] $ head /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve require ["include","copy","fileinto","vacation"]; include :global "global.sieve"; [?] $ ls -al /var/vmail/conf.d/leuxner.net/sieve/ total 12 dr-x------ 2 vmail vmail 4096 Dec 7 15:09 . dr-x------ 4 vmail vmail 4096 Mar 17 2010 .. -r-------- 1 vmail vmail 3647 Dec 7 15:09 global.sieve $ doveconf -n # 2.1.rc1 (056934abd2ef): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 auth_cache_size = 16 k auth_verbose = yes mail_location = mdbox:~/mdbox mail_plugins = acl quota stats namespace { list = yes location = mdbox:/var/vmail/public prefix = Public/ separator = / subscriptions = no type = public } namespace inbox { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = username_format=%u /var/vmail/auth.d/%d/passwd driver = passwd-file } plugin { acl = vfile:/var/vmail/conf.d/%d/acls:cache_secs=300 mail_log_events = expunge mailbox_delete quota = dict:user::file:%h/mdbox/dovecot-quota quota_rule = *:storage=1GB quota_rule2 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/vmail/conf.d/%d/sieve stats_refresh = 30s stats_track_cmds = yes } protocols = imap lmtp quota_full_tempfail = yes service auth-worker { user = doveauth } service auth { client_limit = 1224 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = doveauth } service imap-login { inet_listener imap { address = 1.2.3.4 port = 143 } inet_listener imaps { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_ca = From jerry at seibercom.net Thu Dec 22 13:31:30 2011 From: jerry at seibercom.net (Jerry) Date: Thu, 22 Dec 2011 06:31:30 -0500 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <4EF310E0.6030006@Media-Brokers.com> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> Message-ID: <20111222063130.6c45f3a2@scorpio> On Thu, 22 Dec 2011 06:13:36 -0500 Charles Marcus articulated: > On 2011-12-21 11:18 PM, Simon Brereton > wrote: > > It would be interesting to chart the number of threads caused by > > each distro. I don't know who would have the least, but I suspect > > gentoo and centos would be out in front, > > Been using gentoo since about 2003 and never looked back... best and > easiest distro to maintain, bar none, and the best support and > documentation too. I have been a FreeBSD user since 2000. Dovecot and Postfix run well on the OS. Postfix should since it was developed on FreeBSD. Other than that though, most other apps require extensive patching in order to get them to work. And when it comes to drivers for modern devices, you can pretty much forget about it. After more than five years they still have not developed drivers for wireless "N" protocol devices. However, like Firefox, they do enjoy bumping versions numbers sans any true or radical improvement. Just my 2?. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ Have you ever considered the irony in the fact that we celebrate Christ's birthday every year by ignoring the fact that he would have celebrated Hanukkah? From stephan at rename-it.nl Thu Dec 22 13:59:19 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 22 Dec 2011 12:59:19 +0100 Subject: [Dovecot] Global Sieve Script Includes no longer works with 056934abd2ef In-Reply-To: References: Message-ID: <4EF31B97.5070906@rename-it.nl> On 12/22/2011 12:29 PM, Thomas Leuxner wrote: > Latest Dovecot Auto-Build 2.1.rc1-0~auto+42 (056934abd2ef) fails to include global Sieve Scripts. Not sure this is specific to Stephan's Repository. Rolling back to older version restores functionality. > > ==> /var/log/dovecot/dovecot.log<== > Dec 22 12:13:52 spectre dovecot: lmtp(32246): Connect from local > Dec 22 12:13:52 spectre dovecot: lmtp(32246, tlx at leuxner.net): Error: jo99GvAQ8072fQAAqZii3w: sieve: failed to open script /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve (view user logfile /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve.log for more information) > Dec 22 12:13:52 spectre dovecot: lmtp(32246, tlx at leuxner.net): jo99GvAQ8072fQAAqZii3w: msgid=<4EF310E0.6030006 at Media-Brokers.com>: saved mail to INBOX > > $ cat /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve.log > sieve: info: started log at Dec 22 12:13:52. > main_script: line 2: error: included global script 'global.sieve' does not exist. > main_script: error: validation failed. The fact that << include "global.sieve"; >> and << include "global"; >> would map to the same script file `global.sieve' is not intended behavior and I fixed this in a recent change: http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/66b7b1636c8c I had the impression that this was already documented/announced in the migration instructions from CMUSieve, but apparently these don't tell the whole story: http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration#From_CMUSieve_.28Dovecot_v1.0.2BAC8-v1.1.29 That is why I didn't explicitly announce this change. The .sieve extension only has significance in the filesystem (to make sure that the Sieve interpreter refuses to open anything but Sieve scripts). When specified in the Sieve language, that extension would just be part of the script name, meaning that << include "global.sieve"; >> maps to `global.sieve.sieve' on the filesystem. So, in your case using << include :global "global"; >> should fix it. Because it is technically a bugfix, it is also due to be released for Dovecot v2.0. Is it a big problem to change your include instructions? Is anyone else depending on this unintended feature? Regards, Stephan. From tlx at leuxner.net Thu Dec 22 14:06:59 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Thu, 22 Dec 2011 13:06:59 +0100 Subject: [Dovecot] Global Sieve Script Includes no longer works with 056934abd2ef In-Reply-To: <4EF31B97.5070906@rename-it.nl> References: <4EF31B97.5070906@rename-it.nl> Message-ID: <78911E18-84E8-4CB2-A350-B7FA9B7802E3@leuxner.net> Am 22.12.2011 um 12:59 schrieb Stephan Bosch: > That is why I didn't explicitly announce this change. The .sieve extension only has significance in the filesystem (to make sure that the Sieve interpreter refuses to open anything but Sieve scripts). When specified in the Sieve language, that extension would just be part of the script name, meaning that << include "global.sieve"; >> maps to `global.sieve.sieve' on the filesystem. So, in your case using << include :global "global"; >> should fix it. > > Because it is technically a bugfix, it is also due to be released for Dovecot v2.0. > > Is it a big problem to change your include instructions? Is anyone else depending on this unintended feature? Not a biggie at all to fix on my end. And thanks for the explanation. Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 163 bytes Desc: Message signed with OpenPGP using GPGMail URL: From p.heinlein at heinlein-support.de Thu Dec 22 14:34:05 2011 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Thu, 22 Dec 2011 13:34:05 +0100 Subject: [Dovecot] LSUB and subscribed folders Message-ID: <201112221334.06087.p.heinlein@heinlein-support.de> I have a strange behavior on a customer's server and I don't understand that: User "bar" has some folders and one shared folder from "foo" if I use the "LIST"-command, which should list AFAIK *all* folders: # telnet localhost 143 a login bar xxxx a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk] Logged in a LIST "" "*" * LIST (\HasNoChildren) "/" "Gesendete Objekte" * LIST (\HasNoChildren) "/" "Papierkorb" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "Entw&APw-rfe" * LIST (\HasNoChildren) "/" "Spam" * LIST (\Noselect \HasChildren) "/" "shared/foo" * LIST (\HasNoChildren) "/" "shared/foo/INBOX" a OK List completed. Using the LSUB-command, which should only list subscribed folders I can see some more shared folders. AFAIK the output of LSUB must be always less then LIST: a LSUB "" "*" * LSUB () "/" "Entw&APw-rfe" * LSUB () "/" "Gesendete Objekte" * LSUB () "/" "INBOX" * LSUB () "/" "Papierkorb" * LSUB () "/" "Spam" * LSUB () "/" "Trash" * LSUB (\Noselect) "/" "shared/amerkel" * LSUB () "/" "shared/foo/Papierkorb/Ungelesene Mails" * LSUB () "/" "shared/foo/INBOX" * LSUB () "/" "shared/foo/INBOX/abc/Unterebene 1" * LSUB () "/" "shared/foo/INBOX/abc/Unterebene 1/Test6789" * LSUB () "/" "shared/foo/INBOX/abc/Unterebene 1/Test Unterornder" * LSUB () "/" "shared/foo/INBOX/abc/Unterebene 1/Tsfgnksfgnk" a OK Lsub completed. a logout * BYE Logging out a OK Logout completed. And why is /shared/foo/INBOX listed with "HasNoChildren"? IMHO that's looking buggy. And, btw: Looks like's not possible to use the "doveadm"-command to get a list of a user's complete folder list. Maybe "doveadm mailbox" should get some extra parameters to geht all folders / only subscribe folders / only shared folders: # doveadm mailbox list -u bar Gesendete Objekte Papierkorb INBOX Trash Entw?rfe Spam -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030/405051-42 Fax: 030/405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From tmtalpey at gmail.com Thu Dec 22 14:42:50 2011 From: tmtalpey at gmail.com (Tom Talpey) Date: Thu, 22 Dec 2011 07:42:50 -0500 Subject: [Dovecot] Global Sieve Script Includes no longer works with 056934abd2ef In-Reply-To: <78911E18-84E8-4CB2-A350-B7FA9B7802E3@leuxner.net> References: <4EF31B97.5070906@rename-it.nl> <78911E18-84E8-4CB2-A350-B7FA9B7802E3@leuxner.net> Message-ID: <4EF325CA.6050207@gmail.com> On 12/22/2011 7:06 AM, Thomas Leuxner wrote: > > Am 22.12.2011 um 12:59 schrieb Stephan Bosch: > >> That is why I didn't explicitly announce this change. The .sieve extension only has significance in the filesystem (to make sure that the Sieve interpreter refuses to open anything but Sieve scripts). When specified in the Sieve language, that extension would just be part of the script name, meaning that<< include "global.sieve";>> maps to `global.sieve.sieve' on the filesystem. So, in your case using<< include :global "global";>> should fix it. >> >> Because it is technically a bugfix, it is also due to be released for Dovecot v2.0. >> >> Is it a big problem to change your include instructions? Is anyone else depending on this unintended feature? > > Not a biggie at all to fix on my end. And thanks for the explanation. Not a biggie here either, but my "include"s specified the full filename too. I guess I never read the CMUSieve migration page, since my scripts weren't migrated. So I suspect this will trip up other installations. Good to know, thanks! From hydrapolic at gmail.com Thu Dec 22 16:08:35 2011 From: hydrapolic at gmail.com (hydra) Date: Thu, 22 Dec 2011 15:08:35 +0100 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> Message-ID: Hello Timo, thank you for the reply. I was suspecting the same. However: - the machine runs under Vmware, - I've tried 3 different kernel versions, - I've tried 3 different SCSI controllers. All same results. On Wed, Dec 21, 2011 at 6:16 PM, Timo Sirainen wrote: > On 21.12.2011, at 18.38, hydra wrote: > > > I suspect, that dovecot v2.0.16 under Linux (tested on Gentoo 3.0.4 > > Hardened, Gentoo 3.0.6, Gentoo 3.1.4) causes 100% cpu utilization when > > index.cache is broken and doveadm is lanched. Dovecot uses LDAP as the > > userdb and provides IMAP and LDA. Because each user has a quota, the > > doveadm's expunge functionality is used to get rid of old trashed mail. > > > > The mail log: > > Dec 12 07:38:59 www dovecot: imap(user): Error: Corrupted index cache > file > > /var/data/mail/domain.tld/user/mail/dovecot.index.cache: invalid record > size > > OK.. > > > Mail is stored on ext4 and flush will use all of the CPU capacity like > this: > > load average: 4.00, 4.01, 4.05 > > > > ps: > > root 26401 98.2 0.0 0 0 ? R Dec20 1369:49 > > [flush-253:1] > > That's a kernel process.. > > > I suspect, that this is something to do with Dovecot, because after > > deleting the dovecot.index.cache file, everything went back to normal. > When > > this happens, I cannot unmount the drive nor a system reboot works. > > That's a kernel bug.. > > I think you're thinking it the wrong way: Dovecot isn't causing your > system to break. Your system is causing Dovecot to break. Faulty hardware > or faulty kernel. From ajb2 at mssl.ucl.ac.uk Thu Dec 22 16:11:09 2011 From: ajb2 at mssl.ucl.ac.uk (Alan Brown) Date: Thu, 22 Dec 2011 14:11:09 +0000 Subject: [Dovecot] OS/Distro wars Message-ID: <4EF33A7D.9060800@mssl.ucl.ac.uk> DO NOT FEED THE TROLLS From stan at hardwarefreak.com Thu Dec 22 16:49:56 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Thu, 22 Dec 2011 08:49:56 -0600 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> Message-ID: <4EF34394.5080806@hardwarefreak.com> On 12/22/2011 8:08 AM, hydra wrote: > Hello Timo, thank you for the reply. I was suspecting the same. However: > - the machine runs under Vmware, > - I've tried 3 different kernel versions, > - I've tried 3 different SCSI controllers. > > All same results. dmesg output? Log errors? Is your EXT4 filesystem on a VMFS volume or an RDM (SAN LUN)? > On Wed, Dec 21, 2011 at 6:16 PM, Timo Sirainen wrote: > >> On 21.12.2011, at 18.38, hydra wrote: >> That's a kernel process.. >> >>> I suspect, that this is something to do with Dovecot, because after >>> deleting the dovecot.index.cache file, everything went back to normal. >> When >>> this happens, I cannot unmount the drive nor a system reboot works. System (host machine) reboot, or virtual machine reboot doesn't fix the problem? FYI, Linux doesn't unmount drives, it unmounts filesystems. I'd say you may have a problem with your VMFS volume or RDM, or maybe just your EXT4 filesystem. Have you run an fsck on it? What result? Or, as Timo suggests, could be a kernel bug. Or an interaction of these low level layers causing a problem. If you can't unmount a filesystem, that has nothing to do with Dovecot, and points to a much larger, more critical, problem. Do you have this problem when booting an older kernel? Say 2.6.32? 2.6.37? >> That's a kernel bug.. >> >> I think you're thinking it the wrong way: Dovecot isn't causing your >> system to break. Your system is causing Dovecot to break. Faulty hardware >> or faulty kernel. -- Stan From martin at ilait.se Thu Dec 22 17:33:31 2011 From: martin at ilait.se (Martin Abrahamsson) Date: Thu, 22 Dec 2011 16:33:31 +0100 Subject: [Dovecot] Limit maximum connections for user/IP on proxy Message-ID: <4EF34DCB.6090206@ilait.se> Hi, Is it possible to limit the maximum number of IMAP connections allowed for a user from each IP address, on the proxy server instead of on the mail store server? mail_max_userip_connections works well when the client is connection to the mail store without proxy, but when using proxies the POP/IMAP server will register the remote IP (rip) as the proxy server's IP address - thus a low limit will be reached quite easily. Thanks -- Martin Abrahamsson From alessio at skye.it Thu Dec 22 17:36:07 2011 From: alessio at skye.it (Alessio Cecchi) Date: Thu, 22 Dec 2011 16:36:07 +0100 Subject: [Dovecot] Patch for dovecot 1.2.16 (and .17) for vpopmail module Message-ID: Hi Timo, I love dovecot but I love also vpopmail and its functions for manage user limits (via vmoduser). Unfortunately in dovecot 1.2.x auth default set to use "vpopmail" is unable to apply this limits. Only if used with checkpassword limits works fine but in the dovecot.log only user (without @domain) is logged. So, based on the code of dovecot 2.0, I have created this very simple patch that correct this bug. Thanks for consideration -- Alessio Cecchi is: on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi Linux -> http://www.cecchi.biz/ Hosting Linux -> http://www.hosting-linux.it @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it -------------- next part -------------- A non-text attachment was scrubbed... Name: patch-dovecot-alessice-1.2.16.txt Type: text/x-c Size: 1180 bytes Desc: not available URL: From tss at iki.fi Thu Dec 22 17:37:39 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 22 Dec 2011 17:37:39 +0200 Subject: [Dovecot] Limit maximum connections for user/IP on proxy In-Reply-To: <4EF34DCB.6090206@ilait.se> References: <4EF34DCB.6090206@ilait.se> Message-ID: <78C75C8E-E0C4-408E-BE81-8D74094B182F@iki.fi> On 22.12.2011, at 17.33, Martin Abrahamsson wrote: > mail_max_userip_connections works well when the client is connection to the mail store without proxy, but when using proxies the POP/IMAP server will register the remote IP (rip) as the proxy server's IP address - thus a low limit will be reached quite easily. See login_trusted_networks setting. From hydrapolic at gmail.com Thu Dec 22 18:06:47 2011 From: hydrapolic at gmail.com (hydra) Date: Thu, 22 Dec 2011 17:06:47 +0100 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: <4EF34394.5080806@hardwarefreak.com> References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> Message-ID: On Thu, Dec 22, 2011 at 3:49 PM, Stan Hoeppner wrote: > On 12/22/2011 8:08 AM, hydra wrote: > > Hello Timo, thank you for the reply. I was suspecting the same. However: > > - the machine runs under Vmware, > > - I've tried 3 different kernel versions, > > - I've tried 3 different SCSI controllers. > > > > All same results. > > dmesg output? Log errors? > Nothing there > Is your EXT4 filesystem on a VMFS volume or an RDM (SAN LUN)? > VMFS > > > > On Wed, Dec 21, 2011 at 6:16 PM, Timo Sirainen wrote: > > > >> On 21.12.2011, at 18.38, hydra wrote: > > >> That's a kernel process.. > >> > >>> I suspect, that this is something to do with Dovecot, because after > >>> deleting the dovecot.index.cache file, everything went back to normal. > >> When > >>> this happens, I cannot unmount the drive nor a system reboot works. > > System (host machine) reboot, or virtual machine reboot doesn't fix the > problem? FYI, Linux doesn't unmount drives, it unmounts filesystems. > > After the virtual machine reboot, the CPU usage is normal again, but just until doveadm is launched again (it was run from cron). Sorry for the partition/drive terminology mess up. > I'd say you may have a problem with your VMFS volume or RDM, or maybe > just your EXT4 filesystem. Have you run an fsck on it? What result? > A normal system reboot wasn't possible, because the ext4 fs wasn't unmounted (and it wasn't possible to unmount the fs nor run sync - both locked up) and thus I had to reboot from the vSphere Client. After the reboot, fsck placed the fs to a consistent state, however the problem occurred the next morning, when doveadm from the cron was run again. So a fsck didn't help. > Or, as Timo suggests, could be a kernel bug. Or an interaction of these > low level layers causing a problem. If you can't unmount a filesystem, > that has nothing to do with Dovecot, and points to a much larger, more > critical, problem. > > Do you have this problem when booting an older kernel? Say 2.6.32? > 2.6.37? > > The oldest available kernel is 2.6.32 so I'm going to test it. Thank you :) > >> That's a kernel bug.. > >> > >> I think you're thinking it the wrong way: Dovecot isn't causing your > >> system to break. Your system is causing Dovecot to break. Faulty > hardware > >> or faulty kernel. > > -- > Stan > > From tss at iki.fi Thu Dec 22 18:13:46 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 22 Dec 2011 18:13:46 +0200 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> Message-ID: <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> On 22.12.2011, at 18.06, hydra wrote: > After the virtual machine reboot, the CPU usage is normal again, but just > until doveadm is launched again (it was run from cron). Sorry for the > partition/drive terminology mess up. So it's reproducible? You could see if you can reproduce it by simply reading the file(s) that are causing problems. Like with zsh: cat **/* > /dev/null From slusarz at curecanti.org Thu Dec 22 21:50:01 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Thu, 22 Dec 2011 12:50:01 -0700 Subject: [Dovecot] LSUB and subscribed folders In-Reply-To: <201112221334.06087.p.heinlein@heinlein-support.de> References: <201112221334.06087.p.heinlein@heinlein-support.de> Message-ID: <20111222125001.Horde.-uOJAYF5lbhO84npZMNi2SA@bigworm.curecanti.org> Quoting Peer Heinlein : > Using the LSUB-command, which should only list subscribed folders I can see > some more shared folders. AFAIK the output of LSUB must be always less then > LIST: No, it is exactly the opposite - LSUB can potentially list MORE mailboxes than exist on the server. LSUB only provides the list of mailboxes that have been marked as subscribed. It is quite possible to mark a mailbox as subscribed and then delete it, in which case LSUB must continue to report that mailbox. See RFC 3501 [6.3.9]: The server MUST NOT unilaterally remove an existing mailbox name from the subscription list even if a mailbox by that name no longer exists. michael From p.heinlein at heinlein-support.de Thu Dec 22 23:01:41 2011 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Thu, 22 Dec 2011 22:01:41 +0100 Subject: [Dovecot] crash on shared folders if remote user has empty $home Message-ID: <201112222201.41781.p.heinlein@heinlein-support.de> Hi, in seldom cirumstances it's possible that the imap-process is crashing without write something usefule into the logfile. a) User foo exists, is happy and everything's alright b) He had a shared folder given from bar c) In our setup we have mailforwarding adresses without a valid $home in LDAP c) if user bar is changed from a user with into a mailforwarding adress, the user foo won't have an entry for $home any more, but still exists in LDAP. d) If foo logs in, dovecot's exploring the shared folders given from the non-existing user bar. But bar's entry in LDAP doesn't have $home any more. imap crashes and closes the TCP-connection immediately. root at dobby2:/etc/dovecot# telnet xxxxxxxx 143 Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE ACL UIDPLUS STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5 AUTH=DIGEST-MD5] Dovecot ready. Testing. a LOGIN foo xxxxx a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL UIDPLUS QUOTA ACL RIGHTS=texk] Logged in a LIST "" "*" * BYE Internal error occurred. Refer to server log for more information. Connection closed by foreign host. Dec 22 21:57:41 dobby2 dovecot: master: Error: service(imap): child 18095 killed with signal 11 (core dumps disabled) e) This happens if mail_location=mdbox:%%h/mdbox is set in the shared folder namespace. If I set "mail_location=auto:" then Dovecot logs an error message, but is still possible to continue without any problems. Dec 22 21:33:59 dobby2 dovecot: imap(bar): Error: Namespace 'shared/bar/': Autodetection failed for auto: (home=/mail/foo/) -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030 / 40 50 51 - 0 Fax: 030 / 40 50 51 - 19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From p.heinlein at heinlein-support.de Thu Dec 22 23:07:16 2011 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Thu, 22 Dec 2011 22:07:16 +0100 Subject: [Dovecot] crash on shared folders if remote user has empty $home In-Reply-To: <201112222201.41781.p.heinlein@heinlein-support.de> References: <201112222201.41781.p.heinlein@heinlein-support.de> Message-ID: <201112222207.17006.p.heinlein@heinlein-support.de> Am Donnerstag, 22. Dezember 2011, 22:01:41 schrieb Peer Heinlein: Hi, > e) This happens if mail_location=mdbox:%%h/mdbox is set in the shared > folder namespace. If I set "mail_location=auto:" then Dovecot logs an Sorry, it's mail= and not mail_location= in the shared namespace area. Peer -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030 / 40 50 51 - 0 Fax: 030 / 40 50 51 - 19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From user+dovecot at localhost.localdomain.org Thu Dec 22 23:37:27 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Thu, 22 Dec 2011 22:37:27 +0100 Subject: [Dovecot] file_dotlock_create(~/.dovecot.lda-dupes) failed: No such file or directory ... In-Reply-To: <4EF3070C.1040704@univ-orleans.fr> References: <4EF3070C.1040704@univ-orleans.fr> Message-ID: <4EF3A317.4050209@localhost.localdomain.org> On 12/22/2011 11:31 AM LE NORCY Arnaud wrote: > > Dec 22 10:18:16 mailserver dovecot: deliver(user324): > file_dotlock_create(~/.dovecot.lda-dupes) failed: No such file or directory ^ http://wiki.dovecot.org/VirtualUsers/Home Regards, Pascal -- The trapper recommends today: cafefeed.1135622 at localdomain.org From blmatthews at gmail.com Fri Dec 23 00:21:49 2011 From: blmatthews at gmail.com (Brian L. Matthews) Date: Thu, 22 Dec 2011 14:21:49 -0800 Subject: [Dovecot] Received date no longer email date? Message-ID: <4EF3AD7D.40203@gmail.com> I just upgrade from dovecot 1.2 to dovecot 2.0.16. I use dovecot as a local IMAP server to archive email from my corporate email account (on Exchange). I don't have any automated archiving, I just periodically move messages from my Exchange inbox to the IMAP inbox. I'm on Mac OS X 10.6.8 using Entourage as my mail client. In the previous version of dovecot, the Received date of the email was preserved when I moved a message, but it's not in 2.0.16, it's set to the date and time I move the message. If I open a message, the date displayed is the date on the message as expected. I converted my config from 1.2 with $ doveconf -n -c dovecot.conf > dovecot-2.conf It spit out various warnings but, once I'd created a dovenull user, seemed to work fine. Here's my configuration info: $ dovecot --version 2.0.16 $ dovecot -n # 2.0.16: /usr/local/etc/dovecot/dovecot.conf # OS: Darwin 10.8.0 i386 disable_plaintext_auth = no listen = 127.0.0.1 log_path = /var/log/dovecot.log mail_location = maildir:~/Maildir passdb { args = login driver = pam } service auth { user = root } service imap-login { process_limit = 16 } service imap { process_limit = 64 } ssl = no userdb { driver = passwd } I'd like to get it back to preserving the Received date, any help you can provide will be appreciated. Brian From noel.butler at ausics.net Fri Dec 23 00:49:30 2011 From: noel.butler at ausics.net (Noel Butler) Date: Fri, 23 Dec 2011 08:49:30 +1000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> <1324540348.16562.11.camel@tardis> <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> Message-ID: <1324594170.5841.5.camel@tardis> On Thu, 2011-12-22 at 09:22 +0100, Cor Bosman wrote: > > This also is not the kernel list, since updating to a kernel released in > > the 21st century Cor's issue has gone away, so this thread is now rather > > entirely pointless on the Dovecot list. So I'll my participation in > > Actually, it hasn't. For the last few days we've been trying to pinpoint the problem by running half a dozen servers with different kernels and options. This 'kernel released in the 20th century' we have this problem with is the current stable kernel for debian. So instead of starting a distro war (and I thought canon/nikon, mac/pc were bad), lets be a bit more constructive. Plenty of people use the stable debian release. > Ahh OK, your previous message said it was resolved, did the traceback show anything? > It's happening on about half of our imap servers (20 or so), but on none of our other debian servers (hundreds). So it's not so weird to suspect a dovecot link. But it looks like it may be a driver issue on a specific range of hardware we use. > maybe install a slackware or gentoo box and add it into the farm and see if same problem exists there as well, if so, clearly dovecot, if not, clearly debian, its why I still keep a RHEL box handy, it sits attached to the "dev" unit until I need it to assist to prove/disprove something. All the best. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From noel.butler at ausics.net Fri Dec 23 00:51:50 2011 From: noel.butler at ausics.net (Noel Butler) Date: Fri, 23 Dec 2011 08:51:50 +1000 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <20111222063130.6c45f3a2@scorpio> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> <20111222063130.6c45f3a2@scorpio> Message-ID: <1324594310.5841.7.camel@tardis> On Thu, 2011-12-22 at 06:31 -0500, Jerry wrote: > On Thu, 22 Dec 2011 06:13:36 -0500 > Charles Marcus articulated: > > > On 2011-12-21 11:18 PM, Simon Brereton > > wrote: > > > It would be interesting to chart the number of threads caused by > > > each distro. I don't know who would have the least, but I suspect > > > gentoo and centos would be out in front, > > > > Been using gentoo since about 2003 and never looked back... best and > > easiest distro to maintain, bar none, and the best support and > > documentation too. > > I have been a FreeBSD user since 2000. Dovecot and Postfix run well on > the OS. Postfix should since it was developed on FreeBSD. Other than > that though, most other apps require extensive patching in order to get > them to work. And when it comes to drivers for modern devices, you can > pretty much forget about it. After more than five years they still have > not developed drivers for wireless "N" protocol devices. However, like > Firefox, they do enjoy bumping versions numbers sans any true or > radical improvement. > > Just my 2?. > Tis a shame that, freebsd used to leave linux behind in resource management, but in last 5 or so years, its been other way around and I kinda agree its like "time stood still" -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From noel.butler at ausics.net Fri Dec 23 00:53:59 2011 From: noel.butler at ausics.net (Noel Butler) Date: Fri, 23 Dec 2011 08:53:59 +1000 Subject: [Dovecot] OS/Distro wars In-Reply-To: <4EF33A7D.9060800@mssl.ucl.ac.uk> References: <4EF33A7D.9060800@mssl.ucl.ac.uk> Message-ID: <1324594439.5841.9.camel@tardis> On Thu, 2011-12-22 at 14:11 +0000, Alan Brown wrote: > DO NOT FEED THE TROLLS > > another goose who think he's god... if you dont like a thread, dont read it, especially since its been marked as OT for past 10 or posts, ya moron. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From michael.abbott at apple.com Fri Dec 23 01:10:52 2011 From: michael.abbott at apple.com (Mike Abbott) Date: Thu, 22 Dec 2011 17:10:52 -0600 Subject: [Dovecot] proxying, SSL, and client certificate Message-ID: How do I configure dovecot-2.0.x to present a client SSL certificate when proxying? If dovecot on server1.example.com has: passdb { driver = static args = proxy=y host=server2.example.com nopassword=y ssl=yes } and dovecot on server2.example.com has: ssl_verify_client_cert = yes auth_ssl_require_client_cert = yes then when a client connects to server1 and authenticates, a connection is established to server2 but the SSL handshake fails because server1 doesn't present a client certificate. I don't see where ssl_client_ctx is tied to a client certificate in ssl-proxy-openssl.c. Thanks. From pasek at valbek.cz Fri Dec 23 01:11:58 2011 From: pasek at valbek.cz (pasek at valbek.cz) Date: Fri, 23 Dec 2011 00:11:58 +0100 Subject: [Dovecot] =?utf-8?b?RG92b2xlbsOh?= Message-ID: <55354f37803b3d0dff41d29bbe02e354-1324595518@mail.valbek.cz> Dobr? den, od 23.12. do 30.12. jsem na dovolen?. V p??pad? nutnosti volejte na mobil. S pozdravem Bc. Ladislav Pa?ek vedouc? odd?len? IT a vizualizace mobil: +420 776 140 489 e-mail: pasek at valbek.cz Valbek, s.r.o. Va?urova 505/17, 460 02 Liberec 3 tel./fax: +420 485 103 336, +420 485 103 346 www.valbek.cz From dmiller at amfes.com Fri Dec 23 09:10:53 2011 From: dmiller at amfes.com (Daniel L. Miller) Date: Thu, 22 Dec 2011 23:10:53 -0800 Subject: [Dovecot] Lucene vs Solr with 2.1 single server Message-ID: For a single server, is the Lucene backend now "better" than running a Solr server? -- Daniel From ronleach at tesco.net Fri Dec 23 11:49:10 2011 From: ronleach at tesco.net (Ron Leach) Date: Fri, 23 Dec 2011 09:49:10 +0000 Subject: [Dovecot] =?windows-1252?q?Dovolen=E1?= In-Reply-To: <55354f37803b3d0dff41d29bbe02e354-1324595518@mail.valbek.cz> References: <55354f37803b3d0dff41d29bbe02e354-1324595518@mail.valbek.cz> Message-ID: <4EF44E96.2060401@tesco.net> On 22/12/2011 23:11, pasek at valbek.cz wrote: > > Dobr?? den, > > od 23.12. do 30.12. jsem na dovolen??. V p????pad?? nutnosti volejte na mobil. > > S pozdravem > Ladislav, sure, we'll reach you on your mobile if we need you. Enjoy the break; will you be doing some ski-ing? Ron From hydrapolic at gmail.com Fri Dec 23 12:12:07 2011 From: hydrapolic at gmail.com (hydra) Date: Fri, 23 Dec 2011 11:12:07 +0100 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> Message-ID: Yes, it is reproducible. About the file, I have tarred up the original maildir before I deleted the dovecot.index.cache, so when I try to bring in the original file, a 'cat' does no harm. Moreover, I've tried to do this will all files on the virtual machine, same results - no harm. On Thu, Dec 22, 2011 at 5:13 PM, Timo Sirainen wrote: > On 22.12.2011, at 18.06, hydra wrote: > > > After the virtual machine reboot, the CPU usage is normal again, but just > > until doveadm is launched again (it was run from cron). Sorry for the > > partition/drive terminology mess up. > > So it's reproducible? You could see if you can reproduce it by simply > reading the file(s) that are causing problems. Like with zsh: cat **/* > > /dev/null > > From stan at hardwarefreak.com Fri Dec 23 12:36:46 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 23 Dec 2011 04:36:46 -0600 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> Message-ID: <4EF459BE.7020104@hardwarefreak.com> On 12/23/2011 4:12 AM, hydra wrote: > Yes, it is reproducible. > > About the file, I have tarred up the original maildir before I deleted the > dovecot.index.cache, so when I try to bring in the original file, a 'cat' > does no harm. Moreover, I've tried to do this will all files on the virtual > machine, same results - no harm. Is selinux running? If so, turn it off and see if that helps. And turn off anything/everything else on this Linux VM that's not running on the other Dovecot VMs you mentioned are working properly. Let's do some process of elimination here. -- Stan From p at state-of-mind.de Fri Dec 23 13:46:19 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Fri, 23 Dec 2011 12:46:19 +0100 Subject: [Dovecot] =?utf-8?b?RG92b2xlbsOh?= In-Reply-To: <4EF44E96.2060401@tesco.net> References: <55354f37803b3d0dff41d29bbe02e354-1324595518@mail.valbek.cz> <4EF44E96.2060401@tesco.net> Message-ID: <20111223114619.GD2301@state-of-mind.de> * Ron Leach : > On 22/12/2011 23:11, pasek at valbek.cz wrote: > > > >Dobr?? den, > > > >od 23.12. do 30.12. jsem na dovolen??. V p????pad?? nutnosti volejte na mobil. > > > >S pozdravem > > > Ladislav, sure, we'll reach you on your mobile if we need you. > Enjoy the break; will you be doing some ski-ing? Thanks for the translation! :) p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From martin at ilait.se Fri Dec 23 16:41:30 2011 From: martin at ilait.se (Martin Abrahamsson) Date: Fri, 23 Dec 2011 15:41:30 +0100 Subject: [Dovecot] Limit maximum connections for user/IP on proxy In-Reply-To: <78C75C8E-E0C4-408E-BE81-8D74094B182F@iki.fi> References: <4EF34DCB.6090206@ilait.se> <78C75C8E-E0C4-408E-BE81-8D74094B182F@iki.fi> Message-ID: <4EF4931A.8080308@ilait.se> On 12/22/2011 04:37 PM, Timo Sirainen wrote: > See login_trusted_networks setting. Didn't realize that defining proxies in login_trusted_networks would display the rip at the mail store. Problem solved, thanks for the prompt reply! From achekalin at lazurit.com Fri Dec 23 18:00:48 2011 From: achekalin at lazurit.com (Alexander Chekalin) Date: Fri, 23 Dec 2011 19:00:48 +0300 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP Message-ID: <4EF4A5B0.4040302@lazurit.com> Hello, I'm now dealing with funny problem. I try to use Dovecot (2.1.rc1, actually) and mbox format to store old mailing, to keep logic of "one folder = one file". If I'd choose Maildir, I'd be able to create hierarchical folders (like "OldMail -> Maillists -> Dovecot"), and in fact on disk such a folders would be stored as real folders with dots in their names. In PHP it is easy to create with "imap_createmailbox()" function, I'd simple fire it 3 times (for "OldMail", for "OldMail.Maillists" and for "OldMail.Maillists.Dovecot"). But when I do the same with mbox, in fact it creates separate files (indeed, named "OldMail", "OldMail.Maillists" and "OldMail.Maillists.Dovecot") instead of creating filesystem folders ("OldMail/Maillists/Dovecot"). PHP is not guilty, Thunderbird won't create such folders as well. I can only create folders myself (say, with mkdir in the shell), chown it, and the it perfectly works in IMAP. Now I just wanted to know, are there any way to create IMAP-folders and subfolders using standard IMAP functionality? Thank you, Alexander From hydrapolic at gmail.com Fri Dec 23 19:08:02 2011 From: hydrapolic at gmail.com (hydra) Date: Fri, 23 Dec 2011 18:08:02 +0100 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: <4EF459BE.7020104@hardwarefreak.com> References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> <4EF459BE.7020104@hardwarefreak.com> Message-ID: Selinux wasn't running. I can reproduce the problem with this setup: - restore the maildir with the broken index.cache - run `/usr/bin/doveadm -D expunge -A mailbox Trash savedbefore 1w` in an infinite loop - use horde webmail to access the mail with IMAP - randomly display messages I could reproduce the problem on: Linux-2.6.37-hardened-r7 Linux-2.6.39-hardened-r8 Linux-3.0.4-hardened-r5 Linux-3.0.6-gentoo Linux-3.1.4-gentoo However I failed to reproduce the problem on: Linux-2.6.36-hardened-r9 So it seems it was introduced in 2.6.37. I'm going to inspect it later on. By wishing you a God blessed merry Christmas I thank you for the support ;) On Fri, Dec 23, 2011 at 11:36 AM, Stan Hoeppner wrote: > On 12/23/2011 4:12 AM, hydra wrote: > > Yes, it is reproducible. > > > > About the file, I have tarred up the original maildir before I deleted > the > > dovecot.index.cache, so when I try to bring in the original file, a 'cat' > > does no harm. Moreover, I've tried to do this will all files on the > virtual > > machine, same results - no harm. > > Is selinux running? If so, turn it off and see if that helps. And turn > off anything/everything else on this Linux VM that's not running on the > other Dovecot VMs you mentioned are working properly. Let's do some > process of elimination here. > > -- > Stan > > From e-frog at gmx.de Fri Dec 23 19:33:32 2011 From: e-frog at gmx.de (e-frog) Date: Fri, 23 Dec 2011 18:33:32 +0100 Subject: [Dovecot] 2.1.rc1 (056934abd2ef): virtual plugin mailbox search pattern Message-ID: <4EF4BB6C.3050902@gmx.de> Hello Timo, With dovecot 2.1.rc1 (056934abd2ef) there seems to be something wrong with virtual plugin mailbox search patterns. I'm using a virtual mailbox 'unread' with the following dovecot-virtual file $ cat dovecot-virtual * unseen For testing propose I created the following folders with each containing one unread message INBOX, INBOX/level1 and INBOX/level1/level2 2.1.rc1 (056934abd2ef) 1 LIST "" "*" * LIST (\HasChildren) "/" "INBOX" * LIST (\HasChildren) "/" "INBOX/level1" * LIST (\HasNoChildren) "/" "INBOX/level1/level2" * LIST (\HasChildren) "/" "virtual" * LIST (\HasNoChildren) "/" "virtual/unread" 1 OK List completed. 2 STATUS "INBOX" (UNSEEN) * STATUS "INBOX" (UNSEEN 1) 2 OK Status completed. 3 STATUS "INBOX/level1" (UNSEEN) * STATUS "INBOX/level1" (UNSEEN 1) 3 OK Status completed. 4 STATUS "INBOX/level1/level2" (UNSEEN) * STATUS "INBOX/level1/level2" (UNSEEN 1) 4 OK Status completed. 5 STATUS "virtual/unread" (UNSEEN) * STATUS "virtual/unread" (UNSEEN 1) 5 OK Status completed. Result: virtual/unread shows only 1 unseen message. Further tests showed it's the one from INBOX. The mails from the deeper levels are not found. Downgrading to 2.0.16 restores the correct behavior: 1 LIST "" "*" * LIST (\HasChildren) "/" "INBOX" * LIST (\HasChildren) "/" "INBOX/level1" * LIST (\HasNoChildren) "/" "INBOX/level1/level2" * LIST (\HasChildren) "/" "virtual" * LIST (\HasNoChildren) "/" "virtual/unread" 1 OK List completed. 2 STATUS "INBOX" (UNSEEN) * STATUS "INBOX" (UNSEEN 1) 2 OK Status completed. 3 STATUS "INBOX/level1" (UNSEEN) * STATUS "INBOX/level1" (UNSEEN 1) 3 OK Status completed. 4 STATUS "INBOX/level1/level2" (UNSEEN) * STATUS "INBOX/level1/level2" (UNSEEN 1) 4 OK Status completed. 5 STATUS "virtual/unread" (UNSEEN) * STATUS "virtual/unread" (UNSEEN 3) 5 OK Status completed. Result: virtual/unread shows 3 unseen messages as it should The namespace configuration is as following namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { location = virtual:~/virtual prefix = virtual/ separator = / subscriptions = no type = private } I've also tried this with location = virtual:~/virtual:LAYOUT=maildir++ leading to the same result. Thanks, e-frog From sottilette at rfx.it Fri Dec 23 21:20:20 2011 From: sottilette at rfx.it (sottilette at rfx.it) Date: Fri, 23 Dec 2011 20:20:20 +0100 (CET) Subject: [Dovecot] Upgrade/Migration Message-ID: Current box: CentOS 4.x (32 bit), dovecot 1.02, mbox format New box (supposed): CentOS 6.x (32/64 bit ? ), dovecot 2.04, mbox format The server have about 3.000 active users (unix users); /var/mail is about 100 GB; /home/Users about 150 GB I read the docs and searched on the net, but still request hints for planning the migration. 32/64 bit? Tricks to avoid users get all messages ...? Better first update the old server from 1.02 to 2.0x or ..? Any hints/comment appreciated ;-) Thanks, P. 1.02 dovecot.conf: ----------------------- protocols = pop3 pop3s imap imaps listen = [::] log_path = /var/log/mail/dovecot.log info_log_path = /var/log/mail/dovecot.info.log log_timestamp = "%b %d %H:%M:%S " default_mail_env = mbox:~/:INBOX=/var/mail/%u mail_full_filesystem_access = yes first_valid_uid = 100 mbox_read_locks = dotlock fcntl mbox_write_locks = dotlock fcntl auth default { mechanisms = plain passdb pam { } userdb passwd { } user = root } ----------------------- From djonas at vitalwerks.com Sat Dec 24 01:44:14 2011 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 23 Dec 2011 15:44:14 -0800 Subject: [Dovecot] Dovecot imap proxy to nginx, incompatible Message-ID: <4EF5124E.7000303@vitalwerks.com> It appears that using dovecot to proxy to nginx imap proxy doesn't work. >From tcpdump and browsing the source it appears dovecot sends, C CAPABILITY\r\nL LOGIN \r\n and nginx only responds to the CAPABILITY command. Is this a problem with dovecot sending the two commands without waiting for the first to complete or is it nginx's trouble with not handling it correctly? A quick test with a perl script confirms: #!/usr/bin/perl -w $|++; use IO::Socket; use strict; my ($host, $user, $pass) = @ARGV; my $s = new IO::Socket::INET(Proto => 'tcp', PeerAddr => $host, PeerPort => 143); die "Could not create socket $!\n" unless $s; while(<$s>) { print $_; last if /OK/; } print $s "C CAPABILITY\r\nL LOGIN $user $pass\r\n"; while(<$s>) { print $_; last if /OK/; } print $s "Q logout\r\n"; while(<$s>) { print $_; last if /OK/; } close($s); ## Output: * CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS UIDPLUS LIST-EXTENDED I18NLEVEL=1 QUOTA AUTH=PLAIN C OK completed * BYE Q OK completed From bradley.giesbrecht at gmail.com Sat Dec 24 04:28:02 2011 From: bradley.giesbrecht at gmail.com (Bradley Giesbrecht) Date: Fri, 23 Dec 2011 18:28:02 -0800 Subject: [Dovecot] sieve in sql or reporting Message-ID: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> With dovecot2 and pigeonhole sieve/managesieve is it currently possible to store sieve rules in an sql database? If not is there a way to query all accounts; looking for things like active vacation rules? Regards, Bradley Giesbrecht From stephan at rename-it.nl Sat Dec 24 06:26:24 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 24 Dec 2011 05:26:24 +0100 Subject: [Dovecot] sieve in sql or reporting In-Reply-To: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> Message-ID: <4EF55470.5040708@rename-it.nl> On 12/24/2011 3:28 AM, Bradley Giesbrecht wrote: > With dovecot2 and pigeonhole sieve/managesieve is it currently possible to store sieve rules in an sql database? Unfortunately, not yet. It is listed somewhere on the TODO list, but it does not have high priority so far. > If not is there a way to query all accounts; looking for things like active vacation rules? I'm working on an evolution of the sieve_pipe plugin called the sieve_extprograms plugin. One of the things it adds is a new action command called "execute", which may suit your needs. It will only be available for Dovecot v2.1 though. You can read the latest version of the specification here (example 4 should match your application): http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/raw-file/tip/doc/rfc/spec-bosch-sieve-extprograms.txt Regards, Stephan. From stephan at rename-it.nl Sat Dec 24 06:35:59 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 24 Dec 2011 05:35:59 +0100 Subject: [Dovecot] sieve in sql or reporting In-Reply-To: <4EF55470.5040708@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> Message-ID: <4EF556AF.8070007@rename-it.nl> On 12/24/2011 5:26 AM, Stephan Bosch wrote: > On 12/24/2011 3:28 AM, Bradley Giesbrecht wrote: >> With dovecot2 and pigeonhole sieve/managesieve is it currently >> possible to store sieve rules in an sql database? > Unfortunately, not yet. It is listed somewhere on the TODO list, but > it does not have high priority so far. > >> If not is there a way to query all accounts; looking for things like >> active vacation rules? > > I'm working on an evolution of the sieve_pipe plugin called the > sieve_extprograms plugin. One of the things it adds is a new action > command called "execute", which may suit your needs. It will only be > available for Dovecot v2.1 though. You can read the latest version of > the specification here (example 4 should match your application): > > http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/raw-file/tip/doc/rfc/spec-bosch-sieve-extprograms.txt > Oh btw, if you are looking for a way to disable vacation rules after some period of time, you can use the date extension (http://tools.ietf.org/html/rfc5260#section-4). For example: require ["date", "relational", "vacation"]; if currentdate :value "le" "date" "2011-12-09" { vacation "I'm out of office this week. I'll be back on Saturday 10th to reply to your e-mails."; } Regards, Stephan. From IcedEarthAngel at gmx.de Fri Dec 23 18:02:25 2011 From: IcedEarthAngel at gmx.de (IcedEarth) Date: Fri, 23 Dec 2011 08:02:25 -0800 (PST) Subject: [Dovecot] dovecot / postfix mail bounce problem Message-ID: <33029725.post@talk.nabble.com> Hello, i use a globalsieve rule to collect spam for all mail accounts in a specific mailbox. Here is the code: vi /var/vmail/globalsieverc require ["fileinto"]; # Move spam to junk folder if not address :is "to" "antispam at xxx.com" { if header :contains "X-Spam-Flag" ["YES"] { redirect "antispam at xxx.com"; stop; } } But the spam mails are not delivered. cat /var/log/mail.info postfix/pipe[32301]: AD8F78E2128D: to=, relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, status=bounced (mail forwarding loop for antispam at xxx.de) Why is there a loop? I don't unterstand that. Any help? Thanks! Iced -- View this message in context: http://old.nabble.com/dovecot---postfix-mail-bounce-problem-tp33029725p33029725.html Sent from the Dovecot mailing list archive at Nabble.com. From stan at hardwarefreak.com Sat Dec 24 12:31:08 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 24 Dec 2011 04:31:08 -0600 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF4A5B0.4040302@lazurit.com> References: <4EF4A5B0.4040302@lazurit.com> Message-ID: <4EF5A9EC.8090606@hardwarefreak.com> On 12/23/2011 10:00 AM, Alexander Chekalin wrote: > Hello, > > I'm now dealing with funny problem. I try to use Dovecot (2.1.rc1, > actually) and mbox format to store old mailing, to keep logic of "one > folder = one file". > > If I'd choose Maildir, I'd be able to create hierarchical folders (like > "OldMail -> Maillists -> Dovecot"), and in fact on disk such a folders > would be stored as real folders with dots in their names. In PHP it is > easy to create with "imap_createmailbox()" function, I'd simple fire it > 3 times (for "OldMail", for "OldMail.Maillists" and for > "OldMail.Maillists.Dovecot"). > > But when I do the same with mbox, in fact it creates separate files > (indeed, named "OldMail", "OldMail.Maillists" and > "OldMail.Maillists.Dovecot") instead of creating filesystem folders > ("OldMail/Maillists/Dovecot"). PHP is not guilty, Thunderbird won't > create such folders as well. I can only create folders myself (say, with > mkdir in the shell), chown it, and the it perfectly works in IMAP. > > Now I just wanted to know, are there any way to create IMAP-folders and > subfolders using standard IMAP functionality? Yes. This has been common knowledge for many years, and is covered by lots of documentation, including dovecot and tbird docs. With mbox storage, an IMAP FOLDER contains only sub folders or it contains only messages. It CANNOT contain BOTH. Thunderbird forces you to answer this question each time you create a new IMAP FOLDER in the account root tree. Surely you've seen the radio buttons in the new folder creation box. -- Stan From stan at hardwarefreak.com Sat Dec 24 12:46:58 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 24 Dec 2011 04:46:58 -0600 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> <4EF459BE.7020104@hardwarefreak.com> Message-ID: <4EF5ADA2.8080008@hardwarefreak.com> On 12/23/2011 11:08 AM, hydra wrote: > Selinux wasn't running. > > I can reproduce the problem with this setup: > > - restore the maildir with the broken index.cache > - run `/usr/bin/doveadm -D expunge -A mailbox Trash savedbefore 1w` in an > infinite loop > - use horde webmail to access the mail with IMAP > - randomly display messages > > I could reproduce the problem on: > Linux-2.6.37-hardened-r7 > Linux-2.6.39-hardened-r8 > Linux-3.0.4-hardened-r5 > Linux-3.0.6-gentoo > Linux-3.1.4-gentoo > > However I failed to reproduce the problem on: > Linux-2.6.36-hardened-r9 > > So it seems it was introduced in 2.6.37. I'm going to inspect it later on. > By wishing you a God blessed merry Christmas I thank you for the support ;) Aha, cool. Glad you're making some progress, and that you now know it's kernel related in some way, just as Timo suspected. Keep in mind it may not necessarily be a code change problem in 2.6.37 onward. Could be a compiler/linker issue. It could also be the default EXT4 journal behavior changed (I haven't checked), or something similar. Merry Christmas to you as well hydra. I don't really deserve much credit for support here. I've just nudged you in the direction you already knew you should be heading. :) Best regards, -- Stan From jerry at seibercom.net Sat Dec 24 12:53:58 2011 From: jerry at seibercom.net (Jerry) Date: Sat, 24 Dec 2011 05:53:58 -0500 Subject: [Dovecot] OT: sieve in sql or reporting In-Reply-To: <4EF556AF.8070007@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> Message-ID: <20111224055358.3818150c@scorpio> On Sat, 24 Dec 2011 05:35:59 +0100 Stephan Bosch articulated: > On 12/24/2011 5:26 AM, Stephan Bosch wrote: > > On 12/24/2011 3:28 AM, Bradley Giesbrecht wrote: > >> With dovecot2 and pigeonhole sieve/managesieve is it currently > >> possible to store sieve rules in an sql database? > > Unfortunately, not yet. It is listed somewhere on the TODO list, > > but it does not have high priority so far. > > > >> If not is there a way to query all accounts; looking for things > >> like active vacation rules? > > > > I'm working on an evolution of the sieve_pipe plugin called the > > sieve_extprograms plugin. One of the things it adds is a new action > > command called "execute", which may suit your needs. It will only > > be available for Dovecot v2.1 though. You can read the latest > > version of the specification here (example 4 should match your > > application): > > > > http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/raw-file/tip/doc/rfc/spec-bosch-sieve-extprograms.txt > > > > Oh btw, if you are looking for a way to disable vacation rules after > some period of time, you can use the date extension > (http://tools.ietf.org/html/rfc5260#section-4). For example: > > require ["date", "relational", "vacation"]; > > if currentdate :value "le" "date" "2011-12-09" { > vacation "I'm out of office this week. I'll be back on > Saturday 10th to reply to your e-mails."; > } I know this isn't strictly part of this topic; however, I was wondering if sieve had acquired the ability to "forward as attachment" a received email? I know it did not have that ability previously. It is something that I could really use. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From jerry at seibercom.net Sat Dec 24 12:57:43 2011 From: jerry at seibercom.net (Jerry) Date: Sat, 24 Dec 2011 05:57:43 -0500 Subject: [Dovecot] dovecot / postfix mail bounce problem In-Reply-To: <33029725.post@talk.nabble.com> References: <33029725.post@talk.nabble.com> Message-ID: <20111224055743.2be0a99b@scorpio> On Fri, 23 Dec 2011 08:02:25 -0800 (PST) IcedEarth articulated: > > Hello, > > i use a globalsieve rule to collect spam for all mail accounts in a > specific mailbox. > > Here is the code: > > vi /var/vmail/globalsieverc > > require ["fileinto"]; > # Move spam to junk folder > if not address :is "to" "antispam at xxx.com" { > if header :contains "X-Spam-Flag" ["YES"] { > redirect "antispam at xxx.com"; > stop; > } > } > > But the spam mails are not delivered. > > cat /var/log/mail.info > > postfix/pipe[32301]: AD8F78E2128D: to=, > relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, > status=bounced (mail forwarding loop for antispam at xxx.de) > > Why is there a loop? I don't unterstand that. This question really belongs on the Postfix forum. Please read the directions for posting on that forum first. http://www.postfix.com/DEBUG_README.html Pay attention to the "Reporting problems to postfix-users at postfix.org" section at the end of the article. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ Be frank and explicit with your lawyer ... it is his business to confuse the issue afterwards. From stephan at rename-it.nl Sat Dec 24 13:30:00 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 24 Dec 2011 12:30:00 +0100 Subject: [Dovecot] OT: sieve in sql or reporting In-Reply-To: <20111224055358.3818150c@scorpio> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> <20111224055358.3818150c@scorpio> Message-ID: <4EF5B7B8.4050504@rename-it.nl> On 12/24/2011 11:53 AM, Jerry wrote: > I know this isn't strictly part of this topic; however, I was wondering > if sieve had acquired the ability to "forward as attachment" a received > email? I know it did not have that ability previously. It is something > that I could really use. In the standard Sieve language this is still not possible. It is possible to "enclose" an e-mail, but it is explicitly not allowed to redirect something like that; it can only be stored. I still don't know why. Also, the enclose extension is not implemented for Pigeonhole so far. If you need it for a very specific task, you can try the sieve_pipe plugin for Dovecot v2.0: http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Pipe You can then write your own script that does the forward-as-attachment action. As I indicated earlier, I'm working on a more intricate plugin for Dovecot v2.1. Regards, Stephan From jerry at seibercom.net Sat Dec 24 13:54:19 2011 From: jerry at seibercom.net (Jerry) Date: Sat, 24 Dec 2011 06:54:19 -0500 Subject: [Dovecot] OT: sieve in sql or reporting In-Reply-To: <4EF5B7B8.4050504@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> <20111224055358.3818150c@scorpio> <4EF5B7B8.4050504@rename-it.nl> Message-ID: <20111224065419.5db26ee5@scorpio> On Sat, 24 Dec 2011 12:30:00 +0100 Stephan Bosch articulated: > On 12/24/2011 11:53 AM, Jerry wrote: > > I know this isn't strictly part of this topic; however, I was > > wondering if sieve had acquired the ability to "forward as > > attachment" a received email? I know it did not have that ability > > previously. It is something that I could really use. > > In the standard Sieve language this is still not possible. It is > possible to "enclose" an e-mail, but it is explicitly not allowed to > redirect something like that; it can only be stored. I still don't > know why. Also, the enclose extension is not implemented for > Pigeonhole so far. > > If you need it for a very specific task, you can try the sieve_pipe > plugin for Dovecot v2.0: > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Pipe > > You can then write your own script that does the > forward-as-attachment action. As I indicated earlier, I'm working on > a more intricate plugin for Dovecot v2.1. Thank you very much for your extremely rapid response. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From robert at schetterer.org Sat Dec 24 14:54:32 2011 From: robert at schetterer.org (Robert Schetterer) Date: Sat, 24 Dec 2011 13:54:32 +0100 Subject: [Dovecot] OT: sieve in sql or reporting In-Reply-To: <4EF5B7B8.4050504@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> <20111224055358.3818150c@scorpio> <4EF5B7B8.4050504@rename-it.nl> Message-ID: <4EF5CB88.7060208@schetterer.org> Am 24.12.2011 12:30, schrieb Stephan Bosch: > On 12/24/2011 11:53 AM, Jerry wrote: >> I know this isn't strictly part of this topic; however, I was wondering >> if sieve had acquired the ability to "forward as attachment" a received >> email? I know it did not have that ability previously. It is something >> that I could really use. > > In the standard Sieve language this is still not possible. It is > possible to "enclose" an e-mail, but it is explicitly not allowed to > redirect something like that; it can only be stored. I still don't know > why. Also, the enclose extension is not implemented for Pigeonhole so far. > > If you need it for a very specific task, you can try the sieve_pipe > plugin for Dovecot v2.0: > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Pipe > > You can then write your own script that does the forward-as-attachment > action. As I indicated earlier, I'm working on a more intricate plugin > for Dovecot v2.1. > > Regards, > > Stephan > many people would like to see "forward as attachment" in sieve but i guess there must be good tec reasons why it was not done since yet i thought about it as an advanced notify action ? that should be possible Merry X-Mas ! -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From janfrode at tanso.net Sat Dec 24 17:20:50 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Sat, 24 Dec 2011 16:20:50 +0100 Subject: [Dovecot] Compressing existing maildirs Message-ID: <20111224152050.GA3958@dibs.tanso.net> I've just enabled zlib for our users, and am looking at how to compress the existing files. The routine for doing this at http://wiki2.dovecot.org/Plugins/Zlib seems a bit complicated. What do you think about simply doing: find /var/vmail -type f -name "*,S=*" -mtime +1 -exec gzip -S Z -6 '{}' + I.e. find all maildir-files: - with size in the name ("*,S=*") - modified before I enabled zlib plugin - compress them - add the Z suffix - keep timestamps (gzip does that by default) It's of course racy without the maildirlock, but are there any other problems with this approach ? -jf From achekalin at lazurit.com Sat Dec 24 18:26:49 2011 From: achekalin at lazurit.com (Alexander Chekalin) Date: Sat, 24 Dec 2011 19:26:49 +0300 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF5A9EC.8090606@hardwarefreak.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> Message-ID: <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> Stan, thank you for the reply, But I believe I obey this rule: I create "folder with ONLY folders inside", then in it another "folder with ONLY folders inside", and the into this second folder I create "folder with ONLY messages inside" (the path is "oldmail/lists/dovecot", and oldmail and lists are folders in filesystem, while dovecot is mbox container in filesystem). My problem is I can not understand which way should I create "folder with ONLY folders inside", and which way to create messages-only folder, going down to IMAP protocol commands. PHP for example looks like use only one command to create a mailbox, no difference what type of it I need. I understand PHP isn't the only script language to deal with IMAP, so I seek for advice how IMAP works with on protocol level. 24.12.2011, ? 13:31, Stan Hoeppner ???????(?): > On 12/23/2011 10:00 AM, Alexander Chekalin wrote: >> Hello, >> >> I'm now dealing with funny problem. I try to use Dovecot (2.1.rc1, >> actually) and mbox format to store old mailing, to keep logic of "one >> folder = one file". >> >> If I'd choose Maildir, I'd be able to create hierarchical folders (like >> "OldMail -> Maillists -> Dovecot"), and in fact on disk such a folders >> would be stored as real folders with dots in their names. In PHP it is >> easy to create with "imap_createmailbox()" function, I'd simple fire it >> 3 times (for "OldMail", for "OldMail.Maillists" and for >> "OldMail.Maillists.Dovecot"). >> >> But when I do the same with mbox, in fact it creates separate files >> (indeed, named "OldMail", "OldMail.Maillists" and >> "OldMail.Maillists.Dovecot") instead of creating filesystem folders >> ("OldMail/Maillists/Dovecot"). PHP is not guilty, Thunderbird won't >> create such folders as well. I can only create folders myself (say, with >> mkdir in the shell), chown it, and the it perfectly works in IMAP. >> >> Now I just wanted to know, are there any way to create IMAP-folders and >> subfolders using standard IMAP functionality? > > Yes. This has been common knowledge for many years, and is covered by > lots of documentation, including dovecot and tbird docs. With mbox > storage, an IMAP FOLDER contains only sub folders or it contains only > messages. It CANNOT contain BOTH. Thunderbird forces you to answer > this question each time you create a new IMAP FOLDER in the account root > tree. Surely you've seen the radio buttons in the new folder creation box. > > -- > Stan > From bradley.giesbrecht at gmail.com Sat Dec 24 19:01:14 2011 From: bradley.giesbrecht at gmail.com (Bradley Giesbrecht) Date: Sat, 24 Dec 2011 09:01:14 -0800 Subject: [Dovecot] sieve in sql or reporting In-Reply-To: <4EF556AF.8070007@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> Message-ID: <711A071F-17ED-42E5-A90C-B6B7BADD1DB5@gmail.com> On Dec 23, 2011, at 8:35 PM, Stephan Bosch wrote: > On 12/24/2011 5:26 AM, Stephan Bosch wrote: >> On 12/24/2011 3:28 AM, Bradley Giesbrecht wrote: >>> With dovecot2 and pigeonhole sieve/managesieve is it currently possible to store sieve rules in an sql database? >> Unfortunately, not yet. It is listed somewhere on the TODO list, but it does not have high priority so far. >> >>> If not is there a way to query all accounts; looking for things like active vacation rules? >> >> I'm working on an evolution of the sieve_pipe plugin called the sieve_extprograms plugin. One of the things it adds is a new action command called "execute", which may suit your needs. It will only be available for Dovecot v2.1 though. You can read the latest version of the specification here (example 4 should match your application): >> >> http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/raw-file/tip/doc/rfc/spec-bosch-sieve-extprograms.txt > > Oh btw, if you are looking for a way to disable vacation rules after some period of time, you can use the date extension (http://tools.ietf.org/html/rfc5260#section-4). For example: > > require ["date", "relational", "vacation"]; > > if currentdate :value "le" "date" "2011-12-09" { > vacation "I'm out of office this week. I'll be back on Saturday 10th to reply to your e-mails."; > } Stephan, thank you for both responses. My idea was to add sieve rules to a report so I could look up an email address and explain to the user why things happen. I can read in the users sieve scripts from the file system, or put them into sql myself for that matter. If a managesieve query command already existed I would use that. Regards, Bradley Geisbrecht From stan at hardwarefreak.com Sun Dec 25 02:50:44 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 24 Dec 2011 18:50:44 -0600 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> Message-ID: <4EF67364.6030003@hardwarefreak.com> On 12/24/2011 10:26 AM, Alexander Chekalin wrote: > Stan, thank you for the reply, > > But I believe I obey this rule: I create "folder with ONLY folders inside", then in it another "folder with ONLY folders inside", and the into this second folder I create "folder with ONLY messages inside" (the path is "oldmail/lists/dovecot", and oldmail and lists are folders in filesystem, while dovecot is mbox container in filesystem). > > My problem is I can not understand which way should I create "folder with ONLY folders inside", and which way to create messages-only folder, going down to IMAP protocol commands. PHP for example looks like use only one command to create a mailbox, no difference what type of it I need. > > I understand PHP isn't the only script language to deal with IMAP, so I seek for advice how IMAP works with on protocol level. Ah, ok. I didn't fully understand your issue. Maybe Timo, or someone else, knows the necessary imap folder creation command sequence for this. -- Stan From IcedEarthAngel at gmx.de Sun Dec 25 20:55:50 2011 From: IcedEarthAngel at gmx.de (IcedEarth) Date: Sun, 25 Dec 2011 10:55:50 -0800 (PST) Subject: [Dovecot] dovecot / postfix mail bounce problem In-Reply-To: <20111224055743.2be0a99b@scorpio> References: <33029725.post@talk.nabble.com> <20111224055743.2be0a99b@scorpio> Message-ID: <33036367.post@talk.nabble.com> Jerry-146 wrote: > > On Fri, 23 Dec 2011 08:02:25 -0800 (PST) > IcedEarth articulated: > >> >> Hello, >> >> i use a globalsieve rule to collect spam for all mail accounts in a >> specific mailbox. >> >> Here is the code: >> >> vi /var/vmail/globalsieverc >> >> require ["fileinto"]; >> # Move spam to junk folder >> if not address :is "to" "antispam at xxx.com" { >> if header :contains "X-Spam-Flag" ["YES"] { >> redirect "antispam at xxx.com"; >> stop; >> } >> } >> >> But the spam mails are not delivered. >> >> cat /var/log/mail.info >> >> postfix/pipe[32301]: AD8F78E2128D: to=, >> relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, >> status=bounced (mail forwarding loop for antispam at xxx.de) >> >> Why is there a loop? I don't unterstand that. > > This question really belongs on the Postfix forum. Please read the > directions for posting on that forum first. > > http://www.postfix.com/DEBUG_README.html > > Pay attention to the "Reporting problems to postfix-users at postfix.org" > section at the end of the article. > > > -- > Jerry ? > > Disclaimer: off-list followups get on-list replies or get ignored. > Please do not ignore the Reply-To header. > __________________________________________________________________ > Be frank and explicit with your lawyer ... it is his business to confuse > the issue afterwards. > > Hello Jerry, no this question not belongs on the Postfix forum. It was a dovecot issue. I've fixed it. I just created an empty file '.dovecot.sieve' in the 'antispam at xxx.com' Mailbox dir. This prevents dovecot to execute the globalsieve for the Mailbox 'antispam at xxx.com'. My script triggered a loop. New script: require ["fileinto"]; # Move spam to junk folder if header :contains "X-Spam-Flag" ["YES"] { redirect "antispam at xxx.com"; stop; } -- View this message in context: http://old.nabble.com/dovecot---postfix-mail-bounce-problem-tp33029725p33036367.html Sent from the Dovecot mailing list archive at Nabble.com. From arthur at psw.ro Sun Dec 25 22:08:42 2011 From: arthur at psw.ro (Arthur Titeica) Date: Sun, 25 Dec 2011 22:08:42 +0200 Subject: [Dovecot] dovecot / postfix mail bounce problem In-Reply-To: <33036367.post@talk.nabble.com> References: <33029725.post@talk.nabble.com> <20111224055743.2be0a99b@scorpio> <33036367.post@talk.nabble.com> Message-ID: <3c908c59f40c3171efad55ad3ca06cc1@psw.ro> On 25.12.2011 20:55, IcedEarth wrote: > Jerry-146 wrote: >> >> On Fri, 23 Dec 2011 08:02:25 -0800 (PST) >> IcedEarth articulated: >> >>> >>> Hello, >>> >>> i use a globalsieve rule to collect spam for all mail accounts in a >>> specific mailbox. >>> >>> Here is the code: >>> >>> vi /var/vmail/globalsieverc >>> >>> require ["fileinto"]; >>> # Move spam to junk folder >>> if not address :is "to" "antispam at xxx.com" { >>> if header :contains "X-Spam-Flag" ["YES"] { >>> redirect "antispam at xxx.com"; >>> stop; >>> } >>> } >>> >>> But the spam mails are not delivered. >>> >>> cat /var/log/mail.info >>> >>> postfix/pipe[32301]: AD8F78E2128D: to=, >>> relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, >>> status=bounced (mail forwarding loop for antispam at xxx.de) >>> >>> Why is there a loop? I don't unterstand that. >> >> This question really belongs on the Postfix forum. Please read the >> directions for posting on that forum first. >> >> http://www.postfix.com/DEBUG_README.html >> >> Pay attention to the "Reporting problems to >> postfix-users at postfix.org" >> section at the end of the article. >> >> > > Hello Jerry, > > no this question not belongs on the Postfix forum. > It was a dovecot issue. I've fixed it. > > I just created an empty file '.dovecot.sieve' in the > 'antispam at xxx.com' > Mailbox dir. This prevents dovecot to execute the globalsieve for the > Mailbox 'antispam at xxx.com'. > > My script triggered a loop. > > New script: > require ["fileinto"]; > # Move spam to junk folder > if header :contains "X-Spam-Flag" ["YES"] { > redirect "antispam at xxx.com"; > stop; > } Roundcube sieve plugin writes your original script as # rule:[test] if allof (not address :is "To" "antispam at xxx.com", header :contains "X-Spam-Flag" "YES") { redirect "antispam at xxx.com"; } -- Arthur Titeica From IcedEarthAngel at gmx.de Sun Dec 25 23:58:00 2011 From: IcedEarthAngel at gmx.de (IcedEarth) Date: Sun, 25 Dec 2011 13:58:00 -0800 (PST) Subject: [Dovecot] dovecot / postfix mail bounce problem In-Reply-To: <3c908c59f40c3171efad55ad3ca06cc1@psw.ro> References: <33029725.post@talk.nabble.com> <20111224055743.2be0a99b@scorpio> <33036367.post@talk.nabble.com> <3c908c59f40c3171efad55ad3ca06cc1@psw.ro> Message-ID: <33036676.post@talk.nabble.com> Hi Arthur, tested your script as globalsieve. Same result. Mail is bounced. Only option is to create a .global.sieve for antispam at ... Mailbox. Thanks. Iced Arthur Titeica-2 wrote: > > On 25.12.2011 20:55, IcedEarth wrote: >> Jerry-146 wrote: >>> >>> On Fri, 23 Dec 2011 08:02:25 -0800 (PST) >>> IcedEarth articulated: >>> >>>> >>>> Hello, >>>> >>>> i use a globalsieve rule to collect spam for all mail accounts in a >>>> specific mailbox. >>>> >>>> Here is the code: >>>> >>>> vi /var/vmail/globalsieverc >>>> >>>> require ["fileinto"]; >>>> # Move spam to junk folder >>>> if not address :is "to" "antispam at xxx.com" { >>>> if header :contains "X-Spam-Flag" ["YES"] { >>>> redirect "antispam at xxx.com"; >>>> stop; >>>> } >>>> } >>>> >>>> But the spam mails are not delivered. >>>> >>>> cat /var/log/mail.info >>>> >>>> postfix/pipe[32301]: AD8F78E2128D: to=, >>>> relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, >>>> status=bounced (mail forwarding loop for antispam at xxx.de) >>>> >>>> Why is there a loop? I don't unterstand that. >>> >>> This question really belongs on the Postfix forum. Please read the >>> directions for posting on that forum first. >>> >>> http://www.postfix.com/DEBUG_README.html >>> >>> Pay attention to the "Reporting problems to >>> postfix-users at postfix.org" >>> section at the end of the article. >>> >>> >> >> Hello Jerry, >> >> no this question not belongs on the Postfix forum. >> It was a dovecot issue. I've fixed it. >> >> I just created an empty file '.dovecot.sieve' in the >> 'antispam at xxx.com' >> Mailbox dir. This prevents dovecot to execute the globalsieve for the >> Mailbox 'antispam at xxx.com'. >> >> My script triggered a loop. >> >> New script: >> require ["fileinto"]; >> # Move spam to junk folder >> if header :contains "X-Spam-Flag" ["YES"] { >> redirect "antispam at xxx.com"; >> stop; >> } > > Roundcube sieve plugin writes your original script as > > # rule:[test] > if allof (not address :is "To" "antispam at xxx.com", > header :contains "X-Spam-Flag" "YES") > { > redirect "antispam at xxx.com"; > } > > > -- > Arthur Titeica > > -- View this message in context: http://old.nabble.com/dovecot---postfix-mail-bounce-problem-tp33029725p33036676.html Sent from the Dovecot mailing list archive at Nabble.com. From achekalin at lazurit.com Mon Dec 26 08:43:49 2011 From: achekalin at lazurit.com (Alexander Chekalin) Date: Mon, 26 Dec 2011 09:43:49 +0300 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF67364.6030003@hardwarefreak.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> <4EF67364.6030003@hardwarefreak.com> Message-ID: <4EF817A5.3030101@lazurit.com> Hello Stan, thank you for your care, the answer was pretty simple, and yes you're right, I'd better read the docs before: I tried to create folder named like 'Old Mail' (and in fact I got another mbox container), while I needed to create 'Old Mail/' (note the slash), which results in real filesystem directory. Thanks for your time anyway! Yours, Alexander 25.12.2011 3:50, Stan Hoeppner ?????: > On 12/24/2011 10:26 AM, Alexander Chekalin wrote: >> Stan, thank you for the reply, >> >> But I believe I obey this rule: I create "folder with ONLY folders inside", then in it another "folder with ONLY folders inside", and the into this second folder I create "folder with ONLY messages inside" (the path is "oldmail/lists/dovecot", and oldmail and lists are folders in filesystem, while dovecot is mbox container in filesystem). >> >> My problem is I can not understand which way should I create "folder with ONLY folders inside", and which way to create messages-only folder, going down to IMAP protocol commands. PHP for example looks like use only one command to create a mailbox, no difference what type of it I need. >> >> I understand PHP isn't the only script language to deal with IMAP, so I seek for advice how IMAP works with on protocol level. > > Ah, ok. I didn't fully understand your issue. Maybe Timo, or someone > else, knows the necessary imap folder creation command sequence for this. > From pasek at valbek.cz Mon Dec 26 08:45:17 2011 From: pasek at valbek.cz (pasek at valbek.cz) Date: Mon, 26 Dec 2011 07:45:17 +0100 Subject: [Dovecot] =?utf-8?b?RG92b2xlbsOh?= Message-ID: <54bd608eb02c61ea80e76eb903d3ee5d-1324881917@mail.valbek.cz> Dobr? den, od 23.12. do 30.12. jsem na dovolen?. V p??pad? nutnosti volejte na mobil. S pozdravem Bc. Ladislav Pa?ek vedouc? odd?len? IT a vizualizace mobil: +420 776 140 489 e-mail: pasek at valbek.cz Valbek, s.r.o. Va?urova 505/17, 460 02 Liberec 3 tel./fax: +420 485 103 336, +420 485 103 346 www.valbek.cz From stan at hardwarefreak.com Mon Dec 26 09:48:32 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Mon, 26 Dec 2011 01:48:32 -0600 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF817A5.3030101@lazurit.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> <4EF67364.6030003@hardwarefreak.com> <4EF817A5.3030101@lazurit.com> Message-ID: <4EF826D0.3050005@hardwarefreak.com> On 12/26/2011 12:43 AM, Alexander Chekalin wrote: > Hello Stan, > > thank you for your care, the answer was pretty simple, and yes you're > right, I'd better read the docs before: > > I tried to create folder named like 'Old Mail' (and in fact I got > another mbox container), while I needed to create 'Old Mail/' (note the > slash), which results in real filesystem directory. Oh wow, that is simple. And makes perfect sense. Before my last reply I read the php IMAP command set definitions/parameters and I didn't see anything about how to do this, which is an odd omission in documentation. I guess so few people use mbox these days they omit that case from the docs. I hit three different sources and none of them mentioned the trailing slash for creating 'sub-folders-only' folders... > Thanks for your time anyway! You're welcome. Sorry I didn't get you the answer, but I'm glad you were able to figure it out on your own. -- Stan > 25.12.2011 3:50, Stan Hoeppner ?????: >> On 12/24/2011 10:26 AM, Alexander Chekalin wrote: >>> Stan, thank you for the reply, >>> >>> But I believe I obey this rule: I create "folder with ONLY folders >>> inside", then in it another "folder with ONLY folders inside", and >>> the into this second folder I create "folder with ONLY messages >>> inside" (the path is "oldmail/lists/dovecot", and oldmail and lists >>> are folders in filesystem, while dovecot is mbox container in >>> filesystem). >>> >>> My problem is I can not understand which way should I create "folder >>> with ONLY folders inside", and which way to create messages-only >>> folder, going down to IMAP protocol commands. PHP for example looks >>> like use only one command to create a mailbox, no difference what >>> type of it I need. >>> >>> I understand PHP isn't the only script language to deal with IMAP, so >>> I seek for advice how IMAP works with on protocol level. >> >> Ah, ok. I didn't fully understand your issue. Maybe Timo, or someone >> else, knows the necessary imap folder creation command sequence for this. From denis at fateyev.com Mon Dec 26 10:13:18 2011 From: denis at fateyev.com (Denis Fateyev) Date: Mon, 26 Dec 2011 14:13:18 +0600 Subject: [Dovecot] =?iso-8859-1?q?Dovolen=E1?= In-Reply-To: <54bd608eb02c61ea80e76eb903d3ee5d-1324881917@mail.valbek.cz> References: <54bd608eb02c61ea80e76eb903d3ee5d-1324881917@mail.valbek.cz> Message-ID: Hello all, On Mon, Dec 26, 2011 at 12:45 PM, wrote: > > V p??pad? nutnosti volejte na mobil. > > Indeed, it sounds like a call to action ;-) Merry Christmas to everyone! --- wbr, Denis. From jsxmoney at gmail.com Mon Dec 26 22:41:11 2011 From: jsxmoney at gmail.com (Jason X, Maney) Date: Mon, 26 Dec 2011 22:41:11 +0200 Subject: [Dovecot] managesieve vacation script bounces/frozen with a 550 error. Message-ID: Dear all, I have been trying to get this problem out of the way but I just cant seem to get it right. I hope someone can point me in the right direction here. I have come up with a vacation script as below, which can be send out from my Postfix SMTP server to my smarthost at the ISP, and yet for some reason it is not sent out at my ISP server. The guys at the ISP have sent me the full error they are getting on their Exim SMTP server. My dovecot version is: ========== dovecot --version 1.2.9 ========== ...and my managesieve configs are as follows: ========== dovecot -n |grep sieve protocols: pop3 pop3s imap imaps managesieve listen(managesieve): *:4190 login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(managesieve): mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve mail_plugins: sieve quota sieve: /var/vmail/sieve/%d/%u/sieve-script sieve_global_path: /var/vmail/sieve/default.sieve sieve_storage: /var/vmail/sieve/%d/%u ========== Error from my ISP smarthost: ========== +++ 1ReM7W-000Dm8-My has not completed +++ 2011-12-26 09:34:18 1ReM7W-000Dm8-My <= <> H=(myhostname.mydomain.com) [xxx.xxx.xxx.xxx] P=esmtps X=TLSv1:DHE-RSA-AES256-SHA:256 S=1451 id=dovecot-sieve-1324712058-257846-0 at havana T="Out of office reply" 2011-12-26 09:34:18 1ReM7W-000Dm8-My ** jsxmoney at gmail.comR=send_to_gateway T=remote_smtp: SMTP error from remote mail server after RCPT TO:: host smtp.myisp.com[yyy.yyy.yyy.yyy]: 550 Bounces must have only a single recipient 2011-12-26 09:34:18 1ReM7W-000Dm8-My Frozen (delivery error message ========== My vacation sieve script is: ========== ## /* empty script */ require ["fileinto", "vacation"]; vacation # Reply at most once a day to a same sender :days 1 :subject "Out of office reply" # List of additional recipient addresses which are included in the auto replying. # If a mail's recipient is not the envelope recipient and it's not on this list, # no vacation reply is sent for it. :addresses "me at mydomain.com" "I'm out of office, please contact Joan Doe instead. Best regards Me"; ========== What I am not sure of is, is this a problem I need to fix or is it something my ISP need to work on, on their Exim? If its something they can work on can you also give me pointers so I can work with them to fix it? Many thanx, JXM. From asai at globalchangemusic.org Tue Dec 27 17:46:13 2011 From: asai at globalchangemusic.org (Asai) Date: Tue, 27 Dec 2011 08:46:13 -0700 Subject: [Dovecot] Dsync Error Can't Delete Mailbox Message-ID: <4EF9E845.4030507@globalchangemusic.org> Greetings, I'm getting this error in the dsync logs: Warning: Destination mailbox INBOX has been modified, need to recreate it before we can continue syncing dsync(foo at bar.org): Error: Can't delete mailbox INBOX: INBOX can't be deleted. In this situation, what should I do to remedy the problem? Just delete the backup and rebuild? -- --asai From sottilette at rfx.it Wed Dec 28 00:58:37 2011 From: sottilette at rfx.it (sottilette at rfx.it) Date: Tue, 27 Dec 2011 23:58:37 +0100 (CET) Subject: [Dovecot] UIDL format Message-ID: How can be sure of the current POP3 UIDL? Below my current config (to be migrated to 2.0.x ASAP). Thanks, P. # dovecot -n # 1.0.2: /etc/dovecot.conf log_path: /var/log/mail/dovecot.log info_log_path: /var/log/mail/dovecot.info.log protocols: pop3 pop3s imap imaps listen: * login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login first_valid_uid: 100 mail_location: mbox:~/:INBOX=/var/mail/%u mail_full_filesystem_access: yes mbox_read_locks: dotlock fcntl mbox_write_locks: dotlock fcntl mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd From stephan at rename-it.nl Wed Dec 28 01:19:38 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 28 Dec 2011 00:19:38 +0100 Subject: [Dovecot] managesieve vacation script bounces/frozen with a 550 error. In-Reply-To: References: Message-ID: <4EFA528A.2080400@rename-it.nl> On 12/26/2011 9:41 PM, Jason X, Maney wrote: > I have been trying to get this problem out of the way but I just cant > seem to get it right. I hope someone can point me in the right > direction here. I have come up with a vacation script as below, which > can be send out from my Postfix SMTP server to my smarthost at the > ISP, and yet for some reason it is not sent out at my ISP server. The > guys at the ISP have sent me the full error they are getting on their > Exim SMTP server. My dovecot version is: [...] > 550 Bounces must have only a single recipient [...] > What I am not sure of is, is this a problem I need to fix or is it > something my ISP need to work on, on their Exim? If its something > they can work on can you also give me pointers so I can work with > them to fix it? I googled for this error a bit, and it is probably produced by the following custom anti-backscatter Exim acl (various examples float around on the internet): deny senders = : condition = ${if ! eq{$recipients_count}{1}{1}} message = Bounces must have only a single recipient This rule only fires when the vacation message triggers multiple RCPT commands in the SMTP session with your SMTP. Sieve only replies to a single recipient, so apparently somewhere along the mail path additional recipients get added and it is likely that this happens at your smarthorst. Since this is likely an MTA problem and not a Sieve or Dovecot issue, I cannot help you much more. Regards, Stephan. From david at electric-spoon.com Wed Dec 28 12:26:44 2011 From: david at electric-spoon.com (David Pottage) Date: Wed, 28 Dec 2011 10:26:44 +0000 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. Message-ID: <4EFAEEE4.80405@electric-spoon.com> Hello I am currently running dovecot 1.2.15 on my home server. I have over 200 folders in personal email account, and I have found that my smart-phone does not work well trying to display that many folders. I solved the problem by creating a second instance of dovecot running on a non standard port, and configured it to serve only a subset my email folders, so that way the email client on my smartphone works well and I can read the emails I am interested in on the move. The process of configuring two instances of dovecot on the same machine serving different views of the same mailbox was faily complex, so I think it would be worth documenting the process in an FAQ or suchlike for other users. I thought a good place to write up my method would be in the HowTo section of the Dovecot Wiki. Is that a good idea? Can I request an account to edit the Wiki, or should I send a draft text to an editor? Are there any Dovecot experts here who can review my methods and suggest improvements? -- David Pottage From ruskie at codemages.net Wed Dec 28 12:39:49 2011 From: ruskie at codemages.net (=?UTF-8?Q?Andra=C5=BE_'ruskie'_Levstik?=) Date: Wed, 28 Dec 2011 11:39:49 +0100 (CET) Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFAEEE4.80405@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> Message-ID: :2011-12-28T10:26:David Pottage: > I am currently running dovecot 1.2.15 on my home server. I have over 200 > folders in personal email account, and I have found that my smart-phone > does not work well trying to display that many folders. > > I solved the problem by creating a second instance of dovecot running on > a non standard port, and configured it to serve only a subset my email > folders, so that way the email client on my smartphone works well and I > can read the emails I am interested in on the move. Here's a simple improvement. Create a new email user and symlink just those folders you want to see into it. That way you don't need 2 instances just two different users and you use one on mobile the other elsewhere ;) Using virtual folders could be helpful as well. I have a New mails one which shows me all new emails in all folders which helps in a lot of places. -- Andra? 'ruskie' Levstik Source Mage GNU/Linux Games/Xorg grimoire guru Re-Alpine Coordinator http://sourceforge.net/projects/re-alpine/ Geek/Hacker/Tinker Knowledge is important, knowledge you know is priceless. Share the knowledge, build a better future for everyone. From dovecot at asheesh.org Wed Dec 28 20:31:06 2011 From: dovecot at asheesh.org (Asheesh Laroia) Date: Wed, 28 Dec 2011 13:31:06 -0500 (EST) Subject: [Dovecot] /usr/lib/dovecot/imap ignores log settings? Message-ID: Hi Dovecot peeps, I'm enjoying running /usr/lib/dovecot/imap directly as a PREAUTH IMAP pipe. I find that it outputs log messages whose severity is INFO to stdout. I'm running it as follows: /usr/lib/dovecot/imap -c /tmp/dovecot.conf and I see the following messages output to stdout: * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in as paulproteus imap(paulproteus): Info: Connection closed bytes=0/305 Naturally, the first line is great. My /tmp/dovecot.conf is: # single-dbox mail_location = sdbox:~/Maildir/dbox log_path = syslog info_log_path = /dev/null I'm also attaching strace output, created by running this command: echo | strace /usr/lib/dovecot/imap -c /tmp/dovecot.conf > /tmp/straced 2>&1 (The point of the "echo | " is to provide a newline and then EOF to /usr/lib/dovecot/imap.) You can see in the strace output that /usr/lib/dovecot/imap outputs the "Connection closed" message to file descriptor 2. I'd like that message to actually not be printed, which is why I set log_path to syslog. -- Asheesh. -------------- next part -------------- execve("/usr/lib/dovecot/imap", ["/usr/lib/dovecot/imap", "-c", "/tmp/dovecot.conf"], [/* 31 vars */]) = 0 brk(0) = 0x1eb8000 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee31000 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/x86_64/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls/x86_64", 0x7fff1a7c24f0) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls", 0x7fff1a7c24f0) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/x86_64/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/x86_64", 0x7fff1a7c24f0) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/libdovecot-storage.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\313\2\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=898088, ...}) = 0 mmap(NULL, 2993560, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03e939000 mprotect(0x7ff03ea0d000, 2093056, PROT_NONE) = 0 mmap(0x7ff03ec0c000, 32768, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xd3000) = 0x7ff03ec0c000 close(3) = 0 open("/usr/lib/dovecot/libdovecot.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200\217\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=533816, ...}) = 0 mmap(NULL, 2639392, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03e6b4000 mprotect(0x7ff03e734000, 2093056, PROT_NONE) = 0 mmap(0x7ff03e933000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7f000) = 0x7ff03e933000 mmap(0x7ff03e936000, 9760, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7ff03e936000 close(3) = 0 open("/usr/lib/dovecot/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory) open("/etc/ld.so.cache", O_RDONLY) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=127929, ...}) = 0 mmap(NULL, 127929, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7ff03ee11000 close(3) = 0 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\r\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=14768, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee10000 mmap(NULL, 2109696, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03e4b0000 mprotect(0x7ff03e4b2000, 2097152, PROT_NONE) = 0 mmap(0x7ff03e6b2000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7ff03e6b2000 close(3) = 0 open("/usr/lib/dovecot/librt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\220!\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=31744, ...}) = 0 mmap(NULL, 2128856, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03e2a8000 mprotect(0x7ff03e2af000, 2093056, PROT_NONE) = 0 mmap(0x7ff03e4ae000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7ff03e4ae000 close(3) = 0 open("/usr/lib/dovecot/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\300\357\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=1570832, ...}) = 0 mmap(NULL, 3684440, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03df24000 mprotect(0x7ff03e09e000, 2097152, PROT_NONE) = 0 mmap(0x7ff03e29e000, 20480, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x17a000) = 0x7ff03e29e000 mmap(0x7ff03e2a3000, 18520, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7ff03e2a3000 close(3) = 0 open("/usr/lib/dovecot/libpthread.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libpthread.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@\\\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=131107, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee0f000 mmap(NULL, 2208672, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03dd08000 mprotect(0x7ff03dd1f000, 2093056, PROT_NONE) = 0 mmap(0x7ff03df1e000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16000) = 0x7ff03df1e000 mmap(0x7ff03df20000, 13216, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7ff03df20000 close(3) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee0e000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee0d000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee0c000 arch_prctl(ARCH_SET_FS, 0x7ff03ee0d700) = 0 mprotect(0x7ff03df1e000, 4096, PROT_READ) = 0 mprotect(0x7ff03e29e000, 16384, PROT_READ) = 0 mprotect(0x7ff03e4ae000, 4096, PROT_READ) = 0 mprotect(0x7ff03e6b2000, 4096, PROT_READ) = 0 mprotect(0x7ff03ee33000, 4096, PROT_READ) = 0 munmap(0x7ff03ee11000, 127929) = 0 set_tid_address(0x7ff03ee0d9d0) = 24515 set_robust_list(0x7ff03ee0d9e0, 0x18) = 0 futex(0x7fff1a7c2ddc, FUTEX_WAIT_BITSET_PRIVATE|FUTEX_CLOCK_REALTIME, 1, NULL, 7ff03ee0d700) = -1 EAGAIN (Resource temporarily unavailable) rt_sigaction(SIGRTMIN, {0x7ff03dd0dad0, [], SA_RESTORER|SA_SIGINFO, 0x7ff03dd17030}, NULL, 8) = 0 rt_sigaction(SIGRT_1, {0x7ff03dd0db60, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x7ff03dd17030}, NULL, 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0 getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM_INFINITY}) = 0 getuid() = 1000 brk(0) = 0x1eb8000 brk(0x1ee1000) = 0x1ee1000 uname({sys="Linux", node="pathi", ...}) = 0 rt_sigaction(SIGPIPE, {SIG_IGN, [], SA_RESTORER|SA_RESTART, 0x7ff03df56480}, NULL, 8) = 0 rt_sigaction(SIGALRM, {0x7ff03e7000d0, [], SA_RESTORER|SA_SIGINFO, 0x7ff03df56480}, NULL, 8) = 0 rt_sigaction(SIGINT, {0x7ff03e700160, [], SA_RESTORER|SA_SIGINFO, 0x7ff03df56480}, NULL, 8) = 0 pipe([3, 4]) = 0 fcntl(3, F_GETFL) = 0 (flags O_RDONLY) fcntl(3, F_SETFL, O_RDONLY|O_NONBLOCK) = 0 fcntl(4, F_GETFL) = 0x1 (flags O_WRONLY) fcntl(4, F_SETFL, O_WRONLY|O_NONBLOCK) = 0 fcntl(3, F_GETFD) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 fcntl(4, F_GETFD) = 0 fcntl(4, F_SETFD, FD_CLOEXEC) = 0 epoll_create(128) = 5 fcntl(5, F_GETFD) = 0 fcntl(5, F_SETFD, FD_CLOEXEC) = 0 epoll_ctl(5, EPOLL_CTL_ADD, 3, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=32249584, u64=32249584}}) = 0 rt_sigaction(SIGTERM, {0x7ff03e700160, [], SA_RESTORER|SA_SIGINFO, 0x7ff03df56480}, NULL, 8) = 0 umask(077) = 022 stat("/tmp/dovecot.conf", {st_mode=S_IFREG|0644, st_size=98, ...}) = 0 stat("/tmp/dovecot.conf", {st_mode=S_IFREG|0644, st_size=98, ...}) = 0 execve("/usr/bin/doveconf", ["/usr/bin/doveconf", "-f", "service=imap", "-c", "/tmp/dovecot.conf", "-m", "imap", "-e", "/usr/lib/dovecot/imap", "-c", "/tmp/dovecot.conf"], [/* 2 vars */]) = 0 brk(0) = 0xc98000 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559d8000 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/x86_64/libdovecot.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls/x86_64", 0x7fff99f31d70) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/libdovecot.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls", 0x7fff99f31d70) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/x86_64/libdovecot.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/x86_64", 0x7fff99f31d70) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/libdovecot.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200\217\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=533816, ...}) = 0 mmap(NULL, 2639392, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d55536000 mprotect(0x7f1d555b6000, 2093056, PROT_NONE) = 0 mmap(0x7f1d557b5000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7f000) = 0x7f1d557b5000 mmap(0x7f1d557b8000, 9760, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f1d557b8000 close(3) = 0 open("/usr/lib/dovecot/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory) open("/etc/ld.so.cache", O_RDONLY) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=127929, ...}) = 0 mmap(NULL, 127929, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f1d559b8000 close(3) = 0 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\r\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=14768, ...}) = 0 mmap(NULL, 2109696, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d55332000 mprotect(0x7f1d55334000, 2097152, PROT_NONE) = 0 mmap(0x7f1d55534000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f1d55534000 close(3) = 0 open("/usr/lib/dovecot/librt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\220!\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=31744, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559b7000 mmap(NULL, 2128856, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d5512a000 mprotect(0x7f1d55131000, 2093056, PROT_NONE) = 0 mmap(0x7f1d55330000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f1d55330000 close(3) = 0 open("/usr/lib/dovecot/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\300\357\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=1570832, ...}) = 0 mmap(NULL, 3684440, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d54da6000 mprotect(0x7f1d54f20000, 2097152, PROT_NONE) = 0 mmap(0x7f1d55120000, 20480, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x17a000) = 0x7f1d55120000 mmap(0x7f1d55125000, 18520, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f1d55125000 close(3) = 0 open("/usr/lib/dovecot/libpthread.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libpthread.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@\\\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=131107, ...}) = 0 mmap(NULL, 2208672, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d54b8a000 mprotect(0x7f1d54ba1000, 2093056, PROT_NONE) = 0 mmap(0x7f1d54da0000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16000) = 0x7f1d54da0000 mmap(0x7f1d54da2000, 13216, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f1d54da2000 close(3) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559b6000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559b5000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559b4000 arch_prctl(ARCH_SET_FS, 0x7f1d559b5700) = 0 mprotect(0x7f1d54da0000, 4096, PROT_READ) = 0 mprotect(0x7f1d55120000, 16384, PROT_READ) = 0 mprotect(0x7f1d55330000, 4096, PROT_READ) = 0 mprotect(0x7f1d55534000, 4096, PROT_READ) = 0 mprotect(0x7f1d559da000, 4096, PROT_READ) = 0 munmap(0x7f1d559b8000, 127929) = 0 set_tid_address(0x7f1d559b59d0) = 24515 set_robust_list(0x7f1d559b59e0, 0x18) = 0 futex(0x7fff99f3265c, FUTEX_WAIT_BITSET_PRIVATE|FUTEX_CLOCK_REALTIME, 1, NULL, 7f1d559b5700) = -1 EAGAIN (Resource temporarily unavailable) rt_sigaction(SIGRTMIN, {0x7f1d54b8fad0, [], SA_RESTORER|SA_SIGINFO, 0x7f1d54b99030}, NULL, 8) = 0 rt_sigaction(SIGRT_1, {0x7f1d54b8fb60, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x7f1d54b99030}, NULL, 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0 getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM_INFINITY}) = 0 brk(0) = 0xc98000 brk(0xcc1000) = 0xcc1000 uname({sys="Linux", node="pathi", ...}) = 0 rt_sigaction(SIGPIPE, {SIG_IGN, [], SA_RESTORER|SA_RESTART, 0x7f1d54dd8480}, NULL, 8) = 0 rt_sigaction(SIGALRM, {0x7f1d555820d0, [], SA_RESTORER|SA_SIGINFO, 0x7f1d54dd8480}, NULL, 8) = 0 rt_sigaction(SIGINT, {0x7f1d55582160, [], SA_RESTORER|SA_SIGINFO, 0x7f1d54dd8480}, NULL, 8) = 0 pipe([3, 4]) = 0 fcntl(3, F_GETFL) = 0 (flags O_RDONLY) fcntl(3, F_SETFL, O_RDONLY|O_NONBLOCK) = 0 fcntl(4, F_GETFL) = 0x1 (flags O_WRONLY) fcntl(4, F_SETFL, O_WRONLY|O_NONBLOCK) = 0 fcntl(3, F_GETFD) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 fcntl(4, F_GETFD) = 0 fcntl(4, F_SETFD, FD_CLOEXEC) = 0 epoll_create(128) = 5 fcntl(5, F_GETFD) = 0 fcntl(5, F_SETFD, FD_CLOEXEC) = 0 epoll_ctl(5, EPOLL_CTL_ADD, 3, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=13243088, u64=13243088}}) = 0 rt_sigaction(SIGTERM, {0x7f1d55582160, [], SA_RESTORER|SA_SIGINFO, 0x7f1d54dd8480}, NULL, 8) = 0 open("/usr/lib/dovecot/modules/settings", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 6 getdents(6, /* 2 entries */, 32768) = 48 getdents(6, /* 0 entries */, 32768) = 0 close(6) = 0 open("/tmp/dovecot.conf", O_RDONLY) = 6 mmap(NULL, 266240, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d55973000 brk(0xce3000) = 0xce3000 brk(0xd04000) = 0xd04000 fstat(6, {st_mode=S_IFREG|0644, st_size=98, ...}) = 0 pread(6, "# single-dbox\nmail_location = sd"..., 8192, 0) = 98 pread(6, "", 8094, 98) = 0 close(6) = 0 brk(0xd2d000) = 0xd2d000 brk(0xd4f000) = 0xd4f000 brk(0xd1d000) = 0xd1d000 brk(0xd3f000) = 0xd3f000 brk(0xd61000) = 0xd61000 brk(0xd30000) = 0xd30000 execve("/usr/lib/dovecot/imap", ["/usr/lib/dovecot/imap", "-c", "/tmp/dovecot.conf"], [/* 6 vars */]) = 0 brk(0) = 0x1636000 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc3711a6000 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/x86_64/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls/x86_64", 0x7ffff10a0850) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls", 0x7ffff10a0850) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/x86_64/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/x86_64", 0x7ffff10a0850) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/libdovecot-storage.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\313\2\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=898088, ...}) = 0 mmap(NULL, 2993560, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc370cae000 mprotect(0x7fc370d82000, 2093056, PROT_NONE) = 0 mmap(0x7fc370f81000, 32768, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xd3000) = 0x7fc370f81000 close(3) = 0 open("/usr/lib/dovecot/libdovecot.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200\217\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=533816, ...}) = 0 mmap(NULL, 2639392, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc370a29000 mprotect(0x7fc370aa9000, 2093056, PROT_NONE) = 0 mmap(0x7fc370ca8000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7f000) = 0x7fc370ca8000 mmap(0x7fc370cab000, 9760, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7fc370cab000 close(3) = 0 open("/usr/lib/dovecot/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory) open("/etc/ld.so.cache", O_RDONLY) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=127929, ...}) = 0 mmap(NULL, 127929, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7fc371186000 close(3) = 0 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\r\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=14768, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371185000 mmap(NULL, 2109696, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc370825000 mprotect(0x7fc370827000, 2097152, PROT_NONE) = 0 mmap(0x7fc370a27000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7fc370a27000 close(3) = 0 open("/usr/lib/dovecot/librt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\220!\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=31744, ...}) = 0 mmap(NULL, 2128856, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc37061d000 mprotect(0x7fc370624000, 2093056, PROT_NONE) = 0 mmap(0x7fc370823000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7fc370823000 close(3) = 0 open("/usr/lib/dovecot/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\300\357\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=1570832, ...}) = 0 mmap(NULL, 3684440, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc370299000 mprotect(0x7fc370413000, 2097152, PROT_NONE) = 0 mmap(0x7fc370613000, 20480, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x17a000) = 0x7fc370613000 mmap(0x7fc370618000, 18520, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7fc370618000 close(3) = 0 open("/usr/lib/dovecot/libpthread.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libpthread.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@\\\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=131107, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371184000 mmap(NULL, 2208672, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc37007d000 mprotect(0x7fc370094000, 2093056, PROT_NONE) = 0 mmap(0x7fc370293000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16000) = 0x7fc370293000 mmap(0x7fc370295000, 13216, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7fc370295000 close(3) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371183000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371182000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371181000 arch_prctl(ARCH_SET_FS, 0x7fc371182700) = 0 mprotect(0x7fc370293000, 4096, PROT_READ) = 0 mprotect(0x7fc370613000, 16384, PROT_READ) = 0 mprotect(0x7fc370823000, 4096, PROT_READ) = 0 mprotect(0x7fc370a27000, 4096, PROT_READ) = 0 mprotect(0x7fc3711a8000, 4096, PROT_READ) = 0 munmap(0x7fc371186000, 127929) = 0 set_tid_address(0x7fc3711829d0) = 24515 set_robust_list(0x7fc3711829e0, 0x18) = 0 futex(0x7ffff10a113c, FUTEX_WAIT_BITSET_PRIVATE|FUTEX_CLOCK_REALTIME, 1, NULL, 7fc371182700) = -1 EAGAIN (Resource temporarily unavailable) rt_sigaction(SIGRTMIN, {0x7fc370082ad0, [], SA_RESTORER|SA_SIGINFO, 0x7fc37008c030}, NULL, 8) = 0 rt_sigaction(SIGRT_1, {0x7fc370082b60, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x7fc37008c030}, NULL, 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0 getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM_INFINITY}) = 0 getuid() = 1000 brk(0) = 0x1636000 brk(0x165f000) = 0x165f000 uname({sys="Linux", node="pathi", ...}) = 0 rt_sigaction(SIGPIPE, {SIG_IGN, [], SA_RESTORER|SA_RESTART, 0x7fc3702cb480}, NULL, 8) = 0 rt_sigaction(SIGALRM, {0x7fc370a750d0, [], SA_RESTORER|SA_SIGINFO, 0x7fc3702cb480}, NULL, 8) = 0 rt_sigaction(SIGINT, {0x7fc370a75160, [], SA_RESTORER|SA_SIGINFO, 0x7fc3702cb480}, NULL, 8) = 0 pipe([3, 4]) = 0 fcntl(3, F_GETFL) = 0 (flags O_RDONLY) fcntl(3, F_SETFL, O_RDONLY|O_NONBLOCK) = 0 fcntl(4, F_GETFL) = 0x1 (flags O_WRONLY) fcntl(4, F_SETFL, O_WRONLY|O_NONBLOCK) = 0 fcntl(3, F_GETFD) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 fcntl(4, F_GETFD) = 0 fcntl(4, F_SETFD, FD_CLOEXEC) = 0 epoll_create(128) = 5 fcntl(5, F_GETFD) = 0 fcntl(5, F_SETFD, FD_CLOEXEC) = 0 epoll_ctl(5, EPOLL_CTL_ADD, 3, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=23327440, u64=23327440}}) = 0 rt_sigaction(SIGTERM, {0x7fc370a75160, [], SA_RESTORER|SA_SIGINFO, 0x7fc3702cb480}, NULL, 8) = 0 umask(077) = 077 geteuid() = 1000 geteuid() = 1000 geteuid() = 1000 geteuid() = 1000 getegid() = 1000 getgid() = 1000 getegid() = 1000 setgid(0) = -1 EPERM (Operation not permitted) prctl(PR_SET_DUMPABLE, 1) = 0 geteuid() = 1000 chdir("/home/paulproteus") = 0 stat("/home/paulproteus/Maildir/dbox/mailboxes", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 prctl(PR_SET_DUMPABLE, 1) = 0 fcntl(0, F_GETFL) = 0 (flags O_RDONLY) fcntl(0, F_SETFL, O_RDONLY|O_NONBLOCK) = 0 fcntl(1, F_GETFL) = 0x8001 (flags O_WRONLY|O_LARGEFILE) fcntl(1, F_SETFL, O_WRONLY|O_NONBLOCK|O_LARGEFILE) = 0 fstat(0, {st_mode=S_IFIFO|0600, st_size=0, ...}) = 0 lseek(1, 0, SEEK_CUR) = 25034 fstat(1, {st_mode=S_IFREG|0644, st_size=25071, ...}) = 0 epoll_ctl(5, EPOLL_CTL_ADD, 0, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=23409968, u64=23409968}}) = 0 write(1, "* PREAUTH [CAPABILITY IMAP4rev1 "..., 305* PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in as paulproteus ) = 305 epoll_wait(5, {{EPOLLIN|EPOLLHUP, {u32=23409968, u64=23409968}}}, 2, 1800000) = 1 brk(0x1681000) = 0x1681000 read(0, "\n", 8192) = 1 write(1, "* BAD Error in IMAP command : Un"..., 48* BAD Error in IMAP command : Unknown command. ) = 48 epoll_wait(5, {{EPOLLHUP, {u32=23409968, u64=23409968}}}, 2, 1800000) = 1 read(0, "", 8191) = 0 write(2, "imap(paulproteus): Info: Connect"..., 57imap(paulproteus): Info: Connection closed bytes=1/25387 ) = 57 epoll_ctl(5, EPOLL_CTL_DEL, 0, {0, {u32=23409968, u64=23409968}}) = 0 brk(0x167f000) = 0x167f000 brk(0x167d000) = 0x167d000 close(0) = 0 close(1) = 0 brk(0x1678000) = 0x1678000 brk(0x1677000) = 0x1677000 brk(0x1675000) = 0x1675000 brk(0x1674000) = 0x1674000 epoll_ctl(5, EPOLL_CTL_DEL, 3, {0, {u32=23327440, u64=23327440}}) = 0 close(3) = 0 close(4) = 0 close(5) = 0 exit_group(0) = ? From david at electric-spoon.com Thu Dec 29 00:05:03 2011 From: david at electric-spoon.com (David Pottage) Date: Wed, 28 Dec 2011 22:05:03 +0000 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: References: <4EFAEEE4.80405@electric-spoon.com> Message-ID: <4EFB928F.2010601@electric-spoon.com> On 28/12/11 10:39, Andra? 'ruskie' Levstik wrote: > :2011-12-28T10:26:David Pottage: > >> I solved the problem by creating a second instance of dovecot running on >> a non standard port, and configured it to serve only a subset my email >> folders, so that way the email client on my smartphone works well and I >> can read the emails I am interested in on the move. > Here's a simple improvement. > Create a new email user and symlink just those folders you want to see > into it. I considered that option but decided against it for two reasons. Firstly I wanted to retain the option to switch to the full version of my mail folders if I needed to access something urgently. My smart-phone based email client allows me to change the port number of an existing email account, but will not allow me to change the user-name without creating a whole new account and re-downloading everything. Secondly creating a second account makes the authentication on the server a lot more complex. Either I need two OS level accounts on the sever, and find ways to keep them in sync, or I need to create a custom authentication method on dovecot or PAM so that when it receives a user-name matching some pattern, it will check the password against a different account. In short, I think a second server with a separate configuration is more scalable. I don't think it consumes much more resource compared with one server. > Using virtual folders could be helpful as well. I have a New mails one > which shows me all new emails in all folders which helps in a lot of > places. Could you provide a link to documentation about virtual folders. -- David Pottage From stan at hardwarefreak.com Thu Dec 29 00:12:08 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Wed, 28 Dec 2011 16:12:08 -0600 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFB928F.2010601@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> Message-ID: <4EFB9438.7090608@hardwarefreak.com> On 12/28/2011 4:05 PM, David Pottage wrote: > Firstly I wanted to retain the option to switch to the full version of > my mail folders if I needed to access something urgently. My smart-phone > based email client allows me to change the port number of an existing > email account, but will not allow me to change the user-name without > creating a whole new account and re-downloading everything. > > Secondly creating a second account makes the authentication on the > server a lot more complex. Either I need two OS level accounts on the > sever, and find ways to keep them in sync, or I need to create a custom > authentication method on dovecot or PAM so that when it receives a > user-name matching some pattern, it will check the password against a > different account. > > In short, I think a second server with a separate configuration is more > scalable. I don't think it consumes much more resource compared with one > server. It's a smart phone. Have you considering simply running a webmail server? -- Stan From rick at havokmon.com Thu Dec 29 00:21:49 2011 From: rick at havokmon.com (Rick Romero) Date: Wed, 28 Dec 2011 16:21:49 -0600 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFB928F.2010601@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> Message-ID: <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> Quoting David Pottage : > On 28/12/11 10:39, Andra? 'ruskie' Levstik wrote: >> :2011-12-28T10:26:David Pottage: >> >>> I solved the problem by creating a second instance of dovecot running on >>> a non standard port, and configured it to serve only a subset my email >>> folders, so that way the email client on my smartphone works well and I >>> can read the emails I am interested in on the move. >> Here's a simple improvement. >> Create a new email user and symlink just those folders you want to see >> into it. > I considered that option but decided against it for two reasons. > > Firstly I wanted to retain the option to switch to the full version of > my mail folders if I needed to access something urgently. My smart-phone > based email client allows me to change the port number of an existing > email account, but will not allow me to change the user-name without > creating a whole new account and re-downloading everything. I read back through the thread, and I don't see why you're not using IMAP subscriptions - did I overlook it? Rick From ghandidrivesahumvee at rocketfish.com Thu Dec 29 01:56:33 2011 From: ghandidrivesahumvee at rocketfish.com (Dovecot-GDH) Date: Wed, 28 Dec 2011 15:56:33 -0800 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111224152050.GA3958@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> Message-ID: The cleanest (though not necessarily simplest) way to go about this would be to use dsync to create a new maildir and incrementally direct traffic to a separate Dovecot instance. Unless you have a legacy application that relies on maildir, switching to mdbox would be a good idea too. I expect that with Dovecot compression is something that can "just be turned on", but for fear of any possible issue, I chose to migrate mailboxes in batches with the way mentioned above. On Dec 24, 2011, at 7:20 AM, Jan-Frode Myklebust wrote: > I've just enabled zlib for our users, and am looking at how to compress > the existing files. The routine for doing this at > http://wiki2.dovecot.org/Plugins/Zlib seems a bit complicated. What do > you think about simply doing: > > find /var/vmail -type f -name "*,S=*" -mtime +1 -exec gzip -S Z -6 '{}' + > > > I.e. find all maildir-files: > > - with size in the name ("*,S=*") > - modified before I enabled zlib plugin > - compress them > - add the Z suffix > - keep timestamps (gzip does that by default) > > > It's of course racy without the maildirlock, but are there any other > problems with this approach ? > > > -jf From zdy0818 at gmail.com Thu Dec 29 06:06:45 2011 From: zdy0818 at gmail.com (Dongyu.Zhen) Date: Thu, 29 Dec 2011 12:06:45 +0800 Subject: [Dovecot] imap be killed (core dump disabled) Message-ID: <4EFBE755.7090509@gmail.com> Hello everybody, When I modify the dovecot imap source ,in "src/imap/" dir, I meet the Error below: Error: child (imap) kill (core dump disabled). In fact, I want to record the imap operation through dovecot. So, I modify every source file in "src/imap/cmd-IMAP_OPERATION" ,when the imap command function is executed, it will write to a file cur time and operation. Could you tell me why the imap be killed? Thank you. From janfrode at tanso.net Thu Dec 29 10:49:16 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 09:49:16 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: References: <20111224152050.GA3958@dibs.tanso.net> Message-ID: <20111229084916.GA5895@dibs.tanso.net> On Wed, Dec 28, 2011 at 03:56:33PM -0800, Dovecot-GDH wrote: > The cleanest (though not necessarily simplest) way to go about this would be to use dsync to create a new maildir and incrementally direct traffic to a separate Dovecot instance. > > Unless you have a legacy application that relies on maildir, switching to mdbox would be a good idea too. We just got rid of the legacy app that worked directly against the maildirs, which is the reason we now can turn on compression. I intend to switch to mdbox, but first I need to free up some disks by compressing the existing maildirs (12 TB maildirs, should probably compress down to less than half). > > I expect that with Dovecot compression is something that can "just be turned on", but for fear of any possible issue, I chose to migrate mailboxes in batches with the way mentioned above. > Migrating to mdbox is much scarier to me than an easily reversible compression of existing maildir files. Could you please give a bit more details about how you did this migration? Did you change user home dirctory in the process? Seeing the scripts you used to run the migration would be very interesting.. -jf From janfrode at tanso.net Thu Dec 29 13:14:55 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 12:14:55 +0100 Subject: [Dovecot] dsync / separator / namespace config-problem Message-ID: <20111229111455.GA9344@dibs.tanso.net> Guess I don't quite get namespaces, but we have the following namespace configured: $ doveconf namespace namespace { hidden = no inbox = yes list = yes location = prefix = INBOX. separator = subscriptions = yes type = private } But when I try running dsync it complains: $ sudo -u atmail dsync -u janfrode at tanso.net mirror mdbox:/tmp/janfrodeboks dsync(atmail): Error: user janfrode at tanso.net: Initialization failed: namespace configuration error: list=yes requires prefix=INBOX. to end with separator dsync(atmail): Fatal: User init failed I can fix this by adding "separator = ." to the namespace and dsync is happy, but is changing this now safe, or will this affect existing clients? -jf From CMarcus at Media-Brokers.com Thu Dec 29 14:07:30 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 29 Dec 2011 07:07:30 -0500 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFB928F.2010601@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> Message-ID: <4EFC5802.8090609@Media-Brokers.com> On 2011-12-28 5:05 PM, David Pottage wrote: > Secondly creating a second account makes the authentication on the > server a lot more complex. Either I need two OS level accounts on > the sever, and find ways to keep them in sync, or I need to create a > custom authentication method on dovecot or PAM so that when it > receives a user-name matching some pattern, it will check the > password against a different account. It would be cool if the concept of 'Master User' could be expanded on to provide access to only certain other accounts, as opposed to full domains (or maybe it does alreaqdy and I just don't understand it well enough yet). For example, we have Sales Assistants in our offices, where each assistant may assist up to 3 or 4 different Sales reps. It would be nice to be able to give the Assistant read-only access to the Sales Reps emails without having to set up shared folders for each one... -- Best regards, Charles From CMarcus at Media-Brokers.com Thu Dec 29 14:10:56 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 29 Dec 2011 07:10:56 -0500 Subject: [Dovecot] imap be killed (core dump disabled) In-Reply-To: <4EFBE755.7090509@gmail.com> References: <4EFBE755.7090509@gmail.com> Message-ID: <4EFC58D0.4030300@Media-Brokers.com> On 2011-12-28 11:06 PM, Dongyu.Zhen wrote: > Hello everybody, > When I modify the dovecot imap source ,in "src/imap/" dir, I meet the > Error below: > Error: child (imap) kill (core dump disabled). > > In fact, I want to record the imap operation through dovecot. So, I > modify every source file in "src/imap/cmd-IMAP_OPERATION" ,when the imap > command function is executed, it will write to a file cur time and > operation. Ummm... maybe what you want is already there? http://wiki2.dovecot.org/Plugins/MailLog > Could you tell me why the imap be killed? You modified the source, didn't bother to provide specific details as to what modifications you did, and expect someone to be able to answer that? I don't think even Timo is that good... ;) -- Best regards, Charles From tss at iki.fi Thu Dec 29 14:27:28 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 14:27:28 +0200 Subject: [Dovecot] imap be killed (core dump disabled) In-Reply-To: <4EFBE755.7090509@gmail.com> References: <4EFBE755.7090509@gmail.com> Message-ID: <6BE91CBE-F3EB-4389-A3BC-85CE1F410EDD@iki.fi> On 29.12.2011, at 6.06, Dongyu.Zhen wrote: > Hello everybody, > When I modify the dovecot imap source ,in "src/imap/" dir, I meet the > Error below: > Error: child (imap) kill (core dump disabled). Most likely due to your modification, but gdb backtraces are helpful when debugging crashes: http://dovecot.org/bugreport.html From tss at iki.fi Thu Dec 29 14:35:15 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 14:35:15 +0200 Subject: [Dovecot] doveadm + dsync merging Message-ID: doveadm already supports some nice things, such as being able to remotely launch a doveadm command via TCP socket. It also supports executing a command for all users or to some specific users using a wildcard. dsync could use these features, so I merged dsync and doveadm into same binary for v2.1. I'll still install "dsync" symlink pointing to "doveadm", and running that way it should be fully backwards compatible with the old dsync binary and its parameters. I'm mainly now wondering about the command naming for running dsync via doveadm. Any suggestions? a) Use "doveadm dsync" prefix, and otherwise keep the names same: dsync mirror -> doveadm dsync mirror dsync backup -> doveadm dsync backup dsync server -> doveadm dsync server (for running dsync remotely via ssh/etc.) b) Don't have the dsync prefix: dsync mirror -> doveadm mirror dsync backup -> doveadm backup dsync server -> doveadm dsync-server (could be hidden from the doveadm commands list) c) Either a) or b), but rename "mirror" to "sync" or "dsync" or "replicate"? d) Something else? From japc at co.sapo.pt Thu Dec 29 14:39:11 2011 From: japc at co.sapo.pt (=?ISO-8859-1?Q?Jos=E9?= Celestino) Date: Thu, 29 Dec 2011 12:39:11 +0000 Subject: [Dovecot] imap be killed (core dump disabled) In-Reply-To: <4EFBE755.7090509@gmail.com> References: <4EFBE755.7090509@gmail.com> Message-ID: <1325162351.7270.17.camel@morgoth> On Qui, 2011-12-29 at 12:06 +0800, Dongyu.Zhen wrote: > Hello everybody, > When I modify the dovecot imap source ,in "src/imap/" dir, I meet the > Error below: > Error: child (imap) kill (core dump disabled). > > In fact, I want to record the imap operation through dovecot. So, I > modify every source file in "src/imap/cmd-IMAP_OPERATION" ,when the imap > command function is executed, it will write to a file cur time and > operation. > > Could you tell me why the imap be killed? > When I modified the imap source I had a lot of crashes as I'm sure a lot of people had. Just I wasn't as bossy to ask other people to fix them for me with their crystal ball. Search the dovecot wiki for the maillog plugin, it should do what you want minus the crashes. From tss at iki.fi Thu Dec 29 14:52:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 14:52:06 +0200 Subject: [Dovecot] /usr/lib/dovecot/imap ignores log settings? In-Reply-To: References: Message-ID: On 28.12.2011, at 20.31, Asheesh Laroia wrote: > Hi Dovecot peeps, > > I'm enjoying running /usr/lib/dovecot/imap directly as a PREAUTH IMAP pipe. > > I find that it outputs log messages whose severity is INFO to stdout. I'm running it as follows: > > /usr/lib/dovecot/imap -c /tmp/dovecot.conf > > and I see the following messages output to stdout: stderr actually. > I'd like that message to actually not be printed, which is why I set log_path to syslog. Not possible currently. Either do: /usr/lib/dovecot/imap 2>> ~/imap.log Or patch the source: diff -r 056934abd2ef src/imap/main.c --- a/src/imap/main.c Wed Dec 21 14:40:29 2011 +0200 +++ b/src/imap/main.c Thu Dec 29 14:51:12 2011 +0200 @@ -320,6 +320,7 @@ if (IS_STANDALONE()) { service_flags |= MASTER_SERVICE_FLAG_STANDALONE | + MASTER_SERVICE_FLAG_DONT_LOG_TO_STDERR | MASTER_SERVICE_FLAG_STD_CLIENT; } else { service_flags |= MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN; From p at state-of-mind.de Thu Dec 29 14:53:27 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Thu, 29 Dec 2011 13:53:27 +0100 Subject: [Dovecot] doveadm + dsync merging In-Reply-To: References: Message-ID: <20111229125326.GA2295@state-of-mind.de> * Timo Sirainen : > doveadm already supports some nice things, such as being able to remotely launch a doveadm command via TCP socket. It also supports executing a command for all users or to some specific users using a wildcard. dsync could use these features, so I merged dsync and doveadm into same binary for v2.1. > > I'll still install "dsync" symlink pointing to "doveadm", and running that way it should be fully backwards compatible with the old dsync binary and its parameters. > > I'm mainly now wondering about the command naming for running dsync via doveadm. Any suggestions? > > a) Use "doveadm dsync" prefix, and otherwise keep the names same: > > dsync mirror -> doveadm dsync mirror > dsync backup -> doveadm dsync backup > dsync server -> doveadm dsync server (for running dsync remotely via ssh/etc.) > > b) Don't have the dsync prefix: > > dsync mirror -> doveadm mirror > dsync backup -> doveadm backup > dsync server -> doveadm dsync-server (could be hidden from the doveadm commands list) Calling the old "dsync" command (symlink) directly should keep the already established command structure. Calling dsync features over doveadm should keep command structure as simple (not complex) as possible. I favour b) for that and rename 'mirror' to 'sync'. 'sync' keeps in line with products such as rsync. People will immediately know what it does. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From tss at iki.fi Thu Dec 29 14:55:40 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 14:55:40 +0200 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111224152050.GA3958@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> Message-ID: <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> On 24.12.2011, at 17.20, Jan-Frode Myklebust wrote: > I've just enabled zlib for our users, and am looking at how to compress > the existing files. The routine for doing this at > http://wiki2.dovecot.org/Plugins/Zlib seems a bit complicated. What do > you think about simply doing: > > find /var/vmail -type f -name "*,S=*" -mtime +1 -exec gzip -S Z -6 '{}' + > > > I.e. find all maildir-files: > > - with size in the name ("*,S=*") > - modified before I enabled zlib plugin As long as it doesn't find any already compressed mails.. > - compress them > - add the Z suffix Make sure there's also :2, suffix already. If someone hasn't logged in for a while there are such files in new/ directory. > It's of course racy without the maildirlock, but are there any other > problems with this approach ? Other than being racy, I guess it should work. From stan at hardwarefreak.com Thu Dec 29 15:00:03 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Thu, 29 Dec 2011 07:00:03 -0600 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111229084916.GA5895@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> Message-ID: <4EFC6453.8020304@hardwarefreak.com> On 12/29/2011 2:49 AM, Jan-Frode Myklebust wrote: > On Wed, Dec 28, 2011 at 03:56:33PM -0800, Dovecot-GDH wrote: >> The cleanest (though not necessarily simplest) way to go about this would be to use dsync to create a new maildir and incrementally direct traffic to a separate Dovecot instance. >> >> Unless you have a legacy application that relies on maildir, switching to mdbox would be a good idea too. > > We just got rid of the legacy app that worked directly against the > maildirs, which is the reason we now can turn on compression. I > intend to switch to mdbox, but first I need to free up some disks by > compressing the existing maildirs (12 TB maildirs, should probably > compress down to less than half). How much additional space do you expect the conversion process to compressed mdbox to consume? It shouldn't need much. Using dsync, the conversion will be done one mailbox at a time and the existing emails will be compressed when written into the new mdbox mailbox. After you've converted a few mailboxes by hand and have confirmed you're happy with the results, simply add commands to your bulk conversion script to delete each user maildir and contents after the new mdbox mailbox has been created and populated. Using this method shouldn't require much more additional filesystem space than that equal to your largest single user maildir. Given your 12TB of mailstore, I'd convert users in small batches over a period of weeks or a month, depending on your total mailbox count. Firing up a conversion script and having it run non-stop until all 12TB are converted is probably asking for trouble due to many factors I shouldn't need to put down here. Time your first few manual conversions. Divide that average time into your daily off-peak hours so you know approximately how many mailboxes you can convert during off-peak hours. Run your script daily against these small sets of mailboxes until the entire process is complete. -- Stan From tss at iki.fi Thu Dec 29 15:07:34 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:07:34 +0200 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFC5802.8090609@Media-Brokers.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <4EFC5802.8090609@Media-Brokers.com> Message-ID: On 29.12.2011, at 14.07, Charles Marcus wrote: > It would be cool if the concept of 'Master User' could be expanded on to provide access to only certain other accounts, as opposed to full domains (or maybe it does alreaqdy and I just don't understand it well enough yet). > > For example, we have Sales Assistants in our offices, where each assistant may assist up to 3 or 4 different Sales reps. It would be nice to be able to give the Assistant read-only access to the Sales Reps emails without having to set up shared folders for each one... It's kind of possible, but perhaps not super easy.. Basically you can use %{login_user}, %{login_username} and %{login_domain} variables to figure out if the master user login should be accepted. With SQL you could use these to create a table that has allowed masteruser -> login_username mappings. From tss at iki.fi Thu Dec 29 15:08:35 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:08:35 +0200 Subject: [Dovecot] UIDL format In-Reply-To: References: Message-ID: <058BDAFC-2103-4BFE-9E3B-5179E0E12925@iki.fi> On 28.12.2011, at 0.58, sottilette at rfx.it wrote: > How can be sure of the current POP3 UIDL? If it's not visible, it's the default. Check with: dovecot -a | grep pop3_uidl_format From tss at iki.fi Thu Dec 29 15:10:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:10:20 +0200 Subject: [Dovecot] dsync / separator / namespace config-problem In-Reply-To: <20111229111455.GA9344@dibs.tanso.net> References: <20111229111455.GA9344@dibs.tanso.net> Message-ID: <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> On 29.12.2011, at 13.14, Jan-Frode Myklebust wrote: > Guess I don't quite get namespaces, but we have the following namespace > configured: > > $ doveconf namespace > namespace { > hidden = no > inbox = yes > list = yes > location = > prefix = INBOX. > separator = > subscriptions = yes > type = private > } Since separator is empty, it defaults to whatever the mailbox format's internal separator is. > But when I try running dsync it complains: > > $ sudo -u atmail dsync -u janfrode at tanso.net mirror mdbox:/tmp/janfrodeboks > dsync(atmail): Error: user janfrode at tanso.net: Initialization failed: namespace configuration error: list=yes requires prefix=INBOX. to end with separator dsync(atmail): Fatal: User init failed With mdbox the internal separator is '/', but it's not valid to have "INBOX." prefix then (it should be "INBOX/"). > I can fix this by adding "separator = ." to the namespace and dsync is > happy, but is changing this now safe, or will this affect existing clients? Since you were using Maildir, which uses '.' as the default separator, setting this explicitly won't break anything. From tss at iki.fi Thu Dec 29 15:11:09 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:11:09 +0200 Subject: [Dovecot] Dsync Error Can't Delete Mailbox In-Reply-To: <4EF9E845.4030507@globalchangemusic.org> References: <4EF9E845.4030507@globalchangemusic.org> Message-ID: On 27.12.2011, at 17.46, Asai wrote: > I'm getting this error in the dsync logs: > > Warning: Destination mailbox INBOX has been modified, need to recreate it before we can continue syncing > dsync(foo at bar.org): Error: Can't delete mailbox INBOX: INBOX can't be deleted. > > In this situation, what should I do to remedy the problem? Just delete the backup and rebuild? Yes, that's the only solution currently. From tss at iki.fi Thu Dec 29 15:12:31 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:12:31 +0200 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF826D0.3050005@hardwarefreak.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> <4EF67364.6030003@hardwarefreak.com> <4EF817A5.3030101@lazurit.com> <4EF826D0.3050005@hardwarefreak.com> Message-ID: <0BAAC85A-C73C-413D-9F5E-188AFC5EA40D@iki.fi> On 26.12.2011, at 9.48, Stan Hoeppner wrote: > On 12/26/2011 12:43 AM, Alexander Chekalin wrote: >> I tried to create folder named like 'Old Mail' (and in fact I got >> another mbox container), while I needed to create 'Old Mail/' (note the >> slash), which results in real filesystem directory. > > Oh wow, that is simple. And makes perfect sense. Before my last reply > I read the php IMAP command set definitions/parameters and I didn't see > anything about how to do this, which is an odd omission in > documentation. I guess so few people use mbox these days they omit that > case from the docs. I hit three different sources and none of them > mentioned the trailing slash for creating 'sub-folders-only' folders... That's not PHP-specific, but rather IMAP-specific. It's in RFC 3501. From tss at iki.fi Thu Dec 29 15:15:38 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:15:38 +0200 Subject: [Dovecot] Dovecot imap proxy to nginx, incompatible In-Reply-To: <4EF5124E.7000303@vitalwerks.com> References: <4EF5124E.7000303@vitalwerks.com> Message-ID: <1F6ED1C2-6288-4680-8154-DC581344713B@iki.fi> On 24.12.2011, at 1.44, David Jonas wrote: > It appears that using dovecot to proxy to nginx imap proxy doesn't work. > From tcpdump and browsing the source it appears dovecot sends, > > C CAPABILITY\r\nL LOGIN \r\n > > and nginx only responds to the CAPABILITY command. Is this a problem > with dovecot sending the two commands without waiting for the first to > complete or is it nginx's trouble with not handling it correctly? nginx bug. Dovecot is just being as efficient as it can be. From tss at iki.fi Thu Dec 29 15:18:15 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:18:15 +0200 Subject: [Dovecot] Lucene vs Solr with 2.1 single server In-Reply-To: References: Message-ID: <21140AB9-373B-4E75-B2E5-A848022BD950@iki.fi> On 23.12.2011, at 9.10, Daniel L. Miller wrote: > For a single server, is the Lucene backend now "better" than running a Solr server? Simpler, at least. Probably not better, since Solr uses a newer Lucene engine. From tss at iki.fi Thu Dec 29 15:23:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:23:12 +0200 Subject: [Dovecot] proxying, SSL, and client certificate In-Reply-To: References: Message-ID: On 23.12.2011, at 1.10, Mike Abbott wrote: > How do I configure dovecot-2.0.x to present a client SSL certificate when proxying? Set ssl_client_cert and ssl_client_key settings in dovecot.conf. Requires hg version, since these were added after v2.0.16. > If dovecot on server1.example.com has: > passdb { > driver = static > args = proxy=y host=server2.example.com nopassword=y ssl=yes > } > > and dovecot on server2.example.com has: > ssl_verify_client_cert = yes > auth_ssl_require_client_cert = yes > > then when a client connects to server1 and authenticates, a connection is established to server2 but the SSL handshake fails because server1 doesn't present a client certificate. I don't see where ssl_client_ctx is tied to a client certificate in ssl-proxy-openssl.c. If you want some kind of automatic client certificate forwarding, I don't think that's possible even in theory since the private key is needed. From tss at iki.fi Thu Dec 29 15:31:33 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:31:33 +0200 Subject: [Dovecot] Received date no longer email date? In-Reply-To: <4EF3AD7D.40203@gmail.com> References: <4EF3AD7D.40203@gmail.com> Message-ID: On 23.12.2011, at 0.21, Brian L. Matthews wrote: > I just upgrade from dovecot 1.2 to dovecot 2.0.16. I use dovecot as a local IMAP server to archive email from my corporate email account (on Exchange). I don't have any automated archiving, I just periodically move messages from my Exchange inbox to the IMAP inbox. I'm on Mac OS X 10.6.8 using Entourage as my mail client. > > In the previous version of dovecot, the Received date of the email was preserved when I moved a message, but it's not in 2.0.16, it's set to the date and time I move the message. If I open a message, the date displayed is the date on the message as expected. It should still work the same in Dovecot v2.0. I just tested that giving a timestamp to APPEND command works. Did you also upgrade the IMAP client? Maybe it doesn't add the timestamp anymore. From tss at iki.fi Thu Dec 29 15:35:18 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:35:18 +0200 Subject: [Dovecot] Maildir migration and uids In-Reply-To: <4EF28D7B.8050601@vitalwerks.com> References: <4EF28D7B.8050601@vitalwerks.com> Message-ID: <81E45F76-34A4-4666-9F10-7566B7BD496C@iki.fi> On 22.12.2011, at 3.52, David Jonas wrote: > I'm in the process of migrating a large number of maildirs to a 3rd > party dovecot server (from a dovecot server). Tests have shown that > using imap to sync the accounts doesn't preserve the uidl for pop3 access. > > My current attempt is to convert the maildir to mbox and add an X-UIDL > header in the process. Run a second dovecot that serves the converted > mbox. But dovecot's docs say, "None of these headers are sent to > IMAP/POP3 clients when they read the mail". That's rather complex. > Is there any way to sync these maildirs to the new server and maintain > the uids? What Dovecot versions? dsync could do this easily. You could simply install the dsync binary even if you're using Dovecot v1.x. You could also log in with POP3 and get the UIDL list and write a script to add them to dovecot-uidlist. From janfrode at tanso.net Thu Dec 29 15:36:43 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 14:36:43 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> References: <20111224152050.GA3958@dibs.tanso.net> <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> Message-ID: <20111229133643.GA11809@dibs.tanso.net> On Thu, Dec 29, 2011 at 02:55:40PM +0200, Timo Sirainen wrote: > > > > I.e. find all maildir-files: > > > > - with size in the name ("*,S=*") > > - modified before I enabled zlib plugin > > As long as it doesn't find any already compressed mails.. Can't I trust that no mails with timestamp before I enabled compression are uncompressed? Or will dovecot compress old messages keeping old timestamp when copying messages between folders, or something like that? I want to avoid reading every file to check if it's compressed already, as that will add ages to an already slow process.. > > > - compress them > > - add the Z suffix > > Make sure there's also :2, suffix already. If someone hasn't logged in for a while there are such files in new/ directory. So, find /var/vmail -type f -name "*,S=*:2*" -mtime +6 -exec gzip -S Z -6 '{}' + Right ? I don't care too much if I miss on a few percent of the files.. (I'll probably have to use "-newer /somefile" instead of -mtime since it will run for some days) -jf From janfrode at tanso.net Thu Dec 29 15:42:34 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 14:42:34 +0100 Subject: [Dovecot] dsync / separator / namespace config-problem In-Reply-To: <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> References: <20111229111455.GA9344@dibs.tanso.net> <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> Message-ID: <20111229134234.GB11809@dibs.tanso.net> On Thu, Dec 29, 2011 at 03:10:20PM +0200, Timo Sirainen wrote: > > With mdbox the internal separator is '/', but it's not valid to have "INBOX." prefix then (it should be "INBOX/"). But how should this be handled in the migration phase from maildir to mdbox then? Can we have different namespaces for users with maildirs vs. mdboxes? (..or am i misunderstanding something?) > > > I can fix this by adding "separator = ." to the namespace and dsync is > > happy, but is changing this now safe, or will this affect existing clients? > > Since you were using Maildir, which uses '.' as the default separator, setting this explicitly won't break anything. Great, I'll fix our config then. Thanks! -jf From tss at iki.fi Thu Dec 29 15:48:05 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:48:05 +0200 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111229133643.GA11809@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> <20111229133643.GA11809@dibs.tanso.net> Message-ID: <0A1CC1CE-8C58-47DB-A87D-75FBCF7DF3F8@iki.fi> On 29.12.2011, at 15.36, Jan-Frode Myklebust wrote: > On Thu, Dec 29, 2011 at 02:55:40PM +0200, Timo Sirainen wrote: >>> >>> I.e. find all maildir-files: >>> >>> - with size in the name ("*,S=*") >>> - modified before I enabled zlib plugin >> >> As long as it doesn't find any already compressed mails.. > > Can't I trust that no mails with timestamp before I enabled compression > are uncompressed? Or will dovecot compress old messages keeping old > timestamp when copying messages between folders, or something like that? It's possible that a user saves a mail with an old IMAP INTERNALDATE (=file's mtime), which is already compressed. You could use ctime, but that could skip mails whose flags have been changed since compression. > I want to avoid reading every file to check if it's compressed > already, as that will add ages to an already slow process.. You could use mtime, and just before compressing the mail check if it's already compressed. That won't add much overhead. >>> - compress them >>> - add the Z suffix >> >> Make sure there's also :2, suffix already. If someone hasn't logged in for a while there are such files in new/ directory. > > So, > find /var/vmail -type f -name "*,S=*:2*" -mtime +6 -exec gzip -S Z -6 '{}' + > > > Right ? I don't care too much if I miss on a few percent of the files.. Yes. From tss at iki.fi Thu Dec 29 15:49:57 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:49:57 +0200 Subject: [Dovecot] dsync / separator / namespace config-problem In-Reply-To: <20111229134234.GB11809@dibs.tanso.net> References: <20111229111455.GA9344@dibs.tanso.net> <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> <20111229134234.GB11809@dibs.tanso.net> Message-ID: On 29.12.2011, at 15.42, Jan-Frode Myklebust wrote: > On Thu, Dec 29, 2011 at 03:10:20PM +0200, Timo Sirainen wrote: >> >> With mdbox the internal separator is '/', but it's not valid to have "INBOX." prefix then (it should be "INBOX/"). > > But how should this be handled in the migration phase from maildir to > mdbox then? Can we have different namespaces for users with maildirs vs. > mdboxes? (..or am i misunderstanding something?) You'll most likely want to keep the '.' separator with mdbox, at least initially. Some clients don't like if the separator changes. Perhaps in future if you want to allow users to use '.' character in mailbox names you could change it, or possibly make it a per-user setting. From janfrode at tanso.net Thu Dec 29 16:14:39 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 15:14:39 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <0A1CC1CE-8C58-47DB-A87D-75FBCF7DF3F8@iki.fi> References: <20111224152050.GA3958@dibs.tanso.net> <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> <20111229133643.GA11809@dibs.tanso.net> <0A1CC1CE-8C58-47DB-A87D-75FBCF7DF3F8@iki.fi> Message-ID: <20111229141439.GA12567@dibs.tanso.net> On Thu, Dec 29, 2011 at 03:48:05PM +0200, Timo Sirainen wrote: > > > > Can't I trust that no mails with timestamp before I enabled compression > > are uncompressed? Or will dovecot compress old messages keeping old > > timestamp when copying messages between folders, or something like that? > > It's possible that a user saves a mail with an old IMAP INTERNALDATE (=file's mtime), which is already compressed. You could use ctime, but that could skip mails whose flags have been changed since compression. Ok, if ctime is safer I think I'll use that and not worry too much about missing some messages. > > > I want to avoid reading every file to check if it's compressed > > already, as that will add ages to an already slow process.. > > You could use mtime, and just before compressing the mail check if it's already compressed. That won't add much overhead. Ah, right.. I'll have to read the messages from disk anyway, so checking if they're compressed or not doesn't add much. So mtime + compression-check is what I'll need to do then. -jf From user+dovecot at localhost.localdomain.org Thu Dec 29 16:19:28 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Thu, 29 Dec 2011 15:19:28 +0100 Subject: [Dovecot] doveadm + dsync merging In-Reply-To: <20111229125326.GA2295@state-of-mind.de> References: <20111229125326.GA2295@state-of-mind.de> Message-ID: <4EFC76F0.2050705@localhost.localdomain.org> On 12/29/2011 01:53 PM Patrick Ben Koetter wrote: > * Timo Sirainen : >> ? >> a) Use "doveadm dsync" prefix, and otherwise keep the names same: >> >> dsync mirror -> doveadm dsync mirror >> dsync backup -> doveadm dsync backup >> dsync server -> doveadm dsync server (for running dsync remotely via ssh/etc.) >> >> b) Don't have the dsync prefix: >> >> dsync mirror -> doveadm mirror >> dsync backup -> doveadm backup >> dsync server -> doveadm dsync-server (could be hidden from the doveadm commands list) > > Calling the old "dsync" command (symlink) directly should keep the already > established command structure. > > Calling dsync features over doveadm should keep command structure as simple > (not complex) as possible. I favour b) for that and rename 'mirror' to 'sync'. > > 'sync' keeps in line with products such as rsync. People will immediately know > what it does. I'd prefer doveadm commands with the dsync prefix. (a)) Because: * doveadm already has other 'command groups' like mailbox, director ? * that's the way to avoid command clashes (w/o hiding anything) Renaming 'mirror' to 'sync' could be helpful ? Regards, Pascal -- The trapper recommends today: cafebabe.1136315 at localdomain.org From asai at globalchangemusic.org Thu Dec 29 17:51:14 2011 From: asai at globalchangemusic.org (Asai) Date: Thu, 29 Dec 2011 08:51:14 -0700 Subject: [Dovecot] Dsync Error Can't Delete Mailbox In-Reply-To: References: <4EF9E845.4030507@globalchangemusic.org> Message-ID: <4EFC8C72.4000900@globalchangemusic.org> OK, thank you very much for this wonderful application. --asai On 12/29/2011 6:11 AM, Timo Sirainen wrote: > On 27.12.2011, at 17.46, Asai wrote: > >> I'm getting this error in the dsync logs: >> >> Warning: Destination mailbox INBOX has been modified, need to recreate it before we can continue syncing >> dsync(foo at bar.org): Error: Can't delete mailbox INBOX: INBOX can't be deleted. >> >> In this situation, what should I do to remedy the problem? Just delete the backup and rebuild? > Yes, that's the only solution currently. > From gedalya at gedalya.net Thu Dec 29 19:23:27 2011 From: gedalya at gedalya.net (Gedalya) Date: Thu, 29 Dec 2011 12:23:27 -0500 Subject: [Dovecot] Trouble with proxy_maybe and auth_default_realm Message-ID: <4EFCA20F.10107@gedalya.net> Hello, I'm using proxy_maybe and auth_default_realm. It seems that when a user logs in without the domain name, relying on auth_default_realm, and the "host" field points to the local server, I get the Proxying loops to itself error. It does work as expected - log on to the local server without proxying, if the user does include the domain name in the login. (IP's and domain name masked below) No domain: Dec 29 11:49:07 imap01 dovecot: pop3-login: Error: Proxying loops to itself: user=, method=PLAIN, rip=00.00.52.18, lip=00.00.241.140 Dec 29 11:49:27 imap01 dovecot: pop3-login: Disconnected (auth failed, 1 attempts): user=, method=PLAIN, rip=00.00.52.18, lip=00.00.241.140 With domain: Dec 29 11:52:13 imap01 dovecot: pop3-login: Login: user=, method=PLAIN, rip=00.00.52.18, lip=00.00.241.140, mpid=19969 Dec 29 11:52:18 imap01 dovecot: pop3(jedi at ---.com): Disconnected: Logged out top=0/0, retr=0/0, del=0/1, size=731 Otherwise, e.g. when the proxy host is indeed another host, auth_default_domain works fine, including or not including the domain seems to make no difference, and everything works. I'm using mysql, and I'm able to get around this problem including the following in the password query: IF(host='' or host='00.00.241.140', NULL, 'Y') as proxy_maybe # dovecot --version 2.0.15 # dovecot -n # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 auth_default_realm = ----.com auth_mechanisms = plain login cram-md5 ntlm auth_username_format = %Lu auth_verbose = yes auth_verbose_passwords = plain dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no login_greeting = How can I help you? mail_gid = vmail mail_uid = vmail passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = imap pop3 lmtp service lmtp { inet_listener lmtp { address = 0.0.0.0 port = 7025 } } ssl_cert = References: Message-ID: On Thu, 29 Dec 2011, Timo Sirainen wrote: > On 28.12.2011, at 20.31, Asheesh Laroia wrote: > >> Hi Dovecot peeps, >> >> I'm enjoying running /usr/lib/dovecot/imap directly as a PREAUTH IMAP pipe. >> >> I find that it outputs log messages whose severity is INFO to stdout. I'm running it as follows: >> >> /usr/lib/dovecot/imap -c /tmp/dovecot.conf >> >> and I see the following messages output to stdout: > > stderr actually. Right. Thanks for that; I saw it was file descriptor 2 in the strace after I hit send. >> I'd like that message to actually not be printed, which is why I set log_path to syslog. > > Not possible currently. Either do: > > /usr/lib/dovecot/imap 2>> ~/imap.log > > Or patch the source: [snip] Great! That should be okay for now. -- Asheesh. From bra at fsn.hu Thu Dec 29 21:59:35 2011 From: bra at fsn.hu (Attila Nagy) Date: Thu, 29 Dec 2011 20:59:35 +0100 Subject: [Dovecot] doveadm + dsync merging In-Reply-To: References: Message-ID: <4EFCC6A7.1060406@fsn.hu> Hi, On 12/29/2011 01:35 PM, Timo Sirainen wrote: > doveadm already supports some nice things, such as being able to remotely launch a doveadm command via TCP socket. It also supports executing a command for all users or to some specific users using a wildcard. dsync could use these features, so I merged dsync and doveadm into same binary for v2.1. > > I'll still install "dsync" symlink pointing to "doveadm", and running that way it should be fully backwards compatible with the old dsync binary and its parameters. > > I'm mainly now wondering about the command naming for running dsync via doveadm. Any suggestions? > > a) Use "doveadm dsync" prefix, and otherwise keep the names same: > > dsync mirror -> doveadm dsync mirror > dsync backup -> doveadm dsync backup > dsync server -> doveadm dsync server (for running dsync remotely via ssh/etc.) > > b) Don't have the dsync prefix: > > dsync mirror -> doveadm mirror > dsync backup -> doveadm backup > dsync server -> doveadm dsync-server (could be hidden from the doveadm commands list) > > c) Either a) or b), but rename "mirror" to "sync" or "dsync" or "replicate"? > > d) Something else? > Slightly different, but it would be good to have a persistently running daemon which could operate both in server and client mode. In server mode it would listen on a TCP socket. In client mode it would accept source and target information via a control socket. The target IP address and port would be the daemon's listening socket. Something like this on the server side: service dsync { process_limit = 8 client_limit = 8 inet_listener dsync { port = 5555 } Then doveadm sync on the "client) could first connect to the local server (client), which then connects to the remote service on the server. Eg.: doveadm sync [-C ] [-m ] [-u ] [-frRv] mirror | [@] where user at host should specify the remote user (mailbox user) and host should read like 1.1.1.1:1234 (IP address|hostname and port where the dsync service listens. Or a separate port option to allow easier parsing. Having the client in a persistent setup would allow faster syncs for repeated invocations. It would be good to have a simple API to trigger the sync (a simple text protocol on a unix socket, or something) from outside programs, to avoid calling doveadm. The next thing would be to follow dovecot logs and do a sync/async replication. :) From janfrode at tanso.net Thu Dec 29 22:03:45 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 21:03:45 +0100 Subject: [Dovecot] dsync / separator / namespace config-problem In-Reply-To: References: <20111229111455.GA9344@dibs.tanso.net> <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> <20111229134234.GB11809@dibs.tanso.net> Message-ID: <20111229200345.GA17871@dibs.tanso.net> On Thu, Dec 29, 2011 at 03:49:57PM +0200, Timo Sirainen wrote: > >> > >> With mdbox the internal separator is '/', but it's not valid to have "INBOX." prefix then (it should be "INBOX/"). > > > > But how should this be handled in the migration phase from maildir to > > mdbox then? Can we have different namespaces for users with maildirs vs. > > mdboxes? (..or am i misunderstanding something?) > > You'll most likely want to keep the '.' separator with mdbox, at least initially. Some clients don't like if the separator changes. Perhaps in future if you want to allow users to use '.' character in mailbox names you could change it, or possibly make it a per-user setting. > Sorry for being so dense, but I don't quite get it still. Do you suggest dropping the trailing dot from prefix=INBOX. ? I.e. namespace { inbox = yes location = prefix = INBOX type = private separator = . } when we do the migration to mdbox? And this should work without issues for both current maildir users, and mdbox users ? Ideally I don't want to use the . as a separator, since it's causing problems for our users who expect to be able to use them in folder names. But I don't understand if I can change them without causing problems to existing users.. or how these problems will appear to the users. -jf From david at electric-spoon.com Thu Dec 29 23:54:57 2011 From: david at electric-spoon.com (David Pottage) Date: Thu, 29 Dec 2011 21:54:57 +0000 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFB9438.7090608@hardwarefreak.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <4EFB9438.7090608@hardwarefreak.com> Message-ID: <4EFCE1B1.9060704@electric-spoon.com> On 28/12/11 22:12, Stan Hoeppner wrote: > It's a smart phone. Have you considering simply running a webmail server? I considered it for about 10 seconds. Webmail is much less efficent than IMAP both for the server and the client. I run SquirrelMail on (on Apache) my server, and it consumes far more CPU and RAM than Dovecot. It is also much slower in most operations compared with IMAP. Though I have not measured it, I suspect the bandwidth consumption is much higher because of HTML mark-up and images. In any case, webmail would not solve the problem of too many folders being displayed. I would get just as long a list, with a hard to use scrollbar, but rendered as html instead of in a menu. -- David Pottage From david at electric-spoon.com Fri Dec 30 00:02:09 2011 From: david at electric-spoon.com (David Pottage) Date: Thu, 29 Dec 2011 22:02:09 +0000 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> Message-ID: <4EFCE361.6030104@electric-spoon.com> On 28/12/11 22:21, Rick Romero wrote: > > Quoting David Pottage : >> Firstly I wanted to retain the option to switch to the full version of >> my mail folders if I needed to access something urgently. My smart-phone >> based email client allows me to change the port number of an existing >> email account, but will not allow me to change the user-name without >> creating a whole new account and re-downloading everything. > > I read back through the thread, and I don't see why you're not using > IMAP subscriptions - did I overlook it? > If you mean subscriptions on the smartphone client, I was not using them because the first IMAP client I was using (native email on a Palm Pre) did not support them. I have since switched to an Android phone and started using K9, but I still find it helpful to filter the list of folders that that K9 sees as I don't want a huge list with an unmanageable scrollbar, and many of the folders are archive folders that will never contain anything current, so it makes no sense to make them accessible except through a desktop client. I am not saying my solution is the only possible solution but I do think it is worth recording in the Wiki as others may find my approach useful. -- David Pottage From knute2011 at knutejohnson.com Fri Dec 30 01:57:23 2011 From: knute2011 at knutejohnson.com (Knute Johnson) Date: Thu, 29 Dec 2011 15:57:23 -0800 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFCE361.6030104@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> <4EFCE361.6030104@electric-spoon.com> Message-ID: <4EFCFE63.3000804@knutejohnson.com> On 12/29/2011 2:02 PM, David Pottage wrote: > On 28/12/11 22:21, Rick Romero wrote: >> >> Quoting David Pottage: >>> Firstly I wanted to retain the option to switch to the full version of >>> my mail folders if I needed to access something urgently. My smart-phone >>> based email client allows me to change the port number of an existing >>> email account, but will not allow me to change the user-name without >>> creating a whole new account and re-downloading everything. >> >> I read back through the thread, and I don't see why you're not using >> IMAP subscriptions - did I overlook it? >> > If you mean subscriptions on the smartphone client, I was not using them > because the first IMAP client I was using (native email on a Palm Pre) > did not support them. > > I have since switched to an Android phone and started using K9, but I > still find it helpful to filter the list of folders that that K9 sees as > I don't want a huge list with an unmanageable scrollbar, and many of the > folders are archive folders that will never contain anything current, so > it makes no sense to make them accessible except through a desktop client. > > I am not saying my solution is the only possible solution but I do think > it is worth recording in the Wiki as others may find my approach useful. > My wife has an Android phone running K-9 and she is able to not display most of the hundreds of folders that she has. I haven't seen any drawbacks to that technique on her phone. Well maybe if she got rid of about a 1000 emails out of her INBOX it would help :-). -- Knute Johnson knute2011 at knutejohnson.com From dovecot at knutejohnson.com Fri Dec 30 01:58:01 2011 From: dovecot at knutejohnson.com (Knute Johnson) Date: Thu, 29 Dec 2011 15:58:01 -0800 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFCE361.6030104@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> <4EFCE361.6030104@electric-spoon.com> Message-ID: <4EFCFE89.1030703@knutejohnson.com> On 12/29/2011 2:02 PM, David Pottage wrote: > On 28/12/11 22:21, Rick Romero wrote: >> >> Quoting David Pottage: >>> Firstly I wanted to retain the option to switch to the full version of >>> my mail folders if I needed to access something urgently. My smart-phone >>> based email client allows me to change the port number of an existing >>> email account, but will not allow me to change the user-name without >>> creating a whole new account and re-downloading everything. >> >> I read back through the thread, and I don't see why you're not using >> IMAP subscriptions - did I overlook it? >> > If you mean subscriptions on the smartphone client, I was not using them > because the first IMAP client I was using (native email on a Palm Pre) > did not support them. > > I have since switched to an Android phone and started using K9, but I > still find it helpful to filter the list of folders that that K9 sees as > I don't want a huge list with an unmanageable scrollbar, and many of the > folders are archive folders that will never contain anything current, so > it makes no sense to make them accessible except through a desktop client. > > I am not saying my solution is the only possible solution but I do think > it is worth recording in the Wiki as others may find my approach useful. > My wife has an Android phone running K-9 and she is able to not display most of the hundreds of folders that she has. I haven't seen any drawbacks to that technique on her phone. Well maybe if she got rid of about a 1000 emails out of her INBOX it would help . -- Knute Johnson From bill+dovecot at blunn.org Fri Dec 30 04:31:54 2011 From: bill+dovecot at blunn.org (William Blunn) Date: Fri, 30 Dec 2011 02:31:54 +0000 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF5A9EC.8090606@hardwarefreak.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> Message-ID: <4EFD229A.9080803@blunn.org> On 24/12/2011 10:31, Stan Hoeppner wrote: > With mbox storage, an IMAP FOLDER contains only sub folders or it contains only messages. It CANNOT contain BOTH. Dovecot can store both folders and messages in a folder, under mbox. See http://wiki2.dovecot.org/MboxChildFolders Bill From bill+dovecot at blunn.org Fri Dec 30 05:10:20 2011 From: bill+dovecot at blunn.org (William Blunn) Date: Fri, 30 Dec 2011 03:10:20 +0000 Subject: [Dovecot] Upgrade/Migration In-Reply-To: References: Message-ID: <4EFD2B9C.4050907@blunn.org> On 23/12/2011 19:20, sottilette at rfx.it wrote: > New box (supposed): CentOS 6.x (32/64 bit ? ), dovecot 2.04, mbox format > > Any hints/comment appreciated ;-) Don't use Dovecot 2.0.4, even if your distro tries to tempt you into doing so by including such a version. Whilst it looks like a stable version number, there were a number of issues with early Dovecot 2.0.x. Instead use 2.0.latest. Starting from http://www.dovecot.org/download.html you could find http://packages.atrpms.net/dist/el6/dovecot/ which provides 32- and 64-bit RPMs of Dovecot 2.0.16. Bill From bill at blunn.org Fri Dec 30 05:34:02 2011 From: bill at blunn.org (William Blunn) Date: Fri, 30 Dec 2011 03:34:02 +0000 Subject: [Dovecot] Using Amazon S3 storage for Maildir ? In-Reply-To: References: <4EEF75C4.9040005@gmail.com> Message-ID: <4EFD312A.2070706@blunn.org> On 20/12/2011 05:29, Timo Sirainen wrote: > On 19.12.2011, at 19.35, Forrest Aldrich wrote: > >> I wonder if anyone has tried using an IMAP server with Amazon S3 as a backend. There would be many factors to consider (speed, etc). However, moreso, I don't know that Maildir(++) would support multiple folders that might be linked into the cloud. For example, higher-I/O local incoming mail is on disk, some folders archived on S3. Could be easily done by simply creating another account and storing its Maildir in S3 -- > Maybe [sm]dbox with alt storage set to S3? http://wiki2.dovecot.org/MailboxFormat/dbox#Alternate_storage Also consider using the S3QL ( http://code.google.com/p/s3ql/ ) filesystem, which stores files chunked on the backend (e.g. Amazon S3). This ought to work well for dbox alternate storage, and archived mbox mail (though it may be worth arranging for indexes to be stored locally). Bill From janfrode at tanso.net Fri Dec 30 10:44:07 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 30 Dec 2011 09:44:07 +0100 Subject: [Dovecot] doveadm + dsync merging In-Reply-To: <4EFCC6A7.1060406@fsn.hu> References: <4EFCC6A7.1060406@fsn.hu> Message-ID: <20111230084407.GA30568@dibs.tanso.net> On Thu, Dec 29, 2011 at 08:59:35PM +0100, Attila Nagy wrote: > > > Slightly different, but it would be good to have a persistently > running daemon which could operate both in server and client mode. > In server mode it would listen on a TCP socket. In client mode it > would accept source and target information via a control socket. The > target IP address and port would be the daemon's listening socket. > Great idea! > > The next thing would be to follow dovecot logs and do a sync/async > replication. :) It's not too hard to do async already.. If you have last-login tracking in the post-login scripts, you can use this to know which users to trigger async backups for every X minute. -jf From janfrode at tanso.net Fri Dec 30 11:00:53 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 30 Dec 2011 10:00:53 +0100 Subject: [Dovecot] lmtp-postlogin ? Message-ID: <20111230090053.GA30820@dibs.tanso.net> We have last-login tracking for imap and pop, and I intend to use this for deciding which users to backup daily. But, it would also be nice to backup users who has only received messages, but not logged in lately.. So is it possible to implement "last-login" tracking for lmtp ? I naively tried copying the settings from imap, but it didn't work: service lmtp-postlogin { executable = script-login /usr/local/sbin/lmtp-postlogin.sh unix_listener lmtp-postlogin { } } service lmtp { executable = lmtp lmtp-postlogin -jf From stan at hardwarefreak.com Fri Dec 30 13:53:58 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 30 Dec 2011 05:53:58 -0600 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EFD229A.9080803@blunn.org> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <4EFD229A.9080803@blunn.org> Message-ID: <4EFDA656.9040903@hardwarefreak.com> On 12/29/2011 8:31 PM, William Blunn wrote: > On 24/12/2011 10:31, Stan Hoeppner wrote: >> With mbox storage, an IMAP FOLDER contains only sub folders or it >> contains only messages. It CANNOT contain BOTH. > > Dovecot can store both folders and messages in a folder, under mbox. > > See http://wiki2.dovecot.org/MboxChildFolders Not by default, and not without potential headaches. I'm still waiting to see someone post here that they're using this setup in a production environment, and that it works seamlessly with XYZ IMAP clients, backup software, current custom scripts without requiring a rewrite, etc. mbox capability in this regard hasn't changed for some 15-20 years until Timo suggested this with Dovecot. The capability may exist, but until I see that it is being used successfully in production environments, I'm going to continue stating the standard mbox capability. To do otherwise at this point will only serve to confuse people. -- Stan From tss at iki.fi Fri Dec 30 14:03:34 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 30 Dec 2011 14:03:34 +0200 Subject: [Dovecot] lmtp-postlogin ? In-Reply-To: <20111230090053.GA30820@dibs.tanso.net> References: <20111230090053.GA30820@dibs.tanso.net> Message-ID: <16B30E6C-AE5E-44CB-8F48-66274FEAB357@iki.fi> On 30.12.2011, at 11.00, Jan-Frode Myklebust wrote: > We have last-login tracking for imap and pop, and I intend to use this > for deciding which users to backup daily. But, it would also be nice to > backup users who has only received messages, but not logged in lately.. > So is it possible to implement "last-login" tracking for lmtp ? LMTP supports authentication, but Dovecot doesn't support it. And you most likely didn't mean that anyway. So, when would it be executed? When client connects? After each RCPT TO? After DATA? Maybe create a new plugin for this using notify plugin. From janfrode at tanso.net Fri Dec 30 15:08:04 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 30 Dec 2011 14:08:04 +0100 Subject: [Dovecot] lmtp-postlogin ? In-Reply-To: <16B30E6C-AE5E-44CB-8F48-66274FEAB357@iki.fi> References: <20111230090053.GA30820@dibs.tanso.net> <16B30E6C-AE5E-44CB-8F48-66274FEAB357@iki.fi> Message-ID: <20111230130804.GA2107@dibs.tanso.net> On Fri, Dec 30, 2011 at 02:03:34PM +0200, Timo Sirainen wrote: > > LMTP supports authentication, but Dovecot doesn't support it. And you most likely didn't mean that anyway. Yes, I know.. > So, when would it be executed? When client connects? After each RCPT TO? After DATA? For my async backup-purposes any time after RCPT TO would be fine. I just want to know which users has received any message the last X hours. But i guess the ideal place would be at the time lmtp logs that it's saved a message to a mailbox. Guess a workaround is to grep for these in the log. > Maybe create a new plugin for this using notify plugin. Is there any documentation for this plugin? I've tried searching both this list, and the wiki's. -jf From janfrode at tanso.net Fri Dec 30 16:41:24 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 30 Dec 2011 15:41:24 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <4EFC6453.8020304@hardwarefreak.com> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> <4EFC6453.8020304@hardwarefreak.com> Message-ID: <20111230144124.GA3936@dibs.tanso.net> On Thu, Dec 29, 2011 at 07:00:03AM -0600, Stan Hoeppner wrote: > > We just got rid of the legacy app that worked directly against the > > maildirs, which is the reason we now can turn on compression. I > > intend to switch to mdbox, but first I need to free up some disks by > > compressing the existing maildirs (12 TB maildirs, should probably > > compress down to less than half). > > How much additional space do you expect the conversion process to > compressed mdbox to consume? Somewhere around 1/3 of the current usage, I expect.. > It shouldn't need much. Using dsync, the > conversion will be done one mailbox at a time and the existing emails > will be compressed when written into the new mdbox mailbox. Yes, I know, but I intend to do more than just convert to mdbox. I want to fix the whole folder structure*, in a new filesystem with different settings (turn on metadata-replication, and possibly also data replication). So I need to free up some disks before this can start. [*] move away from @Mails /atmail/a/b/abuser at domain folder structure to mdbox:/srv/mailbackup/%256Hu/%d/%n, stop having home=inbox, possibly use many smaller fs's instead of one huge, move the indexes inside home... -jf From qmailcalvin at gmail.com Fri Dec 30 20:53:00 2011 From: qmailcalvin at gmail.com (Calvin Cochran) Date: Fri, 30 Dec 2011 10:53:00 -0800 Subject: [Dovecot] imap process limits problem Message-ID: I am having a problem with the number of current processes that I cannot seem to diagnose adequately, and is a possible bug. This will be a bit long, but usually more info is better. I am running dovecot 2.0.16 on a CentOS 5 x86_64 server with the mailstore on gfs (output from dovecot -n at bottom). This is an imap issue. This is mostly to do with one client, but none of my tests indicate an issue with the client side. We have mail_max_userip_connections = 10 for imap, but they are not hitting the limit. We also have verbose_proctitle = yes to help in diagnosing the situation. Most of our clients, including this one, use SSL or TLS and connect on 993. As I understand it, that should have an imap-login process and an imap process per authenticated session. Based on some other diagnosis the client seems to have a PC using Outlook 2010 and an i-device (phone or pad, not sure), both on the office network, and both with imap connections to the server. Based on my analysis it seems like the client is connecting, authenticating, and then closing the session, but the imap-login process does not drop until it times out server side (I don't know a way to tell which device, the PC or i???). One odd thing is that the tcp sessions time out at 2 hours and 11 minutes (this is where the possible bug aspect comes in). I have put a strace on the process, and there does not appear to be any traffic, so I don't understand why the 30 min timeout isn't happening. Based on netstat and verbose_proctitle, at this moment there are 99 connections from the IP in question, all of which show in ps output as: dovecot/imap-login [1 connections (1 TLS)] My understanding is that means they have successfully authenticated, and that there should be line with dovecot/imap [username ip TLS] in ps output, but there isn't, so I am taking that to mean the client closed the imap session. The client ip address puts them on comcast (tcp resets?) and we do have a load balancer in front of two servers, just to add a little challenge to the diagnosis fun. The short term fix has been to increase the process limits. However, it is clearly not a workable solution to increase the limits by 100 every time someone starts accessing the server with their new i??? device. I appreciate your thoughts on this, and I am happy to provide additional useful debug info if I have missed something. Thanks, Calvin output from dovecot -n auth_mechanisms = plain apop cram-md5 auth_verbose = yes auth_verbose_passwords = plain auth_worker_max_count = 400 default_process_limit = 400 disable_plaintext_auth = no first_valid_uid = 89 last_valid_uid = 89 login_greeting = EMCS ready. mail_fsync = never maildir_very_dirty_syncs = yes mmap_disable = yes passdb { driver = vpopmail } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_log_group_events = no } protocols = imap pop3 shutdown_clients = no ssl_cert = References: <4EFD2B9C.4050907@blunn.org> Message-ID: On Fri, 30 Dec 2011, William Blunn wrote: >> New box (supposed): CentOS 6.x (32/64 bit ? ), dovecot 2.04, mbox format >> >> Any hints/comment appreciated ;-) > > Don't use Dovecot 2.0.4, even if your distro tries to tempt you into doing so > by including such a version. > > Whilst it looks like a stable version number, there were a number of issues > with early Dovecot 2.0.x. > > Instead use 2.0.latest. Are there relevant difference between 2.0.4 and 2.0.16 config? > Starting from http://www.dovecot.org/download.html you could find > > http://packages.atrpms.net/dist/el6/dovecot/ > > which provides 32- and 64-bit RPMs of Dovecot 2.0.16. Started upgrading old box. - backup data and conf, downloaded old rpm for emergengy - rpm -Uvh dovecot-2.0.16-1_132.el4.i386.rpm - changed some config settings so I can start the daemon ... - seems to work. ;-) There is a way to test it intensively before users do it for me? ;-) Happy new year to all ;-) Thanks, P. From stan at hardwarefreak.com Sat Dec 31 02:38:28 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 30 Dec 2011 18:38:28 -0600 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111230144124.GA3936@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> <4EFC6453.8020304@hardwarefreak.com> <20111230144124.GA3936@dibs.tanso.net> Message-ID: <4EFE5984.9080905@hardwarefreak.com> On 12/30/2011 8:41 AM, Jan-Frode Myklebust wrote: > On Thu, Dec 29, 2011 at 07:00:03AM -0600, Stan Hoeppner wrote: >>> We just got rid of the legacy app that worked directly against the >>> maildirs, which is the reason we now can turn on compression. I >>> intend to switch to mdbox, but first I need to free up some disks by >>> compressing the existing maildirs (12 TB maildirs, should probably >>> compress down to less than half). >> >> How much additional space do you expect the conversion process to >> compressed mdbox to consume? > > Somewhere around 1/3 of the current usage, I expect.. > >> It shouldn't need much. Using dsync, the >> conversion will be done one mailbox at a time and the existing emails >> will be compressed when written into the new mdbox mailbox. > > Yes, I know, but I intend to do more than just convert to mdbox. I want > to fix the whole folder structure*, in a new filesystem with different > settings (turn on metadata-replication, and possibly also data > replication). So I need to free up some disks before this can start. > > [*] move away from @Mails /atmail/a/b/abuser at domain folder structure to > mdbox:/srv/mailbackup/%256Hu/%d/%n, stop having home=inbox, > possibly use many smaller fs's instead of one huge, move the indexes > inside home... Roger that. Good strategy. You using SAN storage or local RAID? What filesystem do you plan to use for the new mailbox location? What OS is the Dovecot host? Lastly, how many users you have? Sorry for prying, I'm always really curious about system details when someone states they have 12TB of mailbox data. ;) -- Stan From stan at hardwarefreak.com Sat Dec 31 03:20:39 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 30 Dec 2011 19:20:39 -0600 Subject: [Dovecot] imap process limits problem In-Reply-To: References: Message-ID: <4EFE6367.5000408@hardwarefreak.com> On 12/30/2011 12:53 PM, Calvin Cochran wrote: > I am having a problem with the number of current processes that I cannot > seem to diagnose adequately, and is a possible bug. This will be a bit > long, but usually more info is better. Usually. :) > I am running dovecot 2.0.16 on a CentOS 5 x86_64 server with the mailstore > on gfs (output from dovecot -n at bottom). This is an imap issue. This is > mostly to do with one client, but none of my tests indicate an issue with > the client side. We have > mail_max_userip_connections = 10 > for imap, but they are not hitting the limit. Not going over 10 connection limit. > We also have > verbose_proctitle = yes > to help in diagnosing the situation. Most of our clients, including this > one, use SSL or TLS and connect on 993. As I understand it, that should > have an imap-login process and an imap process per authenticated session. > Based on some other diagnosis the client seems to have a PC using Outlook > 2010 and an i-device (phone or pad, not sure), both on the office network, Both on office network. > and both with imap connections to the server. Based on my analysis it > seems like the client is connecting, authenticating, and then closing the > session, but the imap-login process does not drop until it times out server > side (I don't know a way to tell which device, the PC or i???). One odd > thing is that the tcp sessions time out at 2 hours and 11 minutes (this is > where the possible bug aspect comes in). I have put a strace on the > process, and there does not appear to be any traffic, so I don't understand > why the 30 min timeout isn't happening. Based on netstat and > verbose_proctitle, at this moment there are 99 connections from the IP in 99 connections from that IP. This is a discrepancy from what you state above, and suggests you are going over the limit. Thus why isn't the 10 connection limit kicking in? > question, all of which show in ps output as: > dovecot/imap-login [1 connections (1 TLS)] > My understanding is that means they have successfully authenticated, and > that there should be line with > dovecot/imap [username ip TLS] > in ps output, but there isn't, so I am taking that to mean the client > closed the imap session. > The client ip address puts them on comcast (tcp resets?) First on office net, now on Comcast. This is a discrepancy. Are we dealing with two issues, or two different users here? > and we do have a > load balancer in front of two servers, just to add a little challenge to > the diagnosis fun. Yay. Which load balancer? Have you removed it from the IMAP loop to eliminate it as a possible cause? > The short term fix has been to increase the process limits. However, it is > clearly not a workable solution to increase the limits by 100 every time > someone starts accessing the server with their new i??? device. > I appreciate your thoughts on this, and I am happy to provide additional > useful debug info if I have missed something. 99 login connections would suggest malware, broken IMAP client software, many multiple client devices behind a NAT all logging in with the same credentials, a load balancer problem, or a combination of these. Unfortunately, with this many variables, the first 3 of which you have no direct control over or even verifiable knowledge of, troubleshooting this may prove difficult. Just out of curiosity, have you tried the non one-login-process-per-connection setup? login_process_size = 64 login_process_per_connection = yes login_processes_count = 3 login_max_processes_count = 128 login_max_connections = 256 Season values to taste. -- Stan From dovecot at r.paypc.com Sat Dec 31 04:21:41 2011 From: dovecot at r.paypc.com (Robin) Date: Fri, 30 Dec 2011 18:21:41 -0800 Subject: [Dovecot] imap process limits problem In-Reply-To: References: Message-ID: <4EFE71B5.3050103@r.paypc.com> On 12/30/2011 10:53 AM, Calvin Cochran wrote: > I am having a problem with the number of current processes that I cannot > seem to diagnose adequately, and is a possible bug. This will be a bit > long, but usually more info is better. > [....] > verbose_proctitle, at this moment there are 99 connections from the IP in > question, all of which show in ps output as: > dovecot/imap-login [1 connections (1 TLS)] > My understanding is that means they have successfully authenticated, and > that there should be line with > dovecot/imap [username ip TLS] > in ps output, but there isn't, so I am taking that to mean the client > closed the imap session. This sounds like yet another round of buggy clients that just abruptly dump connections instead of closing them down properly, or some intervening firewalling configuration that's preventing the proper signoff and TCP FIN handshakes from completing. The 2 hours+ sounds like these sockets (and the processes that used them) might be stuck in FIN_WAIT1, which isn't affected by the timeout specified in /proc/sys/net/ipv4/tcp_fin_timeout Use netstat -a these connections to see their disposition You can try some of the following: 1) Lower tcp_keepalive intervals and reduce the # of probes before a "kill" - does Dovecot make use of SO_KEEPALIVE, or can it be configured to do so? 2) Lower application idle timeout settings. (Is there a mandated "check-in" interval defined for IMAP clients?) =R= From janfrode at tanso.net Sat Dec 31 08:56:49 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Sat, 31 Dec 2011 07:56:49 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <4EFE5984.9080905@hardwarefreak.com> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> <4EFC6453.8020304@hardwarefreak.com> <20111230144124.GA3936@dibs.tanso.net> <4EFE5984.9080905@hardwarefreak.com> Message-ID: <20111231065649.GA19046@dibs.tanso.net> On Fri, Dec 30, 2011 at 06:38:28PM -0600, Stan Hoeppner wrote: > > Roger that. Good strategy. You using SAN storage or local RAID? What > filesystem do you plan to use for the new mailbox location? What OS is > the Dovecot host? IBM DS4800 SAN-storage. Filesystem is IBM GPFS, which stripe all I/O over all the RAID5 LUNs it has assigned. Kind of like RAID5+0. To guard against disaster if one RAID5 array should fail, we plan on replicating the filesystem metadata on different sets for LUNs. OS is RHEL (currently RHEL4 and RHEL5, but new servers are implemented on RHEL6). > Lastly, how many users you have? Sorry for prying, I'd rather not say.. but we're an ISP, with about 250.000 residential customers and multiple mailboxes per customer. > I'm always really curious about system details when someone states they > have 12TB of mailbox data. ;) $ df -h /usr/local/atmail/users Filesystem Size Used Avail Use% Mounted on /dev/atmailusers 14T 12T 2.1T 85% /usr/local/atmail/users $ df -hi /usr/local/atmail/users Filesystem Inodes IUsed IFree IUse% Mounted on /dev/atmailusers 145M 109M 37M 75% /usr/local/atmail/users Looking forward to reducing the number of inodes when we finally move to mdbox.. Should do wonders to the backup process. -jf From stan at hardwarefreak.com Sat Dec 31 09:54:32 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 31 Dec 2011 01:54:32 -0600 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111231065649.GA19046@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> <4EFC6453.8020304@hardwarefreak.com> <20111230144124.GA3936@dibs.tanso.net> <4EFE5984.9080905@hardwarefreak.com> <20111231065649.GA19046@dibs.tanso.net> Message-ID: <4EFEBFB8.1070301@hardwarefreak.com> On 12/31/2011 12:56 AM, Jan-Frode Myklebust wrote: > On Fri, Dec 30, 2011 at 06:38:28PM -0600, Stan Hoeppner wrote: >> >> Roger that. Good strategy. You using SAN storage or local RAID? What >> filesystem do you plan to use for the new mailbox location? What OS is >> the Dovecot host? > > IBM DS4800 SAN-storage. Filesystem is IBM GPFS, which stripe all I/O > over all the RAID5 LUNs it has assigned. Kind of like RAID5+0. To guard > against disaster if one RAID5 array should fail, we plan on replicating > the filesystem metadata on different sets for LUNs. Nice setup. I've mentioned GPFS for cluster use on this list before, but I think you're the only operator to confirm using it. I'm sure others would be interested in hearing of your first hand experience: pros, cons, performance, etc. And a ball park figure on the licensing costs, whether one can only use GPFS on IBM storage or if storage from others vendors is allowed in the GPFS pool. To this point IIRC everyone here doing clusters is using NFS, GFS, or OCFS. Each has its downsides, mostly because everyone is using maildir. NFS has locking issues with shared dovecot index files. GFS and OCFS have filesystem metadata performance issues. How does GPFS perform with your maildir workload? > OS is RHEL (currently RHEL4 and RHEL5, but new servers are implemented > on RHEL6). > >> Lastly, how many users you have? Sorry for prying, > > I'd rather not say.. but we're an ISP, with about 250.000 residential > customers and multiple mailboxes per customer. > >> I'm always really curious about system details when someone states they >> have 12TB of mailbox data. ;) > > $ df -h /usr/local/atmail/users > Filesystem Size Used Avail Use% Mounted on > /dev/atmailusers 14T 12T 2.1T 85% /usr/local/atmail/users > $ df -hi /usr/local/atmail/users > Filesystem Inodes IUsed IFree IUse% Mounted on > /dev/atmailusers 145M 109M 37M 75% /usr/local/atmail/users > > Looking forward to reducing the number of inodes when we finally move to > mdbox.. Should do wonders to the backup process. That will depend to a large degree on your mdbox_rotate_size value. The default is 2MB, which means you'll get multiple ~2MB mdbox files. If we assume the average email size including headers and attachments is 32KB, Dovecot will place ~64 such emails in a single mdbox file with the default 2MB setting. 32KB may be a high or low average depending on your particular users. Considering there is no inherent performance downside to going larger than the default, and significant gains to be made, consider a setting of 8MB to 16MB. This will dramatically reduce both inode consumption and filesystem metadata IOPS vs maildir. Reducing IOPS on a shared SAN is always a plus, especially if you're going to be adding some extra GPFS replication traffic. Timo, is there any technical or sanity based upper bound on mdbox size? Anything wrong with using 64MB, 128MB, or even larger for mdbox_rotate_size? -- Stan From lists at wildgooses.com Sat Dec 31 15:20:53 2011 From: lists at wildgooses.com (Ed W) Date: Sat, 31 Dec 2011 13:20:53 +0000 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <4EF310E0.6030006@Media-Brokers.com> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> Message-ID: <4EFF0C35.5000303@wildgooses.com> On 22/12/2011 11:13, Charles Marcus wrote: > On 2011-12-21 11:18 PM, Simon Brereton > wrote: >> It would be interesting to chart the number of threads caused by each >> distro. I don't know who would have the least, but I suspect gentoo and >> centos would be out in front, > > Been using gentoo since about 2003 and never looked back... best and > easiest distro to maintain, bar none, and the best support and > documentation too. > Wait... Back up... You mean there are *other* distributions of linux? I thought they were all just gentoo derivatives..?!! :-) Ed W From user+dovecot at localhost.localdomain.org Sat Dec 31 15:29:55 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 31 Dec 2011 14:29:55 +0100 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <4EFF0C35.5000303@wildgooses.com> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> <4EFF0C35.5000303@wildgooses.com> Message-ID: <4EFF0E53.4060604@localhost.localdomain.org> On 12/31/2011 02:20 PM Ed W wrote: > > Wait... Back up... You mean there are *other* distributions of linux? I > thought they were all just gentoo derivatives..?!! > > :-) Huh, I thought everything would be based on LFS [http://www.linuxfromscratch.org/lfs/]. Happy new year to the all Dovecot admins and Timo San. Regards, Pascal -- The trapper recommends today: cafebabe.1136514 at localdomain.org From jerry at seibercom.net Sat Dec 31 16:11:14 2011 From: jerry at seibercom.net (Jerry) Date: Sat, 31 Dec 2011 09:11:14 -0500 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <4EFF0C35.5000303@wildgooses.com> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> <4EFF0C35.5000303@wildgooses.com> Message-ID: <20111231091114.5e232cb9@scorpio> On Sat, 31 Dec 2011 13:20:53 +0000 Ed W articulated: > On 22/12/2011 11:13, Charles Marcus wrote: > > On 2011-12-21 11:18 PM, Simon Brereton > > wrote: > >> It would be interesting to chart the number of threads caused by > >> each distro. I don't know who would have the least, but I suspect > >> gentoo and centos would be out in front, > > > > Been using gentoo since about 2003 and never looked back... best > > and easiest distro to maintain, bar none, and the best support and > > documentation too. > > > > Wait... Back up... You mean there are *other* distributions of > linux? I thought they were all just gentoo derivatives..?!! Be careful, you are going to get all of the FreeBSD aficionados panties in a knot. They claim the best documentation. Of course, what do they have to document? From CMarcus at Media-Brokers.com Sat Dec 31 16:43:38 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sat, 31 Dec 2011 09:43:38 -0500 Subject: [Dovecot] imap process limits problem In-Reply-To: References: Message-ID: <4EFF1F9A.1030009@Media-Brokers.com> I think Stan already pointed you to where your problem most likely lies, but just wanted to point out that this: On 2011-12-30 1:53 PM, Calvin Cochran wrote: > Most of our clients, including this one, use SSL or TLS and connect > on 993. I believe is incorrect. Port 993 is for IMAP over SSL, if the client is using TLS (or more correctly, STARTTLS), then they should be using the normal IMAP port 143. -- Best regards, Charles From dmiller at amfes.com Sat Dec 31 22:28:41 2011 From: dmiller at amfes.com (Daniel L. Miller) Date: Sat, 31 Dec 2011 12:28:41 -0800 Subject: [Dovecot] fts_solr break-imap-search 2.1 Message-ID: Is "break-imap-search" still required using 2.1 with Solr to index TEXT & BODY searches? -- Daniel From tss at iki.fi Sat Dec 31 22:30:52 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 31 Dec 2011 22:30:52 +0200 Subject: [Dovecot] fts_solr break-imap-search 2.1 In-Reply-To: References: Message-ID: <3ED2196F-A573-4EB4-AD05-15F30A2A6B81@iki.fi> On 31.12.2011, at 22.28, Daniel L. Miller wrote: > Is "break-imap-search" still required using 2.1 with Solr to index TEXT & BODY searches? No. It's enabled always. From dovecot.user at seibercom.net Thu Dec 1 00:14:06 2011 From: dovecot.user at seibercom.net (Jerry) Date: Wed, 30 Nov 2011 17:14:06 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: <20111130171406.7ac37cbf@scorpio> On Wed, 30 Nov 2011 15:36:46 -0500 Terry Carmen articulated: > I need to make the IMAP interface of an Exchange 2000 server > available on the net, however I would like to give it a little > protection, and believe Dovecot's IMAP proxy might be appropriate. > > Does anybody have a *really simple* config that would allow IMAP > pass-through to a single Exchange server? > > The examples I've seen all assume some sort of load balancing, which > isn't an issue here, so I'd like to eliminate the need for an > unnecessary database server. > > Does Dovecot do any cleanup of the IMAP commands that would be > useful in protecting Exchange (from this, > http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I > barking up the wrong tree? > > If Dovecot isn't helpful for this, can anybody point me to a better > resource? An Exchange 2000 server is ancient. I wouldn't waste time with it unless there was no possible way to get an updated version; ie, Exchange server 2010. -- Jerry ? Dovecot.user at seibercom.net Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From terry at cnysupport.com Thu Dec 1 02:00:39 2011 From: terry at cnysupport.com (Terry Carmen) Date: Wed, 30 Nov 2011 19:00:39 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130171406.7ac37cbf@scorpio> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130171406.7ac37cbf@scorpio> Message-ID: <20111130190039.Horde.A1m8eleGiNBO1sOnioewmHA@www.cnysupport.com> ----- Message from Jerry --------- Date: Wed, 30 Nov 2011 17:14:06 -0500 From: Jerry Reply-To: dovecot at dovecot.org Subject: Re: [Dovecot] MS Exchange IMAP Proxy To: dovecot at dovecot.org > On Wed, 30 Nov 2011 15:36:46 -0500 > Terry Carmen articulated: > >> I need to make the IMAP interface of an Exchange 2000 server >> available on the net, however I would like to give it a little >> protection, and believe Dovecot's IMAP proxy might be appropriate. >> >> Does anybody have a *really simple* config that would allow IMAP >> pass-through to a single Exchange server? >> >> The examples I've seen all assume some sort of load balancing, which >> isn't an issue here, so I'd like to eliminate the need for an >> unnecessary database server. >> >> Does Dovecot do any cleanup of the IMAP commands that would be >> useful in protecting Exchange (from this, >> http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I >> barking up the wrong tree? >> >> If Dovecot isn't helpful for this, can anybody point me to a better >> resource? > > An Exchange 2000 server is ancient. I wouldn't waste time with it > unless there was no possible way to get an updated version; ie, Exchange > server 2010. The client won't pay for an Exchange update just to support a handful of external IMAP users. It works perfectly well internally, using a Postfix relayhost. Terry From seandarcy2 at gmail.com Thu Dec 1 02:15:33 2011 From: seandarcy2 at gmail.com (sean darcy) Date: Wed, 30 Nov 2011 19:15:33 -0500 Subject: [Dovecot] can not get t'bird to create folder In-Reply-To: References: Message-ID: On 11/28/2011 06:50 PM, sean darcy wrote: > dovecot-2.0.16 on Fedora 15. > > thunderbird-8.0 > > I can access dovecot from thunderbird, imap maildir. But when I try to > create a new folder, nothing happens. > > I'm not using LAYOUT=fs, so I have added, tb-extra-mailbox-sep, which > didn't seem relevant anyhow. > > Any help appreciated. > > sean > > The problem was that the antispam plugin was for 2.0.15 - and I'm using 2.0.16. It seems that if a plugin can't be loaded, dovecot can't do anything else. sean From ghandidrivesahumvee at rocketfish.com Thu Dec 1 04:30:31 2011 From: ghandidrivesahumvee at rocketfish.com (Dovecot-GDH) Date: Wed, 30 Nov 2011 18:30:31 -0800 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130190039.Horde.A1m8eleGiNBO1sOnioewmHA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130171406.7ac37cbf@scorpio> <20111130190039.Horde.A1m8eleGiNBO1sOnioewmHA@www.cnysupport.com> Message-ID: >> An Exchange 2000 server is ancient. I wouldn't waste time with it >> unless there was no possible way to get an updated version; ie, Exchange >> server 2010. > > > The client won't pay for an Exchange update just to support a handful of external IMAP users. > > It works perfectly well internally, using a Postfix relayhost. > > Terry If the client is inept enough to run Exchange 2000 for only a handful of users, you're probably wasting your time attempting to sanitize IMAP commands. If your contract with them mandates that you secure their server, you'll most likely have to replace their broken software. From seandarcy2 at gmail.com Thu Dec 1 04:37:59 2011 From: seandarcy2 at gmail.com (sean darcy) Date: Wed, 30 Nov 2011 21:37:59 -0500 Subject: [Dovecot] can't get sieve to sort virus into spam In-Reply-To: <4ED49127.6020000@rename-it.nl> References: <1266621424.20111129030956@gmail.com> <4ED49127.6020000@rename-it.nl> Message-ID: On 11/29/2011 03:00 AM, Stephan Bosch wrote: > On 11/29/2011 4:09 AM, Duane Hill wrote: >> On Tuesday, November 29, 2011 at 02:28:29 UTC, seandarcy2 at gmail.com >> confabulated: >> >>> I can't get sieve to put virus files in the SPAM folder. > >>> does not end up into SPAM, or anyplace else, including inbox. > >>> How do I make this work? >> What gets logged? If sieve has an issue storing something, it is >> logged. > > The message must be stored somewhere, even if Sieve fails entirely. If > your Dovecot logs provide no indication that a message was handled, are > you even sure that LTMP is getting a message at all? In this regard your > MTA's logs are of importance as well. > > Regards, > > Stephan. > Thanks for your response. I solved the disappearing problem: the message is being put into the INBOX. There are no user sieve scripts. Is there a way to disable any that could occur? Here are the headers: Content-Type: multipart/alternative; boundary=000e0cd5712cced62c04b2fe370e X-DSPAM-Result: Virus X-DSPAM-Processed: Wed Nov 30 21:00:35 2011 X-DSPAM-Confidence: 1.0000 X-DSPAM-Probability: 1.0000 X-DSPAM-Signature: 4ed6dfc341474953737117 --000e0cd5712cced62c04b2fe370e Content-Type: text/plain; charset=ISO-8859-1 X5O!P%@AP[4\PZX54(P^)7CC)7}$EICAR-STANDARD-ANTIVIRUS-TEST-FILE!$H+H* Here's default.sieve: cat /var/lib/dovecot/sieve/default.sieve require "fileinto"; if header :contains "X-DSPAM-Result" "Virus" { fileinto "Virus"; } if header :contains "X-DSPAM-Result" "Spam" { fileinto "SPAM"; } From dovecot-info.log: Nov 30 21:25:43 auth: Debug: master in: USER 1 firstlast@<>.com service=lmtp lip=127.0.0.1 lport=24 rip=127. 0.0.1 rport=35594 Nov 30 21:25:43 auth: Debug: passwd(firstlast@<>,127.0.0.1): lookup Nov 30 21:25:43 auth: Info: passwd(firstlast@<>,127.0.0.1): unknown user Nov 30 21:25:43 auth: Debug: passwd-file(firstlast@<>.com,127.0.0.1): lookup: user=firstlast@<>.com file=/etc/dovecot/users Nov 30 21:25:43 auth: Debug: master out: USER 1 firstlast@<>.com uid=504 gid=504 home=/home/vmail/<>.com/firstlas t Nov 30 21:25:43 lmtp(12609, firstlast@<>.com): Info: Av/jFKfl1k5BMQAABoXEcA: msgid=: saved mail to INBOX sean From tss at iki.fi Thu Dec 1 04:47:30 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 1 Dec 2011 04:47:30 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: On 30.11.2011, at 22.36, Terry Carmen wrote: > Does Dovecot do any cleanup of the IMAP commands that would be useful in protecting Exchange (from this, http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I barking up the wrong tree? v2.1 with imapc backend can be used to do this. There's not really documentation for it beyond this mailing list though. From terry at cnysupport.com Thu Dec 1 06:03:24 2011 From: terry at cnysupport.com (Terry Carmen) Date: Wed, 30 Nov 2011 23:03:24 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Thu, 1 Dec 2011 04:47:30 +0200 From: Timo Sirainen Subject: Re: [Dovecot] MS Exchange IMAP Proxy To: Terry Carmen Cc: dovecot at dovecot.org > On 30.11.2011, at 22.36, Terry Carmen wrote: > >> Does Dovecot do any cleanup of the IMAP commands that would be >> useful in protecting Exchange (from this, >> http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I >> barking up the wrong tree? > > v2.1 with imapc backend can be used to do this. There's not really > documentation for it beyond this mailing list though. I'd be happy to give it a try. I have an absolutely dead-simple setup. All it has to do is sit between the internet and the IMAP port on an Exchange server. Any hints on how to set it up? Thanks! Terry From terry at cnysupport.com Thu Dec 1 06:17:39 2011 From: terry at cnysupport.com (Terry Carmen) Date: Wed, 30 Nov 2011 23:17:39 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130171406.7ac37cbf@scorpio> <20111130190039.Horde.A1m8eleGiNBO1sOnioewmHA@www.cnysupport.com> Message-ID: <20111130231739.Horde.rzH2TleGiNBO1v-jWdQQmLA@www.cnysupport.com> > If the client is inept enough to run Exchange 2000 for only a > handful of users, you're probably wasting your time attempting to > sanitize IMAP commands. > > If your contract with them mandates that you secure their server, > you'll most likely have to replace their broken software. There are over 500 users on the server, however there are only a few external users. I'm really not trying to justify a business case here, I'm just trying to get an IMAP connection. Terry From stan at hardwarefreak.com Thu Dec 1 06:44:35 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Wed, 30 Nov 2011 22:44:35 -0600 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: <4ED70633.3000406@hardwarefreak.com> On 11/30/2011 2:36 PM, Terry Carmen wrote: > I need to make the IMAP interface of an Exchange 2000 server available > on the net, however I would like to give it a little protection, and > believe Dovecot's IMAP proxy might be appropriate. > > Does anybody have a *really simple* config that would allow IMAP > pass-through to a single Exchange server? > > The examples I've seen all assume some sort of load balancing, which > isn't an issue here, so I'd like to eliminate the need for an > unnecessary database server. > > Does Dovecot do any cleanup of the IMAP commands that would be useful in > protecting Exchange (from this, > http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I > barking up the wrong tree? > > If Dovecot isn't helpful for this, can anybody point me to a better > resource? Look into the SM IMAP Proxy. It was designed for a different purpose, but may work well for your scenario: http://imapproxy.org/index.html -- Stan From stephan at rename-it.nl Thu Dec 1 09:27:36 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 01 Dec 2011 08:27:36 +0100 Subject: [Dovecot] can't get sieve to sort virus into spam In-Reply-To: References: <1266621424.20111129030956@gmail.com> <4ED49127.6020000@rename-it.nl> Message-ID: <4ED72C68.5040001@rename-it.nl> On 12/1/2011 3:37 AM, sean darcy wrote: > On 11/29/2011 03:00 AM, Stephan Bosch wrote: >> On 11/29/2011 4:09 AM, Duane Hill wrote: >>> On Tuesday, November 29, 2011 at 02:28:29 UTC, seandarcy2 at gmail.com >>> confabulated: >>> >>>> I can't get sieve to put virus files in the SPAM folder. >> >>>> does not end up into SPAM, or anyplace else, including inbox. >> >>>> How do I make this work? >>> What gets logged? If sieve has an issue storing something, it is >>> logged. >> >> The message must be stored somewhere, even if Sieve fails entirely. If >> your Dovecot logs provide no indication that a message was handled, are >> you even sure that LTMP is getting a message at all? In this regard your >> MTA's logs are of importance as well. >> >> Regards, >> >> Stephan. >> > > Thanks for your response. I solved the disappearing problem: the > message is being put into the INBOX. > > There are no user sieve scripts. Is there a way to disable any that > could occur? [...] > Nov 30 21:25:43 auth: Debug: master in: USER 1 > firstlast@<>.com service=lmtp lip=127.0.0.1 > lport=24 rip=127. > 0.0.1 rport=35594 > Nov 30 21:25:43 auth: Debug: passwd(firstlast@<>,127.0.0.1): lookup > Nov 30 21:25:43 auth: Info: passwd(firstlast@<>,127.0.0.1): unknown user > Nov 30 21:25:43 auth: Debug: passwd-file(firstlast@<>.com,127.0.0.1): > lookup: user=firstlast@<>.com file=/etc/dovecot/users > Nov 30 21:25:43 auth: Debug: master out: USER 1 > firstlast@<>.com uid=504 gid=504 home=/home/vmail/<>.com/firstlas > t > Nov 30 21:25:43 lmtp(12609, firstlast@<>.com): Info: > Av/jFKfl1k5BMQAABoXEcA: > msgid= mail.gmail.com>: saved mail to INBOX Apparently, the Sieve plugin is not active or not loaded. The message is stored by lmtp, because otherwise that final log line would have a `sieve: ' prefix somewhere. Do you see any sieve-related log lines when mail_debug=yes? Regards, Stephan. From hs at schlittermann.de Thu Dec 1 10:19:58 2011 From: hs at schlittermann.de (Heiko Schlittermann) Date: Thu, 1 Dec 2011 09:19:58 +0100 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: <20111201081958.GB30720@jumper.schlittermann.de> Terry Carmen (Mi 30 Nov 2011 21:36:46 CET): > useful in protecting Exchange (from this, > http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I > barking up the wrong tree? > > If Dovecot isn't helpful for this, can anybody point me to a better resource? Some time ago wie used "perdition", but I do not know, if it has sanitizing features beyond just being a proxy for the IMAP protocol. -- Heiko :: dresden : linux : SCHLITTERMANN.de GPG Key 48D0359B : 3061 CFBF 2D88 F034 E8D2 7E92 EE4E AC98 48D0 359B -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From wek at andatra.kiev.ua Thu Dec 1 10:33:20 2011 From: wek at andatra.kiev.ua (Yaroslav Boychuk) Date: Thu, 01 Dec 2011 10:33:20 +0200 Subject: [Dovecot] dsync(root): Fatal: execvp() failed: No such file or directory Message-ID: <4ED73BD0.2030302@andatra.kiev.ua> Hi everybody, I try to convert mbox to maildir using local locations /root/mail is a dir with mboxes /root/INBOX is mbox file h=/root dsync -f -v mirror \ mbox:$h/mail:INBOX=$h/INBOX \ maildir:$h/Maildir:CONTROL=$h/dovecot:INDEX=$h/dovecot \ as result I have dsync(root): Fatal: execvp(mbox:/root/mail:INBOX=/root/INBOX) failed: No such file or directory dsync-local(root): Error: read() from worker server failed: EOF thank you for any help FreeBSD, dovecot 2.0.15 From tss at iki.fi Thu Dec 1 15:00:03 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 1 Dec 2011 15:00:03 +0200 Subject: [Dovecot] dsync(root): Fatal: execvp() failed: No such file or directory In-Reply-To: <4ED73BD0.2030302@andatra.kiev.ua> References: <4ED73BD0.2030302@andatra.kiev.ua> Message-ID: On 1.12.2011, at 10.33, Yaroslav Boychuk wrote: > dsync -f -v mirror \ > mbox:$h/mail:INBOX=$h/INBOX \ > maildir:$h/Maildir:CONTROL=$h/dovecot:INDEX=$h/dovecot \ dsync -f -v mirror \ -o mail=mbox:$h/mail:INBOX=$h/INBOX \ maildir:$h/Maildir:CONTROL=$h/dovecot:INDEX=$h/dovecot \ From eray.aslan at caf.com.tr Thu Dec 1 18:15:28 2011 From: eray.aslan at caf.com.tr (Eray Aslan) Date: Thu, 1 Dec 2011 18:15:28 +0200 Subject: [Dovecot] v2.1.rc1 missing SnowballAnalyzer.h Message-ID: <20111201161528.GI3177@zptr-nb18.caf.local> While trying to test v.2.1.rc1 with configure \ --with-lucene \ --without-stemmer \ [...] I get the following error: [...] /bin/sh ../../../libtool --tag=CXX --mode=compile i686-pc-linux-gnu-g++ -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-index -I../../../src/lib-storage -I../../../src/plugins/fts -I../../../src/doveadm -O2 -march=i686 -pipe -c -o lucene-wrapper.lo lucene-wrapper.cc libtool: compile: i686-pc-linux-gnu-g++ -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-index -I../../../src/lib-storage -I../../../src/plugins/fts -I../../../src/doveadm -O2 -march=i686 -pipe -c lucene-wrapper.cc -fPIC -DPIC -o .libs/lucene-wrapper.o lucene-wrapper.cc:26:30: fatal error: SnowballAnalyzer.h: No such file or directory compilation terminated. make[4]: *** [lucene-wrapper.lo] Error 1 The offending line in lucene-wrapper.cc is: #include "SnowballAnalyzer.h" Sure enough, there is no SnowballAnalyzer.h in the tarball. Looks like a missing a backslash in src/plugins/fts-lucene/Makefile.am: [...] noinst_HEADERS = \ fts-lucene-plugin.h \ lucene-wrapper.h SnowballAnalyzer.h \ SnowballFilter.h -- Eray Aslan From terry at cnysupport.com Thu Dec 1 18:24:10 2011 From: terry at cnysupport.com (Terry Carmen) Date: Thu, 01 Dec 2011 11:24:10 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <4ED70633.3000406@hardwarefreak.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <4ED70633.3000406@hardwarefreak.com> Message-ID: <20111201112410.Horde.HODzRVeGiNBO16oqSOuXAfA@www.cnysupport.com> Thanks! I'll take a look. Terry ----- Message from Stan Hoeppner --------- Date: Wed, 30 Nov 2011 22:44:35 -0600 From: Stan Hoeppner Reply-To: stan at hardwarefreak.com Subject: Re: [Dovecot] MS Exchange IMAP Proxy To: dovecot at dovecot.org > On 11/30/2011 2:36 PM, Terry Carmen wrote: >> I need to make the IMAP interface of an Exchange 2000 server available >> on the net, however I would like to give it a little protection, and >> believe Dovecot's IMAP proxy might be appropriate. >> >> Does anybody have a *really simple* config that would allow IMAP >> pass-through to a single Exchange server? >> >> The examples I've seen all assume some sort of load balancing, which >> isn't an issue here, so I'd like to eliminate the need for an >> unnecessary database server. >> >> Does Dovecot do any cleanup of the IMAP commands that would be useful in >> protecting Exchange (from this, >> http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I >> barking up the wrong tree? >> >> If Dovecot isn't helpful for this, can anybody point me to a better >> resource? > > Look into the SM IMAP Proxy. It was designed for a different purpose, > but may work well for your scenario: > > http://imapproxy.org/index.html > > -- > Stan ----- End message from Stan Hoeppner ----- -- Terry Carmen CNY Support, LLC https://www.cnysupport.com From sbbowman at gmail.com Thu Dec 1 19:26:43 2011 From: sbbowman at gmail.com (Stephen Bowman) Date: Thu, 1 Dec 2011 12:26:43 -0500 Subject: [Dovecot] LDAP Authentication - Home Directory Creation Message-ID: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> How does everyone handle this case? Users are authenticated by LDAP, and do not have accounts on the IMAP/dovecot server. When a new user is added to LDAP, the home directory (/home/newuser) needs to be created on the IMAP/dovecot server so dovecot can create the mail directories inside it (/home/newuser/mail/). Obviously I can come up with a few custom solutions, utilizing cron, but I feel like there's a cleaner solution out there. Thanks! From tom at whyscream.net Thu Dec 1 19:51:11 2011 From: tom at whyscream.net (Tom Hendrikx) Date: Thu, 01 Dec 2011 18:51:11 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> Message-ID: <4ED7BE8F.4000609@whyscream.net> On 01-12-11 18:26, Stephen Bowman wrote: > How does everyone handle this case? > > Users are authenticated by LDAP, and do not have accounts on the > IMAP/dovecot server. When a new user is added to LDAP, the home > directory (/home/newuser) needs to be created on the IMAP/dovecot > server so dovecot can create the mail directories inside it > (/home/newuser/mail/). > > Obviously I can come up with a few custom solutions, utilizing cron, > but I feel like there's a cleaner solution out there. How about http://wiki.dovecot.org/PostLoginScripting and something containing 'mkdir -p' ? -- Tom From tss at iki.fi Thu Dec 1 22:48:11 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 1 Dec 2011 22:48:11 +0200 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> Message-ID: On 1.12.2011, at 19.26, Stephen Bowman wrote: > How does everyone handle this case? > > Users are authenticated by LDAP, and do not have accounts on the IMAP/dovecot server. When a new user is added to LDAP, the home directory (/home/newuser) needs to be created on the IMAP/dovecot server so dovecot can create the mail directories inside it (/home/newuser/mail/). Dovecot creates the home directory automatically if it has permissions to do it. So I guess in your case the mail user doesn't have permissions to do it and only root can create it? From micah at riseup.net Thu Dec 1 23:42:34 2011 From: micah at riseup.net (Micah Anderson) Date: Thu, 01 Dec 2011 16:42:34 -0500 Subject: [Dovecot] dovecot-lda quota rule References: <874nybztuz.fsf@algae.riseup.net> <1321388840.21919.520.camel@hurina> <87ehx8gic7.fsf@algae.riseup.net> <87zkfek37g.fsf@algae.riseup.net> Message-ID: <87ty5khstx.fsf@algae.riseup.net> micah anderson writes: > On Wed, 16 Nov 2011 11:09:12 -0500, micah anderson wrote: >> On Tue, 15 Nov 2011 22:27:20 +0200, Timo Sirainen wrote: >> > On Thu, 2011-11-10 at 13:59 -0500, Micah Anderson wrote: >> > > I really like the feature where you can define quota rules with percents >> > > which trigger off of the default values[0] (so you can set the Trash to >> > > allow for 10% more of the user's quota for example). >> > > >> > > What I would really love in dovecot would be for the ability to >> > > configure a quota rule for dovecot-lda. I would like to configure things >> > > so we don't bounce emails for users until they are well over quota, the >> > > IMAP quota plugin is a really great way to notify people that they are >> > > over quota because it fails to write to other folders.... that should be >> > > enough to get people's attention that they need to deal with things, but >> > > bouncing is harsh. >> > >> > You can give LDA-specific quota settings. Like maybe: >> > >> > protocol lda { >> > plugin { >> > quota_rule2 = INBOX:storage=200% >> > } >> > } > > I just tried doing this, and I started bouncing mail for everyone > because they were over quota (even when they arent), so I am clearly > missing something in how I have it configured. This is what I have: Solved, thanks to tss on irc... My problem was the dovecot-lda invocation was not passing the -d parameter, so no userdb quota rules were being applied. micah From sven at svenhartge.de Fri Dec 2 00:41:43 2011 From: sven at svenhartge.de (Sven Hartge) Date: Thu, 1 Dec 2011 23:41:43 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> Message-ID: <58cbklct2vv8@mids.svenhartge.de> Stephen Bowman wrote: > How does everyone handle this case? > Users are authenticated by LDAP, and do not have accounts on the > IMAP/dovecot server. When a new user is added to LDAP, the home > directory (/home/newuser) needs to be created on the IMAP/dovecot > server so dovecot can create the mail directories inside it > (/home/newuser/mail/). chmod /home to 1777 and let dovecot create the directory. Or switch to a virtual setup, where the users don't get real users on the imap server (they can't log in, so they don't need any real user on that server) and every mail is owned by your virtual mail user. Gr??e, Sven. -- Sigmentation fault. Core dumped. From tss at iki.fi Fri Dec 2 00:52:58 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 00:52:58 +0200 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <58cbklct2vv8@mids.svenhartge.de> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> <58cbklct2vv8@mids.svenhartge.de> Message-ID: On 2.12.2011, at 0.41, Sven Hartge wrote: > Or switch to a > virtual setup, where the users don't get real users on the imap server > (they can't log in, so they don't need any real user on that server) and > every mail is owned by your virtual mail user. Well, it of course makes things easier, but from security point of view it's worse.. I hope some day there won't be any problems with Dovecot using multiple UIDs. From sven at svenhartge.de Fri Dec 2 01:03:36 2011 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 2 Dec 2011 00:03:36 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> <58cbklct2vv8@mids.svenhartge.de> Message-ID: <68cbluut2vv8@mids.svenhartge.de> Timo Sirainen wrote: > On 2.12.2011, at 0.41, Sven Hartge wrote: >> Or switch to a virtual setup, where the users don't get real users on >> the imap server (they can't log in, so they don't need any real user >> on that server) and every mail is owned by your virtual mail user. > Well, it of course makes things easier, but from security point of > view it's worse.. Of course. But using real users only works if every user is a PosixUser in LDAP (i.e. has a uidNumber and gidNumber). If this is not the case, then you are forced to use a virtual mail user setup. > I hope some day there won't be any problems with Dovecot using > multiple UIDs. Meaning? Gr??e, Sven. -- Sigmentation fault. Core dumped. From tss at iki.fi Fri Dec 2 01:10:28 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 01:10:28 +0200 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <68cbluut2vv8@mids.svenhartge.de> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> <58cbklct2vv8@mids.svenhartge.de> <68cbluut2vv8@mids.svenhartge.de> Message-ID: On 2.12.2011, at 1.03, Sven Hartge wrote: > Timo Sirainen wrote: >> On 2.12.2011, at 0.41, Sven Hartge wrote: > >>> Or switch to a virtual setup, where the users don't get real users on >>> the imap server (they can't log in, so they don't need any real user >>> on that server) and every mail is owned by your virtual mail user. > >> Well, it of course makes things easier, but from security point of >> view it's worse.. > > Of course. But using real users only works if every user is a PosixUser > in LDAP (i.e. has a uidNumber and gidNumber). If this is not the case, > then you are forced to use a virtual mail user setup. Currently at least. This could be automated in a few ways.. Like simplest: uid = 1000 + md5sum(username) mod 64000. That won't necessarily be unique of course, but it's still better than mod 1. :) >> I hope some day there won't be any problems with Dovecot using >> multiple UIDs. > > Meaning? There are different problems with multiple UIDs that are more difficult to solve than with a single UID. How to manage them, how to handle shared mailboxes, how to create home dirs automatically, probably other things. There are ways to solve these problems in one way or another. From sven at svenhartge.de Fri Dec 2 01:24:24 2011 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 2 Dec 2011 00:24:24 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> <58cbklct2vv8@mids.svenhartge.de> <68cbluut2vv8@mids.svenhartge.de> Message-ID: <88cbn47t2vv8@mids.svenhartge.de> Timo Sirainen wrote: > On 2.12.2011, at 1.03, Sven Hartge wrote: >> Timo Sirainen wrote: >>> I hope some day there won't be any problems with Dovecot using >>> multiple UIDs. >> >> Meaning? > There are different problems with multiple UIDs that are more > difficult to solve than with a single UID. How to manage them, how to > handle shared mailboxes, how to create home dirs automatically, > probably other things. There are ways to solve these problems in one > way or another. Ah, yes, shared folders. I remember now, this is why we changed from using real users to a virtual user in the beginning (using Courier), because implementing this feature with real users was real pain in the lower backside. Gr??e, Sven. -- Sigmentation fault. Core dumped. From amateo at um.es Fri Dec 2 10:07:38 2011 From: amateo at um.es (Angel L. Mateo) Date: Fri, 02 Dec 2011 09:07:38 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> Message-ID: <4ED8874A.3090408@um.es> El 01/12/11 18:26, Stephen Bowman escribi?: > How does everyone handle this case? > > Users are authenticated by LDAP, and do not have accounts on the IMAP/dovecot server. When a new user is added to LDAP, the home directory (/home/newuser) needs to be created on the IMAP/dovecot server so dovecot can create the mail directories inside it (/home/newuser/mail/). > > Obviously I can come up with a few custom solutions, utilizing cron, but I feel like there's a cleaner solution out there. > Are you authenticating directly by LDAP or are you using pam? If you were using pam, you could use pam_mkhomedir module. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica _(___V Tfo: 868887590 Fax: 868888337 From rainer.frey at inxmail.de Fri Dec 2 12:38:53 2011 From: rainer.frey at inxmail.de (Rainer Frey) Date: Fri, 2 Dec 2011 11:38:53 +0100 Subject: [Dovecot] Authentication listener configuration In-Reply-To: <22BC7966-5C73-4085-AB63-3B5E20FCE335@inxmail.de> References: <22BC7966-5C73-4085-AB63-3B5E20FCE335@inxmail.de> Message-ID: <681352ED-B7A4-47EE-B4D8-7A6B5D2E115F@inxmail.de> On 29.11.2011, at 08:19, Rainer Frey wrote: > Hi, > > I'm wondering about the authentication listeners that dovecot uses. In many configurations I see: > service auth { > unix_listener auth-userdb { > > Does any component of dovecot use this listener internally (lmtp, lda ...) and does that read the config and search for the listener, or is the exact name "auth-userdb" expected? Is this maybe dependent on the userdb? Which ones need it? And if I want to use postfix SMTP auth, should I define a second listener, or just re-configure that default one to postfix's needs? I mean, specifically if I use ldaand/or lmtp as well ... Thanks Rainer From wek at andatra.kiev.ua Fri Dec 2 12:53:34 2011 From: wek at andatra.kiev.ua (Yaroslav Boychuk) Date: Fri, 02 Dec 2011 12:53:34 +0200 Subject: [Dovecot] dsync(root): Fatal: execvp() failed: No such file or directory In-Reply-To: References: <4ED73BD0.2030302@andatra.kiev.ua> Message-ID: <4ED8AE2E.6060605@andatra.kiev.ua> thank you Timo, I have moved "mirror" after "options" and add namespace { separator = / prefix = inbox = yes } to 10-mail.conf thank you 01.12.2011 15:00, Timo Sirainen ???????(??): > > dsync -f -v mirror \ > -o mail=mbox:$h/mail:INBOX=$h/INBOX \ > maildir:$h/Maildir:CONTROL=$h/dovecot:INDEX=$h/dovecot \ From rainer.frey at inxmail.de Fri Dec 2 15:39:51 2011 From: rainer.frey at inxmail.de (Rainer Frey) Date: Fri, 2 Dec 2011 14:39:51 +0100 Subject: [Dovecot] Authentication listener configuration In-Reply-To: <681352ED-B7A4-47EE-B4D8-7A6B5D2E115F@inxmail.de> References: <22BC7966-5C73-4085-AB63-3B5E20FCE335@inxmail.de> <681352ED-B7A4-47EE-B4D8-7A6B5D2E115F@inxmail.de> Message-ID: > On 29.11.2011, at 08:19, Rainer Frey wrote: >> I'm wondering about the authentication listeners that dovecot uses. In many configurations I see: >> service auth { >> unix_listener auth-userdb { >> >> Does any component of dovecot use this listener internally (lmtp, lda ...) and does that read the config and search for the listener, or is the exact name "auth-userdb" expected? Is this maybe dependent on the userdb? Which ones need it? And if I want to use postfix SMTP auth, should I define a second listener, or just re-configure that default one to postfix's needs? > > I mean, specifically if I use lda and/or lmtp as well ... Sorry for the noise, found it commented in the example configuration - it's configured in auth_socket_path. I didn't have a dovecot installation handy, so I only looked online. For dovecot 1.x, the wiki contains the full configuration file with all comments. Couldn't anything like that be done for 2.x as well (even though it's more complicated)? Rainer From pw at wk-serv.de Fri Dec 2 16:30:43 2011 From: pw at wk-serv.de (Patrick Westenberg) Date: Fri, 02 Dec 2011 15:30:43 +0100 Subject: [Dovecot] Plugin for munin Message-ID: <4ED8E113.9050908@wk-serv.de> Hi there, is anyone using munin to monitor connections to dovecot? If someone does, which plugin is used? Regards Patrick From ecasarero at gmail.com Fri Dec 2 16:49:12 2011 From: ecasarero at gmail.com (Eduardo Casarero) Date: Fri, 2 Dec 2011 11:49:12 -0300 Subject: [Dovecot] Plugin for munin In-Reply-To: <4ED8E113.9050908@wk-serv.de> References: <4ED8E113.9050908@wk-serv.de> Message-ID: 2011/12/2 Patrick Westenberg > Hi there, > > is anyone using munin to monitor connections to dovecot? > If someone does, which plugin is used? > > Regards > Patrick > I've written a very small script to monitor the amount of users conected to dovecot using imap, so i can get an idea of real usage. The problem is that i wrote it for Nagios, i don't know if you can tune it to work with munin. Regards, Edurardo. From tss at iki.fi Fri Dec 2 17:12:21 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 17:12:21 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension Message-ID: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> It's implemented now in dovecot-2.1 hg. It also deprecates autocreate plugin (but it still works the old way). The idea is that you can now do e.g.: mailbox Trash { auto = no special_use = \Trash } mailbox Drafts { auto = no special_use = \Drafts } mailbox Sent { auto = subscribe # autocreate, autosubscribe special_use = \Sent } mailbox Spam { auto = create # autocreate, but don't autosubscribe special_use = \Junk } mailbox virtual/All { # if you have a virtual "All messages" mailbox auto = no special_use = \All } The mailbox names require a namespace prefix, so if you use e.g. "INBOX." prefix you'll need to use: mailbox INBOX.Trash { ..etc.. From tss at iki.fi Fri Dec 2 23:19:01 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 23:19:01 +0200 Subject: [Dovecot] can not get t'bird to create folder In-Reply-To: References: Message-ID: <655038FA-90B5-4F7A-9C06-23C91EA14701@iki.fi> On 1.12.2011, at 2.15, sean darcy wrote: > The problem was that the antispam plugin was for 2.0.15 - and I'm using 2.0.16. > > It seems that if a plugin can't be loaded, dovecot can't do anything else. Yes. Nowadays I keep stable APIs between micro versions (vX.Y.*), but stable ABIs would require to be a lot more careful. So it's not really worth the trouble, since Dovecot logs about the plugin version mismatch anyway and you can just recompile the plugin it to make it work again. From tss at iki.fi Fri Dec 2 23:22:24 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 23:22:24 +0200 Subject: [Dovecot] lda/sieve ignores quota from ldap In-Reply-To: <20111130190416.641ede1f@meissner.pentament.dyndns.org> References: <20111130190416.641ede1f@meissner.pentament.dyndns.org> Message-ID: <9DCC9F03-5CBC-45E7-A12B-7365565C4067@iki.fi> On 30.11.2011, at 20.04, Jens Mei?ner wrote: > I'm using Dovecot 2.0 with Sieve as MDA and Postfix as MTA. The > Postfix delivery command is /usr/lib/dovecot/dovecot-lda -f "$SENDER" > -a "$RECIPIENT". I have set a default quota with quota_rule = *:storage=1G. > Some users should have a larger quota. This is defined in a ldap > directory and I have set .. You need to use dovecot-lda's -d parameter or it doesn't do a userdb lookup, so it won't see the per-user quota from ldap. From tss at iki.fi Fri Dec 2 23:29:23 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 23:29:23 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> Message-ID: <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> On 1.12.2011, at 6.03, Terry Carmen wrote: >> On 30.11.2011, at 22.36, Terry Carmen wrote: >> >>> Does Dovecot do any cleanup of the IMAP commands that would be useful in protecting Exchange (from this, http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I barking up the wrong tree? >> >> v2.1 with imapc backend can be used to do this. There's not really documentation for it beyond this mailing list though. > > I'd be happy to give it a try. > > I have an absolutely dead-simple setup. All it has to do is sit between the internet and the IMAP port on an Exchange server. > > Any hints on how to set it up? Without SSL it works like this: mail_location = imapc:~/imapc imapc_host = imap.elsewhere.com imapc_port = 143 passdb { driver = imap args = host=imap.elsewhere.com default_fields = userdb_imapc_user=%u userdb_imapc_password=%w } userdb { driver = prefetch } mail_home = /home/tss And about other IMAP proxies: Before login they provide almost comparable security to Dovecot, the main exception being that Dovecot don't by default allow all characters in username (auth_username_chars setting). Post-login all of the IMAP proxies are equivalent. But imapc backend isn't really a proxy, so it does more: The imapc mainly gives protection for post-login commands, which the other proxies don't even attempt to sanitize in any way. But you probably trust your authorized users enough that they won't attempt to break into your mail server.. But then again, users might be running viruses and whatever other things that automate breaking into mail server without even knowing about it (but currently that's rather rare I think). From terry at cnysupport.com Sat Dec 3 00:39:09 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 02 Dec 2011 17:39:09 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> Message-ID: <20111202173909.Horde.tLmudleGiNBO2VONl9B1xPA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Fri, 2 Dec 2011 23:29:23 +0200 From: Timo Sirainen Subject: Re: [Dovecot] MS Exchange IMAP Proxy To: Terry Carmen Cc: dovecot at dovecot.org > On 1.12.2011, at 6.03, Terry Carmen wrote: > >>> On 30.11.2011, at 22.36, Terry Carmen wrote: >>> >>>> Does Dovecot do any cleanup of the IMAP commands that would be >>>> useful in protecting Exchange (from this, >>>> http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am >>>> I barking up the wrong tree? >>> >>> v2.1 with imapc backend can be used to do this. There's not really >>> documentation for it beyond this mailing list though. >> >> I'd be happy to give it a try. >> >> I have an absolutely dead-simple setup. All it has to do is sit >> between the internet and the IMAP port on an Exchange server. >> >> Any hints on how to set it up? > > > Without SSL it works like this: > > mail_location = imapc:~/imapc > imapc_host = imap.elsewhere.com > imapc_port = 143 > > passdb { > driver = imap > args = host=imap.elsewhere.com > default_fields = userdb_imapc_user=%u userdb_imapc_password=%w > } > userdb { > driver = prefetch > } > mail_home = /home/tss My dovecot.conf file contains: ///////////////////////////////////////// protocols = imap listen = *, :: mail_location = imapc:~/imapc imapc_host = exchangeserver.example.com imapc_port = 143 passdb { driver = imap args = host=exchangeserver.example.com default_fields = userdb_imapc_user=%u userdb_imapc_password=%w } userdb { driver = prefetch } mail_home = /home/tss !include conf.d/* ///////////////////////////////////////// Dovecot starts without complaints, but when I try a LOGIN, I get: dovecot: auth: Fatal: passdb imap: Unknown parameter: exchangeserver.example.com in the maillog file. Any thoughts? Terry From terry at cnysupport.com Sat Dec 3 01:42:38 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 02 Dec 2011 18:42:38 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> Message-ID: <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> OK, I'm making headway. it didn't like the config because there were no quotes around the Exchange server's FQDN, however when I added the quotes, I got: Dec 2 18:26:33 host dovecot: auth: Error: imapc('exchangeserver.example.com':143): dns_lookup('exchangeserver.example.com') failed: Name or service not known The name *does* resolve correctly using the "host" command. I then replaced the FQDN with the Exchange server's IP address, which works much better, but now I get: Dec 2 18:35:09 host dovecot: imap(myusername): Error: user myusername: Couldn't drop privileges: User is missing UID (see mail_uid setting) "myusername" is not a local user, but exists only on the exchange server. Any thoughts? Thanks! Terry From tss at iki.fi Sat Dec 3 03:04:10 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 3 Dec 2011 03:04:10 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> Message-ID: <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> On 3.12.2011, at 1.42, Terry Carmen wrote: > Dec 2 18:35:09 host dovecot: imap(myusername): Error: user myusername: Couldn't drop privileges: User is missing UID (see mail_uid setting) > > "myusername" is not a local user, but exists only on the exchange server. Any thoughts? You still need a mail user. For example you could create a "vmail" user and set mail_uid=vmail. Or whatever else user. From terry at cnysupport.com Sat Dec 3 04:55:12 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 02 Dec 2011 21:55:12 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> Message-ID: <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> > On 3.12.2011, at 1.42, Terry Carmen wrote: > >> Dec 2 18:35:09 host dovecot: imap(myusername): Error: user >> myusername: Couldn't drop privileges: User is missing UID (see >> mail_uid setting) >> >> "myusername" is not a local user, but exists only on the exchange >> server. Any thoughts? > > You still need a mail user. For example you could create a "vmail" > user and set mail_uid=vmail. Or whatever else user. Several other configuration problems later . . . I'm getting much closer, but not quite there. The latest message is: dovecot: imap(username): Error: user username: Initialization failed: Initializing mail storage from mail_location setting failed: Home directory not set for user. Can't expand ~/ for mail root dir in: ~/imapc The users who will be using the proxy don't actually have any mail on the box running dovecot and (currently) don't have any accounts or home directories. Right now they only exist on the Exchhange server. Is there a config option I need to create/change so that Dovecot doesn't look for a directory for each user, or does it till ened one even though the users aren't local and there won't be a mail store on the box running dovecot? Thanks again for all your help! When I get this all working, I'll write up a Wiki page for it. Terry From me at junc.org Sat Dec 3 05:35:05 2011 From: me at junc.org (Benny Pedersen) Date: Sat, 03 Dec 2011 04:35:05 +0100 Subject: [Dovecot] MUAs creating different "Sent" folders In-Reply-To: <20111129214256.GL14970@charite.de> References: <20111129214256.GL14970@charite.de> Message-ID: <92d9bf78c8e3ec525b7f3f4c46ce9972@junc.org> On Tue, 29 Nov 2011 22:42:56 +0100, Ralf Hildebrandt wrote: > While our webmail installation creates "Sent" as a Sent-Items Folder, > Apple Mail creates "Sent Messages". open source standards :-) > Is there a way of "mapping" foldernames e.g. > > map "Sent Messages" to "Sent" > map "Deletes Messages" to "Trash" would be nice yes, it was talked about a way to solve it via a plugin > and so on? none mua have it hardcoded folder names, just diff defaults :( From heptalium at gmx.de Sat Dec 3 13:17:51 2011 From: heptalium at gmx.de (Jens =?UTF-8?B?TWVpw59uZXI=?=) Date: Sat, 3 Dec 2011 12:17:51 +0100 Subject: [Dovecot] lda/sieve ignores quota from ldap In-Reply-To: <9DCC9F03-5CBC-45E7-A12B-7365565C4067@iki.fi> References: <20111130190416.641ede1f@meissner.pentament.dyndns.org> <9DCC9F03-5CBC-45E7-A12B-7365565C4067@iki.fi> Message-ID: <20111203121751.73753b7e@meissner.pentament.dyndns.org> Am Fri, 2 Dec 2011 23:22:24 +0200 schrieb Timo Sirainen : > On 30.11.2011, at 20.04, Jens Mei?ner wrote: > >> I'm using Dovecot 2.0 with Sieve as MDA and Postfix as MTA. The >> Postfix delivery command is /usr/lib/dovecot/dovecot-lda -f >> "$SENDER" -a "$RECIPIENT". I have set a default quota with >> quota_rule = *:storage=1G. Some users should have a larger quota. >> This is defined in a ldap directory and I have set > .. > > You need to use dovecot-lda's -d parameter or it doesn't do a userdb > lookup, so it won't see the per-user quota from ldap. Thanks, it works well. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: not available URL: From dovecot at digitalforplay.com Fri Dec 2 20:47:16 2011 From: dovecot at digitalforplay.com (A Dovecot User) Date: Fri, 02 Dec 2011 12:47:16 -0600 Subject: [Dovecot] Panic when attempting index with Apache Solr : fts_solr plugin Message-ID: <4ED91D34.3050906@digitalforplay.com> Dovecot version: 2.1.rc1 Expat version: expat-2.0.1-10 Libcurl version: libcurl-7.21.0-10 OS: Fedora 14 i686 Configure command: ./configure --with-solr Solr version: 1.4.1 (also tried 3.5.0) Java version: java-1.6.0-openjdk-1.6.0.0-55.1.9.10 (also tried Oracle Java 6u29) [root at mymailserver ~]# doveadm -D index -u username mailbox inbox doveadm(username): Info: INBOX: Caching mails seq=1..466 doveadm(username): Panic: file solr-connection.c: line 545 (solr_connection_post_more): assertion failed: (maxfd >= 0) doveadm(username): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3b9b1) [0x14b9b1] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x47) [0x14bac7] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x1211ae] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x293) [0xb1a7d3] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x2599) [0xb16599] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_build_more+0x31) [0x2273f1] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x3b2) [0x228272] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xa74e) [0x22d74e] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_precache+0xf) [0x937a6f] -> doveadm() [0x80520b6] -> doveadm() [0x804f4b5] -> doveadm(doveadm_mail_single_user+0x5b) [0x804f8db] -> doveadm() [0x804fd3f] -> doveadm(doveadm_mail_try_run+0x12e) [0x805019e] -> doveadm(main+0x3a4) [0x8056444] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x729e36] -> doveadm() [0x804f2c1] ---------------------- mail_plugins = acl antispam fts fts_solr plugin { fts = solr fts_solr = break-imap-search debug url=http://127.0.0.1:8983/solr/ } From terry at cnysupport.com Sat Dec 3 18:10:22 2011 From: terry at cnysupport.com (Terry Carmen) Date: Sat, 03 Dec 2011 11:10:22 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> Message-ID: <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> It's working! I'll post a writeup on the wiki on monday. The last problem was it seems to need a writable home directory for mail_home even though all the mail is pass-through.This was included in Timo's original config, although I had accidentally removed it. In any case many thanks to Timo and everybody else who helped! Terry From maria_arrea at gmx.com Sat Dec 3 22:30:53 2011 From: maria_arrea at gmx.com (Maria Arrea) Date: Sat, 03 Dec 2011 21:30:53 +0100 Subject: [Dovecot] Questions about single intance storage Message-ID: <20111203203053.201510@gmx.com> Hello We are using dovecot 2.0.16 with mdbox+zlib. We are now testing SiS (Single Instance Storage) and I have 5 questions: 1? Is possible to "dedup" existing mdboxes? 2? Are attachments compressed with zlib if mdboxes already use zlib? 3? I have plenty CPU to spare, should I use a low value of mail_attachment_min_size , like 16KB ? 4? Can I "undo" SiS if I have problems? 5? We use bacula to save indexes & mdboxes, and we recover mailboxes using doveadm import when a user "makes a fatal mistake" wiping all her Inbox. If we enable SiS I am not really sure how can we safely restore a user's INBOX if that user has SiS attachments. Thank you for your (great) support. Maria From tss at iki.fi Sat Dec 3 23:00:58 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 3 Dec 2011 23:00:58 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111203203053.201510@gmx.com> References: <20111203203053.201510@gmx.com> Message-ID: On 3.12.2011, at 22.30, Maria Arrea wrote: > We are using dovecot 2.0.16 with mdbox+zlib. We are now testing SiS (Single Instance Storage) and I have 5 questions: > > 1? Is possible to "dedup" existing mdboxes? You can dsync the mailbox elsewhere and then replace the original with the new copy. > 2? Are attachments compressed with zlib if mdboxes already use zlib? Currently attachments don't support zlib at all. > 3? I have plenty CPU to spare, should I use a low value of mail_attachment_min_size , like 16KB ? It wastes disk seeks since it now has to read mail from 2 (or more) places in filesystem, so probably not a good idea. So in any case SiS most likely increases your disk IOPS usage. > 4? Can I "undo" SiS if I have problems? dsync will help the other way around too. > 5? We use bacula to save indexes & mdboxes, and we recover mailboxes using doveadm import when a user "makes a fatal mistake" wiping all her Inbox. If we enable SiS I am not really sure how can we safely restore a user's INBOX if that user has SiS attachments. Hm. Yes, that is problematic.. Even if you knew what SIS files were used, there's no simple way to restore those with proper refcounts. I think what really should be done is writing a tool that can create/restore backups, possibly de-SISing the attachments.. From tlx at leuxner.net Sun Dec 4 08:39:14 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Sun, 4 Dec 2011 07:39:14 +0100 Subject: [Dovecot] Core Dump upon IMAP Login with latest HG (2.1) c067025026ed Message-ID: <58C7F575-17FB-47EF-90BC-83C52AAF56D5@leuxner.net> Dec 4 07:27:41 spectre dovecot: imap-login: Login: user=, method=PLAIN, rip=84.58.184.122, lip=1.2.3.4, mpid=30987, TLS Dec 4 07:27:42 spectre dovecot: imap-login: Login: user=, method=PLAIN, rip=84.58.184.122, lip=1.2.3.4, mpid=30990, TLS Dec 4 07:27:42 spectre dovecot: master: Error: service(imap): child 30990 killed with signal 11 (core dumped) Dec 4 07:27:48 spectre dovecot: imap(tlx at leuxner.net): Connection closed in=142 out=410 Dec 4 07:27:48 spectre dovecot: imap-login: Login: user=, method=PLAIN, rip=84.58.184.122, lip=1.2.3.4, mpid=30992, TLS Dec 4 07:27:48 spectre dovecot: master: Warning: Killed with signal 15 (by pid=31013 uid=0 code=kill) [ GDB Backtrace] #0 0x00007fa68d36f978 in mailbox_settings_find (user=0x22162f0, vname=0x21ec318 "INBOX") at mail-storage.c:610 box_set__foreach_end = box_set = #1 0x00007fa68d371003 in mailbox_alloc (list=, vname=0x21ec318 "INBOX", flags=MAILBOX_FLAG_DROP_RECENT) at mail-storage.c:643 _data_stack_cur_id = 4 new_list = 0x22149b0 storage = 0x221b760 box = 0x222a9f0 __FUNCTION__ = "mailbox_alloc" #2 0x000000000040d8de in select_open (cmd=0x22259c0, readonly=false) at cmd-select.c:285 client = 0x2224e30 status = {messages = 2808, recent = 0, unseen = 0, uidvalidity = 0, uidnext = 0, first_unseen_seq = 0, first_recent_uid = 0, last_cached_seq = 0, highest_modseq = 834, keywords = 0x0, permanent_flags = 0, nonpermanent_modseqs = 0, permanent_keywords = 0, allow_new_keywords = 0} flags = 8 ret = #3 cmd_select_full (cmd=0x22259c0, readonly=false) at cmd-select.c:419 client = 0x2224e30 ctx = args = 0x2228218 list_args = 0x7fffbe1e9a58 mailbox = 0x21ec318 "INBOX" ret = __FUNCTION__ = "cmd_select_full" #4 0x000000000041134d in command_exec (cmd=0x22259c0) at imap-commands.c:147 hook = 0x21f5b40 ret = #5 0x000000000041031e in client_command_input (cmd=0x22259c0) at imap-client.c:673 client = 0x2224e30 command = __FUNCTION__ = "client_command_input" #6 0x00000000004103fd in client_command_input (cmd=0x22259c0) at imap-client.c:724 client = 0x2224e30 command = 0x0 __FUNCTION__ = "client_command_input" #7 0x0000000000410625 in client_handle_next_command (client=0x2224e30) at imap-client.c:765 size = 18 #8 client_handle_input (client=0x2224e30) at imap-client.c:777 _data_stack_cur_id = 3 ret = false remove_io = handled_commands = false __FUNCTION__ = "client_handle_input" #9 0x0000000000410f4f in client_input (client=0x2224e30) at imap-client.c:816 cmd = output = 0x2225828 bytes = __FUNCTION__ = "client_input" #10 0x00007fa68d0fbf36 in io_loop_call_io (io=0x22258d0) at ioloop.c:377 ioloop = 0x21f4630 t_id = 2 #11 0x00007fa68d0fcf6f in io_loop_handler_run (ioloop=) at ioloop-epoll.c:213 ctx = 0x21f4850 event = 0x21f48c0 list = 0x2225920 io = 0x22162f0 tv = {tv_sec = 29, tv_usec = 928551} msecs = ret = i = 0 call = false #12 0x00007fa68d0fbed8 in io_loop_run (ioloop=0x21f4630) at ioloop.c:396 No locals. #13 0x00007fa68d0e9433 in master_service_run (service=0x21f44f0, callback=0x21ec318) at master-service.c:499 No locals. #14 0x0000000000419141 in main (argc=1, argv=0x21f4370) at main.c:375 set_roots = {0x41c020, 0x0} service_flags = storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT postlogin_socket_path = 0x0 username = 0x0 c = [ doveconf -n ] # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 auth_cache_size = 16 k auth_verbose = yes mail_location = mdbox:~/mdbox mail_plugins = acl quota stats namespace { hidden = no inbox = yes location = prefix = separator = / type = private } namespace { list = yes location = mdbox:/var/vmail/public prefix = Public/ separator = / subscriptions = no type = public } passdb { args = username_format=%u /var/vmail/auth.d/%d/passwd driver = passwd-file } plugin { acl = vfile:/var/vmail/conf.d/%d/acls:cache_secs=300 mail_log_events = expunge mailbox_delete quota = dict:user::file:%h/mdbox/dovecot-quota quota_rule = *:storage=1GB quota_rule2 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/vmail/conf.d/%d/sieve stats_refresh = 30s stats_track_cmds = yes } protocols = imap lmtp quota_full_tempfail = yes service auth-worker { user = doveauth } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = doveauth } service imap-login { inet_listener imap { address = 1.2.3.4 port = 143 } inet_listener imaps { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_ca = From alec at alec.pl Sun Dec 4 10:00:52 2011 From: alec at alec.pl (A.L.E.C) Date: Sun, 04 Dec 2011 09:00:52 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> Message-ID: <4EDB28B4.4010606@alec.pl> On 2011-12-02 16:12, Timo Sirainen wrote: > It's implemented now in dovecot-2.1 hg. It also deprecates autocreate plugin (but it still works the old way). The idea is that you can now do e.g.: > mailbox Spam { > auto = create # autocreate, but don't autosubscribe > special_use = \Junk This looks very nice. Thanks Timo. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From maria_arrea at gmx.com Sun Dec 4 16:10:58 2011 From: maria_arrea at gmx.com (Maria Arrea) Date: Sun, 04 Dec 2011 15:10:58 +0100 Subject: [Dovecot] Questions about single intance storage Message-ID: <20111204141058.201500@gmx.com> Hello Timo. If we can not safely restore from backup a user's mailbox with SiS enabled, we can not enable SiS. Any plan to include this backup recovery tool in dovecot 2.0.X or 2.1? Regards Maria > 5? We use bacula to save indexes & mdboxes, and we recover mailboxes using doveadm import when a user "makes a fatal mistake" wiping all her Inbox. If we enable SiS I am not really sure how can we safely restore a user's INBOX if that user has SiS attachments. Hm. Yes, that is problematic.. Even if you knew what SIS files were used, there's no simple way to restore those with proper refcounts. I think what really should be done is writing a tool that can create/restore backups, possibly de-SISing the attachments.. From tss at iki.fi Sun Dec 4 19:21:55 2011 From: tss at iki.fi (Timo Sirainen) Date: Sun, 4 Dec 2011 19:21:55 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111204141058.201500@gmx.com> References: <20111204141058.201500@gmx.com> Message-ID: On 4.12.2011, at 16.10, Maria Arrea wrote: > If we can not safely restore from backup a user's mailbox with SiS enabled, we can not enable SiS. Any plan to include this backup recovery tool in dovecot 2.0.X or 2.1? I'd first have to design it. And before designing it I'd need to look into how the backup softwares usually work.. If anyone has any ideas about this, I'd like to hear. From terry at cnysupport.com Sun Dec 4 19:41:29 2011 From: terry at cnysupport.com (Terry Carmen) Date: Sun, 04 Dec 2011 12:41:29 -0500 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> Message-ID: <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> >> If we can not safely restore from backup a user's mailbox with SiS >> enabled, we can not enable SiS. Any plan to include this backup >> recovery tool in dovecot 2.0.X or 2.1? > > I'd first have to design it. And before designing it I'd need to > look into how the backup softwares usually work.. If anyone has any > ideas about this, I'd like to hear. BackupPC uses rsync by default for *nix boxes. No idea what SiS is, but I'm guessing you're running into the same problem as backing up any other open file with changing internal data that may be inconsistent. This is exactly what it's difficult (and pointless) to backup an open MySQL database or a SQL Server database. The snapshot of what's in memory doesn't always match what's on disk. The only ways I know around this are to periodically create a backup copy that *is* consistent and restorable and a utility to restore the backup back to the "live" storage format, or create a method for the software to flush it's buffers to disk then disconnect from the data file while the backup process is running. The first option takes ~2x the storage space, while the second option makes the user's data inaccessible during the backup. My apologies if I'm misunderstanding the problem and have been rambling for no purpose. 8-) Terry From tss at iki.fi Sun Dec 4 20:16:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Sun, 4 Dec 2011 20:16:20 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> Message-ID: On 4.12.2011, at 19.41, Terry Carmen wrote: >>> If we can not safely restore from backup a user's mailbox with SiS enabled, we can not enable SiS. Any plan to include this backup recovery tool in dovecot 2.0.X or 2.1? >> >> I'd first have to design it. And before designing it I'd need to look into how the backup softwares usually work.. If anyone has any ideas about this, I'd like to hear. > > BackupPC uses rsync by default for *nix boxes. > > No idea what SiS is, but I'm guessing you're running into the same problem as backing up any other open file with changing internal data that may be inconsistent. Inconsistency is an issue, but it's not the biggest problem. It would be possible to write a tool that scans through all mails and makes sure everything is consistent after a restore. dbox mostly does this automatically already, but SIS would need a separate program to ensure its consistency. SIS is anyway a single instance attachment storage. So that lets say you send one 100 MB pdf to 10 people, and it's stored only once in disk under /attachments/aa/bb/aabccddeeff-etc. Each people would have their own unique link under /attachments/, but all of them would be hard linked to a common file. So the problem is mainly about restoring a single user's mails. The mail files are simple to restore, but then you need to figure out which attachments to restore. There's no simple way to know which attachment files belong to which users, so you need to scan through the mail files and see what attachments are referred to. Also backing up the attachment links could be problematic if the backup system doesn't support hard links. Each attachment always has at least 2 links, so if the backup doesn't realize that it at minimum duplicates the space used by attachments. So I was thinking that there probably could be some tool that during a user's backup it would write the attachments among the user's other files, so it would be easy to find all of the files needed for a restore. This would of course mean that backups can take a lot more space, because there's no SIS. Perhaps there could be some other alternatives .. like maybe not storing the attachments directly to backups, but add symlinks to them so they can be used to figure out what to restore. Or maybe the backing up wouldn't need a special tool, but the restoring tool could just read through the dbox files to see what attachments are also needed and write a list of them somewhere so they can be taken from backups as well. I'm not really sure what is the best way. From micah at riseup.net Sun Dec 4 21:03:55 2011 From: micah at riseup.net (Micah Anderson) Date: Sun, 04 Dec 2011 14:03:55 -0500 Subject: [Dovecot] Plugin for munin References: <4ED8E113.9050908@wk-serv.de> Message-ID: <877h2ci2g4.fsf@algae.riseup.net> Eduardo Casarero writes: > 2011/12/2 Patrick Westenberg > >> Hi there, >> >> is anyone using munin to monitor connections to dovecot? >> If someone does, which plugin is used? I'm using the one from nagiosexchange, but I modified it for dovecot2: #!/bin/sh # # Munin Plugin # to count logins to your dovecot mailserver # # Created by Dominik Schulz # http://developer.gauner.org/munin/ # Contributions by: # - Stephane Enten # - Micah Anderson (updated for dovecot2) # # Parameters understood: # # config (required) # autoconf (optional - used by munin-config) # # Config variables: # # logfile - Where to find the syslog file # # Add the following line to a file in /etc/munin/plugin-conf.d: # env.logfile /var/log/your/logfile.log # # Magic markers (optional - used by munin-config and installation scripts): # #%# family=auto #%# capabilities=autoconf ###################### # Configuration ###################### STAT_FILE=/var/lib/munin/plugin-state/plugin-dovecot.state EXPR_BIN=/usr/bin/expr LOGFILE=${logfile:-/var/log/mail.log} ###################### if [ "$1" = "autoconf" ]; then echo yes exit 0 fi if [ "$1" = "config" ]; then echo 'graph_title Dovcecot Logins' echo 'graph_args --base 1000 -l 0' echo 'graph_vlabel Login Counters' echo 'login_total.label Total Logins' echo 'login_tls.label TLS Logins' echo 'login_ssl.label SSL Logins' echo 'login_imap.label IMAP Logins' echo 'login_pop3.label POP3 Logins' echo 'connected.label Connected Users' exit 0 fi ############################# # Initialization ############################# if [ ! -r $STAT_FILE ]; then echo "TOTAL=0" > $STAT_FILE echo "TLS=0" >> $STAT_FILE echo "SSL=0" >> $STAT_FILE echo "IMAP=0" >> $STAT_FILE echo "POP3=0" >> $STAT_FILE fi ############################# ###################### # Total Logins ###################### /bin/echo -en "login_total.value " NEW_TOTAL=$(egrep 'dovecot.*Login' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_TOTAL=$(grep TOTAL $STAT_FILE | cut -f2 -d '=') TOTAL=$($EXPR_BIN $NEW_TOTAL - $OLD_TOTAL) if [ $TOTAL -gt 0 ]; then echo "$TOTAL" else echo "0" fi echo -n ###################### # Connected Users ###################### CONNECTS=$(doveadm -f flow who -1 |wc -l) /bin/echo -en "connected.value " echo $CONNECTS echo -n ###################### # TLS Logins ###################### /bin/echo -en "login_tls.value " NEW_TLS=$(egrep 'dovecot.*Login.*TLS' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_TLS=$(grep TLS $STAT_FILE | cut -f2 -d '=') TLS=$($EXPR_BIN $NEW_TLS - $OLD_TLS) if [ $TLS -gt 0 ]; then echo "$TLS" else echo "0" fi echo -n ###################### # SSL Logins ###################### /bin/echo -en "login_ssl.value " NEW_SSL=$(egrep 'dovecot.*Login.*SSL' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_SSL=$(grep SSL $STAT_FILE | cut -f2 -d '=') SSL=$($EXPR_BIN $NEW_SSL - $OLD_SSL) if [ $SSL -gt 0 ]; then echo "$SSL" else echo "0" fi echo -n ###################### # IMAP Logins ###################### /bin/echo -en "login_imap.value " NEW_IMAP=$(egrep 'dovecot.*imap.*Login' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_IMAP=$(grep IMAP $STAT_FILE | cut -f2 -d '=') IMAP=$($EXPR_BIN $NEW_IMAP - $OLD_IMAP) if [ $IMAP -gt 0 ]; then echo "$IMAP" else echo "0" fi echo -n ###################### # POP3 Logins ###################### /bin/echo -en "login_pop3.value " NEW_POP3=$(egrep 'dovecot.*pop3.*Login' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_POP3=$(grep POP3 $STAT_FILE | cut -f2 -d '=') POP3=$($EXPR_BIN $NEW_POP3 - $OLD_POP3) if [ $POP3 -gt 0 ]; then echo "$POP3" else echo "0" fi echo -n ###################### # Save the new values ###################### echo "TOTAL=$NEW_TOTAL" > $STAT_FILE echo "TLS=$NEW_TLS" >> $STAT_FILE echo "SSL=$NEW_SSL" >> $STAT_FILE echo "IMAP=$NEW_IMAP" >> $STAT_FILE echo "POP3=$NEW_POP3" >> $STAT_FILE From terry at cnysupport.com Sun Dec 4 22:16:02 2011 From: terry at cnysupport.com (Terry Carmen) Date: Sun, 04 Dec 2011 15:16:02 -0500 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> Message-ID: <20111204151602.Horde.tWy1GVeGiNBO29UCBMPVY2A@www.cnysupport.com> > So I was thinking that there probably could be some tool that during > a user's backup it would write the attachments among the user's > other files, so it would be easy to find all of the files needed for > a restore. This would of course mean that backups can take a lot > more space, because there's no SIS. Perhaps there could be some other I see. Instead of writing the links directly to the filesystem, why not keep a links list (not a linked list 8-)) file in each directory that contains the information for the links that should be there (source, dest, attributes), then add an inotify hook in Dovecot to create/update/delete the hard links in the directory so they match the links list? The links list would only need to be opened when there's a change and could remain closed (and backup-able) at all other times, and restoring a links list would immediately trigger the inotify hook and regenerate all the required links. Terry From dovecot.fdop at tagged.lorens.org Mon Dec 5 00:07:05 2011 From: dovecot.fdop at tagged.lorens.org (Lorens Kockum) Date: Sun, 4 Dec 2011 23:07:05 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> Message-ID: <20111204220705.GA23867@tagged.lorens.org> Timo Sirainen wrote: > And before designing it I'd need to look into how the backup > softwares usually work.. If anyone has any ideas about this, > I'd like to hear. Simple or even moderately efficient backup programs like rsync copy all the files. Of course, if the program copies directories A B C in that order, then while B is being backed up, a file A/x could be created, and a file C/index could be modified to reflect that A/x exists. C/index would be backed up, but A/x would not be. The way around that is with snapshots. Linux supports this with LVM, FreeBSD with UFS and ZFS file systems, Windows with VSS, and all selfcontained disk arrays I know of implement snapshots. The application quiesces its disk writes, flushes buffers to disk, triggers a snapshot, and resumes work as usual. > Also backing up the attachment links could be problematic if > the backup system doesn't support hard links. Each attachment > always has at least 2 links, so if the backup doesn't realize > that it at minimum duplicates the space used by attachments. rsync recognizes hard links with option -H, but at a very noticeable performance cost when dealing with millions of files. If the aa/bb/aabccddeeff-etc is unique across the whole mailstore, it would be easy to replace the hard link with a symlink, as you said: > maybe not storing the attachments directly to backups, but add > symlinks to them so they can be used to figure out what to > restore. Or maybe the backing up wouldn't need a special tool, > but the restoring tool could just read through the dbox files > to see what attachments are also needed and write a list of > them somewhere so they can be taken from backups as well. In the second way, you would have a separate hierarchy for multiple-recipient attachments, or would the attachment be "really" stored in the box of a recipient chosen at random? Just some random thoughts: professionally, I use Zimbra. Messages are stored in Maildir-equivalents. The time it takes to backup is a quite severe constraint on the backup technique. For example, compressing the backup files takes too long, so the zip files are not compressed. Instead, the individual mails are stored compressed on disk. Each backup zips up the mails in a few big backup files. An improvement could be to sort mails into backup zip files so that once a zip file is made, it stays the same. After all, if a mail is not deleted a month after it is read, then it will probably stay in the same state forever, or at least until the user starts a keep-me-under-quota cleaning-up spree. During this time, backing up that big zip file can just be a check to see if it is already OK in the backup, which is much quicker. I have no idea if this could be applied to Dovecot, but who knows. From alepivain at lagoon.nc Mon Dec 5 01:17:54 2011 From: alepivain at lagoon.nc (Amaury Le Pivain) Date: Mon, 05 Dec 2011 10:17:54 +1100 Subject: [Dovecot] Dovecot crash non stop: "uid 0: exited on signal 11" Message-ID: <4EDBFFA2.2020701@lagoon.nc> Hi all, I have an old physical freebsd 6.2 server running Dovecot 1.0.7. I wanted to virtualised it. So, I did a dd from the physical server and then I restored it on then now Virtual Machine. I booted the server, all services are running just fine excepted Dovecot. I tried to investigate the log as much as I can but i'm not getting any usefull pieces of information. The only entries I have in the log files are the following: /*log: /var/log/messages:*/ /Dec 5 09:53:35 hostname kernel: pid 33815 (imap), uid 0: exited on signal 11 Dec 5 09:53:39 hostname kernel: pid 33820 (imap), uid 0: exited on signal 11 Dec 5 09:54:22 hostname kernel: pid 33910 (pop3), uid 0: exited on signal 11 Dec 5 09:55:22 hostname kernel: pid 34071 (pop3), uid 0: exited on signal 11 Dec 5 09:55:47 hostname kernel: pid 34103 (imap), uid 0: exited on signal 11 Dec 5 09:56:13 hostname kernel: pid 34143 (pop3), uid 0: exited on signal 11 Dec 5 09:56:21 hostname kernel: pid 34164 (pop3), uid 0: exited on signal 11 Dec 5 09:56:26 hostname kernel: pid 34180 (imap), uid 0: exited on signal 11 Dec 5 09:56:40 hostname kernel: pid 34201 (imap), uid 0: exited on signal 11 Dec 5 09:56:49 hostname kernel: pid 34227 (imap), uid 0: exited on signal 11/ /*log: /mail/log/dovecot.log:* dovecot: Dec 05 10:13:46 Info: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot: Dec 05 10:13:46 Error: child 36621 (imap) killed with signal 11/ I'm also running a squirrelmail as a webmail and here when I refresh a folder content 3/5 times I'm getting an error: /Error: Connection dropped by IMAP server Query: SELECT "INBOX.Corbeille"/ I'm using Dovecot version 1.0.7 on a freebsd 6.2 and my dovecot.conf is: dovecot -n /# 1.0.7: /usr/local/etc/dovecot.conf base_dir: /mail/ log_path: /mail/log/dovecot.log protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /mail//login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: POP3/IMAP ready. verbose_proctitle: yes first_valid_gid: 0 mail_extra_groups: mail mail_location: maildir:~/Maildir fsync_disable: yes maildir_copy_with_hardlinks: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota trash mail_plugins(imap): quota imap_quota trash mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: default_realm: tropik.nc passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen master: path: /mail/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir trash: /usr/local/etc/dovecot-trash.conf/ Thank you for your help! Sincerely, -- Amaury Le Pivain Offratel/Lagoon Tel: 28.88.99 From tss at iki.fi Mon Dec 5 01:40:54 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 01:40:54 +0200 Subject: [Dovecot] Dovecot crash non stop: "uid 0: exited on signal 11" In-Reply-To: <4EDBFFA2.2020701@lagoon.nc> References: <4EDBFFA2.2020701@lagoon.nc> Message-ID: On 5.12.2011, at 1.17, Amaury Le Pivain wrote: > I have an old physical freebsd 6.2 server running Dovecot 1.0.7. I wanted to virtualised it. > > So, I did a dd from the physical server and then I restored it on then now Virtual Machine. > > I booted the server, all services are running just fine excepted Dovecot. > > I tried to investigate the log as much as I can but i'm not getting any usefull pieces of information. The only entries I have in the log files are the following: > > /*log: /var/log/messages:*/ > > /Dec 5 09:53:35 hostname kernel: pid 33815 (imap), uid 0: exited on signal 11 This means it crashes. A gdb backtrace might tell why... But I think it would be less trouble to simply upgrade Dovecot to a newer version (at least v1.2.x) where there's a good chance that this has already been fixed. From tss at iki.fi Mon Dec 5 01:51:05 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 01:51:05 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111204220705.GA23867@tagged.lorens.org> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204220705.GA23867@tagged.lorens.org> Message-ID: <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> On 5.12.2011, at 0.07, Lorens Kockum wrote: > Timo Sirainen wrote: >> And before designing it I'd need to look into how the backup >> softwares usually work.. If anyone has any ideas about this, >> I'd like to hear. > > Simple or even moderately efficient backup programs like rsync > copy all the files. I'm mainly wondering if it's common for backup programs to support using a separate program to generate the backups. For example if there was a "dovecot-backup" binary that just dumps all (or new-since-last-backup) of the users' mails into stdout, which the backup program can use. Or perhaps in that case there wouldn't really be much of anything for the backup to do except to write it to tape.. >> Also backing up the attachment links could be problematic if >> the backup system doesn't support hard links. Each attachment >> always has at least 2 links, so if the backup doesn't realize >> that it at minimum duplicates the space used by attachments. > > rsync recognizes hard links with option -H, but at a very > noticeable performance cost when dealing with millions of > files. If the aa/bb/aabccddeeff-etc is unique across the whole > mailstore, it would be easy to replace the hard link with a > symlink, as you said: SIS was designed to work with hard links. They couldn't be replaced with symlinks without a redesign (which would be less efficient in normal operation). >> maybe not storing the attachments directly to backups, but add >> symlinks to them so they can be used to figure out what to >> restore. Or maybe the backing up wouldn't need a special tool, >> but the restoring tool could just read through the dbox files >> to see what attachments are also needed and write a list of >> them somewhere so they can be taken from backups as well. > > In the second way, you would have a separate hierarchy for > multiple-recipient attachments, or would the attachment be > "really" stored in the box of a recipient chosen at random? I meant that SIS would work exactly like it works now, with hard links and everything, but on top of that it would also create symlinks to the used files simply to make it easier to find what files are used. The annoying thing about that is that in error situations the symlinks can get out of sync with the reality. > Just some random thoughts: professionally, I use > Zimbra. Messages are stored in Maildir-equivalents. The time > it takes to backup is a quite severe constraint on the backup > technique. For example, compressing the backup files takes > too long, so the zip files are not compressed. Instead, the > individual mails are stored compressed on disk. Each backup > zips up the mails in a few big backup files. You mean you first create uncompressed zip files (why not just tar?) of all the mails to the filesystem and the backup software then backups those zip files? > An improvement > could be to sort mails into backup zip files so that once a > zip file is made, it stays the same. After all, if a mail is not > deleted a month after it is read, then it will probably stay > in the same state forever, or at least until the user starts a > keep-me-under-quota cleaning-up spree. During this time, backing > up that big zip file can just be a check to see if it is already > OK in the backup, which is much quicker. I have no idea if this > could be applied to Dovecot, but who knows. Dovecot's mdbox files already contain multiple messages in each file, so it should be a lot more efficient to do backups on those. And each message in an mdbox file can be compressed if zlib plugin is enabled. So I think that sounds quite a lot like what you propose. From stan at hardwarefreak.com Mon Dec 5 03:03:32 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sun, 04 Dec 2011 19:03:32 -0600 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> Message-ID: <4EDC1864.60703@hardwarefreak.com> On 12/4/2011 12:16 PM, Timo Sirainen wrote: > On 4.12.2011, at 19.41, Terry Carmen wrote: > >>>> If we can not safely restore from backup a user's mailbox with SiS enabled, we can not enable SiS. Any plan to include this backup recovery tool in dovecot 2.0.X or 2.1? >>> >>> I'd first have to design it. And before designing it I'd need to look into how the backup softwares usually work.. If anyone has any ideas about this, I'd like to hear. >> >> BackupPC uses rsync by default for *nix boxes. >> >> No idea what SiS is, but I'm guessing you're running into the same problem as backing up any other open file with changing internal data that may be inconsistent. > > Inconsistency is an issue, but it's not the biggest problem. It would be possible to write a tool that scans through all mails and makes sure everything is consistent after a restore. dbox mostly does this automatically already, but SIS would need a separate program to ensure its consistency. > > SIS is anyway a single instance attachment storage. So that lets say you send one 100 MB pdf to 10 people, and it's stored only once in disk under /attachments/aa/bb/aabccddeeff-etc. Each people would have their own unique link under /attachments/, but all of them would be hard linked to a common file. > > So the problem is mainly about restoring a single user's mails. The mail files are simple to restore, but then you need to figure out which attachments to restore. There's no simple way to know which attachment files belong to which users, so you need to scan through the mail files and see what attachments are referred to. > > Also backing up the attachment links could be problematic if the backup system doesn't support hard links. Each attachment always has at least 2 links, so if the backup doesn't realize that it at minimum duplicates the space used by attachments. > > So I was thinking that there probably could be some tool that during a user's backup it would write the attachments among the user's other files, so it would be easy to find all of the files needed for a restore. This would of course mean that backups can take a lot more space, because there's no SIS. Perhaps there could be some other alternatives .. like maybe not storing the attachments directly to backups, but add symlinks to them so they can be used to figure out what to restore. Or maybe the backing up wouldn't need a special tool, but the restoring tool could just read through the dbox files to see what attachments are also needed and write a list of them somewhere so they can be taken from backups as well. > > I'm not really sure what is the best way. Backup and restore user hard links to SiS files, but not the files themselves. A single user "Oops" isn't going to delete the shared SiS files (they're already read only until the "last user" aren't they?). Thus we can assume the SiS files are always intact but for catastrophic failure. To cope with catastrophic failure, create a "special" Dovecot administrator only mailbox (real/virtual/whatever) that "contains" all of the SiS files, a special Dovecot index. Back this mailbox up separately, just like you would any mailbox--i.e. backup the SiS mailbox independently from individual user backups. In the event of catastrophic failure, restore the SiS mailbox first, then user mailboxes, so user mailbox hard link creation during restore succeeds. I would think something like this should maintain compatibility with standard IMAP backup software. I don't know if this could be done directly at the filesystem level. If this special mailbox simply contained hard links to the SiS files, would a restore operation at the filesystem level simply attempt to (re)create the hard links, or would it actually writes the files to their original filesystem locations? If only the former, then this proposed solution would only work with IMAP based backup/restore. Just thinking out loud. There are probably better ways to do this. -- Stan From tss at iki.fi Mon Dec 5 03:45:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 03:45:19 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EDC1864.60703@hardwarefreak.com> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> Message-ID: On 5.12.2011, at 3.03, Stan Hoeppner wrote: > To cope with catastrophic failure, create a "special" Dovecot > administrator only mailbox (real/virtual/whatever) that "contains" all > of the SiS files, a special Dovecot index. I'm not thinking about a catastrophe. For that a regular full filesystem backup+restore would work mostly okay (a snapshot would be perfect, without snapshot some extra work would be needed). The problem is that people want to recover only one specific user's mails from some older backup, because they accidentally deleted the mails.. This needs to be somewhat easy to implement with SIS, but it isn't. From dovecot.fdop at tagged.lorens.org Mon Dec 5 09:19:27 2011 From: dovecot.fdop at tagged.lorens.org (Lorens Kockum) Date: Mon, 5 Dec 2011 08:19:27 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204220705.GA23867@tagged.lorens.org> <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> Message-ID: <20111205071927.GA20731@tagged.lorens.org> On Mon, Dec 05, 2011 at 01:51:05AM +0200, Timo Sirainen wrote: > I'm mainly wondering if it's common for backup programs to > support using a separate program to generate the backups. For > example if there was a "dovecot-backup" binary that just > dumps all (or new-since-last-backup) of the users' mails into > stdout, which the backup program can use. Or perhaps in that > case there wouldn't really be much of anything for the backup > to do except to write it to tape.. For databases, most commercial programs use some kind of application-specific plugins. Bakula has "Client Run Before Job" which permits indicating a command to be run before proceeding with the backup, maybe there is more. However I have not heard of any standardized way of doing it so that the application provider could provide a way to interact with multiple backup programs. It's more like each backup vendor boasting that his backup software can backup application XXX without downtime. > SIS was designed to work with hard links. They couldn't be > replaced with symlinks without a redesign (which would be less > efficient in normal operation). Right, but if the backup program recognized this then maybe the replacement by a symlink could be done only in the backup. rsync has to keep in memory all the inodes and check the list every time a hard link is found. If it knew that "a hard link in attachments should link to an identical file name in the common attachment SiS store. > [Zimbra] > > You mean you first create uncompressed zip files (why not > just tar?) of all the mails to the filesystem and the backup > software then backups those zip files? Well, not I, this is Zimbra's backup system :-) The backups are the destination zips. Maybe zip is used because the extension and extraction method is the same whether compressed or not; that way compression is just an option to the backup program to be turned on or off. > Dovecot's mdbox files already contain multiple messages in > each file, so it should be a lot more efficient to do backups > on those. And each message in an mdbox file can be compressed > if zlib plugin is enabled. So I think that sounds quite a lot > like what you propose. Is that combined or combinable with SiS? If attachments are in separate files, that means they are aligned on block boundaries, which make block-level SiS (like NetApp's) much more efficient. Think of an attachment sent to all department heads, all of whom forward the attachment to all their subordinates. From Mark.Zealey at webfusion.com Mon Dec 5 11:01:55 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Mon, 5 Dec 2011 09:01:55 +0000 Subject: [Dovecot] (no subject) Message-ID: From janfrode at tanso.net Mon Dec 5 11:36:24 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 5 Dec 2011 10:36:24 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204220705.GA23867@tagged.lorens.org> <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> Message-ID: <20111205093624.GA18025@dibs.tanso.net> On Mon, Dec 05, 2011 at 01:51:05AM +0200, Timo Sirainen wrote: > > I'm mainly wondering if it's common for backup programs to support using a separate program to generate the backups. For example if there was a "dovecot-backup" binary that just dumps all (or new-since-last-backup) of the users' mails into stdout, which the backup program can use. Or perhaps in that case there wouldn't really be much of anything for the backup to do except to write it to tape.. I know at least tivoli storage manager (TSM) should be able to handle such lists. AFAIK this is how GPFS's "mmbackup" utility works. It utilizes a fast inode scan API to find all candidate files, and will be much more efficient than a normal backup client that traverses the whole fs. https://www-304.ibm.com/support/docview.wss?uid=swg21305169 But in addition to new-since-last-backup, we would probably also need a deleted-since-last-backup feature. -jf From xavier.pons at uib.es Mon Dec 5 16:26:54 2011 From: xavier.pons at uib.es (Xavier Pons) Date: Mon, 05 Dec 2011 15:26:54 +0100 Subject: [Dovecot] lmtp panic in proxy lmtp director Message-ID: <4EDCD4AE.8030607@uib.es> Hi, we are getting some core dumps with signal 6 in ltmp on a dovecot director proxy server, like this: Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Panic: file lmtp-proxy.c: line 376 (lmtp_proxy_output_timeout): assertion failed: (proxy->data_input->eof) Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x363323d99a] -> /usr/lib64/dovecot/libdovecot.so.0() [0x363323d9e6] -> /usr/lib64/dovecot/libdovecot.so.0(i_error+0) [0x3633216f8f] -> dovecot/lmtp() [0x406e57] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xd4) [0x3633248ff4] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x5b) [0x3633249bdb] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x3633248c58] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x3633236fc3] -> dovecot/lmtp(main+0x154) [0x403f84] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x373cc1ec5d] -> dovecot/lmtp() [0x403d69] Dec 5 14:31:51 sproxy1 abrt[30067]: saved core dump of pid 29999 (/usr/libexec/dovecot/lmtp) to /var/spool/abrt/ccpp-1323091911-29999.new/coredump (1368064 bytes) Dec 5 14:31:51 sproxy1 dovecot: master: Error: service(lmtp): child 29999 killed with signal 6 (core dumped) we have something misconfigured or it's a bug on this dovecot version? our doveconf -n is: # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-71.29.1.el6.x86_64 x86_64 CentOS Linux release 6.0 (Final) auth_cache_size = 3 k auth_cache_ttl = 15 mins auth_verbose = yes base_dir = /var/run/dovecot/ default_client_limit = 30000 default_process_limit = 5000 director_doveadm_port = 990 director_mail_servers = 10.80.82.21 10.80.82.22 director_servers = 10.80.82.11 10.80.82.12 doveadm_proxy_port = 24245 lmtp_proxy = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = proxy=y nopassword=y starttls=any-cert driver = static } postmaster_address = xavier.pons at uib.es protocols = imap pop3 lmtp sieve service auth { client_limit = 27048 unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = dovecot mode = 0660 } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 991 } inet_listener director-doveadm { port = 990 } unix_listener director-userdb { mode = 0660 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap-login { executable = imap-login director inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { port = 30025 } } service managesieve-login { executable = managesieve-login director } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_cert = Hello, Could you confirm that the SIS is integrated and functional in the latest version of Dovecot? Regards Guy From terry at cnysupport.com Mon Dec 5 19:16:47 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 12:16:47 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> Message-ID: <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> It's working beautifully! Is there any way to get it to log failed login attempts with the user's IP address? I'd like to setup fail2ban to stop dictionary attacks, however even with debugging, the most I've been able to get it to say is: Dec 5 12:11:30 machinename dovecot: auth: Debug: client out: FAIL#0111#011user=username Is there any possibility of getting the remote IP in there somewhere, or is there a different setting specifically to enable logging auth failures? Thanks! From janfrode at tanso.net Mon Dec 5 20:06:37 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 5 Dec 2011 19:06:37 +0100 Subject: [Dovecot] lmtp panic in proxy lmtp director In-Reply-To: <4EDCD4AE.8030607@uib.es> References: <4EDCD4AE.8030607@uib.es> Message-ID: <20111205180637.GA27400@dibs.tanso.net> On Mon, Dec 05, 2011 at 03:26:54PM +0100, Xavier Pons wrote: > Hi, we are getting some core dumps with signal 6 in ltmp on a > dovecot director proxy server, like this: http://dovecot.org/list/dovecot/2011-September/060830.html http://www.dovecot.org/list/dovecot/2011-September/061395.html > we have something misconfigured or it's a bug on this dovecot version? I believe there's too short LMTP_PROXY_DATA_INPUT_TIMEOUT_MSECS in lmtp-proxy.c. -jf From ghandidrivesahumvee at rocketfish.com Mon Dec 5 20:17:57 2011 From: ghandidrivesahumvee at rocketfish.com (Dovecot-GDH) Date: Mon, 5 Dec 2011 10:17:57 -0800 Subject: [Dovecot] lmtp panic in proxy lmtp director In-Reply-To: <4EDCD4AE.8030607@uib.es> References: <4EDCD4AE.8030607@uib.es> Message-ID: This happens when the LMTP proxy doesn't receive feedback from the back-end LMTP process for a certain amount of time. This typically happens either because of very low I/O performance or NFS locks. Do an strace on your back-end LMTP processes. If you see that these processes are waiting on NFS locks ande you are using NFSv3, you should move over to NFSv4. On Dec 5, 2011, at 6:26 AM, Xavier Pons wrote: > Hi, we are getting some core dumps with signal 6 in ltmp on a dovecot director proxy server, > like this: > > Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Panic: file lmtp-proxy.c: line 376 (lmtp_proxy_output_timeout): assertion failed: (proxy->data_input->eof) > Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x363323d99a] -> /usr/lib64/dovecot/libdovecot.so.0() [0x363323d9e6] -> /usr/lib64/dovecot/libdovecot.so.0(i_error+0) [0x3633216f8f] -> dovecot/lmtp() [0x406e57] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xd4) [0x3633248ff4] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x5b) [0x3633249bdb] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x3633248c58] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x3633236fc3] -> dovecot/lmtp(main+0x154) [0x403f84] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x373cc1ec5d] -> dovecot/lmtp() [0x403d69] > Dec 5 14:31:51 sproxy1 abrt[30067]: saved core dump of pid 29999 (/usr/libexec/dovecot/lmtp) to /var/spool/abrt/ccpp-1323091911-29999.new/coredump (1368064 bytes) > Dec 5 14:31:51 sproxy1 dovecot: master: Error: service(lmtp): child 29999 killed with signal 6 (core dumped) > > we have something misconfigured or it's a bug on this dovecot version? > > our doveconf -n is: > # 2.0.15: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-71.29.1.el6.x86_64 x86_64 CentOS Linux release 6.0 (Final) > auth_cache_size = 3 k > auth_cache_ttl = 15 mins > auth_verbose = yes > base_dir = /var/run/dovecot/ > default_client_limit = 30000 > default_process_limit = 5000 > director_doveadm_port = 990 > director_mail_servers = 10.80.82.21 10.80.82.22 > director_servers = 10.80.82.11 10.80.82.12 > doveadm_proxy_port = 24245 > lmtp_proxy = yes > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave > passdb { > args = proxy=y nopassword=y starttls=any-cert > driver = static > } > postmaster_address = xavier.pons at uib.es > protocols = imap pop3 lmtp sieve > service auth { > client_limit = 27048 > unix_listener /var/spool/postfix/private/auth { > mode = 0666 > } > unix_listener auth-userdb { > group = dovecot > mode = 0660 > } > } > service director { > fifo_listener login/proxy-notify { > mode = 0666 > } > inet_listener { > port = 991 > } > inet_listener director-doveadm { > port = 990 > } > unix_listener director-userdb { > mode = 0660 > } > unix_listener login/director { > mode = 0666 > } > } > service doveadm { > inet_listener { > port = 24245 > } > } > service imap-login { > executable = imap-login director > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > service lmtp { > inet_listener lmtp { > port = 30025 > } > } > service managesieve-login { > executable = managesieve-login director > } > service pop3-login { > executable = pop3-login director > inet_listener pop3 { > port = 110 > } > inet_listener pop3s { > port = 995 > ssl = yes > } > } > ssl = required > ssl_cert = ssl_key = syslog_facility = local1 > verbose_proctitle = yes > protocol lmtp { > auth_socket_path = director-userdb > passdb { > args = /etc/dovecot/dovecot-ldap-pass.conf.lmtp > driver = ldap > } > } > protocol doveadm { > auth_socket_path = director-userdb > } > protocol imap { > mail_max_userip_connections = 20 > } > protocol pop3 { > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > } > > Xavier > > -- > xavier.pons at uib.es > Centre de Tecnologies de la Informaci? > Universitat Illes Balears > > From janfrode at tanso.net Mon Dec 5 21:14:40 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 5 Dec 2011 20:14:40 +0100 Subject: [Dovecot] Strange quota problem Message-ID: <20111205191440.GA28330@dibs.tanso.net> I have a strange problems with quota on v2.0.14. We have an ldap user directory, and all users should have a mailQuota defined there. My problem is that some users gets the quota enforced, while others don't, and "doveadm user" doesn't seem to agree with "doveadm quota ge gett" Ref: $ doveadm user janfrode at example.net userdb: janfrode at example.net home : /usr/local/atmail/users/j/a/janfrode at example.net mailQuota : quota_rule=*:storage=2100000 $ doveadm -f tab quota get -u janfrode at example.net Quota name Type Value Limit % UserQuota STORAGE 760 1000000 0 UserQuota MESSAGE 62 - 0 Why limit 1000000 instead of 2100000 ? $ doveadm user omar at example.net userdb: omar at example.net home : /usr/local/atmail/users/o/m/omar at example.net mailQuota : quota_rule=*:storage=1000000 $ sudo doveadm -f tab quota get -u omar at example.net Quota name Type Value Limit % UserQuota STORAGE 0 - 0 UserQuota MESSAGE 0 - 0 $ doveadm user testkunde at example.net userdb: testkunde at example.net home : /usr/local/atmail/users/t/e/testkunde at example.net mailQuota : quota_rule=*:storage=1000000 $ doveadm -f tab quota get -u testkunde at example.net Quota name Type Value Limit % UserQuota STORAGE 33918 - 0 UserQuota MESSAGE 137 - 0 Why no storage limit ? Config below: ------------------------------------------------------------------ $ grep -v ^# /etc/dovecot/dovecot-ldap.conf.ext |grep -v ^$ hosts = ldapm1.example.net:389 ldapm2.example.net:389 auth_bind = yes auth_bind_userdn = uid=%n,ou=people,o=%d,o=ISP,o=example,c=NET base = ou=people,o=%d,o=ISP,o=example,c=NET deref = never scope = onelevel user_attrs = mailMessageStore=home, mailLocation=mail, mailQuota=mailQuota=quota_rule=*:storage=%$ user_filter = (&(objectClass=examplePerson)(uid=%n)) $ doveconf -n # 2.0.14: /etc/dovecot/dovecot.conf doveconf: Warning: service auth { client_limit=4396 } is lower than required under max. load (4521) # OS: x86_64 Red Hat Enterprise Linux Server release 5.x (Tikanga) auth_verbose = yes auth_verbose_passwords = sha1 disable_plaintext_auth = no mail_gid = 3000 mail_location = maildir:~/:INDEX=/indexes/%1u/%1.1u/%u mail_plugins = quota mail_uid = 3000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { quota = maildir:UserQuota sieve = /sieve/%1u/%1.1u/%u/.dovecot.sieve sieve_dir = /sieve/%1u/%1.1u/%u sieve_max_script_size = 1M } protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { client_limit = 4396 } service imap-login { inet_listener imap { address = * port = 143 } } service imap-postlogin { executable = script-login /usr/local/sbin/imap-postlogin.sh } service imap { executable = imap imap-postlogin process_limit = 2048 } service lmtp { client_limit = 1 inet_listener lmtp { address = * port = 24 } process_limit = 25 } service managesieve-login { inet_listener sieve { address = * port = 4190 } service_count = 1 } service pop3-login { inet_listener pop3 { address = * port = 110 } } service pop3-postlogin { executable = script-login /usr/local/sbin/pop3-postlogin.sh } service pop3 { executable = pop3 pop3-postlogin process_limit = 2048 } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = quota sieve } protocol imap { imap_client_workarounds = delay-newmail mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = UID%u-%v } protocol sieve { managesieve_logout_format = bytes=%i/%o } ------------------------------------------------------------------ -jf From tss at iki.fi Mon Dec 5 21:48:08 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 21:48:08 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> Message-ID: On 3.12.2011, at 18.10, Terry Carmen wrote: > I'll post a writeup on the wiki on monday. I moved it to http://wiki2.dovecot.org/HowTo/ImapcProxy From tss at iki.fi Mon Dec 5 21:49:15 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 21:49:15 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> Message-ID: <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> On 5.12.2011, at 19.16, Terry Carmen wrote: > It's working beautifully! > > Is there any way to get it to log failed login attempts with the user's IP address? auth_verbose=yes > I'd like to setup fail2ban to stop dictionary attacks, however even with debugging, the most I've been able to get it to say is: > > Dec 5 12:11:30 machinename dovecot: auth: Debug: client out: FAIL#0111#011user=username If you enabled auth_debug, it enabled auth_verbose also.. So you should have those log messages. Maybe they're being logged to a different file? From tss at iki.fi Mon Dec 5 21:50:32 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 21:50:32 +0200 Subject: [Dovecot] Strange quota problem In-Reply-To: <20111205191440.GA28330@dibs.tanso.net> References: <20111205191440.GA28330@dibs.tanso.net> Message-ID: On 5.12.2011, at 21.14, Jan-Frode Myklebust wrote: > userdb: janfrode at example.net > home : /usr/local/atmail/users/j/a/janfrode at example.net > mailQuota : quota_rule=*:storage=2100000 it should say: quota_rule: *:storage=2100000 So, fix user_attrs: user_attrs = mailMessageStore=home, mailLocation=mail, mailQuota=quota_rule=*:storage=%$ From terry at cnysupport.com Mon Dec 5 22:27:58 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 15:27:58 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> Message-ID: <20111205152758.Horde.bmYUeVeGiNBO3SlOSgojj2A@www.cnysupport.com> >> I'll post a writeup on the wiki on monday. > > I moved it to http://wiki2.dovecot.org/HowTo/ImapcProxy Thanks! I didn't realize I was in the wrong wiki. Terry From janfrode at tanso.net Mon Dec 5 23:05:19 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 5 Dec 2011 22:05:19 +0100 Subject: [Dovecot] Strange quota problem In-Reply-To: References: <20111205191440.GA28330@dibs.tanso.net> Message-ID: <20111205210519.GA30303@dibs.tanso.net> On Mon, Dec 05, 2011 at 09:50:32PM +0200, Timo Sirainen wrote: > On 5.12.2011, at 21.14, Jan-Frode Myklebust wrote: > > > userdb: janfrode at example.net > > home : /usr/local/atmail/users/j/a/janfrode at example.net > > mailQuota : quota_rule=*:storage=2100000 > > it should say: > > quota_rule: *:storage=2100000 Oh, I had mailQuota=mailQuota=quota_rule=*:storage=%$ > So, fix user_attrs: > > user_attrs = mailMessageStore=home, mailLocation=mail, mailQuota=quota_rule=*:storage=%$ Thanks! -jf From terry at cnysupport.com Mon Dec 5 23:05:08 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 16:05:08 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> Message-ID: <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Mon, 5 Dec 2011 21:49:15 +0200 From: Timo Sirainen Reply-To: Dovecot Mailing List Subject: Re: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) To: Terry Carmen Cc: dovecot at dovecot.org > On 5.12.2011, at 19.16, Terry Carmen wrote: > >> It's working beautifully! >> >> Is there any way to get it to log failed login attempts with the >> user's IP address? > > auth_verbose=yes Got it. syslog_facility = mail auth_verbose = yes auth_verbose_passwords = plain auth_debug = yes mail_debug = yes I'm sure they're not all necessary. I was turning on all the logging I could find. 8-) The log looks like this: Dec 5 15:29:49 it dovecot: auth: Debug: auth client connected (pid=12028) Dec 5 15:30:03 it dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011lip=10.1.2.3#011rip=123.123.123.123#011lport=143#011rport=40816#011resp= Dec 5 15:30:03 it dovecot: auth: Debug: imap(username,123.123.123.123): lookup host=10.1.16.226 port=143 Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.2.3:143): Looking up IP address Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.2.3:143): Connecting to 10.1.2.3:143 Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.2.3:143): Server capabilities: IMAP4 IMAP4rev1 IDLE LOGIN-REFERRALS MAILBOX-REFERRALS NAMESPACE LITERAL+ UIDPLUS CHILDREN AUTH=NTLM Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.2.3:143): Authenticating as username Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.16.226:143): Disconnected Dec 5 15:30:05 it dovecot: auth: Debug: client out: FAIL#0111#011user=username The last line *almost* gets me enough for a fail2ban filter, but not quite, since there's no IP address. Is there something else I can turn on? Thanks, Terry From miha.vrhovnik at cordia.si Mon Dec 5 23:21:47 2011 From: miha.vrhovnik at cordia.si (Miha Vrhovnik) Date: Mon, 5 Dec 2011 22:21:47 +0100 Subject: [Dovecot] =?iso-8859-1?q?MS_Exchange_IMAP_Proxy_=28Logging_Auth_F?= =?iso-8859-1?q?ailures=3F=29?= In-Reply-To: <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> Message-ID: <20111205222148.9047A6F8E8D@miha> "Terry Carmen" wrote on 5.12.2011 22:05:08: ...cut ... >Dec 5 15:30:05 it dovecot: auth: Debug: client out: >FAIL#0111#011user=username > >The last line *almost* gets me enough for a fail2ban filter, but not >quite, since there's no IP address. > >Is there something else I can turn on? It's probably dfferent for proxy, but without it and with auth_verbose = yes as suggested by Timo I get Dec 5 15:02:32 mailstore dovecot: pop3-login: Disconnected (auth failed, 1 attempts): user=, method=PLAIN, rip=x.x.x.x, lip=y.y.y.y Regards, M From tss at iki.fi Mon Dec 5 23:24:23 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 23:24:23 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> Message-ID: <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> On 5.12.2011, at 23.05, Terry Carmen wrote: > The log looks like this: .. All of the lines are "debug" level. Find the "info" log. "doveadm log find" usually finds it for you. From terry at cnysupport.com Tue Dec 6 00:39:26 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 17:39:26 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> Message-ID: <20111205173926.Horde.1M-cPleGiNBO3Uge0ooC9NA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Mon, 5 Dec 2011 23:24:23 +0200 From: Timo Sirainen Reply-To: Dovecot Mailing List Subject: Re: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) To: Terry Carmen Cc: dovecot at dovecot.org > On 5.12.2011, at 23.05, Terry Carmen wrote: > >> The log looks like this: > .. > > All of the lines are "debug" level. Find the "info" log. "doveadm > log find" usually finds it for you. [root at server conf.d]# doveadm log find Looking for log files from /var/log Debug: /var/log/maillog Info: /var/log/maillog Warning: /var/log/maillog Error: /var/log/maillog Fatal: /var/log/maillog The successful logins look good. For example: Dec 5 17:01:50 it dovecot: imap-login: Login: user=, method=PLAIN, rip=123.123.123.123, lip=10.1.2.3, mpid=12277, TLS However there's nothing similar for the failed logins: Dec 5 17:01:36 it dovecot: auth: Debug: imapc(10.1.2.3:143): Authenticating as username Dec 5 17:01:36 it dovecot: auth: Debug: imapc(10.1.2.3:143): Disconnected Dec 5 17:01:38 it dovecot: auth: Debug: client out: FAIL#0111#011user=username Dec 5 17:01:46 it dovecot: auth: Debug: client in: AUTH#0112#011PLAIN#011service=imap#011secured#011lip=10.1.20.52#011rip=123.123.123.123#011lport=143#011rport=41748#011resp= I checked lib-imap-client/imapc-connection.c and found where the "Authenticating as" message comes from, but don't see anyplace where the I believe I found the section of code that does the imapc authentication, but don't see anyplace where auth failures are logged: Any thoughts? Terry From tss at iki.fi Tue Dec 6 00:48:02 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 6 Dec 2011 00:48:02 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <20111205173926.Horde.1M-cPleGiNBO3Uge0ooC9NA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> <20111205173926.Horde.1M-cPleGiNBO3Uge0ooC9NA@www.cnysupport.com> Message-ID: On 6.12.2011, at 0.39, Terry Carmen wrote: > I checked lib-imap-client/imapc-connection.c and found where the "Authenticating as" message comes from, but don't see anyplace where the > > I believe I found the section of code that does the imapc authentication, but don't see anyplace where auth failures are logged: Oh, right, passdb imapc doesn't log about failed authentication. I'll add it tomorrow. From terry at cnysupport.com Tue Dec 6 01:00:33 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 18:00:33 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> <20111205173926.Horde.1M-cPleGiNBO3Uge0ooC9NA@www.cnysupport.com> Message-ID: <20111205180033.Horde.U3wkEFeGiNBO3U0RY5KS9SA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Tue, 6 Dec 2011 00:48:02 +0200 From: Timo Sirainen Subject: Re: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) To: Terry Carmen Cc: dovecot at dovecot.org > On 6.12.2011, at 0.39, Terry Carmen wrote: > >> I checked lib-imap-client/imapc-connection.c and found where the >> "Authenticating as" message comes from, but don't see anyplace >> where the >> >> I believe I found the section of code that does the imapc >> authentication, but don't see anyplace where auth failures are >> logged: > > Oh, right, passdb imapc doesn't log about failed authentication. > I'll add it tomorrow. That's awesome! I really, really appreciate your help. Terry From ales.sevsek at gmail.com Tue Dec 6 10:52:56 2011 From: ales.sevsek at gmail.com (=?iso-8859-2?B?QWxluSBTRVapRUs=?=) Date: Tue, 6 Dec 2011 09:52:56 +0100 Subject: [Dovecot] Outlook double attachments Message-ID: <001e01ccb3f4$73741000$5a5c3000$@gmail.com> Hi! I wonder, have you managed to solve the problem. I have the same one (regarding double attachmets). Thanks for your help. BR Ale? SEV?EK __________________ Izjava o omejitvi odgovornosti: To elektronsko sporo?ilo in vse njegove morebitne priloge lahko vsebujejo zaupne in/ali privilegirane informacijeter namenjene izklju?no naslovniku. ?e ste sporo?ilo prejeli pomotoma, Vas prosimo, da o tem obvestite po?iljatelja, sporo?ilo pa takoj uni?ite. Kakr?nokoli nepoobla??eno razkritje, distribucija ali kopiranje vsebine sporo?ila je izrecno prepovedano. Legal disclaimer statement: This e-mail and any attachments may contain confidential and/or privileged information and is intended solely for the addressee. If you are not the intended recipient (or have received this e-mail by mistake), please notify the sender immediately and delete this e-mail. Any unauthorized reproduction, disclosure or distribution of the material in this e-mail is strictly forbidden. From apm at one.com Tue Dec 6 11:39:44 2011 From: apm at one.com (Peter Mogensen) Date: Tue, 06 Dec 2011 10:39:44 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: Message-ID: <4EDDE2E0.8070202@one.com> On 2011-12-02 22:22, dovecot-request at dovecot.org wrote: > It's implemented now in dovecot-2.1 hg. It also deprecates autocreate > plugin (but it still works the old way). The idea is that you can now > do e.g.: > > mailbox Trash { > auto = no > special_use = \Trash > } > ... This is great Timo. But for solving the localization problem for special-use folders, it's only half the way. Are there any plans to support RFC5464 SETMETADATA, so individual users can name their "\Trash" folder "Skraldspand" in danish or what ever they prefer? /Peter From p at state-of-mind.de Tue Dec 6 12:29:27 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 06 Dec 2011 11:29:27 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDDE2E0.8070202@one.com> References: <4EDDE2E0.8070202@one.com> Message-ID: <4EDDEE87.7090900@state-of-mind.de> Am 06.12.2011 10:39, schrieb Peter Mogensen: > On 2011-12-02 22:22, dovecot-request at dovecot.org wrote: > > It's implemented now in dovecot-2.1 hg. It also deprecates autocreate > > plugin (but it still works the old way). The idea is that you can now > > do e.g.: > > > > mailbox Trash { > > auto = no > > special_use = \Trash > > } > > ... > > This is great Timo. > But for solving the localization problem for special-use folders, it's > only half the way. > > Are there any plans to support RFC5464 SETMETADATA, so individual > users can name their "\Trash" folder "Skraldspand" in danish or what > ever they prefer? I believe setting the name should be a mapping that takes place in the MUA. p@ > > /Peter -- state of mind () Digitale Kommunikation www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5372 bytes Desc: S/MIME Cryptographic Signature URL: From alec at alec.pl Tue Dec 6 13:45:40 2011 From: alec at alec.pl (A.L.E.C) Date: Tue, 06 Dec 2011 12:45:40 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDDEE87.7090900@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> Message-ID: <4EDE0064.7040509@alec.pl> On 06.12.2011 11:29, Patrick Ben Koetter wrote: >> Are there any plans to support RFC5464 SETMETADATA, so individual >> users can name their "\Trash" folder "Skraldspand" in danish or what >> ever they prefer? Now I see in the hg that Timo doesn't implemented this nor CREATE-SPECIAL-USE. So, it's not so nice as I thought ;) There is metadata plugin. Should it be extended to support this? > I believe setting the name should be a mapping that takes place in the MUA. We have RFC6154 for this, don't try to be smarter. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From p at state-of-mind.de Tue Dec 6 14:43:03 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 13:43:03 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDE0064.7040509@alec.pl> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> Message-ID: <20111206124303.GA11375@state-of-mind.de> * A.L.E.C : > On 06.12.2011 11:29, Patrick Ben Koetter wrote: > > >> Are there any plans to support RFC5464 SETMETADATA, so individual > >> users can name their "\Trash" folder "Skraldspand" in danish or what > >> ever they prefer? > > Now I see in the hg that Timo doesn't implemented this nor > CREATE-SPECIAL-USE. So, it's not so nice as I thought ;) There is > metadata plugin. Should it be extended to support this? > > > I believe setting the name should be a mapping that takes place in the MUA. > > We have RFC6154 for this, don't try to be smarter. >From my understanding RFC 6154 serves to flag some IMAP mailboxes in order to indicate they should be used for special use e.g. as trash folder etc. I fail to see how RFC 6154 would help displaying localized mailbox names. Please point out. p at rick -- state of mind () Digitale Kommunikation http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From alec at alec.pl Tue Dec 6 14:45:28 2011 From: alec at alec.pl (A.L.E.C) Date: Tue, 06 Dec 2011 13:45:28 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206124303.GA11375@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> Message-ID: <4EDE0E68.2020305@alec.pl> On 06.12.2011 13:43, Patrick Ben Koetter wrote: > From my understanding RFC 6154 serves to flag some IMAP mailboxes in order to > indicate they should be used for special use e.g. as trash folder etc. > > I fail to see how RFC 6154 would help displaying localized mailbox names. Ok. It will not help for existing folders, but will allow creation of special-use folders with any name. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From p at state-of-mind.de Tue Dec 6 15:07:00 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 14:07:00 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDE0E68.2020305@alec.pl> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> Message-ID: <20111206130659.GB11375@state-of-mind.de> * A.L.E.C : > On 06.12.2011 13:43, Patrick Ben Koetter wrote: > > > From my understanding RFC 6154 serves to flag some IMAP mailboxes in order to > > indicate they should be used for special use e.g. as trash folder etc. > > > > I fail to see how RFC 6154 would help displaying localized mailbox names. > > Ok. It will not help for existing folders, but will allow creation of > special-use folders with any name. Yes. And on top of that a MUA should detect these SPECIAL-USE folders and automagically map its special folders (trash, archive, sent, drafts, etc.) to the servers SPECIAL-USE mailboxes. This should take place transparently and the special folders should carry localized mailbox names e.g. "Sent" or "Gesendet" or "..." At least that was my motivation to initiate that RFC about two years ago and getting closer to that goal was the reason to sponsor this feature in Dovecot 2.1. p at rick -- state of mind () Digitale Kommunikation http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From selcuk.yazar at gmail.com Tue Dec 6 15:07:06 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Tue, 6 Dec 2011 15:07:06 +0200 Subject: [Dovecot] Log/Process users pop3 plain password Message-ID: Hi, I have Postfix + OpenLdap + DoveCot configuration, and it's running succesfuly, i wantto convert users pop3 password NTPassword and LMPassword, so i ne plain passwor dof users, how can i do that. (Normaly using perl's ntlmgen function i convert password , but in plain) thanks in advance -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From thierry at mailhub.co.za Tue Dec 6 15:35:04 2011 From: thierry at mailhub.co.za (Thierry de Montaudry) Date: Tue, 6 Dec 2011 14:35:04 +0100 Subject: [Dovecot] MUAs creating different "Sent" folders In-Reply-To: <20111129214256.GL14970@charite.de> References: <20111129214256.GL14970@charite.de> Message-ID: <3B11D302-945B-4C13-B1F3-1558D564FF3C@mailhub.co.za> Hi, I know this might be a bit off topic, but having just fixed the problem on my machine, I though I might share it: on Mac OS Lion, with Apple Mail, you can change the system folders by editing the file ~/Library/Mail/V2/MailData/Accounts.plist (path might differ with older version of Mac OS). For each accounts it has 3 entries (DraftMailboxName, JunkMailboxName and SentMessagesMailboxName) that can be changed to any value you want. Quite useful when you are IMAPing your account from different systems. Just don't forget to close Mail while editing this file, and don't do it if you don't have a proper plist editor. This can be done as well in iOS, from the Mail settings, in the account advanced settings. But folders (Trash, Spam...) have to be created before. Regards, Thierry On 29 Nov 2011, at 22:42, Ralf Hildebrandt wrote: > While our webmail installation creates "Sent" as a Sent-Items Folder, > Apple Mail creates "Sent Messages". > > Is there a way of "mapping" foldernames e.g. > > map "Sent Messages" to "Sent" > map "Deletes Messages" to "Trash" > and so on? > > -- > Ralf Hildebrandt > Gesch?ftsbereich IT | Abteilung Netzwerk > Charit? - Universit?tsmedizin Berlin > Campus Benjamin Franklin > Hindenburgdamm 30 | D-12203 Berlin > Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 > ralf.hildebrandt at charite.de | http://www.charite.de > From patrickdk at patrickdk.com Tue Dec 6 17:00:34 2011 From: patrickdk at patrickdk.com (Patrick Domack) Date: Tue, 06 Dec 2011 10:00:34 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206130659.GB11375@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> Message-ID: <20111206100034.Horde.RaGtXpLnE6FO3i4SLvRDR2A@kishi.patrickdk.com> Guess the next nice step would be to get sieve scripts to be able to use the aliased special use folders. So you can just say, fileinto \Spam; Quoting Patrick Ben Koetter

: > * A.L.E.C : >> On 06.12.2011 13:43, Patrick Ben Koetter wrote: >> >> > From my understanding RFC 6154 serves to flag some IMAP mailboxes >> in order to >> > indicate they should be used for special use e.g. as trash folder etc. >> > >> > I fail to see how RFC 6154 would help displaying localized mailbox names. >> >> Ok. It will not help for existing folders, but will allow creation of >> special-use folders with any name. > > Yes. And on top of that a MUA should detect these SPECIAL-USE folders and > automagically map its special folders (trash, archive, sent, drafts, etc.) to > the servers SPECIAL-USE mailboxes. > > This should take place transparently and the special folders should carry > localized mailbox names e.g. "Sent" or "Gesendet" or "..." > > At least that was my motivation to initiate that RFC about two years ago and > getting closer to that goal was the reason to sponsor this feature in Dovecot > 2.1. > > p at rick > > -- > state of mind () > Digitale Kommunikation > > http://www.state-of-mind.de > > Franziskanerstra?e 15 Telefon +49 89 3090 4664 > 81669 M?nchen Telefax +49 89 3090 4666 > > Amtsgericht M?nchen Partnerschaftsregister PR 563 From stephan at rename-it.nl Tue Dec 6 17:50:03 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 06 Dec 2011 16:50:03 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206100034.Horde.RaGtXpLnE6FO3i4SLvRDR2A@kishi.patrickdk.com> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206100034.Horde.RaGtXpLnE6FO3i4SLvRDR2A@kishi.patrickdk.com> Message-ID: <4EDE39AB.6050103@rename-it.nl> Op 6-12-2011 16:00, Patrick Domack schreef: > Guess the next nice step would be to get sieve scripts to be able to > use the aliased special use folders. So you can just say, fileinto \Spam; Hmm, yeah. This will require some standardization efforts though. Your example is a bit problematic: - First, syntax-wise, the argument should be enclosed in double quotes; the grammar of the Sieve language is a bit sacred. :) - From what I've read, those SPECIAL-USE flags are not guaranteed to be unique, so the delivery may become ambiguous. So, it is not really an alias. - Making the bare fileinto command accept a SPECIAL-USE flag as an alternative to a regular folder name may be unwise (potentially causing naming conflicts, albeit unlikely). Some sort of :special_use tag would be in order. The ability to query which folder(s) are used for special purposes could be an alternative, although that is not ideal either. I am not sure how to approach this right now. Regards, Stephan. From wgillespie+dovecot at es2eng.com Tue Dec 6 20:14:44 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Tue, 06 Dec 2011 11:14:44 -0700 Subject: [Dovecot] MUAs creating different "Sent" folders In-Reply-To: <3B11D302-945B-4C13-B1F3-1558D564FF3C@mailhub.co.za> References: <20111129214256.GL14970@charite.de> <3B11D302-945B-4C13-B1F3-1558D564FF3C@mailhub.co.za> Message-ID: <4EDE5B94.3010308@es2eng.com> On 12/06/2011 06:35 AM, Thierry de Montaudry wrote: > Hi, > > I know this might be a bit off topic, but having just fixed the problem on my machine, I though I might share it: on Mac OS Lion, with Apple Mail, you can change the system folders by editing the file ~/Library/Mail/V2/MailData/Accounts.plist (path might differ with older version of Mac OS). > For each accounts it has 3 entries (DraftMailboxName, JunkMailboxName and SentMessagesMailboxName) that can be changed to any value you want. Quite useful when you are IMAPing your account from different systems. Just don't forget to close Mail while editing this file, and don't do it if you don't have a proper plist editor. This can also be done via the GUI in Apple Mail. - Click on the mailbox you want. - Mailbox > Use this mailbox for > (whatever) From patrickdk at patrickdk.com Tue Dec 6 21:18:38 2011 From: patrickdk at patrickdk.com (Patrick Domack) Date: Tue, 06 Dec 2011 14:18:38 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDE39AB.6050103@rename-it.nl> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206100034.Horde.RaGtXpLnE6FO3i4SLvRDR2A@kishi.patrickdk.com> <4EDE39AB.6050103@rename-it.nl> Message-ID: <20111206141838.Horde.VeXRY5LnE6FO3mqO69Xj0MA@kishi.patrickdk.com> Yep, I only meant it in the crudest of forms. I'm sure defining the correct syntax will be the hard part. Quoting Stephan Bosch : > Op 6-12-2011 16:00, Patrick Domack schreef: >> Guess the next nice step would be to get sieve scripts to be able >> to use the aliased special use folders. So you can just say, >> fileinto \Spam; > > Hmm, yeah. This will require some standardization efforts though. > > Your example is a bit problematic: > - First, syntax-wise, the argument should be enclosed in double > quotes; the grammar of the Sieve language is a bit sacred. :) > - From what I've read, those SPECIAL-USE flags are not guaranteed > to be unique, so the delivery may become ambiguous. So, it is not > really an alias. > - Making the bare fileinto command accept a SPECIAL-USE flag as an > alternative to a regular folder name may be unwise (potentially > causing naming conflicts, albeit unlikely). Some sort of > :special_use tag would be in order. > > The ability to query which folder(s) are used for special purposes > could be an alternative, although that is not ideal either. I am not > sure how to approach this right now. > > > Regards, > > Stephan. From tss at iki.fi Wed Dec 7 00:13:54 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 07 Dec 2011 00:13:54 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> Message-ID: <1323209634.15365.6.camel@hurina> On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > The mailbox names require a namespace prefix, so if you use e.g. "INBOX." prefix you'll need to use: I changed these so that they are inside namespace {} section and don't require namespace prefix in the name. That way I can include common mailbox definitions in example-config and still allow the namespace prefix to be easily changed. I'm anyway now wondering what the defaults should be? Could someone check what these defaults are for Outlook and any other clients you have: * "Drafts" is used by all clients * "Trash" is used by all clients * "Junk" is used by all clients? Or is "Spam" used by some? * "Sent" is used by Thunderbird, Evolution * "Sent Messages" is used by Apple Mail So I'm mainly wondering about "Sent" vs. "Sent Messages". From p at state-of-mind.de Wed Dec 7 00:26:09 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 23:26:09 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323209634.15365.6.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> Message-ID: <20111206222608.GC2292@state-of-mind.de> * Timo Sirainen : > On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > > > The mailbox names require a namespace prefix, so if you use e.g. "INBOX." prefix you'll need to use: > > I changed these so that they are inside namespace {} section and don't > require namespace prefix in the name. That way I can include common > mailbox definitions in example-config and still allow the namespace > prefix to be easily changed. > > I'm anyway now wondering what the defaults should be? Could someone > check what these defaults are for Outlook and any other clients you > have: > > * "Drafts" is used by all clients > * "Trash" is used by all clients > * "Junk" is used by all clients? Or is "Spam" used by some? > * "Sent" is used by Thunderbird, Evolution > * "Sent Messages" is used by Apple Mail > > So I'm mainly wondering about "Sent" vs. "Sent Messages". Are you looking for US-English mailbox names only? p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From slusarz at curecanti.org Wed Dec 7 00:27:22 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 06 Dec 2011 15:27:22 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206130659.GB11375@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> Message-ID: <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> Quoting Patrick Ben Koetter

: > * A.L.E.C : >> On 06.12.2011 13:43, Patrick Ben Koetter wrote: >> >> > From my understanding RFC 6154 serves to flag some IMAP mailboxes >> in order to >> > indicate they should be used for special use e.g. as trash folder etc. >> > >> > I fail to see how RFC 6154 would help displaying localized mailbox names. >> >> Ok. It will not help for existing folders, but will allow creation of >> special-use folders with any name. > > Yes. And on top of that a MUA should detect these SPECIAL-USE folders and > automagically map its special folders (trash, archive, sent, drafts, etc.) to > the servers SPECIAL-USE mailboxes. > > This should take place transparently and the special folders should carry > localized mailbox names e.g. "Sent" or "Gesendet" or "..." Except the localization conversions should be done on the MUA level, not the mailstore level (see, e.g., INBOX). As Timo noted in another message in this thread, for the most part there has been a informal standardization of special mailbox names to their English equivalents. There is really no reason to move away from this standardization, especially for MUAs that do not yet support RFC 6154 but may support a form auto-detection of common special mailbox names. michael From p at state-of-mind.de Wed Dec 7 00:34:51 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 23:34:51 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> Message-ID: <20111206223451.GD2292@state-of-mind.de> * Michael M Slusarz : > Quoting Patrick Ben Koetter

: > > >* A.L.E.C : > >>On 06.12.2011 13:43, Patrick Ben Koetter wrote: > >> > >>> From my understanding RFC 6154 serves to flag some IMAP > >>mailboxes in order to > >>> indicate they should be used for special use e.g. as trash folder etc. > >>> > >>> I fail to see how RFC 6154 would help displaying localized mailbox names. > >> > >>Ok. It will not help for existing folders, but will allow creation of > >>special-use folders with any name. > > > >Yes. And on top of that a MUA should detect these SPECIAL-USE folders and > >automagically map its special folders (trash, archive, sent, drafts, etc.) to > >the servers SPECIAL-USE mailboxes. > > > >This should take place transparently and the special folders should carry > >localized mailbox names e.g. "Sent" or "Gesendet" or "..." > > Except the localization conversions should be done on the MUA level, > not the mailstore level (see, e.g., INBOX). I believe that is exactly what I said in my lines above. > As Timo noted in another message in this thread, for the most part > there has been a informal standardization of special mailbox names > to their English equivalents. There is really no reason to move > away from this standardization, especially for MUAs that do not yet Where in my posting did I say I want to move away from that standard? > support RFC 6154 but may support a form auto-detection of common > special mailbox names. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From tss at iki.fi Wed Dec 7 00:35:54 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 07 Dec 2011 00:35:54 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206222608.GC2292@state-of-mind.de> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> Message-ID: <1323210956.15365.11.camel@hurina> On Tue, 2011-12-06 at 23:26 +0100, Patrick Ben Koetter wrote: > > I'm anyway now wondering what the defaults should be? Could someone > > check what these defaults are for Outlook and any other clients you > > have: > > > > * "Drafts" is used by all clients > > * "Trash" is used by all clients > > * "Junk" is used by all clients? Or is "Spam" used by some? > > * "Sent" is used by Thunderbird, Evolution > > * "Sent Messages" is used by Apple Mail > > > > So I'm mainly wondering about "Sent" vs. "Sent Messages". > > Are you looking for US-English mailbox names only? Yeah, just some defaults that most people could use without changes. Although maybe if all of them were set with autocreate=no there could be alternatives added. Like: mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } This way whichever mailbox the first client creates would be used as \Sent. Although if different clients create both of them there would then be two \Sent mailboxes. But the user would probably delete one of them and all would be good again. From slusarz at curecanti.org Wed Dec 7 00:40:57 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 06 Dec 2011 15:40:57 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206223451.GD2292@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> <20111206223451.GD2292@state-of-mind.de> Message-ID: <20111206154057.Horde.Ky5VRIF5lbhO3pn5gMOEWMA@bigworm.curecanti.org> Quoting Patrick Ben Koetter

: > * Michael M Slusarz : >> Quoting Patrick Ben Koetter

: >> >> >* A.L.E.C : >> >>On 06.12.2011 13:43, Patrick Ben Koetter wrote: >> >> >> >>> From my understanding RFC 6154 serves to flag some IMAP >> >>mailboxes in order to >> >>> indicate they should be used for special use e.g. as trash folder etc. >> >>> >> >>> I fail to see how RFC 6154 would help displaying localized >> mailbox names. >> >> >> >>Ok. It will not help for existing folders, but will allow creation of >> >>special-use folders with any name. >> > >> >Yes. And on top of that a MUA should detect these SPECIAL-USE folders and >> >automagically map its special folders (trash, archive, sent, >> drafts, etc.) to >> >the servers SPECIAL-USE mailboxes. >> > >> >This should take place transparently and the special folders should carry >> >localized mailbox names e.g. "Sent" or "Gesendet" or "..." >> >> Except the localization conversions should be done on the MUA level, >> not the mailstore level (see, e.g., INBOX). > > I believe that is exactly what I said in my lines above. > > >> As Timo noted in another message in this thread, for the most part >> there has been a informal standardization of special mailbox names >> to their English equivalents. There is really no reason to move >> away from this standardization, especially for MUAs that do not yet > > Where in my posting did I say I want to move away from that standard? The combination of the original author's comment, and your response which did not seem to disagree with him at all, made it ambiguous at best whether you were referring to localized mailbox names being stored on the server or being translated on the client. Looking through the entire thread, and seeing your previous message, I see that this was an incorrect assumption. I apologize for any misunderstanding. michael From p at state-of-mind.de Wed Dec 7 00:46:59 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 23:46:59 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206154057.Horde.Ky5VRIF5lbhO3pn5gMOEWMA@bigworm.curecanti.org> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> <20111206223451.GD2292@state-of-mind.de> <20111206154057.Horde.Ky5VRIF5lbhO3pn5gMOEWMA@bigworm.curecanti.org> Message-ID: <20111206224658.GE2292@state-of-mind.de> * Michael M Slusarz : > The combination of the original author's comment, and your response > which did not seem to disagree with him at all, made it ambiguous at > best whether you were referring to localized mailbox names being > stored on the server or being translated on the client. Looking > through the entire thread, and seeing your previous message, I see > that this was an incorrect assumption. I apologize for any > misunderstanding. Thank you. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From slusarz at curecanti.org Wed Dec 7 00:48:38 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 06 Dec 2011 15:48:38 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323210956.15365.11.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> Message-ID: <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> Quoting Timo Sirainen : > On Tue, 2011-12-06 at 23:26 +0100, Patrick Ben Koetter wrote: >> > I'm anyway now wondering what the defaults should be? Could someone >> > check what these defaults are for Outlook and any other clients you >> > have: >> > >> > * "Drafts" is used by all clients >> > * "Trash" is used by all clients >> > * "Junk" is used by all clients? Or is "Spam" used by some? 'Spam' is also used. This one is probably a bit more site-specific. >> > * "Sent" is used by Thunderbird, Evolution >> > * "Sent Messages" is used by Apple Mail >> > >> > So I'm mainly wondering about "Sent" vs. "Sent Messages". IIRC, at least some versions of Exchange use(d) "Sent Items". > This way whichever mailbox the first client creates would be used as > \Sent. Although if different clients create both of them there would > then be two \Sent mailboxes. But the user would probably delete one of > them and all would be good again. This will continue to be an issue until more clients support the RFC. michael From tss at iki.fi Wed Dec 7 00:49:49 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 07 Dec 2011 00:49:49 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323210956.15365.11.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> Message-ID: <1323211790.15365.12.camel@hurina> On Wed, 2011-12-07 at 00:35 +0200, Timo Sirainen wrote: > Yeah, just some defaults that most people could use without changes. > Although maybe if all of them were set with autocreate=no there could be > alternatives added. Like: > > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } I did this: http://hg.dovecot.org/dovecot-2.1/rev/9b9a206395f7 From bill-dovecot at carpenter.org Wed Dec 7 00:58:04 2011 From: bill-dovecot at carpenter.org (WJCarpenter) Date: Tue, 06 Dec 2011 14:58:04 -0800 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323209634.15365.6.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> Message-ID: <4EDE9DFC.4010101@carpenter.org> > On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > > I'm anyway now wondering what the defaults should be? Could someone > check what these defaults are for Outlook and any other clients you > have: > > * "Drafts" is used by all clients > * "Trash" is used by all clients > * "Junk" is used by all clients? Or is "Spam" used by some? > * "Sent" is used by Thunderbird, Evolution > * "Sent Messages" is used by Apple Mail > SquirrelMail (http://www.squirrelmail.org) and Hastymail2 (http://www.hastymail.org) webmail clients let you customize draft/trash/sent, but the defaults for both are Drafts, Trash, and Sent. From simon.brereton at buongiorno.com Wed Dec 7 01:02:47 2011 From: simon.brereton at buongiorno.com (Simon Brereton) Date: Tue, 6 Dec 2011 18:02:47 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> Message-ID: On 6 December 2011 17:48, Michael M Slusarz wrote: > Quoting Timo Sirainen : > >> On Tue, 2011-12-06 at 23:26 +0100, Patrick Ben Koetter wrote: >>> >>> > I'm anyway now wondering what the defaults should be? Could someone >>> > check what these defaults are for Outlook and any other clients you >>> > have: >>> > >>> > ?* "Drafts" is used by all clients >>> > ?* "Trash" is used by all clients >>> > ?* "Junk" is used by all clients? Or is "Spam" used by some? > > > 'Spam' is also used. ?This one is probably a bit more site-specific. > >>> > ?* "Sent" is used by Thunderbird, Evolution >>> > ?* "Sent Messages" is used by Apple Mail >>> > >>> > So I'm mainly wondering about "Sent" vs. "Sent Messages". > > > IIRC, at least some versions of Exchange use(d) "Sent Items". Certainly mine does, although I couldn't tell you which version. But then I've never seen an Exchange server that doesn't use that. Simon From tss at iki.fi Wed Dec 7 01:14:14 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 07 Dec 2011 01:14:14 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> Message-ID: <1323213254.15365.13.camel@hurina> On Tue, 2011-12-06 at 18:02 -0500, Simon Brereton wrote: > >>> > * "Sent" is used by Thunderbird, Evolution > >>> > * "Sent Messages" is used by Apple Mail > >>> > > >>> > So I'm mainly wondering about "Sent" vs. "Sent Messages". > > > > > > IIRC, at least some versions of Exchange use(d) "Sent Items". > > Certainly mine does, although I couldn't tell you which version. But > then I've never seen an Exchange server that doesn't use that. Exchange doesn't matter, but Outlook does. Does Outlook with IMAP also use "Sent Items" by default? From simon.brereton at buongiorno.com Wed Dec 7 01:30:05 2011 From: simon.brereton at buongiorno.com (Simon Brereton) Date: Tue, 6 Dec 2011 18:30:05 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323213254.15365.13.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> <1323213254.15365.13.camel@hurina> Message-ID: On 6 December 2011 18:14, Timo Sirainen wrote: > On Tue, 2011-12-06 at 18:02 -0500, Simon Brereton wrote: >> >>> > ?* "Sent" is used by Thunderbird, Evolution >> >>> > ?* "Sent Messages" is used by Apple Mail >> >>> > >> >>> > So I'm mainly wondering about "Sent" vs. "Sent Messages". >> > >> > >> > IIRC, at least some versions of Exchange use(d) "Sent Items". >> >> Certainly mine does, although I couldn't tell you which version. ?But >> then I've never seen an Exchange server that doesn't use that. > > Exchange doesn't matter, but Outlook does. Does Outlook with IMAP also > use "Sent Items" by default? It would appear to. But then I have a weird set-up, so may be it doesn't. On the Outlook I use at Work with Gmail a Sent Items is present. At home, with dovecot, it is not. Simon From robert at schetterer.org Wed Dec 7 08:45:53 2011 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 07 Dec 2011 07:45:53 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> Message-ID: <4EDF0BA1.605@schetterer.org> Am 06.12.2011 23:48, schrieb Michael M Slusarz: > Quoting Timo Sirainen : > >> On Tue, 2011-12-06 at 23:26 +0100, Patrick Ben Koetter wrote: >>> > I'm anyway now wondering what the defaults should be? Could someone >>> > check what these defaults are for Outlook and any other clients you >>> > have: >>> > >>> > * "Drafts" is used by all clients >>> > * "Trash" is used by all clients >>> > * "Junk" is used by all clients? Or is "Spam" used by some? > > 'Spam' is also used. This one is probably a bit more site-specific. > >>> > * "Sent" is used by Thunderbird, Evolution >>> > * "Sent Messages" is used by Apple Mail >>> > >>> > So I'm mainly wondering about "Sent" vs. "Sent Messages". > > IIRC, at least some versions of Exchange use(d) "Sent Items". at last , at now there is no way at outlook 2010 to configure default imap junk folder ( only with reg patches, or filters ) cause this folder is special used by some antispam detection internal outlook,i guess, hope this may change by MS someday > >> This way whichever mailbox the first client creates would be used as >> \Sent. Although if different clients create both of them there would >> then be two \Sent mailboxes. But the user would probably delete one of >> them and all would be good again. > > This will continue to be an issue until more clients support the RFC. > > michael > -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From robert at schetterer.org Wed Dec 7 08:48:34 2011 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 07 Dec 2011 07:48:34 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> <1323213254.15365.13.camel@hurina> Message-ID: <4EDF0C42.800@schetterer.org> Am 07.12.2011 00:30, schrieb Simon Brereton: > On 6 December 2011 18:14, Timo Sirainen wrote: >> On Tue, 2011-12-06 at 18:02 -0500, Simon Brereton wrote: >>>>>>> * "Sent" is used by Thunderbird, Evolution >>>>>>> * "Sent Messages" is used by Apple Mail >>>>>>> >>>>>>> So I'm mainly wondering about "Sent" vs. "Sent Messages". >>>> >>>> >>>> IIRC, at least some versions of Exchange use(d) "Sent Items". >>> >>> Certainly mine does, although I couldn't tell you which version. But >>> then I've never seen an Exchange server that doesn't use that. >> >> Exchange doesn't matter, but Outlook does. Does Outlook with IMAP also >> use "Sent Items" by default? > > It would appear to. But then I have a weird set-up, so may be it > doesn't. On the Outlook I use at Work with Gmail a Sent Items is > present. At home, with dovecot, it is not. > > Simon there is no outlook, speak of outlook versions and patchlevels, outlook versions are much different ! i would only concentrate only on the newest version -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From janfrode at tanso.net Wed Dec 7 12:11:43 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Wed, 7 Dec 2011 11:11:43 +0100 Subject: [Dovecot] master user only for sieve Message-ID: <20111207101143.GA19363@dibs.tanso.net> Changes in SOGo is forcing me to define a master user, so that SOGo can disable sieve out-of-office processing on a given date. I'm not too happy about having master users that are allowed to read the users messages, so is it possible to define a master user that can only log in trough manage-sieve? -jf From Yann.Dupont at univ-nantes.fr Wed Dec 7 12:25:20 2011 From: Yann.Dupont at univ-nantes.fr (Yann Dupont) Date: Wed, 07 Dec 2011 11:25:20 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> Message-ID: <4EDF3F10.1090604@univ-nantes.fr> Le 05/12/2011 02:45, Timo Sirainen a ?crit : > On 5.12.2011, at 3.03, Stan Hoeppner wrote: > >> To cope with catastrophic failure, create a "special" Dovecot >> administrator only mailbox (real/virtual/whatever) that "contains" all >> of the SiS files, a special Dovecot index. > > I'm not thinking about a catastrophe. For that a regular full filesystem backup+restore would work mostly okay (a snapshot would be perfect, without snapshot some extra work would be needed). The problem is that people want to recover only one specific user's mails from some older backup, because they accidentally deleted the mails.. This needs to be somewhat easy to implement with SIS, but it isn't. > > Other problem I'm thinking of, because I'd like to use SIS on our production servers ; but right now I think I can't . We have lots of users (+5000 teachers/engineers) on our first setup, +70000 students on our 2nd setup. The user base is on LDAP, and move on a daily basis. When a user leave the university, he has right to use mailbox for a certain time and then we close the account. Right now, we archive and then delete the mailbox directories (we don't use special dovecot mecanism : we migrated from another system not long time ago and we had special scripts for that). If we use SIS, what happen to the attachements ? The usage count will never go to 0, and the attachements will stay there forever. In that situation, I think we have no means to correct the attachement usage count ? -- Yann Dupont - Service IRTS, DSI Universit? de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont at univ-nantes.fr From Yann.Dupont at univ-nantes.fr Wed Dec 7 13:02:22 2011 From: Yann.Dupont at univ-nantes.fr (Yann Dupont) Date: Wed, 07 Dec 2011 12:02:22 +0100 Subject: [Dovecot] problems when using dsync between servers Message-ID: <4EDF47BE.8080703@univ-nantes.fr> Hello, I'm trying to migrate from maildir++ to mdbox. The maildir++ is a leftover of our previous setup (was using courier) We have 3 virtuals servers for our +70000 accounts. Now, I'd like to use mdbox, so I'm trying using dsync for that. I setup a new virtual server, configured for mdbox. 1st, I tried a basic setup: I established a file with all my accounts (taken from LDAP) and then I use this script : FILENAME=$1 while read LINE do dsync -u $LINE backup $LINE at my_new_server done < $FILENAME But it's quite slow and dsync hangs. So I tried another approach using multi threaded python. Much faster (using all the cores), but dsync still hangs on some accounts. After a certain time dsync exit with an error like that : Panic: file dsync-worker-local.c: line 1688 (local_worker_save_msg_continue): assertion failed: (ret == -1) dsync-remote(E072184L): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x3fd8a) [0x7f34fc577d8a] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f34fc577e72] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f34fc55119f] -> dsync() [0x40ff0b] -> dsync() [0x410142] -> dsync(dsync_worker_msg_save+0x99) [0x40f639] -> dsync() [0x40e24a] -> dsync() [0x40d8ef] -> dsync() [0x40dbfc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x48) [0x7f34fc5830d8] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f34fc58403f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f34fc583068] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f34fc5713a3] -> dsync(main+0x9e1) [0x4078b1] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f34fbde9c4d] -> dsync() [0x406cf9] This is on a RUNNNING server. My aim was to make some pass on the running server, then stop it and make a last pass to finish the process. Is dsync supposed to run only on a stopped server ? Is my approach totally wrong ? -- Yann Dupont - Service IRTS, DSI Universit? de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont at univ-nantes.fr From stephan at rename-it.nl Wed Dec 7 13:32:21 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 07 Dec 2011 12:32:21 +0100 Subject: [Dovecot] master user only for sieve In-Reply-To: <20111207101143.GA19363@dibs.tanso.net> References: <20111207101143.GA19363@dibs.tanso.net> Message-ID: <4EDF4EC5.9000302@rename-it.nl> Op 7-12-2011 11:11, Jan-Frode Myklebust schreef: > Changes in SOGo is forcing me to define a master user, so that SOGo can > disable sieve out-of-office processing on a given date. I'm not too > happy about having master users that are allowed to read the users > messages, so is it possible to define a master user that can only log in > trough manage-sieve? I must say I don't really know about that. However, I do have a suggestion for a different approach. You can define a vacation response action with an expiry date, as follows: require ["date", "relational", "vacation"]; if currentdate :value "le" "date" "2011-12-09" { vacation "I'm out of office this week. I'll be back on Saturday 10th to reply to your e-mails."; } This means that there is no need to remove the vacation rule explicitly. It is inactive and can be removed at a (much) later time. You can also plan vacation responses in the future using the same method. Of course, the question is whether the SoGo GUI supports something like this, but I think it should. Regards, Stephan. From janfrode at tanso.net Wed Dec 7 13:57:13 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Wed, 7 Dec 2011 12:57:13 +0100 Subject: [Dovecot] master user only for sieve In-Reply-To: <4EDF4EC5.9000302@rename-it.nl> References: <20111207101143.GA19363@dibs.tanso.net> <4EDF4EC5.9000302@rename-it.nl> Message-ID: <20111207115713.GA21832@dibs.tanso.net> On Wed, Dec 07, 2011 at 12:32:21PM +0100, Stephan Bosch wrote: > > However, I do have a suggestion for a different approach. You can > define a vacation response action with an expiry date, as follows: > > require ["date", "relational", "vacation"]; > > if currentdate :value "le" "date" "2011-12-09" { > vacation "I'm out of office this week. I'll be back on > Saturday 10th to reply to your e-mails."; > } Thanks! I was looking for something like this, but don't know sieve enough to find it myself. This is a much nicer approach. I'll suggest it to the sogo developers. -jf From CMarcus at Media-Brokers.com Wed Dec 7 13:46:26 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 07 Dec 2011 06:46:26 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323209634.15365.6.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> Message-ID: <4EDF5212.7070501@Media-Brokers.com> On 2011-12-06 5:13 PM, Timo Sirainen wrote: > * "Trash" is used by all clients Outlook uses 'Deleted Items', not 'Trash'... -- Best regards, Charles From ef at math.uni-bonn.de Wed Dec 7 13:47:14 2011 From: ef at math.uni-bonn.de (Edgar =?iso-8859-1?B?RnXf?=) Date: Wed, 7 Dec 2011 12:47:14 +0100 Subject: [Dovecot] master user only for sieve In-Reply-To: <20111207101143.GA19363@dibs.tanso.net> References: <20111207101143.GA19363@dibs.tanso.net> Message-ID: <20111207114714.GF25413@gumme.math.uni-bonn.de> I have the following for 1.2. You may search the list archive, I asked that question about halv a year ago and Timo answererd it for both 1.2 and 2.0. auth default { [...] # Master-Benutzer f?r Sieve. # Wirkt nur f?r Sieve, weil es master.imap und master.pop nicht gibt. passdb passwd-file { master = yes args = DOVECOT_CONFDIR/master.%s # kein pass = yes, weil das bei LDAP-Authentication-Binds nicht geht. } [...] } And a master.sieve file containing sievemaster:{SHA}...... From CMarcus at Media-Brokers.com Wed Dec 7 14:08:42 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 07 Dec 2011 07:08:42 -0500 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EDF3F10.1090604@univ-nantes.fr> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> <4EDF3F10.1090604@univ-nantes.fr> Message-ID: <4EDF574A.3060100@Media-Brokers.com> On 2011-12-07 5:25 AM, Yann Dupont wrote: > > Right now, we archive and then delete the mailbox directories (we don't > use special dovecot mecanism : we migrated from another system not long > time ago and we had special scripts for that). > > If we use SIS, what happen to the attachements ? The usage count will > never go to 0, and the attachements will stay there forever. ? Attachment count for any messages that were *only* in those deleted mailbox directories would go to zero after you delete them, and then the attachments would be deleted. Dovecot wouldn't know about any that were archived outside of dovecots knowledge. -- Best regards, Charles From arne at drlinux.no Wed Dec 7 15:28:18 2011 From: arne at drlinux.no (Arne K. Haaje) Date: Wed, 07 Dec 2011 14:28:18 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDE9DFC.4010101@carpenter.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> Message-ID: <2028924.r07FOCeGlj@trillian> Tirsdag 6. desember 2011 14.58.04 skrev WJCarpenter: > > On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > > > > I'm anyway now wondering what the defaults should be? Could someone > > check what these defaults are for Outlook and any other clients you > > > > have: > > * "Drafts" is used by all clients > > * "Trash" is used by all clients > > * "Junk" is used by all clients? Or is "Spam" used by some? > > * "Sent" is used by Thunderbird, Evolution > > * "Sent Messages" is used by Apple Mail > > SquirrelMail (http://www.squirrelmail.org) and Hastymail2 > (http://www.hastymail.org) webmail clients let you customize > draft/trash/sent, but the defaults for both are Drafts, Trash, and Sent. Thunderbird also use a Templates folder. Arne -- Arne K. Haaje - Dr Linux http://www.drlinux.no/ LinkedIn: http://no.linkedin.com/pub/arne-haaje/27/189/bb From user+dovecot at localhost.localdomain.org Wed Dec 7 15:55:09 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Wed, 07 Dec 2011 14:55:09 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <2028924.r07FOCeGlj@trillian> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> <2028924.r07FOCeGlj@trillian> Message-ID: <4EDF703D.2090505@localhost.localdomain.org> On 12/07/2011 02:28 PM Arne K. Haaje wrote: > Thunderbird also use a Templates folder. Yes, I also noticed that. But http://tools.ietf.org/html/rfc6154#section-2 doesn't mention a mailbox for templates. Regards, Pascal -- The trapper recommends today: face1e55.1134114 at localdomain.org From tss at iki.fi Wed Dec 7 16:15:35 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 7 Dec 2011 16:15:35 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EDF3F10.1090604@univ-nantes.fr> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> <4EDF3F10.1090604@univ-nantes.fr> Message-ID: On 7.12.2011, at 12.25, Yann Dupont wrote: > Other problem I'm thinking of, because I'd like to use SIS on our production servers ; but right now I think I can't . > > We have lots of users (+5000 teachers/engineers) on our first setup, +70000 students on our 2nd setup. > > The user base is on LDAP, and move on a daily basis. When a user leave the university, he has right to use mailbox for a certain time and then we close the account. > > Right now, we archive and then delete the mailbox directories (we don't use special dovecot mecanism : we migrated from another system not long time ago and we had special scripts for that). > > If we use SIS, what happen to the attachements ? The usage count will never go to 0, and the attachements will stay there forever. > > In that situation, I think we have no means to correct the attachement usage count ? You'll need to change the deletion script then. Run: doveadm expunge -u user mailbox '*' all before doing rm -rf for the user's mails. And in the archiving step you should do it with dsync with mail_attachment_dir disabled in the destination storage, so the the attachments get written to the archive directly instead of only referencing SIS. From tss at iki.fi Wed Dec 7 16:22:01 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 7 Dec 2011 16:22:01 +0200 Subject: [Dovecot] v2.x services documentation Message-ID: <04D662E7-2A0A-448B-BA21-1E337A400CA6@iki.fi> If you've ever wanted to know everything about the service {} blocks, this should be quite helpful: http://wiki2.dovecot.org/Services From p at state-of-mind.de Wed Dec 7 16:35:00 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 7 Dec 2011 15:35:00 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDF703D.2090505@localhost.localdomain.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> <2028924.r07FOCeGlj@trillian> <4EDF703D.2090505@localhost.localdomain.org> Message-ID: <20111207143500.GB5185@state-of-mind.de> * Pascal Volk : > On 12/07/2011 02:28 PM Arne K. Haaje wrote: > > Thunderbird also use a Templates folder. > > Yes, I also noticed that. But > http://tools.ietf.org/html/rfc6154#section-2 doesn't mention a mailbox > for templates. IIRC IETF allows to register new SPECIAL-USE mailboxes. 'templates' might be a good candidate. p at rick -- state of mind () Digitale Kommunikation http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From robert at schetterer.org Wed Dec 7 16:49:20 2011 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 07 Dec 2011 15:49:20 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111207143500.GB5185@state-of-mind.de> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> <2028924.r07FOCeGlj@trillian> <4EDF703D.2090505@localhost.localdomain.org> <20111207143500.GB5185@state-of-mind.de> Message-ID: <4EDF7CF0.2030403@schetterer.org> Am 07.12.2011 15:35, schrieb Patrick Ben Koetter: > * Pascal Volk : >> On 12/07/2011 02:28 PM Arne K. Haaje wrote: >>> Thunderbird also use a Templates folder. >> >> Yes, I also noticed that. But >> http://tools.ietf.org/html/rfc6154#section-2 doesn't mention a mailbox >> for templates. > > IIRC IETF allows to register new SPECIAL-USE mailboxes. 'templates' might be a > good candidate. > > p at rick > TB also has a archives folder as default -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From CMarcus at Media-Brokers.com Wed Dec 7 17:02:52 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 07 Dec 2011 10:02:52 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDF703D.2090505@localhost.localdomain.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> <2028924.r07FOCeGlj@trillian> <4EDF703D.2090505@localhost.localdomain.org> Message-ID: <4EDF801C.9090508@Media-Brokers.com> On 2011-12-07 8:55 AM, Pascal Volk wrote: > On 12/07/2011 02:28 PM Arne K. Haaje wrote: >> > Thunderbird also use a Templates folder. > Yes, I also noticed that. But > http://tools.ietf.org/html/rfc6154#section-2 doesn't mention a mailbox > for templates. Nevertheless, it is very handy functionality... it isn't just a folder. -- Best regards, Charles From sacha.xxxx at omnitechweb.it Wed Dec 7 16:02:23 2011 From: sacha.xxxx at omnitechweb.it (Sacha xxxx) Date: Wed, 7 Dec 2011 15:02:23 +0100 Subject: [Dovecot] dovecot 2.0 sieve if working, managesieve not. Message-ID: <9DD2BA39-3F7E-4612-8A8F-37967E4491C4@omnitechweb.it> Hi, this is my configuration # OS: Linux 2.6.32-131.0.15.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.1 (Santiago) ext4 auth_debug = yes auth_master_user_separator = * auth_username_format = %Lu auth_verbose = yes disable_plaintext_auth = no info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Dovecot ready mail_debug = yes mail_gid = 999 mail_home = /MAIL/%d/%n/ mail_location = maildir:/MAIL/%d/%n/ mail_log_prefix = "%Us(%u): " mail_plugins = " quota" mail_privileged_group = mail mail_uid = 999 passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes pass = yes } plugin { quota = maildir:User quota quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/sieve/dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve service auth { unix_listener auth-userdb { group = mail mode = 0660 user = postfix } } service managesieve-login { executable = /usr/libexec/dovecot/managesieve-login inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = mail mode = 0666 user = mail } user = mail } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.user driver = ldap } doveconf: Error: protocols: Unknown protocol: sieve doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: protocols: Unknown protocol: sieve I get the error Unknown protocol: sieve The installed rpm package is this: dovecot-2.0.9-2.el6.x86_64 The sieve filtering is working: 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: opening script /MAIL/***/user//sieve/dovecot.sieve 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: script /MAIL/***/user//sieve/dovecot.sieve successfully compiled 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: executing script from /MAIL/***/utente01//sieve/dovecot.sieve 2011-12-07 12:12:29 LDA(utente01@***): Info: sieve: msgid=<4EDF4A1C.9010509@***>: stored mail into mailbox 'INBOX' But the manage sieve won't work. It seems that pigeonhole is installed because /usr/libexec/dovecot/managesieve-login exist and is not empty. Can you help me? Thank You Sushi. From wgillespie+dovecot at es2eng.com Wed Dec 7 17:45:31 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Wed, 07 Dec 2011 08:45:31 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323209634.15365.6.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> Message-ID: <4EDF8A1B.3050105@es2eng.com> On 12/06/2011 03:13 PM, Timo Sirainen wrote: > On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > >> The mailbox names require a namespace prefix, so if you use e.g. "INBOX." prefix you'll need to use: > > I changed these so that they are inside namespace {} section and don't > require namespace prefix in the name. That way I can include common > mailbox definitions in example-config and still allow the namespace > prefix to be easily changed. > > I'm anyway now wondering what the defaults should be? Could someone > check what these defaults are for Outlook and any other clients you > have: > > * "Drafts" is used by all clients > * "Trash" is used by all clients > * "Junk" is used by all clients? Or is "Spam" used by some? > * "Sent" is used by Thunderbird, Evolution > * "Sent Messages" is used by Apple Mail > > So I'm mainly wondering about "Sent" vs. "Sent Messages". Outlook 2010 lets you select a mailbox for Trash and Sent (version 2007 only lets you select a mailbox for Sent messages). Outlook default names for Trash is "Deleted Items" (as someone pointed out) and for junk is "Junk E-mail". Willie From tss at iki.fi Wed Dec 7 17:56:24 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 7 Dec 2011 17:56:24 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDF8A1B.3050105@es2eng.com> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDF8A1B.3050105@es2eng.com> Message-ID: On 7.12.2011, at 17.45, Willie Gillespie wrote: > Outlook 2010 lets you select a mailbox for Trash and Sent (version 2007 only lets you select a mailbox for Sent messages). > Outlook default names for Trash is "Deleted Items" (as someone pointed out) and for junk is "Junk E-mail". And the default name for Sent is "Sent Items"? Wonder if I should add those also to the example config.. From Yann.Dupont at univ-nantes.fr Wed Dec 7 18:02:51 2011 From: Yann.Dupont at univ-nantes.fr (Yann Dupont) Date: Wed, 07 Dec 2011 17:02:51 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> <4EDF3F10.1090604@univ-nantes.fr> Message-ID: <4EDF8E2B.7020204@univ-nantes.fr> Le 07/12/2011 15:15, Timo Sirainen a ?crit : > On 7.12.2011, at 12.25, Yann Dupont wrote: > doveadm expunge -u user mailbox '*' all > > before doing rm -rf for the user's mails. And in the archiving step you should do it with dsync with mail_attachment_dir disabled in the destination storage, so the the attachments get written to the archive directly instead of only referencing SIS. > > Yes, I understand, it will work. But, if case of any error (even our fault : premature end of script, for example) you can still end up with attachement forever lost on the filesystem. Right, it SHOULD not happen, and it probably won't represent a big volume. But Still, it could happen under specific circonstances. In that case, I don't see any simple way to detect that kind of files ? Do you see how a script could detect some orphaned links ?? For the archiving, good idea to use dsync, thanks for your answer. -- Yann Dupont - Service IRTS, DSI Universit? de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont at univ-nantes.fr From Juergen.Obermann at hrz.uni-giessen.de Wed Dec 7 18:12:03 2011 From: Juergen.Obermann at hrz.uni-giessen.de (=?iso-8859-1?b?SvxyZ2Vu?= Obermann) Date: Wed, 07 Dec 2011 17:12:03 +0100 Subject: [Dovecot] lazy_expunge plugin and folder subscription trouble Message-ID: <20111207171203.32263dknm9tyodgc@webmail.hrz.uni-giessen.de> Hello, I wanted to test the lazy expunge plugin together with mdbox. It seems to me that the folder subscriptions file in the mdbox directory was overwritten with only a few folder names every time I added or removed something in the list of subscribed folders, or even if I turned the imap folder subscription feature off and on. Here is my setup: # 2.0.16: /opt/local/etc/dovecot/dovecot.conf # OS: SunOS 5.10 sun4v mail_location = mdbox:~/mdbox mail_plugins = mail_log notify quota lazy_expunge zlib mdbox_rotate_interval = 1 days mdbox_rotate_size = 16 M namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes list = no location = prefix = Mail/ separator = / subscriptions = yes type = private } namespace { location = maildir:/var/mail/public:CONTROL=~/Maildir/public:INDEX=~/Maildir/public prefix = Public/ separator = / subscriptions = no type = public } namespace { location = mdbox:~/mdbox:MAILBOXDIR=expunged prefix = .EXPUNGED/ separator = / } plugin { autocreate = Trash autocreate2 = caughtspam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = caughtspam autosubscribe3 = Sent autosubscribe4 = Drafts fts = squat lazy_expunge = .EXPUNGED/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = fs:Home-Verzeichnis:noenforcing sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 3 } protocols = imap pop3 lmtp sieve quota_full_tempfail = yes sendmail_path = /usr/lib/sendmail service auth { client_limit = 11120 } service imap-login { process_min_avail = 16 service_count = 0 vsz_limit = 640 M } service imap { process_limit = 4096 vsz_limit = 1 G } ssl_cert = refcount > 0) Message-ID: <4EDF9185.7060805@localhost.localdomain.org> Hi Timo, right after delivering the message to the INBOX the lmtp crashes. I wonder about the "Sent" in the attached backtrace. Regards, Pascal -- The trapper recommends today: c01dcofe.1134117 at localdomain.org -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: doveconf.txt URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: lmtp.bt URL: From wgillespie+dovecot at es2eng.com Wed Dec 7 18:29:20 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Wed, 07 Dec 2011 09:29:20 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDF8A1B.3050105@es2eng.com> Message-ID: <4EDF9460.4060409@es2eng.com> On 12/07/2011 08:56 AM, Timo Sirainen wrote: > On 7.12.2011, at 17.45, Willie Gillespie wrote: > >> Outlook 2010 lets you select a mailbox for Trash and Sent (version 2007 only lets you select a mailbox for Sent messages). >> Outlook default names for Trash is "Deleted Items" (as someone pointed out) and for junk is "Junk E-mail". > > And the default name for Sent is "Sent Items"? Yes From sacha.xxxx at omnitechweb.it Wed Dec 7 18:31:29 2011 From: sacha.xxxx at omnitechweb.it (Sacha xxxx) Date: Wed, 7 Dec 2011 17:31:29 +0100 Subject: [Dovecot] dovecot 2.0 sieve if working, managesieve not. In-Reply-To: <9DD2BA39-3F7E-4612-8A8F-37967E4491C4@omnitechweb.it> References: <9DD2BA39-3F7E-4612-8A8F-37967E4491C4@omnitechweb.it> Message-ID: I solved installing dovecot-pigeonhole-2.0.9-2.el6.x86_64.rpm Thank you Il giorno 07/dic/2011, alle ore 15:02, Sacha xxxx ha scritto: > Hi, > this is my configuration > > # OS: Linux 2.6.32-131.0.15.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.1 (Santiago) ext4 > auth_debug = yes > auth_master_user_separator = * > auth_username_format = %Lu > auth_verbose = yes > disable_plaintext_auth = no > info_log_path = /var/log/dovecot-info.log > log_path = /var/log/dovecot.log > log_timestamp = "%Y-%m-%d %H:%M:%S " > login_greeting = Dovecot ready > mail_debug = yes > mail_gid = 999 > mail_home = /MAIL/%d/%n/ > mail_location = maildir:/MAIL/%d/%n/ > mail_log_prefix = "%Us(%u): " > mail_plugins = " quota" > mail_privileged_group = mail > mail_uid = 999 > passdb { > args = /etc/dovecot/dovecot-ldap.conf > driver = ldap > } > passdb { > args = /etc/dovecot/passwd.masterusers > driver = passwd-file > master = yes > pass = yes > } > plugin { > quota = maildir:User quota > quota_warning = storage=95%% quota-warning 95 %u > quota_warning2 = storage=80%% quota-warning 80 %u > sieve = ~/sieve/dovecot.sieve > sieve_dir = ~/sieve > } > protocols = imap pop3 sieve > service auth { > unix_listener auth-userdb { > group = mail > mode = 0660 > user = postfix > } > } > service managesieve-login { > executable = /usr/libexec/dovecot/managesieve-login > inet_listener sieve { > port = 4190 > } > } > service quota-warning { > executable = script /usr/local/bin/quota-warning.sh > unix_listener quota-warning { > group = mail > mode = 0666 > user = mail > } > user = mail > } > ssl = no > userdb { > args = /etc/dovecot/dovecot-ldap.user > driver = ldap > } > doveconf: Error: protocols: Unknown protocol: sieve > doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: protocols: Unknown protocol: sieve > > I get the error Unknown protocol: sieve > > The installed rpm package is this: > dovecot-2.0.9-2.el6.x86_64 > > The sieve filtering is working: > > 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: opening script /MAIL/***/user//sieve/dovecot.sieve > 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: script /MAIL/***/user//sieve/dovecot.sieve successfully compiled > 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: executing script from /MAIL/***/utente01//sieve/dovecot.sieve > 2011-12-07 12:12:29 LDA(utente01@***): Info: sieve: msgid=<4EDF4A1C.9010509@***>: stored mail into mailbox 'INBOX' > > But the manage sieve won't work. > It seems that pigeonhole is installed because /usr/libexec/dovecot/managesieve-login exist and is not empty. > > Can you help me? > > Thank You > > Sushi. > Sacha xxxx Security Consultant ----------------------------------------------------------------- xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxx Questo messaggio ? destinato alle sole persone indicate e pu? contenere informazioni riservate. Se ricevuto per errore, si prega di avvisare immediatam From listen at constabel.net Wed Dec 7 19:05:05 2011 From: listen at constabel.net (Mike Constabel) Date: Wed, 7 Dec 2011 18:05:05 +0100 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts Message-ID: <20111207170505.GI22136@herakles.constabel-it.de> Hi, if I try to crate a folder in Thunderbird 8 which contains umlauts this happens: - Create folder "T?r" - Thunderbird show T&APw-r in folder list In log: Dec 07 17:45:39 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 # ll /mailspool1/in-preetz.de/test1/mdbox/mailboxes/ insgesamt 32K drwx------ 8 vmail vmail 4,0K 7. Dez 17:45 . drwx------ 4 vmail vmail 4,0K 7. Dez 17:45 .. drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Drafts drwx------ 3 vmail vmail 4,0K 29. Nov 11:04 INBOX drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Junk drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Sent drwx------ 3 vmail vmail 4,0K 7. Dez 17:45 T&APw-r drwx------ 4 vmail vmail 4,0K 7. Dez 17:44 Trash If I click in TB on the folder, TB gives an empty message, the log shows: Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: Effective uid=1000, gid=1000, home=/mailspool1/in-preetz.de/test1 Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: quota: No quota setting - plugin disabled Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mdbox Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: fs: root=/mailspool1/in-preetz.de/test1/mdbox, index=, control=, inbox=, alt= Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:43:02 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/&ANY-de doesn't exist yet, using default permissions Dec 07 17:43:02 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:44:19 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/&-ANY-de doesn't exist yet, using default permissions Dec 07 17:44:19 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:44:19 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/Trash/&-ANY-de doesn't exist yet, using default permissions Dec 07 17:44:24 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/Trash/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 On another server with # 2.0.13 (537d4b6d9a7a): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.2 an an server with # 1.2.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 5.0.9 umlauts are working. Is there an problem with my config or with the rc1? thanks, Mike dovecot -n for not working 2.1.rc1: # 2.1.rc1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 6.0.3 auth_cache_size = 1 M auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login cram-md5 auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot/dovecot-debug.log default_client_limit = 2600 disable_plaintext_auth = no hostname = mx4.constabel-it.de info_log_path = /var/log/dovecot/dovecot-info.log log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_location = mdbox:~/mdbox mail_plugins = quota notify mail_log mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = prefix = separator = / type = private } passdb { args = scheme=PLAIN username_format=%u /etc/imap.userdb driver = passwd-file } plugin { autocreate = Trash autocreate2 = Junk autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Sent autosubscribe4 = Drafts sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at localhost protocols = " imap lmtp sieve pop3" service auth { inet_listener { address = 192.168.10.117 port = 12345 } } service imap-login { inet_listener imap { address = 192.168.10.117 port = 143 } inet_listener imaps { address = 192.168.10.117 port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = 192.168.10.117 port = 24 } } service managesieve-login { inet_listener sieve { address = 192.168.10.117 port = 4190 } } service pop3-login { inet_listener pop3 { address = 192.168.10.117 port = 110 } inet_listener pop3s { address = 192.168.10.117 port = 995 ssl = yes } } ssl_ca = I've got my users in a replicated database setup and dovecot configured with two connect lines in dovecot-sql.conf: connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass connect = host=127.0.0.2 port=3306 dbname=users user=user password=pass this works really well to help balance the load. However, when a new user is created, the replication information sometimes has not made it to the slave database before my user creation process tries to send that new user an email about their new email account. If it hasn't and the email gets sent, then it bounces because postfix thinks the user doesn't exist yet. Replication usually happens within seconds, but could be delayed due to problems. I would like a way to see if the new user's information has been replicated yet before sending the email. I was thinking I could use 'doveadm user' to lookup the user, but I am not sure that I can specify one of the specific 'connect' lines in my configuration to check. Is there a way to override that configuration variable to do this test? I tried various incarnations of passing '-o connect=host='... but doveadm user would just ignore them. thanks for any suggestions! micah ps - yes, I can make my user creation process just 'sleep' for an arbitrary amount of time and by that time the replication should have occured, but that is a bit of a shot in the dark, and doesn't handle longer replication delays that could potentially happen. -- -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 835 bytes Desc: not available URL: From mark.zealey at webfusion.com Wed Dec 7 20:38:29 2011 From: mark.zealey at webfusion.com (Mark Zealey) Date: Wed, 07 Dec 2011 20:38:29 +0200 Subject: [Dovecot] sql dict: commit failed: MySQL server has gone away Message-ID: <4EDFB2A5.9090303@webfusion.com> Following on from this thread: http://www.dovecot.org/list/dovecot/2010-September/052704.html in 2.0.16 I am seeing the same issues. I believe this would be related to some timeouts set on our mysql servers which are pretty low (30 or 60 seconds or so to drop idle connections). This is happening for imap, pop and lmtp processes when they try to update quotas stored in a mysql database; presumably it is the dict process that actually has these issues - the lmtp delivery isn't lasting longer than 1 second so shouldn't be seeing any timeouts there. This is always followed by the "Error: dict quota: Quota update failed, it's now desynced" line; presumably it is telling the truth but I'm not sure how I could tell. We are also seeing this "MySQL server has gone away" issue in login processes but it isn't causing an issue there as presumably dovecot transparently retries rather than just giving up as it seems to in the quota updates. Any thoughts or advice would be appreciated. Mark From selcuk.yazar at gmail.com Wed Dec 7 21:57:32 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Wed, 7 Dec 2011 21:57:32 +0200 Subject: [Dovecot] postlogin script Message-ID: Hi, I have Postfix + OpenLdap + DoveCot configuration, and it's running succesfuly, i wantto convert users pop3 password NTPassword and LMPassword, so i ne plain passwor dof users, how can i do that. (Normaly using perl's ntlmgen function i convert password , but in plain) thanks in advance From jtam.home at gmail.com Thu Dec 8 04:00:43 2011 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 7 Dec 2011 18:00:43 -0800 (PST) Subject: [Dovecot] doveadm fetch vs search+fetch Message-ID: What's the pactical difference between using "doveadm fetch" rather than using "doveadm search" in conjunction with "doveadm fetch", as the man pages suggest? It seems "doveadm fetch" functionally supercedes "doveadm search" making the latter obsolete. It can even be closely simulated with "doveadm -f tab fetch ... 'mailbox-guid uid' search-query ...". Joseph Tam From tss at iki.fi Thu Dec 8 05:19:42 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 05:19:42 +0200 Subject: [Dovecot] doveadm fetch vs search+fetch In-Reply-To: References: Message-ID: <1323314382.15365.45.camel@hurina> On Wed, 2011-12-07 at 18:00 -0800, Joseph Tam wrote: > What's the pactical difference between using "doveadm fetch" rather > than using "doveadm search" in conjunction with "doveadm fetch", as the > man pages suggest? > > It seems "doveadm fetch" functionally supercedes "doveadm search" > making the latter obsolete. It can even be closely simulated > with "doveadm -f tab fetch ... 'mailbox-guid uid' search-query ...". If you want to fetch message headers/bodies separately for multiple messages, then doveadm search is useful. With "doveadm fetch" you can't really know where one message ends and another one begins (although the ^L character between messages is a good indicator, it's not 100% reliable). And in any case it's more difficult to use for separating messages in a shell script. From jtam.home at gmail.com Thu Dec 8 05:56:01 2011 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 7 Dec 2011 19:56:01 -0800 (PST) Subject: [Dovecot] doveadm fetch vs search+fetch In-Reply-To: <1323314382.15365.45.camel@hurina> References: <1323314382.15365.45.camel@hurina> Message-ID: On Thu, 8 Dec 2011, Timo Sirainen wrote: >> It seems "doveadm fetch" functionally supercedes "doveadm search" >> making the latter obsolete. It can even be closely simulated >> with "doveadm -f tab fetch ... 'mailbox-guid uid' search-query ...". > > If you want to fetch message headers/bodies separately for multiple > messages, then doveadm search is useful. With "doveadm fetch" you can't > really know where one message ends and another one begins (although the > ^L character between messages is a good indicator, it's not 100% > reliable). And in any case it's more difficult to use for separating > messages in a shell script. You could use, as I suggested, doveadm -f tab fetch -u bob 'mailbox-guid uid' ... | \ while read guid uid; do ... done which pretty much does the same thing (but you have to dump the first line, ugh!). It doesn't matter all that much except some extra man page reading, but it will save you the bother of having to maintain a separate binary, man page, etc. for what is essentially a duplicate. Joseph Tam From tss at iki.fi Thu Dec 8 06:03:25 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:03:25 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EDF8E2B.7020204@univ-nantes.fr> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> <4EDF3F10.1090604@univ-nantes.fr> <4EDF8E2B.7020204@univ-nantes.fr> Message-ID: <1323317006.15365.52.camel@hurina> On Wed, 2011-12-07 at 17:02 +0100, Yann Dupont wrote: > > before doing rm -rf for the user's mails. And in the archiving step you should do it with dsync with mail_attachment_dir disabled in the destination storage, so the the attachments get written to the archive directly instead of only referencing SIS. > > > Yes, I understand, it will work. But, if case of any error (even our > fault : premature end of script, for example) you can still end up with > attachement forever lost on the filesystem. > > Right, it SHOULD not happen, and it probably won't represent a big > volume. But Still, it could happen under specific circonstances. In that > case, I don't see any simple way to detect that kind of files ? > > Do you see how a script could detect some orphaned links ?? It wouldn't be simple. The only safe way would be to: 1. Scan through all the attachment HASH-GUID names and save them. This scanning step could already detect some orphaned attachments, where the hashes/HASH file exists with nlink=1 (i.e. HASH-GUID* files have been deleted, but the HASH itself hasn't been for some reason). 2. Read through all users' all dboxes contents and get a list of all referenced attachment HASH-GUIDs. 3. Delete all attachments that exist in list 1, but not in list 2. I guess there should be a "doveadm sis rescan" command that does this. From tss at iki.fi Thu Dec 8 06:11:44 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:11:44 +0200 Subject: [Dovecot] 2.1.rc1 (1e118913348b): Panic: file mail-user.c: line 128 (mail_user_ref): assertion failed: (user->refcount > 0) In-Reply-To: <4EDF9185.7060805@localhost.localdomain.org> References: <4EDF9185.7060805@localhost.localdomain.org> Message-ID: <1323317504.15365.53.camel@hurina> On Wed, 2011-12-07 at 17:17 +0100, Pascal Volk wrote: > right after delivering the message to the INBOX the lmtp crashes. > I wonder about the "Sent" in the attached backtrace. http://hg.dovecot.org/dovecot-2.1/rev/3b70254e0596 should fix it. From tss at iki.fi Thu Dec 8 06:13:40 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:13:40 +0200 Subject: [Dovecot] doveadm fetch vs search+fetch In-Reply-To: References: <1323314382.15365.45.camel@hurina> Message-ID: <1323317620.15365.55.camel@hurina> On Wed, 2011-12-07 at 19:56 -0800, Joseph Tam wrote: > > If you want to fetch message headers/bodies separately for multiple > > messages, then doveadm search is useful. With "doveadm fetch" you can't > > really know where one message ends and another one begins (although the > > ^L character between messages is a good indicator, it's not 100% > > reliable). And in any case it's more difficult to use for separating > > messages in a shell script. > > You could use, as I suggested, > > doveadm -f tab fetch -u bob 'mailbox-guid uid' ... | \ Oh, you meant this. > while read guid uid; do > ... > done > > which pretty much does the same thing (but you have to dump the first > line, ugh!). It doesn't matter all that much except some extra man > page reading, but it will save you the bother of having to maintain a > separate binary, man page, etc. for what is essentially a duplicate. Yeah, but it's more effort to remove it than to keep it as it is :) Also a "search" is somewhat simpler and prettier to use. From tss at iki.fi Thu Dec 8 06:18:17 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:18:17 +0200 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <20111207170505.GI22136@herakles.constabel-it.de> References: <20111207170505.GI22136@herakles.constabel-it.de> Message-ID: <1323317897.15365.58.camel@hurina> On Wed, 2011-12-07 at 18:05 +0100, Mike Constabel wrote: > if I try to crate a folder in Thunderbird 8 which contains > umlauts this happens: > > - Create folder "T?r" > - Thunderbird show T&APw-r in folder list I can't reproduce. Is it possible this is a TB bug? Try talking IMAP protocol directly: /usr/local/libexec/dovecot/imap -u user at domain a list "" T* If it lists: * LIST (\HasNoChildren) "." "T&APw-r" Then Dovecot is working correctly. > drwx------ 3 vmail vmail 4,0K 7. Dez 17:45 T&APw-r This is correct. > On another server with > > # 2.0.13 (537d4b6d9a7a): /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-5-686 i686 Debian 6.0.2 > > an an server with > > # 1.2.16: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 5.0.9 > > umlauts are working. It wouldn't be impossible for TB to be simply confused with this setup for some reason :) From tss at iki.fi Thu Dec 8 06:22:58 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:22:58 +0200 Subject: [Dovecot] overriding userdb connection host for doveadm-user In-Reply-To: <87aa742rbo.fsf@algae.riseup.net> References: <87aa742rbo.fsf@algae.riseup.net> Message-ID: <1323318179.15365.62.camel@hurina> On Wed, 2011-12-07 at 13:02 -0500, Micah Anderson wrote: > I've got my users in a replicated database setup and dovecot configured > with two connect lines in dovecot-sql.conf: > > connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass > connect = host=127.0.0.2 port=3306 dbname=users user=user password=pass > > this works really well to help balance the load. If you actually have it like that, it should only be using 127.0.0.2, as the second connect setting overrides the first one.. The right way would have been: connect = host=127.0.0.1 host=127.0.0.2 port=... > I would like a way to see if the new user's information has been > replicated yet before sending the email. I was thinking I could use > 'doveadm user' to lookup the user, but I am not sure that I can specify > one of the specific 'connect' lines in my configuration to check. Is > there a way to override that configuration variable to do this test? I > tried various incarnations of passing '-o connect=host='... but doveadm > user would just ignore them. doveadm does the lookup via auth-userdb socket. You have two possibilities: a) Have doveadm use another auth-userdb socket that points to another dovecot installation with different configuration. b) Use a different userdb configuration for doveadm: protocol !doveadm { userdb { driver = sql args = /.../dovecot-sql.conf.ext } } protocol doveadm { userdb { driver = sql args = /.../dovecot-sql-slave.conf.ext } } From tss at iki.fi Thu Dec 8 07:03:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:03:12 +0200 Subject: [Dovecot] sql dict: commit failed: MySQL server has gone away In-Reply-To: <4EDFB2A5.9090303@webfusion.com> References: <4EDFB2A5.9090303@webfusion.com> Message-ID: <1323320593.15365.65.camel@hurina> On Wed, 2011-12-07 at 20:38 +0200, Mark Zealey wrote: > Following on from this thread: > http://www.dovecot.org/list/dovecot/2010-September/052704.html > > in 2.0.16 I am seeing the same issues. I believe this would be related > to some timeouts set on our mysql servers which are pretty low (30 or 60 > seconds or so to drop idle connections). Yes, most likely. But it only happens if the quota isn't enforced (e.g. unlimited quota), because otherwise the previous "current quota usage" lookup would have automatically reconnected. > This is happening for imap, pop > and lmtp processes when they try to update quotas stored in a mysql > database; presumably it is the dict process that actually has these > issues - the lmtp delivery isn't lasting longer than 1 second so > shouldn't be seeing any timeouts there. This is always followed by the > "Error: dict quota: Quota update failed, it's now desynced" line; > presumably it is telling the truth but I'm not sure how I could tell. Yes. All sql dict updates go through dict process, which keeps a long running sql connection open. > We are also seeing this "MySQL server has gone away" issue in login > processes but it isn't causing an issue there as presumably dovecot > transparently retries rather than just giving up as it seems to in the > quota updates. Any thoughts or advice would be appreciated. You mean auth processes. In case of auth the lookup is retried though. Anyway, v2.1 now retries the commit: http://hg.dovecot.org/dovecot-2.1/rev/782f09d13ece From tss at iki.fi Thu Dec 8 07:06:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:06:12 +0200 Subject: [Dovecot] postlogin script In-Reply-To: References: Message-ID: <1323320772.15365.68.camel@hurina> On Wed, 2011-12-07 at 21:57 +0200, Selcuk Yazar wrote: > Hi, > > I have Postfix + OpenLdap + DoveCot configuration, and it's running > succesfuly, > > i wantto convert users pop3 password NTPassword and LMPassword, so i ne > plain passwor dof users, > > how can i do that. (Normaly using perl's ntlmgen function i convert > password , but in plain) 1) You need to enable userdb prefetch and make it work: http://wiki2.dovecot.org/UserDatabase/Prefetch 2) Once you can successfully log in with userdb prefetch enabled, add another field to pass_attrs: pass_attrs = ..., =userdb_plaintext_pass=%w 3) Now in your post-login script you should have PLAINTEXT_PASS environment containing the password. From tss at iki.fi Thu Dec 8 07:11:01 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:11:01 +0200 Subject: [Dovecot] lazy_expunge plugin and folder subscription trouble In-Reply-To: <20111207171203.32263dknm9tyodgc@webmail.hrz.uni-giessen.de> References: <20111207171203.32263dknm9tyodgc@webmail.hrz.uni-giessen.de> Message-ID: <1323321061.15365.70.camel@hurina> On Wed, 2011-12-07 at 17:12 +0100, J?rgen Obermann wrote: > Hello, > I wanted to test the lazy expunge plugin together with mdbox. It seems > to me that the folder subscriptions file in the mdbox directory was > overwritten with only a few folder names every time I added or removed > something in the list of subscribed folders, or even if I turned the > imap folder subscription feature off and on. Here is my setup: .. > namespace { > location = mdbox:~/mdbox:MAILBOXDIR=expunged > prefix = .EXPUNGED/ > separator = / > } Right, with this it thinks that it owns the ~/mdbox/subscriptions file, but that is the same path as for the inbox namespace. I think with subscriptions=no it should have worked ok, but if not, use a different subscriptions filename: location = mdbox:~/mdbox:MAILBOXDIR=expunged:SUBSCRIPTIONS=subscriptions-expunged From tss at iki.fi Thu Dec 8 07:15:13 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:15:13 +0200 Subject: [Dovecot] problems when using dsync between servers In-Reply-To: <4EDF47BE.8080703@univ-nantes.fr> References: <4EDF47BE.8080703@univ-nantes.fr> Message-ID: <1323321313.15365.72.camel@hurina> On Wed, 2011-12-07 at 12:02 +0100, Yann Dupont wrote: > Much faster (using all the cores), but dsync still hangs on some > accounts. After a certain time dsync exit with an error like that : > > Panic: file dsync-worker-local.c: line 1688 > (local_worker_save_msg_continue): assertion failed: (ret == -1) Unfortunately there are still some bugs in dsync.. But you could work around this by checking if dsync returned failure, and if it did just retry the user. > This is on a RUNNNING server. > > My aim was to make some pass on the running server, then stop it and > make a last pass to finish the process. That should work. > Is dsync supposed to run only on a stopped server ? No. From tss at iki.fi Thu Dec 8 07:22:22 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:22:22 +0200 Subject: [Dovecot] Panic when attempting index with Apache Solr : fts_solr plugin In-Reply-To: <4ED91D34.3050906@digitalforplay.com> References: <4ED91D34.3050906@digitalforplay.com> Message-ID: <1323321743.15365.74.camel@hurina> On Fri, 2011-12-02 at 12:47 -0600, A Dovecot User wrote: > [root at mymailserver ~]# doveadm -D index -u username mailbox inbox The "mailbox" isn't necessary above. > doveadm(username): Info: INBOX: Caching mails seq=1..466 > doveadm(username): Panic: file solr-connection.c: line 545 > (solr_connection_post_more): assertion failed: (maxfd >= 0) This happens every time? It can't index any mails at all? Have you tried with Dovecot v2.0? I can't reproduce it. Anyway I guess either I'm using libcurl wrong somehow, or there's a bug in libcurl.. From tss at iki.fi Thu Dec 8 07:23:48 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:23:48 +0200 Subject: [Dovecot] v2.1.rc1 missing SnowballAnalyzer.h In-Reply-To: <20111201161528.GI3177@zptr-nb18.caf.local> References: <20111201161528.GI3177@zptr-nb18.caf.local> Message-ID: <1323321828.15365.75.camel@hurina> On Thu, 2011-12-01 at 18:15 +0200, Eray Aslan wrote: > Sure enough, there is no SnowballAnalyzer.h in the tarball. > Looks like a missing a backslash in src/plugins/fts-lucene/Makefile.am: > [...] > noinst_HEADERS = \ > fts-lucene-plugin.h \ > lucene-wrapper.h > SnowballAnalyzer.h \ > SnowballFilter.h Yes, thanks, will be fixed in rc2. From tss at iki.fi Thu Dec 8 07:27:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:27:12 +0200 Subject: [Dovecot] Questions about Proxy/Director In-Reply-To: <4ED4EB16.1030704@wk-serv.de> References: <1321472837.21919.598.camel@hurina> <4ECAC68D.3060007@wk-serv.de> <20111122071624.GA6110@dibs.tanso.net> <4ECB76A8.80208@wk-serv.de> <20111122104547.GA10680@dibs.tanso.net> <2094e82e55c67f5591540ca7c800b92c@wk-serv.de> <20111124104709.GB24297@dibs.tanso.net> <4ECE483B.5090208@wk-serv.de> <20111124143321.GB28600@dibs.tanso.net> <4ECECBF9.5070507@wk-serv.de> <20111125081715.GA24352@dibs.tanso.net> <4ED4EB16.1030704@wk-serv.de> Message-ID: <1323322033.15365.76.camel@hurina> On Tue, 2011-11-29 at 15:24 +0100, Patrick Westenberg wrote: > I have a working test environment not but I don't feel very comfortable > with a non encrypted connection between the proxy/director and the > backend servers. > > If I set ssl = required on my backend server I get this error: > imap-login: Disconnected (tried to use disabled plaintext auth) > > Is there a chance to encrypt this connection? See the ssl stuff in http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy From tss at iki.fi Thu Dec 8 07:31:53 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:31:53 +0200 Subject: [Dovecot] POP3/IMAP crash signal 10 In-Reply-To: <0D810DB78132A8488DE17E655BF29B685C5EAA5C@TUPSDC01.tups.net.au> References: <0D810DB78132A8488DE17E655BF29B685C5EAA5C@TUPSDC01.tups.net.au> Message-ID: <1323322313.15365.80.camel@hurina> On Mon, 2011-11-28 at 03:24 +0000, Patrick Wood wrote: > Nov 28 14:11:02 mailserver dovecot: [ID 583609 mail.error] master: Error: service(pop3-login): child 28277 killed with signal 10 (core not dumped - set service pop3-log > in { drop_priv_before_exec=yes }) You can easily reproduce this? gdb backtrace is needed to get anything useful out of this crash. Try with: service pop3-login { executable = pop3-login -D drop_priv_before_exec = yes } Now when it crashes, it hopefully says that it's dumping a core (to /usr/local/var/run/dovecot/login/core)? If not, try attaching gdb directly to the process: service pop3-login { process_min_avail = 1 service_count = 0 } gdb /usr/local/libexec/dovecot/pop3-login cont bt full From tss at iki.fi Thu Dec 8 07:37:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:37:20 +0200 Subject: [Dovecot] Assertion failure in 2.0.16 - SEARCH () In-Reply-To: References: Message-ID: <1323322640.15365.81.camel@hurina> On Fri, 2011-11-25 at 22:36 -0800, Daniel Colascione wrote: > Nov 25 22:25:59 dancol dovecot: imap(dancol): Panic: file mail-search-build.c: > line 59 (mail_search_build_key_int): assertion failed: (sarg->value.subargs != > NULL) Thanks, fixed: http://hg.dovecot.org/dovecot-2.0/rev/ba68f9be07c4 From tss at iki.fi Thu Dec 8 07:53:57 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:53:57 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <4ED114DA.7030707@webfusion.com> References: <4ED114DA.7030707@webfusion.com> Message-ID: <1323323637.15365.85.camel@hurina> On Sat, 2011-11-26 at 18:33 +0200, Mark Zealey wrote: > We're trying to convert users from Maildir to sdbox at present; I'm > using dsync to achieve this (2.0.16) however when the user's have been > converted we only get minimal information in the caching files. Is there > some way to preserve all the caching decisions that were previously made > so that when the user logs in to the new mailbox we don't have to cause > an io storm rebuilding the cache that we know was good? Dovecot seems to > be partially doing this - if i remove the logs/cache from the source > mailbox no cache files are built in the conversion; if i put them back > then we get a cache file built but it only contains a few bits of > information (guid, date.save). Looking into this a bit further i find > that when the caches are present at source the fields are preserved but > the 'last used' date and caching decisions are not which I suspect means > dsync doesn't bother caching on import - only fields with a yes decision > in the source are copied (but their decision is only copied as a tmp > with the date of import). For example: How are you calling dsync? Does the destination already exist? I tried with: rm -rf /tmp/foo; dsync -u tss -m INBOX mirror sdbox:/tmp/foo It sets all of the cache fields with "yes" or "tmp" decision, as it should. But yes, the "last used" field should probably be copied as well. Perhaps the problem with you is that dsync actually writes all of the cache fields, but then it does a "cache compression" at the end, which sees that the "last used" fields are so old, so it deletes them. But yes, it is a problem that dsync doesn't update caching decisions.. Hmm. I guess I'll have to fix that for v2.1. From Mark.Zealey at webfusion.com Thu Dec 8 09:10:18 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 07:10:18 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323323637.15365.85.camel@hurina> References: <4ED114DA.7030707@webfusion.com>, <1323323637.15365.85.camel@hurina> Message-ID: Apologies for top-posting but I can't figure out how to make this client do inline... I am seeing on the first run (we are using 'backup') we don't get any of the cache copied just the index files created. On the second run (ie when dest exists); a cache file is created and populated with the bits that are required for the sync presumably - guid. As you say the yes/tmp caching decisions are copied over (and visible in the cache file) but because the last used date is not copied; these fields are not activated for any of the messages so none of their data actually gets cached. I'm not seeing a compression at the end as the tmp etc fields are still there (mostly don't have any yes fields in our source caches) but as I say, because they don't have a last used date then the none of them are ever actually used until the client requests them via pop/imap. Mark ________________________________________ From: Timo Sirainen [tss at iki.fi] Sent: 08 December 2011 05:53 To: Mark Zealey Cc: Dovecot Mailing List Subject: Re: [Dovecot] using dsync to convert mailboxes looses caching options On Sat, 2011-11-26 at 18:33 +0200, Mark Zealey wrote: > We're trying to convert users from Maildir to sdbox at present; I'm > using dsync to achieve this (2.0.16) however when the user's have been > converted we only get minimal information in the caching files. Is there > some way to preserve all the caching decisions that were previously made > so that when the user logs in to the new mailbox we don't have to cause > an io storm rebuilding the cache that we know was good? Dovecot seems to > be partially doing this - if i remove the logs/cache from the source > mailbox no cache files are built in the conversion; if i put them back > then we get a cache file built but it only contains a few bits of > information (guid, date.save). Looking into this a bit further i find > that when the caches are present at source the fields are preserved but > the 'last used' date and caching decisions are not which I suspect means > dsync doesn't bother caching on import - only fields with a yes decision > in the source are copied (but their decision is only copied as a tmp > with the date of import). For example: How are you calling dsync? Does the destination already exist? I tried with: rm -rf /tmp/foo; dsync -u tss -m INBOX mirror sdbox:/tmp/foo It sets all of the cache fields with "yes" or "tmp" decision, as it should. But yes, the "last used" field should probably be copied as well. Perhaps the problem with you is that dsync actually writes all of the cache fields, but then it does a "cache compression" at the end, which sees that the "last used" fields are so old, so it deletes them. But yes, it is a problem that dsync doesn't update caching decisions.. Hmm. I guess I'll have to fix that for v2.1. From Mark.Zealey at webfusion.com Thu Dec 8 09:14:05 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 07:14:05 +0000 Subject: [Dovecot] sql dict: commit failed: MySQL server has gone away In-Reply-To: <1323320593.15365.65.camel@hurina> References: <4EDFB2A5.9090303@webfusion.com>, <1323320593.15365.65.camel@hurina> Message-ID: Correct we're not enforcing the quotas at present just want an easy way to monitor everyone's mailbox usage. Thanks for the patch; will it work ok against 2.0.16? if so I'll recompile and give it a test today. Mark ________________________________________ From: Timo Sirainen [tss at iki.fi] Sent: 08 December 2011 05:03 To: Mark Zealey Cc: dovecot at dovecot.org Subject: Re: [Dovecot] sql dict: commit failed: MySQL server has gone away On Wed, 2011-12-07 at 20:38 +0200, Mark Zealey wrote: > Following on from this thread: > http://www.dovecot.org/list/dovecot/2010-September/052704.html > > in 2.0.16 I am seeing the same issues. I believe this would be related > to some timeouts set on our mysql servers which are pretty low (30 or 60 > seconds or so to drop idle connections). Yes, most likely. But it only happens if the quota isn't enforced (e.g. unlimited quota), because otherwise the previous "current quota usage" lookup would have automatically reconnected. > This is happening for imap, pop > and lmtp processes when they try to update quotas stored in a mysql > database; presumably it is the dict process that actually has these > issues - the lmtp delivery isn't lasting longer than 1 second so > shouldn't be seeing any timeouts there. This is always followed by the > "Error: dict quota: Quota update failed, it's now desynced" line; > presumably it is telling the truth but I'm not sure how I could tell. Yes. All sql dict updates go through dict process, which keeps a long running sql connection open. > We are also seeing this "MySQL server has gone away" issue in login > processes but it isn't causing an issue there as presumably dovecot > transparently retries rather than just giving up as it seems to in the > quota updates. Any thoughts or advice would be appreciated. You mean auth processes. In case of auth the lookup is retried though. Anyway, v2.1 now retries the commit: http://hg.dovecot.org/dovecot-2.1/rev/782f09d13ece From tss at iki.fi Thu Dec 8 09:33:44 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 09:33:44 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323323637.15365.85.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina> Message-ID: <1323329624.15365.87.camel@hurina> On Thu, 2011-12-08 at 07:53 +0200, Timo Sirainen wrote: > But yes, it is a problem that dsync doesn't update caching decisions.. > Hmm. I guess I'll have to fix that for v2.1. Could you try if the attached patch fixes your problems when patching against latest v2.1 hg? It's annoyingly large, and it makes v2.1 dsync incompatible with v2.0, but maybe it's better to do it sooner than later.. -------------- next part -------------- A non-text attachment was scrubbed... Name: dsync.diff Type: text/x-patch Size: 27825 bytes Desc: not available URL: From Yann.Dupont at univ-nantes.fr Thu Dec 8 09:47:16 2011 From: Yann.Dupont at univ-nantes.fr (Yann Dupont) Date: Thu, 08 Dec 2011 08:47:16 +0100 Subject: [Dovecot] problems when using dsync between servers In-Reply-To: <1323321313.15365.72.camel@hurina> References: <4EDF47BE.8080703@univ-nantes.fr> <1323321313.15365.72.camel@hurina> Message-ID: <4EE06B84.2030302@univ-nantes.fr> Le 08/12/2011 06:15, Timo Sirainen a ?crit : > On Wed, 2011-12-07 at 12:02 +0100, Yann Dupont wrote: > >> Much faster (using all the cores), but dsync still hangs on some >> accounts. After a certain time dsync exit with an error like that : >> >> Panic: file dsync-worker-local.c: line 1688 >> (local_worker_save_msg_continue): assertion failed: (ret == -1) > > Unfortunately there are still some bugs in dsync.. But you could work > around this by checking if dsync returned failure, and if it did just > retry the user. > ok will try this. >> This is on a RUNNNING server. >> >> My aim was to make some pass on the running server, then stop it and >> make a last pass to finish the process. > > That should work. > >> Is dsync supposed to run only on a stopped server ? > > No. > OK, thanks for your answer, -- Yann Dupont - Service IRTS, DSI Universit? de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont at univ-nantes.fr From selcuk.yazar at gmail.com Thu Dec 8 10:40:26 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Thu, 8 Dec 2011 10:40:26 +0200 Subject: [Dovecot] postlogin script In-Reply-To: <1323320772.15365.68.camel@hurina> References: <1323320772.15365.68.camel@hurina> Message-ID: Hi, i applied settingsin below but dovecot says that " prefetch(.. at ....edu.tr,IP_ADDRESS): passdb didn't return userdb entries, trying the next userdb " so PLAINTEXT_PASS is empty thanks in advance. > 1) You need to enable userdb prefetch and make it work: > http://wiki2.dovecot.org/UserDatabase/Prefetch > > 2) Once you can successfully log in with userdb prefetch enabled, add > another field to pass_attrs: > > pass_attrs = ..., =userdb_plaintext_pass=%w > > 3) Now in your post-login script you should have PLAINTEXT_PASS > environment containing the password. > > -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From tss at iki.fi Thu Dec 8 10:55:17 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 10:55:17 +0200 Subject: [Dovecot] postlogin script In-Reply-To: References: <1323320772.15365.68.camel@hurina> Message-ID: <1323334517.15365.88.camel@hurina> On Thu, 2011-12-08 at 10:40 +0200, Selcuk Yazar wrote: > Hi, > > i applied settingsin below but dovecot says that > > " prefetch(.. at ....edu.tr,IP_ADDRESS): passdb didn't return userdb entries, > trying the next userdb > " That's why I said make the userdb prefetch work first, the way described in: > > http://wiki2.dovecot.org/UserDatabase/Prefetch You'll need to add stuff to your pass_attrs. It doesn't work automatically. From listen at constabel.net Thu Dec 8 10:55:14 2011 From: listen at constabel.net (Mike Constabel) Date: Thu, 8 Dec 2011 09:55:14 +0100 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <1323317897.15365.58.camel@hurina> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> Message-ID: <20111208085514.GJ22136@herakles.constabel-it.de> Hi, Timo Sirainen schrieb am Thursday, den 08. December 2011: > On Wed, 2011-12-07 at 18:05 +0100, Mike Constabel wrote: > > > if I try to crate a folder in Thunderbird 8 which contains > > umlauts this happens: > > > > - Create folder "T?r" > > - Thunderbird show T&APw-r in folder list > > I can't reproduce. Is it possible this is a TB bug? Try talking IMAP > protocol directly: > > /usr/local/libexec/dovecot/imap -u user at domain > a list "" T* > > If it lists: > > * LIST (\HasNoChildren) "." "T&APw-r" > > Then Dovecot is working correctly. I get: # /usr/lib/dovecot/imap -u test1 at in-preetz.de Debug: Loading modules from directory: /usr/lib/dovecot/modules Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Debug: auth input: test1 at in-preetz.de uid=1000 gid=1000 home=/mailspool1/in-preetz.de/test1 quota_rule=*:storage=500M Debug: Added userdb setting: plugin/quota_rule=*:storage=500M Debug: Effective uid=1000, gid=1000, home=/mailspool1/in-preetz.de/test1 Debug: quota: No quota setting - plugin disabled Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mdbox Debug: fs: root=/mailspool1/in-preetz.de/test1/mdbox, index=, control=, inbox=, alt= Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS FUZZY SPECIAL-USE QUOTA] Logged in as test1 at in-preetz.de a list "" T* * LIST (\HasNoChildren) "/" "T&-APw-r" * LIST (\HasChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "Trash/T&-APw-r" a OK List completed. As you see there is a second "-" in the name: "T&APw-r" != "T&-APw-r" With my old server: # telnet 192.168.10.102 143 Trying 192.168.10.102... Connected to 192.168.10.102. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5] Dovecot ready. A login aaa bbb A OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk QUOTA] Logged in a list "" T* * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "Test-1" * LIST (\HasNoChildren) "/" "T&APw-r" a OK List completed. Mike From selcuk.yazar at gmail.com Thu Dec 8 10:58:03 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Thu, 8 Dec 2011 10:58:03 +0200 Subject: [Dovecot] postlogin script In-Reply-To: <1323334517.15365.88.camel@hurina> References: <1323320772.15365.68.camel@hurina> <1323334517.15365.88.camel@hurina> Message-ID: Hi, i 'sorry, my mistake, it shold be pass_attrs = uid=user,userPassword=password, *=userdb_plaintext_pass=%w* as you said it must contain *equal sign* before userdb_plaintext_pass=%w, i missed it. thank you very much it works.! sel?uk On Thu, Dec 8, 2011 at 10:55 AM, Timo Sirainen wrote: > On Thu, 2011-12-08 at 10:40 +0200, Selcuk Yazar wrote: > > Hi, > > > > i applied settingsin below but dovecot says that > > > > " prefetch(.. at ....edu.tr,IP_ADDRESS): passdb didn't return userdb > entries, > > trying the next userdb > > " > > That's why I said make the userdb prefetch work first, the way described > in: > > > > http://wiki2.dovecot.org/UserDatabase/Prefetch > > You'll need to add stuff to your pass_attrs. It doesn't work > automatically. > > > -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From tss at iki.fi Thu Dec 8 11:19:41 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 11:19:41 +0200 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <20111208085514.GJ22136@herakles.constabel-it.de> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> Message-ID: <1323335981.15365.90.camel@hurina> On Thu, 2011-12-08 at 09:55 +0100, Mike Constabel wrote: > As you see there is a second "-" in the name: > > "T&APw-r" != "T&-APw-r" Oh, right, it's broken in the "fs" layout. With "maildir++" layout it works. And looks like this isn't going to be an easy fix. The fs layout listing code is horrible.. Maybe I'll just try rewriting it. From Mark.Zealey at webfusion.com Thu Dec 8 11:19:47 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 09:19:47 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323329624.15365.87.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> Message-ID: OK now it's copying the timestamp fields for tmp ones. However: 1) hdr.* fields are not being copied at all (unlike in previous releases) 2) although the decisions are now being recorded; the items are not actually being put into the cache for previously sync'd mails. New mails are having all the cache information produced however. Note: this is only when using the -f option to dsync; when not using -f it doesnt even get round to generating a cache so no fields are put there. Perhaps this should be activated by a new option to dsync; if people are using this for backup (rather than conversion) caches could get relatively large? Mark ________________________________________ From: Timo Sirainen [tss at iki.fi] Sent: 08 December 2011 07:33 To: Dovecot Mailing List Cc: Mark Zealey Subject: Re: [Dovecot] using dsync to convert mailboxes looses caching options On Thu, 2011-12-08 at 07:53 +0200, Timo Sirainen wrote: > But yes, it is a problem that dsync doesn't update caching decisions.. > Hmm. I guess I'll have to fix that for v2.1. Could you try if the attached patch fixes your problems when patching against latest v2.1 hg? It's annoyingly large, and it makes v2.1 dsync incompatible with v2.0, but maybe it's better to do it sooner than later.. From tss at iki.fi Thu Dec 8 11:27:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 11:27:20 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> Message-ID: <1323336440.15365.95.camel@hurina> On Thu, 2011-12-08 at 09:19 +0000, Mark Zealey wrote: > OK now it's copying the timestamp fields for tmp ones. However: > > 1) hdr.* fields are not being copied at all (unlike in previous releases) They are in my tests.. This also happens if the destination doesn't exist? > 2) although the decisions are now being recorded; the items are not actually being put into the cache for previously sync'd mails. New mails are having all the cache information produced however. This is intentional. Doing anything else would be horribly inefficient. Note that dsync isn't *copying* cached data. It's simply setting the caching decisions, and the mail saving code parses the mails and updates cache. > Perhaps this should be activated by a new option to dsync; if people are using this for backup (rather than conversion) caches could get relatively large? Hm. Maybe.. From Mark.Zealey at webfusion.com Thu Dec 8 11:35:04 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 09:35:04 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323336440.15365.95.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> Message-ID: OK I'll test the header copying more fully. The reason we want to preserve caching decisions is to avoid an IO storm when users log in to their mailboxes after an sdbox upgrade so it would be great to be able to have some way to warm caches. Mark ________________________________________ From: Timo Sirainen [tss at iki.fi] Sent: 08 December 2011 09:27 To: Mark Zealey Cc: Dovecot Mailing List Subject: RE: [Dovecot] using dsync to convert mailboxes looses caching options On Thu, 2011-12-08 at 09:19 +0000, Mark Zealey wrote: > OK now it's copying the timestamp fields for tmp ones. However: > > 1) hdr.* fields are not being copied at all (unlike in previous releases) They are in my tests.. This also happens if the destination doesn't exist? > 2) although the decisions are now being recorded; the items are not actually being put into the cache for previously sync'd mails. New mails are having all the cache information produced however. This is intentional. Doing anything else would be horribly inefficient. Note that dsync isn't *copying* cached data. It's simply setting the caching decisions, and the mail saving code parses the mails and updates cache. > Perhaps this should be activated by a new option to dsync; if people are using this for backup (rather than conversion) caches could get relatively large? Hm. Maybe.. From knud.dombrowsky at graband.de Thu Dec 8 13:20:16 2011 From: knud.dombrowsky at graband.de (Knud Dombrowsky) Date: Thu, 08 Dec 2011 12:20:16 +0100 Subject: [Dovecot] noaclright Message-ID: <4EE09D70.3080909@graband.de> Hi, I recently upgraded to openSuse 12.1 which comes with dovecot 2.0.14. Because of mail-client-problems I am running one dovecot which requires authentication via a client-certificate and another one which can be used without a certificate. (Configurations can be found below.) Since the upgrade our shared mailbox is no longer visible. I tried to repair this by setting the ACLs once again (using imap-acl in Thunderbird) but every time I try to set a new ACL the tool says "noaclright" and dovecot logs the following messages: Dec 7 14:31:14 mailbox dovecot: imap(): Error: fstat(/home//Maildir/./dovecot-acl.lock) failed: No such file or directory Dec 7 14:31:14 mailbox dovecot: imap(): Error: file_dotlock_open(/home//Maildir/./dovecot-acl) failed: No such file or directory Needless to say the file exists and its contents looks like it should. (Every line is an ACL like "user=testuser ilrws") I took a look at the changelog from 2.0.14 onwards and since it says nothing about my problem I am not looking forward to compiling dovecot myself and installing it. Any ideas why this is happening? Is this a known problem? Any help is appreciated, Knud ------------Dovecot-on-port-992----------------------------------------- mailbox:~ # dovecot -n # 2.0.14: /etc/dovecot/dovecot.conf # OS: Linux 3.1.0-1.2-desktop x86_64 openSUSE 12.1 (x86_64) auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-master default_client_limit = 1600 default_process_limit = 512 listen = * mail_location = maildir:~/Maildir:INBOX=~/Maildir/.INBOX managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { driver = pam } plugin { acl = vfile:/etc/dovecot/acls:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes quota = maildir:alle Nutzer quota_rule = *:storage=1GB sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 992 ssl = yes } } ssl_ca = refcount > 0) In-Reply-To: <1323317504.15365.53.camel@hurina> References: <4EDF9185.7060805@localhost.localdomain.org> <1323317504.15365.53.camel@hurina> Message-ID: <4EE09D7B.7090604@localhost.localdomain.org> On 12/08/2011 05:11 AM Timo Sirainen wrote: > On Wed, 2011-12-07 at 17:17 +0100, Pascal Volk wrote: >> right after delivering the message to the INBOX the lmtp crashes. > http://hg.dovecot.org/dovecot-2.1/rev/3b70254e0596 should fix it. Thanks, that fixed the problem for me. Also thanks for http://hg.dovecot.org/dovecot-2.1/rev/8c803201651e Regards, Pascal -- The trapper recommends today: f007ba11.1134212 at localdomain.org From dovecot at digitalforplay.com Thu Dec 8 14:36:03 2011 From: dovecot at digitalforplay.com (A Dovecot User) Date: Thu, 08 Dec 2011 06:36:03 -0600 Subject: [Dovecot] =?utf-8?q?Panic_when_attempting_index_with_Apache_Solr_?= =?utf-8?q?=3A_fts=5Fsolr_plugin?= In-Reply-To: <1323321743.15365.74.camel@hurina> References: <4ED91D34.3050906@digitalforplay.com> <1323321743.15365.74.camel@hurina> Message-ID: <36a30195798e4f5ad24e7f6a365af649@localhost> It happens every time. Also, I just recompiled for version 2.0.16 and it gives me the same error (pasted below). I'll be updating the OS on this machine soon, which will update libcurl as well. Panic: file solr-connection.c: line 501 (solr_connection_post_more): assertion failed: (maxfd >= 0) Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3aa41) [0xbd5a41] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x47) [0xbd5b57] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xbab8de] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x293) [0x191d53] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x2723) [0x18f723] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_build_more+0x1f) [0x45d2ff] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x5515) [0x460515] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x5928) [0x460928] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_deinit+0x3a) [0xf3d03a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x55) [0xf3d0f5] -> doveadm() [0x805184d] -> doveadm() [0x804ef55] -> doveadm(doveadm_mail_single_user+0x5b) [0x804f3ab] -> doveadm() [0x804f813] -> doveadm(doveadm_mail_try_run+0x12e) [0x804fc6e] -> doveadm(main+0x3a4) [0x8055b64] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x729e36] -> doveadm() [0x804ed61] On Thu, 08 Dec 2011 07:22:22 +0200, Timo Sirainen wrote: > On Fri, 2011-12-02 at 12:47 -0600, A Dovecot User wrote: >> [root at mymailserver ~]# doveadm -D index -u username mailbox inbox > > The "mailbox" isn't necessary above. > >> doveadm(username): Info: INBOX: Caching mails seq=1..466 >> doveadm(username): Panic: file solr-connection.c: line 545 >> (solr_connection_post_more): assertion failed: (maxfd >= 0) > > This happens every time? It can't index any mails at all? Have you tried > with Dovecot v2.0? > > I can't reproduce it. Anyway I guess either I'm using libcurl wrong > somehow, or there's a bug in libcurl.. From micah at riseup.net Thu Dec 8 15:58:30 2011 From: micah at riseup.net (micah anderson) Date: Thu, 08 Dec 2011 08:58:30 -0500 Subject: [Dovecot] overriding userdb connection host for doveadm-user In-Reply-To: <1323318179.15365.62.camel@hurina> References: <87aa742rbo.fsf@algae.riseup.net> <1323318179.15365.62.camel@hurina> Message-ID: <87r50f17y1.fsf@algae.riseup.net> On Thu, 08 Dec 2011 06:22:58 +0200, Timo Sirainen wrote: > On Wed, 2011-12-07 at 13:02 -0500, Micah Anderson wrote: > > I've got my users in a replicated database setup and dovecot configured > > with two connect lines in dovecot-sql.conf: > > > > connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass > > connect = host=127.0.0.2 port=3306 dbname=users user=user password=pass > > > > this works really well to help balance the load. > > If you actually have it like that, it should only be using 127.0.0.2, as > the second connect setting overrides the first one.. What I actually have is: connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass connect = host=127.0.0.1 port=3307 dbname=users user=user password=pass two different port configurations (I'm running stunnel), rather than two different host entries[0]. >The right way would have been: > > connect = host=127.0.0.1 host=127.0.0.2 port=... So, if I just have two different ports, would the right way be: connect = host=127.0.0.1 port=3306 port=3307 dbname... ? micah 0. When I was anonymizing the db connection information in the original post, I accidentally changed the ip and decided it didn't matter for the question I was asking, so just left it. Now I see that might be confusing. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 835 bytes Desc: not available URL: From Mark.Zealey at webfusion.com Thu Dec 8 16:45:12 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 14:45:12 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina>, <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> Message-ID: With 2.0.16 hdr.xxx fields get copied fine (but of course without timestamp). With the patch you provided they don't get copied whether using mirror or backup & starting from scratch. I'm doing a Maildir to sdbox migration otherwise don't think I'm doing anytihng strange. Mark ________________________________________ From: Mark Zealey Sent: 08 December 2011 09:35 To: Timo Sirainen Cc: Dovecot Mailing List Subject: RE: [Dovecot] using dsync to convert mailboxes looses caching options OK I'll test the header copying more fully. The reason we want to preserve caching decisions is to avoid an IO storm when users log in to their mailboxes after an sdbox upgrade so it would be great to be able to have some way to warm caches. Mark From Mark.Zealey at webfusion.com Thu Dec 8 17:41:29 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 15:41:29 +0000 Subject: [Dovecot] sql dict: commit failed: MySQL server has gone away In-Reply-To: <420B5E34BFEE9646B7198438F9978AE223E32092@mail01.internal.webfusion.com> References: <4EDFB2A5.9090303@webfusion.com>, <1323320593.15365.65.camel@hurina>, <420B5E34BFEE9646B7198438F9978AE223E32092@mail01.internal.webfusion.com> Message-ID: Thanks Timo, this patch applied clean against 2.0.16 just running it on live for the past few minutes & seems to have fixed the issues. Mark ________________________________________ From: Mark Zealey Sent: 08 December 2011 07:14 To: Timo Sirainen Cc: dovecot at dovecot.org Subject: RE: [Dovecot] sql dict: commit failed: MySQL server has gone away Correct we're not enforcing the quotas at present just want an easy way to monitor everyone's mailbox usage. Thanks for the patch; will it work ok against 2.0.16? if so I'll recompile and give it a test today. Mark From Mark.Zealey at webfusion.com Thu Dec 8 18:10:15 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 16:10:15 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323336440.15365.95.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> Message-ID: By the way, another bug I noticed with dsync is that when converting from Maildir to sdbox is that the date.saved field is not preserved - it's just the time when the first dsync command happened. Presumably it should be the mtime of the Maildir message file Mark From user+dovecot at localhost.localdomain.org Thu Dec 8 18:37:23 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Thu, 08 Dec 2011 17:37:23 +0100 Subject: [Dovecot] Wish list item: %g/%{gid} variable Message-ID: <4EE0E7C3.2010101@localhost.localdomain.org> I think it would be very useful to have a user's GID in a variable. So i could use for example: mail_attachment_dir = /srv/mail/.SiS/%{gid} I use one GID per domain and the aliases fqhns of the domain. When for example example.com would be an alias for exmaple.net (gid: 12345), the attachments would be stored inside /srv/mail/.SiS/12345/, no matter if a message was sent to john.doe at example.com or to john.doe at example.net. "quota = dict:domain:%{gid}:proxy::quota" would then also work. Regards, Pascal -- The trapper recommends today: c01dcofe.1134217 at localdomain.org From hsehic at econtec.de Fri Dec 9 00:51:53 2011 From: hsehic at econtec.de (Sehic, Haris) Date: Thu, 8 Dec 2011 23:51:53 +0100 (CET) Subject: [Dovecot] Per-User MySQL Quota (postfixadmin) Message-ID: <30505072.4022.1323384713873.JavaMail.open-xchange@mail02.econtec.de> Hi, ? need some help setting per-user quota and postfixadmin.?Setup is working on 1.2 dovecot. Tryin 2.1 dovecot now,? quota is working but overriden quota rule set by 'user_query =' in /etc/dovecot/dovecot-sql.conf.ext takes no efffekt. What's wrong here? ? Greets ? Haris -------------- next part -------------- # 2.1.rc1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 nfs auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain dict { quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } disable_plaintext_auth = no first_valid_uid = 150 last_valid_uid = 150 login_trusted_networks = 127.0.0.1 10.213.1.0/24 mail_debug = yes mail_gid = 8 mail_home = /var/vmail/%d/%u mail_location = maildir:/var/vmail/%d/%u mail_nfs_storage = yes mail_plugins = " quota imap_quota imap_acl" mail_uid = 150 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:/var/vmail/%%d/%%u:INDEX=/var/vmail/%%d/%%u/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_anyone = allow acl_shared_dict = file:/var/vmail/shared-mailboxes.db mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:user quota::noenforcing:proxy::quotadict quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=90%% quota-warning 90 %u quota_warning3 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = hsehic at econtec.de protocols = imap sieve pop3 lmtp sieve quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = mail mode = 0600 user = vmail } } service dict { unix_listener dict { group = mail mode = 0600 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl_cert = -------------- next part -------------- connect = host=localhost dbname=postfixadmindb user=mailusr password=12345678 map { pattern = priv/quota/storage table = quota2 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota2 username_field = username value_field = messages } From maciej.przybecki at gmail.com Fri Dec 9 07:52:59 2011 From: maciej.przybecki at gmail.com (Maciej Przybecki) Date: Fri, 9 Dec 2011 06:52:59 +0100 Subject: [Dovecot] Per-User MySQL Quota (postfixadmin) In-Reply-To: <30505072.4022.1323384713873.JavaMail.open-xchange@mail02.econtec.de> References: <30505072.4022.1323384713873.JavaMail.open-xchange@mail02.econtec.de> Message-ID: I faced the same problem and digged for 2 days with no luck. It occurred, that I have userdb { ...} section defined as static values, so user_query has never been queried :-). So you must check your userdb section of your config. -Maciej Wys?ane z iPhone'a Dnia 8 gru 2011 o godz. 23:51 "Sehic, Haris" napisa?(a): > Hi, > > need some help setting per-user quota and postfixadmin. Setup is working on 1.2 > dovecot. Tryin 2.1 dovecot now, quota is working but overriden quota rule set > by 'user_query =' in /etc/dovecot/dovecot-sql.conf.ext takes no efffekt. What's > wrong here? > > Greets > > Haris > > > From florent at coppint.com Fri Dec 9 16:30:20 2011 From: florent at coppint.com (florent at coppint.com) Date: Fri, 09 Dec 2011 15:30:20 +0100 Subject: [Dovecot] Error: Corrupted index cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid record size Message-ID: Hi all, I got a problem with a Dovecot IMAP/POP installation. Since a recent failure of our distributed file system (no loss of data btw), Dovecot seems to have a problem with index cache files. For a lot of accounts, I have this error in logs: Error: Corrupted index cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid record size If I delete all files from /indexes/ directory, it still occurs... Do you see what can cause this problem ? Or what information can I provide to help ? Our distributed FS is MooseFS. Dovecot is configured like if it was NFS (no mmap, etc...). Thank you for your help :) Flo From terry at cnysupport.com Fri Dec 9 18:24:32 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 09 Dec 2011 11:24:32 -0500 Subject: [Dovecot] "Unstable" vs "Development" vs "Nightly" Message-ID: <4EE23640.6020009@cnysupport.com> I'm currently running v2.1rc1, but have been seeing errors like: Dec 8 11:31:55 it kernel: auth[18914]: segfault at 48 ip 00fe2f74 sp bfcaccd0 error 4 in libauthdb_imap.so[fdd000+f000] The unstable and nightly builds are newer, but are they likely to be more or less stable than the version I'm currently running? I'd like to install a newer version, but am trying to get a feel for how usable they're likely to be. Thanks, Terry From tss at iki.fi Fri Dec 9 18:43:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 9 Dec 2011 18:43:06 +0200 Subject: [Dovecot] "Unstable" vs "Development" vs "Nightly" In-Reply-To: <4EE23640.6020009@cnysupport.com> References: <4EE23640.6020009@cnysupport.com> Message-ID: On 9.12.2011, at 18.24, Terry Carmen wrote: > I'm currently running v2.1rc1, but have been seeing errors like: > > Dec 8 11:31:55 it kernel: auth[18914]: segfault at 48 ip 00fe2f74 sp bfcaccd0 error 4 in libauthdb_imap.so[fdd000+f000] It would be useful to get gdb backtrace from this. You should be able to get core dumps by adding to dovecot.conf: service auth { user = root } Run "ulimit -c unlimited" before starting dovecot. Then when it crashes there should be a core file in your base_dir (e.g. /var/run/dovecot), and you can do: gdb /usr/local/libexec/dovecot/auth /var/run/dovecot/core bt full > The unstable and nightly builds are newer, but are they likely to be more or less stable than the version I'm currently running? > > I'd like to install a newer version, but am trying to get a feel for how usable they're likely to be. The newer hg versions generally should be more stable, since I've mainly been trying to fix bugs instead of add new features.. The exception being this week, since I've needed to do a few bigger changes. From tss at iki.fi Fri Dec 9 18:53:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 9 Dec 2011 18:53:19 +0200 Subject: [Dovecot] Error: Corrupted index cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid record size In-Reply-To: References: Message-ID: <29C5867E-E95A-4A0D-8B9B-8734EDFD3A9A@iki.fi> On 9.12.2011, at 16.30, florent at coppint.com wrote: > Since a recent failure of our distributed file system (no loss of data > btw), Dovecot seems to have a problem with index cache files. > > For a > lot of accounts, I have this error in logs: > > Error: Corrupted index > cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid > record size Broken cache files aren't visible to users. Are there other errors? > If I delete all files from /indexes/ directory, it still > occurs... When that error happens, the cache is automatically deleted. But if it keeps happening over and over again, something's broken. > Do you see what can cause this problem ? Or what information > can I provide to help ? You said it worked fine until the distributed filesystem somehow failed, and after that it just keeps on failing? It doesn't really sound like it's Dovecot's fault. Also what Dovecot version is this? From terry at cnysupport.com Fri Dec 9 18:59:33 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 09 Dec 2011 11:59:33 -0500 Subject: [Dovecot] "Unstable" vs "Development" vs "Nightly" In-Reply-To: References: <4EE23640.6020009@cnysupport.com> Message-ID: <4EE23E75.6040102@cnysupport.com> On 12/09/2011 11:43 AM, Timo Sirainen wrote: > On 9.12.2011, at 18.24, Terry Carmen wrote: > >> I'm currently running v2.1rc1, but have been seeing errors like: >> >> Dec 8 11:31:55 it kernel: auth[18914]: segfault at 48 ip 00fe2f74 sp bfcaccd0 error 4 in libauthdb_imap.so[fdd000+f000] > It would be useful to get gdb backtrace from this. You should be able to get core dumps by adding to dovecot.conf: > > service auth { > user = root > } > > Run "ulimit -c unlimited" before starting dovecot. Then when it crashes there should be a core file in your base_dir (e.g. /var/run/dovecot), and you can do: > > gdb /usr/local/libexec/dovecot/auth /var/run/dovecot/core > bt full > >> The unstable and nightly builds are newer, but are they likely to be more or less stable than the version I'm currently running? >> >> I'd like to install a newer version, but am trying to get a feel for how usable they're likely to be. > The newer hg versions generally should be more stable, since I've mainly been trying to fix bugs instead of add new features.. The exception being this week, since I've needed to do a few bigger changes. Thanks! I'll wait until next week, then upgrade to the current hg version, and see if it goes away, before taking up more of your time on stuff that might already be fixed. Terry From tss at iki.fi Fri Dec 9 19:01:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 9 Dec 2011 19:01:12 +0200 Subject: [Dovecot] Wish list item: %g/%{gid} variable In-Reply-To: <4EE0E7C3.2010101@localhost.localdomain.org> References: <4EE0E7C3.2010101@localhost.localdomain.org> Message-ID: <2EFEE782-4715-4494-B291-521A00FDF9AA@iki.fi> On 8.12.2011, at 18.37, Pascal Volk wrote: > I think it would be very useful to have a user's GID in a variable. > > So i could use for example: mail_attachment_dir = /srv/mail/.SiS/%{gid} This was simple enough :) http://hg.dovecot.org/dovecot-2.1/rev/8a63f621bd2e http://hg.dovecot.org/dovecot-2.0/rev/af6d0858e64b From djonas at vitalwerks.com Fri Dec 9 21:16:19 2011 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 09 Dec 2011 11:16:19 -0800 Subject: [Dovecot] Make entire mailbox read-only (ACLs?) Message-ID: <4EE25E83.1090700@vitalwerks.com> Hello, Is there a way of locking a mailbox, effectively making it read-only to IMAP clients? I've read through http://wiki2.dovecot.org/ACL. I created dovecot-acl with the content "owner lr" in .INBOX which seems to keep me from copying messages into the folder, but not out. I have the plugin configured correctly, it seems, since MYRIGHTS command shows the correct value: 30 MYRIGHTS "INBOX" * MYRIGHTS "INBOX" lr Am I barking up the wrong tree? Is there an easier way to lock a mailbox? post-login scripting perhaps? Thanks! From brad at omnis.com Fri Dec 9 22:13:19 2011 From: brad at omnis.com (Brad Schuetz) Date: Fri, 09 Dec 2011 12:13:19 -0800 Subject: [Dovecot] Two recent issues Message-ID: <4EE26BDF.4080500@omnis.com> I've been using dovecot for years, been working great. However recently I've come across two issues. The first issue unfortunately I have little information on, mail_debug hasn't provided anything useful either (in fact it looks like the login request that fails doesn't even get logged at all). During the morning rush of email, this server has around 11k mailboxes on it, it *appears* that one of the auth processes dies resulting in "dovecot: imap-login: Error: read(imap) failed: Connection reset by peer" errors followed by "dovecot: imap-login: Internal login failure ..." in the logs. I've yet to get any useful debugging information on this error so I'm not expecting much/any help on this one, but if anyone has any ideas on how I can get more debug besides running strace 24/7 in the hopes it catches something before the hard drive is full of strace output I'd love to hear it. The best I've gotten was a lucky strace once (at the time I didn't realize it was so lucky or I would have saved the output) that indicated the imap-login daemon was failing to connect to the auth process. The second issue is lmtp/lda (tried both) delivery to a mailbox that has filesystem quotas enabled and the group quota is maxed is resulting in the below panic and crash. This issue happens with 2.0.13, 2.0.15 and 2.0.16. Here's the logs showing that it knows the disk quota is exceeded and then a subsequent zlib panic. Like it's trying to deliver it anyway. --------------------- 11:21:07 [err] dovecot: lmtp(29691, admin@[redacted].com): Error: o_stream_send_istream(/email/d/r/[redacted]/[redacted]/admin/Maildir/tmp/1323458467.M245978P29691.fenrir.omnis.com) failed: Disk quota exceeded 11:21:07 [crit] dovecot: lmtp(29691, admin@[redacted].com): Panic: file ostream-zlib.c: line 144 (o_stream_zlib_send_flush): assertion failed: (zs->avail_in == 0) 11:21:07 [err] dovecot: lmtp(29691, admin@[redacted].com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 [0x345443ca90] -> /usr/lib64/dovecot/libdovecot.so.0 [0x345443cae6] -> /usr/lib64/dovecot/libdovecot.so.0 [0x345443c4a3] -> /usr/lib64/dovecot/lib20_zlib_plugin.so [0x2ba2d31547f6] -> /usr/lib64/dovecot/lib20_zlib_plugin.so [0x2ba2d315481b] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_flush+0x2a) [0x345444f0ea] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_save_finish+0x6b) [0x3451c63b6b] -> /usr/lib64/dovecot/lib10_quota_plugin.so [0x2ba2d2f4ce7a] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_save_finish+0x30) [0x3451c2fbb0] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xb3) [0x3451c2aae3] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_copy+0x56) [0x3451c6fd36] -> /usr/lib64/dovecot/lib10_quota_plugin.so [0x2ba2d2f4d0ba] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5a) [0x3451c301ba] -> /usr/lib64/dovecot/li 11:21:07 [err] dovecot: master: Error: service(lmtp): child 29691 killed with signal 6 (core dumps disabled) --------------------- Attached is the current "doveadm config" output. -- Brad Schuetz -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: dovecot.config URL: From hsehic at econtec.de Fri Dec 9 23:52:40 2011 From: hsehic at econtec.de (Sehic, Haris) Date: Fri, 9 Dec 2011 22:52:40 +0100 (CET) Subject: [Dovecot] Per-User MySQL Quota (postfixadmin) In-Reply-To: References: <30505072.4022.1323384713873.JavaMail.open-xchange@mail02.econtec.de> Message-ID: <11181131.4211.1323467560596.JavaMail.open-xchange@mail02.econtec.de> Hi Maciej, ? thanks for the hint! ? http://wiki2.dovecot.org/UserDatabase/Prefetch ? did the trick!? ? Greets ? Haris? ? ? Maciej Przybecki hat am 9. Dezember 2011 um 06:52 geschrieben: > I faced the same problem and digged for 2 days with no luck. It occurred, that > I have userdb { ...} section defined as static values, so user_query has never > been queried :-). > So you must check your userdb section of your config. > -Maciej > > > Wys?ane z iPhone'a > > Dnia 8 gru 2011 o godz. 23:51 "Sehic, Haris" napisa?(a): > > > Hi, > >? > > need some help setting per-user quota and postfixadmin. Setup is working on > > 1.2 > > dovecot. Tryin 2.1 dovecot now,? quota is working but overriden quota rule > > set > > by 'user_query =' in /etc/dovecot/dovecot-sql.conf.ext takes no efffekt. > > What's > > wrong here? > >? > > Greets > >? > > Haris > > > > > > > -- Haris Sehic, Econtec GmbH Office Phone: +49 9129 29419-36 Office Fax:? ? ? ? ? ? ? ? ?-99 ----------------------------------------------------------------------------- Econtec GmbH Nibelungenstrasse 5 90530 Wendelstein Germany Tel.: 0049 - 9129 - 29 419 0 Fax : 0049 - 9129 - 29 419 99 e-mail: info at econtec.de Gesch?ftsf?hrer Herr Roland Borst HRB 15208, N?rnberg UID-Nr. : DE190650537 Steuer-Nr.: 241/125/20496 From brad at omnis.com Sat Dec 10 02:12:30 2011 From: brad at omnis.com (Brad Schuetz) Date: Fri, 09 Dec 2011 16:12:30 -0800 Subject: [Dovecot] Major bug with hardlinks and lmtp Message-ID: <4EE2A3EE.6060503@omnis.com> In working on trying to fix the crash issue from my last email I had enabled LMTP delivery to try it out instead of using the LDA. I have discovered that when a single piece of email is to be delivered to multiple users the message is being hard linked instead of copied into each mail box. This is a major problem that makes LMTP unusable in an environment where each mailbox has it's own UID since the hard linked file will only be readable by one of the users. I assume this is related to "maildir_copy_with_hardlinks=yes", however this setting doesn't say anything about hardlinking across different email accounts. -- Brad Schuetz From user+dovecot at localhost.localdomain.org Sat Dec 10 05:35:56 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 10 Dec 2011 04:35:56 +0100 Subject: [Dovecot] 2.1.rc1 (8a63f621bd2e): SiS permission issue + crash Message-ID: <4EE2D39C.2030106@localhost.localdomain.org> Since changeset 8a63f621bd2e I'm one step closer to the perfect working setup. I'm sharing one GID per domain, all it's alias names and accounts. So I can use: mail_attachment_dir = /srv/mail/.SiS/%{gid} In order to avoid permission trouble I've set fs ACL on the .SiS dir: ,--[ getfacl srv/mail/.SiS ]-- | # file: srv/mail/.SiS | # owner: root | # group: root | user::rwx | group::--x | mask::--x | other::-wx | default:user::rwx | default:group::rwx | default:mask::rwx | default:other::--- `-- OK, lets test the setup: dsync -u test-0 at example.com mirror maildir:/tmp/Maildir rm -rf Maildir && cp -a Maildir_org Maildir && chown -R 70010:70002 Maildir dsync -vu test-1 at example.com mirror maildir:/tmp/Maildir dsync(test-1 at example.com): Info: Drafts: only in dest (guid=b6a53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Info: Sent: only in dest (guid=b7a53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Info: Junk-E-Mail: only in dest (guid=b8a53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Info: Trash: only in dest (guid=b9a53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Info: INBOX: only in dest (guid=baa53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Error: stat(/srv/mail/.SiS/70002/a2/7b/.temp.blau.819.4f06409857c627e0) failed: Permission denied dsync(test-1 at example.com): Error: safe_mkstemp(/srv/mail/.SiS/70002/a2/7b/.temp.blau.819.) failed: Permission denied dsync(test-1 at example.com): Panic: file dsync-worker-local.c: line 1644 (local_worker_save_msg_continue): assertion failed: (ret == -1) dsync(test-1 at example.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x4faf1) [0x7f4db31f4af1] -> /usr/local/lib/dovecot/libdovecot.so.0(default_error_handler+0) [0x7f4db31f4b7d] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4db31f4e01] -> dsync() [0x416af8] -> dsync() [0x416e46] -> dsync(dsync_worker_msg_save+0x82) [0x412cb2] -> dsync() [0x40b7e0] -> dsync() [0x417286] -> dsync() [0x417324] -> dsync(dsync_worker_msg_get+0xa8) [0x412dd4] -> dsync() [0x40bbf3] -> dsync() [0x40bd62] -> dsync() [0x40c106] -> dsync() [0x40c318] -> dsync(dsync_brain_msg_sync_new_msgs+0x1c) [0x40c336] -> dsync(dsync_brain_msg_sync_more+0x1ae) [0x40b15e] -> dsync() [0x409b88] -> dsync(dsync_brain_sync+0x231) [0x40a074] -> dsync() [0x4084fb] -> dsync() [0x408729] -> dsync(dsync_brain_sync+0x1a7) [0x409fea] -> dsync() [0x408238] -> dsync() [0x408388] -> dsync(dsync_brain_sync+0x10b) [0x409f4e] -> dsync(dsync_brain_sync_all+0x24) [0x40a16b] -> dsync(main+0x680) [0x407b2b ] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f4db2e3fead] -> dsync() [0x406e09] Aborted (core dumped) Looks like Dovecot ignores the ACL. I think a mail_attachment_dir_mode setting could help to work around this problem. Dunno what would be a good default value. But I would set mail_attachment_dir_mode = 0770 The attachment files have mode 0660, that's perfect in my setup. Regards, Pascal -- The trapper recommends today: c01dcafe.1134404 at localdomain.org -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: doveconf.txt URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: dsync_bt.txt URL: From tss at iki.fi Sat Dec 10 07:08:28 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 07:08:28 +0200 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <1323335981.15365.90.camel@hurina> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> <1323335981.15365.90.camel@hurina> Message-ID: <1323493708.15365.103.camel@hurina> On Thu, 2011-12-08 at 11:19 +0200, Timo Sirainen wrote: > On Thu, 2011-12-08 at 09:55 +0100, Mike Constabel wrote: > > > As you see there is a second "-" in the name: > > > > "T&APw-r" != "T&-APw-r" > > Oh, right, it's broken in the "fs" layout. With "maildir++" layout it > works. And looks like this isn't going to be an easy fix. The fs layout > listing code is horrible.. Maybe I'll just try rewriting it. OK, this should do it, hopefully without breaking anything: http://hg.dovecot.org/dovecot-2.1/rev/ab696ead12cc From tss at iki.fi Sat Dec 10 07:11:34 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 07:11:34 +0200 Subject: [Dovecot] Major bug with hardlinks and lmtp In-Reply-To: <4EE2A3EE.6060503@omnis.com> References: <4EE2A3EE.6060503@omnis.com> Message-ID: <1323493894.15365.105.camel@hurina> On Fri, 2011-12-09 at 16:12 -0800, Brad Schuetz wrote: > I have discovered that when a single piece of email is to be delivered > to multiple users the message is being hard linked instead of copied > into each mail box. This is a major problem that makes LMTP unusable in > an environment where each mailbox has it's own UID since the hard linked > file will only be readable by one of the users. This happens only if the users share the same GID. I already fixed this, but since it's a rather large change it's only in v2.1. From tss at iki.fi Sat Dec 10 07:13:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 07:13:06 +0200 Subject: [Dovecot] Make entire mailbox read-only (ACLs?) In-Reply-To: <4EE25E83.1090700@vitalwerks.com> References: <4EE25E83.1090700@vitalwerks.com> Message-ID: <1323493986.15365.107.camel@hurina> On Fri, 2011-12-09 at 11:16 -0800, David Jonas wrote: > Is there a way of locking a mailbox, effectively making it read-only to > IMAP clients? By "mailbox" you mean the user's all folders? This isn't possible currently, except by modifying filesystem permissions. A "default ACL for entire namespace" would be a nice feature, but it's just not done yet.. From tss at iki.fi Sat Dec 10 07:58:16 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 07:58:16 +0200 Subject: [Dovecot] Two recent issues In-Reply-To: <4EE26BDF.4080500@omnis.com> References: <4EE26BDF.4080500@omnis.com> Message-ID: <1323496696.15365.124.camel@hurina> On Fri, 2011-12-09 at 12:13 -0800, Brad Schuetz wrote: > I've been using dovecot for years, been working great. However recently > I've come across two issues. > > The first issue unfortunately I have little information on, mail_debug > hasn't provided anything useful either (in fact it looks like the login > request that fails doesn't even get logged at all). The *_debug settings aren't very helpful in debugging random failures. > During the morning rush of email, this server has around 11k mailboxes > on it, it *appears* that one of the auth processes dies resulting in > "dovecot: imap-login: Error: read(imap) failed: Connection reset by > peer" errors followed by "dovecot: imap-login: Internal login failure > ..." in the logs. If auth process dies unexpectedly, master always logs an error, such as: Dec 10 07:15:34 auth: Fatal: master: service(auth): child 27895 killed with signal 11 (core dumped) Anyway, "read(imap) failed: Connection reset by peer" can happen if you reach the service imap { process_limit }. But then there should be a warning logged about it also: Dec 10 07:17:39 master: Warning: service(imap): process_limit reached, client connections are being dropped So, that error message alone shouldn't be happening.. > The best I've gotten was a lucky strace once (at the time I didn't > realize it was so lucky or I would have saved the output) that indicated > the imap-login daemon was failing to connect to the auth process. If that happens, there would also be an error message logged about it. One thing that v2.0 doesn't log about is if auth socket gets disconnected, but that would result in different problems. v2.1 logs about that too. > The second issue is lmtp/lda (tried both) delivery to a mailbox that has > filesystem quotas enabled and the group quota is maxed is resulting in > the below panic and crash. > > 11:21:07 [err] dovecot: lmtp(29691, admin@[redacted].com): Error: > o_stream_send_istream(/email/d/r/[redacted]/[redacted]/admin/Maildir/tmp/1323458467.M245978P29691.fenrir.omnis.com) > failed: Disk quota exceeded > 11:21:07 [crit] dovecot: lmtp(29691, admin@[redacted].com): Panic: file > ostream-zlib.c: line 144 (o_stream_zlib_send_flush): assertion failed: > (zs->avail_in == 0) I couldn't reproduce this with my tests, but http://hg.dovecot.org/dovecot-2.0/rev/75daa638281b should fix it. From djonas at vitalwerks.com Sat Dec 10 08:00:04 2011 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 09 Dec 2011 22:00:04 -0800 Subject: [Dovecot] Make entire mailbox read-only (ACLs?) In-Reply-To: <1323493986.15365.107.camel@hurina> References: <4EE25E83.1090700@vitalwerks.com> <1323493986.15365.107.camel@hurina> Message-ID: <4EE2F564.9090405@vitalwerks.com> On 12/9/11 9:13 PM, Timo Sirainen wrote: > On Fri, 2011-12-09 at 11:16 -0800, David Jonas wrote: > >> Is there a way of locking a mailbox, effectively making it read-only to >> IMAP clients? > By "mailbox" you mean the user's all folders? This isn't possible > currently, except by modifying filesystem permissions. A "default ACL > for entire namespace" would be a nice feature, but it's just not done > yet.. Looks like changing the filesystem permissions gets me what I'm looking for. I simply removed write permissions for {cur,tmp,new}. Mailbox access seems to work just fine. Thunderbird shows the server responding with "SERVERBUG" and I get a "Permission denied" error in the logs, though. Not a big deal, the users will be notified before hand. Thanks! From tss at iki.fi Sat Dec 10 08:03:25 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 08:03:25 +0200 Subject: [Dovecot] Make entire mailbox read-only (ACLs?) In-Reply-To: <4EE2F564.9090405@vitalwerks.com> References: <4EE25E83.1090700@vitalwerks.com> <1323493986.15365.107.camel@hurina> <4EE2F564.9090405@vitalwerks.com> Message-ID: <1323497005.15365.126.camel@hurina> On Fri, 2011-12-09 at 22:00 -0800, David Jonas wrote: > On 12/9/11 9:13 PM, Timo Sirainen wrote: > > On Fri, 2011-12-09 at 11:16 -0800, David Jonas wrote: > > > >> Is there a way of locking a mailbox, effectively making it read-only to > >> IMAP clients? > > By "mailbox" you mean the user's all folders? This isn't possible > > currently, except by modifying filesystem permissions. A "default ACL > > for entire namespace" would be a nice feature, but it's just not done > > yet.. > Looks like changing the filesystem permissions gets me what I'm looking > for. I simply removed write permissions for {cur,tmp,new}. Mailbox > access seems to work just fine. Thunderbird shows the server responding > with "SERVERBUG" and I get a "Permission denied" error in the logs, > though. Not a big deal, the users will be notified before hand. Thanks! If you remove the write permissions also from the parent Maildir (or possibly some other files too), it shouldn't send SERVERBUG. From tss at iki.fi Sat Dec 10 08:17:27 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 08:17:27 +0200 Subject: [Dovecot] 2.1.rc1 (8a63f621bd2e): SiS permission issue + crash In-Reply-To: <4EE2D39C.2030106@localhost.localdomain.org> References: <4EE2D39C.2030106@localhost.localdomain.org> Message-ID: <1323497848.15365.128.camel@hurina> On Sat, 2011-12-10 at 04:35 +0100, Pascal Volk wrote: > dsync(test-1 at example.com): Panic: file dsync-worker-local.c: line 1644 (local_worker_save_msg_continue): assertion failed: (ret == -1) I'll see about this crash later.. > Looks like Dovecot ignores the ACL. I think a mail_attachment_dir_mode > setting could help to work around this problem. Dunno what would be a > good default value. But I would set mail_attachment_dir_mode = 0770 > The attachment files have mode 0660, that's perfect in my setup. With http://hg.dovecot.org/dovecot-2.1/rev/fcceee891448 you can do: mail_attachment_fs = sis posix:mode=0660 The dirs get created with 0770 then. From tss at iki.fi Sat Dec 10 08:27:02 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 08:27:02 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> Message-ID: <1323498422.15365.129.camel@hurina> On Thu, 2011-12-08 at 16:10 +0000, Mark Zealey wrote: > By the way, another bug I noticed with dsync is that when converting from Maildir to sdbox is that the date.saved field is not preserved - it's just the time when the first dsync command happened. Presumably it should be the mtime of the Maildir message file With Maildir the date.saved is taken from the mail file's ctime (yes, it's not perfect, but it's good enough for what it's used for). It's preserved in my tests. From tss at iki.fi Sat Dec 10 08:28:27 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 08:28:27 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> Message-ID: <1323498507.15365.130.camel@hurina> On Thu, 2011-12-08 at 14:45 +0000, Mark Zealey wrote: > With 2.0.16 hdr.xxx fields get copied fine (but of course without timestamp). With the patch you provided they don't get copied whether using mirror or backup & starting from scratch. I'm doing a Maildir to sdbox migration otherwise don't think I'm doing anytihng strange. Show the whole list of cache decisions in source and destination? From tss at iki.fi Sat Dec 10 11:16:09 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 11:16:09 +0200 Subject: [Dovecot] lmtp panic in proxy lmtp director In-Reply-To: <4EDCD4AE.8030607@uib.es> References: <4EDCD4AE.8030607@uib.es> Message-ID: <1323508572.15365.141.camel@hurina> On Mon, 2011-12-05 at 15:26 +0100, Xavier Pons wrote: > Hi, we are getting some core dumps with signal 6 in ltmp on a dovecot > director proxy server, > like this: > > Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Panic: file lmtp-proxy.c: > line 376 (lmtp_proxy_output_timeout): assertion failed: > (proxy->data_input->eof) I think the way I originally planned LMTP proxying to work is simply too complex to work reliably, perhaps even if the code was bug-free. So instead of reading+writing DATA at the same time, this patch changes the DATA to be first read into memory or temp file, and then from there read and sent to the LMTP backends: http://hg.dovecot.org/dovecot-2.1/raw-rev/51d87deb5c26 The patch applies on top of v2.0 also. I tested that it appears to work, but more testing wouldn't hurt to make sure it won't corrupt large mails when sending them to multiple backends (one mail with multiple RCPT TOs sent to multiple different backends).. From tss at iki.fi Sat Dec 10 11:35:23 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 11:35:23 +0200 Subject: [Dovecot] overriding userdb connection host for doveadm-user In-Reply-To: <87r50f17y1.fsf@algae.riseup.net> References: <87aa742rbo.fsf@algae.riseup.net> <1323318179.15365.62.camel@hurina> <87r50f17y1.fsf@algae.riseup.net> Message-ID: <1323509723.15365.156.camel@hurina> On Thu, 2011-12-08 at 08:58 -0500, micah anderson wrote: > On Thu, 08 Dec 2011 06:22:58 +0200, Timo Sirainen wrote: > > On Wed, 2011-12-07 at 13:02 -0500, Micah Anderson wrote: > > > I've got my users in a replicated database setup and dovecot configured > > > with two connect lines in dovecot-sql.conf: > > > > > > connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass > > > connect = host=127.0.0.2 port=3306 dbname=users user=user password=pass > > > > > > this works really well to help balance the load. > > > > If you actually have it like that, it should only be using 127.0.0.2, as > > the second connect setting overrides the first one.. > > What I actually have is: > > connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass > connect = host=127.0.0.1 port=3307 dbname=users user=user password=pass > > two different port configurations (I'm running stunnel), rather than two > different host entries[0]. The only port Dovecot should be connecting with the above config is 3307. > >The right way would have been: > > > > connect = host=127.0.0.1 host=127.0.0.2 port=... > > So, if I just have two different ports, would the right way be: > > connect = host=127.0.0.1 port=3306 port=3307 dbname... > > ? There's actually no way to load balance between multiple ports. If there were, the config would probably have to be changed to something like host=127.0.0.1:3306 host=127.0.0.1:3307, because otherwise it would be confusing what should happen when there are multiple hosts and multiple ports. Anyway, maybe you could use multiple IPs instead of multiple ports? "host=127.0.0.1 host=127.0.0.2". From tss at iki.fi Sat Dec 10 11:41:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 11:41:19 +0200 Subject: [Dovecot] noaclright In-Reply-To: <4EE09D70.3080909@graband.de> References: <4EE09D70.3080909@graband.de> Message-ID: <1323510081.15365.159.camel@hurina> On Thu, 2011-12-08 at 12:20 +0100, Knud Dombrowsky wrote: > Hi, > I recently upgraded to openSuse 12.1 which comes with dovecot 2.0.14. What was the old Dovecot version? > Dec 7 14:31:14 mailbox dovecot: imap(): Error: > fstat(/home//Maildir/./dovecot-acl.lock) > failed: No such file or directory This should never happen. fstat() simply cannot fail with ENOENT. It's a kernel bug (or "feature") if it does. What filesystem do you use? Do you have SELinux/apparmor enabled? BTW. There's "doveadm acl" command that may be helpful to you. From tss at iki.fi Sat Dec 10 11:52:24 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 11:52:24 +0200 Subject: [Dovecot] POP - preventing re-download with server move In-Reply-To: <710C58696EA3BC42B425E4DBB39C1D5E48552AAE@MAIL-MBX2.ad.csbsju.edu> References: <710C58696EA3BC42B425E4DBB39C1D5E48552AAE@MAIL-MBX2.ad.csbsju.edu> Message-ID: <1323510745.15365.161.camel@hurina> On Thu, 2011-11-24 at 14:46 +0000, Trutwin, Joshua wrote: > So now I have to move my sites to a new server and I'm trying to > avoid having all these messages re-downloaded by POP clients. http://wiki2.dovecot.org/Migration#POP3_migration explains this. > The mail is stored in Maildirs - a sample file: 1280409166.23580.foo:2,S > > If I move this to server "bar" would renaming the file to > 1280409166.23580.bar:2,S prevent this somehow? That can only make things worse. From nick.z.edwards at gmail.com Sat Dec 10 12:07:48 2011 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Sat, 10 Dec 2011 20:07:48 +1000 Subject: [Dovecot] database failover Message-ID: Trying to get dovecot to _only_ use local copy of database, only querying another database server (same database, just replicated) if local copy is not responding, I have google fu'd a bit and found my only answer in so far as dovecot did this once upon as time, but it was only due to a dovecot bug, that has since been fixed, is that so? The wiki shows no information of failover, just load sharing, or is it an undocumented feature, or can dovecot not do failover, if not, can it be made so? Trying to cut down on network traffic, postfix does this nicely, I thought dovecot did too. From robert at schetterer.org Sat Dec 10 12:18:52 2011 From: robert at schetterer.org (Robert Schetterer) Date: Sat, 10 Dec 2011 11:18:52 +0100 Subject: [Dovecot] database failover In-Reply-To: References: Message-ID: <4EE3320C.2050607@schetterer.org> Am 10.12.2011 11:07, schrieb Nick Edwards: > Trying to get dovecot to _only_ use local copy of database, only querying > another database server (same database, just replicated) if local copy is > not responding, I have google fu'd a bit and found my only answer in so far > as dovecot did this once upon as time, but it was only due to a dovecot > bug, that has since been fixed, is that so? > The wiki shows no information of failover, just load sharing, or is it an > undocumented feature, or can dovecot not do failover, if not, can it be > made so? > > Trying to cut down on network traffic, postfix does this nicely, I thought > dovecot did too. > as far i know recent dovecot cant do it youre right postfix does you can do a master-master setup i.e with mysql solving this works nice here, but might not be the best solution perhaps ldap, or other databases are better -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From tss at iki.fi Sat Dec 10 12:26:09 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 12:26:09 +0200 Subject: [Dovecot] database failover In-Reply-To: References: Message-ID: <994B8A50-1BF9-47D3-8DB1-2E150E975E05@iki.fi> On 10.12.2011, at 12.07, Nick Edwards wrote: > Trying to get dovecot to _only_ use local copy of database, only querying > another database server (same database, just replicated) if local copy is > not responding, I have google fu'd a bit and found my only answer in so far > as dovecot did this once upon as time, but it was only due to a dovecot > bug, that has since been fixed, is that so? > The wiki shows no information of failover, just load sharing, or is it an > undocumented feature, or can dovecot not do failover, if not, can it be > made so? > > Trying to cut down on network traffic, postfix does this nicely, I thought > dovecot did too. You could add two passdbs + userdbs with different configs. The second dbs would be used when first db is down, but also for unknown users / wrong authentications. But yeah, the load balancing should be optional. There are just so many other things to do as well.. From mark.zealey at webfusion.com Sat Dec 10 12:55:28 2011 From: mark.zealey at webfusion.com (Mark Zealey) Date: Sat, 10 Dec 2011 12:55:28 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323498422.15365.129.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> <1323498422.15365.129.camel@hurina> Message-ID: <4EE33AA0.7050807@webfusion.com> 10-12-2011 08:27, Timo Sirainen yazm??: > On Thu, 2011-12-08 at 16:10 +0000, Mark Zealey wrote: >> By the way, another bug I noticed with dsync is that when converting from Maildir to sdbox is that the date.saved field is not preserved - it's just the time when the first dsync command happened. Presumably it should be the mtime of the Maildir message file > With Maildir the date.saved is taken from the mail file's ctime (yes, > it's not perfect, but it's good enough for what it's used for). It's > preserved in my tests. It could well be because of the conversion to sdbox then - the ctime/mtime of the files are not being preserved by dsync (in stock 2.0.16). The date.saved timestamp is only put into the cache on the second dsync run; presumably therefore it picks it up from the filesystem. Mark From mark.zealey at webfusion.com Sat Dec 10 13:03:42 2011 From: mark.zealey at webfusion.com (Mark Zealey) Date: Sat, 10 Dec 2011 13:03:42 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323498507.15365.130.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> <1323498507.15365.130.camel@hurina> Message-ID: <4EE33C8E.9050005@webfusion.com> 10-12-2011 08:28, Timo Sirainen yazm??: > On Thu, 2011-12-08 at 14:45 +0000, Mark Zealey wrote: >> With 2.0.16 hdr.xxx fields get copied fine (but of course without timestamp). With the patch you provided they don't get copied whether using mirror or backup& starting from scratch. I'm doing a Maildir to sdbox migration otherwise don't think I'm doing anytihng strange. > Show the whole list of cache decisions in source and destination? Ah-ha it's doing the same in 2.0.16 - looking deeper it's because i havn't accessed the tmp fields in a week or two so I guess the decision has been taken not to migrate them. Mark From tss at iki.fi Sat Dec 10 13:07:08 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 13:07:08 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <4EE33C8E.9050005@webfusion.com> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> <1323498507.15365.130.camel@hurina> <4EE33C8E.9050005@webfusion.com> Message-ID: On 10.12.2011, at 13.03, Mark Zealey wrote: > Ah-ha it's doing the same in 2.0.16 - looking deeper it's because i havn't accessed the tmp fields in a week or two so I guess the decision has been taken not to migrate them. Yes, most likely the reason. Could this also explain the date.saved? > It could well be because of the conversion to sdbox then - the ctime/mtime of the files are not being preserved by dsync (in stock 2.0.16). The date.saved timestamp is only put into the cache on the second dsync run; presumably therefore it picks it up from the filesystem. With sdbox the file's mtime isn't even tried to be preserved. The received-time and saved-time are written to the metadata block inside the file. From mark.zealey at webfusion.com Sat Dec 10 13:32:23 2011 From: mark.zealey at webfusion.com (Mark Zealey) Date: Sat, 10 Dec 2011 13:32:23 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> <1323498507.15365.130.camel@hurina> <4EE33C8E.9050005@webfusion.com> Message-ID: <4EE34347.7040007@webfusion.com> 10-12-2011 13:07, Timo Sirainen yazm??: >> It could well be because of the conversion to sdbox then - the ctime/mtime of the files are not being preserved by dsync (in stock 2.0.16). The date.saved timestamp is only put into the cache on the second dsync run; presumably therefore it picks it up from the filesystem. > With sdbox the file's mtime isn't even tried to be preserved. The received-time and saved-time are written to the metadata block inside the file. Ah yes; I saw the R metadata but not the C header key. Looking deeper at this I think I was expecting the date.save time to be about the same as the date.receive; however the ctime for these files is quite recent presumably affected by setting of message flags in a maildir or something (we're using nfs). The source cache says: - date.received: 1301978447 (4f9d9a4d) - date.save: 1322465550 (0e39d34e) The message file itself has mtime 1301978447 and ctime 1323514077; and in the sdbox header/metadata we have: C4ee3391a R4d9a9d4f so ctime/sdbox C entry are close enough by my calculations (not sure where the 61 seconds of difference comes from though). It is a bit strange you wouldn't use the source cache's value for date.save if it is available as ctime can be pretty unreliable? Mark From tss at iki.fi Sat Dec 10 14:13:57 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 14:13:57 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <4EE34347.7040007@webfusion.com> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> <1323498507.15365.130.camel@hurina> <4EE33C8E.9050005@webfusion.com> <4EE34347.7040007@webfusion.com> Message-ID: <8A79B07C-80A5-4535-BD0A-58BB0D7D4A36@iki.fi> On 10.12.2011, at 13.32, Mark Zealey wrote: > 10-12-2011 13:07, Timo Sirainen yazm??: >>> It could well be because of the conversion to sdbox then - the ctime/mtime of the files are not being preserved by dsync (in stock 2.0.16). The date.saved timestamp is only put into the cache on the second dsync run; presumably therefore it picks it up from the filesystem. >> With sdbox the file's mtime isn't even tried to be preserved. The received-time and saved-time are written to the metadata block inside the file. > > Ah yes; I saw the R metadata but not the C header key. The C is the file's create time. It's not actually use for anything. > Looking deeper at this I think I was expecting the date.save time to be about the same as the date.receive; however the ctime for these files is quite recent presumably affected by setting of message flags in a maildir or something (we're using nfs). Yes, maildir flag changes change the ctime, which also changes the save date if it's not already cached. > so ctime/sdbox C entry are close enough by my calculations (not sure where the 61 seconds of difference comes from though). It is a bit strange you wouldn't use the source cache's value for date.save if it is available as ctime can be pretty unreliable? It is using the the cached value. Anyway, I remembered wrong how sdbox's save date is looked up. It's taken from the sdbox file's ctime. The reason is similar to maildir: The save date is used mainly to figure out when to automatically expunge messages from Trash after it's been there for n days. So if you copy 1 year old message to Trash, you don't want it expunged immediately (based on mtime or some metadata inside the file), you want it expunged n days since the move. And ctime is really the only nice way to do it automatically, because copying a message with sdbox is done with hard linking. mdbox stores the save date in the index file. sdbox could do it too, but that's just extra work and probably not worth the trouble. And unlink atime/mtime, ctime can't be changed using any syscalls (except to current time). So, I think everything here works as intended, although not really as expected. :) From listen at constabel.net Sat Dec 10 16:10:31 2011 From: listen at constabel.net (Mike Constabel) Date: Sat, 10 Dec 2011 15:10:31 +0100 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <1323493708.15365.103.camel@hurina> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> <1323335981.15365.90.camel@hurina> <1323493708.15365.103.camel@hurina> Message-ID: <20111210141031.GL22136@herakles.constabel-it.de> Hi, Timo Sirainen schrieb am Saturday, den 10. December 2011: > On Thu, 2011-12-08 at 11:19 +0200, Timo Sirainen wrote: > > On Thu, 2011-12-08 at 09:55 +0100, Mike Constabel wrote: > > > > > As you see there is a second "-" in the name: > > > > > > "T&APw-r" != "T&-APw-r" > > > > Oh, right, it's broken in the "fs" layout. With "maildir++" layout it > > works. And looks like this isn't going to be an easy fix. The fs layout > > listing code is horrible.. Maybe I'll just try rewriting it. > > OK, this should do it, hopefully without breaking anything: > http://hg.dovecot.org/dovecot-2.1/rev/ab696ead12cc > This works for me with a litte problem. If I create in TB folder like "moe" (without special chars) the folder will be created, subscribed and TB shows the folder instantly. But if I create a folder like "m?" (with special chars) the folder will be created, subscribed and *TB doesn't show the folder*. I must unsubscribe and subscribe it in TB to show it in folder pane. Mike From user+dovecot at localhost.localdomain.org Sat Dec 10 17:39:26 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 10 Dec 2011 16:39:26 +0100 Subject: [Dovecot] 2.1.rc1 (51d87deb5c26): %{gid} modification problem Message-ID: <4EE37D2E.9020700@localhost.localdomain.org> I tried to apply the X modifier to the %{gid} variable: 'mail_attachment_dir = /srv/mail/.SiS/%X{gid}'. But the name of the created directory is '0', instead of '11172'. Regards, Pascal -- The trapper recommends today: c01dcofe.1134416 at localdomain.org From user+dovecot at localhost.localdomain.org Sat Dec 10 18:09:07 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 10 Dec 2011 17:09:07 +0100 Subject: [Dovecot] 2.1.rc1 (51d87deb5c26): %{gid} modification problem In-Reply-To: <4EE37D2E.9020700@localhost.localdomain.org> References: <4EE37D2E.9020700@localhost.localdomain.org> Message-ID: <4EE38423.3010604@localhost.localdomain.org> On 12/10/2011 04:39 PM Pascal Volk wrote: > But the name of the created directory is '0', instead of '11172'. 0 was the hex version of a empty string. For now I've reverted changeset 499e4916bed5. This brings the content of %{gid} back and %X{gid} works now as expected. Regards, Pascal -- The trapper recommends today: beeffeed.1134417 at localdomain.org From user+dovecot at localhost.localdomain.org Sat Dec 10 18:46:31 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 10 Dec 2011 17:46:31 +0100 Subject: [Dovecot] 2.1.rc1 (51d87deb5c26): %{gid} modification problem In-Reply-To: <4EE38423.3010604@localhost.localdomain.org> References: <4EE37D2E.9020700@localhost.localdomain.org> <4EE38423.3010604@localhost.localdomain.org> Message-ID: <4EE38CE7.8010405@localhost.localdomain.org> On 12/10/2011 05:09 PM Pascal Volk wrote: > ? For now I've reverted changeset 499e4916bed5. OK, I found the problem. You forgot to append the GID to the var_expand_table before returning it. The attached patch works fine for me. It also adds the short variable %g. I hope that's OK. Regards, Pascal -- The trapper recommends today: beeffeed.1134417 at localdomain.org -------------- next part -------------- A non-text attachment was scrubbed... Name: lib-storage.patch Type: text/x-patch Size: 1590 bytes Desc: not available URL: From dieterknopf at googlemail.com Mon Dec 12 02:42:48 2011 From: dieterknopf at googlemail.com (Dieter Knopf) Date: Mon, 12 Dec 2011 01:42:48 +0100 Subject: [Dovecot] Refiltering mails without loosing flags Message-ID: Hello, is there a way to refilter all mails in a folder without loosing all flags and moving all messages in a different folder? I have >10k mails in my Inbox and need to create new filterrules from time to time. But there is no way to refilter my inbox without moving. Atm i need to move all mails in a folder like "refilter" and then run getmail/... to refilter the mails. It would be really nice to refilter a existing folder and just move mails with hits in the filter list. Thanks Dieter From tss at iki.fi Mon Dec 12 06:39:38 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 06:39:38 +0200 Subject: [Dovecot] 2.1.rc1 (51d87deb5c26): %{gid} modification problem In-Reply-To: <4EE38CE7.8010405@localhost.localdomain.org> References: <4EE37D2E.9020700@localhost.localdomain.org> <4EE38423.3010604@localhost.localdomain.org> <4EE38CE7.8010405@localhost.localdomain.org> Message-ID: <1323664781.15365.174.camel@hurina> On Sat, 2011-12-10 at 17:46 +0100, Pascal Volk wrote: > On 12/10/2011 05:09 PM Pascal Volk wrote: > > ? For now I've reverted changeset 499e4916bed5. > > OK, I found the problem. You forgot to append the GID to the > var_expand_table before returning it. The attached patch works fine for me. Yes, fixed that :) > It also adds the short variable %g. I hope that's OK. I think %{gid} is used so rarely that it doesn't really need a short variable. It probably would be better in future to avoid short variables entirely in most places. I also did larger changes to mail-storage-service.c so that in situations when %var expansion is done while running as root, the uid/gid expand properly instead of expanding to 0. This probably happens with some doveadm -A commands or something.. From tss at iki.fi Mon Dec 12 06:53:49 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 06:53:49 +0200 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <20111210141031.GL22136@herakles.constabel-it.de> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> <1323335981.15365.90.camel@hurina> <1323493708.15365.103.camel@hurina> <20111210141031.GL22136@herakles.constabel-it.de> Message-ID: <1323665629.15365.176.camel@hurina> On Sat, 2011-12-10 at 15:10 +0100, Mike Constabel wrote: > > OK, this should do it, hopefully without breaking anything: > > http://hg.dovecot.org/dovecot-2.1/rev/ab696ead12cc > > > > This works for me with a litte problem. > > > If I create in TB folder like "moe" (without special chars) the > folder will be created, subscribed and TB shows the folder > instantly. > > But if I create a folder like "m?" (with special chars) the > folder will be created, subscribed and *TB doesn't show the > folder*. I must unsubscribe and subscribe it in TB to show it in > folder pane. http://hg.dovecot.org/dovecot-2.1/rev/b9fcac239aed should fix it. From listen at constabel.net Mon Dec 12 10:41:04 2011 From: listen at constabel.net (Mike Constabel) Date: Mon, 12 Dec 2011 09:41:04 +0100 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <1323665629.15365.176.camel@hurina> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> <1323335981.15365.90.camel@hurina> <1323493708.15365.103.camel@hurina> <20111210141031.GL22136@herakles.constabel-it.de> <1323665629.15365.176.camel@hurina> Message-ID: <20111212084103.GB6838@herakles.constabel-it.de> On Mon, 12 Dec 2011, Timo Sirainen wrote: > On Sat, 2011-12-10 at 15:10 +0100, Mike Constabel wrote: > > > OK, this should do it, hopefully without breaking anything: > > > http://hg.dovecot.org/dovecot-2.1/rev/ab696ead12cc > > > > > > > This works for me with a litte problem. > > > > > > If I create in TB folder like "moe" (without special chars) the > > folder will be created, subscribed and TB shows the folder > > instantly. > > > > But if I create a folder like "m?" (with special chars) the > > folder will be created, subscribed and *TB doesn't show the > > folder*. I must unsubscribe and subscribe it in TB to show it in > > folder pane. > > http://hg.dovecot.org/dovecot-2.1/rev/b9fcac239aed should fix it. > Yes, it works. Thanks. Mike From listen at constabel.net Mon Dec 12 11:46:15 2011 From: listen at constabel.net (Mike Constabel) Date: Mon, 12 Dec 2011 10:46:15 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts Message-ID: <20111212094615.GD6838@herakles.constabel-it.de> Hi, now the umlauts problem with sieve: # cat /mailspool1/in-preetz.de/test1/.dovecot.sieve ## Generated by Roundcube Webmail SieveRules Plugin ## require ["fileinto"]; # rule:[Test] if anyof (header :contains "Subject" "test") { fileinto "m&APY-"; } Error: DBBjDsXL5U7mIAAA/TNBsA: sieve: execution of script /mailspool1/in-preetz.de/test1/.dovecot.sieve failed, but implicit keep was successful (user logfile /mailspool1/in-preetz.de/test1/.dovecot.sieve.log may reveal additional details) # cat /mailspool1/in-preetz.de/test1/.dovecot.sieve.log sieve: info: started log at Dec 12 10:40:04. error: msgid=<20111212094004.DB86918594 at mx4.constabel-it.de>: failed to store into mailbox 'm&APY-': Mailbox doesn't exist: m&-APY-. Here the same: 'm&APY-' != "m&-APY-" Mike From tss at iki.fi Mon Dec 12 11:58:51 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 11:58:51 +0200 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <20111212094615.GD6838@herakles.constabel-it.de> References: <20111212094615.GD6838@herakles.constabel-it.de> Message-ID: <10C93BD1-CE99-423E-BB13-3DD5C28A83E7@iki.fi> On 12.12.2011, at 11.46, Mike Constabel wrote: > now the umlauts problem with sieve: .. > ## Generated by Roundcube Webmail SieveRules Plugin ## Roundcube bug/"feature". > fileinto "m&APY-"; Sieve uses UTF-8 mailbox names. The reason why Roundcube doesn't use them, is because some old Cyrus Sieve versions didn't use UTF-8. From stephan at rename-it.nl Mon Dec 12 12:00:23 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 12 Dec 2011 11:00:23 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <20111212094615.GD6838@herakles.constabel-it.de> References: <20111212094615.GD6838@herakles.constabel-it.de> Message-ID: <4EE5D0B7.8000208@rename-it.nl> Op 12/12/2011 10:46 AM, Mike Constabel schreef: > Hi, > > now the umlauts problem with sieve: > > # cat /mailspool1/in-preetz.de/test1/.dovecot.sieve > ## Generated by Roundcube Webmail SieveRules Plugin ## > require ["fileinto"]; > > # rule:[Test] > if anyof (header :contains "Subject" "test") > { > fileinto "m&APY-"; > } And here it is actually correct. Sieve fileinto expects the argument to be in utf8 and you are passing the IMAP mutf7. Use fileinto "m?"; instead. Regards, Stephan. From listen at constabel.net Mon Dec 12 12:08:22 2011 From: listen at constabel.net (Mike Constabel) Date: Mon, 12 Dec 2011 11:08:22 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <10C93BD1-CE99-423E-BB13-3DD5C28A83E7@iki.fi> References: <20111212094615.GD6838@herakles.constabel-it.de> <10C93BD1-CE99-423E-BB13-3DD5C28A83E7@iki.fi> Message-ID: <20111212100822.GA27466@herakles.constabel-it.de> Hello, On 2011-12-12 at 10:58 CET Timo Sirainen wrote: > On 12.12.2011, at 11.46, Mike Constabel wrote: > > > now the umlauts problem with sieve: > .. > > ## Generated by Roundcube Webmail SieveRules Plugin ## > > Roundcube bug/"feature". > > > fileinto "m&APY-"; > > Sieve uses UTF-8 mailbox names. The reason why Roundcube doesn't use them, is because some old Cyrus Sieve versions didn't use UTF-8. Ok, good to know. I found the setting in the roundcube sieverules plugin. After setting this to UTF-8 it works. Thanks for the hint. Mike From listen at constabel.net Mon Dec 12 12:10:10 2011 From: listen at constabel.net (Mike Constabel) Date: Mon, 12 Dec 2011 11:10:10 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <4EE5D0B7.8000208@rename-it.nl> References: <20111212094615.GD6838@herakles.constabel-it.de> <4EE5D0B7.8000208@rename-it.nl> Message-ID: <20111212101010.GB27466@herakles.constabel-it.de> Hello Stephan, On 2011-12-12 at 11:00 CET Stephan Bosch wrote: > Op 12/12/2011 10:46 AM, Mike Constabel schreef: > >Hi, > > > >now the umlauts problem with sieve: > > > ># cat /mailspool1/in-preetz.de/test1/.dovecot.sieve > >## Generated by Roundcube Webmail SieveRules Plugin ## > >require ["fileinto"]; > > > ># rule:[Test] > >if anyof (header :contains "Subject" "test") > >{ > > fileinto "m&APY-"; > >} > > And here it is actually correct. Sieve fileinto expects the argument > to be in utf8 and you are passing the IMAP mutf7. > > Use > > fileinto "m?"; > > instead. Thanks for the hint, now it works. :) Mike From stephan at rename-it.nl Mon Dec 12 12:25:29 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 12 Dec 2011 11:25:29 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <20111212100822.GA27466@herakles.constabel-it.de> References: <20111212094615.GD6838@herakles.constabel-it.de> <10C93BD1-CE99-423E-BB13-3DD5C28A83E7@iki.fi> <20111212100822.GA27466@herakles.constabel-it.de> Message-ID: <4EE5D699.4020805@rename-it.nl> Op 12/12/2011 11:08 AM, Mike Constabel schreef: > Hello, > > On 2011-12-12 at 10:58 CET Timo Sirainen wrote: >> On 12.12.2011, at 11.46, Mike Constabel wrote: >>> ## Generated by Roundcube Webmail SieveRules Plugin ## >> Roundcube bug/"feature". >>> fileinto "m&APY-"; >> Sieve uses UTF-8 mailbox names. The reason why Roundcube doesn't use them, is because some old Cyrus Sieve versions didn't use UTF-8. > Ok, good to know. I found the setting in the roundcube sieverules > plugin. After setting this to UTF-8 it works. For posterity: The following setting of the Roundcube Sieverules plugin is relevant to solve this issue (from config.inc.php.dist): // Sieve RFC says that we should use UTF-8 encoding for mailbox names, // but some implementations does not covert UTF-8 to modified UTF-7. // set to null for default behaviour $rcmail_config['sieverules_folder_encoding'] = null; Setting it to 'UTF-8' resolves the issue. Regards, Stephan. From nick.z.edwards at gmail.com Mon Dec 12 13:25:14 2011 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Mon, 12 Dec 2011 21:25:14 +1000 Subject: [Dovecot] database failover In-Reply-To: <4EE3320C.2050607@schetterer.org> References: <4EE3320C.2050607@schetterer.org> Message-ID: Thanks, we considered options, ruled out master-master for security, and since everything is with mysql (AAA) we decided not to introduce another database type, we only use a few servers, so we might use a cron job every minute to test for db response and if fails drop interface, returns up interface, as we use linux HA solution, so if the heartbeat fails it ignores it, and other alerting will notify us eventually if it stays down, not optimum I know, in fact darn right messy, but it'll suffice until Dovecot offers such a solution. On Sat, Dec 10, 2011 at 8:18 PM, Robert Schetterer wrote: > Am 10.12.2011 11:07, schrieb Nick Edwards: > > Trying to get dovecot to _only_ use local copy of database, only querying > > another database server (same database, just replicated) if local copy is > > not responding, I have google fu'd a bit and found my only answer in so > far > > as dovecot did this once upon as time, but it was only due to a dovecot > > bug, that has since been fixed, is that so? > > The wiki shows no information of failover, just load sharing, or is it an > > undocumented feature, or can dovecot not do failover, if not, can it be > > made so? > > > > Trying to cut down on network traffic, postfix does this nicely, I > thought > > dovecot did too. > > > > as far i know recent dovecot cant do it > youre right postfix does > > you can do a master-master setup i.e with mysql > solving this > works nice here, but might not be the best solution > perhaps ldap, or other databases are better > -- > Best Regards > > MfG Robert Schetterer > > Germany/Munich/Bavaria > From nick.z.edwards at gmail.com Mon Dec 12 13:26:31 2011 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Mon, 12 Dec 2011 21:26:31 +1000 Subject: [Dovecot] database failover In-Reply-To: <994B8A50-1BF9-47D3-8DB1-2E150E975E05@iki.fi> References: <994B8A50-1BF9-47D3-8DB1-2E150E975E05@iki.fi> Message-ID: Hello Timo, On Sat, Dec 10, 2011 at 8:26 PM, Timo Sirainen wrote: > On 10.12.2011, at 12.07, Nick Edwards wrote: > > > Trying to get dovecot to _only_ use local copy of database, only querying > > another database server (same database, just replicated) if local copy is > > not responding, I have google fu'd a bit and found my only answer in so > far > > as dovecot did this once upon as time, but it was only due to a dovecot > > bug, that has since been fixed, is that so? > > The wiki shows no information of failover, just load sharing, or is it an > > undocumented feature, or can dovecot not do failover, if not, can it be > > made so? > > > > Trying to cut down on network traffic, postfix does this nicely, I > thought > > dovecot did too. > > You could add two passdbs + userdbs with different configs. The second dbs > would be used when first db is down, but also for unknown users / wrong > authentications. > > But yeah, the load balancing should be optional. There are just so many > other things to do as well.. > > Yes, it would be nice, but I understand you have many things on your todo list. From stephan at rename-it.nl Mon Dec 12 13:43:59 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 12 Dec 2011 12:43:59 +0100 Subject: [Dovecot] Refiltering mails without loosing flags In-Reply-To: References: Message-ID: <4EE5E8FF.8080306@rename-it.nl> Op 12/12/2011 1:42 AM, Dieter Knopf schreef: > is there a way to refilter all mails in a folder without loosing all > flags and moving all messages in a different folder? > > I have>10k mails in my Inbox and need to create new filterrules from > time to time. But there is no way to refilter my inbox without moving. > > Atm i need to move all mails in a folder like "refilter" and then run > getmail/... to refilter the mails. It would be really nice to refilter > a existing > folder and just move mails with hits in the filter list. Since last week, the new sieve-filter command line tool, which is intended for just such a task, is part of the normal compile output for Pigeonhole 0.3.x for Dovecot v2.1. Unfortunately, it is not released yet, so I guess you're stuck with your old getmail-based solution for now. The tool is still experimental and I must say that I have not tested the preservation of flags for some time and many changes were performed since then. I will verify that later today. Also, the interaction with the new editheader extension needs attention. Regards, Stephan. From janfrode at tanso.net Mon Dec 12 13:44:20 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 12 Dec 2011 12:44:20 +0100 Subject: [Dovecot] database failover In-Reply-To: References: <4EE3320C.2050607@schetterer.org> Message-ID: <20111212114420.GA14077@dibs.tanso.net> On Mon, Dec 12, 2011 at 09:25:14PM +1000, Nick Edwards wrote: > Thanks, we considered options, ruled out master-master for security, and > since everything is with mysql (AAA) we decided not to introduce another > database type, But LDAP master-master is sooo nice :-) and once you have your users in LDAP it's triviall to re-use it as user source in lots of services (postfix lookups, authenticated smtp, apache basic auth, dovecot, etc..). To get away from our SPoF mysql userdatabase I wrote some scripts that checkes for changes in the mysql userdatabase, and push these to LDAP every x minutes. The mysql-database is still our master user source, but I'm looking forward to getting rid of it completely real soon now. -jf From marcio.merlone at a1.ind.br Mon Dec 12 13:57:40 2011 From: marcio.merlone at a1.ind.br (Marcio Merlone) Date: Mon, 12 Dec 2011 09:57:40 -0200 Subject: [Dovecot] Documentation clarifiction on mmap_disable Message-ID: <4EE5EC34.5020803@a1.ind.br> Greetings, On http://wiki.dovecot.org/MainConfig I read: "mmap_disable = no Don't use mmap() at all. This is required if you store indexes to shared filesystems (NFS or clustered filesystem). " Does that mean: 1. mmap is required when using NFS or 2. it is required to don't use mmap at all when using NFS? Sorry if this is obvious. Best regards. -- *Marcio Merlone* From tss at iki.fi Mon Dec 12 14:21:02 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 14:21:02 +0200 Subject: [Dovecot] Documentation clarifiction on mmap_disable In-Reply-To: <4EE5EC34.5020803@a1.ind.br> References: <4EE5EC34.5020803@a1.ind.br> Message-ID: <9FFD4EC1-791C-43B8-B80B-F53FE891AFDA@iki.fi> On 12.12.2011, at 13.57, Marcio Merlone wrote: > On http://wiki.dovecot.org/MainConfig I read: > > "mmap_disable = no > Don't use mmap() at all. This is required if you store indexes to > shared filesystems (NFS or clustered filesystem). " The wording is a bit too strong, but..: > Does that mean: > > 1. mmap is required when using NFS or > 2. it is required to don't use mmap at all when using NFS? It's better not to use mmap() with NFS. 1. mmap_disable=yes is required if you attempt to access the same mailbox from more than one Dovecot server, otherwise index files get corrupted really easily. But even with this setting this setup isn't safe! http://wiki2.dovecot.org/NFS explains the problems. 2. mmap_disable=yes is a good idea with NFS even if there's only one Dovecot server, since it should be more optimal and also failures are handled better. 3. mmap_disable=yes is a good idea with cluster filesystems, since it should make the performance better. 4. With local filesystems mmap_disable=no should be faster. From scott_the_musician at yahoo.com.au Mon Dec 12 15:02:05 2011 From: scott_the_musician at yahoo.com.au (Scott Lewis) Date: Mon, 12 Dec 2011 05:02:05 -0800 (PST) Subject: [Dovecot] simultaneous scripts not running via sieve_before Message-ID: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> Hi again everyone, So I've finally got sieve integration happening on my? REHL Postfix/Dovecot server, with private user scripts happily running when users create them. (we user SquirrelMail, so the avelsieve plugin runs the sieve integration). Now I'd like to utilise additional per-user scripts (probably via sieve_before), but I've not been able to get my additional scripts to execute. I am doing the following: a) getting avelsieve to write my redirect script (ie. logging on as user, completing private script wizard, and activating it) b) compiling .dovecot.sieve with sievec c) copying the resultant .dovecot.svbin to sieve/ directory (and renaming it eg redirect.svbin still, it appears that each /home/%u/.dovecot.sieve file is the only one taking effect. Any thoughts on how to make the other ones active? (The idea behind this is to automatically forward all of joeuser at mydomain's incoming mail to somewhere like joeusersbackup at gmail.com, for backup reasons. One day, I'll work out how to configure postfix to do this for all outgoing email too, but that's for another day :) Below are what my .conf files look like. Thanks in advance, Scott /etc/dovecot.conf: [code] protocols = imap imaps managesieve listen = * protocol imap { #mail_plugins = sieve quota } ## ## ManageSieve specific settings ## protocol managesieve { # debugging mail_debug = yes #login_executable = /usr/libexec/dovecot/managesieve-login ?#mail_executable = /usr/libexec/dovecot/managesieve #managesieve_max_line_length = 65536 #managesieve_logout_format = bytes ( in=%i : out=%o ) #managesieve_implementation_string = Cyrus timsieved v2.2.13 } protocol lda { mail_plugins = sieve quota sieve=~/.dovecot.sieve sieve_extentions = +include sieve_dir=~/sieve sieve_before = /home/%u/sieve/redirect.svbin sieve_global_path = /etc/globalsieverc.svbin [/code] From ajb2 at mssl.ucl.ac.uk Mon Dec 12 15:22:50 2011 From: ajb2 at mssl.ucl.ac.uk (Alan Brown) Date: Mon, 12 Dec 2011 13:22:50 +0000 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: Message-ID: <4EE6002A.1000302@mssl.ucl.ac.uk> > Date: Wed, 07 Dec 2011 00:49:49 +0200 > From: Timo Sirainen > Subject: Re: [Dovecot] IMAP SPECIAL-USE extension > > I did this: http://hg.dovecot.org/dovecot-2.1/rev/9b9a206395f7 Just to add to the confusion: Pine/Alpine uses "sent-mail" :( From selcuk.yazar at gmail.com Mon Dec 12 15:49:36 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Mon, 12 Dec 2011 15:49:36 +0200 Subject: [Dovecot] postlogin script In-Reply-To: References: <1323320772.15365.68.camel@hurina> <1323334517.15365.88.camel@hurina> Message-ID: Hi again, show plain passwrod works perfectly. But i have little problem about prefetch. we have users inda openldap username at domain.edu.tr, so, users login their user name to check their emails. after I opened prefetc property, users cannot acceees maildir directory, they use username at domain.edu.trdirectories and they cannot see emails on web (squireel mail). (becouse we migrate our server) our structure domain\username\Maildir, but after prefetch thay try to look in webmail ( also outlook etc. client download email again) domain\username at domain.edu.tr\cur,new etc can we fix this ? thanks. On Thu, Dec 8, 2011 at 10:58 AM, Selcuk Yazar wrote: > Hi, > > i 'sorry, my mistake, it shold be > pass_attrs = uid=user,userPassword=password, *=userdb_plaintext_pass=%w* > > as you said it must contain *equal sign* before userdb_plaintext_pass=%w, > i missed it. > > thank you very much it works.! > > sel?uk > > > On Thu, Dec 8, 2011 at 10:55 AM, Timo Sirainen wrote: > >> On Thu, 2011-12-08 at 10:40 +0200, Selcuk Yazar wrote: >> > Hi, >> > >> > i applied settingsin below but dovecot says that >> > >> > " prefetch(.. at ....edu.tr,IP_ADDRESS): passdb didn't return userdb >> entries, >> > trying the next userdb >> > " >> >> That's why I said make the userdb prefetch work first, the way described >> in: >> >> > > http://wiki2.dovecot.org/UserDatabase/Prefetch >> >> You'll need to add stuff to your pass_attrs. It doesn't work >> automatically. >> >> >> > > > -- > Sel?uk YAZAR > http://www.selcukyazar.blogspot.com > -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From duihi77 at gmail.com Mon Dec 12 15:57:59 2011 From: duihi77 at gmail.com (Duane Hill) Date: Mon, 12 Dec 2011 13:57:59 +0000 Subject: [Dovecot] simultaneous scripts not running via sieve_before In-Reply-To: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> References: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> Message-ID: <1329235723.20111212135759@gmail.com> On Monday, December 12, 2011 at 13:02:05 UTC, scott_the_musician at yahoo.com.au confabulated: > Hi again everyone, > So I've finally got sieve integration happening on my? REHL > Postfix/Dovecot server, with private user scripts happily running > when users create them. (we user SquirrelMail, so the avelsieve > plugin runs the sieve integration). > Now I'd like to utilise additional per-user scripts (probably via > sieve_before), but I've not been able to get my additional scripts to execute. > I am doing the following: > a) getting avelsieve to write my redirect script (ie. logging on as > user, completing private script wizard, and activating it) > b) compiling .dovecot.sieve with sievec > c) copying the resultant .dovecot.svbin to sieve/ directory (and renaming it eg redirect.svbin > still, it appears that each /home/%u/.dovecot.sieve file is the > only one taking effect. Any thoughts on how to make the other ones > active? (The idea behind this is to automatically forward all of > joeuser at mydomain's incoming mail to somewhere like > joeusersbackup at gmail.com, for backup reasons. One day, I'll work out > how to configure postfix to do this for all outgoing email too, but that's for another day :) > Below are what my .conf files look like. Thanks in advance, > Scott > /etc/dovecot.conf: > [code] > protocols = imap imaps managesieve > listen = * > protocol imap { > #mail_plugins = sieve quota > } > ## > ## ManageSieve specific settings > ## > protocol managesieve { > # debugging > mail_debug = yes > #login_executable = /usr/libexec/dovecot/managesieve-login > ?#mail_executable = /usr/libexec/dovecot/managesieve > #managesieve_max_line_length = 65536 > #managesieve_logout_format = bytes ( in=%i : out=%o ) > #managesieve_implementation_string = Cyrus timsieved v2.2.13 > } > protocol lda { > mail_plugins = sieve quota > sieve=~/.dovecot.sieve > sieve_extentions = +include > sieve_dir=~/sieve > sieve_before = /home/%u/sieve/redirect.svbin > sieve_global_path = /etc/globalsieverc.svbin > [/code] sieve_before and sieve_after are directories where extra scripts are run sequentially before user scripts and after user scripts. See: http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration -- If at first you don't succeed, so much for skydiving. From knud.dombrowsky at graband.de Mon Dec 12 18:25:15 2011 From: knud.dombrowsky at graband.de (Knud Dombrowsky) Date: Mon, 12 Dec 2011 17:25:15 +0100 Subject: [Dovecot] Syncing shared mailboxes Message-ID: <4EE62AEB.2020607@graband.de> Hi, while trying to sync the mailboxes of several users who use and share their mailboxes dsync prints this message: dsync-local(): Warning: Subscriptions file /home//Maildir/subscriptions: Removing invalid entry: shared// The problem is: Every user has to subscribe the shared folder again after each run of dsync... Is dsync capable of syncing shared mailboxes? Are there any preliminaries to do so? thanks in advance, Knud From stephan at rename-it.nl Mon Dec 12 18:25:33 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 12 Dec 2011 17:25:33 +0100 Subject: [Dovecot] simultaneous scripts not running via sieve_before In-Reply-To: <1329235723.20111212135759@gmail.com> References: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> <1329235723.20111212135759@gmail.com> Message-ID: <4EE62AFD.90700@rename-it.nl> Op 12/12/2011 2:57 PM, Duane Hill schreef: > On Monday, December 12, 2011 at 13:02:05 UTC, scott_the_musician at yahoo.com.au confabulated: >> protocol lda { >> mail_plugins = sieve quota >> sieve=~/.dovecot.sieve >> sieve_extentions = +include >> sieve_dir=~/sieve >> sieve_before = /home/%u/sieve/redirect.svbin >> sieve_global_path = /etc/globalsieverc.svbin >> [/code] > sieve_before and sieve_after are directories where extra scripts are > run sequentially before user scripts and after user scripts. See: > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration It can be a file, but then it must point to the sieve script (in this case redirect.sieve) and not to the compiled binary (redirect.svbin in this case). Regards, Stephan. From selcuk.yazar at gmail.com Mon Dec 12 18:34:07 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Mon, 12 Dec 2011 18:34:07 +0200 Subject: [Dovecot] Prevent re-download mails Message-ID: Hi, today we have a problem our mail server about user accounts. (something about prefetch) anyway i corrected, but some clients re-download emails again. how can i stop this .I've read about some forums about UIDVALIDITY ? is it posibble prevent clients redownload emails with pop3 ? thanks in advance. -- Sel?uk YAZAR From tss at iki.fi Mon Dec 12 19:04:40 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 19:04:40 +0200 Subject: [Dovecot] Prevent re-download mails In-Reply-To: References: Message-ID: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> On 12.12.2011, at 18.34, Selcuk Yazar wrote: > today we have a problem our mail server about user accounts. (something > about prefetch) anyway i corrected, but some clients re-download emails > again. > how can i stop this .I've read about some forums about UIDVALIDITY ? This isn't enough information to give a useful answer. > is it posibble prevent clients redownload emails with pop3 ? http://wiki2.dovecot.org/Migration#POP3_migration basically explains the redownloading.. From wgrcunha at gmail.com Mon Dec 12 19:11:43 2011 From: wgrcunha at gmail.com (Francisco Wagner C. Freire) Date: Mon, 12 Dec 2011 15:11:43 -0200 Subject: [Dovecot] Prevent re-download mails In-Reply-To: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> References: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> Message-ID: Hello, I got the same problem today, anyone have the this problem? Started few minutes ago. My pop3 server have this uidl setting: pop3_uidl_format = %f and the version 2.0.12, not changed anything in the last monts and got today this problem with lots of clients. Looking for more info. On Mon, Dec 12, 2011 at 3:04 PM, Timo Sirainen wrote: > On 12.12.2011, at 18.34, Selcuk Yazar wrote: > > > today we have a problem our mail server about user accounts. (something > > about prefetch) anyway i corrected, but some clients re-download emails > > again. > > how can i stop this .I've read about some forums about UIDVALIDITY ? > > This isn't enough information to give a useful answer. > > > is it posibble prevent clients redownload emails with pop3 ? > > http://wiki2.dovecot.org/Migration#POP3_migration basically explains the > redownloading.. > > From oni-neko at gmx.net Mon Dec 12 19:18:18 2011 From: oni-neko at gmx.net (oni-neko at gmx.net) Date: Mon, 12 Dec 2011 18:18:18 +0100 Subject: [Dovecot] question regarding postfixadmin Message-ID: <20111212171818.266530@gmx.net> Hello! I hope someone here is already using postfixadmin with dovecot and can help me out =) the install-readme for postfixadmin mentions, that the mail-home should be set to default_mail_env = maildir:/var/mail/vmail/%u/ but my dovecot is already installed and working with another config, namely mail_location = maildir:/var/dovecotmail/%n/Maildir. Do i have to change this, or is postfixadmin able to read this or can i set this value in postfixadmin somewhere? i?d rather avoid moving all mailfolders around just because of that, and unfortunately the paths don?t really lend themself to an easy solution via symlink ^_^ thanks for any replies best regards sil -- Empfehlen Sie GMX DSL Ihren Freunden und Bekannten und wir belohnen Sie mit bis zu 50,- Euro! https://freundschaftswerbung.gmx.de From wgrcunha at gmail.com Mon Dec 12 19:18:28 2011 From: wgrcunha at gmail.com (Francisco Wagner C. Freire) Date: Mon, 12 Dec 2011 15:18:28 -0200 Subject: [Dovecot] Prevent re-download mails In-Reply-To: <00a201ccb8f1$b58e9030$20abb090$@vdschagt.com> References: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> <00a201ccb8f1$b58e9030$20abb090$@vdschagt.com> Message-ID: Hello, The clients re-download the messages on every connection, i current looking for the client versions with this problem. On Mon, Dec 12, 2011 at 3:15 PM, Wouter van der Schagt wrote: > > Looking for more info. > > Even with the same UIDL values, some e-mail clients will still redownload > the messages if a hostname changed. > > Anyway, annoying as it is, after the second download it will stop, you can > ask your users to simply delete the duplicates, it won't download a 3rd > time. > > - WS > > From andrew at oc384.net Mon Dec 12 22:17:12 2011 From: andrew at oc384.net (Andrew M) Date: Mon, 12 Dec 2011 14:17:12 -0600 Subject: [Dovecot] Saving archive copy of all mail sent/received w/Dovecot+Postfix? Message-ID: <4EE66148.2000904@oc384.net> I'm running Dovecot 2.0.15 and Postfix 2.7.7 with postfix handing off to Dovecot's LDA. I am hosting multiple virtual domains with multiple users and everything is working. I would now like to create a permanent archive of all sent/received mail with each virtual user's mail saved to its own sent file and received file. This needs to be independent of the user's regular Maildir store since he can't delete or modify the permanent archive. Any suggestions on how to best accomplish this either via postfix or dovecot? Postfix has in main.cf virtual_transport = dovecot and in master.cf dovecot unix - n n - - pipe flags=DRhu user=virtual:virtual argv=/usr/libexec/dovecot /dovecot-lda -d ${recipient} -f ${sender} dovecot uses this: [root at xxx andrew]# dovecot -n # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.35.14-103.fc14.x86_64 x86_64 Fedora release 14 (Laughlin) ext4 auth_mechanisms = plain login cram-md5 disable_plaintext_auth = no mail_location = maildir:/home/vmail/%d/%n/Maildir mbox_write_locks = fcntl passdb { args = scheme=plain username_format=%u /etc/postfix/passwd driver = passwd-file } protocols = imap lmtp service auth { inet_listener { port = 12345 } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0666 } } ssl_cert = Hi, TLS on imap port 143 works. But if I try TLS on managesieve port 4190, I get no connection. Dec 12 21:16:10 managesieve-login: Info: Disconnected (no auth attempts in 5 secs): rip=192.168.10.117, lip=192.168.10.117, secured Dec 12 21:16:20 managesieve-login: Info: Disconnected (no auth attempts in 5 secs): rip=192.168.10.117, lip=192.168.10.117, TLS handshaking: Disconnected # gnutls-cli --starttls -p 4190 192.168.10.117 Resolving '192.168.10.117'... Connecting to '192.168.10.117:4190'... - Simple Client Mode: "IMPLEMENTATION" "Dovecot Pigeonhole" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave" "NOTIFY" "mailto" "SASL" "PLAIN LOGIN CRAM-MD5" "STARTTLS" "VERSION" "1.0" OK "Dovecot ready." STARTTLS NO "Begin TLS negotiation now." ^ There is a NO and not an OK... Possible something wrong with my config, but I cannot find something... # doveconf -n # 2.1.rc1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 6.0.3 auth_cache_size = 1 M auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login cram-md5 auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot/dovecot-debug.log default_client_limit = 2600 dict { expire = sqlite:/etc/dovecot/dovecot-dict-expire.conf.ext } disable_plaintext_auth = no hostname = mx4.constabel-it.de info_log_path = /var/log/dovecot/dovecot-info.log log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_location = mdbox:~/mdbox mail_plugins = quota notify mail_log expire acl mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Archive/2011 { auto = subscribe } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = scheme=PLAIN username_format=%u /etc/imap.userdb driver = passwd-file } plugin { expire = Trash expire2 = Trash/* expire3 = Spam expire_dict = proxy::expire quota = dict:User quota::file:/mailspool1/%d/%n/dovecot-quota quota_rule = *:storage=9000M:messages=1000000 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at localhost protocols = " imap lmtp sieve pop3" service auth { inet_listener { address = 192.168.10.117 port = 12345 } } service dict { unix_listener dict { group = vmail mode = 0666 } } service imap-login { inet_listener imap { address = 192.168.10.117 port = 143 } inet_listener imaps { address = 192.168.10.117 port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = 192.168.10.117 port = 24 } } service managesieve-login { inet_listener sieve { address = 192.168.10.117 port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { address = 192.168.10.117 port = 110 } inet_listener pop3s { address = 192.168.10.117 port = 995 ssl = yes } } ssl_ca = References: <20111212203055.GC27466@herakles.constabel-it.de> Message-ID: <4EE66C2E.6050001@rename-it.nl> On 12/12/2011 9:30 PM, Mike Constabel wrote: > Hi, > > > TLS on imap port 143 works. > > But if I try TLS on managesieve port 4190, I get no connection. > > Dec 12 21:16:10 managesieve-login: Info: Disconnected (no auth attempts in 5 secs): rip=192.168.10.117, lip=192.168.10.117, secured > Dec 12 21:16:20 managesieve-login: Info: Disconnected (no auth attempts in 5 secs): rip=192.168.10.117, lip=192.168.10.117, TLS handshaking: Disconnected [..] > NO "Begin TLS negotiation now." My bad. By the looks of things you are using the automatic Debian repository. Currently, these builds are a bit tainted by a couple of patches of mine, which apparently caused problems once more. As not to frustrate generic debugging any further, I have removed these patches from the normal v2.1 builds. I did fix this bug, but I'll start a separate builder for the patched packages that I need for a project of mine. If all goes well, new untainted packages should roll out within the hour. Regards, Stephan. From selcuk.yazar at gmail.com Mon Dec 12 23:19:53 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Mon, 12 Dec 2011 23:19:53 +0200 Subject: [Dovecot] Prevent re-download mails In-Reply-To: References: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> <00a201ccb8f1$b58e9030$20abb090$@vdschagt.com> Message-ID: Hi, i give more detail our problem, i edited configuration dovecot for show plain text password(and use postlogin feature), after that, maildir location property (it comes from ldap attribute) changed with domain extension. so some client can't show mails on web interface (squirrel), after that i disabled showing-logging plaintext password, and some client download mails again. in conf file we have %u property , if i sould this change with %n , we don't have this problem :) . now if i change this uidl format can i prevent re-download mails again ? sorry for my english thanks in advance. On Mon, Dec 12, 2011 at 7:18 PM, Francisco Wagner C. Freire < wgrcunha at gmail.com> wrote: > Hello, > > The clients re-download the messages on every connection, i current looking > for the client versions with this problem. > > On Mon, Dec 12, 2011 at 3:15 PM, Wouter van der Schagt > wrote: > > > > Looking for more info. > > > > Even with the same UIDL values, some e-mail clients will still redownload > > the messages if a hostname changed. > > > > Anyway, annoying as it is, after the second download it will stop, you > can > > ask your users to simply delete the duplicates, it won't download a 3rd > > time. > > > > - WS > > > > > -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From dovecot at digitalforplay.com Tue Dec 13 01:49:22 2011 From: dovecot at digitalforplay.com (A Dovecot User) Date: Mon, 12 Dec 2011 17:49:22 -0600 Subject: [Dovecot] Panic when attempting index with Apache Solr : fts_solr plugin In-Reply-To: <1323321743.15365.74.camel@hurina> References: <4ED91D34.3050906@digitalforplay.com> <1323321743.15365.74.camel@hurina> Message-ID: <4EE69302.5050705@digitalforplay.com> Over the weekend I updated the OS on the machine in question to Fedora 15, which should have updated libcurl in the process, and I'm still getting the same error message. I also moved Solr to another server instead of trying to use it on the local box, but that didn't seem to make a difference. On 12/07/2011 11:22 PM, Timo Sirainen wrote: > On Fri, 2011-12-02 at 12:47 -0600, A Dovecot User wrote: >> [root at mymailserver ~]# doveadm -D index -u username mailbox inbox > The "mailbox" isn't necessary above. > >> doveadm(username): Info: INBOX: Caching mails seq=1..466 >> doveadm(username): Panic: file solr-connection.c: line 545 >> (solr_connection_post_more): assertion failed: (maxfd >= 0) > This happens every time? It can't index any mails at all? Have you tried > with Dovecot v2.0? > > I can't reproduce it. Anyway I guess either I'm using libcurl wrong > somehow, or there's a bug in libcurl.. > > From erang at jungo.com Mon Dec 12 20:30:13 2011 From: erang at jungo.com (Eran Guy) Date: Mon, 12 Dec 2011 18:30:13 +0000 (UTC) Subject: [Dovecot] =?utf-8?q?mail=5Fmax=5Fuserip=5Fconnections=3D10?= References: <002d01cc76a5$ff88f970$fe9aec50$@elysium.ltd.uk> <2ED64BFB-87F1-40B2-A489-226031A4633C@iki.fi> Message-ID: Timo Sirainen iki.fi> writes: > > On 19.9.2011, at 11.27, Tom Clark wrote: > > > Is there anyway of whitelisting an IP so that it can ignore > > mail_max_userip_connections=10? > > With v2.0 in theory: > > remote 1.2.3.4 { > mail_max_userip_connections = 0 > } > > I don't know if it actually works. Not sure I follow- in which conf file would it be appropriate to place this? Is it possible to maintain separate values for the same config directive? (I'm having a similar problem with iOS devices connecting to our server- they seem to open multiple connections, easily going over 10 if they have many subscribed directories). Thanks, -E- From joseba.torre at ehu.es Tue Dec 13 10:50:00 2011 From: joseba.torre at ehu.es (Joseba Torre) Date: Tue, 13 Dec 2011 09:50:00 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111204151602.Horde.tWy1GVeGiNBO29UCBMPVY2A@www.cnysupport.com> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204151602.Horde.tWy1GVeGiNBO29UCBMPVY2A@www.cnysupport.com> Message-ID: <4EE711B8.2040201@ehu.es> El 04/12/11 21:16, Terry Carmen escribi?: >> So I was thinking that there probably could be some tool that during a >> user's backup it would write the attachments among the user's other >> files, so it would be easy to find all of the files needed for a >> restore. This would of course mean that backups can take a lot more >> space, because there's no SIS. Perhaps there could be some other > > > I see. > > Instead of writing the links directly to the filesystem, why not keep a > links list (not a linked list 8-)) file in each directory that contains > the information for the links that should be there (source, dest, > attributes), then add an inotify hook in Dovecot to create/update/delete > the hard links in the directory so they match the links list? > > The links list would only need to be opened when there's a change and > could remain closed (and backup-able) at all other times, and restoring > a links list would immediately trigger the inotify hook and regenerate > all the required links. > > Terry Sorry for joining late this thread, but this is a very important issue for us. Terry's solution feels great: just a little modification of the mdbox, adding a ?text? file with the list of attachment files, that is modified every time an attachment is added/deleted. With that, it seems quite easy to modify our mailbox recovery script to something like: - recover the mailbox as now - recover every attachment file that file points to. Other option: a new doveadm option that could generate this list, and then recover the mailbox, generate the list, recover the attachments. Also: no change needed to the backup process itself, and that's good news. From tss at iki.fi Tue Dec 13 10:56:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 13 Dec 2011 10:56:20 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EE711B8.2040201@ehu.es> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204151602.Horde.tWy1GVeGiNBO29UCBMPVY2A@www.cnysupport.com> <4EE711B8.2040201@ehu.es> Message-ID: On 13.12.2011, at 10.50, Joseba Torre wrote: > Terry's solution feels great: just a little modification of the mdbox, adding a ?text? file with the list of attachment files, that is modified every time an attachment is added/deleted. I'd rather not implement that. It makes dbox more fragile and less efficient. > With that, it seems quite easy to modify our mailbox recovery script to something like: > - recover the mailbox as now > - recover every attachment file that file points to. > > Other option: a new doveadm option that could generate this list, and then recover the mailbox, generate the list, recover the attachments. That would be possible. You could actually already do it with v2.1's "doveadm dump", which outputs dbox file's metadata. From Juergen.Obermann at hrz.uni-giessen.de Tue Dec 13 12:47:01 2011 From: Juergen.Obermann at hrz.uni-giessen.de (=?iso-8859-1?b?SvxyZ2Vu?= Obermann) Date: Tue, 13 Dec 2011 11:47:01 +0100 Subject: [Dovecot] dsync error Mailbox has children, delete them first Message-ID: <20111213114701.185112l8l37ih0yo@webmail.hrz.uni-giessen.de> Hi, I use dsync to backup mailboxes from mbox format to mdbox on a remote system. The first run for a user with dsync is OK, but during the second there are lots of the following errors: dsync-remote(user): Error: Can't delete mailbox directory Example: Mailbox has children, delete them first I see no way how I could influence the order dsync deletes mailboxes. This happens with dovecot version 2.0.16 Thank you, Juergen Obermann From leolistas at solutti.com.br Tue Dec 13 13:39:52 2011 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Tue, 13 Dec 2011 09:39:52 -0200 Subject: [Dovecot] dovecot penalties and anvil Message-ID: <4EE73988.1090000@solutti.com.br> Hi, I'm strugling to find some documentation on dovecot's anvil service and/or its penalties (that can be checked with doveadm penalty) ... but i'm not finding anything on that. is there any documentation on anvil/penalties that i should check other than a few messages on the mailing list archive ? thanks ! -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From asai at globalchangemusic.org Wed Dec 14 01:21:09 2011 From: asai at globalchangemusic.org (Asai) Date: Tue, 13 Dec 2011 16:21:09 -0700 Subject: [Dovecot] Backing Up To Windows File Server Message-ID: <4EE7DDE5.3070605@globalchangemusic.org> Greetings, Working with dsync and setting up backups to a Windows file server. Problem seems to be that Windows is renaming the dovecot mail files (maildir) to Windows friendly filenames, and losing the Dovecot name. For example, 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S becomes 1AETPH~X. Does anyone have any ideas about how to tell Windows to not do this? Or is it not possible? -- --asai From dovecot at r.paypc.com Wed Dec 14 01:50:19 2011 From: dovecot at r.paypc.com (Robin) Date: Tue, 13 Dec 2011 15:50:19 -0800 Subject: [Dovecot] Dovecot 2.1rc1 + 2.0.16 woes regarding fts_squat Message-ID: <4EE7E4BB.2040008@r.paypc.com> I can confirm the report posted in http://dovecot.org/list/dovecot/2011-November/062263.html that fts_squat no longer seems to be used after moving from 2.0.16->2.1 rc 1. I don't see crash reports in the logs, just "0 messages indexed". My search test tool just does a normal IMAP SEARCH for a long non-existent string. If there's another way to trigger re-indexing in 2.1, I don't see anything in the documentation for it. I've enabled mail_debug, but no log entries that shed light on the problem are available. Has the configuration for fts_squat changed? If anyone has a working fts_squat setup with Dovecot 2.1rc1, I'd appreciate hearing how you have it setup and working. During a large mail import with 2.0.16 today, I ran across a worrying message in the logs during an fts_squat reindex: out of memory. The plugin doesn't obey the mmap_disable configuration directive, which I've confirmed in the plugin source. The mailbox in question has only 17GB (mdbox style), with about 90,000 emails in it. Its "index" (for the purposes of normal IMAP retrieval as opposed to IMAP TEXT/BODY searching) is fine and uncorrupted. I freshly import these mailboxes between test iterations and any version changes anyway, so if there's corruption, it's happening within dovecot only. I'm using use Mail::IMAPClient to create + append mail over localhost, not any direct mdbox conversion trickery. In looking through the code, I see that mmap() is called for the *ENTIRE FILE*, which is guaranteed to fail on large indexes. I assume this was done out of expedience, but it's a "risky" sort of thing to do in a server process, even if 8GB RAM systems do seem to grow on trees. I intend to put this to work in a large installation (>10K users), so this IS of some concern for me in the long-term. Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: mremap_anon(188084224) failed: Cannot allocate memory Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: read(.../mdbox/mailboxes/INBOX2010/dbox-Mails/dovecot.index.search.uids) failed: Cannot allocate memory Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: mremap_anon(188280832) failed: Cannot allocate memory Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: read(.../mdbox/mailboxes/INBOX2010/dbox-Mails/dovecot.index.search.uids) failed: Cannot allocate memory Dec 12 22:50:47 linuxcode dovecot: imap(user1001): Error: Corrupted squat uidlist file .../mdbox/mailboxes/INBOX2010/dbox-Mails/dovecot.index.search.uids: uidlist not found ================ dovecot -n output: # 2.0.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.35.7-smp i686 Slackware 13.1.0 auth_mechanisms = plain cram-md5 digest-md5 apop default_vsz_limit = 192 M disable_plaintext_auth = no first_valid_gid = 100 hostname = linuxcode info_log_path = /tmp/dovecot.log last_valid_gid = 60000 last_valid_uid = 60000 listen = * mail_location = mdbox:~/mdbox mail_plugins = " zlib acl" mdbox_preallocate_space = yes mdbox_rotate_interval = 1 days mmap_disable = yes passdb { args = scheme=plain /etc/cram-md5.pwd driver = passwd-file } plugin { acl = vfile } postmaster_address = postmaster at linuxcode quota_full_tempfail = yes service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 0 vsz_limit = 64 M } service imap { vsz_limit = 512 M } service lmtp { unix_listener lmtp { mode = 0666 } } ssl = no userdb { args = blocking=no driver = passwd } protocol lmtp { mail_plugins = " zlib acl" } protocol imap { mail_plugins = " zlib acl fts fts_squat imap_acl imap_zlib" plugin { fts = squat fts_squat = partial=4 full=10 } } ================ CONFIGURE ================ LIBS=-lnsl CFLAGS='-O2 -march=core2 -mtune=core2 -fstack-protector -fomit-frame-pointer' \ CXXFLAGS='-O2 -march=core2 -mtune=core2 -fstack-protector -fomit-frame-pointer' \ LDFLAGS=-s ./configure --prefix=/usr --sysconfdir=/etc \ --with-mysql --with-sqlite --with-pgsql --without-pam --with-sql \ --with-libwrap --with-libcap -with-ssl=openssl --with-solr \ --with-mem-align=16 --with-bzlib --with-zlib --localstatedir=/var ================ OS: Slackware 13.1 (32-bit, 2GB physical RAM, kernel setup for 2G/2G split) fully patched up =R= From jerry at seibercom.net Wed Dec 14 02:34:38 2011 From: jerry at seibercom.net (Jerry) Date: Tue, 13 Dec 2011 19:34:38 -0500 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE7DDE5.3070605@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> Message-ID: <20111213193438.69c57904@scorpio> On Tue, 13 Dec 2011 16:21:09 -0700 Asai articulated: > Working with dsync and setting up backups to a Windows file server. > Problem seems to be that Windows is renaming the dovecot mail files > (maildir) to Windows friendly filenames, and losing the Dovecot name. > For example, > 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > becomes 1AETPH~X. > > Does anyone have any ideas about how to tell Windows to not do this? > Or is it not possible? I have backed up files to a Windows server before but have never experienced the problems you are describing. Could you please list the Windows Server specifics, ie. version, etc. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From duihi77 at gmail.com Wed Dec 14 03:16:33 2011 From: duihi77 at gmail.com (Duane Hill) Date: Wed, 14 Dec 2011 01:16:33 +0000 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE7DDE5.3070605@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> Message-ID: <341320.20111214011633@gmail.com> On Tuesday, December 13, 2011 at 23:21:09 UTC, asai at globalchangemusic.org confabulated: > Greetings, > Working with dsync and setting up backups to a Windows file server. > Problem seems to be that Windows is renaming the dovecot mail files > (maildir) to Windows friendly filenames, and losing the Dovecot name. > For example, > 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > becomes 1AETPH~X. > Does anyone have any ideas about how to tell Windows to not do this? Or > is it not possible? AFAIK, the colon is not valid in a windows file name. -- If at first you don't succeed, so much for skydiving. From brad at omnis.com Wed Dec 14 03:41:54 2011 From: brad at omnis.com (Brad Schuetz) Date: Tue, 13 Dec 2011 17:41:54 -0800 Subject: [Dovecot] Two recent issues In-Reply-To: <1323496696.15365.124.camel@hurina> References: <4EE26BDF.4080500@omnis.com> <1323496696.15365.124.camel@hurina> Message-ID: <4EE7FEE2.6040701@omnis.com> On 12/09/2011 09:58 PM, Timo Sirainen wrote: > If auth process dies unexpectedly, master always logs an error, such as: > > Dec 10 07:15:34 auth: Fatal: master: service(auth): child 27895 killed with signal 11 (core dumped) > > Anyway, "read(imap) failed: Connection reset by peer" can happen if you > reach the service imap { process_limit }. But then there should be a > warning logged about it also: > > Dec 10 07:17:39 master: Warning: service(imap): process_limit reached, client connections are being dropped > > So, that error message alone shouldn't be happening.. Interesting, the log entries I provided were the only ones that did exist. > If that happens, there would also be an error message logged about it. > One thing that v2.0 doesn't log about is if auth socket gets > disconnected, but that would result in different problems. v2.1 logs > about that too. The problem has vanished in the last couple of days. When 2.1 comes out I will upgrade and if the problem returns I'll see if it's logs have any further information. >> The second issue is lmtp/lda (tried both) delivery to a mailbox that has >> filesystem quotas enabled and the group quota is maxed is resulting in >> the below panic and crash. >> >> 11:21:07 [err] dovecot: lmtp(29691, admin@[redacted].com): Error: >> o_stream_send_istream(/email/d/r/[redacted]/[redacted]/admin/Maildir/tmp/1323458467.M245978P29691.fenrir.omnis.com) >> failed: Disk quota exceeded >> 11:21:07 [crit] dovecot: lmtp(29691, admin@[redacted].com): Panic: file >> ostream-zlib.c: line 144 (o_stream_zlib_send_flush): assertion failed: >> (zs->avail_in == 0) > > I couldn't reproduce this with my tests, but > http://hg.dovecot.org/dovecot-2.0/rev/75daa638281b should fix it. > This patch has corrected the issue I was seeing. Thank you very much. From lists at luigirosa.com Wed Dec 14 07:38:07 2011 From: lists at luigirosa.com (Luigi Rosa) Date: Wed, 14 Dec 2011 06:38:07 +0100 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE7DDE5.3070605@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> Message-ID: <4EE8363F.30303@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Asai said the following on 14/12/11 00:21: > Working with dsync and setting up backups to a Windows file server. > Problem seems to be that Windows is renaming the dovecot mail files > (maildir) to Windows friendly filenames, and losing the Dovecot name. For > example, > 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > > becomes 1AETPH~X. > > Does anyone have any ideas about how to tell Windows to not do this? Or is > it not possible? Got same problem rsync-ing to some low cost NAS and, of course, windows share. My solution is to tar.gz before copying to Windows. Ciao, luigi - -- / +--[Luigi Rosa]-- \ Ask ten different scientists about the environment, population control, genetics, and you'll get ten different answers, but there's one thing every scientist on the planet agrees on. Whether it happens in a hundred years or a thousand years or a million years, eventually our Sun will grow cold and go out. When that happens, it won't just take us. It'll take Marilyn Monroe, and Lao-Tzu, and Einstein, and Morobuto, and Buddy Holly, and Aristophanes... [and] all of this... all of this... was for nothing. Unless we go to the stars. --Jeffrey Sinclair, "Infection" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk7oNjYACgkQ3kWu7Tfl6ZTaBACaAmu1MtZkcBEGxMM3iXfezLpr KEsAnjczFO4QVnIcHtvC2MbWGbU7AuO2 =cGog -----END PGP SIGNATURE----- From nmilas at noa.gr Wed Dec 14 12:47:05 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Wed, 14 Dec 2011 12:47:05 +0200 Subject: [Dovecot] Quota warnings not being sent Message-ID: <4EE87EA9.5050503@noa.gr> Hello, I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7 with the config shown below. All accounts are virtual, hosted on LDAP Server. My problem is that the quota warning mail is not sent as expected. For example, in the logs I get: Dec 12 08:42:40 vmail dovecot: lda(imaptester): Error: quota: net_connect_unix(/var/run/dovecot/quota-warning) failed: Permission denied (euid=500(vmail) egid=500(vmail) missing +r perm: /var/run/dovecot/quota-warning, euid is not dir owner) Here is /var/run/dovecot/: # ls -la /var/run/dovecot/ total 32 drwxr-xr-x 4 root dovecot 4096 Dec 9 21:27 . drwxr-xr-x 23 root root 4096 Dec 14 12:27 .. srw------- 1 root root 0 Dec 9 21:27 anvil srw------- 1 root root 0 Dec 9 21:27 anvil-auth-penalty srw------- 1 root root 0 Dec 9 21:27 auth-client srw------- 1 dovecot root 0 Dec 9 21:27 auth-login srw-rw---- 1 vmail vmail 0 Dec 9 21:27 auth-master srw------- 1 root root 0 Dec 9 21:27 auth-userdb srw------- 1 dovecot root 0 Dec 9 21:27 auth-worker srw------- 1 root root 0 Dec 9 21:27 config srw------- 1 root root 0 Dec 9 21:27 dict srw------- 1 root root 0 Dec 9 21:27 director-admin srw-rw-rw- 1 root root 0 Dec 9 21:27 dns-client srw------- 1 root root 0 Dec 9 21:27 doveadm-server lrwxrwxrwx 1 root root 25 Dec 9 21:27 dovecot.conf -> /etc/dovecot/dovecot.conf drwxr-xr-x 2 root root 4096 May 17 2011 empty drwxr-x--- 2 root dovenull 4096 Dec 9 21:27 login -rw------- 1 root root 5 Dec 9 21:27 master.pid srw------- 1 root root 0 Dec 9 21:27 quota-warning Follows my config (at the end of this message). How should I change permissions to resolve the issue? Would it be enough to change ownership of the whole directory /var/run/dovecot/ and its contents to vmail:vmail? What configuration directives determine the ownership and the access permissions for these sockets? Please advise. Thanks in advance, Nick ------------------------------------------ # 2.0.13: dovecot.conf protocols = imap pop3 mail_location = maildir:~/Maildir/ mail_gid = 500 mail_uid = 500 auth_mechanisms = plain login auth_username_format = %Lu auth_verbose = yes disable_plaintext_auth = no mail_plugins = quota protocol imap { imap_client_workarounds = "delay-newmail " mail_plugins = quota imap_quota } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = log_path = mail_plugins = quota postmaster_address = sysadmin at example.com sendmail_path = /usr/lib/sendmail } userdb { args = /etc/dovecot/dovecot-usrdb-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-passdb-ldap.conf driver = ldap } plugin { quota = maildir:User quota quota_rule = *:storage=4G quota_rule2 = Trash:storage=+3%% quota_warning = storage=75%% quota-warning 75 %u quota_warning2 = storage=90%% quota-warning 90 %u } service quota-warning { executable = script /opt/mail1.sh user = root unix_listener quota-warning { } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service imap-login { service_count = 1 vsz_limit = 64 M } service pop3-login { service_count = 1 vsz_limit = 64 M } ssl_ca = From tlx at leuxner.net Wed Dec 14 13:06:00 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Wed, 14 Dec 2011 12:06:00 +0100 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE87EA9.5050503@noa.gr> References: <4EE87EA9.5050503@noa.gr> Message-ID: <20111214110559.GA15164@nihlus.leuxner.net> On Wed, Dec 14, 2011 at 12:47:05PM +0200, Nikolaos Milas wrote: > For example, in the logs I get: > Dec 12 08:42:40 vmail dovecot: lda(imaptester): Error: quota: > net_connect_unix(/var/run/dovecot/quota-warning) failed: Permission > denied (euid=500(vmail) egid=500(vmail) missing +r perm: > /var/run/dovecot/quota-warning, euid is not dir owner) service quota-warning { executable = script /opt/mail1.sh user = vmail unix_listener quota-warning { } } I'd guess setting the user to 'vmail' here solves the problem: http://wiki2.dovecot.org/Quota/Configuration Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From nmilas at noa.gr Wed Dec 14 13:40:19 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Wed, 14 Dec 2011 13:40:19 +0200 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <20111214110559.GA15164@nihlus.leuxner.net> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> Message-ID: <4EE88B23.90609@noa.gr> On 14/12/2011 1:06 ??, Thomas Leuxner wrote: > I'd guess setting the user to 'vmail' here solves the problem Thank you for the reply. No, this did not solve the problem. I changed to vmail service quota-warning { executable = script /opt/mail1.sh user = vmail unix_listener quota-warning { } } and did a full restart: # service dovecot restart Again: Dec 14 13:30:11 vmail dovecot: lda(tester): Error: quota: net_connect_unix(/var/run/dovecot/quota-warning) failed: Permission denied (euid=500(vmail) egid=500(v mail) missing +r perm: /var/run/dovecot/quota-warning, euid is not dir owner) And still, the socket is owned by root: # ls -la /var/run/dovecot/ total 32 drwxr-xr-x 4 root dovecot 4096 Dec 14 13:20 . drwxr-xr-x 23 root root 4096 Dec 14 13:27 .. ... srw------- 1 root root 0 Dec 14 13:20 quota-warning Any suggestions? Thanks, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From pw at wk-serv.de Wed Dec 14 14:24:31 2011 From: pw at wk-serv.de (Patrick Westenberg) Date: Wed, 14 Dec 2011 13:24:31 +0100 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE88B23.90609@noa.gr> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> Message-ID: <4EE8957F.8090101@wk-serv.de> Nikolaos Milas schrieb: > No, this did not solve the problem. I changed to vmail > > service quota-warning { > executable = script /opt/mail1.sh > user = vmail > unix_listener quota-warning { > } > } This is what works for me: service quota-warning { executable = script /usr/local/etc/dovecot/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } From leolistas at solutti.com.br Wed Dec 14 14:33:14 2011 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Wed, 14 Dec 2011 10:33:14 -0200 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE8957F.8090101@wk-serv.de> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> <4EE8957F.8090101@wk-serv.de> Message-ID: <4EE8978A.2030409@solutti.com.br> Em 14/12/11 10:24, Patrick Westenberg escreveu: > > This is what works for me: > > service quota-warning { > executable = script /usr/local/etc/dovecot/quota-warning.sh > unix_listener quota-warning { > user = vmail > } > user = vmail > } My configurations are similar to Patrick ones and works just fine: service quota-warning { executable = script /etc/dovecot/aviso-quota.sh user = dovecot unix_listener quota-warning { user = mail } } plugin { quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=85%% quota-warning 85 %u quota_warning3 = storage=70%% quota-warning 70 %u quota_exceeded_message = Quota excedida (caixa postal cheia) / Quota exceeded (mailbox is full) } -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From tlx at leuxner.net Wed Dec 14 15:02:37 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Wed, 14 Dec 2011 14:02:37 +0100 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE8978A.2030409@solutti.com.br> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> <4EE8957F.8090101@wk-serv.de> <4EE8978A.2030409@solutti.com.br> Message-ID: <20111214130237.GB15164@nihlus.leuxner.net> On Wed, Dec 14, 2011 at 10:33:14AM -0200, Leonardo Rodrigues wrote: > service quota-warning { > executable = script /etc/dovecot/aviso-quota.sh > user = dovecot > unix_listener quota-warning { > user = mail > } > } Right, looks like the Wiki Example needs to be revamped... [ 90-quota.conf ] matches the real life examples posted: # Example quota-warning service. The unix listener's permissions should be # set in a way that mail processes can connect to it. Below example assumes # that mail processes run as vmail user. If you use mode=0666, all system users # can generate quota warnings to anyone. #service quota-warning { # executable = script /usr/local/bin/quota-warning.sh # user = dovecot # unix_listener quota-warning { # user = vmail # } #} From forall at stalowka.info Wed Dec 14 14:49:39 2011 From: forall at stalowka.info (For@ll) Date: Wed, 14 Dec 2011 13:49:39 +0100 Subject: [Dovecot] Autosubscribe new folders Message-ID: Hi, I have a sieve filter: require ["fileinto","reject","body"]; if header :contains "subject" "NOTE" { if body :content "application/pdf" :contains "" { redirect "notes at domena.com"; } else { reject text: Lack attachment PDF! . ; stop; } } When I get a new message, in user folder is automaticly created folder like subject but is not subscribed. What I must settings in dovecot to automaticly subscribe folders to subscriptions files.? From dg at dguhl.org Wed Dec 14 18:20:00 2011 From: dg at dguhl.org (Dennis Guhl) Date: Wed, 14 Dec 2011 17:20:00 +0100 Subject: [Dovecot] Autosubscribe new folders In-Reply-To: References: Message-ID: <20111214161958.GA2843@PC211.ikt.de> On Wed, Dec 14, 2011 at 01:49:39PM +0100, For at ll wrote: > Hi, [..] > When I get a new message, in user folder is automaticly created > folder like subject but is not subscribed. What I must settings in > dovecot to automaticly subscribe folders to subscriptions files.? Add lda_mailbox_autosubscribe = yes to 15-lda.conf (or wherever you defined lda_mailbox_autocreate = yes). Dennis From asai at globalchangemusic.org Wed Dec 14 19:17:58 2011 From: asai at globalchangemusic.org (Asai) Date: Wed, 14 Dec 2011 10:17:58 -0700 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <20111213193438.69c57904@scorpio> References: <4EE7DDE5.3070605@globalchangemusic.org> <20111213193438.69c57904@scorpio> Message-ID: <4EE8DA46.5090003@globalchangemusic.org> On 12/13/2011 5:34 PM, Jerry wrote: > On Tue, 13 Dec 2011 16:21:09 -0700 > Asai articulated: > >> Working with dsync and setting up backups to a Windows file server. >> Problem seems to be that Windows is renaming the dovecot mail files >> (maildir) to Windows friendly filenames, and losing the Dovecot name. >> For example, >> 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S >> becomes 1AETPH~X. >> >> Does anyone have any ideas about how to tell Windows to not do this? >> Or is it not possible? > I have backed up files to a Windows server before but have never > experienced the problems you are describing. Could you please list the > Windows Server specifics, ie. version, etc. This is a Win 2008 R2 server with NFS shares enabled. I initially copied the backups from my former backup server to this Windows box, and that's when I noticed the file names had been changed. From jerry at seibercom.net Wed Dec 14 19:24:03 2011 From: jerry at seibercom.net (Jerry) Date: Wed, 14 Dec 2011 12:24:03 -0500 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE8DA46.5090003@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> <20111213193438.69c57904@scorpio> <4EE8DA46.5090003@globalchangemusic.org> Message-ID: <20111214122403.17d6af91@scorpio> On Wed, 14 Dec 2011 10:17:58 -0700 Asai articulated: > On 12/13/2011 5:34 PM, Jerry wrote: > > On Tue, 13 Dec 2011 16:21:09 -0700 > > Asai articulated: > > > >> Working with dsync and setting up backups to a Windows file server. > >> Problem seems to be that Windows is renaming the dovecot mail files > >> (maildir) to Windows friendly filenames, and losing the Dovecot > >> name. For example, > >> 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > >> becomes 1AETPH~X. > >> > >> Does anyone have any ideas about how to tell Windows to not do > >> this? Or is it not possible? > > I have backed up files to a Windows server before but have never > > experienced the problems you are describing. Could you please list > > the Windows Server specifics, ie. version, etc. > This is a Win 2008 R2 server with NFS shares enabled. I initially > copied the backups from my former backup server to this Windows box, > and that's when I noticed the file names had been changed. IMHO, I think you might be better served by posting your inquiry to a Microsoft forum dedicated to the 2008 server framework. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From lists at luigirosa.com Wed Dec 14 19:34:52 2011 From: lists at luigirosa.com (Luigi Rosa) Date: Wed, 14 Dec 2011 18:34:52 +0100 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE8D467.3030904@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> <4EE8363F.30303@luigirosa.com> <4EE8D467.3030904@globalchangemusic.org> Message-ID: <4EE8DE3C.1010507@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Asai said the following on 14/12/11 17:52: > Thanks, Luigi, I may fall back to that. Should you need it, here's the script I use to do it. In my configurations /var/spool/mail contains one dir for each domain and each of that dir contains a maildir for each domain. So the email of foobar at acme.com is in /var/spool/mail/acme.com/foobar/ The 4th line checks lost&found because /bar/spool/mail is a different file system. I create the .tgz file on local /tmp for performance reasons. TARGET=/backup for DOMAINPATH in /var/spool/mail/* do if [ "${DOMAINPATH}" != "/var/spool/mail/lost+found" ] then DOMAIN=`echo $DOMAINPATH | cut -d '/' -f 5` for USERPATH in ${DOMAINPATH}/* do USER=`echo $USERPATH | cut -d '/' -f 6` tar cvzf /tmp/$DOMAIN-$USER.tgz $USERPATH > /dev/null cp -f /tmp/$DOMAIN-$USER.tgz $TARGET/mail rm -f /tmp/$DOMAIN-$USER.tgz done fi done Ciao, luigi - -- / +--[Luigi Rosa]-- \ I don't think we have the right or the wisdom to interfere, however a planet is evolving. --James Kirk, "The Omega Glory" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk7o3jYACgkQ3kWu7Tfl6ZSfpQCgvzhOJH6mnJMu8ZzvKu5y8um+ 46wAoKd0eXxBNPad9EZao7VKjZBkACer =dhk0 -----END PGP SIGNATURE----- From nmilas at noa.gr Wed Dec 14 19:52:24 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Wed, 14 Dec 2011 19:52:24 +0200 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE8978A.2030409@solutti.com.br> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> <4EE8957F.8090101@wk-serv.de> <4EE8978A.2030409@solutti.com.br> Message-ID: <4EE8E258.2080801@noa.gr> Thank you all for your help. Changing from: unix_listener quota-warning { } to: unix_listener quota-warning { user = vmail } solved the problem! Now my quota warning message is being sent successfully. I think I'll now open a new thread on how to send rich/UTF-8 mail warnings. Thanks again, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From leolistas at solutti.com.br Wed Dec 14 21:10:26 2011 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Wed, 14 Dec 2011 17:10:26 -0200 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE8E258.2080801@noa.gr> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> <4EE8957F.8090101@wk-serv.de> <4EE8978A.2030409@solutti.com.br> <4EE8E258.2080801@noa.gr> Message-ID: <4EE8F4A2.8060507@solutti.com.br> Em 14/12/11 15:52, Nikolaos Milas escreveu: > > I think I'll now open a new thread on how to send rich/UTF-8 mail > warnings. > > Probably you just need to format/encode it properly ... no big deal on that. -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From maria_arrea at gmx.com Wed Dec 14 23:10:36 2011 From: maria_arrea at gmx.com (Maria Arrea) Date: Wed, 14 Dec 2011 22:10:36 +0100 Subject: [Dovecot] Question about index reset in dovecot 2.0.15 Message-ID: <20111214211036.55980@gmx.com> I have seen some strange error log messages in our dovecot server (2.0.15, RHEL 5.7x64, mdbox+zlib, local storage, high load) Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Dec 14 20:56:46 buzon dovecot: imap(rcam): Error: Corrupted index cache file /indices_dovecot/indices/03/6b/rcam/mailboxes/INBOX/dovecot.index.cache: Broken virtual size for mail UID 132197 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox INBOX I have been googling without luck, why does this happen? I have tried with doveadm force-resync, maybe this could solve this issues. doveconf -n output # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-274.7.1.el5 x86_64 Red Hat Enterprise Linux Server release 5.7 (Tikanga) ext4 auth_cache_negative_ttl = 10 secs auth_cache_size = 10 M auth_cache_ttl = 2 mins auth_master_user_separator = * auth_mechanisms = plain login auth_worker_max_count = 3500 base_dir = /var/run/dovecot/ default_client_limit = 5000 default_process_limit = 6500 disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep delay-newmail tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_fsync = never mail_gid = entrega mail_home = /buzones/domain/%2.26Hn/%2.200Hn/%n/home_usuario/ mail_location = mdbox:/buzones/domain/%2.26Hn/%2.200Hn/%n:INDEX=/indices_dovecot/indices/%2.26Hn/%2.200Hn/%n mail_max_userip_connections = 15000 mail_plugins = " zlib acl quota autocreate" mail_uid = entrega managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mdbox_rotate_interval = 1 days mdbox_rotate_size = 60 M passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/usuario_maestro.txt driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile autocreate = SPAM autocreate2 = Sent autocreate3 = Drafts autocreate4 = Trash autosubscribe = SPAM autosubscribe2 = Sent autosubscribe3 = Drafts autosubscribe4 = Trash lda_mailbox_autosubscribe = yes quota = dict:Cuota de usuario::file:/buzones/cuotas/%n quota_rule2 = Trash:storage=+10%% quota_warning = storage=90%% aviso_cuota 90 %u sieve = /buzones/domain/%2.26Hn/%2.200Hn/%n/home_usuario/dovecot.sieve sieve_dir = /buzones/domain/%2.26Hn/%2.200Hn/%n/home_usuario/sieve/ zlib_save = gz zlib_save_level = 9 } pop3_no_flag_updates = yes protocols = pop3 imap sieve service anvil { client_limit = 25000 } service auth { client_limit = 28000 unix_listener auth-master { user = entrega } unix_listener auth-userdb { user = entrega } user = root } service aviso_cuota { executable = script /usr/local/bin/quota-warning.sh unix_listener aviso_cuota { mode = 0666 } user = entrega } service imap-login { executable = /usr/libexec/dovecot/imap-login group = dovenull service_count = 0 vsz_limit = 1 G } service imap { executable = /usr/libexec/dovecot/imap process_limit = 6000 } service managesieve-login { executable = /usr/libexec/dovecot/managesieve-login inet_listener sieve { port = 2000 } process_limit = 2000 vsz_limit = 1 G } service managesieve { executable = /usr/libexec/dovecot/managesieve process_limit = 5000 } service pop3-login { executable = /usr/libexec/dovecot/pop3-login process_limit = 4000 service_count = 0 vsz_limit = 1 G } service pop3 { executable = /usr/libexec/dovecot/pop3 process_limit = 4000 } ssl_ca = I'm trying to get the pipe backend to work with the new dovecot-antispam (I was very pleased to see the new version, thanks Johannes!) Before I would run the following over the maildir: spamc -d 10.0.1.109 -L ham < $file 2>&1 > /dev/null now, i'm using dovecot-antispam and mdbox and have the following configured: antispam_backend = pipe antispam_signature = X-Spam-Flag antispam_signature_missing = error antispam_trash_pattern = trash;Trash;Deleted * antispam_spam_pattern_ignorecase = SPAM antispam_pipe_tmpdir = /var/tmp antispam_pipe_program_spam_arg = -L spam antispam_pipe_program_notspam_arg = -L ham antispam_pipe_program = /usr/bin/spamc antispam_pipe_program_args = -d 10.0.1.109 Now, when I move a message to Spam, dovecot-antispam detects it and attempts to run, but it fails: Dec 14 16:22:45 grosbeak [username 10.0.1.74 uid]: antispam: run program failed with exit code 64 Exit code 64 is spamc's exit code for "command line usage error" - but I can't see exactly the command that is being constructed by dovecot-antispam to know where the error is. Any ideas? micah -- -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 835 bytes Desc: not available URL: From janm-dovecot at transactionware.com Thu Dec 15 03:05:42 2011 From: janm-dovecot at transactionware.com (Jan Mikkelsen) Date: Thu, 15 Dec 2011 12:05:42 +1100 Subject: [Dovecot] Building 2.1.rc1 with cluence, but without libstemmer Message-ID: Hi, I'm testing out 2.1.rc1, building against clucene 2.3.3.4. Without libstemmber, the build fails because it attempts to include SnowballAnalyzer.h which is not part of "core" clucene. Simple patch below to make dovecot 2.1.rc1 build with clucene but without libstemmer (or textcat). Looking at libstemmer itself, there are multiple versions. The version in clucene is put into libclucene-contribs-lib.so, but that version is older than libstemmer_c, which generates libstemmer.a, tested for in the dovecot 2.1.rc1 configure script. The dovecot code uses SnowballAnalyzer.h as a C++ wrapper around libstemmer. What versions of libstemmer, clucene and libtextcat is dovecot 2.1.rc1 intended to be used against? Is it worth bringing the wrapper class around libstemmer into dovecot to avoid funny dependencies against clucene and so that the -lstemmer test in configure is enough? For reference, I'm building on FreeBSD 9.0-RC3, system gcc. Regards, Jan Mikkelsen. diff -u -d -r dovecot-2.1.rc1/src/plugins/fts-lucene/lucene-wrapper.cc dovecot-2.1.rc1.patched/src/plugins/fts-lucene/lucene-wrapper.cc --- dovecot-2.1.rc1/src/plugins/fts-lucene/lucene-wrapper.cc 2011-11-09 08:45:26.000000000 +1100 +++ dovecot-2.1.rc1.patched/src/plugins/fts-lucene/lucene-wrapper.cc 2011-12-14 23:36:54.319796535 +1100 @@ -23,7 +23,9 @@ #include #include #include +#if defined(HAVE_LUCENE_STEMMER) || defined(HAVE_LUCENE_TEXTCAT) #include "SnowballAnalyzer.h" +#endif /* Lucene's default is 10000. Use it here also.. */ #define MAX_TERMS_PER_DOCUMENT 10000 From dmiller at amfes.com Thu Dec 15 05:27:06 2011 From: dmiller at amfes.com (Daniel L. Miller) Date: Wed, 14 Dec 2011 19:27:06 -0800 Subject: [Dovecot] doveadm index Message-ID: Does "doveadm index -A INBOX" reindex everything? What about users with multiple folders, both subbed & not subbed under INBOX? -- Daniel From adis at linux.org.ba Thu Dec 15 10:37:58 2011 From: adis at linux.org.ba (Adis Nezirovic) Date: Thu, 15 Dec 2011 09:37:58 +0100 Subject: [Dovecot] Quota PostgreSQL INSERT trigger Message-ID: Wiki instructions for creating insert trigger for PostgreSQL are wrong http://wiki.dovecot.org/Quota/Dict Calling INSERT on the table from within BEFORE INSERT trigger creates cascading trigger. http://www.postgresql.org/docs/current/interactive/trigger-definition.html Instead, one should return NEW record from the trigger, and it will be inserted after trigger execution. --- CREATE OR REPLACE FUNCTION merge_quota2() RETURNS TRIGGER AS $$ BEGIN IF NEW.messages < 0 OR NEW.messages IS NULL THEN -- ugly kludge: we came here from this function, really do try to insert IF NEW.messages IS NULL THEN NEW.messages = 0; ELSE NEW.messages = -NEW.messages; END IF; return NEW; END IF; LOOP UPDATE quota2 SET bytes = bytes + NEW.bytes, messages = messages + NEW.messages WHERE username = NEW.username; IF found THEN RETURN NULL; END IF; BEGIN IF NEW.messages = 0 THEN RETURN NEW; ELSE NEW.messages = - NEW.messages; RETURN NEW; END IF; EXCEPTION WHEN unique_violation THEN -- someone just inserted the record, update it END; END LOOP; END; $$ LANGUAGE plpgsql; DROP TRIGGER IF EXISTS mergequota2 ON quota2; CREATE TRIGGER mergequota2 BEFORE INSERT ON quota2 FOR EACH ROW EXECUTE PROCEDURE merge_quota2(); --- Best regards, Adis From tom at whyscream.net Thu Dec 15 12:55:19 2011 From: tom at whyscream.net (Tom Hendrikx) Date: Thu, 15 Dec 2011 11:55:19 +0100 Subject: [Dovecot] dovecot-antispam: pipe backend with spamc failing to parse args In-Reply-To: <87k45yllf3.fsf@algae.riseup.net> References: <87k45yllf3.fsf@algae.riseup.net> Message-ID: <4EE9D217.5060006@whyscream.net> On 15/12/11 01:37, Micah Anderson wrote: > > I'm trying to get the pipe backend to work with the new > dovecot-antispam (I was very pleased to see the new version, thanks > Johannes!) > > antispam_pipe_program_spam_arg = -L spam > antispam_pipe_program_notspam_arg = -L ham > antispam_pipe_program = /usr/bin/spamc > antispam_pipe_program_args = -d 10.0.1.109 > > Now, when I move a message to Spam, dovecot-antispam detects it and > attempts to run, but it fails: > > Dec 14 16:22:45 grosbeak [username 10.0.1.74 uid]: antispam: run program > failed with exit code 64 > > Exit code 64 is spamc's exit code for "command line usage error" - but I > can't see exactly the command that is being constructed by > dovecot-antispam to know where the error is. I use dspam as backend, but multiple args need to be specified separated by semicolons (';') if spaces aare needed on the original commandline. i.e.: antispam_pipe_program_spam_arg = -L;spam antispam_pipe_program_notspam_arg = -L;ham antispam_pipe_program = /usr/bin/spamc antispam_pipe_program_args = -d;10.0.1.109 Note that this is the fork from Eugene as documented on the wiki, which is based on the same code. Did I miss the announcement from Johannes somewhere?:) -- Regards, Tom From forall at stalowka.info Thu Dec 15 16:03:40 2011 From: forall at stalowka.info (For@ll) Date: Thu, 15 Dec 2011 15:03:40 +0100 Subject: [Dovecot] Autosubscribe new folders In-Reply-To: <20111214161958.GA2843@PC211.ikt.de> References: <20111214161958.GA2843@PC211.ikt.de> Message-ID: W dniu 14.12.2011 17:20, Dennis Guhl pisze: > On Wed, Dec 14, 2011 at 01:49:39PM +0100, For at ll wrote: >> Hi, > > [..] > >> When I get a new message, in user folder is automaticly created >> folder like subject but is not subscribed. What I must settings in >> dovecot to automaticly subscribe folders to subscriptions files.? > > Add > > lda_mailbox_autosubscribe = yes > > to 15-lda.conf (or wherever you defined lda_mailbox_autocreate = yes). > > Dennis > It doesn't work. This is a part of config file about lda: protocol lda { log_path = /var/log/dovecot-deliver.log auth_socket_path = /var/run/dovecot/auth-master postmaster_address = postmaster at i-bs.pl mail_plugins = sieve # global_script_path = /home/vmail/globalsieverc lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes } I have dovecot 1.2.15 From dg at dguhl.org Thu Dec 15 17:46:35 2011 From: dg at dguhl.org (Dennis Guhl) Date: Thu, 15 Dec 2011 16:46:35 +0100 Subject: [Dovecot] Autosubscribe new folders In-Reply-To: References: <20111214161958.GA2843@PC211.ikt.de> Message-ID: <20111215154634.GB11853@PC211.ikt.de> On Thu, Dec 15, 2011 at 03:03:40PM +0100, For at ll wrote: > W dniu 14.12.2011 17:20, Dennis Guhl pisze: > >On Wed, Dec 14, 2011 at 01:49:39PM +0100, For at ll wrote: > >>Hi, [..] > It doesn't work. This is a part of config file about lda: > protocol lda { [..] > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > } > I have dovecot 1.2.15 This are directives from 2.0 which won't work with dovecot 1.2. IIRC dovecot 1.2 can only automatically create and subscribe administratively defined folders on first login. Dennis -- Dennis Guhl () ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments From e-frog at gmx.de Thu Dec 15 19:17:05 2011 From: e-frog at gmx.de (e-frog) Date: Thu, 15 Dec 2011 18:17:05 +0100 Subject: [Dovecot] Autosubscribe new folders In-Reply-To: <20111215154634.GB11853@PC211.ikt.de> References: <20111214161958.GA2843@PC211.ikt.de> <20111215154634.GB11853@PC211.ikt.de> Message-ID: <4EEA2B91.9050306@gmx.de> Am 15.12.2011 16:46, schrieb Dennis Guhl: > On Thu, Dec 15, 2011 at 03:03:40PM +0100, For at ll wrote: >> W dniu 14.12.2011 17:20, Dennis Guhl pisze: >>> On Wed, Dec 14, 2011 at 01:49:39PM +0100, For at ll wrote: >>>> Hi, > > [..] > >> It doesn't work. This is a part of config file about lda: >> protocol lda { > > [..] > >> lda_mailbox_autocreate = yes >> lda_mailbox_autosubscribe = yes >> } >> I have dovecot 1.2.15 > > This are directives from 2.0 which won't work with dovecot 1.2. > > IIRC dovecot 1.2 can only automatically create and subscribe > administratively defined folders on first login. > > Dennis http://wiki1.dovecot.org/LDA#Parameters Look for the -s switch /e-frog From Juergen.Obermann at hrz.uni-giessen.de Fri Dec 16 00:00:05 2011 From: Juergen.Obermann at hrz.uni-giessen.de (=?UTF-8?Q?J=C3=BCrgen_Obermann?=) Date: Thu, 15 Dec 2011 23:00:05 +0100 Subject: [Dovecot] dsync panic Message-ID: <3a8f9df5e523c0391c41964ae3d09d1b@imapproxy.hrz> Hello, when I try to convert from mbox to mdbox with dsync with one user it always panics: # /opt/local/bin/dsync -v -u userxy backup ssh root at minerva1 /opt/local/bin/dsync -v -u userxy dsync-local(userxy): Info: Papierkorb: uidnext changed: 161 != 1 dsync-local(userxy): Info: INBOX: uidnext changed: 9139 != 9105 dsync-local(userxy): Info: Trash: uidnext changed: 3924 != 3915 dsync-local(userxy): Info: Drafts: uidnext changed: 1563 != 1 dsync-local(userxy): Info: Gesendet: uidnext changed: 369 != 1 dsync-local(userxy): Info: Sent: uidnext changed: 1955 != 1 dsync-remote(userxy): Panic: Trying to allocate 2147483648 bytes dsync-remote(userxy): Error: Raw backtrace: 0xff14bc30 -> 0xff1658c0 -> 0xff15744c -> 0xff157520 -> 0xff159d90 -> 0xff156540 -> 0xff15cf5c -> 0xff156540 -> 0xff157100 -> 0xff16d158 -> 0xff16cfe8 -> 0xff26e350 -> 0x251c4 -> 0x2547c -> 0x21110 -> 0x20494 -> 0x1f230 -> 0x1f3d4 -> 0xff15e46c -> 0xff15f738 -> 0xff15e530 -> 0xff140ec8 -> 0x1525c -> 0x14608 Abort dsync-local(userxy): Error: read() from worker server failed: EOF dsync-local(userxy): Error: Unexpected reply from server: My local configuration is: # /opt/local/bin/doveconf -n # 2.0.16: /opt/local/etc/dovecot/dovecot.conf # OS: SunOS 5.10 sun4v auth_verbose = yes disable_plaintext_auth = no lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = imap.hrz.uni-giessen.de localhost mail_fsync = always mail_location = mbox:~/Mail:INBOX=/var/mail/%u mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = mail_log notify zlib managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes list = no location = prefix = Mail/ separator = / subscriptions = yes type = private } passdb { driver = pam } passdb { args = /opt/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { autocreate = Trash autocreate2 = caughtspam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = caughtspam autosubscribe3 = Sent autosubscribe4 = Drafts mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at hrz.uni-giessen.de quota_full_tempfail = yes sendmail_path = /usr/lib/sendmail service auth { client_limit = 11120 } service imap-login { process_min_avail = 16 service_count = 0 vsz_limit = 640 M } service imap { process_limit = 4096 vsz_limit = 1 G } ssl_cert = Hello, I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7. All accounts are virtual, hosted on LDAP Server. My problem is that the command: doveadm quota get -A stopped listing all accounts. I think this problem started after I changed in LDAP lookup configuration from "scope = subtree" to "scope = onelevel", because it did not occur before (I did no other changes). Now, the above command only lists 12 accounts. If I query for a particular user: doveadm quota get -u userx this works fine, but userx (and all users except those 12) is NOT listed when trying to display all users. How can I run the above command without problems again? Thanks in advance, Nick From nmilas at noa.gr Fri Dec 16 00:25:40 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Fri, 16 Dec 2011 00:25:40 +0200 Subject: [Dovecot] DKIM Verification failures Message-ID: <4EEA73E4.6080305@noa.gr> Hi, -- This message refers to the maillist itself rather than to dovecot software -- I have noticed that when I post to this list (only), I get DKIM Verification failure reports from: root at moncton.sidefx.com (e.g. for my last post: "DKIM failure report for job 4D27B5DC4E on mail.sidefx.com") root at mail.rmacd.com (e.g. for my last post: "DKIM failure report for job B69B3187F1 on mail.rmacd.com") root at mx0.roessner-net.de (e.g. for my last post: "DKIM failure report for job 6103B52092 on mx0.roessner-net.de") I have not had other DKIM failure reports from anywhere and I know that we should not have issues with it. An example from gmail: Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of nmilas at noa.gr designates 195.251.204.235 as permitted sender) smtp.mail=nmilas at noa.gr; dkim=pass header.i=@noa.gr So, whom should I contact to investigate this problem? Thanks, Nick From robert at schetterer.org Fri Dec 16 00:54:21 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 15 Dec 2011 23:54:21 +0100 Subject: [Dovecot] DKIM Verification failures In-Reply-To: <4EEA73E4.6080305@noa.gr> References: <4EEA73E4.6080305@noa.gr> Message-ID: <4EEA7A9D.9070101@schetterer.org> Am 15.12.2011 23:25, schrieb Nikolaos Milas: > Hi, > > -- This message refers to the maillist itself rather than to dovecot > software -- > > I have noticed that when I post to this list (only), I get DKIM > Verification failure reports from: > > root at moncton.sidefx.com (e.g. for my last post: "DKIM failure report > for job 4D27B5DC4E on mail.sidefx.com") > root at mail.rmacd.com (e.g. for my last post: "DKIM failure report for job > B69B3187F1 on mail.rmacd.com") > root at mx0.roessner-net.de (e.g. for my last post: "DKIM failure report > for job 6103B52092 on mx0.roessner-net.de") whois roessner-net.de and search the list archive for roessner mail address, guess it will no problem to contact and debug > > I have not had other DKIM failure reports from anywhere and I know that > we should not have issues with it. An example from gmail: > > Authentication-Results: mx.google.com; spf=pass (google.com: best guess > record for domain of nmilas at noa.gr designates 195.251.204.235 as > permitted sender) smtp.mail=nmilas at noa.gr; dkim=pass header.i=@noa.gr > > So, whom should I contact to investigate this problem? > > Thanks, > Nick From ml at smtp.fakessh.eu Fri Dec 16 03:56:55 2011 From: ml at smtp.fakessh.eu (ml) Date: Fri, 16 Dec 2011 02:56:55 +0100 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EEA6DF0.3080909@noa.gr> References: <4EEA6DF0.3080909@noa.gr> Message-ID: <20b427c7163c0ebb3e8c90603f460b5a@roundcube.fakessh.eu> Le 2011-12-15 23:00, Nikolaos Milas a ?crit?: > Hello, > > I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7. > > All accounts are virtual, hosted on LDAP Server. > > My problem is that the command: > > doveadm quota get -A > > stopped listing all accounts. I think this problem started after I > changed in LDAP lookup configuration from "scope = subtree" to "scope > = onelevel", because it did not occur before (I did no other > changes). > > Now, the above command only lists 12 accounts. If I query for a > particular user: > > doveadm quota get -u userx > > this works fine, but userx (and all users except those 12) is NOT > listed when trying to display all users. > > How can I run the above command without problems again? > > Thanks in advance, > Nick upgrade to the latest rpm i any problem with the last release -- http://pgp.mit.edu:11371/pks/lookup?op=get&search=0x092164A7 gpg --keyserver pgp.mit.edu --recv-key 092164A7 http://urlshort.eu fakessh @ http://gplus.to/sshfake http://gplus.to/sshswilting http://gplus.to/john.swilting From nmilas at noa.gr Fri Dec 16 10:30:28 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Fri, 16 Dec 2011 10:30:28 +0200 Subject: [Dovecot] DKIM Verification failures In-Reply-To: <4EEA7A9D.9070101@schetterer.org> References: <4EEA73E4.6080305@noa.gr> <4EEA7A9D.9070101@schetterer.org> Message-ID: <4EEB01A4.3030507@noa.gr> On 16/12/2011 12:54 ??, Robert Schetterer wrote: > whois roessner-net.de > > and search the list archive for > > roessner mail address, guess it will no problem to contact and debug Thanks, I've found and privately emailed the affected members. Nick From nmilas at noa.gr Fri Dec 16 11:09:39 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Fri, 16 Dec 2011 11:09:39 +0200 Subject: [Dovecot] Calculation of suggested vsz_limit values Message-ID: <4EEB0AD3.20001@noa.gr> Hello, I would like to ask on suggested vsz_limit values. Is there any way of calculating such values? How should we determine them? I don't want to risk wrong values (and possible errors) on a production system, if I upgrade to 2.0.16 where vsz_limit values are enforced (I read release notes)! If there is no standard way of calculation, could someone please check the following info and suggest some values? I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7 (as a VM on a KVM Host). All accounts are virtual, hosted on LDAP Server. We have about 250 mailboxes of 4GB each (in practice, only a couple of mailboxes ever reach 1GB so we are "over-booking"). It is a relatively low-load server. Memory status and config follows below. Thanks, Nick The server memory condition is as follows: # vmstat procs -----------memory---------- ---swap-- -----io---- --system-- -----cpu------ r b swpd free buff cache si so bi bo in cs us sy id wa st 0 0 92 62400 212324 1299604 0 0 397 235 70 39 4 2 89 4 0 # free -m total used free shared buffers cached Mem: 2010 1951 59 0 207 1269 -/+ buffers/cache: 474 1536 Swap: 2015 0 2015 ---------- Config Start ------------- # 2.0.13: dovecot.conf protocols = imap pop3 mail_location = maildir:~/Maildir/ mail_gid = 500 mail_uid = 500 auth_mechanisms = plain login auth_username_format = %Lu auth_verbose = yes disable_plaintext_auth = no mail_plugins = quota protocol imap { imap_client_workarounds = "delay-newmail " mail_plugins = quota imap_quota } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = log_path = mail_plugins = quota postmaster_address = sysadmin at example.com sendmail_path = /usr/lib/sendmail } userdb { args = /etc/dovecot/dovecot-usrdb-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-passdb-ldap.conf driver = ldap } plugin { quota = maildir:User quota quota_rule = *:storage=4G quota_rule2 = Trash:storage=+3%% quota_warning = storage=75%% quota-warning 75 %u quota_warning2 = storage=90%% quota-warning 90 %u } service quota-warning { executable = script /opt/mail1.sh user = vmail unix_listener quota-warning { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service imap-login { service_count = 1 vsz_limit = 64 M } service pop3-login { service_count = 1 vsz_limit = 64 M } ssl_ca = Hi, I'm working for tuning a busy cluster of dovecot servers. Heach server as 4 core, 8GB of RAM and provide POP3 and IMAP access to mailbox. OS is Debian 6.0 and dovecot version is 1.2.15. I am unsure how to set "login_max_processes_count" and "login_max_connections" for reach the best situation when login_process_per_connection is set to no. I don't know what value to set login_max_processes_count. For example is better the first or the second configuration? login_process_per_connection=no login_processes_count=4 login_max_processes_count=8 login_max_connections=512 login_process_size=128 login_process_per_connection=no login_processes_count=4 login_max_processes_count=16 login_max_connections=256 login_process_size=128 Which is a suggested ratio from login_max_processes_count and login_max_connections ? Other values are correct? Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it @ LOLUG -> Socio http://www.lolug.net From scott_the_musician at yahoo.com.au Fri Dec 16 15:24:08 2011 From: scott_the_musician at yahoo.com.au (Scott Lewis) Date: Fri, 16 Dec 2011 05:24:08 -0800 (PST) Subject: [Dovecot] simultaneous scripts not running via sieve_before In-Reply-To: <4EE62AFD.90700@rename-it.nl> References: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> <1329235723.20111212135759@gmail.com> <4EE62AFD.90700@rename-it.nl> Message-ID: <1324041848.73103.YahooMailNeo@web130103.mail.mud.yahoo.com> Thanks for the advise - it worked a treat! Glad to finally have this sieve stuff under control, after weeks of trying to get it working :) ________________________________ From: Stephan Bosch To: Duane Hill Cc: dovecot at dovecot.org Sent: Tuesday, 13 December 2011 3:25 AM Subject: Re: [Dovecot] simultaneous scripts not running via sieve_before Op 12/12/2011 2:57 PM, Duane Hill schreef: > On Monday, December 12, 2011 at 13:02:05 UTC, scott_the_musician at yahoo.com.au confabulated: >> protocol lda { >> mail_plugins = sieve quota >> sieve=~/.dovecot.sieve >> sieve_extentions = +include >> sieve_dir=~/sieve >> sieve_before = /home/%u/sieve/redirect.svbin >> sieve_global_path = /etc/globalsieverc.svbin >> [/code] > sieve_before? and? sieve_after are directories where extra scripts are > run sequentially before user scripts and after user scripts. See: > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration It can be a file, but then it must point to the sieve script (in this case redirect.sieve) and not to the compiled binary (redirect.svbin in this case). Regards, Stephan. From carloswill at gmail.com Fri Dec 16 18:15:42 2011 From: carloswill at gmail.com (Carlos Mennens) Date: Fri, 16 Dec 2011 11:15:42 -0500 Subject: [Dovecot] Strange Login / Timeout Sessions Message-ID: I have my webmail application tied to Postfix / Dovecot server & now for some reason the IMAP sessions oddly time out throughout the day and then logging back into the mail system over the web is painfully slow. The only thing I've seen that fixes it is to reload the Dovecot daemon in Linux: /etc/init.d/dovecot reload Once that command is ran, my webmail login is super fast and moving from folder to folder is extremely fast again. Then in about a few hours, the session will time out and this problem repeats. The problem is the same for everyone and not just a few user accounts. Anyone have any idea what I should be looking for or looking at? My Dovecot logs or mixed in /var/log/maillog which is extremely hard to watch live & gets mixed with Postfix, Amavisd, and Postgrey. Any ideas or suggestions to narrow this problem out? I'm running Dovecot-1.0.7-7.el5_7.1. I saw this load on the console today: Error: Dovecot is already running with PID 2334 (read from /var/run/dovecot/master.pid) Fatal: Invalid configuration in /etc/dovecot.conf Below is my configuration file: [root at mail ~]# dovecot -n # 1.0.7: /etc/dovecot.conf protocols: imap ssl_ca_file: /etc/ssl/certs/digicert.crt ssl_cert_file: ***OMIT*** ssl_key_file: ***OMIT*** login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:~/Maildir auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix From john at adeptivesw.com Fri Dec 16 21:20:17 2011 From: john at adeptivesw.com (John Brock) Date: Fri, 16 Dec 2011 12:20:17 -0700 Subject: [Dovecot] logging deletion of emails through IMAP? Message-ID: <4EEB99F1.7040702@adeptivesw.com> Version 1.2.16: Is there some way to enable logging for when emails are deleted via IMAP? All I see are log entries for users logging in/logging out. It would be nice to know when an email is deleted, and from which IP address the user was logged in when s/he deleted the email. -- John Brock Adeptive Software 303-554-0301 x1 From e-frog at gmx.de Fri Dec 16 21:29:45 2011 From: e-frog at gmx.de (e-frog) Date: Fri, 16 Dec 2011 20:29:45 +0100 Subject: [Dovecot] logging deletion of emails through IMAP? In-Reply-To: <4EEB99F1.7040702@adeptivesw.com> References: <4EEB99F1.7040702@adeptivesw.com> Message-ID: <4EEB9C29.10607@gmx.de> On 16.12.2011 20:20, wrote John Brock: > Version 1.2.16: Is there some way to enable logging for when emails are > deleted via IMAP? All I see are log entries for users logging in/logging > out. It would be nice to know when an email is deleted, and from which > IP address the user was logged in when s/he deleted the email. > The maillog plugin is what you are looking for: http://wiki1.dovecot.org/Plugins/MailLog From stephan at rename-it.nl Sat Dec 17 01:25:21 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 17 Dec 2011 00:25:21 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features Message-ID: <4EEBD361.2090809@rename-it.nl> Hello Dovecot users, Pigeonhole v0.3 for Dovecot v2.1 has two new features I would like you to play with before I make a first release: 1) The new Sieve editheader extension (http://tools.ietf.org/html/rfc5293). This allows modifying the headers of the message before delivery. This is actually the first implemented extension that can modify the message itself in any way. This feature adds quite a bit of new code that I'd like to see tested more thoroughly. 2) The new sieve-filter tool (documented in the sieve-filter(1) man page upon installation). This allows (re-)filtering messages that are already stored in a particular mailbox. It preserves the assigned IMAP flags and keywords and using the imap4flags extension these can also be modified. It also plays nice with the editheader extension. Judging by postings in this mailing list from the last few years, this is a highly-demanded feature and I'm glad that I finally got around to finish this thing. If the new sieve-filter tool is lacking certain features in your opinion, just let me know. Needless to say: read the man page carefully and watch out with important mail. This is currently only available from the mercurial repository, but if you prefer to have an .rc1 release first, just tell me and I'll make one. The automatic Debian repository already includes these features. Regards, Stephan. From robert at schetterer.org Sat Dec 17 02:13:20 2011 From: robert at schetterer.org (Robert Schetterer) Date: Sat, 17 Dec 2011 01:13:20 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features In-Reply-To: <4EEBD361.2090809@rename-it.nl> References: <4EEBD361.2090809@rename-it.nl> Message-ID: <4EEBDEA0.7000004@schetterer.org> Am 17.12.2011 00:25, schrieb Stephan Bosch: > Hello Dovecot users, > > Pigeonhole v0.3 for Dovecot v2.1 has two new features I would like you > to play with before I make a first release: dove 2.1 only? > > 1) The new Sieve editheader extension > (http://tools.ietf.org/html/rfc5293). This allows modifying the headers > of the message before delivery. This is actually the first implemented > extension that can modify the message itself in any way. This feature > adds quite a bit of new code that I'd like to see tested more thoroughly. > > 2) The new sieve-filter tool (documented in the sieve-filter(1) man page > upon installation). is there an online version ? This allows (re-)filtering messages that are already > stored in a particular mailbox. It preserves the assigned IMAP flags and > keywords and using the imap4flags extension these can also be modified. > It also plays nice with the editheader extension. Judging by postings in > this mailing list from the last few years, this is a highly-demanded > feature and I'm glad that I finally got around to finish this thing. If > the new sieve-filter tool is lacking certain features in your opinion, > just let me know. Needless to say: read the man page carefully and watch > out with important mail. > > This is currently only available from the mercurial repository, but if > you prefer to have an .rc1 release first, just tell me and I'll make > one. The automatic Debian repository already includes these features. thats fine > > Regards, > > Stephan. > > > > > > From stephan at rename-it.nl Sat Dec 17 02:48:20 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 17 Dec 2011 01:48:20 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features In-Reply-To: <4EEBDEA0.7000004@schetterer.org> References: <4EEBD361.2090809@rename-it.nl> <4EEBDEA0.7000004@schetterer.org> Message-ID: <4EEBE6D4.5030304@rename-it.nl> On 12/17/2011 1:13 AM, Robert Schetterer wrote: > Am 17.12.2011 00:25, schrieb Stephan Bosch: >> Hello Dovecot users, >> >> Pigeonhole v0.3 for Dovecot v2.1 has two new features I would like you >> to play with before I make a first release: > dove 2.1 only? Yes. >> 1) The new Sieve editheader extension >> (http://tools.ietf.org/html/rfc5293). This allows modifying the headers >> of the message before delivery. This is actually the first implemented >> extension that can modify the message itself in any way. This feature >> adds quite a bit of new code that I'd like to see tested more thoroughly. >> >> 2) The new sieve-filter tool (documented in the sieve-filter(1) man page >> upon installation). > is there an online version ? Well, now there is: I've produced html output for the current version of the man pages: http://pigeonhole.dovecot.org/doc/man1/sieve-filter.1.html Regards, Stephan. From robert at schetterer.org Sat Dec 17 08:42:13 2011 From: robert at schetterer.org (Robert Schetterer) Date: Sat, 17 Dec 2011 07:42:13 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features In-Reply-To: <4EEBE6D4.5030304@rename-it.nl> References: <4EEBD361.2090809@rename-it.nl> <4EEBDEA0.7000004@schetterer.org> <4EEBE6D4.5030304@rename-it.nl> Message-ID: <4EEC39C5.8010404@schetterer.org> Am 17.12.2011 01:48, schrieb Stephan Bosch: > On 12/17/2011 1:13 AM, Robert Schetterer wrote: >> Am 17.12.2011 00:25, schrieb Stephan Bosch: >>> Hello Dovecot users, >>> >>> Pigeonhole v0.3 for Dovecot v2.1 has two new features I would like you >>> to play with before I make a first release: >> dove 2.1 only? > > Yes. > >>> 1) The new Sieve editheader extension >>> (http://tools.ietf.org/html/rfc5293). This allows modifying the headers >>> of the message before delivery. This is actually the first implemented >>> extension that can modify the message itself in any way. This feature >>> adds quite a bit of new code that I'd like to see tested more >>> thoroughly. >>> >>> 2) The new sieve-filter tool (documented in the sieve-filter(1) man page >>> upon installation). >> is there an online version ? > > Well, now there is: I've produced html output for the current version of > the man pages: > > http://pigeonhole.dovecot.org/doc/man1/sieve-filter.1.html > > Regards, > > Stephan. > > thx Stephan -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From c at roessner-network-solutions.com Sun Dec 18 18:14:45 2011 From: c at roessner-network-solutions.com (Christian =?ISO-8859-1?B?UvbfbmVy?=) Date: Sun, 18 Dec 2011 17:14:45 +0100 Subject: [Dovecot] DKIM Verification failures In-Reply-To: <4EEA7A9D.9070101@schetterer.org> Message-ID: Hello, First of all: I am really, really sorry for all of you that got DKIM failure reports from my server! That was never my intention! I had some feedback from one of the Dovecot's users who contacted me and informed me about this circumstances. As soon as I new about it, I disabled the reports feature. It seems that there do exist problems with DKIM and some mailing lists. Not only with my mail server. I have found several SSL errors, when OpenDKIM tries to verify signatures that came from a mailing list. And in turn my MTA tried to send a report to focus on that problem. Yet I can not say, what is going wrong here, but OpenDKIM is really sensitive, if something is wrong with a signature. So as of writing this, you do not get any further report messages. For those of you, who would like to find out, what caused these reports are welcome to contact me. Maybe we can find the problem and eliminate it (maybe a bug in OpenDKIM, mailman, whatever. I don't think it's part of my configuration and therefor several other people might have this problem as well). Thanks in advance Christian Roessner Am 15.12.11 23:54 schrieb "Robert Schetterer" unter : >Am 15.12.2011 23:25, schrieb Nikolaos Milas: >> Hi, >> >> -- This message refers to the maillist itself rather than to dovecot >> software -- >> >> I have noticed that when I post to this list (only), I get DKIM >> Verification failure reports from: >> >> root at moncton.sidefx.com (e.g. for my last post: "DKIM failure report >> for job 4D27B5DC4E on mail.sidefx.com") >> root at mail.rmacd.com (e.g. for my last post: "DKIM failure report for job >> B69B3187F1 on mail.rmacd.com") > >> root at mx0.roessner-net.de (e.g. for my last post: "DKIM failure report >> for job 6103B52092 on mx0.roessner-net.de") > > > > > >whois roessner-net.de > >and search the list archive for > >roessner mail address, guess it will no problem to contact and debug > >> >> I have not had other DKIM failure reports from anywhere and I know that >> we should not have issues with it. An example from gmail: >> >> Authentication-Results: mx.google.com; spf=pass (google.com: best guess >> record for domain of nmilas at noa.gr designates 195.251.204.235 as >> permitted sender) smtp.mail=nmilas at noa.gr; dkim=pass header.i=@noa.gr >> >> So, whom should I contact to investigate this problem? >> >> Thanks, >> Nick > From profymath at yahoo.com Sun Dec 18 21:05:38 2011 From: profymath at yahoo.com (I M) Date: Sun, 18 Dec 2011 11:05:38 -0800 (PST) Subject: [Dovecot] One important question! Message-ID: <1324235138.51268.YahooMailClassic@web125604.mail.ne1.yahoo.com> Hello!Please, give me a feedback as soon as you can! I need some advice regarding ?"dovecot?self signed certificate" configuration!If you have any experience in working with php IMAP-module that would be useful for me to know what would you say about below: ? Problem: I can connect to my INBOX through telnet, but I cannot do it through imap-functions (Certificate failure for ...)? My best,Edward. From user+dovecot at localhost.localdomain.org Sun Dec 18 21:12:07 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sun, 18 Dec 2011 20:12:07 +0100 Subject: [Dovecot] OT: PHP imap_open [was: One important question!] In-Reply-To: <1324235138.51268.YahooMailClassic@web125604.mail.ne1.yahoo.com> References: <1324235138.51268.YahooMailClassic@web125604.mail.ne1.yahoo.com> Message-ID: <4EEE3B07.4070907@localhost.localdomain.org> On 12/18/2011 08:05 PM I M wrote: > Hello!Please, give me a feedback as soon as you can! > I need some advice regarding "dovecot self signed certificate" configuration!If you have any experience in working with php IMAP-module that would be useful for me to know what would you say about below: > Problem: I can connect to my INBOX through telnet, but I cannot do it through imap-functions (Certificate failure for ...)? > My best,Edward. http://php.net/manual/en/function.imap-open.php#refsect1-function.imap-open-parameters ? /novalidate-cert do not validate certificates from TLS/SSL server, needed if server uses self-signed certificates ? Regards, Pascal -- The trapper recommends today: 5e1f1e55.1135220 at localdomain.org From cor at xs4all.nl Mon Dec 19 01:32:43 2011 From: cor at xs4all.nl (Cor Bosman) Date: Mon, 19 Dec 2011 00:32:43 +0100 Subject: [Dovecot] crashes on 2.0.16 Message-ID: Hey all, I upgraded some servers today from Debian Lenny to Debian Squeeze, and after the upgrade I started getting dovecot crashes. I was on 2.0.13 but got these there as well, and hoped upgrading to 2.0.16 would help. It didn't. Anyone have an idea? Cor Dec 18 23:32:21 userimap1 kernel: [263492.245530] __ratelimit: 122 callbacks suppressed Dec 18 23:32:21 userimap1 kernel: [263492.245536] imap[19665]: segfault at 7f108efb7f60 ip 00007f108ecd37e0 sp 00007fff73c3d658 error 5 in libc-2.11.2.so[7f108ec5d000+158000] Dec 18 23:32:21 userimap1 kernel: [263492.245663] BUG: Bad page map in process imap pte:00000001 pmd:09767067 Dec 18 23:32:21 userimap1 kernel: [263492.252563] page:ffffea0000000000 flags:(null) count:-84 mapcount:-84 mapping:(null) index:0 Dec 18 23:32:21 userimap1 kernel: [263492.261186] addr:00007f108ef46000 vm_flags:08000070 anon_vma:(null) mapping:ffff88012b6e5238 index:2e9 Dec 18 23:32:21 userimap1 kernel: [263492.270804] vma->vm_ops->fault: filemap_fault+0x0/0x460 Dec 18 23:32:21 userimap1 kernel: [263492.276172] vma->vm_file->f_op->mmap: generic_file_mmap+0x0/0x60 Dec 18 23:32:21 userimap1 kernel: [263492.282424] Pid: 19665, comm: imap Tainted: G B 2.6.32.36-xsserver #1 Dec 18 23:32:21 userimap1 kernel: [263492.282429] Call Trace: Dec 18 23:32:21 userimap1 kernel: [263492.282441] [] print_bad_pte+0x1d5/0x280 Dec 18 23:32:21 userimap1 kernel: [263492.282448] [] unmap_vmas+0xa1a/0xa20 Dec 18 23:32:21 userimap1 kernel: [263492.282458] [] ? sch_direct_xmit+0x81/0x1d0 Dec 18 23:32:21 userimap1 kernel: [263492.282465] [] exit_mmap+0xbd/0x190 Dec 18 23:32:21 userimap1 kernel: [263492.282473] [] mmput+0x4d/0x120 Dec 18 23:32:21 userimap1 kernel: [263492.282481] [] exit_mm+0x112/0x150 Dec 18 23:32:21 userimap1 kernel: [263492.282488] [] do_exit+0x13d/0x800 Dec 18 23:32:21 userimap1 kernel: [263492.282496] [] ? __dequeue_signal+0xe1/0x200 Dec 18 23:32:21 userimap1 kernel: [263492.282503] [] do_group_exit+0x55/0xd0 Dec 18 23:32:21 userimap1 kernel: [263492.282510] [] get_signal_to_deliver+0x1e1/0x3e0 Dec 18 23:32:21 userimap1 kernel: [263492.282517] [] do_signal+0x75/0x7d0 Dec 18 23:32:21 userimap1 kernel: [263492.282523] [] ? print_vma_addr+0xb3/0x120 Dec 18 23:32:21 userimap1 kernel: [263492.282533] [] ? printk+0x41/0x43 Dec 18 23:32:21 userimap1 kernel: [263492.282541] [] ? __bad_area_nosemaphore+0xf6/0x1e0 Dec 18 23:32:21 userimap1 kernel: [263492.282547] [] ? bad_area_access_error+0x4e/0x60 Dec 18 23:32:21 userimap1 kernel: [263492.282553] [] do_notify_resume+0x57/0x60 Dec 18 23:32:21 userimap1 kernel: [263492.282559] [] retint_signal+0x48/0x8c # 2.0.16: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 auth_cache_size = 1 M auth_verbose = yes base_dir = /var/run/dovecot/ default_vsz_limit = 2 G disable_plaintext_auth = no first_valid_uid = 20 lock_method = dotlock login_greeting = User-IMAP ready. login_trusted_networks = 194.109.26.128/27 mail_fsync = always mail_nfs_index = yes mail_nfs_storage = yes mailbox_idle_check_interval = 1 mins maildir_stat_dirs = yes mmap_disable = yes namespace { inbox = yes location = maildir:%Nu:INDEX=/var/spool/mail/dovecot-control/indexes/%1u/%2u/%u:INBOX=%Nu:CONTROL=/var/spool/mail/dovecot-control/%1u/%2u/%u/INBOX prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot.masterusers driver = passwd-file master = yes } passdb { args = cache_key=%u%r dovecot driver = pam } plugin { quota = fs:User quota } protocols = imap service auth { client_limit = 5000 } service imap-login { process_min_avail = 8 service_count = 0 vsz_limit = 2 G } service imap { process_limit = 4096 vsz_limit = 2 G } shutdown_clients = no ssl_cert = References: Message-ID: <1324256311.8138.5.camel@tardis> Have you tried using a modern kernel? that one is about 2 years old. On Mon, 2011-12-19 at 00:32 +0100, Cor Bosman wrote: > Hey all, I upgraded some servers today from Debian Lenny to Debian Squeeze, and after the upgrade I started getting dovecot crashes. I was on 2.0.13 but got these there as well, and hoped upgrading to 2.0.16 would help. It didn't. Anyone have an idea? > > Cor > # 2.0.16: /usr/local/etc/dovecot/dovecot.conf > # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From sven at svenhartge.de Mon Dec 19 03:32:20 2011 From: sven at svenhartge.de (Sven Hartge) Date: Mon, 19 Dec 2011 02:32:20 +0100 Subject: [Dovecot] crashes on 2.0.16 References: <1324256311.8138.5.camel@tardis> Message-ID: Noel Butler wrote: > On Mon, 2011-12-19 at 00:32 +0100, Cor Bosman wrote: >> # 2.0.16: /usr/local/etc/dovecot/dovecot.conf >> # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 > Have you tried using a modern kernel? that one is about 2 years old. Well, this _is_ the kernel from Debian Stable and based on the Long-Term-Release from the kernel maintainers. Besides, from the suffix i assume this may be a virtual server, so it may be not possible for Cor to even change the kernel himself. Gr??e, Sven. -- Sigmentation fault. Core dumped. From noel.butler at ausics.net Mon Dec 19 05:13:58 2011 From: noel.butler at ausics.net (Noel Butler) Date: Mon, 19 Dec 2011 13:13:58 +1000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: <1324256311.8138.5.camel@tardis> Message-ID: <1324264438.11142.9.camel@tardis> On Mon, 2011-12-19 at 02:32 +0100, Sven Hartge wrote: > Noel Butler wrote: > > On Mon, 2011-12-19 at 00:32 +0100, Cor Bosman wrote: > > >> # 2.0.16: /usr/local/etc/dovecot/dovecot.conf > >> # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 > > > Have you tried using a modern kernel? that one is about 2 years old. > > Well, this _is_ the kernel from Debian Stable and based on the > Long-Term-Release from the kernel maintainers. So what? It is not anything current, that the kernel dev team would waste their time on. Please remember, there is a massive difference between the kernel maintainers, and the debian kernel package maintainers, do not confuse the two, because the later have nothing to do with the former. > > Besides, from the suffix i assume this may be a virtual server, so it > may be not possible for Cor to even change the kernel himself. > Given who Cor is, I'd be actually horrified if he was running any of his plethora of mail servers on a virtual server. hint: don't read too much into the uname value. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From nmilas at noa.gr Mon Dec 19 09:31:45 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Mon, 19 Dec 2011 09:31:45 +0200 Subject: [Dovecot] Calculation of suggested vsz_limit values In-Reply-To: <4EEB0AD3.20001@noa.gr> References: <4EEB0AD3.20001@noa.gr> Message-ID: <4EEEE861.2010503@noa.gr> Hi, No hints about vsz_limit values? Anyone? Thanks, Nick On 16/12/2011 11:09 ??, Nikolaos Milas wrote: > Hello, > > I would like to ask on suggested vsz_limit values. > > Is there any way of calculating such values? How should we determine > them? I don't want to risk wrong values (and possible errors) on a > production system, if I upgrade to 2.0.16 where vsz_limit values are > enforced (I read release notes)! > > If there is no standard way of calculation, could someone please check > the following info and suggest some values? > > I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7 (as a > VM on a KVM Host). > > All accounts are virtual, hosted on LDAP Server. We have about 250 > mailboxes of 4GB each (in practice, only a couple of mailboxes ever > reach 1GB so we are "over-booking"). It is a relatively low-load server. > > Memory status and config follows below. > > Thanks, > Nick > > The server memory condition is as follows: > > # vmstat > procs -----------memory---------- ---swap-- -----io---- --system-- > -----cpu------ > r b swpd free buff cache si so bi bo in cs us > sy id wa st > 0 0 92 62400 212324 1299604 0 0 397 235 70 39 4 > 2 89 4 0 > > # free -m > total used free shared buffers cached > Mem: 2010 1951 59 0 207 1269 > -/+ buffers/cache: 474 1536 > Swap: 2015 0 2015 > > ---------- Config Start ------------- > > # 2.0.13: dovecot.conf > > protocols = imap pop3 > > mail_location = maildir:~/Maildir/ > mail_gid = 500 > mail_uid = 500 > > auth_mechanisms = plain login > auth_username_format = %Lu > auth_verbose = yes > disable_plaintext_auth = no > > mail_plugins = quota > > protocol imap { > imap_client_workarounds = "delay-newmail " > mail_plugins = quota imap_quota > } > > protocol pop3 { > mail_max_userip_connections = 3 > mail_plugins = quota > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > pop3_uidl_format = %08Xu%08Xv > } > > protocol lda { > auth_socket_path = /var/run/dovecot/auth-master > info_log_path = > log_path = > mail_plugins = quota > postmaster_address = sysadmin at example.com > sendmail_path = /usr/lib/sendmail > } > > userdb { > args = /etc/dovecot/dovecot-usrdb-ldap.conf > driver = ldap > } > > passdb { > args = /etc/dovecot/dovecot-passdb-ldap.conf > driver = ldap > } > > plugin { > quota = maildir:User quota > quota_rule = *:storage=4G > quota_rule2 = Trash:storage=+3%% > quota_warning = storage=75%% quota-warning 75 %u > quota_warning2 = storage=90%% quota-warning 90 %u > } > > service quota-warning { > executable = script /opt/mail1.sh > user = vmail > unix_listener quota-warning { > user = vmail > } > } > > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-master { > group = vmail > mode = 0660 > user = vmail > } > user = root > } > > service imap-login { > service_count = 1 > vsz_limit = 64 M > } > > service pop3-login { > service_count = 1 > vsz_limit = 64 M > } > > ssl_ca = ssl_cert = ssl_key = > syslog_facility = local1 > > ---------- Config End ------------- > > From bigmoozer at gmail.com Mon Dec 19 11:27:18 2011 From: bigmoozer at gmail.com (moozer) Date: Mon, 19 Dec 2011 10:27:18 +0100 Subject: [Dovecot] IMAP and sieve Message-ID: <4EEF0376.404@gmail.com> I am currently setting up an IMAP server for archiving purposes. The goal is to drag an email to the IMAP folder, and then have a server-side sieve script to put it in the right folder. One of the sources used was this wiki entry http://wiki.dovecot.org/LDA/Sieve/Dovecot I added the mail_plugins = sieve to /etc/dovecot/15-lda.conf and after some exim4 fiddling, mails delivered are filtered by my sieve script. Doing the same for imap delivery (in /etc/dovecot/20-imap.conf) give the following error Dec 19 10:22:09 leon dovecot: imap: Error: dlopen(/usr/lib/dovecot/modules/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_save_open Dec 19 10:22:09 leon dovecot: imap: Error: Can't load plugin sieve_plugin: Plugin is intended to be used only by binaries: lda lmtp (we're imap) Dec 19 10:22:09 leon dovecot: imap: Fatal: Couldn't load required plugins Dec 19 10:22:10 leon dovecot: imap: Error: dlopen(/usr/lib/dovecot/modules/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_save_open Dec 19 10:22:10 leon dovecot: imap: Error: Can't load plugin sieve_plugin: Plugin is intended to be used only by binaries: lda lmtp (we're imap) Dec 19 10:22:10 leon dovecot: imap: Fatal: Couldn't load required plugins I notice this part: "plugin is intended to be used only by binaries: lda lmtp (we're imap)" So the question is if it is possible to run sieve server-side sieve scripts on emails copied using IMAP. Suggestions are most welcome. Moozer -- I am running debian testing # dovecot --version 2.0.15 From stephan at rename-it.nl Mon Dec 19 11:45:18 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 19 Dec 2011 10:45:18 +0100 Subject: [Dovecot] IMAP and sieve In-Reply-To: <4EEF0376.404@gmail.com> References: <4EEF0376.404@gmail.com> Message-ID: <4EEF07AE.3010503@rename-it.nl> On 12/19/2011 10:27 AM, moozer wrote: > I am currently setting up an IMAP server for archiving purposes. The > goal is to drag an email to the IMAP folder, and then have a server-side > sieve script to put it in the right folder. [...] > I notice this part: > "plugin is intended to be used only by binaries: lda lmtp (we're imap)" > > So the question is if it is possible to run sieve server-side sieve > scripts on emails copied using IMAP. Not directly. There is some standardization effort done to achieve something like that: http://tools.ietf.org/html/draft-ietf-sieve-imap-sieve-02 But this is not implemented so far. > Suggestions are most welcome. What you can do is run the Sieve filter in some (in)cron job (or by means of some other trigger). For Dovecot v2.1 there is now a special sieve-filter command line tool to perform the filtering on a folder. However, it is not released yet. For older Dovecot versions you can use this recipe to re-filter mail: http://wiki2.dovecot.org/HowTo/RefilterMail Regards, Stephan. From bigmoozer at gmail.com Mon Dec 19 11:56:57 2011 From: bigmoozer at gmail.com (moozer) Date: Mon, 19 Dec 2011 10:56:57 +0100 Subject: [Dovecot] IMAP and sieve In-Reply-To: <4EEF07AE.3010503@rename-it.nl> References: <4EEF0376.404@gmail.com> <4EEF07AE.3010503@rename-it.nl> Message-ID: <4EEF0A69.7040105@gmail.com> On 2011-12-19 10:45, Stephan Bosch wrote: > On 12/19/2011 10:27 AM, moozer wrote: >> I am currently setting up an IMAP server for archiving purposes. The >> goal is to drag an email to the IMAP folder, and then have a server-side >> sieve script to put it in the right folder. > [...] >> I notice this part: >> "plugin is intended to be used only by binaries: lda lmtp (we're imap)" >> >> So the question is if it is possible to run sieve server-side sieve >> scripts on emails copied using IMAP. > > Not directly. There is some standardization effort done to achieve > something like that: > > http://tools.ietf.org/html/draft-ietf-sieve-imap-sieve-02 > > But this is not implemented so far. > This is the exact thing I was looking for. Too bad that I am ahead of my time :-) >> Suggestions are most welcome. > > What you can do is run the Sieve filter in some (in)cron job (or by > means of some other trigger). For Dovecot v2.1 there is now a special > sieve-filter command line tool to perform the filtering on a folder. > However, it is not released yet. > > For older Dovecot versions you can use this recipe to re-filter mail: > > http://wiki2.dovecot.org/HowTo/RefilterMail > At first glance it looks like using dovecot as a generic IMAP server, fetch mail, run filters and ask the IMAP server to move the mail. It could work also. > Regards, > > Stephan. > > Thank you for a good answer. I will reevaluate my plan based on this. moozer From alec at alec.pl Mon Dec 19 12:06:35 2011 From: alec at alec.pl (A.L.E.C) Date: Mon, 19 Dec 2011 11:06:35 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features In-Reply-To: <4EEBD361.2090809@rename-it.nl> References: <4EEBD361.2090809@rename-it.nl> Message-ID: <4EEF0CAB.4080307@alec.pl> On 17.12.2011 00:25, Stephan Bosch wrote: > 2) The new sieve-filter tool (documented in the sieve-filter(1) man page > upon installation). This allows (re-)filtering messages that are already > stored in a particular mailbox. This is really nice. I'd love to see this tool integrated with IMAP (or MANAGESIEVE) protocol somehow. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From profymath at yahoo.com Mon Dec 19 20:19:07 2011 From: profymath at yahoo.com (I M) Date: Mon, 19 Dec 2011 10:19:07 -0800 (PST) Subject: [Dovecot] OT: PHP imap_open [was: One important question!] In-Reply-To: <4EEE3B07.4070907@localhost.localdomain.org> Message-ID: <1324318747.92715.YahooMailClassic@web125606.mail.ne1.yahoo.com> Thank you for the response,?Pascal!But I have read the all flags and functions that might be useful for this problem before sending this letter.Please, find one more minute to know what I've done yet! 1. I installed MTA (sendmail) first. Then tuned it for receiving and sending emails outside of localhost. As for MDA I used "MAILER(`local')" as dovecot has built in one!?2. I installed IMAP Server (dovecot). I made it working in PLAIN ?LOGIN mode on imap protocol. But as you know it doesn't mean that dovecot won't use SSL/TLS. So we are going to transmit out data as a plain text inside SSL/TLS. (see http://wiki1.dovecot.org/SSL, "...?Some clients unfortunately try to do plaintext authentication without STARTTLS, even when IMAP server has told the client that it won't work." ). So when you try to disable ssl-support in dovecot.conf, you are going to get the message "SECURITY PROBLEM: insecure server advertised AUTH=PLAIN ...". The same message you get when putting "/notls" flag. That why I thought It might be a certificate configuration problem on the client side! Cause when I tried to put the /novalidate-cert flag in string "$mbox = imap_open("{XXXXXX.com:143/novalidate-cert}","user_name","user_password");" I immediately got the ?message: "Undefined variable: mbox in ...". Also keep in mind that the connection to imap server (dovecot) can be established through telnet. So my guess is around misconfiguration of php5-imap module! I've also checked apache-server configuration cause it could also be a problem as I use php-functions on webserver environment. So what would you say?Please, correct me if I am wrong.Thanks again for the response and, please give me a feedback as soon as you can! My best,Edward. ? --- On?Sun, 12/18/11, Pascal Volk?wrote: From: Pascal Volk Subject: [Dovecot] OT: PHP imap_open [was: One important question!] To: "Dovecot Mailing List" Date: Sunday, December 18, 2011, 2:12 PM On 12/18/2011 08:05 PM I M wrote: > Hello!Please, give me a feedback as soon as you can! > I need some advice regarding? "dovecot self signed certificate" configuration!If you have any experience in working with php IMAP-module that would be useful for me to know what would you say about below:?? > Problem: I can connect to my INBOX through telnet, but I cannot do it through imap-functions (Certificate failure for ...)? > My best,Edward. http://php.net/manual/en/function.imap-open.php#refsect1-function.imap-open-parameters ? /novalidate-cert ??? do not validate certificates from TLS/SSL server, needed if ??? server uses self-signed certificates ? Regards, Pascal --? The trapper recommends today:5e1f1e55.1135220 at localdomain.org --- On Sun, 12/18/11, Pascal Volk wrote: From: Pascal Volk Subject: [Dovecot] OT: PHP imap_open [was: One important question!] To: "Dovecot Mailing List" Date: Sunday, December 18, 2011, 2:12 PM On 12/18/2011 08:05 PM I M wrote: > Hello!Please, give me a feedback as soon as you can! > I need some advice regarding? "dovecot self signed certificate" configuration!If you have any experience in working with php IMAP-module that would be useful for me to know what would you say about below:? > Problem: I can connect to my INBOX through telnet, but I cannot do it through imap-functions (Certificate failure for ...)? > My best,Edward. http://php.net/manual/en/function.imap-open.php#refsect1-function.imap-open-parameters ? /novalidate-cert ??? do not validate certificates from TLS/SSL server, needed if ??? server uses self-signed certificates ? Regards, Pascal -- The trapper recommends today: 5e1f1e55.1135220 at localdomain.org From CMarcus at Media-Brokers.com Mon Dec 19 21:28:37 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 19 Dec 2011 14:28:37 -0500 Subject: [Dovecot] OT: PHP imap_open [was: One important question!] In-Reply-To: <1324318747.92715.YahooMailClassic@web125606.mail.ne1.yahoo.com> References: <1324318747.92715.YahooMailClassic@web125606.mail.ne1.yahoo.com> Message-ID: <4EEF9065.9090406@Media-Brokers.com> Your emails are extremely poorly formatted and too much trouble to try to read. If you want to get help, you should learn how to properly compose an email. On 2011-12-19 1:19 PM, I M wrote: > Thank you for the response, Pascal!But I have read the all flags and functions that might be useful for this problem before sending this letter.Please, find one more minute to know what I've done yet! > 1. I installed MTA (sendmail) first. Then tuned it for receiving and sending emails outside of localhost. As for MDA I used "MAILER(`local')" as dovecot has built in one! 2. I installed IMAP Server (dovecot). I made it working in PLAIN LOGIN mode on imap protocol. But as you know it doesn't mean that dovecot won't use SSL/TLS. So we are going to transmit out data as a plain text inside SSL/TLS. (see http://wiki1.dovecot.org/SSL, "... Some clients unfortunately try to do plaintext authentication without STARTTLS, even when IMAP server has told the client that it won't work." ). So when you try to disable ssl-support in dovecot.conf, you are going to get the message "SECURITY PROBLEM: insecure server advertised AUTH=PLAIN ...". The same message you get when putting "/notls" flag. That why I thought It might be a certificate configuration problem on the client side! Cause when I tried to put the /novalidate-cert flag in string "$mbox = > imap_open("{XXXXXX.com:143/novalidate-cert}","user_name","user_password");" I immediately got the message: "Undefined variable: mbox in ...". Also keep in mind that the connection to imap server (dovecot) can be established through telnet. So my guess is around misconfiguration of php5-imap module! I've also checked apache-server configuration cause it could also be a problem as I use php-functions on webserver environment. > So what would you say?Please, correct me if I am wrong.Thanks again for the response and, please give me a feedback as soon as you can! > My best,Edward. -- Best regards, Charles From forrie at gmail.com Mon Dec 19 19:35:00 2011 From: forrie at gmail.com (Forrest Aldrich) Date: Mon, 19 Dec 2011 12:35:00 -0500 Subject: [Dovecot] Using Amazon S3 storage for Maildir ? Message-ID: <4EEF75C4.9040005@gmail.com> I wonder if anyone has tried using an IMAP server with Amazon S3 as a backend. There would be many factors to consider (speed, etc). However, moreso, I don't know that Maildir(++) would support multiple folders that might be linked into the cloud. For example, higher-I/O local incoming mail is on disk, some folders archived on S3. Could be easily done by simply creating another account and storing its Maildir in S3 -- Curious.... From tss at iki.fi Tue Dec 20 07:26:26 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:26:26 +0200 Subject: [Dovecot] Calculation of suggested vsz_limit values In-Reply-To: <4EEB0AD3.20001@noa.gr> References: <4EEB0AD3.20001@noa.gr> Message-ID: <352FB226-243B-4916-AB21-97D6990AC0BD@iki.fi> On 16.12.2011, at 11.09, Nikolaos Milas wrote: > I would like to ask on suggested vsz_limit values. > > Is there any way of calculating such values? Not really. For mail related processes (imap, pop3, lmtp) you could find the largest dovecot.index.cache file and make sure that vsz_limit is at least 3 times that. > How should we determine them? I don't want to risk wrong values (and possible errors) on a production system, if I upgrade to 2.0.16 where vsz_limit values are enforced (I read release notes)! If you're very worried, you can simply disable the vsz limits by setting them to 0. The default 256 MB limit is good enough for most uses though. From tss at iki.fi Tue Dec 20 07:27:55 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:27:55 +0200 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: Message-ID: On 19.12.2011, at 1.32, Cor Bosman wrote: > Hey all, I upgraded some servers today from Debian Lenny to Debian Squeeze, and after the upgrade I started getting dovecot crashes. I was on 2.0.13 but got these there as well, and hoped upgrading to 2.0.16 would help. It didn't. Anyone have an idea? > > Dec 18 23:32:21 userimap1 kernel: [263492.245536] imap[19665]: segfault at 7f108efb7f60 ip 00007f108ecd37e0 sp 00007fff73c3d658 error 5 in libc-2.11.2.so[7f108ec5d000+158000] gdb backtrace of the crash would be helpful: http://dovecot.org/bugreport.html > Dec 18 23:32:21 userimap1 kernel: [263492.245663] BUG: Bad page map in process imap pte:00000001 pmd:09767067 Looks more like a kernel bug though. From tss at iki.fi Tue Dec 20 07:29:22 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:29:22 +0200 Subject: [Dovecot] Using Amazon S3 storage for Maildir ? In-Reply-To: <4EEF75C4.9040005@gmail.com> References: <4EEF75C4.9040005@gmail.com> Message-ID: On 19.12.2011, at 19.35, Forrest Aldrich wrote: > I wonder if anyone has tried using an IMAP server with Amazon S3 as a backend. There would be many factors to consider (speed, etc). However, moreso, I don't know that Maildir(++) would support multiple folders that might be linked into the cloud. For example, higher-I/O local incoming mail is on disk, some folders archived on S3. Could be easily done by simply creating another account and storing its Maildir in S3 -- Maybe [sm]dbox with alt storage set to S3? http://wiki2.dovecot.org/MailboxFormat/dbox#Alternate_storage From tss at iki.fi Tue Dec 20 07:32:27 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:32:27 +0200 Subject: [Dovecot] Tuning Login processes for High-performance Mode In-Reply-To: <4EEB3443.4030104@skye.it> References: <4EEB3443.4030104@skye.it> Message-ID: <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> On 16.12.2011, at 14.06, Alessio Cecchi wrote: > I'm working for tuning a busy cluster of dovecot servers. Heach server as 4 core, 8GB of RAM and provide POP3 and IMAP access to mailbox. OS is Debian 6.0 and dovecot version is 1.2.15. > > I am unsure how to set "login_max_processes_count" and "login_max_connections" for reach the best situation when login_process_per_connection is set to no. They need to be high enough to handle all the concurrent login / SSL connections. > I don't know what value to set login_max_processes_count. This doesn't matter so much as login_processes_count. In normal operation the login_processes_count should be around 1-2x of the number of CPU cores. There's no reason to create more processes, so the login_max_process_count might as well be the same as login_processes_count. The login_max_connections then just needs to be high enough. From tss at iki.fi Tue Dec 20 07:36:53 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:36:53 +0200 Subject: [Dovecot] Strange Login / Timeout Sessions In-Reply-To: References: Message-ID: <21AE7D9C-D533-4C7E-B7BC-E8109D8F6C2D@iki.fi> On 16.12.2011, at 18.15, Carlos Mennens wrote: > I have my webmail application tied to Postfix / Dovecot server & now > for some reason the IMAP sessions oddly time out throughout the day > and then logging back into the mail system over the web is painfully > slow. The only thing I've seen that fixes it is to reload the Dovecot > daemon in Linux: .. > I'm running Dovecot-1.0.7-7.el5_7.1. That's rather old. Might get solved simply by upgrading. You could try if using high-performance mode of login processes helps: http://wiki.dovecot.org/LoginProcess Another reason might be your PAM setup. From tss at iki.fi Tue Dec 20 07:41:32 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:41:32 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EEA6DF0.3080909@noa.gr> References: <4EEA6DF0.3080909@noa.gr> Message-ID: On 16.12.2011, at 0.00, Nikolaos Milas wrote: > I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7. > > All accounts are virtual, hosted on LDAP Server. > > My problem is that the command: > > doveadm quota get -A > > stopped listing all accounts. I think this problem started after I changed in LDAP lookup configuration from "scope = subtree" to "scope = onelevel", because it did not occur before (I did no other changes). Can you try if changing it back helps? Or by running the same LDAP query using ldapsearch. Is there a reason why you changed the scope? (I'm not entirely sure what the LDAP schemes usually look like..) Also to make sure the problem is listing instead of something quota related, list the users: doveadm user '*' From tss at iki.fi Tue Dec 20 07:45:34 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:45:34 +0200 Subject: [Dovecot] dsync panic In-Reply-To: <3a8f9df5e523c0391c41964ae3d09d1b@imapproxy.hrz> References: <3a8f9df5e523c0391c41964ae3d09d1b@imapproxy.hrz> Message-ID: <677F82FE-850B-43EC-86C1-6B99ED74642A@iki.fi> On 16.12.2011, at 0.00, J?rgen Obermann wrote: > Hello, > when I try to convert from mbox to mdbox with dsync with one user it always panics: > > # /opt/local/bin/dsync -v -u userxy backup ssh root at minerva1 /opt/local/bin/dsync -v -u userxy > dsync-remote(userxy): Panic: Trying to allocate 2147483648 bytes Well, this is clearly the problem.. But it's difficult to guess where it's allocating that. I'd need a gdb backtrace. Does it write a core file to userxy's home dir? If not, try replacing dsync with a script that runs "ulimit -c unlimited" first and then execs dsync. http://dovecot.org/bugreport.html tells what to do with core once you have it. Alternative idea: Does it crash also when dsyncing locally? gdb --args dsync -u userxy backup mdbox:/tmp/foobar run bt full From dovecot at r.paypc.com Tue Dec 20 08:45:50 2011 From: dovecot at r.paypc.com (Robin) Date: Mon, 19 Dec 2011 22:45:50 -0800 Subject: [Dovecot] Calculation of suggested vsz_limit values In-Reply-To: <352FB226-243B-4916-AB21-97D6990AC0BD@iki.fi> References: <4EEB0AD3.20001@noa.gr> <352FB226-243B-4916-AB21-97D6990AC0BD@iki.fi> Message-ID: <4EF02F1E.6020701@r.paypc.com> Timo wrote: > Not really. For mail related processes (imap, pop3, lmtp) you could > find the largest dovecot.index.cache file and make sure that > vsz_limit is at least 3 times that. Yikes. Aside from forcing users to "prune" mailboxes, what do you suggest when vsz_limit exceeds available host RAM? I ran across another "RAM only" process in fts_squat for a large, but not *HUGE* mailbox when the size of the dovecot.index.search.uids file got larger than 600MB. There's no mitigation for these problems other than "buying more RAM" or getting users to delete/file their emails? I was quite shocked to hit these limits so early - there was no mention of RAM resource requirements in the Dovecot documentation I'd perused. :( =R= From tss at iki.fi Tue Dec 20 08:53:37 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 08:53:37 +0200 Subject: [Dovecot] Calculation of suggested vsz_limit values In-Reply-To: <4EF02F1E.6020701@r.paypc.com> References: <4EEB0AD3.20001@noa.gr> <352FB226-243B-4916-AB21-97D6990AC0BD@iki.fi> <4EF02F1E.6020701@r.paypc.com> Message-ID: <1324364017.3597.14.camel@innu> On Mon, 2011-12-19 at 22:45 -0800, Robin wrote: > Timo wrote: > > > Not really. For mail related processes (imap, pop3, lmtp) you could > > find the largest dovecot.index.cache file and make sure that > > vsz_limit is at least 3 times that. > > Yikes. Aside from forcing users to "prune" mailboxes, what do you > suggest when vsz_limit exceeds available host RAM? vsz_limit isn't about actually using that much memory, but about how much address space can be allocated. Just because Dovecot mmap()s a 1 GB dovecot.index.cache file doesn't mean that it physically uses more than a few kilobytes of memory. > I ran across another "RAM only" process in fts_squat for a large, but > not *HUGE* mailbox when the size of the dovecot.index.search.uids file > got larger than 600MB. I suggest switching to fts-lucene in Dovecot v2.1. From alessio at skye.it Tue Dec 20 09:24:16 2011 From: alessio at skye.it (Alessio Cecchi) Date: Tue, 20 Dec 2011 08:24:16 +0100 Subject: [Dovecot] Tuning Login processes for High-performance Mode In-Reply-To: <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> References: <4EEB3443.4030104@skye.it> <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> Message-ID: <4EF03820.4000406@skye.it> Il 20/12/2011 06:32, Timo Sirainen ha scritto: > On 16.12.2011, at 14.06, Alessio Cecchi wrote: > >> I'm working for tuning a busy cluster of dovecot servers. Heach server as 4 core, 8GB of RAM and provide POP3 and IMAP access to mailbox. OS is Debian 6.0 and dovecot version is 1.2.15. >> >> I am unsure how to set "login_max_processes_count" and "login_max_connections" for reach the best situation when login_process_per_connection is set to no. > > They need to be high enough to handle all the concurrent login / SSL connections. > >> I don't know what value to set login_max_processes_count. > > This doesn't matter so much as login_processes_count. In normal operation the login_processes_count should be around 1-2x of the number of CPU cores. There's no reason to create more processes, so the login_max_process_count might as well be the same as login_processes_count. The login_max_connections then just needs to be high enough. > Thanks Timo, I had read on wiki the ratio from core and login_processes_count, but I did not understand the ratio from login_processes_count and login_max_processes_count. So, if I have 4 core and want to serve up to 1024 users, an example of configuration can be: login_processes_count = 4 login_max_processes_count = 8 login_max_connections = 128 Right? -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it @ LOLUG -> Socio http://www.lolug.net From tss at iki.fi Tue Dec 20 09:39:49 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 09:39:49 +0200 Subject: [Dovecot] Tuning Login processes for High-performance Mode In-Reply-To: <4EF03820.4000406@skye.it> References: <4EEB3443.4030104@skye.it> <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> <4EF03820.4000406@skye.it> Message-ID: <1324366789.3597.21.camel@innu> On Tue, 2011-12-20 at 08:24 +0100, Alessio Cecchi wrote: > I had read on wiki the ratio from core and login_processes_count, but I > did not understand the ratio from login_processes_count and > login_max_processes_count. Just set login_max_processes_count to same as login_processes_count and you don't have to wonder about it. I don't know if any other values make much sense anyway. From alessio at skye.it Tue Dec 20 09:41:46 2011 From: alessio at skye.it (Alessio Cecchi) Date: Tue, 20 Dec 2011 08:41:46 +0100 Subject: [Dovecot] Tuning Login processes for High-performance Mode In-Reply-To: <1324366789.3597.21.camel@innu> References: <4EEB3443.4030104@skye.it> <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> <4EF03820.4000406@skye.it> <1324366789.3597.21.camel@innu> Message-ID: <4EF03C3A.5030304@skye.it> Il 20/12/2011 08:39, Timo Sirainen ha scritto: > On Tue, 2011-12-20 at 08:24 +0100, Alessio Cecchi wrote: > >> I had read on wiki the ratio from core and login_processes_count, but I >> did not understand the ratio from login_processes_count and >> login_max_processes_count. > > Just set login_max_processes_count to same as login_processes_count and > you don't have to wonder about it. I don't know if any other values make > much sense anyway. > > Ok, thanks for this suggestion. Bye -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it @ LOLUG -> Socio http://www.lolug.net From nmilas at noa.gr Tue Dec 20 10:10:46 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 10:10:46 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: References: <4EEA6DF0.3080909@noa.gr> Message-ID: <4EF04306.4090804@noa.gr> On 20/12/2011 7:41 ??, Timo Sirainen wrote: > Can you try if changing it back helps? Or by running the same LDAP query using ldapsearch. Is there a reason why you changed the scope? (I'm not entirely sure what the LDAP schemes usually look like..) Hi Timo, The same query, using ldapsearch (with the same binddn, same scope, same filter) returns 247 entries. The command is (all searches are against localhost - it's a local replication slave [openldap syncrepl consumer]): /usr/local/openldap/bin/ldapsearch -x -W -vv -D "uid=authenticate,ou=System,dc=noa,dc=gr" -s one -b "ou=people,dc=example,dc=com" uid doveadm user '*' and doveadm quota get -A both return the same 30 entries. I noticed that most of them are the LDAP user entries most recently updated in the LDAP Server (although it doesn't make any sense to me why it so happens). I changed the scope in the search because my "ou=people,dc=example,dc=com" branch has some new sub-branches which contain user accounts not related with mailboxes and I didn't want them to be returned by the Dovecot search (they were useless). I only now tried changing the scope back to subtree and again to onelevel and found that nothing changes (again 30 entries are returned). For reference: /etc/dovecot/dovecot-userdb-ldap.conf (identical to dovecot-passdb-ldap.conf): hosts = localhost tls = no base = ou=people, dc=example, dc=com scope = onelevel ldap_version = 3 dn = uid=authenticate,ou=System,dc=example,dc=com dnpass = secret auth_bind = yes user_filter = (uid=%u) pass_filter = (uid=%u) pass_attrs = uid=user,userPassword=password auth_bind_userdn = uid=%u,ou=people,dc=example,dc=com user_attrs = roomNumber=quota_rule=*:bytes=%$,uid=home=/home/vmail/%u I have not managed yet to upgrade to 2.0.16 to see what happens... Thank you for your assistance, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From nmilas at noa.gr Tue Dec 20 10:14:11 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 10:14:11 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: References: <4EEA6DF0.3080909@noa.gr> Message-ID: <4EF043D3.7000006@noa.gr> I resend, because I forgot to change the true domain once and the previous message would appear to include inconsistencies... Sorry for this... On 20/12/2011 7:41 ??, Timo Sirainen wrote: > Can you try if changing it back helps? Or by running the same LDAP query using ldapsearch. Is there a reason why you changed the scope? (I'm not entirely sure what the LDAP schemes usually look like..) Hi Timo, The same query, using ldapsearch (with the same binddn, same scope, same filter) returns 247 entries. The command is (all searches are against localhost - it's a local replication slave [openldap syncrepl consumer]): /usr/local/openldap/bin/ldapsearch -x -W -vv -D "uid=authenticate,ou=System,dc=example,dc=com" -s one -b "ou=people,dc=example,dc=com" uid doveadm user '*' and doveadm quota get -A both return the same 30 entries. I noticed that most of them are the LDAP user entries most recently updated in the LDAP Server (although it doesn't make any sense to me why it so happens). I changed the scope in the search because my "ou=people,dc=example,dc=com" branch has some new sub-branches which contain user accounts not related with mailboxes and I didn't want them to be returned by the Dovecot search (they were useless). I only now tried changing the scope back to subtree and again to onelevel and found that nothing changes (again 30 entries are returned). For reference: /etc/dovecot/dovecot-userdb-ldap.conf (identical to dovecot-passdb-ldap.conf): hosts = localhost tls = no base = ou=people, dc=example, dc=com scope = onelevel ldap_version = 3 dn = uid=authenticate,ou=System,dc=example,dc=com dnpass = secret auth_bind = yes user_filter = (uid=%u) pass_filter = (uid=%u) pass_attrs = uid=user,userPassword=password auth_bind_userdn = uid=%u,ou=people,dc=example,dc=com user_attrs = roomNumber=quota_rule=*:bytes=%$,uid=home=/home/vmail/%u I have not managed yet to upgrade to 2.0.16 to see what happens... Thank you for your assistance, Nick From tss at iki.fi Tue Dec 20 10:15:21 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 10:15:21 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EF04306.4090804@noa.gr> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> Message-ID: <1324368921.3597.23.camel@innu> On Tue, 2011-12-20 at 10:10 +0200, Nikolaos Milas wrote: > On 20/12/2011 7:41 ??, Timo Sirainen wrote: > > > Can you try if changing it back helps? Or by running the same LDAP query using ldapsearch. Is there a reason why you changed the scope? (I'm not entirely sure what the LDAP schemes usually look like..) > > The same query, using ldapsearch (with the same binddn, same scope, same > filter) returns 247 entries. The command is (all searches are against > localhost - it's a local replication slave [openldap syncrepl consumer]): > > /usr/local/openldap/bin/ldapsearch -x -W -vv -D > "uid=authenticate,ou=System,dc=noa,dc=gr" -s one -b > "ou=people,dc=example,dc=com" uid > > doveadm user '*' and doveadm quota get -A both return the same 30 > entries. I noticed that most of them are the LDAP user entries most > recently updated in the LDAP Server (although it doesn't make any sense > to me why it so happens). Try adding (objectClass=posixAccount) as filter in the ldapsearch. That's the default iterate_filter. From nmilas at noa.gr Tue Dec 20 10:47:21 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 10:47:21 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324368921.3597.23.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> Message-ID: <4EF04B99.1030201@noa.gr> On 20/12/2011 10:15 ??, Timo Sirainen wrote: > Try adding (objectClass=posixAccount) as filter in the ldapsearch. > That's the default iterate_filter. We've caught it! Only the returned (30) accounts include the posixAccount objectClass! So I added in the LDAP setup: iterate_filter = (objectClass=*) and now everything works fine! Perhaps page: http://wiki2.dovecot.org/Tools/Doveadm/Altmove should explicitly state which is the default iterate_filter value, because in most LDAP applications (objectClass=*) is the default filter. Thanks very much Timo. All the best, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Tue Dec 20 10:57:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 10:57:19 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EF04B99.1030201@noa.gr> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> Message-ID: <1324371439.3597.25.camel@innu> On Tue, 2011-12-20 at 10:47 +0200, Nikolaos Milas wrote: > On 20/12/2011 10:15 ??, Timo Sirainen wrote: > > > Try adding (objectClass=posixAccount) as filter in the ldapsearch. > > That's the default iterate_filter. > > We've caught it! Only the returned (30) accounts include the > posixAccount objectClass! > > So I added in the LDAP setup: > > iterate_filter = (objectClass=*) > > and now everything works fine! Isn't that basically the same as an empty filter? What other types of objectClasses are there with user accounts? Perhaps the default should be changed to empty, or maybe to (uid=*) From cor at xs4all.nl Tue Dec 20 11:11:10 2011 From: cor at xs4all.nl (Cor Bosman) Date: Tue, 20 Dec 2011 10:11:10 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: Message-ID: <20111220091110.GA19728@xs4all.nl> I installed a newer kernel on these boxes, and it's fixed. Seems to be a problem with the stock debian squeeze kernel. Not a dovecot issue, but others with a stable squeeze box might see similar problems so good to have it in the archive :) regards, Cor From ronleach at tesco.net Tue Dec 20 11:49:06 2011 From: ronleach at tesco.net (Ron Leach) Date: Tue, 20 Dec 2011 09:49:06 +0000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <20111220091110.GA19728@xs4all.nl> References: <20111220091110.GA19728@xs4all.nl> Message-ID: <4EF05A12.7010502@tesco.net> On 20/12/2011 09:11, Cor Bosman wrote: > I installed a newer kernel on these boxes, and it's fixed. Seems to be > a problem with the stock debian squeeze kernel. Not a dovecot issue, but > others with a stable squeeze box might see similar problems so good > to have it in the archive :) Indeed; very many of us use Debian stable. Which kernel did you install that is 2.0.16-friendly, and was this from Debian stable's updates system? regards, Ron From nmilas at noa.gr Tue Dec 20 12:06:11 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 12:06:11 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324371439.3597.25.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> Message-ID: <4EF05E13.3000704@noa.gr> On 20/12/2011 10:57 ??, Timo Sirainen wrote: > On Tue, 2011-12-20 at 10:47 +0200, Nikolaos Milas wrote: >> So I added in the LDAP setup: >> >> iterate_filter = (objectClass=*) >> >> and now everything works fine! > Isn't that basically the same as an empty filter? What other types of > objectClasses are there with user accounts? Perhaps the default should > be changed to empty, or maybe to (uid=*) > I agree that the default should be changed to empty. There are various ObjectClasses available. For example, for normal user accounts (physical persons) the main objectClass we use is inetOrgPerson (with its parents: organizationalPerson, person) and for other, non-personal accounts we use objectClass: account. posixAccount objectClass is added to particular accounts when we want to assign further access privileges, mainly shell and FTP. Best regards, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Tue Dec 20 12:13:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:13:19 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EF05E13.3000704@noa.gr> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> <4EF05E13.3000704@noa.gr> Message-ID: <1324375999.3597.35.camel@innu> On Tue, 2011-12-20 at 12:06 +0200, Nikolaos Milas wrote: > > Isn't that basically the same as an empty filter? What other types of > > objectClasses are there with user accounts? Perhaps the default should > > be changed to empty, or maybe to (uid=*) > > > > I agree that the default should be changed to empty. But that also returns non-user results, like at least in my test setup it returns an organization and admin. > There are various ObjectClasses available. > > For example, for normal user accounts (physical persons) the main > objectClass we use is inetOrgPerson (with its parents: > organizationalPerson, person) and for other, non-personal accounts we > use objectClass: account. So you can have Dovecot accounts that aren't "person"s? Perhaps: iterate_filter = (uid=*) From tss at iki.fi Tue Dec 20 12:15:23 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:15:23 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324375999.3597.35.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> <4EF05E13.3000704@noa.gr> <1324375999.3597.35.camel@innu> Message-ID: <1324376123.3597.37.camel@innu> On Tue, 2011-12-20 at 12:13 +0200, Timo Sirainen wrote: > > I agree that the default should be changed to empty. > > But that also returns non-user results, like at least in my test setup > it returns an organization and admin. .. > Perhaps: iterate_filter = (uid=*) Actually, the current default iterate_filter is fine, if you look at the default pass/user filters: #user_filter = (&(objectClass=posixAccount)(uid=%u)) #pass_filter = (&(objectClass=posixAccount)(uid=%u)) From nmilas at noa.gr Tue Dec 20 12:16:12 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 12:16:12 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324371439.3597.25.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> Message-ID: <4EF0606C.7050908@noa.gr> On 20/12/2011 10:57 ??, Timo Sirainen wrote: > On Tue, 2011-12-20 at 10:47 +0200, Nikolaos Milas wrote: >> So I added in the LDAP setup: >> >> iterate_filter = (objectClass=*) >> >> and now everything works fine! > Isn't that basically the same as an empty filter? And I forgot to answer: Yes, (objectClass=*) is the same as an empty filter. An empty filter defaults to: (objectClass=*) Nick From tss at iki.fi Tue Dec 20 12:18:45 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:18:45 +0200 Subject: [Dovecot] doveadm index In-Reply-To: References: Message-ID: <1324376325.3597.39.camel@innu> On Wed, 2011-12-14 at 19:27 -0800, Daniel L. Miller wrote: > Does "doveadm index -A INBOX" reindex everything? What about users with > multiple folders, both subbed & not subbed under INBOX? It indexes INBOX (only) for all users. And it doesn't "reindex" anything, it just adds any missing stuff. From tss at iki.fi Tue Dec 20 12:24:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:24:06 +0200 Subject: [Dovecot] Quota PostgreSQL INSERT trigger In-Reply-To: References: Message-ID: <1324376646.3597.42.camel@innu> On Thu, 2011-12-15 at 09:37 +0100, Adis Nezirovic wrote: > Wiki instructions for creating insert trigger for PostgreSQL are wrong > http://wiki.dovecot.org/Quota/Dict > > Calling INSERT on the table from within BEFORE INSERT trigger creates > cascading trigger. Yes.. > Instead, one should return NEW record from the trigger, and it will be > inserted after trigger execution. But does this handle race conditions when a record is inserted/deleted while the trigger is being run? That's the reason this trigger is so complex. > BEGIN > IF NEW.messages = 0 THEN > RETURN NEW; > ELSE > NEW.messages = - NEW.messages; > RETURN NEW; > END IF; > EXCEPTION WHEN unique_violation THEN > -- someone just inserted the record, update it > END; I'd guess the unique_violation is never caught here, and instead the whole INSERT fails? From nmilas at noa.gr Tue Dec 20 12:30:57 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 12:30:57 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324376123.3597.37.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> <4EF05E13.3000704@noa.gr> <1324375999.3597.35.camel@innu> <1324376123.3597.37.camel@innu> Message-ID: <4EF063E1.6050404@noa.gr> On 20/12/2011 12:15 ??, Timo Sirainen wrote: > > Perhaps: iterate_filter = (uid=*) > > Actually, the current default iterate_filter is fine, if you look at the > default pass/user filters: > > #user_filter = (&(objectClass=posixAccount)(uid=%u)) > #pass_filter = (&(objectClass=posixAccount)(uid=%u)) This means that default values for all these settings are compatible. I would say that it would be enough to explicitly state the default value for iterate_filter in the documentation. I guess the filter uid=* might probably also return all entries, because in many cases uid is part of the DN, so it is included in all entries. But this is not always the case. Nick From tss at iki.fi Tue Dec 20 12:35:24 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:35:24 +0200 Subject: [Dovecot] Building 2.1.rc1 with cluence, but without libstemmer In-Reply-To: References: Message-ID: <1324377324.3597.47.camel@innu> On Thu, 2011-12-15 at 12:05 +1100, Jan Mikkelsen wrote: > I'm testing out 2.1.rc1, building against clucene 2.3.3.4. > > Without libstemmber, the build fails because it attempts to include SnowballAnalyzer.h which is not part of "core" clucene. It was actually supposed to be distributed with Dovecot, but it got left out from the tarball. > What versions of libstemmer, http://snowball.tartarus.org/ this one. > clucene 2.3.3.4 > and libtextcat is dovecot 2.1.rc1 intended to be used against? http://www.let.rug.nl/vannoord/TextCat/ probably.. Basically I've just used the libstemmer and libtextcat that are in Debian. > Is it worth bringing the wrapper class around libstemmer into dovecot > to avoid funny dependencies against clucene and so that the -lstemmer > test in configure is enough? I'm hoping for a new CLucene release where I don't need libstemmer anymore. From tss at iki.fi Tue Dec 20 12:49:18 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:49:18 +0200 Subject: [Dovecot] Question about index reset in dovecot 2.0.15 In-Reply-To: <20111214211036.55980@gmx.com> References: <20111214211036.55980@gmx.com> Message-ID: <1324378158.6987.7.camel@innu> On Wed, 2011-12-14 at 22:10 +0100, Maria Arrea wrote: > I have seen some strange error log messages in our dovecot server (2.0.15, RHEL 5.7x64, mdbox+zlib, local storage, high load) > > Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent These messages shouldn't appear alone. Is there anything else logged about them? > Dec 14 20:56:46 buzon dovecot: imap(rcam): Error: Corrupted index cache file /indices_dovecot/indices/03/6b/rcam/mailboxes/INBOX/dovecot.index.cache: Broken virtual size for mail UID 132197 Possibly related to zlib.. Again it should have logged another error message just before this. > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox INBOX Possibly related to other errors. So .. none of the errors above really were what I'd call the actual cause of the problems. They were just after effects. > I have been googling without luck, why does this happen? I have tried with doveadm force-resync, maybe this could solve this issues. All of those should be fixed automatically. Do they keep happening if you don't do force-resync? How often do they happen anyway? Do they happen at any specific times (e.g. during doveadm purge)? From tss at iki.fi Tue Dec 20 12:54:50 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:54:50 +0200 Subject: [Dovecot] Dovecot 2.1rc1 + 2.0.16 woes regarding fts_squat In-Reply-To: <4EE7E4BB.2040008@r.paypc.com> References: <4EE7E4BB.2040008@r.paypc.com> Message-ID: <1324378490.6987.9.camel@innu> On Tue, 2011-12-13 at 15:50 -0800, Robin wrote: > I can confirm the report posted in > http://dovecot.org/list/dovecot/2011-November/062263.html that > fts_squat no longer seems to be used after moving from 2.0.16->2.1 rc > 1. I don't see crash reports in the logs, just "0 messages indexed". > My search test tool just does a normal IMAP SEARCH for a long > non-existent string. If there's another way to trigger re-indexing in > 2.1, I don't see anything in the documentation for it. Maybe it was buggy in v2.1.rc1 .. at least in my tests now it works with latest v2.1 hg. I should release rc2 soon I guess. > During a large mail import with 2.0.16 today, I ran across a worrying > message in the logs during an fts_squat reindex: out of memory. I'm not planning on doing any changes to fts-squat anymore. With v2.1 you can use fts-lucene instead. From tss at iki.fi Tue Dec 20 12:59:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:59:06 +0200 Subject: [Dovecot] dovecot penalties and anvil In-Reply-To: <4EE73988.1090000@solutti.com.br> References: <4EE73988.1090000@solutti.com.br> Message-ID: <1324378746.6987.13.camel@innu> On Tue, 2011-12-13 at 09:39 -0200, Leonardo Rodrigues wrote: > I'm strugling to find some documentation on dovecot's anvil service > and/or its penalties (that can be checked with doveadm penalty) ... but > i'm not finding anything on that. > > is there any documentation on anvil/penalties that i should check > other than a few messages on the mailing list archive ? Nope. Basically: * Each failed attempt doubles the penalty for next login attempt from that specific IP * Penalty is maxed out at 30 seconds * Each successful login (after waiting for penalty) will clear the penalty for that IP * You can disable the penalty entirely with: service anvil { unix_listener anvil-auth-penalty { mode = 0 } } I don't really like this penalty stuff. Maybe it's better than nothing, maybe not. Maybe there's a better way to do it. Not very useful for IPv6. From marco at carcano.ch Tue Dec 20 13:46:16 2011 From: marco at carcano.ch (Marco Carcano) Date: Tue, 20 Dec 2011 12:46:16 +0100 Subject: [Dovecot] Mail lost - maybe a bug??? In-Reply-To: <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> Message-ID: <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> Hello Timo and Urban I took quite a long time to reply, but as I told you this issue does not verify very often, so I had enabled verbose logging and just waited .. I summarize the situation - user mmanzoni sometimes does not receive a message - it does not matter if he is the only recipient or if there are others its outlook 2010 is configured for POP3 mail and to leave all messages on the server, and setup to never delete them (neither after a few days, neither when he deletes from his trash folder). There are not any other client that log to that mail account: this is the only one client that download messages the following extract of the LDA log shows what happened: the message was sent to 4 users (I report just 2 of them: criva, that received it, and mmanzoni, who didn't) ################CRIVA##################### Dec 12 10:51:24 srv001 dovecot: lda: Debug: Loading modules from directory: /usr/lib64/dovecot Dec 12 10:51:24 srv001 dovecot: lda: Debug: Module loaded: /usr/lib64/ dovecot/lib10_quota_plugin.so Dec 12 10:51:24 srv001 dovecot: lda: Debug: Module loaded: /usr/lib64/ dovecot/lib90_sieve_plugin.so Dec 12 10:51:24 srv001 dovecot: lda: Debug: auth input: criva home=/ home/criva 499=criva quota_rule=*:storage=8192M Dec 12 10:51:24 srv001 dovecot: lda: Debug: Added userdb setting: plugin/499=criva Dec 12 10:51:24 srv001 dovecot: lda: Debug: Added userdb setting: plugin/quota_rule=*:storage=8192M Dec 12 10:51:24 srv001 dovecot: lda(criva): Debug: Effective uid=499, gid=499, home=/home/criva Dec 12 10:51:24 srv001 dovecot: lda(criva): Debug: Quota root: name=User quota backend=maildir args= Dec 12 10:51:24 srv001 dovecot: lda(criva): Debug: Quota rule: root=User quota mailbox=* bytes=8589934592 messages=0 Dec 12 10:51:24 srv001 dovecot: lda(criva): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1048576000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=6871947673 (80%) messages=0 reverse=no command=quota-warning 80 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=7730941132 (90%) messages=0 reverse=no command=quota-warning 90 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=8160437862 (95%) messages=0 reverse=no command=quota-warning 95 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota root: name=Shared quota backend=maildir args=ns=Public/ Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota rule: root=Shared quota mailbox=* bytes=20971520000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mailboxstore/criva/Maildir Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: maildir++: root=/ home/mailboxstore/criva/Maildir, index=, control=, inbox=/home/ mailboxstore/criva/Maildir Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Namespace : type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:/home/mailboxstore/ %Lu/Maildir:INDEX=/home/mailboxstore/criva/Maildir/shared/%Lu Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: shared: root=/var/ run/dovecot, index=, control=, inbox= Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Namespace : type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:/home/mailboxstore/public Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: maildir++: root=/ home/mailboxstore/public, index=, control=, inbox= Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota root: name=User quota backend=maildir args= Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota rule: root=User quota mailbox=* bytes=14680064000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1048576000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=11744051200 (80%) messages=0 reverse=no command=quota-warning 80 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=13212057600 (90%) messages=0 reverse=no command=quota-warning 90 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=13946060800 (95%) messages=0 reverse=no command=quota-warning 95 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota root: name=Shared quota backend=maildir args=ns=Public/ Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota rule: root=Shared quota mailbox=* bytes=20971520000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: none: root=, index=, control=, inbox= Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: sieve: user's script path /home/mailboxstore/criva/.dovecot.sieve doesn't exist (using global script path in stead) Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: sieve: user has no valid personal script Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: sieve: no scripts to execute: reverting to default delivery. Dec 12 10:51:27 srv001 dovecot: lda(criva): msgid=<1888520041-1323683477-cardhu_decombobulator_blackberry.rim.net-2066152169- at b12.c13.bise7.blackberry >: saved mail to INBOX #################MMANZONI############### Dec 12 10:51:28 srv001 dovecot: lda: Debug: Loading modules from directory: /usr/lib64/dovecot Dec 12 10:51:28 srv001 dovecot: lda: Debug: Module loaded: /usr/lib64/ dovecot/lib10_quota_plugin.so Dec 12 10:51:28 srv001 dovecot: lda: Debug: Module loaded: /usr/lib64/ dovecot/lib90_sieve_plugin.so Dec 12 10:51:28 srv001 dovecot: lda: Debug: auth input: mmanzoni home=/ home/mmanzoni 499=mmanzoni quota_rule=*:storage=8192M Dec 12 10:51:28 srv001 dovecot: lda: Debug: Added userdb setting: plugin/499=mmanzoni Dec 12 10:51:28 srv001 dovecot: lda: Debug: Added userdb setting: plugin/quota_rule=*:storage=8192M Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Effective uid=499, gid=499, home=/home/mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota root: name=User quota backend=maildir args= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=User quota mailbox=* bytes=8589934592 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1048576000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=6871947673 (80%) messages=0 reverse=no command=quota-warning 80 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=7730941132 (90%) messages=0 reverse=no command=quota-warning 90 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=8160437862 (95%) messages=0 reverse=no command=quota-warning 95 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota root: name=Shared quota backend=maildir args=ns=Public/ Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=Shared quota mailbox=* bytes=20971520000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mailboxstore/mmanzoni/Maildir Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: maildir++: root=/ home/mailboxstore/mmanzoni/Maildir, index=, control=, inbox=/home/ mailboxstore/mmanzoni/Maildir Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Namespace : type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:/home/mailboxstore/ %Lu/Maildir:INDEX=/home/mailboxstore/mmanzoni/Maildir/shared/%Lu Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: shared: root=/ var/run/dovecot, index=, control=, inbox= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Namespace : type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:/home/mailboxstore/public Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: maildir++: root=/ home/mailboxstore/public, index=, control=, inbox= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota root: name=User quota backend=maildir args= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=User quota mailbox=* bytes=14680064000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1048576000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=11744051200 (80%) messages=0 reverse=no command=quota-warning 80 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=13212057600 (90%) messages=0 reverse=no command=quota-warning 90 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=13946060800 (95%) messages=0 reverse=no command=quota-warning 95 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota root: name=Shared quota backend=maildir args=ns=Public/ Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=Shared quota mailbox=* bytes=20971520000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: none: root=, index=, control=, inbox= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: sieve: user's script path /home/mailboxstore/mmanzoni/.dovecot.sieve doesn't exist (using global script path in stead) Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: sieve: user has no valid personal script Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: sieve: no scripts to execute: reverting to default delivery. Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): msgid=<1888520041-1323683477-cardhu_decombobulator_blackberry.rim.net-2066152169- at b12.c13.bise7.blackberry >: saved mail to INBOX ######################################### I know it seems absurd, but mmanzoni has not received the message - I tried also "grepping" for the object in the maildir, but haven't been able to get it what do you think about this? I really do not know where this issue can be - the only componet I suppose could have some kind of problem is in the LDA phase, but I'm just supposing do you want to give a look to my config files? If so, which one could be interesting to post? kind regards Marco Carcano Il giorno 17/nov/11, alle ore 18:34, Timo Sirainen ha scritto: > On 17.11.2011, at 18.47, Marco Carcano wrote: > >>>> Oct 27 11:20:34 srv001 dovecot: lda(user3): msgid=>>>> : saved mail to INBOX >>> >>> If Dovecot logs this, then the message definitely was saved to >>> INBOX. >> >> it is exactly what I told to my colleagues, but belive me, sometime >> some mail get lost - > > Most likely reason for this is that the user's client deletes the > message. Possibly an automatic client side filter or some UI issue > that causes user to accidentally delete a mail. The mail_log > plugin's logging would have showed if this was the case. > >> I suspect however that could be mine misconfiguration somewhere, so >> that lda sometimes write the email not in the right place, but >> elsewhere, and just write the phrase " saved mail to INBOX in the >> logs (however I'm wondering why sometimes?!?) > > I can't think of any reason why it would randomly write to a wrong > place. > >> I tried to find the missed email in the Maildir, but have not been >> able to get it - the commands used are >> >> cd /home/mailboxstore/theuser/Maildir >> >> grep "6000029222" */* |grep "RE:" >> grep "6000029222" .Drafts/* |grep "RE:" >> grep "6000029222" .Drafts/*/* |grep "RE:" >> grep "6000029222" .Junk/* |grep "RE:" >> grep "6000029222" .Posta\ eliminata/* |grep "RE:" >> grep "6000029222" .Posta\ indesiderata/* |grep "RE:" >> grep "6000029222" .Posta\ inviata/* |grep "RE:" >> grep "6000029222" .Sent/* |grep "RE:" >> grep "6000029222" .Templates/* |grep "RE:" >> grep "6000029222" .Trash/* |grep "RE:" > > Only the grep "6000029222" .Drafts/*/* |grep "RE:" was grepping from > mail files. Easier would be just: > > grep -r "RE:.*6000029222" . > >> I really think is some kind of misconfiguration of mine, may you >> help me, please? Just tell me what pieces of config to show (just >> not to flood the whole config) > > I doubt this is related to configuration. > > But you could enable http://wiki2.dovecot.org/Plugins/Lazyexpunge so > that messages won't be lost if they are expunged. The next time a > message is lost, you would most likely find it from the lazy-expunge > namespace. (Then you could write a script that deletes e.g. >1 week > old files nightly.) From drum.lucas at gmail.com Tue Dec 20 14:26:00 2011 From: drum.lucas at gmail.com (drum.lucas at gmail.com) Date: Tue, 20 Dec 2011 10:26:00 -0200 Subject: [Dovecot] v2.x services documentation In-Reply-To: <04D662E7-2A0A-448B-BA21-1E337A400CA6@iki.fi> References: <04D662E7-2A0A-448B-BA21-1E337A400CA6@iki.fi> Message-ID: Well I've got some servers running 1.0 with dovecot, however, I make the installation of Dovecot 2.0 and would like to understand better the way it works. It uses the files in / etc / dovecot / conf.d right? Example: protocol pop3 protocol imap {{or is everything in / etc/dovecot/conf.d/10-master.conf? Or the directory conf.d it is only for examples and everything is still done in dovecot.conf? Thanks Lucas Possamai 2011/12/7 Timo Sirainen > If you've ever wanted to know everything about the service {} blocks, this > should be quite helpful: http://wiki2.dovecot.org/Services > > -- *Lucas Possamai* taekwondo facebook vivaolinux work blog funny From maria_arrea at gmx.com Tue Dec 20 14:48:12 2011 From: maria_arrea at gmx.com (Maria Arrea) Date: Tue, 20 Dec 2011 13:48:12 +0100 Subject: [Dovecot] Question about index reset in dovecot 2.0.15 Message-ID: <20111220124812.55990@gmx.com> Hello Timo, thank you in advance. Full log here (1 hour time range) Dec 14 21:19:43 buzon postfix/pipe[27103]: 4423BC7C31: to=, relay=dovecot, delay=0.24, delays=0.03 /0/0/0.2, dsn=2.0.0, status=sent (delivered via dovecot service) Dec 14 21:20:59 buzon dovecot: imap(fmcarrasco): Disconnected: Logged out bytes=556/2245 Dec 14 21:44:30 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 21:44:30 buzon dovecot: imap(fmcarrasco): Disconnected: IMAP session state is inconsistent, please relogin. bytes=42402/3153543 Dec 14 21:45:30 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=20035, TLS Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Disconnected: IMAP session state is inconsistent, please relogin. bytes=343/8671 Dec 14 22:02:58 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=2685, TLS Dec 14 22:13:46 buzon dovecot: lda(fmcarrasco): sieve: msgid=: stored mail into mailbox 'INBOX' Dec 14 22:13:46 buzon postfix/pipe[21152]: AAD36C8501: to=, relay=dovecot, delay=0.34, delays=0.03/0.01/0/0.31, dsn=2.0.0, status=sent (delivered via dovecot service) The other one: Dec 14 20:53:38 buzon dovecot: pop3(cfp): Connection closed top=0/0, retr=0/0, del=0/3605, size=446902389 Dec 14 21:38:34 buzon postfix/qmgr[4015]: A90CFC7C31: from=, size=23256, nrcpt=1 (queue active) Dec 14 21:43:00 buzon postfix/qmgr[4015]: E7E61C7DED: from=, size=23244, nrcpt=1 (queue active) Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=32118/127014 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox Trash Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Trash/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=38097/309083 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox Preinscripcion Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Preinscripcion/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=33263/164275 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Emagister/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=35437/111594 Dec 14 21:50:38 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=24811, TLS Dec 14 21:50:39 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=24822, TLS Dec 14 21:52:12 buzon postfix/cleanup[21212]: 9A22CC816C: message-id= Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=554/169764 Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Trash/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=533/10963 Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Preinscripcion/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=629/39790 Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=613/496956 Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=464, TLS Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=465, TLS Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=466, TLS Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=467, TLS Dec 14 22:30:28 buzon dovecot: pop3-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=25194 I do not see any pattern about this problem of index reset, logs from other day, maybe the problem is I/O load based: Dec 15 13:16:06 buzon dovecot: imap(ehlers): Connection closed bytes=357/20249 Dec 15 13:16:06 buzon dovecot: imap(ehlers): Connection closed bytes=70/12804 Dec 15 13:16:12 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=1005 Dec 15 13:16:12 buzon dovecot: imap(ehlers): Connection closed bytes=103/818 Dec 15 13:16:19 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=1419 Dec 15 13:16:19 buzon dovecot: imap(ehlers): Error: Mailbox Archivador/Facultad/curso whiteboard: Corrupted index, uidvalidity=0 Dec 15 13:16:19 buzon dovecot: imap(ehlers): Warning: mdbox /buzones/domain/11/53/ehlers/storage: rebuilding indexes Dec 15 13:16:19 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=1426 Dec 15 13:16:19 buzon dovecot: imap(ehlers): Connection closed bytes=459/3205 Dec 15 13:16:32 buzon dovecot: imap(ehlers): Error: /indices_dovecot/indices/11/53/ehlers/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 15 13:16:32 buzon dovecot: imap(ehlers): Disconnected: IMAP session state is inconsistent, please relogin. bytes=195/963 Dec 15 13:16:32 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=2006 Dec 15 13:16:32 buzon dovecot: imap(ehlers): Connection closed bytes=274/80860 Dec 15 13:16:49 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=2735 Any idea? Regards Maria On Wed, 2011-12-14 at 22:10 +0100, Maria Arrea wrote: > I have seen some strange error log messages in our dovecot server (2.0.15, RHEL 5.7x64, mdbox+zlib, local storage, high load) > > Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent These messages shouldn't appear alone. Is there anything else logged about them? > Dec 14 20:56:46 buzon dovecot: imap(rcam): Error: Corrupted index cache file /indices_dovecot/indices/03/6b/rcam/mailboxes/INBOX/dovecot.index.cache: Broken virtual size for mail UID 132197 Possibly related to zlib.. Again it should have logged another error message just before this. > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox INBOX Possibly related to other errors. So .. none of the errors above really were what I'd call the actual cause of the problems. They were just after effects. > I have been googling without luck, why does this happen? I have tried with doveadm force-resync, maybe this could solve this issues. All of those should be fixed automatically. Do they keep happening if you don't do force-resync? How often do they happen anyway? Do they happen at any specific times (e.g. during doveadm purge)? From tss at iki.fi Tue Dec 20 15:37:29 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 15:37:29 +0200 Subject: [Dovecot] Mail lost - maybe a bug??? In-Reply-To: <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> Message-ID: <1324388249.6987.32.camel@innu> On Tue, 2011-12-20 at 12:46 +0100, Marco Carcano wrote: > Hello Timo and Urban > > I took quite a long time to reply, but as I told you this issue does > not verify very often, so I had enabled verbose logging and just > waited .. Enabling mail_log plugin and/or lazy_expunge plugin would have helped more (both mentioned in my previous mail). > I summarize the situation - user mmanzoni sometimes does not receive a > message - it does not matter if he is the only recipient or if there > are others > > its outlook 2010 is configured for POP3 mail and to leave all messages > on the server, and setup to never delete them (neither after a few > days, neither when he deletes from his trash folder). There are not > any other client that log to that mail account: this is the only one > client that download messages > > the following extract of the LDA log shows what happened: the message > was sent to 4 users (I report just 2 of them: criva, that received it, > and mmanzoni, who didn't) There's really nothing in the LDA log that could explain why the message gets lost. It most likely was successfully delivered by LDA, but got deleted afterwards for some reason. You mean that this user's mails are never supposed to be deleted via POP3? Verify that with: grep 'pop3.*mmanzoni.*del=[^0]' /var/log/dovecot.log or wherever those POP3 disconnection messages are logged, i.e. you should find lots of messages with: grep 'pop3.*mmanzoni.*del=0' /var/log/dovecot.log From tss at iki.fi Tue Dec 20 15:40:42 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 15:40:42 +0200 Subject: [Dovecot] v2.x services documentation In-Reply-To: References: <04D662E7-2A0A-448B-BA21-1E337A400CA6@iki.fi> Message-ID: <1324388442.6987.35.camel@innu> On Tue, 2011-12-20 at 10:26 -0200, drum.lucas at gmail.com wrote: > Well I've got some servers running 1.0 with dovecot, however, I make the > installation of Dovecot 2.0 and would like to understand better the way it > works. > > It uses the files in / etc / dovecot / conf.d right? > > Example: protocol pop3 protocol imap {{or > is everything in / etc/dovecot/conf.d/10-master.conf? > > Or the directory conf.d it is only for examples and everything is still > done in dovecot.conf? It still uses dovecot.conf just like before. It's just that the new included example dovecot.conf has an "!include conf.d/*.conf" line, and the example configuration is split in those files. So if you want to do it like the new example config does, you need to modify the conf.d/* files. (But all of this could have been done this way in v1.x already, so it's not really any different in that way.) From janfrode at tanso.net Tue Dec 20 16:38:15 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Tue, 20 Dec 2011 15:38:15 +0100 Subject: [Dovecot] Sieve too rfc compliant ;-) Message-ID: <20111220143815.GA2236@dibs.tanso.net> It seems we have a few email addresses that are not RFC 5322 compliant, and now that we've started using sieve these are failing. The problem is that we have a few addresses with leading, trailing or double dots in the local part: jan..frode at tanso.net .janfrode at tanso.net janfrode. at tanso.net I believe these has been working fine with everything else in dovecot (lda, lmtp, imap, pop), but that sieve is more strict. I think it's fair enough that it's strict with messages generated by sieve scripts, but it would be nice if it could be more tolerant with messages addressed for the sieve script. So, is there any setting for making it more tolerant ? -jf From tss at iki.fi Tue Dec 20 16:45:47 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 16:45:47 +0200 Subject: [Dovecot] Question about index reset in dovecot 2.0.15 In-Reply-To: <20111220124812.55990@gmx.com> References: <20111220124812.55990@gmx.com> Message-ID: <1324392347.6987.46.camel@innu> On Tue, 2011-12-20 at 13:48 +0100, Maria Arrea wrote: > Hello Timo, thank you in advance. Full log here (1 hour time range) It could be useful to have all error/warning messages logged to their own file, so you could quickly see a list of all errors from the last day or two. That's also the log I'd be more interested in seeing. What things do you have accessing mailboxes? * imap * pop3 * dovecot-lda * doveadm purge Nothing else? No dsync for example? > Dec 14 21:44:30 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent I think these should happen only when dbox is being rebuilt by another process at the same time.. But it's a bit strange that it happens again in another session: > Dec 14 21:45:30 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=20035, TLS > Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Kind of looks as if it isn't fixing itself?.. Also it might be helpful to have PID in the log lines: mail_log_prefix = %s(%u %p): > The other one: > > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Again it's strange how this begins. > Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=32118/127014 > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox Trash > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Trash/dovecot.index reset, view is now inconsistent > Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=38097/309083 > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox Preinscripcion > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Preinscripcion/dovecot.index reset, view is now inconsistent > Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=33263/164275 > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Emagister/dovecot.index reset, view is now inconsistent > Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=35437/111594 > Dec 14 21:50:38 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=24811, TLS > Dec 14 21:50:39 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=24822, TLS > Dec 14 21:52:12 buzon postfix/cleanup[21212]: 9A22CC816C: message-id= > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=554/169764 > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Trash/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=533/10963 > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Preinscripcion/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=629/39790 > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/INBOX/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=613/496956 But all of the rest of this is quite clearly caused by the first problem. > I do not see any pattern about this problem of index reset, logs from other day, maybe the problem is I/O load based: > > Dec 15 13:16:19 buzon dovecot: imap(ehlers): Error: Mailbox Archivador/Facultad/curso whiteboard: Corrupted index, uidvalidity=0 This is clearly an originating error. But perhaps this is a newly created mailbox? I just noticed that this can happen if a mailbox creation is slow, and another session opens the mailbox before its creation has been finished. Check with: doveadm dump ".../mdbox/mailboxes/Mailbox Archivador/Facultad/curso whiteboard/dbox-Mails" The interesting lines in the output are: index id ................. = 1324032275 (2011-12-16 12:44:35) uid validity ............. = 1324032275 (2011-12-16 12:44:35) > Dec 15 13:16:19 buzon dovecot: imap(ehlers): Warning: mdbox /buzones/domain/11/53/ehlers/storage: rebuilding indexes This then caused all of the user's other existing processes to fail with: > Dec 15 13:16:32 buzon dovecot: imap(ehlers): Error: /indices_dovecot/indices/11/53/ehlers/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Perhaps the other users' problems began with similar errors? From marco at carcano.ch Tue Dec 20 16:52:21 2011 From: marco at carcano.ch (Marco Carcano) Date: Tue, 20 Dec 2011 15:52:21 +0100 Subject: [Dovecot] Mail lost - maybe a bug??? In-Reply-To: <1324388249.6987.32.camel@innu> References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> <1324388249.6987.32.camel@innu> Message-ID: Hello Timo and thanks again for the ultra quick reply! > Enabling mail_log plugin and/or lazy_expunge plugin would have helped > more (both mentioned in my previous mail). Sorry - I thought I have enabled it, but maybe I did something wrong with the configuration and it was not enabled: here is what I did in order to enable mail_log: syslog_facility = local5 mail_debug = yes plugin { # Events to log. Also available: flag_change append mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename # Group events within a transaction to one line. #mail_log_group_events = no # Available fields: uid, box, msgid, from, subject, size, vsize, flags # size and vsize are available only for expunge and copy events. #mail_log_fields = uid box msgid size } > > There's really nothing in the LDA log that could explain why the > message > gets lost. It most likely was successfully delivered by LDA, but got > deleted afterwards for some reason. > > You mean that this user's mails are never supposed to be deleted via > POP3? Verify that with: yes, you got it - it is never supposed only because we are debugging ;O) > > grep 'pop3.*mmanzoni.*del=[^0]' /var/log/dovecot.log > > or wherever those POP3 disconnection messages are logged, i.e. you > should find lots of messages with: > > grep 'pop3.*mmanzoni.*del=0' /var/log/dovecot.log > > OK, tried the following - I have varoius log files grep 'pop3.*mmanzoni.*del=[^0]' deliver.log* and got nothing grep 'pop3.*criva.*del=[^0]' deliver.log* and got deliver.log.1:Dec 15 12:26:16 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=1/8147, del=1613/1613, size=619997598 deliver.log.1:Dec 15 12:27:39 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=200/50212479, del=200/200, size=50208702 deliver.log.1:Dec 15 12:29:08 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=600/203527129, del=600/600, size=203515938 deliver.log.1:Dec 15 12:30:49 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=1000/310592896, del=1000/1000, size=310574037 deliver.log.1:Dec 15 12:31:10 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=399/44426198, del=399/399, size=44418942 deliver.log.2:Dec 15 00:11:09 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=10530/1684049964, del=10530/10530, size=1683854308 so yes, I'm pretty sure that mmanzoni never deletes messages belive to me - usually I try to solve problems myself without disturbing anyone else, but this time is really hard and I do not know if I could face it alone I hope you can help kind regards Marco Carcano From stephan at rename-it.nl Tue Dec 20 17:46:33 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 20 Dec 2011 16:46:33 +0100 Subject: [Dovecot] Sieve too rfc compliant ;-) In-Reply-To: <20111220143815.GA2236@dibs.tanso.net> References: <20111220143815.GA2236@dibs.tanso.net> Message-ID: <4EF0ADD9.6090704@rename-it.nl> On 12/20/2011 3:38 PM, Jan-Frode Myklebust wrote: > It seems we have a few email addresses that are not RFC 5322 compliant, > and now that we've started using sieve these are failing. The problem is > that we have a few addresses with leading, trailing or double dots in > the local part: > > jan..frode at tanso.net > .janfrode at tanso.net > janfrode. at tanso.net > > I believe these has been working fine with everything else in dovecot > (lda, lmtp, imap, pop), but that sieve is more strict. I think it's fair > enough that it's strict with messages generated by sieve scripts, but it > would be nice if it could be more tolerant with messages addressed for > the sieve script. > > So, is there any setting for making it more tolerant ? Could you indicate exactly in what situations these examples cause trouble? What does Sieve log? Then I'll give it a look. Regards, Stephan. From tss at iki.fi Tue Dec 20 18:48:57 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 18:48:57 +0200 Subject: [Dovecot] Mail lost - maybe a bug??? In-Reply-To: References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> <1324388249.6987.32.camel@innu> Message-ID: On 20.12.2011, at 16.52, Marco Carcano wrote: >> Enabling mail_log plugin and/or lazy_expunge plugin would have helped >> more (both mentioned in my previous mail). > > Sorry - I thought I have enabled it, but maybe I did something wrong with the configuration and it was not enabled: > > here is what I did in order to enable mail_log: > > syslog_facility = local5 > > mail_debug = yes > > plugin { > # Events to log. Also available: flag_change append > mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename > # Group events within a transaction to one line. > #mail_log_group_events = no > # Available fields: uid, box, msgid, from, subject, size, vsize, flags > # size and vsize are available only for expunge and copy events. > #mail_log_fields = uid box msgid size > } You're missing: mail_plugins = mail_log >> grep 'pop3.*mmanzoni.*del=[^0]' /var/log/dovecot.log >> >> or wherever those POP3 disconnection messages are logged, i.e. you >> should find lots of messages with: >> >> grep 'pop3.*mmanzoni.*del=0' /var/log/dovecot.log >> >> > > OK, tried the following - I have varoius log files > > grep 'pop3.*mmanzoni.*del=[^0]' deliver.log* > > and got nothing But with: grep 'pop3.*mmanzoni.*del=0' deliver.log* There are log entries listed since December 12? (So they haven't gotten deleted from the logs already?) Also what kind of tools are ever accessing mails? Is it just Dovecot LDA + IMAP + POP3? No doveadm or any external tools? From profymath at yahoo.com Tue Dec 20 20:16:08 2011 From: profymath at yahoo.com (I M) Date: Tue, 20 Dec 2011 10:16:08 -0800 (PST) Subject: [Dovecot] Why imap_open doesn't work as is expected to? Message-ID: <1324404968.11869.YahooMailClassic@web125602.mail.ne1.yahoo.com> Hi, everybody! Question: Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? Note:?imap.so is loaded!?imap.ini is parsed!? From profymath at yahoo.com Tue Dec 20 21:20:21 2011 From: profymath at yahoo.com (I M) Date: Tue, 20 Dec 2011 11:20:21 -0800 (PST) Subject: [Dovecot] Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? Message-ID: <1324408821.52360.YahooMailClassic@web125603.mail.ne1.yahoo.com> Hi, everybody! Question: Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? Note:?imap.so is loaded!?imap.ini is parsed!php flags is checked! Is it a bug? From leolistas at solutti.com.br Tue Dec 20 21:46:28 2011 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Tue, 20 Dec 2011 17:46:28 -0200 Subject: [Dovecot] Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? In-Reply-To: <1324408821.52360.YahooMailClassic@web125603.mail.ne1.yahoo.com> References: <1324408821.52360.YahooMailClassic@web125603.mail.ne1.yahoo.com> Message-ID: <4EF0E614.5090209@solutti.com.br> if it works through telnet, so dovecot is working and you probably have a PHP problem, which should be probably pointed to a PHP related mailing list. Em 20/12/11 17:20, I M escreveu: > Hi, everybody! > Question: Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? > Note: imap.so is loaded! imap.ini is parsed!php flags is checked! > Is it a bug? -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From dmiller at amfes.com Tue Dec 20 22:02:34 2011 From: dmiller at amfes.com (Daniel L. Miller) Date: Tue, 20 Dec 2011 12:02:34 -0800 Subject: [Dovecot] doveadm index In-Reply-To: <1324376325.3597.39.camel@innu> References: <4EE9690A.7040308@amfes.com> <1324376325.3597.39.camel@innu> Message-ID: On 12/20/2011 2:18 AM, Timo Sirainen wrote: > On Wed, 2011-12-14 at 19:27 -0800, Daniel L. Miller wrote: >> Does "doveadm index -A INBOX" reindex everything? What about users with >> multiple folders, both subbed& not subbed under INBOX? > It indexes INBOX (only) for all users. And it doesn't "reindex" > anything, it just adds any missing stuff. > > Ok - IS there a command that will ... fully update ... all folders for all users? Will something like "doveadm search -A text zyxabcxyz > /dev/null" work? -- Daniel From pete at linuxbox.co.uk Wed Dec 21 01:08:14 2011 From: pete at linuxbox.co.uk (Peter Smith) Date: Tue, 20 Dec 2011 23:08:14 -0000 (GMT) Subject: [Dovecot] APOP and AuthDatabase/SQL Message-ID: <403888bda02b86bbf1d557c344d2191f.squirrel@linuxbox.co.uk> Hi, We're running dovecot 1.2.15 and use SQL authentication. We'd like to be able to support APOP, but can't see how this would fit in with SQL auth. Currently we have: password_query = SELECT email as user, password FROM virtual_users WHERE email='%u' or (email LIKE '%n@%%' AND unhashed='%w') It seems that in order to auth APOP logins, we'd need to access variables containing the authentication string sent by the client, and also variables containing the auth string sent in the POP3 greeting. Incidentally, the RFC (1939) suggests using: for the greeting, but it looks as if dovecot uses something else? I'm seeing greetings such as: +OK Dovecot ready. <260f.4abcc.4ef11550.cJD6sQSUSnmPS1B/5RGF0Q==@myhostname.com> base64 encoding? Thanks in advance, Peter Smith From gchodos at gmail.com Wed Dec 21 06:09:17 2011 From: gchodos at gmail.com (Gary Chodos) Date: Tue, 20 Dec 2011 23:09:17 -0500 Subject: [Dovecot] lmtp logging incomplete (does not tell what mailbox mail is actually being saved to!) Message-ID: We created a new virtual domain and created a user in that domain in our pgsql database. Instead of creating any directory structure in /home/virtual/mail//, I just sent a test email to see if dovecot's lmtp would autocreate. And it did! And mail appears to be delivered to an inbox.. but, logging is weird and I'm not sure everything is working as it should because: Dec 20 23:01:28 mx dovecot: lmtp(21458, user at example.com): lUDFG8tZ8U7SUwAAO3tENA: msgid=<20111221040122.GP13367 at hostname.example.org>: saved mail to . so why doesn't dovecot log where mail is stored/saved? thanks, Gary From p at state-of-mind.de Wed Dec 21 07:18:03 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 21 Dec 2011 06:18:03 +0100 Subject: [Dovecot] Problem listing SPECIAL-USE flags Message-ID: <20111221051802.GB2286@state-of-mind.de> Timo, we want to implement SPECIAL-USE in Thunderbird (TB), but we've run into problems. I believe you could help change that. Here's the problem: By default TB only lists subscribed (LSUB) folders when it accesses an IMAP server. However when I do a LSUB on recent Dovecot 2.1 code from mercurial I don't get to see the SPECIAL-USE flags. Therefore TB fails to identify which folders it should use and map to until someone tells it to list all folders (LIST) manually. Central part of the SPECIAL-USE idea was/is to require as little user interaction as possible to automatically setup a MUA to do the right thing. Speculating that probably most MUAs will do a LSUB by default and never will get to see SPECIAL-USE flags I think it is easier to have the server-side promote the flags. Do you think that would be possible? Just to verify I configured Dovecot as you would expect for SPECIAL-USE: I've set Dovecot 2.1 to autocreate and autosubscribe SPECIAL-USE mailboxes like this: namespace inbox { ... mailbox AltDrafts { special_use = \Drafts auto = subscribe } ... } This is what I get: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5] Dovecot 2.1 ready. t1 login alice at example.com secret t1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS FUZZY SPECIAL-USE] Logged in t2 LSUB "" "%" * LSUB () "." "Trash" * LSUB () "." "AltDrafts" * LSUB () "." "AltSent" * LSUB () "." "Archives" * LSUB () "." "AltTrash" * LSUB () "." "AltJunk" * LSUB () "." "AltArchive" * LSUB () "." "Junk" t2 OK Lsub completed. t3 LIST "" "%" * LIST (\HasNoChildren \Sent) "." "AltSent" * LIST (\HasChildren) "." "Archives" * LIST (\HasNoChildren \Archive) "." "AltArchive" * LIST (\HasNoChildren \Junk) "." "AltJunk" * LIST (\HasNoChildren) "." "Junk" * LIST (\HasNoChildren \Trash) "." "AltTrash" * LIST (\HasNoChildren \Drafts) "." "AltDrafts" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "INBOX" t3 OK List completed. t4 logout * BYE Logging out t4 OK Logout completed. Connection closed by foreign host. Thanks, p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From slusarz at curecanti.org Wed Dec 21 08:24:44 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 20 Dec 2011 23:24:44 -0700 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111221051802.GB2286@state-of-mind.de> References: <20111221051802.GB2286@state-of-mind.de> Message-ID: <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> Quoting Patrick Ben Koetter

: > we want to implement SPECIAL-USE in Thunderbird (TB), but we've run into > problems. I believe you could help change that. > > Here's the problem: > > By default TB only lists subscribed (LSUB) folders when it accesses an IMAP > server. However when I do a LSUB on recent Dovecot 2.1 code from mercurial I > don't get to see the SPECIAL-USE flags. Therefore TB fails to identify which > folders it should use and map to until someone tells it to list all folders > (LIST) manually. > > Central part of the SPECIAL-USE idea was/is to require as little user > interaction as possible to automatically setup a MUA to do the right thing. > > Speculating that probably most MUAs will do a LSUB by default and never will > get to see SPECIAL-USE flags I think it is easier to have the server-side > promote the flags. Except you never, never, never, never, never can rely on LSUB for mailbox attributes. It says so right in RFC 3501 [6.3.9]: The returned untagged LSUB response MAY contain different mailbox flags from a LIST untagged response. If this should happen, the flags in the untagged LIST are considered more authoritative. See also RFC 5258 [3.1], which discusses the difference between the base RFC 3501 LSUB command and the LIST-EXTENDED SUBSCRIBED option: This option is intended to supplement the LSUB command. Of particular note are the mailbox attributes as returned by this option, compared with what is returned by LSUB. With the latter, the attributes returned may not reflect the actual attribute status on the mailbox name, and the \NoSelect attribute has a second special meaning (it indicates that this mailbox is not, itself, subscribed, but that it has descendant mailboxes that are). With the SUBSCRIBED selection option described here, the attributes are accurate and complete, and have no special meanings. "LSUB" and "LIST (SUBSCRIBED)" are, thus, not the same thing, and some servers must do significant extra work to respond to "LIST (SUBSCRIBED)". Because of this, clients SHOULD continue to use "LSUB" unless they specifically want the additional information offered by "LIST (SUBSCRIBED)". Even if Timo changes things on Dovecot, you still can't rely on the flags returned from an LSUB command because other servers are not guaranteed to act the same way. That's just the reality of IMAP. LSUB is only useful for grabbing the list of subscribed mailboxes (I *really* hope TB is not using flags from the LSUB response for any meaningful purpose - that is simply badly broken behavior). In conclusion, there are 2 ways of handling special-use flags: 1. If the server that supports SPECIAL-USE also supports LIST-EXTENDED (RFC 5258), you are in luck. You can then use LIST-EXTENDED which can accurately retrieve both the list of subscribed mailboxes and special-use flags in a single command. 2. If the server supports SPECIAL-USE but does NOT support LIST-EXTENDED, you MUST make a LIST call. A LSUB call is not sufficient. It's inefficient, but that's the only way to be 100% sure the information in the response is accurate. michael From tss at iki.fi Wed Dec 21 08:26:42 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 08:26:42 +0200 Subject: [Dovecot] doveadm index In-Reply-To: References: <4EE9690A.7040308@amfes.com> <1324376325.3597.39.camel@innu> Message-ID: <34DB33F4-27C1-41DA-91F5-46F0AA712C78@iki.fi> On 20.12.2011, at 22.02, Daniel L. Miller wrote: > On 12/20/2011 2:18 AM, Timo Sirainen wrote: >> On Wed, 2011-12-14 at 19:27 -0800, Daniel L. Miller wrote: >>> Does "doveadm index -A INBOX" reindex everything? What about users with >>> multiple folders, both subbed& not subbed under INBOX? >> It indexes INBOX (only) for all users. And it doesn't "reindex" >> anything, it just adds any missing stuff. >> >> > Ok - IS there a command that will ... fully update ... all folders for all users? Will something like "doveadm search -A text zyxabcxyz > /dev/null" work? For updating full text search indexes, I guess you could do a "doveadm fetch uid text asdfasf > /dev/null".. But some day doveadm index (and several other commands) should allow wildcards in mailbox names, so you could just do doveadm index -A '*' From tss at iki.fi Wed Dec 21 08:28:42 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 08:28:42 +0200 Subject: [Dovecot] APOP and AuthDatabase/SQL In-Reply-To: <403888bda02b86bbf1d557c344d2191f.squirrel@linuxbox.co.uk> References: <403888bda02b86bbf1d557c344d2191f.squirrel@linuxbox.co.uk> Message-ID: <4F901E30-3A93-4C88-87A7-0E8342C1A3A2@iki.fi> On 21.12.2011, at 1.08, Peter Smith wrote: > We're running dovecot 1.2.15 and use SQL authentication. We'd like to > be able to support APOP, but can't see how this would fit in with SQL > auth. > > Currently we have: > > password_query = SELECT email as user, password FROM virtual_users > WHERE email='%u' or (email LIKE '%n@%%' AND unhashed='%w') > > It seems that in order to auth APOP logins, we'd need to access > variables containing the authentication string sent by the client, and > also variables containing the auth string sent in the POP3 greeting. The only way to get it working is to have the password_query return the password in plaintext, so Dovecot can do the APOP check. There's no way to get the APOP greeting string. From tss at iki.fi Wed Dec 21 08:29:43 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 08:29:43 +0200 Subject: [Dovecot] lmtp logging incomplete (does not tell what mailbox mail is actually being saved to!) In-Reply-To: References: Message-ID: On 21.12.2011, at 6.09, Gary Chodos wrote: > We created a new virtual domain and created a user in that domain in > our pgsql database. Instead of creating any directory structure in > /home/virtual/mail//, I just sent a test email to see if > dovecot's lmtp would autocreate. And it did! And mail appears to be > delivered to an inbox.. but, logging is weird and I'm not sure > everything is working as it should because: > > Dec 20 23:01:28 mx dovecot: lmtp(21458, user at example.com): > lUDFG8tZ8U7SUwAAO3tENA: > msgid=<20111221040122.GP13367 at hostname.example.org>: saved mail to > > . so why doesn't dovecot log where mail is stored/saved? That's a bug. Fixed by http://hg.dovecot.org/dovecot-2.0/rev/6d188f4e8e6a The empty string anyway means INBOX. From tss at iki.fi Wed Dec 21 08:38:51 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 08:38:51 +0200 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> Message-ID: <7151089E-C041-4A17-BA68-97615EED6BEC@iki.fi> On 21.12.2011, at 8.24, Michael M Slusarz wrote: > That's just the reality of IMAP. LSUB is only useful for grabbing the list of subscribed mailboxes (I *really* hope TB is not using flags from the LSUB response for any meaningful purpose - that is simply badly broken behavior). It does: # tb-lsub-flags: # Show \Noselect flags for LSUB replies with LAYOUT=fs (e.g. mbox). # This makes Thunderbird realize they aren't selectable and show them # greyed out, instead of only later giving "not selectable" popup error. > In conclusion, there are 2 ways of handling special-use flags: > > 1. If the server that supports SPECIAL-USE also supports LIST-EXTENDED (RFC 5258), you are in luck. You can then use LIST-EXTENDED which can accurately retrieve both the list of subscribed mailboxes and special-use flags in a single command. > 2. If the server supports SPECIAL-USE but does NOT support LIST-EXTENDED, you MUST make a LIST call. A LSUB call is not sufficient. It's inefficient, but that's the only way to be 100% sure the information in the response is accurate. Agreed. I thought about adding the flags to LSUB, but then thought that other servers probably won't do it either. Note how GMail sends them with XLIST command, but there is no XLSUB command. From marco at carcano.ch Wed Dec 21 10:54:05 2011 From: marco at carcano.ch (marco at carcano.ch) Date: Wed, 21 Dec 2011 09:54:05 +0100 Subject: [Dovecot] =?utf-8?q?Mail_lost_-_maybe_a_bug=3F=3F=3F?= In-Reply-To: References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> <1324388249.6987.32.camel@innu> Message-ID: <23a86409a8afc748266069adfd1bc17b@localhost> Hello Timo of course we have entries: grep 'pop3.*mmanzoni.*del=0.*' deliver.log* |grep "Dec 12" deliver.log.2:Dec 12 13:13:19 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=23/2025701, del=0/3920, size=700800292 deliver.log.2:Dec 12 13:46:02 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=1/475746, del=0/3921, size=701276018 deliver.log.2:Dec 12 14:58:08 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=8/911587, del=0/3929, size=702187446 deliver.log.2:Dec 12 14:58:09 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3929, size=702187446 deliver.log.2:Dec 12 15:55:24 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=1/936418, del=0/3930, size=703123844 deliver.log.2:Dec 12 16:40:59 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=1/421415, del=0/3931, size=703545240 deliver.log.2:Dec 12 16:43:23 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 deliver.log.2:Dec 12 17:37:21 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 deliver.log.2:Dec 12 17:44:38 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 deliver.log.2:Dec 12 18:14:29 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 deliver.log.2:Dec 12 18:17:50 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 Also what kind of tools are ever accessing mails? Is it just Dovecot LDA + IMAP + POP3? No doveadm or any external tools? yes, only LDA + IMAP + POP3, no external tools I hope you have some ideas Kind regards Marco carcano From jtam.home at gmail.com Wed Dec 21 11:10:58 2011 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 21 Dec 2011 01:10:58 -0800 (PST) Subject: [Dovecot] Why imap_open doesn't work as is expected to? In-Reply-To: References: Message-ID: I M writes: > Question: Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? > Note:?imap.so is loaded!?imap.ini is parsed!? After the imap_open() invocation, you should check for error messages in your PHP logs, or dump all the errors using imap_errors(); Without more details, I would say you dropped one of those /option-flags or got the mailbox argument syntax wrong. Joseph Tam From lars at nulogic.net Wed Dec 21 16:11:36 2011 From: lars at nulogic.net (Lars Larsen) Date: Wed, 21 Dec 2011 14:11:36 +0000 (UTC) Subject: [Dovecot] Sieve filter not working Message-ID: Hi, Dovecot, the "deliver" LDA and managesieve are all working. However, the sieve rules do not seem to work: System info: CenOS 2.6.32-131.21.1.el6.x86_64 #1 SMP dovecot-pigeonhole-2.0.9-2.el6_1.1.x86_64 dovecot-2.0.9-2.el6_1.1.x86_64 /etc/dovecot/dovecot.conf: mbox_write_locks = fcntl protocols = imap pop3 sieve passdb { driver = pam } ssl_cert = I suspect, that dovecot v2.0.16 under Linux (tested on Gentoo 3.0.4 Hardened, Gentoo 3.0.6, Gentoo 3.1.4) causes 100% cpu utilization when index.cache is broken and doveadm is lanched. Dovecot uses LDAP as the userdb and provides IMAP and LDA. Because each user has a quota, the doveadm's expunge functionality is used to get rid of old trashed mail. The mail log: Dec 12 07:38:59 www dovecot: imap(user): Error: Corrupted index cache file /var/data/mail/domain.tld/user/mail/dovecot.index.cache: invalid record size Doveadm is launched as: doveadm -D expunge -A mailbox Trash savedbefore 1w Mail is stored on ext4 and flush will use all of the CPU capacity like this: load average: 4.00, 4.01, 4.05 ps: root 26401 98.2 0.0 0 0 ? R Dec20 1369:49 [flush-253:1] lsblk: vg_data-mail (dm-1) 253:1 0 500M 0 /var/data/mail dovecot -n: # 2.0.16: /etc/dovecot/dovecot.conf # OS: Linux 3.0.4-hardened-r5 x86_64 Gentoo Base System release 2.0.3 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes hostname = mail.domain.tld lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * mail_debug = yes mail_gid = vmail mail_home = /var/data/mail/domain.tld/%n mail_location = maildir:~/mail mail_plugins = " mail_log notify zlib quota" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { autocreate = Sent autocreate2 = Trash autocreate3 = Spam autosubscribe = Sent autosubscribe2 = Trash autosubscribe3 = Spam fts = squat fts_squat = partial=4 full=10 quota = maildir:User quota quota_rule = *:storage=100M quota_rule2 = Trash:ignore quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_quota_max_scripts = 5 sieve_quota_max_storage = 5M } postmaster_address = postmaster at domain.tld protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service quota-warning { executable = script /etc/dovecot/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl_cert = Hi all, Is there an option to disable (server-side) the deletion of read mails after fetching them via POP3, regardless of the MUA config? Here are the issues I'm facing: - my boss wants to force everyone into a server-side "no delete message"-policy, for archiving, auditing and backup&recovery purposes - the requisite here is pop3, so imap is out - the mailusers are virtual users (held in a mysql db) - don't have the budget to set up a separate mail-arvhing server - don't want to use shaggy ways (aka immutable flag, r/w permissions for Maildirs, etc) dovecot --version 2.0.15 Help? Thanks! From rick at havokmon.com Wed Dec 21 19:01:17 2011 From: rick at havokmon.com (Rick Romero) Date: Wed, 21 Dec 2011 11:01:17 -0600 Subject: [Dovecot] Can I block dovecot from deleting read messages, after being fetched? In-Reply-To: References: Message-ID: <20111221110117.Horde.EM4JIW2tkQ9O8hDd7J0hY5Q@beta.vfemail.net> The policy apparently doesn't cover archiving outgoing email ? Typically you set up your SMTP service to 'BCC' an archive mailbox to achieve a complete archive of both incoming and outgoing mail. Rick Quoting Vasiliu Adrian : > Hi all, > Is there an option to disable (server-side) the deletion of read mails > after fetching them via POP3, regardless of the MUA config? > > Here are the issues I'm facing: > > - my boss wants to force everyone into a server-side "no delete > message"-policy, for archiving, auditing and backup&recovery purposes > - the requisite here is pop3, so imap is out > - the mailusers are virtual users (held in a mysql db) > - don't have the budget to set up a separate mail-arvhing server > - don't want to use shaggy ways (aka immutable flag, r/w permissions for > Maildirs, etc) > > dovecot --version > 2.0.15 > > Help? > Thanks! From miquels at cistron.nl Wed Dec 21 19:10:40 2011 From: miquels at cistron.nl (Miquel van Smoorenburg) Date: Wed, 21 Dec 2011 18:10:40 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <1324264438.11142.9.camel@tardis> References: <1324256311.8138.5.camel@tardis> <1324264438.11142.9.camel@tardis> Message-ID: <4EF21310.9010302@cistron.nl> On 19-12-11 4:13 AM, Noel Butler wrote: > On Mon, 2011-12-19 at 02:32 +0100, Sven Hartge wrote: > >> Noel Butler wrote: >>> On Mon, 2011-12-19 at 00:32 +0100, Cor Bosman wrote: >> >>>> # 2.0.16: /usr/local/etc/dovecot/dovecot.conf >>>> # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 >> >>> Have you tried using a modern kernel? that one is about 2 years old. >> >> Well, this _is_ the kernel from Debian Stable and based on the >> Long-Term-Release from the kernel maintainers. > > > So what? It is not anything current, that the kernel dev team would > waste their time on. The kernel developers actually do "waste their time" on the 2.6.32.x kernel. It's a long-term stable kernel, there are frequent releases on kernel.org (I admit, .36 is a bit long in the tooth, latest is .50, released about 2 weeks ago). Mike. From tss at iki.fi Wed Dec 21 19:14:44 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 19:14:44 +0200 Subject: [Dovecot] Can I block dovecot from deleting read messages, after being fetched? In-Reply-To: References: Message-ID: <7DB25AB3-9942-4A30-9634-1C1FC6627E25@iki.fi> On 21.12.2011, at 18.51, Vasiliu Adrian wrote: > Is there an option to disable (server-side) the deletion of read mails > after fetching them via POP3, regardless of the MUA config? Global ACL for INBOX that gives owner a read-only access would do it. Or maybe http://wiki2.dovecot.org/Plugins/Lazyexpunge? That would work better if the POP3 client can't handle keeping mails on the server (but instead keeps on redownloading them). From tss at iki.fi Wed Dec 21 19:16:52 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 19:16:52 +0200 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: Message-ID: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> On 21.12.2011, at 18.38, hydra wrote: > I suspect, that dovecot v2.0.16 under Linux (tested on Gentoo 3.0.4 > Hardened, Gentoo 3.0.6, Gentoo 3.1.4) causes 100% cpu utilization when > index.cache is broken and doveadm is lanched. Dovecot uses LDAP as the > userdb and provides IMAP and LDA. Because each user has a quota, the > doveadm's expunge functionality is used to get rid of old trashed mail. > > The mail log: > Dec 12 07:38:59 www dovecot: imap(user): Error: Corrupted index cache file > /var/data/mail/domain.tld/user/mail/dovecot.index.cache: invalid record size OK.. > Mail is stored on ext4 and flush will use all of the CPU capacity like this: > load average: 4.00, 4.01, 4.05 > > ps: > root 26401 98.2 0.0 0 0 ? R Dec20 1369:49 > [flush-253:1] That's a kernel process.. > I suspect, that this is something to do with Dovecot, because after > deleting the dovecot.index.cache file, everything went back to normal. When > this happens, I cannot unmount the drive nor a system reboot works. That's a kernel bug.. I think you're thinking it the wrong way: Dovecot isn't causing your system to break. Your system is causing Dovecot to break. Faulty hardware or faulty kernel. From e-frog at gmx.de Wed Dec 21 19:35:51 2011 From: e-frog at gmx.de (e-frog) Date: Wed, 21 Dec 2011 18:35:51 +0100 Subject: [Dovecot] doveadm index In-Reply-To: <34DB33F4-27C1-41DA-91F5-46F0AA712C78@iki.fi> References: <4EE9690A.7040308@amfes.com> <1324376325.3597.39.camel@innu> <34DB33F4-27C1-41DA-91F5-46F0AA712C78@iki.fi> Message-ID: <4EF218F7.2050709@gmx.de> On 21.12.2011 07:26, wrote Timo Sirainen: > On 20.12.2011, at 22.02, Daniel L. Miller wrote: > >> On 12/20/2011 2:18 AM, Timo Sirainen wrote: >>> On Wed, 2011-12-14 at 19:27 -0800, Daniel L. Miller wrote: >>>> Does "doveadm index -A INBOX" reindex everything? What about users with >>>> multiple folders, both subbed& not subbed under INBOX? >>> It indexes INBOX (only) for all users. And it doesn't "reindex" >>> anything, it just adds any missing stuff. >>> >>> >> Ok - IS there a command that will ... fully update ... all folders for all users? Will something like "doveadm search -A text zyxabcxyz> /dev/null" work? > > For updating full text search indexes, I guess you could do a "doveadm fetch uid text asdfasf> /dev/null".. > > But some day doveadm index (and several other commands) should allow wildcards in mailbox names, so you could just do doveadm index -A '*' Actually I'm using doveadm index -A '*' in a daily cron job and it seems to work for me. At least the timestamps of the dovecot.index.search and dovecot.index.search.uids files equal or close to the cron job start time in every folder. Is there a way to examine the search index? Doveadm dump doesn't seem to like it. $: doveadm dump dovecot.index.search $: doveadm(vmail): Fatal: Can't autodetect file type: dovecot.index.search Thanks, e-frog From newsl at aradriel.de Wed Dec 21 21:23:22 2011 From: newsl at aradriel.de (Julien Lacroix) Date: Wed, 21 Dec 2011 20:23:22 +0100 Subject: [Dovecot] compile dovecot-sieve for dovecot 1.2.9 (ubuntu pkg) Message-ID: <4EF2322A.6040806@aradriel.de> Cheers, I've a running Dovecot 1.2.9, installed from the ubuntu 10.04 Lucid LTS repository and trying to get the dovecot-sieve plugin (which seems to be not included in the lucid repo) compiled. Method 1 listed in http://wiki.dovecot.org/LDA/Sieve/Dovecot wont work, seems the rpm was build without --enable-header-install Is it sufficient to download the sources from http://archive.ubuntu.com/ubuntu/pool/main/d/dovecot/dovecot_1.2.9.orig.tar.gz and use them for ./configure --with-dovecot=$path ? thanks and happy holidays julien From p at state-of-mind.de Wed Dec 21 21:42:48 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 21 Dec 2011 20:42:48 +0100 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> Message-ID: <20111221194248.GB2293@state-of-mind.de> * Michael M Slusarz : > Quoting Patrick Ben Koetter

: > >we want to implement SPECIAL-USE in Thunderbird (TB), but we've run into > >problems. I believe you could help change that. > > > >Here's the problem: > > > >By default TB only lists subscribed (LSUB) folders when it accesses an IMAP > >server. However when I do a LSUB on recent Dovecot 2.1 code from mercurial I > >don't get to see the SPECIAL-USE flags. Therefore TB fails to identify which > >folders it should use and map to until someone tells it to list all folders > >(LIST) manually. > > > >Central part of the SPECIAL-USE idea was/is to require as little user > >interaction as possible to automatically setup a MUA to do the right thing. > > > >Speculating that probably most MUAs will do a LSUB by default and never will > >get to see SPECIAL-USE flags I think it is easier to have the server-side > >promote the flags. > > Except you never, never, never, never, never can rely on LSUB for > mailbox attributes. It says so right in RFC 3501 [6.3.9]: > > The returned untagged LSUB response MAY contain different mailbox > flags from a LIST untagged response. If this should happen, the > flags in the untagged LIST are considered more authoritative. > > See also RFC 5258 [3.1], which discusses the difference between the > base RFC 3501 LSUB command and the LIST-EXTENDED SUBSCRIBED option: > > This option is > intended to supplement the LSUB command. Of particular note are > the mailbox attributes as returned by this option, compared with > what is returned by LSUB. With the latter, the attributes > returned may not reflect the actual attribute status on the > mailbox name, and the \NoSelect attribute has a second special > meaning (it indicates that this mailbox is not, itself, > subscribed, but that it has descendant mailboxes that are). With > the SUBSCRIBED selection option described here, the attributes are > accurate and complete, and have no special meanings. "LSUB" and > "LIST (SUBSCRIBED)" are, thus, not the same thing, and some > servers must do significant extra work to respond to "LIST > (SUBSCRIBED)". Because of this, clients SHOULD continue to use > "LSUB" unless they specifically want the additional information > offered by "LIST (SUBSCRIBED)". Thanks for the clarification. I did some reading to get a better understanding. We'll probably stick with this and may go for LIST if the server does not announce LIST-EXTENTED: t2 LIST "" "%" RETURN (SPECIAL-USE) * LIST (\Sent) "." "AltSent" * LIST () "." "Archives" * LIST (\Archive) "." "AltArchive" * LIST (\Junk) "." "AltJunk" * LIST () "." "Junk" * LIST (\Trash) "." "AltTrash" * LIST (\Drafts) "." "AltDrafts" * LIST () "." "Trash" * LIST () "." "INBOX" t2 OK List completed. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From CMarcus at Media-Brokers.com Wed Dec 21 21:45:19 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 21 Dec 2011 14:45:19 -0500 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111221194248.GB2293@state-of-mind.de> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> <20111221194248.GB2293@state-of-mind.de> Message-ID: <4EF2374F.7010300@Media-Brokers.com> On 2011-12-21 2:42 PM, Patrick Ben Koetter

wrote: > Thanks for the clarification. I did some reading to get a better > understanding. We'll probably stick with this and may go for LIST if the > server does not announce LIST-EXTENTED So... out of curoisity, does dovecot support LIST-EXTENDED? -- Best regards, Charles From p at state-of-mind.de Wed Dec 21 21:50:55 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 21 Dec 2011 20:50:55 +0100 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <4EF2374F.7010300@Media-Brokers.com> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> <20111221194248.GB2293@state-of-mind.de> <4EF2374F.7010300@Media-Brokers.com> Message-ID: <20111221195055.GC2293@state-of-mind.de> * Charles Marcus : > On 2011-12-21 2:42 PM, Patrick Ben Koetter

wrote: > >Thanks for the clarification. I did some reading to get a better > >understanding. We'll probably stick with this and may go for LIST if the > >server does not announce LIST-EXTENTED > > So... out of curoisity, does dovecot support LIST-EXTENDED? Yes, it does. See the full session below: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5] Dovecot 2.1 ready. 1 login alice at example.com secret 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS FUZZY SPECIAL-USE] Logged in t2 LIST "" "%" RETURN (SPECIAL-USE) * LIST (\Sent) "." "AltSent" * LIST () "." "Archives" * LIST (\Archive) "." "AltArchive" * LIST (\Junk) "." "AltJunk" * LIST () "." "Junk" * LIST (\Trash) "." "AltTrash" * LIST (\Drafts) "." "AltDrafts" * LIST () "." "Trash" * LIST () "." "INBOX" t2 OK List completed. t3 logout * BYE Logging out t3 OK Logout completed. -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From p at state-of-mind.de Wed Dec 21 21:56:05 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 21 Dec 2011 20:56:05 +0100 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111221195055.GC2293@state-of-mind.de> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> <20111221194248.GB2293@state-of-mind.de> <4EF2374F.7010300@Media-Brokers.com> <20111221195055.GC2293@state-of-mind.de> Message-ID: <20111221195605.GE2293@state-of-mind.de> Timo, if I read the specs correctly http://tools.ietf.org/html/rfc6154#section-5.2 says the following command should work too: C: t3 LIST (SPECIAL-USE) "" "*" S: * LIST (\Sent) "/" SentMail S: * LIST (\Marked \Drafts) "/" MyDrafts S: * LIST (\Trash) "/" Trash S: t3 OK done However if I send that command it fails: t2 LIST (SPECIAL-USE) "" "*" t2 BAD Error in IMAP command LIST: Unknown select options Is that a bug or was a decision on purpose? p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From tss at iki.fi Wed Dec 21 21:59:53 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 21:59:53 +0200 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111221195605.GE2293@state-of-mind.de> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> <20111221194248.GB2293@state-of-mind.de> <4EF2374F.7010300@Media-Brokers.com> <20111221195055.GC2293@state-of-mind.de> <20111221195605.GE2293@state-of-mind.de> Message-ID: On 21.12.2011, at 21.56, Patrick Ben Koetter wrote: > if I read the specs correctly http://tools.ietf.org/html/rfc6154#section-5.2 > says the following command should work too: > > C: t3 LIST (SPECIAL-USE) "" "*" Yes. > However if I send that command it fails: > > t2 LIST (SPECIAL-USE) "" "*" > t2 BAD Error in IMAP command LIST: Unknown select options > > Is that a bug or was a decision on purpose? I forgot that existed. I'll add it. From xchris89x at googlemail.com Thu Dec 22 01:15:09 2011 From: xchris89x at googlemail.com (Christopher Stolzenberg) Date: Thu, 22 Dec 2011 00:15:09 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <4EF05A12.7010502@tesco.net> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> Message-ID: 2011/12/20 Ron Leach : > On 20/12/2011 09:11, Cor Bosman wrote: >> >> I installed a newer kernel on these boxes, and it's fixed. Seems to be >> a problem with the stock debian squeeze kernel. Not a dovecot issue, but >> others with a stable squeeze box might see similar problems so good >> to have it in the archive :) > > > Indeed; very many of us use Debian stable. ?Which kernel did you install > that is 2.0.16-friendly, and was this from Debian stable's updates system? > > regards, Ron Debian for production servers??? That sounds dangerous. -- Chris From jk at jkart.de Thu Dec 22 01:26:35 2011 From: jk at jkart.de (Jim Knuth) Date: Thu, 22 Dec 2011 00:26:35 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> Message-ID: <4EF26B2B.1090507@jkart.de> am 22.12.11 00:15 schrieb Christopher Stolzenberg : >> Indeed; very many of us use Debian stable. Which kernel did you install >> that is 2.0.16-friendly, and was this from Debian stable's updates system? >> >> regards, Ron > > Debian for production servers??? That sounds dangerous. sorry, but that`s absolutely bulls*it. *lol* Where have you read then THIS? > > -- > Chris -- Mit freundlichen Gr??en, with kind regards, Jim Knuth From xchris89x at googlemail.com Thu Dec 22 01:49:52 2011 From: xchris89x at googlemail.com (Christopher Stolzenberg) Date: Thu, 22 Dec 2011 00:49:52 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <4EF26B2B.1090507@jkart.de> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> Message-ID: 2011/12/22 Jim Knuth : > am 22.12.11 00:15 schrieb Christopher Stolzenberg > > : > > >>> Indeed; very many of us use Debian stable. ?Which kernel did you install >>> that is 2.0.16-friendly, and was this from Debian stable's updates >>> system? >>> >>> regards, Ron >> >> >> Debian for production servers??? That sounds dangerous. > > > sorry, but that`s absolutely bulls*it. *lol* > Where have you read then THIS? My own experience! Reasons against Debian: - No LSB certification (Linux Standard Base) - No hardware certification (IBM, Dell, HP ...) - Incompatible with some Broadcom NICs - Full of bugs - Free Kernel (non-free firmware removed... lol) - Obsolete kernel (incompatible with new hardware) - Obsolete packages - Only one year support for oldstable *lol* - Long delay for security updates -- Chris From mcbdovecot at robuust.nl Thu Dec 22 01:54:50 2011 From: mcbdovecot at robuust.nl (Maarten Bezemer) Date: Thu, 22 Dec 2011 00:54:50 +0100 (CET) Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: Message-ID: On Mon, 19 Dec 2011, Cor Bosman wrote: > # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 Are you sure you didn't roll your own kernel? Debian kernels I know don't use the ".36" suffix, but ship as 2.6.32-something and use their own internal version numbering. For example, I found this on packages.debian.org: linux-image-2.6.32-5-amd64 (2.6.32-38) According to changelog, this actually carries patches from 2.6.32.46, yet only shows in uname as 2.6.32-5-amd64. Also a friendly reminder for the question asked by Ron Leach: which kernel version did you install that appears to be Dovecot-friendlier? Would be very useful to have that in the archives as well. By the way, happy holidays to everyone ;-) -- Maarten From djonas at vitalwerks.com Thu Dec 22 03:52:59 2011 From: djonas at vitalwerks.com (David Jonas) Date: Wed, 21 Dec 2011 17:52:59 -0800 Subject: [Dovecot] Maildir migration and uids Message-ID: <4EF28D7B.8050601@vitalwerks.com> I'm in the process of migrating a large number of maildirs to a 3rd party dovecot server (from a dovecot server). Tests have shown that using imap to sync the accounts doesn't preserve the uidl for pop3 access. My current attempt is to convert the maildir to mbox and add an X-UIDL header in the process. Run a second dovecot that serves the converted mbox. But dovecot's docs say, "None of these headers are sent to IMAP/POP3 clients when they read the mail". Is there any way to sync these maildirs to the new server and maintain the uids? The real goal is keep customers email clients happy when they are pointed at the new server. Am I just wishing? From noel.butler at ausics.net Thu Dec 22 04:13:22 2011 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 22 Dec 2011 12:13:22 +1000 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> Message-ID: <1324520002.7098.14.camel@tardis> On Thu, 2011-12-22 at 00:49 +0100, Christopher Stolzenberg wrote: > 2011/12/22 Jim Knuth : > > am 22.12.11 00:15 schrieb Christopher Stolzenberg > > > > : > > > > > >>> Indeed; very many of us use Debian stable. Which kernel did you install > >>> that is 2.0.16-friendly, and was this from Debian stable's updates > >>> system? > >>> > >>> regards, Ron > >> > >> > >> Debian for production servers??? That sounds dangerous. > > > > > > sorry, but that`s absolutely bulls*it. *lol* > > Where have you read then THIS? > > My own experience! > > Reasons against Debian: > > - No LSB certification (Linux Standard Base) > - No hardware certification (IBM, Dell, HP ...) > - Incompatible with some Broadcom NICs > - Full of bugs > - Free Kernel (non-free firmware removed... lol) > - Obsolete kernel (incompatible with new hardware) > - Obsolete packages > - Only one year support for oldstable *lol* > - Long delay for security updates > > -- > Chris Reasons for debian: They have largest number of packages! ... oh Wait! thats because they break up simple packages into 8-10 sub packages where as other distros use single or split in two .. yeah, scratch that... you're right, no pro's that I can think of ;) Ahhh just before I hit send I remember one, debian, like windows, is an ideal distro on a server in a Colo that charges for remote hands (incl reboots), cause they have the highest fail rate. Most stable OS's from colo are freebsd, slackware, RHEL, CentOS (ok same thing) and SuSE, and surprisingly, we once had a customer with an old win2K box back in mid 00's, that was very well behaved, and it was busy, they ran a concert/band/event ticketing site on it, truly amazed me that box. Worse OS's would be netbsd, fedora, debian, ubuntu, mint, windows* .. but very very nice money earners for remote hands :P -------------- next part -------------- A non-text attachment was scrubbed... Name: face-raspberry.png Type: image/png Size: 865 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: face-wink.png Type: image/png Size: 876 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From gchodos at gmail.com Thu Dec 22 05:12:40 2011 From: gchodos at gmail.com (Gary Chodos) Date: Wed, 21 Dec 2011 22:12:40 -0500 Subject: [Dovecot] lmtp logging incomplete (does not tell what mailbox mail is actually being saved to!) In-Reply-To: References: Message-ID: On Wed, Dec 21, 2011 at 1:29 AM, Timo Sirainen wrote: > On 21.12.2011, at 6.09, Gary Chodos wrote: > >> We created a new virtual domain and created a user in that domain in >> our pgsql database. ?Instead of creating any directory structure in >> /home/virtual/mail//, I just sent a test email to see if >> dovecot's lmtp would autocreate. ?And it did! ?And mail appears to be >> delivered to an inbox.. but, logging is weird and I'm not sure >> everything is working as it should because: >> >> Dec 20 23:01:28 mx dovecot: lmtp(21458, user at example.com): >> lUDFG8tZ8U7SUwAAO3tENA: >> msgid=<20111221040122.GP13367 at hostname.example.org>: saved mail to >> >> . so why doesn't dovecot log where mail is stored/saved? > > That's a bug. Fixed by http://hg.dovecot.org/dovecot-2.0/rev/6d188f4e8e6a > > The empty string anyway means INBOX. ahhhh, thanks Timo! From simon.brereton at buongiorno.com Thu Dec 22 06:18:54 2011 From: simon.brereton at buongiorno.com (Simon Brereton) Date: Wed, 21 Dec 2011 23:18:54 -0500 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <1324520002.7098.14.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> Message-ID: On Dec 21, 2011 9:13 PM, "Noel Butler" wrote: > > On Thu, 2011-12-22 at 00:49 +0100, Christopher Stolzenberg wrote: > > > 2011/12/22 Jim Knuth : > > > am 22.12.11 00:15 schrieb Christopher Stolzenberg > > > > > > : > > > > > > > > >>> Indeed; very many of us use Debian stable. Which kernel did you install > > >>> that is 2.0.16-friendly, and was this from Debian stable's updates > > >>> system? > > >>> > > >>> regards, Ron > > >> > > >> > > >> Debian for production servers??? That sounds dangerous. > > > > > > > > > sorry, but that`s absolutely bulls*it. *lol* > > > Where have you read then THIS? > > > > My own experience! > > > > Reasons against Debian: > > > > - No LSB certification (Linux Standard Base) > > - No hardware certification (IBM, Dell, HP ...) > > - Incompatible with some Broadcom NICs > > - Full of bugs > > - Free Kernel (non-free firmware removed... lol) > > - Obsolete kernel (incompatible with new hardware) > > - Obsolete packages > > - Only one year support for oldstable *lol* > > - Long delay for security updates I'm with Jim. Debian has served me well for years. This is just distro-bias. Sure, you need modicum more sense and hands on experience, but that's not bad thing in a production environment.. It would be interesting to chart the number of threads caused by each distro. I don't know who would have the least, but I suspect gentoo and centos would be out in front, with Ubuntu panting along behind.. Simon > > Reasons for debian: > They have largest number of packages! ... oh Wait! thats because they > break up simple packages into 8-10 sub packages where as other distros > use single or split in two .. yeah, scratch that... you're right, no > pro's that I can think of ;) > > Ahhh just before I hit send I remember one, debian, like windows, is an > ideal distro on a server in a Colo that charges for remote hands (incl > reboots), cause they have the highest fail rate. > > Most stable OS's from colo are freebsd, slackware, RHEL, CentOS (ok same > thing) and SuSE, and surprisingly, we once had a customer with an old > win2K box back in mid 00's, that was very well behaved, and it was busy, > they ran a concert/band/event ticketing site on it, truly amazed me that > box. > > Worse OS's would be netbsd, fedora, debian, ubuntu, mint, windows* .. > but very very nice money earners for remote hands :P > From robert at schetterer.org Thu Dec 22 09:06:36 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 08:06:36 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> Message-ID: <4EF2D6FC.9070207@schetterer.org> Am 22.12.2011 00:15, schrieb Christopher Stolzenberg: > 2011/12/20 Ron Leach : >> On 20/12/2011 09:11, Cor Bosman wrote: >>> >>> I installed a newer kernel on these boxes, and it's fixed. Seems to be >>> a problem with the stock debian squeeze kernel. Not a dovecot issue, but >>> others with a stable squeeze box might see similar problems so good >>> to have it in the archive :) >> >> >> Indeed; very many of us use Debian stable. Which kernel did you install >> that is 2.0.16-friendly, and was this from Debian stable's updates system? >> >> regards, Ron > > Debian for production servers??? That sounds dangerous. nonsense, Debian and clones are widly used for massive big server Farms > > -- > Chris -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From robert at schetterer.org Thu Dec 22 09:08:06 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 08:08:06 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> Message-ID: <4EF2D756.6000107@schetterer.org> Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: > 2011/12/22 Jim Knuth : >> am 22.12.11 00:15 schrieb Christopher Stolzenberg >> >> : >> >> >>>> Indeed; very many of us use Debian stable. Which kernel did you install >>>> that is 2.0.16-friendly, and was this from Debian stable's updates >>>> system? >>>> >>>> regards, Ron >>> >>> >>> Debian for production servers??? That sounds dangerous. >> >> >> sorry, but that`s absolutely bulls*it. *lol* >> Where have you read then THIS? > > My own experience! > > Reasons against Debian: > > - No LSB certification (Linux Standard Base) > - No hardware certification (IBM, Dell, HP ...) > - Incompatible with some Broadcom NICs > - Full of bugs > - Free Kernel (non-free firmware removed... lol) > - Obsolete kernel (incompatible with new hardware) > - Obsolete packages > - Only one year support for oldstable *lol* > - Long delay for security updates > > -- > Chris dont feed trolls -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From noel.butler at ausics.net Thu Dec 22 09:23:36 2011 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 22 Dec 2011 17:23:36 +1000 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> Message-ID: <1324538616.14607.12.camel@tardis> On Wed, 2011-12-21 at 23:18 -0500, Simon Brereton wrote: > > I'm with Jim. Debian has served me well for years. This is just > distro-bias. Sure, you need modicum more sense and hands on experience, distro holy ways will outlast the real world holy wars, we each have a distro we all stand by, else there would only be one distro. > but that's not bad thing in a production environment.. > > It would be interesting to chart the number of threads caused by each > distro. I don't know who would have the least, but I suspect gentoo and > centos would be out in front, with Ubuntu panting along behind.. > > Simon I'm yet to meet a debian based admin who uses source, they only seem to think that apt is only way of installing stuff. They are scared of conflicts, who knows. Most the servers in the DC's I've run or worked in are all either freebsd, RHEL, slackware or gentoo, the later two being my personal favourites, that said, I do use ubuntu LTS on pc's/laptop, if there was no LTS however, I'd likely go back to fedora. > > Ahhh just before I hit send I remember one, debian, like windows, is an > > ideal distro on a server in a Colo that charges for remote hands (incl > > reboots), cause they have the highest fail rate. > > > > Most stable OS's from colo are freebsd, slackware, RHEL, CentOS (ok same > > thing) and SuSE, and surprisingly, we once had a customer with an old > > win2K box back in mid 00's, that was very well behaved, and it was busy, > > they ran a concert/band/event ticketing site on it, truly amazed me that > > box. > > > > Worse OS's would be netbsd, fedora, debian, ubuntu, mint, windows* .. > > but very very nice money earners for remote hands :P > > -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From noel.butler at ausics.net Thu Dec 22 09:27:04 2011 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 22 Dec 2011 17:27:04 +1000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <4EF2D756.6000107@schetterer.org> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> Message-ID: <1324538824.14607.16.camel@tardis> On Thu, 2011-12-22 at 08:08 +0100, Robert Schetterer wrote: > Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: > > 2011/12/22 Jim Knuth : > >> am 22.12.11 00:15 schrieb Christopher Stolzenberg > >> > >> : > >> > >> > >>>> Indeed; very many of us use Debian stable. Which kernel did you install > >>>> that is 2.0.16-friendly, and was this from Debian stable's updates > >>>> system? > >>>> > >>>> regards, Ron > >>> > >>> > >>> Debian for production servers??? That sounds dangerous. > >> > >> > >> sorry, but that`s absolutely bulls*it. *lol* > >> Where have you read then THIS? > > > > My own experience! > > > > Reasons against Debian: > > > > - No LSB certification (Linux Standard Base) > > - No hardware certification (IBM, Dell, HP ...) > > - Incompatible with some Broadcom NICs > > - Full of bugs > > - Free Kernel (non-free firmware removed... lol) > > - Obsolete kernel (incompatible with new hardware) > > - Obsolete packages > > - Only one year support for oldstable *lol* > > - Long delay for security updates > > > > -- > > Chris > > dont feed trolls > Why is it when someone disagrees with someone's opinion they are labelled a troll, maybe because it hits a raw nerve huh? I dunno, and frankly don't care, but you have no right to do so just because you don't agree with Christophers statements. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From robert at schetterer.org Thu Dec 22 09:34:30 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 08:34:30 +0100 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <1324538616.14607.12.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <1324538616.14607.12.camel@tardis> Message-ID: <4EF2DD86.8070609@schetterer.org> Am 22.12.2011 08:23, schrieb Noel Butler: > On Wed, 2011-12-21 at 23:18 -0500, Simon Brereton wrote: > >> >> I'm with Jim. Debian has served me well for years. This is just >> distro-bias. Sure, you need modicum more sense and hands on experience, > > > distro holy ways will outlast the real world holy wars, we each have a > distro we all stand by, else there would only be one distro. > > >> but that's not bad thing in a production environment.. >> >> It would be interesting to chart the number of threads caused by each >> distro. I don't know who would have the least, but I suspect gentoo and >> centos would be out in front, with Ubuntu panting along behind.. >> >> Simon > > > I'm yet to meet a debian based admin who uses source, they only seem to > think that apt is only way of installing stuff. > They are scared of conflicts, who knows. Most the servers in the DC's > I've run or worked in are all either freebsd, RHEL, slackware or gentoo, > the later two being my personal favourites, that said, I do use ubuntu > LTS on pc's/laptop, if there was no LTS however, I'd likely go back to > fedora. > X-mas is comming, we are waiting to get the perfect OS presented, so lets pray *g by the way ,where is the match to the dovecot list topic anyone identified the kernel bug? > > >>> Ahhh just before I hit send I remember one, debian, like windows, is an >>> ideal distro on a server in a Colo that charges for remote hands (incl >>> reboots), cause they have the highest fail rate. >>> >>> Most stable OS's from colo are freebsd, slackware, RHEL, CentOS (ok same >>> thing) and SuSE, and surprisingly, we once had a customer with an old >>> win2K box back in mid 00's, that was very well behaved, and it was busy, >>> they ran a concert/band/event ticketing site on it, truly amazed me that >>> box. >>> >>> Worse OS's would be netbsd, fedora, debian, ubuntu, mint, windows* .. >>> but very very nice money earners for remote hands :P >>> > > > -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From robert at schetterer.org Thu Dec 22 09:42:30 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 08:42:30 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <1324538824.14607.16.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> Message-ID: <4EF2DF66.4060408@schetterer.org> Am 22.12.2011 08:27, schrieb Noel Butler: > On Thu, 2011-12-22 at 08:08 +0100, Robert Schetterer wrote: > >> Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: >>> 2011/12/22 Jim Knuth : >>>> am 22.12.11 00:15 schrieb Christopher Stolzenberg >>>> >>>> : >>>> >>>> >>>>>> Indeed; very many of us use Debian stable. Which kernel did you install >>>>>> that is 2.0.16-friendly, and was this from Debian stable's updates >>>>>> system? >>>>>> >>>>>> regards, Ron >>>>> >>>>> >>>>> Debian for production servers??? That sounds dangerous. >>>> >>>> >>>> sorry, but that`s absolutely bulls*it. *lol* >>>> Where have you read then THIS? >>> >>> My own experience! >>> >>> Reasons against Debian: >>> >>> - No LSB certification (Linux Standard Base) >>> - No hardware certification (IBM, Dell, HP ...) >>> - Incompatible with some Broadcom NICs >>> - Full of bugs >>> - Free Kernel (non-free firmware removed... lol) >>> - Obsolete kernel (incompatible with new hardware) >>> - Obsolete packages >>> - Only one year support for oldstable *lol* >>> - Long delay for security updates >>> >>> -- >>> Chris >> >> dont feed trolls >> > > > Why is it when someone disagrees with someone's opinion they are > labelled a troll, maybe because it hits a raw nerve huh? > I dunno, and frankly don't care, but you have no right to do so just > because you don't agree with Christophers statements. > > > Hi Noel. this has left the topic of the dovecot list, after all , everyone is free to use what he likes and what fits best to solute the tec problem/task he/she likes to solve these everlasting os discussions are leading to nirvana are heavy boring, doesnt help on fixing the asked tec problem -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From noel.butler at ausics.net Thu Dec 22 09:52:28 2011 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 22 Dec 2011 17:52:28 +1000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <4EF2DF66.4060408@schetterer.org> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> Message-ID: <1324540348.16562.11.camel@tardis> On Thu, 2011-12-22 at 08:42 +0100, Robert Schetterer wrote: > Am 22.12.2011 08:27, schrieb Noel Butler: > > On Thu, 2011-12-22 at 08:08 +0100, Robert Schetterer wrote: > > > >> Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: > >>> 2011/12/22 Jim Knuth : > >>>> am 22.12.11 00:15 schrieb Christopher Stolzenberg > >>>> > >>>> : > >>>> > >>>> > >>>>>> Indeed; very many of us use Debian stable. Which kernel did you install > >>>>>> that is 2.0.16-friendly, and was this from Debian stable's updates > >>>>>> system? > >>>>>> > >>>>>> regards, Ron > >>>>> > >>>>> > >>>>> Debian for production servers??? That sounds dangerous. > >>>> > >>>> > >>>> sorry, but that`s absolutely bulls*it. *lol* > >>>> Where have you read then THIS? > >>> > >>> My own experience! > >>> > >>> Reasons against Debian: > >>> > >>> - No LSB certification (Linux Standard Base) > >>> - No hardware certification (IBM, Dell, HP ...) > >>> - Incompatible with some Broadcom NICs > >>> - Full of bugs > >>> - Free Kernel (non-free firmware removed... lol) > >>> - Obsolete kernel (incompatible with new hardware) > >>> - Obsolete packages > >>> - Only one year support for oldstable *lol* > >>> - Long delay for security updates > >>> > >>> -- > >>> Chris > >> > >> dont feed trolls > >> > > > > > > Why is it when someone disagrees with someone's opinion they are > > labelled a troll, maybe because it hits a raw nerve huh? > > I dunno, and frankly don't care, but you have no right to do so just > > because you don't agree with Christophers statements. > > > > > > > > Hi Noel. this has left the topic of the dovecot list, > after all , everyone is free to use what he likes and what fits best to > solute the tec problem/task he/she likes to solve > these everlasting os discussions are leading to nirvana > are heavy boring, doesnt help on fixing the asked tec problem > > Still, everyone is entitled to their opinion, including Christopher, perhaps it was not the right place for his comment, but none the less he made it, so he must feel that way, we should respect that without placing labels on him. This also is not the kernel list, since updating to a kernel released in the 21st century Cor's issue has gone away, so this thread is now rather entirely pointless on the Dovecot list. So I'll my participation in this thread, since its nearly 6pm, and tonight we have lots of prawns and lots and lots of beer and bourbon ;) Merry Christmas to those who celebrate it. -------------- next part -------------- A non-text attachment was scrubbed... Name: face-wink.png Type: image/png Size: 876 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From robert at schetterer.org Thu Dec 22 10:03:24 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 09:03:24 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <1324540348.16562.11.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> <1324540348.16562.11.camel@tardis> Message-ID: <4EF2E44C.60307@schetterer.org> On 22.12.2011 08:52, Noel Butler wrote: > On Thu, 2011-12-22 at 08:42 +0100, Robert Schetterer wrote: > >> Am 22.12.2011 08:27, schrieb Noel Butler: >>> On Thu, 2011-12-22 at 08:08 +0100, Robert Schetterer wrote: >>> >>>> Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: >>>>> 2011/12/22 Jim Knuth : >>>>>> am 22.12.11 00:15 schrieb Christopher Stolzenberg >>>>>> >>>>>> : >>>>>> >>>>>> >>>>>>>> Indeed; very many of us use Debian stable. Which kernel did you install >>>>>>>> that is 2.0.16-friendly, and was this from Debian stable's updates >>>>>>>> system? >>>>>>>> >>>>>>>> regards, Ron >>>>>>> >>>>>>> >>>>>>> Debian for production servers??? That sounds dangerous. >>>>>> >>>>>> >>>>>> sorry, but that`s absolutely bulls*it. *lol* >>>>>> Where have you read then THIS? >>>>> >>>>> My own experience! >>>>> >>>>> Reasons against Debian: >>>>> >>>>> - No LSB certification (Linux Standard Base) >>>>> - No hardware certification (IBM, Dell, HP ...) >>>>> - Incompatible with some Broadcom NICs >>>>> - Full of bugs >>>>> - Free Kernel (non-free firmware removed... lol) >>>>> - Obsolete kernel (incompatible with new hardware) >>>>> - Obsolete packages >>>>> - Only one year support for oldstable *lol* >>>>> - Long delay for security updates >>>>> >>>>> -- >>>>> Chris >>>> >>>> dont feed trolls >>>> >>> >>> >>> Why is it when someone disagrees with someone's opinion they are >>> labelled a troll, maybe because it hits a raw nerve huh? >>> I dunno, and frankly don't care, but you have no right to do so just >>> because you don't agree with Christophers statements. >>> >>> >>> >> >> Hi Noel. this has left the topic of the dovecot list, >> after all , everyone is free to use what he likes and what fits best to >> solute the tec problem/task he/she likes to solve >> these everlasting os discussions are leading to nirvana >> are heavy boring, doesnt help on fixing the asked tec problem >> >> > > > > Still, everyone is entitled to their opinion, including Christopher, > perhaps it was not the right place for his comment, but none the less he > made it, so he must feel that way, we should respect that without > placing labels on him. > This also is not the kernel list, since updating to a kernel released in > the 21st century Cor's issue has gone away, so this thread is now rather > entirely pointless on the Dovecot list. So I'll my participation in > this thread, since its nearly 6pm, and tonight we have lots of prawns > and lots and lots of beer and bourbon ;) jeppa no need to flame ever cheers ! > > Merry Christmas to those who celebrate it. celebrate ,is a good idea, anytime > > > > -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From cor at xs4all.nl Thu Dec 22 10:22:07 2011 From: cor at xs4all.nl (Cor Bosman) Date: Thu, 22 Dec 2011 09:22:07 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <1324540348.16562.11.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> <1324540348.16562.11.camel@tardis> Message-ID: <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> > This also is not the kernel list, since updating to a kernel released in > the 21st century Cor's issue has gone away, so this thread is now rather > entirely pointless on the Dovecot list. So I'll my participation in Actually, it hasn't. For the last few days we've been trying to pinpoint the problem by running half a dozen servers with different kernels and options. This 'kernel released in the 20th century' we have this problem with is the current stable kernel for debian. So instead of starting a distro war (and I thought canon/nikon, mac/pc were bad), lets be a bit more constructive. Plenty of people use the stable debian release. It's happening on about half of our imap servers (20 or so), but on none of our other debian servers (hundreds). So it's not so weird to suspect a dovecot link. But it looks like it may be a driver issue on a specific range of hardware we use. Once we find the issue, i'll report back. Until then, this doesn't look like a dovecot problem. Cor From wgillespie+dovecot at es2eng.com Thu Dec 22 10:30:38 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Thu, 22 Dec 2011 01:30:38 -0700 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE7DDE5.3070605@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> Message-ID: <4EF2EAAE.9090705@es2eng.com> On 12/13/2011 04:21 PM, Asai wrote: > Greetings, > > Working with dsync and setting up backups to a Windows file server. > Problem seems to be that Windows is renaming the dovecot mail files > (maildir) to Windows friendly filenames, and losing the Dovecot name. > For example, > 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > becomes 1AETPH~X. > > Does anyone have any ideas about how to tell Windows to not do this? Or > is it not possible? Don't have any answers for you, but I know that : is an invalid character in Windows filenames, so that could have something to do with it. From wgillespie+dovecot at es2eng.com Thu Dec 22 10:32:24 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Thu, 22 Dec 2011 01:32:24 -0700 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EF2EAAE.9090705@es2eng.com> References: <4EE7DDE5.3070605@globalchangemusic.org> <4EF2EAAE.9090705@es2eng.com> Message-ID: <4EF2EB18.1090102@es2eng.com> On 12/22/2011 01:30 AM, Willie Gillespie wrote: > On 12/13/2011 04:21 PM, Asai wrote: >> Greetings, >> >> Working with dsync and setting up backups to a Windows file server. >> Problem seems to be that Windows is renaming the dovecot mail files >> (maildir) to Windows friendly filenames, and losing the Dovecot name. >> For example, >> 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S >> >> becomes 1AETPH~X. >> >> Does anyone have any ideas about how to tell Windows to not do this? Or >> is it not possible? > > Don't have any answers for you, but I know that : is an invalid > character in Windows filenames, so that could have something to do with it. Whoops, should have finished going through the old thread. Seems like MyBSD already answered. From dg at dguhl.org Thu Dec 22 11:27:33 2011 From: dg at dguhl.org (Dennis Guhl) Date: Thu, 22 Dec 2011 10:27:33 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> <1324540348.16562.11.camel@tardis> <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> Message-ID: <20111222092732.GA6678@PC211.ikt.de> On Thu, Dec 22, 2011 at 09:22:07AM +0100, Cor Bosman wrote: [..] > Actually, it hasn't. For the last few days we've been trying to > pinpoint the problem by running half a dozen servers with different In your initial posting you mentioned this happens on a machine wich was updated from Lenny to Squeeze. Did you try a fresh install? Sometimes I had some kernel related troubles in case of updateting releases. [..] > Once we find the issue, i'll report back. Until then, this doesn't > look like a dovecot problem. Most likely it will be best to ask on a debian list. Dennis From arnaud.lenorcy at univ-orleans.fr Thu Dec 22 12:31:40 2011 From: arnaud.lenorcy at univ-orleans.fr (LE NORCY Arnaud) Date: Thu, 22 Dec 2011 11:31:40 +0100 Subject: [Dovecot] file_dotlock_create(~/.dovecot.lda-dupes) failed: No such file or directory ... Message-ID: <4EF3070C.1040704@univ-orleans.fr> Hello, i get this message every time that a user has enabled the vacation script (into Horde webmail) in my mail.err log file: Dec 22 10:18:16 mailserver dovecot: deliver(user324): file_dotlock_create(~/.dovecot.lda-dupes) failed: No such file or directory normally the reply is sent only once in the number of configured days.. but for all users the reply is sent every time... the day variable is "ignored.." because the file "dovecot.lda-dupes" is not wrotten i think.. ~# dpkg -l | grep dovecot ii dovecot-common 1:1.2.15-4 secure mail server that supports mbox and maildir mailboxes ii dovecot-imapd 1:1.2.15-4 secure IMAP server that supports mbox and maildir mailboxes ii dovecot-pop3d 1:1.2.15-4 secure POP3 server that supports mbox and maildir mailboxes dovecot.conf : protocols = imap imaps pop3s managesieve mail_location = maildir:/ext/spool/imap/%1Mu/%u mail_uid = vmail mail_gid = vmail protocol lda { mail_plugins = quota sieves.fr } .. plugin { .. sieve_dir = /ext/spool/sieve/%1Mu/%u sieve = /ext/spool/sieve/%1Mu/%u/dovecot.sieve } rights are OK for user "vmail" in /ext/spool/sieve/%1Mu/%u/ ....; for example : /ext/spool/sieve/d/user324# ls -la total 20 drwxr-x--- 3 vmail vmail 4096 20 d?c. 19:15 . drwxr-x--- 43 vmail vmail 4096 17 nov. 10:14 .. lrwxrwxrwx 1 vmail vmail 10 20 d?c. 18:38 dovecot.sieve -> ingo.sieve -rw-r----- 1 vmail vmail 65 20 d?c. 19:15 dovecot.svbin -rw-r----- 1 vmail vmail 88 20 d?c. 18:38 ingo.sieve drwxr-x--- 2 vmail vmail 4096 20 d?c. 18:38 tmp any ideas?thanks Arnaud, From CMarcus at Media-Brokers.com Thu Dec 22 13:13:36 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 22 Dec 2011 06:13:36 -0500 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> Message-ID: <4EF310E0.6030006@Media-Brokers.com> On 2011-12-21 11:18 PM, Simon Brereton wrote: > It would be interesting to chart the number of threads caused by each > distro. I don't know who would have the least, but I suspect gentoo and > centos would be out in front, Been using gentoo since about 2003 and never looked back... best and easiest distro to maintain, bar none, and the best support and documentation too. -- Best regards, Charles From tlx at leuxner.net Thu Dec 22 13:29:08 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Thu, 22 Dec 2011 12:29:08 +0100 Subject: [Dovecot] Global Sieve Script Includes no longer works with 056934abd2ef Message-ID: Latest Dovecot Auto-Build 2.1.rc1-0~auto+42 (056934abd2ef) fails to include global Sieve Scripts. Not sure this is specific to Stephan's Repository. Rolling back to older version restores functionality. ==> /var/log/dovecot/dovecot.log <== Dec 22 12:13:52 spectre dovecot: lmtp(32246): Connect from local Dec 22 12:13:52 spectre dovecot: lmtp(32246, tlx at leuxner.net): Error: jo99GvAQ8072fQAAqZii3w: sieve: failed to open script /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve (view user logfile /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve.log for more information) Dec 22 12:13:52 spectre dovecot: lmtp(32246, tlx at leuxner.net): jo99GvAQ8072fQAAqZii3w: msgid=<4EF310E0.6030006 at Media-Brokers.com>: saved mail to INBOX $ cat /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve.log sieve: info: started log at Dec 22 12:13:52. main_script: line 2: error: included global script 'global.sieve' does not exist. main_script: error: validation failed. [ Script Calling Global ] $ head /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve require ["include","copy","fileinto","vacation"]; include :global "global.sieve"; [?] $ ls -al /var/vmail/conf.d/leuxner.net/sieve/ total 12 dr-x------ 2 vmail vmail 4096 Dec 7 15:09 . dr-x------ 4 vmail vmail 4096 Mar 17 2010 .. -r-------- 1 vmail vmail 3647 Dec 7 15:09 global.sieve $ doveconf -n # 2.1.rc1 (056934abd2ef): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 auth_cache_size = 16 k auth_verbose = yes mail_location = mdbox:~/mdbox mail_plugins = acl quota stats namespace { list = yes location = mdbox:/var/vmail/public prefix = Public/ separator = / subscriptions = no type = public } namespace inbox { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = username_format=%u /var/vmail/auth.d/%d/passwd driver = passwd-file } plugin { acl = vfile:/var/vmail/conf.d/%d/acls:cache_secs=300 mail_log_events = expunge mailbox_delete quota = dict:user::file:%h/mdbox/dovecot-quota quota_rule = *:storage=1GB quota_rule2 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/vmail/conf.d/%d/sieve stats_refresh = 30s stats_track_cmds = yes } protocols = imap lmtp quota_full_tempfail = yes service auth-worker { user = doveauth } service auth { client_limit = 1224 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = doveauth } service imap-login { inet_listener imap { address = 1.2.3.4 port = 143 } inet_listener imaps { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_ca = From jerry at seibercom.net Thu Dec 22 13:31:30 2011 From: jerry at seibercom.net (Jerry) Date: Thu, 22 Dec 2011 06:31:30 -0500 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <4EF310E0.6030006@Media-Brokers.com> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> Message-ID: <20111222063130.6c45f3a2@scorpio> On Thu, 22 Dec 2011 06:13:36 -0500 Charles Marcus articulated: > On 2011-12-21 11:18 PM, Simon Brereton > wrote: > > It would be interesting to chart the number of threads caused by > > each distro. I don't know who would have the least, but I suspect > > gentoo and centos would be out in front, > > Been using gentoo since about 2003 and never looked back... best and > easiest distro to maintain, bar none, and the best support and > documentation too. I have been a FreeBSD user since 2000. Dovecot and Postfix run well on the OS. Postfix should since it was developed on FreeBSD. Other than that though, most other apps require extensive patching in order to get them to work. And when it comes to drivers for modern devices, you can pretty much forget about it. After more than five years they still have not developed drivers for wireless "N" protocol devices. However, like Firefox, they do enjoy bumping versions numbers sans any true or radical improvement. Just my 2?. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ Have you ever considered the irony in the fact that we celebrate Christ's birthday every year by ignoring the fact that he would have celebrated Hanukkah? From stephan at rename-it.nl Thu Dec 22 13:59:19 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 22 Dec 2011 12:59:19 +0100 Subject: [Dovecot] Global Sieve Script Includes no longer works with 056934abd2ef In-Reply-To: References: Message-ID: <4EF31B97.5070906@rename-it.nl> On 12/22/2011 12:29 PM, Thomas Leuxner wrote: > Latest Dovecot Auto-Build 2.1.rc1-0~auto+42 (056934abd2ef) fails to include global Sieve Scripts. Not sure this is specific to Stephan's Repository. Rolling back to older version restores functionality. > > ==> /var/log/dovecot/dovecot.log<== > Dec 22 12:13:52 spectre dovecot: lmtp(32246): Connect from local > Dec 22 12:13:52 spectre dovecot: lmtp(32246, tlx at leuxner.net): Error: jo99GvAQ8072fQAAqZii3w: sieve: failed to open script /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve (view user logfile /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve.log for more information) > Dec 22 12:13:52 spectre dovecot: lmtp(32246, tlx at leuxner.net): jo99GvAQ8072fQAAqZii3w: msgid=<4EF310E0.6030006 at Media-Brokers.com>: saved mail to INBOX > > $ cat /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve.log > sieve: info: started log at Dec 22 12:13:52. > main_script: line 2: error: included global script 'global.sieve' does not exist. > main_script: error: validation failed. The fact that << include "global.sieve"; >> and << include "global"; >> would map to the same script file `global.sieve' is not intended behavior and I fixed this in a recent change: http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/66b7b1636c8c I had the impression that this was already documented/announced in the migration instructions from CMUSieve, but apparently these don't tell the whole story: http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration#From_CMUSieve_.28Dovecot_v1.0.2BAC8-v1.1.29 That is why I didn't explicitly announce this change. The .sieve extension only has significance in the filesystem (to make sure that the Sieve interpreter refuses to open anything but Sieve scripts). When specified in the Sieve language, that extension would just be part of the script name, meaning that << include "global.sieve"; >> maps to `global.sieve.sieve' on the filesystem. So, in your case using << include :global "global"; >> should fix it. Because it is technically a bugfix, it is also due to be released for Dovecot v2.0. Is it a big problem to change your include instructions? Is anyone else depending on this unintended feature? Regards, Stephan. From tlx at leuxner.net Thu Dec 22 14:06:59 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Thu, 22 Dec 2011 13:06:59 +0100 Subject: [Dovecot] Global Sieve Script Includes no longer works with 056934abd2ef In-Reply-To: <4EF31B97.5070906@rename-it.nl> References: <4EF31B97.5070906@rename-it.nl> Message-ID: <78911E18-84E8-4CB2-A350-B7FA9B7802E3@leuxner.net> Am 22.12.2011 um 12:59 schrieb Stephan Bosch: > That is why I didn't explicitly announce this change. The .sieve extension only has significance in the filesystem (to make sure that the Sieve interpreter refuses to open anything but Sieve scripts). When specified in the Sieve language, that extension would just be part of the script name, meaning that << include "global.sieve"; >> maps to `global.sieve.sieve' on the filesystem. So, in your case using << include :global "global"; >> should fix it. > > Because it is technically a bugfix, it is also due to be released for Dovecot v2.0. > > Is it a big problem to change your include instructions? Is anyone else depending on this unintended feature? Not a biggie at all to fix on my end. And thanks for the explanation. Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 163 bytes Desc: Message signed with OpenPGP using GPGMail URL: From p.heinlein at heinlein-support.de Thu Dec 22 14:34:05 2011 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Thu, 22 Dec 2011 13:34:05 +0100 Subject: [Dovecot] LSUB and subscribed folders Message-ID: <201112221334.06087.p.heinlein@heinlein-support.de> I have a strange behavior on a customer's server and I don't understand that: User "bar" has some folders and one shared folder from "foo" if I use the "LIST"-command, which should list AFAIK *all* folders: # telnet localhost 143 a login bar xxxx a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk] Logged in a LIST "" "*" * LIST (\HasNoChildren) "/" "Gesendete Objekte" * LIST (\HasNoChildren) "/" "Papierkorb" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "Entw&APw-rfe" * LIST (\HasNoChildren) "/" "Spam" * LIST (\Noselect \HasChildren) "/" "shared/foo" * LIST (\HasNoChildren) "/" "shared/foo/INBOX" a OK List completed. Using the LSUB-command, which should only list subscribed folders I can see some more shared folders. AFAIK the output of LSUB must be always less then LIST: a LSUB "" "*" * LSUB () "/" "Entw&APw-rfe" * LSUB () "/" "Gesendete Objekte" * LSUB () "/" "INBOX" * LSUB () "/" "Papierkorb" * LSUB () "/" "Spam" * LSUB () "/" "Trash" * LSUB (\Noselect) "/" "shared/amerkel" * LSUB () "/" "shared/foo/Papierkorb/Ungelesene Mails" * LSUB () "/" "shared/foo/INBOX" * LSUB () "/" "shared/foo/INBOX/abc/Unterebene 1" * LSUB () "/" "shared/foo/INBOX/abc/Unterebene 1/Test6789" * LSUB () "/" "shared/foo/INBOX/abc/Unterebene 1/Test Unterornder" * LSUB () "/" "shared/foo/INBOX/abc/Unterebene 1/Tsfgnksfgnk" a OK Lsub completed. a logout * BYE Logging out a OK Logout completed. And why is /shared/foo/INBOX listed with "HasNoChildren"? IMHO that's looking buggy. And, btw: Looks like's not possible to use the "doveadm"-command to get a list of a user's complete folder list. Maybe "doveadm mailbox" should get some extra parameters to geht all folders / only subscribe folders / only shared folders: # doveadm mailbox list -u bar Gesendete Objekte Papierkorb INBOX Trash Entw?rfe Spam -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030/405051-42 Fax: 030/405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From tmtalpey at gmail.com Thu Dec 22 14:42:50 2011 From: tmtalpey at gmail.com (Tom Talpey) Date: Thu, 22 Dec 2011 07:42:50 -0500 Subject: [Dovecot] Global Sieve Script Includes no longer works with 056934abd2ef In-Reply-To: <78911E18-84E8-4CB2-A350-B7FA9B7802E3@leuxner.net> References: <4EF31B97.5070906@rename-it.nl> <78911E18-84E8-4CB2-A350-B7FA9B7802E3@leuxner.net> Message-ID: <4EF325CA.6050207@gmail.com> On 12/22/2011 7:06 AM, Thomas Leuxner wrote: > > Am 22.12.2011 um 12:59 schrieb Stephan Bosch: > >> That is why I didn't explicitly announce this change. The .sieve extension only has significance in the filesystem (to make sure that the Sieve interpreter refuses to open anything but Sieve scripts). When specified in the Sieve language, that extension would just be part of the script name, meaning that<< include "global.sieve";>> maps to `global.sieve.sieve' on the filesystem. So, in your case using<< include :global "global";>> should fix it. >> >> Because it is technically a bugfix, it is also due to be released for Dovecot v2.0. >> >> Is it a big problem to change your include instructions? Is anyone else depending on this unintended feature? > > Not a biggie at all to fix on my end. And thanks for the explanation. Not a biggie here either, but my "include"s specified the full filename too. I guess I never read the CMUSieve migration page, since my scripts weren't migrated. So I suspect this will trip up other installations. Good to know, thanks! From hydrapolic at gmail.com Thu Dec 22 16:08:35 2011 From: hydrapolic at gmail.com (hydra) Date: Thu, 22 Dec 2011 15:08:35 +0100 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> Message-ID: Hello Timo, thank you for the reply. I was suspecting the same. However: - the machine runs under Vmware, - I've tried 3 different kernel versions, - I've tried 3 different SCSI controllers. All same results. On Wed, Dec 21, 2011 at 6:16 PM, Timo Sirainen wrote: > On 21.12.2011, at 18.38, hydra wrote: > > > I suspect, that dovecot v2.0.16 under Linux (tested on Gentoo 3.0.4 > > Hardened, Gentoo 3.0.6, Gentoo 3.1.4) causes 100% cpu utilization when > > index.cache is broken and doveadm is lanched. Dovecot uses LDAP as the > > userdb and provides IMAP and LDA. Because each user has a quota, the > > doveadm's expunge functionality is used to get rid of old trashed mail. > > > > The mail log: > > Dec 12 07:38:59 www dovecot: imap(user): Error: Corrupted index cache > file > > /var/data/mail/domain.tld/user/mail/dovecot.index.cache: invalid record > size > > OK.. > > > Mail is stored on ext4 and flush will use all of the CPU capacity like > this: > > load average: 4.00, 4.01, 4.05 > > > > ps: > > root 26401 98.2 0.0 0 0 ? R Dec20 1369:49 > > [flush-253:1] > > That's a kernel process.. > > > I suspect, that this is something to do with Dovecot, because after > > deleting the dovecot.index.cache file, everything went back to normal. > When > > this happens, I cannot unmount the drive nor a system reboot works. > > That's a kernel bug.. > > I think you're thinking it the wrong way: Dovecot isn't causing your > system to break. Your system is causing Dovecot to break. Faulty hardware > or faulty kernel. From ajb2 at mssl.ucl.ac.uk Thu Dec 22 16:11:09 2011 From: ajb2 at mssl.ucl.ac.uk (Alan Brown) Date: Thu, 22 Dec 2011 14:11:09 +0000 Subject: [Dovecot] OS/Distro wars Message-ID: <4EF33A7D.9060800@mssl.ucl.ac.uk> DO NOT FEED THE TROLLS From stan at hardwarefreak.com Thu Dec 22 16:49:56 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Thu, 22 Dec 2011 08:49:56 -0600 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> Message-ID: <4EF34394.5080806@hardwarefreak.com> On 12/22/2011 8:08 AM, hydra wrote: > Hello Timo, thank you for the reply. I was suspecting the same. However: > - the machine runs under Vmware, > - I've tried 3 different kernel versions, > - I've tried 3 different SCSI controllers. > > All same results. dmesg output? Log errors? Is your EXT4 filesystem on a VMFS volume or an RDM (SAN LUN)? > On Wed, Dec 21, 2011 at 6:16 PM, Timo Sirainen wrote: > >> On 21.12.2011, at 18.38, hydra wrote: >> That's a kernel process.. >> >>> I suspect, that this is something to do with Dovecot, because after >>> deleting the dovecot.index.cache file, everything went back to normal. >> When >>> this happens, I cannot unmount the drive nor a system reboot works. System (host machine) reboot, or virtual machine reboot doesn't fix the problem? FYI, Linux doesn't unmount drives, it unmounts filesystems. I'd say you may have a problem with your VMFS volume or RDM, or maybe just your EXT4 filesystem. Have you run an fsck on it? What result? Or, as Timo suggests, could be a kernel bug. Or an interaction of these low level layers causing a problem. If you can't unmount a filesystem, that has nothing to do with Dovecot, and points to a much larger, more critical, problem. Do you have this problem when booting an older kernel? Say 2.6.32? 2.6.37? >> That's a kernel bug.. >> >> I think you're thinking it the wrong way: Dovecot isn't causing your >> system to break. Your system is causing Dovecot to break. Faulty hardware >> or faulty kernel. -- Stan From martin at ilait.se Thu Dec 22 17:33:31 2011 From: martin at ilait.se (Martin Abrahamsson) Date: Thu, 22 Dec 2011 16:33:31 +0100 Subject: [Dovecot] Limit maximum connections for user/IP on proxy Message-ID: <4EF34DCB.6090206@ilait.se> Hi, Is it possible to limit the maximum number of IMAP connections allowed for a user from each IP address, on the proxy server instead of on the mail store server? mail_max_userip_connections works well when the client is connection to the mail store without proxy, but when using proxies the POP/IMAP server will register the remote IP (rip) as the proxy server's IP address - thus a low limit will be reached quite easily. Thanks -- Martin Abrahamsson From alessio at skye.it Thu Dec 22 17:36:07 2011 From: alessio at skye.it (Alessio Cecchi) Date: Thu, 22 Dec 2011 16:36:07 +0100 Subject: [Dovecot] Patch for dovecot 1.2.16 (and .17) for vpopmail module Message-ID: Hi Timo, I love dovecot but I love also vpopmail and its functions for manage user limits (via vmoduser). Unfortunately in dovecot 1.2.x auth default set to use "vpopmail" is unable to apply this limits. Only if used with checkpassword limits works fine but in the dovecot.log only user (without @domain) is logged. So, based on the code of dovecot 2.0, I have created this very simple patch that correct this bug. Thanks for consideration -- Alessio Cecchi is: on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi Linux -> http://www.cecchi.biz/ Hosting Linux -> http://www.hosting-linux.it @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it -------------- next part -------------- A non-text attachment was scrubbed... Name: patch-dovecot-alessice-1.2.16.txt Type: text/x-c Size: 1180 bytes Desc: not available URL: From tss at iki.fi Thu Dec 22 17:37:39 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 22 Dec 2011 17:37:39 +0200 Subject: [Dovecot] Limit maximum connections for user/IP on proxy In-Reply-To: <4EF34DCB.6090206@ilait.se> References: <4EF34DCB.6090206@ilait.se> Message-ID: <78C75C8E-E0C4-408E-BE81-8D74094B182F@iki.fi> On 22.12.2011, at 17.33, Martin Abrahamsson wrote: > mail_max_userip_connections works well when the client is connection to the mail store without proxy, but when using proxies the POP/IMAP server will register the remote IP (rip) as the proxy server's IP address - thus a low limit will be reached quite easily. See login_trusted_networks setting. From hydrapolic at gmail.com Thu Dec 22 18:06:47 2011 From: hydrapolic at gmail.com (hydra) Date: Thu, 22 Dec 2011 17:06:47 +0100 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: <4EF34394.5080806@hardwarefreak.com> References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> Message-ID: On Thu, Dec 22, 2011 at 3:49 PM, Stan Hoeppner wrote: > On 12/22/2011 8:08 AM, hydra wrote: > > Hello Timo, thank you for the reply. I was suspecting the same. However: > > - the machine runs under Vmware, > > - I've tried 3 different kernel versions, > > - I've tried 3 different SCSI controllers. > > > > All same results. > > dmesg output? Log errors? > Nothing there > Is your EXT4 filesystem on a VMFS volume or an RDM (SAN LUN)? > VMFS > > > > On Wed, Dec 21, 2011 at 6:16 PM, Timo Sirainen wrote: > > > >> On 21.12.2011, at 18.38, hydra wrote: > > >> That's a kernel process.. > >> > >>> I suspect, that this is something to do with Dovecot, because after > >>> deleting the dovecot.index.cache file, everything went back to normal. > >> When > >>> this happens, I cannot unmount the drive nor a system reboot works. > > System (host machine) reboot, or virtual machine reboot doesn't fix the > problem? FYI, Linux doesn't unmount drives, it unmounts filesystems. > > After the virtual machine reboot, the CPU usage is normal again, but just until doveadm is launched again (it was run from cron). Sorry for the partition/drive terminology mess up. > I'd say you may have a problem with your VMFS volume or RDM, or maybe > just your EXT4 filesystem. Have you run an fsck on it? What result? > A normal system reboot wasn't possible, because the ext4 fs wasn't unmounted (and it wasn't possible to unmount the fs nor run sync - both locked up) and thus I had to reboot from the vSphere Client. After the reboot, fsck placed the fs to a consistent state, however the problem occurred the next morning, when doveadm from the cron was run again. So a fsck didn't help. > Or, as Timo suggests, could be a kernel bug. Or an interaction of these > low level layers causing a problem. If you can't unmount a filesystem, > that has nothing to do with Dovecot, and points to a much larger, more > critical, problem. > > Do you have this problem when booting an older kernel? Say 2.6.32? > 2.6.37? > > The oldest available kernel is 2.6.32 so I'm going to test it. Thank you :) > >> That's a kernel bug.. > >> > >> I think you're thinking it the wrong way: Dovecot isn't causing your > >> system to break. Your system is causing Dovecot to break. Faulty > hardware > >> or faulty kernel. > > -- > Stan > > From tss at iki.fi Thu Dec 22 18:13:46 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 22 Dec 2011 18:13:46 +0200 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> Message-ID: <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> On 22.12.2011, at 18.06, hydra wrote: > After the virtual machine reboot, the CPU usage is normal again, but just > until doveadm is launched again (it was run from cron). Sorry for the > partition/drive terminology mess up. So it's reproducible? You could see if you can reproduce it by simply reading the file(s) that are causing problems. Like with zsh: cat **/* > /dev/null From slusarz at curecanti.org Thu Dec 22 21:50:01 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Thu, 22 Dec 2011 12:50:01 -0700 Subject: [Dovecot] LSUB and subscribed folders In-Reply-To: <201112221334.06087.p.heinlein@heinlein-support.de> References: <201112221334.06087.p.heinlein@heinlein-support.de> Message-ID: <20111222125001.Horde.-uOJAYF5lbhO84npZMNi2SA@bigworm.curecanti.org> Quoting Peer Heinlein : > Using the LSUB-command, which should only list subscribed folders I can see > some more shared folders. AFAIK the output of LSUB must be always less then > LIST: No, it is exactly the opposite - LSUB can potentially list MORE mailboxes than exist on the server. LSUB only provides the list of mailboxes that have been marked as subscribed. It is quite possible to mark a mailbox as subscribed and then delete it, in which case LSUB must continue to report that mailbox. See RFC 3501 [6.3.9]: The server MUST NOT unilaterally remove an existing mailbox name from the subscription list even if a mailbox by that name no longer exists. michael From p.heinlein at heinlein-support.de Thu Dec 22 23:01:41 2011 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Thu, 22 Dec 2011 22:01:41 +0100 Subject: [Dovecot] crash on shared folders if remote user has empty $home Message-ID: <201112222201.41781.p.heinlein@heinlein-support.de> Hi, in seldom cirumstances it's possible that the imap-process is crashing without write something usefule into the logfile. a) User foo exists, is happy and everything's alright b) He had a shared folder given from bar c) In our setup we have mailforwarding adresses without a valid $home in LDAP c) if user bar is changed from a user with into a mailforwarding adress, the user foo won't have an entry for $home any more, but still exists in LDAP. d) If foo logs in, dovecot's exploring the shared folders given from the non-existing user bar. But bar's entry in LDAP doesn't have $home any more. imap crashes and closes the TCP-connection immediately. root at dobby2:/etc/dovecot# telnet xxxxxxxx 143 Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE ACL UIDPLUS STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5 AUTH=DIGEST-MD5] Dovecot ready. Testing. a LOGIN foo xxxxx a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL UIDPLUS QUOTA ACL RIGHTS=texk] Logged in a LIST "" "*" * BYE Internal error occurred. Refer to server log for more information. Connection closed by foreign host. Dec 22 21:57:41 dobby2 dovecot: master: Error: service(imap): child 18095 killed with signal 11 (core dumps disabled) e) This happens if mail_location=mdbox:%%h/mdbox is set in the shared folder namespace. If I set "mail_location=auto:" then Dovecot logs an error message, but is still possible to continue without any problems. Dec 22 21:33:59 dobby2 dovecot: imap(bar): Error: Namespace 'shared/bar/': Autodetection failed for auto: (home=/mail/foo/) -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030 / 40 50 51 - 0 Fax: 030 / 40 50 51 - 19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From p.heinlein at heinlein-support.de Thu Dec 22 23:07:16 2011 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Thu, 22 Dec 2011 22:07:16 +0100 Subject: [Dovecot] crash on shared folders if remote user has empty $home In-Reply-To: <201112222201.41781.p.heinlein@heinlein-support.de> References: <201112222201.41781.p.heinlein@heinlein-support.de> Message-ID: <201112222207.17006.p.heinlein@heinlein-support.de> Am Donnerstag, 22. Dezember 2011, 22:01:41 schrieb Peer Heinlein: Hi, > e) This happens if mail_location=mdbox:%%h/mdbox is set in the shared > folder namespace. If I set "mail_location=auto:" then Dovecot logs an Sorry, it's mail= and not mail_location= in the shared namespace area. Peer -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030 / 40 50 51 - 0 Fax: 030 / 40 50 51 - 19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From user+dovecot at localhost.localdomain.org Thu Dec 22 23:37:27 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Thu, 22 Dec 2011 22:37:27 +0100 Subject: [Dovecot] file_dotlock_create(~/.dovecot.lda-dupes) failed: No such file or directory ... In-Reply-To: <4EF3070C.1040704@univ-orleans.fr> References: <4EF3070C.1040704@univ-orleans.fr> Message-ID: <4EF3A317.4050209@localhost.localdomain.org> On 12/22/2011 11:31 AM LE NORCY Arnaud wrote: > > Dec 22 10:18:16 mailserver dovecot: deliver(user324): > file_dotlock_create(~/.dovecot.lda-dupes) failed: No such file or directory ^ http://wiki.dovecot.org/VirtualUsers/Home Regards, Pascal -- The trapper recommends today: cafefeed.1135622 at localdomain.org From blmatthews at gmail.com Fri Dec 23 00:21:49 2011 From: blmatthews at gmail.com (Brian L. Matthews) Date: Thu, 22 Dec 2011 14:21:49 -0800 Subject: [Dovecot] Received date no longer email date? Message-ID: <4EF3AD7D.40203@gmail.com> I just upgrade from dovecot 1.2 to dovecot 2.0.16. I use dovecot as a local IMAP server to archive email from my corporate email account (on Exchange). I don't have any automated archiving, I just periodically move messages from my Exchange inbox to the IMAP inbox. I'm on Mac OS X 10.6.8 using Entourage as my mail client. In the previous version of dovecot, the Received date of the email was preserved when I moved a message, but it's not in 2.0.16, it's set to the date and time I move the message. If I open a message, the date displayed is the date on the message as expected. I converted my config from 1.2 with $ doveconf -n -c dovecot.conf > dovecot-2.conf It spit out various warnings but, once I'd created a dovenull user, seemed to work fine. Here's my configuration info: $ dovecot --version 2.0.16 $ dovecot -n # 2.0.16: /usr/local/etc/dovecot/dovecot.conf # OS: Darwin 10.8.0 i386 disable_plaintext_auth = no listen = 127.0.0.1 log_path = /var/log/dovecot.log mail_location = maildir:~/Maildir passdb { args = login driver = pam } service auth { user = root } service imap-login { process_limit = 16 } service imap { process_limit = 64 } ssl = no userdb { driver = passwd } I'd like to get it back to preserving the Received date, any help you can provide will be appreciated. Brian From noel.butler at ausics.net Fri Dec 23 00:49:30 2011 From: noel.butler at ausics.net (Noel Butler) Date: Fri, 23 Dec 2011 08:49:30 +1000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> <1324540348.16562.11.camel@tardis> <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> Message-ID: <1324594170.5841.5.camel@tardis> On Thu, 2011-12-22 at 09:22 +0100, Cor Bosman wrote: > > This also is not the kernel list, since updating to a kernel released in > > the 21st century Cor's issue has gone away, so this thread is now rather > > entirely pointless on the Dovecot list. So I'll my participation in > > Actually, it hasn't. For the last few days we've been trying to pinpoint the problem by running half a dozen servers with different kernels and options. This 'kernel released in the 20th century' we have this problem with is the current stable kernel for debian. So instead of starting a distro war (and I thought canon/nikon, mac/pc were bad), lets be a bit more constructive. Plenty of people use the stable debian release. > Ahh OK, your previous message said it was resolved, did the traceback show anything? > It's happening on about half of our imap servers (20 or so), but on none of our other debian servers (hundreds). So it's not so weird to suspect a dovecot link. But it looks like it may be a driver issue on a specific range of hardware we use. > maybe install a slackware or gentoo box and add it into the farm and see if same problem exists there as well, if so, clearly dovecot, if not, clearly debian, its why I still keep a RHEL box handy, it sits attached to the "dev" unit until I need it to assist to prove/disprove something. All the best. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From noel.butler at ausics.net Fri Dec 23 00:51:50 2011 From: noel.butler at ausics.net (Noel Butler) Date: Fri, 23 Dec 2011 08:51:50 +1000 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <20111222063130.6c45f3a2@scorpio> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> <20111222063130.6c45f3a2@scorpio> Message-ID: <1324594310.5841.7.camel@tardis> On Thu, 2011-12-22 at 06:31 -0500, Jerry wrote: > On Thu, 22 Dec 2011 06:13:36 -0500 > Charles Marcus articulated: > > > On 2011-12-21 11:18 PM, Simon Brereton > > wrote: > > > It would be interesting to chart the number of threads caused by > > > each distro. I don't know who would have the least, but I suspect > > > gentoo and centos would be out in front, > > > > Been using gentoo since about 2003 and never looked back... best and > > easiest distro to maintain, bar none, and the best support and > > documentation too. > > I have been a FreeBSD user since 2000. Dovecot and Postfix run well on > the OS. Postfix should since it was developed on FreeBSD. Other than > that though, most other apps require extensive patching in order to get > them to work. And when it comes to drivers for modern devices, you can > pretty much forget about it. After more than five years they still have > not developed drivers for wireless "N" protocol devices. However, like > Firefox, they do enjoy bumping versions numbers sans any true or > radical improvement. > > Just my 2?. > Tis a shame that, freebsd used to leave linux behind in resource management, but in last 5 or so years, its been other way around and I kinda agree its like "time stood still" -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From noel.butler at ausics.net Fri Dec 23 00:53:59 2011 From: noel.butler at ausics.net (Noel Butler) Date: Fri, 23 Dec 2011 08:53:59 +1000 Subject: [Dovecot] OS/Distro wars In-Reply-To: <4EF33A7D.9060800@mssl.ucl.ac.uk> References: <4EF33A7D.9060800@mssl.ucl.ac.uk> Message-ID: <1324594439.5841.9.camel@tardis> On Thu, 2011-12-22 at 14:11 +0000, Alan Brown wrote: > DO NOT FEED THE TROLLS > > another goose who think he's god... if you dont like a thread, dont read it, especially since its been marked as OT for past 10 or posts, ya moron. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From michael.abbott at apple.com Fri Dec 23 01:10:52 2011 From: michael.abbott at apple.com (Mike Abbott) Date: Thu, 22 Dec 2011 17:10:52 -0600 Subject: [Dovecot] proxying, SSL, and client certificate Message-ID: How do I configure dovecot-2.0.x to present a client SSL certificate when proxying? If dovecot on server1.example.com has: passdb { driver = static args = proxy=y host=server2.example.com nopassword=y ssl=yes } and dovecot on server2.example.com has: ssl_verify_client_cert = yes auth_ssl_require_client_cert = yes then when a client connects to server1 and authenticates, a connection is established to server2 but the SSL handshake fails because server1 doesn't present a client certificate. I don't see where ssl_client_ctx is tied to a client certificate in ssl-proxy-openssl.c. Thanks. From pasek at valbek.cz Fri Dec 23 01:11:58 2011 From: pasek at valbek.cz (pasek at valbek.cz) Date: Fri, 23 Dec 2011 00:11:58 +0100 Subject: [Dovecot] =?utf-8?b?RG92b2xlbsOh?= Message-ID: <55354f37803b3d0dff41d29bbe02e354-1324595518@mail.valbek.cz> Dobr? den, od 23.12. do 30.12. jsem na dovolen?. V p??pad? nutnosti volejte na mobil. S pozdravem Bc. Ladislav Pa?ek vedouc? odd?len? IT a vizualizace mobil: +420 776 140 489 e-mail: pasek at valbek.cz Valbek, s.r.o. Va?urova 505/17, 460 02 Liberec 3 tel./fax: +420 485 103 336, +420 485 103 346 www.valbek.cz From dmiller at amfes.com Fri Dec 23 09:10:53 2011 From: dmiller at amfes.com (Daniel L. Miller) Date: Thu, 22 Dec 2011 23:10:53 -0800 Subject: [Dovecot] Lucene vs Solr with 2.1 single server Message-ID: For a single server, is the Lucene backend now "better" than running a Solr server? -- Daniel From ronleach at tesco.net Fri Dec 23 11:49:10 2011 From: ronleach at tesco.net (Ron Leach) Date: Fri, 23 Dec 2011 09:49:10 +0000 Subject: [Dovecot] =?windows-1252?q?Dovolen=E1?= In-Reply-To: <55354f37803b3d0dff41d29bbe02e354-1324595518@mail.valbek.cz> References: <55354f37803b3d0dff41d29bbe02e354-1324595518@mail.valbek.cz> Message-ID: <4EF44E96.2060401@tesco.net> On 22/12/2011 23:11, pasek at valbek.cz wrote: > > Dobr?? den, > > od 23.12. do 30.12. jsem na dovolen??. V p????pad?? nutnosti volejte na mobil. > > S pozdravem > Ladislav, sure, we'll reach you on your mobile if we need you. Enjoy the break; will you be doing some ski-ing? Ron From hydrapolic at gmail.com Fri Dec 23 12:12:07 2011 From: hydrapolic at gmail.com (hydra) Date: Fri, 23 Dec 2011 11:12:07 +0100 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> Message-ID: Yes, it is reproducible. About the file, I have tarred up the original maildir before I deleted the dovecot.index.cache, so when I try to bring in the original file, a 'cat' does no harm. Moreover, I've tried to do this will all files on the virtual machine, same results - no harm. On Thu, Dec 22, 2011 at 5:13 PM, Timo Sirainen wrote: > On 22.12.2011, at 18.06, hydra wrote: > > > After the virtual machine reboot, the CPU usage is normal again, but just > > until doveadm is launched again (it was run from cron). Sorry for the > > partition/drive terminology mess up. > > So it's reproducible? You could see if you can reproduce it by simply > reading the file(s) that are causing problems. Like with zsh: cat **/* > > /dev/null > > From stan at hardwarefreak.com Fri Dec 23 12:36:46 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 23 Dec 2011 04:36:46 -0600 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> Message-ID: <4EF459BE.7020104@hardwarefreak.com> On 12/23/2011 4:12 AM, hydra wrote: > Yes, it is reproducible. > > About the file, I have tarred up the original maildir before I deleted the > dovecot.index.cache, so when I try to bring in the original file, a 'cat' > does no harm. Moreover, I've tried to do this will all files on the virtual > machine, same results - no harm. Is selinux running? If so, turn it off and see if that helps. And turn off anything/everything else on this Linux VM that's not running on the other Dovecot VMs you mentioned are working properly. Let's do some process of elimination here. -- Stan From p at state-of-mind.de Fri Dec 23 13:46:19 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Fri, 23 Dec 2011 12:46:19 +0100 Subject: [Dovecot] =?utf-8?b?RG92b2xlbsOh?= In-Reply-To: <4EF44E96.2060401@tesco.net> References: <55354f37803b3d0dff41d29bbe02e354-1324595518@mail.valbek.cz> <4EF44E96.2060401@tesco.net> Message-ID: <20111223114619.GD2301@state-of-mind.de> * Ron Leach : > On 22/12/2011 23:11, pasek at valbek.cz wrote: > > > >Dobr?? den, > > > >od 23.12. do 30.12. jsem na dovolen??. V p????pad?? nutnosti volejte na mobil. > > > >S pozdravem > > > Ladislav, sure, we'll reach you on your mobile if we need you. > Enjoy the break; will you be doing some ski-ing? Thanks for the translation! :) p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From martin at ilait.se Fri Dec 23 16:41:30 2011 From: martin at ilait.se (Martin Abrahamsson) Date: Fri, 23 Dec 2011 15:41:30 +0100 Subject: [Dovecot] Limit maximum connections for user/IP on proxy In-Reply-To: <78C75C8E-E0C4-408E-BE81-8D74094B182F@iki.fi> References: <4EF34DCB.6090206@ilait.se> <78C75C8E-E0C4-408E-BE81-8D74094B182F@iki.fi> Message-ID: <4EF4931A.8080308@ilait.se> On 12/22/2011 04:37 PM, Timo Sirainen wrote: > See login_trusted_networks setting. Didn't realize that defining proxies in login_trusted_networks would display the rip at the mail store. Problem solved, thanks for the prompt reply! From achekalin at lazurit.com Fri Dec 23 18:00:48 2011 From: achekalin at lazurit.com (Alexander Chekalin) Date: Fri, 23 Dec 2011 19:00:48 +0300 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP Message-ID: <4EF4A5B0.4040302@lazurit.com> Hello, I'm now dealing with funny problem. I try to use Dovecot (2.1.rc1, actually) and mbox format to store old mailing, to keep logic of "one folder = one file". If I'd choose Maildir, I'd be able to create hierarchical folders (like "OldMail -> Maillists -> Dovecot"), and in fact on disk such a folders would be stored as real folders with dots in their names. In PHP it is easy to create with "imap_createmailbox()" function, I'd simple fire it 3 times (for "OldMail", for "OldMail.Maillists" and for "OldMail.Maillists.Dovecot"). But when I do the same with mbox, in fact it creates separate files (indeed, named "OldMail", "OldMail.Maillists" and "OldMail.Maillists.Dovecot") instead of creating filesystem folders ("OldMail/Maillists/Dovecot"). PHP is not guilty, Thunderbird won't create such folders as well. I can only create folders myself (say, with mkdir in the shell), chown it, and the it perfectly works in IMAP. Now I just wanted to know, are there any way to create IMAP-folders and subfolders using standard IMAP functionality? Thank you, Alexander From hydrapolic at gmail.com Fri Dec 23 19:08:02 2011 From: hydrapolic at gmail.com (hydra) Date: Fri, 23 Dec 2011 18:08:02 +0100 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: <4EF459BE.7020104@hardwarefreak.com> References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> <4EF459BE.7020104@hardwarefreak.com> Message-ID: Selinux wasn't running. I can reproduce the problem with this setup: - restore the maildir with the broken index.cache - run `/usr/bin/doveadm -D expunge -A mailbox Trash savedbefore 1w` in an infinite loop - use horde webmail to access the mail with IMAP - randomly display messages I could reproduce the problem on: Linux-2.6.37-hardened-r7 Linux-2.6.39-hardened-r8 Linux-3.0.4-hardened-r5 Linux-3.0.6-gentoo Linux-3.1.4-gentoo However I failed to reproduce the problem on: Linux-2.6.36-hardened-r9 So it seems it was introduced in 2.6.37. I'm going to inspect it later on. By wishing you a God blessed merry Christmas I thank you for the support ;) On Fri, Dec 23, 2011 at 11:36 AM, Stan Hoeppner wrote: > On 12/23/2011 4:12 AM, hydra wrote: > > Yes, it is reproducible. > > > > About the file, I have tarred up the original maildir before I deleted > the > > dovecot.index.cache, so when I try to bring in the original file, a 'cat' > > does no harm. Moreover, I've tried to do this will all files on the > virtual > > machine, same results - no harm. > > Is selinux running? If so, turn it off and see if that helps. And turn > off anything/everything else on this Linux VM that's not running on the > other Dovecot VMs you mentioned are working properly. Let's do some > process of elimination here. > > -- > Stan > > From e-frog at gmx.de Fri Dec 23 19:33:32 2011 From: e-frog at gmx.de (e-frog) Date: Fri, 23 Dec 2011 18:33:32 +0100 Subject: [Dovecot] 2.1.rc1 (056934abd2ef): virtual plugin mailbox search pattern Message-ID: <4EF4BB6C.3050902@gmx.de> Hello Timo, With dovecot 2.1.rc1 (056934abd2ef) there seems to be something wrong with virtual plugin mailbox search patterns. I'm using a virtual mailbox 'unread' with the following dovecot-virtual file $ cat dovecot-virtual * unseen For testing propose I created the following folders with each containing one unread message INBOX, INBOX/level1 and INBOX/level1/level2 2.1.rc1 (056934abd2ef) 1 LIST "" "*" * LIST (\HasChildren) "/" "INBOX" * LIST (\HasChildren) "/" "INBOX/level1" * LIST (\HasNoChildren) "/" "INBOX/level1/level2" * LIST (\HasChildren) "/" "virtual" * LIST (\HasNoChildren) "/" "virtual/unread" 1 OK List completed. 2 STATUS "INBOX" (UNSEEN) * STATUS "INBOX" (UNSEEN 1) 2 OK Status completed. 3 STATUS "INBOX/level1" (UNSEEN) * STATUS "INBOX/level1" (UNSEEN 1) 3 OK Status completed. 4 STATUS "INBOX/level1/level2" (UNSEEN) * STATUS "INBOX/level1/level2" (UNSEEN 1) 4 OK Status completed. 5 STATUS "virtual/unread" (UNSEEN) * STATUS "virtual/unread" (UNSEEN 1) 5 OK Status completed. Result: virtual/unread shows only 1 unseen message. Further tests showed it's the one from INBOX. The mails from the deeper levels are not found. Downgrading to 2.0.16 restores the correct behavior: 1 LIST "" "*" * LIST (\HasChildren) "/" "INBOX" * LIST (\HasChildren) "/" "INBOX/level1" * LIST (\HasNoChildren) "/" "INBOX/level1/level2" * LIST (\HasChildren) "/" "virtual" * LIST (\HasNoChildren) "/" "virtual/unread" 1 OK List completed. 2 STATUS "INBOX" (UNSEEN) * STATUS "INBOX" (UNSEEN 1) 2 OK Status completed. 3 STATUS "INBOX/level1" (UNSEEN) * STATUS "INBOX/level1" (UNSEEN 1) 3 OK Status completed. 4 STATUS "INBOX/level1/level2" (UNSEEN) * STATUS "INBOX/level1/level2" (UNSEEN 1) 4 OK Status completed. 5 STATUS "virtual/unread" (UNSEEN) * STATUS "virtual/unread" (UNSEEN 3) 5 OK Status completed. Result: virtual/unread shows 3 unseen messages as it should The namespace configuration is as following namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { location = virtual:~/virtual prefix = virtual/ separator = / subscriptions = no type = private } I've also tried this with location = virtual:~/virtual:LAYOUT=maildir++ leading to the same result. Thanks, e-frog From sottilette at rfx.it Fri Dec 23 21:20:20 2011 From: sottilette at rfx.it (sottilette at rfx.it) Date: Fri, 23 Dec 2011 20:20:20 +0100 (CET) Subject: [Dovecot] Upgrade/Migration Message-ID: Current box: CentOS 4.x (32 bit), dovecot 1.02, mbox format New box (supposed): CentOS 6.x (32/64 bit ? ), dovecot 2.04, mbox format The server have about 3.000 active users (unix users); /var/mail is about 100 GB; /home/Users about 150 GB I read the docs and searched on the net, but still request hints for planning the migration. 32/64 bit? Tricks to avoid users get all messages ...? Better first update the old server from 1.02 to 2.0x or ..? Any hints/comment appreciated ;-) Thanks, P. 1.02 dovecot.conf: ----------------------- protocols = pop3 pop3s imap imaps listen = [::] log_path = /var/log/mail/dovecot.log info_log_path = /var/log/mail/dovecot.info.log log_timestamp = "%b %d %H:%M:%S " default_mail_env = mbox:~/:INBOX=/var/mail/%u mail_full_filesystem_access = yes first_valid_uid = 100 mbox_read_locks = dotlock fcntl mbox_write_locks = dotlock fcntl auth default { mechanisms = plain passdb pam { } userdb passwd { } user = root } ----------------------- From djonas at vitalwerks.com Sat Dec 24 01:44:14 2011 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 23 Dec 2011 15:44:14 -0800 Subject: [Dovecot] Dovecot imap proxy to nginx, incompatible Message-ID: <4EF5124E.7000303@vitalwerks.com> It appears that using dovecot to proxy to nginx imap proxy doesn't work. >From tcpdump and browsing the source it appears dovecot sends, C CAPABILITY\r\nL LOGIN \r\n and nginx only responds to the CAPABILITY command. Is this a problem with dovecot sending the two commands without waiting for the first to complete or is it nginx's trouble with not handling it correctly? A quick test with a perl script confirms: #!/usr/bin/perl -w $|++; use IO::Socket; use strict; my ($host, $user, $pass) = @ARGV; my $s = new IO::Socket::INET(Proto => 'tcp', PeerAddr => $host, PeerPort => 143); die "Could not create socket $!\n" unless $s; while(<$s>) { print $_; last if /OK/; } print $s "C CAPABILITY\r\nL LOGIN $user $pass\r\n"; while(<$s>) { print $_; last if /OK/; } print $s "Q logout\r\n"; while(<$s>) { print $_; last if /OK/; } close($s); ## Output: * CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS UIDPLUS LIST-EXTENDED I18NLEVEL=1 QUOTA AUTH=PLAIN C OK completed * BYE Q OK completed From bradley.giesbrecht at gmail.com Sat Dec 24 04:28:02 2011 From: bradley.giesbrecht at gmail.com (Bradley Giesbrecht) Date: Fri, 23 Dec 2011 18:28:02 -0800 Subject: [Dovecot] sieve in sql or reporting Message-ID: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> With dovecot2 and pigeonhole sieve/managesieve is it currently possible to store sieve rules in an sql database? If not is there a way to query all accounts; looking for things like active vacation rules? Regards, Bradley Giesbrecht From stephan at rename-it.nl Sat Dec 24 06:26:24 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 24 Dec 2011 05:26:24 +0100 Subject: [Dovecot] sieve in sql or reporting In-Reply-To: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> Message-ID: <4EF55470.5040708@rename-it.nl> On 12/24/2011 3:28 AM, Bradley Giesbrecht wrote: > With dovecot2 and pigeonhole sieve/managesieve is it currently possible to store sieve rules in an sql database? Unfortunately, not yet. It is listed somewhere on the TODO list, but it does not have high priority so far. > If not is there a way to query all accounts; looking for things like active vacation rules? I'm working on an evolution of the sieve_pipe plugin called the sieve_extprograms plugin. One of the things it adds is a new action command called "execute", which may suit your needs. It will only be available for Dovecot v2.1 though. You can read the latest version of the specification here (example 4 should match your application): http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/raw-file/tip/doc/rfc/spec-bosch-sieve-extprograms.txt Regards, Stephan. From stephan at rename-it.nl Sat Dec 24 06:35:59 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 24 Dec 2011 05:35:59 +0100 Subject: [Dovecot] sieve in sql or reporting In-Reply-To: <4EF55470.5040708@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> Message-ID: <4EF556AF.8070007@rename-it.nl> On 12/24/2011 5:26 AM, Stephan Bosch wrote: > On 12/24/2011 3:28 AM, Bradley Giesbrecht wrote: >> With dovecot2 and pigeonhole sieve/managesieve is it currently >> possible to store sieve rules in an sql database? > Unfortunately, not yet. It is listed somewhere on the TODO list, but > it does not have high priority so far. > >> If not is there a way to query all accounts; looking for things like >> active vacation rules? > > I'm working on an evolution of the sieve_pipe plugin called the > sieve_extprograms plugin. One of the things it adds is a new action > command called "execute", which may suit your needs. It will only be > available for Dovecot v2.1 though. You can read the latest version of > the specification here (example 4 should match your application): > > http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/raw-file/tip/doc/rfc/spec-bosch-sieve-extprograms.txt > Oh btw, if you are looking for a way to disable vacation rules after some period of time, you can use the date extension (http://tools.ietf.org/html/rfc5260#section-4). For example: require ["date", "relational", "vacation"]; if currentdate :value "le" "date" "2011-12-09" { vacation "I'm out of office this week. I'll be back on Saturday 10th to reply to your e-mails."; } Regards, Stephan. From IcedEarthAngel at gmx.de Fri Dec 23 18:02:25 2011 From: IcedEarthAngel at gmx.de (IcedEarth) Date: Fri, 23 Dec 2011 08:02:25 -0800 (PST) Subject: [Dovecot] dovecot / postfix mail bounce problem Message-ID: <33029725.post@talk.nabble.com> Hello, i use a globalsieve rule to collect spam for all mail accounts in a specific mailbox. Here is the code: vi /var/vmail/globalsieverc require ["fileinto"]; # Move spam to junk folder if not address :is "to" "antispam at xxx.com" { if header :contains "X-Spam-Flag" ["YES"] { redirect "antispam at xxx.com"; stop; } } But the spam mails are not delivered. cat /var/log/mail.info postfix/pipe[32301]: AD8F78E2128D: to=, relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, status=bounced (mail forwarding loop for antispam at xxx.de) Why is there a loop? I don't unterstand that. Any help? Thanks! Iced -- View this message in context: http://old.nabble.com/dovecot---postfix-mail-bounce-problem-tp33029725p33029725.html Sent from the Dovecot mailing list archive at Nabble.com. From stan at hardwarefreak.com Sat Dec 24 12:31:08 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 24 Dec 2011 04:31:08 -0600 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF4A5B0.4040302@lazurit.com> References: <4EF4A5B0.4040302@lazurit.com> Message-ID: <4EF5A9EC.8090606@hardwarefreak.com> On 12/23/2011 10:00 AM, Alexander Chekalin wrote: > Hello, > > I'm now dealing with funny problem. I try to use Dovecot (2.1.rc1, > actually) and mbox format to store old mailing, to keep logic of "one > folder = one file". > > If I'd choose Maildir, I'd be able to create hierarchical folders (like > "OldMail -> Maillists -> Dovecot"), and in fact on disk such a folders > would be stored as real folders with dots in their names. In PHP it is > easy to create with "imap_createmailbox()" function, I'd simple fire it > 3 times (for "OldMail", for "OldMail.Maillists" and for > "OldMail.Maillists.Dovecot"). > > But when I do the same with mbox, in fact it creates separate files > (indeed, named "OldMail", "OldMail.Maillists" and > "OldMail.Maillists.Dovecot") instead of creating filesystem folders > ("OldMail/Maillists/Dovecot"). PHP is not guilty, Thunderbird won't > create such folders as well. I can only create folders myself (say, with > mkdir in the shell), chown it, and the it perfectly works in IMAP. > > Now I just wanted to know, are there any way to create IMAP-folders and > subfolders using standard IMAP functionality? Yes. This has been common knowledge for many years, and is covered by lots of documentation, including dovecot and tbird docs. With mbox storage, an IMAP FOLDER contains only sub folders or it contains only messages. It CANNOT contain BOTH. Thunderbird forces you to answer this question each time you create a new IMAP FOLDER in the account root tree. Surely you've seen the radio buttons in the new folder creation box. -- Stan From stan at hardwarefreak.com Sat Dec 24 12:46:58 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 24 Dec 2011 04:46:58 -0600 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> <4EF459BE.7020104@hardwarefreak.com> Message-ID: <4EF5ADA2.8080008@hardwarefreak.com> On 12/23/2011 11:08 AM, hydra wrote: > Selinux wasn't running. > > I can reproduce the problem with this setup: > > - restore the maildir with the broken index.cache > - run `/usr/bin/doveadm -D expunge -A mailbox Trash savedbefore 1w` in an > infinite loop > - use horde webmail to access the mail with IMAP > - randomly display messages > > I could reproduce the problem on: > Linux-2.6.37-hardened-r7 > Linux-2.6.39-hardened-r8 > Linux-3.0.4-hardened-r5 > Linux-3.0.6-gentoo > Linux-3.1.4-gentoo > > However I failed to reproduce the problem on: > Linux-2.6.36-hardened-r9 > > So it seems it was introduced in 2.6.37. I'm going to inspect it later on. > By wishing you a God blessed merry Christmas I thank you for the support ;) Aha, cool. Glad you're making some progress, and that you now know it's kernel related in some way, just as Timo suspected. Keep in mind it may not necessarily be a code change problem in 2.6.37 onward. Could be a compiler/linker issue. It could also be the default EXT4 journal behavior changed (I haven't checked), or something similar. Merry Christmas to you as well hydra. I don't really deserve much credit for support here. I've just nudged you in the direction you already knew you should be heading. :) Best regards, -- Stan From jerry at seibercom.net Sat Dec 24 12:53:58 2011 From: jerry at seibercom.net (Jerry) Date: Sat, 24 Dec 2011 05:53:58 -0500 Subject: [Dovecot] OT: sieve in sql or reporting In-Reply-To: <4EF556AF.8070007@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> Message-ID: <20111224055358.3818150c@scorpio> On Sat, 24 Dec 2011 05:35:59 +0100 Stephan Bosch articulated: > On 12/24/2011 5:26 AM, Stephan Bosch wrote: > > On 12/24/2011 3:28 AM, Bradley Giesbrecht wrote: > >> With dovecot2 and pigeonhole sieve/managesieve is it currently > >> possible to store sieve rules in an sql database? > > Unfortunately, not yet. It is listed somewhere on the TODO list, > > but it does not have high priority so far. > > > >> If not is there a way to query all accounts; looking for things > >> like active vacation rules? > > > > I'm working on an evolution of the sieve_pipe plugin called the > > sieve_extprograms plugin. One of the things it adds is a new action > > command called "execute", which may suit your needs. It will only > > be available for Dovecot v2.1 though. You can read the latest > > version of the specification here (example 4 should match your > > application): > > > > http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/raw-file/tip/doc/rfc/spec-bosch-sieve-extprograms.txt > > > > Oh btw, if you are looking for a way to disable vacation rules after > some period of time, you can use the date extension > (http://tools.ietf.org/html/rfc5260#section-4). For example: > > require ["date", "relational", "vacation"]; > > if currentdate :value "le" "date" "2011-12-09" { > vacation "I'm out of office this week. I'll be back on > Saturday 10th to reply to your e-mails."; > } I know this isn't strictly part of this topic; however, I was wondering if sieve had acquired the ability to "forward as attachment" a received email? I know it did not have that ability previously. It is something that I could really use. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From jerry at seibercom.net Sat Dec 24 12:57:43 2011 From: jerry at seibercom.net (Jerry) Date: Sat, 24 Dec 2011 05:57:43 -0500 Subject: [Dovecot] dovecot / postfix mail bounce problem In-Reply-To: <33029725.post@talk.nabble.com> References: <33029725.post@talk.nabble.com> Message-ID: <20111224055743.2be0a99b@scorpio> On Fri, 23 Dec 2011 08:02:25 -0800 (PST) IcedEarth articulated: > > Hello, > > i use a globalsieve rule to collect spam for all mail accounts in a > specific mailbox. > > Here is the code: > > vi /var/vmail/globalsieverc > > require ["fileinto"]; > # Move spam to junk folder > if not address :is "to" "antispam at xxx.com" { > if header :contains "X-Spam-Flag" ["YES"] { > redirect "antispam at xxx.com"; > stop; > } > } > > But the spam mails are not delivered. > > cat /var/log/mail.info > > postfix/pipe[32301]: AD8F78E2128D: to=, > relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, > status=bounced (mail forwarding loop for antispam at xxx.de) > > Why is there a loop? I don't unterstand that. This question really belongs on the Postfix forum. Please read the directions for posting on that forum first. http://www.postfix.com/DEBUG_README.html Pay attention to the "Reporting problems to postfix-users at postfix.org" section at the end of the article. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ Be frank and explicit with your lawyer ... it is his business to confuse the issue afterwards. From stephan at rename-it.nl Sat Dec 24 13:30:00 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 24 Dec 2011 12:30:00 +0100 Subject: [Dovecot] OT: sieve in sql or reporting In-Reply-To: <20111224055358.3818150c@scorpio> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> <20111224055358.3818150c@scorpio> Message-ID: <4EF5B7B8.4050504@rename-it.nl> On 12/24/2011 11:53 AM, Jerry wrote: > I know this isn't strictly part of this topic; however, I was wondering > if sieve had acquired the ability to "forward as attachment" a received > email? I know it did not have that ability previously. It is something > that I could really use. In the standard Sieve language this is still not possible. It is possible to "enclose" an e-mail, but it is explicitly not allowed to redirect something like that; it can only be stored. I still don't know why. Also, the enclose extension is not implemented for Pigeonhole so far. If you need it for a very specific task, you can try the sieve_pipe plugin for Dovecot v2.0: http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Pipe You can then write your own script that does the forward-as-attachment action. As I indicated earlier, I'm working on a more intricate plugin for Dovecot v2.1. Regards, Stephan From jerry at seibercom.net Sat Dec 24 13:54:19 2011 From: jerry at seibercom.net (Jerry) Date: Sat, 24 Dec 2011 06:54:19 -0500 Subject: [Dovecot] OT: sieve in sql or reporting In-Reply-To: <4EF5B7B8.4050504@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> <20111224055358.3818150c@scorpio> <4EF5B7B8.4050504@rename-it.nl> Message-ID: <20111224065419.5db26ee5@scorpio> On Sat, 24 Dec 2011 12:30:00 +0100 Stephan Bosch articulated: > On 12/24/2011 11:53 AM, Jerry wrote: > > I know this isn't strictly part of this topic; however, I was > > wondering if sieve had acquired the ability to "forward as > > attachment" a received email? I know it did not have that ability > > previously. It is something that I could really use. > > In the standard Sieve language this is still not possible. It is > possible to "enclose" an e-mail, but it is explicitly not allowed to > redirect something like that; it can only be stored. I still don't > know why. Also, the enclose extension is not implemented for > Pigeonhole so far. > > If you need it for a very specific task, you can try the sieve_pipe > plugin for Dovecot v2.0: > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Pipe > > You can then write your own script that does the > forward-as-attachment action. As I indicated earlier, I'm working on > a more intricate plugin for Dovecot v2.1. Thank you very much for your extremely rapid response. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From robert at schetterer.org Sat Dec 24 14:54:32 2011 From: robert at schetterer.org (Robert Schetterer) Date: Sat, 24 Dec 2011 13:54:32 +0100 Subject: [Dovecot] OT: sieve in sql or reporting In-Reply-To: <4EF5B7B8.4050504@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> <20111224055358.3818150c@scorpio> <4EF5B7B8.4050504@rename-it.nl> Message-ID: <4EF5CB88.7060208@schetterer.org> Am 24.12.2011 12:30, schrieb Stephan Bosch: > On 12/24/2011 11:53 AM, Jerry wrote: >> I know this isn't strictly part of this topic; however, I was wondering >> if sieve had acquired the ability to "forward as attachment" a received >> email? I know it did not have that ability previously. It is something >> that I could really use. > > In the standard Sieve language this is still not possible. It is > possible to "enclose" an e-mail, but it is explicitly not allowed to > redirect something like that; it can only be stored. I still don't know > why. Also, the enclose extension is not implemented for Pigeonhole so far. > > If you need it for a very specific task, you can try the sieve_pipe > plugin for Dovecot v2.0: > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Pipe > > You can then write your own script that does the forward-as-attachment > action. As I indicated earlier, I'm working on a more intricate plugin > for Dovecot v2.1. > > Regards, > > Stephan > many people would like to see "forward as attachment" in sieve but i guess there must be good tec reasons why it was not done since yet i thought about it as an advanced notify action ? that should be possible Merry X-Mas ! -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From janfrode at tanso.net Sat Dec 24 17:20:50 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Sat, 24 Dec 2011 16:20:50 +0100 Subject: [Dovecot] Compressing existing maildirs Message-ID: <20111224152050.GA3958@dibs.tanso.net> I've just enabled zlib for our users, and am looking at how to compress the existing files. The routine for doing this at http://wiki2.dovecot.org/Plugins/Zlib seems a bit complicated. What do you think about simply doing: find /var/vmail -type f -name "*,S=*" -mtime +1 -exec gzip -S Z -6 '{}' + I.e. find all maildir-files: - with size in the name ("*,S=*") - modified before I enabled zlib plugin - compress them - add the Z suffix - keep timestamps (gzip does that by default) It's of course racy without the maildirlock, but are there any other problems with this approach ? -jf From achekalin at lazurit.com Sat Dec 24 18:26:49 2011 From: achekalin at lazurit.com (Alexander Chekalin) Date: Sat, 24 Dec 2011 19:26:49 +0300 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF5A9EC.8090606@hardwarefreak.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> Message-ID: <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> Stan, thank you for the reply, But I believe I obey this rule: I create "folder with ONLY folders inside", then in it another "folder with ONLY folders inside", and the into this second folder I create "folder with ONLY messages inside" (the path is "oldmail/lists/dovecot", and oldmail and lists are folders in filesystem, while dovecot is mbox container in filesystem). My problem is I can not understand which way should I create "folder with ONLY folders inside", and which way to create messages-only folder, going down to IMAP protocol commands. PHP for example looks like use only one command to create a mailbox, no difference what type of it I need. I understand PHP isn't the only script language to deal with IMAP, so I seek for advice how IMAP works with on protocol level. 24.12.2011, ? 13:31, Stan Hoeppner ???????(?): > On 12/23/2011 10:00 AM, Alexander Chekalin wrote: >> Hello, >> >> I'm now dealing with funny problem. I try to use Dovecot (2.1.rc1, >> actually) and mbox format to store old mailing, to keep logic of "one >> folder = one file". >> >> If I'd choose Maildir, I'd be able to create hierarchical folders (like >> "OldMail -> Maillists -> Dovecot"), and in fact on disk such a folders >> would be stored as real folders with dots in their names. In PHP it is >> easy to create with "imap_createmailbox()" function, I'd simple fire it >> 3 times (for "OldMail", for "OldMail.Maillists" and for >> "OldMail.Maillists.Dovecot"). >> >> But when I do the same with mbox, in fact it creates separate files >> (indeed, named "OldMail", "OldMail.Maillists" and >> "OldMail.Maillists.Dovecot") instead of creating filesystem folders >> ("OldMail/Maillists/Dovecot"). PHP is not guilty, Thunderbird won't >> create such folders as well. I can only create folders myself (say, with >> mkdir in the shell), chown it, and the it perfectly works in IMAP. >> >> Now I just wanted to know, are there any way to create IMAP-folders and >> subfolders using standard IMAP functionality? > > Yes. This has been common knowledge for many years, and is covered by > lots of documentation, including dovecot and tbird docs. With mbox > storage, an IMAP FOLDER contains only sub folders or it contains only > messages. It CANNOT contain BOTH. Thunderbird forces you to answer > this question each time you create a new IMAP FOLDER in the account root > tree. Surely you've seen the radio buttons in the new folder creation box. > > -- > Stan > From bradley.giesbrecht at gmail.com Sat Dec 24 19:01:14 2011 From: bradley.giesbrecht at gmail.com (Bradley Giesbrecht) Date: Sat, 24 Dec 2011 09:01:14 -0800 Subject: [Dovecot] sieve in sql or reporting In-Reply-To: <4EF556AF.8070007@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> Message-ID: <711A071F-17ED-42E5-A90C-B6B7BADD1DB5@gmail.com> On Dec 23, 2011, at 8:35 PM, Stephan Bosch wrote: > On 12/24/2011 5:26 AM, Stephan Bosch wrote: >> On 12/24/2011 3:28 AM, Bradley Giesbrecht wrote: >>> With dovecot2 and pigeonhole sieve/managesieve is it currently possible to store sieve rules in an sql database? >> Unfortunately, not yet. It is listed somewhere on the TODO list, but it does not have high priority so far. >> >>> If not is there a way to query all accounts; looking for things like active vacation rules? >> >> I'm working on an evolution of the sieve_pipe plugin called the sieve_extprograms plugin. One of the things it adds is a new action command called "execute", which may suit your needs. It will only be available for Dovecot v2.1 though. You can read the latest version of the specification here (example 4 should match your application): >> >> http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/raw-file/tip/doc/rfc/spec-bosch-sieve-extprograms.txt > > Oh btw, if you are looking for a way to disable vacation rules after some period of time, you can use the date extension (http://tools.ietf.org/html/rfc5260#section-4). For example: > > require ["date", "relational", "vacation"]; > > if currentdate :value "le" "date" "2011-12-09" { > vacation "I'm out of office this week. I'll be back on Saturday 10th to reply to your e-mails."; > } Stephan, thank you for both responses. My idea was to add sieve rules to a report so I could look up an email address and explain to the user why things happen. I can read in the users sieve scripts from the file system, or put them into sql myself for that matter. If a managesieve query command already existed I would use that. Regards, Bradley Geisbrecht From stan at hardwarefreak.com Sun Dec 25 02:50:44 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 24 Dec 2011 18:50:44 -0600 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> Message-ID: <4EF67364.6030003@hardwarefreak.com> On 12/24/2011 10:26 AM, Alexander Chekalin wrote: > Stan, thank you for the reply, > > But I believe I obey this rule: I create "folder with ONLY folders inside", then in it another "folder with ONLY folders inside", and the into this second folder I create "folder with ONLY messages inside" (the path is "oldmail/lists/dovecot", and oldmail and lists are folders in filesystem, while dovecot is mbox container in filesystem). > > My problem is I can not understand which way should I create "folder with ONLY folders inside", and which way to create messages-only folder, going down to IMAP protocol commands. PHP for example looks like use only one command to create a mailbox, no difference what type of it I need. > > I understand PHP isn't the only script language to deal with IMAP, so I seek for advice how IMAP works with on protocol level. Ah, ok. I didn't fully understand your issue. Maybe Timo, or someone else, knows the necessary imap folder creation command sequence for this. -- Stan From IcedEarthAngel at gmx.de Sun Dec 25 20:55:50 2011 From: IcedEarthAngel at gmx.de (IcedEarth) Date: Sun, 25 Dec 2011 10:55:50 -0800 (PST) Subject: [Dovecot] dovecot / postfix mail bounce problem In-Reply-To: <20111224055743.2be0a99b@scorpio> References: <33029725.post@talk.nabble.com> <20111224055743.2be0a99b@scorpio> Message-ID: <33036367.post@talk.nabble.com> Jerry-146 wrote: > > On Fri, 23 Dec 2011 08:02:25 -0800 (PST) > IcedEarth articulated: > >> >> Hello, >> >> i use a globalsieve rule to collect spam for all mail accounts in a >> specific mailbox. >> >> Here is the code: >> >> vi /var/vmail/globalsieverc >> >> require ["fileinto"]; >> # Move spam to junk folder >> if not address :is "to" "antispam at xxx.com" { >> if header :contains "X-Spam-Flag" ["YES"] { >> redirect "antispam at xxx.com"; >> stop; >> } >> } >> >> But the spam mails are not delivered. >> >> cat /var/log/mail.info >> >> postfix/pipe[32301]: AD8F78E2128D: to=, >> relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, >> status=bounced (mail forwarding loop for antispam at xxx.de) >> >> Why is there a loop? I don't unterstand that. > > This question really belongs on the Postfix forum. Please read the > directions for posting on that forum first. > > http://www.postfix.com/DEBUG_README.html > > Pay attention to the "Reporting problems to postfix-users at postfix.org" > section at the end of the article. > > > -- > Jerry ? > > Disclaimer: off-list followups get on-list replies or get ignored. > Please do not ignore the Reply-To header. > __________________________________________________________________ > Be frank and explicit with your lawyer ... it is his business to confuse > the issue afterwards. > > Hello Jerry, no this question not belongs on the Postfix forum. It was a dovecot issue. I've fixed it. I just created an empty file '.dovecot.sieve' in the 'antispam at xxx.com' Mailbox dir. This prevents dovecot to execute the globalsieve for the Mailbox 'antispam at xxx.com'. My script triggered a loop. New script: require ["fileinto"]; # Move spam to junk folder if header :contains "X-Spam-Flag" ["YES"] { redirect "antispam at xxx.com"; stop; } -- View this message in context: http://old.nabble.com/dovecot---postfix-mail-bounce-problem-tp33029725p33036367.html Sent from the Dovecot mailing list archive at Nabble.com. From arthur at psw.ro Sun Dec 25 22:08:42 2011 From: arthur at psw.ro (Arthur Titeica) Date: Sun, 25 Dec 2011 22:08:42 +0200 Subject: [Dovecot] dovecot / postfix mail bounce problem In-Reply-To: <33036367.post@talk.nabble.com> References: <33029725.post@talk.nabble.com> <20111224055743.2be0a99b@scorpio> <33036367.post@talk.nabble.com> Message-ID: <3c908c59f40c3171efad55ad3ca06cc1@psw.ro> On 25.12.2011 20:55, IcedEarth wrote: > Jerry-146 wrote: >> >> On Fri, 23 Dec 2011 08:02:25 -0800 (PST) >> IcedEarth articulated: >> >>> >>> Hello, >>> >>> i use a globalsieve rule to collect spam for all mail accounts in a >>> specific mailbox. >>> >>> Here is the code: >>> >>> vi /var/vmail/globalsieverc >>> >>> require ["fileinto"]; >>> # Move spam to junk folder >>> if not address :is "to" "antispam at xxx.com" { >>> if header :contains "X-Spam-Flag" ["YES"] { >>> redirect "antispam at xxx.com"; >>> stop; >>> } >>> } >>> >>> But the spam mails are not delivered. >>> >>> cat /var/log/mail.info >>> >>> postfix/pipe[32301]: AD8F78E2128D: to=, >>> relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, >>> status=bounced (mail forwarding loop for antispam at xxx.de) >>> >>> Why is there a loop? I don't unterstand that. >> >> This question really belongs on the Postfix forum. Please read the >> directions for posting on that forum first. >> >> http://www.postfix.com/DEBUG_README.html >> >> Pay attention to the "Reporting problems to >> postfix-users at postfix.org" >> section at the end of the article. >> >> > > Hello Jerry, > > no this question not belongs on the Postfix forum. > It was a dovecot issue. I've fixed it. > > I just created an empty file '.dovecot.sieve' in the > 'antispam at xxx.com' > Mailbox dir. This prevents dovecot to execute the globalsieve for the > Mailbox 'antispam at xxx.com'. > > My script triggered a loop. > > New script: > require ["fileinto"]; > # Move spam to junk folder > if header :contains "X-Spam-Flag" ["YES"] { > redirect "antispam at xxx.com"; > stop; > } Roundcube sieve plugin writes your original script as # rule:[test] if allof (not address :is "To" "antispam at xxx.com", header :contains "X-Spam-Flag" "YES") { redirect "antispam at xxx.com"; } -- Arthur Titeica From IcedEarthAngel at gmx.de Sun Dec 25 23:58:00 2011 From: IcedEarthAngel at gmx.de (IcedEarth) Date: Sun, 25 Dec 2011 13:58:00 -0800 (PST) Subject: [Dovecot] dovecot / postfix mail bounce problem In-Reply-To: <3c908c59f40c3171efad55ad3ca06cc1@psw.ro> References: <33029725.post@talk.nabble.com> <20111224055743.2be0a99b@scorpio> <33036367.post@talk.nabble.com> <3c908c59f40c3171efad55ad3ca06cc1@psw.ro> Message-ID: <33036676.post@talk.nabble.com> Hi Arthur, tested your script as globalsieve. Same result. Mail is bounced. Only option is to create a .global.sieve for antispam at ... Mailbox. Thanks. Iced Arthur Titeica-2 wrote: > > On 25.12.2011 20:55, IcedEarth wrote: >> Jerry-146 wrote: >>> >>> On Fri, 23 Dec 2011 08:02:25 -0800 (PST) >>> IcedEarth articulated: >>> >>>> >>>> Hello, >>>> >>>> i use a globalsieve rule to collect spam for all mail accounts in a >>>> specific mailbox. >>>> >>>> Here is the code: >>>> >>>> vi /var/vmail/globalsieverc >>>> >>>> require ["fileinto"]; >>>> # Move spam to junk folder >>>> if not address :is "to" "antispam at xxx.com" { >>>> if header :contains "X-Spam-Flag" ["YES"] { >>>> redirect "antispam at xxx.com"; >>>> stop; >>>> } >>>> } >>>> >>>> But the spam mails are not delivered. >>>> >>>> cat /var/log/mail.info >>>> >>>> postfix/pipe[32301]: AD8F78E2128D: to=, >>>> relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, >>>> status=bounced (mail forwarding loop for antispam at xxx.de) >>>> >>>> Why is there a loop? I don't unterstand that. >>> >>> This question really belongs on the Postfix forum. Please read the >>> directions for posting on that forum first. >>> >>> http://www.postfix.com/DEBUG_README.html >>> >>> Pay attention to the "Reporting problems to >>> postfix-users at postfix.org" >>> section at the end of the article. >>> >>> >> >> Hello Jerry, >> >> no this question not belongs on the Postfix forum. >> It was a dovecot issue. I've fixed it. >> >> I just created an empty file '.dovecot.sieve' in the >> 'antispam at xxx.com' >> Mailbox dir. This prevents dovecot to execute the globalsieve for the >> Mailbox 'antispam at xxx.com'. >> >> My script triggered a loop. >> >> New script: >> require ["fileinto"]; >> # Move spam to junk folder >> if header :contains "X-Spam-Flag" ["YES"] { >> redirect "antispam at xxx.com"; >> stop; >> } > > Roundcube sieve plugin writes your original script as > > # rule:[test] > if allof (not address :is "To" "antispam at xxx.com", > header :contains "X-Spam-Flag" "YES") > { > redirect "antispam at xxx.com"; > } > > > -- > Arthur Titeica > > -- View this message in context: http://old.nabble.com/dovecot---postfix-mail-bounce-problem-tp33029725p33036676.html Sent from the Dovecot mailing list archive at Nabble.com. From achekalin at lazurit.com Mon Dec 26 08:43:49 2011 From: achekalin at lazurit.com (Alexander Chekalin) Date: Mon, 26 Dec 2011 09:43:49 +0300 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF67364.6030003@hardwarefreak.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> <4EF67364.6030003@hardwarefreak.com> Message-ID: <4EF817A5.3030101@lazurit.com> Hello Stan, thank you for your care, the answer was pretty simple, and yes you're right, I'd better read the docs before: I tried to create folder named like 'Old Mail' (and in fact I got another mbox container), while I needed to create 'Old Mail/' (note the slash), which results in real filesystem directory. Thanks for your time anyway! Yours, Alexander 25.12.2011 3:50, Stan Hoeppner ?????: > On 12/24/2011 10:26 AM, Alexander Chekalin wrote: >> Stan, thank you for the reply, >> >> But I believe I obey this rule: I create "folder with ONLY folders inside", then in it another "folder with ONLY folders inside", and the into this second folder I create "folder with ONLY messages inside" (the path is "oldmail/lists/dovecot", and oldmail and lists are folders in filesystem, while dovecot is mbox container in filesystem). >> >> My problem is I can not understand which way should I create "folder with ONLY folders inside", and which way to create messages-only folder, going down to IMAP protocol commands. PHP for example looks like use only one command to create a mailbox, no difference what type of it I need. >> >> I understand PHP isn't the only script language to deal with IMAP, so I seek for advice how IMAP works with on protocol level. > > Ah, ok. I didn't fully understand your issue. Maybe Timo, or someone > else, knows the necessary imap folder creation command sequence for this. > From pasek at valbek.cz Mon Dec 26 08:45:17 2011 From: pasek at valbek.cz (pasek at valbek.cz) Date: Mon, 26 Dec 2011 07:45:17 +0100 Subject: [Dovecot] =?utf-8?b?RG92b2xlbsOh?= Message-ID: <54bd608eb02c61ea80e76eb903d3ee5d-1324881917@mail.valbek.cz> Dobr? den, od 23.12. do 30.12. jsem na dovolen?. V p??pad? nutnosti volejte na mobil. S pozdravem Bc. Ladislav Pa?ek vedouc? odd?len? IT a vizualizace mobil: +420 776 140 489 e-mail: pasek at valbek.cz Valbek, s.r.o. Va?urova 505/17, 460 02 Liberec 3 tel./fax: +420 485 103 336, +420 485 103 346 www.valbek.cz From stan at hardwarefreak.com Mon Dec 26 09:48:32 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Mon, 26 Dec 2011 01:48:32 -0600 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF817A5.3030101@lazurit.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> <4EF67364.6030003@hardwarefreak.com> <4EF817A5.3030101@lazurit.com> Message-ID: <4EF826D0.3050005@hardwarefreak.com> On 12/26/2011 12:43 AM, Alexander Chekalin wrote: > Hello Stan, > > thank you for your care, the answer was pretty simple, and yes you're > right, I'd better read the docs before: > > I tried to create folder named like 'Old Mail' (and in fact I got > another mbox container), while I needed to create 'Old Mail/' (note the > slash), which results in real filesystem directory. Oh wow, that is simple. And makes perfect sense. Before my last reply I read the php IMAP command set definitions/parameters and I didn't see anything about how to do this, which is an odd omission in documentation. I guess so few people use mbox these days they omit that case from the docs. I hit three different sources and none of them mentioned the trailing slash for creating 'sub-folders-only' folders... > Thanks for your time anyway! You're welcome. Sorry I didn't get you the answer, but I'm glad you were able to figure it out on your own. -- Stan > 25.12.2011 3:50, Stan Hoeppner ?????: >> On 12/24/2011 10:26 AM, Alexander Chekalin wrote: >>> Stan, thank you for the reply, >>> >>> But I believe I obey this rule: I create "folder with ONLY folders >>> inside", then in it another "folder with ONLY folders inside", and >>> the into this second folder I create "folder with ONLY messages >>> inside" (the path is "oldmail/lists/dovecot", and oldmail and lists >>> are folders in filesystem, while dovecot is mbox container in >>> filesystem). >>> >>> My problem is I can not understand which way should I create "folder >>> with ONLY folders inside", and which way to create messages-only >>> folder, going down to IMAP protocol commands. PHP for example looks >>> like use only one command to create a mailbox, no difference what >>> type of it I need. >>> >>> I understand PHP isn't the only script language to deal with IMAP, so >>> I seek for advice how IMAP works with on protocol level. >> >> Ah, ok. I didn't fully understand your issue. Maybe Timo, or someone >> else, knows the necessary imap folder creation command sequence for this. From denis at fateyev.com Mon Dec 26 10:13:18 2011 From: denis at fateyev.com (Denis Fateyev) Date: Mon, 26 Dec 2011 14:13:18 +0600 Subject: [Dovecot] =?iso-8859-1?q?Dovolen=E1?= In-Reply-To: <54bd608eb02c61ea80e76eb903d3ee5d-1324881917@mail.valbek.cz> References: <54bd608eb02c61ea80e76eb903d3ee5d-1324881917@mail.valbek.cz> Message-ID: Hello all, On Mon, Dec 26, 2011 at 12:45 PM, wrote: > > V p??pad? nutnosti volejte na mobil. > > Indeed, it sounds like a call to action ;-) Merry Christmas to everyone! --- wbr, Denis. From jsxmoney at gmail.com Mon Dec 26 22:41:11 2011 From: jsxmoney at gmail.com (Jason X, Maney) Date: Mon, 26 Dec 2011 22:41:11 +0200 Subject: [Dovecot] managesieve vacation script bounces/frozen with a 550 error. Message-ID: Dear all, I have been trying to get this problem out of the way but I just cant seem to get it right. I hope someone can point me in the right direction here. I have come up with a vacation script as below, which can be send out from my Postfix SMTP server to my smarthost at the ISP, and yet for some reason it is not sent out at my ISP server. The guys at the ISP have sent me the full error they are getting on their Exim SMTP server. My dovecot version is: ========== dovecot --version 1.2.9 ========== ...and my managesieve configs are as follows: ========== dovecot -n |grep sieve protocols: pop3 pop3s imap imaps managesieve listen(managesieve): *:4190 login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(managesieve): mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve mail_plugins: sieve quota sieve: /var/vmail/sieve/%d/%u/sieve-script sieve_global_path: /var/vmail/sieve/default.sieve sieve_storage: /var/vmail/sieve/%d/%u ========== Error from my ISP smarthost: ========== +++ 1ReM7W-000Dm8-My has not completed +++ 2011-12-26 09:34:18 1ReM7W-000Dm8-My <= <> H=(myhostname.mydomain.com) [xxx.xxx.xxx.xxx] P=esmtps X=TLSv1:DHE-RSA-AES256-SHA:256 S=1451 id=dovecot-sieve-1324712058-257846-0 at havana T="Out of office reply" 2011-12-26 09:34:18 1ReM7W-000Dm8-My ** jsxmoney at gmail.comR=send_to_gateway T=remote_smtp: SMTP error from remote mail server after RCPT TO:: host smtp.myisp.com[yyy.yyy.yyy.yyy]: 550 Bounces must have only a single recipient 2011-12-26 09:34:18 1ReM7W-000Dm8-My Frozen (delivery error message ========== My vacation sieve script is: ========== ## /* empty script */ require ["fileinto", "vacation"]; vacation # Reply at most once a day to a same sender :days 1 :subject "Out of office reply" # List of additional recipient addresses which are included in the auto replying. # If a mail's recipient is not the envelope recipient and it's not on this list, # no vacation reply is sent for it. :addresses "me at mydomain.com" "I'm out of office, please contact Joan Doe instead. Best regards Me"; ========== What I am not sure of is, is this a problem I need to fix or is it something my ISP need to work on, on their Exim? If its something they can work on can you also give me pointers so I can work with them to fix it? Many thanx, JXM. From asai at globalchangemusic.org Tue Dec 27 17:46:13 2011 From: asai at globalchangemusic.org (Asai) Date: Tue, 27 Dec 2011 08:46:13 -0700 Subject: [Dovecot] Dsync Error Can't Delete Mailbox Message-ID: <4EF9E845.4030507@globalchangemusic.org> Greetings, I'm getting this error in the dsync logs: Warning: Destination mailbox INBOX has been modified, need to recreate it before we can continue syncing dsync(foo at bar.org): Error: Can't delete mailbox INBOX: INBOX can't be deleted. In this situation, what should I do to remedy the problem? Just delete the backup and rebuild? -- --asai From sottilette at rfx.it Wed Dec 28 00:58:37 2011 From: sottilette at rfx.it (sottilette at rfx.it) Date: Tue, 27 Dec 2011 23:58:37 +0100 (CET) Subject: [Dovecot] UIDL format Message-ID: How can be sure of the current POP3 UIDL? Below my current config (to be migrated to 2.0.x ASAP). Thanks, P. # dovecot -n # 1.0.2: /etc/dovecot.conf log_path: /var/log/mail/dovecot.log info_log_path: /var/log/mail/dovecot.info.log protocols: pop3 pop3s imap imaps listen: * login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login first_valid_uid: 100 mail_location: mbox:~/:INBOX=/var/mail/%u mail_full_filesystem_access: yes mbox_read_locks: dotlock fcntl mbox_write_locks: dotlock fcntl mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd From stephan at rename-it.nl Wed Dec 28 01:19:38 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 28 Dec 2011 00:19:38 +0100 Subject: [Dovecot] managesieve vacation script bounces/frozen with a 550 error. In-Reply-To: References: Message-ID: <4EFA528A.2080400@rename-it.nl> On 12/26/2011 9:41 PM, Jason X, Maney wrote: > I have been trying to get this problem out of the way but I just cant > seem to get it right. I hope someone can point me in the right > direction here. I have come up with a vacation script as below, which > can be send out from my Postfix SMTP server to my smarthost at the > ISP, and yet for some reason it is not sent out at my ISP server. The > guys at the ISP have sent me the full error they are getting on their > Exim SMTP server. My dovecot version is: [...] > 550 Bounces must have only a single recipient [...] > What I am not sure of is, is this a problem I need to fix or is it > something my ISP need to work on, on their Exim? If its something > they can work on can you also give me pointers so I can work with > them to fix it? I googled for this error a bit, and it is probably produced by the following custom anti-backscatter Exim acl (various examples float around on the internet): deny senders = : condition = ${if ! eq{$recipients_count}{1}{1}} message = Bounces must have only a single recipient This rule only fires when the vacation message triggers multiple RCPT commands in the SMTP session with your SMTP. Sieve only replies to a single recipient, so apparently somewhere along the mail path additional recipients get added and it is likely that this happens at your smarthorst. Since this is likely an MTA problem and not a Sieve or Dovecot issue, I cannot help you much more. Regards, Stephan. From david at electric-spoon.com Wed Dec 28 12:26:44 2011 From: david at electric-spoon.com (David Pottage) Date: Wed, 28 Dec 2011 10:26:44 +0000 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. Message-ID: <4EFAEEE4.80405@electric-spoon.com> Hello I am currently running dovecot 1.2.15 on my home server. I have over 200 folders in personal email account, and I have found that my smart-phone does not work well trying to display that many folders. I solved the problem by creating a second instance of dovecot running on a non standard port, and configured it to serve only a subset my email folders, so that way the email client on my smartphone works well and I can read the emails I am interested in on the move. The process of configuring two instances of dovecot on the same machine serving different views of the same mailbox was faily complex, so I think it would be worth documenting the process in an FAQ or suchlike for other users. I thought a good place to write up my method would be in the HowTo section of the Dovecot Wiki. Is that a good idea? Can I request an account to edit the Wiki, or should I send a draft text to an editor? Are there any Dovecot experts here who can review my methods and suggest improvements? -- David Pottage From ruskie at codemages.net Wed Dec 28 12:39:49 2011 From: ruskie at codemages.net (=?UTF-8?Q?Andra=C5=BE_'ruskie'_Levstik?=) Date: Wed, 28 Dec 2011 11:39:49 +0100 (CET) Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFAEEE4.80405@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> Message-ID: :2011-12-28T10:26:David Pottage: > I am currently running dovecot 1.2.15 on my home server. I have over 200 > folders in personal email account, and I have found that my smart-phone > does not work well trying to display that many folders. > > I solved the problem by creating a second instance of dovecot running on > a non standard port, and configured it to serve only a subset my email > folders, so that way the email client on my smartphone works well and I > can read the emails I am interested in on the move. Here's a simple improvement. Create a new email user and symlink just those folders you want to see into it. That way you don't need 2 instances just two different users and you use one on mobile the other elsewhere ;) Using virtual folders could be helpful as well. I have a New mails one which shows me all new emails in all folders which helps in a lot of places. -- Andra? 'ruskie' Levstik Source Mage GNU/Linux Games/Xorg grimoire guru Re-Alpine Coordinator http://sourceforge.net/projects/re-alpine/ Geek/Hacker/Tinker Knowledge is important, knowledge you know is priceless. Share the knowledge, build a better future for everyone. From dovecot at asheesh.org Wed Dec 28 20:31:06 2011 From: dovecot at asheesh.org (Asheesh Laroia) Date: Wed, 28 Dec 2011 13:31:06 -0500 (EST) Subject: [Dovecot] /usr/lib/dovecot/imap ignores log settings? Message-ID: Hi Dovecot peeps, I'm enjoying running /usr/lib/dovecot/imap directly as a PREAUTH IMAP pipe. I find that it outputs log messages whose severity is INFO to stdout. I'm running it as follows: /usr/lib/dovecot/imap -c /tmp/dovecot.conf and I see the following messages output to stdout: * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in as paulproteus imap(paulproteus): Info: Connection closed bytes=0/305 Naturally, the first line is great. My /tmp/dovecot.conf is: # single-dbox mail_location = sdbox:~/Maildir/dbox log_path = syslog info_log_path = /dev/null I'm also attaching strace output, created by running this command: echo | strace /usr/lib/dovecot/imap -c /tmp/dovecot.conf > /tmp/straced 2>&1 (The point of the "echo | " is to provide a newline and then EOF to /usr/lib/dovecot/imap.) You can see in the strace output that /usr/lib/dovecot/imap outputs the "Connection closed" message to file descriptor 2. I'd like that message to actually not be printed, which is why I set log_path to syslog. -- Asheesh. -------------- next part -------------- execve("/usr/lib/dovecot/imap", ["/usr/lib/dovecot/imap", "-c", "/tmp/dovecot.conf"], [/* 31 vars */]) = 0 brk(0) = 0x1eb8000 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee31000 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/x86_64/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls/x86_64", 0x7fff1a7c24f0) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls", 0x7fff1a7c24f0) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/x86_64/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/x86_64", 0x7fff1a7c24f0) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/libdovecot-storage.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\313\2\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=898088, ...}) = 0 mmap(NULL, 2993560, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03e939000 mprotect(0x7ff03ea0d000, 2093056, PROT_NONE) = 0 mmap(0x7ff03ec0c000, 32768, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xd3000) = 0x7ff03ec0c000 close(3) = 0 open("/usr/lib/dovecot/libdovecot.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200\217\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=533816, ...}) = 0 mmap(NULL, 2639392, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03e6b4000 mprotect(0x7ff03e734000, 2093056, PROT_NONE) = 0 mmap(0x7ff03e933000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7f000) = 0x7ff03e933000 mmap(0x7ff03e936000, 9760, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7ff03e936000 close(3) = 0 open("/usr/lib/dovecot/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory) open("/etc/ld.so.cache", O_RDONLY) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=127929, ...}) = 0 mmap(NULL, 127929, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7ff03ee11000 close(3) = 0 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\r\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=14768, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee10000 mmap(NULL, 2109696, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03e4b0000 mprotect(0x7ff03e4b2000, 2097152, PROT_NONE) = 0 mmap(0x7ff03e6b2000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7ff03e6b2000 close(3) = 0 open("/usr/lib/dovecot/librt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\220!\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=31744, ...}) = 0 mmap(NULL, 2128856, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03e2a8000 mprotect(0x7ff03e2af000, 2093056, PROT_NONE) = 0 mmap(0x7ff03e4ae000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7ff03e4ae000 close(3) = 0 open("/usr/lib/dovecot/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\300\357\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=1570832, ...}) = 0 mmap(NULL, 3684440, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03df24000 mprotect(0x7ff03e09e000, 2097152, PROT_NONE) = 0 mmap(0x7ff03e29e000, 20480, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x17a000) = 0x7ff03e29e000 mmap(0x7ff03e2a3000, 18520, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7ff03e2a3000 close(3) = 0 open("/usr/lib/dovecot/libpthread.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libpthread.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@\\\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=131107, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee0f000 mmap(NULL, 2208672, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03dd08000 mprotect(0x7ff03dd1f000, 2093056, PROT_NONE) = 0 mmap(0x7ff03df1e000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16000) = 0x7ff03df1e000 mmap(0x7ff03df20000, 13216, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7ff03df20000 close(3) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee0e000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee0d000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee0c000 arch_prctl(ARCH_SET_FS, 0x7ff03ee0d700) = 0 mprotect(0x7ff03df1e000, 4096, PROT_READ) = 0 mprotect(0x7ff03e29e000, 16384, PROT_READ) = 0 mprotect(0x7ff03e4ae000, 4096, PROT_READ) = 0 mprotect(0x7ff03e6b2000, 4096, PROT_READ) = 0 mprotect(0x7ff03ee33000, 4096, PROT_READ) = 0 munmap(0x7ff03ee11000, 127929) = 0 set_tid_address(0x7ff03ee0d9d0) = 24515 set_robust_list(0x7ff03ee0d9e0, 0x18) = 0 futex(0x7fff1a7c2ddc, FUTEX_WAIT_BITSET_PRIVATE|FUTEX_CLOCK_REALTIME, 1, NULL, 7ff03ee0d700) = -1 EAGAIN (Resource temporarily unavailable) rt_sigaction(SIGRTMIN, {0x7ff03dd0dad0, [], SA_RESTORER|SA_SIGINFO, 0x7ff03dd17030}, NULL, 8) = 0 rt_sigaction(SIGRT_1, {0x7ff03dd0db60, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x7ff03dd17030}, NULL, 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0 getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM_INFINITY}) = 0 getuid() = 1000 brk(0) = 0x1eb8000 brk(0x1ee1000) = 0x1ee1000 uname({sys="Linux", node="pathi", ...}) = 0 rt_sigaction(SIGPIPE, {SIG_IGN, [], SA_RESTORER|SA_RESTART, 0x7ff03df56480}, NULL, 8) = 0 rt_sigaction(SIGALRM, {0x7ff03e7000d0, [], SA_RESTORER|SA_SIGINFO, 0x7ff03df56480}, NULL, 8) = 0 rt_sigaction(SIGINT, {0x7ff03e700160, [], SA_RESTORER|SA_SIGINFO, 0x7ff03df56480}, NULL, 8) = 0 pipe([3, 4]) = 0 fcntl(3, F_GETFL) = 0 (flags O_RDONLY) fcntl(3, F_SETFL, O_RDONLY|O_NONBLOCK) = 0 fcntl(4, F_GETFL) = 0x1 (flags O_WRONLY) fcntl(4, F_SETFL, O_WRONLY|O_NONBLOCK) = 0 fcntl(3, F_GETFD) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 fcntl(4, F_GETFD) = 0 fcntl(4, F_SETFD, FD_CLOEXEC) = 0 epoll_create(128) = 5 fcntl(5, F_GETFD) = 0 fcntl(5, F_SETFD, FD_CLOEXEC) = 0 epoll_ctl(5, EPOLL_CTL_ADD, 3, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=32249584, u64=32249584}}) = 0 rt_sigaction(SIGTERM, {0x7ff03e700160, [], SA_RESTORER|SA_SIGINFO, 0x7ff03df56480}, NULL, 8) = 0 umask(077) = 022 stat("/tmp/dovecot.conf", {st_mode=S_IFREG|0644, st_size=98, ...}) = 0 stat("/tmp/dovecot.conf", {st_mode=S_IFREG|0644, st_size=98, ...}) = 0 execve("/usr/bin/doveconf", ["/usr/bin/doveconf", "-f", "service=imap", "-c", "/tmp/dovecot.conf", "-m", "imap", "-e", "/usr/lib/dovecot/imap", "-c", "/tmp/dovecot.conf"], [/* 2 vars */]) = 0 brk(0) = 0xc98000 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559d8000 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/x86_64/libdovecot.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls/x86_64", 0x7fff99f31d70) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/libdovecot.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls", 0x7fff99f31d70) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/x86_64/libdovecot.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/x86_64", 0x7fff99f31d70) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/libdovecot.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200\217\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=533816, ...}) = 0 mmap(NULL, 2639392, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d55536000 mprotect(0x7f1d555b6000, 2093056, PROT_NONE) = 0 mmap(0x7f1d557b5000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7f000) = 0x7f1d557b5000 mmap(0x7f1d557b8000, 9760, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f1d557b8000 close(3) = 0 open("/usr/lib/dovecot/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory) open("/etc/ld.so.cache", O_RDONLY) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=127929, ...}) = 0 mmap(NULL, 127929, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f1d559b8000 close(3) = 0 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\r\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=14768, ...}) = 0 mmap(NULL, 2109696, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d55332000 mprotect(0x7f1d55334000, 2097152, PROT_NONE) = 0 mmap(0x7f1d55534000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f1d55534000 close(3) = 0 open("/usr/lib/dovecot/librt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\220!\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=31744, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559b7000 mmap(NULL, 2128856, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d5512a000 mprotect(0x7f1d55131000, 2093056, PROT_NONE) = 0 mmap(0x7f1d55330000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f1d55330000 close(3) = 0 open("/usr/lib/dovecot/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\300\357\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=1570832, ...}) = 0 mmap(NULL, 3684440, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d54da6000 mprotect(0x7f1d54f20000, 2097152, PROT_NONE) = 0 mmap(0x7f1d55120000, 20480, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x17a000) = 0x7f1d55120000 mmap(0x7f1d55125000, 18520, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f1d55125000 close(3) = 0 open("/usr/lib/dovecot/libpthread.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libpthread.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@\\\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=131107, ...}) = 0 mmap(NULL, 2208672, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d54b8a000 mprotect(0x7f1d54ba1000, 2093056, PROT_NONE) = 0 mmap(0x7f1d54da0000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16000) = 0x7f1d54da0000 mmap(0x7f1d54da2000, 13216, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f1d54da2000 close(3) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559b6000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559b5000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559b4000 arch_prctl(ARCH_SET_FS, 0x7f1d559b5700) = 0 mprotect(0x7f1d54da0000, 4096, PROT_READ) = 0 mprotect(0x7f1d55120000, 16384, PROT_READ) = 0 mprotect(0x7f1d55330000, 4096, PROT_READ) = 0 mprotect(0x7f1d55534000, 4096, PROT_READ) = 0 mprotect(0x7f1d559da000, 4096, PROT_READ) = 0 munmap(0x7f1d559b8000, 127929) = 0 set_tid_address(0x7f1d559b59d0) = 24515 set_robust_list(0x7f1d559b59e0, 0x18) = 0 futex(0x7fff99f3265c, FUTEX_WAIT_BITSET_PRIVATE|FUTEX_CLOCK_REALTIME, 1, NULL, 7f1d559b5700) = -1 EAGAIN (Resource temporarily unavailable) rt_sigaction(SIGRTMIN, {0x7f1d54b8fad0, [], SA_RESTORER|SA_SIGINFO, 0x7f1d54b99030}, NULL, 8) = 0 rt_sigaction(SIGRT_1, {0x7f1d54b8fb60, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x7f1d54b99030}, NULL, 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0 getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM_INFINITY}) = 0 brk(0) = 0xc98000 brk(0xcc1000) = 0xcc1000 uname({sys="Linux", node="pathi", ...}) = 0 rt_sigaction(SIGPIPE, {SIG_IGN, [], SA_RESTORER|SA_RESTART, 0x7f1d54dd8480}, NULL, 8) = 0 rt_sigaction(SIGALRM, {0x7f1d555820d0, [], SA_RESTORER|SA_SIGINFO, 0x7f1d54dd8480}, NULL, 8) = 0 rt_sigaction(SIGINT, {0x7f1d55582160, [], SA_RESTORER|SA_SIGINFO, 0x7f1d54dd8480}, NULL, 8) = 0 pipe([3, 4]) = 0 fcntl(3, F_GETFL) = 0 (flags O_RDONLY) fcntl(3, F_SETFL, O_RDONLY|O_NONBLOCK) = 0 fcntl(4, F_GETFL) = 0x1 (flags O_WRONLY) fcntl(4, F_SETFL, O_WRONLY|O_NONBLOCK) = 0 fcntl(3, F_GETFD) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 fcntl(4, F_GETFD) = 0 fcntl(4, F_SETFD, FD_CLOEXEC) = 0 epoll_create(128) = 5 fcntl(5, F_GETFD) = 0 fcntl(5, F_SETFD, FD_CLOEXEC) = 0 epoll_ctl(5, EPOLL_CTL_ADD, 3, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=13243088, u64=13243088}}) = 0 rt_sigaction(SIGTERM, {0x7f1d55582160, [], SA_RESTORER|SA_SIGINFO, 0x7f1d54dd8480}, NULL, 8) = 0 open("/usr/lib/dovecot/modules/settings", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 6 getdents(6, /* 2 entries */, 32768) = 48 getdents(6, /* 0 entries */, 32768) = 0 close(6) = 0 open("/tmp/dovecot.conf", O_RDONLY) = 6 mmap(NULL, 266240, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d55973000 brk(0xce3000) = 0xce3000 brk(0xd04000) = 0xd04000 fstat(6, {st_mode=S_IFREG|0644, st_size=98, ...}) = 0 pread(6, "# single-dbox\nmail_location = sd"..., 8192, 0) = 98 pread(6, "", 8094, 98) = 0 close(6) = 0 brk(0xd2d000) = 0xd2d000 brk(0xd4f000) = 0xd4f000 brk(0xd1d000) = 0xd1d000 brk(0xd3f000) = 0xd3f000 brk(0xd61000) = 0xd61000 brk(0xd30000) = 0xd30000 execve("/usr/lib/dovecot/imap", ["/usr/lib/dovecot/imap", "-c", "/tmp/dovecot.conf"], [/* 6 vars */]) = 0 brk(0) = 0x1636000 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc3711a6000 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/x86_64/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls/x86_64", 0x7ffff10a0850) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls", 0x7ffff10a0850) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/x86_64/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/x86_64", 0x7ffff10a0850) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/libdovecot-storage.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\313\2\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=898088, ...}) = 0 mmap(NULL, 2993560, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc370cae000 mprotect(0x7fc370d82000, 2093056, PROT_NONE) = 0 mmap(0x7fc370f81000, 32768, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xd3000) = 0x7fc370f81000 close(3) = 0 open("/usr/lib/dovecot/libdovecot.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200\217\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=533816, ...}) = 0 mmap(NULL, 2639392, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc370a29000 mprotect(0x7fc370aa9000, 2093056, PROT_NONE) = 0 mmap(0x7fc370ca8000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7f000) = 0x7fc370ca8000 mmap(0x7fc370cab000, 9760, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7fc370cab000 close(3) = 0 open("/usr/lib/dovecot/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory) open("/etc/ld.so.cache", O_RDONLY) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=127929, ...}) = 0 mmap(NULL, 127929, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7fc371186000 close(3) = 0 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\r\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=14768, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371185000 mmap(NULL, 2109696, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc370825000 mprotect(0x7fc370827000, 2097152, PROT_NONE) = 0 mmap(0x7fc370a27000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7fc370a27000 close(3) = 0 open("/usr/lib/dovecot/librt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\220!\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=31744, ...}) = 0 mmap(NULL, 2128856, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc37061d000 mprotect(0x7fc370624000, 2093056, PROT_NONE) = 0 mmap(0x7fc370823000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7fc370823000 close(3) = 0 open("/usr/lib/dovecot/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\300\357\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=1570832, ...}) = 0 mmap(NULL, 3684440, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc370299000 mprotect(0x7fc370413000, 2097152, PROT_NONE) = 0 mmap(0x7fc370613000, 20480, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x17a000) = 0x7fc370613000 mmap(0x7fc370618000, 18520, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7fc370618000 close(3) = 0 open("/usr/lib/dovecot/libpthread.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libpthread.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@\\\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=131107, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371184000 mmap(NULL, 2208672, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc37007d000 mprotect(0x7fc370094000, 2093056, PROT_NONE) = 0 mmap(0x7fc370293000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16000) = 0x7fc370293000 mmap(0x7fc370295000, 13216, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7fc370295000 close(3) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371183000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371182000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371181000 arch_prctl(ARCH_SET_FS, 0x7fc371182700) = 0 mprotect(0x7fc370293000, 4096, PROT_READ) = 0 mprotect(0x7fc370613000, 16384, PROT_READ) = 0 mprotect(0x7fc370823000, 4096, PROT_READ) = 0 mprotect(0x7fc370a27000, 4096, PROT_READ) = 0 mprotect(0x7fc3711a8000, 4096, PROT_READ) = 0 munmap(0x7fc371186000, 127929) = 0 set_tid_address(0x7fc3711829d0) = 24515 set_robust_list(0x7fc3711829e0, 0x18) = 0 futex(0x7ffff10a113c, FUTEX_WAIT_BITSET_PRIVATE|FUTEX_CLOCK_REALTIME, 1, NULL, 7fc371182700) = -1 EAGAIN (Resource temporarily unavailable) rt_sigaction(SIGRTMIN, {0x7fc370082ad0, [], SA_RESTORER|SA_SIGINFO, 0x7fc37008c030}, NULL, 8) = 0 rt_sigaction(SIGRT_1, {0x7fc370082b60, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x7fc37008c030}, NULL, 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0 getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM_INFINITY}) = 0 getuid() = 1000 brk(0) = 0x1636000 brk(0x165f000) = 0x165f000 uname({sys="Linux", node="pathi", ...}) = 0 rt_sigaction(SIGPIPE, {SIG_IGN, [], SA_RESTORER|SA_RESTART, 0x7fc3702cb480}, NULL, 8) = 0 rt_sigaction(SIGALRM, {0x7fc370a750d0, [], SA_RESTORER|SA_SIGINFO, 0x7fc3702cb480}, NULL, 8) = 0 rt_sigaction(SIGINT, {0x7fc370a75160, [], SA_RESTORER|SA_SIGINFO, 0x7fc3702cb480}, NULL, 8) = 0 pipe([3, 4]) = 0 fcntl(3, F_GETFL) = 0 (flags O_RDONLY) fcntl(3, F_SETFL, O_RDONLY|O_NONBLOCK) = 0 fcntl(4, F_GETFL) = 0x1 (flags O_WRONLY) fcntl(4, F_SETFL, O_WRONLY|O_NONBLOCK) = 0 fcntl(3, F_GETFD) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 fcntl(4, F_GETFD) = 0 fcntl(4, F_SETFD, FD_CLOEXEC) = 0 epoll_create(128) = 5 fcntl(5, F_GETFD) = 0 fcntl(5, F_SETFD, FD_CLOEXEC) = 0 epoll_ctl(5, EPOLL_CTL_ADD, 3, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=23327440, u64=23327440}}) = 0 rt_sigaction(SIGTERM, {0x7fc370a75160, [], SA_RESTORER|SA_SIGINFO, 0x7fc3702cb480}, NULL, 8) = 0 umask(077) = 077 geteuid() = 1000 geteuid() = 1000 geteuid() = 1000 geteuid() = 1000 getegid() = 1000 getgid() = 1000 getegid() = 1000 setgid(0) = -1 EPERM (Operation not permitted) prctl(PR_SET_DUMPABLE, 1) = 0 geteuid() = 1000 chdir("/home/paulproteus") = 0 stat("/home/paulproteus/Maildir/dbox/mailboxes", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 prctl(PR_SET_DUMPABLE, 1) = 0 fcntl(0, F_GETFL) = 0 (flags O_RDONLY) fcntl(0, F_SETFL, O_RDONLY|O_NONBLOCK) = 0 fcntl(1, F_GETFL) = 0x8001 (flags O_WRONLY|O_LARGEFILE) fcntl(1, F_SETFL, O_WRONLY|O_NONBLOCK|O_LARGEFILE) = 0 fstat(0, {st_mode=S_IFIFO|0600, st_size=0, ...}) = 0 lseek(1, 0, SEEK_CUR) = 25034 fstat(1, {st_mode=S_IFREG|0644, st_size=25071, ...}) = 0 epoll_ctl(5, EPOLL_CTL_ADD, 0, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=23409968, u64=23409968}}) = 0 write(1, "* PREAUTH [CAPABILITY IMAP4rev1 "..., 305* PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in as paulproteus ) = 305 epoll_wait(5, {{EPOLLIN|EPOLLHUP, {u32=23409968, u64=23409968}}}, 2, 1800000) = 1 brk(0x1681000) = 0x1681000 read(0, "\n", 8192) = 1 write(1, "* BAD Error in IMAP command : Un"..., 48* BAD Error in IMAP command : Unknown command. ) = 48 epoll_wait(5, {{EPOLLHUP, {u32=23409968, u64=23409968}}}, 2, 1800000) = 1 read(0, "", 8191) = 0 write(2, "imap(paulproteus): Info: Connect"..., 57imap(paulproteus): Info: Connection closed bytes=1/25387 ) = 57 epoll_ctl(5, EPOLL_CTL_DEL, 0, {0, {u32=23409968, u64=23409968}}) = 0 brk(0x167f000) = 0x167f000 brk(0x167d000) = 0x167d000 close(0) = 0 close(1) = 0 brk(0x1678000) = 0x1678000 brk(0x1677000) = 0x1677000 brk(0x1675000) = 0x1675000 brk(0x1674000) = 0x1674000 epoll_ctl(5, EPOLL_CTL_DEL, 3, {0, {u32=23327440, u64=23327440}}) = 0 close(3) = 0 close(4) = 0 close(5) = 0 exit_group(0) = ? From david at electric-spoon.com Thu Dec 29 00:05:03 2011 From: david at electric-spoon.com (David Pottage) Date: Wed, 28 Dec 2011 22:05:03 +0000 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: References: <4EFAEEE4.80405@electric-spoon.com> Message-ID: <4EFB928F.2010601@electric-spoon.com> On 28/12/11 10:39, Andra? 'ruskie' Levstik wrote: > :2011-12-28T10:26:David Pottage: > >> I solved the problem by creating a second instance of dovecot running on >> a non standard port, and configured it to serve only a subset my email >> folders, so that way the email client on my smartphone works well and I >> can read the emails I am interested in on the move. > Here's a simple improvement. > Create a new email user and symlink just those folders you want to see > into it. I considered that option but decided against it for two reasons. Firstly I wanted to retain the option to switch to the full version of my mail folders if I needed to access something urgently. My smart-phone based email client allows me to change the port number of an existing email account, but will not allow me to change the user-name without creating a whole new account and re-downloading everything. Secondly creating a second account makes the authentication on the server a lot more complex. Either I need two OS level accounts on the sever, and find ways to keep them in sync, or I need to create a custom authentication method on dovecot or PAM so that when it receives a user-name matching some pattern, it will check the password against a different account. In short, I think a second server with a separate configuration is more scalable. I don't think it consumes much more resource compared with one server. > Using virtual folders could be helpful as well. I have a New mails one > which shows me all new emails in all folders which helps in a lot of > places. Could you provide a link to documentation about virtual folders. -- David Pottage From stan at hardwarefreak.com Thu Dec 29 00:12:08 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Wed, 28 Dec 2011 16:12:08 -0600 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFB928F.2010601@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> Message-ID: <4EFB9438.7090608@hardwarefreak.com> On 12/28/2011 4:05 PM, David Pottage wrote: > Firstly I wanted to retain the option to switch to the full version of > my mail folders if I needed to access something urgently. My smart-phone > based email client allows me to change the port number of an existing > email account, but will not allow me to change the user-name without > creating a whole new account and re-downloading everything. > > Secondly creating a second account makes the authentication on the > server a lot more complex. Either I need two OS level accounts on the > sever, and find ways to keep them in sync, or I need to create a custom > authentication method on dovecot or PAM so that when it receives a > user-name matching some pattern, it will check the password against a > different account. > > In short, I think a second server with a separate configuration is more > scalable. I don't think it consumes much more resource compared with one > server. It's a smart phone. Have you considering simply running a webmail server? -- Stan From rick at havokmon.com Thu Dec 29 00:21:49 2011 From: rick at havokmon.com (Rick Romero) Date: Wed, 28 Dec 2011 16:21:49 -0600 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFB928F.2010601@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> Message-ID: <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> Quoting David Pottage : > On 28/12/11 10:39, Andra? 'ruskie' Levstik wrote: >> :2011-12-28T10:26:David Pottage: >> >>> I solved the problem by creating a second instance of dovecot running on >>> a non standard port, and configured it to serve only a subset my email >>> folders, so that way the email client on my smartphone works well and I >>> can read the emails I am interested in on the move. >> Here's a simple improvement. >> Create a new email user and symlink just those folders you want to see >> into it. > I considered that option but decided against it for two reasons. > > Firstly I wanted to retain the option to switch to the full version of > my mail folders if I needed to access something urgently. My smart-phone > based email client allows me to change the port number of an existing > email account, but will not allow me to change the user-name without > creating a whole new account and re-downloading everything. I read back through the thread, and I don't see why you're not using IMAP subscriptions - did I overlook it? Rick From ghandidrivesahumvee at rocketfish.com Thu Dec 29 01:56:33 2011 From: ghandidrivesahumvee at rocketfish.com (Dovecot-GDH) Date: Wed, 28 Dec 2011 15:56:33 -0800 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111224152050.GA3958@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> Message-ID: The cleanest (though not necessarily simplest) way to go about this would be to use dsync to create a new maildir and incrementally direct traffic to a separate Dovecot instance. Unless you have a legacy application that relies on maildir, switching to mdbox would be a good idea too. I expect that with Dovecot compression is something that can "just be turned on", but for fear of any possible issue, I chose to migrate mailboxes in batches with the way mentioned above. On Dec 24, 2011, at 7:20 AM, Jan-Frode Myklebust wrote: > I've just enabled zlib for our users, and am looking at how to compress > the existing files. The routine for doing this at > http://wiki2.dovecot.org/Plugins/Zlib seems a bit complicated. What do > you think about simply doing: > > find /var/vmail -type f -name "*,S=*" -mtime +1 -exec gzip -S Z -6 '{}' + > > > I.e. find all maildir-files: > > - with size in the name ("*,S=*") > - modified before I enabled zlib plugin > - compress them > - add the Z suffix > - keep timestamps (gzip does that by default) > > > It's of course racy without the maildirlock, but are there any other > problems with this approach ? > > > -jf From zdy0818 at gmail.com Thu Dec 29 06:06:45 2011 From: zdy0818 at gmail.com (Dongyu.Zhen) Date: Thu, 29 Dec 2011 12:06:45 +0800 Subject: [Dovecot] imap be killed (core dump disabled) Message-ID: <4EFBE755.7090509@gmail.com> Hello everybody, When I modify the dovecot imap source ,in "src/imap/" dir, I meet the Error below: Error: child (imap) kill (core dump disabled). In fact, I want to record the imap operation through dovecot. So, I modify every source file in "src/imap/cmd-IMAP_OPERATION" ,when the imap command function is executed, it will write to a file cur time and operation. Could you tell me why the imap be killed? Thank you. From janfrode at tanso.net Thu Dec 29 10:49:16 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 09:49:16 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: References: <20111224152050.GA3958@dibs.tanso.net> Message-ID: <20111229084916.GA5895@dibs.tanso.net> On Wed, Dec 28, 2011 at 03:56:33PM -0800, Dovecot-GDH wrote: > The cleanest (though not necessarily simplest) way to go about this would be to use dsync to create a new maildir and incrementally direct traffic to a separate Dovecot instance. > > Unless you have a legacy application that relies on maildir, switching to mdbox would be a good idea too. We just got rid of the legacy app that worked directly against the maildirs, which is the reason we now can turn on compression. I intend to switch to mdbox, but first I need to free up some disks by compressing the existing maildirs (12 TB maildirs, should probably compress down to less than half). > > I expect that with Dovecot compression is something that can "just be turned on", but for fear of any possible issue, I chose to migrate mailboxes in batches with the way mentioned above. > Migrating to mdbox is much scarier to me than an easily reversible compression of existing maildir files. Could you please give a bit more details about how you did this migration? Did you change user home dirctory in the process? Seeing the scripts you used to run the migration would be very interesting.. -jf From janfrode at tanso.net Thu Dec 29 13:14:55 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 12:14:55 +0100 Subject: [Dovecot] dsync / separator / namespace config-problem Message-ID: <20111229111455.GA9344@dibs.tanso.net> Guess I don't quite get namespaces, but we have the following namespace configured: $ doveconf namespace namespace { hidden = no inbox = yes list = yes location = prefix = INBOX. separator = subscriptions = yes type = private } But when I try running dsync it complains: $ sudo -u atmail dsync -u janfrode at tanso.net mirror mdbox:/tmp/janfrodeboks dsync(atmail): Error: user janfrode at tanso.net: Initialization failed: namespace configuration error: list=yes requires prefix=INBOX. to end with separator dsync(atmail): Fatal: User init failed I can fix this by adding "separator = ." to the namespace and dsync is happy, but is changing this now safe, or will this affect existing clients? -jf From CMarcus at Media-Brokers.com Thu Dec 29 14:07:30 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 29 Dec 2011 07:07:30 -0500 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFB928F.2010601@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> Message-ID: <4EFC5802.8090609@Media-Brokers.com> On 2011-12-28 5:05 PM, David Pottage wrote: > Secondly creating a second account makes the authentication on the > server a lot more complex. Either I need two OS level accounts on > the sever, and find ways to keep them in sync, or I need to create a > custom authentication method on dovecot or PAM so that when it > receives a user-name matching some pattern, it will check the > password against a different account. It would be cool if the concept of 'Master User' could be expanded on to provide access to only certain other accounts, as opposed to full domains (or maybe it does alreaqdy and I just don't understand it well enough yet). For example, we have Sales Assistants in our offices, where each assistant may assist up to 3 or 4 different Sales reps. It would be nice to be able to give the Assistant read-only access to the Sales Reps emails without having to set up shared folders for each one... -- Best regards, Charles From CMarcus at Media-Brokers.com Thu Dec 29 14:10:56 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 29 Dec 2011 07:10:56 -0500 Subject: [Dovecot] imap be killed (core dump disabled) In-Reply-To: <4EFBE755.7090509@gmail.com> References: <4EFBE755.7090509@gmail.com> Message-ID: <4EFC58D0.4030300@Media-Brokers.com> On 2011-12-28 11:06 PM, Dongyu.Zhen wrote: > Hello everybody, > When I modify the dovecot imap source ,in "src/imap/" dir, I meet the > Error below: > Error: child (imap) kill (core dump disabled). > > In fact, I want to record the imap operation through dovecot. So, I > modify every source file in "src/imap/cmd-IMAP_OPERATION" ,when the imap > command function is executed, it will write to a file cur time and > operation. Ummm... maybe what you want is already there? http://wiki2.dovecot.org/Plugins/MailLog > Could you tell me why the imap be killed? You modified the source, didn't bother to provide specific details as to what modifications you did, and expect someone to be able to answer that? I don't think even Timo is that good... ;) -- Best regards, Charles From tss at iki.fi Thu Dec 29 14:27:28 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 14:27:28 +0200 Subject: [Dovecot] imap be killed (core dump disabled) In-Reply-To: <4EFBE755.7090509@gmail.com> References: <4EFBE755.7090509@gmail.com> Message-ID: <6BE91CBE-F3EB-4389-A3BC-85CE1F410EDD@iki.fi> On 29.12.2011, at 6.06, Dongyu.Zhen wrote: > Hello everybody, > When I modify the dovecot imap source ,in "src/imap/" dir, I meet the > Error below: > Error: child (imap) kill (core dump disabled). Most likely due to your modification, but gdb backtraces are helpful when debugging crashes: http://dovecot.org/bugreport.html From tss at iki.fi Thu Dec 29 14:35:15 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 14:35:15 +0200 Subject: [Dovecot] doveadm + dsync merging Message-ID: doveadm already supports some nice things, such as being able to remotely launch a doveadm command via TCP socket. It also supports executing a command for all users or to some specific users using a wildcard. dsync could use these features, so I merged dsync and doveadm into same binary for v2.1. I'll still install "dsync" symlink pointing to "doveadm", and running that way it should be fully backwards compatible with the old dsync binary and its parameters. I'm mainly now wondering about the command naming for running dsync via doveadm. Any suggestions? a) Use "doveadm dsync" prefix, and otherwise keep the names same: dsync mirror -> doveadm dsync mirror dsync backup -> doveadm dsync backup dsync server -> doveadm dsync server (for running dsync remotely via ssh/etc.) b) Don't have the dsync prefix: dsync mirror -> doveadm mirror dsync backup -> doveadm backup dsync server -> doveadm dsync-server (could be hidden from the doveadm commands list) c) Either a) or b), but rename "mirror" to "sync" or "dsync" or "replicate"? d) Something else? From japc at co.sapo.pt Thu Dec 29 14:39:11 2011 From: japc at co.sapo.pt (=?ISO-8859-1?Q?Jos=E9?= Celestino) Date: Thu, 29 Dec 2011 12:39:11 +0000 Subject: [Dovecot] imap be killed (core dump disabled) In-Reply-To: <4EFBE755.7090509@gmail.com> References: <4EFBE755.7090509@gmail.com> Message-ID: <1325162351.7270.17.camel@morgoth> On Qui, 2011-12-29 at 12:06 +0800, Dongyu.Zhen wrote: > Hello everybody, > When I modify the dovecot imap source ,in "src/imap/" dir, I meet the > Error below: > Error: child (imap) kill (core dump disabled). > > In fact, I want to record the imap operation through dovecot. So, I > modify every source file in "src/imap/cmd-IMAP_OPERATION" ,when the imap > command function is executed, it will write to a file cur time and > operation. > > Could you tell me why the imap be killed? > When I modified the imap source I had a lot of crashes as I'm sure a lot of people had. Just I wasn't as bossy to ask other people to fix them for me with their crystal ball. Search the dovecot wiki for the maillog plugin, it should do what you want minus the crashes. From tss at iki.fi Thu Dec 29 14:52:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 14:52:06 +0200 Subject: [Dovecot] /usr/lib/dovecot/imap ignores log settings? In-Reply-To: References: Message-ID: On 28.12.2011, at 20.31, Asheesh Laroia wrote: > Hi Dovecot peeps, > > I'm enjoying running /usr/lib/dovecot/imap directly as a PREAUTH IMAP pipe. > > I find that it outputs log messages whose severity is INFO to stdout. I'm running it as follows: > > /usr/lib/dovecot/imap -c /tmp/dovecot.conf > > and I see the following messages output to stdout: stderr actually. > I'd like that message to actually not be printed, which is why I set log_path to syslog. Not possible currently. Either do: /usr/lib/dovecot/imap 2>> ~/imap.log Or patch the source: diff -r 056934abd2ef src/imap/main.c --- a/src/imap/main.c Wed Dec 21 14:40:29 2011 +0200 +++ b/src/imap/main.c Thu Dec 29 14:51:12 2011 +0200 @@ -320,6 +320,7 @@ if (IS_STANDALONE()) { service_flags |= MASTER_SERVICE_FLAG_STANDALONE | + MASTER_SERVICE_FLAG_DONT_LOG_TO_STDERR | MASTER_SERVICE_FLAG_STD_CLIENT; } else { service_flags |= MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN; From p at state-of-mind.de Thu Dec 29 14:53:27 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Thu, 29 Dec 2011 13:53:27 +0100 Subject: [Dovecot] doveadm + dsync merging In-Reply-To: References: Message-ID: <20111229125326.GA2295@state-of-mind.de> * Timo Sirainen : > doveadm already supports some nice things, such as being able to remotely launch a doveadm command via TCP socket. It also supports executing a command for all users or to some specific users using a wildcard. dsync could use these features, so I merged dsync and doveadm into same binary for v2.1. > > I'll still install "dsync" symlink pointing to "doveadm", and running that way it should be fully backwards compatible with the old dsync binary and its parameters. > > I'm mainly now wondering about the command naming for running dsync via doveadm. Any suggestions? > > a) Use "doveadm dsync" prefix, and otherwise keep the names same: > > dsync mirror -> doveadm dsync mirror > dsync backup -> doveadm dsync backup > dsync server -> doveadm dsync server (for running dsync remotely via ssh/etc.) > > b) Don't have the dsync prefix: > > dsync mirror -> doveadm mirror > dsync backup -> doveadm backup > dsync server -> doveadm dsync-server (could be hidden from the doveadm commands list) Calling the old "dsync" command (symlink) directly should keep the already established command structure. Calling dsync features over doveadm should keep command structure as simple (not complex) as possible. I favour b) for that and rename 'mirror' to 'sync'. 'sync' keeps in line with products such as rsync. People will immediately know what it does. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From tss at iki.fi Thu Dec 29 14:55:40 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 14:55:40 +0200 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111224152050.GA3958@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> Message-ID: <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> On 24.12.2011, at 17.20, Jan-Frode Myklebust wrote: > I've just enabled zlib for our users, and am looking at how to compress > the existing files. The routine for doing this at > http://wiki2.dovecot.org/Plugins/Zlib seems a bit complicated. What do > you think about simply doing: > > find /var/vmail -type f -name "*,S=*" -mtime +1 -exec gzip -S Z -6 '{}' + > > > I.e. find all maildir-files: > > - with size in the name ("*,S=*") > - modified before I enabled zlib plugin As long as it doesn't find any already compressed mails.. > - compress them > - add the Z suffix Make sure there's also :2, suffix already. If someone hasn't logged in for a while there are such files in new/ directory. > It's of course racy without the maildirlock, but are there any other > problems with this approach ? Other than being racy, I guess it should work. From stan at hardwarefreak.com Thu Dec 29 15:00:03 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Thu, 29 Dec 2011 07:00:03 -0600 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111229084916.GA5895@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> Message-ID: <4EFC6453.8020304@hardwarefreak.com> On 12/29/2011 2:49 AM, Jan-Frode Myklebust wrote: > On Wed, Dec 28, 2011 at 03:56:33PM -0800, Dovecot-GDH wrote: >> The cleanest (though not necessarily simplest) way to go about this would be to use dsync to create a new maildir and incrementally direct traffic to a separate Dovecot instance. >> >> Unless you have a legacy application that relies on maildir, switching to mdbox would be a good idea too. > > We just got rid of the legacy app that worked directly against the > maildirs, which is the reason we now can turn on compression. I > intend to switch to mdbox, but first I need to free up some disks by > compressing the existing maildirs (12 TB maildirs, should probably > compress down to less than half). How much additional space do you expect the conversion process to compressed mdbox to consume? It shouldn't need much. Using dsync, the conversion will be done one mailbox at a time and the existing emails will be compressed when written into the new mdbox mailbox. After you've converted a few mailboxes by hand and have confirmed you're happy with the results, simply add commands to your bulk conversion script to delete each user maildir and contents after the new mdbox mailbox has been created and populated. Using this method shouldn't require much more additional filesystem space than that equal to your largest single user maildir. Given your 12TB of mailstore, I'd convert users in small batches over a period of weeks or a month, depending on your total mailbox count. Firing up a conversion script and having it run non-stop until all 12TB are converted is probably asking for trouble due to many factors I shouldn't need to put down here. Time your first few manual conversions. Divide that average time into your daily off-peak hours so you know approximately how many mailboxes you can convert during off-peak hours. Run your script daily against these small sets of mailboxes until the entire process is complete. -- Stan From tss at iki.fi Thu Dec 29 15:07:34 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:07:34 +0200 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFC5802.8090609@Media-Brokers.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <4EFC5802.8090609@Media-Brokers.com> Message-ID: On 29.12.2011, at 14.07, Charles Marcus wrote: > It would be cool if the concept of 'Master User' could be expanded on to provide access to only certain other accounts, as opposed to full domains (or maybe it does alreaqdy and I just don't understand it well enough yet). > > For example, we have Sales Assistants in our offices, where each assistant may assist up to 3 or 4 different Sales reps. It would be nice to be able to give the Assistant read-only access to the Sales Reps emails without having to set up shared folders for each one... It's kind of possible, but perhaps not super easy.. Basically you can use %{login_user}, %{login_username} and %{login_domain} variables to figure out if the master user login should be accepted. With SQL you could use these to create a table that has allowed masteruser -> login_username mappings. From tss at iki.fi Thu Dec 29 15:08:35 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:08:35 +0200 Subject: [Dovecot] UIDL format In-Reply-To: References: Message-ID: <058BDAFC-2103-4BFE-9E3B-5179E0E12925@iki.fi> On 28.12.2011, at 0.58, sottilette at rfx.it wrote: > How can be sure of the current POP3 UIDL? If it's not visible, it's the default. Check with: dovecot -a | grep pop3_uidl_format From tss at iki.fi Thu Dec 29 15:10:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:10:20 +0200 Subject: [Dovecot] dsync / separator / namespace config-problem In-Reply-To: <20111229111455.GA9344@dibs.tanso.net> References: <20111229111455.GA9344@dibs.tanso.net> Message-ID: <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> On 29.12.2011, at 13.14, Jan-Frode Myklebust wrote: > Guess I don't quite get namespaces, but we have the following namespace > configured: > > $ doveconf namespace > namespace { > hidden = no > inbox = yes > list = yes > location = > prefix = INBOX. > separator = > subscriptions = yes > type = private > } Since separator is empty, it defaults to whatever the mailbox format's internal separator is. > But when I try running dsync it complains: > > $ sudo -u atmail dsync -u janfrode at tanso.net mirror mdbox:/tmp/janfrodeboks > dsync(atmail): Error: user janfrode at tanso.net: Initialization failed: namespace configuration error: list=yes requires prefix=INBOX. to end with separator dsync(atmail): Fatal: User init failed With mdbox the internal separator is '/', but it's not valid to have "INBOX." prefix then (it should be "INBOX/"). > I can fix this by adding "separator = ." to the namespace and dsync is > happy, but is changing this now safe, or will this affect existing clients? Since you were using Maildir, which uses '.' as the default separator, setting this explicitly won't break anything. From tss at iki.fi Thu Dec 29 15:11:09 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:11:09 +0200 Subject: [Dovecot] Dsync Error Can't Delete Mailbox In-Reply-To: <4EF9E845.4030507@globalchangemusic.org> References: <4EF9E845.4030507@globalchangemusic.org> Message-ID: On 27.12.2011, at 17.46, Asai wrote: > I'm getting this error in the dsync logs: > > Warning: Destination mailbox INBOX has been modified, need to recreate it before we can continue syncing > dsync(foo at bar.org): Error: Can't delete mailbox INBOX: INBOX can't be deleted. > > In this situation, what should I do to remedy the problem? Just delete the backup and rebuild? Yes, that's the only solution currently. From tss at iki.fi Thu Dec 29 15:12:31 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:12:31 +0200 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF826D0.3050005@hardwarefreak.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> <4EF67364.6030003@hardwarefreak.com> <4EF817A5.3030101@lazurit.com> <4EF826D0.3050005@hardwarefreak.com> Message-ID: <0BAAC85A-C73C-413D-9F5E-188AFC5EA40D@iki.fi> On 26.12.2011, at 9.48, Stan Hoeppner wrote: > On 12/26/2011 12:43 AM, Alexander Chekalin wrote: >> I tried to create folder named like 'Old Mail' (and in fact I got >> another mbox container), while I needed to create 'Old Mail/' (note the >> slash), which results in real filesystem directory. > > Oh wow, that is simple. And makes perfect sense. Before my last reply > I read the php IMAP command set definitions/parameters and I didn't see > anything about how to do this, which is an odd omission in > documentation. I guess so few people use mbox these days they omit that > case from the docs. I hit three different sources and none of them > mentioned the trailing slash for creating 'sub-folders-only' folders... That's not PHP-specific, but rather IMAP-specific. It's in RFC 3501. From tss at iki.fi Thu Dec 29 15:15:38 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:15:38 +0200 Subject: [Dovecot] Dovecot imap proxy to nginx, incompatible In-Reply-To: <4EF5124E.7000303@vitalwerks.com> References: <4EF5124E.7000303@vitalwerks.com> Message-ID: <1F6ED1C2-6288-4680-8154-DC581344713B@iki.fi> On 24.12.2011, at 1.44, David Jonas wrote: > It appears that using dovecot to proxy to nginx imap proxy doesn't work. > From tcpdump and browsing the source it appears dovecot sends, > > C CAPABILITY\r\nL LOGIN \r\n > > and nginx only responds to the CAPABILITY command. Is this a problem > with dovecot sending the two commands without waiting for the first to > complete or is it nginx's trouble with not handling it correctly? nginx bug. Dovecot is just being as efficient as it can be. From tss at iki.fi Thu Dec 29 15:18:15 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:18:15 +0200 Subject: [Dovecot] Lucene vs Solr with 2.1 single server In-Reply-To: References: Message-ID: <21140AB9-373B-4E75-B2E5-A848022BD950@iki.fi> On 23.12.2011, at 9.10, Daniel L. Miller wrote: > For a single server, is the Lucene backend now "better" than running a Solr server? Simpler, at least. Probably not better, since Solr uses a newer Lucene engine. From tss at iki.fi Thu Dec 29 15:23:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:23:12 +0200 Subject: [Dovecot] proxying, SSL, and client certificate In-Reply-To: References: Message-ID: On 23.12.2011, at 1.10, Mike Abbott wrote: > How do I configure dovecot-2.0.x to present a client SSL certificate when proxying? Set ssl_client_cert and ssl_client_key settings in dovecot.conf. Requires hg version, since these were added after v2.0.16. > If dovecot on server1.example.com has: > passdb { > driver = static > args = proxy=y host=server2.example.com nopassword=y ssl=yes > } > > and dovecot on server2.example.com has: > ssl_verify_client_cert = yes > auth_ssl_require_client_cert = yes > > then when a client connects to server1 and authenticates, a connection is established to server2 but the SSL handshake fails because server1 doesn't present a client certificate. I don't see where ssl_client_ctx is tied to a client certificate in ssl-proxy-openssl.c. If you want some kind of automatic client certificate forwarding, I don't think that's possible even in theory since the private key is needed. From tss at iki.fi Thu Dec 29 15:31:33 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:31:33 +0200 Subject: [Dovecot] Received date no longer email date? In-Reply-To: <4EF3AD7D.40203@gmail.com> References: <4EF3AD7D.40203@gmail.com> Message-ID: On 23.12.2011, at 0.21, Brian L. Matthews wrote: > I just upgrade from dovecot 1.2 to dovecot 2.0.16. I use dovecot as a local IMAP server to archive email from my corporate email account (on Exchange). I don't have any automated archiving, I just periodically move messages from my Exchange inbox to the IMAP inbox. I'm on Mac OS X 10.6.8 using Entourage as my mail client. > > In the previous version of dovecot, the Received date of the email was preserved when I moved a message, but it's not in 2.0.16, it's set to the date and time I move the message. If I open a message, the date displayed is the date on the message as expected. It should still work the same in Dovecot v2.0. I just tested that giving a timestamp to APPEND command works. Did you also upgrade the IMAP client? Maybe it doesn't add the timestamp anymore. From tss at iki.fi Thu Dec 29 15:35:18 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:35:18 +0200 Subject: [Dovecot] Maildir migration and uids In-Reply-To: <4EF28D7B.8050601@vitalwerks.com> References: <4EF28D7B.8050601@vitalwerks.com> Message-ID: <81E45F76-34A4-4666-9F10-7566B7BD496C@iki.fi> On 22.12.2011, at 3.52, David Jonas wrote: > I'm in the process of migrating a large number of maildirs to a 3rd > party dovecot server (from a dovecot server). Tests have shown that > using imap to sync the accounts doesn't preserve the uidl for pop3 access. > > My current attempt is to convert the maildir to mbox and add an X-UIDL > header in the process. Run a second dovecot that serves the converted > mbox. But dovecot's docs say, "None of these headers are sent to > IMAP/POP3 clients when they read the mail". That's rather complex. > Is there any way to sync these maildirs to the new server and maintain > the uids? What Dovecot versions? dsync could do this easily. You could simply install the dsync binary even if you're using Dovecot v1.x. You could also log in with POP3 and get the UIDL list and write a script to add them to dovecot-uidlist. From janfrode at tanso.net Thu Dec 29 15:36:43 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 14:36:43 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> References: <20111224152050.GA3958@dibs.tanso.net> <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> Message-ID: <20111229133643.GA11809@dibs.tanso.net> On Thu, Dec 29, 2011 at 02:55:40PM +0200, Timo Sirainen wrote: > > > > I.e. find all maildir-files: > > > > - with size in the name ("*,S=*") > > - modified before I enabled zlib plugin > > As long as it doesn't find any already compressed mails.. Can't I trust that no mails with timestamp before I enabled compression are uncompressed? Or will dovecot compress old messages keeping old timestamp when copying messages between folders, or something like that? I want to avoid reading every file to check if it's compressed already, as that will add ages to an already slow process.. > > > - compress them > > - add the Z suffix > > Make sure there's also :2, suffix already. If someone hasn't logged in for a while there are such files in new/ directory. So, find /var/vmail -type f -name "*,S=*:2*" -mtime +6 -exec gzip -S Z -6 '{}' + Right ? I don't care too much if I miss on a few percent of the files.. (I'll probably have to use "-newer /somefile" instead of -mtime since it will run for some days) -jf From janfrode at tanso.net Thu Dec 29 15:42:34 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 14:42:34 +0100 Subject: [Dovecot] dsync / separator / namespace config-problem In-Reply-To: <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> References: <20111229111455.GA9344@dibs.tanso.net> <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> Message-ID: <20111229134234.GB11809@dibs.tanso.net> On Thu, Dec 29, 2011 at 03:10:20PM +0200, Timo Sirainen wrote: > > With mdbox the internal separator is '/', but it's not valid to have "INBOX." prefix then (it should be "INBOX/"). But how should this be handled in the migration phase from maildir to mdbox then? Can we have different namespaces for users with maildirs vs. mdboxes? (..or am i misunderstanding something?) > > > I can fix this by adding "separator = ." to the namespace and dsync is > > happy, but is changing this now safe, or will this affect existing clients? > > Since you were using Maildir, which uses '.' as the default separator, setting this explicitly won't break anything. Great, I'll fix our config then. Thanks! -jf From tss at iki.fi Thu Dec 29 15:48:05 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:48:05 +0200 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111229133643.GA11809@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> <20111229133643.GA11809@dibs.tanso.net> Message-ID: <0A1CC1CE-8C58-47DB-A87D-75FBCF7DF3F8@iki.fi> On 29.12.2011, at 15.36, Jan-Frode Myklebust wrote: > On Thu, Dec 29, 2011 at 02:55:40PM +0200, Timo Sirainen wrote: >>> >>> I.e. find all maildir-files: >>> >>> - with size in the name ("*,S=*") >>> - modified before I enabled zlib plugin >> >> As long as it doesn't find any already compressed mails.. > > Can't I trust that no mails with timestamp before I enabled compression > are uncompressed? Or will dovecot compress old messages keeping old > timestamp when copying messages between folders, or something like that? It's possible that a user saves a mail with an old IMAP INTERNALDATE (=file's mtime), which is already compressed. You could use ctime, but that could skip mails whose flags have been changed since compression. > I want to avoid reading every file to check if it's compressed > already, as that will add ages to an already slow process.. You could use mtime, and just before compressing the mail check if it's already compressed. That won't add much overhead. >>> - compress them >>> - add the Z suffix >> >> Make sure there's also :2, suffix already. If someone hasn't logged in for a while there are such files in new/ directory. > > So, > find /var/vmail -type f -name "*,S=*:2*" -mtime +6 -exec gzip -S Z -6 '{}' + > > > Right ? I don't care too much if I miss on a few percent of the files.. Yes. From tss at iki.fi Thu Dec 29 15:49:57 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:49:57 +0200 Subject: [Dovecot] dsync / separator / namespace config-problem In-Reply-To: <20111229134234.GB11809@dibs.tanso.net> References: <20111229111455.GA9344@dibs.tanso.net> <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> <20111229134234.GB11809@dibs.tanso.net> Message-ID: On 29.12.2011, at 15.42, Jan-Frode Myklebust wrote: > On Thu, Dec 29, 2011 at 03:10:20PM +0200, Timo Sirainen wrote: >> >> With mdbox the internal separator is '/', but it's not valid to have "INBOX." prefix then (it should be "INBOX/"). > > But how should this be handled in the migration phase from maildir to > mdbox then? Can we have different namespaces for users with maildirs vs. > mdboxes? (..or am i misunderstanding something?) You'll most likely want to keep the '.' separator with mdbox, at least initially. Some clients don't like if the separator changes. Perhaps in future if you want to allow users to use '.' character in mailbox names you could change it, or possibly make it a per-user setting. From janfrode at tanso.net Thu Dec 29 16:14:39 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 15:14:39 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <0A1CC1CE-8C58-47DB-A87D-75FBCF7DF3F8@iki.fi> References: <20111224152050.GA3958@dibs.tanso.net> <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> <20111229133643.GA11809@dibs.tanso.net> <0A1CC1CE-8C58-47DB-A87D-75FBCF7DF3F8@iki.fi> Message-ID: <20111229141439.GA12567@dibs.tanso.net> On Thu, Dec 29, 2011 at 03:48:05PM +0200, Timo Sirainen wrote: > > > > Can't I trust that no mails with timestamp before I enabled compression > > are uncompressed? Or will dovecot compress old messages keeping old > > timestamp when copying messages between folders, or something like that? > > It's possible that a user saves a mail with an old IMAP INTERNALDATE (=file's mtime), which is already compressed. You could use ctime, but that could skip mails whose flags have been changed since compression. Ok, if ctime is safer I think I'll use that and not worry too much about missing some messages. > > > I want to avoid reading every file to check if it's compressed > > already, as that will add ages to an already slow process.. > > You could use mtime, and just before compressing the mail check if it's already compressed. That won't add much overhead. Ah, right.. I'll have to read the messages from disk anyway, so checking if they're compressed or not doesn't add much. So mtime + compression-check is what I'll need to do then. -jf From user+dovecot at localhost.localdomain.org Thu Dec 29 16:19:28 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Thu, 29 Dec 2011 15:19:28 +0100 Subject: [Dovecot] doveadm + dsync merging In-Reply-To: <20111229125326.GA2295@state-of-mind.de> References: <20111229125326.GA2295@state-of-mind.de> Message-ID: <4EFC76F0.2050705@localhost.localdomain.org> On 12/29/2011 01:53 PM Patrick Ben Koetter wrote: > * Timo Sirainen : >> ? >> a) Use "doveadm dsync" prefix, and otherwise keep the names same: >> >> dsync mirror -> doveadm dsync mirror >> dsync backup -> doveadm dsync backup >> dsync server -> doveadm dsync server (for running dsync remotely via ssh/etc.) >> >> b) Don't have the dsync prefix: >> >> dsync mirror -> doveadm mirror >> dsync backup -> doveadm backup >> dsync server -> doveadm dsync-server (could be hidden from the doveadm commands list) > > Calling the old "dsync" command (symlink) directly should keep the already > established command structure. > > Calling dsync features over doveadm should keep command structure as simple > (not complex) as possible. I favour b) for that and rename 'mirror' to 'sync'. > > 'sync' keeps in line with products such as rsync. People will immediately know > what it does. I'd prefer doveadm commands with the dsync prefix. (a)) Because: * doveadm already has other 'command groups' like mailbox, director ? * that's the way to avoid command clashes (w/o hiding anything) Renaming 'mirror' to 'sync' could be helpful ? Regards, Pascal -- The trapper recommends today: cafebabe.1136315 at localdomain.org From asai at globalchangemusic.org Thu Dec 29 17:51:14 2011 From: asai at globalchangemusic.org (Asai) Date: Thu, 29 Dec 2011 08:51:14 -0700 Subject: [Dovecot] Dsync Error Can't Delete Mailbox In-Reply-To: References: <4EF9E845.4030507@globalchangemusic.org> Message-ID: <4EFC8C72.4000900@globalchangemusic.org> OK, thank you very much for this wonderful application. --asai On 12/29/2011 6:11 AM, Timo Sirainen wrote: > On 27.12.2011, at 17.46, Asai wrote: > >> I'm getting this error in the dsync logs: >> >> Warning: Destination mailbox INBOX has been modified, need to recreate it before we can continue syncing >> dsync(foo at bar.org): Error: Can't delete mailbox INBOX: INBOX can't be deleted. >> >> In this situation, what should I do to remedy the problem? Just delete the backup and rebuild? > Yes, that's the only solution currently. > From gedalya at gedalya.net Thu Dec 29 19:23:27 2011 From: gedalya at gedalya.net (Gedalya) Date: Thu, 29 Dec 2011 12:23:27 -0500 Subject: [Dovecot] Trouble with proxy_maybe and auth_default_realm Message-ID: <4EFCA20F.10107@gedalya.net> Hello, I'm using proxy_maybe and auth_default_realm. It seems that when a user logs in without the domain name, relying on auth_default_realm, and the "host" field points to the local server, I get the Proxying loops to itself error. It does work as expected - log on to the local server without proxying, if the user does include the domain name in the login. (IP's and domain name masked below) No domain: Dec 29 11:49:07 imap01 dovecot: pop3-login: Error: Proxying loops to itself: user=, method=PLAIN, rip=00.00.52.18, lip=00.00.241.140 Dec 29 11:49:27 imap01 dovecot: pop3-login: Disconnected (auth failed, 1 attempts): user=, method=PLAIN, rip=00.00.52.18, lip=00.00.241.140 With domain: Dec 29 11:52:13 imap01 dovecot: pop3-login: Login: user=, method=PLAIN, rip=00.00.52.18, lip=00.00.241.140, mpid=19969 Dec 29 11:52:18 imap01 dovecot: pop3(jedi at ---.com): Disconnected: Logged out top=0/0, retr=0/0, del=0/1, size=731 Otherwise, e.g. when the proxy host is indeed another host, auth_default_domain works fine, including or not including the domain seems to make no difference, and everything works. I'm using mysql, and I'm able to get around this problem including the following in the password query: IF(host='' or host='00.00.241.140', NULL, 'Y') as proxy_maybe # dovecot --version 2.0.15 # dovecot -n # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 auth_default_realm = ----.com auth_mechanisms = plain login cram-md5 ntlm auth_username_format = %Lu auth_verbose = yes auth_verbose_passwords = plain dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no login_greeting = How can I help you? mail_gid = vmail mail_uid = vmail passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = imap pop3 lmtp service lmtp { inet_listener lmtp { address = 0.0.0.0 port = 7025 } } ssl_cert = References: Message-ID: On Thu, 29 Dec 2011, Timo Sirainen wrote: > On 28.12.2011, at 20.31, Asheesh Laroia wrote: > >> Hi Dovecot peeps, >> >> I'm enjoying running /usr/lib/dovecot/imap directly as a PREAUTH IMAP pipe. >> >> I find that it outputs log messages whose severity is INFO to stdout. I'm running it as follows: >> >> /usr/lib/dovecot/imap -c /tmp/dovecot.conf >> >> and I see the following messages output to stdout: > > stderr actually. Right. Thanks for that; I saw it was file descriptor 2 in the strace after I hit send. >> I'd like that message to actually not be printed, which is why I set log_path to syslog. > > Not possible currently. Either do: > > /usr/lib/dovecot/imap 2>> ~/imap.log > > Or patch the source: [snip] Great! That should be okay for now. -- Asheesh. From bra at fsn.hu Thu Dec 29 21:59:35 2011 From: bra at fsn.hu (Attila Nagy) Date: Thu, 29 Dec 2011 20:59:35 +0100 Subject: [Dovecot] doveadm + dsync merging In-Reply-To: References: Message-ID: <4EFCC6A7.1060406@fsn.hu> Hi, On 12/29/2011 01:35 PM, Timo Sirainen wrote: > doveadm already supports some nice things, such as being able to remotely launch a doveadm command via TCP socket. It also supports executing a command for all users or to some specific users using a wildcard. dsync could use these features, so I merged dsync and doveadm into same binary for v2.1. > > I'll still install "dsync" symlink pointing to "doveadm", and running that way it should be fully backwards compatible with the old dsync binary and its parameters. > > I'm mainly now wondering about the command naming for running dsync via doveadm. Any suggestions? > > a) Use "doveadm dsync" prefix, and otherwise keep the names same: > > dsync mirror -> doveadm dsync mirror > dsync backup -> doveadm dsync backup > dsync server -> doveadm dsync server (for running dsync remotely via ssh/etc.) > > b) Don't have the dsync prefix: > > dsync mirror -> doveadm mirror > dsync backup -> doveadm backup > dsync server -> doveadm dsync-server (could be hidden from the doveadm commands list) > > c) Either a) or b), but rename "mirror" to "sync" or "dsync" or "replicate"? > > d) Something else? > Slightly different, but it would be good to have a persistently running daemon which could operate both in server and client mode. In server mode it would listen on a TCP socket. In client mode it would accept source and target information via a control socket. The target IP address and port would be the daemon's listening socket. Something like this on the server side: service dsync { process_limit = 8 client_limit = 8 inet_listener dsync { port = 5555 } Then doveadm sync on the "client) could first connect to the local server (client), which then connects to the remote service on the server. Eg.: doveadm sync [-C ] [-m ] [-u ] [-frRv] mirror | [@] where user at host should specify the remote user (mailbox user) and host should read like 1.1.1.1:1234 (IP address|hostname and port where the dsync service listens. Or a separate port option to allow easier parsing. Having the client in a persistent setup would allow faster syncs for repeated invocations. It would be good to have a simple API to trigger the sync (a simple text protocol on a unix socket, or something) from outside programs, to avoid calling doveadm. The next thing would be to follow dovecot logs and do a sync/async replication. :) From janfrode at tanso.net Thu Dec 29 22:03:45 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 21:03:45 +0100 Subject: [Dovecot] dsync / separator / namespace config-problem In-Reply-To: References: <20111229111455.GA9344@dibs.tanso.net> <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> <20111229134234.GB11809@dibs.tanso.net> Message-ID: <20111229200345.GA17871@dibs.tanso.net> On Thu, Dec 29, 2011 at 03:49:57PM +0200, Timo Sirainen wrote: > >> > >> With mdbox the internal separator is '/', but it's not valid to have "INBOX." prefix then (it should be "INBOX/"). > > > > But how should this be handled in the migration phase from maildir to > > mdbox then? Can we have different namespaces for users with maildirs vs. > > mdboxes? (..or am i misunderstanding something?) > > You'll most likely want to keep the '.' separator with mdbox, at least initially. Some clients don't like if the separator changes. Perhaps in future if you want to allow users to use '.' character in mailbox names you could change it, or possibly make it a per-user setting. > Sorry for being so dense, but I don't quite get it still. Do you suggest dropping the trailing dot from prefix=INBOX. ? I.e. namespace { inbox = yes location = prefix = INBOX type = private separator = . } when we do the migration to mdbox? And this should work without issues for both current maildir users, and mdbox users ? Ideally I don't want to use the . as a separator, since it's causing problems for our users who expect to be able to use them in folder names. But I don't understand if I can change them without causing problems to existing users.. or how these problems will appear to the users. -jf From david at electric-spoon.com Thu Dec 29 23:54:57 2011 From: david at electric-spoon.com (David Pottage) Date: Thu, 29 Dec 2011 21:54:57 +0000 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFB9438.7090608@hardwarefreak.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <4EFB9438.7090608@hardwarefreak.com> Message-ID: <4EFCE1B1.9060704@electric-spoon.com> On 28/12/11 22:12, Stan Hoeppner wrote: > It's a smart phone. Have you considering simply running a webmail server? I considered it for about 10 seconds. Webmail is much less efficent than IMAP both for the server and the client. I run SquirrelMail on (on Apache) my server, and it consumes far more CPU and RAM than Dovecot. It is also much slower in most operations compared with IMAP. Though I have not measured it, I suspect the bandwidth consumption is much higher because of HTML mark-up and images. In any case, webmail would not solve the problem of too many folders being displayed. I would get just as long a list, with a hard to use scrollbar, but rendered as html instead of in a menu. -- David Pottage From david at electric-spoon.com Fri Dec 30 00:02:09 2011 From: david at electric-spoon.com (David Pottage) Date: Thu, 29 Dec 2011 22:02:09 +0000 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> Message-ID: <4EFCE361.6030104@electric-spoon.com> On 28/12/11 22:21, Rick Romero wrote: > > Quoting David Pottage : >> Firstly I wanted to retain the option to switch to the full version of >> my mail folders if I needed to access something urgently. My smart-phone >> based email client allows me to change the port number of an existing >> email account, but will not allow me to change the user-name without >> creating a whole new account and re-downloading everything. > > I read back through the thread, and I don't see why you're not using > IMAP subscriptions - did I overlook it? > If you mean subscriptions on the smartphone client, I was not using them because the first IMAP client I was using (native email on a Palm Pre) did not support them. I have since switched to an Android phone and started using K9, but I still find it helpful to filter the list of folders that that K9 sees as I don't want a huge list with an unmanageable scrollbar, and many of the folders are archive folders that will never contain anything current, so it makes no sense to make them accessible except through a desktop client. I am not saying my solution is the only possible solution but I do think it is worth recording in the Wiki as others may find my approach useful. -- David Pottage From knute2011 at knutejohnson.com Fri Dec 30 01:57:23 2011 From: knute2011 at knutejohnson.com (Knute Johnson) Date: Thu, 29 Dec 2011 15:57:23 -0800 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFCE361.6030104@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> <4EFCE361.6030104@electric-spoon.com> Message-ID: <4EFCFE63.3000804@knutejohnson.com> On 12/29/2011 2:02 PM, David Pottage wrote: > On 28/12/11 22:21, Rick Romero wrote: >> >> Quoting David Pottage: >>> Firstly I wanted to retain the option to switch to the full version of >>> my mail folders if I needed to access something urgently. My smart-phone >>> based email client allows me to change the port number of an existing >>> email account, but will not allow me to change the user-name without >>> creating a whole new account and re-downloading everything. >> >> I read back through the thread, and I don't see why you're not using >> IMAP subscriptions - did I overlook it? >> > If you mean subscriptions on the smartphone client, I was not using them > because the first IMAP client I was using (native email on a Palm Pre) > did not support them. > > I have since switched to an Android phone and started using K9, but I > still find it helpful to filter the list of folders that that K9 sees as > I don't want a huge list with an unmanageable scrollbar, and many of the > folders are archive folders that will never contain anything current, so > it makes no sense to make them accessible except through a desktop client. > > I am not saying my solution is the only possible solution but I do think > it is worth recording in the Wiki as others may find my approach useful. > My wife has an Android phone running K-9 and she is able to not display most of the hundreds of folders that she has. I haven't seen any drawbacks to that technique on her phone. Well maybe if she got rid of about a 1000 emails out of her INBOX it would help :-). -- Knute Johnson knute2011 at knutejohnson.com From dovecot at knutejohnson.com Fri Dec 30 01:58:01 2011 From: dovecot at knutejohnson.com (Knute Johnson) Date: Thu, 29 Dec 2011 15:58:01 -0800 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFCE361.6030104@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> <4EFCE361.6030104@electric-spoon.com> Message-ID: <4EFCFE89.1030703@knutejohnson.com> On 12/29/2011 2:02 PM, David Pottage wrote: > On 28/12/11 22:21, Rick Romero wrote: >> >> Quoting David Pottage: >>> Firstly I wanted to retain the option to switch to the full version of >>> my mail folders if I needed to access something urgently. My smart-phone >>> based email client allows me to change the port number of an existing >>> email account, but will not allow me to change the user-name without >>> creating a whole new account and re-downloading everything. >> >> I read back through the thread, and I don't see why you're not using >> IMAP subscriptions - did I overlook it? >> > If you mean subscriptions on the smartphone client, I was not using them > because the first IMAP client I was using (native email on a Palm Pre) > did not support them. > > I have since switched to an Android phone and started using K9, but I > still find it helpful to filter the list of folders that that K9 sees as > I don't want a huge list with an unmanageable scrollbar, and many of the > folders are archive folders that will never contain anything current, so > it makes no sense to make them accessible except through a desktop client. > > I am not saying my solution is the only possible solution but I do think > it is worth recording in the Wiki as others may find my approach useful. > My wife has an Android phone running K-9 and she is able to not display most of the hundreds of folders that she has. I haven't seen any drawbacks to that technique on her phone. Well maybe if she got rid of about a 1000 emails out of her INBOX it would help . -- Knute Johnson From bill+dovecot at blunn.org Fri Dec 30 04:31:54 2011 From: bill+dovecot at blunn.org (William Blunn) Date: Fri, 30 Dec 2011 02:31:54 +0000 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF5A9EC.8090606@hardwarefreak.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> Message-ID: <4EFD229A.9080803@blunn.org> On 24/12/2011 10:31, Stan Hoeppner wrote: > With mbox storage, an IMAP FOLDER contains only sub folders or it contains only messages. It CANNOT contain BOTH. Dovecot can store both folders and messages in a folder, under mbox. See http://wiki2.dovecot.org/MboxChildFolders Bill From bill+dovecot at blunn.org Fri Dec 30 05:10:20 2011 From: bill+dovecot at blunn.org (William Blunn) Date: Fri, 30 Dec 2011 03:10:20 +0000 Subject: [Dovecot] Upgrade/Migration In-Reply-To: References: Message-ID: <4EFD2B9C.4050907@blunn.org> On 23/12/2011 19:20, sottilette at rfx.it wrote: > New box (supposed): CentOS 6.x (32/64 bit ? ), dovecot 2.04, mbox format > > Any hints/comment appreciated ;-) Don't use Dovecot 2.0.4, even if your distro tries to tempt you into doing so by including such a version. Whilst it looks like a stable version number, there were a number of issues with early Dovecot 2.0.x. Instead use 2.0.latest. Starting from http://www.dovecot.org/download.html you could find http://packages.atrpms.net/dist/el6/dovecot/ which provides 32- and 64-bit RPMs of Dovecot 2.0.16. Bill From bill at blunn.org Fri Dec 30 05:34:02 2011 From: bill at blunn.org (William Blunn) Date: Fri, 30 Dec 2011 03:34:02 +0000 Subject: [Dovecot] Using Amazon S3 storage for Maildir ? In-Reply-To: References: <4EEF75C4.9040005@gmail.com> Message-ID: <4EFD312A.2070706@blunn.org> On 20/12/2011 05:29, Timo Sirainen wrote: > On 19.12.2011, at 19.35, Forrest Aldrich wrote: > >> I wonder if anyone has tried using an IMAP server with Amazon S3 as a backend. There would be many factors to consider (speed, etc). However, moreso, I don't know that Maildir(++) would support multiple folders that might be linked into the cloud. For example, higher-I/O local incoming mail is on disk, some folders archived on S3. Could be easily done by simply creating another account and storing its Maildir in S3 -- > Maybe [sm]dbox with alt storage set to S3? http://wiki2.dovecot.org/MailboxFormat/dbox#Alternate_storage Also consider using the S3QL ( http://code.google.com/p/s3ql/ ) filesystem, which stores files chunked on the backend (e.g. Amazon S3). This ought to work well for dbox alternate storage, and archived mbox mail (though it may be worth arranging for indexes to be stored locally). Bill From janfrode at tanso.net Fri Dec 30 10:44:07 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 30 Dec 2011 09:44:07 +0100 Subject: [Dovecot] doveadm + dsync merging In-Reply-To: <4EFCC6A7.1060406@fsn.hu> References: <4EFCC6A7.1060406@fsn.hu> Message-ID: <20111230084407.GA30568@dibs.tanso.net> On Thu, Dec 29, 2011 at 08:59:35PM +0100, Attila Nagy wrote: > > > Slightly different, but it would be good to have a persistently > running daemon which could operate both in server and client mode. > In server mode it would listen on a TCP socket. In client mode it > would accept source and target information via a control socket. The > target IP address and port would be the daemon's listening socket. > Great idea! > > The next thing would be to follow dovecot logs and do a sync/async > replication. :) It's not too hard to do async already.. If you have last-login tracking in the post-login scripts, you can use this to know which users to trigger async backups for every X minute. -jf From janfrode at tanso.net Fri Dec 30 11:00:53 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 30 Dec 2011 10:00:53 +0100 Subject: [Dovecot] lmtp-postlogin ? Message-ID: <20111230090053.GA30820@dibs.tanso.net> We have last-login tracking for imap and pop, and I intend to use this for deciding which users to backup daily. But, it would also be nice to backup users who has only received messages, but not logged in lately.. So is it possible to implement "last-login" tracking for lmtp ? I naively tried copying the settings from imap, but it didn't work: service lmtp-postlogin { executable = script-login /usr/local/sbin/lmtp-postlogin.sh unix_listener lmtp-postlogin { } } service lmtp { executable = lmtp lmtp-postlogin -jf From stan at hardwarefreak.com Fri Dec 30 13:53:58 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 30 Dec 2011 05:53:58 -0600 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EFD229A.9080803@blunn.org> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <4EFD229A.9080803@blunn.org> Message-ID: <4EFDA656.9040903@hardwarefreak.com> On 12/29/2011 8:31 PM, William Blunn wrote: > On 24/12/2011 10:31, Stan Hoeppner wrote: >> With mbox storage, an IMAP FOLDER contains only sub folders or it >> contains only messages. It CANNOT contain BOTH. > > Dovecot can store both folders and messages in a folder, under mbox. > > See http://wiki2.dovecot.org/MboxChildFolders Not by default, and not without potential headaches. I'm still waiting to see someone post here that they're using this setup in a production environment, and that it works seamlessly with XYZ IMAP clients, backup software, current custom scripts without requiring a rewrite, etc. mbox capability in this regard hasn't changed for some 15-20 years until Timo suggested this with Dovecot. The capability may exist, but until I see that it is being used successfully in production environments, I'm going to continue stating the standard mbox capability. To do otherwise at this point will only serve to confuse people. -- Stan From tss at iki.fi Fri Dec 30 14:03:34 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 30 Dec 2011 14:03:34 +0200 Subject: [Dovecot] lmtp-postlogin ? In-Reply-To: <20111230090053.GA30820@dibs.tanso.net> References: <20111230090053.GA30820@dibs.tanso.net> Message-ID: <16B30E6C-AE5E-44CB-8F48-66274FEAB357@iki.fi> On 30.12.2011, at 11.00, Jan-Frode Myklebust wrote: > We have last-login tracking for imap and pop, and I intend to use this > for deciding which users to backup daily. But, it would also be nice to > backup users who has only received messages, but not logged in lately.. > So is it possible to implement "last-login" tracking for lmtp ? LMTP supports authentication, but Dovecot doesn't support it. And you most likely didn't mean that anyway. So, when would it be executed? When client connects? After each RCPT TO? After DATA? Maybe create a new plugin for this using notify plugin. From janfrode at tanso.net Fri Dec 30 15:08:04 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 30 Dec 2011 14:08:04 +0100 Subject: [Dovecot] lmtp-postlogin ? In-Reply-To: <16B30E6C-AE5E-44CB-8F48-66274FEAB357@iki.fi> References: <20111230090053.GA30820@dibs.tanso.net> <16B30E6C-AE5E-44CB-8F48-66274FEAB357@iki.fi> Message-ID: <20111230130804.GA2107@dibs.tanso.net> On Fri, Dec 30, 2011 at 02:03:34PM +0200, Timo Sirainen wrote: > > LMTP supports authentication, but Dovecot doesn't support it. And you most likely didn't mean that anyway. Yes, I know.. > So, when would it be executed? When client connects? After each RCPT TO? After DATA? For my async backup-purposes any time after RCPT TO would be fine. I just want to know which users has received any message the last X hours. But i guess the ideal place would be at the time lmtp logs that it's saved a message to a mailbox. Guess a workaround is to grep for these in the log. > Maybe create a new plugin for this using notify plugin. Is there any documentation for this plugin? I've tried searching both this list, and the wiki's. -jf From janfrode at tanso.net Fri Dec 30 16:41:24 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 30 Dec 2011 15:41:24 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <4EFC6453.8020304@hardwarefreak.com> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> <4EFC6453.8020304@hardwarefreak.com> Message-ID: <20111230144124.GA3936@dibs.tanso.net> On Thu, Dec 29, 2011 at 07:00:03AM -0600, Stan Hoeppner wrote: > > We just got rid of the legacy app that worked directly against the > > maildirs, which is the reason we now can turn on compression. I > > intend to switch to mdbox, but first I need to free up some disks by > > compressing the existing maildirs (12 TB maildirs, should probably > > compress down to less than half). > > How much additional space do you expect the conversion process to > compressed mdbox to consume? Somewhere around 1/3 of the current usage, I expect.. > It shouldn't need much. Using dsync, the > conversion will be done one mailbox at a time and the existing emails > will be compressed when written into the new mdbox mailbox. Yes, I know, but I intend to do more than just convert to mdbox. I want to fix the whole folder structure*, in a new filesystem with different settings (turn on metadata-replication, and possibly also data replication). So I need to free up some disks before this can start. [*] move away from @Mails /atmail/a/b/abuser at domain folder structure to mdbox:/srv/mailbackup/%256Hu/%d/%n, stop having home=inbox, possibly use many smaller fs's instead of one huge, move the indexes inside home... -jf From qmailcalvin at gmail.com Fri Dec 30 20:53:00 2011 From: qmailcalvin at gmail.com (Calvin Cochran) Date: Fri, 30 Dec 2011 10:53:00 -0800 Subject: [Dovecot] imap process limits problem Message-ID: I am having a problem with the number of current processes that I cannot seem to diagnose adequately, and is a possible bug. This will be a bit long, but usually more info is better. I am running dovecot 2.0.16 on a CentOS 5 x86_64 server with the mailstore on gfs (output from dovecot -n at bottom). This is an imap issue. This is mostly to do with one client, but none of my tests indicate an issue with the client side. We have mail_max_userip_connections = 10 for imap, but they are not hitting the limit. We also have verbose_proctitle = yes to help in diagnosing the situation. Most of our clients, including this one, use SSL or TLS and connect on 993. As I understand it, that should have an imap-login process and an imap process per authenticated session. Based on some other diagnosis the client seems to have a PC using Outlook 2010 and an i-device (phone or pad, not sure), both on the office network, and both with imap connections to the server. Based on my analysis it seems like the client is connecting, authenticating, and then closing the session, but the imap-login process does not drop until it times out server side (I don't know a way to tell which device, the PC or i???). One odd thing is that the tcp sessions time out at 2 hours and 11 minutes (this is where the possible bug aspect comes in). I have put a strace on the process, and there does not appear to be any traffic, so I don't understand why the 30 min timeout isn't happening. Based on netstat and verbose_proctitle, at this moment there are 99 connections from the IP in question, all of which show in ps output as: dovecot/imap-login [1 connections (1 TLS)] My understanding is that means they have successfully authenticated, and that there should be line with dovecot/imap [username ip TLS] in ps output, but there isn't, so I am taking that to mean the client closed the imap session. The client ip address puts them on comcast (tcp resets?) and we do have a load balancer in front of two servers, just to add a little challenge to the diagnosis fun. The short term fix has been to increase the process limits. However, it is clearly not a workable solution to increase the limits by 100 every time someone starts accessing the server with their new i??? device. I appreciate your thoughts on this, and I am happy to provide additional useful debug info if I have missed something. Thanks, Calvin output from dovecot -n auth_mechanisms = plain apop cram-md5 auth_verbose = yes auth_verbose_passwords = plain auth_worker_max_count = 400 default_process_limit = 400 disable_plaintext_auth = no first_valid_uid = 89 last_valid_uid = 89 login_greeting = EMCS ready. mail_fsync = never maildir_very_dirty_syncs = yes mmap_disable = yes passdb { driver = vpopmail } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_log_group_events = no } protocols = imap pop3 shutdown_clients = no ssl_cert = References: <4EFD2B9C.4050907@blunn.org> Message-ID: On Fri, 30 Dec 2011, William Blunn wrote: >> New box (supposed): CentOS 6.x (32/64 bit ? ), dovecot 2.04, mbox format >> >> Any hints/comment appreciated ;-) > > Don't use Dovecot 2.0.4, even if your distro tries to tempt you into doing so > by including such a version. > > Whilst it looks like a stable version number, there were a number of issues > with early Dovecot 2.0.x. > > Instead use 2.0.latest. Are there relevant difference between 2.0.4 and 2.0.16 config? > Starting from http://www.dovecot.org/download.html you could find > > http://packages.atrpms.net/dist/el6/dovecot/ > > which provides 32- and 64-bit RPMs of Dovecot 2.0.16. Started upgrading old box. - backup data and conf, downloaded old rpm for emergengy - rpm -Uvh dovecot-2.0.16-1_132.el4.i386.rpm - changed some config settings so I can start the daemon ... - seems to work. ;-) There is a way to test it intensively before users do it for me? ;-) Happy new year to all ;-) Thanks, P. From stan at hardwarefreak.com Sat Dec 31 02:38:28 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 30 Dec 2011 18:38:28 -0600 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111230144124.GA3936@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> <4EFC6453.8020304@hardwarefreak.com> <20111230144124.GA3936@dibs.tanso.net> Message-ID: <4EFE5984.9080905@hardwarefreak.com> On 12/30/2011 8:41 AM, Jan-Frode Myklebust wrote: > On Thu, Dec 29, 2011 at 07:00:03AM -0600, Stan Hoeppner wrote: >>> We just got rid of the legacy app that worked directly against the >>> maildirs, which is the reason we now can turn on compression. I >>> intend to switch to mdbox, but first I need to free up some disks by >>> compressing the existing maildirs (12 TB maildirs, should probably >>> compress down to less than half). >> >> How much additional space do you expect the conversion process to >> compressed mdbox to consume? > > Somewhere around 1/3 of the current usage, I expect.. > >> It shouldn't need much. Using dsync, the >> conversion will be done one mailbox at a time and the existing emails >> will be compressed when written into the new mdbox mailbox. > > Yes, I know, but I intend to do more than just convert to mdbox. I want > to fix the whole folder structure*, in a new filesystem with different > settings (turn on metadata-replication, and possibly also data > replication). So I need to free up some disks before this can start. > > [*] move away from @Mails /atmail/a/b/abuser at domain folder structure to > mdbox:/srv/mailbackup/%256Hu/%d/%n, stop having home=inbox, > possibly use many smaller fs's instead of one huge, move the indexes > inside home... Roger that. Good strategy. You using SAN storage or local RAID? What filesystem do you plan to use for the new mailbox location? What OS is the Dovecot host? Lastly, how many users you have? Sorry for prying, I'm always really curious about system details when someone states they have 12TB of mailbox data. ;) -- Stan From stan at hardwarefreak.com Sat Dec 31 03:20:39 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 30 Dec 2011 19:20:39 -0600 Subject: [Dovecot] imap process limits problem In-Reply-To: References: Message-ID: <4EFE6367.5000408@hardwarefreak.com> On 12/30/2011 12:53 PM, Calvin Cochran wrote: > I am having a problem with the number of current processes that I cannot > seem to diagnose adequately, and is a possible bug. This will be a bit > long, but usually more info is better. Usually. :) > I am running dovecot 2.0.16 on a CentOS 5 x86_64 server with the mailstore > on gfs (output from dovecot -n at bottom). This is an imap issue. This is > mostly to do with one client, but none of my tests indicate an issue with > the client side. We have > mail_max_userip_connections = 10 > for imap, but they are not hitting the limit. Not going over 10 connection limit. > We also have > verbose_proctitle = yes > to help in diagnosing the situation. Most of our clients, including this > one, use SSL or TLS and connect on 993. As I understand it, that should > have an imap-login process and an imap process per authenticated session. > Based on some other diagnosis the client seems to have a PC using Outlook > 2010 and an i-device (phone or pad, not sure), both on the office network, Both on office network. > and both with imap connections to the server. Based on my analysis it > seems like the client is connecting, authenticating, and then closing the > session, but the imap-login process does not drop until it times out server > side (I don't know a way to tell which device, the PC or i???). One odd > thing is that the tcp sessions time out at 2 hours and 11 minutes (this is > where the possible bug aspect comes in). I have put a strace on the > process, and there does not appear to be any traffic, so I don't understand > why the 30 min timeout isn't happening. Based on netstat and > verbose_proctitle, at this moment there are 99 connections from the IP in 99 connections from that IP. This is a discrepancy from what you state above, and suggests you are going over the limit. Thus why isn't the 10 connection limit kicking in? > question, all of which show in ps output as: > dovecot/imap-login [1 connections (1 TLS)] > My understanding is that means they have successfully authenticated, and > that there should be line with > dovecot/imap [username ip TLS] > in ps output, but there isn't, so I am taking that to mean the client > closed the imap session. > The client ip address puts them on comcast (tcp resets?) First on office net, now on Comcast. This is a discrepancy. Are we dealing with two issues, or two different users here? > and we do have a > load balancer in front of two servers, just to add a little challenge to > the diagnosis fun. Yay. Which load balancer? Have you removed it from the IMAP loop to eliminate it as a possible cause? > The short term fix has been to increase the process limits. However, it is > clearly not a workable solution to increase the limits by 100 every time > someone starts accessing the server with their new i??? device. > I appreciate your thoughts on this, and I am happy to provide additional > useful debug info if I have missed something. 99 login connections would suggest malware, broken IMAP client software, many multiple client devices behind a NAT all logging in with the same credentials, a load balancer problem, or a combination of these. Unfortunately, with this many variables, the first 3 of which you have no direct control over or even verifiable knowledge of, troubleshooting this may prove difficult. Just out of curiosity, have you tried the non one-login-process-per-connection setup? login_process_size = 64 login_process_per_connection = yes login_processes_count = 3 login_max_processes_count = 128 login_max_connections = 256 Season values to taste. -- Stan From dovecot at r.paypc.com Sat Dec 31 04:21:41 2011 From: dovecot at r.paypc.com (Robin) Date: Fri, 30 Dec 2011 18:21:41 -0800 Subject: [Dovecot] imap process limits problem In-Reply-To: References: Message-ID: <4EFE71B5.3050103@r.paypc.com> On 12/30/2011 10:53 AM, Calvin Cochran wrote: > I am having a problem with the number of current processes that I cannot > seem to diagnose adequately, and is a possible bug. This will be a bit > long, but usually more info is better. > [....] > verbose_proctitle, at this moment there are 99 connections from the IP in > question, all of which show in ps output as: > dovecot/imap-login [1 connections (1 TLS)] > My understanding is that means they have successfully authenticated, and > that there should be line with > dovecot/imap [username ip TLS] > in ps output, but there isn't, so I am taking that to mean the client > closed the imap session. This sounds like yet another round of buggy clients that just abruptly dump connections instead of closing them down properly, or some intervening firewalling configuration that's preventing the proper signoff and TCP FIN handshakes from completing. The 2 hours+ sounds like these sockets (and the processes that used them) might be stuck in FIN_WAIT1, which isn't affected by the timeout specified in /proc/sys/net/ipv4/tcp_fin_timeout Use netstat -a these connections to see their disposition You can try some of the following: 1) Lower tcp_keepalive intervals and reduce the # of probes before a "kill" - does Dovecot make use of SO_KEEPALIVE, or can it be configured to do so? 2) Lower application idle timeout settings. (Is there a mandated "check-in" interval defined for IMAP clients?) =R= From janfrode at tanso.net Sat Dec 31 08:56:49 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Sat, 31 Dec 2011 07:56:49 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <4EFE5984.9080905@hardwarefreak.com> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> <4EFC6453.8020304@hardwarefreak.com> <20111230144124.GA3936@dibs.tanso.net> <4EFE5984.9080905@hardwarefreak.com> Message-ID: <20111231065649.GA19046@dibs.tanso.net> On Fri, Dec 30, 2011 at 06:38:28PM -0600, Stan Hoeppner wrote: > > Roger that. Good strategy. You using SAN storage or local RAID? What > filesystem do you plan to use for the new mailbox location? What OS is > the Dovecot host? IBM DS4800 SAN-storage. Filesystem is IBM GPFS, which stripe all I/O over all the RAID5 LUNs it has assigned. Kind of like RAID5+0. To guard against disaster if one RAID5 array should fail, we plan on replicating the filesystem metadata on different sets for LUNs. OS is RHEL (currently RHEL4 and RHEL5, but new servers are implemented on RHEL6). > Lastly, how many users you have? Sorry for prying, I'd rather not say.. but we're an ISP, with about 250.000 residential customers and multiple mailboxes per customer. > I'm always really curious about system details when someone states they > have 12TB of mailbox data. ;) $ df -h /usr/local/atmail/users Filesystem Size Used Avail Use% Mounted on /dev/atmailusers 14T 12T 2.1T 85% /usr/local/atmail/users $ df -hi /usr/local/atmail/users Filesystem Inodes IUsed IFree IUse% Mounted on /dev/atmailusers 145M 109M 37M 75% /usr/local/atmail/users Looking forward to reducing the number of inodes when we finally move to mdbox.. Should do wonders to the backup process. -jf From stan at hardwarefreak.com Sat Dec 31 09:54:32 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 31 Dec 2011 01:54:32 -0600 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111231065649.GA19046@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> <4EFC6453.8020304@hardwarefreak.com> <20111230144124.GA3936@dibs.tanso.net> <4EFE5984.9080905@hardwarefreak.com> <20111231065649.GA19046@dibs.tanso.net> Message-ID: <4EFEBFB8.1070301@hardwarefreak.com> On 12/31/2011 12:56 AM, Jan-Frode Myklebust wrote: > On Fri, Dec 30, 2011 at 06:38:28PM -0600, Stan Hoeppner wrote: >> >> Roger that. Good strategy. You using SAN storage or local RAID? What >> filesystem do you plan to use for the new mailbox location? What OS is >> the Dovecot host? > > IBM DS4800 SAN-storage. Filesystem is IBM GPFS, which stripe all I/O > over all the RAID5 LUNs it has assigned. Kind of like RAID5+0. To guard > against disaster if one RAID5 array should fail, we plan on replicating > the filesystem metadata on different sets for LUNs. Nice setup. I've mentioned GPFS for cluster use on this list before, but I think you're the only operator to confirm using it. I'm sure others would be interested in hearing of your first hand experience: pros, cons, performance, etc. And a ball park figure on the licensing costs, whether one can only use GPFS on IBM storage or if storage from others vendors is allowed in the GPFS pool. To this point IIRC everyone here doing clusters is using NFS, GFS, or OCFS. Each has its downsides, mostly because everyone is using maildir. NFS has locking issues with shared dovecot index files. GFS and OCFS have filesystem metadata performance issues. How does GPFS perform with your maildir workload? > OS is RHEL (currently RHEL4 and RHEL5, but new servers are implemented > on RHEL6). > >> Lastly, how many users you have? Sorry for prying, > > I'd rather not say.. but we're an ISP, with about 250.000 residential > customers and multiple mailboxes per customer. > >> I'm always really curious about system details when someone states they >> have 12TB of mailbox data. ;) > > $ df -h /usr/local/atmail/users > Filesystem Size Used Avail Use% Mounted on > /dev/atmailusers 14T 12T 2.1T 85% /usr/local/atmail/users > $ df -hi /usr/local/atmail/users > Filesystem Inodes IUsed IFree IUse% Mounted on > /dev/atmailusers 145M 109M 37M 75% /usr/local/atmail/users > > Looking forward to reducing the number of inodes when we finally move to > mdbox.. Should do wonders to the backup process. That will depend to a large degree on your mdbox_rotate_size value. The default is 2MB, which means you'll get multiple ~2MB mdbox files. If we assume the average email size including headers and attachments is 32KB, Dovecot will place ~64 such emails in a single mdbox file with the default 2MB setting. 32KB may be a high or low average depending on your particular users. Considering there is no inherent performance downside to going larger than the default, and significant gains to be made, consider a setting of 8MB to 16MB. This will dramatically reduce both inode consumption and filesystem metadata IOPS vs maildir. Reducing IOPS on a shared SAN is always a plus, especially if you're going to be adding some extra GPFS replication traffic. Timo, is there any technical or sanity based upper bound on mdbox size? Anything wrong with using 64MB, 128MB, or even larger for mdbox_rotate_size? -- Stan From lists at wildgooses.com Sat Dec 31 15:20:53 2011 From: lists at wildgooses.com (Ed W) Date: Sat, 31 Dec 2011 13:20:53 +0000 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <4EF310E0.6030006@Media-Brokers.com> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> Message-ID: <4EFF0C35.5000303@wildgooses.com> On 22/12/2011 11:13, Charles Marcus wrote: > On 2011-12-21 11:18 PM, Simon Brereton > wrote: >> It would be interesting to chart the number of threads caused by each >> distro. I don't know who would have the least, but I suspect gentoo and >> centos would be out in front, > > Been using gentoo since about 2003 and never looked back... best and > easiest distro to maintain, bar none, and the best support and > documentation too. > Wait... Back up... You mean there are *other* distributions of linux? I thought they were all just gentoo derivatives..?!! :-) Ed W From user+dovecot at localhost.localdomain.org Sat Dec 31 15:29:55 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 31 Dec 2011 14:29:55 +0100 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <4EFF0C35.5000303@wildgooses.com> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> <4EFF0C35.5000303@wildgooses.com> Message-ID: <4EFF0E53.4060604@localhost.localdomain.org> On 12/31/2011 02:20 PM Ed W wrote: > > Wait... Back up... You mean there are *other* distributions of linux? I > thought they were all just gentoo derivatives..?!! > > :-) Huh, I thought everything would be based on LFS [http://www.linuxfromscratch.org/lfs/]. Happy new year to the all Dovecot admins and Timo San. Regards, Pascal -- The trapper recommends today: cafebabe.1136514 at localdomain.org From jerry at seibercom.net Sat Dec 31 16:11:14 2011 From: jerry at seibercom.net (Jerry) Date: Sat, 31 Dec 2011 09:11:14 -0500 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <4EFF0C35.5000303@wildgooses.com> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> <4EFF0C35.5000303@wildgooses.com> Message-ID: <20111231091114.5e232cb9@scorpio> On Sat, 31 Dec 2011 13:20:53 +0000 Ed W articulated: > On 22/12/2011 11:13, Charles Marcus wrote: > > On 2011-12-21 11:18 PM, Simon Brereton > > wrote: > >> It would be interesting to chart the number of threads caused by > >> each distro. I don't know who would have the least, but I suspect > >> gentoo and centos would be out in front, > > > > Been using gentoo since about 2003 and never looked back... best > > and easiest distro to maintain, bar none, and the best support and > > documentation too. > > > > Wait... Back up... You mean there are *other* distributions of > linux? I thought they were all just gentoo derivatives..?!! Be careful, you are going to get all of the FreeBSD aficionados panties in a knot. They claim the best documentation. Of course, what do they have to document? From CMarcus at Media-Brokers.com Sat Dec 31 16:43:38 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sat, 31 Dec 2011 09:43:38 -0500 Subject: [Dovecot] imap process limits problem In-Reply-To: References: Message-ID: <4EFF1F9A.1030009@Media-Brokers.com> I think Stan already pointed you to where your problem most likely lies, but just wanted to point out that this: On 2011-12-30 1:53 PM, Calvin Cochran wrote: > Most of our clients, including this one, use SSL or TLS and connect > on 993. I believe is incorrect. Port 993 is for IMAP over SSL, if the client is using TLS (or more correctly, STARTTLS), then they should be using the normal IMAP port 143. -- Best regards, Charles From dmiller at amfes.com Sat Dec 31 22:28:41 2011 From: dmiller at amfes.com (Daniel L. Miller) Date: Sat, 31 Dec 2011 12:28:41 -0800 Subject: [Dovecot] fts_solr break-imap-search 2.1 Message-ID: Is "break-imap-search" still required using 2.1 with Solr to index TEXT & BODY searches? -- Daniel From tss at iki.fi Sat Dec 31 22:30:52 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 31 Dec 2011 22:30:52 +0200 Subject: [Dovecot] fts_solr break-imap-search 2.1 In-Reply-To: References: Message-ID: <3ED2196F-A573-4EB4-AD05-15F30A2A6B81@iki.fi> On 31.12.2011, at 22.28, Daniel L. Miller wrote: > Is "break-imap-search" still required using 2.1 with Solr to index TEXT & BODY searches? No. It's enabled always. From dovecot.user at seibercom.net Thu Dec 1 00:14:06 2011 From: dovecot.user at seibercom.net (Jerry) Date: Wed, 30 Nov 2011 17:14:06 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: <20111130171406.7ac37cbf@scorpio> On Wed, 30 Nov 2011 15:36:46 -0500 Terry Carmen articulated: > I need to make the IMAP interface of an Exchange 2000 server > available on the net, however I would like to give it a little > protection, and believe Dovecot's IMAP proxy might be appropriate. > > Does anybody have a *really simple* config that would allow IMAP > pass-through to a single Exchange server? > > The examples I've seen all assume some sort of load balancing, which > isn't an issue here, so I'd like to eliminate the need for an > unnecessary database server. > > Does Dovecot do any cleanup of the IMAP commands that would be > useful in protecting Exchange (from this, > http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I > barking up the wrong tree? > > If Dovecot isn't helpful for this, can anybody point me to a better > resource? An Exchange 2000 server is ancient. I wouldn't waste time with it unless there was no possible way to get an updated version; ie, Exchange server 2010. -- Jerry ? Dovecot.user at seibercom.net Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From terry at cnysupport.com Thu Dec 1 02:00:39 2011 From: terry at cnysupport.com (Terry Carmen) Date: Wed, 30 Nov 2011 19:00:39 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130171406.7ac37cbf@scorpio> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130171406.7ac37cbf@scorpio> Message-ID: <20111130190039.Horde.A1m8eleGiNBO1sOnioewmHA@www.cnysupport.com> ----- Message from Jerry --------- Date: Wed, 30 Nov 2011 17:14:06 -0500 From: Jerry Reply-To: dovecot at dovecot.org Subject: Re: [Dovecot] MS Exchange IMAP Proxy To: dovecot at dovecot.org > On Wed, 30 Nov 2011 15:36:46 -0500 > Terry Carmen articulated: > >> I need to make the IMAP interface of an Exchange 2000 server >> available on the net, however I would like to give it a little >> protection, and believe Dovecot's IMAP proxy might be appropriate. >> >> Does anybody have a *really simple* config that would allow IMAP >> pass-through to a single Exchange server? >> >> The examples I've seen all assume some sort of load balancing, which >> isn't an issue here, so I'd like to eliminate the need for an >> unnecessary database server. >> >> Does Dovecot do any cleanup of the IMAP commands that would be >> useful in protecting Exchange (from this, >> http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I >> barking up the wrong tree? >> >> If Dovecot isn't helpful for this, can anybody point me to a better >> resource? > > An Exchange 2000 server is ancient. I wouldn't waste time with it > unless there was no possible way to get an updated version; ie, Exchange > server 2010. The client won't pay for an Exchange update just to support a handful of external IMAP users. It works perfectly well internally, using a Postfix relayhost. Terry From seandarcy2 at gmail.com Thu Dec 1 02:15:33 2011 From: seandarcy2 at gmail.com (sean darcy) Date: Wed, 30 Nov 2011 19:15:33 -0500 Subject: [Dovecot] can not get t'bird to create folder In-Reply-To: References: Message-ID: On 11/28/2011 06:50 PM, sean darcy wrote: > dovecot-2.0.16 on Fedora 15. > > thunderbird-8.0 > > I can access dovecot from thunderbird, imap maildir. But when I try to > create a new folder, nothing happens. > > I'm not using LAYOUT=fs, so I have added, tb-extra-mailbox-sep, which > didn't seem relevant anyhow. > > Any help appreciated. > > sean > > The problem was that the antispam plugin was for 2.0.15 - and I'm using 2.0.16. It seems that if a plugin can't be loaded, dovecot can't do anything else. sean From ghandidrivesahumvee at rocketfish.com Thu Dec 1 04:30:31 2011 From: ghandidrivesahumvee at rocketfish.com (Dovecot-GDH) Date: Wed, 30 Nov 2011 18:30:31 -0800 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130190039.Horde.A1m8eleGiNBO1sOnioewmHA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130171406.7ac37cbf@scorpio> <20111130190039.Horde.A1m8eleGiNBO1sOnioewmHA@www.cnysupport.com> Message-ID: >> An Exchange 2000 server is ancient. I wouldn't waste time with it >> unless there was no possible way to get an updated version; ie, Exchange >> server 2010. > > > The client won't pay for an Exchange update just to support a handful of external IMAP users. > > It works perfectly well internally, using a Postfix relayhost. > > Terry If the client is inept enough to run Exchange 2000 for only a handful of users, you're probably wasting your time attempting to sanitize IMAP commands. If your contract with them mandates that you secure their server, you'll most likely have to replace their broken software. From seandarcy2 at gmail.com Thu Dec 1 04:37:59 2011 From: seandarcy2 at gmail.com (sean darcy) Date: Wed, 30 Nov 2011 21:37:59 -0500 Subject: [Dovecot] can't get sieve to sort virus into spam In-Reply-To: <4ED49127.6020000@rename-it.nl> References: <1266621424.20111129030956@gmail.com> <4ED49127.6020000@rename-it.nl> Message-ID: On 11/29/2011 03:00 AM, Stephan Bosch wrote: > On 11/29/2011 4:09 AM, Duane Hill wrote: >> On Tuesday, November 29, 2011 at 02:28:29 UTC, seandarcy2 at gmail.com >> confabulated: >> >>> I can't get sieve to put virus files in the SPAM folder. > >>> does not end up into SPAM, or anyplace else, including inbox. > >>> How do I make this work? >> What gets logged? If sieve has an issue storing something, it is >> logged. > > The message must be stored somewhere, even if Sieve fails entirely. If > your Dovecot logs provide no indication that a message was handled, are > you even sure that LTMP is getting a message at all? In this regard your > MTA's logs are of importance as well. > > Regards, > > Stephan. > Thanks for your response. I solved the disappearing problem: the message is being put into the INBOX. There are no user sieve scripts. Is there a way to disable any that could occur? Here are the headers: Content-Type: multipart/alternative; boundary=000e0cd5712cced62c04b2fe370e X-DSPAM-Result: Virus X-DSPAM-Processed: Wed Nov 30 21:00:35 2011 X-DSPAM-Confidence: 1.0000 X-DSPAM-Probability: 1.0000 X-DSPAM-Signature: 4ed6dfc341474953737117 --000e0cd5712cced62c04b2fe370e Content-Type: text/plain; charset=ISO-8859-1 X5O!P%@AP[4\PZX54(P^)7CC)7}$EICAR-STANDARD-ANTIVIRUS-TEST-FILE!$H+H* Here's default.sieve: cat /var/lib/dovecot/sieve/default.sieve require "fileinto"; if header :contains "X-DSPAM-Result" "Virus" { fileinto "Virus"; } if header :contains "X-DSPAM-Result" "Spam" { fileinto "SPAM"; } From dovecot-info.log: Nov 30 21:25:43 auth: Debug: master in: USER 1 firstlast@<>.com service=lmtp lip=127.0.0.1 lport=24 rip=127. 0.0.1 rport=35594 Nov 30 21:25:43 auth: Debug: passwd(firstlast@<>,127.0.0.1): lookup Nov 30 21:25:43 auth: Info: passwd(firstlast@<>,127.0.0.1): unknown user Nov 30 21:25:43 auth: Debug: passwd-file(firstlast@<>.com,127.0.0.1): lookup: user=firstlast@<>.com file=/etc/dovecot/users Nov 30 21:25:43 auth: Debug: master out: USER 1 firstlast@<>.com uid=504 gid=504 home=/home/vmail/<>.com/firstlas t Nov 30 21:25:43 lmtp(12609, firstlast@<>.com): Info: Av/jFKfl1k5BMQAABoXEcA: msgid=: saved mail to INBOX sean From tss at iki.fi Thu Dec 1 04:47:30 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 1 Dec 2011 04:47:30 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: On 30.11.2011, at 22.36, Terry Carmen wrote: > Does Dovecot do any cleanup of the IMAP commands that would be useful in protecting Exchange (from this, http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I barking up the wrong tree? v2.1 with imapc backend can be used to do this. There's not really documentation for it beyond this mailing list though. From terry at cnysupport.com Thu Dec 1 06:03:24 2011 From: terry at cnysupport.com (Terry Carmen) Date: Wed, 30 Nov 2011 23:03:24 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Thu, 1 Dec 2011 04:47:30 +0200 From: Timo Sirainen Subject: Re: [Dovecot] MS Exchange IMAP Proxy To: Terry Carmen Cc: dovecot at dovecot.org > On 30.11.2011, at 22.36, Terry Carmen wrote: > >> Does Dovecot do any cleanup of the IMAP commands that would be >> useful in protecting Exchange (from this, >> http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I >> barking up the wrong tree? > > v2.1 with imapc backend can be used to do this. There's not really > documentation for it beyond this mailing list though. I'd be happy to give it a try. I have an absolutely dead-simple setup. All it has to do is sit between the internet and the IMAP port on an Exchange server. Any hints on how to set it up? Thanks! Terry From terry at cnysupport.com Thu Dec 1 06:17:39 2011 From: terry at cnysupport.com (Terry Carmen) Date: Wed, 30 Nov 2011 23:17:39 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130171406.7ac37cbf@scorpio> <20111130190039.Horde.A1m8eleGiNBO1sOnioewmHA@www.cnysupport.com> Message-ID: <20111130231739.Horde.rzH2TleGiNBO1v-jWdQQmLA@www.cnysupport.com> > If the client is inept enough to run Exchange 2000 for only a > handful of users, you're probably wasting your time attempting to > sanitize IMAP commands. > > If your contract with them mandates that you secure their server, > you'll most likely have to replace their broken software. There are over 500 users on the server, however there are only a few external users. I'm really not trying to justify a business case here, I'm just trying to get an IMAP connection. Terry From stan at hardwarefreak.com Thu Dec 1 06:44:35 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Wed, 30 Nov 2011 22:44:35 -0600 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: <4ED70633.3000406@hardwarefreak.com> On 11/30/2011 2:36 PM, Terry Carmen wrote: > I need to make the IMAP interface of an Exchange 2000 server available > on the net, however I would like to give it a little protection, and > believe Dovecot's IMAP proxy might be appropriate. > > Does anybody have a *really simple* config that would allow IMAP > pass-through to a single Exchange server? > > The examples I've seen all assume some sort of load balancing, which > isn't an issue here, so I'd like to eliminate the need for an > unnecessary database server. > > Does Dovecot do any cleanup of the IMAP commands that would be useful in > protecting Exchange (from this, > http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I > barking up the wrong tree? > > If Dovecot isn't helpful for this, can anybody point me to a better > resource? Look into the SM IMAP Proxy. It was designed for a different purpose, but may work well for your scenario: http://imapproxy.org/index.html -- Stan From stephan at rename-it.nl Thu Dec 1 09:27:36 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 01 Dec 2011 08:27:36 +0100 Subject: [Dovecot] can't get sieve to sort virus into spam In-Reply-To: References: <1266621424.20111129030956@gmail.com> <4ED49127.6020000@rename-it.nl> Message-ID: <4ED72C68.5040001@rename-it.nl> On 12/1/2011 3:37 AM, sean darcy wrote: > On 11/29/2011 03:00 AM, Stephan Bosch wrote: >> On 11/29/2011 4:09 AM, Duane Hill wrote: >>> On Tuesday, November 29, 2011 at 02:28:29 UTC, seandarcy2 at gmail.com >>> confabulated: >>> >>>> I can't get sieve to put virus files in the SPAM folder. >> >>>> does not end up into SPAM, or anyplace else, including inbox. >> >>>> How do I make this work? >>> What gets logged? If sieve has an issue storing something, it is >>> logged. >> >> The message must be stored somewhere, even if Sieve fails entirely. If >> your Dovecot logs provide no indication that a message was handled, are >> you even sure that LTMP is getting a message at all? In this regard your >> MTA's logs are of importance as well. >> >> Regards, >> >> Stephan. >> > > Thanks for your response. I solved the disappearing problem: the > message is being put into the INBOX. > > There are no user sieve scripts. Is there a way to disable any that > could occur? [...] > Nov 30 21:25:43 auth: Debug: master in: USER 1 > firstlast@<>.com service=lmtp lip=127.0.0.1 > lport=24 rip=127. > 0.0.1 rport=35594 > Nov 30 21:25:43 auth: Debug: passwd(firstlast@<>,127.0.0.1): lookup > Nov 30 21:25:43 auth: Info: passwd(firstlast@<>,127.0.0.1): unknown user > Nov 30 21:25:43 auth: Debug: passwd-file(firstlast@<>.com,127.0.0.1): > lookup: user=firstlast@<>.com file=/etc/dovecot/users > Nov 30 21:25:43 auth: Debug: master out: USER 1 > firstlast@<>.com uid=504 gid=504 home=/home/vmail/<>.com/firstlas > t > Nov 30 21:25:43 lmtp(12609, firstlast@<>.com): Info: > Av/jFKfl1k5BMQAABoXEcA: > msgid= mail.gmail.com>: saved mail to INBOX Apparently, the Sieve plugin is not active or not loaded. The message is stored by lmtp, because otherwise that final log line would have a `sieve: ' prefix somewhere. Do you see any sieve-related log lines when mail_debug=yes? Regards, Stephan. From hs at schlittermann.de Thu Dec 1 10:19:58 2011 From: hs at schlittermann.de (Heiko Schlittermann) Date: Thu, 1 Dec 2011 09:19:58 +0100 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> Message-ID: <20111201081958.GB30720@jumper.schlittermann.de> Terry Carmen (Mi 30 Nov 2011 21:36:46 CET): > useful in protecting Exchange (from this, > http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I > barking up the wrong tree? > > If Dovecot isn't helpful for this, can anybody point me to a better resource? Some time ago wie used "perdition", but I do not know, if it has sanitizing features beyond just being a proxy for the IMAP protocol. -- Heiko :: dresden : linux : SCHLITTERMANN.de GPG Key 48D0359B : 3061 CFBF 2D88 F034 E8D2 7E92 EE4E AC98 48D0 359B -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From wek at andatra.kiev.ua Thu Dec 1 10:33:20 2011 From: wek at andatra.kiev.ua (Yaroslav Boychuk) Date: Thu, 01 Dec 2011 10:33:20 +0200 Subject: [Dovecot] dsync(root): Fatal: execvp() failed: No such file or directory Message-ID: <4ED73BD0.2030302@andatra.kiev.ua> Hi everybody, I try to convert mbox to maildir using local locations /root/mail is a dir with mboxes /root/INBOX is mbox file h=/root dsync -f -v mirror \ mbox:$h/mail:INBOX=$h/INBOX \ maildir:$h/Maildir:CONTROL=$h/dovecot:INDEX=$h/dovecot \ as result I have dsync(root): Fatal: execvp(mbox:/root/mail:INBOX=/root/INBOX) failed: No such file or directory dsync-local(root): Error: read() from worker server failed: EOF thank you for any help FreeBSD, dovecot 2.0.15 From tss at iki.fi Thu Dec 1 15:00:03 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 1 Dec 2011 15:00:03 +0200 Subject: [Dovecot] dsync(root): Fatal: execvp() failed: No such file or directory In-Reply-To: <4ED73BD0.2030302@andatra.kiev.ua> References: <4ED73BD0.2030302@andatra.kiev.ua> Message-ID: On 1.12.2011, at 10.33, Yaroslav Boychuk wrote: > dsync -f -v mirror \ > mbox:$h/mail:INBOX=$h/INBOX \ > maildir:$h/Maildir:CONTROL=$h/dovecot:INDEX=$h/dovecot \ dsync -f -v mirror \ -o mail=mbox:$h/mail:INBOX=$h/INBOX \ maildir:$h/Maildir:CONTROL=$h/dovecot:INDEX=$h/dovecot \ From eray.aslan at caf.com.tr Thu Dec 1 18:15:28 2011 From: eray.aslan at caf.com.tr (Eray Aslan) Date: Thu, 1 Dec 2011 18:15:28 +0200 Subject: [Dovecot] v2.1.rc1 missing SnowballAnalyzer.h Message-ID: <20111201161528.GI3177@zptr-nb18.caf.local> While trying to test v.2.1.rc1 with configure \ --with-lucene \ --without-stemmer \ [...] I get the following error: [...] /bin/sh ../../../libtool --tag=CXX --mode=compile i686-pc-linux-gnu-g++ -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-index -I../../../src/lib-storage -I../../../src/plugins/fts -I../../../src/doveadm -O2 -march=i686 -pipe -c -o lucene-wrapper.lo lucene-wrapper.cc libtool: compile: i686-pc-linux-gnu-g++ -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-index -I../../../src/lib-storage -I../../../src/plugins/fts -I../../../src/doveadm -O2 -march=i686 -pipe -c lucene-wrapper.cc -fPIC -DPIC -o .libs/lucene-wrapper.o lucene-wrapper.cc:26:30: fatal error: SnowballAnalyzer.h: No such file or directory compilation terminated. make[4]: *** [lucene-wrapper.lo] Error 1 The offending line in lucene-wrapper.cc is: #include "SnowballAnalyzer.h" Sure enough, there is no SnowballAnalyzer.h in the tarball. Looks like a missing a backslash in src/plugins/fts-lucene/Makefile.am: [...] noinst_HEADERS = \ fts-lucene-plugin.h \ lucene-wrapper.h SnowballAnalyzer.h \ SnowballFilter.h -- Eray Aslan From terry at cnysupport.com Thu Dec 1 18:24:10 2011 From: terry at cnysupport.com (Terry Carmen) Date: Thu, 01 Dec 2011 11:24:10 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <4ED70633.3000406@hardwarefreak.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <4ED70633.3000406@hardwarefreak.com> Message-ID: <20111201112410.Horde.HODzRVeGiNBO16oqSOuXAfA@www.cnysupport.com> Thanks! I'll take a look. Terry ----- Message from Stan Hoeppner --------- Date: Wed, 30 Nov 2011 22:44:35 -0600 From: Stan Hoeppner Reply-To: stan at hardwarefreak.com Subject: Re: [Dovecot] MS Exchange IMAP Proxy To: dovecot at dovecot.org > On 11/30/2011 2:36 PM, Terry Carmen wrote: >> I need to make the IMAP interface of an Exchange 2000 server available >> on the net, however I would like to give it a little protection, and >> believe Dovecot's IMAP proxy might be appropriate. >> >> Does anybody have a *really simple* config that would allow IMAP >> pass-through to a single Exchange server? >> >> The examples I've seen all assume some sort of load balancing, which >> isn't an issue here, so I'd like to eliminate the need for an >> unnecessary database server. >> >> Does Dovecot do any cleanup of the IMAP commands that would be useful in >> protecting Exchange (from this, >> http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I >> barking up the wrong tree? >> >> If Dovecot isn't helpful for this, can anybody point me to a better >> resource? > > Look into the SM IMAP Proxy. It was designed for a different purpose, > but may work well for your scenario: > > http://imapproxy.org/index.html > > -- > Stan ----- End message from Stan Hoeppner ----- -- Terry Carmen CNY Support, LLC https://www.cnysupport.com From sbbowman at gmail.com Thu Dec 1 19:26:43 2011 From: sbbowman at gmail.com (Stephen Bowman) Date: Thu, 1 Dec 2011 12:26:43 -0500 Subject: [Dovecot] LDAP Authentication - Home Directory Creation Message-ID: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> How does everyone handle this case? Users are authenticated by LDAP, and do not have accounts on the IMAP/dovecot server. When a new user is added to LDAP, the home directory (/home/newuser) needs to be created on the IMAP/dovecot server so dovecot can create the mail directories inside it (/home/newuser/mail/). Obviously I can come up with a few custom solutions, utilizing cron, but I feel like there's a cleaner solution out there. Thanks! From tom at whyscream.net Thu Dec 1 19:51:11 2011 From: tom at whyscream.net (Tom Hendrikx) Date: Thu, 01 Dec 2011 18:51:11 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> Message-ID: <4ED7BE8F.4000609@whyscream.net> On 01-12-11 18:26, Stephen Bowman wrote: > How does everyone handle this case? > > Users are authenticated by LDAP, and do not have accounts on the > IMAP/dovecot server. When a new user is added to LDAP, the home > directory (/home/newuser) needs to be created on the IMAP/dovecot > server so dovecot can create the mail directories inside it > (/home/newuser/mail/). > > Obviously I can come up with a few custom solutions, utilizing cron, > but I feel like there's a cleaner solution out there. How about http://wiki.dovecot.org/PostLoginScripting and something containing 'mkdir -p' ? -- Tom From tss at iki.fi Thu Dec 1 22:48:11 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 1 Dec 2011 22:48:11 +0200 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> Message-ID: On 1.12.2011, at 19.26, Stephen Bowman wrote: > How does everyone handle this case? > > Users are authenticated by LDAP, and do not have accounts on the IMAP/dovecot server. When a new user is added to LDAP, the home directory (/home/newuser) needs to be created on the IMAP/dovecot server so dovecot can create the mail directories inside it (/home/newuser/mail/). Dovecot creates the home directory automatically if it has permissions to do it. So I guess in your case the mail user doesn't have permissions to do it and only root can create it? From micah at riseup.net Thu Dec 1 23:42:34 2011 From: micah at riseup.net (Micah Anderson) Date: Thu, 01 Dec 2011 16:42:34 -0500 Subject: [Dovecot] dovecot-lda quota rule References: <874nybztuz.fsf@algae.riseup.net> <1321388840.21919.520.camel@hurina> <87ehx8gic7.fsf@algae.riseup.net> <87zkfek37g.fsf@algae.riseup.net> Message-ID: <87ty5khstx.fsf@algae.riseup.net> micah anderson writes: > On Wed, 16 Nov 2011 11:09:12 -0500, micah anderson wrote: >> On Tue, 15 Nov 2011 22:27:20 +0200, Timo Sirainen wrote: >> > On Thu, 2011-11-10 at 13:59 -0500, Micah Anderson wrote: >> > > I really like the feature where you can define quota rules with percents >> > > which trigger off of the default values[0] (so you can set the Trash to >> > > allow for 10% more of the user's quota for example). >> > > >> > > What I would really love in dovecot would be for the ability to >> > > configure a quota rule for dovecot-lda. I would like to configure things >> > > so we don't bounce emails for users until they are well over quota, the >> > > IMAP quota plugin is a really great way to notify people that they are >> > > over quota because it fails to write to other folders.... that should be >> > > enough to get people's attention that they need to deal with things, but >> > > bouncing is harsh. >> > >> > You can give LDA-specific quota settings. Like maybe: >> > >> > protocol lda { >> > plugin { >> > quota_rule2 = INBOX:storage=200% >> > } >> > } > > I just tried doing this, and I started bouncing mail for everyone > because they were over quota (even when they arent), so I am clearly > missing something in how I have it configured. This is what I have: Solved, thanks to tss on irc... My problem was the dovecot-lda invocation was not passing the -d parameter, so no userdb quota rules were being applied. micah From sven at svenhartge.de Fri Dec 2 00:41:43 2011 From: sven at svenhartge.de (Sven Hartge) Date: Thu, 1 Dec 2011 23:41:43 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> Message-ID: <58cbklct2vv8@mids.svenhartge.de> Stephen Bowman wrote: > How does everyone handle this case? > Users are authenticated by LDAP, and do not have accounts on the > IMAP/dovecot server. When a new user is added to LDAP, the home > directory (/home/newuser) needs to be created on the IMAP/dovecot > server so dovecot can create the mail directories inside it > (/home/newuser/mail/). chmod /home to 1777 and let dovecot create the directory. Or switch to a virtual setup, where the users don't get real users on the imap server (they can't log in, so they don't need any real user on that server) and every mail is owned by your virtual mail user. Gr??e, Sven. -- Sigmentation fault. Core dumped. From tss at iki.fi Fri Dec 2 00:52:58 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 00:52:58 +0200 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <58cbklct2vv8@mids.svenhartge.de> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> <58cbklct2vv8@mids.svenhartge.de> Message-ID: On 2.12.2011, at 0.41, Sven Hartge wrote: > Or switch to a > virtual setup, where the users don't get real users on the imap server > (they can't log in, so they don't need any real user on that server) and > every mail is owned by your virtual mail user. Well, it of course makes things easier, but from security point of view it's worse.. I hope some day there won't be any problems with Dovecot using multiple UIDs. From sven at svenhartge.de Fri Dec 2 01:03:36 2011 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 2 Dec 2011 00:03:36 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> <58cbklct2vv8@mids.svenhartge.de> Message-ID: <68cbluut2vv8@mids.svenhartge.de> Timo Sirainen wrote: > On 2.12.2011, at 0.41, Sven Hartge wrote: >> Or switch to a virtual setup, where the users don't get real users on >> the imap server (they can't log in, so they don't need any real user >> on that server) and every mail is owned by your virtual mail user. > Well, it of course makes things easier, but from security point of > view it's worse.. Of course. But using real users only works if every user is a PosixUser in LDAP (i.e. has a uidNumber and gidNumber). If this is not the case, then you are forced to use a virtual mail user setup. > I hope some day there won't be any problems with Dovecot using > multiple UIDs. Meaning? Gr??e, Sven. -- Sigmentation fault. Core dumped. From tss at iki.fi Fri Dec 2 01:10:28 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 01:10:28 +0200 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <68cbluut2vv8@mids.svenhartge.de> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> <58cbklct2vv8@mids.svenhartge.de> <68cbluut2vv8@mids.svenhartge.de> Message-ID: On 2.12.2011, at 1.03, Sven Hartge wrote: > Timo Sirainen wrote: >> On 2.12.2011, at 0.41, Sven Hartge wrote: > >>> Or switch to a virtual setup, where the users don't get real users on >>> the imap server (they can't log in, so they don't need any real user >>> on that server) and every mail is owned by your virtual mail user. > >> Well, it of course makes things easier, but from security point of >> view it's worse.. > > Of course. But using real users only works if every user is a PosixUser > in LDAP (i.e. has a uidNumber and gidNumber). If this is not the case, > then you are forced to use a virtual mail user setup. Currently at least. This could be automated in a few ways.. Like simplest: uid = 1000 + md5sum(username) mod 64000. That won't necessarily be unique of course, but it's still better than mod 1. :) >> I hope some day there won't be any problems with Dovecot using >> multiple UIDs. > > Meaning? There are different problems with multiple UIDs that are more difficult to solve than with a single UID. How to manage them, how to handle shared mailboxes, how to create home dirs automatically, probably other things. There are ways to solve these problems in one way or another. From sven at svenhartge.de Fri Dec 2 01:24:24 2011 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 2 Dec 2011 00:24:24 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> <58cbklct2vv8@mids.svenhartge.de> <68cbluut2vv8@mids.svenhartge.de> Message-ID: <88cbn47t2vv8@mids.svenhartge.de> Timo Sirainen wrote: > On 2.12.2011, at 1.03, Sven Hartge wrote: >> Timo Sirainen wrote: >>> I hope some day there won't be any problems with Dovecot using >>> multiple UIDs. >> >> Meaning? > There are different problems with multiple UIDs that are more > difficult to solve than with a single UID. How to manage them, how to > handle shared mailboxes, how to create home dirs automatically, > probably other things. There are ways to solve these problems in one > way or another. Ah, yes, shared folders. I remember now, this is why we changed from using real users to a virtual user in the beginning (using Courier), because implementing this feature with real users was real pain in the lower backside. Gr??e, Sven. -- Sigmentation fault. Core dumped. From amateo at um.es Fri Dec 2 10:07:38 2011 From: amateo at um.es (Angel L. Mateo) Date: Fri, 02 Dec 2011 09:07:38 +0100 Subject: [Dovecot] LDAP Authentication - Home Directory Creation In-Reply-To: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> References: <0CA4DAAD-41FA-4DE2-A030-FE79BB8CB469@gmail.com> Message-ID: <4ED8874A.3090408@um.es> El 01/12/11 18:26, Stephen Bowman escribi?: > How does everyone handle this case? > > Users are authenticated by LDAP, and do not have accounts on the IMAP/dovecot server. When a new user is added to LDAP, the home directory (/home/newuser) needs to be created on the IMAP/dovecot server so dovecot can create the mail directories inside it (/home/newuser/mail/). > > Obviously I can come up with a few custom solutions, utilizing cron, but I feel like there's a cleaner solution out there. > Are you authenticating directly by LDAP or are you using pam? If you were using pam, you could use pam_mkhomedir module. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica _(___V Tfo: 868887590 Fax: 868888337 From rainer.frey at inxmail.de Fri Dec 2 12:38:53 2011 From: rainer.frey at inxmail.de (Rainer Frey) Date: Fri, 2 Dec 2011 11:38:53 +0100 Subject: [Dovecot] Authentication listener configuration In-Reply-To: <22BC7966-5C73-4085-AB63-3B5E20FCE335@inxmail.de> References: <22BC7966-5C73-4085-AB63-3B5E20FCE335@inxmail.de> Message-ID: <681352ED-B7A4-47EE-B4D8-7A6B5D2E115F@inxmail.de> On 29.11.2011, at 08:19, Rainer Frey wrote: > Hi, > > I'm wondering about the authentication listeners that dovecot uses. In many configurations I see: > service auth { > unix_listener auth-userdb { > > Does any component of dovecot use this listener internally (lmtp, lda ...) and does that read the config and search for the listener, or is the exact name "auth-userdb" expected? Is this maybe dependent on the userdb? Which ones need it? And if I want to use postfix SMTP auth, should I define a second listener, or just re-configure that default one to postfix's needs? I mean, specifically if I use ldaand/or lmtp as well ... Thanks Rainer From wek at andatra.kiev.ua Fri Dec 2 12:53:34 2011 From: wek at andatra.kiev.ua (Yaroslav Boychuk) Date: Fri, 02 Dec 2011 12:53:34 +0200 Subject: [Dovecot] dsync(root): Fatal: execvp() failed: No such file or directory In-Reply-To: References: <4ED73BD0.2030302@andatra.kiev.ua> Message-ID: <4ED8AE2E.6060605@andatra.kiev.ua> thank you Timo, I have moved "mirror" after "options" and add namespace { separator = / prefix = inbox = yes } to 10-mail.conf thank you 01.12.2011 15:00, Timo Sirainen ???????(??): > > dsync -f -v mirror \ > -o mail=mbox:$h/mail:INBOX=$h/INBOX \ > maildir:$h/Maildir:CONTROL=$h/dovecot:INDEX=$h/dovecot \ From rainer.frey at inxmail.de Fri Dec 2 15:39:51 2011 From: rainer.frey at inxmail.de (Rainer Frey) Date: Fri, 2 Dec 2011 14:39:51 +0100 Subject: [Dovecot] Authentication listener configuration In-Reply-To: <681352ED-B7A4-47EE-B4D8-7A6B5D2E115F@inxmail.de> References: <22BC7966-5C73-4085-AB63-3B5E20FCE335@inxmail.de> <681352ED-B7A4-47EE-B4D8-7A6B5D2E115F@inxmail.de> Message-ID: > On 29.11.2011, at 08:19, Rainer Frey wrote: >> I'm wondering about the authentication listeners that dovecot uses. In many configurations I see: >> service auth { >> unix_listener auth-userdb { >> >> Does any component of dovecot use this listener internally (lmtp, lda ...) and does that read the config and search for the listener, or is the exact name "auth-userdb" expected? Is this maybe dependent on the userdb? Which ones need it? And if I want to use postfix SMTP auth, should I define a second listener, or just re-configure that default one to postfix's needs? > > I mean, specifically if I use lda and/or lmtp as well ... Sorry for the noise, found it commented in the example configuration - it's configured in auth_socket_path. I didn't have a dovecot installation handy, so I only looked online. For dovecot 1.x, the wiki contains the full configuration file with all comments. Couldn't anything like that be done for 2.x as well (even though it's more complicated)? Rainer From pw at wk-serv.de Fri Dec 2 16:30:43 2011 From: pw at wk-serv.de (Patrick Westenberg) Date: Fri, 02 Dec 2011 15:30:43 +0100 Subject: [Dovecot] Plugin for munin Message-ID: <4ED8E113.9050908@wk-serv.de> Hi there, is anyone using munin to monitor connections to dovecot? If someone does, which plugin is used? Regards Patrick From ecasarero at gmail.com Fri Dec 2 16:49:12 2011 From: ecasarero at gmail.com (Eduardo Casarero) Date: Fri, 2 Dec 2011 11:49:12 -0300 Subject: [Dovecot] Plugin for munin In-Reply-To: <4ED8E113.9050908@wk-serv.de> References: <4ED8E113.9050908@wk-serv.de> Message-ID: 2011/12/2 Patrick Westenberg > Hi there, > > is anyone using munin to monitor connections to dovecot? > If someone does, which plugin is used? > > Regards > Patrick > I've written a very small script to monitor the amount of users conected to dovecot using imap, so i can get an idea of real usage. The problem is that i wrote it for Nagios, i don't know if you can tune it to work with munin. Regards, Edurardo. From tss at iki.fi Fri Dec 2 17:12:21 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 17:12:21 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension Message-ID: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> It's implemented now in dovecot-2.1 hg. It also deprecates autocreate plugin (but it still works the old way). The idea is that you can now do e.g.: mailbox Trash { auto = no special_use = \Trash } mailbox Drafts { auto = no special_use = \Drafts } mailbox Sent { auto = subscribe # autocreate, autosubscribe special_use = \Sent } mailbox Spam { auto = create # autocreate, but don't autosubscribe special_use = \Junk } mailbox virtual/All { # if you have a virtual "All messages" mailbox auto = no special_use = \All } The mailbox names require a namespace prefix, so if you use e.g. "INBOX." prefix you'll need to use: mailbox INBOX.Trash { ..etc.. From tss at iki.fi Fri Dec 2 23:19:01 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 23:19:01 +0200 Subject: [Dovecot] can not get t'bird to create folder In-Reply-To: References: Message-ID: <655038FA-90B5-4F7A-9C06-23C91EA14701@iki.fi> On 1.12.2011, at 2.15, sean darcy wrote: > The problem was that the antispam plugin was for 2.0.15 - and I'm using 2.0.16. > > It seems that if a plugin can't be loaded, dovecot can't do anything else. Yes. Nowadays I keep stable APIs between micro versions (vX.Y.*), but stable ABIs would require to be a lot more careful. So it's not really worth the trouble, since Dovecot logs about the plugin version mismatch anyway and you can just recompile the plugin it to make it work again. From tss at iki.fi Fri Dec 2 23:22:24 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 23:22:24 +0200 Subject: [Dovecot] lda/sieve ignores quota from ldap In-Reply-To: <20111130190416.641ede1f@meissner.pentament.dyndns.org> References: <20111130190416.641ede1f@meissner.pentament.dyndns.org> Message-ID: <9DCC9F03-5CBC-45E7-A12B-7365565C4067@iki.fi> On 30.11.2011, at 20.04, Jens Mei?ner wrote: > I'm using Dovecot 2.0 with Sieve as MDA and Postfix as MTA. The > Postfix delivery command is /usr/lib/dovecot/dovecot-lda -f "$SENDER" > -a "$RECIPIENT". I have set a default quota with quota_rule = *:storage=1G. > Some users should have a larger quota. This is defined in a ldap > directory and I have set .. You need to use dovecot-lda's -d parameter or it doesn't do a userdb lookup, so it won't see the per-user quota from ldap. From tss at iki.fi Fri Dec 2 23:29:23 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 2 Dec 2011 23:29:23 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> Message-ID: <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> On 1.12.2011, at 6.03, Terry Carmen wrote: >> On 30.11.2011, at 22.36, Terry Carmen wrote: >> >>> Does Dovecot do any cleanup of the IMAP commands that would be useful in protecting Exchange (from this, http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am I barking up the wrong tree? >> >> v2.1 with imapc backend can be used to do this. There's not really documentation for it beyond this mailing list though. > > I'd be happy to give it a try. > > I have an absolutely dead-simple setup. All it has to do is sit between the internet and the IMAP port on an Exchange server. > > Any hints on how to set it up? Without SSL it works like this: mail_location = imapc:~/imapc imapc_host = imap.elsewhere.com imapc_port = 143 passdb { driver = imap args = host=imap.elsewhere.com default_fields = userdb_imapc_user=%u userdb_imapc_password=%w } userdb { driver = prefetch } mail_home = /home/tss And about other IMAP proxies: Before login they provide almost comparable security to Dovecot, the main exception being that Dovecot don't by default allow all characters in username (auth_username_chars setting). Post-login all of the IMAP proxies are equivalent. But imapc backend isn't really a proxy, so it does more: The imapc mainly gives protection for post-login commands, which the other proxies don't even attempt to sanitize in any way. But you probably trust your authorized users enough that they won't attempt to break into your mail server.. But then again, users might be running viruses and whatever other things that automate breaking into mail server without even knowing about it (but currently that's rather rare I think). From terry at cnysupport.com Sat Dec 3 00:39:09 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 02 Dec 2011 17:39:09 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> Message-ID: <20111202173909.Horde.tLmudleGiNBO2VONl9B1xPA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Fri, 2 Dec 2011 23:29:23 +0200 From: Timo Sirainen Subject: Re: [Dovecot] MS Exchange IMAP Proxy To: Terry Carmen Cc: dovecot at dovecot.org > On 1.12.2011, at 6.03, Terry Carmen wrote: > >>> On 30.11.2011, at 22.36, Terry Carmen wrote: >>> >>>> Does Dovecot do any cleanup of the IMAP commands that would be >>>> useful in protecting Exchange (from this, >>>> http://www.cvedetails.com/cve/CVE-2007-0221/ for example), or am >>>> I barking up the wrong tree? >>> >>> v2.1 with imapc backend can be used to do this. There's not really >>> documentation for it beyond this mailing list though. >> >> I'd be happy to give it a try. >> >> I have an absolutely dead-simple setup. All it has to do is sit >> between the internet and the IMAP port on an Exchange server. >> >> Any hints on how to set it up? > > > Without SSL it works like this: > > mail_location = imapc:~/imapc > imapc_host = imap.elsewhere.com > imapc_port = 143 > > passdb { > driver = imap > args = host=imap.elsewhere.com > default_fields = userdb_imapc_user=%u userdb_imapc_password=%w > } > userdb { > driver = prefetch > } > mail_home = /home/tss My dovecot.conf file contains: ///////////////////////////////////////// protocols = imap listen = *, :: mail_location = imapc:~/imapc imapc_host = exchangeserver.example.com imapc_port = 143 passdb { driver = imap args = host=exchangeserver.example.com default_fields = userdb_imapc_user=%u userdb_imapc_password=%w } userdb { driver = prefetch } mail_home = /home/tss !include conf.d/* ///////////////////////////////////////// Dovecot starts without complaints, but when I try a LOGIN, I get: dovecot: auth: Fatal: passdb imap: Unknown parameter: exchangeserver.example.com in the maillog file. Any thoughts? Terry From terry at cnysupport.com Sat Dec 3 01:42:38 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 02 Dec 2011 18:42:38 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> Message-ID: <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> OK, I'm making headway. it didn't like the config because there were no quotes around the Exchange server's FQDN, however when I added the quotes, I got: Dec 2 18:26:33 host dovecot: auth: Error: imapc('exchangeserver.example.com':143): dns_lookup('exchangeserver.example.com') failed: Name or service not known The name *does* resolve correctly using the "host" command. I then replaced the FQDN with the Exchange server's IP address, which works much better, but now I get: Dec 2 18:35:09 host dovecot: imap(myusername): Error: user myusername: Couldn't drop privileges: User is missing UID (see mail_uid setting) "myusername" is not a local user, but exists only on the exchange server. Any thoughts? Thanks! Terry From tss at iki.fi Sat Dec 3 03:04:10 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 3 Dec 2011 03:04:10 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> Message-ID: <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> On 3.12.2011, at 1.42, Terry Carmen wrote: > Dec 2 18:35:09 host dovecot: imap(myusername): Error: user myusername: Couldn't drop privileges: User is missing UID (see mail_uid setting) > > "myusername" is not a local user, but exists only on the exchange server. Any thoughts? You still need a mail user. For example you could create a "vmail" user and set mail_uid=vmail. Or whatever else user. From terry at cnysupport.com Sat Dec 3 04:55:12 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 02 Dec 2011 21:55:12 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> Message-ID: <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> > On 3.12.2011, at 1.42, Terry Carmen wrote: > >> Dec 2 18:35:09 host dovecot: imap(myusername): Error: user >> myusername: Couldn't drop privileges: User is missing UID (see >> mail_uid setting) >> >> "myusername" is not a local user, but exists only on the exchange >> server. Any thoughts? > > You still need a mail user. For example you could create a "vmail" > user and set mail_uid=vmail. Or whatever else user. Several other configuration problems later . . . I'm getting much closer, but not quite there. The latest message is: dovecot: imap(username): Error: user username: Initialization failed: Initializing mail storage from mail_location setting failed: Home directory not set for user. Can't expand ~/ for mail root dir in: ~/imapc The users who will be using the proxy don't actually have any mail on the box running dovecot and (currently) don't have any accounts or home directories. Right now they only exist on the Exchhange server. Is there a config option I need to create/change so that Dovecot doesn't look for a directory for each user, or does it till ened one even though the users aren't local and there won't be a mail store on the box running dovecot? Thanks again for all your help! When I get this all working, I'll write up a Wiki page for it. Terry From me at junc.org Sat Dec 3 05:35:05 2011 From: me at junc.org (Benny Pedersen) Date: Sat, 03 Dec 2011 04:35:05 +0100 Subject: [Dovecot] MUAs creating different "Sent" folders In-Reply-To: <20111129214256.GL14970@charite.de> References: <20111129214256.GL14970@charite.de> Message-ID: <92d9bf78c8e3ec525b7f3f4c46ce9972@junc.org> On Tue, 29 Nov 2011 22:42:56 +0100, Ralf Hildebrandt wrote: > While our webmail installation creates "Sent" as a Sent-Items Folder, > Apple Mail creates "Sent Messages". open source standards :-) > Is there a way of "mapping" foldernames e.g. > > map "Sent Messages" to "Sent" > map "Deletes Messages" to "Trash" would be nice yes, it was talked about a way to solve it via a plugin > and so on? none mua have it hardcoded folder names, just diff defaults :( From heptalium at gmx.de Sat Dec 3 13:17:51 2011 From: heptalium at gmx.de (Jens =?UTF-8?B?TWVpw59uZXI=?=) Date: Sat, 3 Dec 2011 12:17:51 +0100 Subject: [Dovecot] lda/sieve ignores quota from ldap In-Reply-To: <9DCC9F03-5CBC-45E7-A12B-7365565C4067@iki.fi> References: <20111130190416.641ede1f@meissner.pentament.dyndns.org> <9DCC9F03-5CBC-45E7-A12B-7365565C4067@iki.fi> Message-ID: <20111203121751.73753b7e@meissner.pentament.dyndns.org> Am Fri, 2 Dec 2011 23:22:24 +0200 schrieb Timo Sirainen : > On 30.11.2011, at 20.04, Jens Mei?ner wrote: > >> I'm using Dovecot 2.0 with Sieve as MDA and Postfix as MTA. The >> Postfix delivery command is /usr/lib/dovecot/dovecot-lda -f >> "$SENDER" -a "$RECIPIENT". I have set a default quota with >> quota_rule = *:storage=1G. Some users should have a larger quota. >> This is defined in a ldap directory and I have set > .. > > You need to use dovecot-lda's -d parameter or it doesn't do a userdb > lookup, so it won't see the per-user quota from ldap. Thanks, it works well. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: not available URL: From dovecot at digitalforplay.com Fri Dec 2 20:47:16 2011 From: dovecot at digitalforplay.com (A Dovecot User) Date: Fri, 02 Dec 2011 12:47:16 -0600 Subject: [Dovecot] Panic when attempting index with Apache Solr : fts_solr plugin Message-ID: <4ED91D34.3050906@digitalforplay.com> Dovecot version: 2.1.rc1 Expat version: expat-2.0.1-10 Libcurl version: libcurl-7.21.0-10 OS: Fedora 14 i686 Configure command: ./configure --with-solr Solr version: 1.4.1 (also tried 3.5.0) Java version: java-1.6.0-openjdk-1.6.0.0-55.1.9.10 (also tried Oracle Java 6u29) [root at mymailserver ~]# doveadm -D index -u username mailbox inbox doveadm(username): Info: INBOX: Caching mails seq=1..466 doveadm(username): Panic: file solr-connection.c: line 545 (solr_connection_post_more): assertion failed: (maxfd >= 0) doveadm(username): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3b9b1) [0x14b9b1] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x47) [0x14bac7] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x1211ae] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x293) [0xb1a7d3] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x2599) [0xb16599] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_build_more+0x31) [0x2273f1] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x3b2) [0x228272] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xa74e) [0x22d74e] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_precache+0xf) [0x937a6f] -> doveadm() [0x80520b6] -> doveadm() [0x804f4b5] -> doveadm(doveadm_mail_single_user+0x5b) [0x804f8db] -> doveadm() [0x804fd3f] -> doveadm(doveadm_mail_try_run+0x12e) [0x805019e] -> doveadm(main+0x3a4) [0x8056444] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x729e36] -> doveadm() [0x804f2c1] ---------------------- mail_plugins = acl antispam fts fts_solr plugin { fts = solr fts_solr = break-imap-search debug url=http://127.0.0.1:8983/solr/ } From terry at cnysupport.com Sat Dec 3 18:10:22 2011 From: terry at cnysupport.com (Terry Carmen) Date: Sat, 03 Dec 2011 11:10:22 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> Message-ID: <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> It's working! I'll post a writeup on the wiki on monday. The last problem was it seems to need a writable home directory for mail_home even though all the mail is pass-through.This was included in Timo's original config, although I had accidentally removed it. In any case many thanks to Timo and everybody else who helped! Terry From maria_arrea at gmx.com Sat Dec 3 22:30:53 2011 From: maria_arrea at gmx.com (Maria Arrea) Date: Sat, 03 Dec 2011 21:30:53 +0100 Subject: [Dovecot] Questions about single intance storage Message-ID: <20111203203053.201510@gmx.com> Hello We are using dovecot 2.0.16 with mdbox+zlib. We are now testing SiS (Single Instance Storage) and I have 5 questions: 1? Is possible to "dedup" existing mdboxes? 2? Are attachments compressed with zlib if mdboxes already use zlib? 3? I have plenty CPU to spare, should I use a low value of mail_attachment_min_size , like 16KB ? 4? Can I "undo" SiS if I have problems? 5? We use bacula to save indexes & mdboxes, and we recover mailboxes using doveadm import when a user "makes a fatal mistake" wiping all her Inbox. If we enable SiS I am not really sure how can we safely restore a user's INBOX if that user has SiS attachments. Thank you for your (great) support. Maria From tss at iki.fi Sat Dec 3 23:00:58 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 3 Dec 2011 23:00:58 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111203203053.201510@gmx.com> References: <20111203203053.201510@gmx.com> Message-ID: On 3.12.2011, at 22.30, Maria Arrea wrote: > We are using dovecot 2.0.16 with mdbox+zlib. We are now testing SiS (Single Instance Storage) and I have 5 questions: > > 1? Is possible to "dedup" existing mdboxes? You can dsync the mailbox elsewhere and then replace the original with the new copy. > 2? Are attachments compressed with zlib if mdboxes already use zlib? Currently attachments don't support zlib at all. > 3? I have plenty CPU to spare, should I use a low value of mail_attachment_min_size , like 16KB ? It wastes disk seeks since it now has to read mail from 2 (or more) places in filesystem, so probably not a good idea. So in any case SiS most likely increases your disk IOPS usage. > 4? Can I "undo" SiS if I have problems? dsync will help the other way around too. > 5? We use bacula to save indexes & mdboxes, and we recover mailboxes using doveadm import when a user "makes a fatal mistake" wiping all her Inbox. If we enable SiS I am not really sure how can we safely restore a user's INBOX if that user has SiS attachments. Hm. Yes, that is problematic.. Even if you knew what SIS files were used, there's no simple way to restore those with proper refcounts. I think what really should be done is writing a tool that can create/restore backups, possibly de-SISing the attachments.. From tlx at leuxner.net Sun Dec 4 08:39:14 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Sun, 4 Dec 2011 07:39:14 +0100 Subject: [Dovecot] Core Dump upon IMAP Login with latest HG (2.1) c067025026ed Message-ID: <58C7F575-17FB-47EF-90BC-83C52AAF56D5@leuxner.net> Dec 4 07:27:41 spectre dovecot: imap-login: Login: user=, method=PLAIN, rip=84.58.184.122, lip=1.2.3.4, mpid=30987, TLS Dec 4 07:27:42 spectre dovecot: imap-login: Login: user=, method=PLAIN, rip=84.58.184.122, lip=1.2.3.4, mpid=30990, TLS Dec 4 07:27:42 spectre dovecot: master: Error: service(imap): child 30990 killed with signal 11 (core dumped) Dec 4 07:27:48 spectre dovecot: imap(tlx at leuxner.net): Connection closed in=142 out=410 Dec 4 07:27:48 spectre dovecot: imap-login: Login: user=, method=PLAIN, rip=84.58.184.122, lip=1.2.3.4, mpid=30992, TLS Dec 4 07:27:48 spectre dovecot: master: Warning: Killed with signal 15 (by pid=31013 uid=0 code=kill) [ GDB Backtrace] #0 0x00007fa68d36f978 in mailbox_settings_find (user=0x22162f0, vname=0x21ec318 "INBOX") at mail-storage.c:610 box_set__foreach_end = box_set = #1 0x00007fa68d371003 in mailbox_alloc (list=, vname=0x21ec318 "INBOX", flags=MAILBOX_FLAG_DROP_RECENT) at mail-storage.c:643 _data_stack_cur_id = 4 new_list = 0x22149b0 storage = 0x221b760 box = 0x222a9f0 __FUNCTION__ = "mailbox_alloc" #2 0x000000000040d8de in select_open (cmd=0x22259c0, readonly=false) at cmd-select.c:285 client = 0x2224e30 status = {messages = 2808, recent = 0, unseen = 0, uidvalidity = 0, uidnext = 0, first_unseen_seq = 0, first_recent_uid = 0, last_cached_seq = 0, highest_modseq = 834, keywords = 0x0, permanent_flags = 0, nonpermanent_modseqs = 0, permanent_keywords = 0, allow_new_keywords = 0} flags = 8 ret = #3 cmd_select_full (cmd=0x22259c0, readonly=false) at cmd-select.c:419 client = 0x2224e30 ctx = args = 0x2228218 list_args = 0x7fffbe1e9a58 mailbox = 0x21ec318 "INBOX" ret = __FUNCTION__ = "cmd_select_full" #4 0x000000000041134d in command_exec (cmd=0x22259c0) at imap-commands.c:147 hook = 0x21f5b40 ret = #5 0x000000000041031e in client_command_input (cmd=0x22259c0) at imap-client.c:673 client = 0x2224e30 command = __FUNCTION__ = "client_command_input" #6 0x00000000004103fd in client_command_input (cmd=0x22259c0) at imap-client.c:724 client = 0x2224e30 command = 0x0 __FUNCTION__ = "client_command_input" #7 0x0000000000410625 in client_handle_next_command (client=0x2224e30) at imap-client.c:765 size = 18 #8 client_handle_input (client=0x2224e30) at imap-client.c:777 _data_stack_cur_id = 3 ret = false remove_io = handled_commands = false __FUNCTION__ = "client_handle_input" #9 0x0000000000410f4f in client_input (client=0x2224e30) at imap-client.c:816 cmd = output = 0x2225828 bytes = __FUNCTION__ = "client_input" #10 0x00007fa68d0fbf36 in io_loop_call_io (io=0x22258d0) at ioloop.c:377 ioloop = 0x21f4630 t_id = 2 #11 0x00007fa68d0fcf6f in io_loop_handler_run (ioloop=) at ioloop-epoll.c:213 ctx = 0x21f4850 event = 0x21f48c0 list = 0x2225920 io = 0x22162f0 tv = {tv_sec = 29, tv_usec = 928551} msecs = ret = i = 0 call = false #12 0x00007fa68d0fbed8 in io_loop_run (ioloop=0x21f4630) at ioloop.c:396 No locals. #13 0x00007fa68d0e9433 in master_service_run (service=0x21f44f0, callback=0x21ec318) at master-service.c:499 No locals. #14 0x0000000000419141 in main (argc=1, argv=0x21f4370) at main.c:375 set_roots = {0x41c020, 0x0} service_flags = storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT postlogin_socket_path = 0x0 username = 0x0 c = [ doveconf -n ] # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 auth_cache_size = 16 k auth_verbose = yes mail_location = mdbox:~/mdbox mail_plugins = acl quota stats namespace { hidden = no inbox = yes location = prefix = separator = / type = private } namespace { list = yes location = mdbox:/var/vmail/public prefix = Public/ separator = / subscriptions = no type = public } passdb { args = username_format=%u /var/vmail/auth.d/%d/passwd driver = passwd-file } plugin { acl = vfile:/var/vmail/conf.d/%d/acls:cache_secs=300 mail_log_events = expunge mailbox_delete quota = dict:user::file:%h/mdbox/dovecot-quota quota_rule = *:storage=1GB quota_rule2 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/vmail/conf.d/%d/sieve stats_refresh = 30s stats_track_cmds = yes } protocols = imap lmtp quota_full_tempfail = yes service auth-worker { user = doveauth } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = doveauth } service imap-login { inet_listener imap { address = 1.2.3.4 port = 143 } inet_listener imaps { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_ca = From alec at alec.pl Sun Dec 4 10:00:52 2011 From: alec at alec.pl (A.L.E.C) Date: Sun, 04 Dec 2011 09:00:52 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> Message-ID: <4EDB28B4.4010606@alec.pl> On 2011-12-02 16:12, Timo Sirainen wrote: > It's implemented now in dovecot-2.1 hg. It also deprecates autocreate plugin (but it still works the old way). The idea is that you can now do e.g.: > mailbox Spam { > auto = create # autocreate, but don't autosubscribe > special_use = \Junk This looks very nice. Thanks Timo. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From maria_arrea at gmx.com Sun Dec 4 16:10:58 2011 From: maria_arrea at gmx.com (Maria Arrea) Date: Sun, 04 Dec 2011 15:10:58 +0100 Subject: [Dovecot] Questions about single intance storage Message-ID: <20111204141058.201500@gmx.com> Hello Timo. If we can not safely restore from backup a user's mailbox with SiS enabled, we can not enable SiS. Any plan to include this backup recovery tool in dovecot 2.0.X or 2.1? Regards Maria > 5? We use bacula to save indexes & mdboxes, and we recover mailboxes using doveadm import when a user "makes a fatal mistake" wiping all her Inbox. If we enable SiS I am not really sure how can we safely restore a user's INBOX if that user has SiS attachments. Hm. Yes, that is problematic.. Even if you knew what SIS files were used, there's no simple way to restore those with proper refcounts. I think what really should be done is writing a tool that can create/restore backups, possibly de-SISing the attachments.. From tss at iki.fi Sun Dec 4 19:21:55 2011 From: tss at iki.fi (Timo Sirainen) Date: Sun, 4 Dec 2011 19:21:55 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111204141058.201500@gmx.com> References: <20111204141058.201500@gmx.com> Message-ID: On 4.12.2011, at 16.10, Maria Arrea wrote: > If we can not safely restore from backup a user's mailbox with SiS enabled, we can not enable SiS. Any plan to include this backup recovery tool in dovecot 2.0.X or 2.1? I'd first have to design it. And before designing it I'd need to look into how the backup softwares usually work.. If anyone has any ideas about this, I'd like to hear. From terry at cnysupport.com Sun Dec 4 19:41:29 2011 From: terry at cnysupport.com (Terry Carmen) Date: Sun, 04 Dec 2011 12:41:29 -0500 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> Message-ID: <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> >> If we can not safely restore from backup a user's mailbox with SiS >> enabled, we can not enable SiS. Any plan to include this backup >> recovery tool in dovecot 2.0.X or 2.1? > > I'd first have to design it. And before designing it I'd need to > look into how the backup softwares usually work.. If anyone has any > ideas about this, I'd like to hear. BackupPC uses rsync by default for *nix boxes. No idea what SiS is, but I'm guessing you're running into the same problem as backing up any other open file with changing internal data that may be inconsistent. This is exactly what it's difficult (and pointless) to backup an open MySQL database or a SQL Server database. The snapshot of what's in memory doesn't always match what's on disk. The only ways I know around this are to periodically create a backup copy that *is* consistent and restorable and a utility to restore the backup back to the "live" storage format, or create a method for the software to flush it's buffers to disk then disconnect from the data file while the backup process is running. The first option takes ~2x the storage space, while the second option makes the user's data inaccessible during the backup. My apologies if I'm misunderstanding the problem and have been rambling for no purpose. 8-) Terry From tss at iki.fi Sun Dec 4 20:16:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Sun, 4 Dec 2011 20:16:20 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> Message-ID: On 4.12.2011, at 19.41, Terry Carmen wrote: >>> If we can not safely restore from backup a user's mailbox with SiS enabled, we can not enable SiS. Any plan to include this backup recovery tool in dovecot 2.0.X or 2.1? >> >> I'd first have to design it. And before designing it I'd need to look into how the backup softwares usually work.. If anyone has any ideas about this, I'd like to hear. > > BackupPC uses rsync by default for *nix boxes. > > No idea what SiS is, but I'm guessing you're running into the same problem as backing up any other open file with changing internal data that may be inconsistent. Inconsistency is an issue, but it's not the biggest problem. It would be possible to write a tool that scans through all mails and makes sure everything is consistent after a restore. dbox mostly does this automatically already, but SIS would need a separate program to ensure its consistency. SIS is anyway a single instance attachment storage. So that lets say you send one 100 MB pdf to 10 people, and it's stored only once in disk under /attachments/aa/bb/aabccddeeff-etc. Each people would have their own unique link under /attachments/, but all of them would be hard linked to a common file. So the problem is mainly about restoring a single user's mails. The mail files are simple to restore, but then you need to figure out which attachments to restore. There's no simple way to know which attachment files belong to which users, so you need to scan through the mail files and see what attachments are referred to. Also backing up the attachment links could be problematic if the backup system doesn't support hard links. Each attachment always has at least 2 links, so if the backup doesn't realize that it at minimum duplicates the space used by attachments. So I was thinking that there probably could be some tool that during a user's backup it would write the attachments among the user's other files, so it would be easy to find all of the files needed for a restore. This would of course mean that backups can take a lot more space, because there's no SIS. Perhaps there could be some other alternatives .. like maybe not storing the attachments directly to backups, but add symlinks to them so they can be used to figure out what to restore. Or maybe the backing up wouldn't need a special tool, but the restoring tool could just read through the dbox files to see what attachments are also needed and write a list of them somewhere so they can be taken from backups as well. I'm not really sure what is the best way. From micah at riseup.net Sun Dec 4 21:03:55 2011 From: micah at riseup.net (Micah Anderson) Date: Sun, 04 Dec 2011 14:03:55 -0500 Subject: [Dovecot] Plugin for munin References: <4ED8E113.9050908@wk-serv.de> Message-ID: <877h2ci2g4.fsf@algae.riseup.net> Eduardo Casarero writes: > 2011/12/2 Patrick Westenberg > >> Hi there, >> >> is anyone using munin to monitor connections to dovecot? >> If someone does, which plugin is used? I'm using the one from nagiosexchange, but I modified it for dovecot2: #!/bin/sh # # Munin Plugin # to count logins to your dovecot mailserver # # Created by Dominik Schulz # http://developer.gauner.org/munin/ # Contributions by: # - Stephane Enten # - Micah Anderson (updated for dovecot2) # # Parameters understood: # # config (required) # autoconf (optional - used by munin-config) # # Config variables: # # logfile - Where to find the syslog file # # Add the following line to a file in /etc/munin/plugin-conf.d: # env.logfile /var/log/your/logfile.log # # Magic markers (optional - used by munin-config and installation scripts): # #%# family=auto #%# capabilities=autoconf ###################### # Configuration ###################### STAT_FILE=/var/lib/munin/plugin-state/plugin-dovecot.state EXPR_BIN=/usr/bin/expr LOGFILE=${logfile:-/var/log/mail.log} ###################### if [ "$1" = "autoconf" ]; then echo yes exit 0 fi if [ "$1" = "config" ]; then echo 'graph_title Dovcecot Logins' echo 'graph_args --base 1000 -l 0' echo 'graph_vlabel Login Counters' echo 'login_total.label Total Logins' echo 'login_tls.label TLS Logins' echo 'login_ssl.label SSL Logins' echo 'login_imap.label IMAP Logins' echo 'login_pop3.label POP3 Logins' echo 'connected.label Connected Users' exit 0 fi ############################# # Initialization ############################# if [ ! -r $STAT_FILE ]; then echo "TOTAL=0" > $STAT_FILE echo "TLS=0" >> $STAT_FILE echo "SSL=0" >> $STAT_FILE echo "IMAP=0" >> $STAT_FILE echo "POP3=0" >> $STAT_FILE fi ############################# ###################### # Total Logins ###################### /bin/echo -en "login_total.value " NEW_TOTAL=$(egrep 'dovecot.*Login' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_TOTAL=$(grep TOTAL $STAT_FILE | cut -f2 -d '=') TOTAL=$($EXPR_BIN $NEW_TOTAL - $OLD_TOTAL) if [ $TOTAL -gt 0 ]; then echo "$TOTAL" else echo "0" fi echo -n ###################### # Connected Users ###################### CONNECTS=$(doveadm -f flow who -1 |wc -l) /bin/echo -en "connected.value " echo $CONNECTS echo -n ###################### # TLS Logins ###################### /bin/echo -en "login_tls.value " NEW_TLS=$(egrep 'dovecot.*Login.*TLS' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_TLS=$(grep TLS $STAT_FILE | cut -f2 -d '=') TLS=$($EXPR_BIN $NEW_TLS - $OLD_TLS) if [ $TLS -gt 0 ]; then echo "$TLS" else echo "0" fi echo -n ###################### # SSL Logins ###################### /bin/echo -en "login_ssl.value " NEW_SSL=$(egrep 'dovecot.*Login.*SSL' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_SSL=$(grep SSL $STAT_FILE | cut -f2 -d '=') SSL=$($EXPR_BIN $NEW_SSL - $OLD_SSL) if [ $SSL -gt 0 ]; then echo "$SSL" else echo "0" fi echo -n ###################### # IMAP Logins ###################### /bin/echo -en "login_imap.value " NEW_IMAP=$(egrep 'dovecot.*imap.*Login' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_IMAP=$(grep IMAP $STAT_FILE | cut -f2 -d '=') IMAP=$($EXPR_BIN $NEW_IMAP - $OLD_IMAP) if [ $IMAP -gt 0 ]; then echo "$IMAP" else echo "0" fi echo -n ###################### # POP3 Logins ###################### /bin/echo -en "login_pop3.value " NEW_POP3=$(egrep 'dovecot.*pop3.*Login' $LOGFILE | grep "`date '+%b %e'`" | sort | wc -l) OLD_POP3=$(grep POP3 $STAT_FILE | cut -f2 -d '=') POP3=$($EXPR_BIN $NEW_POP3 - $OLD_POP3) if [ $POP3 -gt 0 ]; then echo "$POP3" else echo "0" fi echo -n ###################### # Save the new values ###################### echo "TOTAL=$NEW_TOTAL" > $STAT_FILE echo "TLS=$NEW_TLS" >> $STAT_FILE echo "SSL=$NEW_SSL" >> $STAT_FILE echo "IMAP=$NEW_IMAP" >> $STAT_FILE echo "POP3=$NEW_POP3" >> $STAT_FILE From terry at cnysupport.com Sun Dec 4 22:16:02 2011 From: terry at cnysupport.com (Terry Carmen) Date: Sun, 04 Dec 2011 15:16:02 -0500 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> Message-ID: <20111204151602.Horde.tWy1GVeGiNBO29UCBMPVY2A@www.cnysupport.com> > So I was thinking that there probably could be some tool that during > a user's backup it would write the attachments among the user's > other files, so it would be easy to find all of the files needed for > a restore. This would of course mean that backups can take a lot > more space, because there's no SIS. Perhaps there could be some other I see. Instead of writing the links directly to the filesystem, why not keep a links list (not a linked list 8-)) file in each directory that contains the information for the links that should be there (source, dest, attributes), then add an inotify hook in Dovecot to create/update/delete the hard links in the directory so they match the links list? The links list would only need to be opened when there's a change and could remain closed (and backup-able) at all other times, and restoring a links list would immediately trigger the inotify hook and regenerate all the required links. Terry From dovecot.fdop at tagged.lorens.org Mon Dec 5 00:07:05 2011 From: dovecot.fdop at tagged.lorens.org (Lorens Kockum) Date: Sun, 4 Dec 2011 23:07:05 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> Message-ID: <20111204220705.GA23867@tagged.lorens.org> Timo Sirainen wrote: > And before designing it I'd need to look into how the backup > softwares usually work.. If anyone has any ideas about this, > I'd like to hear. Simple or even moderately efficient backup programs like rsync copy all the files. Of course, if the program copies directories A B C in that order, then while B is being backed up, a file A/x could be created, and a file C/index could be modified to reflect that A/x exists. C/index would be backed up, but A/x would not be. The way around that is with snapshots. Linux supports this with LVM, FreeBSD with UFS and ZFS file systems, Windows with VSS, and all selfcontained disk arrays I know of implement snapshots. The application quiesces its disk writes, flushes buffers to disk, triggers a snapshot, and resumes work as usual. > Also backing up the attachment links could be problematic if > the backup system doesn't support hard links. Each attachment > always has at least 2 links, so if the backup doesn't realize > that it at minimum duplicates the space used by attachments. rsync recognizes hard links with option -H, but at a very noticeable performance cost when dealing with millions of files. If the aa/bb/aabccddeeff-etc is unique across the whole mailstore, it would be easy to replace the hard link with a symlink, as you said: > maybe not storing the attachments directly to backups, but add > symlinks to them so they can be used to figure out what to > restore. Or maybe the backing up wouldn't need a special tool, > but the restoring tool could just read through the dbox files > to see what attachments are also needed and write a list of > them somewhere so they can be taken from backups as well. In the second way, you would have a separate hierarchy for multiple-recipient attachments, or would the attachment be "really" stored in the box of a recipient chosen at random? Just some random thoughts: professionally, I use Zimbra. Messages are stored in Maildir-equivalents. The time it takes to backup is a quite severe constraint on the backup technique. For example, compressing the backup files takes too long, so the zip files are not compressed. Instead, the individual mails are stored compressed on disk. Each backup zips up the mails in a few big backup files. An improvement could be to sort mails into backup zip files so that once a zip file is made, it stays the same. After all, if a mail is not deleted a month after it is read, then it will probably stay in the same state forever, or at least until the user starts a keep-me-under-quota cleaning-up spree. During this time, backing up that big zip file can just be a check to see if it is already OK in the backup, which is much quicker. I have no idea if this could be applied to Dovecot, but who knows. From alepivain at lagoon.nc Mon Dec 5 01:17:54 2011 From: alepivain at lagoon.nc (Amaury Le Pivain) Date: Mon, 05 Dec 2011 10:17:54 +1100 Subject: [Dovecot] Dovecot crash non stop: "uid 0: exited on signal 11" Message-ID: <4EDBFFA2.2020701@lagoon.nc> Hi all, I have an old physical freebsd 6.2 server running Dovecot 1.0.7. I wanted to virtualised it. So, I did a dd from the physical server and then I restored it on then now Virtual Machine. I booted the server, all services are running just fine excepted Dovecot. I tried to investigate the log as much as I can but i'm not getting any usefull pieces of information. The only entries I have in the log files are the following: /*log: /var/log/messages:*/ /Dec 5 09:53:35 hostname kernel: pid 33815 (imap), uid 0: exited on signal 11 Dec 5 09:53:39 hostname kernel: pid 33820 (imap), uid 0: exited on signal 11 Dec 5 09:54:22 hostname kernel: pid 33910 (pop3), uid 0: exited on signal 11 Dec 5 09:55:22 hostname kernel: pid 34071 (pop3), uid 0: exited on signal 11 Dec 5 09:55:47 hostname kernel: pid 34103 (imap), uid 0: exited on signal 11 Dec 5 09:56:13 hostname kernel: pid 34143 (pop3), uid 0: exited on signal 11 Dec 5 09:56:21 hostname kernel: pid 34164 (pop3), uid 0: exited on signal 11 Dec 5 09:56:26 hostname kernel: pid 34180 (imap), uid 0: exited on signal 11 Dec 5 09:56:40 hostname kernel: pid 34201 (imap), uid 0: exited on signal 11 Dec 5 09:56:49 hostname kernel: pid 34227 (imap), uid 0: exited on signal 11/ /*log: /mail/log/dovecot.log:* dovecot: Dec 05 10:13:46 Info: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot: Dec 05 10:13:46 Error: child 36621 (imap) killed with signal 11/ I'm also running a squirrelmail as a webmail and here when I refresh a folder content 3/5 times I'm getting an error: /Error: Connection dropped by IMAP server Query: SELECT "INBOX.Corbeille"/ I'm using Dovecot version 1.0.7 on a freebsd 6.2 and my dovecot.conf is: dovecot -n /# 1.0.7: /usr/local/etc/dovecot.conf base_dir: /mail/ log_path: /mail/log/dovecot.log protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /mail//login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: POP3/IMAP ready. verbose_proctitle: yes first_valid_gid: 0 mail_extra_groups: mail mail_location: maildir:~/Maildir fsync_disable: yes maildir_copy_with_hardlinks: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota trash mail_plugins(imap): quota imap_quota trash mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: default_realm: tropik.nc passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen master: path: /mail/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir trash: /usr/local/etc/dovecot-trash.conf/ Thank you for your help! Sincerely, -- Amaury Le Pivain Offratel/Lagoon Tel: 28.88.99 From tss at iki.fi Mon Dec 5 01:40:54 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 01:40:54 +0200 Subject: [Dovecot] Dovecot crash non stop: "uid 0: exited on signal 11" In-Reply-To: <4EDBFFA2.2020701@lagoon.nc> References: <4EDBFFA2.2020701@lagoon.nc> Message-ID: On 5.12.2011, at 1.17, Amaury Le Pivain wrote: > I have an old physical freebsd 6.2 server running Dovecot 1.0.7. I wanted to virtualised it. > > So, I did a dd from the physical server and then I restored it on then now Virtual Machine. > > I booted the server, all services are running just fine excepted Dovecot. > > I tried to investigate the log as much as I can but i'm not getting any usefull pieces of information. The only entries I have in the log files are the following: > > /*log: /var/log/messages:*/ > > /Dec 5 09:53:35 hostname kernel: pid 33815 (imap), uid 0: exited on signal 11 This means it crashes. A gdb backtrace might tell why... But I think it would be less trouble to simply upgrade Dovecot to a newer version (at least v1.2.x) where there's a good chance that this has already been fixed. From tss at iki.fi Mon Dec 5 01:51:05 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 01:51:05 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111204220705.GA23867@tagged.lorens.org> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204220705.GA23867@tagged.lorens.org> Message-ID: <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> On 5.12.2011, at 0.07, Lorens Kockum wrote: > Timo Sirainen wrote: >> And before designing it I'd need to look into how the backup >> softwares usually work.. If anyone has any ideas about this, >> I'd like to hear. > > Simple or even moderately efficient backup programs like rsync > copy all the files. I'm mainly wondering if it's common for backup programs to support using a separate program to generate the backups. For example if there was a "dovecot-backup" binary that just dumps all (or new-since-last-backup) of the users' mails into stdout, which the backup program can use. Or perhaps in that case there wouldn't really be much of anything for the backup to do except to write it to tape.. >> Also backing up the attachment links could be problematic if >> the backup system doesn't support hard links. Each attachment >> always has at least 2 links, so if the backup doesn't realize >> that it at minimum duplicates the space used by attachments. > > rsync recognizes hard links with option -H, but at a very > noticeable performance cost when dealing with millions of > files. If the aa/bb/aabccddeeff-etc is unique across the whole > mailstore, it would be easy to replace the hard link with a > symlink, as you said: SIS was designed to work with hard links. They couldn't be replaced with symlinks without a redesign (which would be less efficient in normal operation). >> maybe not storing the attachments directly to backups, but add >> symlinks to them so they can be used to figure out what to >> restore. Or maybe the backing up wouldn't need a special tool, >> but the restoring tool could just read through the dbox files >> to see what attachments are also needed and write a list of >> them somewhere so they can be taken from backups as well. > > In the second way, you would have a separate hierarchy for > multiple-recipient attachments, or would the attachment be > "really" stored in the box of a recipient chosen at random? I meant that SIS would work exactly like it works now, with hard links and everything, but on top of that it would also create symlinks to the used files simply to make it easier to find what files are used. The annoying thing about that is that in error situations the symlinks can get out of sync with the reality. > Just some random thoughts: professionally, I use > Zimbra. Messages are stored in Maildir-equivalents. The time > it takes to backup is a quite severe constraint on the backup > technique. For example, compressing the backup files takes > too long, so the zip files are not compressed. Instead, the > individual mails are stored compressed on disk. Each backup > zips up the mails in a few big backup files. You mean you first create uncompressed zip files (why not just tar?) of all the mails to the filesystem and the backup software then backups those zip files? > An improvement > could be to sort mails into backup zip files so that once a > zip file is made, it stays the same. After all, if a mail is not > deleted a month after it is read, then it will probably stay > in the same state forever, or at least until the user starts a > keep-me-under-quota cleaning-up spree. During this time, backing > up that big zip file can just be a check to see if it is already > OK in the backup, which is much quicker. I have no idea if this > could be applied to Dovecot, but who knows. Dovecot's mdbox files already contain multiple messages in each file, so it should be a lot more efficient to do backups on those. And each message in an mdbox file can be compressed if zlib plugin is enabled. So I think that sounds quite a lot like what you propose. From stan at hardwarefreak.com Mon Dec 5 03:03:32 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sun, 04 Dec 2011 19:03:32 -0600 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> Message-ID: <4EDC1864.60703@hardwarefreak.com> On 12/4/2011 12:16 PM, Timo Sirainen wrote: > On 4.12.2011, at 19.41, Terry Carmen wrote: > >>>> If we can not safely restore from backup a user's mailbox with SiS enabled, we can not enable SiS. Any plan to include this backup recovery tool in dovecot 2.0.X or 2.1? >>> >>> I'd first have to design it. And before designing it I'd need to look into how the backup softwares usually work.. If anyone has any ideas about this, I'd like to hear. >> >> BackupPC uses rsync by default for *nix boxes. >> >> No idea what SiS is, but I'm guessing you're running into the same problem as backing up any other open file with changing internal data that may be inconsistent. > > Inconsistency is an issue, but it's not the biggest problem. It would be possible to write a tool that scans through all mails and makes sure everything is consistent after a restore. dbox mostly does this automatically already, but SIS would need a separate program to ensure its consistency. > > SIS is anyway a single instance attachment storage. So that lets say you send one 100 MB pdf to 10 people, and it's stored only once in disk under /attachments/aa/bb/aabccddeeff-etc. Each people would have their own unique link under /attachments/, but all of them would be hard linked to a common file. > > So the problem is mainly about restoring a single user's mails. The mail files are simple to restore, but then you need to figure out which attachments to restore. There's no simple way to know which attachment files belong to which users, so you need to scan through the mail files and see what attachments are referred to. > > Also backing up the attachment links could be problematic if the backup system doesn't support hard links. Each attachment always has at least 2 links, so if the backup doesn't realize that it at minimum duplicates the space used by attachments. > > So I was thinking that there probably could be some tool that during a user's backup it would write the attachments among the user's other files, so it would be easy to find all of the files needed for a restore. This would of course mean that backups can take a lot more space, because there's no SIS. Perhaps there could be some other alternatives .. like maybe not storing the attachments directly to backups, but add symlinks to them so they can be used to figure out what to restore. Or maybe the backing up wouldn't need a special tool, but the restoring tool could just read through the dbox files to see what attachments are also needed and write a list of them somewhere so they can be taken from backups as well. > > I'm not really sure what is the best way. Backup and restore user hard links to SiS files, but not the files themselves. A single user "Oops" isn't going to delete the shared SiS files (they're already read only until the "last user" aren't they?). Thus we can assume the SiS files are always intact but for catastrophic failure. To cope with catastrophic failure, create a "special" Dovecot administrator only mailbox (real/virtual/whatever) that "contains" all of the SiS files, a special Dovecot index. Back this mailbox up separately, just like you would any mailbox--i.e. backup the SiS mailbox independently from individual user backups. In the event of catastrophic failure, restore the SiS mailbox first, then user mailboxes, so user mailbox hard link creation during restore succeeds. I would think something like this should maintain compatibility with standard IMAP backup software. I don't know if this could be done directly at the filesystem level. If this special mailbox simply contained hard links to the SiS files, would a restore operation at the filesystem level simply attempt to (re)create the hard links, or would it actually writes the files to their original filesystem locations? If only the former, then this proposed solution would only work with IMAP based backup/restore. Just thinking out loud. There are probably better ways to do this. -- Stan From tss at iki.fi Mon Dec 5 03:45:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 03:45:19 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EDC1864.60703@hardwarefreak.com> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> Message-ID: On 5.12.2011, at 3.03, Stan Hoeppner wrote: > To cope with catastrophic failure, create a "special" Dovecot > administrator only mailbox (real/virtual/whatever) that "contains" all > of the SiS files, a special Dovecot index. I'm not thinking about a catastrophe. For that a regular full filesystem backup+restore would work mostly okay (a snapshot would be perfect, without snapshot some extra work would be needed). The problem is that people want to recover only one specific user's mails from some older backup, because they accidentally deleted the mails.. This needs to be somewhat easy to implement with SIS, but it isn't. From dovecot.fdop at tagged.lorens.org Mon Dec 5 09:19:27 2011 From: dovecot.fdop at tagged.lorens.org (Lorens Kockum) Date: Mon, 5 Dec 2011 08:19:27 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204220705.GA23867@tagged.lorens.org> <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> Message-ID: <20111205071927.GA20731@tagged.lorens.org> On Mon, Dec 05, 2011 at 01:51:05AM +0200, Timo Sirainen wrote: > I'm mainly wondering if it's common for backup programs to > support using a separate program to generate the backups. For > example if there was a "dovecot-backup" binary that just > dumps all (or new-since-last-backup) of the users' mails into > stdout, which the backup program can use. Or perhaps in that > case there wouldn't really be much of anything for the backup > to do except to write it to tape.. For databases, most commercial programs use some kind of application-specific plugins. Bakula has "Client Run Before Job" which permits indicating a command to be run before proceeding with the backup, maybe there is more. However I have not heard of any standardized way of doing it so that the application provider could provide a way to interact with multiple backup programs. It's more like each backup vendor boasting that his backup software can backup application XXX without downtime. > SIS was designed to work with hard links. They couldn't be > replaced with symlinks without a redesign (which would be less > efficient in normal operation). Right, but if the backup program recognized this then maybe the replacement by a symlink could be done only in the backup. rsync has to keep in memory all the inodes and check the list every time a hard link is found. If it knew that "a hard link in attachments should link to an identical file name in the common attachment SiS store. > [Zimbra] > > You mean you first create uncompressed zip files (why not > just tar?) of all the mails to the filesystem and the backup > software then backups those zip files? Well, not I, this is Zimbra's backup system :-) The backups are the destination zips. Maybe zip is used because the extension and extraction method is the same whether compressed or not; that way compression is just an option to the backup program to be turned on or off. > Dovecot's mdbox files already contain multiple messages in > each file, so it should be a lot more efficient to do backups > on those. And each message in an mdbox file can be compressed > if zlib plugin is enabled. So I think that sounds quite a lot > like what you propose. Is that combined or combinable with SiS? If attachments are in separate files, that means they are aligned on block boundaries, which make block-level SiS (like NetApp's) much more efficient. Think of an attachment sent to all department heads, all of whom forward the attachment to all their subordinates. From Mark.Zealey at webfusion.com Mon Dec 5 11:01:55 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Mon, 5 Dec 2011 09:01:55 +0000 Subject: [Dovecot] (no subject) Message-ID: From janfrode at tanso.net Mon Dec 5 11:36:24 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 5 Dec 2011 10:36:24 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204220705.GA23867@tagged.lorens.org> <8D0B80D3-5725-4F77-943B-71CE1C13F5DE@iki.fi> Message-ID: <20111205093624.GA18025@dibs.tanso.net> On Mon, Dec 05, 2011 at 01:51:05AM +0200, Timo Sirainen wrote: > > I'm mainly wondering if it's common for backup programs to support using a separate program to generate the backups. For example if there was a "dovecot-backup" binary that just dumps all (or new-since-last-backup) of the users' mails into stdout, which the backup program can use. Or perhaps in that case there wouldn't really be much of anything for the backup to do except to write it to tape.. I know at least tivoli storage manager (TSM) should be able to handle such lists. AFAIK this is how GPFS's "mmbackup" utility works. It utilizes a fast inode scan API to find all candidate files, and will be much more efficient than a normal backup client that traverses the whole fs. https://www-304.ibm.com/support/docview.wss?uid=swg21305169 But in addition to new-since-last-backup, we would probably also need a deleted-since-last-backup feature. -jf From xavier.pons at uib.es Mon Dec 5 16:26:54 2011 From: xavier.pons at uib.es (Xavier Pons) Date: Mon, 05 Dec 2011 15:26:54 +0100 Subject: [Dovecot] lmtp panic in proxy lmtp director Message-ID: <4EDCD4AE.8030607@uib.es> Hi, we are getting some core dumps with signal 6 in ltmp on a dovecot director proxy server, like this: Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Panic: file lmtp-proxy.c: line 376 (lmtp_proxy_output_timeout): assertion failed: (proxy->data_input->eof) Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x363323d99a] -> /usr/lib64/dovecot/libdovecot.so.0() [0x363323d9e6] -> /usr/lib64/dovecot/libdovecot.so.0(i_error+0) [0x3633216f8f] -> dovecot/lmtp() [0x406e57] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xd4) [0x3633248ff4] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x5b) [0x3633249bdb] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x3633248c58] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x3633236fc3] -> dovecot/lmtp(main+0x154) [0x403f84] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x373cc1ec5d] -> dovecot/lmtp() [0x403d69] Dec 5 14:31:51 sproxy1 abrt[30067]: saved core dump of pid 29999 (/usr/libexec/dovecot/lmtp) to /var/spool/abrt/ccpp-1323091911-29999.new/coredump (1368064 bytes) Dec 5 14:31:51 sproxy1 dovecot: master: Error: service(lmtp): child 29999 killed with signal 6 (core dumped) we have something misconfigured or it's a bug on this dovecot version? our doveconf -n is: # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-71.29.1.el6.x86_64 x86_64 CentOS Linux release 6.0 (Final) auth_cache_size = 3 k auth_cache_ttl = 15 mins auth_verbose = yes base_dir = /var/run/dovecot/ default_client_limit = 30000 default_process_limit = 5000 director_doveadm_port = 990 director_mail_servers = 10.80.82.21 10.80.82.22 director_servers = 10.80.82.11 10.80.82.12 doveadm_proxy_port = 24245 lmtp_proxy = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = proxy=y nopassword=y starttls=any-cert driver = static } postmaster_address = xavier.pons at uib.es protocols = imap pop3 lmtp sieve service auth { client_limit = 27048 unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = dovecot mode = 0660 } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 991 } inet_listener director-doveadm { port = 990 } unix_listener director-userdb { mode = 0660 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap-login { executable = imap-login director inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { port = 30025 } } service managesieve-login { executable = managesieve-login director } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_cert = Hello, Could you confirm that the SIS is integrated and functional in the latest version of Dovecot? Regards Guy From terry at cnysupport.com Mon Dec 5 19:16:47 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 12:16:47 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> Message-ID: <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> It's working beautifully! Is there any way to get it to log failed login attempts with the user's IP address? I'd like to setup fail2ban to stop dictionary attacks, however even with debugging, the most I've been able to get it to say is: Dec 5 12:11:30 machinename dovecot: auth: Debug: client out: FAIL#0111#011user=username Is there any possibility of getting the remote IP in there somewhere, or is there a different setting specifically to enable logging auth failures? Thanks! From janfrode at tanso.net Mon Dec 5 20:06:37 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 5 Dec 2011 19:06:37 +0100 Subject: [Dovecot] lmtp panic in proxy lmtp director In-Reply-To: <4EDCD4AE.8030607@uib.es> References: <4EDCD4AE.8030607@uib.es> Message-ID: <20111205180637.GA27400@dibs.tanso.net> On Mon, Dec 05, 2011 at 03:26:54PM +0100, Xavier Pons wrote: > Hi, we are getting some core dumps with signal 6 in ltmp on a > dovecot director proxy server, like this: http://dovecot.org/list/dovecot/2011-September/060830.html http://www.dovecot.org/list/dovecot/2011-September/061395.html > we have something misconfigured or it's a bug on this dovecot version? I believe there's too short LMTP_PROXY_DATA_INPUT_TIMEOUT_MSECS in lmtp-proxy.c. -jf From ghandidrivesahumvee at rocketfish.com Mon Dec 5 20:17:57 2011 From: ghandidrivesahumvee at rocketfish.com (Dovecot-GDH) Date: Mon, 5 Dec 2011 10:17:57 -0800 Subject: [Dovecot] lmtp panic in proxy lmtp director In-Reply-To: <4EDCD4AE.8030607@uib.es> References: <4EDCD4AE.8030607@uib.es> Message-ID: This happens when the LMTP proxy doesn't receive feedback from the back-end LMTP process for a certain amount of time. This typically happens either because of very low I/O performance or NFS locks. Do an strace on your back-end LMTP processes. If you see that these processes are waiting on NFS locks ande you are using NFSv3, you should move over to NFSv4. On Dec 5, 2011, at 6:26 AM, Xavier Pons wrote: > Hi, we are getting some core dumps with signal 6 in ltmp on a dovecot director proxy server, > like this: > > Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Panic: file lmtp-proxy.c: line 376 (lmtp_proxy_output_timeout): assertion failed: (proxy->data_input->eof) > Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x363323d99a] -> /usr/lib64/dovecot/libdovecot.so.0() [0x363323d9e6] -> /usr/lib64/dovecot/libdovecot.so.0(i_error+0) [0x3633216f8f] -> dovecot/lmtp() [0x406e57] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xd4) [0x3633248ff4] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x5b) [0x3633249bdb] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x3633248c58] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x3633236fc3] -> dovecot/lmtp(main+0x154) [0x403f84] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x373cc1ec5d] -> dovecot/lmtp() [0x403d69] > Dec 5 14:31:51 sproxy1 abrt[30067]: saved core dump of pid 29999 (/usr/libexec/dovecot/lmtp) to /var/spool/abrt/ccpp-1323091911-29999.new/coredump (1368064 bytes) > Dec 5 14:31:51 sproxy1 dovecot: master: Error: service(lmtp): child 29999 killed with signal 6 (core dumped) > > we have something misconfigured or it's a bug on this dovecot version? > > our doveconf -n is: > # 2.0.15: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-71.29.1.el6.x86_64 x86_64 CentOS Linux release 6.0 (Final) > auth_cache_size = 3 k > auth_cache_ttl = 15 mins > auth_verbose = yes > base_dir = /var/run/dovecot/ > default_client_limit = 30000 > default_process_limit = 5000 > director_doveadm_port = 990 > director_mail_servers = 10.80.82.21 10.80.82.22 > director_servers = 10.80.82.11 10.80.82.12 > doveadm_proxy_port = 24245 > lmtp_proxy = yes > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave > passdb { > args = proxy=y nopassword=y starttls=any-cert > driver = static > } > postmaster_address = xavier.pons at uib.es > protocols = imap pop3 lmtp sieve > service auth { > client_limit = 27048 > unix_listener /var/spool/postfix/private/auth { > mode = 0666 > } > unix_listener auth-userdb { > group = dovecot > mode = 0660 > } > } > service director { > fifo_listener login/proxy-notify { > mode = 0666 > } > inet_listener { > port = 991 > } > inet_listener director-doveadm { > port = 990 > } > unix_listener director-userdb { > mode = 0660 > } > unix_listener login/director { > mode = 0666 > } > } > service doveadm { > inet_listener { > port = 24245 > } > } > service imap-login { > executable = imap-login director > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > service lmtp { > inet_listener lmtp { > port = 30025 > } > } > service managesieve-login { > executable = managesieve-login director > } > service pop3-login { > executable = pop3-login director > inet_listener pop3 { > port = 110 > } > inet_listener pop3s { > port = 995 > ssl = yes > } > } > ssl = required > ssl_cert = ssl_key = syslog_facility = local1 > verbose_proctitle = yes > protocol lmtp { > auth_socket_path = director-userdb > passdb { > args = /etc/dovecot/dovecot-ldap-pass.conf.lmtp > driver = ldap > } > } > protocol doveadm { > auth_socket_path = director-userdb > } > protocol imap { > mail_max_userip_connections = 20 > } > protocol pop3 { > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > } > > Xavier > > -- > xavier.pons at uib.es > Centre de Tecnologies de la Informaci? > Universitat Illes Balears > > From janfrode at tanso.net Mon Dec 5 21:14:40 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 5 Dec 2011 20:14:40 +0100 Subject: [Dovecot] Strange quota problem Message-ID: <20111205191440.GA28330@dibs.tanso.net> I have a strange problems with quota on v2.0.14. We have an ldap user directory, and all users should have a mailQuota defined there. My problem is that some users gets the quota enforced, while others don't, and "doveadm user" doesn't seem to agree with "doveadm quota ge gett" Ref: $ doveadm user janfrode at example.net userdb: janfrode at example.net home : /usr/local/atmail/users/j/a/janfrode at example.net mailQuota : quota_rule=*:storage=2100000 $ doveadm -f tab quota get -u janfrode at example.net Quota name Type Value Limit % UserQuota STORAGE 760 1000000 0 UserQuota MESSAGE 62 - 0 Why limit 1000000 instead of 2100000 ? $ doveadm user omar at example.net userdb: omar at example.net home : /usr/local/atmail/users/o/m/omar at example.net mailQuota : quota_rule=*:storage=1000000 $ sudo doveadm -f tab quota get -u omar at example.net Quota name Type Value Limit % UserQuota STORAGE 0 - 0 UserQuota MESSAGE 0 - 0 $ doveadm user testkunde at example.net userdb: testkunde at example.net home : /usr/local/atmail/users/t/e/testkunde at example.net mailQuota : quota_rule=*:storage=1000000 $ doveadm -f tab quota get -u testkunde at example.net Quota name Type Value Limit % UserQuota STORAGE 33918 - 0 UserQuota MESSAGE 137 - 0 Why no storage limit ? Config below: ------------------------------------------------------------------ $ grep -v ^# /etc/dovecot/dovecot-ldap.conf.ext |grep -v ^$ hosts = ldapm1.example.net:389 ldapm2.example.net:389 auth_bind = yes auth_bind_userdn = uid=%n,ou=people,o=%d,o=ISP,o=example,c=NET base = ou=people,o=%d,o=ISP,o=example,c=NET deref = never scope = onelevel user_attrs = mailMessageStore=home, mailLocation=mail, mailQuota=mailQuota=quota_rule=*:storage=%$ user_filter = (&(objectClass=examplePerson)(uid=%n)) $ doveconf -n # 2.0.14: /etc/dovecot/dovecot.conf doveconf: Warning: service auth { client_limit=4396 } is lower than required under max. load (4521) # OS: x86_64 Red Hat Enterprise Linux Server release 5.x (Tikanga) auth_verbose = yes auth_verbose_passwords = sha1 disable_plaintext_auth = no mail_gid = 3000 mail_location = maildir:~/:INDEX=/indexes/%1u/%1.1u/%u mail_plugins = quota mail_uid = 3000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { quota = maildir:UserQuota sieve = /sieve/%1u/%1.1u/%u/.dovecot.sieve sieve_dir = /sieve/%1u/%1.1u/%u sieve_max_script_size = 1M } protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { client_limit = 4396 } service imap-login { inet_listener imap { address = * port = 143 } } service imap-postlogin { executable = script-login /usr/local/sbin/imap-postlogin.sh } service imap { executable = imap imap-postlogin process_limit = 2048 } service lmtp { client_limit = 1 inet_listener lmtp { address = * port = 24 } process_limit = 25 } service managesieve-login { inet_listener sieve { address = * port = 4190 } service_count = 1 } service pop3-login { inet_listener pop3 { address = * port = 110 } } service pop3-postlogin { executable = script-login /usr/local/sbin/pop3-postlogin.sh } service pop3 { executable = pop3 pop3-postlogin process_limit = 2048 } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = quota sieve } protocol imap { imap_client_workarounds = delay-newmail mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = UID%u-%v } protocol sieve { managesieve_logout_format = bytes=%i/%o } ------------------------------------------------------------------ -jf From tss at iki.fi Mon Dec 5 21:48:08 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 21:48:08 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> Message-ID: On 3.12.2011, at 18.10, Terry Carmen wrote: > I'll post a writeup on the wiki on monday. I moved it to http://wiki2.dovecot.org/HowTo/ImapcProxy From tss at iki.fi Mon Dec 5 21:49:15 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 21:49:15 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> Message-ID: <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> On 5.12.2011, at 19.16, Terry Carmen wrote: > It's working beautifully! > > Is there any way to get it to log failed login attempts with the user's IP address? auth_verbose=yes > I'd like to setup fail2ban to stop dictionary attacks, however even with debugging, the most I've been able to get it to say is: > > Dec 5 12:11:30 machinename dovecot: auth: Debug: client out: FAIL#0111#011user=username If you enabled auth_debug, it enabled auth_verbose also.. So you should have those log messages. Maybe they're being logged to a different file? From tss at iki.fi Mon Dec 5 21:50:32 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 21:50:32 +0200 Subject: [Dovecot] Strange quota problem In-Reply-To: <20111205191440.GA28330@dibs.tanso.net> References: <20111205191440.GA28330@dibs.tanso.net> Message-ID: On 5.12.2011, at 21.14, Jan-Frode Myklebust wrote: > userdb: janfrode at example.net > home : /usr/local/atmail/users/j/a/janfrode at example.net > mailQuota : quota_rule=*:storage=2100000 it should say: quota_rule: *:storage=2100000 So, fix user_attrs: user_attrs = mailMessageStore=home, mailLocation=mail, mailQuota=quota_rule=*:storage=%$ From terry at cnysupport.com Mon Dec 5 22:27:58 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 15:27:58 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy In-Reply-To: References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> Message-ID: <20111205152758.Horde.bmYUeVeGiNBO3SlOSgojj2A@www.cnysupport.com> >> I'll post a writeup on the wiki on monday. > > I moved it to http://wiki2.dovecot.org/HowTo/ImapcProxy Thanks! I didn't realize I was in the wrong wiki. Terry From janfrode at tanso.net Mon Dec 5 23:05:19 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 5 Dec 2011 22:05:19 +0100 Subject: [Dovecot] Strange quota problem In-Reply-To: References: <20111205191440.GA28330@dibs.tanso.net> Message-ID: <20111205210519.GA30303@dibs.tanso.net> On Mon, Dec 05, 2011 at 09:50:32PM +0200, Timo Sirainen wrote: > On 5.12.2011, at 21.14, Jan-Frode Myklebust wrote: > > > userdb: janfrode at example.net > > home : /usr/local/atmail/users/j/a/janfrode at example.net > > mailQuota : quota_rule=*:storage=2100000 > > it should say: > > quota_rule: *:storage=2100000 Oh, I had mailQuota=mailQuota=quota_rule=*:storage=%$ > So, fix user_attrs: > > user_attrs = mailMessageStore=home, mailLocation=mail, mailQuota=quota_rule=*:storage=%$ Thanks! -jf From terry at cnysupport.com Mon Dec 5 23:05:08 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 16:05:08 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> Message-ID: <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Mon, 5 Dec 2011 21:49:15 +0200 From: Timo Sirainen Reply-To: Dovecot Mailing List Subject: Re: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) To: Terry Carmen Cc: dovecot at dovecot.org > On 5.12.2011, at 19.16, Terry Carmen wrote: > >> It's working beautifully! >> >> Is there any way to get it to log failed login attempts with the >> user's IP address? > > auth_verbose=yes Got it. syslog_facility = mail auth_verbose = yes auth_verbose_passwords = plain auth_debug = yes mail_debug = yes I'm sure they're not all necessary. I was turning on all the logging I could find. 8-) The log looks like this: Dec 5 15:29:49 it dovecot: auth: Debug: auth client connected (pid=12028) Dec 5 15:30:03 it dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011lip=10.1.2.3#011rip=123.123.123.123#011lport=143#011rport=40816#011resp= Dec 5 15:30:03 it dovecot: auth: Debug: imap(username,123.123.123.123): lookup host=10.1.16.226 port=143 Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.2.3:143): Looking up IP address Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.2.3:143): Connecting to 10.1.2.3:143 Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.2.3:143): Server capabilities: IMAP4 IMAP4rev1 IDLE LOGIN-REFERRALS MAILBOX-REFERRALS NAMESPACE LITERAL+ UIDPLUS CHILDREN AUTH=NTLM Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.2.3:143): Authenticating as username Dec 5 15:30:03 it dovecot: auth: Debug: imapc(10.1.16.226:143): Disconnected Dec 5 15:30:05 it dovecot: auth: Debug: client out: FAIL#0111#011user=username The last line *almost* gets me enough for a fail2ban filter, but not quite, since there's no IP address. Is there something else I can turn on? Thanks, Terry From miha.vrhovnik at cordia.si Mon Dec 5 23:21:47 2011 From: miha.vrhovnik at cordia.si (Miha Vrhovnik) Date: Mon, 5 Dec 2011 22:21:47 +0100 Subject: [Dovecot] =?iso-8859-1?q?MS_Exchange_IMAP_Proxy_=28Logging_Auth_F?= =?iso-8859-1?q?ailures=3F=29?= In-Reply-To: <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> Message-ID: <20111205222148.9047A6F8E8D@miha> "Terry Carmen" wrote on 5.12.2011 22:05:08: ...cut ... >Dec 5 15:30:05 it dovecot: auth: Debug: client out: >FAIL#0111#011user=username > >The last line *almost* gets me enough for a fail2ban filter, but not >quite, since there's no IP address. > >Is there something else I can turn on? It's probably dfferent for proxy, but without it and with auth_verbose = yes as suggested by Timo I get Dec 5 15:02:32 mailstore dovecot: pop3-login: Disconnected (auth failed, 1 attempts): user=, method=PLAIN, rip=x.x.x.x, lip=y.y.y.y Regards, M From tss at iki.fi Mon Dec 5 23:24:23 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 5 Dec 2011 23:24:23 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> Message-ID: <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> On 5.12.2011, at 23.05, Terry Carmen wrote: > The log looks like this: .. All of the lines are "debug" level. Find the "info" log. "doveadm log find" usually finds it for you. From terry at cnysupport.com Tue Dec 6 00:39:26 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 17:39:26 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> Message-ID: <20111205173926.Horde.1M-cPleGiNBO3Uge0ooC9NA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Mon, 5 Dec 2011 23:24:23 +0200 From: Timo Sirainen Reply-To: Dovecot Mailing List Subject: Re: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) To: Terry Carmen Cc: dovecot at dovecot.org > On 5.12.2011, at 23.05, Terry Carmen wrote: > >> The log looks like this: > .. > > All of the lines are "debug" level. Find the "info" log. "doveadm > log find" usually finds it for you. [root at server conf.d]# doveadm log find Looking for log files from /var/log Debug: /var/log/maillog Info: /var/log/maillog Warning: /var/log/maillog Error: /var/log/maillog Fatal: /var/log/maillog The successful logins look good. For example: Dec 5 17:01:50 it dovecot: imap-login: Login: user=, method=PLAIN, rip=123.123.123.123, lip=10.1.2.3, mpid=12277, TLS However there's nothing similar for the failed logins: Dec 5 17:01:36 it dovecot: auth: Debug: imapc(10.1.2.3:143): Authenticating as username Dec 5 17:01:36 it dovecot: auth: Debug: imapc(10.1.2.3:143): Disconnected Dec 5 17:01:38 it dovecot: auth: Debug: client out: FAIL#0111#011user=username Dec 5 17:01:46 it dovecot: auth: Debug: client in: AUTH#0112#011PLAIN#011service=imap#011secured#011lip=10.1.20.52#011rip=123.123.123.123#011lport=143#011rport=41748#011resp= I checked lib-imap-client/imapc-connection.c and found where the "Authenticating as" message comes from, but don't see anyplace where the I believe I found the section of code that does the imapc authentication, but don't see anyplace where auth failures are logged: Any thoughts? Terry From tss at iki.fi Tue Dec 6 00:48:02 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 6 Dec 2011 00:48:02 +0200 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: <20111205173926.Horde.1M-cPleGiNBO3Uge0ooC9NA@www.cnysupport.com> References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> <20111205173926.Horde.1M-cPleGiNBO3Uge0ooC9NA@www.cnysupport.com> Message-ID: On 6.12.2011, at 0.39, Terry Carmen wrote: > I checked lib-imap-client/imapc-connection.c and found where the "Authenticating as" message comes from, but don't see anyplace where the > > I believe I found the section of code that does the imapc authentication, but don't see anyplace where auth failures are logged: Oh, right, passdb imapc doesn't log about failed authentication. I'll add it tomorrow. From terry at cnysupport.com Tue Dec 6 01:00:33 2011 From: terry at cnysupport.com (Terry Carmen) Date: Mon, 05 Dec 2011 18:00:33 -0500 Subject: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) In-Reply-To: References: <20111130153646.Horde.fehRaFeGiNBO1pPe5xWA0vA@www.cnysupport.com> <20111130230324.Horde.ly0efFeGiNBO1vyM4jvQmLA@www.cnysupport.com> <224889EC-1221-4399-A166-4DB6961360D4@iki.fi> <20111202184238.Horde.YuNOfVeGiNBO2WJusDnl0aA@www.cnysupport.com> <91DE0184-B27D-4995-A42F-0193B570290E@iki.fi> <20111202215512.Horde.kWyJLleGiNBO2Y_Q6MHl0aA@www.cnysupport.com> <20111203111022.Horde.8q-sFFeGiNBO2knugynGCwA@www.cnysupport.com> <20111205121647.Horde.OcjiWFeGiNBO3Px-NsDC9NA@www.cnysupport.com> <47957A94-9E4F-4C93-AE6E-7714CFCDAF0F@iki.fi> <20111205160508.Horde.VDgRVVeGiNBO3TIEkgdC_LA@www.cnysupport.com> <97BAD19D-9AA0-4DD8-B83A-144DC27AAD49@iki.fi> <20111205173926.Horde.1M-cPleGiNBO3Uge0ooC9NA@www.cnysupport.com> Message-ID: <20111205180033.Horde.U3wkEFeGiNBO3U0RY5KS9SA@www.cnysupport.com> ----- Message from Timo Sirainen --------- Date: Tue, 6 Dec 2011 00:48:02 +0200 From: Timo Sirainen Subject: Re: [Dovecot] MS Exchange IMAP Proxy (Logging Auth Failures?) To: Terry Carmen Cc: dovecot at dovecot.org > On 6.12.2011, at 0.39, Terry Carmen wrote: > >> I checked lib-imap-client/imapc-connection.c and found where the >> "Authenticating as" message comes from, but don't see anyplace >> where the >> >> I believe I found the section of code that does the imapc >> authentication, but don't see anyplace where auth failures are >> logged: > > Oh, right, passdb imapc doesn't log about failed authentication. > I'll add it tomorrow. That's awesome! I really, really appreciate your help. Terry From ales.sevsek at gmail.com Tue Dec 6 10:52:56 2011 From: ales.sevsek at gmail.com (=?iso-8859-2?B?QWxluSBTRVapRUs=?=) Date: Tue, 6 Dec 2011 09:52:56 +0100 Subject: [Dovecot] Outlook double attachments Message-ID: <001e01ccb3f4$73741000$5a5c3000$@gmail.com> Hi! I wonder, have you managed to solve the problem. I have the same one (regarding double attachmets). Thanks for your help. BR Ale? SEV?EK __________________ Izjava o omejitvi odgovornosti: To elektronsko sporo?ilo in vse njegove morebitne priloge lahko vsebujejo zaupne in/ali privilegirane informacijeter namenjene izklju?no naslovniku. ?e ste sporo?ilo prejeli pomotoma, Vas prosimo, da o tem obvestite po?iljatelja, sporo?ilo pa takoj uni?ite. Kakr?nokoli nepoobla??eno razkritje, distribucija ali kopiranje vsebine sporo?ila je izrecno prepovedano. Legal disclaimer statement: This e-mail and any attachments may contain confidential and/or privileged information and is intended solely for the addressee. If you are not the intended recipient (or have received this e-mail by mistake), please notify the sender immediately and delete this e-mail. Any unauthorized reproduction, disclosure or distribution of the material in this e-mail is strictly forbidden. From apm at one.com Tue Dec 6 11:39:44 2011 From: apm at one.com (Peter Mogensen) Date: Tue, 06 Dec 2011 10:39:44 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: Message-ID: <4EDDE2E0.8070202@one.com> On 2011-12-02 22:22, dovecot-request at dovecot.org wrote: > It's implemented now in dovecot-2.1 hg. It also deprecates autocreate > plugin (but it still works the old way). The idea is that you can now > do e.g.: > > mailbox Trash { > auto = no > special_use = \Trash > } > ... This is great Timo. But for solving the localization problem for special-use folders, it's only half the way. Are there any plans to support RFC5464 SETMETADATA, so individual users can name their "\Trash" folder "Skraldspand" in danish or what ever they prefer? /Peter From p at state-of-mind.de Tue Dec 6 12:29:27 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 06 Dec 2011 11:29:27 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDDE2E0.8070202@one.com> References: <4EDDE2E0.8070202@one.com> Message-ID: <4EDDEE87.7090900@state-of-mind.de> Am 06.12.2011 10:39, schrieb Peter Mogensen: > On 2011-12-02 22:22, dovecot-request at dovecot.org wrote: > > It's implemented now in dovecot-2.1 hg. It also deprecates autocreate > > plugin (but it still works the old way). The idea is that you can now > > do e.g.: > > > > mailbox Trash { > > auto = no > > special_use = \Trash > > } > > ... > > This is great Timo. > But for solving the localization problem for special-use folders, it's > only half the way. > > Are there any plans to support RFC5464 SETMETADATA, so individual > users can name their "\Trash" folder "Skraldspand" in danish or what > ever they prefer? I believe setting the name should be a mapping that takes place in the MUA. p@ > > /Peter -- state of mind () Digitale Kommunikation www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5372 bytes Desc: S/MIME Cryptographic Signature URL: From alec at alec.pl Tue Dec 6 13:45:40 2011 From: alec at alec.pl (A.L.E.C) Date: Tue, 06 Dec 2011 12:45:40 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDDEE87.7090900@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> Message-ID: <4EDE0064.7040509@alec.pl> On 06.12.2011 11:29, Patrick Ben Koetter wrote: >> Are there any plans to support RFC5464 SETMETADATA, so individual >> users can name their "\Trash" folder "Skraldspand" in danish or what >> ever they prefer? Now I see in the hg that Timo doesn't implemented this nor CREATE-SPECIAL-USE. So, it's not so nice as I thought ;) There is metadata plugin. Should it be extended to support this? > I believe setting the name should be a mapping that takes place in the MUA. We have RFC6154 for this, don't try to be smarter. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From p at state-of-mind.de Tue Dec 6 14:43:03 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 13:43:03 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDE0064.7040509@alec.pl> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> Message-ID: <20111206124303.GA11375@state-of-mind.de> * A.L.E.C : > On 06.12.2011 11:29, Patrick Ben Koetter wrote: > > >> Are there any plans to support RFC5464 SETMETADATA, so individual > >> users can name their "\Trash" folder "Skraldspand" in danish or what > >> ever they prefer? > > Now I see in the hg that Timo doesn't implemented this nor > CREATE-SPECIAL-USE. So, it's not so nice as I thought ;) There is > metadata plugin. Should it be extended to support this? > > > I believe setting the name should be a mapping that takes place in the MUA. > > We have RFC6154 for this, don't try to be smarter. >From my understanding RFC 6154 serves to flag some IMAP mailboxes in order to indicate they should be used for special use e.g. as trash folder etc. I fail to see how RFC 6154 would help displaying localized mailbox names. Please point out. p at rick -- state of mind () Digitale Kommunikation http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From alec at alec.pl Tue Dec 6 14:45:28 2011 From: alec at alec.pl (A.L.E.C) Date: Tue, 06 Dec 2011 13:45:28 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206124303.GA11375@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> Message-ID: <4EDE0E68.2020305@alec.pl> On 06.12.2011 13:43, Patrick Ben Koetter wrote: > From my understanding RFC 6154 serves to flag some IMAP mailboxes in order to > indicate they should be used for special use e.g. as trash folder etc. > > I fail to see how RFC 6154 would help displaying localized mailbox names. Ok. It will not help for existing folders, but will allow creation of special-use folders with any name. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From p at state-of-mind.de Tue Dec 6 15:07:00 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 14:07:00 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDE0E68.2020305@alec.pl> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> Message-ID: <20111206130659.GB11375@state-of-mind.de> * A.L.E.C : > On 06.12.2011 13:43, Patrick Ben Koetter wrote: > > > From my understanding RFC 6154 serves to flag some IMAP mailboxes in order to > > indicate they should be used for special use e.g. as trash folder etc. > > > > I fail to see how RFC 6154 would help displaying localized mailbox names. > > Ok. It will not help for existing folders, but will allow creation of > special-use folders with any name. Yes. And on top of that a MUA should detect these SPECIAL-USE folders and automagically map its special folders (trash, archive, sent, drafts, etc.) to the servers SPECIAL-USE mailboxes. This should take place transparently and the special folders should carry localized mailbox names e.g. "Sent" or "Gesendet" or "..." At least that was my motivation to initiate that RFC about two years ago and getting closer to that goal was the reason to sponsor this feature in Dovecot 2.1. p at rick -- state of mind () Digitale Kommunikation http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From selcuk.yazar at gmail.com Tue Dec 6 15:07:06 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Tue, 6 Dec 2011 15:07:06 +0200 Subject: [Dovecot] Log/Process users pop3 plain password Message-ID: Hi, I have Postfix + OpenLdap + DoveCot configuration, and it's running succesfuly, i wantto convert users pop3 password NTPassword and LMPassword, so i ne plain passwor dof users, how can i do that. (Normaly using perl's ntlmgen function i convert password , but in plain) thanks in advance -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From thierry at mailhub.co.za Tue Dec 6 15:35:04 2011 From: thierry at mailhub.co.za (Thierry de Montaudry) Date: Tue, 6 Dec 2011 14:35:04 +0100 Subject: [Dovecot] MUAs creating different "Sent" folders In-Reply-To: <20111129214256.GL14970@charite.de> References: <20111129214256.GL14970@charite.de> Message-ID: <3B11D302-945B-4C13-B1F3-1558D564FF3C@mailhub.co.za> Hi, I know this might be a bit off topic, but having just fixed the problem on my machine, I though I might share it: on Mac OS Lion, with Apple Mail, you can change the system folders by editing the file ~/Library/Mail/V2/MailData/Accounts.plist (path might differ with older version of Mac OS). For each accounts it has 3 entries (DraftMailboxName, JunkMailboxName and SentMessagesMailboxName) that can be changed to any value you want. Quite useful when you are IMAPing your account from different systems. Just don't forget to close Mail while editing this file, and don't do it if you don't have a proper plist editor. This can be done as well in iOS, from the Mail settings, in the account advanced settings. But folders (Trash, Spam...) have to be created before. Regards, Thierry On 29 Nov 2011, at 22:42, Ralf Hildebrandt wrote: > While our webmail installation creates "Sent" as a Sent-Items Folder, > Apple Mail creates "Sent Messages". > > Is there a way of "mapping" foldernames e.g. > > map "Sent Messages" to "Sent" > map "Deletes Messages" to "Trash" > and so on? > > -- > Ralf Hildebrandt > Gesch?ftsbereich IT | Abteilung Netzwerk > Charit? - Universit?tsmedizin Berlin > Campus Benjamin Franklin > Hindenburgdamm 30 | D-12203 Berlin > Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 > ralf.hildebrandt at charite.de | http://www.charite.de > From patrickdk at patrickdk.com Tue Dec 6 17:00:34 2011 From: patrickdk at patrickdk.com (Patrick Domack) Date: Tue, 06 Dec 2011 10:00:34 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206130659.GB11375@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> Message-ID: <20111206100034.Horde.RaGtXpLnE6FO3i4SLvRDR2A@kishi.patrickdk.com> Guess the next nice step would be to get sieve scripts to be able to use the aliased special use folders. So you can just say, fileinto \Spam; Quoting Patrick Ben Koetter

: > * A.L.E.C : >> On 06.12.2011 13:43, Patrick Ben Koetter wrote: >> >> > From my understanding RFC 6154 serves to flag some IMAP mailboxes >> in order to >> > indicate they should be used for special use e.g. as trash folder etc. >> > >> > I fail to see how RFC 6154 would help displaying localized mailbox names. >> >> Ok. It will not help for existing folders, but will allow creation of >> special-use folders with any name. > > Yes. And on top of that a MUA should detect these SPECIAL-USE folders and > automagically map its special folders (trash, archive, sent, drafts, etc.) to > the servers SPECIAL-USE mailboxes. > > This should take place transparently and the special folders should carry > localized mailbox names e.g. "Sent" or "Gesendet" or "..." > > At least that was my motivation to initiate that RFC about two years ago and > getting closer to that goal was the reason to sponsor this feature in Dovecot > 2.1. > > p at rick > > -- > state of mind () > Digitale Kommunikation > > http://www.state-of-mind.de > > Franziskanerstra?e 15 Telefon +49 89 3090 4664 > 81669 M?nchen Telefax +49 89 3090 4666 > > Amtsgericht M?nchen Partnerschaftsregister PR 563 From stephan at rename-it.nl Tue Dec 6 17:50:03 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 06 Dec 2011 16:50:03 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206100034.Horde.RaGtXpLnE6FO3i4SLvRDR2A@kishi.patrickdk.com> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206100034.Horde.RaGtXpLnE6FO3i4SLvRDR2A@kishi.patrickdk.com> Message-ID: <4EDE39AB.6050103@rename-it.nl> Op 6-12-2011 16:00, Patrick Domack schreef: > Guess the next nice step would be to get sieve scripts to be able to > use the aliased special use folders. So you can just say, fileinto \Spam; Hmm, yeah. This will require some standardization efforts though. Your example is a bit problematic: - First, syntax-wise, the argument should be enclosed in double quotes; the grammar of the Sieve language is a bit sacred. :) - From what I've read, those SPECIAL-USE flags are not guaranteed to be unique, so the delivery may become ambiguous. So, it is not really an alias. - Making the bare fileinto command accept a SPECIAL-USE flag as an alternative to a regular folder name may be unwise (potentially causing naming conflicts, albeit unlikely). Some sort of :special_use tag would be in order. The ability to query which folder(s) are used for special purposes could be an alternative, although that is not ideal either. I am not sure how to approach this right now. Regards, Stephan. From wgillespie+dovecot at es2eng.com Tue Dec 6 20:14:44 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Tue, 06 Dec 2011 11:14:44 -0700 Subject: [Dovecot] MUAs creating different "Sent" folders In-Reply-To: <3B11D302-945B-4C13-B1F3-1558D564FF3C@mailhub.co.za> References: <20111129214256.GL14970@charite.de> <3B11D302-945B-4C13-B1F3-1558D564FF3C@mailhub.co.za> Message-ID: <4EDE5B94.3010308@es2eng.com> On 12/06/2011 06:35 AM, Thierry de Montaudry wrote: > Hi, > > I know this might be a bit off topic, but having just fixed the problem on my machine, I though I might share it: on Mac OS Lion, with Apple Mail, you can change the system folders by editing the file ~/Library/Mail/V2/MailData/Accounts.plist (path might differ with older version of Mac OS). > For each accounts it has 3 entries (DraftMailboxName, JunkMailboxName and SentMessagesMailboxName) that can be changed to any value you want. Quite useful when you are IMAPing your account from different systems. Just don't forget to close Mail while editing this file, and don't do it if you don't have a proper plist editor. This can also be done via the GUI in Apple Mail. - Click on the mailbox you want. - Mailbox > Use this mailbox for > (whatever) From patrickdk at patrickdk.com Tue Dec 6 21:18:38 2011 From: patrickdk at patrickdk.com (Patrick Domack) Date: Tue, 06 Dec 2011 14:18:38 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDE39AB.6050103@rename-it.nl> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206100034.Horde.RaGtXpLnE6FO3i4SLvRDR2A@kishi.patrickdk.com> <4EDE39AB.6050103@rename-it.nl> Message-ID: <20111206141838.Horde.VeXRY5LnE6FO3mqO69Xj0MA@kishi.patrickdk.com> Yep, I only meant it in the crudest of forms. I'm sure defining the correct syntax will be the hard part. Quoting Stephan Bosch : > Op 6-12-2011 16:00, Patrick Domack schreef: >> Guess the next nice step would be to get sieve scripts to be able >> to use the aliased special use folders. So you can just say, >> fileinto \Spam; > > Hmm, yeah. This will require some standardization efforts though. > > Your example is a bit problematic: > - First, syntax-wise, the argument should be enclosed in double > quotes; the grammar of the Sieve language is a bit sacred. :) > - From what I've read, those SPECIAL-USE flags are not guaranteed > to be unique, so the delivery may become ambiguous. So, it is not > really an alias. > - Making the bare fileinto command accept a SPECIAL-USE flag as an > alternative to a regular folder name may be unwise (potentially > causing naming conflicts, albeit unlikely). Some sort of > :special_use tag would be in order. > > The ability to query which folder(s) are used for special purposes > could be an alternative, although that is not ideal either. I am not > sure how to approach this right now. > > > Regards, > > Stephan. From tss at iki.fi Wed Dec 7 00:13:54 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 07 Dec 2011 00:13:54 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> Message-ID: <1323209634.15365.6.camel@hurina> On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > The mailbox names require a namespace prefix, so if you use e.g. "INBOX." prefix you'll need to use: I changed these so that they are inside namespace {} section and don't require namespace prefix in the name. That way I can include common mailbox definitions in example-config and still allow the namespace prefix to be easily changed. I'm anyway now wondering what the defaults should be? Could someone check what these defaults are for Outlook and any other clients you have: * "Drafts" is used by all clients * "Trash" is used by all clients * "Junk" is used by all clients? Or is "Spam" used by some? * "Sent" is used by Thunderbird, Evolution * "Sent Messages" is used by Apple Mail So I'm mainly wondering about "Sent" vs. "Sent Messages". From p at state-of-mind.de Wed Dec 7 00:26:09 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 23:26:09 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323209634.15365.6.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> Message-ID: <20111206222608.GC2292@state-of-mind.de> * Timo Sirainen : > On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > > > The mailbox names require a namespace prefix, so if you use e.g. "INBOX." prefix you'll need to use: > > I changed these so that they are inside namespace {} section and don't > require namespace prefix in the name. That way I can include common > mailbox definitions in example-config and still allow the namespace > prefix to be easily changed. > > I'm anyway now wondering what the defaults should be? Could someone > check what these defaults are for Outlook and any other clients you > have: > > * "Drafts" is used by all clients > * "Trash" is used by all clients > * "Junk" is used by all clients? Or is "Spam" used by some? > * "Sent" is used by Thunderbird, Evolution > * "Sent Messages" is used by Apple Mail > > So I'm mainly wondering about "Sent" vs. "Sent Messages". Are you looking for US-English mailbox names only? p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From slusarz at curecanti.org Wed Dec 7 00:27:22 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 06 Dec 2011 15:27:22 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206130659.GB11375@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> Message-ID: <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> Quoting Patrick Ben Koetter

: > * A.L.E.C : >> On 06.12.2011 13:43, Patrick Ben Koetter wrote: >> >> > From my understanding RFC 6154 serves to flag some IMAP mailboxes >> in order to >> > indicate they should be used for special use e.g. as trash folder etc. >> > >> > I fail to see how RFC 6154 would help displaying localized mailbox names. >> >> Ok. It will not help for existing folders, but will allow creation of >> special-use folders with any name. > > Yes. And on top of that a MUA should detect these SPECIAL-USE folders and > automagically map its special folders (trash, archive, sent, drafts, etc.) to > the servers SPECIAL-USE mailboxes. > > This should take place transparently and the special folders should carry > localized mailbox names e.g. "Sent" or "Gesendet" or "..." Except the localization conversions should be done on the MUA level, not the mailstore level (see, e.g., INBOX). As Timo noted in another message in this thread, for the most part there has been a informal standardization of special mailbox names to their English equivalents. There is really no reason to move away from this standardization, especially for MUAs that do not yet support RFC 6154 but may support a form auto-detection of common special mailbox names. michael From p at state-of-mind.de Wed Dec 7 00:34:51 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 23:34:51 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> Message-ID: <20111206223451.GD2292@state-of-mind.de> * Michael M Slusarz : > Quoting Patrick Ben Koetter

: > > >* A.L.E.C : > >>On 06.12.2011 13:43, Patrick Ben Koetter wrote: > >> > >>> From my understanding RFC 6154 serves to flag some IMAP > >>mailboxes in order to > >>> indicate they should be used for special use e.g. as trash folder etc. > >>> > >>> I fail to see how RFC 6154 would help displaying localized mailbox names. > >> > >>Ok. It will not help for existing folders, but will allow creation of > >>special-use folders with any name. > > > >Yes. And on top of that a MUA should detect these SPECIAL-USE folders and > >automagically map its special folders (trash, archive, sent, drafts, etc.) to > >the servers SPECIAL-USE mailboxes. > > > >This should take place transparently and the special folders should carry > >localized mailbox names e.g. "Sent" or "Gesendet" or "..." > > Except the localization conversions should be done on the MUA level, > not the mailstore level (see, e.g., INBOX). I believe that is exactly what I said in my lines above. > As Timo noted in another message in this thread, for the most part > there has been a informal standardization of special mailbox names > to their English equivalents. There is really no reason to move > away from this standardization, especially for MUAs that do not yet Where in my posting did I say I want to move away from that standard? > support RFC 6154 but may support a form auto-detection of common > special mailbox names. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From tss at iki.fi Wed Dec 7 00:35:54 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 07 Dec 2011 00:35:54 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206222608.GC2292@state-of-mind.de> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> Message-ID: <1323210956.15365.11.camel@hurina> On Tue, 2011-12-06 at 23:26 +0100, Patrick Ben Koetter wrote: > > I'm anyway now wondering what the defaults should be? Could someone > > check what these defaults are for Outlook and any other clients you > > have: > > > > * "Drafts" is used by all clients > > * "Trash" is used by all clients > > * "Junk" is used by all clients? Or is "Spam" used by some? > > * "Sent" is used by Thunderbird, Evolution > > * "Sent Messages" is used by Apple Mail > > > > So I'm mainly wondering about "Sent" vs. "Sent Messages". > > Are you looking for US-English mailbox names only? Yeah, just some defaults that most people could use without changes. Although maybe if all of them were set with autocreate=no there could be alternatives added. Like: mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } This way whichever mailbox the first client creates would be used as \Sent. Although if different clients create both of them there would then be two \Sent mailboxes. But the user would probably delete one of them and all would be good again. From slusarz at curecanti.org Wed Dec 7 00:40:57 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 06 Dec 2011 15:40:57 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206223451.GD2292@state-of-mind.de> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> <20111206223451.GD2292@state-of-mind.de> Message-ID: <20111206154057.Horde.Ky5VRIF5lbhO3pn5gMOEWMA@bigworm.curecanti.org> Quoting Patrick Ben Koetter

: > * Michael M Slusarz : >> Quoting Patrick Ben Koetter

: >> >> >* A.L.E.C : >> >>On 06.12.2011 13:43, Patrick Ben Koetter wrote: >> >> >> >>> From my understanding RFC 6154 serves to flag some IMAP >> >>mailboxes in order to >> >>> indicate they should be used for special use e.g. as trash folder etc. >> >>> >> >>> I fail to see how RFC 6154 would help displaying localized >> mailbox names. >> >> >> >>Ok. It will not help for existing folders, but will allow creation of >> >>special-use folders with any name. >> > >> >Yes. And on top of that a MUA should detect these SPECIAL-USE folders and >> >automagically map its special folders (trash, archive, sent, >> drafts, etc.) to >> >the servers SPECIAL-USE mailboxes. >> > >> >This should take place transparently and the special folders should carry >> >localized mailbox names e.g. "Sent" or "Gesendet" or "..." >> >> Except the localization conversions should be done on the MUA level, >> not the mailstore level (see, e.g., INBOX). > > I believe that is exactly what I said in my lines above. > > >> As Timo noted in another message in this thread, for the most part >> there has been a informal standardization of special mailbox names >> to their English equivalents. There is really no reason to move >> away from this standardization, especially for MUAs that do not yet > > Where in my posting did I say I want to move away from that standard? The combination of the original author's comment, and your response which did not seem to disagree with him at all, made it ambiguous at best whether you were referring to localized mailbox names being stored on the server or being translated on the client. Looking through the entire thread, and seeing your previous message, I see that this was an incorrect assumption. I apologize for any misunderstanding. michael From p at state-of-mind.de Wed Dec 7 00:46:59 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Tue, 6 Dec 2011 23:46:59 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206154057.Horde.Ky5VRIF5lbhO3pn5gMOEWMA@bigworm.curecanti.org> References: <4EDDE2E0.8070202@one.com> <4EDDEE87.7090900@state-of-mind.de> <4EDE0064.7040509@alec.pl> <20111206124303.GA11375@state-of-mind.de> <4EDE0E68.2020305@alec.pl> <20111206130659.GB11375@state-of-mind.de> <20111206152722.Horde.Gqg-WYF5lbhO3pbKG1Yz2FA@bigworm.curecanti.org> <20111206223451.GD2292@state-of-mind.de> <20111206154057.Horde.Ky5VRIF5lbhO3pn5gMOEWMA@bigworm.curecanti.org> Message-ID: <20111206224658.GE2292@state-of-mind.de> * Michael M Slusarz : > The combination of the original author's comment, and your response > which did not seem to disagree with him at all, made it ambiguous at > best whether you were referring to localized mailbox names being > stored on the server or being translated on the client. Looking > through the entire thread, and seeing your previous message, I see > that this was an incorrect assumption. I apologize for any > misunderstanding. Thank you. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From slusarz at curecanti.org Wed Dec 7 00:48:38 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 06 Dec 2011 15:48:38 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323210956.15365.11.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> Message-ID: <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> Quoting Timo Sirainen : > On Tue, 2011-12-06 at 23:26 +0100, Patrick Ben Koetter wrote: >> > I'm anyway now wondering what the defaults should be? Could someone >> > check what these defaults are for Outlook and any other clients you >> > have: >> > >> > * "Drafts" is used by all clients >> > * "Trash" is used by all clients >> > * "Junk" is used by all clients? Or is "Spam" used by some? 'Spam' is also used. This one is probably a bit more site-specific. >> > * "Sent" is used by Thunderbird, Evolution >> > * "Sent Messages" is used by Apple Mail >> > >> > So I'm mainly wondering about "Sent" vs. "Sent Messages". IIRC, at least some versions of Exchange use(d) "Sent Items". > This way whichever mailbox the first client creates would be used as > \Sent. Although if different clients create both of them there would > then be two \Sent mailboxes. But the user would probably delete one of > them and all would be good again. This will continue to be an issue until more clients support the RFC. michael From tss at iki.fi Wed Dec 7 00:49:49 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 07 Dec 2011 00:49:49 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323210956.15365.11.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> Message-ID: <1323211790.15365.12.camel@hurina> On Wed, 2011-12-07 at 00:35 +0200, Timo Sirainen wrote: > Yeah, just some defaults that most people could use without changes. > Although maybe if all of them were set with autocreate=no there could be > alternatives added. Like: > > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } I did this: http://hg.dovecot.org/dovecot-2.1/rev/9b9a206395f7 From bill-dovecot at carpenter.org Wed Dec 7 00:58:04 2011 From: bill-dovecot at carpenter.org (WJCarpenter) Date: Tue, 06 Dec 2011 14:58:04 -0800 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323209634.15365.6.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> Message-ID: <4EDE9DFC.4010101@carpenter.org> > On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > > I'm anyway now wondering what the defaults should be? Could someone > check what these defaults are for Outlook and any other clients you > have: > > * "Drafts" is used by all clients > * "Trash" is used by all clients > * "Junk" is used by all clients? Or is "Spam" used by some? > * "Sent" is used by Thunderbird, Evolution > * "Sent Messages" is used by Apple Mail > SquirrelMail (http://www.squirrelmail.org) and Hastymail2 (http://www.hastymail.org) webmail clients let you customize draft/trash/sent, but the defaults for both are Drafts, Trash, and Sent. From simon.brereton at buongiorno.com Wed Dec 7 01:02:47 2011 From: simon.brereton at buongiorno.com (Simon Brereton) Date: Tue, 6 Dec 2011 18:02:47 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> Message-ID: On 6 December 2011 17:48, Michael M Slusarz wrote: > Quoting Timo Sirainen : > >> On Tue, 2011-12-06 at 23:26 +0100, Patrick Ben Koetter wrote: >>> >>> > I'm anyway now wondering what the defaults should be? Could someone >>> > check what these defaults are for Outlook and any other clients you >>> > have: >>> > >>> > ?* "Drafts" is used by all clients >>> > ?* "Trash" is used by all clients >>> > ?* "Junk" is used by all clients? Or is "Spam" used by some? > > > 'Spam' is also used. ?This one is probably a bit more site-specific. > >>> > ?* "Sent" is used by Thunderbird, Evolution >>> > ?* "Sent Messages" is used by Apple Mail >>> > >>> > So I'm mainly wondering about "Sent" vs. "Sent Messages". > > > IIRC, at least some versions of Exchange use(d) "Sent Items". Certainly mine does, although I couldn't tell you which version. But then I've never seen an Exchange server that doesn't use that. Simon From tss at iki.fi Wed Dec 7 01:14:14 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 07 Dec 2011 01:14:14 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> Message-ID: <1323213254.15365.13.camel@hurina> On Tue, 2011-12-06 at 18:02 -0500, Simon Brereton wrote: > >>> > * "Sent" is used by Thunderbird, Evolution > >>> > * "Sent Messages" is used by Apple Mail > >>> > > >>> > So I'm mainly wondering about "Sent" vs. "Sent Messages". > > > > > > IIRC, at least some versions of Exchange use(d) "Sent Items". > > Certainly mine does, although I couldn't tell you which version. But > then I've never seen an Exchange server that doesn't use that. Exchange doesn't matter, but Outlook does. Does Outlook with IMAP also use "Sent Items" by default? From simon.brereton at buongiorno.com Wed Dec 7 01:30:05 2011 From: simon.brereton at buongiorno.com (Simon Brereton) Date: Tue, 6 Dec 2011 18:30:05 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323213254.15365.13.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> <1323213254.15365.13.camel@hurina> Message-ID: On 6 December 2011 18:14, Timo Sirainen wrote: > On Tue, 2011-12-06 at 18:02 -0500, Simon Brereton wrote: >> >>> > ?* "Sent" is used by Thunderbird, Evolution >> >>> > ?* "Sent Messages" is used by Apple Mail >> >>> > >> >>> > So I'm mainly wondering about "Sent" vs. "Sent Messages". >> > >> > >> > IIRC, at least some versions of Exchange use(d) "Sent Items". >> >> Certainly mine does, although I couldn't tell you which version. ?But >> then I've never seen an Exchange server that doesn't use that. > > Exchange doesn't matter, but Outlook does. Does Outlook with IMAP also > use "Sent Items" by default? It would appear to. But then I have a weird set-up, so may be it doesn't. On the Outlook I use at Work with Gmail a Sent Items is present. At home, with dovecot, it is not. Simon From robert at schetterer.org Wed Dec 7 08:45:53 2011 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 07 Dec 2011 07:45:53 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> Message-ID: <4EDF0BA1.605@schetterer.org> Am 06.12.2011 23:48, schrieb Michael M Slusarz: > Quoting Timo Sirainen : > >> On Tue, 2011-12-06 at 23:26 +0100, Patrick Ben Koetter wrote: >>> > I'm anyway now wondering what the defaults should be? Could someone >>> > check what these defaults are for Outlook and any other clients you >>> > have: >>> > >>> > * "Drafts" is used by all clients >>> > * "Trash" is used by all clients >>> > * "Junk" is used by all clients? Or is "Spam" used by some? > > 'Spam' is also used. This one is probably a bit more site-specific. > >>> > * "Sent" is used by Thunderbird, Evolution >>> > * "Sent Messages" is used by Apple Mail >>> > >>> > So I'm mainly wondering about "Sent" vs. "Sent Messages". > > IIRC, at least some versions of Exchange use(d) "Sent Items". at last , at now there is no way at outlook 2010 to configure default imap junk folder ( only with reg patches, or filters ) cause this folder is special used by some antispam detection internal outlook,i guess, hope this may change by MS someday > >> This way whichever mailbox the first client creates would be used as >> \Sent. Although if different clients create both of them there would >> then be two \Sent mailboxes. But the user would probably delete one of >> them and all would be good again. > > This will continue to be an issue until more clients support the RFC. > > michael > -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From robert at schetterer.org Wed Dec 7 08:48:34 2011 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 07 Dec 2011 07:48:34 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <20111206222608.GC2292@state-of-mind.de> <1323210956.15365.11.camel@hurina> <20111206154838.Horde.8pU5TIF5lbhO3pvGQcUkOoA@bigworm.curecanti.org> <1323213254.15365.13.camel@hurina> Message-ID: <4EDF0C42.800@schetterer.org> Am 07.12.2011 00:30, schrieb Simon Brereton: > On 6 December 2011 18:14, Timo Sirainen wrote: >> On Tue, 2011-12-06 at 18:02 -0500, Simon Brereton wrote: >>>>>>> * "Sent" is used by Thunderbird, Evolution >>>>>>> * "Sent Messages" is used by Apple Mail >>>>>>> >>>>>>> So I'm mainly wondering about "Sent" vs. "Sent Messages". >>>> >>>> >>>> IIRC, at least some versions of Exchange use(d) "Sent Items". >>> >>> Certainly mine does, although I couldn't tell you which version. But >>> then I've never seen an Exchange server that doesn't use that. >> >> Exchange doesn't matter, but Outlook does. Does Outlook with IMAP also >> use "Sent Items" by default? > > It would appear to. But then I have a weird set-up, so may be it > doesn't. On the Outlook I use at Work with Gmail a Sent Items is > present. At home, with dovecot, it is not. > > Simon there is no outlook, speak of outlook versions and patchlevels, outlook versions are much different ! i would only concentrate only on the newest version -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From janfrode at tanso.net Wed Dec 7 12:11:43 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Wed, 7 Dec 2011 11:11:43 +0100 Subject: [Dovecot] master user only for sieve Message-ID: <20111207101143.GA19363@dibs.tanso.net> Changes in SOGo is forcing me to define a master user, so that SOGo can disable sieve out-of-office processing on a given date. I'm not too happy about having master users that are allowed to read the users messages, so is it possible to define a master user that can only log in trough manage-sieve? -jf From Yann.Dupont at univ-nantes.fr Wed Dec 7 12:25:20 2011 From: Yann.Dupont at univ-nantes.fr (Yann Dupont) Date: Wed, 07 Dec 2011 11:25:20 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> Message-ID: <4EDF3F10.1090604@univ-nantes.fr> Le 05/12/2011 02:45, Timo Sirainen a ?crit : > On 5.12.2011, at 3.03, Stan Hoeppner wrote: > >> To cope with catastrophic failure, create a "special" Dovecot >> administrator only mailbox (real/virtual/whatever) that "contains" all >> of the SiS files, a special Dovecot index. > > I'm not thinking about a catastrophe. For that a regular full filesystem backup+restore would work mostly okay (a snapshot would be perfect, without snapshot some extra work would be needed). The problem is that people want to recover only one specific user's mails from some older backup, because they accidentally deleted the mails.. This needs to be somewhat easy to implement with SIS, but it isn't. > > Other problem I'm thinking of, because I'd like to use SIS on our production servers ; but right now I think I can't . We have lots of users (+5000 teachers/engineers) on our first setup, +70000 students on our 2nd setup. The user base is on LDAP, and move on a daily basis. When a user leave the university, he has right to use mailbox for a certain time and then we close the account. Right now, we archive and then delete the mailbox directories (we don't use special dovecot mecanism : we migrated from another system not long time ago and we had special scripts for that). If we use SIS, what happen to the attachements ? The usage count will never go to 0, and the attachements will stay there forever. In that situation, I think we have no means to correct the attachement usage count ? -- Yann Dupont - Service IRTS, DSI Universit? de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont at univ-nantes.fr From Yann.Dupont at univ-nantes.fr Wed Dec 7 13:02:22 2011 From: Yann.Dupont at univ-nantes.fr (Yann Dupont) Date: Wed, 07 Dec 2011 12:02:22 +0100 Subject: [Dovecot] problems when using dsync between servers Message-ID: <4EDF47BE.8080703@univ-nantes.fr> Hello, I'm trying to migrate from maildir++ to mdbox. The maildir++ is a leftover of our previous setup (was using courier) We have 3 virtuals servers for our +70000 accounts. Now, I'd like to use mdbox, so I'm trying using dsync for that. I setup a new virtual server, configured for mdbox. 1st, I tried a basic setup: I established a file with all my accounts (taken from LDAP) and then I use this script : FILENAME=$1 while read LINE do dsync -u $LINE backup $LINE at my_new_server done < $FILENAME But it's quite slow and dsync hangs. So I tried another approach using multi threaded python. Much faster (using all the cores), but dsync still hangs on some accounts. After a certain time dsync exit with an error like that : Panic: file dsync-worker-local.c: line 1688 (local_worker_save_msg_continue): assertion failed: (ret == -1) dsync-remote(E072184L): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x3fd8a) [0x7f34fc577d8a] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f34fc577e72] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f34fc55119f] -> dsync() [0x40ff0b] -> dsync() [0x410142] -> dsync(dsync_worker_msg_save+0x99) [0x40f639] -> dsync() [0x40e24a] -> dsync() [0x40d8ef] -> dsync() [0x40dbfc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x48) [0x7f34fc5830d8] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f34fc58403f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f34fc583068] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f34fc5713a3] -> dsync(main+0x9e1) [0x4078b1] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f34fbde9c4d] -> dsync() [0x406cf9] This is on a RUNNNING server. My aim was to make some pass on the running server, then stop it and make a last pass to finish the process. Is dsync supposed to run only on a stopped server ? Is my approach totally wrong ? -- Yann Dupont - Service IRTS, DSI Universit? de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont at univ-nantes.fr From stephan at rename-it.nl Wed Dec 7 13:32:21 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 07 Dec 2011 12:32:21 +0100 Subject: [Dovecot] master user only for sieve In-Reply-To: <20111207101143.GA19363@dibs.tanso.net> References: <20111207101143.GA19363@dibs.tanso.net> Message-ID: <4EDF4EC5.9000302@rename-it.nl> Op 7-12-2011 11:11, Jan-Frode Myklebust schreef: > Changes in SOGo is forcing me to define a master user, so that SOGo can > disable sieve out-of-office processing on a given date. I'm not too > happy about having master users that are allowed to read the users > messages, so is it possible to define a master user that can only log in > trough manage-sieve? I must say I don't really know about that. However, I do have a suggestion for a different approach. You can define a vacation response action with an expiry date, as follows: require ["date", "relational", "vacation"]; if currentdate :value "le" "date" "2011-12-09" { vacation "I'm out of office this week. I'll be back on Saturday 10th to reply to your e-mails."; } This means that there is no need to remove the vacation rule explicitly. It is inactive and can be removed at a (much) later time. You can also plan vacation responses in the future using the same method. Of course, the question is whether the SoGo GUI supports something like this, but I think it should. Regards, Stephan. From janfrode at tanso.net Wed Dec 7 13:57:13 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Wed, 7 Dec 2011 12:57:13 +0100 Subject: [Dovecot] master user only for sieve In-Reply-To: <4EDF4EC5.9000302@rename-it.nl> References: <20111207101143.GA19363@dibs.tanso.net> <4EDF4EC5.9000302@rename-it.nl> Message-ID: <20111207115713.GA21832@dibs.tanso.net> On Wed, Dec 07, 2011 at 12:32:21PM +0100, Stephan Bosch wrote: > > However, I do have a suggestion for a different approach. You can > define a vacation response action with an expiry date, as follows: > > require ["date", "relational", "vacation"]; > > if currentdate :value "le" "date" "2011-12-09" { > vacation "I'm out of office this week. I'll be back on > Saturday 10th to reply to your e-mails."; > } Thanks! I was looking for something like this, but don't know sieve enough to find it myself. This is a much nicer approach. I'll suggest it to the sogo developers. -jf From CMarcus at Media-Brokers.com Wed Dec 7 13:46:26 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 07 Dec 2011 06:46:26 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323209634.15365.6.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> Message-ID: <4EDF5212.7070501@Media-Brokers.com> On 2011-12-06 5:13 PM, Timo Sirainen wrote: > * "Trash" is used by all clients Outlook uses 'Deleted Items', not 'Trash'... -- Best regards, Charles From ef at math.uni-bonn.de Wed Dec 7 13:47:14 2011 From: ef at math.uni-bonn.de (Edgar =?iso-8859-1?B?RnXf?=) Date: Wed, 7 Dec 2011 12:47:14 +0100 Subject: [Dovecot] master user only for sieve In-Reply-To: <20111207101143.GA19363@dibs.tanso.net> References: <20111207101143.GA19363@dibs.tanso.net> Message-ID: <20111207114714.GF25413@gumme.math.uni-bonn.de> I have the following for 1.2. You may search the list archive, I asked that question about halv a year ago and Timo answererd it for both 1.2 and 2.0. auth default { [...] # Master-Benutzer f?r Sieve. # Wirkt nur f?r Sieve, weil es master.imap und master.pop nicht gibt. passdb passwd-file { master = yes args = DOVECOT_CONFDIR/master.%s # kein pass = yes, weil das bei LDAP-Authentication-Binds nicht geht. } [...] } And a master.sieve file containing sievemaster:{SHA}...... From CMarcus at Media-Brokers.com Wed Dec 7 14:08:42 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 07 Dec 2011 07:08:42 -0500 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EDF3F10.1090604@univ-nantes.fr> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> <4EDF3F10.1090604@univ-nantes.fr> Message-ID: <4EDF574A.3060100@Media-Brokers.com> On 2011-12-07 5:25 AM, Yann Dupont wrote: > > Right now, we archive and then delete the mailbox directories (we don't > use special dovecot mecanism : we migrated from another system not long > time ago and we had special scripts for that). > > If we use SIS, what happen to the attachements ? The usage count will > never go to 0, and the attachements will stay there forever. ? Attachment count for any messages that were *only* in those deleted mailbox directories would go to zero after you delete them, and then the attachments would be deleted. Dovecot wouldn't know about any that were archived outside of dovecots knowledge. -- Best regards, Charles From arne at drlinux.no Wed Dec 7 15:28:18 2011 From: arne at drlinux.no (Arne K. Haaje) Date: Wed, 07 Dec 2011 14:28:18 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDE9DFC.4010101@carpenter.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> Message-ID: <2028924.r07FOCeGlj@trillian> Tirsdag 6. desember 2011 14.58.04 skrev WJCarpenter: > > On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > > > > I'm anyway now wondering what the defaults should be? Could someone > > check what these defaults are for Outlook and any other clients you > > > > have: > > * "Drafts" is used by all clients > > * "Trash" is used by all clients > > * "Junk" is used by all clients? Or is "Spam" used by some? > > * "Sent" is used by Thunderbird, Evolution > > * "Sent Messages" is used by Apple Mail > > SquirrelMail (http://www.squirrelmail.org) and Hastymail2 > (http://www.hastymail.org) webmail clients let you customize > draft/trash/sent, but the defaults for both are Drafts, Trash, and Sent. Thunderbird also use a Templates folder. Arne -- Arne K. Haaje - Dr Linux http://www.drlinux.no/ LinkedIn: http://no.linkedin.com/pub/arne-haaje/27/189/bb From user+dovecot at localhost.localdomain.org Wed Dec 7 15:55:09 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Wed, 07 Dec 2011 14:55:09 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <2028924.r07FOCeGlj@trillian> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> <2028924.r07FOCeGlj@trillian> Message-ID: <4EDF703D.2090505@localhost.localdomain.org> On 12/07/2011 02:28 PM Arne K. Haaje wrote: > Thunderbird also use a Templates folder. Yes, I also noticed that. But http://tools.ietf.org/html/rfc6154#section-2 doesn't mention a mailbox for templates. Regards, Pascal -- The trapper recommends today: face1e55.1134114 at localdomain.org From tss at iki.fi Wed Dec 7 16:15:35 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 7 Dec 2011 16:15:35 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EDF3F10.1090604@univ-nantes.fr> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> <4EDF3F10.1090604@univ-nantes.fr> Message-ID: On 7.12.2011, at 12.25, Yann Dupont wrote: > Other problem I'm thinking of, because I'd like to use SIS on our production servers ; but right now I think I can't . > > We have lots of users (+5000 teachers/engineers) on our first setup, +70000 students on our 2nd setup. > > The user base is on LDAP, and move on a daily basis. When a user leave the university, he has right to use mailbox for a certain time and then we close the account. > > Right now, we archive and then delete the mailbox directories (we don't use special dovecot mecanism : we migrated from another system not long time ago and we had special scripts for that). > > If we use SIS, what happen to the attachements ? The usage count will never go to 0, and the attachements will stay there forever. > > In that situation, I think we have no means to correct the attachement usage count ? You'll need to change the deletion script then. Run: doveadm expunge -u user mailbox '*' all before doing rm -rf for the user's mails. And in the archiving step you should do it with dsync with mail_attachment_dir disabled in the destination storage, so the the attachments get written to the archive directly instead of only referencing SIS. From tss at iki.fi Wed Dec 7 16:22:01 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 7 Dec 2011 16:22:01 +0200 Subject: [Dovecot] v2.x services documentation Message-ID: <04D662E7-2A0A-448B-BA21-1E337A400CA6@iki.fi> If you've ever wanted to know everything about the service {} blocks, this should be quite helpful: http://wiki2.dovecot.org/Services From p at state-of-mind.de Wed Dec 7 16:35:00 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 7 Dec 2011 15:35:00 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDF703D.2090505@localhost.localdomain.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> <2028924.r07FOCeGlj@trillian> <4EDF703D.2090505@localhost.localdomain.org> Message-ID: <20111207143500.GB5185@state-of-mind.de> * Pascal Volk : > On 12/07/2011 02:28 PM Arne K. Haaje wrote: > > Thunderbird also use a Templates folder. > > Yes, I also noticed that. But > http://tools.ietf.org/html/rfc6154#section-2 doesn't mention a mailbox > for templates. IIRC IETF allows to register new SPECIAL-USE mailboxes. 'templates' might be a good candidate. p at rick -- state of mind () Digitale Kommunikation http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From robert at schetterer.org Wed Dec 7 16:49:20 2011 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 07 Dec 2011 15:49:20 +0100 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <20111207143500.GB5185@state-of-mind.de> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> <2028924.r07FOCeGlj@trillian> <4EDF703D.2090505@localhost.localdomain.org> <20111207143500.GB5185@state-of-mind.de> Message-ID: <4EDF7CF0.2030403@schetterer.org> Am 07.12.2011 15:35, schrieb Patrick Ben Koetter: > * Pascal Volk : >> On 12/07/2011 02:28 PM Arne K. Haaje wrote: >>> Thunderbird also use a Templates folder. >> >> Yes, I also noticed that. But >> http://tools.ietf.org/html/rfc6154#section-2 doesn't mention a mailbox >> for templates. > > IIRC IETF allows to register new SPECIAL-USE mailboxes. 'templates' might be a > good candidate. > > p at rick > TB also has a archives folder as default -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From CMarcus at Media-Brokers.com Wed Dec 7 17:02:52 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 07 Dec 2011 10:02:52 -0500 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDF703D.2090505@localhost.localdomain.org> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDE9DFC.4010101@carpenter.org> <2028924.r07FOCeGlj@trillian> <4EDF703D.2090505@localhost.localdomain.org> Message-ID: <4EDF801C.9090508@Media-Brokers.com> On 2011-12-07 8:55 AM, Pascal Volk wrote: > On 12/07/2011 02:28 PM Arne K. Haaje wrote: >> > Thunderbird also use a Templates folder. > Yes, I also noticed that. But > http://tools.ietf.org/html/rfc6154#section-2 doesn't mention a mailbox > for templates. Nevertheless, it is very handy functionality... it isn't just a folder. -- Best regards, Charles From sacha.xxxx at omnitechweb.it Wed Dec 7 16:02:23 2011 From: sacha.xxxx at omnitechweb.it (Sacha xxxx) Date: Wed, 7 Dec 2011 15:02:23 +0100 Subject: [Dovecot] dovecot 2.0 sieve if working, managesieve not. Message-ID: <9DD2BA39-3F7E-4612-8A8F-37967E4491C4@omnitechweb.it> Hi, this is my configuration # OS: Linux 2.6.32-131.0.15.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.1 (Santiago) ext4 auth_debug = yes auth_master_user_separator = * auth_username_format = %Lu auth_verbose = yes disable_plaintext_auth = no info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Dovecot ready mail_debug = yes mail_gid = 999 mail_home = /MAIL/%d/%n/ mail_location = maildir:/MAIL/%d/%n/ mail_log_prefix = "%Us(%u): " mail_plugins = " quota" mail_privileged_group = mail mail_uid = 999 passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes pass = yes } plugin { quota = maildir:User quota quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/sieve/dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve service auth { unix_listener auth-userdb { group = mail mode = 0660 user = postfix } } service managesieve-login { executable = /usr/libexec/dovecot/managesieve-login inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = mail mode = 0666 user = mail } user = mail } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.user driver = ldap } doveconf: Error: protocols: Unknown protocol: sieve doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: protocols: Unknown protocol: sieve I get the error Unknown protocol: sieve The installed rpm package is this: dovecot-2.0.9-2.el6.x86_64 The sieve filtering is working: 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: opening script /MAIL/***/user//sieve/dovecot.sieve 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: script /MAIL/***/user//sieve/dovecot.sieve successfully compiled 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: executing script from /MAIL/***/utente01//sieve/dovecot.sieve 2011-12-07 12:12:29 LDA(utente01@***): Info: sieve: msgid=<4EDF4A1C.9010509@***>: stored mail into mailbox 'INBOX' But the manage sieve won't work. It seems that pigeonhole is installed because /usr/libexec/dovecot/managesieve-login exist and is not empty. Can you help me? Thank You Sushi. From wgillespie+dovecot at es2eng.com Wed Dec 7 17:45:31 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Wed, 07 Dec 2011 08:45:31 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <1323209634.15365.6.camel@hurina> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> Message-ID: <4EDF8A1B.3050105@es2eng.com> On 12/06/2011 03:13 PM, Timo Sirainen wrote: > On Fri, 2011-12-02 at 17:12 +0200, Timo Sirainen wrote: > >> The mailbox names require a namespace prefix, so if you use e.g. "INBOX." prefix you'll need to use: > > I changed these so that they are inside namespace {} section and don't > require namespace prefix in the name. That way I can include common > mailbox definitions in example-config and still allow the namespace > prefix to be easily changed. > > I'm anyway now wondering what the defaults should be? Could someone > check what these defaults are for Outlook and any other clients you > have: > > * "Drafts" is used by all clients > * "Trash" is used by all clients > * "Junk" is used by all clients? Or is "Spam" used by some? > * "Sent" is used by Thunderbird, Evolution > * "Sent Messages" is used by Apple Mail > > So I'm mainly wondering about "Sent" vs. "Sent Messages". Outlook 2010 lets you select a mailbox for Trash and Sent (version 2007 only lets you select a mailbox for Sent messages). Outlook default names for Trash is "Deleted Items" (as someone pointed out) and for junk is "Junk E-mail". Willie From tss at iki.fi Wed Dec 7 17:56:24 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 7 Dec 2011 17:56:24 +0200 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: <4EDF8A1B.3050105@es2eng.com> References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDF8A1B.3050105@es2eng.com> Message-ID: On 7.12.2011, at 17.45, Willie Gillespie wrote: > Outlook 2010 lets you select a mailbox for Trash and Sent (version 2007 only lets you select a mailbox for Sent messages). > Outlook default names for Trash is "Deleted Items" (as someone pointed out) and for junk is "Junk E-mail". And the default name for Sent is "Sent Items"? Wonder if I should add those also to the example config.. From Yann.Dupont at univ-nantes.fr Wed Dec 7 18:02:51 2011 From: Yann.Dupont at univ-nantes.fr (Yann Dupont) Date: Wed, 07 Dec 2011 17:02:51 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> <4EDF3F10.1090604@univ-nantes.fr> Message-ID: <4EDF8E2B.7020204@univ-nantes.fr> Le 07/12/2011 15:15, Timo Sirainen a ?crit : > On 7.12.2011, at 12.25, Yann Dupont wrote: > doveadm expunge -u user mailbox '*' all > > before doing rm -rf for the user's mails. And in the archiving step you should do it with dsync with mail_attachment_dir disabled in the destination storage, so the the attachments get written to the archive directly instead of only referencing SIS. > > Yes, I understand, it will work. But, if case of any error (even our fault : premature end of script, for example) you can still end up with attachement forever lost on the filesystem. Right, it SHOULD not happen, and it probably won't represent a big volume. But Still, it could happen under specific circonstances. In that case, I don't see any simple way to detect that kind of files ? Do you see how a script could detect some orphaned links ?? For the archiving, good idea to use dsync, thanks for your answer. -- Yann Dupont - Service IRTS, DSI Universit? de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont at univ-nantes.fr From Juergen.Obermann at hrz.uni-giessen.de Wed Dec 7 18:12:03 2011 From: Juergen.Obermann at hrz.uni-giessen.de (=?iso-8859-1?b?SvxyZ2Vu?= Obermann) Date: Wed, 07 Dec 2011 17:12:03 +0100 Subject: [Dovecot] lazy_expunge plugin and folder subscription trouble Message-ID: <20111207171203.32263dknm9tyodgc@webmail.hrz.uni-giessen.de> Hello, I wanted to test the lazy expunge plugin together with mdbox. It seems to me that the folder subscriptions file in the mdbox directory was overwritten with only a few folder names every time I added or removed something in the list of subscribed folders, or even if I turned the imap folder subscription feature off and on. Here is my setup: # 2.0.16: /opt/local/etc/dovecot/dovecot.conf # OS: SunOS 5.10 sun4v mail_location = mdbox:~/mdbox mail_plugins = mail_log notify quota lazy_expunge zlib mdbox_rotate_interval = 1 days mdbox_rotate_size = 16 M namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes list = no location = prefix = Mail/ separator = / subscriptions = yes type = private } namespace { location = maildir:/var/mail/public:CONTROL=~/Maildir/public:INDEX=~/Maildir/public prefix = Public/ separator = / subscriptions = no type = public } namespace { location = mdbox:~/mdbox:MAILBOXDIR=expunged prefix = .EXPUNGED/ separator = / } plugin { autocreate = Trash autocreate2 = caughtspam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = caughtspam autosubscribe3 = Sent autosubscribe4 = Drafts fts = squat lazy_expunge = .EXPUNGED/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = fs:Home-Verzeichnis:noenforcing sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 3 } protocols = imap pop3 lmtp sieve quota_full_tempfail = yes sendmail_path = /usr/lib/sendmail service auth { client_limit = 11120 } service imap-login { process_min_avail = 16 service_count = 0 vsz_limit = 640 M } service imap { process_limit = 4096 vsz_limit = 1 G } ssl_cert = refcount > 0) Message-ID: <4EDF9185.7060805@localhost.localdomain.org> Hi Timo, right after delivering the message to the INBOX the lmtp crashes. I wonder about the "Sent" in the attached backtrace. Regards, Pascal -- The trapper recommends today: c01dcofe.1134117 at localdomain.org -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: doveconf.txt URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: lmtp.bt URL: From wgillespie+dovecot at es2eng.com Wed Dec 7 18:29:20 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Wed, 07 Dec 2011 09:29:20 -0700 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: <0CA763CB-438C-441D-8EF6-ED1A7B4BB7ED@iki.fi> <1323209634.15365.6.camel@hurina> <4EDF8A1B.3050105@es2eng.com> Message-ID: <4EDF9460.4060409@es2eng.com> On 12/07/2011 08:56 AM, Timo Sirainen wrote: > On 7.12.2011, at 17.45, Willie Gillespie wrote: > >> Outlook 2010 lets you select a mailbox for Trash and Sent (version 2007 only lets you select a mailbox for Sent messages). >> Outlook default names for Trash is "Deleted Items" (as someone pointed out) and for junk is "Junk E-mail". > > And the default name for Sent is "Sent Items"? Yes From sacha.xxxx at omnitechweb.it Wed Dec 7 18:31:29 2011 From: sacha.xxxx at omnitechweb.it (Sacha xxxx) Date: Wed, 7 Dec 2011 17:31:29 +0100 Subject: [Dovecot] dovecot 2.0 sieve if working, managesieve not. In-Reply-To: <9DD2BA39-3F7E-4612-8A8F-37967E4491C4@omnitechweb.it> References: <9DD2BA39-3F7E-4612-8A8F-37967E4491C4@omnitechweb.it> Message-ID: I solved installing dovecot-pigeonhole-2.0.9-2.el6.x86_64.rpm Thank you Il giorno 07/dic/2011, alle ore 15:02, Sacha xxxx ha scritto: > Hi, > this is my configuration > > # OS: Linux 2.6.32-131.0.15.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.1 (Santiago) ext4 > auth_debug = yes > auth_master_user_separator = * > auth_username_format = %Lu > auth_verbose = yes > disable_plaintext_auth = no > info_log_path = /var/log/dovecot-info.log > log_path = /var/log/dovecot.log > log_timestamp = "%Y-%m-%d %H:%M:%S " > login_greeting = Dovecot ready > mail_debug = yes > mail_gid = 999 > mail_home = /MAIL/%d/%n/ > mail_location = maildir:/MAIL/%d/%n/ > mail_log_prefix = "%Us(%u): " > mail_plugins = " quota" > mail_privileged_group = mail > mail_uid = 999 > passdb { > args = /etc/dovecot/dovecot-ldap.conf > driver = ldap > } > passdb { > args = /etc/dovecot/passwd.masterusers > driver = passwd-file > master = yes > pass = yes > } > plugin { > quota = maildir:User quota > quota_warning = storage=95%% quota-warning 95 %u > quota_warning2 = storage=80%% quota-warning 80 %u > sieve = ~/sieve/dovecot.sieve > sieve_dir = ~/sieve > } > protocols = imap pop3 sieve > service auth { > unix_listener auth-userdb { > group = mail > mode = 0660 > user = postfix > } > } > service managesieve-login { > executable = /usr/libexec/dovecot/managesieve-login > inet_listener sieve { > port = 4190 > } > } > service quota-warning { > executable = script /usr/local/bin/quota-warning.sh > unix_listener quota-warning { > group = mail > mode = 0666 > user = mail > } > user = mail > } > ssl = no > userdb { > args = /etc/dovecot/dovecot-ldap.user > driver = ldap > } > doveconf: Error: protocols: Unknown protocol: sieve > doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: protocols: Unknown protocol: sieve > > I get the error Unknown protocol: sieve > > The installed rpm package is this: > dovecot-2.0.9-2.el6.x86_64 > > The sieve filtering is working: > > 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: opening script /MAIL/***/user//sieve/dovecot.sieve > 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: script /MAIL/***/user//sieve/dovecot.sieve successfully compiled > 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: executing script from /MAIL/***/utente01//sieve/dovecot.sieve > 2011-12-07 12:12:29 LDA(utente01@***): Info: sieve: msgid=<4EDF4A1C.9010509@***>: stored mail into mailbox 'INBOX' > > But the manage sieve won't work. > It seems that pigeonhole is installed because /usr/libexec/dovecot/managesieve-login exist and is not empty. > > Can you help me? > > Thank You > > Sushi. > Sacha xxxx Security Consultant ----------------------------------------------------------------- xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxx Questo messaggio ? destinato alle sole persone indicate e pu? contenere informazioni riservate. Se ricevuto per errore, si prega di avvisare immediatam From listen at constabel.net Wed Dec 7 19:05:05 2011 From: listen at constabel.net (Mike Constabel) Date: Wed, 7 Dec 2011 18:05:05 +0100 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts Message-ID: <20111207170505.GI22136@herakles.constabel-it.de> Hi, if I try to crate a folder in Thunderbird 8 which contains umlauts this happens: - Create folder "T?r" - Thunderbird show T&APw-r in folder list In log: Dec 07 17:45:39 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 # ll /mailspool1/in-preetz.de/test1/mdbox/mailboxes/ insgesamt 32K drwx------ 8 vmail vmail 4,0K 7. Dez 17:45 . drwx------ 4 vmail vmail 4,0K 7. Dez 17:45 .. drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Drafts drwx------ 3 vmail vmail 4,0K 29. Nov 11:04 INBOX drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Junk drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Sent drwx------ 3 vmail vmail 4,0K 7. Dez 17:45 T&APw-r drwx------ 4 vmail vmail 4,0K 7. Dez 17:44 Trash If I click in TB on the folder, TB gives an empty message, the log shows: Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: Effective uid=1000, gid=1000, home=/mailspool1/in-preetz.de/test1 Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: quota: No quota setting - plugin disabled Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mdbox Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: fs: root=/mailspool1/in-preetz.de/test1/mdbox, index=, control=, inbox=, alt= Dec 07 17:42:53 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:43:02 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/&ANY-de doesn't exist yet, using default permissions Dec 07 17:43:02 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:44:19 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/&-ANY-de doesn't exist yet, using default permissions Dec 07 17:44:19 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:44:19 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/Trash/&-ANY-de doesn't exist yet, using default permissions Dec 07 17:44:24 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/Trash/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1 at in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1 at in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 On another server with # 2.0.13 (537d4b6d9a7a): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.2 an an server with # 1.2.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 5.0.9 umlauts are working. Is there an problem with my config or with the rc1? thanks, Mike dovecot -n for not working 2.1.rc1: # 2.1.rc1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 6.0.3 auth_cache_size = 1 M auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login cram-md5 auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot/dovecot-debug.log default_client_limit = 2600 disable_plaintext_auth = no hostname = mx4.constabel-it.de info_log_path = /var/log/dovecot/dovecot-info.log log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_location = mdbox:~/mdbox mail_plugins = quota notify mail_log mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = prefix = separator = / type = private } passdb { args = scheme=PLAIN username_format=%u /etc/imap.userdb driver = passwd-file } plugin { autocreate = Trash autocreate2 = Junk autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Sent autosubscribe4 = Drafts sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at localhost protocols = " imap lmtp sieve pop3" service auth { inet_listener { address = 192.168.10.117 port = 12345 } } service imap-login { inet_listener imap { address = 192.168.10.117 port = 143 } inet_listener imaps { address = 192.168.10.117 port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = 192.168.10.117 port = 24 } } service managesieve-login { inet_listener sieve { address = 192.168.10.117 port = 4190 } } service pop3-login { inet_listener pop3 { address = 192.168.10.117 port = 110 } inet_listener pop3s { address = 192.168.10.117 port = 995 ssl = yes } } ssl_ca = I've got my users in a replicated database setup and dovecot configured with two connect lines in dovecot-sql.conf: connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass connect = host=127.0.0.2 port=3306 dbname=users user=user password=pass this works really well to help balance the load. However, when a new user is created, the replication information sometimes has not made it to the slave database before my user creation process tries to send that new user an email about their new email account. If it hasn't and the email gets sent, then it bounces because postfix thinks the user doesn't exist yet. Replication usually happens within seconds, but could be delayed due to problems. I would like a way to see if the new user's information has been replicated yet before sending the email. I was thinking I could use 'doveadm user' to lookup the user, but I am not sure that I can specify one of the specific 'connect' lines in my configuration to check. Is there a way to override that configuration variable to do this test? I tried various incarnations of passing '-o connect=host='... but doveadm user would just ignore them. thanks for any suggestions! micah ps - yes, I can make my user creation process just 'sleep' for an arbitrary amount of time and by that time the replication should have occured, but that is a bit of a shot in the dark, and doesn't handle longer replication delays that could potentially happen. -- -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 835 bytes Desc: not available URL: From mark.zealey at webfusion.com Wed Dec 7 20:38:29 2011 From: mark.zealey at webfusion.com (Mark Zealey) Date: Wed, 07 Dec 2011 20:38:29 +0200 Subject: [Dovecot] sql dict: commit failed: MySQL server has gone away Message-ID: <4EDFB2A5.9090303@webfusion.com> Following on from this thread: http://www.dovecot.org/list/dovecot/2010-September/052704.html in 2.0.16 I am seeing the same issues. I believe this would be related to some timeouts set on our mysql servers which are pretty low (30 or 60 seconds or so to drop idle connections). This is happening for imap, pop and lmtp processes when they try to update quotas stored in a mysql database; presumably it is the dict process that actually has these issues - the lmtp delivery isn't lasting longer than 1 second so shouldn't be seeing any timeouts there. This is always followed by the "Error: dict quota: Quota update failed, it's now desynced" line; presumably it is telling the truth but I'm not sure how I could tell. We are also seeing this "MySQL server has gone away" issue in login processes but it isn't causing an issue there as presumably dovecot transparently retries rather than just giving up as it seems to in the quota updates. Any thoughts or advice would be appreciated. Mark From selcuk.yazar at gmail.com Wed Dec 7 21:57:32 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Wed, 7 Dec 2011 21:57:32 +0200 Subject: [Dovecot] postlogin script Message-ID: Hi, I have Postfix + OpenLdap + DoveCot configuration, and it's running succesfuly, i wantto convert users pop3 password NTPassword and LMPassword, so i ne plain passwor dof users, how can i do that. (Normaly using perl's ntlmgen function i convert password , but in plain) thanks in advance From jtam.home at gmail.com Thu Dec 8 04:00:43 2011 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 7 Dec 2011 18:00:43 -0800 (PST) Subject: [Dovecot] doveadm fetch vs search+fetch Message-ID: What's the pactical difference between using "doveadm fetch" rather than using "doveadm search" in conjunction with "doveadm fetch", as the man pages suggest? It seems "doveadm fetch" functionally supercedes "doveadm search" making the latter obsolete. It can even be closely simulated with "doveadm -f tab fetch ... 'mailbox-guid uid' search-query ...". Joseph Tam From tss at iki.fi Thu Dec 8 05:19:42 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 05:19:42 +0200 Subject: [Dovecot] doveadm fetch vs search+fetch In-Reply-To: References: Message-ID: <1323314382.15365.45.camel@hurina> On Wed, 2011-12-07 at 18:00 -0800, Joseph Tam wrote: > What's the pactical difference between using "doveadm fetch" rather > than using "doveadm search" in conjunction with "doveadm fetch", as the > man pages suggest? > > It seems "doveadm fetch" functionally supercedes "doveadm search" > making the latter obsolete. It can even be closely simulated > with "doveadm -f tab fetch ... 'mailbox-guid uid' search-query ...". If you want to fetch message headers/bodies separately for multiple messages, then doveadm search is useful. With "doveadm fetch" you can't really know where one message ends and another one begins (although the ^L character between messages is a good indicator, it's not 100% reliable). And in any case it's more difficult to use for separating messages in a shell script. From jtam.home at gmail.com Thu Dec 8 05:56:01 2011 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 7 Dec 2011 19:56:01 -0800 (PST) Subject: [Dovecot] doveadm fetch vs search+fetch In-Reply-To: <1323314382.15365.45.camel@hurina> References: <1323314382.15365.45.camel@hurina> Message-ID: On Thu, 8 Dec 2011, Timo Sirainen wrote: >> It seems "doveadm fetch" functionally supercedes "doveadm search" >> making the latter obsolete. It can even be closely simulated >> with "doveadm -f tab fetch ... 'mailbox-guid uid' search-query ...". > > If you want to fetch message headers/bodies separately for multiple > messages, then doveadm search is useful. With "doveadm fetch" you can't > really know where one message ends and another one begins (although the > ^L character between messages is a good indicator, it's not 100% > reliable). And in any case it's more difficult to use for separating > messages in a shell script. You could use, as I suggested, doveadm -f tab fetch -u bob 'mailbox-guid uid' ... | \ while read guid uid; do ... done which pretty much does the same thing (but you have to dump the first line, ugh!). It doesn't matter all that much except some extra man page reading, but it will save you the bother of having to maintain a separate binary, man page, etc. for what is essentially a duplicate. Joseph Tam From tss at iki.fi Thu Dec 8 06:03:25 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:03:25 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EDF8E2B.7020204@univ-nantes.fr> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <4EDC1864.60703@hardwarefreak.com> <4EDF3F10.1090604@univ-nantes.fr> <4EDF8E2B.7020204@univ-nantes.fr> Message-ID: <1323317006.15365.52.camel@hurina> On Wed, 2011-12-07 at 17:02 +0100, Yann Dupont wrote: > > before doing rm -rf for the user's mails. And in the archiving step you should do it with dsync with mail_attachment_dir disabled in the destination storage, so the the attachments get written to the archive directly instead of only referencing SIS. > > > Yes, I understand, it will work. But, if case of any error (even our > fault : premature end of script, for example) you can still end up with > attachement forever lost on the filesystem. > > Right, it SHOULD not happen, and it probably won't represent a big > volume. But Still, it could happen under specific circonstances. In that > case, I don't see any simple way to detect that kind of files ? > > Do you see how a script could detect some orphaned links ?? It wouldn't be simple. The only safe way would be to: 1. Scan through all the attachment HASH-GUID names and save them. This scanning step could already detect some orphaned attachments, where the hashes/HASH file exists with nlink=1 (i.e. HASH-GUID* files have been deleted, but the HASH itself hasn't been for some reason). 2. Read through all users' all dboxes contents and get a list of all referenced attachment HASH-GUIDs. 3. Delete all attachments that exist in list 1, but not in list 2. I guess there should be a "doveadm sis rescan" command that does this. From tss at iki.fi Thu Dec 8 06:11:44 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:11:44 +0200 Subject: [Dovecot] 2.1.rc1 (1e118913348b): Panic: file mail-user.c: line 128 (mail_user_ref): assertion failed: (user->refcount > 0) In-Reply-To: <4EDF9185.7060805@localhost.localdomain.org> References: <4EDF9185.7060805@localhost.localdomain.org> Message-ID: <1323317504.15365.53.camel@hurina> On Wed, 2011-12-07 at 17:17 +0100, Pascal Volk wrote: > right after delivering the message to the INBOX the lmtp crashes. > I wonder about the "Sent" in the attached backtrace. http://hg.dovecot.org/dovecot-2.1/rev/3b70254e0596 should fix it. From tss at iki.fi Thu Dec 8 06:13:40 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:13:40 +0200 Subject: [Dovecot] doveadm fetch vs search+fetch In-Reply-To: References: <1323314382.15365.45.camel@hurina> Message-ID: <1323317620.15365.55.camel@hurina> On Wed, 2011-12-07 at 19:56 -0800, Joseph Tam wrote: > > If you want to fetch message headers/bodies separately for multiple > > messages, then doveadm search is useful. With "doveadm fetch" you can't > > really know where one message ends and another one begins (although the > > ^L character between messages is a good indicator, it's not 100% > > reliable). And in any case it's more difficult to use for separating > > messages in a shell script. > > You could use, as I suggested, > > doveadm -f tab fetch -u bob 'mailbox-guid uid' ... | \ Oh, you meant this. > while read guid uid; do > ... > done > > which pretty much does the same thing (but you have to dump the first > line, ugh!). It doesn't matter all that much except some extra man > page reading, but it will save you the bother of having to maintain a > separate binary, man page, etc. for what is essentially a duplicate. Yeah, but it's more effort to remove it than to keep it as it is :) Also a "search" is somewhat simpler and prettier to use. From tss at iki.fi Thu Dec 8 06:18:17 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:18:17 +0200 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <20111207170505.GI22136@herakles.constabel-it.de> References: <20111207170505.GI22136@herakles.constabel-it.de> Message-ID: <1323317897.15365.58.camel@hurina> On Wed, 2011-12-07 at 18:05 +0100, Mike Constabel wrote: > if I try to crate a folder in Thunderbird 8 which contains > umlauts this happens: > > - Create folder "T?r" > - Thunderbird show T&APw-r in folder list I can't reproduce. Is it possible this is a TB bug? Try talking IMAP protocol directly: /usr/local/libexec/dovecot/imap -u user at domain a list "" T* If it lists: * LIST (\HasNoChildren) "." "T&APw-r" Then Dovecot is working correctly. > drwx------ 3 vmail vmail 4,0K 7. Dez 17:45 T&APw-r This is correct. > On another server with > > # 2.0.13 (537d4b6d9a7a): /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-5-686 i686 Debian 6.0.2 > > an an server with > > # 1.2.16: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 5.0.9 > > umlauts are working. It wouldn't be impossible for TB to be simply confused with this setup for some reason :) From tss at iki.fi Thu Dec 8 06:22:58 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 06:22:58 +0200 Subject: [Dovecot] overriding userdb connection host for doveadm-user In-Reply-To: <87aa742rbo.fsf@algae.riseup.net> References: <87aa742rbo.fsf@algae.riseup.net> Message-ID: <1323318179.15365.62.camel@hurina> On Wed, 2011-12-07 at 13:02 -0500, Micah Anderson wrote: > I've got my users in a replicated database setup and dovecot configured > with two connect lines in dovecot-sql.conf: > > connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass > connect = host=127.0.0.2 port=3306 dbname=users user=user password=pass > > this works really well to help balance the load. If you actually have it like that, it should only be using 127.0.0.2, as the second connect setting overrides the first one.. The right way would have been: connect = host=127.0.0.1 host=127.0.0.2 port=... > I would like a way to see if the new user's information has been > replicated yet before sending the email. I was thinking I could use > 'doveadm user' to lookup the user, but I am not sure that I can specify > one of the specific 'connect' lines in my configuration to check. Is > there a way to override that configuration variable to do this test? I > tried various incarnations of passing '-o connect=host='... but doveadm > user would just ignore them. doveadm does the lookup via auth-userdb socket. You have two possibilities: a) Have doveadm use another auth-userdb socket that points to another dovecot installation with different configuration. b) Use a different userdb configuration for doveadm: protocol !doveadm { userdb { driver = sql args = /.../dovecot-sql.conf.ext } } protocol doveadm { userdb { driver = sql args = /.../dovecot-sql-slave.conf.ext } } From tss at iki.fi Thu Dec 8 07:03:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:03:12 +0200 Subject: [Dovecot] sql dict: commit failed: MySQL server has gone away In-Reply-To: <4EDFB2A5.9090303@webfusion.com> References: <4EDFB2A5.9090303@webfusion.com> Message-ID: <1323320593.15365.65.camel@hurina> On Wed, 2011-12-07 at 20:38 +0200, Mark Zealey wrote: > Following on from this thread: > http://www.dovecot.org/list/dovecot/2010-September/052704.html > > in 2.0.16 I am seeing the same issues. I believe this would be related > to some timeouts set on our mysql servers which are pretty low (30 or 60 > seconds or so to drop idle connections). Yes, most likely. But it only happens if the quota isn't enforced (e.g. unlimited quota), because otherwise the previous "current quota usage" lookup would have automatically reconnected. > This is happening for imap, pop > and lmtp processes when they try to update quotas stored in a mysql > database; presumably it is the dict process that actually has these > issues - the lmtp delivery isn't lasting longer than 1 second so > shouldn't be seeing any timeouts there. This is always followed by the > "Error: dict quota: Quota update failed, it's now desynced" line; > presumably it is telling the truth but I'm not sure how I could tell. Yes. All sql dict updates go through dict process, which keeps a long running sql connection open. > We are also seeing this "MySQL server has gone away" issue in login > processes but it isn't causing an issue there as presumably dovecot > transparently retries rather than just giving up as it seems to in the > quota updates. Any thoughts or advice would be appreciated. You mean auth processes. In case of auth the lookup is retried though. Anyway, v2.1 now retries the commit: http://hg.dovecot.org/dovecot-2.1/rev/782f09d13ece From tss at iki.fi Thu Dec 8 07:06:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:06:12 +0200 Subject: [Dovecot] postlogin script In-Reply-To: References: Message-ID: <1323320772.15365.68.camel@hurina> On Wed, 2011-12-07 at 21:57 +0200, Selcuk Yazar wrote: > Hi, > > I have Postfix + OpenLdap + DoveCot configuration, and it's running > succesfuly, > > i wantto convert users pop3 password NTPassword and LMPassword, so i ne > plain passwor dof users, > > how can i do that. (Normaly using perl's ntlmgen function i convert > password , but in plain) 1) You need to enable userdb prefetch and make it work: http://wiki2.dovecot.org/UserDatabase/Prefetch 2) Once you can successfully log in with userdb prefetch enabled, add another field to pass_attrs: pass_attrs = ..., =userdb_plaintext_pass=%w 3) Now in your post-login script you should have PLAINTEXT_PASS environment containing the password. From tss at iki.fi Thu Dec 8 07:11:01 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:11:01 +0200 Subject: [Dovecot] lazy_expunge plugin and folder subscription trouble In-Reply-To: <20111207171203.32263dknm9tyodgc@webmail.hrz.uni-giessen.de> References: <20111207171203.32263dknm9tyodgc@webmail.hrz.uni-giessen.de> Message-ID: <1323321061.15365.70.camel@hurina> On Wed, 2011-12-07 at 17:12 +0100, J?rgen Obermann wrote: > Hello, > I wanted to test the lazy expunge plugin together with mdbox. It seems > to me that the folder subscriptions file in the mdbox directory was > overwritten with only a few folder names every time I added or removed > something in the list of subscribed folders, or even if I turned the > imap folder subscription feature off and on. Here is my setup: .. > namespace { > location = mdbox:~/mdbox:MAILBOXDIR=expunged > prefix = .EXPUNGED/ > separator = / > } Right, with this it thinks that it owns the ~/mdbox/subscriptions file, but that is the same path as for the inbox namespace. I think with subscriptions=no it should have worked ok, but if not, use a different subscriptions filename: location = mdbox:~/mdbox:MAILBOXDIR=expunged:SUBSCRIPTIONS=subscriptions-expunged From tss at iki.fi Thu Dec 8 07:15:13 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:15:13 +0200 Subject: [Dovecot] problems when using dsync between servers In-Reply-To: <4EDF47BE.8080703@univ-nantes.fr> References: <4EDF47BE.8080703@univ-nantes.fr> Message-ID: <1323321313.15365.72.camel@hurina> On Wed, 2011-12-07 at 12:02 +0100, Yann Dupont wrote: > Much faster (using all the cores), but dsync still hangs on some > accounts. After a certain time dsync exit with an error like that : > > Panic: file dsync-worker-local.c: line 1688 > (local_worker_save_msg_continue): assertion failed: (ret == -1) Unfortunately there are still some bugs in dsync.. But you could work around this by checking if dsync returned failure, and if it did just retry the user. > This is on a RUNNNING server. > > My aim was to make some pass on the running server, then stop it and > make a last pass to finish the process. That should work. > Is dsync supposed to run only on a stopped server ? No. From tss at iki.fi Thu Dec 8 07:22:22 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:22:22 +0200 Subject: [Dovecot] Panic when attempting index with Apache Solr : fts_solr plugin In-Reply-To: <4ED91D34.3050906@digitalforplay.com> References: <4ED91D34.3050906@digitalforplay.com> Message-ID: <1323321743.15365.74.camel@hurina> On Fri, 2011-12-02 at 12:47 -0600, A Dovecot User wrote: > [root at mymailserver ~]# doveadm -D index -u username mailbox inbox The "mailbox" isn't necessary above. > doveadm(username): Info: INBOX: Caching mails seq=1..466 > doveadm(username): Panic: file solr-connection.c: line 545 > (solr_connection_post_more): assertion failed: (maxfd >= 0) This happens every time? It can't index any mails at all? Have you tried with Dovecot v2.0? I can't reproduce it. Anyway I guess either I'm using libcurl wrong somehow, or there's a bug in libcurl.. From tss at iki.fi Thu Dec 8 07:23:48 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:23:48 +0200 Subject: [Dovecot] v2.1.rc1 missing SnowballAnalyzer.h In-Reply-To: <20111201161528.GI3177@zptr-nb18.caf.local> References: <20111201161528.GI3177@zptr-nb18.caf.local> Message-ID: <1323321828.15365.75.camel@hurina> On Thu, 2011-12-01 at 18:15 +0200, Eray Aslan wrote: > Sure enough, there is no SnowballAnalyzer.h in the tarball. > Looks like a missing a backslash in src/plugins/fts-lucene/Makefile.am: > [...] > noinst_HEADERS = \ > fts-lucene-plugin.h \ > lucene-wrapper.h > SnowballAnalyzer.h \ > SnowballFilter.h Yes, thanks, will be fixed in rc2. From tss at iki.fi Thu Dec 8 07:27:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:27:12 +0200 Subject: [Dovecot] Questions about Proxy/Director In-Reply-To: <4ED4EB16.1030704@wk-serv.de> References: <1321472837.21919.598.camel@hurina> <4ECAC68D.3060007@wk-serv.de> <20111122071624.GA6110@dibs.tanso.net> <4ECB76A8.80208@wk-serv.de> <20111122104547.GA10680@dibs.tanso.net> <2094e82e55c67f5591540ca7c800b92c@wk-serv.de> <20111124104709.GB24297@dibs.tanso.net> <4ECE483B.5090208@wk-serv.de> <20111124143321.GB28600@dibs.tanso.net> <4ECECBF9.5070507@wk-serv.de> <20111125081715.GA24352@dibs.tanso.net> <4ED4EB16.1030704@wk-serv.de> Message-ID: <1323322033.15365.76.camel@hurina> On Tue, 2011-11-29 at 15:24 +0100, Patrick Westenberg wrote: > I have a working test environment not but I don't feel very comfortable > with a non encrypted connection between the proxy/director and the > backend servers. > > If I set ssl = required on my backend server I get this error: > imap-login: Disconnected (tried to use disabled plaintext auth) > > Is there a chance to encrypt this connection? See the ssl stuff in http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy From tss at iki.fi Thu Dec 8 07:31:53 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:31:53 +0200 Subject: [Dovecot] POP3/IMAP crash signal 10 In-Reply-To: <0D810DB78132A8488DE17E655BF29B685C5EAA5C@TUPSDC01.tups.net.au> References: <0D810DB78132A8488DE17E655BF29B685C5EAA5C@TUPSDC01.tups.net.au> Message-ID: <1323322313.15365.80.camel@hurina> On Mon, 2011-11-28 at 03:24 +0000, Patrick Wood wrote: > Nov 28 14:11:02 mailserver dovecot: [ID 583609 mail.error] master: Error: service(pop3-login): child 28277 killed with signal 10 (core not dumped - set service pop3-log > in { drop_priv_before_exec=yes }) You can easily reproduce this? gdb backtrace is needed to get anything useful out of this crash. Try with: service pop3-login { executable = pop3-login -D drop_priv_before_exec = yes } Now when it crashes, it hopefully says that it's dumping a core (to /usr/local/var/run/dovecot/login/core)? If not, try attaching gdb directly to the process: service pop3-login { process_min_avail = 1 service_count = 0 } gdb /usr/local/libexec/dovecot/pop3-login cont bt full From tss at iki.fi Thu Dec 8 07:37:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:37:20 +0200 Subject: [Dovecot] Assertion failure in 2.0.16 - SEARCH () In-Reply-To: References: Message-ID: <1323322640.15365.81.camel@hurina> On Fri, 2011-11-25 at 22:36 -0800, Daniel Colascione wrote: > Nov 25 22:25:59 dancol dovecot: imap(dancol): Panic: file mail-search-build.c: > line 59 (mail_search_build_key_int): assertion failed: (sarg->value.subargs != > NULL) Thanks, fixed: http://hg.dovecot.org/dovecot-2.0/rev/ba68f9be07c4 From tss at iki.fi Thu Dec 8 07:53:57 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 07:53:57 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <4ED114DA.7030707@webfusion.com> References: <4ED114DA.7030707@webfusion.com> Message-ID: <1323323637.15365.85.camel@hurina> On Sat, 2011-11-26 at 18:33 +0200, Mark Zealey wrote: > We're trying to convert users from Maildir to sdbox at present; I'm > using dsync to achieve this (2.0.16) however when the user's have been > converted we only get minimal information in the caching files. Is there > some way to preserve all the caching decisions that were previously made > so that when the user logs in to the new mailbox we don't have to cause > an io storm rebuilding the cache that we know was good? Dovecot seems to > be partially doing this - if i remove the logs/cache from the source > mailbox no cache files are built in the conversion; if i put them back > then we get a cache file built but it only contains a few bits of > information (guid, date.save). Looking into this a bit further i find > that when the caches are present at source the fields are preserved but > the 'last used' date and caching decisions are not which I suspect means > dsync doesn't bother caching on import - only fields with a yes decision > in the source are copied (but their decision is only copied as a tmp > with the date of import). For example: How are you calling dsync? Does the destination already exist? I tried with: rm -rf /tmp/foo; dsync -u tss -m INBOX mirror sdbox:/tmp/foo It sets all of the cache fields with "yes" or "tmp" decision, as it should. But yes, the "last used" field should probably be copied as well. Perhaps the problem with you is that dsync actually writes all of the cache fields, but then it does a "cache compression" at the end, which sees that the "last used" fields are so old, so it deletes them. But yes, it is a problem that dsync doesn't update caching decisions.. Hmm. I guess I'll have to fix that for v2.1. From Mark.Zealey at webfusion.com Thu Dec 8 09:10:18 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 07:10:18 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323323637.15365.85.camel@hurina> References: <4ED114DA.7030707@webfusion.com>, <1323323637.15365.85.camel@hurina> Message-ID: Apologies for top-posting but I can't figure out how to make this client do inline... I am seeing on the first run (we are using 'backup') we don't get any of the cache copied just the index files created. On the second run (ie when dest exists); a cache file is created and populated with the bits that are required for the sync presumably - guid. As you say the yes/tmp caching decisions are copied over (and visible in the cache file) but because the last used date is not copied; these fields are not activated for any of the messages so none of their data actually gets cached. I'm not seeing a compression at the end as the tmp etc fields are still there (mostly don't have any yes fields in our source caches) but as I say, because they don't have a last used date then the none of them are ever actually used until the client requests them via pop/imap. Mark ________________________________________ From: Timo Sirainen [tss at iki.fi] Sent: 08 December 2011 05:53 To: Mark Zealey Cc: Dovecot Mailing List Subject: Re: [Dovecot] using dsync to convert mailboxes looses caching options On Sat, 2011-11-26 at 18:33 +0200, Mark Zealey wrote: > We're trying to convert users from Maildir to sdbox at present; I'm > using dsync to achieve this (2.0.16) however when the user's have been > converted we only get minimal information in the caching files. Is there > some way to preserve all the caching decisions that were previously made > so that when the user logs in to the new mailbox we don't have to cause > an io storm rebuilding the cache that we know was good? Dovecot seems to > be partially doing this - if i remove the logs/cache from the source > mailbox no cache files are built in the conversion; if i put them back > then we get a cache file built but it only contains a few bits of > information (guid, date.save). Looking into this a bit further i find > that when the caches are present at source the fields are preserved but > the 'last used' date and caching decisions are not which I suspect means > dsync doesn't bother caching on import - only fields with a yes decision > in the source are copied (but their decision is only copied as a tmp > with the date of import). For example: How are you calling dsync? Does the destination already exist? I tried with: rm -rf /tmp/foo; dsync -u tss -m INBOX mirror sdbox:/tmp/foo It sets all of the cache fields with "yes" or "tmp" decision, as it should. But yes, the "last used" field should probably be copied as well. Perhaps the problem with you is that dsync actually writes all of the cache fields, but then it does a "cache compression" at the end, which sees that the "last used" fields are so old, so it deletes them. But yes, it is a problem that dsync doesn't update caching decisions.. Hmm. I guess I'll have to fix that for v2.1. From Mark.Zealey at webfusion.com Thu Dec 8 09:14:05 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 07:14:05 +0000 Subject: [Dovecot] sql dict: commit failed: MySQL server has gone away In-Reply-To: <1323320593.15365.65.camel@hurina> References: <4EDFB2A5.9090303@webfusion.com>, <1323320593.15365.65.camel@hurina> Message-ID: Correct we're not enforcing the quotas at present just want an easy way to monitor everyone's mailbox usage. Thanks for the patch; will it work ok against 2.0.16? if so I'll recompile and give it a test today. Mark ________________________________________ From: Timo Sirainen [tss at iki.fi] Sent: 08 December 2011 05:03 To: Mark Zealey Cc: dovecot at dovecot.org Subject: Re: [Dovecot] sql dict: commit failed: MySQL server has gone away On Wed, 2011-12-07 at 20:38 +0200, Mark Zealey wrote: > Following on from this thread: > http://www.dovecot.org/list/dovecot/2010-September/052704.html > > in 2.0.16 I am seeing the same issues. I believe this would be related > to some timeouts set on our mysql servers which are pretty low (30 or 60 > seconds or so to drop idle connections). Yes, most likely. But it only happens if the quota isn't enforced (e.g. unlimited quota), because otherwise the previous "current quota usage" lookup would have automatically reconnected. > This is happening for imap, pop > and lmtp processes when they try to update quotas stored in a mysql > database; presumably it is the dict process that actually has these > issues - the lmtp delivery isn't lasting longer than 1 second so > shouldn't be seeing any timeouts there. This is always followed by the > "Error: dict quota: Quota update failed, it's now desynced" line; > presumably it is telling the truth but I'm not sure how I could tell. Yes. All sql dict updates go through dict process, which keeps a long running sql connection open. > We are also seeing this "MySQL server has gone away" issue in login > processes but it isn't causing an issue there as presumably dovecot > transparently retries rather than just giving up as it seems to in the > quota updates. Any thoughts or advice would be appreciated. You mean auth processes. In case of auth the lookup is retried though. Anyway, v2.1 now retries the commit: http://hg.dovecot.org/dovecot-2.1/rev/782f09d13ece From tss at iki.fi Thu Dec 8 09:33:44 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 09:33:44 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323323637.15365.85.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina> Message-ID: <1323329624.15365.87.camel@hurina> On Thu, 2011-12-08 at 07:53 +0200, Timo Sirainen wrote: > But yes, it is a problem that dsync doesn't update caching decisions.. > Hmm. I guess I'll have to fix that for v2.1. Could you try if the attached patch fixes your problems when patching against latest v2.1 hg? It's annoyingly large, and it makes v2.1 dsync incompatible with v2.0, but maybe it's better to do it sooner than later.. -------------- next part -------------- A non-text attachment was scrubbed... Name: dsync.diff Type: text/x-patch Size: 27825 bytes Desc: not available URL: From Yann.Dupont at univ-nantes.fr Thu Dec 8 09:47:16 2011 From: Yann.Dupont at univ-nantes.fr (Yann Dupont) Date: Thu, 08 Dec 2011 08:47:16 +0100 Subject: [Dovecot] problems when using dsync between servers In-Reply-To: <1323321313.15365.72.camel@hurina> References: <4EDF47BE.8080703@univ-nantes.fr> <1323321313.15365.72.camel@hurina> Message-ID: <4EE06B84.2030302@univ-nantes.fr> Le 08/12/2011 06:15, Timo Sirainen a ?crit : > On Wed, 2011-12-07 at 12:02 +0100, Yann Dupont wrote: > >> Much faster (using all the cores), but dsync still hangs on some >> accounts. After a certain time dsync exit with an error like that : >> >> Panic: file dsync-worker-local.c: line 1688 >> (local_worker_save_msg_continue): assertion failed: (ret == -1) > > Unfortunately there are still some bugs in dsync.. But you could work > around this by checking if dsync returned failure, and if it did just > retry the user. > ok will try this. >> This is on a RUNNNING server. >> >> My aim was to make some pass on the running server, then stop it and >> make a last pass to finish the process. > > That should work. > >> Is dsync supposed to run only on a stopped server ? > > No. > OK, thanks for your answer, -- Yann Dupont - Service IRTS, DSI Universit? de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont at univ-nantes.fr From selcuk.yazar at gmail.com Thu Dec 8 10:40:26 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Thu, 8 Dec 2011 10:40:26 +0200 Subject: [Dovecot] postlogin script In-Reply-To: <1323320772.15365.68.camel@hurina> References: <1323320772.15365.68.camel@hurina> Message-ID: Hi, i applied settingsin below but dovecot says that " prefetch(.. at ....edu.tr,IP_ADDRESS): passdb didn't return userdb entries, trying the next userdb " so PLAINTEXT_PASS is empty thanks in advance. > 1) You need to enable userdb prefetch and make it work: > http://wiki2.dovecot.org/UserDatabase/Prefetch > > 2) Once you can successfully log in with userdb prefetch enabled, add > another field to pass_attrs: > > pass_attrs = ..., =userdb_plaintext_pass=%w > > 3) Now in your post-login script you should have PLAINTEXT_PASS > environment containing the password. > > -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From tss at iki.fi Thu Dec 8 10:55:17 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 10:55:17 +0200 Subject: [Dovecot] postlogin script In-Reply-To: References: <1323320772.15365.68.camel@hurina> Message-ID: <1323334517.15365.88.camel@hurina> On Thu, 2011-12-08 at 10:40 +0200, Selcuk Yazar wrote: > Hi, > > i applied settingsin below but dovecot says that > > " prefetch(.. at ....edu.tr,IP_ADDRESS): passdb didn't return userdb entries, > trying the next userdb > " That's why I said make the userdb prefetch work first, the way described in: > > http://wiki2.dovecot.org/UserDatabase/Prefetch You'll need to add stuff to your pass_attrs. It doesn't work automatically. From listen at constabel.net Thu Dec 8 10:55:14 2011 From: listen at constabel.net (Mike Constabel) Date: Thu, 8 Dec 2011 09:55:14 +0100 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <1323317897.15365.58.camel@hurina> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> Message-ID: <20111208085514.GJ22136@herakles.constabel-it.de> Hi, Timo Sirainen schrieb am Thursday, den 08. December 2011: > On Wed, 2011-12-07 at 18:05 +0100, Mike Constabel wrote: > > > if I try to crate a folder in Thunderbird 8 which contains > > umlauts this happens: > > > > - Create folder "T?r" > > - Thunderbird show T&APw-r in folder list > > I can't reproduce. Is it possible this is a TB bug? Try talking IMAP > protocol directly: > > /usr/local/libexec/dovecot/imap -u user at domain > a list "" T* > > If it lists: > > * LIST (\HasNoChildren) "." "T&APw-r" > > Then Dovecot is working correctly. I get: # /usr/lib/dovecot/imap -u test1 at in-preetz.de Debug: Loading modules from directory: /usr/lib/dovecot/modules Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Debug: auth input: test1 at in-preetz.de uid=1000 gid=1000 home=/mailspool1/in-preetz.de/test1 quota_rule=*:storage=500M Debug: Added userdb setting: plugin/quota_rule=*:storage=500M Debug: Effective uid=1000, gid=1000, home=/mailspool1/in-preetz.de/test1 Debug: quota: No quota setting - plugin disabled Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mdbox Debug: fs: root=/mailspool1/in-preetz.de/test1/mdbox, index=, control=, inbox=, alt= Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS FUZZY SPECIAL-USE QUOTA] Logged in as test1 at in-preetz.de a list "" T* * LIST (\HasNoChildren) "/" "T&-APw-r" * LIST (\HasChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "Trash/T&-APw-r" a OK List completed. As you see there is a second "-" in the name: "T&APw-r" != "T&-APw-r" With my old server: # telnet 192.168.10.102 143 Trying 192.168.10.102... Connected to 192.168.10.102. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5] Dovecot ready. A login aaa bbb A OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk QUOTA] Logged in a list "" T* * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "Test-1" * LIST (\HasNoChildren) "/" "T&APw-r" a OK List completed. Mike From selcuk.yazar at gmail.com Thu Dec 8 10:58:03 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Thu, 8 Dec 2011 10:58:03 +0200 Subject: [Dovecot] postlogin script In-Reply-To: <1323334517.15365.88.camel@hurina> References: <1323320772.15365.68.camel@hurina> <1323334517.15365.88.camel@hurina> Message-ID: Hi, i 'sorry, my mistake, it shold be pass_attrs = uid=user,userPassword=password, *=userdb_plaintext_pass=%w* as you said it must contain *equal sign* before userdb_plaintext_pass=%w, i missed it. thank you very much it works.! sel?uk On Thu, Dec 8, 2011 at 10:55 AM, Timo Sirainen wrote: > On Thu, 2011-12-08 at 10:40 +0200, Selcuk Yazar wrote: > > Hi, > > > > i applied settingsin below but dovecot says that > > > > " prefetch(.. at ....edu.tr,IP_ADDRESS): passdb didn't return userdb > entries, > > trying the next userdb > > " > > That's why I said make the userdb prefetch work first, the way described > in: > > > > http://wiki2.dovecot.org/UserDatabase/Prefetch > > You'll need to add stuff to your pass_attrs. It doesn't work > automatically. > > > -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From tss at iki.fi Thu Dec 8 11:19:41 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 11:19:41 +0200 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <20111208085514.GJ22136@herakles.constabel-it.de> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> Message-ID: <1323335981.15365.90.camel@hurina> On Thu, 2011-12-08 at 09:55 +0100, Mike Constabel wrote: > As you see there is a second "-" in the name: > > "T&APw-r" != "T&-APw-r" Oh, right, it's broken in the "fs" layout. With "maildir++" layout it works. And looks like this isn't going to be an easy fix. The fs layout listing code is horrible.. Maybe I'll just try rewriting it. From Mark.Zealey at webfusion.com Thu Dec 8 11:19:47 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 09:19:47 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323329624.15365.87.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> Message-ID: OK now it's copying the timestamp fields for tmp ones. However: 1) hdr.* fields are not being copied at all (unlike in previous releases) 2) although the decisions are now being recorded; the items are not actually being put into the cache for previously sync'd mails. New mails are having all the cache information produced however. Note: this is only when using the -f option to dsync; when not using -f it doesnt even get round to generating a cache so no fields are put there. Perhaps this should be activated by a new option to dsync; if people are using this for backup (rather than conversion) caches could get relatively large? Mark ________________________________________ From: Timo Sirainen [tss at iki.fi] Sent: 08 December 2011 07:33 To: Dovecot Mailing List Cc: Mark Zealey Subject: Re: [Dovecot] using dsync to convert mailboxes looses caching options On Thu, 2011-12-08 at 07:53 +0200, Timo Sirainen wrote: > But yes, it is a problem that dsync doesn't update caching decisions.. > Hmm. I guess I'll have to fix that for v2.1. Could you try if the attached patch fixes your problems when patching against latest v2.1 hg? It's annoyingly large, and it makes v2.1 dsync incompatible with v2.0, but maybe it's better to do it sooner than later.. From tss at iki.fi Thu Dec 8 11:27:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 08 Dec 2011 11:27:20 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> Message-ID: <1323336440.15365.95.camel@hurina> On Thu, 2011-12-08 at 09:19 +0000, Mark Zealey wrote: > OK now it's copying the timestamp fields for tmp ones. However: > > 1) hdr.* fields are not being copied at all (unlike in previous releases) They are in my tests.. This also happens if the destination doesn't exist? > 2) although the decisions are now being recorded; the items are not actually being put into the cache for previously sync'd mails. New mails are having all the cache information produced however. This is intentional. Doing anything else would be horribly inefficient. Note that dsync isn't *copying* cached data. It's simply setting the caching decisions, and the mail saving code parses the mails and updates cache. > Perhaps this should be activated by a new option to dsync; if people are using this for backup (rather than conversion) caches could get relatively large? Hm. Maybe.. From Mark.Zealey at webfusion.com Thu Dec 8 11:35:04 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 09:35:04 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323336440.15365.95.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> Message-ID: OK I'll test the header copying more fully. The reason we want to preserve caching decisions is to avoid an IO storm when users log in to their mailboxes after an sdbox upgrade so it would be great to be able to have some way to warm caches. Mark ________________________________________ From: Timo Sirainen [tss at iki.fi] Sent: 08 December 2011 09:27 To: Mark Zealey Cc: Dovecot Mailing List Subject: RE: [Dovecot] using dsync to convert mailboxes looses caching options On Thu, 2011-12-08 at 09:19 +0000, Mark Zealey wrote: > OK now it's copying the timestamp fields for tmp ones. However: > > 1) hdr.* fields are not being copied at all (unlike in previous releases) They are in my tests.. This also happens if the destination doesn't exist? > 2) although the decisions are now being recorded; the items are not actually being put into the cache for previously sync'd mails. New mails are having all the cache information produced however. This is intentional. Doing anything else would be horribly inefficient. Note that dsync isn't *copying* cached data. It's simply setting the caching decisions, and the mail saving code parses the mails and updates cache. > Perhaps this should be activated by a new option to dsync; if people are using this for backup (rather than conversion) caches could get relatively large? Hm. Maybe.. From knud.dombrowsky at graband.de Thu Dec 8 13:20:16 2011 From: knud.dombrowsky at graband.de (Knud Dombrowsky) Date: Thu, 08 Dec 2011 12:20:16 +0100 Subject: [Dovecot] noaclright Message-ID: <4EE09D70.3080909@graband.de> Hi, I recently upgraded to openSuse 12.1 which comes with dovecot 2.0.14. Because of mail-client-problems I am running one dovecot which requires authentication via a client-certificate and another one which can be used without a certificate. (Configurations can be found below.) Since the upgrade our shared mailbox is no longer visible. I tried to repair this by setting the ACLs once again (using imap-acl in Thunderbird) but every time I try to set a new ACL the tool says "noaclright" and dovecot logs the following messages: Dec 7 14:31:14 mailbox dovecot: imap(): Error: fstat(/home//Maildir/./dovecot-acl.lock) failed: No such file or directory Dec 7 14:31:14 mailbox dovecot: imap(): Error: file_dotlock_open(/home//Maildir/./dovecot-acl) failed: No such file or directory Needless to say the file exists and its contents looks like it should. (Every line is an ACL like "user=testuser ilrws") I took a look at the changelog from 2.0.14 onwards and since it says nothing about my problem I am not looking forward to compiling dovecot myself and installing it. Any ideas why this is happening? Is this a known problem? Any help is appreciated, Knud ------------Dovecot-on-port-992----------------------------------------- mailbox:~ # dovecot -n # 2.0.14: /etc/dovecot/dovecot.conf # OS: Linux 3.1.0-1.2-desktop x86_64 openSUSE 12.1 (x86_64) auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-master default_client_limit = 1600 default_process_limit = 512 listen = * mail_location = maildir:~/Maildir:INBOX=~/Maildir/.INBOX managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { driver = pam } plugin { acl = vfile:/etc/dovecot/acls:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes quota = maildir:alle Nutzer quota_rule = *:storage=1GB sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 992 ssl = yes } } ssl_ca = refcount > 0) In-Reply-To: <1323317504.15365.53.camel@hurina> References: <4EDF9185.7060805@localhost.localdomain.org> <1323317504.15365.53.camel@hurina> Message-ID: <4EE09D7B.7090604@localhost.localdomain.org> On 12/08/2011 05:11 AM Timo Sirainen wrote: > On Wed, 2011-12-07 at 17:17 +0100, Pascal Volk wrote: >> right after delivering the message to the INBOX the lmtp crashes. > http://hg.dovecot.org/dovecot-2.1/rev/3b70254e0596 should fix it. Thanks, that fixed the problem for me. Also thanks for http://hg.dovecot.org/dovecot-2.1/rev/8c803201651e Regards, Pascal -- The trapper recommends today: f007ba11.1134212 at localdomain.org From dovecot at digitalforplay.com Thu Dec 8 14:36:03 2011 From: dovecot at digitalforplay.com (A Dovecot User) Date: Thu, 08 Dec 2011 06:36:03 -0600 Subject: [Dovecot] =?utf-8?q?Panic_when_attempting_index_with_Apache_Solr_?= =?utf-8?q?=3A_fts=5Fsolr_plugin?= In-Reply-To: <1323321743.15365.74.camel@hurina> References: <4ED91D34.3050906@digitalforplay.com> <1323321743.15365.74.camel@hurina> Message-ID: <36a30195798e4f5ad24e7f6a365af649@localhost> It happens every time. Also, I just recompiled for version 2.0.16 and it gives me the same error (pasted below). I'll be updating the OS on this machine soon, which will update libcurl as well. Panic: file solr-connection.c: line 501 (solr_connection_post_more): assertion failed: (maxfd >= 0) Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3aa41) [0xbd5a41] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x47) [0xbd5b57] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xbab8de] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x293) [0x191d53] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x2723) [0x18f723] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_build_more+0x1f) [0x45d2ff] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x5515) [0x460515] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x5928) [0x460928] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_deinit+0x3a) [0xf3d03a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x55) [0xf3d0f5] -> doveadm() [0x805184d] -> doveadm() [0x804ef55] -> doveadm(doveadm_mail_single_user+0x5b) [0x804f3ab] -> doveadm() [0x804f813] -> doveadm(doveadm_mail_try_run+0x12e) [0x804fc6e] -> doveadm(main+0x3a4) [0x8055b64] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x729e36] -> doveadm() [0x804ed61] On Thu, 08 Dec 2011 07:22:22 +0200, Timo Sirainen wrote: > On Fri, 2011-12-02 at 12:47 -0600, A Dovecot User wrote: >> [root at mymailserver ~]# doveadm -D index -u username mailbox inbox > > The "mailbox" isn't necessary above. > >> doveadm(username): Info: INBOX: Caching mails seq=1..466 >> doveadm(username): Panic: file solr-connection.c: line 545 >> (solr_connection_post_more): assertion failed: (maxfd >= 0) > > This happens every time? It can't index any mails at all? Have you tried > with Dovecot v2.0? > > I can't reproduce it. Anyway I guess either I'm using libcurl wrong > somehow, or there's a bug in libcurl.. From micah at riseup.net Thu Dec 8 15:58:30 2011 From: micah at riseup.net (micah anderson) Date: Thu, 08 Dec 2011 08:58:30 -0500 Subject: [Dovecot] overriding userdb connection host for doveadm-user In-Reply-To: <1323318179.15365.62.camel@hurina> References: <87aa742rbo.fsf@algae.riseup.net> <1323318179.15365.62.camel@hurina> Message-ID: <87r50f17y1.fsf@algae.riseup.net> On Thu, 08 Dec 2011 06:22:58 +0200, Timo Sirainen wrote: > On Wed, 2011-12-07 at 13:02 -0500, Micah Anderson wrote: > > I've got my users in a replicated database setup and dovecot configured > > with two connect lines in dovecot-sql.conf: > > > > connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass > > connect = host=127.0.0.2 port=3306 dbname=users user=user password=pass > > > > this works really well to help balance the load. > > If you actually have it like that, it should only be using 127.0.0.2, as > the second connect setting overrides the first one.. What I actually have is: connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass connect = host=127.0.0.1 port=3307 dbname=users user=user password=pass two different port configurations (I'm running stunnel), rather than two different host entries[0]. >The right way would have been: > > connect = host=127.0.0.1 host=127.0.0.2 port=... So, if I just have two different ports, would the right way be: connect = host=127.0.0.1 port=3306 port=3307 dbname... ? micah 0. When I was anonymizing the db connection information in the original post, I accidentally changed the ip and decided it didn't matter for the question I was asking, so just left it. Now I see that might be confusing. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 835 bytes Desc: not available URL: From Mark.Zealey at webfusion.com Thu Dec 8 16:45:12 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 14:45:12 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina>, <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> Message-ID: With 2.0.16 hdr.xxx fields get copied fine (but of course without timestamp). With the patch you provided they don't get copied whether using mirror or backup & starting from scratch. I'm doing a Maildir to sdbox migration otherwise don't think I'm doing anytihng strange. Mark ________________________________________ From: Mark Zealey Sent: 08 December 2011 09:35 To: Timo Sirainen Cc: Dovecot Mailing List Subject: RE: [Dovecot] using dsync to convert mailboxes looses caching options OK I'll test the header copying more fully. The reason we want to preserve caching decisions is to avoid an IO storm when users log in to their mailboxes after an sdbox upgrade so it would be great to be able to have some way to warm caches. Mark From Mark.Zealey at webfusion.com Thu Dec 8 17:41:29 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 15:41:29 +0000 Subject: [Dovecot] sql dict: commit failed: MySQL server has gone away In-Reply-To: <420B5E34BFEE9646B7198438F9978AE223E32092@mail01.internal.webfusion.com> References: <4EDFB2A5.9090303@webfusion.com>, <1323320593.15365.65.camel@hurina>, <420B5E34BFEE9646B7198438F9978AE223E32092@mail01.internal.webfusion.com> Message-ID: Thanks Timo, this patch applied clean against 2.0.16 just running it on live for the past few minutes & seems to have fixed the issues. Mark ________________________________________ From: Mark Zealey Sent: 08 December 2011 07:14 To: Timo Sirainen Cc: dovecot at dovecot.org Subject: RE: [Dovecot] sql dict: commit failed: MySQL server has gone away Correct we're not enforcing the quotas at present just want an easy way to monitor everyone's mailbox usage. Thanks for the patch; will it work ok against 2.0.16? if so I'll recompile and give it a test today. Mark From Mark.Zealey at webfusion.com Thu Dec 8 18:10:15 2011 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 8 Dec 2011 16:10:15 +0000 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323336440.15365.95.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> Message-ID: By the way, another bug I noticed with dsync is that when converting from Maildir to sdbox is that the date.saved field is not preserved - it's just the time when the first dsync command happened. Presumably it should be the mtime of the Maildir message file Mark From user+dovecot at localhost.localdomain.org Thu Dec 8 18:37:23 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Thu, 08 Dec 2011 17:37:23 +0100 Subject: [Dovecot] Wish list item: %g/%{gid} variable Message-ID: <4EE0E7C3.2010101@localhost.localdomain.org> I think it would be very useful to have a user's GID in a variable. So i could use for example: mail_attachment_dir = /srv/mail/.SiS/%{gid} I use one GID per domain and the aliases fqhns of the domain. When for example example.com would be an alias for exmaple.net (gid: 12345), the attachments would be stored inside /srv/mail/.SiS/12345/, no matter if a message was sent to john.doe at example.com or to john.doe at example.net. "quota = dict:domain:%{gid}:proxy::quota" would then also work. Regards, Pascal -- The trapper recommends today: c01dcofe.1134217 at localdomain.org From hsehic at econtec.de Fri Dec 9 00:51:53 2011 From: hsehic at econtec.de (Sehic, Haris) Date: Thu, 8 Dec 2011 23:51:53 +0100 (CET) Subject: [Dovecot] Per-User MySQL Quota (postfixadmin) Message-ID: <30505072.4022.1323384713873.JavaMail.open-xchange@mail02.econtec.de> Hi, ? need some help setting per-user quota and postfixadmin.?Setup is working on 1.2 dovecot. Tryin 2.1 dovecot now,? quota is working but overriden quota rule set by 'user_query =' in /etc/dovecot/dovecot-sql.conf.ext takes no efffekt. What's wrong here? ? Greets ? Haris -------------- next part -------------- # 2.1.rc1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 nfs auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain dict { quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } disable_plaintext_auth = no first_valid_uid = 150 last_valid_uid = 150 login_trusted_networks = 127.0.0.1 10.213.1.0/24 mail_debug = yes mail_gid = 8 mail_home = /var/vmail/%d/%u mail_location = maildir:/var/vmail/%d/%u mail_nfs_storage = yes mail_plugins = " quota imap_quota imap_acl" mail_uid = 150 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:/var/vmail/%%d/%%u:INDEX=/var/vmail/%%d/%%u/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_anyone = allow acl_shared_dict = file:/var/vmail/shared-mailboxes.db mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:user quota::noenforcing:proxy::quotadict quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=90%% quota-warning 90 %u quota_warning3 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = hsehic at econtec.de protocols = imap sieve pop3 lmtp sieve quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = mail mode = 0600 user = vmail } } service dict { unix_listener dict { group = mail mode = 0600 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl_cert = -------------- next part -------------- connect = host=localhost dbname=postfixadmindb user=mailusr password=12345678 map { pattern = priv/quota/storage table = quota2 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota2 username_field = username value_field = messages } From maciej.przybecki at gmail.com Fri Dec 9 07:52:59 2011 From: maciej.przybecki at gmail.com (Maciej Przybecki) Date: Fri, 9 Dec 2011 06:52:59 +0100 Subject: [Dovecot] Per-User MySQL Quota (postfixadmin) In-Reply-To: <30505072.4022.1323384713873.JavaMail.open-xchange@mail02.econtec.de> References: <30505072.4022.1323384713873.JavaMail.open-xchange@mail02.econtec.de> Message-ID: I faced the same problem and digged for 2 days with no luck. It occurred, that I have userdb { ...} section defined as static values, so user_query has never been queried :-). So you must check your userdb section of your config. -Maciej Wys?ane z iPhone'a Dnia 8 gru 2011 o godz. 23:51 "Sehic, Haris" napisa?(a): > Hi, > > need some help setting per-user quota and postfixadmin. Setup is working on 1.2 > dovecot. Tryin 2.1 dovecot now, quota is working but overriden quota rule set > by 'user_query =' in /etc/dovecot/dovecot-sql.conf.ext takes no efffekt. What's > wrong here? > > Greets > > Haris > > > From florent at coppint.com Fri Dec 9 16:30:20 2011 From: florent at coppint.com (florent at coppint.com) Date: Fri, 09 Dec 2011 15:30:20 +0100 Subject: [Dovecot] Error: Corrupted index cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid record size Message-ID: Hi all, I got a problem with a Dovecot IMAP/POP installation. Since a recent failure of our distributed file system (no loss of data btw), Dovecot seems to have a problem with index cache files. For a lot of accounts, I have this error in logs: Error: Corrupted index cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid record size If I delete all files from /indexes/ directory, it still occurs... Do you see what can cause this problem ? Or what information can I provide to help ? Our distributed FS is MooseFS. Dovecot is configured like if it was NFS (no mmap, etc...). Thank you for your help :) Flo From terry at cnysupport.com Fri Dec 9 18:24:32 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 09 Dec 2011 11:24:32 -0500 Subject: [Dovecot] "Unstable" vs "Development" vs "Nightly" Message-ID: <4EE23640.6020009@cnysupport.com> I'm currently running v2.1rc1, but have been seeing errors like: Dec 8 11:31:55 it kernel: auth[18914]: segfault at 48 ip 00fe2f74 sp bfcaccd0 error 4 in libauthdb_imap.so[fdd000+f000] The unstable and nightly builds are newer, but are they likely to be more or less stable than the version I'm currently running? I'd like to install a newer version, but am trying to get a feel for how usable they're likely to be. Thanks, Terry From tss at iki.fi Fri Dec 9 18:43:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 9 Dec 2011 18:43:06 +0200 Subject: [Dovecot] "Unstable" vs "Development" vs "Nightly" In-Reply-To: <4EE23640.6020009@cnysupport.com> References: <4EE23640.6020009@cnysupport.com> Message-ID: On 9.12.2011, at 18.24, Terry Carmen wrote: > I'm currently running v2.1rc1, but have been seeing errors like: > > Dec 8 11:31:55 it kernel: auth[18914]: segfault at 48 ip 00fe2f74 sp bfcaccd0 error 4 in libauthdb_imap.so[fdd000+f000] It would be useful to get gdb backtrace from this. You should be able to get core dumps by adding to dovecot.conf: service auth { user = root } Run "ulimit -c unlimited" before starting dovecot. Then when it crashes there should be a core file in your base_dir (e.g. /var/run/dovecot), and you can do: gdb /usr/local/libexec/dovecot/auth /var/run/dovecot/core bt full > The unstable and nightly builds are newer, but are they likely to be more or less stable than the version I'm currently running? > > I'd like to install a newer version, but am trying to get a feel for how usable they're likely to be. The newer hg versions generally should be more stable, since I've mainly been trying to fix bugs instead of add new features.. The exception being this week, since I've needed to do a few bigger changes. From tss at iki.fi Fri Dec 9 18:53:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 9 Dec 2011 18:53:19 +0200 Subject: [Dovecot] Error: Corrupted index cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid record size In-Reply-To: References: Message-ID: <29C5867E-E95A-4A0D-8B9B-8734EDFD3A9A@iki.fi> On 9.12.2011, at 16.30, florent at coppint.com wrote: > Since a recent failure of our distributed file system (no loss of data > btw), Dovecot seems to have a problem with index cache files. > > For a > lot of accounts, I have this error in logs: > > Error: Corrupted index > cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid > record size Broken cache files aren't visible to users. Are there other errors? > If I delete all files from /indexes/ directory, it still > occurs... When that error happens, the cache is automatically deleted. But if it keeps happening over and over again, something's broken. > Do you see what can cause this problem ? Or what information > can I provide to help ? You said it worked fine until the distributed filesystem somehow failed, and after that it just keeps on failing? It doesn't really sound like it's Dovecot's fault. Also what Dovecot version is this? From terry at cnysupport.com Fri Dec 9 18:59:33 2011 From: terry at cnysupport.com (Terry Carmen) Date: Fri, 09 Dec 2011 11:59:33 -0500 Subject: [Dovecot] "Unstable" vs "Development" vs "Nightly" In-Reply-To: References: <4EE23640.6020009@cnysupport.com> Message-ID: <4EE23E75.6040102@cnysupport.com> On 12/09/2011 11:43 AM, Timo Sirainen wrote: > On 9.12.2011, at 18.24, Terry Carmen wrote: > >> I'm currently running v2.1rc1, but have been seeing errors like: >> >> Dec 8 11:31:55 it kernel: auth[18914]: segfault at 48 ip 00fe2f74 sp bfcaccd0 error 4 in libauthdb_imap.so[fdd000+f000] > It would be useful to get gdb backtrace from this. You should be able to get core dumps by adding to dovecot.conf: > > service auth { > user = root > } > > Run "ulimit -c unlimited" before starting dovecot. Then when it crashes there should be a core file in your base_dir (e.g. /var/run/dovecot), and you can do: > > gdb /usr/local/libexec/dovecot/auth /var/run/dovecot/core > bt full > >> The unstable and nightly builds are newer, but are they likely to be more or less stable than the version I'm currently running? >> >> I'd like to install a newer version, but am trying to get a feel for how usable they're likely to be. > The newer hg versions generally should be more stable, since I've mainly been trying to fix bugs instead of add new features.. The exception being this week, since I've needed to do a few bigger changes. Thanks! I'll wait until next week, then upgrade to the current hg version, and see if it goes away, before taking up more of your time on stuff that might already be fixed. Terry From tss at iki.fi Fri Dec 9 19:01:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 9 Dec 2011 19:01:12 +0200 Subject: [Dovecot] Wish list item: %g/%{gid} variable In-Reply-To: <4EE0E7C3.2010101@localhost.localdomain.org> References: <4EE0E7C3.2010101@localhost.localdomain.org> Message-ID: <2EFEE782-4715-4494-B291-521A00FDF9AA@iki.fi> On 8.12.2011, at 18.37, Pascal Volk wrote: > I think it would be very useful to have a user's GID in a variable. > > So i could use for example: mail_attachment_dir = /srv/mail/.SiS/%{gid} This was simple enough :) http://hg.dovecot.org/dovecot-2.1/rev/8a63f621bd2e http://hg.dovecot.org/dovecot-2.0/rev/af6d0858e64b From djonas at vitalwerks.com Fri Dec 9 21:16:19 2011 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 09 Dec 2011 11:16:19 -0800 Subject: [Dovecot] Make entire mailbox read-only (ACLs?) Message-ID: <4EE25E83.1090700@vitalwerks.com> Hello, Is there a way of locking a mailbox, effectively making it read-only to IMAP clients? I've read through http://wiki2.dovecot.org/ACL. I created dovecot-acl with the content "owner lr" in .INBOX which seems to keep me from copying messages into the folder, but not out. I have the plugin configured correctly, it seems, since MYRIGHTS command shows the correct value: 30 MYRIGHTS "INBOX" * MYRIGHTS "INBOX" lr Am I barking up the wrong tree? Is there an easier way to lock a mailbox? post-login scripting perhaps? Thanks! From brad at omnis.com Fri Dec 9 22:13:19 2011 From: brad at omnis.com (Brad Schuetz) Date: Fri, 09 Dec 2011 12:13:19 -0800 Subject: [Dovecot] Two recent issues Message-ID: <4EE26BDF.4080500@omnis.com> I've been using dovecot for years, been working great. However recently I've come across two issues. The first issue unfortunately I have little information on, mail_debug hasn't provided anything useful either (in fact it looks like the login request that fails doesn't even get logged at all). During the morning rush of email, this server has around 11k mailboxes on it, it *appears* that one of the auth processes dies resulting in "dovecot: imap-login: Error: read(imap) failed: Connection reset by peer" errors followed by "dovecot: imap-login: Internal login failure ..." in the logs. I've yet to get any useful debugging information on this error so I'm not expecting much/any help on this one, but if anyone has any ideas on how I can get more debug besides running strace 24/7 in the hopes it catches something before the hard drive is full of strace output I'd love to hear it. The best I've gotten was a lucky strace once (at the time I didn't realize it was so lucky or I would have saved the output) that indicated the imap-login daemon was failing to connect to the auth process. The second issue is lmtp/lda (tried both) delivery to a mailbox that has filesystem quotas enabled and the group quota is maxed is resulting in the below panic and crash. This issue happens with 2.0.13, 2.0.15 and 2.0.16. Here's the logs showing that it knows the disk quota is exceeded and then a subsequent zlib panic. Like it's trying to deliver it anyway. --------------------- 11:21:07 [err] dovecot: lmtp(29691, admin@[redacted].com): Error: o_stream_send_istream(/email/d/r/[redacted]/[redacted]/admin/Maildir/tmp/1323458467.M245978P29691.fenrir.omnis.com) failed: Disk quota exceeded 11:21:07 [crit] dovecot: lmtp(29691, admin@[redacted].com): Panic: file ostream-zlib.c: line 144 (o_stream_zlib_send_flush): assertion failed: (zs->avail_in == 0) 11:21:07 [err] dovecot: lmtp(29691, admin@[redacted].com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 [0x345443ca90] -> /usr/lib64/dovecot/libdovecot.so.0 [0x345443cae6] -> /usr/lib64/dovecot/libdovecot.so.0 [0x345443c4a3] -> /usr/lib64/dovecot/lib20_zlib_plugin.so [0x2ba2d31547f6] -> /usr/lib64/dovecot/lib20_zlib_plugin.so [0x2ba2d315481b] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_flush+0x2a) [0x345444f0ea] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_save_finish+0x6b) [0x3451c63b6b] -> /usr/lib64/dovecot/lib10_quota_plugin.so [0x2ba2d2f4ce7a] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_save_finish+0x30) [0x3451c2fbb0] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xb3) [0x3451c2aae3] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_copy+0x56) [0x3451c6fd36] -> /usr/lib64/dovecot/lib10_quota_plugin.so [0x2ba2d2f4d0ba] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5a) [0x3451c301ba] -> /usr/lib64/dovecot/li 11:21:07 [err] dovecot: master: Error: service(lmtp): child 29691 killed with signal 6 (core dumps disabled) --------------------- Attached is the current "doveadm config" output. -- Brad Schuetz -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: dovecot.config URL: From hsehic at econtec.de Fri Dec 9 23:52:40 2011 From: hsehic at econtec.de (Sehic, Haris) Date: Fri, 9 Dec 2011 22:52:40 +0100 (CET) Subject: [Dovecot] Per-User MySQL Quota (postfixadmin) In-Reply-To: References: <30505072.4022.1323384713873.JavaMail.open-xchange@mail02.econtec.de> Message-ID: <11181131.4211.1323467560596.JavaMail.open-xchange@mail02.econtec.de> Hi Maciej, ? thanks for the hint! ? http://wiki2.dovecot.org/UserDatabase/Prefetch ? did the trick!? ? Greets ? Haris? ? ? Maciej Przybecki hat am 9. Dezember 2011 um 06:52 geschrieben: > I faced the same problem and digged for 2 days with no luck. It occurred, that > I have userdb { ...} section defined as static values, so user_query has never > been queried :-). > So you must check your userdb section of your config. > -Maciej > > > Wys?ane z iPhone'a > > Dnia 8 gru 2011 o godz. 23:51 "Sehic, Haris" napisa?(a): > > > Hi, > >? > > need some help setting per-user quota and postfixadmin. Setup is working on > > 1.2 > > dovecot. Tryin 2.1 dovecot now,? quota is working but overriden quota rule > > set > > by 'user_query =' in /etc/dovecot/dovecot-sql.conf.ext takes no efffekt. > > What's > > wrong here? > >? > > Greets > >? > > Haris > > > > > > > -- Haris Sehic, Econtec GmbH Office Phone: +49 9129 29419-36 Office Fax:? ? ? ? ? ? ? ? ?-99 ----------------------------------------------------------------------------- Econtec GmbH Nibelungenstrasse 5 90530 Wendelstein Germany Tel.: 0049 - 9129 - 29 419 0 Fax : 0049 - 9129 - 29 419 99 e-mail: info at econtec.de Gesch?ftsf?hrer Herr Roland Borst HRB 15208, N?rnberg UID-Nr. : DE190650537 Steuer-Nr.: 241/125/20496 From brad at omnis.com Sat Dec 10 02:12:30 2011 From: brad at omnis.com (Brad Schuetz) Date: Fri, 09 Dec 2011 16:12:30 -0800 Subject: [Dovecot] Major bug with hardlinks and lmtp Message-ID: <4EE2A3EE.6060503@omnis.com> In working on trying to fix the crash issue from my last email I had enabled LMTP delivery to try it out instead of using the LDA. I have discovered that when a single piece of email is to be delivered to multiple users the message is being hard linked instead of copied into each mail box. This is a major problem that makes LMTP unusable in an environment where each mailbox has it's own UID since the hard linked file will only be readable by one of the users. I assume this is related to "maildir_copy_with_hardlinks=yes", however this setting doesn't say anything about hardlinking across different email accounts. -- Brad Schuetz From user+dovecot at localhost.localdomain.org Sat Dec 10 05:35:56 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 10 Dec 2011 04:35:56 +0100 Subject: [Dovecot] 2.1.rc1 (8a63f621bd2e): SiS permission issue + crash Message-ID: <4EE2D39C.2030106@localhost.localdomain.org> Since changeset 8a63f621bd2e I'm one step closer to the perfect working setup. I'm sharing one GID per domain, all it's alias names and accounts. So I can use: mail_attachment_dir = /srv/mail/.SiS/%{gid} In order to avoid permission trouble I've set fs ACL on the .SiS dir: ,--[ getfacl srv/mail/.SiS ]-- | # file: srv/mail/.SiS | # owner: root | # group: root | user::rwx | group::--x | mask::--x | other::-wx | default:user::rwx | default:group::rwx | default:mask::rwx | default:other::--- `-- OK, lets test the setup: dsync -u test-0 at example.com mirror maildir:/tmp/Maildir rm -rf Maildir && cp -a Maildir_org Maildir && chown -R 70010:70002 Maildir dsync -vu test-1 at example.com mirror maildir:/tmp/Maildir dsync(test-1 at example.com): Info: Drafts: only in dest (guid=b6a53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Info: Sent: only in dest (guid=b7a53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Info: Junk-E-Mail: only in dest (guid=b8a53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Info: Trash: only in dest (guid=b9a53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Info: INBOX: only in dest (guid=baa53627f3cbe24e33030000850d2fad) dsync(test-1 at example.com): Error: stat(/srv/mail/.SiS/70002/a2/7b/.temp.blau.819.4f06409857c627e0) failed: Permission denied dsync(test-1 at example.com): Error: safe_mkstemp(/srv/mail/.SiS/70002/a2/7b/.temp.blau.819.) failed: Permission denied dsync(test-1 at example.com): Panic: file dsync-worker-local.c: line 1644 (local_worker_save_msg_continue): assertion failed: (ret == -1) dsync(test-1 at example.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x4faf1) [0x7f4db31f4af1] -> /usr/local/lib/dovecot/libdovecot.so.0(default_error_handler+0) [0x7f4db31f4b7d] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4db31f4e01] -> dsync() [0x416af8] -> dsync() [0x416e46] -> dsync(dsync_worker_msg_save+0x82) [0x412cb2] -> dsync() [0x40b7e0] -> dsync() [0x417286] -> dsync() [0x417324] -> dsync(dsync_worker_msg_get+0xa8) [0x412dd4] -> dsync() [0x40bbf3] -> dsync() [0x40bd62] -> dsync() [0x40c106] -> dsync() [0x40c318] -> dsync(dsync_brain_msg_sync_new_msgs+0x1c) [0x40c336] -> dsync(dsync_brain_msg_sync_more+0x1ae) [0x40b15e] -> dsync() [0x409b88] -> dsync(dsync_brain_sync+0x231) [0x40a074] -> dsync() [0x4084fb] -> dsync() [0x408729] -> dsync(dsync_brain_sync+0x1a7) [0x409fea] -> dsync() [0x408238] -> dsync() [0x408388] -> dsync(dsync_brain_sync+0x10b) [0x409f4e] -> dsync(dsync_brain_sync_all+0x24) [0x40a16b] -> dsync(main+0x680) [0x407b2b ] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f4db2e3fead] -> dsync() [0x406e09] Aborted (core dumped) Looks like Dovecot ignores the ACL. I think a mail_attachment_dir_mode setting could help to work around this problem. Dunno what would be a good default value. But I would set mail_attachment_dir_mode = 0770 The attachment files have mode 0660, that's perfect in my setup. Regards, Pascal -- The trapper recommends today: c01dcafe.1134404 at localdomain.org -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: doveconf.txt URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: dsync_bt.txt URL: From tss at iki.fi Sat Dec 10 07:08:28 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 07:08:28 +0200 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <1323335981.15365.90.camel@hurina> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> <1323335981.15365.90.camel@hurina> Message-ID: <1323493708.15365.103.camel@hurina> On Thu, 2011-12-08 at 11:19 +0200, Timo Sirainen wrote: > On Thu, 2011-12-08 at 09:55 +0100, Mike Constabel wrote: > > > As you see there is a second "-" in the name: > > > > "T&APw-r" != "T&-APw-r" > > Oh, right, it's broken in the "fs" layout. With "maildir++" layout it > works. And looks like this isn't going to be an easy fix. The fs layout > listing code is horrible.. Maybe I'll just try rewriting it. OK, this should do it, hopefully without breaking anything: http://hg.dovecot.org/dovecot-2.1/rev/ab696ead12cc From tss at iki.fi Sat Dec 10 07:11:34 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 07:11:34 +0200 Subject: [Dovecot] Major bug with hardlinks and lmtp In-Reply-To: <4EE2A3EE.6060503@omnis.com> References: <4EE2A3EE.6060503@omnis.com> Message-ID: <1323493894.15365.105.camel@hurina> On Fri, 2011-12-09 at 16:12 -0800, Brad Schuetz wrote: > I have discovered that when a single piece of email is to be delivered > to multiple users the message is being hard linked instead of copied > into each mail box. This is a major problem that makes LMTP unusable in > an environment where each mailbox has it's own UID since the hard linked > file will only be readable by one of the users. This happens only if the users share the same GID. I already fixed this, but since it's a rather large change it's only in v2.1. From tss at iki.fi Sat Dec 10 07:13:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 07:13:06 +0200 Subject: [Dovecot] Make entire mailbox read-only (ACLs?) In-Reply-To: <4EE25E83.1090700@vitalwerks.com> References: <4EE25E83.1090700@vitalwerks.com> Message-ID: <1323493986.15365.107.camel@hurina> On Fri, 2011-12-09 at 11:16 -0800, David Jonas wrote: > Is there a way of locking a mailbox, effectively making it read-only to > IMAP clients? By "mailbox" you mean the user's all folders? This isn't possible currently, except by modifying filesystem permissions. A "default ACL for entire namespace" would be a nice feature, but it's just not done yet.. From tss at iki.fi Sat Dec 10 07:58:16 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 07:58:16 +0200 Subject: [Dovecot] Two recent issues In-Reply-To: <4EE26BDF.4080500@omnis.com> References: <4EE26BDF.4080500@omnis.com> Message-ID: <1323496696.15365.124.camel@hurina> On Fri, 2011-12-09 at 12:13 -0800, Brad Schuetz wrote: > I've been using dovecot for years, been working great. However recently > I've come across two issues. > > The first issue unfortunately I have little information on, mail_debug > hasn't provided anything useful either (in fact it looks like the login > request that fails doesn't even get logged at all). The *_debug settings aren't very helpful in debugging random failures. > During the morning rush of email, this server has around 11k mailboxes > on it, it *appears* that one of the auth processes dies resulting in > "dovecot: imap-login: Error: read(imap) failed: Connection reset by > peer" errors followed by "dovecot: imap-login: Internal login failure > ..." in the logs. If auth process dies unexpectedly, master always logs an error, such as: Dec 10 07:15:34 auth: Fatal: master: service(auth): child 27895 killed with signal 11 (core dumped) Anyway, "read(imap) failed: Connection reset by peer" can happen if you reach the service imap { process_limit }. But then there should be a warning logged about it also: Dec 10 07:17:39 master: Warning: service(imap): process_limit reached, client connections are being dropped So, that error message alone shouldn't be happening.. > The best I've gotten was a lucky strace once (at the time I didn't > realize it was so lucky or I would have saved the output) that indicated > the imap-login daemon was failing to connect to the auth process. If that happens, there would also be an error message logged about it. One thing that v2.0 doesn't log about is if auth socket gets disconnected, but that would result in different problems. v2.1 logs about that too. > The second issue is lmtp/lda (tried both) delivery to a mailbox that has > filesystem quotas enabled and the group quota is maxed is resulting in > the below panic and crash. > > 11:21:07 [err] dovecot: lmtp(29691, admin@[redacted].com): Error: > o_stream_send_istream(/email/d/r/[redacted]/[redacted]/admin/Maildir/tmp/1323458467.M245978P29691.fenrir.omnis.com) > failed: Disk quota exceeded > 11:21:07 [crit] dovecot: lmtp(29691, admin@[redacted].com): Panic: file > ostream-zlib.c: line 144 (o_stream_zlib_send_flush): assertion failed: > (zs->avail_in == 0) I couldn't reproduce this with my tests, but http://hg.dovecot.org/dovecot-2.0/rev/75daa638281b should fix it. From djonas at vitalwerks.com Sat Dec 10 08:00:04 2011 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 09 Dec 2011 22:00:04 -0800 Subject: [Dovecot] Make entire mailbox read-only (ACLs?) In-Reply-To: <1323493986.15365.107.camel@hurina> References: <4EE25E83.1090700@vitalwerks.com> <1323493986.15365.107.camel@hurina> Message-ID: <4EE2F564.9090405@vitalwerks.com> On 12/9/11 9:13 PM, Timo Sirainen wrote: > On Fri, 2011-12-09 at 11:16 -0800, David Jonas wrote: > >> Is there a way of locking a mailbox, effectively making it read-only to >> IMAP clients? > By "mailbox" you mean the user's all folders? This isn't possible > currently, except by modifying filesystem permissions. A "default ACL > for entire namespace" would be a nice feature, but it's just not done > yet.. Looks like changing the filesystem permissions gets me what I'm looking for. I simply removed write permissions for {cur,tmp,new}. Mailbox access seems to work just fine. Thunderbird shows the server responding with "SERVERBUG" and I get a "Permission denied" error in the logs, though. Not a big deal, the users will be notified before hand. Thanks! From tss at iki.fi Sat Dec 10 08:03:25 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 08:03:25 +0200 Subject: [Dovecot] Make entire mailbox read-only (ACLs?) In-Reply-To: <4EE2F564.9090405@vitalwerks.com> References: <4EE25E83.1090700@vitalwerks.com> <1323493986.15365.107.camel@hurina> <4EE2F564.9090405@vitalwerks.com> Message-ID: <1323497005.15365.126.camel@hurina> On Fri, 2011-12-09 at 22:00 -0800, David Jonas wrote: > On 12/9/11 9:13 PM, Timo Sirainen wrote: > > On Fri, 2011-12-09 at 11:16 -0800, David Jonas wrote: > > > >> Is there a way of locking a mailbox, effectively making it read-only to > >> IMAP clients? > > By "mailbox" you mean the user's all folders? This isn't possible > > currently, except by modifying filesystem permissions. A "default ACL > > for entire namespace" would be a nice feature, but it's just not done > > yet.. > Looks like changing the filesystem permissions gets me what I'm looking > for. I simply removed write permissions for {cur,tmp,new}. Mailbox > access seems to work just fine. Thunderbird shows the server responding > with "SERVERBUG" and I get a "Permission denied" error in the logs, > though. Not a big deal, the users will be notified before hand. Thanks! If you remove the write permissions also from the parent Maildir (or possibly some other files too), it shouldn't send SERVERBUG. From tss at iki.fi Sat Dec 10 08:17:27 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 08:17:27 +0200 Subject: [Dovecot] 2.1.rc1 (8a63f621bd2e): SiS permission issue + crash In-Reply-To: <4EE2D39C.2030106@localhost.localdomain.org> References: <4EE2D39C.2030106@localhost.localdomain.org> Message-ID: <1323497848.15365.128.camel@hurina> On Sat, 2011-12-10 at 04:35 +0100, Pascal Volk wrote: > dsync(test-1 at example.com): Panic: file dsync-worker-local.c: line 1644 (local_worker_save_msg_continue): assertion failed: (ret == -1) I'll see about this crash later.. > Looks like Dovecot ignores the ACL. I think a mail_attachment_dir_mode > setting could help to work around this problem. Dunno what would be a > good default value. But I would set mail_attachment_dir_mode = 0770 > The attachment files have mode 0660, that's perfect in my setup. With http://hg.dovecot.org/dovecot-2.1/rev/fcceee891448 you can do: mail_attachment_fs = sis posix:mode=0660 The dirs get created with 0770 then. From tss at iki.fi Sat Dec 10 08:27:02 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 08:27:02 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> Message-ID: <1323498422.15365.129.camel@hurina> On Thu, 2011-12-08 at 16:10 +0000, Mark Zealey wrote: > By the way, another bug I noticed with dsync is that when converting from Maildir to sdbox is that the date.saved field is not preserved - it's just the time when the first dsync command happened. Presumably it should be the mtime of the Maildir message file With Maildir the date.saved is taken from the mail file's ctime (yes, it's not perfect, but it's good enough for what it's used for). It's preserved in my tests. From tss at iki.fi Sat Dec 10 08:28:27 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 08:28:27 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>,<1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> Message-ID: <1323498507.15365.130.camel@hurina> On Thu, 2011-12-08 at 14:45 +0000, Mark Zealey wrote: > With 2.0.16 hdr.xxx fields get copied fine (but of course without timestamp). With the patch you provided they don't get copied whether using mirror or backup & starting from scratch. I'm doing a Maildir to sdbox migration otherwise don't think I'm doing anytihng strange. Show the whole list of cache decisions in source and destination? From tss at iki.fi Sat Dec 10 11:16:09 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 11:16:09 +0200 Subject: [Dovecot] lmtp panic in proxy lmtp director In-Reply-To: <4EDCD4AE.8030607@uib.es> References: <4EDCD4AE.8030607@uib.es> Message-ID: <1323508572.15365.141.camel@hurina> On Mon, 2011-12-05 at 15:26 +0100, Xavier Pons wrote: > Hi, we are getting some core dumps with signal 6 in ltmp on a dovecot > director proxy server, > like this: > > Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Panic: file lmtp-proxy.c: > line 376 (lmtp_proxy_output_timeout): assertion failed: > (proxy->data_input->eof) I think the way I originally planned LMTP proxying to work is simply too complex to work reliably, perhaps even if the code was bug-free. So instead of reading+writing DATA at the same time, this patch changes the DATA to be first read into memory or temp file, and then from there read and sent to the LMTP backends: http://hg.dovecot.org/dovecot-2.1/raw-rev/51d87deb5c26 The patch applies on top of v2.0 also. I tested that it appears to work, but more testing wouldn't hurt to make sure it won't corrupt large mails when sending them to multiple backends (one mail with multiple RCPT TOs sent to multiple different backends).. From tss at iki.fi Sat Dec 10 11:35:23 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 11:35:23 +0200 Subject: [Dovecot] overriding userdb connection host for doveadm-user In-Reply-To: <87r50f17y1.fsf@algae.riseup.net> References: <87aa742rbo.fsf@algae.riseup.net> <1323318179.15365.62.camel@hurina> <87r50f17y1.fsf@algae.riseup.net> Message-ID: <1323509723.15365.156.camel@hurina> On Thu, 2011-12-08 at 08:58 -0500, micah anderson wrote: > On Thu, 08 Dec 2011 06:22:58 +0200, Timo Sirainen wrote: > > On Wed, 2011-12-07 at 13:02 -0500, Micah Anderson wrote: > > > I've got my users in a replicated database setup and dovecot configured > > > with two connect lines in dovecot-sql.conf: > > > > > > connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass > > > connect = host=127.0.0.2 port=3306 dbname=users user=user password=pass > > > > > > this works really well to help balance the load. > > > > If you actually have it like that, it should only be using 127.0.0.2, as > > the second connect setting overrides the first one.. > > What I actually have is: > > connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass > connect = host=127.0.0.1 port=3307 dbname=users user=user password=pass > > two different port configurations (I'm running stunnel), rather than two > different host entries[0]. The only port Dovecot should be connecting with the above config is 3307. > >The right way would have been: > > > > connect = host=127.0.0.1 host=127.0.0.2 port=... > > So, if I just have two different ports, would the right way be: > > connect = host=127.0.0.1 port=3306 port=3307 dbname... > > ? There's actually no way to load balance between multiple ports. If there were, the config would probably have to be changed to something like host=127.0.0.1:3306 host=127.0.0.1:3307, because otherwise it would be confusing what should happen when there are multiple hosts and multiple ports. Anyway, maybe you could use multiple IPs instead of multiple ports? "host=127.0.0.1 host=127.0.0.2". From tss at iki.fi Sat Dec 10 11:41:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 11:41:19 +0200 Subject: [Dovecot] noaclright In-Reply-To: <4EE09D70.3080909@graband.de> References: <4EE09D70.3080909@graband.de> Message-ID: <1323510081.15365.159.camel@hurina> On Thu, 2011-12-08 at 12:20 +0100, Knud Dombrowsky wrote: > Hi, > I recently upgraded to openSuse 12.1 which comes with dovecot 2.0.14. What was the old Dovecot version? > Dec 7 14:31:14 mailbox dovecot: imap(): Error: > fstat(/home//Maildir/./dovecot-acl.lock) > failed: No such file or directory This should never happen. fstat() simply cannot fail with ENOENT. It's a kernel bug (or "feature") if it does. What filesystem do you use? Do you have SELinux/apparmor enabled? BTW. There's "doveadm acl" command that may be helpful to you. From tss at iki.fi Sat Dec 10 11:52:24 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 11:52:24 +0200 Subject: [Dovecot] POP - preventing re-download with server move In-Reply-To: <710C58696EA3BC42B425E4DBB39C1D5E48552AAE@MAIL-MBX2.ad.csbsju.edu> References: <710C58696EA3BC42B425E4DBB39C1D5E48552AAE@MAIL-MBX2.ad.csbsju.edu> Message-ID: <1323510745.15365.161.camel@hurina> On Thu, 2011-11-24 at 14:46 +0000, Trutwin, Joshua wrote: > So now I have to move my sites to a new server and I'm trying to > avoid having all these messages re-downloaded by POP clients. http://wiki2.dovecot.org/Migration#POP3_migration explains this. > The mail is stored in Maildirs - a sample file: 1280409166.23580.foo:2,S > > If I move this to server "bar" would renaming the file to > 1280409166.23580.bar:2,S prevent this somehow? That can only make things worse. From nick.z.edwards at gmail.com Sat Dec 10 12:07:48 2011 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Sat, 10 Dec 2011 20:07:48 +1000 Subject: [Dovecot] database failover Message-ID: Trying to get dovecot to _only_ use local copy of database, only querying another database server (same database, just replicated) if local copy is not responding, I have google fu'd a bit and found my only answer in so far as dovecot did this once upon as time, but it was only due to a dovecot bug, that has since been fixed, is that so? The wiki shows no information of failover, just load sharing, or is it an undocumented feature, or can dovecot not do failover, if not, can it be made so? Trying to cut down on network traffic, postfix does this nicely, I thought dovecot did too. From robert at schetterer.org Sat Dec 10 12:18:52 2011 From: robert at schetterer.org (Robert Schetterer) Date: Sat, 10 Dec 2011 11:18:52 +0100 Subject: [Dovecot] database failover In-Reply-To: References: Message-ID: <4EE3320C.2050607@schetterer.org> Am 10.12.2011 11:07, schrieb Nick Edwards: > Trying to get dovecot to _only_ use local copy of database, only querying > another database server (same database, just replicated) if local copy is > not responding, I have google fu'd a bit and found my only answer in so far > as dovecot did this once upon as time, but it was only due to a dovecot > bug, that has since been fixed, is that so? > The wiki shows no information of failover, just load sharing, or is it an > undocumented feature, or can dovecot not do failover, if not, can it be > made so? > > Trying to cut down on network traffic, postfix does this nicely, I thought > dovecot did too. > as far i know recent dovecot cant do it youre right postfix does you can do a master-master setup i.e with mysql solving this works nice here, but might not be the best solution perhaps ldap, or other databases are better -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From tss at iki.fi Sat Dec 10 12:26:09 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 12:26:09 +0200 Subject: [Dovecot] database failover In-Reply-To: References: Message-ID: <994B8A50-1BF9-47D3-8DB1-2E150E975E05@iki.fi> On 10.12.2011, at 12.07, Nick Edwards wrote: > Trying to get dovecot to _only_ use local copy of database, only querying > another database server (same database, just replicated) if local copy is > not responding, I have google fu'd a bit and found my only answer in so far > as dovecot did this once upon as time, but it was only due to a dovecot > bug, that has since been fixed, is that so? > The wiki shows no information of failover, just load sharing, or is it an > undocumented feature, or can dovecot not do failover, if not, can it be > made so? > > Trying to cut down on network traffic, postfix does this nicely, I thought > dovecot did too. You could add two passdbs + userdbs with different configs. The second dbs would be used when first db is down, but also for unknown users / wrong authentications. But yeah, the load balancing should be optional. There are just so many other things to do as well.. From mark.zealey at webfusion.com Sat Dec 10 12:55:28 2011 From: mark.zealey at webfusion.com (Mark Zealey) Date: Sat, 10 Dec 2011 12:55:28 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323498422.15365.129.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> <1323498422.15365.129.camel@hurina> Message-ID: <4EE33AA0.7050807@webfusion.com> 10-12-2011 08:27, Timo Sirainen yazm??: > On Thu, 2011-12-08 at 16:10 +0000, Mark Zealey wrote: >> By the way, another bug I noticed with dsync is that when converting from Maildir to sdbox is that the date.saved field is not preserved - it's just the time when the first dsync command happened. Presumably it should be the mtime of the Maildir message file > With Maildir the date.saved is taken from the mail file's ctime (yes, > it's not perfect, but it's good enough for what it's used for). It's > preserved in my tests. It could well be because of the conversion to sdbox then - the ctime/mtime of the files are not being preserved by dsync (in stock 2.0.16). The date.saved timestamp is only put into the cache on the second dsync run; presumably therefore it picks it up from the filesystem. Mark From mark.zealey at webfusion.com Sat Dec 10 13:03:42 2011 From: mark.zealey at webfusion.com (Mark Zealey) Date: Sat, 10 Dec 2011 13:03:42 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <1323498507.15365.130.camel@hurina> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> <1323498507.15365.130.camel@hurina> Message-ID: <4EE33C8E.9050005@webfusion.com> 10-12-2011 08:28, Timo Sirainen yazm??: > On Thu, 2011-12-08 at 14:45 +0000, Mark Zealey wrote: >> With 2.0.16 hdr.xxx fields get copied fine (but of course without timestamp). With the patch you provided they don't get copied whether using mirror or backup& starting from scratch. I'm doing a Maildir to sdbox migration otherwise don't think I'm doing anytihng strange. > Show the whole list of cache decisions in source and destination? Ah-ha it's doing the same in 2.0.16 - looking deeper it's because i havn't accessed the tmp fields in a week or two so I guess the decision has been taken not to migrate them. Mark From tss at iki.fi Sat Dec 10 13:07:08 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 13:07:08 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <4EE33C8E.9050005@webfusion.com> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> <1323498507.15365.130.camel@hurina> <4EE33C8E.9050005@webfusion.com> Message-ID: On 10.12.2011, at 13.03, Mark Zealey wrote: > Ah-ha it's doing the same in 2.0.16 - looking deeper it's because i havn't accessed the tmp fields in a week or two so I guess the decision has been taken not to migrate them. Yes, most likely the reason. Could this also explain the date.saved? > It could well be because of the conversion to sdbox then - the ctime/mtime of the files are not being preserved by dsync (in stock 2.0.16). The date.saved timestamp is only put into the cache on the second dsync run; presumably therefore it picks it up from the filesystem. With sdbox the file's mtime isn't even tried to be preserved. The received-time and saved-time are written to the metadata block inside the file. From mark.zealey at webfusion.com Sat Dec 10 13:32:23 2011 From: mark.zealey at webfusion.com (Mark Zealey) Date: Sat, 10 Dec 2011 13:32:23 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> <1323498507.15365.130.camel@hurina> <4EE33C8E.9050005@webfusion.com> Message-ID: <4EE34347.7040007@webfusion.com> 10-12-2011 13:07, Timo Sirainen yazm??: >> It could well be because of the conversion to sdbox then - the ctime/mtime of the files are not being preserved by dsync (in stock 2.0.16). The date.saved timestamp is only put into the cache on the second dsync run; presumably therefore it picks it up from the filesystem. > With sdbox the file's mtime isn't even tried to be preserved. The received-time and saved-time are written to the metadata block inside the file. Ah yes; I saw the R metadata but not the C header key. Looking deeper at this I think I was expecting the date.save time to be about the same as the date.receive; however the ctime for these files is quite recent presumably affected by setting of message flags in a maildir or something (we're using nfs). The source cache says: - date.received: 1301978447 (4f9d9a4d) - date.save: 1322465550 (0e39d34e) The message file itself has mtime 1301978447 and ctime 1323514077; and in the sdbox header/metadata we have: C4ee3391a R4d9a9d4f so ctime/sdbox C entry are close enough by my calculations (not sure where the 61 seconds of difference comes from though). It is a bit strange you wouldn't use the source cache's value for date.save if it is available as ctime can be pretty unreliable? Mark From tss at iki.fi Sat Dec 10 14:13:57 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 10 Dec 2011 14:13:57 +0200 Subject: [Dovecot] using dsync to convert mailboxes looses caching options In-Reply-To: <4EE34347.7040007@webfusion.com> References: <4ED114DA.7030707@webfusion.com> <1323323637.15365.85.camel@hurina>, <1323329624.15365.87.camel@hurina> , <1323336440.15365.95.camel@hurina> , <420B5E34BFEE9646B7198438F9978AE223E320C7@mail01.internal.webfusion.com> <1323498507.15365.130.camel@hurina> <4EE33C8E.9050005@webfusion.com> <4EE34347.7040007@webfusion.com> Message-ID: <8A79B07C-80A5-4535-BD0A-58BB0D7D4A36@iki.fi> On 10.12.2011, at 13.32, Mark Zealey wrote: > 10-12-2011 13:07, Timo Sirainen yazm??: >>> It could well be because of the conversion to sdbox then - the ctime/mtime of the files are not being preserved by dsync (in stock 2.0.16). The date.saved timestamp is only put into the cache on the second dsync run; presumably therefore it picks it up from the filesystem. >> With sdbox the file's mtime isn't even tried to be preserved. The received-time and saved-time are written to the metadata block inside the file. > > Ah yes; I saw the R metadata but not the C header key. The C is the file's create time. It's not actually use for anything. > Looking deeper at this I think I was expecting the date.save time to be about the same as the date.receive; however the ctime for these files is quite recent presumably affected by setting of message flags in a maildir or something (we're using nfs). Yes, maildir flag changes change the ctime, which also changes the save date if it's not already cached. > so ctime/sdbox C entry are close enough by my calculations (not sure where the 61 seconds of difference comes from though). It is a bit strange you wouldn't use the source cache's value for date.save if it is available as ctime can be pretty unreliable? It is using the the cached value. Anyway, I remembered wrong how sdbox's save date is looked up. It's taken from the sdbox file's ctime. The reason is similar to maildir: The save date is used mainly to figure out when to automatically expunge messages from Trash after it's been there for n days. So if you copy 1 year old message to Trash, you don't want it expunged immediately (based on mtime or some metadata inside the file), you want it expunged n days since the move. And ctime is really the only nice way to do it automatically, because copying a message with sdbox is done with hard linking. mdbox stores the save date in the index file. sdbox could do it too, but that's just extra work and probably not worth the trouble. And unlink atime/mtime, ctime can't be changed using any syscalls (except to current time). So, I think everything here works as intended, although not really as expected. :) From listen at constabel.net Sat Dec 10 16:10:31 2011 From: listen at constabel.net (Mike Constabel) Date: Sat, 10 Dec 2011 15:10:31 +0100 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <1323493708.15365.103.camel@hurina> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> <1323335981.15365.90.camel@hurina> <1323493708.15365.103.camel@hurina> Message-ID: <20111210141031.GL22136@herakles.constabel-it.de> Hi, Timo Sirainen schrieb am Saturday, den 10. December 2011: > On Thu, 2011-12-08 at 11:19 +0200, Timo Sirainen wrote: > > On Thu, 2011-12-08 at 09:55 +0100, Mike Constabel wrote: > > > > > As you see there is a second "-" in the name: > > > > > > "T&APw-r" != "T&-APw-r" > > > > Oh, right, it's broken in the "fs" layout. With "maildir++" layout it > > works. And looks like this isn't going to be an easy fix. The fs layout > > listing code is horrible.. Maybe I'll just try rewriting it. > > OK, this should do it, hopefully without breaking anything: > http://hg.dovecot.org/dovecot-2.1/rev/ab696ead12cc > This works for me with a litte problem. If I create in TB folder like "moe" (without special chars) the folder will be created, subscribed and TB shows the folder instantly. But if I create a folder like "m?" (with special chars) the folder will be created, subscribed and *TB doesn't show the folder*. I must unsubscribe and subscribe it in TB to show it in folder pane. Mike From user+dovecot at localhost.localdomain.org Sat Dec 10 17:39:26 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 10 Dec 2011 16:39:26 +0100 Subject: [Dovecot] 2.1.rc1 (51d87deb5c26): %{gid} modification problem Message-ID: <4EE37D2E.9020700@localhost.localdomain.org> I tried to apply the X modifier to the %{gid} variable: 'mail_attachment_dir = /srv/mail/.SiS/%X{gid}'. But the name of the created directory is '0', instead of '11172'. Regards, Pascal -- The trapper recommends today: c01dcofe.1134416 at localdomain.org From user+dovecot at localhost.localdomain.org Sat Dec 10 18:09:07 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 10 Dec 2011 17:09:07 +0100 Subject: [Dovecot] 2.1.rc1 (51d87deb5c26): %{gid} modification problem In-Reply-To: <4EE37D2E.9020700@localhost.localdomain.org> References: <4EE37D2E.9020700@localhost.localdomain.org> Message-ID: <4EE38423.3010604@localhost.localdomain.org> On 12/10/2011 04:39 PM Pascal Volk wrote: > But the name of the created directory is '0', instead of '11172'. 0 was the hex version of a empty string. For now I've reverted changeset 499e4916bed5. This brings the content of %{gid} back and %X{gid} works now as expected. Regards, Pascal -- The trapper recommends today: beeffeed.1134417 at localdomain.org From user+dovecot at localhost.localdomain.org Sat Dec 10 18:46:31 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 10 Dec 2011 17:46:31 +0100 Subject: [Dovecot] 2.1.rc1 (51d87deb5c26): %{gid} modification problem In-Reply-To: <4EE38423.3010604@localhost.localdomain.org> References: <4EE37D2E.9020700@localhost.localdomain.org> <4EE38423.3010604@localhost.localdomain.org> Message-ID: <4EE38CE7.8010405@localhost.localdomain.org> On 12/10/2011 05:09 PM Pascal Volk wrote: > ? For now I've reverted changeset 499e4916bed5. OK, I found the problem. You forgot to append the GID to the var_expand_table before returning it. The attached patch works fine for me. It also adds the short variable %g. I hope that's OK. Regards, Pascal -- The trapper recommends today: beeffeed.1134417 at localdomain.org -------------- next part -------------- A non-text attachment was scrubbed... Name: lib-storage.patch Type: text/x-patch Size: 1590 bytes Desc: not available URL: From dieterknopf at googlemail.com Mon Dec 12 02:42:48 2011 From: dieterknopf at googlemail.com (Dieter Knopf) Date: Mon, 12 Dec 2011 01:42:48 +0100 Subject: [Dovecot] Refiltering mails without loosing flags Message-ID: Hello, is there a way to refilter all mails in a folder without loosing all flags and moving all messages in a different folder? I have >10k mails in my Inbox and need to create new filterrules from time to time. But there is no way to refilter my inbox without moving. Atm i need to move all mails in a folder like "refilter" and then run getmail/... to refilter the mails. It would be really nice to refilter a existing folder and just move mails with hits in the filter list. Thanks Dieter From tss at iki.fi Mon Dec 12 06:39:38 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 06:39:38 +0200 Subject: [Dovecot] 2.1.rc1 (51d87deb5c26): %{gid} modification problem In-Reply-To: <4EE38CE7.8010405@localhost.localdomain.org> References: <4EE37D2E.9020700@localhost.localdomain.org> <4EE38423.3010604@localhost.localdomain.org> <4EE38CE7.8010405@localhost.localdomain.org> Message-ID: <1323664781.15365.174.camel@hurina> On Sat, 2011-12-10 at 17:46 +0100, Pascal Volk wrote: > On 12/10/2011 05:09 PM Pascal Volk wrote: > > ? For now I've reverted changeset 499e4916bed5. > > OK, I found the problem. You forgot to append the GID to the > var_expand_table before returning it. The attached patch works fine for me. Yes, fixed that :) > It also adds the short variable %g. I hope that's OK. I think %{gid} is used so rarely that it doesn't really need a short variable. It probably would be better in future to avoid short variables entirely in most places. I also did larger changes to mail-storage-service.c so that in situations when %var expansion is done while running as root, the uid/gid expand properly instead of expanding to 0. This probably happens with some doveadm -A commands or something.. From tss at iki.fi Mon Dec 12 06:53:49 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 06:53:49 +0200 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <20111210141031.GL22136@herakles.constabel-it.de> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> <1323335981.15365.90.camel@hurina> <1323493708.15365.103.camel@hurina> <20111210141031.GL22136@herakles.constabel-it.de> Message-ID: <1323665629.15365.176.camel@hurina> On Sat, 2011-12-10 at 15:10 +0100, Mike Constabel wrote: > > OK, this should do it, hopefully without breaking anything: > > http://hg.dovecot.org/dovecot-2.1/rev/ab696ead12cc > > > > This works for me with a litte problem. > > > If I create in TB folder like "moe" (without special chars) the > folder will be created, subscribed and TB shows the folder > instantly. > > But if I create a folder like "m?" (with special chars) the > folder will be created, subscribed and *TB doesn't show the > folder*. I must unsubscribe and subscribe it in TB to show it in > folder pane. http://hg.dovecot.org/dovecot-2.1/rev/b9fcac239aed should fix it. From listen at constabel.net Mon Dec 12 10:41:04 2011 From: listen at constabel.net (Mike Constabel) Date: Mon, 12 Dec 2011 09:41:04 +0100 Subject: [Dovecot] dovecot 2.1.rc1 and folders with umlauts In-Reply-To: <1323665629.15365.176.camel@hurina> References: <20111207170505.GI22136@herakles.constabel-it.de> <1323317897.15365.58.camel@hurina> <20111208085514.GJ22136@herakles.constabel-it.de> <1323335981.15365.90.camel@hurina> <1323493708.15365.103.camel@hurina> <20111210141031.GL22136@herakles.constabel-it.de> <1323665629.15365.176.camel@hurina> Message-ID: <20111212084103.GB6838@herakles.constabel-it.de> On Mon, 12 Dec 2011, Timo Sirainen wrote: > On Sat, 2011-12-10 at 15:10 +0100, Mike Constabel wrote: > > > OK, this should do it, hopefully without breaking anything: > > > http://hg.dovecot.org/dovecot-2.1/rev/ab696ead12cc > > > > > > > This works for me with a litte problem. > > > > > > If I create in TB folder like "moe" (without special chars) the > > folder will be created, subscribed and TB shows the folder > > instantly. > > > > But if I create a folder like "m?" (with special chars) the > > folder will be created, subscribed and *TB doesn't show the > > folder*. I must unsubscribe and subscribe it in TB to show it in > > folder pane. > > http://hg.dovecot.org/dovecot-2.1/rev/b9fcac239aed should fix it. > Yes, it works. Thanks. Mike From listen at constabel.net Mon Dec 12 11:46:15 2011 From: listen at constabel.net (Mike Constabel) Date: Mon, 12 Dec 2011 10:46:15 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts Message-ID: <20111212094615.GD6838@herakles.constabel-it.de> Hi, now the umlauts problem with sieve: # cat /mailspool1/in-preetz.de/test1/.dovecot.sieve ## Generated by Roundcube Webmail SieveRules Plugin ## require ["fileinto"]; # rule:[Test] if anyof (header :contains "Subject" "test") { fileinto "m&APY-"; } Error: DBBjDsXL5U7mIAAA/TNBsA: sieve: execution of script /mailspool1/in-preetz.de/test1/.dovecot.sieve failed, but implicit keep was successful (user logfile /mailspool1/in-preetz.de/test1/.dovecot.sieve.log may reveal additional details) # cat /mailspool1/in-preetz.de/test1/.dovecot.sieve.log sieve: info: started log at Dec 12 10:40:04. error: msgid=<20111212094004.DB86918594 at mx4.constabel-it.de>: failed to store into mailbox 'm&APY-': Mailbox doesn't exist: m&-APY-. Here the same: 'm&APY-' != "m&-APY-" Mike From tss at iki.fi Mon Dec 12 11:58:51 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 11:58:51 +0200 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <20111212094615.GD6838@herakles.constabel-it.de> References: <20111212094615.GD6838@herakles.constabel-it.de> Message-ID: <10C93BD1-CE99-423E-BB13-3DD5C28A83E7@iki.fi> On 12.12.2011, at 11.46, Mike Constabel wrote: > now the umlauts problem with sieve: .. > ## Generated by Roundcube Webmail SieveRules Plugin ## Roundcube bug/"feature". > fileinto "m&APY-"; Sieve uses UTF-8 mailbox names. The reason why Roundcube doesn't use them, is because some old Cyrus Sieve versions didn't use UTF-8. From stephan at rename-it.nl Mon Dec 12 12:00:23 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 12 Dec 2011 11:00:23 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <20111212094615.GD6838@herakles.constabel-it.de> References: <20111212094615.GD6838@herakles.constabel-it.de> Message-ID: <4EE5D0B7.8000208@rename-it.nl> Op 12/12/2011 10:46 AM, Mike Constabel schreef: > Hi, > > now the umlauts problem with sieve: > > # cat /mailspool1/in-preetz.de/test1/.dovecot.sieve > ## Generated by Roundcube Webmail SieveRules Plugin ## > require ["fileinto"]; > > # rule:[Test] > if anyof (header :contains "Subject" "test") > { > fileinto "m&APY-"; > } And here it is actually correct. Sieve fileinto expects the argument to be in utf8 and you are passing the IMAP mutf7. Use fileinto "m?"; instead. Regards, Stephan. From listen at constabel.net Mon Dec 12 12:08:22 2011 From: listen at constabel.net (Mike Constabel) Date: Mon, 12 Dec 2011 11:08:22 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <10C93BD1-CE99-423E-BB13-3DD5C28A83E7@iki.fi> References: <20111212094615.GD6838@herakles.constabel-it.de> <10C93BD1-CE99-423E-BB13-3DD5C28A83E7@iki.fi> Message-ID: <20111212100822.GA27466@herakles.constabel-it.de> Hello, On 2011-12-12 at 10:58 CET Timo Sirainen wrote: > On 12.12.2011, at 11.46, Mike Constabel wrote: > > > now the umlauts problem with sieve: > .. > > ## Generated by Roundcube Webmail SieveRules Plugin ## > > Roundcube bug/"feature". > > > fileinto "m&APY-"; > > Sieve uses UTF-8 mailbox names. The reason why Roundcube doesn't use them, is because some old Cyrus Sieve versions didn't use UTF-8. Ok, good to know. I found the setting in the roundcube sieverules plugin. After setting this to UTF-8 it works. Thanks for the hint. Mike From listen at constabel.net Mon Dec 12 12:10:10 2011 From: listen at constabel.net (Mike Constabel) Date: Mon, 12 Dec 2011 11:10:10 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <4EE5D0B7.8000208@rename-it.nl> References: <20111212094615.GD6838@herakles.constabel-it.de> <4EE5D0B7.8000208@rename-it.nl> Message-ID: <20111212101010.GB27466@herakles.constabel-it.de> Hello Stephan, On 2011-12-12 at 11:00 CET Stephan Bosch wrote: > Op 12/12/2011 10:46 AM, Mike Constabel schreef: > >Hi, > > > >now the umlauts problem with sieve: > > > ># cat /mailspool1/in-preetz.de/test1/.dovecot.sieve > >## Generated by Roundcube Webmail SieveRules Plugin ## > >require ["fileinto"]; > > > ># rule:[Test] > >if anyof (header :contains "Subject" "test") > >{ > > fileinto "m&APY-"; > >} > > And here it is actually correct. Sieve fileinto expects the argument > to be in utf8 and you are passing the IMAP mutf7. > > Use > > fileinto "m?"; > > instead. Thanks for the hint, now it works. :) Mike From stephan at rename-it.nl Mon Dec 12 12:25:29 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 12 Dec 2011 11:25:29 +0100 Subject: [Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts In-Reply-To: <20111212100822.GA27466@herakles.constabel-it.de> References: <20111212094615.GD6838@herakles.constabel-it.de> <10C93BD1-CE99-423E-BB13-3DD5C28A83E7@iki.fi> <20111212100822.GA27466@herakles.constabel-it.de> Message-ID: <4EE5D699.4020805@rename-it.nl> Op 12/12/2011 11:08 AM, Mike Constabel schreef: > Hello, > > On 2011-12-12 at 10:58 CET Timo Sirainen wrote: >> On 12.12.2011, at 11.46, Mike Constabel wrote: >>> ## Generated by Roundcube Webmail SieveRules Plugin ## >> Roundcube bug/"feature". >>> fileinto "m&APY-"; >> Sieve uses UTF-8 mailbox names. The reason why Roundcube doesn't use them, is because some old Cyrus Sieve versions didn't use UTF-8. > Ok, good to know. I found the setting in the roundcube sieverules > plugin. After setting this to UTF-8 it works. For posterity: The following setting of the Roundcube Sieverules plugin is relevant to solve this issue (from config.inc.php.dist): // Sieve RFC says that we should use UTF-8 encoding for mailbox names, // but some implementations does not covert UTF-8 to modified UTF-7. // set to null for default behaviour $rcmail_config['sieverules_folder_encoding'] = null; Setting it to 'UTF-8' resolves the issue. Regards, Stephan. From nick.z.edwards at gmail.com Mon Dec 12 13:25:14 2011 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Mon, 12 Dec 2011 21:25:14 +1000 Subject: [Dovecot] database failover In-Reply-To: <4EE3320C.2050607@schetterer.org> References: <4EE3320C.2050607@schetterer.org> Message-ID: Thanks, we considered options, ruled out master-master for security, and since everything is with mysql (AAA) we decided not to introduce another database type, we only use a few servers, so we might use a cron job every minute to test for db response and if fails drop interface, returns up interface, as we use linux HA solution, so if the heartbeat fails it ignores it, and other alerting will notify us eventually if it stays down, not optimum I know, in fact darn right messy, but it'll suffice until Dovecot offers such a solution. On Sat, Dec 10, 2011 at 8:18 PM, Robert Schetterer wrote: > Am 10.12.2011 11:07, schrieb Nick Edwards: > > Trying to get dovecot to _only_ use local copy of database, only querying > > another database server (same database, just replicated) if local copy is > > not responding, I have google fu'd a bit and found my only answer in so > far > > as dovecot did this once upon as time, but it was only due to a dovecot > > bug, that has since been fixed, is that so? > > The wiki shows no information of failover, just load sharing, or is it an > > undocumented feature, or can dovecot not do failover, if not, can it be > > made so? > > > > Trying to cut down on network traffic, postfix does this nicely, I > thought > > dovecot did too. > > > > as far i know recent dovecot cant do it > youre right postfix does > > you can do a master-master setup i.e with mysql > solving this > works nice here, but might not be the best solution > perhaps ldap, or other databases are better > -- > Best Regards > > MfG Robert Schetterer > > Germany/Munich/Bavaria > From nick.z.edwards at gmail.com Mon Dec 12 13:26:31 2011 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Mon, 12 Dec 2011 21:26:31 +1000 Subject: [Dovecot] database failover In-Reply-To: <994B8A50-1BF9-47D3-8DB1-2E150E975E05@iki.fi> References: <994B8A50-1BF9-47D3-8DB1-2E150E975E05@iki.fi> Message-ID: Hello Timo, On Sat, Dec 10, 2011 at 8:26 PM, Timo Sirainen wrote: > On 10.12.2011, at 12.07, Nick Edwards wrote: > > > Trying to get dovecot to _only_ use local copy of database, only querying > > another database server (same database, just replicated) if local copy is > > not responding, I have google fu'd a bit and found my only answer in so > far > > as dovecot did this once upon as time, but it was only due to a dovecot > > bug, that has since been fixed, is that so? > > The wiki shows no information of failover, just load sharing, or is it an > > undocumented feature, or can dovecot not do failover, if not, can it be > > made so? > > > > Trying to cut down on network traffic, postfix does this nicely, I > thought > > dovecot did too. > > You could add two passdbs + userdbs with different configs. The second dbs > would be used when first db is down, but also for unknown users / wrong > authentications. > > But yeah, the load balancing should be optional. There are just so many > other things to do as well.. > > Yes, it would be nice, but I understand you have many things on your todo list. From stephan at rename-it.nl Mon Dec 12 13:43:59 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 12 Dec 2011 12:43:59 +0100 Subject: [Dovecot] Refiltering mails without loosing flags In-Reply-To: References: Message-ID: <4EE5E8FF.8080306@rename-it.nl> Op 12/12/2011 1:42 AM, Dieter Knopf schreef: > is there a way to refilter all mails in a folder without loosing all > flags and moving all messages in a different folder? > > I have>10k mails in my Inbox and need to create new filterrules from > time to time. But there is no way to refilter my inbox without moving. > > Atm i need to move all mails in a folder like "refilter" and then run > getmail/... to refilter the mails. It would be really nice to refilter > a existing > folder and just move mails with hits in the filter list. Since last week, the new sieve-filter command line tool, which is intended for just such a task, is part of the normal compile output for Pigeonhole 0.3.x for Dovecot v2.1. Unfortunately, it is not released yet, so I guess you're stuck with your old getmail-based solution for now. The tool is still experimental and I must say that I have not tested the preservation of flags for some time and many changes were performed since then. I will verify that later today. Also, the interaction with the new editheader extension needs attention. Regards, Stephan. From janfrode at tanso.net Mon Dec 12 13:44:20 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 12 Dec 2011 12:44:20 +0100 Subject: [Dovecot] database failover In-Reply-To: References: <4EE3320C.2050607@schetterer.org> Message-ID: <20111212114420.GA14077@dibs.tanso.net> On Mon, Dec 12, 2011 at 09:25:14PM +1000, Nick Edwards wrote: > Thanks, we considered options, ruled out master-master for security, and > since everything is with mysql (AAA) we decided not to introduce another > database type, But LDAP master-master is sooo nice :-) and once you have your users in LDAP it's triviall to re-use it as user source in lots of services (postfix lookups, authenticated smtp, apache basic auth, dovecot, etc..). To get away from our SPoF mysql userdatabase I wrote some scripts that checkes for changes in the mysql userdatabase, and push these to LDAP every x minutes. The mysql-database is still our master user source, but I'm looking forward to getting rid of it completely real soon now. -jf From marcio.merlone at a1.ind.br Mon Dec 12 13:57:40 2011 From: marcio.merlone at a1.ind.br (Marcio Merlone) Date: Mon, 12 Dec 2011 09:57:40 -0200 Subject: [Dovecot] Documentation clarifiction on mmap_disable Message-ID: <4EE5EC34.5020803@a1.ind.br> Greetings, On http://wiki.dovecot.org/MainConfig I read: "mmap_disable = no Don't use mmap() at all. This is required if you store indexes to shared filesystems (NFS or clustered filesystem). " Does that mean: 1. mmap is required when using NFS or 2. it is required to don't use mmap at all when using NFS? Sorry if this is obvious. Best regards. -- *Marcio Merlone* From tss at iki.fi Mon Dec 12 14:21:02 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 14:21:02 +0200 Subject: [Dovecot] Documentation clarifiction on mmap_disable In-Reply-To: <4EE5EC34.5020803@a1.ind.br> References: <4EE5EC34.5020803@a1.ind.br> Message-ID: <9FFD4EC1-791C-43B8-B80B-F53FE891AFDA@iki.fi> On 12.12.2011, at 13.57, Marcio Merlone wrote: > On http://wiki.dovecot.org/MainConfig I read: > > "mmap_disable = no > Don't use mmap() at all. This is required if you store indexes to > shared filesystems (NFS or clustered filesystem). " The wording is a bit too strong, but..: > Does that mean: > > 1. mmap is required when using NFS or > 2. it is required to don't use mmap at all when using NFS? It's better not to use mmap() with NFS. 1. mmap_disable=yes is required if you attempt to access the same mailbox from more than one Dovecot server, otherwise index files get corrupted really easily. But even with this setting this setup isn't safe! http://wiki2.dovecot.org/NFS explains the problems. 2. mmap_disable=yes is a good idea with NFS even if there's only one Dovecot server, since it should be more optimal and also failures are handled better. 3. mmap_disable=yes is a good idea with cluster filesystems, since it should make the performance better. 4. With local filesystems mmap_disable=no should be faster. From scott_the_musician at yahoo.com.au Mon Dec 12 15:02:05 2011 From: scott_the_musician at yahoo.com.au (Scott Lewis) Date: Mon, 12 Dec 2011 05:02:05 -0800 (PST) Subject: [Dovecot] simultaneous scripts not running via sieve_before Message-ID: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> Hi again everyone, So I've finally got sieve integration happening on my? REHL Postfix/Dovecot server, with private user scripts happily running when users create them. (we user SquirrelMail, so the avelsieve plugin runs the sieve integration). Now I'd like to utilise additional per-user scripts (probably via sieve_before), but I've not been able to get my additional scripts to execute. I am doing the following: a) getting avelsieve to write my redirect script (ie. logging on as user, completing private script wizard, and activating it) b) compiling .dovecot.sieve with sievec c) copying the resultant .dovecot.svbin to sieve/ directory (and renaming it eg redirect.svbin still, it appears that each /home/%u/.dovecot.sieve file is the only one taking effect. Any thoughts on how to make the other ones active? (The idea behind this is to automatically forward all of joeuser at mydomain's incoming mail to somewhere like joeusersbackup at gmail.com, for backup reasons. One day, I'll work out how to configure postfix to do this for all outgoing email too, but that's for another day :) Below are what my .conf files look like. Thanks in advance, Scott /etc/dovecot.conf: [code] protocols = imap imaps managesieve listen = * protocol imap { #mail_plugins = sieve quota } ## ## ManageSieve specific settings ## protocol managesieve { # debugging mail_debug = yes #login_executable = /usr/libexec/dovecot/managesieve-login ?#mail_executable = /usr/libexec/dovecot/managesieve #managesieve_max_line_length = 65536 #managesieve_logout_format = bytes ( in=%i : out=%o ) #managesieve_implementation_string = Cyrus timsieved v2.2.13 } protocol lda { mail_plugins = sieve quota sieve=~/.dovecot.sieve sieve_extentions = +include sieve_dir=~/sieve sieve_before = /home/%u/sieve/redirect.svbin sieve_global_path = /etc/globalsieverc.svbin [/code] From ajb2 at mssl.ucl.ac.uk Mon Dec 12 15:22:50 2011 From: ajb2 at mssl.ucl.ac.uk (Alan Brown) Date: Mon, 12 Dec 2011 13:22:50 +0000 Subject: [Dovecot] IMAP SPECIAL-USE extension In-Reply-To: References: Message-ID: <4EE6002A.1000302@mssl.ucl.ac.uk> > Date: Wed, 07 Dec 2011 00:49:49 +0200 > From: Timo Sirainen > Subject: Re: [Dovecot] IMAP SPECIAL-USE extension > > I did this: http://hg.dovecot.org/dovecot-2.1/rev/9b9a206395f7 Just to add to the confusion: Pine/Alpine uses "sent-mail" :( From selcuk.yazar at gmail.com Mon Dec 12 15:49:36 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Mon, 12 Dec 2011 15:49:36 +0200 Subject: [Dovecot] postlogin script In-Reply-To: References: <1323320772.15365.68.camel@hurina> <1323334517.15365.88.camel@hurina> Message-ID: Hi again, show plain passwrod works perfectly. But i have little problem about prefetch. we have users inda openldap username at domain.edu.tr, so, users login their user name to check their emails. after I opened prefetc property, users cannot acceees maildir directory, they use username at domain.edu.trdirectories and they cannot see emails on web (squireel mail). (becouse we migrate our server) our structure domain\username\Maildir, but after prefetch thay try to look in webmail ( also outlook etc. client download email again) domain\username at domain.edu.tr\cur,new etc can we fix this ? thanks. On Thu, Dec 8, 2011 at 10:58 AM, Selcuk Yazar wrote: > Hi, > > i 'sorry, my mistake, it shold be > pass_attrs = uid=user,userPassword=password, *=userdb_plaintext_pass=%w* > > as you said it must contain *equal sign* before userdb_plaintext_pass=%w, > i missed it. > > thank you very much it works.! > > sel?uk > > > On Thu, Dec 8, 2011 at 10:55 AM, Timo Sirainen wrote: > >> On Thu, 2011-12-08 at 10:40 +0200, Selcuk Yazar wrote: >> > Hi, >> > >> > i applied settingsin below but dovecot says that >> > >> > " prefetch(.. at ....edu.tr,IP_ADDRESS): passdb didn't return userdb >> entries, >> > trying the next userdb >> > " >> >> That's why I said make the userdb prefetch work first, the way described >> in: >> >> > > http://wiki2.dovecot.org/UserDatabase/Prefetch >> >> You'll need to add stuff to your pass_attrs. It doesn't work >> automatically. >> >> >> > > > -- > Sel?uk YAZAR > http://www.selcukyazar.blogspot.com > -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From duihi77 at gmail.com Mon Dec 12 15:57:59 2011 From: duihi77 at gmail.com (Duane Hill) Date: Mon, 12 Dec 2011 13:57:59 +0000 Subject: [Dovecot] simultaneous scripts not running via sieve_before In-Reply-To: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> References: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> Message-ID: <1329235723.20111212135759@gmail.com> On Monday, December 12, 2011 at 13:02:05 UTC, scott_the_musician at yahoo.com.au confabulated: > Hi again everyone, > So I've finally got sieve integration happening on my? REHL > Postfix/Dovecot server, with private user scripts happily running > when users create them. (we user SquirrelMail, so the avelsieve > plugin runs the sieve integration). > Now I'd like to utilise additional per-user scripts (probably via > sieve_before), but I've not been able to get my additional scripts to execute. > I am doing the following: > a) getting avelsieve to write my redirect script (ie. logging on as > user, completing private script wizard, and activating it) > b) compiling .dovecot.sieve with sievec > c) copying the resultant .dovecot.svbin to sieve/ directory (and renaming it eg redirect.svbin > still, it appears that each /home/%u/.dovecot.sieve file is the > only one taking effect. Any thoughts on how to make the other ones > active? (The idea behind this is to automatically forward all of > joeuser at mydomain's incoming mail to somewhere like > joeusersbackup at gmail.com, for backup reasons. One day, I'll work out > how to configure postfix to do this for all outgoing email too, but that's for another day :) > Below are what my .conf files look like. Thanks in advance, > Scott > /etc/dovecot.conf: > [code] > protocols = imap imaps managesieve > listen = * > protocol imap { > #mail_plugins = sieve quota > } > ## > ## ManageSieve specific settings > ## > protocol managesieve { > # debugging > mail_debug = yes > #login_executable = /usr/libexec/dovecot/managesieve-login > ?#mail_executable = /usr/libexec/dovecot/managesieve > #managesieve_max_line_length = 65536 > #managesieve_logout_format = bytes ( in=%i : out=%o ) > #managesieve_implementation_string = Cyrus timsieved v2.2.13 > } > protocol lda { > mail_plugins = sieve quota > sieve=~/.dovecot.sieve > sieve_extentions = +include > sieve_dir=~/sieve > sieve_before = /home/%u/sieve/redirect.svbin > sieve_global_path = /etc/globalsieverc.svbin > [/code] sieve_before and sieve_after are directories where extra scripts are run sequentially before user scripts and after user scripts. See: http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration -- If at first you don't succeed, so much for skydiving. From knud.dombrowsky at graband.de Mon Dec 12 18:25:15 2011 From: knud.dombrowsky at graband.de (Knud Dombrowsky) Date: Mon, 12 Dec 2011 17:25:15 +0100 Subject: [Dovecot] Syncing shared mailboxes Message-ID: <4EE62AEB.2020607@graband.de> Hi, while trying to sync the mailboxes of several users who use and share their mailboxes dsync prints this message: dsync-local(): Warning: Subscriptions file /home//Maildir/subscriptions: Removing invalid entry: shared// The problem is: Every user has to subscribe the shared folder again after each run of dsync... Is dsync capable of syncing shared mailboxes? Are there any preliminaries to do so? thanks in advance, Knud From stephan at rename-it.nl Mon Dec 12 18:25:33 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 12 Dec 2011 17:25:33 +0100 Subject: [Dovecot] simultaneous scripts not running via sieve_before In-Reply-To: <1329235723.20111212135759@gmail.com> References: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> <1329235723.20111212135759@gmail.com> Message-ID: <4EE62AFD.90700@rename-it.nl> Op 12/12/2011 2:57 PM, Duane Hill schreef: > On Monday, December 12, 2011 at 13:02:05 UTC, scott_the_musician at yahoo.com.au confabulated: >> protocol lda { >> mail_plugins = sieve quota >> sieve=~/.dovecot.sieve >> sieve_extentions = +include >> sieve_dir=~/sieve >> sieve_before = /home/%u/sieve/redirect.svbin >> sieve_global_path = /etc/globalsieverc.svbin >> [/code] > sieve_before and sieve_after are directories where extra scripts are > run sequentially before user scripts and after user scripts. See: > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration It can be a file, but then it must point to the sieve script (in this case redirect.sieve) and not to the compiled binary (redirect.svbin in this case). Regards, Stephan. From selcuk.yazar at gmail.com Mon Dec 12 18:34:07 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Mon, 12 Dec 2011 18:34:07 +0200 Subject: [Dovecot] Prevent re-download mails Message-ID: Hi, today we have a problem our mail server about user accounts. (something about prefetch) anyway i corrected, but some clients re-download emails again. how can i stop this .I've read about some forums about UIDVALIDITY ? is it posibble prevent clients redownload emails with pop3 ? thanks in advance. -- Sel?uk YAZAR From tss at iki.fi Mon Dec 12 19:04:40 2011 From: tss at iki.fi (Timo Sirainen) Date: Mon, 12 Dec 2011 19:04:40 +0200 Subject: [Dovecot] Prevent re-download mails In-Reply-To: References: Message-ID: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> On 12.12.2011, at 18.34, Selcuk Yazar wrote: > today we have a problem our mail server about user accounts. (something > about prefetch) anyway i corrected, but some clients re-download emails > again. > how can i stop this .I've read about some forums about UIDVALIDITY ? This isn't enough information to give a useful answer. > is it posibble prevent clients redownload emails with pop3 ? http://wiki2.dovecot.org/Migration#POP3_migration basically explains the redownloading.. From wgrcunha at gmail.com Mon Dec 12 19:11:43 2011 From: wgrcunha at gmail.com (Francisco Wagner C. Freire) Date: Mon, 12 Dec 2011 15:11:43 -0200 Subject: [Dovecot] Prevent re-download mails In-Reply-To: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> References: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> Message-ID: Hello, I got the same problem today, anyone have the this problem? Started few minutes ago. My pop3 server have this uidl setting: pop3_uidl_format = %f and the version 2.0.12, not changed anything in the last monts and got today this problem with lots of clients. Looking for more info. On Mon, Dec 12, 2011 at 3:04 PM, Timo Sirainen wrote: > On 12.12.2011, at 18.34, Selcuk Yazar wrote: > > > today we have a problem our mail server about user accounts. (something > > about prefetch) anyway i corrected, but some clients re-download emails > > again. > > how can i stop this .I've read about some forums about UIDVALIDITY ? > > This isn't enough information to give a useful answer. > > > is it posibble prevent clients redownload emails with pop3 ? > > http://wiki2.dovecot.org/Migration#POP3_migration basically explains the > redownloading.. > > From oni-neko at gmx.net Mon Dec 12 19:18:18 2011 From: oni-neko at gmx.net (oni-neko at gmx.net) Date: Mon, 12 Dec 2011 18:18:18 +0100 Subject: [Dovecot] question regarding postfixadmin Message-ID: <20111212171818.266530@gmx.net> Hello! I hope someone here is already using postfixadmin with dovecot and can help me out =) the install-readme for postfixadmin mentions, that the mail-home should be set to default_mail_env = maildir:/var/mail/vmail/%u/ but my dovecot is already installed and working with another config, namely mail_location = maildir:/var/dovecotmail/%n/Maildir. Do i have to change this, or is postfixadmin able to read this or can i set this value in postfixadmin somewhere? i?d rather avoid moving all mailfolders around just because of that, and unfortunately the paths don?t really lend themself to an easy solution via symlink ^_^ thanks for any replies best regards sil -- Empfehlen Sie GMX DSL Ihren Freunden und Bekannten und wir belohnen Sie mit bis zu 50,- Euro! https://freundschaftswerbung.gmx.de From wgrcunha at gmail.com Mon Dec 12 19:18:28 2011 From: wgrcunha at gmail.com (Francisco Wagner C. Freire) Date: Mon, 12 Dec 2011 15:18:28 -0200 Subject: [Dovecot] Prevent re-download mails In-Reply-To: <00a201ccb8f1$b58e9030$20abb090$@vdschagt.com> References: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> <00a201ccb8f1$b58e9030$20abb090$@vdschagt.com> Message-ID: Hello, The clients re-download the messages on every connection, i current looking for the client versions with this problem. On Mon, Dec 12, 2011 at 3:15 PM, Wouter van der Schagt wrote: > > Looking for more info. > > Even with the same UIDL values, some e-mail clients will still redownload > the messages if a hostname changed. > > Anyway, annoying as it is, after the second download it will stop, you can > ask your users to simply delete the duplicates, it won't download a 3rd > time. > > - WS > > From andrew at oc384.net Mon Dec 12 22:17:12 2011 From: andrew at oc384.net (Andrew M) Date: Mon, 12 Dec 2011 14:17:12 -0600 Subject: [Dovecot] Saving archive copy of all mail sent/received w/Dovecot+Postfix? Message-ID: <4EE66148.2000904@oc384.net> I'm running Dovecot 2.0.15 and Postfix 2.7.7 with postfix handing off to Dovecot's LDA. I am hosting multiple virtual domains with multiple users and everything is working. I would now like to create a permanent archive of all sent/received mail with each virtual user's mail saved to its own sent file and received file. This needs to be independent of the user's regular Maildir store since he can't delete or modify the permanent archive. Any suggestions on how to best accomplish this either via postfix or dovecot? Postfix has in main.cf virtual_transport = dovecot and in master.cf dovecot unix - n n - - pipe flags=DRhu user=virtual:virtual argv=/usr/libexec/dovecot /dovecot-lda -d ${recipient} -f ${sender} dovecot uses this: [root at xxx andrew]# dovecot -n # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.35.14-103.fc14.x86_64 x86_64 Fedora release 14 (Laughlin) ext4 auth_mechanisms = plain login cram-md5 disable_plaintext_auth = no mail_location = maildir:/home/vmail/%d/%n/Maildir mbox_write_locks = fcntl passdb { args = scheme=plain username_format=%u /etc/postfix/passwd driver = passwd-file } protocols = imap lmtp service auth { inet_listener { port = 12345 } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0666 } } ssl_cert = Hi, TLS on imap port 143 works. But if I try TLS on managesieve port 4190, I get no connection. Dec 12 21:16:10 managesieve-login: Info: Disconnected (no auth attempts in 5 secs): rip=192.168.10.117, lip=192.168.10.117, secured Dec 12 21:16:20 managesieve-login: Info: Disconnected (no auth attempts in 5 secs): rip=192.168.10.117, lip=192.168.10.117, TLS handshaking: Disconnected # gnutls-cli --starttls -p 4190 192.168.10.117 Resolving '192.168.10.117'... Connecting to '192.168.10.117:4190'... - Simple Client Mode: "IMPLEMENTATION" "Dovecot Pigeonhole" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave" "NOTIFY" "mailto" "SASL" "PLAIN LOGIN CRAM-MD5" "STARTTLS" "VERSION" "1.0" OK "Dovecot ready." STARTTLS NO "Begin TLS negotiation now." ^ There is a NO and not an OK... Possible something wrong with my config, but I cannot find something... # doveconf -n # 2.1.rc1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 6.0.3 auth_cache_size = 1 M auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login cram-md5 auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot/dovecot-debug.log default_client_limit = 2600 dict { expire = sqlite:/etc/dovecot/dovecot-dict-expire.conf.ext } disable_plaintext_auth = no hostname = mx4.constabel-it.de info_log_path = /var/log/dovecot/dovecot-info.log log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_location = mdbox:~/mdbox mail_plugins = quota notify mail_log expire acl mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Archive/2011 { auto = subscribe } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = scheme=PLAIN username_format=%u /etc/imap.userdb driver = passwd-file } plugin { expire = Trash expire2 = Trash/* expire3 = Spam expire_dict = proxy::expire quota = dict:User quota::file:/mailspool1/%d/%n/dovecot-quota quota_rule = *:storage=9000M:messages=1000000 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at localhost protocols = " imap lmtp sieve pop3" service auth { inet_listener { address = 192.168.10.117 port = 12345 } } service dict { unix_listener dict { group = vmail mode = 0666 } } service imap-login { inet_listener imap { address = 192.168.10.117 port = 143 } inet_listener imaps { address = 192.168.10.117 port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = 192.168.10.117 port = 24 } } service managesieve-login { inet_listener sieve { address = 192.168.10.117 port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { address = 192.168.10.117 port = 110 } inet_listener pop3s { address = 192.168.10.117 port = 995 ssl = yes } } ssl_ca = References: <20111212203055.GC27466@herakles.constabel-it.de> Message-ID: <4EE66C2E.6050001@rename-it.nl> On 12/12/2011 9:30 PM, Mike Constabel wrote: > Hi, > > > TLS on imap port 143 works. > > But if I try TLS on managesieve port 4190, I get no connection. > > Dec 12 21:16:10 managesieve-login: Info: Disconnected (no auth attempts in 5 secs): rip=192.168.10.117, lip=192.168.10.117, secured > Dec 12 21:16:20 managesieve-login: Info: Disconnected (no auth attempts in 5 secs): rip=192.168.10.117, lip=192.168.10.117, TLS handshaking: Disconnected [..] > NO "Begin TLS negotiation now." My bad. By the looks of things you are using the automatic Debian repository. Currently, these builds are a bit tainted by a couple of patches of mine, which apparently caused problems once more. As not to frustrate generic debugging any further, I have removed these patches from the normal v2.1 builds. I did fix this bug, but I'll start a separate builder for the patched packages that I need for a project of mine. If all goes well, new untainted packages should roll out within the hour. Regards, Stephan. From selcuk.yazar at gmail.com Mon Dec 12 23:19:53 2011 From: selcuk.yazar at gmail.com (Selcuk Yazar) Date: Mon, 12 Dec 2011 23:19:53 +0200 Subject: [Dovecot] Prevent re-download mails In-Reply-To: References: <0E6761D7-B709-4432-86CF-B09005BDB68B@iki.fi> <00a201ccb8f1$b58e9030$20abb090$@vdschagt.com> Message-ID: Hi, i give more detail our problem, i edited configuration dovecot for show plain text password(and use postlogin feature), after that, maildir location property (it comes from ldap attribute) changed with domain extension. so some client can't show mails on web interface (squirrel), after that i disabled showing-logging plaintext password, and some client download mails again. in conf file we have %u property , if i sould this change with %n , we don't have this problem :) . now if i change this uidl format can i prevent re-download mails again ? sorry for my english thanks in advance. On Mon, Dec 12, 2011 at 7:18 PM, Francisco Wagner C. Freire < wgrcunha at gmail.com> wrote: > Hello, > > The clients re-download the messages on every connection, i current looking > for the client versions with this problem. > > On Mon, Dec 12, 2011 at 3:15 PM, Wouter van der Schagt > wrote: > > > > Looking for more info. > > > > Even with the same UIDL values, some e-mail clients will still redownload > > the messages if a hostname changed. > > > > Anyway, annoying as it is, after the second download it will stop, you > can > > ask your users to simply delete the duplicates, it won't download a 3rd > > time. > > > > - WS > > > > > -- Sel?uk YAZAR http://www.selcukyazar.blogspot.com From dovecot at digitalforplay.com Tue Dec 13 01:49:22 2011 From: dovecot at digitalforplay.com (A Dovecot User) Date: Mon, 12 Dec 2011 17:49:22 -0600 Subject: [Dovecot] Panic when attempting index with Apache Solr : fts_solr plugin In-Reply-To: <1323321743.15365.74.camel@hurina> References: <4ED91D34.3050906@digitalforplay.com> <1323321743.15365.74.camel@hurina> Message-ID: <4EE69302.5050705@digitalforplay.com> Over the weekend I updated the OS on the machine in question to Fedora 15, which should have updated libcurl in the process, and I'm still getting the same error message. I also moved Solr to another server instead of trying to use it on the local box, but that didn't seem to make a difference. On 12/07/2011 11:22 PM, Timo Sirainen wrote: > On Fri, 2011-12-02 at 12:47 -0600, A Dovecot User wrote: >> [root at mymailserver ~]# doveadm -D index -u username mailbox inbox > The "mailbox" isn't necessary above. > >> doveadm(username): Info: INBOX: Caching mails seq=1..466 >> doveadm(username): Panic: file solr-connection.c: line 545 >> (solr_connection_post_more): assertion failed: (maxfd >= 0) > This happens every time? It can't index any mails at all? Have you tried > with Dovecot v2.0? > > I can't reproduce it. Anyway I guess either I'm using libcurl wrong > somehow, or there's a bug in libcurl.. > > From erang at jungo.com Mon Dec 12 20:30:13 2011 From: erang at jungo.com (Eran Guy) Date: Mon, 12 Dec 2011 18:30:13 +0000 (UTC) Subject: [Dovecot] =?utf-8?q?mail=5Fmax=5Fuserip=5Fconnections=3D10?= References: <002d01cc76a5$ff88f970$fe9aec50$@elysium.ltd.uk> <2ED64BFB-87F1-40B2-A489-226031A4633C@iki.fi> Message-ID: Timo Sirainen iki.fi> writes: > > On 19.9.2011, at 11.27, Tom Clark wrote: > > > Is there anyway of whitelisting an IP so that it can ignore > > mail_max_userip_connections=10? > > With v2.0 in theory: > > remote 1.2.3.4 { > mail_max_userip_connections = 0 > } > > I don't know if it actually works. Not sure I follow- in which conf file would it be appropriate to place this? Is it possible to maintain separate values for the same config directive? (I'm having a similar problem with iOS devices connecting to our server- they seem to open multiple connections, easily going over 10 if they have many subscribed directories). Thanks, -E- From joseba.torre at ehu.es Tue Dec 13 10:50:00 2011 From: joseba.torre at ehu.es (Joseba Torre) Date: Tue, 13 Dec 2011 09:50:00 +0100 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <20111204151602.Horde.tWy1GVeGiNBO29UCBMPVY2A@www.cnysupport.com> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204151602.Horde.tWy1GVeGiNBO29UCBMPVY2A@www.cnysupport.com> Message-ID: <4EE711B8.2040201@ehu.es> El 04/12/11 21:16, Terry Carmen escribi?: >> So I was thinking that there probably could be some tool that during a >> user's backup it would write the attachments among the user's other >> files, so it would be easy to find all of the files needed for a >> restore. This would of course mean that backups can take a lot more >> space, because there's no SIS. Perhaps there could be some other > > > I see. > > Instead of writing the links directly to the filesystem, why not keep a > links list (not a linked list 8-)) file in each directory that contains > the information for the links that should be there (source, dest, > attributes), then add an inotify hook in Dovecot to create/update/delete > the hard links in the directory so they match the links list? > > The links list would only need to be opened when there's a change and > could remain closed (and backup-able) at all other times, and restoring > a links list would immediately trigger the inotify hook and regenerate > all the required links. > > Terry Sorry for joining late this thread, but this is a very important issue for us. Terry's solution feels great: just a little modification of the mdbox, adding a ?text? file with the list of attachment files, that is modified every time an attachment is added/deleted. With that, it seems quite easy to modify our mailbox recovery script to something like: - recover the mailbox as now - recover every attachment file that file points to. Other option: a new doveadm option that could generate this list, and then recover the mailbox, generate the list, recover the attachments. Also: no change needed to the backup process itself, and that's good news. From tss at iki.fi Tue Dec 13 10:56:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 13 Dec 2011 10:56:20 +0200 Subject: [Dovecot] Questions about single intance storage In-Reply-To: <4EE711B8.2040201@ehu.es> References: <20111204141058.201500@gmx.com> <20111204124129.Horde.hn45SVeGiNBO27DJwgL1Y5A@www.cnysupport.com> <20111204151602.Horde.tWy1GVeGiNBO29UCBMPVY2A@www.cnysupport.com> <4EE711B8.2040201@ehu.es> Message-ID: On 13.12.2011, at 10.50, Joseba Torre wrote: > Terry's solution feels great: just a little modification of the mdbox, adding a ?text? file with the list of attachment files, that is modified every time an attachment is added/deleted. I'd rather not implement that. It makes dbox more fragile and less efficient. > With that, it seems quite easy to modify our mailbox recovery script to something like: > - recover the mailbox as now > - recover every attachment file that file points to. > > Other option: a new doveadm option that could generate this list, and then recover the mailbox, generate the list, recover the attachments. That would be possible. You could actually already do it with v2.1's "doveadm dump", which outputs dbox file's metadata. From Juergen.Obermann at hrz.uni-giessen.de Tue Dec 13 12:47:01 2011 From: Juergen.Obermann at hrz.uni-giessen.de (=?iso-8859-1?b?SvxyZ2Vu?= Obermann) Date: Tue, 13 Dec 2011 11:47:01 +0100 Subject: [Dovecot] dsync error Mailbox has children, delete them first Message-ID: <20111213114701.185112l8l37ih0yo@webmail.hrz.uni-giessen.de> Hi, I use dsync to backup mailboxes from mbox format to mdbox on a remote system. The first run for a user with dsync is OK, but during the second there are lots of the following errors: dsync-remote(user): Error: Can't delete mailbox directory Example: Mailbox has children, delete them first I see no way how I could influence the order dsync deletes mailboxes. This happens with dovecot version 2.0.16 Thank you, Juergen Obermann From leolistas at solutti.com.br Tue Dec 13 13:39:52 2011 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Tue, 13 Dec 2011 09:39:52 -0200 Subject: [Dovecot] dovecot penalties and anvil Message-ID: <4EE73988.1090000@solutti.com.br> Hi, I'm strugling to find some documentation on dovecot's anvil service and/or its penalties (that can be checked with doveadm penalty) ... but i'm not finding anything on that. is there any documentation on anvil/penalties that i should check other than a few messages on the mailing list archive ? thanks ! -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From asai at globalchangemusic.org Wed Dec 14 01:21:09 2011 From: asai at globalchangemusic.org (Asai) Date: Tue, 13 Dec 2011 16:21:09 -0700 Subject: [Dovecot] Backing Up To Windows File Server Message-ID: <4EE7DDE5.3070605@globalchangemusic.org> Greetings, Working with dsync and setting up backups to a Windows file server. Problem seems to be that Windows is renaming the dovecot mail files (maildir) to Windows friendly filenames, and losing the Dovecot name. For example, 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S becomes 1AETPH~X. Does anyone have any ideas about how to tell Windows to not do this? Or is it not possible? -- --asai From dovecot at r.paypc.com Wed Dec 14 01:50:19 2011 From: dovecot at r.paypc.com (Robin) Date: Tue, 13 Dec 2011 15:50:19 -0800 Subject: [Dovecot] Dovecot 2.1rc1 + 2.0.16 woes regarding fts_squat Message-ID: <4EE7E4BB.2040008@r.paypc.com> I can confirm the report posted in http://dovecot.org/list/dovecot/2011-November/062263.html that fts_squat no longer seems to be used after moving from 2.0.16->2.1 rc 1. I don't see crash reports in the logs, just "0 messages indexed". My search test tool just does a normal IMAP SEARCH for a long non-existent string. If there's another way to trigger re-indexing in 2.1, I don't see anything in the documentation for it. I've enabled mail_debug, but no log entries that shed light on the problem are available. Has the configuration for fts_squat changed? If anyone has a working fts_squat setup with Dovecot 2.1rc1, I'd appreciate hearing how you have it setup and working. During a large mail import with 2.0.16 today, I ran across a worrying message in the logs during an fts_squat reindex: out of memory. The plugin doesn't obey the mmap_disable configuration directive, which I've confirmed in the plugin source. The mailbox in question has only 17GB (mdbox style), with about 90,000 emails in it. Its "index" (for the purposes of normal IMAP retrieval as opposed to IMAP TEXT/BODY searching) is fine and uncorrupted. I freshly import these mailboxes between test iterations and any version changes anyway, so if there's corruption, it's happening within dovecot only. I'm using use Mail::IMAPClient to create + append mail over localhost, not any direct mdbox conversion trickery. In looking through the code, I see that mmap() is called for the *ENTIRE FILE*, which is guaranteed to fail on large indexes. I assume this was done out of expedience, but it's a "risky" sort of thing to do in a server process, even if 8GB RAM systems do seem to grow on trees. I intend to put this to work in a large installation (>10K users), so this IS of some concern for me in the long-term. Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: mremap_anon(188084224) failed: Cannot allocate memory Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: read(.../mdbox/mailboxes/INBOX2010/dbox-Mails/dovecot.index.search.uids) failed: Cannot allocate memory Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: mremap_anon(188280832) failed: Cannot allocate memory Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: read(.../mdbox/mailboxes/INBOX2010/dbox-Mails/dovecot.index.search.uids) failed: Cannot allocate memory Dec 12 22:50:47 linuxcode dovecot: imap(user1001): Error: Corrupted squat uidlist file .../mdbox/mailboxes/INBOX2010/dbox-Mails/dovecot.index.search.uids: uidlist not found ================ dovecot -n output: # 2.0.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.35.7-smp i686 Slackware 13.1.0 auth_mechanisms = plain cram-md5 digest-md5 apop default_vsz_limit = 192 M disable_plaintext_auth = no first_valid_gid = 100 hostname = linuxcode info_log_path = /tmp/dovecot.log last_valid_gid = 60000 last_valid_uid = 60000 listen = * mail_location = mdbox:~/mdbox mail_plugins = " zlib acl" mdbox_preallocate_space = yes mdbox_rotate_interval = 1 days mmap_disable = yes passdb { args = scheme=plain /etc/cram-md5.pwd driver = passwd-file } plugin { acl = vfile } postmaster_address = postmaster at linuxcode quota_full_tempfail = yes service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 0 vsz_limit = 64 M } service imap { vsz_limit = 512 M } service lmtp { unix_listener lmtp { mode = 0666 } } ssl = no userdb { args = blocking=no driver = passwd } protocol lmtp { mail_plugins = " zlib acl" } protocol imap { mail_plugins = " zlib acl fts fts_squat imap_acl imap_zlib" plugin { fts = squat fts_squat = partial=4 full=10 } } ================ CONFIGURE ================ LIBS=-lnsl CFLAGS='-O2 -march=core2 -mtune=core2 -fstack-protector -fomit-frame-pointer' \ CXXFLAGS='-O2 -march=core2 -mtune=core2 -fstack-protector -fomit-frame-pointer' \ LDFLAGS=-s ./configure --prefix=/usr --sysconfdir=/etc \ --with-mysql --with-sqlite --with-pgsql --without-pam --with-sql \ --with-libwrap --with-libcap -with-ssl=openssl --with-solr \ --with-mem-align=16 --with-bzlib --with-zlib --localstatedir=/var ================ OS: Slackware 13.1 (32-bit, 2GB physical RAM, kernel setup for 2G/2G split) fully patched up =R= From jerry at seibercom.net Wed Dec 14 02:34:38 2011 From: jerry at seibercom.net (Jerry) Date: Tue, 13 Dec 2011 19:34:38 -0500 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE7DDE5.3070605@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> Message-ID: <20111213193438.69c57904@scorpio> On Tue, 13 Dec 2011 16:21:09 -0700 Asai articulated: > Working with dsync and setting up backups to a Windows file server. > Problem seems to be that Windows is renaming the dovecot mail files > (maildir) to Windows friendly filenames, and losing the Dovecot name. > For example, > 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > becomes 1AETPH~X. > > Does anyone have any ideas about how to tell Windows to not do this? > Or is it not possible? I have backed up files to a Windows server before but have never experienced the problems you are describing. Could you please list the Windows Server specifics, ie. version, etc. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From duihi77 at gmail.com Wed Dec 14 03:16:33 2011 From: duihi77 at gmail.com (Duane Hill) Date: Wed, 14 Dec 2011 01:16:33 +0000 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE7DDE5.3070605@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> Message-ID: <341320.20111214011633@gmail.com> On Tuesday, December 13, 2011 at 23:21:09 UTC, asai at globalchangemusic.org confabulated: > Greetings, > Working with dsync and setting up backups to a Windows file server. > Problem seems to be that Windows is renaming the dovecot mail files > (maildir) to Windows friendly filenames, and losing the Dovecot name. > For example, > 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > becomes 1AETPH~X. > Does anyone have any ideas about how to tell Windows to not do this? Or > is it not possible? AFAIK, the colon is not valid in a windows file name. -- If at first you don't succeed, so much for skydiving. From brad at omnis.com Wed Dec 14 03:41:54 2011 From: brad at omnis.com (Brad Schuetz) Date: Tue, 13 Dec 2011 17:41:54 -0800 Subject: [Dovecot] Two recent issues In-Reply-To: <1323496696.15365.124.camel@hurina> References: <4EE26BDF.4080500@omnis.com> <1323496696.15365.124.camel@hurina> Message-ID: <4EE7FEE2.6040701@omnis.com> On 12/09/2011 09:58 PM, Timo Sirainen wrote: > If auth process dies unexpectedly, master always logs an error, such as: > > Dec 10 07:15:34 auth: Fatal: master: service(auth): child 27895 killed with signal 11 (core dumped) > > Anyway, "read(imap) failed: Connection reset by peer" can happen if you > reach the service imap { process_limit }. But then there should be a > warning logged about it also: > > Dec 10 07:17:39 master: Warning: service(imap): process_limit reached, client connections are being dropped > > So, that error message alone shouldn't be happening.. Interesting, the log entries I provided were the only ones that did exist. > If that happens, there would also be an error message logged about it. > One thing that v2.0 doesn't log about is if auth socket gets > disconnected, but that would result in different problems. v2.1 logs > about that too. The problem has vanished in the last couple of days. When 2.1 comes out I will upgrade and if the problem returns I'll see if it's logs have any further information. >> The second issue is lmtp/lda (tried both) delivery to a mailbox that has >> filesystem quotas enabled and the group quota is maxed is resulting in >> the below panic and crash. >> >> 11:21:07 [err] dovecot: lmtp(29691, admin@[redacted].com): Error: >> o_stream_send_istream(/email/d/r/[redacted]/[redacted]/admin/Maildir/tmp/1323458467.M245978P29691.fenrir.omnis.com) >> failed: Disk quota exceeded >> 11:21:07 [crit] dovecot: lmtp(29691, admin@[redacted].com): Panic: file >> ostream-zlib.c: line 144 (o_stream_zlib_send_flush): assertion failed: >> (zs->avail_in == 0) > > I couldn't reproduce this with my tests, but > http://hg.dovecot.org/dovecot-2.0/rev/75daa638281b should fix it. > This patch has corrected the issue I was seeing. Thank you very much. From lists at luigirosa.com Wed Dec 14 07:38:07 2011 From: lists at luigirosa.com (Luigi Rosa) Date: Wed, 14 Dec 2011 06:38:07 +0100 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE7DDE5.3070605@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> Message-ID: <4EE8363F.30303@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Asai said the following on 14/12/11 00:21: > Working with dsync and setting up backups to a Windows file server. > Problem seems to be that Windows is renaming the dovecot mail files > (maildir) to Windows friendly filenames, and losing the Dovecot name. For > example, > 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > > becomes 1AETPH~X. > > Does anyone have any ideas about how to tell Windows to not do this? Or is > it not possible? Got same problem rsync-ing to some low cost NAS and, of course, windows share. My solution is to tar.gz before copying to Windows. Ciao, luigi - -- / +--[Luigi Rosa]-- \ Ask ten different scientists about the environment, population control, genetics, and you'll get ten different answers, but there's one thing every scientist on the planet agrees on. Whether it happens in a hundred years or a thousand years or a million years, eventually our Sun will grow cold and go out. When that happens, it won't just take us. It'll take Marilyn Monroe, and Lao-Tzu, and Einstein, and Morobuto, and Buddy Holly, and Aristophanes... [and] all of this... all of this... was for nothing. Unless we go to the stars. --Jeffrey Sinclair, "Infection" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk7oNjYACgkQ3kWu7Tfl6ZTaBACaAmu1MtZkcBEGxMM3iXfezLpr KEsAnjczFO4QVnIcHtvC2MbWGbU7AuO2 =cGog -----END PGP SIGNATURE----- From nmilas at noa.gr Wed Dec 14 12:47:05 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Wed, 14 Dec 2011 12:47:05 +0200 Subject: [Dovecot] Quota warnings not being sent Message-ID: <4EE87EA9.5050503@noa.gr> Hello, I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7 with the config shown below. All accounts are virtual, hosted on LDAP Server. My problem is that the quota warning mail is not sent as expected. For example, in the logs I get: Dec 12 08:42:40 vmail dovecot: lda(imaptester): Error: quota: net_connect_unix(/var/run/dovecot/quota-warning) failed: Permission denied (euid=500(vmail) egid=500(vmail) missing +r perm: /var/run/dovecot/quota-warning, euid is not dir owner) Here is /var/run/dovecot/: # ls -la /var/run/dovecot/ total 32 drwxr-xr-x 4 root dovecot 4096 Dec 9 21:27 . drwxr-xr-x 23 root root 4096 Dec 14 12:27 .. srw------- 1 root root 0 Dec 9 21:27 anvil srw------- 1 root root 0 Dec 9 21:27 anvil-auth-penalty srw------- 1 root root 0 Dec 9 21:27 auth-client srw------- 1 dovecot root 0 Dec 9 21:27 auth-login srw-rw---- 1 vmail vmail 0 Dec 9 21:27 auth-master srw------- 1 root root 0 Dec 9 21:27 auth-userdb srw------- 1 dovecot root 0 Dec 9 21:27 auth-worker srw------- 1 root root 0 Dec 9 21:27 config srw------- 1 root root 0 Dec 9 21:27 dict srw------- 1 root root 0 Dec 9 21:27 director-admin srw-rw-rw- 1 root root 0 Dec 9 21:27 dns-client srw------- 1 root root 0 Dec 9 21:27 doveadm-server lrwxrwxrwx 1 root root 25 Dec 9 21:27 dovecot.conf -> /etc/dovecot/dovecot.conf drwxr-xr-x 2 root root 4096 May 17 2011 empty drwxr-x--- 2 root dovenull 4096 Dec 9 21:27 login -rw------- 1 root root 5 Dec 9 21:27 master.pid srw------- 1 root root 0 Dec 9 21:27 quota-warning Follows my config (at the end of this message). How should I change permissions to resolve the issue? Would it be enough to change ownership of the whole directory /var/run/dovecot/ and its contents to vmail:vmail? What configuration directives determine the ownership and the access permissions for these sockets? Please advise. Thanks in advance, Nick ------------------------------------------ # 2.0.13: dovecot.conf protocols = imap pop3 mail_location = maildir:~/Maildir/ mail_gid = 500 mail_uid = 500 auth_mechanisms = plain login auth_username_format = %Lu auth_verbose = yes disable_plaintext_auth = no mail_plugins = quota protocol imap { imap_client_workarounds = "delay-newmail " mail_plugins = quota imap_quota } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = log_path = mail_plugins = quota postmaster_address = sysadmin at example.com sendmail_path = /usr/lib/sendmail } userdb { args = /etc/dovecot/dovecot-usrdb-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-passdb-ldap.conf driver = ldap } plugin { quota = maildir:User quota quota_rule = *:storage=4G quota_rule2 = Trash:storage=+3%% quota_warning = storage=75%% quota-warning 75 %u quota_warning2 = storage=90%% quota-warning 90 %u } service quota-warning { executable = script /opt/mail1.sh user = root unix_listener quota-warning { } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service imap-login { service_count = 1 vsz_limit = 64 M } service pop3-login { service_count = 1 vsz_limit = 64 M } ssl_ca = From tlx at leuxner.net Wed Dec 14 13:06:00 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Wed, 14 Dec 2011 12:06:00 +0100 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE87EA9.5050503@noa.gr> References: <4EE87EA9.5050503@noa.gr> Message-ID: <20111214110559.GA15164@nihlus.leuxner.net> On Wed, Dec 14, 2011 at 12:47:05PM +0200, Nikolaos Milas wrote: > For example, in the logs I get: > Dec 12 08:42:40 vmail dovecot: lda(imaptester): Error: quota: > net_connect_unix(/var/run/dovecot/quota-warning) failed: Permission > denied (euid=500(vmail) egid=500(vmail) missing +r perm: > /var/run/dovecot/quota-warning, euid is not dir owner) service quota-warning { executable = script /opt/mail1.sh user = vmail unix_listener quota-warning { } } I'd guess setting the user to 'vmail' here solves the problem: http://wiki2.dovecot.org/Quota/Configuration Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From nmilas at noa.gr Wed Dec 14 13:40:19 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Wed, 14 Dec 2011 13:40:19 +0200 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <20111214110559.GA15164@nihlus.leuxner.net> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> Message-ID: <4EE88B23.90609@noa.gr> On 14/12/2011 1:06 ??, Thomas Leuxner wrote: > I'd guess setting the user to 'vmail' here solves the problem Thank you for the reply. No, this did not solve the problem. I changed to vmail service quota-warning { executable = script /opt/mail1.sh user = vmail unix_listener quota-warning { } } and did a full restart: # service dovecot restart Again: Dec 14 13:30:11 vmail dovecot: lda(tester): Error: quota: net_connect_unix(/var/run/dovecot/quota-warning) failed: Permission denied (euid=500(vmail) egid=500(v mail) missing +r perm: /var/run/dovecot/quota-warning, euid is not dir owner) And still, the socket is owned by root: # ls -la /var/run/dovecot/ total 32 drwxr-xr-x 4 root dovecot 4096 Dec 14 13:20 . drwxr-xr-x 23 root root 4096 Dec 14 13:27 .. ... srw------- 1 root root 0 Dec 14 13:20 quota-warning Any suggestions? Thanks, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From pw at wk-serv.de Wed Dec 14 14:24:31 2011 From: pw at wk-serv.de (Patrick Westenberg) Date: Wed, 14 Dec 2011 13:24:31 +0100 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE88B23.90609@noa.gr> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> Message-ID: <4EE8957F.8090101@wk-serv.de> Nikolaos Milas schrieb: > No, this did not solve the problem. I changed to vmail > > service quota-warning { > executable = script /opt/mail1.sh > user = vmail > unix_listener quota-warning { > } > } This is what works for me: service quota-warning { executable = script /usr/local/etc/dovecot/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } From leolistas at solutti.com.br Wed Dec 14 14:33:14 2011 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Wed, 14 Dec 2011 10:33:14 -0200 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE8957F.8090101@wk-serv.de> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> <4EE8957F.8090101@wk-serv.de> Message-ID: <4EE8978A.2030409@solutti.com.br> Em 14/12/11 10:24, Patrick Westenberg escreveu: > > This is what works for me: > > service quota-warning { > executable = script /usr/local/etc/dovecot/quota-warning.sh > unix_listener quota-warning { > user = vmail > } > user = vmail > } My configurations are similar to Patrick ones and works just fine: service quota-warning { executable = script /etc/dovecot/aviso-quota.sh user = dovecot unix_listener quota-warning { user = mail } } plugin { quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=85%% quota-warning 85 %u quota_warning3 = storage=70%% quota-warning 70 %u quota_exceeded_message = Quota excedida (caixa postal cheia) / Quota exceeded (mailbox is full) } -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From tlx at leuxner.net Wed Dec 14 15:02:37 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Wed, 14 Dec 2011 14:02:37 +0100 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE8978A.2030409@solutti.com.br> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> <4EE8957F.8090101@wk-serv.de> <4EE8978A.2030409@solutti.com.br> Message-ID: <20111214130237.GB15164@nihlus.leuxner.net> On Wed, Dec 14, 2011 at 10:33:14AM -0200, Leonardo Rodrigues wrote: > service quota-warning { > executable = script /etc/dovecot/aviso-quota.sh > user = dovecot > unix_listener quota-warning { > user = mail > } > } Right, looks like the Wiki Example needs to be revamped... [ 90-quota.conf ] matches the real life examples posted: # Example quota-warning service. The unix listener's permissions should be # set in a way that mail processes can connect to it. Below example assumes # that mail processes run as vmail user. If you use mode=0666, all system users # can generate quota warnings to anyone. #service quota-warning { # executable = script /usr/local/bin/quota-warning.sh # user = dovecot # unix_listener quota-warning { # user = vmail # } #} From forall at stalowka.info Wed Dec 14 14:49:39 2011 From: forall at stalowka.info (For@ll) Date: Wed, 14 Dec 2011 13:49:39 +0100 Subject: [Dovecot] Autosubscribe new folders Message-ID: Hi, I have a sieve filter: require ["fileinto","reject","body"]; if header :contains "subject" "NOTE" { if body :content "application/pdf" :contains "" { redirect "notes at domena.com"; } else { reject text: Lack attachment PDF! . ; stop; } } When I get a new message, in user folder is automaticly created folder like subject but is not subscribed. What I must settings in dovecot to automaticly subscribe folders to subscriptions files.? From dg at dguhl.org Wed Dec 14 18:20:00 2011 From: dg at dguhl.org (Dennis Guhl) Date: Wed, 14 Dec 2011 17:20:00 +0100 Subject: [Dovecot] Autosubscribe new folders In-Reply-To: References: Message-ID: <20111214161958.GA2843@PC211.ikt.de> On Wed, Dec 14, 2011 at 01:49:39PM +0100, For at ll wrote: > Hi, [..] > When I get a new message, in user folder is automaticly created > folder like subject but is not subscribed. What I must settings in > dovecot to automaticly subscribe folders to subscriptions files.? Add lda_mailbox_autosubscribe = yes to 15-lda.conf (or wherever you defined lda_mailbox_autocreate = yes). Dennis From asai at globalchangemusic.org Wed Dec 14 19:17:58 2011 From: asai at globalchangemusic.org (Asai) Date: Wed, 14 Dec 2011 10:17:58 -0700 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <20111213193438.69c57904@scorpio> References: <4EE7DDE5.3070605@globalchangemusic.org> <20111213193438.69c57904@scorpio> Message-ID: <4EE8DA46.5090003@globalchangemusic.org> On 12/13/2011 5:34 PM, Jerry wrote: > On Tue, 13 Dec 2011 16:21:09 -0700 > Asai articulated: > >> Working with dsync and setting up backups to a Windows file server. >> Problem seems to be that Windows is renaming the dovecot mail files >> (maildir) to Windows friendly filenames, and losing the Dovecot name. >> For example, >> 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S >> becomes 1AETPH~X. >> >> Does anyone have any ideas about how to tell Windows to not do this? >> Or is it not possible? > I have backed up files to a Windows server before but have never > experienced the problems you are describing. Could you please list the > Windows Server specifics, ie. version, etc. This is a Win 2008 R2 server with NFS shares enabled. I initially copied the backups from my former backup server to this Windows box, and that's when I noticed the file names had been changed. From jerry at seibercom.net Wed Dec 14 19:24:03 2011 From: jerry at seibercom.net (Jerry) Date: Wed, 14 Dec 2011 12:24:03 -0500 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE8DA46.5090003@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> <20111213193438.69c57904@scorpio> <4EE8DA46.5090003@globalchangemusic.org> Message-ID: <20111214122403.17d6af91@scorpio> On Wed, 14 Dec 2011 10:17:58 -0700 Asai articulated: > On 12/13/2011 5:34 PM, Jerry wrote: > > On Tue, 13 Dec 2011 16:21:09 -0700 > > Asai articulated: > > > >> Working with dsync and setting up backups to a Windows file server. > >> Problem seems to be that Windows is renaming the dovecot mail files > >> (maildir) to Windows friendly filenames, and losing the Dovecot > >> name. For example, > >> 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > >> becomes 1AETPH~X. > >> > >> Does anyone have any ideas about how to tell Windows to not do > >> this? Or is it not possible? > > I have backed up files to a Windows server before but have never > > experienced the problems you are describing. Could you please list > > the Windows Server specifics, ie. version, etc. > This is a Win 2008 R2 server with NFS shares enabled. I initially > copied the backups from my former backup server to this Windows box, > and that's when I noticed the file names had been changed. IMHO, I think you might be better served by posting your inquiry to a Microsoft forum dedicated to the 2008 server framework. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From lists at luigirosa.com Wed Dec 14 19:34:52 2011 From: lists at luigirosa.com (Luigi Rosa) Date: Wed, 14 Dec 2011 18:34:52 +0100 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE8D467.3030904@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> <4EE8363F.30303@luigirosa.com> <4EE8D467.3030904@globalchangemusic.org> Message-ID: <4EE8DE3C.1010507@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Asai said the following on 14/12/11 17:52: > Thanks, Luigi, I may fall back to that. Should you need it, here's the script I use to do it. In my configurations /var/spool/mail contains one dir for each domain and each of that dir contains a maildir for each domain. So the email of foobar at acme.com is in /var/spool/mail/acme.com/foobar/ The 4th line checks lost&found because /bar/spool/mail is a different file system. I create the .tgz file on local /tmp for performance reasons. TARGET=/backup for DOMAINPATH in /var/spool/mail/* do if [ "${DOMAINPATH}" != "/var/spool/mail/lost+found" ] then DOMAIN=`echo $DOMAINPATH | cut -d '/' -f 5` for USERPATH in ${DOMAINPATH}/* do USER=`echo $USERPATH | cut -d '/' -f 6` tar cvzf /tmp/$DOMAIN-$USER.tgz $USERPATH > /dev/null cp -f /tmp/$DOMAIN-$USER.tgz $TARGET/mail rm -f /tmp/$DOMAIN-$USER.tgz done fi done Ciao, luigi - -- / +--[Luigi Rosa]-- \ I don't think we have the right or the wisdom to interfere, however a planet is evolving. --James Kirk, "The Omega Glory" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk7o3jYACgkQ3kWu7Tfl6ZSfpQCgvzhOJH6mnJMu8ZzvKu5y8um+ 46wAoKd0eXxBNPad9EZao7VKjZBkACer =dhk0 -----END PGP SIGNATURE----- From nmilas at noa.gr Wed Dec 14 19:52:24 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Wed, 14 Dec 2011 19:52:24 +0200 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE8978A.2030409@solutti.com.br> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> <4EE8957F.8090101@wk-serv.de> <4EE8978A.2030409@solutti.com.br> Message-ID: <4EE8E258.2080801@noa.gr> Thank you all for your help. Changing from: unix_listener quota-warning { } to: unix_listener quota-warning { user = vmail } solved the problem! Now my quota warning message is being sent successfully. I think I'll now open a new thread on how to send rich/UTF-8 mail warnings. Thanks again, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From leolistas at solutti.com.br Wed Dec 14 21:10:26 2011 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Wed, 14 Dec 2011 17:10:26 -0200 Subject: [Dovecot] Quota warnings not being sent In-Reply-To: <4EE8E258.2080801@noa.gr> References: <4EE87EA9.5050503@noa.gr> <20111214110559.GA15164@nihlus.leuxner.net> <4EE88B23.90609@noa.gr> <4EE8957F.8090101@wk-serv.de> <4EE8978A.2030409@solutti.com.br> <4EE8E258.2080801@noa.gr> Message-ID: <4EE8F4A2.8060507@solutti.com.br> Em 14/12/11 15:52, Nikolaos Milas escreveu: > > I think I'll now open a new thread on how to send rich/UTF-8 mail > warnings. > > Probably you just need to format/encode it properly ... no big deal on that. -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From maria_arrea at gmx.com Wed Dec 14 23:10:36 2011 From: maria_arrea at gmx.com (Maria Arrea) Date: Wed, 14 Dec 2011 22:10:36 +0100 Subject: [Dovecot] Question about index reset in dovecot 2.0.15 Message-ID: <20111214211036.55980@gmx.com> I have seen some strange error log messages in our dovecot server (2.0.15, RHEL 5.7x64, mdbox+zlib, local storage, high load) Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Dec 14 20:56:46 buzon dovecot: imap(rcam): Error: Corrupted index cache file /indices_dovecot/indices/03/6b/rcam/mailboxes/INBOX/dovecot.index.cache: Broken virtual size for mail UID 132197 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox INBOX I have been googling without luck, why does this happen? I have tried with doveadm force-resync, maybe this could solve this issues. doveconf -n output # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-274.7.1.el5 x86_64 Red Hat Enterprise Linux Server release 5.7 (Tikanga) ext4 auth_cache_negative_ttl = 10 secs auth_cache_size = 10 M auth_cache_ttl = 2 mins auth_master_user_separator = * auth_mechanisms = plain login auth_worker_max_count = 3500 base_dir = /var/run/dovecot/ default_client_limit = 5000 default_process_limit = 6500 disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep delay-newmail tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_fsync = never mail_gid = entrega mail_home = /buzones/domain/%2.26Hn/%2.200Hn/%n/home_usuario/ mail_location = mdbox:/buzones/domain/%2.26Hn/%2.200Hn/%n:INDEX=/indices_dovecot/indices/%2.26Hn/%2.200Hn/%n mail_max_userip_connections = 15000 mail_plugins = " zlib acl quota autocreate" mail_uid = entrega managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mdbox_rotate_interval = 1 days mdbox_rotate_size = 60 M passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/usuario_maestro.txt driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile autocreate = SPAM autocreate2 = Sent autocreate3 = Drafts autocreate4 = Trash autosubscribe = SPAM autosubscribe2 = Sent autosubscribe3 = Drafts autosubscribe4 = Trash lda_mailbox_autosubscribe = yes quota = dict:Cuota de usuario::file:/buzones/cuotas/%n quota_rule2 = Trash:storage=+10%% quota_warning = storage=90%% aviso_cuota 90 %u sieve = /buzones/domain/%2.26Hn/%2.200Hn/%n/home_usuario/dovecot.sieve sieve_dir = /buzones/domain/%2.26Hn/%2.200Hn/%n/home_usuario/sieve/ zlib_save = gz zlib_save_level = 9 } pop3_no_flag_updates = yes protocols = pop3 imap sieve service anvil { client_limit = 25000 } service auth { client_limit = 28000 unix_listener auth-master { user = entrega } unix_listener auth-userdb { user = entrega } user = root } service aviso_cuota { executable = script /usr/local/bin/quota-warning.sh unix_listener aviso_cuota { mode = 0666 } user = entrega } service imap-login { executable = /usr/libexec/dovecot/imap-login group = dovenull service_count = 0 vsz_limit = 1 G } service imap { executable = /usr/libexec/dovecot/imap process_limit = 6000 } service managesieve-login { executable = /usr/libexec/dovecot/managesieve-login inet_listener sieve { port = 2000 } process_limit = 2000 vsz_limit = 1 G } service managesieve { executable = /usr/libexec/dovecot/managesieve process_limit = 5000 } service pop3-login { executable = /usr/libexec/dovecot/pop3-login process_limit = 4000 service_count = 0 vsz_limit = 1 G } service pop3 { executable = /usr/libexec/dovecot/pop3 process_limit = 4000 } ssl_ca = I'm trying to get the pipe backend to work with the new dovecot-antispam (I was very pleased to see the new version, thanks Johannes!) Before I would run the following over the maildir: spamc -d 10.0.1.109 -L ham < $file 2>&1 > /dev/null now, i'm using dovecot-antispam and mdbox and have the following configured: antispam_backend = pipe antispam_signature = X-Spam-Flag antispam_signature_missing = error antispam_trash_pattern = trash;Trash;Deleted * antispam_spam_pattern_ignorecase = SPAM antispam_pipe_tmpdir = /var/tmp antispam_pipe_program_spam_arg = -L spam antispam_pipe_program_notspam_arg = -L ham antispam_pipe_program = /usr/bin/spamc antispam_pipe_program_args = -d 10.0.1.109 Now, when I move a message to Spam, dovecot-antispam detects it and attempts to run, but it fails: Dec 14 16:22:45 grosbeak [username 10.0.1.74 uid]: antispam: run program failed with exit code 64 Exit code 64 is spamc's exit code for "command line usage error" - but I can't see exactly the command that is being constructed by dovecot-antispam to know where the error is. Any ideas? micah -- -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 835 bytes Desc: not available URL: From janm-dovecot at transactionware.com Thu Dec 15 03:05:42 2011 From: janm-dovecot at transactionware.com (Jan Mikkelsen) Date: Thu, 15 Dec 2011 12:05:42 +1100 Subject: [Dovecot] Building 2.1.rc1 with cluence, but without libstemmer Message-ID: Hi, I'm testing out 2.1.rc1, building against clucene 2.3.3.4. Without libstemmber, the build fails because it attempts to include SnowballAnalyzer.h which is not part of "core" clucene. Simple patch below to make dovecot 2.1.rc1 build with clucene but without libstemmer (or textcat). Looking at libstemmer itself, there are multiple versions. The version in clucene is put into libclucene-contribs-lib.so, but that version is older than libstemmer_c, which generates libstemmer.a, tested for in the dovecot 2.1.rc1 configure script. The dovecot code uses SnowballAnalyzer.h as a C++ wrapper around libstemmer. What versions of libstemmer, clucene and libtextcat is dovecot 2.1.rc1 intended to be used against? Is it worth bringing the wrapper class around libstemmer into dovecot to avoid funny dependencies against clucene and so that the -lstemmer test in configure is enough? For reference, I'm building on FreeBSD 9.0-RC3, system gcc. Regards, Jan Mikkelsen. diff -u -d -r dovecot-2.1.rc1/src/plugins/fts-lucene/lucene-wrapper.cc dovecot-2.1.rc1.patched/src/plugins/fts-lucene/lucene-wrapper.cc --- dovecot-2.1.rc1/src/plugins/fts-lucene/lucene-wrapper.cc 2011-11-09 08:45:26.000000000 +1100 +++ dovecot-2.1.rc1.patched/src/plugins/fts-lucene/lucene-wrapper.cc 2011-12-14 23:36:54.319796535 +1100 @@ -23,7 +23,9 @@ #include #include #include +#if defined(HAVE_LUCENE_STEMMER) || defined(HAVE_LUCENE_TEXTCAT) #include "SnowballAnalyzer.h" +#endif /* Lucene's default is 10000. Use it here also.. */ #define MAX_TERMS_PER_DOCUMENT 10000 From dmiller at amfes.com Thu Dec 15 05:27:06 2011 From: dmiller at amfes.com (Daniel L. Miller) Date: Wed, 14 Dec 2011 19:27:06 -0800 Subject: [Dovecot] doveadm index Message-ID: Does "doveadm index -A INBOX" reindex everything? What about users with multiple folders, both subbed & not subbed under INBOX? -- Daniel From adis at linux.org.ba Thu Dec 15 10:37:58 2011 From: adis at linux.org.ba (Adis Nezirovic) Date: Thu, 15 Dec 2011 09:37:58 +0100 Subject: [Dovecot] Quota PostgreSQL INSERT trigger Message-ID: Wiki instructions for creating insert trigger for PostgreSQL are wrong http://wiki.dovecot.org/Quota/Dict Calling INSERT on the table from within BEFORE INSERT trigger creates cascading trigger. http://www.postgresql.org/docs/current/interactive/trigger-definition.html Instead, one should return NEW record from the trigger, and it will be inserted after trigger execution. --- CREATE OR REPLACE FUNCTION merge_quota2() RETURNS TRIGGER AS $$ BEGIN IF NEW.messages < 0 OR NEW.messages IS NULL THEN -- ugly kludge: we came here from this function, really do try to insert IF NEW.messages IS NULL THEN NEW.messages = 0; ELSE NEW.messages = -NEW.messages; END IF; return NEW; END IF; LOOP UPDATE quota2 SET bytes = bytes + NEW.bytes, messages = messages + NEW.messages WHERE username = NEW.username; IF found THEN RETURN NULL; END IF; BEGIN IF NEW.messages = 0 THEN RETURN NEW; ELSE NEW.messages = - NEW.messages; RETURN NEW; END IF; EXCEPTION WHEN unique_violation THEN -- someone just inserted the record, update it END; END LOOP; END; $$ LANGUAGE plpgsql; DROP TRIGGER IF EXISTS mergequota2 ON quota2; CREATE TRIGGER mergequota2 BEFORE INSERT ON quota2 FOR EACH ROW EXECUTE PROCEDURE merge_quota2(); --- Best regards, Adis From tom at whyscream.net Thu Dec 15 12:55:19 2011 From: tom at whyscream.net (Tom Hendrikx) Date: Thu, 15 Dec 2011 11:55:19 +0100 Subject: [Dovecot] dovecot-antispam: pipe backend with spamc failing to parse args In-Reply-To: <87k45yllf3.fsf@algae.riseup.net> References: <87k45yllf3.fsf@algae.riseup.net> Message-ID: <4EE9D217.5060006@whyscream.net> On 15/12/11 01:37, Micah Anderson wrote: > > I'm trying to get the pipe backend to work with the new > dovecot-antispam (I was very pleased to see the new version, thanks > Johannes!) > > antispam_pipe_program_spam_arg = -L spam > antispam_pipe_program_notspam_arg = -L ham > antispam_pipe_program = /usr/bin/spamc > antispam_pipe_program_args = -d 10.0.1.109 > > Now, when I move a message to Spam, dovecot-antispam detects it and > attempts to run, but it fails: > > Dec 14 16:22:45 grosbeak [username 10.0.1.74 uid]: antispam: run program > failed with exit code 64 > > Exit code 64 is spamc's exit code for "command line usage error" - but I > can't see exactly the command that is being constructed by > dovecot-antispam to know where the error is. I use dspam as backend, but multiple args need to be specified separated by semicolons (';') if spaces aare needed on the original commandline. i.e.: antispam_pipe_program_spam_arg = -L;spam antispam_pipe_program_notspam_arg = -L;ham antispam_pipe_program = /usr/bin/spamc antispam_pipe_program_args = -d;10.0.1.109 Note that this is the fork from Eugene as documented on the wiki, which is based on the same code. Did I miss the announcement from Johannes somewhere?:) -- Regards, Tom From forall at stalowka.info Thu Dec 15 16:03:40 2011 From: forall at stalowka.info (For@ll) Date: Thu, 15 Dec 2011 15:03:40 +0100 Subject: [Dovecot] Autosubscribe new folders In-Reply-To: <20111214161958.GA2843@PC211.ikt.de> References: <20111214161958.GA2843@PC211.ikt.de> Message-ID: W dniu 14.12.2011 17:20, Dennis Guhl pisze: > On Wed, Dec 14, 2011 at 01:49:39PM +0100, For at ll wrote: >> Hi, > > [..] > >> When I get a new message, in user folder is automaticly created >> folder like subject but is not subscribed. What I must settings in >> dovecot to automaticly subscribe folders to subscriptions files.? > > Add > > lda_mailbox_autosubscribe = yes > > to 15-lda.conf (or wherever you defined lda_mailbox_autocreate = yes). > > Dennis > It doesn't work. This is a part of config file about lda: protocol lda { log_path = /var/log/dovecot-deliver.log auth_socket_path = /var/run/dovecot/auth-master postmaster_address = postmaster at i-bs.pl mail_plugins = sieve # global_script_path = /home/vmail/globalsieverc lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes } I have dovecot 1.2.15 From dg at dguhl.org Thu Dec 15 17:46:35 2011 From: dg at dguhl.org (Dennis Guhl) Date: Thu, 15 Dec 2011 16:46:35 +0100 Subject: [Dovecot] Autosubscribe new folders In-Reply-To: References: <20111214161958.GA2843@PC211.ikt.de> Message-ID: <20111215154634.GB11853@PC211.ikt.de> On Thu, Dec 15, 2011 at 03:03:40PM +0100, For at ll wrote: > W dniu 14.12.2011 17:20, Dennis Guhl pisze: > >On Wed, Dec 14, 2011 at 01:49:39PM +0100, For at ll wrote: > >>Hi, [..] > It doesn't work. This is a part of config file about lda: > protocol lda { [..] > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > } > I have dovecot 1.2.15 This are directives from 2.0 which won't work with dovecot 1.2. IIRC dovecot 1.2 can only automatically create and subscribe administratively defined folders on first login. Dennis -- Dennis Guhl () ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments From e-frog at gmx.de Thu Dec 15 19:17:05 2011 From: e-frog at gmx.de (e-frog) Date: Thu, 15 Dec 2011 18:17:05 +0100 Subject: [Dovecot] Autosubscribe new folders In-Reply-To: <20111215154634.GB11853@PC211.ikt.de> References: <20111214161958.GA2843@PC211.ikt.de> <20111215154634.GB11853@PC211.ikt.de> Message-ID: <4EEA2B91.9050306@gmx.de> Am 15.12.2011 16:46, schrieb Dennis Guhl: > On Thu, Dec 15, 2011 at 03:03:40PM +0100, For at ll wrote: >> W dniu 14.12.2011 17:20, Dennis Guhl pisze: >>> On Wed, Dec 14, 2011 at 01:49:39PM +0100, For at ll wrote: >>>> Hi, > > [..] > >> It doesn't work. This is a part of config file about lda: >> protocol lda { > > [..] > >> lda_mailbox_autocreate = yes >> lda_mailbox_autosubscribe = yes >> } >> I have dovecot 1.2.15 > > This are directives from 2.0 which won't work with dovecot 1.2. > > IIRC dovecot 1.2 can only automatically create and subscribe > administratively defined folders on first login. > > Dennis http://wiki1.dovecot.org/LDA#Parameters Look for the -s switch /e-frog From Juergen.Obermann at hrz.uni-giessen.de Fri Dec 16 00:00:05 2011 From: Juergen.Obermann at hrz.uni-giessen.de (=?UTF-8?Q?J=C3=BCrgen_Obermann?=) Date: Thu, 15 Dec 2011 23:00:05 +0100 Subject: [Dovecot] dsync panic Message-ID: <3a8f9df5e523c0391c41964ae3d09d1b@imapproxy.hrz> Hello, when I try to convert from mbox to mdbox with dsync with one user it always panics: # /opt/local/bin/dsync -v -u userxy backup ssh root at minerva1 /opt/local/bin/dsync -v -u userxy dsync-local(userxy): Info: Papierkorb: uidnext changed: 161 != 1 dsync-local(userxy): Info: INBOX: uidnext changed: 9139 != 9105 dsync-local(userxy): Info: Trash: uidnext changed: 3924 != 3915 dsync-local(userxy): Info: Drafts: uidnext changed: 1563 != 1 dsync-local(userxy): Info: Gesendet: uidnext changed: 369 != 1 dsync-local(userxy): Info: Sent: uidnext changed: 1955 != 1 dsync-remote(userxy): Panic: Trying to allocate 2147483648 bytes dsync-remote(userxy): Error: Raw backtrace: 0xff14bc30 -> 0xff1658c0 -> 0xff15744c -> 0xff157520 -> 0xff159d90 -> 0xff156540 -> 0xff15cf5c -> 0xff156540 -> 0xff157100 -> 0xff16d158 -> 0xff16cfe8 -> 0xff26e350 -> 0x251c4 -> 0x2547c -> 0x21110 -> 0x20494 -> 0x1f230 -> 0x1f3d4 -> 0xff15e46c -> 0xff15f738 -> 0xff15e530 -> 0xff140ec8 -> 0x1525c -> 0x14608 Abort dsync-local(userxy): Error: read() from worker server failed: EOF dsync-local(userxy): Error: Unexpected reply from server: My local configuration is: # /opt/local/bin/doveconf -n # 2.0.16: /opt/local/etc/dovecot/dovecot.conf # OS: SunOS 5.10 sun4v auth_verbose = yes disable_plaintext_auth = no lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = imap.hrz.uni-giessen.de localhost mail_fsync = always mail_location = mbox:~/Mail:INBOX=/var/mail/%u mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = mail_log notify zlib managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes list = no location = prefix = Mail/ separator = / subscriptions = yes type = private } passdb { driver = pam } passdb { args = /opt/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { autocreate = Trash autocreate2 = caughtspam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = caughtspam autosubscribe3 = Sent autosubscribe4 = Drafts mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at hrz.uni-giessen.de quota_full_tempfail = yes sendmail_path = /usr/lib/sendmail service auth { client_limit = 11120 } service imap-login { process_min_avail = 16 service_count = 0 vsz_limit = 640 M } service imap { process_limit = 4096 vsz_limit = 1 G } ssl_cert = Hello, I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7. All accounts are virtual, hosted on LDAP Server. My problem is that the command: doveadm quota get -A stopped listing all accounts. I think this problem started after I changed in LDAP lookup configuration from "scope = subtree" to "scope = onelevel", because it did not occur before (I did no other changes). Now, the above command only lists 12 accounts. If I query for a particular user: doveadm quota get -u userx this works fine, but userx (and all users except those 12) is NOT listed when trying to display all users. How can I run the above command without problems again? Thanks in advance, Nick From nmilas at noa.gr Fri Dec 16 00:25:40 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Fri, 16 Dec 2011 00:25:40 +0200 Subject: [Dovecot] DKIM Verification failures Message-ID: <4EEA73E4.6080305@noa.gr> Hi, -- This message refers to the maillist itself rather than to dovecot software -- I have noticed that when I post to this list (only), I get DKIM Verification failure reports from: root at moncton.sidefx.com (e.g. for my last post: "DKIM failure report for job 4D27B5DC4E on mail.sidefx.com") root at mail.rmacd.com (e.g. for my last post: "DKIM failure report for job B69B3187F1 on mail.rmacd.com") root at mx0.roessner-net.de (e.g. for my last post: "DKIM failure report for job 6103B52092 on mx0.roessner-net.de") I have not had other DKIM failure reports from anywhere and I know that we should not have issues with it. An example from gmail: Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of nmilas at noa.gr designates 195.251.204.235 as permitted sender) smtp.mail=nmilas at noa.gr; dkim=pass header.i=@noa.gr So, whom should I contact to investigate this problem? Thanks, Nick From robert at schetterer.org Fri Dec 16 00:54:21 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 15 Dec 2011 23:54:21 +0100 Subject: [Dovecot] DKIM Verification failures In-Reply-To: <4EEA73E4.6080305@noa.gr> References: <4EEA73E4.6080305@noa.gr> Message-ID: <4EEA7A9D.9070101@schetterer.org> Am 15.12.2011 23:25, schrieb Nikolaos Milas: > Hi, > > -- This message refers to the maillist itself rather than to dovecot > software -- > > I have noticed that when I post to this list (only), I get DKIM > Verification failure reports from: > > root at moncton.sidefx.com (e.g. for my last post: "DKIM failure report > for job 4D27B5DC4E on mail.sidefx.com") > root at mail.rmacd.com (e.g. for my last post: "DKIM failure report for job > B69B3187F1 on mail.rmacd.com") > root at mx0.roessner-net.de (e.g. for my last post: "DKIM failure report > for job 6103B52092 on mx0.roessner-net.de") whois roessner-net.de and search the list archive for roessner mail address, guess it will no problem to contact and debug > > I have not had other DKIM failure reports from anywhere and I know that > we should not have issues with it. An example from gmail: > > Authentication-Results: mx.google.com; spf=pass (google.com: best guess > record for domain of nmilas at noa.gr designates 195.251.204.235 as > permitted sender) smtp.mail=nmilas at noa.gr; dkim=pass header.i=@noa.gr > > So, whom should I contact to investigate this problem? > > Thanks, > Nick From ml at smtp.fakessh.eu Fri Dec 16 03:56:55 2011 From: ml at smtp.fakessh.eu (ml) Date: Fri, 16 Dec 2011 02:56:55 +0100 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EEA6DF0.3080909@noa.gr> References: <4EEA6DF0.3080909@noa.gr> Message-ID: <20b427c7163c0ebb3e8c90603f460b5a@roundcube.fakessh.eu> Le 2011-12-15 23:00, Nikolaos Milas a ?crit?: > Hello, > > I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7. > > All accounts are virtual, hosted on LDAP Server. > > My problem is that the command: > > doveadm quota get -A > > stopped listing all accounts. I think this problem started after I > changed in LDAP lookup configuration from "scope = subtree" to "scope > = onelevel", because it did not occur before (I did no other > changes). > > Now, the above command only lists 12 accounts. If I query for a > particular user: > > doveadm quota get -u userx > > this works fine, but userx (and all users except those 12) is NOT > listed when trying to display all users. > > How can I run the above command without problems again? > > Thanks in advance, > Nick upgrade to the latest rpm i any problem with the last release -- http://pgp.mit.edu:11371/pks/lookup?op=get&search=0x092164A7 gpg --keyserver pgp.mit.edu --recv-key 092164A7 http://urlshort.eu fakessh @ http://gplus.to/sshfake http://gplus.to/sshswilting http://gplus.to/john.swilting From nmilas at noa.gr Fri Dec 16 10:30:28 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Fri, 16 Dec 2011 10:30:28 +0200 Subject: [Dovecot] DKIM Verification failures In-Reply-To: <4EEA7A9D.9070101@schetterer.org> References: <4EEA73E4.6080305@noa.gr> <4EEA7A9D.9070101@schetterer.org> Message-ID: <4EEB01A4.3030507@noa.gr> On 16/12/2011 12:54 ??, Robert Schetterer wrote: > whois roessner-net.de > > and search the list archive for > > roessner mail address, guess it will no problem to contact and debug Thanks, I've found and privately emailed the affected members. Nick From nmilas at noa.gr Fri Dec 16 11:09:39 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Fri, 16 Dec 2011 11:09:39 +0200 Subject: [Dovecot] Calculation of suggested vsz_limit values Message-ID: <4EEB0AD3.20001@noa.gr> Hello, I would like to ask on suggested vsz_limit values. Is there any way of calculating such values? How should we determine them? I don't want to risk wrong values (and possible errors) on a production system, if I upgrade to 2.0.16 where vsz_limit values are enforced (I read release notes)! If there is no standard way of calculation, could someone please check the following info and suggest some values? I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7 (as a VM on a KVM Host). All accounts are virtual, hosted on LDAP Server. We have about 250 mailboxes of 4GB each (in practice, only a couple of mailboxes ever reach 1GB so we are "over-booking"). It is a relatively low-load server. Memory status and config follows below. Thanks, Nick The server memory condition is as follows: # vmstat procs -----------memory---------- ---swap-- -----io---- --system-- -----cpu------ r b swpd free buff cache si so bi bo in cs us sy id wa st 0 0 92 62400 212324 1299604 0 0 397 235 70 39 4 2 89 4 0 # free -m total used free shared buffers cached Mem: 2010 1951 59 0 207 1269 -/+ buffers/cache: 474 1536 Swap: 2015 0 2015 ---------- Config Start ------------- # 2.0.13: dovecot.conf protocols = imap pop3 mail_location = maildir:~/Maildir/ mail_gid = 500 mail_uid = 500 auth_mechanisms = plain login auth_username_format = %Lu auth_verbose = yes disable_plaintext_auth = no mail_plugins = quota protocol imap { imap_client_workarounds = "delay-newmail " mail_plugins = quota imap_quota } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = log_path = mail_plugins = quota postmaster_address = sysadmin at example.com sendmail_path = /usr/lib/sendmail } userdb { args = /etc/dovecot/dovecot-usrdb-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-passdb-ldap.conf driver = ldap } plugin { quota = maildir:User quota quota_rule = *:storage=4G quota_rule2 = Trash:storage=+3%% quota_warning = storage=75%% quota-warning 75 %u quota_warning2 = storage=90%% quota-warning 90 %u } service quota-warning { executable = script /opt/mail1.sh user = vmail unix_listener quota-warning { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service imap-login { service_count = 1 vsz_limit = 64 M } service pop3-login { service_count = 1 vsz_limit = 64 M } ssl_ca = Hi, I'm working for tuning a busy cluster of dovecot servers. Heach server as 4 core, 8GB of RAM and provide POP3 and IMAP access to mailbox. OS is Debian 6.0 and dovecot version is 1.2.15. I am unsure how to set "login_max_processes_count" and "login_max_connections" for reach the best situation when login_process_per_connection is set to no. I don't know what value to set login_max_processes_count. For example is better the first or the second configuration? login_process_per_connection=no login_processes_count=4 login_max_processes_count=8 login_max_connections=512 login_process_size=128 login_process_per_connection=no login_processes_count=4 login_max_processes_count=16 login_max_connections=256 login_process_size=128 Which is a suggested ratio from login_max_processes_count and login_max_connections ? Other values are correct? Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it @ LOLUG -> Socio http://www.lolug.net From scott_the_musician at yahoo.com.au Fri Dec 16 15:24:08 2011 From: scott_the_musician at yahoo.com.au (Scott Lewis) Date: Fri, 16 Dec 2011 05:24:08 -0800 (PST) Subject: [Dovecot] simultaneous scripts not running via sieve_before In-Reply-To: <4EE62AFD.90700@rename-it.nl> References: <1323694925.83114.YahooMailNeo@web130102.mail.mud.yahoo.com> <1329235723.20111212135759@gmail.com> <4EE62AFD.90700@rename-it.nl> Message-ID: <1324041848.73103.YahooMailNeo@web130103.mail.mud.yahoo.com> Thanks for the advise - it worked a treat! Glad to finally have this sieve stuff under control, after weeks of trying to get it working :) ________________________________ From: Stephan Bosch To: Duane Hill Cc: dovecot at dovecot.org Sent: Tuesday, 13 December 2011 3:25 AM Subject: Re: [Dovecot] simultaneous scripts not running via sieve_before Op 12/12/2011 2:57 PM, Duane Hill schreef: > On Monday, December 12, 2011 at 13:02:05 UTC, scott_the_musician at yahoo.com.au confabulated: >> protocol lda { >> mail_plugins = sieve quota >> sieve=~/.dovecot.sieve >> sieve_extentions = +include >> sieve_dir=~/sieve >> sieve_before = /home/%u/sieve/redirect.svbin >> sieve_global_path = /etc/globalsieverc.svbin >> [/code] > sieve_before? and? sieve_after are directories where extra scripts are > run sequentially before user scripts and after user scripts. See: > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration It can be a file, but then it must point to the sieve script (in this case redirect.sieve) and not to the compiled binary (redirect.svbin in this case). Regards, Stephan. From carloswill at gmail.com Fri Dec 16 18:15:42 2011 From: carloswill at gmail.com (Carlos Mennens) Date: Fri, 16 Dec 2011 11:15:42 -0500 Subject: [Dovecot] Strange Login / Timeout Sessions Message-ID: I have my webmail application tied to Postfix / Dovecot server & now for some reason the IMAP sessions oddly time out throughout the day and then logging back into the mail system over the web is painfully slow. The only thing I've seen that fixes it is to reload the Dovecot daemon in Linux: /etc/init.d/dovecot reload Once that command is ran, my webmail login is super fast and moving from folder to folder is extremely fast again. Then in about a few hours, the session will time out and this problem repeats. The problem is the same for everyone and not just a few user accounts. Anyone have any idea what I should be looking for or looking at? My Dovecot logs or mixed in /var/log/maillog which is extremely hard to watch live & gets mixed with Postfix, Amavisd, and Postgrey. Any ideas or suggestions to narrow this problem out? I'm running Dovecot-1.0.7-7.el5_7.1. I saw this load on the console today: Error: Dovecot is already running with PID 2334 (read from /var/run/dovecot/master.pid) Fatal: Invalid configuration in /etc/dovecot.conf Below is my configuration file: [root at mail ~]# dovecot -n # 1.0.7: /etc/dovecot.conf protocols: imap ssl_ca_file: /etc/ssl/certs/digicert.crt ssl_cert_file: ***OMIT*** ssl_key_file: ***OMIT*** login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:~/Maildir auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix From john at adeptivesw.com Fri Dec 16 21:20:17 2011 From: john at adeptivesw.com (John Brock) Date: Fri, 16 Dec 2011 12:20:17 -0700 Subject: [Dovecot] logging deletion of emails through IMAP? Message-ID: <4EEB99F1.7040702@adeptivesw.com> Version 1.2.16: Is there some way to enable logging for when emails are deleted via IMAP? All I see are log entries for users logging in/logging out. It would be nice to know when an email is deleted, and from which IP address the user was logged in when s/he deleted the email. -- John Brock Adeptive Software 303-554-0301 x1 From e-frog at gmx.de Fri Dec 16 21:29:45 2011 From: e-frog at gmx.de (e-frog) Date: Fri, 16 Dec 2011 20:29:45 +0100 Subject: [Dovecot] logging deletion of emails through IMAP? In-Reply-To: <4EEB99F1.7040702@adeptivesw.com> References: <4EEB99F1.7040702@adeptivesw.com> Message-ID: <4EEB9C29.10607@gmx.de> On 16.12.2011 20:20, wrote John Brock: > Version 1.2.16: Is there some way to enable logging for when emails are > deleted via IMAP? All I see are log entries for users logging in/logging > out. It would be nice to know when an email is deleted, and from which > IP address the user was logged in when s/he deleted the email. > The maillog plugin is what you are looking for: http://wiki1.dovecot.org/Plugins/MailLog From stephan at rename-it.nl Sat Dec 17 01:25:21 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 17 Dec 2011 00:25:21 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features Message-ID: <4EEBD361.2090809@rename-it.nl> Hello Dovecot users, Pigeonhole v0.3 for Dovecot v2.1 has two new features I would like you to play with before I make a first release: 1) The new Sieve editheader extension (http://tools.ietf.org/html/rfc5293). This allows modifying the headers of the message before delivery. This is actually the first implemented extension that can modify the message itself in any way. This feature adds quite a bit of new code that I'd like to see tested more thoroughly. 2) The new sieve-filter tool (documented in the sieve-filter(1) man page upon installation). This allows (re-)filtering messages that are already stored in a particular mailbox. It preserves the assigned IMAP flags and keywords and using the imap4flags extension these can also be modified. It also plays nice with the editheader extension. Judging by postings in this mailing list from the last few years, this is a highly-demanded feature and I'm glad that I finally got around to finish this thing. If the new sieve-filter tool is lacking certain features in your opinion, just let me know. Needless to say: read the man page carefully and watch out with important mail. This is currently only available from the mercurial repository, but if you prefer to have an .rc1 release first, just tell me and I'll make one. The automatic Debian repository already includes these features. Regards, Stephan. From robert at schetterer.org Sat Dec 17 02:13:20 2011 From: robert at schetterer.org (Robert Schetterer) Date: Sat, 17 Dec 2011 01:13:20 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features In-Reply-To: <4EEBD361.2090809@rename-it.nl> References: <4EEBD361.2090809@rename-it.nl> Message-ID: <4EEBDEA0.7000004@schetterer.org> Am 17.12.2011 00:25, schrieb Stephan Bosch: > Hello Dovecot users, > > Pigeonhole v0.3 for Dovecot v2.1 has two new features I would like you > to play with before I make a first release: dove 2.1 only? > > 1) The new Sieve editheader extension > (http://tools.ietf.org/html/rfc5293). This allows modifying the headers > of the message before delivery. This is actually the first implemented > extension that can modify the message itself in any way. This feature > adds quite a bit of new code that I'd like to see tested more thoroughly. > > 2) The new sieve-filter tool (documented in the sieve-filter(1) man page > upon installation). is there an online version ? This allows (re-)filtering messages that are already > stored in a particular mailbox. It preserves the assigned IMAP flags and > keywords and using the imap4flags extension these can also be modified. > It also plays nice with the editheader extension. Judging by postings in > this mailing list from the last few years, this is a highly-demanded > feature and I'm glad that I finally got around to finish this thing. If > the new sieve-filter tool is lacking certain features in your opinion, > just let me know. Needless to say: read the man page carefully and watch > out with important mail. > > This is currently only available from the mercurial repository, but if > you prefer to have an .rc1 release first, just tell me and I'll make > one. The automatic Debian repository already includes these features. thats fine > > Regards, > > Stephan. > > > > > > From stephan at rename-it.nl Sat Dec 17 02:48:20 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 17 Dec 2011 01:48:20 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features In-Reply-To: <4EEBDEA0.7000004@schetterer.org> References: <4EEBD361.2090809@rename-it.nl> <4EEBDEA0.7000004@schetterer.org> Message-ID: <4EEBE6D4.5030304@rename-it.nl> On 12/17/2011 1:13 AM, Robert Schetterer wrote: > Am 17.12.2011 00:25, schrieb Stephan Bosch: >> Hello Dovecot users, >> >> Pigeonhole v0.3 for Dovecot v2.1 has two new features I would like you >> to play with before I make a first release: > dove 2.1 only? Yes. >> 1) The new Sieve editheader extension >> (http://tools.ietf.org/html/rfc5293). This allows modifying the headers >> of the message before delivery. This is actually the first implemented >> extension that can modify the message itself in any way. This feature >> adds quite a bit of new code that I'd like to see tested more thoroughly. >> >> 2) The new sieve-filter tool (documented in the sieve-filter(1) man page >> upon installation). > is there an online version ? Well, now there is: I've produced html output for the current version of the man pages: http://pigeonhole.dovecot.org/doc/man1/sieve-filter.1.html Regards, Stephan. From robert at schetterer.org Sat Dec 17 08:42:13 2011 From: robert at schetterer.org (Robert Schetterer) Date: Sat, 17 Dec 2011 07:42:13 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features In-Reply-To: <4EEBE6D4.5030304@rename-it.nl> References: <4EEBD361.2090809@rename-it.nl> <4EEBDEA0.7000004@schetterer.org> <4EEBE6D4.5030304@rename-it.nl> Message-ID: <4EEC39C5.8010404@schetterer.org> Am 17.12.2011 01:48, schrieb Stephan Bosch: > On 12/17/2011 1:13 AM, Robert Schetterer wrote: >> Am 17.12.2011 00:25, schrieb Stephan Bosch: >>> Hello Dovecot users, >>> >>> Pigeonhole v0.3 for Dovecot v2.1 has two new features I would like you >>> to play with before I make a first release: >> dove 2.1 only? > > Yes. > >>> 1) The new Sieve editheader extension >>> (http://tools.ietf.org/html/rfc5293). This allows modifying the headers >>> of the message before delivery. This is actually the first implemented >>> extension that can modify the message itself in any way. This feature >>> adds quite a bit of new code that I'd like to see tested more >>> thoroughly. >>> >>> 2) The new sieve-filter tool (documented in the sieve-filter(1) man page >>> upon installation). >> is there an online version ? > > Well, now there is: I've produced html output for the current version of > the man pages: > > http://pigeonhole.dovecot.org/doc/man1/sieve-filter.1.html > > Regards, > > Stephan. > > thx Stephan -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From c at roessner-network-solutions.com Sun Dec 18 18:14:45 2011 From: c at roessner-network-solutions.com (Christian =?ISO-8859-1?B?UvbfbmVy?=) Date: Sun, 18 Dec 2011 17:14:45 +0100 Subject: [Dovecot] DKIM Verification failures In-Reply-To: <4EEA7A9D.9070101@schetterer.org> Message-ID: Hello, First of all: I am really, really sorry for all of you that got DKIM failure reports from my server! That was never my intention! I had some feedback from one of the Dovecot's users who contacted me and informed me about this circumstances. As soon as I new about it, I disabled the reports feature. It seems that there do exist problems with DKIM and some mailing lists. Not only with my mail server. I have found several SSL errors, when OpenDKIM tries to verify signatures that came from a mailing list. And in turn my MTA tried to send a report to focus on that problem. Yet I can not say, what is going wrong here, but OpenDKIM is really sensitive, if something is wrong with a signature. So as of writing this, you do not get any further report messages. For those of you, who would like to find out, what caused these reports are welcome to contact me. Maybe we can find the problem and eliminate it (maybe a bug in OpenDKIM, mailman, whatever. I don't think it's part of my configuration and therefor several other people might have this problem as well). Thanks in advance Christian Roessner Am 15.12.11 23:54 schrieb "Robert Schetterer" unter : >Am 15.12.2011 23:25, schrieb Nikolaos Milas: >> Hi, >> >> -- This message refers to the maillist itself rather than to dovecot >> software -- >> >> I have noticed that when I post to this list (only), I get DKIM >> Verification failure reports from: >> >> root at moncton.sidefx.com (e.g. for my last post: "DKIM failure report >> for job 4D27B5DC4E on mail.sidefx.com") >> root at mail.rmacd.com (e.g. for my last post: "DKIM failure report for job >> B69B3187F1 on mail.rmacd.com") > >> root at mx0.roessner-net.de (e.g. for my last post: "DKIM failure report >> for job 6103B52092 on mx0.roessner-net.de") > > > > > >whois roessner-net.de > >and search the list archive for > >roessner mail address, guess it will no problem to contact and debug > >> >> I have not had other DKIM failure reports from anywhere and I know that >> we should not have issues with it. An example from gmail: >> >> Authentication-Results: mx.google.com; spf=pass (google.com: best guess >> record for domain of nmilas at noa.gr designates 195.251.204.235 as >> permitted sender) smtp.mail=nmilas at noa.gr; dkim=pass header.i=@noa.gr >> >> So, whom should I contact to investigate this problem? >> >> Thanks, >> Nick > From profymath at yahoo.com Sun Dec 18 21:05:38 2011 From: profymath at yahoo.com (I M) Date: Sun, 18 Dec 2011 11:05:38 -0800 (PST) Subject: [Dovecot] One important question! Message-ID: <1324235138.51268.YahooMailClassic@web125604.mail.ne1.yahoo.com> Hello!Please, give me a feedback as soon as you can! I need some advice regarding ?"dovecot?self signed certificate" configuration!If you have any experience in working with php IMAP-module that would be useful for me to know what would you say about below: ? Problem: I can connect to my INBOX through telnet, but I cannot do it through imap-functions (Certificate failure for ...)? My best,Edward. From user+dovecot at localhost.localdomain.org Sun Dec 18 21:12:07 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sun, 18 Dec 2011 20:12:07 +0100 Subject: [Dovecot] OT: PHP imap_open [was: One important question!] In-Reply-To: <1324235138.51268.YahooMailClassic@web125604.mail.ne1.yahoo.com> References: <1324235138.51268.YahooMailClassic@web125604.mail.ne1.yahoo.com> Message-ID: <4EEE3B07.4070907@localhost.localdomain.org> On 12/18/2011 08:05 PM I M wrote: > Hello!Please, give me a feedback as soon as you can! > I need some advice regarding "dovecot self signed certificate" configuration!If you have any experience in working with php IMAP-module that would be useful for me to know what would you say about below: > Problem: I can connect to my INBOX through telnet, but I cannot do it through imap-functions (Certificate failure for ...)? > My best,Edward. http://php.net/manual/en/function.imap-open.php#refsect1-function.imap-open-parameters ? /novalidate-cert do not validate certificates from TLS/SSL server, needed if server uses self-signed certificates ? Regards, Pascal -- The trapper recommends today: 5e1f1e55.1135220 at localdomain.org From cor at xs4all.nl Mon Dec 19 01:32:43 2011 From: cor at xs4all.nl (Cor Bosman) Date: Mon, 19 Dec 2011 00:32:43 +0100 Subject: [Dovecot] crashes on 2.0.16 Message-ID: Hey all, I upgraded some servers today from Debian Lenny to Debian Squeeze, and after the upgrade I started getting dovecot crashes. I was on 2.0.13 but got these there as well, and hoped upgrading to 2.0.16 would help. It didn't. Anyone have an idea? Cor Dec 18 23:32:21 userimap1 kernel: [263492.245530] __ratelimit: 122 callbacks suppressed Dec 18 23:32:21 userimap1 kernel: [263492.245536] imap[19665]: segfault at 7f108efb7f60 ip 00007f108ecd37e0 sp 00007fff73c3d658 error 5 in libc-2.11.2.so[7f108ec5d000+158000] Dec 18 23:32:21 userimap1 kernel: [263492.245663] BUG: Bad page map in process imap pte:00000001 pmd:09767067 Dec 18 23:32:21 userimap1 kernel: [263492.252563] page:ffffea0000000000 flags:(null) count:-84 mapcount:-84 mapping:(null) index:0 Dec 18 23:32:21 userimap1 kernel: [263492.261186] addr:00007f108ef46000 vm_flags:08000070 anon_vma:(null) mapping:ffff88012b6e5238 index:2e9 Dec 18 23:32:21 userimap1 kernel: [263492.270804] vma->vm_ops->fault: filemap_fault+0x0/0x460 Dec 18 23:32:21 userimap1 kernel: [263492.276172] vma->vm_file->f_op->mmap: generic_file_mmap+0x0/0x60 Dec 18 23:32:21 userimap1 kernel: [263492.282424] Pid: 19665, comm: imap Tainted: G B 2.6.32.36-xsserver #1 Dec 18 23:32:21 userimap1 kernel: [263492.282429] Call Trace: Dec 18 23:32:21 userimap1 kernel: [263492.282441] [] print_bad_pte+0x1d5/0x280 Dec 18 23:32:21 userimap1 kernel: [263492.282448] [] unmap_vmas+0xa1a/0xa20 Dec 18 23:32:21 userimap1 kernel: [263492.282458] [] ? sch_direct_xmit+0x81/0x1d0 Dec 18 23:32:21 userimap1 kernel: [263492.282465] [] exit_mmap+0xbd/0x190 Dec 18 23:32:21 userimap1 kernel: [263492.282473] [] mmput+0x4d/0x120 Dec 18 23:32:21 userimap1 kernel: [263492.282481] [] exit_mm+0x112/0x150 Dec 18 23:32:21 userimap1 kernel: [263492.282488] [] do_exit+0x13d/0x800 Dec 18 23:32:21 userimap1 kernel: [263492.282496] [] ? __dequeue_signal+0xe1/0x200 Dec 18 23:32:21 userimap1 kernel: [263492.282503] [] do_group_exit+0x55/0xd0 Dec 18 23:32:21 userimap1 kernel: [263492.282510] [] get_signal_to_deliver+0x1e1/0x3e0 Dec 18 23:32:21 userimap1 kernel: [263492.282517] [] do_signal+0x75/0x7d0 Dec 18 23:32:21 userimap1 kernel: [263492.282523] [] ? print_vma_addr+0xb3/0x120 Dec 18 23:32:21 userimap1 kernel: [263492.282533] [] ? printk+0x41/0x43 Dec 18 23:32:21 userimap1 kernel: [263492.282541] [] ? __bad_area_nosemaphore+0xf6/0x1e0 Dec 18 23:32:21 userimap1 kernel: [263492.282547] [] ? bad_area_access_error+0x4e/0x60 Dec 18 23:32:21 userimap1 kernel: [263492.282553] [] do_notify_resume+0x57/0x60 Dec 18 23:32:21 userimap1 kernel: [263492.282559] [] retint_signal+0x48/0x8c # 2.0.16: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 auth_cache_size = 1 M auth_verbose = yes base_dir = /var/run/dovecot/ default_vsz_limit = 2 G disable_plaintext_auth = no first_valid_uid = 20 lock_method = dotlock login_greeting = User-IMAP ready. login_trusted_networks = 194.109.26.128/27 mail_fsync = always mail_nfs_index = yes mail_nfs_storage = yes mailbox_idle_check_interval = 1 mins maildir_stat_dirs = yes mmap_disable = yes namespace { inbox = yes location = maildir:%Nu:INDEX=/var/spool/mail/dovecot-control/indexes/%1u/%2u/%u:INBOX=%Nu:CONTROL=/var/spool/mail/dovecot-control/%1u/%2u/%u/INBOX prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot.masterusers driver = passwd-file master = yes } passdb { args = cache_key=%u%r dovecot driver = pam } plugin { quota = fs:User quota } protocols = imap service auth { client_limit = 5000 } service imap-login { process_min_avail = 8 service_count = 0 vsz_limit = 2 G } service imap { process_limit = 4096 vsz_limit = 2 G } shutdown_clients = no ssl_cert = References: Message-ID: <1324256311.8138.5.camel@tardis> Have you tried using a modern kernel? that one is about 2 years old. On Mon, 2011-12-19 at 00:32 +0100, Cor Bosman wrote: > Hey all, I upgraded some servers today from Debian Lenny to Debian Squeeze, and after the upgrade I started getting dovecot crashes. I was on 2.0.13 but got these there as well, and hoped upgrading to 2.0.16 would help. It didn't. Anyone have an idea? > > Cor > # 2.0.16: /usr/local/etc/dovecot/dovecot.conf > # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From sven at svenhartge.de Mon Dec 19 03:32:20 2011 From: sven at svenhartge.de (Sven Hartge) Date: Mon, 19 Dec 2011 02:32:20 +0100 Subject: [Dovecot] crashes on 2.0.16 References: <1324256311.8138.5.camel@tardis> Message-ID: Noel Butler wrote: > On Mon, 2011-12-19 at 00:32 +0100, Cor Bosman wrote: >> # 2.0.16: /usr/local/etc/dovecot/dovecot.conf >> # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 > Have you tried using a modern kernel? that one is about 2 years old. Well, this _is_ the kernel from Debian Stable and based on the Long-Term-Release from the kernel maintainers. Besides, from the suffix i assume this may be a virtual server, so it may be not possible for Cor to even change the kernel himself. Gr??e, Sven. -- Sigmentation fault. Core dumped. From noel.butler at ausics.net Mon Dec 19 05:13:58 2011 From: noel.butler at ausics.net (Noel Butler) Date: Mon, 19 Dec 2011 13:13:58 +1000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: <1324256311.8138.5.camel@tardis> Message-ID: <1324264438.11142.9.camel@tardis> On Mon, 2011-12-19 at 02:32 +0100, Sven Hartge wrote: > Noel Butler wrote: > > On Mon, 2011-12-19 at 00:32 +0100, Cor Bosman wrote: > > >> # 2.0.16: /usr/local/etc/dovecot/dovecot.conf > >> # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 > > > Have you tried using a modern kernel? that one is about 2 years old. > > Well, this _is_ the kernel from Debian Stable and based on the > Long-Term-Release from the kernel maintainers. So what? It is not anything current, that the kernel dev team would waste their time on. Please remember, there is a massive difference between the kernel maintainers, and the debian kernel package maintainers, do not confuse the two, because the later have nothing to do with the former. > > Besides, from the suffix i assume this may be a virtual server, so it > may be not possible for Cor to even change the kernel himself. > Given who Cor is, I'd be actually horrified if he was running any of his plethora of mail servers on a virtual server. hint: don't read too much into the uname value. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From nmilas at noa.gr Mon Dec 19 09:31:45 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Mon, 19 Dec 2011 09:31:45 +0200 Subject: [Dovecot] Calculation of suggested vsz_limit values In-Reply-To: <4EEB0AD3.20001@noa.gr> References: <4EEB0AD3.20001@noa.gr> Message-ID: <4EEEE861.2010503@noa.gr> Hi, No hints about vsz_limit values? Anyone? Thanks, Nick On 16/12/2011 11:09 ??, Nikolaos Milas wrote: > Hello, > > I would like to ask on suggested vsz_limit values. > > Is there any way of calculating such values? How should we determine > them? I don't want to risk wrong values (and possible errors) on a > production system, if I upgrade to 2.0.16 where vsz_limit values are > enforced (I read release notes)! > > If there is no standard way of calculation, could someone please check > the following info and suggest some values? > > I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7 (as a > VM on a KVM Host). > > All accounts are virtual, hosted on LDAP Server. We have about 250 > mailboxes of 4GB each (in practice, only a couple of mailboxes ever > reach 1GB so we are "over-booking"). It is a relatively low-load server. > > Memory status and config follows below. > > Thanks, > Nick > > The server memory condition is as follows: > > # vmstat > procs -----------memory---------- ---swap-- -----io---- --system-- > -----cpu------ > r b swpd free buff cache si so bi bo in cs us > sy id wa st > 0 0 92 62400 212324 1299604 0 0 397 235 70 39 4 > 2 89 4 0 > > # free -m > total used free shared buffers cached > Mem: 2010 1951 59 0 207 1269 > -/+ buffers/cache: 474 1536 > Swap: 2015 0 2015 > > ---------- Config Start ------------- > > # 2.0.13: dovecot.conf > > protocols = imap pop3 > > mail_location = maildir:~/Maildir/ > mail_gid = 500 > mail_uid = 500 > > auth_mechanisms = plain login > auth_username_format = %Lu > auth_verbose = yes > disable_plaintext_auth = no > > mail_plugins = quota > > protocol imap { > imap_client_workarounds = "delay-newmail " > mail_plugins = quota imap_quota > } > > protocol pop3 { > mail_max_userip_connections = 3 > mail_plugins = quota > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > pop3_uidl_format = %08Xu%08Xv > } > > protocol lda { > auth_socket_path = /var/run/dovecot/auth-master > info_log_path = > log_path = > mail_plugins = quota > postmaster_address = sysadmin at example.com > sendmail_path = /usr/lib/sendmail > } > > userdb { > args = /etc/dovecot/dovecot-usrdb-ldap.conf > driver = ldap > } > > passdb { > args = /etc/dovecot/dovecot-passdb-ldap.conf > driver = ldap > } > > plugin { > quota = maildir:User quota > quota_rule = *:storage=4G > quota_rule2 = Trash:storage=+3%% > quota_warning = storage=75%% quota-warning 75 %u > quota_warning2 = storage=90%% quota-warning 90 %u > } > > service quota-warning { > executable = script /opt/mail1.sh > user = vmail > unix_listener quota-warning { > user = vmail > } > } > > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-master { > group = vmail > mode = 0660 > user = vmail > } > user = root > } > > service imap-login { > service_count = 1 > vsz_limit = 64 M > } > > service pop3-login { > service_count = 1 > vsz_limit = 64 M > } > > ssl_ca = ssl_cert = ssl_key = > syslog_facility = local1 > > ---------- Config End ------------- > > From bigmoozer at gmail.com Mon Dec 19 11:27:18 2011 From: bigmoozer at gmail.com (moozer) Date: Mon, 19 Dec 2011 10:27:18 +0100 Subject: [Dovecot] IMAP and sieve Message-ID: <4EEF0376.404@gmail.com> I am currently setting up an IMAP server for archiving purposes. The goal is to drag an email to the IMAP folder, and then have a server-side sieve script to put it in the right folder. One of the sources used was this wiki entry http://wiki.dovecot.org/LDA/Sieve/Dovecot I added the mail_plugins = sieve to /etc/dovecot/15-lda.conf and after some exim4 fiddling, mails delivered are filtered by my sieve script. Doing the same for imap delivery (in /etc/dovecot/20-imap.conf) give the following error Dec 19 10:22:09 leon dovecot: imap: Error: dlopen(/usr/lib/dovecot/modules/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_save_open Dec 19 10:22:09 leon dovecot: imap: Error: Can't load plugin sieve_plugin: Plugin is intended to be used only by binaries: lda lmtp (we're imap) Dec 19 10:22:09 leon dovecot: imap: Fatal: Couldn't load required plugins Dec 19 10:22:10 leon dovecot: imap: Error: dlopen(/usr/lib/dovecot/modules/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_save_open Dec 19 10:22:10 leon dovecot: imap: Error: Can't load plugin sieve_plugin: Plugin is intended to be used only by binaries: lda lmtp (we're imap) Dec 19 10:22:10 leon dovecot: imap: Fatal: Couldn't load required plugins I notice this part: "plugin is intended to be used only by binaries: lda lmtp (we're imap)" So the question is if it is possible to run sieve server-side sieve scripts on emails copied using IMAP. Suggestions are most welcome. Moozer -- I am running debian testing # dovecot --version 2.0.15 From stephan at rename-it.nl Mon Dec 19 11:45:18 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 19 Dec 2011 10:45:18 +0100 Subject: [Dovecot] IMAP and sieve In-Reply-To: <4EEF0376.404@gmail.com> References: <4EEF0376.404@gmail.com> Message-ID: <4EEF07AE.3010503@rename-it.nl> On 12/19/2011 10:27 AM, moozer wrote: > I am currently setting up an IMAP server for archiving purposes. The > goal is to drag an email to the IMAP folder, and then have a server-side > sieve script to put it in the right folder. [...] > I notice this part: > "plugin is intended to be used only by binaries: lda lmtp (we're imap)" > > So the question is if it is possible to run sieve server-side sieve > scripts on emails copied using IMAP. Not directly. There is some standardization effort done to achieve something like that: http://tools.ietf.org/html/draft-ietf-sieve-imap-sieve-02 But this is not implemented so far. > Suggestions are most welcome. What you can do is run the Sieve filter in some (in)cron job (or by means of some other trigger). For Dovecot v2.1 there is now a special sieve-filter command line tool to perform the filtering on a folder. However, it is not released yet. For older Dovecot versions you can use this recipe to re-filter mail: http://wiki2.dovecot.org/HowTo/RefilterMail Regards, Stephan. From bigmoozer at gmail.com Mon Dec 19 11:56:57 2011 From: bigmoozer at gmail.com (moozer) Date: Mon, 19 Dec 2011 10:56:57 +0100 Subject: [Dovecot] IMAP and sieve In-Reply-To: <4EEF07AE.3010503@rename-it.nl> References: <4EEF0376.404@gmail.com> <4EEF07AE.3010503@rename-it.nl> Message-ID: <4EEF0A69.7040105@gmail.com> On 2011-12-19 10:45, Stephan Bosch wrote: > On 12/19/2011 10:27 AM, moozer wrote: >> I am currently setting up an IMAP server for archiving purposes. The >> goal is to drag an email to the IMAP folder, and then have a server-side >> sieve script to put it in the right folder. > [...] >> I notice this part: >> "plugin is intended to be used only by binaries: lda lmtp (we're imap)" >> >> So the question is if it is possible to run sieve server-side sieve >> scripts on emails copied using IMAP. > > Not directly. There is some standardization effort done to achieve > something like that: > > http://tools.ietf.org/html/draft-ietf-sieve-imap-sieve-02 > > But this is not implemented so far. > This is the exact thing I was looking for. Too bad that I am ahead of my time :-) >> Suggestions are most welcome. > > What you can do is run the Sieve filter in some (in)cron job (or by > means of some other trigger). For Dovecot v2.1 there is now a special > sieve-filter command line tool to perform the filtering on a folder. > However, it is not released yet. > > For older Dovecot versions you can use this recipe to re-filter mail: > > http://wiki2.dovecot.org/HowTo/RefilterMail > At first glance it looks like using dovecot as a generic IMAP server, fetch mail, run filters and ask the IMAP server to move the mail. It could work also. > Regards, > > Stephan. > > Thank you for a good answer. I will reevaluate my plan based on this. moozer From alec at alec.pl Mon Dec 19 12:06:35 2011 From: alec at alec.pl (A.L.E.C) Date: Mon, 19 Dec 2011 11:06:35 +0100 Subject: [Dovecot] Two important new Pigeonhole v0.3 features In-Reply-To: <4EEBD361.2090809@rename-it.nl> References: <4EEBD361.2090809@rename-it.nl> Message-ID: <4EEF0CAB.4080307@alec.pl> On 17.12.2011 00:25, Stephan Bosch wrote: > 2) The new sieve-filter tool (documented in the sieve-filter(1) man page > upon installation). This allows (re-)filtering messages that are already > stored in a particular mailbox. This is really nice. I'd love to see this tool integrated with IMAP (or MANAGESIEVE) protocol somehow. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From profymath at yahoo.com Mon Dec 19 20:19:07 2011 From: profymath at yahoo.com (I M) Date: Mon, 19 Dec 2011 10:19:07 -0800 (PST) Subject: [Dovecot] OT: PHP imap_open [was: One important question!] In-Reply-To: <4EEE3B07.4070907@localhost.localdomain.org> Message-ID: <1324318747.92715.YahooMailClassic@web125606.mail.ne1.yahoo.com> Thank you for the response,?Pascal!But I have read the all flags and functions that might be useful for this problem before sending this letter.Please, find one more minute to know what I've done yet! 1. I installed MTA (sendmail) first. Then tuned it for receiving and sending emails outside of localhost. As for MDA I used "MAILER(`local')" as dovecot has built in one!?2. I installed IMAP Server (dovecot). I made it working in PLAIN ?LOGIN mode on imap protocol. But as you know it doesn't mean that dovecot won't use SSL/TLS. So we are going to transmit out data as a plain text inside SSL/TLS. (see http://wiki1.dovecot.org/SSL, "...?Some clients unfortunately try to do plaintext authentication without STARTTLS, even when IMAP server has told the client that it won't work." ). So when you try to disable ssl-support in dovecot.conf, you are going to get the message "SECURITY PROBLEM: insecure server advertised AUTH=PLAIN ...". The same message you get when putting "/notls" flag. That why I thought It might be a certificate configuration problem on the client side! Cause when I tried to put the /novalidate-cert flag in string "$mbox = imap_open("{XXXXXX.com:143/novalidate-cert}","user_name","user_password");" I immediately got the ?message: "Undefined variable: mbox in ...". Also keep in mind that the connection to imap server (dovecot) can be established through telnet. So my guess is around misconfiguration of php5-imap module! I've also checked apache-server configuration cause it could also be a problem as I use php-functions on webserver environment. So what would you say?Please, correct me if I am wrong.Thanks again for the response and, please give me a feedback as soon as you can! My best,Edward. ? --- On?Sun, 12/18/11, Pascal Volk?wrote: From: Pascal Volk Subject: [Dovecot] OT: PHP imap_open [was: One important question!] To: "Dovecot Mailing List" Date: Sunday, December 18, 2011, 2:12 PM On 12/18/2011 08:05 PM I M wrote: > Hello!Please, give me a feedback as soon as you can! > I need some advice regarding? "dovecot self signed certificate" configuration!If you have any experience in working with php IMAP-module that would be useful for me to know what would you say about below:?? > Problem: I can connect to my INBOX through telnet, but I cannot do it through imap-functions (Certificate failure for ...)? > My best,Edward. http://php.net/manual/en/function.imap-open.php#refsect1-function.imap-open-parameters ? /novalidate-cert ??? do not validate certificates from TLS/SSL server, needed if ??? server uses self-signed certificates ? Regards, Pascal --? The trapper recommends today:5e1f1e55.1135220 at localdomain.org --- On Sun, 12/18/11, Pascal Volk wrote: From: Pascal Volk Subject: [Dovecot] OT: PHP imap_open [was: One important question!] To: "Dovecot Mailing List" Date: Sunday, December 18, 2011, 2:12 PM On 12/18/2011 08:05 PM I M wrote: > Hello!Please, give me a feedback as soon as you can! > I need some advice regarding? "dovecot self signed certificate" configuration!If you have any experience in working with php IMAP-module that would be useful for me to know what would you say about below:? > Problem: I can connect to my INBOX through telnet, but I cannot do it through imap-functions (Certificate failure for ...)? > My best,Edward. http://php.net/manual/en/function.imap-open.php#refsect1-function.imap-open-parameters ? /novalidate-cert ??? do not validate certificates from TLS/SSL server, needed if ??? server uses self-signed certificates ? Regards, Pascal -- The trapper recommends today: 5e1f1e55.1135220 at localdomain.org From CMarcus at Media-Brokers.com Mon Dec 19 21:28:37 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 19 Dec 2011 14:28:37 -0500 Subject: [Dovecot] OT: PHP imap_open [was: One important question!] In-Reply-To: <1324318747.92715.YahooMailClassic@web125606.mail.ne1.yahoo.com> References: <1324318747.92715.YahooMailClassic@web125606.mail.ne1.yahoo.com> Message-ID: <4EEF9065.9090406@Media-Brokers.com> Your emails are extremely poorly formatted and too much trouble to try to read. If you want to get help, you should learn how to properly compose an email. On 2011-12-19 1:19 PM, I M wrote: > Thank you for the response, Pascal!But I have read the all flags and functions that might be useful for this problem before sending this letter.Please, find one more minute to know what I've done yet! > 1. I installed MTA (sendmail) first. Then tuned it for receiving and sending emails outside of localhost. As for MDA I used "MAILER(`local')" as dovecot has built in one! 2. I installed IMAP Server (dovecot). I made it working in PLAIN LOGIN mode on imap protocol. But as you know it doesn't mean that dovecot won't use SSL/TLS. So we are going to transmit out data as a plain text inside SSL/TLS. (see http://wiki1.dovecot.org/SSL, "... Some clients unfortunately try to do plaintext authentication without STARTTLS, even when IMAP server has told the client that it won't work." ). So when you try to disable ssl-support in dovecot.conf, you are going to get the message "SECURITY PROBLEM: insecure server advertised AUTH=PLAIN ...". The same message you get when putting "/notls" flag. That why I thought It might be a certificate configuration problem on the client side! Cause when I tried to put the /novalidate-cert flag in string "$mbox = > imap_open("{XXXXXX.com:143/novalidate-cert}","user_name","user_password");" I immediately got the message: "Undefined variable: mbox in ...". Also keep in mind that the connection to imap server (dovecot) can be established through telnet. So my guess is around misconfiguration of php5-imap module! I've also checked apache-server configuration cause it could also be a problem as I use php-functions on webserver environment. > So what would you say?Please, correct me if I am wrong.Thanks again for the response and, please give me a feedback as soon as you can! > My best,Edward. -- Best regards, Charles From forrie at gmail.com Mon Dec 19 19:35:00 2011 From: forrie at gmail.com (Forrest Aldrich) Date: Mon, 19 Dec 2011 12:35:00 -0500 Subject: [Dovecot] Using Amazon S3 storage for Maildir ? Message-ID: <4EEF75C4.9040005@gmail.com> I wonder if anyone has tried using an IMAP server with Amazon S3 as a backend. There would be many factors to consider (speed, etc). However, moreso, I don't know that Maildir(++) would support multiple folders that might be linked into the cloud. For example, higher-I/O local incoming mail is on disk, some folders archived on S3. Could be easily done by simply creating another account and storing its Maildir in S3 -- Curious.... From tss at iki.fi Tue Dec 20 07:26:26 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:26:26 +0200 Subject: [Dovecot] Calculation of suggested vsz_limit values In-Reply-To: <4EEB0AD3.20001@noa.gr> References: <4EEB0AD3.20001@noa.gr> Message-ID: <352FB226-243B-4916-AB21-97D6990AC0BD@iki.fi> On 16.12.2011, at 11.09, Nikolaos Milas wrote: > I would like to ask on suggested vsz_limit values. > > Is there any way of calculating such values? Not really. For mail related processes (imap, pop3, lmtp) you could find the largest dovecot.index.cache file and make sure that vsz_limit is at least 3 times that. > How should we determine them? I don't want to risk wrong values (and possible errors) on a production system, if I upgrade to 2.0.16 where vsz_limit values are enforced (I read release notes)! If you're very worried, you can simply disable the vsz limits by setting them to 0. The default 256 MB limit is good enough for most uses though. From tss at iki.fi Tue Dec 20 07:27:55 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:27:55 +0200 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: Message-ID: On 19.12.2011, at 1.32, Cor Bosman wrote: > Hey all, I upgraded some servers today from Debian Lenny to Debian Squeeze, and after the upgrade I started getting dovecot crashes. I was on 2.0.13 but got these there as well, and hoped upgrading to 2.0.16 would help. It didn't. Anyone have an idea? > > Dec 18 23:32:21 userimap1 kernel: [263492.245536] imap[19665]: segfault at 7f108efb7f60 ip 00007f108ecd37e0 sp 00007fff73c3d658 error 5 in libc-2.11.2.so[7f108ec5d000+158000] gdb backtrace of the crash would be helpful: http://dovecot.org/bugreport.html > Dec 18 23:32:21 userimap1 kernel: [263492.245663] BUG: Bad page map in process imap pte:00000001 pmd:09767067 Looks more like a kernel bug though. From tss at iki.fi Tue Dec 20 07:29:22 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:29:22 +0200 Subject: [Dovecot] Using Amazon S3 storage for Maildir ? In-Reply-To: <4EEF75C4.9040005@gmail.com> References: <4EEF75C4.9040005@gmail.com> Message-ID: On 19.12.2011, at 19.35, Forrest Aldrich wrote: > I wonder if anyone has tried using an IMAP server with Amazon S3 as a backend. There would be many factors to consider (speed, etc). However, moreso, I don't know that Maildir(++) would support multiple folders that might be linked into the cloud. For example, higher-I/O local incoming mail is on disk, some folders archived on S3. Could be easily done by simply creating another account and storing its Maildir in S3 -- Maybe [sm]dbox with alt storage set to S3? http://wiki2.dovecot.org/MailboxFormat/dbox#Alternate_storage From tss at iki.fi Tue Dec 20 07:32:27 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:32:27 +0200 Subject: [Dovecot] Tuning Login processes for High-performance Mode In-Reply-To: <4EEB3443.4030104@skye.it> References: <4EEB3443.4030104@skye.it> Message-ID: <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> On 16.12.2011, at 14.06, Alessio Cecchi wrote: > I'm working for tuning a busy cluster of dovecot servers. Heach server as 4 core, 8GB of RAM and provide POP3 and IMAP access to mailbox. OS is Debian 6.0 and dovecot version is 1.2.15. > > I am unsure how to set "login_max_processes_count" and "login_max_connections" for reach the best situation when login_process_per_connection is set to no. They need to be high enough to handle all the concurrent login / SSL connections. > I don't know what value to set login_max_processes_count. This doesn't matter so much as login_processes_count. In normal operation the login_processes_count should be around 1-2x of the number of CPU cores. There's no reason to create more processes, so the login_max_process_count might as well be the same as login_processes_count. The login_max_connections then just needs to be high enough. From tss at iki.fi Tue Dec 20 07:36:53 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:36:53 +0200 Subject: [Dovecot] Strange Login / Timeout Sessions In-Reply-To: References: Message-ID: <21AE7D9C-D533-4C7E-B7BC-E8109D8F6C2D@iki.fi> On 16.12.2011, at 18.15, Carlos Mennens wrote: > I have my webmail application tied to Postfix / Dovecot server & now > for some reason the IMAP sessions oddly time out throughout the day > and then logging back into the mail system over the web is painfully > slow. The only thing I've seen that fixes it is to reload the Dovecot > daemon in Linux: .. > I'm running Dovecot-1.0.7-7.el5_7.1. That's rather old. Might get solved simply by upgrading. You could try if using high-performance mode of login processes helps: http://wiki.dovecot.org/LoginProcess Another reason might be your PAM setup. From tss at iki.fi Tue Dec 20 07:41:32 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:41:32 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EEA6DF0.3080909@noa.gr> References: <4EEA6DF0.3080909@noa.gr> Message-ID: On 16.12.2011, at 0.00, Nikolaos Milas wrote: > I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7. > > All accounts are virtual, hosted on LDAP Server. > > My problem is that the command: > > doveadm quota get -A > > stopped listing all accounts. I think this problem started after I changed in LDAP lookup configuration from "scope = subtree" to "scope = onelevel", because it did not occur before (I did no other changes). Can you try if changing it back helps? Or by running the same LDAP query using ldapsearch. Is there a reason why you changed the scope? (I'm not entirely sure what the LDAP schemes usually look like..) Also to make sure the problem is listing instead of something quota related, list the users: doveadm user '*' From tss at iki.fi Tue Dec 20 07:45:34 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 07:45:34 +0200 Subject: [Dovecot] dsync panic In-Reply-To: <3a8f9df5e523c0391c41964ae3d09d1b@imapproxy.hrz> References: <3a8f9df5e523c0391c41964ae3d09d1b@imapproxy.hrz> Message-ID: <677F82FE-850B-43EC-86C1-6B99ED74642A@iki.fi> On 16.12.2011, at 0.00, J?rgen Obermann wrote: > Hello, > when I try to convert from mbox to mdbox with dsync with one user it always panics: > > # /opt/local/bin/dsync -v -u userxy backup ssh root at minerva1 /opt/local/bin/dsync -v -u userxy > dsync-remote(userxy): Panic: Trying to allocate 2147483648 bytes Well, this is clearly the problem.. But it's difficult to guess where it's allocating that. I'd need a gdb backtrace. Does it write a core file to userxy's home dir? If not, try replacing dsync with a script that runs "ulimit -c unlimited" first and then execs dsync. http://dovecot.org/bugreport.html tells what to do with core once you have it. Alternative idea: Does it crash also when dsyncing locally? gdb --args dsync -u userxy backup mdbox:/tmp/foobar run bt full From dovecot at r.paypc.com Tue Dec 20 08:45:50 2011 From: dovecot at r.paypc.com (Robin) Date: Mon, 19 Dec 2011 22:45:50 -0800 Subject: [Dovecot] Calculation of suggested vsz_limit values In-Reply-To: <352FB226-243B-4916-AB21-97D6990AC0BD@iki.fi> References: <4EEB0AD3.20001@noa.gr> <352FB226-243B-4916-AB21-97D6990AC0BD@iki.fi> Message-ID: <4EF02F1E.6020701@r.paypc.com> Timo wrote: > Not really. For mail related processes (imap, pop3, lmtp) you could > find the largest dovecot.index.cache file and make sure that > vsz_limit is at least 3 times that. Yikes. Aside from forcing users to "prune" mailboxes, what do you suggest when vsz_limit exceeds available host RAM? I ran across another "RAM only" process in fts_squat for a large, but not *HUGE* mailbox when the size of the dovecot.index.search.uids file got larger than 600MB. There's no mitigation for these problems other than "buying more RAM" or getting users to delete/file their emails? I was quite shocked to hit these limits so early - there was no mention of RAM resource requirements in the Dovecot documentation I'd perused. :( =R= From tss at iki.fi Tue Dec 20 08:53:37 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 08:53:37 +0200 Subject: [Dovecot] Calculation of suggested vsz_limit values In-Reply-To: <4EF02F1E.6020701@r.paypc.com> References: <4EEB0AD3.20001@noa.gr> <352FB226-243B-4916-AB21-97D6990AC0BD@iki.fi> <4EF02F1E.6020701@r.paypc.com> Message-ID: <1324364017.3597.14.camel@innu> On Mon, 2011-12-19 at 22:45 -0800, Robin wrote: > Timo wrote: > > > Not really. For mail related processes (imap, pop3, lmtp) you could > > find the largest dovecot.index.cache file and make sure that > > vsz_limit is at least 3 times that. > > Yikes. Aside from forcing users to "prune" mailboxes, what do you > suggest when vsz_limit exceeds available host RAM? vsz_limit isn't about actually using that much memory, but about how much address space can be allocated. Just because Dovecot mmap()s a 1 GB dovecot.index.cache file doesn't mean that it physically uses more than a few kilobytes of memory. > I ran across another "RAM only" process in fts_squat for a large, but > not *HUGE* mailbox when the size of the dovecot.index.search.uids file > got larger than 600MB. I suggest switching to fts-lucene in Dovecot v2.1. From alessio at skye.it Tue Dec 20 09:24:16 2011 From: alessio at skye.it (Alessio Cecchi) Date: Tue, 20 Dec 2011 08:24:16 +0100 Subject: [Dovecot] Tuning Login processes for High-performance Mode In-Reply-To: <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> References: <4EEB3443.4030104@skye.it> <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> Message-ID: <4EF03820.4000406@skye.it> Il 20/12/2011 06:32, Timo Sirainen ha scritto: > On 16.12.2011, at 14.06, Alessio Cecchi wrote: > >> I'm working for tuning a busy cluster of dovecot servers. Heach server as 4 core, 8GB of RAM and provide POP3 and IMAP access to mailbox. OS is Debian 6.0 and dovecot version is 1.2.15. >> >> I am unsure how to set "login_max_processes_count" and "login_max_connections" for reach the best situation when login_process_per_connection is set to no. > > They need to be high enough to handle all the concurrent login / SSL connections. > >> I don't know what value to set login_max_processes_count. > > This doesn't matter so much as login_processes_count. In normal operation the login_processes_count should be around 1-2x of the number of CPU cores. There's no reason to create more processes, so the login_max_process_count might as well be the same as login_processes_count. The login_max_connections then just needs to be high enough. > Thanks Timo, I had read on wiki the ratio from core and login_processes_count, but I did not understand the ratio from login_processes_count and login_max_processes_count. So, if I have 4 core and want to serve up to 1024 users, an example of configuration can be: login_processes_count = 4 login_max_processes_count = 8 login_max_connections = 128 Right? -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it @ LOLUG -> Socio http://www.lolug.net From tss at iki.fi Tue Dec 20 09:39:49 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 09:39:49 +0200 Subject: [Dovecot] Tuning Login processes for High-performance Mode In-Reply-To: <4EF03820.4000406@skye.it> References: <4EEB3443.4030104@skye.it> <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> <4EF03820.4000406@skye.it> Message-ID: <1324366789.3597.21.camel@innu> On Tue, 2011-12-20 at 08:24 +0100, Alessio Cecchi wrote: > I had read on wiki the ratio from core and login_processes_count, but I > did not understand the ratio from login_processes_count and > login_max_processes_count. Just set login_max_processes_count to same as login_processes_count and you don't have to wonder about it. I don't know if any other values make much sense anyway. From alessio at skye.it Tue Dec 20 09:41:46 2011 From: alessio at skye.it (Alessio Cecchi) Date: Tue, 20 Dec 2011 08:41:46 +0100 Subject: [Dovecot] Tuning Login processes for High-performance Mode In-Reply-To: <1324366789.3597.21.camel@innu> References: <4EEB3443.4030104@skye.it> <3A335D47-7D23-4A2F-952D-3454ACA62503@iki.fi> <4EF03820.4000406@skye.it> <1324366789.3597.21.camel@innu> Message-ID: <4EF03C3A.5030304@skye.it> Il 20/12/2011 08:39, Timo Sirainen ha scritto: > On Tue, 2011-12-20 at 08:24 +0100, Alessio Cecchi wrote: > >> I had read on wiki the ratio from core and login_processes_count, but I >> did not understand the ratio from login_processes_count and >> login_max_processes_count. > > Just set login_max_processes_count to same as login_processes_count and > you don't have to wonder about it. I don't know if any other values make > much sense anyway. > > Ok, thanks for this suggestion. Bye -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it @ LOLUG -> Socio http://www.lolug.net From nmilas at noa.gr Tue Dec 20 10:10:46 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 10:10:46 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: References: <4EEA6DF0.3080909@noa.gr> Message-ID: <4EF04306.4090804@noa.gr> On 20/12/2011 7:41 ??, Timo Sirainen wrote: > Can you try if changing it back helps? Or by running the same LDAP query using ldapsearch. Is there a reason why you changed the scope? (I'm not entirely sure what the LDAP schemes usually look like..) Hi Timo, The same query, using ldapsearch (with the same binddn, same scope, same filter) returns 247 entries. The command is (all searches are against localhost - it's a local replication slave [openldap syncrepl consumer]): /usr/local/openldap/bin/ldapsearch -x -W -vv -D "uid=authenticate,ou=System,dc=noa,dc=gr" -s one -b "ou=people,dc=example,dc=com" uid doveadm user '*' and doveadm quota get -A both return the same 30 entries. I noticed that most of them are the LDAP user entries most recently updated in the LDAP Server (although it doesn't make any sense to me why it so happens). I changed the scope in the search because my "ou=people,dc=example,dc=com" branch has some new sub-branches which contain user accounts not related with mailboxes and I didn't want them to be returned by the Dovecot search (they were useless). I only now tried changing the scope back to subtree and again to onelevel and found that nothing changes (again 30 entries are returned). For reference: /etc/dovecot/dovecot-userdb-ldap.conf (identical to dovecot-passdb-ldap.conf): hosts = localhost tls = no base = ou=people, dc=example, dc=com scope = onelevel ldap_version = 3 dn = uid=authenticate,ou=System,dc=example,dc=com dnpass = secret auth_bind = yes user_filter = (uid=%u) pass_filter = (uid=%u) pass_attrs = uid=user,userPassword=password auth_bind_userdn = uid=%u,ou=people,dc=example,dc=com user_attrs = roomNumber=quota_rule=*:bytes=%$,uid=home=/home/vmail/%u I have not managed yet to upgrade to 2.0.16 to see what happens... Thank you for your assistance, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From nmilas at noa.gr Tue Dec 20 10:14:11 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 10:14:11 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: References: <4EEA6DF0.3080909@noa.gr> Message-ID: <4EF043D3.7000006@noa.gr> I resend, because I forgot to change the true domain once and the previous message would appear to include inconsistencies... Sorry for this... On 20/12/2011 7:41 ??, Timo Sirainen wrote: > Can you try if changing it back helps? Or by running the same LDAP query using ldapsearch. Is there a reason why you changed the scope? (I'm not entirely sure what the LDAP schemes usually look like..) Hi Timo, The same query, using ldapsearch (with the same binddn, same scope, same filter) returns 247 entries. The command is (all searches are against localhost - it's a local replication slave [openldap syncrepl consumer]): /usr/local/openldap/bin/ldapsearch -x -W -vv -D "uid=authenticate,ou=System,dc=example,dc=com" -s one -b "ou=people,dc=example,dc=com" uid doveadm user '*' and doveadm quota get -A both return the same 30 entries. I noticed that most of them are the LDAP user entries most recently updated in the LDAP Server (although it doesn't make any sense to me why it so happens). I changed the scope in the search because my "ou=people,dc=example,dc=com" branch has some new sub-branches which contain user accounts not related with mailboxes and I didn't want them to be returned by the Dovecot search (they were useless). I only now tried changing the scope back to subtree and again to onelevel and found that nothing changes (again 30 entries are returned). For reference: /etc/dovecot/dovecot-userdb-ldap.conf (identical to dovecot-passdb-ldap.conf): hosts = localhost tls = no base = ou=people, dc=example, dc=com scope = onelevel ldap_version = 3 dn = uid=authenticate,ou=System,dc=example,dc=com dnpass = secret auth_bind = yes user_filter = (uid=%u) pass_filter = (uid=%u) pass_attrs = uid=user,userPassword=password auth_bind_userdn = uid=%u,ou=people,dc=example,dc=com user_attrs = roomNumber=quota_rule=*:bytes=%$,uid=home=/home/vmail/%u I have not managed yet to upgrade to 2.0.16 to see what happens... Thank you for your assistance, Nick From tss at iki.fi Tue Dec 20 10:15:21 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 10:15:21 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EF04306.4090804@noa.gr> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> Message-ID: <1324368921.3597.23.camel@innu> On Tue, 2011-12-20 at 10:10 +0200, Nikolaos Milas wrote: > On 20/12/2011 7:41 ??, Timo Sirainen wrote: > > > Can you try if changing it back helps? Or by running the same LDAP query using ldapsearch. Is there a reason why you changed the scope? (I'm not entirely sure what the LDAP schemes usually look like..) > > The same query, using ldapsearch (with the same binddn, same scope, same > filter) returns 247 entries. The command is (all searches are against > localhost - it's a local replication slave [openldap syncrepl consumer]): > > /usr/local/openldap/bin/ldapsearch -x -W -vv -D > "uid=authenticate,ou=System,dc=noa,dc=gr" -s one -b > "ou=people,dc=example,dc=com" uid > > doveadm user '*' and doveadm quota get -A both return the same 30 > entries. I noticed that most of them are the LDAP user entries most > recently updated in the LDAP Server (although it doesn't make any sense > to me why it so happens). Try adding (objectClass=posixAccount) as filter in the ldapsearch. That's the default iterate_filter. From nmilas at noa.gr Tue Dec 20 10:47:21 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 10:47:21 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324368921.3597.23.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> Message-ID: <4EF04B99.1030201@noa.gr> On 20/12/2011 10:15 ??, Timo Sirainen wrote: > Try adding (objectClass=posixAccount) as filter in the ldapsearch. > That's the default iterate_filter. We've caught it! Only the returned (30) accounts include the posixAccount objectClass! So I added in the LDAP setup: iterate_filter = (objectClass=*) and now everything works fine! Perhaps page: http://wiki2.dovecot.org/Tools/Doveadm/Altmove should explicitly state which is the default iterate_filter value, because in most LDAP applications (objectClass=*) is the default filter. Thanks very much Timo. All the best, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Tue Dec 20 10:57:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 10:57:19 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EF04B99.1030201@noa.gr> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> Message-ID: <1324371439.3597.25.camel@innu> On Tue, 2011-12-20 at 10:47 +0200, Nikolaos Milas wrote: > On 20/12/2011 10:15 ??, Timo Sirainen wrote: > > > Try adding (objectClass=posixAccount) as filter in the ldapsearch. > > That's the default iterate_filter. > > We've caught it! Only the returned (30) accounts include the > posixAccount objectClass! > > So I added in the LDAP setup: > > iterate_filter = (objectClass=*) > > and now everything works fine! Isn't that basically the same as an empty filter? What other types of objectClasses are there with user accounts? Perhaps the default should be changed to empty, or maybe to (uid=*) From cor at xs4all.nl Tue Dec 20 11:11:10 2011 From: cor at xs4all.nl (Cor Bosman) Date: Tue, 20 Dec 2011 10:11:10 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: Message-ID: <20111220091110.GA19728@xs4all.nl> I installed a newer kernel on these boxes, and it's fixed. Seems to be a problem with the stock debian squeeze kernel. Not a dovecot issue, but others with a stable squeeze box might see similar problems so good to have it in the archive :) regards, Cor From ronleach at tesco.net Tue Dec 20 11:49:06 2011 From: ronleach at tesco.net (Ron Leach) Date: Tue, 20 Dec 2011 09:49:06 +0000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <20111220091110.GA19728@xs4all.nl> References: <20111220091110.GA19728@xs4all.nl> Message-ID: <4EF05A12.7010502@tesco.net> On 20/12/2011 09:11, Cor Bosman wrote: > I installed a newer kernel on these boxes, and it's fixed. Seems to be > a problem with the stock debian squeeze kernel. Not a dovecot issue, but > others with a stable squeeze box might see similar problems so good > to have it in the archive :) Indeed; very many of us use Debian stable. Which kernel did you install that is 2.0.16-friendly, and was this from Debian stable's updates system? regards, Ron From nmilas at noa.gr Tue Dec 20 12:06:11 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 12:06:11 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324371439.3597.25.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> Message-ID: <4EF05E13.3000704@noa.gr> On 20/12/2011 10:57 ??, Timo Sirainen wrote: > On Tue, 2011-12-20 at 10:47 +0200, Nikolaos Milas wrote: >> So I added in the LDAP setup: >> >> iterate_filter = (objectClass=*) >> >> and now everything works fine! > Isn't that basically the same as an empty filter? What other types of > objectClasses are there with user accounts? Perhaps the default should > be changed to empty, or maybe to (uid=*) > I agree that the default should be changed to empty. There are various ObjectClasses available. For example, for normal user accounts (physical persons) the main objectClass we use is inetOrgPerson (with its parents: organizationalPerson, person) and for other, non-personal accounts we use objectClass: account. posixAccount objectClass is added to particular accounts when we want to assign further access privileges, mainly shell and FTP. Best regards, Nick -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5554 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Tue Dec 20 12:13:19 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:13:19 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <4EF05E13.3000704@noa.gr> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> <4EF05E13.3000704@noa.gr> Message-ID: <1324375999.3597.35.camel@innu> On Tue, 2011-12-20 at 12:06 +0200, Nikolaos Milas wrote: > > Isn't that basically the same as an empty filter? What other types of > > objectClasses are there with user accounts? Perhaps the default should > > be changed to empty, or maybe to (uid=*) > > > > I agree that the default should be changed to empty. But that also returns non-user results, like at least in my test setup it returns an organization and admin. > There are various ObjectClasses available. > > For example, for normal user accounts (physical persons) the main > objectClass we use is inetOrgPerson (with its parents: > organizationalPerson, person) and for other, non-personal accounts we > use objectClass: account. So you can have Dovecot accounts that aren't "person"s? Perhaps: iterate_filter = (uid=*) From tss at iki.fi Tue Dec 20 12:15:23 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:15:23 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324375999.3597.35.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> <4EF05E13.3000704@noa.gr> <1324375999.3597.35.camel@innu> Message-ID: <1324376123.3597.37.camel@innu> On Tue, 2011-12-20 at 12:13 +0200, Timo Sirainen wrote: > > I agree that the default should be changed to empty. > > But that also returns non-user results, like at least in my test setup > it returns an organization and admin. .. > Perhaps: iterate_filter = (uid=*) Actually, the current default iterate_filter is fine, if you look at the default pass/user filters: #user_filter = (&(objectClass=posixAccount)(uid=%u)) #pass_filter = (&(objectClass=posixAccount)(uid=%u)) From nmilas at noa.gr Tue Dec 20 12:16:12 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 12:16:12 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324371439.3597.25.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> Message-ID: <4EF0606C.7050908@noa.gr> On 20/12/2011 10:57 ??, Timo Sirainen wrote: > On Tue, 2011-12-20 at 10:47 +0200, Nikolaos Milas wrote: >> So I added in the LDAP setup: >> >> iterate_filter = (objectClass=*) >> >> and now everything works fine! > Isn't that basically the same as an empty filter? And I forgot to answer: Yes, (objectClass=*) is the same as an empty filter. An empty filter defaults to: (objectClass=*) Nick From tss at iki.fi Tue Dec 20 12:18:45 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:18:45 +0200 Subject: [Dovecot] doveadm index In-Reply-To: References: Message-ID: <1324376325.3597.39.camel@innu> On Wed, 2011-12-14 at 19:27 -0800, Daniel L. Miller wrote: > Does "doveadm index -A INBOX" reindex everything? What about users with > multiple folders, both subbed & not subbed under INBOX? It indexes INBOX (only) for all users. And it doesn't "reindex" anything, it just adds any missing stuff. From tss at iki.fi Tue Dec 20 12:24:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:24:06 +0200 Subject: [Dovecot] Quota PostgreSQL INSERT trigger In-Reply-To: References: Message-ID: <1324376646.3597.42.camel@innu> On Thu, 2011-12-15 at 09:37 +0100, Adis Nezirovic wrote: > Wiki instructions for creating insert trigger for PostgreSQL are wrong > http://wiki.dovecot.org/Quota/Dict > > Calling INSERT on the table from within BEFORE INSERT trigger creates > cascading trigger. Yes.. > Instead, one should return NEW record from the trigger, and it will be > inserted after trigger execution. But does this handle race conditions when a record is inserted/deleted while the trigger is being run? That's the reason this trigger is so complex. > BEGIN > IF NEW.messages = 0 THEN > RETURN NEW; > ELSE > NEW.messages = - NEW.messages; > RETURN NEW; > END IF; > EXCEPTION WHEN unique_violation THEN > -- someone just inserted the record, update it > END; I'd guess the unique_violation is never caught here, and instead the whole INSERT fails? From nmilas at noa.gr Tue Dec 20 12:30:57 2011 From: nmilas at noa.gr (Nikolaos Milas) Date: Tue, 20 Dec 2011 12:30:57 +0200 Subject: [Dovecot] doveadm quota does not list all accounts In-Reply-To: <1324376123.3597.37.camel@innu> References: <4EEA6DF0.3080909@noa.gr> <4EF04306.4090804@noa.gr> <1324368921.3597.23.camel@innu> <4EF04B99.1030201@noa.gr> <1324371439.3597.25.camel@innu> <4EF05E13.3000704@noa.gr> <1324375999.3597.35.camel@innu> <1324376123.3597.37.camel@innu> Message-ID: <4EF063E1.6050404@noa.gr> On 20/12/2011 12:15 ??, Timo Sirainen wrote: > > Perhaps: iterate_filter = (uid=*) > > Actually, the current default iterate_filter is fine, if you look at the > default pass/user filters: > > #user_filter = (&(objectClass=posixAccount)(uid=%u)) > #pass_filter = (&(objectClass=posixAccount)(uid=%u)) This means that default values for all these settings are compatible. I would say that it would be enough to explicitly state the default value for iterate_filter in the documentation. I guess the filter uid=* might probably also return all entries, because in many cases uid is part of the DN, so it is included in all entries. But this is not always the case. Nick From tss at iki.fi Tue Dec 20 12:35:24 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:35:24 +0200 Subject: [Dovecot] Building 2.1.rc1 with cluence, but without libstemmer In-Reply-To: References: Message-ID: <1324377324.3597.47.camel@innu> On Thu, 2011-12-15 at 12:05 +1100, Jan Mikkelsen wrote: > I'm testing out 2.1.rc1, building against clucene 2.3.3.4. > > Without libstemmber, the build fails because it attempts to include SnowballAnalyzer.h which is not part of "core" clucene. It was actually supposed to be distributed with Dovecot, but it got left out from the tarball. > What versions of libstemmer, http://snowball.tartarus.org/ this one. > clucene 2.3.3.4 > and libtextcat is dovecot 2.1.rc1 intended to be used against? http://www.let.rug.nl/vannoord/TextCat/ probably.. Basically I've just used the libstemmer and libtextcat that are in Debian. > Is it worth bringing the wrapper class around libstemmer into dovecot > to avoid funny dependencies against clucene and so that the -lstemmer > test in configure is enough? I'm hoping for a new CLucene release where I don't need libstemmer anymore. From tss at iki.fi Tue Dec 20 12:49:18 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:49:18 +0200 Subject: [Dovecot] Question about index reset in dovecot 2.0.15 In-Reply-To: <20111214211036.55980@gmx.com> References: <20111214211036.55980@gmx.com> Message-ID: <1324378158.6987.7.camel@innu> On Wed, 2011-12-14 at 22:10 +0100, Maria Arrea wrote: > I have seen some strange error log messages in our dovecot server (2.0.15, RHEL 5.7x64, mdbox+zlib, local storage, high load) > > Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent These messages shouldn't appear alone. Is there anything else logged about them? > Dec 14 20:56:46 buzon dovecot: imap(rcam): Error: Corrupted index cache file /indices_dovecot/indices/03/6b/rcam/mailboxes/INBOX/dovecot.index.cache: Broken virtual size for mail UID 132197 Possibly related to zlib.. Again it should have logged another error message just before this. > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox INBOX Possibly related to other errors. So .. none of the errors above really were what I'd call the actual cause of the problems. They were just after effects. > I have been googling without luck, why does this happen? I have tried with doveadm force-resync, maybe this could solve this issues. All of those should be fixed automatically. Do they keep happening if you don't do force-resync? How often do they happen anyway? Do they happen at any specific times (e.g. during doveadm purge)? From tss at iki.fi Tue Dec 20 12:54:50 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:54:50 +0200 Subject: [Dovecot] Dovecot 2.1rc1 + 2.0.16 woes regarding fts_squat In-Reply-To: <4EE7E4BB.2040008@r.paypc.com> References: <4EE7E4BB.2040008@r.paypc.com> Message-ID: <1324378490.6987.9.camel@innu> On Tue, 2011-12-13 at 15:50 -0800, Robin wrote: > I can confirm the report posted in > http://dovecot.org/list/dovecot/2011-November/062263.html that > fts_squat no longer seems to be used after moving from 2.0.16->2.1 rc > 1. I don't see crash reports in the logs, just "0 messages indexed". > My search test tool just does a normal IMAP SEARCH for a long > non-existent string. If there's another way to trigger re-indexing in > 2.1, I don't see anything in the documentation for it. Maybe it was buggy in v2.1.rc1 .. at least in my tests now it works with latest v2.1 hg. I should release rc2 soon I guess. > During a large mail import with 2.0.16 today, I ran across a worrying > message in the logs during an fts_squat reindex: out of memory. I'm not planning on doing any changes to fts-squat anymore. With v2.1 you can use fts-lucene instead. From tss at iki.fi Tue Dec 20 12:59:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 12:59:06 +0200 Subject: [Dovecot] dovecot penalties and anvil In-Reply-To: <4EE73988.1090000@solutti.com.br> References: <4EE73988.1090000@solutti.com.br> Message-ID: <1324378746.6987.13.camel@innu> On Tue, 2011-12-13 at 09:39 -0200, Leonardo Rodrigues wrote: > I'm strugling to find some documentation on dovecot's anvil service > and/or its penalties (that can be checked with doveadm penalty) ... but > i'm not finding anything on that. > > is there any documentation on anvil/penalties that i should check > other than a few messages on the mailing list archive ? Nope. Basically: * Each failed attempt doubles the penalty for next login attempt from that specific IP * Penalty is maxed out at 30 seconds * Each successful login (after waiting for penalty) will clear the penalty for that IP * You can disable the penalty entirely with: service anvil { unix_listener anvil-auth-penalty { mode = 0 } } I don't really like this penalty stuff. Maybe it's better than nothing, maybe not. Maybe there's a better way to do it. Not very useful for IPv6. From marco at carcano.ch Tue Dec 20 13:46:16 2011 From: marco at carcano.ch (Marco Carcano) Date: Tue, 20 Dec 2011 12:46:16 +0100 Subject: [Dovecot] Mail lost - maybe a bug??? In-Reply-To: <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> Message-ID: <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> Hello Timo and Urban I took quite a long time to reply, but as I told you this issue does not verify very often, so I had enabled verbose logging and just waited .. I summarize the situation - user mmanzoni sometimes does not receive a message - it does not matter if he is the only recipient or if there are others its outlook 2010 is configured for POP3 mail and to leave all messages on the server, and setup to never delete them (neither after a few days, neither when he deletes from his trash folder). There are not any other client that log to that mail account: this is the only one client that download messages the following extract of the LDA log shows what happened: the message was sent to 4 users (I report just 2 of them: criva, that received it, and mmanzoni, who didn't) ################CRIVA##################### Dec 12 10:51:24 srv001 dovecot: lda: Debug: Loading modules from directory: /usr/lib64/dovecot Dec 12 10:51:24 srv001 dovecot: lda: Debug: Module loaded: /usr/lib64/ dovecot/lib10_quota_plugin.so Dec 12 10:51:24 srv001 dovecot: lda: Debug: Module loaded: /usr/lib64/ dovecot/lib90_sieve_plugin.so Dec 12 10:51:24 srv001 dovecot: lda: Debug: auth input: criva home=/ home/criva 499=criva quota_rule=*:storage=8192M Dec 12 10:51:24 srv001 dovecot: lda: Debug: Added userdb setting: plugin/499=criva Dec 12 10:51:24 srv001 dovecot: lda: Debug: Added userdb setting: plugin/quota_rule=*:storage=8192M Dec 12 10:51:24 srv001 dovecot: lda(criva): Debug: Effective uid=499, gid=499, home=/home/criva Dec 12 10:51:24 srv001 dovecot: lda(criva): Debug: Quota root: name=User quota backend=maildir args= Dec 12 10:51:24 srv001 dovecot: lda(criva): Debug: Quota rule: root=User quota mailbox=* bytes=8589934592 messages=0 Dec 12 10:51:24 srv001 dovecot: lda(criva): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1048576000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=6871947673 (80%) messages=0 reverse=no command=quota-warning 80 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=7730941132 (90%) messages=0 reverse=no command=quota-warning 90 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=8160437862 (95%) messages=0 reverse=no command=quota-warning 95 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota root: name=Shared quota backend=maildir args=ns=Public/ Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota rule: root=Shared quota mailbox=* bytes=20971520000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mailboxstore/criva/Maildir Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: maildir++: root=/ home/mailboxstore/criva/Maildir, index=, control=, inbox=/home/ mailboxstore/criva/Maildir Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Namespace : type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:/home/mailboxstore/ %Lu/Maildir:INDEX=/home/mailboxstore/criva/Maildir/shared/%Lu Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: shared: root=/var/ run/dovecot, index=, control=, inbox= Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Namespace : type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:/home/mailboxstore/public Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: maildir++: root=/ home/mailboxstore/public, index=, control=, inbox= Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota root: name=User quota backend=maildir args= Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota rule: root=User quota mailbox=* bytes=14680064000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1048576000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=11744051200 (80%) messages=0 reverse=no command=quota-warning 80 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=13212057600 (90%) messages=0 reverse=no command=quota-warning 90 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota warning: bytes=13946060800 (95%) messages=0 reverse=no command=quota-warning 95 criva Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota root: name=Shared quota backend=maildir args=ns=Public/ Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: Quota rule: root=Shared quota mailbox=* bytes=20971520000 messages=0 Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: none: root=, index=, control=, inbox= Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: sieve: user's script path /home/mailboxstore/criva/.dovecot.sieve doesn't exist (using global script path in stead) Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: sieve: user has no valid personal script Dec 12 10:51:27 srv001 dovecot: lda(criva): Debug: sieve: no scripts to execute: reverting to default delivery. Dec 12 10:51:27 srv001 dovecot: lda(criva): msgid=<1888520041-1323683477-cardhu_decombobulator_blackberry.rim.net-2066152169- at b12.c13.bise7.blackberry >: saved mail to INBOX #################MMANZONI############### Dec 12 10:51:28 srv001 dovecot: lda: Debug: Loading modules from directory: /usr/lib64/dovecot Dec 12 10:51:28 srv001 dovecot: lda: Debug: Module loaded: /usr/lib64/ dovecot/lib10_quota_plugin.so Dec 12 10:51:28 srv001 dovecot: lda: Debug: Module loaded: /usr/lib64/ dovecot/lib90_sieve_plugin.so Dec 12 10:51:28 srv001 dovecot: lda: Debug: auth input: mmanzoni home=/ home/mmanzoni 499=mmanzoni quota_rule=*:storage=8192M Dec 12 10:51:28 srv001 dovecot: lda: Debug: Added userdb setting: plugin/499=mmanzoni Dec 12 10:51:28 srv001 dovecot: lda: Debug: Added userdb setting: plugin/quota_rule=*:storage=8192M Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Effective uid=499, gid=499, home=/home/mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota root: name=User quota backend=maildir args= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=User quota mailbox=* bytes=8589934592 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1048576000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=6871947673 (80%) messages=0 reverse=no command=quota-warning 80 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=7730941132 (90%) messages=0 reverse=no command=quota-warning 90 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=8160437862 (95%) messages=0 reverse=no command=quota-warning 95 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota root: name=Shared quota backend=maildir args=ns=Public/ Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=Shared quota mailbox=* bytes=20971520000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mailboxstore/mmanzoni/Maildir Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: maildir++: root=/ home/mailboxstore/mmanzoni/Maildir, index=, control=, inbox=/home/ mailboxstore/mmanzoni/Maildir Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Namespace : type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=no location=maildir:/home/mailboxstore/ %Lu/Maildir:INDEX=/home/mailboxstore/mmanzoni/Maildir/shared/%Lu Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: shared: root=/ var/run/dovecot, index=, control=, inbox= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Namespace : type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:/home/mailboxstore/public Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: maildir++: root=/ home/mailboxstore/public, index=, control=, inbox= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota root: name=User quota backend=maildir args= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=User quota mailbox=* bytes=14680064000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=User quota mailbox=Trash bytes=+1048576000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=11744051200 (80%) messages=0 reverse=no command=quota-warning 80 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=13212057600 (90%) messages=0 reverse=no command=quota-warning 90 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota warning: bytes=13946060800 (95%) messages=0 reverse=no command=quota-warning 95 mmanzoni Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota root: name=Shared quota backend=maildir args=ns=Public/ Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: Quota rule: root=Shared quota mailbox=* bytes=20971520000 messages=0 Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: none: root=, index=, control=, inbox= Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: sieve: user's script path /home/mailboxstore/mmanzoni/.dovecot.sieve doesn't exist (using global script path in stead) Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: sieve: user has no valid personal script Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): Debug: sieve: no scripts to execute: reverting to default delivery. Dec 12 10:51:28 srv001 dovecot: lda(mmanzoni): msgid=<1888520041-1323683477-cardhu_decombobulator_blackberry.rim.net-2066152169- at b12.c13.bise7.blackberry >: saved mail to INBOX ######################################### I know it seems absurd, but mmanzoni has not received the message - I tried also "grepping" for the object in the maildir, but haven't been able to get it what do you think about this? I really do not know where this issue can be - the only componet I suppose could have some kind of problem is in the LDA phase, but I'm just supposing do you want to give a look to my config files? If so, which one could be interesting to post? kind regards Marco Carcano Il giorno 17/nov/11, alle ore 18:34, Timo Sirainen ha scritto: > On 17.11.2011, at 18.47, Marco Carcano wrote: > >>>> Oct 27 11:20:34 srv001 dovecot: lda(user3): msgid=>>>> : saved mail to INBOX >>> >>> If Dovecot logs this, then the message definitely was saved to >>> INBOX. >> >> it is exactly what I told to my colleagues, but belive me, sometime >> some mail get lost - > > Most likely reason for this is that the user's client deletes the > message. Possibly an automatic client side filter or some UI issue > that causes user to accidentally delete a mail. The mail_log > plugin's logging would have showed if this was the case. > >> I suspect however that could be mine misconfiguration somewhere, so >> that lda sometimes write the email not in the right place, but >> elsewhere, and just write the phrase " saved mail to INBOX in the >> logs (however I'm wondering why sometimes?!?) > > I can't think of any reason why it would randomly write to a wrong > place. > >> I tried to find the missed email in the Maildir, but have not been >> able to get it - the commands used are >> >> cd /home/mailboxstore/theuser/Maildir >> >> grep "6000029222" */* |grep "RE:" >> grep "6000029222" .Drafts/* |grep "RE:" >> grep "6000029222" .Drafts/*/* |grep "RE:" >> grep "6000029222" .Junk/* |grep "RE:" >> grep "6000029222" .Posta\ eliminata/* |grep "RE:" >> grep "6000029222" .Posta\ indesiderata/* |grep "RE:" >> grep "6000029222" .Posta\ inviata/* |grep "RE:" >> grep "6000029222" .Sent/* |grep "RE:" >> grep "6000029222" .Templates/* |grep "RE:" >> grep "6000029222" .Trash/* |grep "RE:" > > Only the grep "6000029222" .Drafts/*/* |grep "RE:" was grepping from > mail files. Easier would be just: > > grep -r "RE:.*6000029222" . > >> I really think is some kind of misconfiguration of mine, may you >> help me, please? Just tell me what pieces of config to show (just >> not to flood the whole config) > > I doubt this is related to configuration. > > But you could enable http://wiki2.dovecot.org/Plugins/Lazyexpunge so > that messages won't be lost if they are expunged. The next time a > message is lost, you would most likely find it from the lazy-expunge > namespace. (Then you could write a script that deletes e.g. >1 week > old files nightly.) From drum.lucas at gmail.com Tue Dec 20 14:26:00 2011 From: drum.lucas at gmail.com (drum.lucas at gmail.com) Date: Tue, 20 Dec 2011 10:26:00 -0200 Subject: [Dovecot] v2.x services documentation In-Reply-To: <04D662E7-2A0A-448B-BA21-1E337A400CA6@iki.fi> References: <04D662E7-2A0A-448B-BA21-1E337A400CA6@iki.fi> Message-ID: Well I've got some servers running 1.0 with dovecot, however, I make the installation of Dovecot 2.0 and would like to understand better the way it works. It uses the files in / etc / dovecot / conf.d right? Example: protocol pop3 protocol imap {{or is everything in / etc/dovecot/conf.d/10-master.conf? Or the directory conf.d it is only for examples and everything is still done in dovecot.conf? Thanks Lucas Possamai 2011/12/7 Timo Sirainen > If you've ever wanted to know everything about the service {} blocks, this > should be quite helpful: http://wiki2.dovecot.org/Services > > -- *Lucas Possamai* taekwondo facebook vivaolinux work blog funny From maria_arrea at gmx.com Tue Dec 20 14:48:12 2011 From: maria_arrea at gmx.com (Maria Arrea) Date: Tue, 20 Dec 2011 13:48:12 +0100 Subject: [Dovecot] Question about index reset in dovecot 2.0.15 Message-ID: <20111220124812.55990@gmx.com> Hello Timo, thank you in advance. Full log here (1 hour time range) Dec 14 21:19:43 buzon postfix/pipe[27103]: 4423BC7C31: to=, relay=dovecot, delay=0.24, delays=0.03 /0/0/0.2, dsn=2.0.0, status=sent (delivered via dovecot service) Dec 14 21:20:59 buzon dovecot: imap(fmcarrasco): Disconnected: Logged out bytes=556/2245 Dec 14 21:44:30 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 21:44:30 buzon dovecot: imap(fmcarrasco): Disconnected: IMAP session state is inconsistent, please relogin. bytes=42402/3153543 Dec 14 21:45:30 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=20035, TLS Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Disconnected: IMAP session state is inconsistent, please relogin. bytes=343/8671 Dec 14 22:02:58 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=2685, TLS Dec 14 22:13:46 buzon dovecot: lda(fmcarrasco): sieve: msgid=: stored mail into mailbox 'INBOX' Dec 14 22:13:46 buzon postfix/pipe[21152]: AAD36C8501: to=, relay=dovecot, delay=0.34, delays=0.03/0.01/0/0.31, dsn=2.0.0, status=sent (delivered via dovecot service) The other one: Dec 14 20:53:38 buzon dovecot: pop3(cfp): Connection closed top=0/0, retr=0/0, del=0/3605, size=446902389 Dec 14 21:38:34 buzon postfix/qmgr[4015]: A90CFC7C31: from=, size=23256, nrcpt=1 (queue active) Dec 14 21:43:00 buzon postfix/qmgr[4015]: E7E61C7DED: from=, size=23244, nrcpt=1 (queue active) Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=32118/127014 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox Trash Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Trash/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=38097/309083 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox Preinscripcion Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Preinscripcion/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=33263/164275 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Emagister/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=35437/111594 Dec 14 21:50:38 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=24811, TLS Dec 14 21:50:39 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=24822, TLS Dec 14 21:52:12 buzon postfix/cleanup[21212]: 9A22CC816C: message-id= Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=554/169764 Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Trash/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=533/10963 Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Preinscripcion/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=629/39790 Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=613/496956 Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=464, TLS Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=465, TLS Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=466, TLS Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=467, TLS Dec 14 22:30:28 buzon dovecot: pop3-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=25194 I do not see any pattern about this problem of index reset, logs from other day, maybe the problem is I/O load based: Dec 15 13:16:06 buzon dovecot: imap(ehlers): Connection closed bytes=357/20249 Dec 15 13:16:06 buzon dovecot: imap(ehlers): Connection closed bytes=70/12804 Dec 15 13:16:12 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=1005 Dec 15 13:16:12 buzon dovecot: imap(ehlers): Connection closed bytes=103/818 Dec 15 13:16:19 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=1419 Dec 15 13:16:19 buzon dovecot: imap(ehlers): Error: Mailbox Archivador/Facultad/curso whiteboard: Corrupted index, uidvalidity=0 Dec 15 13:16:19 buzon dovecot: imap(ehlers): Warning: mdbox /buzones/domain/11/53/ehlers/storage: rebuilding indexes Dec 15 13:16:19 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=1426 Dec 15 13:16:19 buzon dovecot: imap(ehlers): Connection closed bytes=459/3205 Dec 15 13:16:32 buzon dovecot: imap(ehlers): Error: /indices_dovecot/indices/11/53/ehlers/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 15 13:16:32 buzon dovecot: imap(ehlers): Disconnected: IMAP session state is inconsistent, please relogin. bytes=195/963 Dec 15 13:16:32 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=2006 Dec 15 13:16:32 buzon dovecot: imap(ehlers): Connection closed bytes=274/80860 Dec 15 13:16:49 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=2735 Any idea? Regards Maria On Wed, 2011-12-14 at 22:10 +0100, Maria Arrea wrote: > I have seen some strange error log messages in our dovecot server (2.0.15, RHEL 5.7x64, mdbox+zlib, local storage, high load) > > Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent These messages shouldn't appear alone. Is there anything else logged about them? > Dec 14 20:56:46 buzon dovecot: imap(rcam): Error: Corrupted index cache file /indices_dovecot/indices/03/6b/rcam/mailboxes/INBOX/dovecot.index.cache: Broken virtual size for mail UID 132197 Possibly related to zlib.. Again it should have logged another error message just before this. > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox INBOX Possibly related to other errors. So .. none of the errors above really were what I'd call the actual cause of the problems. They were just after effects. > I have been googling without luck, why does this happen? I have tried with doveadm force-resync, maybe this could solve this issues. All of those should be fixed automatically. Do they keep happening if you don't do force-resync? How often do they happen anyway? Do they happen at any specific times (e.g. during doveadm purge)? From tss at iki.fi Tue Dec 20 15:37:29 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 15:37:29 +0200 Subject: [Dovecot] Mail lost - maybe a bug??? In-Reply-To: <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> Message-ID: <1324388249.6987.32.camel@innu> On Tue, 2011-12-20 at 12:46 +0100, Marco Carcano wrote: > Hello Timo and Urban > > I took quite a long time to reply, but as I told you this issue does > not verify very often, so I had enabled verbose logging and just > waited .. Enabling mail_log plugin and/or lazy_expunge plugin would have helped more (both mentioned in my previous mail). > I summarize the situation - user mmanzoni sometimes does not receive a > message - it does not matter if he is the only recipient or if there > are others > > its outlook 2010 is configured for POP3 mail and to leave all messages > on the server, and setup to never delete them (neither after a few > days, neither when he deletes from his trash folder). There are not > any other client that log to that mail account: this is the only one > client that download messages > > the following extract of the LDA log shows what happened: the message > was sent to 4 users (I report just 2 of them: criva, that received it, > and mmanzoni, who didn't) There's really nothing in the LDA log that could explain why the message gets lost. It most likely was successfully delivered by LDA, but got deleted afterwards for some reason. You mean that this user's mails are never supposed to be deleted via POP3? Verify that with: grep 'pop3.*mmanzoni.*del=[^0]' /var/log/dovecot.log or wherever those POP3 disconnection messages are logged, i.e. you should find lots of messages with: grep 'pop3.*mmanzoni.*del=0' /var/log/dovecot.log From tss at iki.fi Tue Dec 20 15:40:42 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 15:40:42 +0200 Subject: [Dovecot] v2.x services documentation In-Reply-To: References: <04D662E7-2A0A-448B-BA21-1E337A400CA6@iki.fi> Message-ID: <1324388442.6987.35.camel@innu> On Tue, 2011-12-20 at 10:26 -0200, drum.lucas at gmail.com wrote: > Well I've got some servers running 1.0 with dovecot, however, I make the > installation of Dovecot 2.0 and would like to understand better the way it > works. > > It uses the files in / etc / dovecot / conf.d right? > > Example: protocol pop3 protocol imap {{or > is everything in / etc/dovecot/conf.d/10-master.conf? > > Or the directory conf.d it is only for examples and everything is still > done in dovecot.conf? It still uses dovecot.conf just like before. It's just that the new included example dovecot.conf has an "!include conf.d/*.conf" line, and the example configuration is split in those files. So if you want to do it like the new example config does, you need to modify the conf.d/* files. (But all of this could have been done this way in v1.x already, so it's not really any different in that way.) From janfrode at tanso.net Tue Dec 20 16:38:15 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Tue, 20 Dec 2011 15:38:15 +0100 Subject: [Dovecot] Sieve too rfc compliant ;-) Message-ID: <20111220143815.GA2236@dibs.tanso.net> It seems we have a few email addresses that are not RFC 5322 compliant, and now that we've started using sieve these are failing. The problem is that we have a few addresses with leading, trailing or double dots in the local part: jan..frode at tanso.net .janfrode at tanso.net janfrode. at tanso.net I believe these has been working fine with everything else in dovecot (lda, lmtp, imap, pop), but that sieve is more strict. I think it's fair enough that it's strict with messages generated by sieve scripts, but it would be nice if it could be more tolerant with messages addressed for the sieve script. So, is there any setting for making it more tolerant ? -jf From tss at iki.fi Tue Dec 20 16:45:47 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 16:45:47 +0200 Subject: [Dovecot] Question about index reset in dovecot 2.0.15 In-Reply-To: <20111220124812.55990@gmx.com> References: <20111220124812.55990@gmx.com> Message-ID: <1324392347.6987.46.camel@innu> On Tue, 2011-12-20 at 13:48 +0100, Maria Arrea wrote: > Hello Timo, thank you in advance. Full log here (1 hour time range) It could be useful to have all error/warning messages logged to their own file, so you could quickly see a list of all errors from the last day or two. That's also the log I'd be more interested in seeing. What things do you have accessing mailboxes? * imap * pop3 * dovecot-lda * doveadm purge Nothing else? No dsync for example? > Dec 14 21:44:30 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent I think these should happen only when dbox is being rebuilt by another process at the same time.. But it's a bit strange that it happens again in another session: > Dec 14 21:45:30 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=20035, TLS > Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Kind of looks as if it isn't fixing itself?.. Also it might be helpful to have PID in the log lines: mail_log_prefix = %s(%u %p): > The other one: > > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Again it's strange how this begins. > Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=32118/127014 > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox Trash > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Trash/dovecot.index reset, view is now inconsistent > Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=38097/309083 > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox Preinscripcion > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Preinscripcion/dovecot.index reset, view is now inconsistent > Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=33263/164275 > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Emagister/dovecot.index reset, view is now inconsistent > Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=35437/111594 > Dec 14 21:50:38 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=24811, TLS > Dec 14 21:50:39 buzon dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=24822, TLS > Dec 14 21:52:12 buzon postfix/cleanup[21212]: 9A22CC816C: message-id= > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=554/169764 > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Trash/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=533/10963 > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Preinscripcion/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=629/39790 > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/INBOX/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=613/496956 But all of the rest of this is quite clearly caused by the first problem. > I do not see any pattern about this problem of index reset, logs from other day, maybe the problem is I/O load based: > > Dec 15 13:16:19 buzon dovecot: imap(ehlers): Error: Mailbox Archivador/Facultad/curso whiteboard: Corrupted index, uidvalidity=0 This is clearly an originating error. But perhaps this is a newly created mailbox? I just noticed that this can happen if a mailbox creation is slow, and another session opens the mailbox before its creation has been finished. Check with: doveadm dump ".../mdbox/mailboxes/Mailbox Archivador/Facultad/curso whiteboard/dbox-Mails" The interesting lines in the output are: index id ................. = 1324032275 (2011-12-16 12:44:35) uid validity ............. = 1324032275 (2011-12-16 12:44:35) > Dec 15 13:16:19 buzon dovecot: imap(ehlers): Warning: mdbox /buzones/domain/11/53/ehlers/storage: rebuilding indexes This then caused all of the user's other existing processes to fail with: > Dec 15 13:16:32 buzon dovecot: imap(ehlers): Error: /indices_dovecot/indices/11/53/ehlers/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Perhaps the other users' problems began with similar errors? From marco at carcano.ch Tue Dec 20 16:52:21 2011 From: marco at carcano.ch (Marco Carcano) Date: Tue, 20 Dec 2011 15:52:21 +0100 Subject: [Dovecot] Mail lost - maybe a bug??? In-Reply-To: <1324388249.6987.32.camel@innu> References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> <1324388249.6987.32.camel@innu> Message-ID: Hello Timo and thanks again for the ultra quick reply! > Enabling mail_log plugin and/or lazy_expunge plugin would have helped > more (both mentioned in my previous mail). Sorry - I thought I have enabled it, but maybe I did something wrong with the configuration and it was not enabled: here is what I did in order to enable mail_log: syslog_facility = local5 mail_debug = yes plugin { # Events to log. Also available: flag_change append mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename # Group events within a transaction to one line. #mail_log_group_events = no # Available fields: uid, box, msgid, from, subject, size, vsize, flags # size and vsize are available only for expunge and copy events. #mail_log_fields = uid box msgid size } > > There's really nothing in the LDA log that could explain why the > message > gets lost. It most likely was successfully delivered by LDA, but got > deleted afterwards for some reason. > > You mean that this user's mails are never supposed to be deleted via > POP3? Verify that with: yes, you got it - it is never supposed only because we are debugging ;O) > > grep 'pop3.*mmanzoni.*del=[^0]' /var/log/dovecot.log > > or wherever those POP3 disconnection messages are logged, i.e. you > should find lots of messages with: > > grep 'pop3.*mmanzoni.*del=0' /var/log/dovecot.log > > OK, tried the following - I have varoius log files grep 'pop3.*mmanzoni.*del=[^0]' deliver.log* and got nothing grep 'pop3.*criva.*del=[^0]' deliver.log* and got deliver.log.1:Dec 15 12:26:16 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=1/8147, del=1613/1613, size=619997598 deliver.log.1:Dec 15 12:27:39 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=200/50212479, del=200/200, size=50208702 deliver.log.1:Dec 15 12:29:08 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=600/203527129, del=600/600, size=203515938 deliver.log.1:Dec 15 12:30:49 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=1000/310592896, del=1000/1000, size=310574037 deliver.log.1:Dec 15 12:31:10 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=399/44426198, del=399/399, size=44418942 deliver.log.2:Dec 15 00:11:09 srv001 dovecot: pop3(criva): Disconnected: Logged out top=0/0, retr=10530/1684049964, del=10530/10530, size=1683854308 so yes, I'm pretty sure that mmanzoni never deletes messages belive to me - usually I try to solve problems myself without disturbing anyone else, but this time is really hard and I do not know if I could face it alone I hope you can help kind regards Marco Carcano From stephan at rename-it.nl Tue Dec 20 17:46:33 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 20 Dec 2011 16:46:33 +0100 Subject: [Dovecot] Sieve too rfc compliant ;-) In-Reply-To: <20111220143815.GA2236@dibs.tanso.net> References: <20111220143815.GA2236@dibs.tanso.net> Message-ID: <4EF0ADD9.6090704@rename-it.nl> On 12/20/2011 3:38 PM, Jan-Frode Myklebust wrote: > It seems we have a few email addresses that are not RFC 5322 compliant, > and now that we've started using sieve these are failing. The problem is > that we have a few addresses with leading, trailing or double dots in > the local part: > > jan..frode at tanso.net > .janfrode at tanso.net > janfrode. at tanso.net > > I believe these has been working fine with everything else in dovecot > (lda, lmtp, imap, pop), but that sieve is more strict. I think it's fair > enough that it's strict with messages generated by sieve scripts, but it > would be nice if it could be more tolerant with messages addressed for > the sieve script. > > So, is there any setting for making it more tolerant ? Could you indicate exactly in what situations these examples cause trouble? What does Sieve log? Then I'll give it a look. Regards, Stephan. From tss at iki.fi Tue Dec 20 18:48:57 2011 From: tss at iki.fi (Timo Sirainen) Date: Tue, 20 Dec 2011 18:48:57 +0200 Subject: [Dovecot] Mail lost - maybe a bug??? In-Reply-To: References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> <1324388249.6987.32.camel@innu> Message-ID: On 20.12.2011, at 16.52, Marco Carcano wrote: >> Enabling mail_log plugin and/or lazy_expunge plugin would have helped >> more (both mentioned in my previous mail). > > Sorry - I thought I have enabled it, but maybe I did something wrong with the configuration and it was not enabled: > > here is what I did in order to enable mail_log: > > syslog_facility = local5 > > mail_debug = yes > > plugin { > # Events to log. Also available: flag_change append > mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename > # Group events within a transaction to one line. > #mail_log_group_events = no > # Available fields: uid, box, msgid, from, subject, size, vsize, flags > # size and vsize are available only for expunge and copy events. > #mail_log_fields = uid box msgid size > } You're missing: mail_plugins = mail_log >> grep 'pop3.*mmanzoni.*del=[^0]' /var/log/dovecot.log >> >> or wherever those POP3 disconnection messages are logged, i.e. you >> should find lots of messages with: >> >> grep 'pop3.*mmanzoni.*del=0' /var/log/dovecot.log >> >> > > OK, tried the following - I have varoius log files > > grep 'pop3.*mmanzoni.*del=[^0]' deliver.log* > > and got nothing But with: grep 'pop3.*mmanzoni.*del=0' deliver.log* There are log entries listed since December 12? (So they haven't gotten deleted from the logs already?) Also what kind of tools are ever accessing mails? Is it just Dovecot LDA + IMAP + POP3? No doveadm or any external tools? From profymath at yahoo.com Tue Dec 20 20:16:08 2011 From: profymath at yahoo.com (I M) Date: Tue, 20 Dec 2011 10:16:08 -0800 (PST) Subject: [Dovecot] Why imap_open doesn't work as is expected to? Message-ID: <1324404968.11869.YahooMailClassic@web125602.mail.ne1.yahoo.com> Hi, everybody! Question: Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? Note:?imap.so is loaded!?imap.ini is parsed!? From profymath at yahoo.com Tue Dec 20 21:20:21 2011 From: profymath at yahoo.com (I M) Date: Tue, 20 Dec 2011 11:20:21 -0800 (PST) Subject: [Dovecot] Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? Message-ID: <1324408821.52360.YahooMailClassic@web125603.mail.ne1.yahoo.com> Hi, everybody! Question: Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? Note:?imap.so is loaded!?imap.ini is parsed!php flags is checked! Is it a bug? From leolistas at solutti.com.br Tue Dec 20 21:46:28 2011 From: leolistas at solutti.com.br (Leonardo Rodrigues) Date: Tue, 20 Dec 2011 17:46:28 -0200 Subject: [Dovecot] Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? In-Reply-To: <1324408821.52360.YahooMailClassic@web125603.mail.ne1.yahoo.com> References: <1324408821.52360.YahooMailClassic@web125603.mail.ne1.yahoo.com> Message-ID: <4EF0E614.5090209@solutti.com.br> if it works through telnet, so dovecot is working and you probably have a PHP problem, which should be probably pointed to a PHP related mailing list. Em 20/12/11 17:20, I M escreveu: > Hi, everybody! > Question: Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? > Note: imap.so is loaded! imap.ini is parsed!php flags is checked! > Is it a bug? -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, N?O mandem email gertrudes at solutti.com.br My SPAMTRAP, do not email it From dmiller at amfes.com Tue Dec 20 22:02:34 2011 From: dmiller at amfes.com (Daniel L. Miller) Date: Tue, 20 Dec 2011 12:02:34 -0800 Subject: [Dovecot] doveadm index In-Reply-To: <1324376325.3597.39.camel@innu> References: <4EE9690A.7040308@amfes.com> <1324376325.3597.39.camel@innu> Message-ID: On 12/20/2011 2:18 AM, Timo Sirainen wrote: > On Wed, 2011-12-14 at 19:27 -0800, Daniel L. Miller wrote: >> Does "doveadm index -A INBOX" reindex everything? What about users with >> multiple folders, both subbed& not subbed under INBOX? > It indexes INBOX (only) for all users. And it doesn't "reindex" > anything, it just adds any missing stuff. > > Ok - IS there a command that will ... fully update ... all folders for all users? Will something like "doveadm search -A text zyxabcxyz > /dev/null" work? -- Daniel From pete at linuxbox.co.uk Wed Dec 21 01:08:14 2011 From: pete at linuxbox.co.uk (Peter Smith) Date: Tue, 20 Dec 2011 23:08:14 -0000 (GMT) Subject: [Dovecot] APOP and AuthDatabase/SQL Message-ID: <403888bda02b86bbf1d557c344d2191f.squirrel@linuxbox.co.uk> Hi, We're running dovecot 1.2.15 and use SQL authentication. We'd like to be able to support APOP, but can't see how this would fit in with SQL auth. Currently we have: password_query = SELECT email as user, password FROM virtual_users WHERE email='%u' or (email LIKE '%n@%%' AND unhashed='%w') It seems that in order to auth APOP logins, we'd need to access variables containing the authentication string sent by the client, and also variables containing the auth string sent in the POP3 greeting. Incidentally, the RFC (1939) suggests using: for the greeting, but it looks as if dovecot uses something else? I'm seeing greetings such as: +OK Dovecot ready. <260f.4abcc.4ef11550.cJD6sQSUSnmPS1B/5RGF0Q==@myhostname.com> base64 encoding? Thanks in advance, Peter Smith From gchodos at gmail.com Wed Dec 21 06:09:17 2011 From: gchodos at gmail.com (Gary Chodos) Date: Tue, 20 Dec 2011 23:09:17 -0500 Subject: [Dovecot] lmtp logging incomplete (does not tell what mailbox mail is actually being saved to!) Message-ID: We created a new virtual domain and created a user in that domain in our pgsql database. Instead of creating any directory structure in /home/virtual/mail//, I just sent a test email to see if dovecot's lmtp would autocreate. And it did! And mail appears to be delivered to an inbox.. but, logging is weird and I'm not sure everything is working as it should because: Dec 20 23:01:28 mx dovecot: lmtp(21458, user at example.com): lUDFG8tZ8U7SUwAAO3tENA: msgid=<20111221040122.GP13367 at hostname.example.org>: saved mail to . so why doesn't dovecot log where mail is stored/saved? thanks, Gary From p at state-of-mind.de Wed Dec 21 07:18:03 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 21 Dec 2011 06:18:03 +0100 Subject: [Dovecot] Problem listing SPECIAL-USE flags Message-ID: <20111221051802.GB2286@state-of-mind.de> Timo, we want to implement SPECIAL-USE in Thunderbird (TB), but we've run into problems. I believe you could help change that. Here's the problem: By default TB only lists subscribed (LSUB) folders when it accesses an IMAP server. However when I do a LSUB on recent Dovecot 2.1 code from mercurial I don't get to see the SPECIAL-USE flags. Therefore TB fails to identify which folders it should use and map to until someone tells it to list all folders (LIST) manually. Central part of the SPECIAL-USE idea was/is to require as little user interaction as possible to automatically setup a MUA to do the right thing. Speculating that probably most MUAs will do a LSUB by default and never will get to see SPECIAL-USE flags I think it is easier to have the server-side promote the flags. Do you think that would be possible? Just to verify I configured Dovecot as you would expect for SPECIAL-USE: I've set Dovecot 2.1 to autocreate and autosubscribe SPECIAL-USE mailboxes like this: namespace inbox { ... mailbox AltDrafts { special_use = \Drafts auto = subscribe } ... } This is what I get: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5] Dovecot 2.1 ready. t1 login alice at example.com secret t1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS FUZZY SPECIAL-USE] Logged in t2 LSUB "" "%" * LSUB () "." "Trash" * LSUB () "." "AltDrafts" * LSUB () "." "AltSent" * LSUB () "." "Archives" * LSUB () "." "AltTrash" * LSUB () "." "AltJunk" * LSUB () "." "AltArchive" * LSUB () "." "Junk" t2 OK Lsub completed. t3 LIST "" "%" * LIST (\HasNoChildren \Sent) "." "AltSent" * LIST (\HasChildren) "." "Archives" * LIST (\HasNoChildren \Archive) "." "AltArchive" * LIST (\HasNoChildren \Junk) "." "AltJunk" * LIST (\HasNoChildren) "." "Junk" * LIST (\HasNoChildren \Trash) "." "AltTrash" * LIST (\HasNoChildren \Drafts) "." "AltDrafts" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "INBOX" t3 OK List completed. t4 logout * BYE Logging out t4 OK Logout completed. Connection closed by foreign host. Thanks, p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From slusarz at curecanti.org Wed Dec 21 08:24:44 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 20 Dec 2011 23:24:44 -0700 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111221051802.GB2286@state-of-mind.de> References: <20111221051802.GB2286@state-of-mind.de> Message-ID: <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> Quoting Patrick Ben Koetter

: > we want to implement SPECIAL-USE in Thunderbird (TB), but we've run into > problems. I believe you could help change that. > > Here's the problem: > > By default TB only lists subscribed (LSUB) folders when it accesses an IMAP > server. However when I do a LSUB on recent Dovecot 2.1 code from mercurial I > don't get to see the SPECIAL-USE flags. Therefore TB fails to identify which > folders it should use and map to until someone tells it to list all folders > (LIST) manually. > > Central part of the SPECIAL-USE idea was/is to require as little user > interaction as possible to automatically setup a MUA to do the right thing. > > Speculating that probably most MUAs will do a LSUB by default and never will > get to see SPECIAL-USE flags I think it is easier to have the server-side > promote the flags. Except you never, never, never, never, never can rely on LSUB for mailbox attributes. It says so right in RFC 3501 [6.3.9]: The returned untagged LSUB response MAY contain different mailbox flags from a LIST untagged response. If this should happen, the flags in the untagged LIST are considered more authoritative. See also RFC 5258 [3.1], which discusses the difference between the base RFC 3501 LSUB command and the LIST-EXTENDED SUBSCRIBED option: This option is intended to supplement the LSUB command. Of particular note are the mailbox attributes as returned by this option, compared with what is returned by LSUB. With the latter, the attributes returned may not reflect the actual attribute status on the mailbox name, and the \NoSelect attribute has a second special meaning (it indicates that this mailbox is not, itself, subscribed, but that it has descendant mailboxes that are). With the SUBSCRIBED selection option described here, the attributes are accurate and complete, and have no special meanings. "LSUB" and "LIST (SUBSCRIBED)" are, thus, not the same thing, and some servers must do significant extra work to respond to "LIST (SUBSCRIBED)". Because of this, clients SHOULD continue to use "LSUB" unless they specifically want the additional information offered by "LIST (SUBSCRIBED)". Even if Timo changes things on Dovecot, you still can't rely on the flags returned from an LSUB command because other servers are not guaranteed to act the same way. That's just the reality of IMAP. LSUB is only useful for grabbing the list of subscribed mailboxes (I *really* hope TB is not using flags from the LSUB response for any meaningful purpose - that is simply badly broken behavior). In conclusion, there are 2 ways of handling special-use flags: 1. If the server that supports SPECIAL-USE also supports LIST-EXTENDED (RFC 5258), you are in luck. You can then use LIST-EXTENDED which can accurately retrieve both the list of subscribed mailboxes and special-use flags in a single command. 2. If the server supports SPECIAL-USE but does NOT support LIST-EXTENDED, you MUST make a LIST call. A LSUB call is not sufficient. It's inefficient, but that's the only way to be 100% sure the information in the response is accurate. michael From tss at iki.fi Wed Dec 21 08:26:42 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 08:26:42 +0200 Subject: [Dovecot] doveadm index In-Reply-To: References: <4EE9690A.7040308@amfes.com> <1324376325.3597.39.camel@innu> Message-ID: <34DB33F4-27C1-41DA-91F5-46F0AA712C78@iki.fi> On 20.12.2011, at 22.02, Daniel L. Miller wrote: > On 12/20/2011 2:18 AM, Timo Sirainen wrote: >> On Wed, 2011-12-14 at 19:27 -0800, Daniel L. Miller wrote: >>> Does "doveadm index -A INBOX" reindex everything? What about users with >>> multiple folders, both subbed& not subbed under INBOX? >> It indexes INBOX (only) for all users. And it doesn't "reindex" >> anything, it just adds any missing stuff. >> >> > Ok - IS there a command that will ... fully update ... all folders for all users? Will something like "doveadm search -A text zyxabcxyz > /dev/null" work? For updating full text search indexes, I guess you could do a "doveadm fetch uid text asdfasf > /dev/null".. But some day doveadm index (and several other commands) should allow wildcards in mailbox names, so you could just do doveadm index -A '*' From tss at iki.fi Wed Dec 21 08:28:42 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 08:28:42 +0200 Subject: [Dovecot] APOP and AuthDatabase/SQL In-Reply-To: <403888bda02b86bbf1d557c344d2191f.squirrel@linuxbox.co.uk> References: <403888bda02b86bbf1d557c344d2191f.squirrel@linuxbox.co.uk> Message-ID: <4F901E30-3A93-4C88-87A7-0E8342C1A3A2@iki.fi> On 21.12.2011, at 1.08, Peter Smith wrote: > We're running dovecot 1.2.15 and use SQL authentication. We'd like to > be able to support APOP, but can't see how this would fit in with SQL > auth. > > Currently we have: > > password_query = SELECT email as user, password FROM virtual_users > WHERE email='%u' or (email LIKE '%n@%%' AND unhashed='%w') > > It seems that in order to auth APOP logins, we'd need to access > variables containing the authentication string sent by the client, and > also variables containing the auth string sent in the POP3 greeting. The only way to get it working is to have the password_query return the password in plaintext, so Dovecot can do the APOP check. There's no way to get the APOP greeting string. From tss at iki.fi Wed Dec 21 08:29:43 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 08:29:43 +0200 Subject: [Dovecot] lmtp logging incomplete (does not tell what mailbox mail is actually being saved to!) In-Reply-To: References: Message-ID: On 21.12.2011, at 6.09, Gary Chodos wrote: > We created a new virtual domain and created a user in that domain in > our pgsql database. Instead of creating any directory structure in > /home/virtual/mail//, I just sent a test email to see if > dovecot's lmtp would autocreate. And it did! And mail appears to be > delivered to an inbox.. but, logging is weird and I'm not sure > everything is working as it should because: > > Dec 20 23:01:28 mx dovecot: lmtp(21458, user at example.com): > lUDFG8tZ8U7SUwAAO3tENA: > msgid=<20111221040122.GP13367 at hostname.example.org>: saved mail to > > . so why doesn't dovecot log where mail is stored/saved? That's a bug. Fixed by http://hg.dovecot.org/dovecot-2.0/rev/6d188f4e8e6a The empty string anyway means INBOX. From tss at iki.fi Wed Dec 21 08:38:51 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 08:38:51 +0200 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> Message-ID: <7151089E-C041-4A17-BA68-97615EED6BEC@iki.fi> On 21.12.2011, at 8.24, Michael M Slusarz wrote: > That's just the reality of IMAP. LSUB is only useful for grabbing the list of subscribed mailboxes (I *really* hope TB is not using flags from the LSUB response for any meaningful purpose - that is simply badly broken behavior). It does: # tb-lsub-flags: # Show \Noselect flags for LSUB replies with LAYOUT=fs (e.g. mbox). # This makes Thunderbird realize they aren't selectable and show them # greyed out, instead of only later giving "not selectable" popup error. > In conclusion, there are 2 ways of handling special-use flags: > > 1. If the server that supports SPECIAL-USE also supports LIST-EXTENDED (RFC 5258), you are in luck. You can then use LIST-EXTENDED which can accurately retrieve both the list of subscribed mailboxes and special-use flags in a single command. > 2. If the server supports SPECIAL-USE but does NOT support LIST-EXTENDED, you MUST make a LIST call. A LSUB call is not sufficient. It's inefficient, but that's the only way to be 100% sure the information in the response is accurate. Agreed. I thought about adding the flags to LSUB, but then thought that other servers probably won't do it either. Note how GMail sends them with XLIST command, but there is no XLSUB command. From marco at carcano.ch Wed Dec 21 10:54:05 2011 From: marco at carcano.ch (marco at carcano.ch) Date: Wed, 21 Dec 2011 09:54:05 +0100 Subject: [Dovecot] =?utf-8?q?Mail_lost_-_maybe_a_bug=3F=3F=3F?= In-Reply-To: References: <0A7F1BA2-87A8-4688-A69B-86EAA7D78A73@carcano.ch> <1320437339.21919.165.camel@hurina> <9F24E73A-7DC3-403C-B036-FC5CA989CD3E@iki.fi> <1AAD32DF-90EA-49C7-8403-776AB2D62E90@carcano.ch> <1324388249.6987.32.camel@innu> Message-ID: <23a86409a8afc748266069adfd1bc17b@localhost> Hello Timo of course we have entries: grep 'pop3.*mmanzoni.*del=0.*' deliver.log* |grep "Dec 12" deliver.log.2:Dec 12 13:13:19 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=23/2025701, del=0/3920, size=700800292 deliver.log.2:Dec 12 13:46:02 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=1/475746, del=0/3921, size=701276018 deliver.log.2:Dec 12 14:58:08 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=8/911587, del=0/3929, size=702187446 deliver.log.2:Dec 12 14:58:09 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3929, size=702187446 deliver.log.2:Dec 12 15:55:24 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=1/936418, del=0/3930, size=703123844 deliver.log.2:Dec 12 16:40:59 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=1/421415, del=0/3931, size=703545240 deliver.log.2:Dec 12 16:43:23 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 deliver.log.2:Dec 12 17:37:21 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 deliver.log.2:Dec 12 17:44:38 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 deliver.log.2:Dec 12 18:14:29 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 deliver.log.2:Dec 12 18:17:50 srv001 dovecot: pop3(mmanzoni): Disconnected: Logged out top=0/0, retr=0/0, del=0/3931, size=703545240 Also what kind of tools are ever accessing mails? Is it just Dovecot LDA + IMAP + POP3? No doveadm or any external tools? yes, only LDA + IMAP + POP3, no external tools I hope you have some ideas Kind regards Marco carcano From jtam.home at gmail.com Wed Dec 21 11:10:58 2011 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 21 Dec 2011 01:10:58 -0800 (PST) Subject: [Dovecot] Why imap_open doesn't work as is expected to? In-Reply-To: References: Message-ID: I M writes: > Question: Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? > Note:?imap.so is loaded!?imap.ini is parsed!? After the imap_open() invocation, you should check for error messages in your PHP logs, or dump all the errors using imap_errors(); Without more details, I would say you dropped one of those /option-flags or got the mailbox argument syntax wrong. Joseph Tam From lars at nulogic.net Wed Dec 21 16:11:36 2011 From: lars at nulogic.net (Lars Larsen) Date: Wed, 21 Dec 2011 14:11:36 +0000 (UTC) Subject: [Dovecot] Sieve filter not working Message-ID: Hi, Dovecot, the "deliver" LDA and managesieve are all working. However, the sieve rules do not seem to work: System info: CenOS 2.6.32-131.21.1.el6.x86_64 #1 SMP dovecot-pigeonhole-2.0.9-2.el6_1.1.x86_64 dovecot-2.0.9-2.el6_1.1.x86_64 /etc/dovecot/dovecot.conf: mbox_write_locks = fcntl protocols = imap pop3 sieve passdb { driver = pam } ssl_cert = I suspect, that dovecot v2.0.16 under Linux (tested on Gentoo 3.0.4 Hardened, Gentoo 3.0.6, Gentoo 3.1.4) causes 100% cpu utilization when index.cache is broken and doveadm is lanched. Dovecot uses LDAP as the userdb and provides IMAP and LDA. Because each user has a quota, the doveadm's expunge functionality is used to get rid of old trashed mail. The mail log: Dec 12 07:38:59 www dovecot: imap(user): Error: Corrupted index cache file /var/data/mail/domain.tld/user/mail/dovecot.index.cache: invalid record size Doveadm is launched as: doveadm -D expunge -A mailbox Trash savedbefore 1w Mail is stored on ext4 and flush will use all of the CPU capacity like this: load average: 4.00, 4.01, 4.05 ps: root 26401 98.2 0.0 0 0 ? R Dec20 1369:49 [flush-253:1] lsblk: vg_data-mail (dm-1) 253:1 0 500M 0 /var/data/mail dovecot -n: # 2.0.16: /etc/dovecot/dovecot.conf # OS: Linux 3.0.4-hardened-r5 x86_64 Gentoo Base System release 2.0.3 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes hostname = mail.domain.tld lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * mail_debug = yes mail_gid = vmail mail_home = /var/data/mail/domain.tld/%n mail_location = maildir:~/mail mail_plugins = " mail_log notify zlib quota" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { autocreate = Sent autocreate2 = Trash autocreate3 = Spam autosubscribe = Sent autosubscribe2 = Trash autosubscribe3 = Spam fts = squat fts_squat = partial=4 full=10 quota = maildir:User quota quota_rule = *:storage=100M quota_rule2 = Trash:ignore quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_quota_max_scripts = 5 sieve_quota_max_storage = 5M } postmaster_address = postmaster at domain.tld protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service quota-warning { executable = script /etc/dovecot/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl_cert = Hi all, Is there an option to disable (server-side) the deletion of read mails after fetching them via POP3, regardless of the MUA config? Here are the issues I'm facing: - my boss wants to force everyone into a server-side "no delete message"-policy, for archiving, auditing and backup&recovery purposes - the requisite here is pop3, so imap is out - the mailusers are virtual users (held in a mysql db) - don't have the budget to set up a separate mail-arvhing server - don't want to use shaggy ways (aka immutable flag, r/w permissions for Maildirs, etc) dovecot --version 2.0.15 Help? Thanks! From rick at havokmon.com Wed Dec 21 19:01:17 2011 From: rick at havokmon.com (Rick Romero) Date: Wed, 21 Dec 2011 11:01:17 -0600 Subject: [Dovecot] Can I block dovecot from deleting read messages, after being fetched? In-Reply-To: References: Message-ID: <20111221110117.Horde.EM4JIW2tkQ9O8hDd7J0hY5Q@beta.vfemail.net> The policy apparently doesn't cover archiving outgoing email ? Typically you set up your SMTP service to 'BCC' an archive mailbox to achieve a complete archive of both incoming and outgoing mail. Rick Quoting Vasiliu Adrian : > Hi all, > Is there an option to disable (server-side) the deletion of read mails > after fetching them via POP3, regardless of the MUA config? > > Here are the issues I'm facing: > > - my boss wants to force everyone into a server-side "no delete > message"-policy, for archiving, auditing and backup&recovery purposes > - the requisite here is pop3, so imap is out > - the mailusers are virtual users (held in a mysql db) > - don't have the budget to set up a separate mail-arvhing server > - don't want to use shaggy ways (aka immutable flag, r/w permissions for > Maildirs, etc) > > dovecot --version > 2.0.15 > > Help? > Thanks! From miquels at cistron.nl Wed Dec 21 19:10:40 2011 From: miquels at cistron.nl (Miquel van Smoorenburg) Date: Wed, 21 Dec 2011 18:10:40 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <1324264438.11142.9.camel@tardis> References: <1324256311.8138.5.camel@tardis> <1324264438.11142.9.camel@tardis> Message-ID: <4EF21310.9010302@cistron.nl> On 19-12-11 4:13 AM, Noel Butler wrote: > On Mon, 2011-12-19 at 02:32 +0100, Sven Hartge wrote: > >> Noel Butler wrote: >>> On Mon, 2011-12-19 at 00:32 +0100, Cor Bosman wrote: >> >>>> # 2.0.16: /usr/local/etc/dovecot/dovecot.conf >>>> # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 >> >>> Have you tried using a modern kernel? that one is about 2 years old. >> >> Well, this _is_ the kernel from Debian Stable and based on the >> Long-Term-Release from the kernel maintainers. > > > So what? It is not anything current, that the kernel dev team would > waste their time on. The kernel developers actually do "waste their time" on the 2.6.32.x kernel. It's a long-term stable kernel, there are frequent releases on kernel.org (I admit, .36 is a bit long in the tooth, latest is .50, released about 2 weeks ago). Mike. From tss at iki.fi Wed Dec 21 19:14:44 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 19:14:44 +0200 Subject: [Dovecot] Can I block dovecot from deleting read messages, after being fetched? In-Reply-To: References: Message-ID: <7DB25AB3-9942-4A30-9634-1C1FC6627E25@iki.fi> On 21.12.2011, at 18.51, Vasiliu Adrian wrote: > Is there an option to disable (server-side) the deletion of read mails > after fetching them via POP3, regardless of the MUA config? Global ACL for INBOX that gives owner a read-only access would do it. Or maybe http://wiki2.dovecot.org/Plugins/Lazyexpunge? That would work better if the POP3 client can't handle keeping mails on the server (but instead keeps on redownloading them). From tss at iki.fi Wed Dec 21 19:16:52 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 19:16:52 +0200 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: Message-ID: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> On 21.12.2011, at 18.38, hydra wrote: > I suspect, that dovecot v2.0.16 under Linux (tested on Gentoo 3.0.4 > Hardened, Gentoo 3.0.6, Gentoo 3.1.4) causes 100% cpu utilization when > index.cache is broken and doveadm is lanched. Dovecot uses LDAP as the > userdb and provides IMAP and LDA. Because each user has a quota, the > doveadm's expunge functionality is used to get rid of old trashed mail. > > The mail log: > Dec 12 07:38:59 www dovecot: imap(user): Error: Corrupted index cache file > /var/data/mail/domain.tld/user/mail/dovecot.index.cache: invalid record size OK.. > Mail is stored on ext4 and flush will use all of the CPU capacity like this: > load average: 4.00, 4.01, 4.05 > > ps: > root 26401 98.2 0.0 0 0 ? R Dec20 1369:49 > [flush-253:1] That's a kernel process.. > I suspect, that this is something to do with Dovecot, because after > deleting the dovecot.index.cache file, everything went back to normal. When > this happens, I cannot unmount the drive nor a system reboot works. That's a kernel bug.. I think you're thinking it the wrong way: Dovecot isn't causing your system to break. Your system is causing Dovecot to break. Faulty hardware or faulty kernel. From e-frog at gmx.de Wed Dec 21 19:35:51 2011 From: e-frog at gmx.de (e-frog) Date: Wed, 21 Dec 2011 18:35:51 +0100 Subject: [Dovecot] doveadm index In-Reply-To: <34DB33F4-27C1-41DA-91F5-46F0AA712C78@iki.fi> References: <4EE9690A.7040308@amfes.com> <1324376325.3597.39.camel@innu> <34DB33F4-27C1-41DA-91F5-46F0AA712C78@iki.fi> Message-ID: <4EF218F7.2050709@gmx.de> On 21.12.2011 07:26, wrote Timo Sirainen: > On 20.12.2011, at 22.02, Daniel L. Miller wrote: > >> On 12/20/2011 2:18 AM, Timo Sirainen wrote: >>> On Wed, 2011-12-14 at 19:27 -0800, Daniel L. Miller wrote: >>>> Does "doveadm index -A INBOX" reindex everything? What about users with >>>> multiple folders, both subbed& not subbed under INBOX? >>> It indexes INBOX (only) for all users. And it doesn't "reindex" >>> anything, it just adds any missing stuff. >>> >>> >> Ok - IS there a command that will ... fully update ... all folders for all users? Will something like "doveadm search -A text zyxabcxyz> /dev/null" work? > > For updating full text search indexes, I guess you could do a "doveadm fetch uid text asdfasf> /dev/null".. > > But some day doveadm index (and several other commands) should allow wildcards in mailbox names, so you could just do doveadm index -A '*' Actually I'm using doveadm index -A '*' in a daily cron job and it seems to work for me. At least the timestamps of the dovecot.index.search and dovecot.index.search.uids files equal or close to the cron job start time in every folder. Is there a way to examine the search index? Doveadm dump doesn't seem to like it. $: doveadm dump dovecot.index.search $: doveadm(vmail): Fatal: Can't autodetect file type: dovecot.index.search Thanks, e-frog From newsl at aradriel.de Wed Dec 21 21:23:22 2011 From: newsl at aradriel.de (Julien Lacroix) Date: Wed, 21 Dec 2011 20:23:22 +0100 Subject: [Dovecot] compile dovecot-sieve for dovecot 1.2.9 (ubuntu pkg) Message-ID: <4EF2322A.6040806@aradriel.de> Cheers, I've a running Dovecot 1.2.9, installed from the ubuntu 10.04 Lucid LTS repository and trying to get the dovecot-sieve plugin (which seems to be not included in the lucid repo) compiled. Method 1 listed in http://wiki.dovecot.org/LDA/Sieve/Dovecot wont work, seems the rpm was build without --enable-header-install Is it sufficient to download the sources from http://archive.ubuntu.com/ubuntu/pool/main/d/dovecot/dovecot_1.2.9.orig.tar.gz and use them for ./configure --with-dovecot=$path ? thanks and happy holidays julien From p at state-of-mind.de Wed Dec 21 21:42:48 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 21 Dec 2011 20:42:48 +0100 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> Message-ID: <20111221194248.GB2293@state-of-mind.de> * Michael M Slusarz : > Quoting Patrick Ben Koetter

: > >we want to implement SPECIAL-USE in Thunderbird (TB), but we've run into > >problems. I believe you could help change that. > > > >Here's the problem: > > > >By default TB only lists subscribed (LSUB) folders when it accesses an IMAP > >server. However when I do a LSUB on recent Dovecot 2.1 code from mercurial I > >don't get to see the SPECIAL-USE flags. Therefore TB fails to identify which > >folders it should use and map to until someone tells it to list all folders > >(LIST) manually. > > > >Central part of the SPECIAL-USE idea was/is to require as little user > >interaction as possible to automatically setup a MUA to do the right thing. > > > >Speculating that probably most MUAs will do a LSUB by default and never will > >get to see SPECIAL-USE flags I think it is easier to have the server-side > >promote the flags. > > Except you never, never, never, never, never can rely on LSUB for > mailbox attributes. It says so right in RFC 3501 [6.3.9]: > > The returned untagged LSUB response MAY contain different mailbox > flags from a LIST untagged response. If this should happen, the > flags in the untagged LIST are considered more authoritative. > > See also RFC 5258 [3.1], which discusses the difference between the > base RFC 3501 LSUB command and the LIST-EXTENDED SUBSCRIBED option: > > This option is > intended to supplement the LSUB command. Of particular note are > the mailbox attributes as returned by this option, compared with > what is returned by LSUB. With the latter, the attributes > returned may not reflect the actual attribute status on the > mailbox name, and the \NoSelect attribute has a second special > meaning (it indicates that this mailbox is not, itself, > subscribed, but that it has descendant mailboxes that are). With > the SUBSCRIBED selection option described here, the attributes are > accurate and complete, and have no special meanings. "LSUB" and > "LIST (SUBSCRIBED)" are, thus, not the same thing, and some > servers must do significant extra work to respond to "LIST > (SUBSCRIBED)". Because of this, clients SHOULD continue to use > "LSUB" unless they specifically want the additional information > offered by "LIST (SUBSCRIBED)". Thanks for the clarification. I did some reading to get a better understanding. We'll probably stick with this and may go for LIST if the server does not announce LIST-EXTENTED: t2 LIST "" "%" RETURN (SPECIAL-USE) * LIST (\Sent) "." "AltSent" * LIST () "." "Archives" * LIST (\Archive) "." "AltArchive" * LIST (\Junk) "." "AltJunk" * LIST () "." "Junk" * LIST (\Trash) "." "AltTrash" * LIST (\Drafts) "." "AltDrafts" * LIST () "." "Trash" * LIST () "." "INBOX" t2 OK List completed. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From CMarcus at Media-Brokers.com Wed Dec 21 21:45:19 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 21 Dec 2011 14:45:19 -0500 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111221194248.GB2293@state-of-mind.de> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> <20111221194248.GB2293@state-of-mind.de> Message-ID: <4EF2374F.7010300@Media-Brokers.com> On 2011-12-21 2:42 PM, Patrick Ben Koetter

wrote: > Thanks for the clarification. I did some reading to get a better > understanding. We'll probably stick with this and may go for LIST if the > server does not announce LIST-EXTENTED So... out of curoisity, does dovecot support LIST-EXTENDED? -- Best regards, Charles From p at state-of-mind.de Wed Dec 21 21:50:55 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 21 Dec 2011 20:50:55 +0100 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <4EF2374F.7010300@Media-Brokers.com> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> <20111221194248.GB2293@state-of-mind.de> <4EF2374F.7010300@Media-Brokers.com> Message-ID: <20111221195055.GC2293@state-of-mind.de> * Charles Marcus : > On 2011-12-21 2:42 PM, Patrick Ben Koetter

wrote: > >Thanks for the clarification. I did some reading to get a better > >understanding. We'll probably stick with this and may go for LIST if the > >server does not announce LIST-EXTENTED > > So... out of curoisity, does dovecot support LIST-EXTENDED? Yes, it does. See the full session below: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5] Dovecot 2.1 ready. 1 login alice at example.com secret 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS FUZZY SPECIAL-USE] Logged in t2 LIST "" "%" RETURN (SPECIAL-USE) * LIST (\Sent) "." "AltSent" * LIST () "." "Archives" * LIST (\Archive) "." "AltArchive" * LIST (\Junk) "." "AltJunk" * LIST () "." "Junk" * LIST (\Trash) "." "AltTrash" * LIST (\Drafts) "." "AltDrafts" * LIST () "." "Trash" * LIST () "." "INBOX" t2 OK List completed. t3 logout * BYE Logging out t3 OK Logout completed. -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From p at state-of-mind.de Wed Dec 21 21:56:05 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Wed, 21 Dec 2011 20:56:05 +0100 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111221195055.GC2293@state-of-mind.de> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> <20111221194248.GB2293@state-of-mind.de> <4EF2374F.7010300@Media-Brokers.com> <20111221195055.GC2293@state-of-mind.de> Message-ID: <20111221195605.GE2293@state-of-mind.de> Timo, if I read the specs correctly http://tools.ietf.org/html/rfc6154#section-5.2 says the following command should work too: C: t3 LIST (SPECIAL-USE) "" "*" S: * LIST (\Sent) "/" SentMail S: * LIST (\Marked \Drafts) "/" MyDrafts S: * LIST (\Trash) "/" Trash S: t3 OK done However if I send that command it fails: t2 LIST (SPECIAL-USE) "" "*" t2 BAD Error in IMAP command LIST: Unknown select options Is that a bug or was a decision on purpose? p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From tss at iki.fi Wed Dec 21 21:59:53 2011 From: tss at iki.fi (Timo Sirainen) Date: Wed, 21 Dec 2011 21:59:53 +0200 Subject: [Dovecot] Problem listing SPECIAL-USE flags In-Reply-To: <20111221195605.GE2293@state-of-mind.de> References: <20111221051802.GB2286@state-of-mind.de> <20111220232444.Horde.uC3efoF5lbhO8Xus7BdEKhA@bigworm.curecanti.org> <20111221194248.GB2293@state-of-mind.de> <4EF2374F.7010300@Media-Brokers.com> <20111221195055.GC2293@state-of-mind.de> <20111221195605.GE2293@state-of-mind.de> Message-ID: On 21.12.2011, at 21.56, Patrick Ben Koetter wrote: > if I read the specs correctly http://tools.ietf.org/html/rfc6154#section-5.2 > says the following command should work too: > > C: t3 LIST (SPECIAL-USE) "" "*" Yes. > However if I send that command it fails: > > t2 LIST (SPECIAL-USE) "" "*" > t2 BAD Error in IMAP command LIST: Unknown select options > > Is that a bug or was a decision on purpose? I forgot that existed. I'll add it. From xchris89x at googlemail.com Thu Dec 22 01:15:09 2011 From: xchris89x at googlemail.com (Christopher Stolzenberg) Date: Thu, 22 Dec 2011 00:15:09 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <4EF05A12.7010502@tesco.net> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> Message-ID: 2011/12/20 Ron Leach : > On 20/12/2011 09:11, Cor Bosman wrote: >> >> I installed a newer kernel on these boxes, and it's fixed. Seems to be >> a problem with the stock debian squeeze kernel. Not a dovecot issue, but >> others with a stable squeeze box might see similar problems so good >> to have it in the archive :) > > > Indeed; very many of us use Debian stable. ?Which kernel did you install > that is 2.0.16-friendly, and was this from Debian stable's updates system? > > regards, Ron Debian for production servers??? That sounds dangerous. -- Chris From jk at jkart.de Thu Dec 22 01:26:35 2011 From: jk at jkart.de (Jim Knuth) Date: Thu, 22 Dec 2011 00:26:35 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> Message-ID: <4EF26B2B.1090507@jkart.de> am 22.12.11 00:15 schrieb Christopher Stolzenberg : >> Indeed; very many of us use Debian stable. Which kernel did you install >> that is 2.0.16-friendly, and was this from Debian stable's updates system? >> >> regards, Ron > > Debian for production servers??? That sounds dangerous. sorry, but that`s absolutely bulls*it. *lol* Where have you read then THIS? > > -- > Chris -- Mit freundlichen Gr??en, with kind regards, Jim Knuth From xchris89x at googlemail.com Thu Dec 22 01:49:52 2011 From: xchris89x at googlemail.com (Christopher Stolzenberg) Date: Thu, 22 Dec 2011 00:49:52 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <4EF26B2B.1090507@jkart.de> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> Message-ID: 2011/12/22 Jim Knuth : > am 22.12.11 00:15 schrieb Christopher Stolzenberg > > : > > >>> Indeed; very many of us use Debian stable. ?Which kernel did you install >>> that is 2.0.16-friendly, and was this from Debian stable's updates >>> system? >>> >>> regards, Ron >> >> >> Debian for production servers??? That sounds dangerous. > > > sorry, but that`s absolutely bulls*it. *lol* > Where have you read then THIS? My own experience! Reasons against Debian: - No LSB certification (Linux Standard Base) - No hardware certification (IBM, Dell, HP ...) - Incompatible with some Broadcom NICs - Full of bugs - Free Kernel (non-free firmware removed... lol) - Obsolete kernel (incompatible with new hardware) - Obsolete packages - Only one year support for oldstable *lol* - Long delay for security updates -- Chris From mcbdovecot at robuust.nl Thu Dec 22 01:54:50 2011 From: mcbdovecot at robuust.nl (Maarten Bezemer) Date: Thu, 22 Dec 2011 00:54:50 +0100 (CET) Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: Message-ID: On Mon, 19 Dec 2011, Cor Bosman wrote: > # OS: Linux 2.6.32.36-xsserver x86_64 Debian 6.0.3 Are you sure you didn't roll your own kernel? Debian kernels I know don't use the ".36" suffix, but ship as 2.6.32-something and use their own internal version numbering. For example, I found this on packages.debian.org: linux-image-2.6.32-5-amd64 (2.6.32-38) According to changelog, this actually carries patches from 2.6.32.46, yet only shows in uname as 2.6.32-5-amd64. Also a friendly reminder for the question asked by Ron Leach: which kernel version did you install that appears to be Dovecot-friendlier? Would be very useful to have that in the archives as well. By the way, happy holidays to everyone ;-) -- Maarten From djonas at vitalwerks.com Thu Dec 22 03:52:59 2011 From: djonas at vitalwerks.com (David Jonas) Date: Wed, 21 Dec 2011 17:52:59 -0800 Subject: [Dovecot] Maildir migration and uids Message-ID: <4EF28D7B.8050601@vitalwerks.com> I'm in the process of migrating a large number of maildirs to a 3rd party dovecot server (from a dovecot server). Tests have shown that using imap to sync the accounts doesn't preserve the uidl for pop3 access. My current attempt is to convert the maildir to mbox and add an X-UIDL header in the process. Run a second dovecot that serves the converted mbox. But dovecot's docs say, "None of these headers are sent to IMAP/POP3 clients when they read the mail". Is there any way to sync these maildirs to the new server and maintain the uids? The real goal is keep customers email clients happy when they are pointed at the new server. Am I just wishing? From noel.butler at ausics.net Thu Dec 22 04:13:22 2011 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 22 Dec 2011 12:13:22 +1000 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> Message-ID: <1324520002.7098.14.camel@tardis> On Thu, 2011-12-22 at 00:49 +0100, Christopher Stolzenberg wrote: > 2011/12/22 Jim Knuth : > > am 22.12.11 00:15 schrieb Christopher Stolzenberg > > > > : > > > > > >>> Indeed; very many of us use Debian stable. Which kernel did you install > >>> that is 2.0.16-friendly, and was this from Debian stable's updates > >>> system? > >>> > >>> regards, Ron > >> > >> > >> Debian for production servers??? That sounds dangerous. > > > > > > sorry, but that`s absolutely bulls*it. *lol* > > Where have you read then THIS? > > My own experience! > > Reasons against Debian: > > - No LSB certification (Linux Standard Base) > - No hardware certification (IBM, Dell, HP ...) > - Incompatible with some Broadcom NICs > - Full of bugs > - Free Kernel (non-free firmware removed... lol) > - Obsolete kernel (incompatible with new hardware) > - Obsolete packages > - Only one year support for oldstable *lol* > - Long delay for security updates > > -- > Chris Reasons for debian: They have largest number of packages! ... oh Wait! thats because they break up simple packages into 8-10 sub packages where as other distros use single or split in two .. yeah, scratch that... you're right, no pro's that I can think of ;) Ahhh just before I hit send I remember one, debian, like windows, is an ideal distro on a server in a Colo that charges for remote hands (incl reboots), cause they have the highest fail rate. Most stable OS's from colo are freebsd, slackware, RHEL, CentOS (ok same thing) and SuSE, and surprisingly, we once had a customer with an old win2K box back in mid 00's, that was very well behaved, and it was busy, they ran a concert/band/event ticketing site on it, truly amazed me that box. Worse OS's would be netbsd, fedora, debian, ubuntu, mint, windows* .. but very very nice money earners for remote hands :P -------------- next part -------------- A non-text attachment was scrubbed... Name: face-raspberry.png Type: image/png Size: 865 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: face-wink.png Type: image/png Size: 876 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From gchodos at gmail.com Thu Dec 22 05:12:40 2011 From: gchodos at gmail.com (Gary Chodos) Date: Wed, 21 Dec 2011 22:12:40 -0500 Subject: [Dovecot] lmtp logging incomplete (does not tell what mailbox mail is actually being saved to!) In-Reply-To: References: Message-ID: On Wed, Dec 21, 2011 at 1:29 AM, Timo Sirainen wrote: > On 21.12.2011, at 6.09, Gary Chodos wrote: > >> We created a new virtual domain and created a user in that domain in >> our pgsql database. ?Instead of creating any directory structure in >> /home/virtual/mail//, I just sent a test email to see if >> dovecot's lmtp would autocreate. ?And it did! ?And mail appears to be >> delivered to an inbox.. but, logging is weird and I'm not sure >> everything is working as it should because: >> >> Dec 20 23:01:28 mx dovecot: lmtp(21458, user at example.com): >> lUDFG8tZ8U7SUwAAO3tENA: >> msgid=<20111221040122.GP13367 at hostname.example.org>: saved mail to >> >> . so why doesn't dovecot log where mail is stored/saved? > > That's a bug. Fixed by http://hg.dovecot.org/dovecot-2.0/rev/6d188f4e8e6a > > The empty string anyway means INBOX. ahhhh, thanks Timo! From simon.brereton at buongiorno.com Thu Dec 22 06:18:54 2011 From: simon.brereton at buongiorno.com (Simon Brereton) Date: Wed, 21 Dec 2011 23:18:54 -0500 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <1324520002.7098.14.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> Message-ID: On Dec 21, 2011 9:13 PM, "Noel Butler" wrote: > > On Thu, 2011-12-22 at 00:49 +0100, Christopher Stolzenberg wrote: > > > 2011/12/22 Jim Knuth : > > > am 22.12.11 00:15 schrieb Christopher Stolzenberg > > > > > > : > > > > > > > > >>> Indeed; very many of us use Debian stable. Which kernel did you install > > >>> that is 2.0.16-friendly, and was this from Debian stable's updates > > >>> system? > > >>> > > >>> regards, Ron > > >> > > >> > > >> Debian for production servers??? That sounds dangerous. > > > > > > > > > sorry, but that`s absolutely bulls*it. *lol* > > > Where have you read then THIS? > > > > My own experience! > > > > Reasons against Debian: > > > > - No LSB certification (Linux Standard Base) > > - No hardware certification (IBM, Dell, HP ...) > > - Incompatible with some Broadcom NICs > > - Full of bugs > > - Free Kernel (non-free firmware removed... lol) > > - Obsolete kernel (incompatible with new hardware) > > - Obsolete packages > > - Only one year support for oldstable *lol* > > - Long delay for security updates I'm with Jim. Debian has served me well for years. This is just distro-bias. Sure, you need modicum more sense and hands on experience, but that's not bad thing in a production environment.. It would be interesting to chart the number of threads caused by each distro. I don't know who would have the least, but I suspect gentoo and centos would be out in front, with Ubuntu panting along behind.. Simon > > Reasons for debian: > They have largest number of packages! ... oh Wait! thats because they > break up simple packages into 8-10 sub packages where as other distros > use single or split in two .. yeah, scratch that... you're right, no > pro's that I can think of ;) > > Ahhh just before I hit send I remember one, debian, like windows, is an > ideal distro on a server in a Colo that charges for remote hands (incl > reboots), cause they have the highest fail rate. > > Most stable OS's from colo are freebsd, slackware, RHEL, CentOS (ok same > thing) and SuSE, and surprisingly, we once had a customer with an old > win2K box back in mid 00's, that was very well behaved, and it was busy, > they ran a concert/band/event ticketing site on it, truly amazed me that > box. > > Worse OS's would be netbsd, fedora, debian, ubuntu, mint, windows* .. > but very very nice money earners for remote hands :P > From robert at schetterer.org Thu Dec 22 09:06:36 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 08:06:36 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> Message-ID: <4EF2D6FC.9070207@schetterer.org> Am 22.12.2011 00:15, schrieb Christopher Stolzenberg: > 2011/12/20 Ron Leach : >> On 20/12/2011 09:11, Cor Bosman wrote: >>> >>> I installed a newer kernel on these boxes, and it's fixed. Seems to be >>> a problem with the stock debian squeeze kernel. Not a dovecot issue, but >>> others with a stable squeeze box might see similar problems so good >>> to have it in the archive :) >> >> >> Indeed; very many of us use Debian stable. Which kernel did you install >> that is 2.0.16-friendly, and was this from Debian stable's updates system? >> >> regards, Ron > > Debian for production servers??? That sounds dangerous. nonsense, Debian and clones are widly used for massive big server Farms > > -- > Chris -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From robert at schetterer.org Thu Dec 22 09:08:06 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 08:08:06 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> Message-ID: <4EF2D756.6000107@schetterer.org> Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: > 2011/12/22 Jim Knuth : >> am 22.12.11 00:15 schrieb Christopher Stolzenberg >> >> : >> >> >>>> Indeed; very many of us use Debian stable. Which kernel did you install >>>> that is 2.0.16-friendly, and was this from Debian stable's updates >>>> system? >>>> >>>> regards, Ron >>> >>> >>> Debian for production servers??? That sounds dangerous. >> >> >> sorry, but that`s absolutely bulls*it. *lol* >> Where have you read then THIS? > > My own experience! > > Reasons against Debian: > > - No LSB certification (Linux Standard Base) > - No hardware certification (IBM, Dell, HP ...) > - Incompatible with some Broadcom NICs > - Full of bugs > - Free Kernel (non-free firmware removed... lol) > - Obsolete kernel (incompatible with new hardware) > - Obsolete packages > - Only one year support for oldstable *lol* > - Long delay for security updates > > -- > Chris dont feed trolls -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From noel.butler at ausics.net Thu Dec 22 09:23:36 2011 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 22 Dec 2011 17:23:36 +1000 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> Message-ID: <1324538616.14607.12.camel@tardis> On Wed, 2011-12-21 at 23:18 -0500, Simon Brereton wrote: > > I'm with Jim. Debian has served me well for years. This is just > distro-bias. Sure, you need modicum more sense and hands on experience, distro holy ways will outlast the real world holy wars, we each have a distro we all stand by, else there would only be one distro. > but that's not bad thing in a production environment.. > > It would be interesting to chart the number of threads caused by each > distro. I don't know who would have the least, but I suspect gentoo and > centos would be out in front, with Ubuntu panting along behind.. > > Simon I'm yet to meet a debian based admin who uses source, they only seem to think that apt is only way of installing stuff. They are scared of conflicts, who knows. Most the servers in the DC's I've run or worked in are all either freebsd, RHEL, slackware or gentoo, the later two being my personal favourites, that said, I do use ubuntu LTS on pc's/laptop, if there was no LTS however, I'd likely go back to fedora. > > Ahhh just before I hit send I remember one, debian, like windows, is an > > ideal distro on a server in a Colo that charges for remote hands (incl > > reboots), cause they have the highest fail rate. > > > > Most stable OS's from colo are freebsd, slackware, RHEL, CentOS (ok same > > thing) and SuSE, and surprisingly, we once had a customer with an old > > win2K box back in mid 00's, that was very well behaved, and it was busy, > > they ran a concert/band/event ticketing site on it, truly amazed me that > > box. > > > > Worse OS's would be netbsd, fedora, debian, ubuntu, mint, windows* .. > > but very very nice money earners for remote hands :P > > -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From noel.butler at ausics.net Thu Dec 22 09:27:04 2011 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 22 Dec 2011 17:27:04 +1000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <4EF2D756.6000107@schetterer.org> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> Message-ID: <1324538824.14607.16.camel@tardis> On Thu, 2011-12-22 at 08:08 +0100, Robert Schetterer wrote: > Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: > > 2011/12/22 Jim Knuth : > >> am 22.12.11 00:15 schrieb Christopher Stolzenberg > >> > >> : > >> > >> > >>>> Indeed; very many of us use Debian stable. Which kernel did you install > >>>> that is 2.0.16-friendly, and was this from Debian stable's updates > >>>> system? > >>>> > >>>> regards, Ron > >>> > >>> > >>> Debian for production servers??? That sounds dangerous. > >> > >> > >> sorry, but that`s absolutely bulls*it. *lol* > >> Where have you read then THIS? > > > > My own experience! > > > > Reasons against Debian: > > > > - No LSB certification (Linux Standard Base) > > - No hardware certification (IBM, Dell, HP ...) > > - Incompatible with some Broadcom NICs > > - Full of bugs > > - Free Kernel (non-free firmware removed... lol) > > - Obsolete kernel (incompatible with new hardware) > > - Obsolete packages > > - Only one year support for oldstable *lol* > > - Long delay for security updates > > > > -- > > Chris > > dont feed trolls > Why is it when someone disagrees with someone's opinion they are labelled a troll, maybe because it hits a raw nerve huh? I dunno, and frankly don't care, but you have no right to do so just because you don't agree with Christophers statements. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From robert at schetterer.org Thu Dec 22 09:34:30 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 08:34:30 +0100 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <1324538616.14607.12.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <1324538616.14607.12.camel@tardis> Message-ID: <4EF2DD86.8070609@schetterer.org> Am 22.12.2011 08:23, schrieb Noel Butler: > On Wed, 2011-12-21 at 23:18 -0500, Simon Brereton wrote: > >> >> I'm with Jim. Debian has served me well for years. This is just >> distro-bias. Sure, you need modicum more sense and hands on experience, > > > distro holy ways will outlast the real world holy wars, we each have a > distro we all stand by, else there would only be one distro. > > >> but that's not bad thing in a production environment.. >> >> It would be interesting to chart the number of threads caused by each >> distro. I don't know who would have the least, but I suspect gentoo and >> centos would be out in front, with Ubuntu panting along behind.. >> >> Simon > > > I'm yet to meet a debian based admin who uses source, they only seem to > think that apt is only way of installing stuff. > They are scared of conflicts, who knows. Most the servers in the DC's > I've run or worked in are all either freebsd, RHEL, slackware or gentoo, > the later two being my personal favourites, that said, I do use ubuntu > LTS on pc's/laptop, if there was no LTS however, I'd likely go back to > fedora. > X-mas is comming, we are waiting to get the perfect OS presented, so lets pray *g by the way ,where is the match to the dovecot list topic anyone identified the kernel bug? > > >>> Ahhh just before I hit send I remember one, debian, like windows, is an >>> ideal distro on a server in a Colo that charges for remote hands (incl >>> reboots), cause they have the highest fail rate. >>> >>> Most stable OS's from colo are freebsd, slackware, RHEL, CentOS (ok same >>> thing) and SuSE, and surprisingly, we once had a customer with an old >>> win2K box back in mid 00's, that was very well behaved, and it was busy, >>> they ran a concert/band/event ticketing site on it, truly amazed me that >>> box. >>> >>> Worse OS's would be netbsd, fedora, debian, ubuntu, mint, windows* .. >>> but very very nice money earners for remote hands :P >>> > > > -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From robert at schetterer.org Thu Dec 22 09:42:30 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 08:42:30 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <1324538824.14607.16.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> Message-ID: <4EF2DF66.4060408@schetterer.org> Am 22.12.2011 08:27, schrieb Noel Butler: > On Thu, 2011-12-22 at 08:08 +0100, Robert Schetterer wrote: > >> Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: >>> 2011/12/22 Jim Knuth : >>>> am 22.12.11 00:15 schrieb Christopher Stolzenberg >>>> >>>> : >>>> >>>> >>>>>> Indeed; very many of us use Debian stable. Which kernel did you install >>>>>> that is 2.0.16-friendly, and was this from Debian stable's updates >>>>>> system? >>>>>> >>>>>> regards, Ron >>>>> >>>>> >>>>> Debian for production servers??? That sounds dangerous. >>>> >>>> >>>> sorry, but that`s absolutely bulls*it. *lol* >>>> Where have you read then THIS? >>> >>> My own experience! >>> >>> Reasons against Debian: >>> >>> - No LSB certification (Linux Standard Base) >>> - No hardware certification (IBM, Dell, HP ...) >>> - Incompatible with some Broadcom NICs >>> - Full of bugs >>> - Free Kernel (non-free firmware removed... lol) >>> - Obsolete kernel (incompatible with new hardware) >>> - Obsolete packages >>> - Only one year support for oldstable *lol* >>> - Long delay for security updates >>> >>> -- >>> Chris >> >> dont feed trolls >> > > > Why is it when someone disagrees with someone's opinion they are > labelled a troll, maybe because it hits a raw nerve huh? > I dunno, and frankly don't care, but you have no right to do so just > because you don't agree with Christophers statements. > > > Hi Noel. this has left the topic of the dovecot list, after all , everyone is free to use what he likes and what fits best to solute the tec problem/task he/she likes to solve these everlasting os discussions are leading to nirvana are heavy boring, doesnt help on fixing the asked tec problem -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From noel.butler at ausics.net Thu Dec 22 09:52:28 2011 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 22 Dec 2011 17:52:28 +1000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <4EF2DF66.4060408@schetterer.org> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> Message-ID: <1324540348.16562.11.camel@tardis> On Thu, 2011-12-22 at 08:42 +0100, Robert Schetterer wrote: > Am 22.12.2011 08:27, schrieb Noel Butler: > > On Thu, 2011-12-22 at 08:08 +0100, Robert Schetterer wrote: > > > >> Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: > >>> 2011/12/22 Jim Knuth : > >>>> am 22.12.11 00:15 schrieb Christopher Stolzenberg > >>>> > >>>> : > >>>> > >>>> > >>>>>> Indeed; very many of us use Debian stable. Which kernel did you install > >>>>>> that is 2.0.16-friendly, and was this from Debian stable's updates > >>>>>> system? > >>>>>> > >>>>>> regards, Ron > >>>>> > >>>>> > >>>>> Debian for production servers??? That sounds dangerous. > >>>> > >>>> > >>>> sorry, but that`s absolutely bulls*it. *lol* > >>>> Where have you read then THIS? > >>> > >>> My own experience! > >>> > >>> Reasons against Debian: > >>> > >>> - No LSB certification (Linux Standard Base) > >>> - No hardware certification (IBM, Dell, HP ...) > >>> - Incompatible with some Broadcom NICs > >>> - Full of bugs > >>> - Free Kernel (non-free firmware removed... lol) > >>> - Obsolete kernel (incompatible with new hardware) > >>> - Obsolete packages > >>> - Only one year support for oldstable *lol* > >>> - Long delay for security updates > >>> > >>> -- > >>> Chris > >> > >> dont feed trolls > >> > > > > > > Why is it when someone disagrees with someone's opinion they are > > labelled a troll, maybe because it hits a raw nerve huh? > > I dunno, and frankly don't care, but you have no right to do so just > > because you don't agree with Christophers statements. > > > > > > > > Hi Noel. this has left the topic of the dovecot list, > after all , everyone is free to use what he likes and what fits best to > solute the tec problem/task he/she likes to solve > these everlasting os discussions are leading to nirvana > are heavy boring, doesnt help on fixing the asked tec problem > > Still, everyone is entitled to their opinion, including Christopher, perhaps it was not the right place for his comment, but none the less he made it, so he must feel that way, we should respect that without placing labels on him. This also is not the kernel list, since updating to a kernel released in the 21st century Cor's issue has gone away, so this thread is now rather entirely pointless on the Dovecot list. So I'll my participation in this thread, since its nearly 6pm, and tonight we have lots of prawns and lots and lots of beer and bourbon ;) Merry Christmas to those who celebrate it. -------------- next part -------------- A non-text attachment was scrubbed... Name: face-wink.png Type: image/png Size: 876 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From robert at schetterer.org Thu Dec 22 10:03:24 2011 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 22 Dec 2011 09:03:24 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <1324540348.16562.11.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> <1324540348.16562.11.camel@tardis> Message-ID: <4EF2E44C.60307@schetterer.org> On 22.12.2011 08:52, Noel Butler wrote: > On Thu, 2011-12-22 at 08:42 +0100, Robert Schetterer wrote: > >> Am 22.12.2011 08:27, schrieb Noel Butler: >>> On Thu, 2011-12-22 at 08:08 +0100, Robert Schetterer wrote: >>> >>>> Am 22.12.2011 00:49, schrieb Christopher Stolzenberg: >>>>> 2011/12/22 Jim Knuth : >>>>>> am 22.12.11 00:15 schrieb Christopher Stolzenberg >>>>>> >>>>>> : >>>>>> >>>>>> >>>>>>>> Indeed; very many of us use Debian stable. Which kernel did you install >>>>>>>> that is 2.0.16-friendly, and was this from Debian stable's updates >>>>>>>> system? >>>>>>>> >>>>>>>> regards, Ron >>>>>>> >>>>>>> >>>>>>> Debian for production servers??? That sounds dangerous. >>>>>> >>>>>> >>>>>> sorry, but that`s absolutely bulls*it. *lol* >>>>>> Where have you read then THIS? >>>>> >>>>> My own experience! >>>>> >>>>> Reasons against Debian: >>>>> >>>>> - No LSB certification (Linux Standard Base) >>>>> - No hardware certification (IBM, Dell, HP ...) >>>>> - Incompatible with some Broadcom NICs >>>>> - Full of bugs >>>>> - Free Kernel (non-free firmware removed... lol) >>>>> - Obsolete kernel (incompatible with new hardware) >>>>> - Obsolete packages >>>>> - Only one year support for oldstable *lol* >>>>> - Long delay for security updates >>>>> >>>>> -- >>>>> Chris >>>> >>>> dont feed trolls >>>> >>> >>> >>> Why is it when someone disagrees with someone's opinion they are >>> labelled a troll, maybe because it hits a raw nerve huh? >>> I dunno, and frankly don't care, but you have no right to do so just >>> because you don't agree with Christophers statements. >>> >>> >>> >> >> Hi Noel. this has left the topic of the dovecot list, >> after all , everyone is free to use what he likes and what fits best to >> solute the tec problem/task he/she likes to solve >> these everlasting os discussions are leading to nirvana >> are heavy boring, doesnt help on fixing the asked tec problem >> >> > > > > Still, everyone is entitled to their opinion, including Christopher, > perhaps it was not the right place for his comment, but none the less he > made it, so he must feel that way, we should respect that without > placing labels on him. > This also is not the kernel list, since updating to a kernel released in > the 21st century Cor's issue has gone away, so this thread is now rather > entirely pointless on the Dovecot list. So I'll my participation in > this thread, since its nearly 6pm, and tonight we have lots of prawns > and lots and lots of beer and bourbon ;) jeppa no need to flame ever cheers ! > > Merry Christmas to those who celebrate it. celebrate ,is a good idea, anytime > > > > -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From cor at xs4all.nl Thu Dec 22 10:22:07 2011 From: cor at xs4all.nl (Cor Bosman) Date: Thu, 22 Dec 2011 09:22:07 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <1324540348.16562.11.camel@tardis> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> <1324540348.16562.11.camel@tardis> Message-ID: <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> > This also is not the kernel list, since updating to a kernel released in > the 21st century Cor's issue has gone away, so this thread is now rather > entirely pointless on the Dovecot list. So I'll my participation in Actually, it hasn't. For the last few days we've been trying to pinpoint the problem by running half a dozen servers with different kernels and options. This 'kernel released in the 20th century' we have this problem with is the current stable kernel for debian. So instead of starting a distro war (and I thought canon/nikon, mac/pc were bad), lets be a bit more constructive. Plenty of people use the stable debian release. It's happening on about half of our imap servers (20 or so), but on none of our other debian servers (hundreds). So it's not so weird to suspect a dovecot link. But it looks like it may be a driver issue on a specific range of hardware we use. Once we find the issue, i'll report back. Until then, this doesn't look like a dovecot problem. Cor From wgillespie+dovecot at es2eng.com Thu Dec 22 10:30:38 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Thu, 22 Dec 2011 01:30:38 -0700 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EE7DDE5.3070605@globalchangemusic.org> References: <4EE7DDE5.3070605@globalchangemusic.org> Message-ID: <4EF2EAAE.9090705@es2eng.com> On 12/13/2011 04:21 PM, Asai wrote: > Greetings, > > Working with dsync and setting up backups to a Windows file server. > Problem seems to be that Windows is renaming the dovecot mail files > (maildir) to Windows friendly filenames, and losing the Dovecot name. > For example, > 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S > becomes 1AETPH~X. > > Does anyone have any ideas about how to tell Windows to not do this? Or > is it not possible? Don't have any answers for you, but I know that : is an invalid character in Windows filenames, so that could have something to do with it. From wgillespie+dovecot at es2eng.com Thu Dec 22 10:32:24 2011 From: wgillespie+dovecot at es2eng.com (Willie Gillespie) Date: Thu, 22 Dec 2011 01:32:24 -0700 Subject: [Dovecot] Backing Up To Windows File Server In-Reply-To: <4EF2EAAE.9090705@es2eng.com> References: <4EE7DDE5.3070605@globalchangemusic.org> <4EF2EAAE.9090705@es2eng.com> Message-ID: <4EF2EB18.1090102@es2eng.com> On 12/22/2011 01:30 AM, Willie Gillespie wrote: > On 12/13/2011 04:21 PM, Asai wrote: >> Greetings, >> >> Working with dsync and setting up backups to a Windows file server. >> Problem seems to be that Windows is renaming the dovecot mail files >> (maildir) to Windows friendly filenames, and losing the Dovecot name. >> For example, >> 1323817925.M36368P32049.triata.globalchangemultimedia.net,S=2255,W=2318:2,S >> >> becomes 1AETPH~X. >> >> Does anyone have any ideas about how to tell Windows to not do this? Or >> is it not possible? > > Don't have any answers for you, but I know that : is an invalid > character in Windows filenames, so that could have something to do with it. Whoops, should have finished going through the old thread. Seems like MyBSD already answered. From dg at dguhl.org Thu Dec 22 11:27:33 2011 From: dg at dguhl.org (Dennis Guhl) Date: Thu, 22 Dec 2011 10:27:33 +0100 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> <1324540348.16562.11.camel@tardis> <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> Message-ID: <20111222092732.GA6678@PC211.ikt.de> On Thu, Dec 22, 2011 at 09:22:07AM +0100, Cor Bosman wrote: [..] > Actually, it hasn't. For the last few days we've been trying to > pinpoint the problem by running half a dozen servers with different In your initial posting you mentioned this happens on a machine wich was updated from Lenny to Squeeze. Did you try a fresh install? Sometimes I had some kernel related troubles in case of updateting releases. [..] > Once we find the issue, i'll report back. Until then, this doesn't > look like a dovecot problem. Most likely it will be best to ask on a debian list. Dennis From arnaud.lenorcy at univ-orleans.fr Thu Dec 22 12:31:40 2011 From: arnaud.lenorcy at univ-orleans.fr (LE NORCY Arnaud) Date: Thu, 22 Dec 2011 11:31:40 +0100 Subject: [Dovecot] file_dotlock_create(~/.dovecot.lda-dupes) failed: No such file or directory ... Message-ID: <4EF3070C.1040704@univ-orleans.fr> Hello, i get this message every time that a user has enabled the vacation script (into Horde webmail) in my mail.err log file: Dec 22 10:18:16 mailserver dovecot: deliver(user324): file_dotlock_create(~/.dovecot.lda-dupes) failed: No such file or directory normally the reply is sent only once in the number of configured days.. but for all users the reply is sent every time... the day variable is "ignored.." because the file "dovecot.lda-dupes" is not wrotten i think.. ~# dpkg -l | grep dovecot ii dovecot-common 1:1.2.15-4 secure mail server that supports mbox and maildir mailboxes ii dovecot-imapd 1:1.2.15-4 secure IMAP server that supports mbox and maildir mailboxes ii dovecot-pop3d 1:1.2.15-4 secure POP3 server that supports mbox and maildir mailboxes dovecot.conf : protocols = imap imaps pop3s managesieve mail_location = maildir:/ext/spool/imap/%1Mu/%u mail_uid = vmail mail_gid = vmail protocol lda { mail_plugins = quota sieves.fr } .. plugin { .. sieve_dir = /ext/spool/sieve/%1Mu/%u sieve = /ext/spool/sieve/%1Mu/%u/dovecot.sieve } rights are OK for user "vmail" in /ext/spool/sieve/%1Mu/%u/ ....; for example : /ext/spool/sieve/d/user324# ls -la total 20 drwxr-x--- 3 vmail vmail 4096 20 d?c. 19:15 . drwxr-x--- 43 vmail vmail 4096 17 nov. 10:14 .. lrwxrwxrwx 1 vmail vmail 10 20 d?c. 18:38 dovecot.sieve -> ingo.sieve -rw-r----- 1 vmail vmail 65 20 d?c. 19:15 dovecot.svbin -rw-r----- 1 vmail vmail 88 20 d?c. 18:38 ingo.sieve drwxr-x--- 2 vmail vmail 4096 20 d?c. 18:38 tmp any ideas?thanks Arnaud, From CMarcus at Media-Brokers.com Thu Dec 22 13:13:36 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 22 Dec 2011 06:13:36 -0500 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> Message-ID: <4EF310E0.6030006@Media-Brokers.com> On 2011-12-21 11:18 PM, Simon Brereton wrote: > It would be interesting to chart the number of threads caused by each > distro. I don't know who would have the least, but I suspect gentoo and > centos would be out in front, Been using gentoo since about 2003 and never looked back... best and easiest distro to maintain, bar none, and the best support and documentation too. -- Best regards, Charles From tlx at leuxner.net Thu Dec 22 13:29:08 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Thu, 22 Dec 2011 12:29:08 +0100 Subject: [Dovecot] Global Sieve Script Includes no longer works with 056934abd2ef Message-ID: Latest Dovecot Auto-Build 2.1.rc1-0~auto+42 (056934abd2ef) fails to include global Sieve Scripts. Not sure this is specific to Stephan's Repository. Rolling back to older version restores functionality. ==> /var/log/dovecot/dovecot.log <== Dec 22 12:13:52 spectre dovecot: lmtp(32246): Connect from local Dec 22 12:13:52 spectre dovecot: lmtp(32246, tlx at leuxner.net): Error: jo99GvAQ8072fQAAqZii3w: sieve: failed to open script /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve (view user logfile /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve.log for more information) Dec 22 12:13:52 spectre dovecot: lmtp(32246, tlx at leuxner.net): jo99GvAQ8072fQAAqZii3w: msgid=<4EF310E0.6030006 at Media-Brokers.com>: saved mail to INBOX $ cat /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve.log sieve: info: started log at Dec 22 12:13:52. main_script: line 2: error: included global script 'global.sieve' does not exist. main_script: error: validation failed. [ Script Calling Global ] $ head /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve require ["include","copy","fileinto","vacation"]; include :global "global.sieve"; [?] $ ls -al /var/vmail/conf.d/leuxner.net/sieve/ total 12 dr-x------ 2 vmail vmail 4096 Dec 7 15:09 . dr-x------ 4 vmail vmail 4096 Mar 17 2010 .. -r-------- 1 vmail vmail 3647 Dec 7 15:09 global.sieve $ doveconf -n # 2.1.rc1 (056934abd2ef): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 auth_cache_size = 16 k auth_verbose = yes mail_location = mdbox:~/mdbox mail_plugins = acl quota stats namespace { list = yes location = mdbox:/var/vmail/public prefix = Public/ separator = / subscriptions = no type = public } namespace inbox { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = username_format=%u /var/vmail/auth.d/%d/passwd driver = passwd-file } plugin { acl = vfile:/var/vmail/conf.d/%d/acls:cache_secs=300 mail_log_events = expunge mailbox_delete quota = dict:user::file:%h/mdbox/dovecot-quota quota_rule = *:storage=1GB quota_rule2 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/vmail/conf.d/%d/sieve stats_refresh = 30s stats_track_cmds = yes } protocols = imap lmtp quota_full_tempfail = yes service auth-worker { user = doveauth } service auth { client_limit = 1224 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = doveauth } service imap-login { inet_listener imap { address = 1.2.3.4 port = 143 } inet_listener imaps { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_ca = From jerry at seibercom.net Thu Dec 22 13:31:30 2011 From: jerry at seibercom.net (Jerry) Date: Thu, 22 Dec 2011 06:31:30 -0500 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <4EF310E0.6030006@Media-Brokers.com> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> Message-ID: <20111222063130.6c45f3a2@scorpio> On Thu, 22 Dec 2011 06:13:36 -0500 Charles Marcus articulated: > On 2011-12-21 11:18 PM, Simon Brereton > wrote: > > It would be interesting to chart the number of threads caused by > > each distro. I don't know who would have the least, but I suspect > > gentoo and centos would be out in front, > > Been using gentoo since about 2003 and never looked back... best and > easiest distro to maintain, bar none, and the best support and > documentation too. I have been a FreeBSD user since 2000. Dovecot and Postfix run well on the OS. Postfix should since it was developed on FreeBSD. Other than that though, most other apps require extensive patching in order to get them to work. And when it comes to drivers for modern devices, you can pretty much forget about it. After more than five years they still have not developed drivers for wireless "N" protocol devices. However, like Firefox, they do enjoy bumping versions numbers sans any true or radical improvement. Just my 2?. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ Have you ever considered the irony in the fact that we celebrate Christ's birthday every year by ignoring the fact that he would have celebrated Hanukkah? From stephan at rename-it.nl Thu Dec 22 13:59:19 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 22 Dec 2011 12:59:19 +0100 Subject: [Dovecot] Global Sieve Script Includes no longer works with 056934abd2ef In-Reply-To: References: Message-ID: <4EF31B97.5070906@rename-it.nl> On 12/22/2011 12:29 PM, Thomas Leuxner wrote: > Latest Dovecot Auto-Build 2.1.rc1-0~auto+42 (056934abd2ef) fails to include global Sieve Scripts. Not sure this is specific to Stephan's Repository. Rolling back to older version restores functionality. > > ==> /var/log/dovecot/dovecot.log<== > Dec 22 12:13:52 spectre dovecot: lmtp(32246): Connect from local > Dec 22 12:13:52 spectre dovecot: lmtp(32246, tlx at leuxner.net): Error: jo99GvAQ8072fQAAqZii3w: sieve: failed to open script /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve (view user logfile /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve.log for more information) > Dec 22 12:13:52 spectre dovecot: lmtp(32246, tlx at leuxner.net): jo99GvAQ8072fQAAqZii3w: msgid=<4EF310E0.6030006 at Media-Brokers.com>: saved mail to INBOX > > $ cat /var/vmail/domains/leuxner.net/tlx/.dovecot.sieve.log > sieve: info: started log at Dec 22 12:13:52. > main_script: line 2: error: included global script 'global.sieve' does not exist. > main_script: error: validation failed. The fact that << include "global.sieve"; >> and << include "global"; >> would map to the same script file `global.sieve' is not intended behavior and I fixed this in a recent change: http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/66b7b1636c8c I had the impression that this was already documented/announced in the migration instructions from CMUSieve, but apparently these don't tell the whole story: http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration#From_CMUSieve_.28Dovecot_v1.0.2BAC8-v1.1.29 That is why I didn't explicitly announce this change. The .sieve extension only has significance in the filesystem (to make sure that the Sieve interpreter refuses to open anything but Sieve scripts). When specified in the Sieve language, that extension would just be part of the script name, meaning that << include "global.sieve"; >> maps to `global.sieve.sieve' on the filesystem. So, in your case using << include :global "global"; >> should fix it. Because it is technically a bugfix, it is also due to be released for Dovecot v2.0. Is it a big problem to change your include instructions? Is anyone else depending on this unintended feature? Regards, Stephan. From tlx at leuxner.net Thu Dec 22 14:06:59 2011 From: tlx at leuxner.net (Thomas Leuxner) Date: Thu, 22 Dec 2011 13:06:59 +0100 Subject: [Dovecot] Global Sieve Script Includes no longer works with 056934abd2ef In-Reply-To: <4EF31B97.5070906@rename-it.nl> References: <4EF31B97.5070906@rename-it.nl> Message-ID: <78911E18-84E8-4CB2-A350-B7FA9B7802E3@leuxner.net> Am 22.12.2011 um 12:59 schrieb Stephan Bosch: > That is why I didn't explicitly announce this change. The .sieve extension only has significance in the filesystem (to make sure that the Sieve interpreter refuses to open anything but Sieve scripts). When specified in the Sieve language, that extension would just be part of the script name, meaning that << include "global.sieve"; >> maps to `global.sieve.sieve' on the filesystem. So, in your case using << include :global "global"; >> should fix it. > > Because it is technically a bugfix, it is also due to be released for Dovecot v2.0. > > Is it a big problem to change your include instructions? Is anyone else depending on this unintended feature? Not a biggie at all to fix on my end. And thanks for the explanation. Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 163 bytes Desc: Message signed with OpenPGP using GPGMail URL: From p.heinlein at heinlein-support.de Thu Dec 22 14:34:05 2011 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Thu, 22 Dec 2011 13:34:05 +0100 Subject: [Dovecot] LSUB and subscribed folders Message-ID: <201112221334.06087.p.heinlein@heinlein-support.de> I have a strange behavior on a customer's server and I don't understand that: User "bar" has some folders and one shared folder from "foo" if I use the "LIST"-command, which should list AFAIK *all* folders: # telnet localhost 143 a login bar xxxx a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk] Logged in a LIST "" "*" * LIST (\HasNoChildren) "/" "Gesendete Objekte" * LIST (\HasNoChildren) "/" "Papierkorb" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "Entw&APw-rfe" * LIST (\HasNoChildren) "/" "Spam" * LIST (\Noselect \HasChildren) "/" "shared/foo" * LIST (\HasNoChildren) "/" "shared/foo/INBOX" a OK List completed. Using the LSUB-command, which should only list subscribed folders I can see some more shared folders. AFAIK the output of LSUB must be always less then LIST: a LSUB "" "*" * LSUB () "/" "Entw&APw-rfe" * LSUB () "/" "Gesendete Objekte" * LSUB () "/" "INBOX" * LSUB () "/" "Papierkorb" * LSUB () "/" "Spam" * LSUB () "/" "Trash" * LSUB (\Noselect) "/" "shared/amerkel" * LSUB () "/" "shared/foo/Papierkorb/Ungelesene Mails" * LSUB () "/" "shared/foo/INBOX" * LSUB () "/" "shared/foo/INBOX/abc/Unterebene 1" * LSUB () "/" "shared/foo/INBOX/abc/Unterebene 1/Test6789" * LSUB () "/" "shared/foo/INBOX/abc/Unterebene 1/Test Unterornder" * LSUB () "/" "shared/foo/INBOX/abc/Unterebene 1/Tsfgnksfgnk" a OK Lsub completed. a logout * BYE Logging out a OK Logout completed. And why is /shared/foo/INBOX listed with "HasNoChildren"? IMHO that's looking buggy. And, btw: Looks like's not possible to use the "doveadm"-command to get a list of a user's complete folder list. Maybe "doveadm mailbox" should get some extra parameters to geht all folders / only subscribe folders / only shared folders: # doveadm mailbox list -u bar Gesendete Objekte Papierkorb INBOX Trash Entw?rfe Spam -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030/405051-42 Fax: 030/405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From tmtalpey at gmail.com Thu Dec 22 14:42:50 2011 From: tmtalpey at gmail.com (Tom Talpey) Date: Thu, 22 Dec 2011 07:42:50 -0500 Subject: [Dovecot] Global Sieve Script Includes no longer works with 056934abd2ef In-Reply-To: <78911E18-84E8-4CB2-A350-B7FA9B7802E3@leuxner.net> References: <4EF31B97.5070906@rename-it.nl> <78911E18-84E8-4CB2-A350-B7FA9B7802E3@leuxner.net> Message-ID: <4EF325CA.6050207@gmail.com> On 12/22/2011 7:06 AM, Thomas Leuxner wrote: > > Am 22.12.2011 um 12:59 schrieb Stephan Bosch: > >> That is why I didn't explicitly announce this change. The .sieve extension only has significance in the filesystem (to make sure that the Sieve interpreter refuses to open anything but Sieve scripts). When specified in the Sieve language, that extension would just be part of the script name, meaning that<< include "global.sieve";>> maps to `global.sieve.sieve' on the filesystem. So, in your case using<< include :global "global";>> should fix it. >> >> Because it is technically a bugfix, it is also due to be released for Dovecot v2.0. >> >> Is it a big problem to change your include instructions? Is anyone else depending on this unintended feature? > > Not a biggie at all to fix on my end. And thanks for the explanation. Not a biggie here either, but my "include"s specified the full filename too. I guess I never read the CMUSieve migration page, since my scripts weren't migrated. So I suspect this will trip up other installations. Good to know, thanks! From hydrapolic at gmail.com Thu Dec 22 16:08:35 2011 From: hydrapolic at gmail.com (hydra) Date: Thu, 22 Dec 2011 15:08:35 +0100 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> Message-ID: Hello Timo, thank you for the reply. I was suspecting the same. However: - the machine runs under Vmware, - I've tried 3 different kernel versions, - I've tried 3 different SCSI controllers. All same results. On Wed, Dec 21, 2011 at 6:16 PM, Timo Sirainen wrote: > On 21.12.2011, at 18.38, hydra wrote: > > > I suspect, that dovecot v2.0.16 under Linux (tested on Gentoo 3.0.4 > > Hardened, Gentoo 3.0.6, Gentoo 3.1.4) causes 100% cpu utilization when > > index.cache is broken and doveadm is lanched. Dovecot uses LDAP as the > > userdb and provides IMAP and LDA. Because each user has a quota, the > > doveadm's expunge functionality is used to get rid of old trashed mail. > > > > The mail log: > > Dec 12 07:38:59 www dovecot: imap(user): Error: Corrupted index cache > file > > /var/data/mail/domain.tld/user/mail/dovecot.index.cache: invalid record > size > > OK.. > > > Mail is stored on ext4 and flush will use all of the CPU capacity like > this: > > load average: 4.00, 4.01, 4.05 > > > > ps: > > root 26401 98.2 0.0 0 0 ? R Dec20 1369:49 > > [flush-253:1] > > That's a kernel process.. > > > I suspect, that this is something to do with Dovecot, because after > > deleting the dovecot.index.cache file, everything went back to normal. > When > > this happens, I cannot unmount the drive nor a system reboot works. > > That's a kernel bug.. > > I think you're thinking it the wrong way: Dovecot isn't causing your > system to break. Your system is causing Dovecot to break. Faulty hardware > or faulty kernel. From ajb2 at mssl.ucl.ac.uk Thu Dec 22 16:11:09 2011 From: ajb2 at mssl.ucl.ac.uk (Alan Brown) Date: Thu, 22 Dec 2011 14:11:09 +0000 Subject: [Dovecot] OS/Distro wars Message-ID: <4EF33A7D.9060800@mssl.ucl.ac.uk> DO NOT FEED THE TROLLS From stan at hardwarefreak.com Thu Dec 22 16:49:56 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Thu, 22 Dec 2011 08:49:56 -0600 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> Message-ID: <4EF34394.5080806@hardwarefreak.com> On 12/22/2011 8:08 AM, hydra wrote: > Hello Timo, thank you for the reply. I was suspecting the same. However: > - the machine runs under Vmware, > - I've tried 3 different kernel versions, > - I've tried 3 different SCSI controllers. > > All same results. dmesg output? Log errors? Is your EXT4 filesystem on a VMFS volume or an RDM (SAN LUN)? > On Wed, Dec 21, 2011 at 6:16 PM, Timo Sirainen wrote: > >> On 21.12.2011, at 18.38, hydra wrote: >> That's a kernel process.. >> >>> I suspect, that this is something to do with Dovecot, because after >>> deleting the dovecot.index.cache file, everything went back to normal. >> When >>> this happens, I cannot unmount the drive nor a system reboot works. System (host machine) reboot, or virtual machine reboot doesn't fix the problem? FYI, Linux doesn't unmount drives, it unmounts filesystems. I'd say you may have a problem with your VMFS volume or RDM, or maybe just your EXT4 filesystem. Have you run an fsck on it? What result? Or, as Timo suggests, could be a kernel bug. Or an interaction of these low level layers causing a problem. If you can't unmount a filesystem, that has nothing to do with Dovecot, and points to a much larger, more critical, problem. Do you have this problem when booting an older kernel? Say 2.6.32? 2.6.37? >> That's a kernel bug.. >> >> I think you're thinking it the wrong way: Dovecot isn't causing your >> system to break. Your system is causing Dovecot to break. Faulty hardware >> or faulty kernel. -- Stan From martin at ilait.se Thu Dec 22 17:33:31 2011 From: martin at ilait.se (Martin Abrahamsson) Date: Thu, 22 Dec 2011 16:33:31 +0100 Subject: [Dovecot] Limit maximum connections for user/IP on proxy Message-ID: <4EF34DCB.6090206@ilait.se> Hi, Is it possible to limit the maximum number of IMAP connections allowed for a user from each IP address, on the proxy server instead of on the mail store server? mail_max_userip_connections works well when the client is connection to the mail store without proxy, but when using proxies the POP/IMAP server will register the remote IP (rip) as the proxy server's IP address - thus a low limit will be reached quite easily. Thanks -- Martin Abrahamsson From alessio at skye.it Thu Dec 22 17:36:07 2011 From: alessio at skye.it (Alessio Cecchi) Date: Thu, 22 Dec 2011 16:36:07 +0100 Subject: [Dovecot] Patch for dovecot 1.2.16 (and .17) for vpopmail module Message-ID: Hi Timo, I love dovecot but I love also vpopmail and its functions for manage user limits (via vmoduser). Unfortunately in dovecot 1.2.x auth default set to use "vpopmail" is unable to apply this limits. Only if used with checkpassword limits works fine but in the dovecot.log only user (without @domain) is logged. So, based on the code of dovecot 2.0, I have created this very simple patch that correct this bug. Thanks for consideration -- Alessio Cecchi is: on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi Linux -> http://www.cecchi.biz/ Hosting Linux -> http://www.hosting-linux.it @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it -------------- next part -------------- A non-text attachment was scrubbed... Name: patch-dovecot-alessice-1.2.16.txt Type: text/x-c Size: 1180 bytes Desc: not available URL: From tss at iki.fi Thu Dec 22 17:37:39 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 22 Dec 2011 17:37:39 +0200 Subject: [Dovecot] Limit maximum connections for user/IP on proxy In-Reply-To: <4EF34DCB.6090206@ilait.se> References: <4EF34DCB.6090206@ilait.se> Message-ID: <78C75C8E-E0C4-408E-BE81-8D74094B182F@iki.fi> On 22.12.2011, at 17.33, Martin Abrahamsson wrote: > mail_max_userip_connections works well when the client is connection to the mail store without proxy, but when using proxies the POP/IMAP server will register the remote IP (rip) as the proxy server's IP address - thus a low limit will be reached quite easily. See login_trusted_networks setting. From hydrapolic at gmail.com Thu Dec 22 18:06:47 2011 From: hydrapolic at gmail.com (hydra) Date: Thu, 22 Dec 2011 17:06:47 +0100 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: <4EF34394.5080806@hardwarefreak.com> References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> Message-ID: On Thu, Dec 22, 2011 at 3:49 PM, Stan Hoeppner wrote: > On 12/22/2011 8:08 AM, hydra wrote: > > Hello Timo, thank you for the reply. I was suspecting the same. However: > > - the machine runs under Vmware, > > - I've tried 3 different kernel versions, > > - I've tried 3 different SCSI controllers. > > > > All same results. > > dmesg output? Log errors? > Nothing there > Is your EXT4 filesystem on a VMFS volume or an RDM (SAN LUN)? > VMFS > > > > On Wed, Dec 21, 2011 at 6:16 PM, Timo Sirainen wrote: > > > >> On 21.12.2011, at 18.38, hydra wrote: > > >> That's a kernel process.. > >> > >>> I suspect, that this is something to do with Dovecot, because after > >>> deleting the dovecot.index.cache file, everything went back to normal. > >> When > >>> this happens, I cannot unmount the drive nor a system reboot works. > > System (host machine) reboot, or virtual machine reboot doesn't fix the > problem? FYI, Linux doesn't unmount drives, it unmounts filesystems. > > After the virtual machine reboot, the CPU usage is normal again, but just until doveadm is launched again (it was run from cron). Sorry for the partition/drive terminology mess up. > I'd say you may have a problem with your VMFS volume or RDM, or maybe > just your EXT4 filesystem. Have you run an fsck on it? What result? > A normal system reboot wasn't possible, because the ext4 fs wasn't unmounted (and it wasn't possible to unmount the fs nor run sync - both locked up) and thus I had to reboot from the vSphere Client. After the reboot, fsck placed the fs to a consistent state, however the problem occurred the next morning, when doveadm from the cron was run again. So a fsck didn't help. > Or, as Timo suggests, could be a kernel bug. Or an interaction of these > low level layers causing a problem. If you can't unmount a filesystem, > that has nothing to do with Dovecot, and points to a much larger, more > critical, problem. > > Do you have this problem when booting an older kernel? Say 2.6.32? > 2.6.37? > > The oldest available kernel is 2.6.32 so I'm going to test it. Thank you :) > >> That's a kernel bug.. > >> > >> I think you're thinking it the wrong way: Dovecot isn't causing your > >> system to break. Your system is causing Dovecot to break. Faulty > hardware > >> or faulty kernel. > > -- > Stan > > From tss at iki.fi Thu Dec 22 18:13:46 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 22 Dec 2011 18:13:46 +0200 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> Message-ID: <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> On 22.12.2011, at 18.06, hydra wrote: > After the virtual machine reboot, the CPU usage is normal again, but just > until doveadm is launched again (it was run from cron). Sorry for the > partition/drive terminology mess up. So it's reproducible? You could see if you can reproduce it by simply reading the file(s) that are causing problems. Like with zsh: cat **/* > /dev/null From slusarz at curecanti.org Thu Dec 22 21:50:01 2011 From: slusarz at curecanti.org (Michael M Slusarz) Date: Thu, 22 Dec 2011 12:50:01 -0700 Subject: [Dovecot] LSUB and subscribed folders In-Reply-To: <201112221334.06087.p.heinlein@heinlein-support.de> References: <201112221334.06087.p.heinlein@heinlein-support.de> Message-ID: <20111222125001.Horde.-uOJAYF5lbhO84npZMNi2SA@bigworm.curecanti.org> Quoting Peer Heinlein : > Using the LSUB-command, which should only list subscribed folders I can see > some more shared folders. AFAIK the output of LSUB must be always less then > LIST: No, it is exactly the opposite - LSUB can potentially list MORE mailboxes than exist on the server. LSUB only provides the list of mailboxes that have been marked as subscribed. It is quite possible to mark a mailbox as subscribed and then delete it, in which case LSUB must continue to report that mailbox. See RFC 3501 [6.3.9]: The server MUST NOT unilaterally remove an existing mailbox name from the subscription list even if a mailbox by that name no longer exists. michael From p.heinlein at heinlein-support.de Thu Dec 22 23:01:41 2011 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Thu, 22 Dec 2011 22:01:41 +0100 Subject: [Dovecot] crash on shared folders if remote user has empty $home Message-ID: <201112222201.41781.p.heinlein@heinlein-support.de> Hi, in seldom cirumstances it's possible that the imap-process is crashing without write something usefule into the logfile. a) User foo exists, is happy and everything's alright b) He had a shared folder given from bar c) In our setup we have mailforwarding adresses without a valid $home in LDAP c) if user bar is changed from a user with into a mailforwarding adress, the user foo won't have an entry for $home any more, but still exists in LDAP. d) If foo logs in, dovecot's exploring the shared folders given from the non-existing user bar. But bar's entry in LDAP doesn't have $home any more. imap crashes and closes the TCP-connection immediately. root at dobby2:/etc/dovecot# telnet xxxxxxxx 143 Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE ACL UIDPLUS STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5 AUTH=DIGEST-MD5] Dovecot ready. Testing. a LOGIN foo xxxxx a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL UIDPLUS QUOTA ACL RIGHTS=texk] Logged in a LIST "" "*" * BYE Internal error occurred. Refer to server log for more information. Connection closed by foreign host. Dec 22 21:57:41 dobby2 dovecot: master: Error: service(imap): child 18095 killed with signal 11 (core dumps disabled) e) This happens if mail_location=mdbox:%%h/mdbox is set in the shared folder namespace. If I set "mail_location=auto:" then Dovecot logs an error message, but is still possible to continue without any problems. Dec 22 21:33:59 dobby2 dovecot: imap(bar): Error: Namespace 'shared/bar/': Autodetection failed for auto: (home=/mail/foo/) -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030 / 40 50 51 - 0 Fax: 030 / 40 50 51 - 19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From p.heinlein at heinlein-support.de Thu Dec 22 23:07:16 2011 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Thu, 22 Dec 2011 22:07:16 +0100 Subject: [Dovecot] crash on shared folders if remote user has empty $home In-Reply-To: <201112222201.41781.p.heinlein@heinlein-support.de> References: <201112222201.41781.p.heinlein@heinlein-support.de> Message-ID: <201112222207.17006.p.heinlein@heinlein-support.de> Am Donnerstag, 22. Dezember 2011, 22:01:41 schrieb Peer Heinlein: Hi, > e) This happens if mail_location=mdbox:%%h/mdbox is set in the shared > folder namespace. If I set "mail_location=auto:" then Dovecot logs an Sorry, it's mail= and not mail_location= in the shared namespace area. Peer -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030 / 40 50 51 - 0 Fax: 030 / 40 50 51 - 19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From user+dovecot at localhost.localdomain.org Thu Dec 22 23:37:27 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Thu, 22 Dec 2011 22:37:27 +0100 Subject: [Dovecot] file_dotlock_create(~/.dovecot.lda-dupes) failed: No such file or directory ... In-Reply-To: <4EF3070C.1040704@univ-orleans.fr> References: <4EF3070C.1040704@univ-orleans.fr> Message-ID: <4EF3A317.4050209@localhost.localdomain.org> On 12/22/2011 11:31 AM LE NORCY Arnaud wrote: > > Dec 22 10:18:16 mailserver dovecot: deliver(user324): > file_dotlock_create(~/.dovecot.lda-dupes) failed: No such file or directory ^ http://wiki.dovecot.org/VirtualUsers/Home Regards, Pascal -- The trapper recommends today: cafefeed.1135622 at localdomain.org From blmatthews at gmail.com Fri Dec 23 00:21:49 2011 From: blmatthews at gmail.com (Brian L. Matthews) Date: Thu, 22 Dec 2011 14:21:49 -0800 Subject: [Dovecot] Received date no longer email date? Message-ID: <4EF3AD7D.40203@gmail.com> I just upgrade from dovecot 1.2 to dovecot 2.0.16. I use dovecot as a local IMAP server to archive email from my corporate email account (on Exchange). I don't have any automated archiving, I just periodically move messages from my Exchange inbox to the IMAP inbox. I'm on Mac OS X 10.6.8 using Entourage as my mail client. In the previous version of dovecot, the Received date of the email was preserved when I moved a message, but it's not in 2.0.16, it's set to the date and time I move the message. If I open a message, the date displayed is the date on the message as expected. I converted my config from 1.2 with $ doveconf -n -c dovecot.conf > dovecot-2.conf It spit out various warnings but, once I'd created a dovenull user, seemed to work fine. Here's my configuration info: $ dovecot --version 2.0.16 $ dovecot -n # 2.0.16: /usr/local/etc/dovecot/dovecot.conf # OS: Darwin 10.8.0 i386 disable_plaintext_auth = no listen = 127.0.0.1 log_path = /var/log/dovecot.log mail_location = maildir:~/Maildir passdb { args = login driver = pam } service auth { user = root } service imap-login { process_limit = 16 } service imap { process_limit = 64 } ssl = no userdb { driver = passwd } I'd like to get it back to preserving the Received date, any help you can provide will be appreciated. Brian From noel.butler at ausics.net Fri Dec 23 00:49:30 2011 From: noel.butler at ausics.net (Noel Butler) Date: Fri, 23 Dec 2011 08:49:30 +1000 Subject: [Dovecot] crashes on 2.0.16 In-Reply-To: <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <4EF2D756.6000107@schetterer.org> <1324538824.14607.16.camel@tardis> <4EF2DF66.4060408@schetterer.org> <1324540348.16562.11.camel@tardis> <9B941B3D-84C2-4642-9311-52295BA04805@xs4all.nl> Message-ID: <1324594170.5841.5.camel@tardis> On Thu, 2011-12-22 at 09:22 +0100, Cor Bosman wrote: > > This also is not the kernel list, since updating to a kernel released in > > the 21st century Cor's issue has gone away, so this thread is now rather > > entirely pointless on the Dovecot list. So I'll my participation in > > Actually, it hasn't. For the last few days we've been trying to pinpoint the problem by running half a dozen servers with different kernels and options. This 'kernel released in the 20th century' we have this problem with is the current stable kernel for debian. So instead of starting a distro war (and I thought canon/nikon, mac/pc were bad), lets be a bit more constructive. Plenty of people use the stable debian release. > Ahh OK, your previous message said it was resolved, did the traceback show anything? > It's happening on about half of our imap servers (20 or so), but on none of our other debian servers (hundreds). So it's not so weird to suspect a dovecot link. But it looks like it may be a driver issue on a specific range of hardware we use. > maybe install a slackware or gentoo box and add it into the farm and see if same problem exists there as well, if so, clearly dovecot, if not, clearly debian, its why I still keep a RHEL box handy, it sits attached to the "dev" unit until I need it to assist to prove/disprove something. All the best. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From noel.butler at ausics.net Fri Dec 23 00:51:50 2011 From: noel.butler at ausics.net (Noel Butler) Date: Fri, 23 Dec 2011 08:51:50 +1000 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <20111222063130.6c45f3a2@scorpio> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> <20111222063130.6c45f3a2@scorpio> Message-ID: <1324594310.5841.7.camel@tardis> On Thu, 2011-12-22 at 06:31 -0500, Jerry wrote: > On Thu, 22 Dec 2011 06:13:36 -0500 > Charles Marcus articulated: > > > On 2011-12-21 11:18 PM, Simon Brereton > > wrote: > > > It would be interesting to chart the number of threads caused by > > > each distro. I don't know who would have the least, but I suspect > > > gentoo and centos would be out in front, > > > > Been using gentoo since about 2003 and never looked back... best and > > easiest distro to maintain, bar none, and the best support and > > documentation too. > > I have been a FreeBSD user since 2000. Dovecot and Postfix run well on > the OS. Postfix should since it was developed on FreeBSD. Other than > that though, most other apps require extensive patching in order to get > them to work. And when it comes to drivers for modern devices, you can > pretty much forget about it. After more than five years they still have > not developed drivers for wireless "N" protocol devices. However, like > Firefox, they do enjoy bumping versions numbers sans any true or > radical improvement. > > Just my 2?. > Tis a shame that, freebsd used to leave linux behind in resource management, but in last 5 or so years, its been other way around and I kinda agree its like "time stood still" -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From noel.butler at ausics.net Fri Dec 23 00:53:59 2011 From: noel.butler at ausics.net (Noel Butler) Date: Fri, 23 Dec 2011 08:53:59 +1000 Subject: [Dovecot] OS/Distro wars In-Reply-To: <4EF33A7D.9060800@mssl.ucl.ac.uk> References: <4EF33A7D.9060800@mssl.ucl.ac.uk> Message-ID: <1324594439.5841.9.camel@tardis> On Thu, 2011-12-22 at 14:11 +0000, Alan Brown wrote: > DO NOT FEED THE TROLLS > > another goose who think he's god... if you dont like a thread, dont read it, especially since its been marked as OT for past 10 or posts, ya moron. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From michael.abbott at apple.com Fri Dec 23 01:10:52 2011 From: michael.abbott at apple.com (Mike Abbott) Date: Thu, 22 Dec 2011 17:10:52 -0600 Subject: [Dovecot] proxying, SSL, and client certificate Message-ID: How do I configure dovecot-2.0.x to present a client SSL certificate when proxying? If dovecot on server1.example.com has: passdb { driver = static args = proxy=y host=server2.example.com nopassword=y ssl=yes } and dovecot on server2.example.com has: ssl_verify_client_cert = yes auth_ssl_require_client_cert = yes then when a client connects to server1 and authenticates, a connection is established to server2 but the SSL handshake fails because server1 doesn't present a client certificate. I don't see where ssl_client_ctx is tied to a client certificate in ssl-proxy-openssl.c. Thanks. From pasek at valbek.cz Fri Dec 23 01:11:58 2011 From: pasek at valbek.cz (pasek at valbek.cz) Date: Fri, 23 Dec 2011 00:11:58 +0100 Subject: [Dovecot] =?utf-8?b?RG92b2xlbsOh?= Message-ID: <55354f37803b3d0dff41d29bbe02e354-1324595518@mail.valbek.cz> Dobr? den, od 23.12. do 30.12. jsem na dovolen?. V p??pad? nutnosti volejte na mobil. S pozdravem Bc. Ladislav Pa?ek vedouc? odd?len? IT a vizualizace mobil: +420 776 140 489 e-mail: pasek at valbek.cz Valbek, s.r.o. Va?urova 505/17, 460 02 Liberec 3 tel./fax: +420 485 103 336, +420 485 103 346 www.valbek.cz From dmiller at amfes.com Fri Dec 23 09:10:53 2011 From: dmiller at amfes.com (Daniel L. Miller) Date: Thu, 22 Dec 2011 23:10:53 -0800 Subject: [Dovecot] Lucene vs Solr with 2.1 single server Message-ID: For a single server, is the Lucene backend now "better" than running a Solr server? -- Daniel From ronleach at tesco.net Fri Dec 23 11:49:10 2011 From: ronleach at tesco.net (Ron Leach) Date: Fri, 23 Dec 2011 09:49:10 +0000 Subject: [Dovecot] =?windows-1252?q?Dovolen=E1?= In-Reply-To: <55354f37803b3d0dff41d29bbe02e354-1324595518@mail.valbek.cz> References: <55354f37803b3d0dff41d29bbe02e354-1324595518@mail.valbek.cz> Message-ID: <4EF44E96.2060401@tesco.net> On 22/12/2011 23:11, pasek at valbek.cz wrote: > > Dobr?? den, > > od 23.12. do 30.12. jsem na dovolen??. V p????pad?? nutnosti volejte na mobil. > > S pozdravem > Ladislav, sure, we'll reach you on your mobile if we need you. Enjoy the break; will you be doing some ski-ing? Ron From hydrapolic at gmail.com Fri Dec 23 12:12:07 2011 From: hydrapolic at gmail.com (hydra) Date: Fri, 23 Dec 2011 11:12:07 +0100 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> Message-ID: Yes, it is reproducible. About the file, I have tarred up the original maildir before I deleted the dovecot.index.cache, so when I try to bring in the original file, a 'cat' does no harm. Moreover, I've tried to do this will all files on the virtual machine, same results - no harm. On Thu, Dec 22, 2011 at 5:13 PM, Timo Sirainen wrote: > On 22.12.2011, at 18.06, hydra wrote: > > > After the virtual machine reboot, the CPU usage is normal again, but just > > until doveadm is launched again (it was run from cron). Sorry for the > > partition/drive terminology mess up. > > So it's reproducible? You could see if you can reproduce it by simply > reading the file(s) that are causing problems. Like with zsh: cat **/* > > /dev/null > > From stan at hardwarefreak.com Fri Dec 23 12:36:46 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 23 Dec 2011 04:36:46 -0600 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> Message-ID: <4EF459BE.7020104@hardwarefreak.com> On 12/23/2011 4:12 AM, hydra wrote: > Yes, it is reproducible. > > About the file, I have tarred up the original maildir before I deleted the > dovecot.index.cache, so when I try to bring in the original file, a 'cat' > does no harm. Moreover, I've tried to do this will all files on the virtual > machine, same results - no harm. Is selinux running? If so, turn it off and see if that helps. And turn off anything/everything else on this Linux VM that's not running on the other Dovecot VMs you mentioned are working properly. Let's do some process of elimination here. -- Stan From p at state-of-mind.de Fri Dec 23 13:46:19 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Fri, 23 Dec 2011 12:46:19 +0100 Subject: [Dovecot] =?utf-8?b?RG92b2xlbsOh?= In-Reply-To: <4EF44E96.2060401@tesco.net> References: <55354f37803b3d0dff41d29bbe02e354-1324595518@mail.valbek.cz> <4EF44E96.2060401@tesco.net> Message-ID: <20111223114619.GD2301@state-of-mind.de> * Ron Leach : > On 22/12/2011 23:11, pasek at valbek.cz wrote: > > > >Dobr?? den, > > > >od 23.12. do 30.12. jsem na dovolen??. V p????pad?? nutnosti volejte na mobil. > > > >S pozdravem > > > Ladislav, sure, we'll reach you on your mobile if we need you. > Enjoy the break; will you be doing some ski-ing? Thanks for the translation! :) p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From martin at ilait.se Fri Dec 23 16:41:30 2011 From: martin at ilait.se (Martin Abrahamsson) Date: Fri, 23 Dec 2011 15:41:30 +0100 Subject: [Dovecot] Limit maximum connections for user/IP on proxy In-Reply-To: <78C75C8E-E0C4-408E-BE81-8D74094B182F@iki.fi> References: <4EF34DCB.6090206@ilait.se> <78C75C8E-E0C4-408E-BE81-8D74094B182F@iki.fi> Message-ID: <4EF4931A.8080308@ilait.se> On 12/22/2011 04:37 PM, Timo Sirainen wrote: > See login_trusted_networks setting. Didn't realize that defining proxies in login_trusted_networks would display the rip at the mail store. Problem solved, thanks for the prompt reply! From achekalin at lazurit.com Fri Dec 23 18:00:48 2011 From: achekalin at lazurit.com (Alexander Chekalin) Date: Fri, 23 Dec 2011 19:00:48 +0300 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP Message-ID: <4EF4A5B0.4040302@lazurit.com> Hello, I'm now dealing with funny problem. I try to use Dovecot (2.1.rc1, actually) and mbox format to store old mailing, to keep logic of "one folder = one file". If I'd choose Maildir, I'd be able to create hierarchical folders (like "OldMail -> Maillists -> Dovecot"), and in fact on disk such a folders would be stored as real folders with dots in their names. In PHP it is easy to create with "imap_createmailbox()" function, I'd simple fire it 3 times (for "OldMail", for "OldMail.Maillists" and for "OldMail.Maillists.Dovecot"). But when I do the same with mbox, in fact it creates separate files (indeed, named "OldMail", "OldMail.Maillists" and "OldMail.Maillists.Dovecot") instead of creating filesystem folders ("OldMail/Maillists/Dovecot"). PHP is not guilty, Thunderbird won't create such folders as well. I can only create folders myself (say, with mkdir in the shell), chown it, and the it perfectly works in IMAP. Now I just wanted to know, are there any way to create IMAP-folders and subfolders using standard IMAP functionality? Thank you, Alexander From hydrapolic at gmail.com Fri Dec 23 19:08:02 2011 From: hydrapolic at gmail.com (hydra) Date: Fri, 23 Dec 2011 18:08:02 +0100 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: <4EF459BE.7020104@hardwarefreak.com> References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> <4EF459BE.7020104@hardwarefreak.com> Message-ID: Selinux wasn't running. I can reproduce the problem with this setup: - restore the maildir with the broken index.cache - run `/usr/bin/doveadm -D expunge -A mailbox Trash savedbefore 1w` in an infinite loop - use horde webmail to access the mail with IMAP - randomly display messages I could reproduce the problem on: Linux-2.6.37-hardened-r7 Linux-2.6.39-hardened-r8 Linux-3.0.4-hardened-r5 Linux-3.0.6-gentoo Linux-3.1.4-gentoo However I failed to reproduce the problem on: Linux-2.6.36-hardened-r9 So it seems it was introduced in 2.6.37. I'm going to inspect it later on. By wishing you a God blessed merry Christmas I thank you for the support ;) On Fri, Dec 23, 2011 at 11:36 AM, Stan Hoeppner wrote: > On 12/23/2011 4:12 AM, hydra wrote: > > Yes, it is reproducible. > > > > About the file, I have tarred up the original maildir before I deleted > the > > dovecot.index.cache, so when I try to bring in the original file, a 'cat' > > does no harm. Moreover, I've tried to do this will all files on the > virtual > > machine, same results - no harm. > > Is selinux running? If so, turn it off and see if that helps. And turn > off anything/everything else on this Linux VM that's not running on the > other Dovecot VMs you mentioned are working properly. Let's do some > process of elimination here. > > -- > Stan > > From e-frog at gmx.de Fri Dec 23 19:33:32 2011 From: e-frog at gmx.de (e-frog) Date: Fri, 23 Dec 2011 18:33:32 +0100 Subject: [Dovecot] 2.1.rc1 (056934abd2ef): virtual plugin mailbox search pattern Message-ID: <4EF4BB6C.3050902@gmx.de> Hello Timo, With dovecot 2.1.rc1 (056934abd2ef) there seems to be something wrong with virtual plugin mailbox search patterns. I'm using a virtual mailbox 'unread' with the following dovecot-virtual file $ cat dovecot-virtual * unseen For testing propose I created the following folders with each containing one unread message INBOX, INBOX/level1 and INBOX/level1/level2 2.1.rc1 (056934abd2ef) 1 LIST "" "*" * LIST (\HasChildren) "/" "INBOX" * LIST (\HasChildren) "/" "INBOX/level1" * LIST (\HasNoChildren) "/" "INBOX/level1/level2" * LIST (\HasChildren) "/" "virtual" * LIST (\HasNoChildren) "/" "virtual/unread" 1 OK List completed. 2 STATUS "INBOX" (UNSEEN) * STATUS "INBOX" (UNSEEN 1) 2 OK Status completed. 3 STATUS "INBOX/level1" (UNSEEN) * STATUS "INBOX/level1" (UNSEEN 1) 3 OK Status completed. 4 STATUS "INBOX/level1/level2" (UNSEEN) * STATUS "INBOX/level1/level2" (UNSEEN 1) 4 OK Status completed. 5 STATUS "virtual/unread" (UNSEEN) * STATUS "virtual/unread" (UNSEEN 1) 5 OK Status completed. Result: virtual/unread shows only 1 unseen message. Further tests showed it's the one from INBOX. The mails from the deeper levels are not found. Downgrading to 2.0.16 restores the correct behavior: 1 LIST "" "*" * LIST (\HasChildren) "/" "INBOX" * LIST (\HasChildren) "/" "INBOX/level1" * LIST (\HasNoChildren) "/" "INBOX/level1/level2" * LIST (\HasChildren) "/" "virtual" * LIST (\HasNoChildren) "/" "virtual/unread" 1 OK List completed. 2 STATUS "INBOX" (UNSEEN) * STATUS "INBOX" (UNSEEN 1) 2 OK Status completed. 3 STATUS "INBOX/level1" (UNSEEN) * STATUS "INBOX/level1" (UNSEEN 1) 3 OK Status completed. 4 STATUS "INBOX/level1/level2" (UNSEEN) * STATUS "INBOX/level1/level2" (UNSEEN 1) 4 OK Status completed. 5 STATUS "virtual/unread" (UNSEEN) * STATUS "virtual/unread" (UNSEEN 3) 5 OK Status completed. Result: virtual/unread shows 3 unseen messages as it should The namespace configuration is as following namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { location = virtual:~/virtual prefix = virtual/ separator = / subscriptions = no type = private } I've also tried this with location = virtual:~/virtual:LAYOUT=maildir++ leading to the same result. Thanks, e-frog From sottilette at rfx.it Fri Dec 23 21:20:20 2011 From: sottilette at rfx.it (sottilette at rfx.it) Date: Fri, 23 Dec 2011 20:20:20 +0100 (CET) Subject: [Dovecot] Upgrade/Migration Message-ID: Current box: CentOS 4.x (32 bit), dovecot 1.02, mbox format New box (supposed): CentOS 6.x (32/64 bit ? ), dovecot 2.04, mbox format The server have about 3.000 active users (unix users); /var/mail is about 100 GB; /home/Users about 150 GB I read the docs and searched on the net, but still request hints for planning the migration. 32/64 bit? Tricks to avoid users get all messages ...? Better first update the old server from 1.02 to 2.0x or ..? Any hints/comment appreciated ;-) Thanks, P. 1.02 dovecot.conf: ----------------------- protocols = pop3 pop3s imap imaps listen = [::] log_path = /var/log/mail/dovecot.log info_log_path = /var/log/mail/dovecot.info.log log_timestamp = "%b %d %H:%M:%S " default_mail_env = mbox:~/:INBOX=/var/mail/%u mail_full_filesystem_access = yes first_valid_uid = 100 mbox_read_locks = dotlock fcntl mbox_write_locks = dotlock fcntl auth default { mechanisms = plain passdb pam { } userdb passwd { } user = root } ----------------------- From djonas at vitalwerks.com Sat Dec 24 01:44:14 2011 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 23 Dec 2011 15:44:14 -0800 Subject: [Dovecot] Dovecot imap proxy to nginx, incompatible Message-ID: <4EF5124E.7000303@vitalwerks.com> It appears that using dovecot to proxy to nginx imap proxy doesn't work. >From tcpdump and browsing the source it appears dovecot sends, C CAPABILITY\r\nL LOGIN \r\n and nginx only responds to the CAPABILITY command. Is this a problem with dovecot sending the two commands without waiting for the first to complete or is it nginx's trouble with not handling it correctly? A quick test with a perl script confirms: #!/usr/bin/perl -w $|++; use IO::Socket; use strict; my ($host, $user, $pass) = @ARGV; my $s = new IO::Socket::INET(Proto => 'tcp', PeerAddr => $host, PeerPort => 143); die "Could not create socket $!\n" unless $s; while(<$s>) { print $_; last if /OK/; } print $s "C CAPABILITY\r\nL LOGIN $user $pass\r\n"; while(<$s>) { print $_; last if /OK/; } print $s "Q logout\r\n"; while(<$s>) { print $_; last if /OK/; } close($s); ## Output: * CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS UIDPLUS LIST-EXTENDED I18NLEVEL=1 QUOTA AUTH=PLAIN C OK completed * BYE Q OK completed From bradley.giesbrecht at gmail.com Sat Dec 24 04:28:02 2011 From: bradley.giesbrecht at gmail.com (Bradley Giesbrecht) Date: Fri, 23 Dec 2011 18:28:02 -0800 Subject: [Dovecot] sieve in sql or reporting Message-ID: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> With dovecot2 and pigeonhole sieve/managesieve is it currently possible to store sieve rules in an sql database? If not is there a way to query all accounts; looking for things like active vacation rules? Regards, Bradley Giesbrecht From stephan at rename-it.nl Sat Dec 24 06:26:24 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 24 Dec 2011 05:26:24 +0100 Subject: [Dovecot] sieve in sql or reporting In-Reply-To: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> Message-ID: <4EF55470.5040708@rename-it.nl> On 12/24/2011 3:28 AM, Bradley Giesbrecht wrote: > With dovecot2 and pigeonhole sieve/managesieve is it currently possible to store sieve rules in an sql database? Unfortunately, not yet. It is listed somewhere on the TODO list, but it does not have high priority so far. > If not is there a way to query all accounts; looking for things like active vacation rules? I'm working on an evolution of the sieve_pipe plugin called the sieve_extprograms plugin. One of the things it adds is a new action command called "execute", which may suit your needs. It will only be available for Dovecot v2.1 though. You can read the latest version of the specification here (example 4 should match your application): http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/raw-file/tip/doc/rfc/spec-bosch-sieve-extprograms.txt Regards, Stephan. From stephan at rename-it.nl Sat Dec 24 06:35:59 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 24 Dec 2011 05:35:59 +0100 Subject: [Dovecot] sieve in sql or reporting In-Reply-To: <4EF55470.5040708@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> Message-ID: <4EF556AF.8070007@rename-it.nl> On 12/24/2011 5:26 AM, Stephan Bosch wrote: > On 12/24/2011 3:28 AM, Bradley Giesbrecht wrote: >> With dovecot2 and pigeonhole sieve/managesieve is it currently >> possible to store sieve rules in an sql database? > Unfortunately, not yet. It is listed somewhere on the TODO list, but > it does not have high priority so far. > >> If not is there a way to query all accounts; looking for things like >> active vacation rules? > > I'm working on an evolution of the sieve_pipe plugin called the > sieve_extprograms plugin. One of the things it adds is a new action > command called "execute", which may suit your needs. It will only be > available for Dovecot v2.1 though. You can read the latest version of > the specification here (example 4 should match your application): > > http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/raw-file/tip/doc/rfc/spec-bosch-sieve-extprograms.txt > Oh btw, if you are looking for a way to disable vacation rules after some period of time, you can use the date extension (http://tools.ietf.org/html/rfc5260#section-4). For example: require ["date", "relational", "vacation"]; if currentdate :value "le" "date" "2011-12-09" { vacation "I'm out of office this week. I'll be back on Saturday 10th to reply to your e-mails."; } Regards, Stephan. From IcedEarthAngel at gmx.de Fri Dec 23 18:02:25 2011 From: IcedEarthAngel at gmx.de (IcedEarth) Date: Fri, 23 Dec 2011 08:02:25 -0800 (PST) Subject: [Dovecot] dovecot / postfix mail bounce problem Message-ID: <33029725.post@talk.nabble.com> Hello, i use a globalsieve rule to collect spam for all mail accounts in a specific mailbox. Here is the code: vi /var/vmail/globalsieverc require ["fileinto"]; # Move spam to junk folder if not address :is "to" "antispam at xxx.com" { if header :contains "X-Spam-Flag" ["YES"] { redirect "antispam at xxx.com"; stop; } } But the spam mails are not delivered. cat /var/log/mail.info postfix/pipe[32301]: AD8F78E2128D: to=, relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, status=bounced (mail forwarding loop for antispam at xxx.de) Why is there a loop? I don't unterstand that. Any help? Thanks! Iced -- View this message in context: http://old.nabble.com/dovecot---postfix-mail-bounce-problem-tp33029725p33029725.html Sent from the Dovecot mailing list archive at Nabble.com. From stan at hardwarefreak.com Sat Dec 24 12:31:08 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 24 Dec 2011 04:31:08 -0600 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF4A5B0.4040302@lazurit.com> References: <4EF4A5B0.4040302@lazurit.com> Message-ID: <4EF5A9EC.8090606@hardwarefreak.com> On 12/23/2011 10:00 AM, Alexander Chekalin wrote: > Hello, > > I'm now dealing with funny problem. I try to use Dovecot (2.1.rc1, > actually) and mbox format to store old mailing, to keep logic of "one > folder = one file". > > If I'd choose Maildir, I'd be able to create hierarchical folders (like > "OldMail -> Maillists -> Dovecot"), and in fact on disk such a folders > would be stored as real folders with dots in their names. In PHP it is > easy to create with "imap_createmailbox()" function, I'd simple fire it > 3 times (for "OldMail", for "OldMail.Maillists" and for > "OldMail.Maillists.Dovecot"). > > But when I do the same with mbox, in fact it creates separate files > (indeed, named "OldMail", "OldMail.Maillists" and > "OldMail.Maillists.Dovecot") instead of creating filesystem folders > ("OldMail/Maillists/Dovecot"). PHP is not guilty, Thunderbird won't > create such folders as well. I can only create folders myself (say, with > mkdir in the shell), chown it, and the it perfectly works in IMAP. > > Now I just wanted to know, are there any way to create IMAP-folders and > subfolders using standard IMAP functionality? Yes. This has been common knowledge for many years, and is covered by lots of documentation, including dovecot and tbird docs. With mbox storage, an IMAP FOLDER contains only sub folders or it contains only messages. It CANNOT contain BOTH. Thunderbird forces you to answer this question each time you create a new IMAP FOLDER in the account root tree. Surely you've seen the radio buttons in the new folder creation box. -- Stan From stan at hardwarefreak.com Sat Dec 24 12:46:58 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 24 Dec 2011 04:46:58 -0600 Subject: [Dovecot] Corrupted index cache file and high CPU usage In-Reply-To: References: <15E2615E-451B-4B80-ADAF-6EBA153BBC39@iki.fi> <4EF34394.5080806@hardwarefreak.com> <4C942851-0EF0-4FFF-8BA8-91242F7E7D45@iki.fi> <4EF459BE.7020104@hardwarefreak.com> Message-ID: <4EF5ADA2.8080008@hardwarefreak.com> On 12/23/2011 11:08 AM, hydra wrote: > Selinux wasn't running. > > I can reproduce the problem with this setup: > > - restore the maildir with the broken index.cache > - run `/usr/bin/doveadm -D expunge -A mailbox Trash savedbefore 1w` in an > infinite loop > - use horde webmail to access the mail with IMAP > - randomly display messages > > I could reproduce the problem on: > Linux-2.6.37-hardened-r7 > Linux-2.6.39-hardened-r8 > Linux-3.0.4-hardened-r5 > Linux-3.0.6-gentoo > Linux-3.1.4-gentoo > > However I failed to reproduce the problem on: > Linux-2.6.36-hardened-r9 > > So it seems it was introduced in 2.6.37. I'm going to inspect it later on. > By wishing you a God blessed merry Christmas I thank you for the support ;) Aha, cool. Glad you're making some progress, and that you now know it's kernel related in some way, just as Timo suspected. Keep in mind it may not necessarily be a code change problem in 2.6.37 onward. Could be a compiler/linker issue. It could also be the default EXT4 journal behavior changed (I haven't checked), or something similar. Merry Christmas to you as well hydra. I don't really deserve much credit for support here. I've just nudged you in the direction you already knew you should be heading. :) Best regards, -- Stan From jerry at seibercom.net Sat Dec 24 12:53:58 2011 From: jerry at seibercom.net (Jerry) Date: Sat, 24 Dec 2011 05:53:58 -0500 Subject: [Dovecot] OT: sieve in sql or reporting In-Reply-To: <4EF556AF.8070007@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> Message-ID: <20111224055358.3818150c@scorpio> On Sat, 24 Dec 2011 05:35:59 +0100 Stephan Bosch articulated: > On 12/24/2011 5:26 AM, Stephan Bosch wrote: > > On 12/24/2011 3:28 AM, Bradley Giesbrecht wrote: > >> With dovecot2 and pigeonhole sieve/managesieve is it currently > >> possible to store sieve rules in an sql database? > > Unfortunately, not yet. It is listed somewhere on the TODO list, > > but it does not have high priority so far. > > > >> If not is there a way to query all accounts; looking for things > >> like active vacation rules? > > > > I'm working on an evolution of the sieve_pipe plugin called the > > sieve_extprograms plugin. One of the things it adds is a new action > > command called "execute", which may suit your needs. It will only > > be available for Dovecot v2.1 though. You can read the latest > > version of the specification here (example 4 should match your > > application): > > > > http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/raw-file/tip/doc/rfc/spec-bosch-sieve-extprograms.txt > > > > Oh btw, if you are looking for a way to disable vacation rules after > some period of time, you can use the date extension > (http://tools.ietf.org/html/rfc5260#section-4). For example: > > require ["date", "relational", "vacation"]; > > if currentdate :value "le" "date" "2011-12-09" { > vacation "I'm out of office this week. I'll be back on > Saturday 10th to reply to your e-mails."; > } I know this isn't strictly part of this topic; however, I was wondering if sieve had acquired the ability to "forward as attachment" a received email? I know it did not have that ability previously. It is something that I could really use. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From jerry at seibercom.net Sat Dec 24 12:57:43 2011 From: jerry at seibercom.net (Jerry) Date: Sat, 24 Dec 2011 05:57:43 -0500 Subject: [Dovecot] dovecot / postfix mail bounce problem In-Reply-To: <33029725.post@talk.nabble.com> References: <33029725.post@talk.nabble.com> Message-ID: <20111224055743.2be0a99b@scorpio> On Fri, 23 Dec 2011 08:02:25 -0800 (PST) IcedEarth articulated: > > Hello, > > i use a globalsieve rule to collect spam for all mail accounts in a > specific mailbox. > > Here is the code: > > vi /var/vmail/globalsieverc > > require ["fileinto"]; > # Move spam to junk folder > if not address :is "to" "antispam at xxx.com" { > if header :contains "X-Spam-Flag" ["YES"] { > redirect "antispam at xxx.com"; > stop; > } > } > > But the spam mails are not delivered. > > cat /var/log/mail.info > > postfix/pipe[32301]: AD8F78E2128D: to=, > relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, > status=bounced (mail forwarding loop for antispam at xxx.de) > > Why is there a loop? I don't unterstand that. This question really belongs on the Postfix forum. Please read the directions for posting on that forum first. http://www.postfix.com/DEBUG_README.html Pay attention to the "Reporting problems to postfix-users at postfix.org" section at the end of the article. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ Be frank and explicit with your lawyer ... it is his business to confuse the issue afterwards. From stephan at rename-it.nl Sat Dec 24 13:30:00 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 24 Dec 2011 12:30:00 +0100 Subject: [Dovecot] OT: sieve in sql or reporting In-Reply-To: <20111224055358.3818150c@scorpio> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> <20111224055358.3818150c@scorpio> Message-ID: <4EF5B7B8.4050504@rename-it.nl> On 12/24/2011 11:53 AM, Jerry wrote: > I know this isn't strictly part of this topic; however, I was wondering > if sieve had acquired the ability to "forward as attachment" a received > email? I know it did not have that ability previously. It is something > that I could really use. In the standard Sieve language this is still not possible. It is possible to "enclose" an e-mail, but it is explicitly not allowed to redirect something like that; it can only be stored. I still don't know why. Also, the enclose extension is not implemented for Pigeonhole so far. If you need it for a very specific task, you can try the sieve_pipe plugin for Dovecot v2.0: http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Pipe You can then write your own script that does the forward-as-attachment action. As I indicated earlier, I'm working on a more intricate plugin for Dovecot v2.1. Regards, Stephan From jerry at seibercom.net Sat Dec 24 13:54:19 2011 From: jerry at seibercom.net (Jerry) Date: Sat, 24 Dec 2011 06:54:19 -0500 Subject: [Dovecot] OT: sieve in sql or reporting In-Reply-To: <4EF5B7B8.4050504@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> <20111224055358.3818150c@scorpio> <4EF5B7B8.4050504@rename-it.nl> Message-ID: <20111224065419.5db26ee5@scorpio> On Sat, 24 Dec 2011 12:30:00 +0100 Stephan Bosch articulated: > On 12/24/2011 11:53 AM, Jerry wrote: > > I know this isn't strictly part of this topic; however, I was > > wondering if sieve had acquired the ability to "forward as > > attachment" a received email? I know it did not have that ability > > previously. It is something that I could really use. > > In the standard Sieve language this is still not possible. It is > possible to "enclose" an e-mail, but it is explicitly not allowed to > redirect something like that; it can only be stored. I still don't > know why. Also, the enclose extension is not implemented for > Pigeonhole so far. > > If you need it for a very specific task, you can try the sieve_pipe > plugin for Dovecot v2.0: > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Pipe > > You can then write your own script that does the > forward-as-attachment action. As I indicated earlier, I'm working on > a more intricate plugin for Dovecot v2.1. Thank you very much for your extremely rapid response. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From robert at schetterer.org Sat Dec 24 14:54:32 2011 From: robert at schetterer.org (Robert Schetterer) Date: Sat, 24 Dec 2011 13:54:32 +0100 Subject: [Dovecot] OT: sieve in sql or reporting In-Reply-To: <4EF5B7B8.4050504@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> <20111224055358.3818150c@scorpio> <4EF5B7B8.4050504@rename-it.nl> Message-ID: <4EF5CB88.7060208@schetterer.org> Am 24.12.2011 12:30, schrieb Stephan Bosch: > On 12/24/2011 11:53 AM, Jerry wrote: >> I know this isn't strictly part of this topic; however, I was wondering >> if sieve had acquired the ability to "forward as attachment" a received >> email? I know it did not have that ability previously. It is something >> that I could really use. > > In the standard Sieve language this is still not possible. It is > possible to "enclose" an e-mail, but it is explicitly not allowed to > redirect something like that; it can only be stored. I still don't know > why. Also, the enclose extension is not implemented for Pigeonhole so far. > > If you need it for a very specific task, you can try the sieve_pipe > plugin for Dovecot v2.0: > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Pipe > > You can then write your own script that does the forward-as-attachment > action. As I indicated earlier, I'm working on a more intricate plugin > for Dovecot v2.1. > > Regards, > > Stephan > many people would like to see "forward as attachment" in sieve but i guess there must be good tec reasons why it was not done since yet i thought about it as an advanced notify action ? that should be possible Merry X-Mas ! -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria From janfrode at tanso.net Sat Dec 24 17:20:50 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Sat, 24 Dec 2011 16:20:50 +0100 Subject: [Dovecot] Compressing existing maildirs Message-ID: <20111224152050.GA3958@dibs.tanso.net> I've just enabled zlib for our users, and am looking at how to compress the existing files. The routine for doing this at http://wiki2.dovecot.org/Plugins/Zlib seems a bit complicated. What do you think about simply doing: find /var/vmail -type f -name "*,S=*" -mtime +1 -exec gzip -S Z -6 '{}' + I.e. find all maildir-files: - with size in the name ("*,S=*") - modified before I enabled zlib plugin - compress them - add the Z suffix - keep timestamps (gzip does that by default) It's of course racy without the maildirlock, but are there any other problems with this approach ? -jf From achekalin at lazurit.com Sat Dec 24 18:26:49 2011 From: achekalin at lazurit.com (Alexander Chekalin) Date: Sat, 24 Dec 2011 19:26:49 +0300 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF5A9EC.8090606@hardwarefreak.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> Message-ID: <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> Stan, thank you for the reply, But I believe I obey this rule: I create "folder with ONLY folders inside", then in it another "folder with ONLY folders inside", and the into this second folder I create "folder with ONLY messages inside" (the path is "oldmail/lists/dovecot", and oldmail and lists are folders in filesystem, while dovecot is mbox container in filesystem). My problem is I can not understand which way should I create "folder with ONLY folders inside", and which way to create messages-only folder, going down to IMAP protocol commands. PHP for example looks like use only one command to create a mailbox, no difference what type of it I need. I understand PHP isn't the only script language to deal with IMAP, so I seek for advice how IMAP works with on protocol level. 24.12.2011, ? 13:31, Stan Hoeppner ???????(?): > On 12/23/2011 10:00 AM, Alexander Chekalin wrote: >> Hello, >> >> I'm now dealing with funny problem. I try to use Dovecot (2.1.rc1, >> actually) and mbox format to store old mailing, to keep logic of "one >> folder = one file". >> >> If I'd choose Maildir, I'd be able to create hierarchical folders (like >> "OldMail -> Maillists -> Dovecot"), and in fact on disk such a folders >> would be stored as real folders with dots in their names. In PHP it is >> easy to create with "imap_createmailbox()" function, I'd simple fire it >> 3 times (for "OldMail", for "OldMail.Maillists" and for >> "OldMail.Maillists.Dovecot"). >> >> But when I do the same with mbox, in fact it creates separate files >> (indeed, named "OldMail", "OldMail.Maillists" and >> "OldMail.Maillists.Dovecot") instead of creating filesystem folders >> ("OldMail/Maillists/Dovecot"). PHP is not guilty, Thunderbird won't >> create such folders as well. I can only create folders myself (say, with >> mkdir in the shell), chown it, and the it perfectly works in IMAP. >> >> Now I just wanted to know, are there any way to create IMAP-folders and >> subfolders using standard IMAP functionality? > > Yes. This has been common knowledge for many years, and is covered by > lots of documentation, including dovecot and tbird docs. With mbox > storage, an IMAP FOLDER contains only sub folders or it contains only > messages. It CANNOT contain BOTH. Thunderbird forces you to answer > this question each time you create a new IMAP FOLDER in the account root > tree. Surely you've seen the radio buttons in the new folder creation box. > > -- > Stan > From bradley.giesbrecht at gmail.com Sat Dec 24 19:01:14 2011 From: bradley.giesbrecht at gmail.com (Bradley Giesbrecht) Date: Sat, 24 Dec 2011 09:01:14 -0800 Subject: [Dovecot] sieve in sql or reporting In-Reply-To: <4EF556AF.8070007@rename-it.nl> References: <77B36D09-F823-4864-8D55-C2C90CD03C79@gmail.com> <4EF55470.5040708@rename-it.nl> <4EF556AF.8070007@rename-it.nl> Message-ID: <711A071F-17ED-42E5-A90C-B6B7BADD1DB5@gmail.com> On Dec 23, 2011, at 8:35 PM, Stephan Bosch wrote: > On 12/24/2011 5:26 AM, Stephan Bosch wrote: >> On 12/24/2011 3:28 AM, Bradley Giesbrecht wrote: >>> With dovecot2 and pigeonhole sieve/managesieve is it currently possible to store sieve rules in an sql database? >> Unfortunately, not yet. It is listed somewhere on the TODO list, but it does not have high priority so far. >> >>> If not is there a way to query all accounts; looking for things like active vacation rules? >> >> I'm working on an evolution of the sieve_pipe plugin called the sieve_extprograms plugin. One of the things it adds is a new action command called "execute", which may suit your needs. It will only be available for Dovecot v2.1 though. You can read the latest version of the specification here (example 4 should match your application): >> >> http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/raw-file/tip/doc/rfc/spec-bosch-sieve-extprograms.txt > > Oh btw, if you are looking for a way to disable vacation rules after some period of time, you can use the date extension (http://tools.ietf.org/html/rfc5260#section-4). For example: > > require ["date", "relational", "vacation"]; > > if currentdate :value "le" "date" "2011-12-09" { > vacation "I'm out of office this week. I'll be back on Saturday 10th to reply to your e-mails."; > } Stephan, thank you for both responses. My idea was to add sieve rules to a report so I could look up an email address and explain to the user why things happen. I can read in the users sieve scripts from the file system, or put them into sql myself for that matter. If a managesieve query command already existed I would use that. Regards, Bradley Geisbrecht From stan at hardwarefreak.com Sun Dec 25 02:50:44 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 24 Dec 2011 18:50:44 -0600 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> Message-ID: <4EF67364.6030003@hardwarefreak.com> On 12/24/2011 10:26 AM, Alexander Chekalin wrote: > Stan, thank you for the reply, > > But I believe I obey this rule: I create "folder with ONLY folders inside", then in it another "folder with ONLY folders inside", and the into this second folder I create "folder with ONLY messages inside" (the path is "oldmail/lists/dovecot", and oldmail and lists are folders in filesystem, while dovecot is mbox container in filesystem). > > My problem is I can not understand which way should I create "folder with ONLY folders inside", and which way to create messages-only folder, going down to IMAP protocol commands. PHP for example looks like use only one command to create a mailbox, no difference what type of it I need. > > I understand PHP isn't the only script language to deal with IMAP, so I seek for advice how IMAP works with on protocol level. Ah, ok. I didn't fully understand your issue. Maybe Timo, or someone else, knows the necessary imap folder creation command sequence for this. -- Stan From IcedEarthAngel at gmx.de Sun Dec 25 20:55:50 2011 From: IcedEarthAngel at gmx.de (IcedEarth) Date: Sun, 25 Dec 2011 10:55:50 -0800 (PST) Subject: [Dovecot] dovecot / postfix mail bounce problem In-Reply-To: <20111224055743.2be0a99b@scorpio> References: <33029725.post@talk.nabble.com> <20111224055743.2be0a99b@scorpio> Message-ID: <33036367.post@talk.nabble.com> Jerry-146 wrote: > > On Fri, 23 Dec 2011 08:02:25 -0800 (PST) > IcedEarth articulated: > >> >> Hello, >> >> i use a globalsieve rule to collect spam for all mail accounts in a >> specific mailbox. >> >> Here is the code: >> >> vi /var/vmail/globalsieverc >> >> require ["fileinto"]; >> # Move spam to junk folder >> if not address :is "to" "antispam at xxx.com" { >> if header :contains "X-Spam-Flag" ["YES"] { >> redirect "antispam at xxx.com"; >> stop; >> } >> } >> >> But the spam mails are not delivered. >> >> cat /var/log/mail.info >> >> postfix/pipe[32301]: AD8F78E2128D: to=, >> relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, >> status=bounced (mail forwarding loop for antispam at xxx.de) >> >> Why is there a loop? I don't unterstand that. > > This question really belongs on the Postfix forum. Please read the > directions for posting on that forum first. > > http://www.postfix.com/DEBUG_README.html > > Pay attention to the "Reporting problems to postfix-users at postfix.org" > section at the end of the article. > > > -- > Jerry ? > > Disclaimer: off-list followups get on-list replies or get ignored. > Please do not ignore the Reply-To header. > __________________________________________________________________ > Be frank and explicit with your lawyer ... it is his business to confuse > the issue afterwards. > > Hello Jerry, no this question not belongs on the Postfix forum. It was a dovecot issue. I've fixed it. I just created an empty file '.dovecot.sieve' in the 'antispam at xxx.com' Mailbox dir. This prevents dovecot to execute the globalsieve for the Mailbox 'antispam at xxx.com'. My script triggered a loop. New script: require ["fileinto"]; # Move spam to junk folder if header :contains "X-Spam-Flag" ["YES"] { redirect "antispam at xxx.com"; stop; } -- View this message in context: http://old.nabble.com/dovecot---postfix-mail-bounce-problem-tp33029725p33036367.html Sent from the Dovecot mailing list archive at Nabble.com. From arthur at psw.ro Sun Dec 25 22:08:42 2011 From: arthur at psw.ro (Arthur Titeica) Date: Sun, 25 Dec 2011 22:08:42 +0200 Subject: [Dovecot] dovecot / postfix mail bounce problem In-Reply-To: <33036367.post@talk.nabble.com> References: <33029725.post@talk.nabble.com> <20111224055743.2be0a99b@scorpio> <33036367.post@talk.nabble.com> Message-ID: <3c908c59f40c3171efad55ad3ca06cc1@psw.ro> On 25.12.2011 20:55, IcedEarth wrote: > Jerry-146 wrote: >> >> On Fri, 23 Dec 2011 08:02:25 -0800 (PST) >> IcedEarth articulated: >> >>> >>> Hello, >>> >>> i use a globalsieve rule to collect spam for all mail accounts in a >>> specific mailbox. >>> >>> Here is the code: >>> >>> vi /var/vmail/globalsieverc >>> >>> require ["fileinto"]; >>> # Move spam to junk folder >>> if not address :is "to" "antispam at xxx.com" { >>> if header :contains "X-Spam-Flag" ["YES"] { >>> redirect "antispam at xxx.com"; >>> stop; >>> } >>> } >>> >>> But the spam mails are not delivered. >>> >>> cat /var/log/mail.info >>> >>> postfix/pipe[32301]: AD8F78E2128D: to=, >>> relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, >>> status=bounced (mail forwarding loop for antispam at xxx.de) >>> >>> Why is there a loop? I don't unterstand that. >> >> This question really belongs on the Postfix forum. Please read the >> directions for posting on that forum first. >> >> http://www.postfix.com/DEBUG_README.html >> >> Pay attention to the "Reporting problems to >> postfix-users at postfix.org" >> section at the end of the article. >> >> > > Hello Jerry, > > no this question not belongs on the Postfix forum. > It was a dovecot issue. I've fixed it. > > I just created an empty file '.dovecot.sieve' in the > 'antispam at xxx.com' > Mailbox dir. This prevents dovecot to execute the globalsieve for the > Mailbox 'antispam at xxx.com'. > > My script triggered a loop. > > New script: > require ["fileinto"]; > # Move spam to junk folder > if header :contains "X-Spam-Flag" ["YES"] { > redirect "antispam at xxx.com"; > stop; > } Roundcube sieve plugin writes your original script as # rule:[test] if allof (not address :is "To" "antispam at xxx.com", header :contains "X-Spam-Flag" "YES") { redirect "antispam at xxx.com"; } -- Arthur Titeica From IcedEarthAngel at gmx.de Sun Dec 25 23:58:00 2011 From: IcedEarthAngel at gmx.de (IcedEarth) Date: Sun, 25 Dec 2011 13:58:00 -0800 (PST) Subject: [Dovecot] dovecot / postfix mail bounce problem In-Reply-To: <3c908c59f40c3171efad55ad3ca06cc1@psw.ro> References: <33029725.post@talk.nabble.com> <20111224055743.2be0a99b@scorpio> <33036367.post@talk.nabble.com> <3c908c59f40c3171efad55ad3ca06cc1@psw.ro> Message-ID: <33036676.post@talk.nabble.com> Hi Arthur, tested your script as globalsieve. Same result. Mail is bounced. Only option is to create a .global.sieve for antispam at ... Mailbox. Thanks. Iced Arthur Titeica-2 wrote: > > On 25.12.2011 20:55, IcedEarth wrote: >> Jerry-146 wrote: >>> >>> On Fri, 23 Dec 2011 08:02:25 -0800 (PST) >>> IcedEarth articulated: >>> >>>> >>>> Hello, >>>> >>>> i use a globalsieve rule to collect spam for all mail accounts in a >>>> specific mailbox. >>>> >>>> Here is the code: >>>> >>>> vi /var/vmail/globalsieverc >>>> >>>> require ["fileinto"]; >>>> # Move spam to junk folder >>>> if not address :is "to" "antispam at xxx.com" { >>>> if header :contains "X-Spam-Flag" ["YES"] { >>>> redirect "antispam at xxx.com"; >>>> stop; >>>> } >>>> } >>>> >>>> But the spam mails are not delivered. >>>> >>>> cat /var/log/mail.info >>>> >>>> postfix/pipe[32301]: AD8F78E2128D: to=, >>>> relay=dovecot, delay=0.14, delays=0.08/0/0/0.06, dsn=5.4.6, >>>> status=bounced (mail forwarding loop for antispam at xxx.de) >>>> >>>> Why is there a loop? I don't unterstand that. >>> >>> This question really belongs on the Postfix forum. Please read the >>> directions for posting on that forum first. >>> >>> http://www.postfix.com/DEBUG_README.html >>> >>> Pay attention to the "Reporting problems to >>> postfix-users at postfix.org" >>> section at the end of the article. >>> >>> >> >> Hello Jerry, >> >> no this question not belongs on the Postfix forum. >> It was a dovecot issue. I've fixed it. >> >> I just created an empty file '.dovecot.sieve' in the >> 'antispam at xxx.com' >> Mailbox dir. This prevents dovecot to execute the globalsieve for the >> Mailbox 'antispam at xxx.com'. >> >> My script triggered a loop. >> >> New script: >> require ["fileinto"]; >> # Move spam to junk folder >> if header :contains "X-Spam-Flag" ["YES"] { >> redirect "antispam at xxx.com"; >> stop; >> } > > Roundcube sieve plugin writes your original script as > > # rule:[test] > if allof (not address :is "To" "antispam at xxx.com", > header :contains "X-Spam-Flag" "YES") > { > redirect "antispam at xxx.com"; > } > > > -- > Arthur Titeica > > -- View this message in context: http://old.nabble.com/dovecot---postfix-mail-bounce-problem-tp33029725p33036676.html Sent from the Dovecot mailing list archive at Nabble.com. From achekalin at lazurit.com Mon Dec 26 08:43:49 2011 From: achekalin at lazurit.com (Alexander Chekalin) Date: Mon, 26 Dec 2011 09:43:49 +0300 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF67364.6030003@hardwarefreak.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> <4EF67364.6030003@hardwarefreak.com> Message-ID: <4EF817A5.3030101@lazurit.com> Hello Stan, thank you for your care, the answer was pretty simple, and yes you're right, I'd better read the docs before: I tried to create folder named like 'Old Mail' (and in fact I got another mbox container), while I needed to create 'Old Mail/' (note the slash), which results in real filesystem directory. Thanks for your time anyway! Yours, Alexander 25.12.2011 3:50, Stan Hoeppner ?????: > On 12/24/2011 10:26 AM, Alexander Chekalin wrote: >> Stan, thank you for the reply, >> >> But I believe I obey this rule: I create "folder with ONLY folders inside", then in it another "folder with ONLY folders inside", and the into this second folder I create "folder with ONLY messages inside" (the path is "oldmail/lists/dovecot", and oldmail and lists are folders in filesystem, while dovecot is mbox container in filesystem). >> >> My problem is I can not understand which way should I create "folder with ONLY folders inside", and which way to create messages-only folder, going down to IMAP protocol commands. PHP for example looks like use only one command to create a mailbox, no difference what type of it I need. >> >> I understand PHP isn't the only script language to deal with IMAP, so I seek for advice how IMAP works with on protocol level. > > Ah, ok. I didn't fully understand your issue. Maybe Timo, or someone > else, knows the necessary imap folder creation command sequence for this. > From pasek at valbek.cz Mon Dec 26 08:45:17 2011 From: pasek at valbek.cz (pasek at valbek.cz) Date: Mon, 26 Dec 2011 07:45:17 +0100 Subject: [Dovecot] =?utf-8?b?RG92b2xlbsOh?= Message-ID: <54bd608eb02c61ea80e76eb903d3ee5d-1324881917@mail.valbek.cz> Dobr? den, od 23.12. do 30.12. jsem na dovolen?. V p??pad? nutnosti volejte na mobil. S pozdravem Bc. Ladislav Pa?ek vedouc? odd?len? IT a vizualizace mobil: +420 776 140 489 e-mail: pasek at valbek.cz Valbek, s.r.o. Va?urova 505/17, 460 02 Liberec 3 tel./fax: +420 485 103 336, +420 485 103 346 www.valbek.cz From stan at hardwarefreak.com Mon Dec 26 09:48:32 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Mon, 26 Dec 2011 01:48:32 -0600 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF817A5.3030101@lazurit.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> <4EF67364.6030003@hardwarefreak.com> <4EF817A5.3030101@lazurit.com> Message-ID: <4EF826D0.3050005@hardwarefreak.com> On 12/26/2011 12:43 AM, Alexander Chekalin wrote: > Hello Stan, > > thank you for your care, the answer was pretty simple, and yes you're > right, I'd better read the docs before: > > I tried to create folder named like 'Old Mail' (and in fact I got > another mbox container), while I needed to create 'Old Mail/' (note the > slash), which results in real filesystem directory. Oh wow, that is simple. And makes perfect sense. Before my last reply I read the php IMAP command set definitions/parameters and I didn't see anything about how to do this, which is an odd omission in documentation. I guess so few people use mbox these days they omit that case from the docs. I hit three different sources and none of them mentioned the trailing slash for creating 'sub-folders-only' folders... > Thanks for your time anyway! You're welcome. Sorry I didn't get you the answer, but I'm glad you were able to figure it out on your own. -- Stan > 25.12.2011 3:50, Stan Hoeppner ?????: >> On 12/24/2011 10:26 AM, Alexander Chekalin wrote: >>> Stan, thank you for the reply, >>> >>> But I believe I obey this rule: I create "folder with ONLY folders >>> inside", then in it another "folder with ONLY folders inside", and >>> the into this second folder I create "folder with ONLY messages >>> inside" (the path is "oldmail/lists/dovecot", and oldmail and lists >>> are folders in filesystem, while dovecot is mbox container in >>> filesystem). >>> >>> My problem is I can not understand which way should I create "folder >>> with ONLY folders inside", and which way to create messages-only >>> folder, going down to IMAP protocol commands. PHP for example looks >>> like use only one command to create a mailbox, no difference what >>> type of it I need. >>> >>> I understand PHP isn't the only script language to deal with IMAP, so >>> I seek for advice how IMAP works with on protocol level. >> >> Ah, ok. I didn't fully understand your issue. Maybe Timo, or someone >> else, knows the necessary imap folder creation command sequence for this. From denis at fateyev.com Mon Dec 26 10:13:18 2011 From: denis at fateyev.com (Denis Fateyev) Date: Mon, 26 Dec 2011 14:13:18 +0600 Subject: [Dovecot] =?iso-8859-1?q?Dovolen=E1?= In-Reply-To: <54bd608eb02c61ea80e76eb903d3ee5d-1324881917@mail.valbek.cz> References: <54bd608eb02c61ea80e76eb903d3ee5d-1324881917@mail.valbek.cz> Message-ID: Hello all, On Mon, Dec 26, 2011 at 12:45 PM, wrote: > > V p??pad? nutnosti volejte na mobil. > > Indeed, it sounds like a call to action ;-) Merry Christmas to everyone! --- wbr, Denis. From jsxmoney at gmail.com Mon Dec 26 22:41:11 2011 From: jsxmoney at gmail.com (Jason X, Maney) Date: Mon, 26 Dec 2011 22:41:11 +0200 Subject: [Dovecot] managesieve vacation script bounces/frozen with a 550 error. Message-ID: Dear all, I have been trying to get this problem out of the way but I just cant seem to get it right. I hope someone can point me in the right direction here. I have come up with a vacation script as below, which can be send out from my Postfix SMTP server to my smarthost at the ISP, and yet for some reason it is not sent out at my ISP server. The guys at the ISP have sent me the full error they are getting on their Exim SMTP server. My dovecot version is: ========== dovecot --version 1.2.9 ========== ...and my managesieve configs are as follows: ========== dovecot -n |grep sieve protocols: pop3 pop3s imap imaps managesieve listen(managesieve): *:4190 login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(managesieve): mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve mail_plugins: sieve quota sieve: /var/vmail/sieve/%d/%u/sieve-script sieve_global_path: /var/vmail/sieve/default.sieve sieve_storage: /var/vmail/sieve/%d/%u ========== Error from my ISP smarthost: ========== +++ 1ReM7W-000Dm8-My has not completed +++ 2011-12-26 09:34:18 1ReM7W-000Dm8-My <= <> H=(myhostname.mydomain.com) [xxx.xxx.xxx.xxx] P=esmtps X=TLSv1:DHE-RSA-AES256-SHA:256 S=1451 id=dovecot-sieve-1324712058-257846-0 at havana T="Out of office reply" 2011-12-26 09:34:18 1ReM7W-000Dm8-My ** jsxmoney at gmail.comR=send_to_gateway T=remote_smtp: SMTP error from remote mail server after RCPT TO:: host smtp.myisp.com[yyy.yyy.yyy.yyy]: 550 Bounces must have only a single recipient 2011-12-26 09:34:18 1ReM7W-000Dm8-My Frozen (delivery error message ========== My vacation sieve script is: ========== ## /* empty script */ require ["fileinto", "vacation"]; vacation # Reply at most once a day to a same sender :days 1 :subject "Out of office reply" # List of additional recipient addresses which are included in the auto replying. # If a mail's recipient is not the envelope recipient and it's not on this list, # no vacation reply is sent for it. :addresses "me at mydomain.com" "I'm out of office, please contact Joan Doe instead. Best regards Me"; ========== What I am not sure of is, is this a problem I need to fix or is it something my ISP need to work on, on their Exim? If its something they can work on can you also give me pointers so I can work with them to fix it? Many thanx, JXM. From asai at globalchangemusic.org Tue Dec 27 17:46:13 2011 From: asai at globalchangemusic.org (Asai) Date: Tue, 27 Dec 2011 08:46:13 -0700 Subject: [Dovecot] Dsync Error Can't Delete Mailbox Message-ID: <4EF9E845.4030507@globalchangemusic.org> Greetings, I'm getting this error in the dsync logs: Warning: Destination mailbox INBOX has been modified, need to recreate it before we can continue syncing dsync(foo at bar.org): Error: Can't delete mailbox INBOX: INBOX can't be deleted. In this situation, what should I do to remedy the problem? Just delete the backup and rebuild? -- --asai From sottilette at rfx.it Wed Dec 28 00:58:37 2011 From: sottilette at rfx.it (sottilette at rfx.it) Date: Tue, 27 Dec 2011 23:58:37 +0100 (CET) Subject: [Dovecot] UIDL format Message-ID: How can be sure of the current POP3 UIDL? Below my current config (to be migrated to 2.0.x ASAP). Thanks, P. # dovecot -n # 1.0.2: /etc/dovecot.conf log_path: /var/log/mail/dovecot.log info_log_path: /var/log/mail/dovecot.info.log protocols: pop3 pop3s imap imaps listen: * login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login first_valid_uid: 100 mail_location: mbox:~/:INBOX=/var/mail/%u mail_full_filesystem_access: yes mbox_read_locks: dotlock fcntl mbox_write_locks: dotlock fcntl mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd From stephan at rename-it.nl Wed Dec 28 01:19:38 2011 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 28 Dec 2011 00:19:38 +0100 Subject: [Dovecot] managesieve vacation script bounces/frozen with a 550 error. In-Reply-To: References: Message-ID: <4EFA528A.2080400@rename-it.nl> On 12/26/2011 9:41 PM, Jason X, Maney wrote: > I have been trying to get this problem out of the way but I just cant > seem to get it right. I hope someone can point me in the right > direction here. I have come up with a vacation script as below, which > can be send out from my Postfix SMTP server to my smarthost at the > ISP, and yet for some reason it is not sent out at my ISP server. The > guys at the ISP have sent me the full error they are getting on their > Exim SMTP server. My dovecot version is: [...] > 550 Bounces must have only a single recipient [...] > What I am not sure of is, is this a problem I need to fix or is it > something my ISP need to work on, on their Exim? If its something > they can work on can you also give me pointers so I can work with > them to fix it? I googled for this error a bit, and it is probably produced by the following custom anti-backscatter Exim acl (various examples float around on the internet): deny senders = : condition = ${if ! eq{$recipients_count}{1}{1}} message = Bounces must have only a single recipient This rule only fires when the vacation message triggers multiple RCPT commands in the SMTP session with your SMTP. Sieve only replies to a single recipient, so apparently somewhere along the mail path additional recipients get added and it is likely that this happens at your smarthorst. Since this is likely an MTA problem and not a Sieve or Dovecot issue, I cannot help you much more. Regards, Stephan. From david at electric-spoon.com Wed Dec 28 12:26:44 2011 From: david at electric-spoon.com (David Pottage) Date: Wed, 28 Dec 2011 10:26:44 +0000 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. Message-ID: <4EFAEEE4.80405@electric-spoon.com> Hello I am currently running dovecot 1.2.15 on my home server. I have over 200 folders in personal email account, and I have found that my smart-phone does not work well trying to display that many folders. I solved the problem by creating a second instance of dovecot running on a non standard port, and configured it to serve only a subset my email folders, so that way the email client on my smartphone works well and I can read the emails I am interested in on the move. The process of configuring two instances of dovecot on the same machine serving different views of the same mailbox was faily complex, so I think it would be worth documenting the process in an FAQ or suchlike for other users. I thought a good place to write up my method would be in the HowTo section of the Dovecot Wiki. Is that a good idea? Can I request an account to edit the Wiki, or should I send a draft text to an editor? Are there any Dovecot experts here who can review my methods and suggest improvements? -- David Pottage From ruskie at codemages.net Wed Dec 28 12:39:49 2011 From: ruskie at codemages.net (=?UTF-8?Q?Andra=C5=BE_'ruskie'_Levstik?=) Date: Wed, 28 Dec 2011 11:39:49 +0100 (CET) Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFAEEE4.80405@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> Message-ID: :2011-12-28T10:26:David Pottage: > I am currently running dovecot 1.2.15 on my home server. I have over 200 > folders in personal email account, and I have found that my smart-phone > does not work well trying to display that many folders. > > I solved the problem by creating a second instance of dovecot running on > a non standard port, and configured it to serve only a subset my email > folders, so that way the email client on my smartphone works well and I > can read the emails I am interested in on the move. Here's a simple improvement. Create a new email user and symlink just those folders you want to see into it. That way you don't need 2 instances just two different users and you use one on mobile the other elsewhere ;) Using virtual folders could be helpful as well. I have a New mails one which shows me all new emails in all folders which helps in a lot of places. -- Andra? 'ruskie' Levstik Source Mage GNU/Linux Games/Xorg grimoire guru Re-Alpine Coordinator http://sourceforge.net/projects/re-alpine/ Geek/Hacker/Tinker Knowledge is important, knowledge you know is priceless. Share the knowledge, build a better future for everyone. From dovecot at asheesh.org Wed Dec 28 20:31:06 2011 From: dovecot at asheesh.org (Asheesh Laroia) Date: Wed, 28 Dec 2011 13:31:06 -0500 (EST) Subject: [Dovecot] /usr/lib/dovecot/imap ignores log settings? Message-ID: Hi Dovecot peeps, I'm enjoying running /usr/lib/dovecot/imap directly as a PREAUTH IMAP pipe. I find that it outputs log messages whose severity is INFO to stdout. I'm running it as follows: /usr/lib/dovecot/imap -c /tmp/dovecot.conf and I see the following messages output to stdout: * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in as paulproteus imap(paulproteus): Info: Connection closed bytes=0/305 Naturally, the first line is great. My /tmp/dovecot.conf is: # single-dbox mail_location = sdbox:~/Maildir/dbox log_path = syslog info_log_path = /dev/null I'm also attaching strace output, created by running this command: echo | strace /usr/lib/dovecot/imap -c /tmp/dovecot.conf > /tmp/straced 2>&1 (The point of the "echo | " is to provide a newline and then EOF to /usr/lib/dovecot/imap.) You can see in the strace output that /usr/lib/dovecot/imap outputs the "Connection closed" message to file descriptor 2. I'd like that message to actually not be printed, which is why I set log_path to syslog. -- Asheesh. -------------- next part -------------- execve("/usr/lib/dovecot/imap", ["/usr/lib/dovecot/imap", "-c", "/tmp/dovecot.conf"], [/* 31 vars */]) = 0 brk(0) = 0x1eb8000 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee31000 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/x86_64/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls/x86_64", 0x7fff1a7c24f0) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls", 0x7fff1a7c24f0) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/x86_64/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/x86_64", 0x7fff1a7c24f0) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/libdovecot-storage.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\313\2\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=898088, ...}) = 0 mmap(NULL, 2993560, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03e939000 mprotect(0x7ff03ea0d000, 2093056, PROT_NONE) = 0 mmap(0x7ff03ec0c000, 32768, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xd3000) = 0x7ff03ec0c000 close(3) = 0 open("/usr/lib/dovecot/libdovecot.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200\217\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=533816, ...}) = 0 mmap(NULL, 2639392, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03e6b4000 mprotect(0x7ff03e734000, 2093056, PROT_NONE) = 0 mmap(0x7ff03e933000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7f000) = 0x7ff03e933000 mmap(0x7ff03e936000, 9760, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7ff03e936000 close(3) = 0 open("/usr/lib/dovecot/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory) open("/etc/ld.so.cache", O_RDONLY) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=127929, ...}) = 0 mmap(NULL, 127929, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7ff03ee11000 close(3) = 0 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\r\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=14768, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee10000 mmap(NULL, 2109696, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03e4b0000 mprotect(0x7ff03e4b2000, 2097152, PROT_NONE) = 0 mmap(0x7ff03e6b2000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7ff03e6b2000 close(3) = 0 open("/usr/lib/dovecot/librt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\220!\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=31744, ...}) = 0 mmap(NULL, 2128856, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03e2a8000 mprotect(0x7ff03e2af000, 2093056, PROT_NONE) = 0 mmap(0x7ff03e4ae000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7ff03e4ae000 close(3) = 0 open("/usr/lib/dovecot/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\300\357\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=1570832, ...}) = 0 mmap(NULL, 3684440, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03df24000 mprotect(0x7ff03e09e000, 2097152, PROT_NONE) = 0 mmap(0x7ff03e29e000, 20480, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x17a000) = 0x7ff03e29e000 mmap(0x7ff03e2a3000, 18520, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7ff03e2a3000 close(3) = 0 open("/usr/lib/dovecot/libpthread.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libpthread.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@\\\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=131107, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee0f000 mmap(NULL, 2208672, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff03dd08000 mprotect(0x7ff03dd1f000, 2093056, PROT_NONE) = 0 mmap(0x7ff03df1e000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16000) = 0x7ff03df1e000 mmap(0x7ff03df20000, 13216, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7ff03df20000 close(3) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee0e000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee0d000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff03ee0c000 arch_prctl(ARCH_SET_FS, 0x7ff03ee0d700) = 0 mprotect(0x7ff03df1e000, 4096, PROT_READ) = 0 mprotect(0x7ff03e29e000, 16384, PROT_READ) = 0 mprotect(0x7ff03e4ae000, 4096, PROT_READ) = 0 mprotect(0x7ff03e6b2000, 4096, PROT_READ) = 0 mprotect(0x7ff03ee33000, 4096, PROT_READ) = 0 munmap(0x7ff03ee11000, 127929) = 0 set_tid_address(0x7ff03ee0d9d0) = 24515 set_robust_list(0x7ff03ee0d9e0, 0x18) = 0 futex(0x7fff1a7c2ddc, FUTEX_WAIT_BITSET_PRIVATE|FUTEX_CLOCK_REALTIME, 1, NULL, 7ff03ee0d700) = -1 EAGAIN (Resource temporarily unavailable) rt_sigaction(SIGRTMIN, {0x7ff03dd0dad0, [], SA_RESTORER|SA_SIGINFO, 0x7ff03dd17030}, NULL, 8) = 0 rt_sigaction(SIGRT_1, {0x7ff03dd0db60, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x7ff03dd17030}, NULL, 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0 getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM_INFINITY}) = 0 getuid() = 1000 brk(0) = 0x1eb8000 brk(0x1ee1000) = 0x1ee1000 uname({sys="Linux", node="pathi", ...}) = 0 rt_sigaction(SIGPIPE, {SIG_IGN, [], SA_RESTORER|SA_RESTART, 0x7ff03df56480}, NULL, 8) = 0 rt_sigaction(SIGALRM, {0x7ff03e7000d0, [], SA_RESTORER|SA_SIGINFO, 0x7ff03df56480}, NULL, 8) = 0 rt_sigaction(SIGINT, {0x7ff03e700160, [], SA_RESTORER|SA_SIGINFO, 0x7ff03df56480}, NULL, 8) = 0 pipe([3, 4]) = 0 fcntl(3, F_GETFL) = 0 (flags O_RDONLY) fcntl(3, F_SETFL, O_RDONLY|O_NONBLOCK) = 0 fcntl(4, F_GETFL) = 0x1 (flags O_WRONLY) fcntl(4, F_SETFL, O_WRONLY|O_NONBLOCK) = 0 fcntl(3, F_GETFD) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 fcntl(4, F_GETFD) = 0 fcntl(4, F_SETFD, FD_CLOEXEC) = 0 epoll_create(128) = 5 fcntl(5, F_GETFD) = 0 fcntl(5, F_SETFD, FD_CLOEXEC) = 0 epoll_ctl(5, EPOLL_CTL_ADD, 3, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=32249584, u64=32249584}}) = 0 rt_sigaction(SIGTERM, {0x7ff03e700160, [], SA_RESTORER|SA_SIGINFO, 0x7ff03df56480}, NULL, 8) = 0 umask(077) = 022 stat("/tmp/dovecot.conf", {st_mode=S_IFREG|0644, st_size=98, ...}) = 0 stat("/tmp/dovecot.conf", {st_mode=S_IFREG|0644, st_size=98, ...}) = 0 execve("/usr/bin/doveconf", ["/usr/bin/doveconf", "-f", "service=imap", "-c", "/tmp/dovecot.conf", "-m", "imap", "-e", "/usr/lib/dovecot/imap", "-c", "/tmp/dovecot.conf"], [/* 2 vars */]) = 0 brk(0) = 0xc98000 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559d8000 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/x86_64/libdovecot.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls/x86_64", 0x7fff99f31d70) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/libdovecot.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls", 0x7fff99f31d70) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/x86_64/libdovecot.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/x86_64", 0x7fff99f31d70) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/libdovecot.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200\217\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=533816, ...}) = 0 mmap(NULL, 2639392, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d55536000 mprotect(0x7f1d555b6000, 2093056, PROT_NONE) = 0 mmap(0x7f1d557b5000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7f000) = 0x7f1d557b5000 mmap(0x7f1d557b8000, 9760, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f1d557b8000 close(3) = 0 open("/usr/lib/dovecot/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory) open("/etc/ld.so.cache", O_RDONLY) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=127929, ...}) = 0 mmap(NULL, 127929, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f1d559b8000 close(3) = 0 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\r\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=14768, ...}) = 0 mmap(NULL, 2109696, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d55332000 mprotect(0x7f1d55334000, 2097152, PROT_NONE) = 0 mmap(0x7f1d55534000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f1d55534000 close(3) = 0 open("/usr/lib/dovecot/librt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\220!\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=31744, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559b7000 mmap(NULL, 2128856, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d5512a000 mprotect(0x7f1d55131000, 2093056, PROT_NONE) = 0 mmap(0x7f1d55330000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f1d55330000 close(3) = 0 open("/usr/lib/dovecot/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\300\357\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=1570832, ...}) = 0 mmap(NULL, 3684440, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d54da6000 mprotect(0x7f1d54f20000, 2097152, PROT_NONE) = 0 mmap(0x7f1d55120000, 20480, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x17a000) = 0x7f1d55120000 mmap(0x7f1d55125000, 18520, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f1d55125000 close(3) = 0 open("/usr/lib/dovecot/libpthread.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libpthread.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@\\\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=131107, ...}) = 0 mmap(NULL, 2208672, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f1d54b8a000 mprotect(0x7f1d54ba1000, 2093056, PROT_NONE) = 0 mmap(0x7f1d54da0000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16000) = 0x7f1d54da0000 mmap(0x7f1d54da2000, 13216, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f1d54da2000 close(3) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559b6000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559b5000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d559b4000 arch_prctl(ARCH_SET_FS, 0x7f1d559b5700) = 0 mprotect(0x7f1d54da0000, 4096, PROT_READ) = 0 mprotect(0x7f1d55120000, 16384, PROT_READ) = 0 mprotect(0x7f1d55330000, 4096, PROT_READ) = 0 mprotect(0x7f1d55534000, 4096, PROT_READ) = 0 mprotect(0x7f1d559da000, 4096, PROT_READ) = 0 munmap(0x7f1d559b8000, 127929) = 0 set_tid_address(0x7f1d559b59d0) = 24515 set_robust_list(0x7f1d559b59e0, 0x18) = 0 futex(0x7fff99f3265c, FUTEX_WAIT_BITSET_PRIVATE|FUTEX_CLOCK_REALTIME, 1, NULL, 7f1d559b5700) = -1 EAGAIN (Resource temporarily unavailable) rt_sigaction(SIGRTMIN, {0x7f1d54b8fad0, [], SA_RESTORER|SA_SIGINFO, 0x7f1d54b99030}, NULL, 8) = 0 rt_sigaction(SIGRT_1, {0x7f1d54b8fb60, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x7f1d54b99030}, NULL, 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0 getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM_INFINITY}) = 0 brk(0) = 0xc98000 brk(0xcc1000) = 0xcc1000 uname({sys="Linux", node="pathi", ...}) = 0 rt_sigaction(SIGPIPE, {SIG_IGN, [], SA_RESTORER|SA_RESTART, 0x7f1d54dd8480}, NULL, 8) = 0 rt_sigaction(SIGALRM, {0x7f1d555820d0, [], SA_RESTORER|SA_SIGINFO, 0x7f1d54dd8480}, NULL, 8) = 0 rt_sigaction(SIGINT, {0x7f1d55582160, [], SA_RESTORER|SA_SIGINFO, 0x7f1d54dd8480}, NULL, 8) = 0 pipe([3, 4]) = 0 fcntl(3, F_GETFL) = 0 (flags O_RDONLY) fcntl(3, F_SETFL, O_RDONLY|O_NONBLOCK) = 0 fcntl(4, F_GETFL) = 0x1 (flags O_WRONLY) fcntl(4, F_SETFL, O_WRONLY|O_NONBLOCK) = 0 fcntl(3, F_GETFD) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 fcntl(4, F_GETFD) = 0 fcntl(4, F_SETFD, FD_CLOEXEC) = 0 epoll_create(128) = 5 fcntl(5, F_GETFD) = 0 fcntl(5, F_SETFD, FD_CLOEXEC) = 0 epoll_ctl(5, EPOLL_CTL_ADD, 3, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=13243088, u64=13243088}}) = 0 rt_sigaction(SIGTERM, {0x7f1d55582160, [], SA_RESTORER|SA_SIGINFO, 0x7f1d54dd8480}, NULL, 8) = 0 open("/usr/lib/dovecot/modules/settings", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 6 getdents(6, /* 2 entries */, 32768) = 48 getdents(6, /* 0 entries */, 32768) = 0 close(6) = 0 open("/tmp/dovecot.conf", O_RDONLY) = 6 mmap(NULL, 266240, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f1d55973000 brk(0xce3000) = 0xce3000 brk(0xd04000) = 0xd04000 fstat(6, {st_mode=S_IFREG|0644, st_size=98, ...}) = 0 pread(6, "# single-dbox\nmail_location = sd"..., 8192, 0) = 98 pread(6, "", 8094, 98) = 0 close(6) = 0 brk(0xd2d000) = 0xd2d000 brk(0xd4f000) = 0xd4f000 brk(0xd1d000) = 0xd1d000 brk(0xd3f000) = 0xd3f000 brk(0xd61000) = 0xd61000 brk(0xd30000) = 0xd30000 execve("/usr/lib/dovecot/imap", ["/usr/lib/dovecot/imap", "-c", "/tmp/dovecot.conf"], [/* 6 vars */]) = 0 brk(0) = 0x1636000 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc3711a6000 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/x86_64/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls/x86_64", 0x7ffff10a0850) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/tls/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/tls", 0x7ffff10a0850) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/x86_64/libdovecot-storage.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) stat("/usr/lib/dovecot/x86_64", 0x7ffff10a0850) = -1 ENOENT (No such file or directory) open("/usr/lib/dovecot/libdovecot-storage.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\313\2\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=898088, ...}) = 0 mmap(NULL, 2993560, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc370cae000 mprotect(0x7fc370d82000, 2093056, PROT_NONE) = 0 mmap(0x7fc370f81000, 32768, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xd3000) = 0x7fc370f81000 close(3) = 0 open("/usr/lib/dovecot/libdovecot.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200\217\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=533816, ...}) = 0 mmap(NULL, 2639392, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc370a29000 mprotect(0x7fc370aa9000, 2093056, PROT_NONE) = 0 mmap(0x7fc370ca8000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7f000) = 0x7fc370ca8000 mmap(0x7fc370cab000, 9760, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7fc370cab000 close(3) = 0 open("/usr/lib/dovecot/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory) open("/etc/ld.so.cache", O_RDONLY) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=127929, ...}) = 0 mmap(NULL, 127929, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7fc371186000 close(3) = 0 access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\r\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=14768, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371185000 mmap(NULL, 2109696, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc370825000 mprotect(0x7fc370827000, 2097152, PROT_NONE) = 0 mmap(0x7fc370a27000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7fc370a27000 close(3) = 0 open("/usr/lib/dovecot/librt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\220!\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0644, st_size=31744, ...}) = 0 mmap(NULL, 2128856, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc37061d000 mprotect(0x7fc370624000, 2093056, PROT_NONE) = 0 mmap(0x7fc370823000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7fc370823000 close(3) = 0 open("/usr/lib/dovecot/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\300\357\1\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=1570832, ...}) = 0 mmap(NULL, 3684440, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc370299000 mprotect(0x7fc370413000, 2097152, PROT_NONE) = 0 mmap(0x7fc370613000, 20480, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x17a000) = 0x7fc370613000 mmap(0x7fc370618000, 18520, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7fc370618000 close(3) = 0 open("/usr/lib/dovecot/libpthread.so.0", O_RDONLY) = -1 ENOENT (No such file or directory) access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or directory) open("/lib/x86_64-linux-gnu/libpthread.so.0", O_RDONLY) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@\\\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=131107, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371184000 mmap(NULL, 2208672, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fc37007d000 mprotect(0x7fc370094000, 2093056, PROT_NONE) = 0 mmap(0x7fc370293000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16000) = 0x7fc370293000 mmap(0x7fc370295000, 13216, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7fc370295000 close(3) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371183000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371182000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc371181000 arch_prctl(ARCH_SET_FS, 0x7fc371182700) = 0 mprotect(0x7fc370293000, 4096, PROT_READ) = 0 mprotect(0x7fc370613000, 16384, PROT_READ) = 0 mprotect(0x7fc370823000, 4096, PROT_READ) = 0 mprotect(0x7fc370a27000, 4096, PROT_READ) = 0 mprotect(0x7fc3711a8000, 4096, PROT_READ) = 0 munmap(0x7fc371186000, 127929) = 0 set_tid_address(0x7fc3711829d0) = 24515 set_robust_list(0x7fc3711829e0, 0x18) = 0 futex(0x7ffff10a113c, FUTEX_WAIT_BITSET_PRIVATE|FUTEX_CLOCK_REALTIME, 1, NULL, 7fc371182700) = -1 EAGAIN (Resource temporarily unavailable) rt_sigaction(SIGRTMIN, {0x7fc370082ad0, [], SA_RESTORER|SA_SIGINFO, 0x7fc37008c030}, NULL, 8) = 0 rt_sigaction(SIGRT_1, {0x7fc370082b60, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x7fc37008c030}, NULL, 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0 getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM_INFINITY}) = 0 getuid() = 1000 brk(0) = 0x1636000 brk(0x165f000) = 0x165f000 uname({sys="Linux", node="pathi", ...}) = 0 rt_sigaction(SIGPIPE, {SIG_IGN, [], SA_RESTORER|SA_RESTART, 0x7fc3702cb480}, NULL, 8) = 0 rt_sigaction(SIGALRM, {0x7fc370a750d0, [], SA_RESTORER|SA_SIGINFO, 0x7fc3702cb480}, NULL, 8) = 0 rt_sigaction(SIGINT, {0x7fc370a75160, [], SA_RESTORER|SA_SIGINFO, 0x7fc3702cb480}, NULL, 8) = 0 pipe([3, 4]) = 0 fcntl(3, F_GETFL) = 0 (flags O_RDONLY) fcntl(3, F_SETFL, O_RDONLY|O_NONBLOCK) = 0 fcntl(4, F_GETFL) = 0x1 (flags O_WRONLY) fcntl(4, F_SETFL, O_WRONLY|O_NONBLOCK) = 0 fcntl(3, F_GETFD) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 fcntl(4, F_GETFD) = 0 fcntl(4, F_SETFD, FD_CLOEXEC) = 0 epoll_create(128) = 5 fcntl(5, F_GETFD) = 0 fcntl(5, F_SETFD, FD_CLOEXEC) = 0 epoll_ctl(5, EPOLL_CTL_ADD, 3, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=23327440, u64=23327440}}) = 0 rt_sigaction(SIGTERM, {0x7fc370a75160, [], SA_RESTORER|SA_SIGINFO, 0x7fc3702cb480}, NULL, 8) = 0 umask(077) = 077 geteuid() = 1000 geteuid() = 1000 geteuid() = 1000 geteuid() = 1000 getegid() = 1000 getgid() = 1000 getegid() = 1000 setgid(0) = -1 EPERM (Operation not permitted) prctl(PR_SET_DUMPABLE, 1) = 0 geteuid() = 1000 chdir("/home/paulproteus") = 0 stat("/home/paulproteus/Maildir/dbox/mailboxes", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 prctl(PR_SET_DUMPABLE, 1) = 0 fcntl(0, F_GETFL) = 0 (flags O_RDONLY) fcntl(0, F_SETFL, O_RDONLY|O_NONBLOCK) = 0 fcntl(1, F_GETFL) = 0x8001 (flags O_WRONLY|O_LARGEFILE) fcntl(1, F_SETFL, O_WRONLY|O_NONBLOCK|O_LARGEFILE) = 0 fstat(0, {st_mode=S_IFIFO|0600, st_size=0, ...}) = 0 lseek(1, 0, SEEK_CUR) = 25034 fstat(1, {st_mode=S_IFREG|0644, st_size=25071, ...}) = 0 epoll_ctl(5, EPOLL_CTL_ADD, 0, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=23409968, u64=23409968}}) = 0 write(1, "* PREAUTH [CAPABILITY IMAP4rev1 "..., 305* PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in as paulproteus ) = 305 epoll_wait(5, {{EPOLLIN|EPOLLHUP, {u32=23409968, u64=23409968}}}, 2, 1800000) = 1 brk(0x1681000) = 0x1681000 read(0, "\n", 8192) = 1 write(1, "* BAD Error in IMAP command : Un"..., 48* BAD Error in IMAP command : Unknown command. ) = 48 epoll_wait(5, {{EPOLLHUP, {u32=23409968, u64=23409968}}}, 2, 1800000) = 1 read(0, "", 8191) = 0 write(2, "imap(paulproteus): Info: Connect"..., 57imap(paulproteus): Info: Connection closed bytes=1/25387 ) = 57 epoll_ctl(5, EPOLL_CTL_DEL, 0, {0, {u32=23409968, u64=23409968}}) = 0 brk(0x167f000) = 0x167f000 brk(0x167d000) = 0x167d000 close(0) = 0 close(1) = 0 brk(0x1678000) = 0x1678000 brk(0x1677000) = 0x1677000 brk(0x1675000) = 0x1675000 brk(0x1674000) = 0x1674000 epoll_ctl(5, EPOLL_CTL_DEL, 3, {0, {u32=23327440, u64=23327440}}) = 0 close(3) = 0 close(4) = 0 close(5) = 0 exit_group(0) = ? From david at electric-spoon.com Thu Dec 29 00:05:03 2011 From: david at electric-spoon.com (David Pottage) Date: Wed, 28 Dec 2011 22:05:03 +0000 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: References: <4EFAEEE4.80405@electric-spoon.com> Message-ID: <4EFB928F.2010601@electric-spoon.com> On 28/12/11 10:39, Andra? 'ruskie' Levstik wrote: > :2011-12-28T10:26:David Pottage: > >> I solved the problem by creating a second instance of dovecot running on >> a non standard port, and configured it to serve only a subset my email >> folders, so that way the email client on my smartphone works well and I >> can read the emails I am interested in on the move. > Here's a simple improvement. > Create a new email user and symlink just those folders you want to see > into it. I considered that option but decided against it for two reasons. Firstly I wanted to retain the option to switch to the full version of my mail folders if I needed to access something urgently. My smart-phone based email client allows me to change the port number of an existing email account, but will not allow me to change the user-name without creating a whole new account and re-downloading everything. Secondly creating a second account makes the authentication on the server a lot more complex. Either I need two OS level accounts on the sever, and find ways to keep them in sync, or I need to create a custom authentication method on dovecot or PAM so that when it receives a user-name matching some pattern, it will check the password against a different account. In short, I think a second server with a separate configuration is more scalable. I don't think it consumes much more resource compared with one server. > Using virtual folders could be helpful as well. I have a New mails one > which shows me all new emails in all folders which helps in a lot of > places. Could you provide a link to documentation about virtual folders. -- David Pottage From stan at hardwarefreak.com Thu Dec 29 00:12:08 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Wed, 28 Dec 2011 16:12:08 -0600 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFB928F.2010601@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> Message-ID: <4EFB9438.7090608@hardwarefreak.com> On 12/28/2011 4:05 PM, David Pottage wrote: > Firstly I wanted to retain the option to switch to the full version of > my mail folders if I needed to access something urgently. My smart-phone > based email client allows me to change the port number of an existing > email account, but will not allow me to change the user-name without > creating a whole new account and re-downloading everything. > > Secondly creating a second account makes the authentication on the > server a lot more complex. Either I need two OS level accounts on the > sever, and find ways to keep them in sync, or I need to create a custom > authentication method on dovecot or PAM so that when it receives a > user-name matching some pattern, it will check the password against a > different account. > > In short, I think a second server with a separate configuration is more > scalable. I don't think it consumes much more resource compared with one > server. It's a smart phone. Have you considering simply running a webmail server? -- Stan From rick at havokmon.com Thu Dec 29 00:21:49 2011 From: rick at havokmon.com (Rick Romero) Date: Wed, 28 Dec 2011 16:21:49 -0600 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFB928F.2010601@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> Message-ID: <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> Quoting David Pottage : > On 28/12/11 10:39, Andra? 'ruskie' Levstik wrote: >> :2011-12-28T10:26:David Pottage: >> >>> I solved the problem by creating a second instance of dovecot running on >>> a non standard port, and configured it to serve only a subset my email >>> folders, so that way the email client on my smartphone works well and I >>> can read the emails I am interested in on the move. >> Here's a simple improvement. >> Create a new email user and symlink just those folders you want to see >> into it. > I considered that option but decided against it for two reasons. > > Firstly I wanted to retain the option to switch to the full version of > my mail folders if I needed to access something urgently. My smart-phone > based email client allows me to change the port number of an existing > email account, but will not allow me to change the user-name without > creating a whole new account and re-downloading everything. I read back through the thread, and I don't see why you're not using IMAP subscriptions - did I overlook it? Rick From ghandidrivesahumvee at rocketfish.com Thu Dec 29 01:56:33 2011 From: ghandidrivesahumvee at rocketfish.com (Dovecot-GDH) Date: Wed, 28 Dec 2011 15:56:33 -0800 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111224152050.GA3958@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> Message-ID: The cleanest (though not necessarily simplest) way to go about this would be to use dsync to create a new maildir and incrementally direct traffic to a separate Dovecot instance. Unless you have a legacy application that relies on maildir, switching to mdbox would be a good idea too. I expect that with Dovecot compression is something that can "just be turned on", but for fear of any possible issue, I chose to migrate mailboxes in batches with the way mentioned above. On Dec 24, 2011, at 7:20 AM, Jan-Frode Myklebust wrote: > I've just enabled zlib for our users, and am looking at how to compress > the existing files. The routine for doing this at > http://wiki2.dovecot.org/Plugins/Zlib seems a bit complicated. What do > you think about simply doing: > > find /var/vmail -type f -name "*,S=*" -mtime +1 -exec gzip -S Z -6 '{}' + > > > I.e. find all maildir-files: > > - with size in the name ("*,S=*") > - modified before I enabled zlib plugin > - compress them > - add the Z suffix > - keep timestamps (gzip does that by default) > > > It's of course racy without the maildirlock, but are there any other > problems with this approach ? > > > -jf From zdy0818 at gmail.com Thu Dec 29 06:06:45 2011 From: zdy0818 at gmail.com (Dongyu.Zhen) Date: Thu, 29 Dec 2011 12:06:45 +0800 Subject: [Dovecot] imap be killed (core dump disabled) Message-ID: <4EFBE755.7090509@gmail.com> Hello everybody, When I modify the dovecot imap source ,in "src/imap/" dir, I meet the Error below: Error: child (imap) kill (core dump disabled). In fact, I want to record the imap operation through dovecot. So, I modify every source file in "src/imap/cmd-IMAP_OPERATION" ,when the imap command function is executed, it will write to a file cur time and operation. Could you tell me why the imap be killed? Thank you. From janfrode at tanso.net Thu Dec 29 10:49:16 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 09:49:16 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: References: <20111224152050.GA3958@dibs.tanso.net> Message-ID: <20111229084916.GA5895@dibs.tanso.net> On Wed, Dec 28, 2011 at 03:56:33PM -0800, Dovecot-GDH wrote: > The cleanest (though not necessarily simplest) way to go about this would be to use dsync to create a new maildir and incrementally direct traffic to a separate Dovecot instance. > > Unless you have a legacy application that relies on maildir, switching to mdbox would be a good idea too. We just got rid of the legacy app that worked directly against the maildirs, which is the reason we now can turn on compression. I intend to switch to mdbox, but first I need to free up some disks by compressing the existing maildirs (12 TB maildirs, should probably compress down to less than half). > > I expect that with Dovecot compression is something that can "just be turned on", but for fear of any possible issue, I chose to migrate mailboxes in batches with the way mentioned above. > Migrating to mdbox is much scarier to me than an easily reversible compression of existing maildir files. Could you please give a bit more details about how you did this migration? Did you change user home dirctory in the process? Seeing the scripts you used to run the migration would be very interesting.. -jf From janfrode at tanso.net Thu Dec 29 13:14:55 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 12:14:55 +0100 Subject: [Dovecot] dsync / separator / namespace config-problem Message-ID: <20111229111455.GA9344@dibs.tanso.net> Guess I don't quite get namespaces, but we have the following namespace configured: $ doveconf namespace namespace { hidden = no inbox = yes list = yes location = prefix = INBOX. separator = subscriptions = yes type = private } But when I try running dsync it complains: $ sudo -u atmail dsync -u janfrode at tanso.net mirror mdbox:/tmp/janfrodeboks dsync(atmail): Error: user janfrode at tanso.net: Initialization failed: namespace configuration error: list=yes requires prefix=INBOX. to end with separator dsync(atmail): Fatal: User init failed I can fix this by adding "separator = ." to the namespace and dsync is happy, but is changing this now safe, or will this affect existing clients? -jf From CMarcus at Media-Brokers.com Thu Dec 29 14:07:30 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 29 Dec 2011 07:07:30 -0500 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFB928F.2010601@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> Message-ID: <4EFC5802.8090609@Media-Brokers.com> On 2011-12-28 5:05 PM, David Pottage wrote: > Secondly creating a second account makes the authentication on the > server a lot more complex. Either I need two OS level accounts on > the sever, and find ways to keep them in sync, or I need to create a > custom authentication method on dovecot or PAM so that when it > receives a user-name matching some pattern, it will check the > password against a different account. It would be cool if the concept of 'Master User' could be expanded on to provide access to only certain other accounts, as opposed to full domains (or maybe it does alreaqdy and I just don't understand it well enough yet). For example, we have Sales Assistants in our offices, where each assistant may assist up to 3 or 4 different Sales reps. It would be nice to be able to give the Assistant read-only access to the Sales Reps emails without having to set up shared folders for each one... -- Best regards, Charles From CMarcus at Media-Brokers.com Thu Dec 29 14:10:56 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 29 Dec 2011 07:10:56 -0500 Subject: [Dovecot] imap be killed (core dump disabled) In-Reply-To: <4EFBE755.7090509@gmail.com> References: <4EFBE755.7090509@gmail.com> Message-ID: <4EFC58D0.4030300@Media-Brokers.com> On 2011-12-28 11:06 PM, Dongyu.Zhen wrote: > Hello everybody, > When I modify the dovecot imap source ,in "src/imap/" dir, I meet the > Error below: > Error: child (imap) kill (core dump disabled). > > In fact, I want to record the imap operation through dovecot. So, I > modify every source file in "src/imap/cmd-IMAP_OPERATION" ,when the imap > command function is executed, it will write to a file cur time and > operation. Ummm... maybe what you want is already there? http://wiki2.dovecot.org/Plugins/MailLog > Could you tell me why the imap be killed? You modified the source, didn't bother to provide specific details as to what modifications you did, and expect someone to be able to answer that? I don't think even Timo is that good... ;) -- Best regards, Charles From tss at iki.fi Thu Dec 29 14:27:28 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 14:27:28 +0200 Subject: [Dovecot] imap be killed (core dump disabled) In-Reply-To: <4EFBE755.7090509@gmail.com> References: <4EFBE755.7090509@gmail.com> Message-ID: <6BE91CBE-F3EB-4389-A3BC-85CE1F410EDD@iki.fi> On 29.12.2011, at 6.06, Dongyu.Zhen wrote: > Hello everybody, > When I modify the dovecot imap source ,in "src/imap/" dir, I meet the > Error below: > Error: child (imap) kill (core dump disabled). Most likely due to your modification, but gdb backtraces are helpful when debugging crashes: http://dovecot.org/bugreport.html From tss at iki.fi Thu Dec 29 14:35:15 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 14:35:15 +0200 Subject: [Dovecot] doveadm + dsync merging Message-ID: doveadm already supports some nice things, such as being able to remotely launch a doveadm command via TCP socket. It also supports executing a command for all users or to some specific users using a wildcard. dsync could use these features, so I merged dsync and doveadm into same binary for v2.1. I'll still install "dsync" symlink pointing to "doveadm", and running that way it should be fully backwards compatible with the old dsync binary and its parameters. I'm mainly now wondering about the command naming for running dsync via doveadm. Any suggestions? a) Use "doveadm dsync" prefix, and otherwise keep the names same: dsync mirror -> doveadm dsync mirror dsync backup -> doveadm dsync backup dsync server -> doveadm dsync server (for running dsync remotely via ssh/etc.) b) Don't have the dsync prefix: dsync mirror -> doveadm mirror dsync backup -> doveadm backup dsync server -> doveadm dsync-server (could be hidden from the doveadm commands list) c) Either a) or b), but rename "mirror" to "sync" or "dsync" or "replicate"? d) Something else? From japc at co.sapo.pt Thu Dec 29 14:39:11 2011 From: japc at co.sapo.pt (=?ISO-8859-1?Q?Jos=E9?= Celestino) Date: Thu, 29 Dec 2011 12:39:11 +0000 Subject: [Dovecot] imap be killed (core dump disabled) In-Reply-To: <4EFBE755.7090509@gmail.com> References: <4EFBE755.7090509@gmail.com> Message-ID: <1325162351.7270.17.camel@morgoth> On Qui, 2011-12-29 at 12:06 +0800, Dongyu.Zhen wrote: > Hello everybody, > When I modify the dovecot imap source ,in "src/imap/" dir, I meet the > Error below: > Error: child (imap) kill (core dump disabled). > > In fact, I want to record the imap operation through dovecot. So, I > modify every source file in "src/imap/cmd-IMAP_OPERATION" ,when the imap > command function is executed, it will write to a file cur time and > operation. > > Could you tell me why the imap be killed? > When I modified the imap source I had a lot of crashes as I'm sure a lot of people had. Just I wasn't as bossy to ask other people to fix them for me with their crystal ball. Search the dovecot wiki for the maillog plugin, it should do what you want minus the crashes. From tss at iki.fi Thu Dec 29 14:52:06 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 14:52:06 +0200 Subject: [Dovecot] /usr/lib/dovecot/imap ignores log settings? In-Reply-To: References: Message-ID: On 28.12.2011, at 20.31, Asheesh Laroia wrote: > Hi Dovecot peeps, > > I'm enjoying running /usr/lib/dovecot/imap directly as a PREAUTH IMAP pipe. > > I find that it outputs log messages whose severity is INFO to stdout. I'm running it as follows: > > /usr/lib/dovecot/imap -c /tmp/dovecot.conf > > and I see the following messages output to stdout: stderr actually. > I'd like that message to actually not be printed, which is why I set log_path to syslog. Not possible currently. Either do: /usr/lib/dovecot/imap 2>> ~/imap.log Or patch the source: diff -r 056934abd2ef src/imap/main.c --- a/src/imap/main.c Wed Dec 21 14:40:29 2011 +0200 +++ b/src/imap/main.c Thu Dec 29 14:51:12 2011 +0200 @@ -320,6 +320,7 @@ if (IS_STANDALONE()) { service_flags |= MASTER_SERVICE_FLAG_STANDALONE | + MASTER_SERVICE_FLAG_DONT_LOG_TO_STDERR | MASTER_SERVICE_FLAG_STD_CLIENT; } else { service_flags |= MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN; From p at state-of-mind.de Thu Dec 29 14:53:27 2011 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Thu, 29 Dec 2011 13:53:27 +0100 Subject: [Dovecot] doveadm + dsync merging In-Reply-To: References: Message-ID: <20111229125326.GA2295@state-of-mind.de> * Timo Sirainen : > doveadm already supports some nice things, such as being able to remotely launch a doveadm command via TCP socket. It also supports executing a command for all users or to some specific users using a wildcard. dsync could use these features, so I merged dsync and doveadm into same binary for v2.1. > > I'll still install "dsync" symlink pointing to "doveadm", and running that way it should be fully backwards compatible with the old dsync binary and its parameters. > > I'm mainly now wondering about the command naming for running dsync via doveadm. Any suggestions? > > a) Use "doveadm dsync" prefix, and otherwise keep the names same: > > dsync mirror -> doveadm dsync mirror > dsync backup -> doveadm dsync backup > dsync server -> doveadm dsync server (for running dsync remotely via ssh/etc.) > > b) Don't have the dsync prefix: > > dsync mirror -> doveadm mirror > dsync backup -> doveadm backup > dsync server -> doveadm dsync-server (could be hidden from the doveadm commands list) Calling the old "dsync" command (symlink) directly should keep the already established command structure. Calling dsync features over doveadm should keep command structure as simple (not complex) as possible. I favour b) for that and rename 'mirror' to 'sync'. 'sync' keeps in line with products such as rsync. People will immediately know what it does. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From tss at iki.fi Thu Dec 29 14:55:40 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 14:55:40 +0200 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111224152050.GA3958@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> Message-ID: <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> On 24.12.2011, at 17.20, Jan-Frode Myklebust wrote: > I've just enabled zlib for our users, and am looking at how to compress > the existing files. The routine for doing this at > http://wiki2.dovecot.org/Plugins/Zlib seems a bit complicated. What do > you think about simply doing: > > find /var/vmail -type f -name "*,S=*" -mtime +1 -exec gzip -S Z -6 '{}' + > > > I.e. find all maildir-files: > > - with size in the name ("*,S=*") > - modified before I enabled zlib plugin As long as it doesn't find any already compressed mails.. > - compress them > - add the Z suffix Make sure there's also :2, suffix already. If someone hasn't logged in for a while there are such files in new/ directory. > It's of course racy without the maildirlock, but are there any other > problems with this approach ? Other than being racy, I guess it should work. From stan at hardwarefreak.com Thu Dec 29 15:00:03 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Thu, 29 Dec 2011 07:00:03 -0600 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111229084916.GA5895@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> Message-ID: <4EFC6453.8020304@hardwarefreak.com> On 12/29/2011 2:49 AM, Jan-Frode Myklebust wrote: > On Wed, Dec 28, 2011 at 03:56:33PM -0800, Dovecot-GDH wrote: >> The cleanest (though not necessarily simplest) way to go about this would be to use dsync to create a new maildir and incrementally direct traffic to a separate Dovecot instance. >> >> Unless you have a legacy application that relies on maildir, switching to mdbox would be a good idea too. > > We just got rid of the legacy app that worked directly against the > maildirs, which is the reason we now can turn on compression. I > intend to switch to mdbox, but first I need to free up some disks by > compressing the existing maildirs (12 TB maildirs, should probably > compress down to less than half). How much additional space do you expect the conversion process to compressed mdbox to consume? It shouldn't need much. Using dsync, the conversion will be done one mailbox at a time and the existing emails will be compressed when written into the new mdbox mailbox. After you've converted a few mailboxes by hand and have confirmed you're happy with the results, simply add commands to your bulk conversion script to delete each user maildir and contents after the new mdbox mailbox has been created and populated. Using this method shouldn't require much more additional filesystem space than that equal to your largest single user maildir. Given your 12TB of mailstore, I'd convert users in small batches over a period of weeks or a month, depending on your total mailbox count. Firing up a conversion script and having it run non-stop until all 12TB are converted is probably asking for trouble due to many factors I shouldn't need to put down here. Time your first few manual conversions. Divide that average time into your daily off-peak hours so you know approximately how many mailboxes you can convert during off-peak hours. Run your script daily against these small sets of mailboxes until the entire process is complete. -- Stan From tss at iki.fi Thu Dec 29 15:07:34 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:07:34 +0200 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFC5802.8090609@Media-Brokers.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <4EFC5802.8090609@Media-Brokers.com> Message-ID: On 29.12.2011, at 14.07, Charles Marcus wrote: > It would be cool if the concept of 'Master User' could be expanded on to provide access to only certain other accounts, as opposed to full domains (or maybe it does alreaqdy and I just don't understand it well enough yet). > > For example, we have Sales Assistants in our offices, where each assistant may assist up to 3 or 4 different Sales reps. It would be nice to be able to give the Assistant read-only access to the Sales Reps emails without having to set up shared folders for each one... It's kind of possible, but perhaps not super easy.. Basically you can use %{login_user}, %{login_username} and %{login_domain} variables to figure out if the master user login should be accepted. With SQL you could use these to create a table that has allowed masteruser -> login_username mappings. From tss at iki.fi Thu Dec 29 15:08:35 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:08:35 +0200 Subject: [Dovecot] UIDL format In-Reply-To: References: Message-ID: <058BDAFC-2103-4BFE-9E3B-5179E0E12925@iki.fi> On 28.12.2011, at 0.58, sottilette at rfx.it wrote: > How can be sure of the current POP3 UIDL? If it's not visible, it's the default. Check with: dovecot -a | grep pop3_uidl_format From tss at iki.fi Thu Dec 29 15:10:20 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:10:20 +0200 Subject: [Dovecot] dsync / separator / namespace config-problem In-Reply-To: <20111229111455.GA9344@dibs.tanso.net> References: <20111229111455.GA9344@dibs.tanso.net> Message-ID: <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> On 29.12.2011, at 13.14, Jan-Frode Myklebust wrote: > Guess I don't quite get namespaces, but we have the following namespace > configured: > > $ doveconf namespace > namespace { > hidden = no > inbox = yes > list = yes > location = > prefix = INBOX. > separator = > subscriptions = yes > type = private > } Since separator is empty, it defaults to whatever the mailbox format's internal separator is. > But when I try running dsync it complains: > > $ sudo -u atmail dsync -u janfrode at tanso.net mirror mdbox:/tmp/janfrodeboks > dsync(atmail): Error: user janfrode at tanso.net: Initialization failed: namespace configuration error: list=yes requires prefix=INBOX. to end with separator dsync(atmail): Fatal: User init failed With mdbox the internal separator is '/', but it's not valid to have "INBOX." prefix then (it should be "INBOX/"). > I can fix this by adding "separator = ." to the namespace and dsync is > happy, but is changing this now safe, or will this affect existing clients? Since you were using Maildir, which uses '.' as the default separator, setting this explicitly won't break anything. From tss at iki.fi Thu Dec 29 15:11:09 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:11:09 +0200 Subject: [Dovecot] Dsync Error Can't Delete Mailbox In-Reply-To: <4EF9E845.4030507@globalchangemusic.org> References: <4EF9E845.4030507@globalchangemusic.org> Message-ID: On 27.12.2011, at 17.46, Asai wrote: > I'm getting this error in the dsync logs: > > Warning: Destination mailbox INBOX has been modified, need to recreate it before we can continue syncing > dsync(foo at bar.org): Error: Can't delete mailbox INBOX: INBOX can't be deleted. > > In this situation, what should I do to remedy the problem? Just delete the backup and rebuild? Yes, that's the only solution currently. From tss at iki.fi Thu Dec 29 15:12:31 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:12:31 +0200 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF826D0.3050005@hardwarefreak.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <9347F262-3300-4600-A87C-40230E71FF10@lazurit.com> <4EF67364.6030003@hardwarefreak.com> <4EF817A5.3030101@lazurit.com> <4EF826D0.3050005@hardwarefreak.com> Message-ID: <0BAAC85A-C73C-413D-9F5E-188AFC5EA40D@iki.fi> On 26.12.2011, at 9.48, Stan Hoeppner wrote: > On 12/26/2011 12:43 AM, Alexander Chekalin wrote: >> I tried to create folder named like 'Old Mail' (and in fact I got >> another mbox container), while I needed to create 'Old Mail/' (note the >> slash), which results in real filesystem directory. > > Oh wow, that is simple. And makes perfect sense. Before my last reply > I read the php IMAP command set definitions/parameters and I didn't see > anything about how to do this, which is an odd omission in > documentation. I guess so few people use mbox these days they omit that > case from the docs. I hit three different sources and none of them > mentioned the trailing slash for creating 'sub-folders-only' folders... That's not PHP-specific, but rather IMAP-specific. It's in RFC 3501. From tss at iki.fi Thu Dec 29 15:15:38 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:15:38 +0200 Subject: [Dovecot] Dovecot imap proxy to nginx, incompatible In-Reply-To: <4EF5124E.7000303@vitalwerks.com> References: <4EF5124E.7000303@vitalwerks.com> Message-ID: <1F6ED1C2-6288-4680-8154-DC581344713B@iki.fi> On 24.12.2011, at 1.44, David Jonas wrote: > It appears that using dovecot to proxy to nginx imap proxy doesn't work. > From tcpdump and browsing the source it appears dovecot sends, > > C CAPABILITY\r\nL LOGIN \r\n > > and nginx only responds to the CAPABILITY command. Is this a problem > with dovecot sending the two commands without waiting for the first to > complete or is it nginx's trouble with not handling it correctly? nginx bug. Dovecot is just being as efficient as it can be. From tss at iki.fi Thu Dec 29 15:18:15 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:18:15 +0200 Subject: [Dovecot] Lucene vs Solr with 2.1 single server In-Reply-To: References: Message-ID: <21140AB9-373B-4E75-B2E5-A848022BD950@iki.fi> On 23.12.2011, at 9.10, Daniel L. Miller wrote: > For a single server, is the Lucene backend now "better" than running a Solr server? Simpler, at least. Probably not better, since Solr uses a newer Lucene engine. From tss at iki.fi Thu Dec 29 15:23:12 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:23:12 +0200 Subject: [Dovecot] proxying, SSL, and client certificate In-Reply-To: References: Message-ID: On 23.12.2011, at 1.10, Mike Abbott wrote: > How do I configure dovecot-2.0.x to present a client SSL certificate when proxying? Set ssl_client_cert and ssl_client_key settings in dovecot.conf. Requires hg version, since these were added after v2.0.16. > If dovecot on server1.example.com has: > passdb { > driver = static > args = proxy=y host=server2.example.com nopassword=y ssl=yes > } > > and dovecot on server2.example.com has: > ssl_verify_client_cert = yes > auth_ssl_require_client_cert = yes > > then when a client connects to server1 and authenticates, a connection is established to server2 but the SSL handshake fails because server1 doesn't present a client certificate. I don't see where ssl_client_ctx is tied to a client certificate in ssl-proxy-openssl.c. If you want some kind of automatic client certificate forwarding, I don't think that's possible even in theory since the private key is needed. From tss at iki.fi Thu Dec 29 15:31:33 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:31:33 +0200 Subject: [Dovecot] Received date no longer email date? In-Reply-To: <4EF3AD7D.40203@gmail.com> References: <4EF3AD7D.40203@gmail.com> Message-ID: On 23.12.2011, at 0.21, Brian L. Matthews wrote: > I just upgrade from dovecot 1.2 to dovecot 2.0.16. I use dovecot as a local IMAP server to archive email from my corporate email account (on Exchange). I don't have any automated archiving, I just periodically move messages from my Exchange inbox to the IMAP inbox. I'm on Mac OS X 10.6.8 using Entourage as my mail client. > > In the previous version of dovecot, the Received date of the email was preserved when I moved a message, but it's not in 2.0.16, it's set to the date and time I move the message. If I open a message, the date displayed is the date on the message as expected. It should still work the same in Dovecot v2.0. I just tested that giving a timestamp to APPEND command works. Did you also upgrade the IMAP client? Maybe it doesn't add the timestamp anymore. From tss at iki.fi Thu Dec 29 15:35:18 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:35:18 +0200 Subject: [Dovecot] Maildir migration and uids In-Reply-To: <4EF28D7B.8050601@vitalwerks.com> References: <4EF28D7B.8050601@vitalwerks.com> Message-ID: <81E45F76-34A4-4666-9F10-7566B7BD496C@iki.fi> On 22.12.2011, at 3.52, David Jonas wrote: > I'm in the process of migrating a large number of maildirs to a 3rd > party dovecot server (from a dovecot server). Tests have shown that > using imap to sync the accounts doesn't preserve the uidl for pop3 access. > > My current attempt is to convert the maildir to mbox and add an X-UIDL > header in the process. Run a second dovecot that serves the converted > mbox. But dovecot's docs say, "None of these headers are sent to > IMAP/POP3 clients when they read the mail". That's rather complex. > Is there any way to sync these maildirs to the new server and maintain > the uids? What Dovecot versions? dsync could do this easily. You could simply install the dsync binary even if you're using Dovecot v1.x. You could also log in with POP3 and get the UIDL list and write a script to add them to dovecot-uidlist. From janfrode at tanso.net Thu Dec 29 15:36:43 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 14:36:43 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> References: <20111224152050.GA3958@dibs.tanso.net> <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> Message-ID: <20111229133643.GA11809@dibs.tanso.net> On Thu, Dec 29, 2011 at 02:55:40PM +0200, Timo Sirainen wrote: > > > > I.e. find all maildir-files: > > > > - with size in the name ("*,S=*") > > - modified before I enabled zlib plugin > > As long as it doesn't find any already compressed mails.. Can't I trust that no mails with timestamp before I enabled compression are uncompressed? Or will dovecot compress old messages keeping old timestamp when copying messages between folders, or something like that? I want to avoid reading every file to check if it's compressed already, as that will add ages to an already slow process.. > > > - compress them > > - add the Z suffix > > Make sure there's also :2, suffix already. If someone hasn't logged in for a while there are such files in new/ directory. So, find /var/vmail -type f -name "*,S=*:2*" -mtime +6 -exec gzip -S Z -6 '{}' + Right ? I don't care too much if I miss on a few percent of the files.. (I'll probably have to use "-newer /somefile" instead of -mtime since it will run for some days) -jf From janfrode at tanso.net Thu Dec 29 15:42:34 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 14:42:34 +0100 Subject: [Dovecot] dsync / separator / namespace config-problem In-Reply-To: <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> References: <20111229111455.GA9344@dibs.tanso.net> <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> Message-ID: <20111229134234.GB11809@dibs.tanso.net> On Thu, Dec 29, 2011 at 03:10:20PM +0200, Timo Sirainen wrote: > > With mdbox the internal separator is '/', but it's not valid to have "INBOX." prefix then (it should be "INBOX/"). But how should this be handled in the migration phase from maildir to mdbox then? Can we have different namespaces for users with maildirs vs. mdboxes? (..or am i misunderstanding something?) > > > I can fix this by adding "separator = ." to the namespace and dsync is > > happy, but is changing this now safe, or will this affect existing clients? > > Since you were using Maildir, which uses '.' as the default separator, setting this explicitly won't break anything. Great, I'll fix our config then. Thanks! -jf From tss at iki.fi Thu Dec 29 15:48:05 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:48:05 +0200 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111229133643.GA11809@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> <20111229133643.GA11809@dibs.tanso.net> Message-ID: <0A1CC1CE-8C58-47DB-A87D-75FBCF7DF3F8@iki.fi> On 29.12.2011, at 15.36, Jan-Frode Myklebust wrote: > On Thu, Dec 29, 2011 at 02:55:40PM +0200, Timo Sirainen wrote: >>> >>> I.e. find all maildir-files: >>> >>> - with size in the name ("*,S=*") >>> - modified before I enabled zlib plugin >> >> As long as it doesn't find any already compressed mails.. > > Can't I trust that no mails with timestamp before I enabled compression > are uncompressed? Or will dovecot compress old messages keeping old > timestamp when copying messages between folders, or something like that? It's possible that a user saves a mail with an old IMAP INTERNALDATE (=file's mtime), which is already compressed. You could use ctime, but that could skip mails whose flags have been changed since compression. > I want to avoid reading every file to check if it's compressed > already, as that will add ages to an already slow process.. You could use mtime, and just before compressing the mail check if it's already compressed. That won't add much overhead. >>> - compress them >>> - add the Z suffix >> >> Make sure there's also :2, suffix already. If someone hasn't logged in for a while there are such files in new/ directory. > > So, > find /var/vmail -type f -name "*,S=*:2*" -mtime +6 -exec gzip -S Z -6 '{}' + > > > Right ? I don't care too much if I miss on a few percent of the files.. Yes. From tss at iki.fi Thu Dec 29 15:49:57 2011 From: tss at iki.fi (Timo Sirainen) Date: Thu, 29 Dec 2011 15:49:57 +0200 Subject: [Dovecot] dsync / separator / namespace config-problem In-Reply-To: <20111229134234.GB11809@dibs.tanso.net> References: <20111229111455.GA9344@dibs.tanso.net> <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> <20111229134234.GB11809@dibs.tanso.net> Message-ID: On 29.12.2011, at 15.42, Jan-Frode Myklebust wrote: > On Thu, Dec 29, 2011 at 03:10:20PM +0200, Timo Sirainen wrote: >> >> With mdbox the internal separator is '/', but it's not valid to have "INBOX." prefix then (it should be "INBOX/"). > > But how should this be handled in the migration phase from maildir to > mdbox then? Can we have different namespaces for users with maildirs vs. > mdboxes? (..or am i misunderstanding something?) You'll most likely want to keep the '.' separator with mdbox, at least initially. Some clients don't like if the separator changes. Perhaps in future if you want to allow users to use '.' character in mailbox names you could change it, or possibly make it a per-user setting. From janfrode at tanso.net Thu Dec 29 16:14:39 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 15:14:39 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <0A1CC1CE-8C58-47DB-A87D-75FBCF7DF3F8@iki.fi> References: <20111224152050.GA3958@dibs.tanso.net> <57C4D01B-81C8-48E1-A89D-E3E6E019AA7E@iki.fi> <20111229133643.GA11809@dibs.tanso.net> <0A1CC1CE-8C58-47DB-A87D-75FBCF7DF3F8@iki.fi> Message-ID: <20111229141439.GA12567@dibs.tanso.net> On Thu, Dec 29, 2011 at 03:48:05PM +0200, Timo Sirainen wrote: > > > > Can't I trust that no mails with timestamp before I enabled compression > > are uncompressed? Or will dovecot compress old messages keeping old > > timestamp when copying messages between folders, or something like that? > > It's possible that a user saves a mail with an old IMAP INTERNALDATE (=file's mtime), which is already compressed. You could use ctime, but that could skip mails whose flags have been changed since compression. Ok, if ctime is safer I think I'll use that and not worry too much about missing some messages. > > > I want to avoid reading every file to check if it's compressed > > already, as that will add ages to an already slow process.. > > You could use mtime, and just before compressing the mail check if it's already compressed. That won't add much overhead. Ah, right.. I'll have to read the messages from disk anyway, so checking if they're compressed or not doesn't add much. So mtime + compression-check is what I'll need to do then. -jf From user+dovecot at localhost.localdomain.org Thu Dec 29 16:19:28 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Thu, 29 Dec 2011 15:19:28 +0100 Subject: [Dovecot] doveadm + dsync merging In-Reply-To: <20111229125326.GA2295@state-of-mind.de> References: <20111229125326.GA2295@state-of-mind.de> Message-ID: <4EFC76F0.2050705@localhost.localdomain.org> On 12/29/2011 01:53 PM Patrick Ben Koetter wrote: > * Timo Sirainen : >> ? >> a) Use "doveadm dsync" prefix, and otherwise keep the names same: >> >> dsync mirror -> doveadm dsync mirror >> dsync backup -> doveadm dsync backup >> dsync server -> doveadm dsync server (for running dsync remotely via ssh/etc.) >> >> b) Don't have the dsync prefix: >> >> dsync mirror -> doveadm mirror >> dsync backup -> doveadm backup >> dsync server -> doveadm dsync-server (could be hidden from the doveadm commands list) > > Calling the old "dsync" command (symlink) directly should keep the already > established command structure. > > Calling dsync features over doveadm should keep command structure as simple > (not complex) as possible. I favour b) for that and rename 'mirror' to 'sync'. > > 'sync' keeps in line with products such as rsync. People will immediately know > what it does. I'd prefer doveadm commands with the dsync prefix. (a)) Because: * doveadm already has other 'command groups' like mailbox, director ? * that's the way to avoid command clashes (w/o hiding anything) Renaming 'mirror' to 'sync' could be helpful ? Regards, Pascal -- The trapper recommends today: cafebabe.1136315 at localdomain.org From asai at globalchangemusic.org Thu Dec 29 17:51:14 2011 From: asai at globalchangemusic.org (Asai) Date: Thu, 29 Dec 2011 08:51:14 -0700 Subject: [Dovecot] Dsync Error Can't Delete Mailbox In-Reply-To: References: <4EF9E845.4030507@globalchangemusic.org> Message-ID: <4EFC8C72.4000900@globalchangemusic.org> OK, thank you very much for this wonderful application. --asai On 12/29/2011 6:11 AM, Timo Sirainen wrote: > On 27.12.2011, at 17.46, Asai wrote: > >> I'm getting this error in the dsync logs: >> >> Warning: Destination mailbox INBOX has been modified, need to recreate it before we can continue syncing >> dsync(foo at bar.org): Error: Can't delete mailbox INBOX: INBOX can't be deleted. >> >> In this situation, what should I do to remedy the problem? Just delete the backup and rebuild? > Yes, that's the only solution currently. > From gedalya at gedalya.net Thu Dec 29 19:23:27 2011 From: gedalya at gedalya.net (Gedalya) Date: Thu, 29 Dec 2011 12:23:27 -0500 Subject: [Dovecot] Trouble with proxy_maybe and auth_default_realm Message-ID: <4EFCA20F.10107@gedalya.net> Hello, I'm using proxy_maybe and auth_default_realm. It seems that when a user logs in without the domain name, relying on auth_default_realm, and the "host" field points to the local server, I get the Proxying loops to itself error. It does work as expected - log on to the local server without proxying, if the user does include the domain name in the login. (IP's and domain name masked below) No domain: Dec 29 11:49:07 imap01 dovecot: pop3-login: Error: Proxying loops to itself: user=, method=PLAIN, rip=00.00.52.18, lip=00.00.241.140 Dec 29 11:49:27 imap01 dovecot: pop3-login: Disconnected (auth failed, 1 attempts): user=, method=PLAIN, rip=00.00.52.18, lip=00.00.241.140 With domain: Dec 29 11:52:13 imap01 dovecot: pop3-login: Login: user=, method=PLAIN, rip=00.00.52.18, lip=00.00.241.140, mpid=19969 Dec 29 11:52:18 imap01 dovecot: pop3(jedi at ---.com): Disconnected: Logged out top=0/0, retr=0/0, del=0/1, size=731 Otherwise, e.g. when the proxy host is indeed another host, auth_default_domain works fine, including or not including the domain seems to make no difference, and everything works. I'm using mysql, and I'm able to get around this problem including the following in the password query: IF(host='' or host='00.00.241.140', NULL, 'Y') as proxy_maybe # dovecot --version 2.0.15 # dovecot -n # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 auth_default_realm = ----.com auth_mechanisms = plain login cram-md5 ntlm auth_username_format = %Lu auth_verbose = yes auth_verbose_passwords = plain dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no login_greeting = How can I help you? mail_gid = vmail mail_uid = vmail passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = imap pop3 lmtp service lmtp { inet_listener lmtp { address = 0.0.0.0 port = 7025 } } ssl_cert = References: Message-ID: On Thu, 29 Dec 2011, Timo Sirainen wrote: > On 28.12.2011, at 20.31, Asheesh Laroia wrote: > >> Hi Dovecot peeps, >> >> I'm enjoying running /usr/lib/dovecot/imap directly as a PREAUTH IMAP pipe. >> >> I find that it outputs log messages whose severity is INFO to stdout. I'm running it as follows: >> >> /usr/lib/dovecot/imap -c /tmp/dovecot.conf >> >> and I see the following messages output to stdout: > > stderr actually. Right. Thanks for that; I saw it was file descriptor 2 in the strace after I hit send. >> I'd like that message to actually not be printed, which is why I set log_path to syslog. > > Not possible currently. Either do: > > /usr/lib/dovecot/imap 2>> ~/imap.log > > Or patch the source: [snip] Great! That should be okay for now. -- Asheesh. From bra at fsn.hu Thu Dec 29 21:59:35 2011 From: bra at fsn.hu (Attila Nagy) Date: Thu, 29 Dec 2011 20:59:35 +0100 Subject: [Dovecot] doveadm + dsync merging In-Reply-To: References: Message-ID: <4EFCC6A7.1060406@fsn.hu> Hi, On 12/29/2011 01:35 PM, Timo Sirainen wrote: > doveadm already supports some nice things, such as being able to remotely launch a doveadm command via TCP socket. It also supports executing a command for all users or to some specific users using a wildcard. dsync could use these features, so I merged dsync and doveadm into same binary for v2.1. > > I'll still install "dsync" symlink pointing to "doveadm", and running that way it should be fully backwards compatible with the old dsync binary and its parameters. > > I'm mainly now wondering about the command naming for running dsync via doveadm. Any suggestions? > > a) Use "doveadm dsync" prefix, and otherwise keep the names same: > > dsync mirror -> doveadm dsync mirror > dsync backup -> doveadm dsync backup > dsync server -> doveadm dsync server (for running dsync remotely via ssh/etc.) > > b) Don't have the dsync prefix: > > dsync mirror -> doveadm mirror > dsync backup -> doveadm backup > dsync server -> doveadm dsync-server (could be hidden from the doveadm commands list) > > c) Either a) or b), but rename "mirror" to "sync" or "dsync" or "replicate"? > > d) Something else? > Slightly different, but it would be good to have a persistently running daemon which could operate both in server and client mode. In server mode it would listen on a TCP socket. In client mode it would accept source and target information via a control socket. The target IP address and port would be the daemon's listening socket. Something like this on the server side: service dsync { process_limit = 8 client_limit = 8 inet_listener dsync { port = 5555 } Then doveadm sync on the "client) could first connect to the local server (client), which then connects to the remote service on the server. Eg.: doveadm sync [-C ] [-m ] [-u ] [-frRv] mirror | [@] where user at host should specify the remote user (mailbox user) and host should read like 1.1.1.1:1234 (IP address|hostname and port where the dsync service listens. Or a separate port option to allow easier parsing. Having the client in a persistent setup would allow faster syncs for repeated invocations. It would be good to have a simple API to trigger the sync (a simple text protocol on a unix socket, or something) from outside programs, to avoid calling doveadm. The next thing would be to follow dovecot logs and do a sync/async replication. :) From janfrode at tanso.net Thu Dec 29 22:03:45 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 29 Dec 2011 21:03:45 +0100 Subject: [Dovecot] dsync / separator / namespace config-problem In-Reply-To: References: <20111229111455.GA9344@dibs.tanso.net> <3F4112A3-FF46-4ABA-9EC5-E04651D50E87@iki.fi> <20111229134234.GB11809@dibs.tanso.net> Message-ID: <20111229200345.GA17871@dibs.tanso.net> On Thu, Dec 29, 2011 at 03:49:57PM +0200, Timo Sirainen wrote: > >> > >> With mdbox the internal separator is '/', but it's not valid to have "INBOX." prefix then (it should be "INBOX/"). > > > > But how should this be handled in the migration phase from maildir to > > mdbox then? Can we have different namespaces for users with maildirs vs. > > mdboxes? (..or am i misunderstanding something?) > > You'll most likely want to keep the '.' separator with mdbox, at least initially. Some clients don't like if the separator changes. Perhaps in future if you want to allow users to use '.' character in mailbox names you could change it, or possibly make it a per-user setting. > Sorry for being so dense, but I don't quite get it still. Do you suggest dropping the trailing dot from prefix=INBOX. ? I.e. namespace { inbox = yes location = prefix = INBOX type = private separator = . } when we do the migration to mdbox? And this should work without issues for both current maildir users, and mdbox users ? Ideally I don't want to use the . as a separator, since it's causing problems for our users who expect to be able to use them in folder names. But I don't understand if I can change them without causing problems to existing users.. or how these problems will appear to the users. -jf From david at electric-spoon.com Thu Dec 29 23:54:57 2011 From: david at electric-spoon.com (David Pottage) Date: Thu, 29 Dec 2011 21:54:57 +0000 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFB9438.7090608@hardwarefreak.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <4EFB9438.7090608@hardwarefreak.com> Message-ID: <4EFCE1B1.9060704@electric-spoon.com> On 28/12/11 22:12, Stan Hoeppner wrote: > It's a smart phone. Have you considering simply running a webmail server? I considered it for about 10 seconds. Webmail is much less efficent than IMAP both for the server and the client. I run SquirrelMail on (on Apache) my server, and it consumes far more CPU and RAM than Dovecot. It is also much slower in most operations compared with IMAP. Though I have not measured it, I suspect the bandwidth consumption is much higher because of HTML mark-up and images. In any case, webmail would not solve the problem of too many folders being displayed. I would get just as long a list, with a hard to use scrollbar, but rendered as html instead of in a menu. -- David Pottage From david at electric-spoon.com Fri Dec 30 00:02:09 2011 From: david at electric-spoon.com (David Pottage) Date: Thu, 29 Dec 2011 22:02:09 +0000 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> Message-ID: <4EFCE361.6030104@electric-spoon.com> On 28/12/11 22:21, Rick Romero wrote: > > Quoting David Pottage : >> Firstly I wanted to retain the option to switch to the full version of >> my mail folders if I needed to access something urgently. My smart-phone >> based email client allows me to change the port number of an existing >> email account, but will not allow me to change the user-name without >> creating a whole new account and re-downloading everything. > > I read back through the thread, and I don't see why you're not using > IMAP subscriptions - did I overlook it? > If you mean subscriptions on the smartphone client, I was not using them because the first IMAP client I was using (native email on a Palm Pre) did not support them. I have since switched to an Android phone and started using K9, but I still find it helpful to filter the list of folders that that K9 sees as I don't want a huge list with an unmanageable scrollbar, and many of the folders are archive folders that will never contain anything current, so it makes no sense to make them accessible except through a desktop client. I am not saying my solution is the only possible solution but I do think it is worth recording in the Wiki as others may find my approach useful. -- David Pottage From knute2011 at knutejohnson.com Fri Dec 30 01:57:23 2011 From: knute2011 at knutejohnson.com (Knute Johnson) Date: Thu, 29 Dec 2011 15:57:23 -0800 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFCE361.6030104@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> <4EFCE361.6030104@electric-spoon.com> Message-ID: <4EFCFE63.3000804@knutejohnson.com> On 12/29/2011 2:02 PM, David Pottage wrote: > On 28/12/11 22:21, Rick Romero wrote: >> >> Quoting David Pottage: >>> Firstly I wanted to retain the option to switch to the full version of >>> my mail folders if I needed to access something urgently. My smart-phone >>> based email client allows me to change the port number of an existing >>> email account, but will not allow me to change the user-name without >>> creating a whole new account and re-downloading everything. >> >> I read back through the thread, and I don't see why you're not using >> IMAP subscriptions - did I overlook it? >> > If you mean subscriptions on the smartphone client, I was not using them > because the first IMAP client I was using (native email on a Palm Pre) > did not support them. > > I have since switched to an Android phone and started using K9, but I > still find it helpful to filter the list of folders that that K9 sees as > I don't want a huge list with an unmanageable scrollbar, and many of the > folders are archive folders that will never contain anything current, so > it makes no sense to make them accessible except through a desktop client. > > I am not saying my solution is the only possible solution but I do think > it is worth recording in the Wiki as others may find my approach useful. > My wife has an Android phone running K-9 and she is able to not display most of the hundreds of folders that she has. I haven't seen any drawbacks to that technique on her phone. Well maybe if she got rid of about a 1000 emails out of her INBOX it would help :-). -- Knute Johnson knute2011 at knutejohnson.com From dovecot at knutejohnson.com Fri Dec 30 01:58:01 2011 From: dovecot at knutejohnson.com (Knute Johnson) Date: Thu, 29 Dec 2011 15:58:01 -0800 Subject: [Dovecot] How to serve a subset of IMAP folders for hand held devices. In-Reply-To: <4EFCE361.6030104@electric-spoon.com> References: <4EFAEEE4.80405@electric-spoon.com> <4EFB928F.2010601@electric-spoon.com> <20111228162149.Horde.EpGxNqPBW7JO_5Z9dth24mA@beta.vfemail.net> <4EFCE361.6030104@electric-spoon.com> Message-ID: <4EFCFE89.1030703@knutejohnson.com> On 12/29/2011 2:02 PM, David Pottage wrote: > On 28/12/11 22:21, Rick Romero wrote: >> >> Quoting David Pottage: >>> Firstly I wanted to retain the option to switch to the full version of >>> my mail folders if I needed to access something urgently. My smart-phone >>> based email client allows me to change the port number of an existing >>> email account, but will not allow me to change the user-name without >>> creating a whole new account and re-downloading everything. >> >> I read back through the thread, and I don't see why you're not using >> IMAP subscriptions - did I overlook it? >> > If you mean subscriptions on the smartphone client, I was not using them > because the first IMAP client I was using (native email on a Palm Pre) > did not support them. > > I have since switched to an Android phone and started using K9, but I > still find it helpful to filter the list of folders that that K9 sees as > I don't want a huge list with an unmanageable scrollbar, and many of the > folders are archive folders that will never contain anything current, so > it makes no sense to make them accessible except through a desktop client. > > I am not saying my solution is the only possible solution but I do think > it is worth recording in the Wiki as others may find my approach useful. > My wife has an Android phone running K-9 and she is able to not display most of the hundreds of folders that she has. I haven't seen any drawbacks to that technique on her phone. Well maybe if she got rid of about a 1000 emails out of her INBOX it would help . -- Knute Johnson From bill+dovecot at blunn.org Fri Dec 30 04:31:54 2011 From: bill+dovecot at blunn.org (William Blunn) Date: Fri, 30 Dec 2011 02:31:54 +0000 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EF5A9EC.8090606@hardwarefreak.com> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> Message-ID: <4EFD229A.9080803@blunn.org> On 24/12/2011 10:31, Stan Hoeppner wrote: > With mbox storage, an IMAP FOLDER contains only sub folders or it contains only messages. It CANNOT contain BOTH. Dovecot can store both folders and messages in a folder, under mbox. See http://wiki2.dovecot.org/MboxChildFolders Bill From bill+dovecot at blunn.org Fri Dec 30 05:10:20 2011 From: bill+dovecot at blunn.org (William Blunn) Date: Fri, 30 Dec 2011 03:10:20 +0000 Subject: [Dovecot] Upgrade/Migration In-Reply-To: References: Message-ID: <4EFD2B9C.4050907@blunn.org> On 23/12/2011 19:20, sottilette at rfx.it wrote: > New box (supposed): CentOS 6.x (32/64 bit ? ), dovecot 2.04, mbox format > > Any hints/comment appreciated ;-) Don't use Dovecot 2.0.4, even if your distro tries to tempt you into doing so by including such a version. Whilst it looks like a stable version number, there were a number of issues with early Dovecot 2.0.x. Instead use 2.0.latest. Starting from http://www.dovecot.org/download.html you could find http://packages.atrpms.net/dist/el6/dovecot/ which provides 32- and 64-bit RPMs of Dovecot 2.0.16. Bill From bill at blunn.org Fri Dec 30 05:34:02 2011 From: bill at blunn.org (William Blunn) Date: Fri, 30 Dec 2011 03:34:02 +0000 Subject: [Dovecot] Using Amazon S3 storage for Maildir ? In-Reply-To: References: <4EEF75C4.9040005@gmail.com> Message-ID: <4EFD312A.2070706@blunn.org> On 20/12/2011 05:29, Timo Sirainen wrote: > On 19.12.2011, at 19.35, Forrest Aldrich wrote: > >> I wonder if anyone has tried using an IMAP server with Amazon S3 as a backend. There would be many factors to consider (speed, etc). However, moreso, I don't know that Maildir(++) would support multiple folders that might be linked into the cloud. For example, higher-I/O local incoming mail is on disk, some folders archived on S3. Could be easily done by simply creating another account and storing its Maildir in S3 -- > Maybe [sm]dbox with alt storage set to S3? http://wiki2.dovecot.org/MailboxFormat/dbox#Alternate_storage Also consider using the S3QL ( http://code.google.com/p/s3ql/ ) filesystem, which stores files chunked on the backend (e.g. Amazon S3). This ought to work well for dbox alternate storage, and archived mbox mail (though it may be worth arranging for indexes to be stored locally). Bill From janfrode at tanso.net Fri Dec 30 10:44:07 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 30 Dec 2011 09:44:07 +0100 Subject: [Dovecot] doveadm + dsync merging In-Reply-To: <4EFCC6A7.1060406@fsn.hu> References: <4EFCC6A7.1060406@fsn.hu> Message-ID: <20111230084407.GA30568@dibs.tanso.net> On Thu, Dec 29, 2011 at 08:59:35PM +0100, Attila Nagy wrote: > > > Slightly different, but it would be good to have a persistently > running daemon which could operate both in server and client mode. > In server mode it would listen on a TCP socket. In client mode it > would accept source and target information via a control socket. The > target IP address and port would be the daemon's listening socket. > Great idea! > > The next thing would be to follow dovecot logs and do a sync/async > replication. :) It's not too hard to do async already.. If you have last-login tracking in the post-login scripts, you can use this to know which users to trigger async backups for every X minute. -jf From janfrode at tanso.net Fri Dec 30 11:00:53 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 30 Dec 2011 10:00:53 +0100 Subject: [Dovecot] lmtp-postlogin ? Message-ID: <20111230090053.GA30820@dibs.tanso.net> We have last-login tracking for imap and pop, and I intend to use this for deciding which users to backup daily. But, it would also be nice to backup users who has only received messages, but not logged in lately.. So is it possible to implement "last-login" tracking for lmtp ? I naively tried copying the settings from imap, but it didn't work: service lmtp-postlogin { executable = script-login /usr/local/sbin/lmtp-postlogin.sh unix_listener lmtp-postlogin { } } service lmtp { executable = lmtp lmtp-postlogin -jf From stan at hardwarefreak.com Fri Dec 30 13:53:58 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 30 Dec 2011 05:53:58 -0600 Subject: [Dovecot] mbox, hierarchical folders/folders and IMAP In-Reply-To: <4EFD229A.9080803@blunn.org> References: <4EF4A5B0.4040302@lazurit.com> <4EF5A9EC.8090606@hardwarefreak.com> <4EFD229A.9080803@blunn.org> Message-ID: <4EFDA656.9040903@hardwarefreak.com> On 12/29/2011 8:31 PM, William Blunn wrote: > On 24/12/2011 10:31, Stan Hoeppner wrote: >> With mbox storage, an IMAP FOLDER contains only sub folders or it >> contains only messages. It CANNOT contain BOTH. > > Dovecot can store both folders and messages in a folder, under mbox. > > See http://wiki2.dovecot.org/MboxChildFolders Not by default, and not without potential headaches. I'm still waiting to see someone post here that they're using this setup in a production environment, and that it works seamlessly with XYZ IMAP clients, backup software, current custom scripts without requiring a rewrite, etc. mbox capability in this regard hasn't changed for some 15-20 years until Timo suggested this with Dovecot. The capability may exist, but until I see that it is being used successfully in production environments, I'm going to continue stating the standard mbox capability. To do otherwise at this point will only serve to confuse people. -- Stan From tss at iki.fi Fri Dec 30 14:03:34 2011 From: tss at iki.fi (Timo Sirainen) Date: Fri, 30 Dec 2011 14:03:34 +0200 Subject: [Dovecot] lmtp-postlogin ? In-Reply-To: <20111230090053.GA30820@dibs.tanso.net> References: <20111230090053.GA30820@dibs.tanso.net> Message-ID: <16B30E6C-AE5E-44CB-8F48-66274FEAB357@iki.fi> On 30.12.2011, at 11.00, Jan-Frode Myklebust wrote: > We have last-login tracking for imap and pop, and I intend to use this > for deciding which users to backup daily. But, it would also be nice to > backup users who has only received messages, but not logged in lately.. > So is it possible to implement "last-login" tracking for lmtp ? LMTP supports authentication, but Dovecot doesn't support it. And you most likely didn't mean that anyway. So, when would it be executed? When client connects? After each RCPT TO? After DATA? Maybe create a new plugin for this using notify plugin. From janfrode at tanso.net Fri Dec 30 15:08:04 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 30 Dec 2011 14:08:04 +0100 Subject: [Dovecot] lmtp-postlogin ? In-Reply-To: <16B30E6C-AE5E-44CB-8F48-66274FEAB357@iki.fi> References: <20111230090053.GA30820@dibs.tanso.net> <16B30E6C-AE5E-44CB-8F48-66274FEAB357@iki.fi> Message-ID: <20111230130804.GA2107@dibs.tanso.net> On Fri, Dec 30, 2011 at 02:03:34PM +0200, Timo Sirainen wrote: > > LMTP supports authentication, but Dovecot doesn't support it. And you most likely didn't mean that anyway. Yes, I know.. > So, when would it be executed? When client connects? After each RCPT TO? After DATA? For my async backup-purposes any time after RCPT TO would be fine. I just want to know which users has received any message the last X hours. But i guess the ideal place would be at the time lmtp logs that it's saved a message to a mailbox. Guess a workaround is to grep for these in the log. > Maybe create a new plugin for this using notify plugin. Is there any documentation for this plugin? I've tried searching both this list, and the wiki's. -jf From janfrode at tanso.net Fri Dec 30 16:41:24 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Fri, 30 Dec 2011 15:41:24 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <4EFC6453.8020304@hardwarefreak.com> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> <4EFC6453.8020304@hardwarefreak.com> Message-ID: <20111230144124.GA3936@dibs.tanso.net> On Thu, Dec 29, 2011 at 07:00:03AM -0600, Stan Hoeppner wrote: > > We just got rid of the legacy app that worked directly against the > > maildirs, which is the reason we now can turn on compression. I > > intend to switch to mdbox, but first I need to free up some disks by > > compressing the existing maildirs (12 TB maildirs, should probably > > compress down to less than half). > > How much additional space do you expect the conversion process to > compressed mdbox to consume? Somewhere around 1/3 of the current usage, I expect.. > It shouldn't need much. Using dsync, the > conversion will be done one mailbox at a time and the existing emails > will be compressed when written into the new mdbox mailbox. Yes, I know, but I intend to do more than just convert to mdbox. I want to fix the whole folder structure*, in a new filesystem with different settings (turn on metadata-replication, and possibly also data replication). So I need to free up some disks before this can start. [*] move away from @Mails /atmail/a/b/abuser at domain folder structure to mdbox:/srv/mailbackup/%256Hu/%d/%n, stop having home=inbox, possibly use many smaller fs's instead of one huge, move the indexes inside home... -jf From qmailcalvin at gmail.com Fri Dec 30 20:53:00 2011 From: qmailcalvin at gmail.com (Calvin Cochran) Date: Fri, 30 Dec 2011 10:53:00 -0800 Subject: [Dovecot] imap process limits problem Message-ID: I am having a problem with the number of current processes that I cannot seem to diagnose adequately, and is a possible bug. This will be a bit long, but usually more info is better. I am running dovecot 2.0.16 on a CentOS 5 x86_64 server with the mailstore on gfs (output from dovecot -n at bottom). This is an imap issue. This is mostly to do with one client, but none of my tests indicate an issue with the client side. We have mail_max_userip_connections = 10 for imap, but they are not hitting the limit. We also have verbose_proctitle = yes to help in diagnosing the situation. Most of our clients, including this one, use SSL or TLS and connect on 993. As I understand it, that should have an imap-login process and an imap process per authenticated session. Based on some other diagnosis the client seems to have a PC using Outlook 2010 and an i-device (phone or pad, not sure), both on the office network, and both with imap connections to the server. Based on my analysis it seems like the client is connecting, authenticating, and then closing the session, but the imap-login process does not drop until it times out server side (I don't know a way to tell which device, the PC or i???). One odd thing is that the tcp sessions time out at 2 hours and 11 minutes (this is where the possible bug aspect comes in). I have put a strace on the process, and there does not appear to be any traffic, so I don't understand why the 30 min timeout isn't happening. Based on netstat and verbose_proctitle, at this moment there are 99 connections from the IP in question, all of which show in ps output as: dovecot/imap-login [1 connections (1 TLS)] My understanding is that means they have successfully authenticated, and that there should be line with dovecot/imap [username ip TLS] in ps output, but there isn't, so I am taking that to mean the client closed the imap session. The client ip address puts them on comcast (tcp resets?) and we do have a load balancer in front of two servers, just to add a little challenge to the diagnosis fun. The short term fix has been to increase the process limits. However, it is clearly not a workable solution to increase the limits by 100 every time someone starts accessing the server with their new i??? device. I appreciate your thoughts on this, and I am happy to provide additional useful debug info if I have missed something. Thanks, Calvin output from dovecot -n auth_mechanisms = plain apop cram-md5 auth_verbose = yes auth_verbose_passwords = plain auth_worker_max_count = 400 default_process_limit = 400 disable_plaintext_auth = no first_valid_uid = 89 last_valid_uid = 89 login_greeting = EMCS ready. mail_fsync = never maildir_very_dirty_syncs = yes mmap_disable = yes passdb { driver = vpopmail } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_log_group_events = no } protocols = imap pop3 shutdown_clients = no ssl_cert = References: <4EFD2B9C.4050907@blunn.org> Message-ID: On Fri, 30 Dec 2011, William Blunn wrote: >> New box (supposed): CentOS 6.x (32/64 bit ? ), dovecot 2.04, mbox format >> >> Any hints/comment appreciated ;-) > > Don't use Dovecot 2.0.4, even if your distro tries to tempt you into doing so > by including such a version. > > Whilst it looks like a stable version number, there were a number of issues > with early Dovecot 2.0.x. > > Instead use 2.0.latest. Are there relevant difference between 2.0.4 and 2.0.16 config? > Starting from http://www.dovecot.org/download.html you could find > > http://packages.atrpms.net/dist/el6/dovecot/ > > which provides 32- and 64-bit RPMs of Dovecot 2.0.16. Started upgrading old box. - backup data and conf, downloaded old rpm for emergengy - rpm -Uvh dovecot-2.0.16-1_132.el4.i386.rpm - changed some config settings so I can start the daemon ... - seems to work. ;-) There is a way to test it intensively before users do it for me? ;-) Happy new year to all ;-) Thanks, P. From stan at hardwarefreak.com Sat Dec 31 02:38:28 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 30 Dec 2011 18:38:28 -0600 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111230144124.GA3936@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> <4EFC6453.8020304@hardwarefreak.com> <20111230144124.GA3936@dibs.tanso.net> Message-ID: <4EFE5984.9080905@hardwarefreak.com> On 12/30/2011 8:41 AM, Jan-Frode Myklebust wrote: > On Thu, Dec 29, 2011 at 07:00:03AM -0600, Stan Hoeppner wrote: >>> We just got rid of the legacy app that worked directly against the >>> maildirs, which is the reason we now can turn on compression. I >>> intend to switch to mdbox, but first I need to free up some disks by >>> compressing the existing maildirs (12 TB maildirs, should probably >>> compress down to less than half). >> >> How much additional space do you expect the conversion process to >> compressed mdbox to consume? > > Somewhere around 1/3 of the current usage, I expect.. > >> It shouldn't need much. Using dsync, the >> conversion will be done one mailbox at a time and the existing emails >> will be compressed when written into the new mdbox mailbox. > > Yes, I know, but I intend to do more than just convert to mdbox. I want > to fix the whole folder structure*, in a new filesystem with different > settings (turn on metadata-replication, and possibly also data > replication). So I need to free up some disks before this can start. > > [*] move away from @Mails /atmail/a/b/abuser at domain folder structure to > mdbox:/srv/mailbackup/%256Hu/%d/%n, stop having home=inbox, > possibly use many smaller fs's instead of one huge, move the indexes > inside home... Roger that. Good strategy. You using SAN storage or local RAID? What filesystem do you plan to use for the new mailbox location? What OS is the Dovecot host? Lastly, how many users you have? Sorry for prying, I'm always really curious about system details when someone states they have 12TB of mailbox data. ;) -- Stan From stan at hardwarefreak.com Sat Dec 31 03:20:39 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 30 Dec 2011 19:20:39 -0600 Subject: [Dovecot] imap process limits problem In-Reply-To: References: Message-ID: <4EFE6367.5000408@hardwarefreak.com> On 12/30/2011 12:53 PM, Calvin Cochran wrote: > I am having a problem with the number of current processes that I cannot > seem to diagnose adequately, and is a possible bug. This will be a bit > long, but usually more info is better. Usually. :) > I am running dovecot 2.0.16 on a CentOS 5 x86_64 server with the mailstore > on gfs (output from dovecot -n at bottom). This is an imap issue. This is > mostly to do with one client, but none of my tests indicate an issue with > the client side. We have > mail_max_userip_connections = 10 > for imap, but they are not hitting the limit. Not going over 10 connection limit. > We also have > verbose_proctitle = yes > to help in diagnosing the situation. Most of our clients, including this > one, use SSL or TLS and connect on 993. As I understand it, that should > have an imap-login process and an imap process per authenticated session. > Based on some other diagnosis the client seems to have a PC using Outlook > 2010 and an i-device (phone or pad, not sure), both on the office network, Both on office network. > and both with imap connections to the server. Based on my analysis it > seems like the client is connecting, authenticating, and then closing the > session, but the imap-login process does not drop until it times out server > side (I don't know a way to tell which device, the PC or i???). One odd > thing is that the tcp sessions time out at 2 hours and 11 minutes (this is > where the possible bug aspect comes in). I have put a strace on the > process, and there does not appear to be any traffic, so I don't understand > why the 30 min timeout isn't happening. Based on netstat and > verbose_proctitle, at this moment there are 99 connections from the IP in 99 connections from that IP. This is a discrepancy from what you state above, and suggests you are going over the limit. Thus why isn't the 10 connection limit kicking in? > question, all of which show in ps output as: > dovecot/imap-login [1 connections (1 TLS)] > My understanding is that means they have successfully authenticated, and > that there should be line with > dovecot/imap [username ip TLS] > in ps output, but there isn't, so I am taking that to mean the client > closed the imap session. > The client ip address puts them on comcast (tcp resets?) First on office net, now on Comcast. This is a discrepancy. Are we dealing with two issues, or two different users here? > and we do have a > load balancer in front of two servers, just to add a little challenge to > the diagnosis fun. Yay. Which load balancer? Have you removed it from the IMAP loop to eliminate it as a possible cause? > The short term fix has been to increase the process limits. However, it is > clearly not a workable solution to increase the limits by 100 every time > someone starts accessing the server with their new i??? device. > I appreciate your thoughts on this, and I am happy to provide additional > useful debug info if I have missed something. 99 login connections would suggest malware, broken IMAP client software, many multiple client devices behind a NAT all logging in with the same credentials, a load balancer problem, or a combination of these. Unfortunately, with this many variables, the first 3 of which you have no direct control over or even verifiable knowledge of, troubleshooting this may prove difficult. Just out of curiosity, have you tried the non one-login-process-per-connection setup? login_process_size = 64 login_process_per_connection = yes login_processes_count = 3 login_max_processes_count = 128 login_max_connections = 256 Season values to taste. -- Stan From dovecot at r.paypc.com Sat Dec 31 04:21:41 2011 From: dovecot at r.paypc.com (Robin) Date: Fri, 30 Dec 2011 18:21:41 -0800 Subject: [Dovecot] imap process limits problem In-Reply-To: References: Message-ID: <4EFE71B5.3050103@r.paypc.com> On 12/30/2011 10:53 AM, Calvin Cochran wrote: > I am having a problem with the number of current processes that I cannot > seem to diagnose adequately, and is a possible bug. This will be a bit > long, but usually more info is better. > [....] > verbose_proctitle, at this moment there are 99 connections from the IP in > question, all of which show in ps output as: > dovecot/imap-login [1 connections (1 TLS)] > My understanding is that means they have successfully authenticated, and > that there should be line with > dovecot/imap [username ip TLS] > in ps output, but there isn't, so I am taking that to mean the client > closed the imap session. This sounds like yet another round of buggy clients that just abruptly dump connections instead of closing them down properly, or some intervening firewalling configuration that's preventing the proper signoff and TCP FIN handshakes from completing. The 2 hours+ sounds like these sockets (and the processes that used them) might be stuck in FIN_WAIT1, which isn't affected by the timeout specified in /proc/sys/net/ipv4/tcp_fin_timeout Use netstat -a these connections to see their disposition You can try some of the following: 1) Lower tcp_keepalive intervals and reduce the # of probes before a "kill" - does Dovecot make use of SO_KEEPALIVE, or can it be configured to do so? 2) Lower application idle timeout settings. (Is there a mandated "check-in" interval defined for IMAP clients?) =R= From janfrode at tanso.net Sat Dec 31 08:56:49 2011 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Sat, 31 Dec 2011 07:56:49 +0100 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <4EFE5984.9080905@hardwarefreak.com> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> <4EFC6453.8020304@hardwarefreak.com> <20111230144124.GA3936@dibs.tanso.net> <4EFE5984.9080905@hardwarefreak.com> Message-ID: <20111231065649.GA19046@dibs.tanso.net> On Fri, Dec 30, 2011 at 06:38:28PM -0600, Stan Hoeppner wrote: > > Roger that. Good strategy. You using SAN storage or local RAID? What > filesystem do you plan to use for the new mailbox location? What OS is > the Dovecot host? IBM DS4800 SAN-storage. Filesystem is IBM GPFS, which stripe all I/O over all the RAID5 LUNs it has assigned. Kind of like RAID5+0. To guard against disaster if one RAID5 array should fail, we plan on replicating the filesystem metadata on different sets for LUNs. OS is RHEL (currently RHEL4 and RHEL5, but new servers are implemented on RHEL6). > Lastly, how many users you have? Sorry for prying, I'd rather not say.. but we're an ISP, with about 250.000 residential customers and multiple mailboxes per customer. > I'm always really curious about system details when someone states they > have 12TB of mailbox data. ;) $ df -h /usr/local/atmail/users Filesystem Size Used Avail Use% Mounted on /dev/atmailusers 14T 12T 2.1T 85% /usr/local/atmail/users $ df -hi /usr/local/atmail/users Filesystem Inodes IUsed IFree IUse% Mounted on /dev/atmailusers 145M 109M 37M 75% /usr/local/atmail/users Looking forward to reducing the number of inodes when we finally move to mdbox.. Should do wonders to the backup process. -jf From stan at hardwarefreak.com Sat Dec 31 09:54:32 2011 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 31 Dec 2011 01:54:32 -0600 Subject: [Dovecot] Compressing existing maildirs In-Reply-To: <20111231065649.GA19046@dibs.tanso.net> References: <20111224152050.GA3958@dibs.tanso.net> <20111229084916.GA5895@dibs.tanso.net> <4EFC6453.8020304@hardwarefreak.com> <20111230144124.GA3936@dibs.tanso.net> <4EFE5984.9080905@hardwarefreak.com> <20111231065649.GA19046@dibs.tanso.net> Message-ID: <4EFEBFB8.1070301@hardwarefreak.com> On 12/31/2011 12:56 AM, Jan-Frode Myklebust wrote: > On Fri, Dec 30, 2011 at 06:38:28PM -0600, Stan Hoeppner wrote: >> >> Roger that. Good strategy. You using SAN storage or local RAID? What >> filesystem do you plan to use for the new mailbox location? What OS is >> the Dovecot host? > > IBM DS4800 SAN-storage. Filesystem is IBM GPFS, which stripe all I/O > over all the RAID5 LUNs it has assigned. Kind of like RAID5+0. To guard > against disaster if one RAID5 array should fail, we plan on replicating > the filesystem metadata on different sets for LUNs. Nice setup. I've mentioned GPFS for cluster use on this list before, but I think you're the only operator to confirm using it. I'm sure others would be interested in hearing of your first hand experience: pros, cons, performance, etc. And a ball park figure on the licensing costs, whether one can only use GPFS on IBM storage or if storage from others vendors is allowed in the GPFS pool. To this point IIRC everyone here doing clusters is using NFS, GFS, or OCFS. Each has its downsides, mostly because everyone is using maildir. NFS has locking issues with shared dovecot index files. GFS and OCFS have filesystem metadata performance issues. How does GPFS perform with your maildir workload? > OS is RHEL (currently RHEL4 and RHEL5, but new servers are implemented > on RHEL6). > >> Lastly, how many users you have? Sorry for prying, > > I'd rather not say.. but we're an ISP, with about 250.000 residential > customers and multiple mailboxes per customer. > >> I'm always really curious about system details when someone states they >> have 12TB of mailbox data. ;) > > $ df -h /usr/local/atmail/users > Filesystem Size Used Avail Use% Mounted on > /dev/atmailusers 14T 12T 2.1T 85% /usr/local/atmail/users > $ df -hi /usr/local/atmail/users > Filesystem Inodes IUsed IFree IUse% Mounted on > /dev/atmailusers 145M 109M 37M 75% /usr/local/atmail/users > > Looking forward to reducing the number of inodes when we finally move to > mdbox.. Should do wonders to the backup process. That will depend to a large degree on your mdbox_rotate_size value. The default is 2MB, which means you'll get multiple ~2MB mdbox files. If we assume the average email size including headers and attachments is 32KB, Dovecot will place ~64 such emails in a single mdbox file with the default 2MB setting. 32KB may be a high or low average depending on your particular users. Considering there is no inherent performance downside to going larger than the default, and significant gains to be made, consider a setting of 8MB to 16MB. This will dramatically reduce both inode consumption and filesystem metadata IOPS vs maildir. Reducing IOPS on a shared SAN is always a plus, especially if you're going to be adding some extra GPFS replication traffic. Timo, is there any technical or sanity based upper bound on mdbox size? Anything wrong with using 64MB, 128MB, or even larger for mdbox_rotate_size? -- Stan From lists at wildgooses.com Sat Dec 31 15:20:53 2011 From: lists at wildgooses.com (Ed W) Date: Sat, 31 Dec 2011 13:20:53 +0000 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <4EF310E0.6030006@Media-Brokers.com> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> Message-ID: <4EFF0C35.5000303@wildgooses.com> On 22/12/2011 11:13, Charles Marcus wrote: > On 2011-12-21 11:18 PM, Simon Brereton > wrote: >> It would be interesting to chart the number of threads caused by each >> distro. I don't know who would have the least, but I suspect gentoo and >> centos would be out in front, > > Been using gentoo since about 2003 and never looked back... best and > easiest distro to maintain, bar none, and the best support and > documentation too. > Wait... Back up... You mean there are *other* distributions of linux? I thought they were all just gentoo derivatives..?!! :-) Ed W From user+dovecot at localhost.localdomain.org Sat Dec 31 15:29:55 2011 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 31 Dec 2011 14:29:55 +0100 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <4EFF0C35.5000303@wildgooses.com> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> <4EFF0C35.5000303@wildgooses.com> Message-ID: <4EFF0E53.4060604@localhost.localdomain.org> On 12/31/2011 02:20 PM Ed W wrote: > > Wait... Back up... You mean there are *other* distributions of linux? I > thought they were all just gentoo derivatives..?!! > > :-) Huh, I thought everything would be based on LFS [http://www.linuxfromscratch.org/lfs/]. Happy new year to the all Dovecot admins and Timo San. Regards, Pascal -- The trapper recommends today: cafebabe.1136514 at localdomain.org From jerry at seibercom.net Sat Dec 31 16:11:14 2011 From: jerry at seibercom.net (Jerry) Date: Sat, 31 Dec 2011 09:11:14 -0500 Subject: [Dovecot] OT Re: crashes on 2.0.16 In-Reply-To: <4EFF0C35.5000303@wildgooses.com> References: <20111220091110.GA19728@xs4all.nl> <4EF05A12.7010502@tesco.net> <4EF26B2B.1090507@jkart.de> <1324520002.7098.14.camel@tardis> <4EF310E0.6030006@Media-Brokers.com> <4EFF0C35.5000303@wildgooses.com> Message-ID: <20111231091114.5e232cb9@scorpio> On Sat, 31 Dec 2011 13:20:53 +0000 Ed W articulated: > On 22/12/2011 11:13, Charles Marcus wrote: > > On 2011-12-21 11:18 PM, Simon Brereton > > wrote: > >> It would be interesting to chart the number of threads caused by > >> each distro. I don't know who would have the least, but I suspect > >> gentoo and centos would be out in front, > > > > Been using gentoo since about 2003 and never looked back... best > > and easiest distro to maintain, bar none, and the best support and > > documentation too. > > > > Wait... Back up... You mean there are *other* distributions of > linux? I thought they were all just gentoo derivatives..?!! Be careful, you are going to get all of the FreeBSD aficionados panties in a knot. They claim the best documentation. Of course, what do they have to document? From CMarcus at Media-Brokers.com Sat Dec 31 16:43:38 2011 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sat, 31 Dec 2011 09:43:38 -0500 Subject: [Dovecot] imap process limits problem In-Reply-To: References: Message-ID: <4EFF1F9A.1030009@Media-Brokers.com> I think Stan already pointed you to where your problem most likely lies, but just wanted to point out that this: On 2011-12-30 1:53 PM, Calvin Cochran wrote: > Most of our clients, including this one, use SSL or TLS and connect > on 993. I believe is incorrect. Port 993 is for IMAP over SSL, if the client is using TLS (or more correctly, STARTTLS), then they should be using the normal IMAP port 143. -- Best regards, Charles From dmiller at amfes.com Sat Dec 31 22:28:41 2011 From: dmiller at amfes.com (Daniel L. Miller) Date: Sat, 31 Dec 2011 12:28:41 -0800 Subject: [Dovecot] fts_solr break-imap-search 2.1 Message-ID: Is "break-imap-search" still required using 2.1 with Solr to index TEXT & BODY searches? -- Daniel From tss at iki.fi Sat Dec 31 22:30:52 2011 From: tss at iki.fi (Timo Sirainen) Date: Sat, 31 Dec 2011 22:30:52 +0200 Subject: [Dovecot] fts_solr break-imap-search 2.1 In-Reply-To: References: Message-ID: <3ED2196F-A573-4EB4-AD05-15F30A2A6B81@iki.fi> On 31.12.2011, at 22.28, Daniel L. Miller wrote: > Is "break-imap-search" still required using 2.1 with Solr to index TEXT & BODY searches? No. It's enabled always.