wrote: > This 'new' type of writing defines mailboxes for SPECIAL-USE as > defined in http://tools.ietf.org/rfc/rfc6154.txt. > > If your mail clients support it, they will automatically map their > mailboxes for Sent, Junk, Trash, Drafts etc. to whatever mailbox you > have assigned the respective $special_use option to. > > If they don't nothing will change. Out of curiosity, do you (or does anyone else) know of a list of clients that do (or don't) support this (what I consider to be most *excellent*) feature? Specifically, what about the most problematic clients I know of - Outlook and Apple Mail? Maybe the wiki could be updated with this info, and us users could keep it up to date as time goes on? -- Best regards, Charles From tompru at jla.rutgers.edu Thu Jun 21 17:48:29 2012 From: tompru at jla.rutgers.edu (Tom Pawlowski) Date: Thu, 21 Jun 2012 10:48:29 -0400 Subject: [Dovecot] doveadm proxy kick in director setups Message-ID: <20120621144829.GA8792@hawkeye.rutgers.edu> Something I noticed on a 2.1.7 director test cluster (two directors, three backends): 'doveadm proxy kick user' will kick all connections for that user on that director only. Any additional connections on other directors will remain active unless the command is run on all directors. Are the proxy and director sub-commands intended to be separate and distinct in their operation? If so, then this makes sense, as a proxy isn't necessarily a director. Are there any plans for a proxy kick equivalent that would work across directors? -- Tom Pawlowski OIT-CSS System Administrator office: Hill 145 email: tompru at jla.rutgers.edu phone: (732) 445-2634 From emailbuilder88 at yahoo.com Thu Jun 21 21:05:24 2012 From: emailbuilder88 at yahoo.com (email builder) Date: Thu, 21 Jun 2012 11:05:24 -0700 (PDT) Subject: [Dovecot] Dovecot performance under high load (vs. Courier) Message-ID: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> Hi, We are building a new system that will support a large number of users (high volume, high concurrent usage, etc).? We have played with Dovecot, but in most serious applications we have traditionally used Courier IMAP.? It's my (lay) understanding that with indexing and perhaps other things in Dovecot, it might perform better than Courier in larger environments like this.? Am I correct or is it less clear-cut? Any tips on making the migration (not migrating an existing system, I mean migrating our paradigm - things to consider, things to watch out for)? TIA From tss at iki.fi Thu Jun 21 21:13:21 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 21 Jun 2012 21:13:21 +0300 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> Message-ID: <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> On 21.6.2012, at 21.05, email builder wrote: > We are building a new system that will support a large number of users (high volume, high concurrent usage, etc). We have played with Dovecot, but in most serious applications we have traditionally used Courier IMAP. It's my (lay) understanding that with indexing and perhaps other things in Dovecot, it might perform better than Courier in larger environments like this. Am I correct or is it less clear-cut? If you disable index index files in Dovecot, its performance should be slightly better than Courier. With index files the performance is typically much better in Dovecot, especially if you use a (non-caching) webmail. > Any tips on making the migration (not migrating an existing system, I mean migrating our paradigm - things to consider, things to watch out for)? If you don't migrate any existing users, I guess this doesn't differ much from any other optimized Dovecot installation. Usually large installations (>1M users) use NetApp NFS + Dovecot director. You might also want to enable full text searches. http://wiki2.dovecot.org/PerformanceTuning lists some other things. From emailbuilder88 at yahoo.com Thu Jun 21 21:32:46 2012 From: emailbuilder88 at yahoo.com (email builder) Date: Thu, 21 Jun 2012 11:32:46 -0700 (PDT) Subject: [Dovecot] Manual manipulation of Sieve files Message-ID: <1340303566.38480.YahooMailNeo@web39306.mail.mud.yahoo.com> We have some scripts that take care of some tasks when creating new email accounts, such as creating some default mail filter rules. I know Sieve scripts are plain text files, but need to be compiled for use.? I see that you can use seivec to compile scripts manually, which can help me create .dovecot.svbin which can be placed where needed and permissioned correctly.? But a couple questions: * Sieve has the concept of an active script - is this merely whatever is compiled into the .dovecot.svbin file? * Does dovecot (managesieve) do any other housekeeping when a user sieve script is installed and set as the active script?? I would need to replicate this manually. * If the default script is always the same (sorry, for us, the solution isn't global scripts), would it work to compile that script once, keep the compiled version somewhere and merely copy it into the correct place for a new user?? Are there issues with this? * Should we always have the plain text version along with the compiled one for proper managesieve operation going forward (users can edit their sieve scripts) Thank you From emailbuilder88 at yahoo.com Thu Jun 21 23:05:25 2012 From: emailbuilder88 at yahoo.com (email builder) Date: Thu, 21 Jun 2012 13:05:25 -0700 (PDT) Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> Message-ID: <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> Thank you very much for the fast reply. >> We are building a new system that will support a large number of users >> (high volume, high concurrent usage, etc).? We have played with Dovecot, but in >> most serious applications we have traditionally used Courier IMAP.? It's my >> (lay) understanding that with indexing and perhaps other things in Dovecot, it >> might perform better than Courier in larger environments like this.? Am I >> correct or is it less clear-cut? > > If you disable index index files in Dovecot, its performance should be slightly > better than Courier. With index files the performance is typically much better > in Dovecot, especially if you use a (non-caching) webmail. Interesting.? What would be the motivations for disabling indexing? Indexing is by default enabled? Do you know what webmails are caching vs. non-caching?? Am I correct that what you're pointing out is that with non-caching webmails you will notice IMAP performance differences more readily but that a caching webmail application might be better no matter which IMAP server because it reduces the need for webmail to make IMAP connections? >> Any tips on making the migration (not migrating an existing system, I mean >> migrating our paradigm - things to consider, things to watch out for)? > > If you don't migrate any existing users, I guess this doesn't differ > much from any other optimized Dovecot installation. Usually large installations > (>1M users) use NetApp NFS + Dovecot director. You might also want to enable > full text searches. http://wiki2.dovecot.org/PerformanceTuning lists some other > things. Ah, I didn't know about Director.? That looks very nice.? I had in mind that we would have to use Perdition, but an integrated solution might be good. Anyone have any thoughts or opinions considering Perdition vs. Director? Full text searches don't hurt performance too bad? Thanks for the other links, I will certainly go read up on them. From tss at iki.fi Thu Jun 21 23:22:44 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 21 Jun 2012 23:22:44 +0300 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> Message-ID: <1340310164.5967.86.camel@hurina> On Thu, 2012-06-21 at 13:05 -0700, email builder wrote: > Thank you very much for the fast reply. > > >> We are building a new system that will support a large number of users > > >> (high volume, high concurrent usage, etc). We have played with Dovecot, but in > >> most serious applications we have traditionally used Courier IMAP. It's my > >> (lay) understanding that with indexing and perhaps other things in Dovecot, it > >> might perform better than Courier in larger environments like this. Am I > >> correct or is it less clear-cut? > > > > If you disable index index files in Dovecot, its performance should be slightly > > better than Courier. With index files the performance is typically much better > > in Dovecot, especially if you use a (non-caching) webmail. > > Interesting. What would be the motivations for disabling indexing? > Indexing is by default enabled? Yes, enabled by default. There aren't many good reasons for disabling indexing. > Do you know what webmails are caching vs. non-caching? Nearly all of them are non-caching. (I don't know of any caching ones.) > Am I correct that what you're pointing out is that with non-caching > webmails you will notice IMAP performance differences more readily > but that a caching webmail application might be better no matter > which IMAP server because it reduces the need for webmail to make > IMAP connections? It's not about the IMAP connections themselves, but how often they fetch message (meta)data. http://www.imapwiki.org/Benchmarking should explain this better. Dovecot's indexing can lower the disk I/O usage perhaps by 10x compared to Courier. > >> Any tips on making the migration (not migrating an existing system, I mean > >> migrating our paradigm - things to consider, things to watch out for)? > > > > If you don't migrate any existing users, I guess this doesn't differ > > much from any other optimized Dovecot installation. Usually large installations > > (>1M users) use NetApp NFS + Dovecot director. You might also want to enable > > full text searches. http://wiki2.dovecot.org/PerformanceTuning lists some other > > things. > > Ah, I didn't know about Director. That looks very nice. I had in mind that > we would have to use Perdition, but an integrated solution might be good. > > Anyone have any thoughts or opinions considering Perdition vs. Director? Dovecot proxy has several Dovecot-specific features that make it work better than perdition (forwards client IP address to backend, handle CAPABILITY stuff better, maybe other things). > Full text searches don't hurt performance too bad? They should improve the performance, at least from the user's point of view when doing a search on webmail. But yes, the indexing itself does cost CPU cycles, disk I/O and disk usage (perhaps 30% more disk space). From h.reindl at thelounge.net Thu Jun 21 23:34:15 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 21 Jun 2012 22:34:15 +0200 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <1340310164.5967.86.camel@hurina> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> Message-ID: <4FE38547.4060407@thelounge.net> Am 21.06.2012 22:22, schrieb Timo Sirainen: >> Do you know what webmails are caching vs. non-caching? > > Nearly all of them are non-caching. (I don't know of any caching ones.) roundcube can if configured additionally you should install imapproxy on the webserver wehre your webmail is running and configure the webmail for using 127.0.0.1 - so only one connection per user is persistent instead make a new one for each ajax-request -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From lists at necoro.eu Thu Jun 21 23:37:55 2012 From: lists at necoro.eu (=?UTF-8?B?UmVuw6kgTmV1bWFubg==?=) Date: Thu, 21 Jun 2012 22:37:55 +0200 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <1340310164.5967.86.camel@hurina> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> Message-ID: <4FE38623.5050303@necoro.eu> Am 21.06.2012 22:22, schrieb Timo Sirainen: > On Thu, 2012-06-21 at 13:05 -0700, email builder wrote: >> Do you know what webmails are caching vs. non-caching? > > Nearly all of them are non-caching. (I don't know of any caching ones.) At least roundcube (v0.7.1 here) has some caching options: ------------------[excerpt from roundcubes main.inc.php]------------- // Type of IMAP indexes cache. Supported values: 'db', 'apc' and 'memcache'. $rcmail_config['imap_cache'] = null; // Enables messages cache. Only 'db' cache is supported. $rcmail_config['messages_cache'] = false; -------------------------[end]---------------------------------------- But I don't know, whether this is the sort of caching you are referring to. - Ren? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From bdh at machinehum.com Thu Jun 21 23:37:52 2012 From: bdh at machinehum.com (Brian Hayden) Date: Thu, 21 Jun 2012 15:37:52 -0500 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <1340310164.5967.86.camel@hurina> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> Message-ID: On Jun 21, 2012, at 3:22 PM, Timo Sirainen wrote: > On Thu, 2012-06-21 at 13:05 -0700, email builder wrote: >> Thank you very much for the fast reply. >> >>>> We are building a new system that will support a large number of users >> >>>> (high volume, high concurrent usage, etc). We have played with Dovecot, but in >>>> most serious applications we have traditionally used Courier IMAP. It's my >>>> (lay) understanding that with indexing and perhaps other things in Dovecot, it >>>> might perform better than Courier in larger environments like this. Am I >>>> correct or is it less clear-cut? >>> >>> If you disable index index files in Dovecot, its performance should be slightly >>> better than Courier. With index files the performance is typically much better >>> in Dovecot, especially if you use a (non-caching) webmail. >> >> Interesting. What would be the motivations for disabling indexing? >> Indexing is by default enabled? > > Yes, enabled by default. There aren't many good reasons for disabling > indexing. > >> Do you know what webmails are caching vs. non-caching? > > Nearly all of them are non-caching. (I don't know of any caching ones.) Prayer, from University of Cambridge, or Chickadee, a fork of it. It's essentially a proper IMAP client in C that runs on a server, and uses HTTPS (via an embedded server, no external dependency on apache or etc.) to the end user just to deliver the display. When I was on the email project for the University of Minnesota, I modified it heavily for interface and to add some features that admins are used to having in systems where apache is involved (virtual hosts, things like that). I have it available (GPL) as a vanilla, de-branded package--Chickadee. Website is currently offline as I've been switching hosts, anyone who's interested can feel free to drop me a line. -Brian From tss at iki.fi Thu Jun 21 23:44:33 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 21 Jun 2012 23:44:33 +0300 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <4FE38547.4060407@thelounge.net> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38547.4060407@thelounge.net> Message-ID: <8A2BA8AE-3A0A-4131-9C15-7811D9E688CE@iki.fi> On 21.6.2012, at 23.34, Reindl Harald wrote: > Am 21.06.2012 22:22, schrieb Timo Sirainen: >>> Do you know what webmails are caching vs. non-caching? >> >> Nearly all of them are non-caching. (I don't know of any caching ones.) > > roundcube can if configured > > additionally you should install imapproxy on the webserver > wehre your webmail is running and configure the webmail for > using 127.0.0.1 - so only one connection per user is > persistent instead make a new one for each ajax-request Someone benchmarked Dovecot a while ago in this list with and without imapproxy and the results showed that imapproxy simply slowed things down by adding extra latency. This probably isn't true for all installations, but I don't think there's much of a difference either way. From h.reindl at thelounge.net Thu Jun 21 23:48:03 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 21 Jun 2012 22:48:03 +0200 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <8A2BA8AE-3A0A-4131-9C15-7811D9E688CE@iki.fi> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38547.4060407@thelounge.net> <8A2BA8AE-3A0A-4131-9C15-7811D9E688CE@iki.fi> Message-ID: <4FE38883.8000808@thelounge.net> Am 21.06.2012 22:44, schrieb Timo Sirainen: > On 21.6.2012, at 23.34, Reindl Harald wrote: > >> Am 21.06.2012 22:22, schrieb Timo Sirainen: >>>> Do you know what webmails are caching vs. non-caching? >>> >>> Nearly all of them are non-caching. (I don't know of any caching ones.) >> >> roundcube can if configured >> >> additionally you should install imapproxy on the webserver >> wehre your webmail is running and configure the webmail for >> using 127.0.0.1 - so only one connection per user is >> persistent instead make a new one for each ajax-request > > Someone benchmarked Dovecot a while ago in this list with and without imapproxy and the results showed that imapproxy simply slowed things down by adding extra latency. This probably isn't true for all installations, but I don't think there's much of a difference either way. depends on network-latency, parallel users and last but not least count of folders - if you have 30 folders and roundcube refreshs every 20 seconds it will make in the worst case 180 connections for one user per minute maybe a bechmark with high load shows other values but felt performance in our setup is much better with imapproxy in front - roundcube feels like a desktop client -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From tss at iki.fi Thu Jun 21 23:52:22 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 21 Jun 2012 23:52:22 +0300 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <4FE38883.8000808@thelounge.net> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38547.4060407@thelounge.net> <8A2BA8AE-3A0A-4131-9C15-7811D9E688CE@iki.fi> <4FE38883.8000808@thelounge.net> Message-ID: <2ABE733D-E478-4B40-93FB-8F1CDAB72193@iki.fi> On 21.6.2012, at 23.48, Reindl Harald wrote: >> Someone benchmarked Dovecot a while ago in this list with and without imapproxy and the results showed that imapproxy simply slowed things down by adding extra latency. This probably isn't true for all installations, but I don't think there's much of a difference either way. > > depends on network-latency, parallel users and last but > not least count of folders - if you have 30 folders and > roundcube refreshs every 20 seconds it will make in the > worst case 180 connections for one user per minute Really? Doesn't it simply connect once every 20 seconds and send 30 STATUS requests in one connection? From h.reindl at thelounge.net Thu Jun 21 23:54:23 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 21 Jun 2012 22:54:23 +0200 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <2ABE733D-E478-4B40-93FB-8F1CDAB72193@iki.fi> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38547.4060407@thelounge.net> <8A2BA8AE-3A0A-4131-9C15-7811D9E688CE@iki.fi> <4FE38883.8000808@thelounge.net> <2ABE733D-E478-4B40-93FB-8F1CDAB72193@iki.fi> Message-ID: <4FE389FF.2080106@thelounge.net> Am 21.06.2012 22:52, schrieb Timo Sirainen: > On 21.6.2012, at 23.48, Reindl Harald wrote: > >>> Someone benchmarked Dovecot a while ago in this list with and without imapproxy and the results showed that imapproxy simply slowed things down by adding extra latency. This probably isn't true for all installations, but I don't think there's much of a difference either way. >> >> depends on network-latency, parallel users and last but >> not least count of folders - if you have 30 folders and >> roundcube refreshs every 20 seconds it will make in the >> worst case 180 connections for one user per minute > > Really? Doesn't it simply connect once every 20 seconds and send 30 STATUS requests in one connection? not 100% sure i simply tried it with proxy, was happy that it feels faster and last but not least i have lesser entries in maillog which goes to a central mysql-server for self-developed web-interfaces -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From tss at iki.fi Thu Jun 21 23:57:18 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 21 Jun 2012 23:57:18 +0300 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <4FE38883.8000808@thelounge.net> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38547.4060407@thelounge.net> <8A2BA8AE-3A0A-4131-9C15-7811D9E688CE@iki.fi> <4FE38883.8000808@thelounge.net> Message-ID: <03B002D3-5C2D-49CB-A94E-C0F2CC086746@iki.fi> On 21.6.2012, at 23.48, Reindl Harald wrote: >> Someone benchmarked Dovecot a while ago in this list with and without imapproxy and the results showed that imapproxy simply slowed things down by adding extra latency. This probably isn't true for all installations, but I don't think there's much of a difference either way. > > depends on network-latency, parallel users and last but > not least count of folders - if you have 30 folders and > roundcube refreshs every 20 seconds it will make in the > worst case 180 connections for one user per minute > > maybe a bechmark with high load shows other values > > but felt performance in our setup is much better with > imapproxy in front - roundcube feels like a desktop client Oh, and of course it also depends on Dovecot configuration :) Authentication cache is needed and login processes must be in high performance mode. There is still the extra work of forking a new imap process (could also be avoided with yet another config option) and some other extra CPU usage, but those shouldn't cause much of a difference. The extra network latency during login is a good point though. From slusarz at curecanti.org Fri Jun 22 00:07:52 2012 From: slusarz at curecanti.org (Michael M Slusarz) Date: Thu, 21 Jun 2012 15:07:52 -0600 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <1340310164.5967.86.camel@hurina> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> Message-ID: <20120621150752.Horde.Mln7K4F5lbhP440ot73xbcA@bigworm.curecanti.org> Quoting Timo Sirainen : > On Thu, 2012-06-21 at 13:05 -0700, email builder wrote: >> Do you know what webmails are caching vs. non-caching? > > Nearly all of them are non-caching. (I don't know of any caching ones.) IMP is caching (message/mailbox/folder listing), with full QRESYNC/CONDSTORE support. michael From lists at wildgooses.com Fri Jun 22 00:48:31 2012 From: lists at wildgooses.com (Ed W) Date: Thu, 21 Jun 2012 22:48:31 +0100 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <4FE389FF.2080106@thelounge.net> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38547.4060407@thelounge.net> <8A2BA8AE-3A0A-4131-9C15-7811D9E688CE@iki.fi> <4FE38883.8000808@thelounge.net> <2ABE733D-E478-4B40-93FB-8F1CDAB72193@iki.fi> <4FE389FF.2080106@thelounge.net> Message-ID: <4FE396AF.4070309@wildgooses.com> On 21/06/2012 21:54, Reindl Harald wrote: > and last but not least i have lesser entries in maillog which > goes to a central mysql-server for self-developed web-interfaces I recently added imapproxy to my Roundcube installation. Benchmarks showed a very slight slowdown, but as you point out it reduced the login count from dovecot and I use a login script to kind of report last login / length of session and this tallies better with an imap desktop user now I think the conclusion is that imapproxy is not necessary. There are some advantages (eg with high network latency between web and imap server, and reducing apparent login count), and some disadvantages (extra complexity, slowdown) On average I think few users should use it.. Or at least benchmark and add it reluctantly... Ed From lists at wildgooses.com Fri Jun 22 00:55:04 2012 From: lists at wildgooses.com (Ed W) Date: Thu, 21 Jun 2012 22:55:04 +0100 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <4FE38623.5050303@necoro.eu> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38623.5050303@necoro.eu> Message-ID: <4FE39838.1030508@wildgooses.com> On 21/06/2012 21:37, Ren? Neumann wrote: > Am 21.06.2012 22:22, schrieb Timo Sirainen: >> On Thu, 2012-06-21 at 13:05 -0700, email builder wrote: >>> Do you know what webmails are caching vs. non-caching? >> Nearly all of them are non-caching. (I don't know of any caching ones.) > At least roundcube (v0.7.1 here) has some caching options: > > ------------------[excerpt from roundcubes main.inc.php]------------- > // Type of IMAP indexes cache. Supported values: 'db', 'apc' and 'memcache'. > $rcmail_config['imap_cache'] = null; > > // Enables messages cache. Only 'db' cache is supported. > $rcmail_config['messages_cache'] = false; > -------------------------[end]---------------------------------------- > > But I don't know, whether this is the sort of caching you are referring to. > > - Ren? It is caching, but unless your mysql / memcache server is lower latency than your dovecot server, then the caching does very little. I tested it very briefly and it added a lot of latency to my results when adding a mysql cache. However, my setup has the mysql/dovecot/roundcube all on the same machine, so latency is minimal. Roughly I found that the amount of caching is absolutely massive, eg roughly subject headers, message ids and more for every message in every folder. This meant multiple seconds of latency on first login and then slight additional latency on every folder view. I guess this might breakeven in the situation of a roundcube installation in an office and dovecot on the far end of an ADSL line with 60-100ms+ of latency and bandwidth constraints, but it's really, really hard to see it's sensible for two machines in the same datacenter with an uncontended network connection between them This isn't to say that the caching isn't sensible for use with other mail servers, but I don't see it offers any benefit for most Dovecot installations? However, very clever and full featured webmail client! Ed W P.S. Sogo has a kind of caching in that it has a clientside javascript cache. Not what was meant, but for all practical purposes much more useful... From slusarz at curecanti.org Fri Jun 22 00:58:01 2012 From: slusarz at curecanti.org (Michael M Slusarz) Date: Thu, 21 Jun 2012 15:58:01 -0600 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <4FE396AF.4070309@wildgooses.com> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38547.4060407@thelounge.net> <8A2BA8AE-3A0A-4131-9C15-7811D9E688CE@iki.fi> <4FE38883.8000808@thelounge.net> <2ABE733D-E478-4B40-93FB-8F1CDAB72193@iki.fi> <4FE389FF.2080106@thelounge.net> <4FE396AF.4070309@wildgooses.com> Message-ID: <20120621155801.Horde.YXauVYF5lbhP45jpl_ezE_A@bigworm.curecanti.org> Quoting Ed W : > I think the conclusion is that imapproxy is not necessary. There > are some advantages (eg with high network latency between web and > imap server, and reducing apparent login count), and some > disadvantages (extra complexity, slowdown) Not entirely true. See this thread: http://markmail.org/thread/z7ctwle2go6zafas Thread in short: imapproxy provides benefits for more MUAs that take advantage of the XIMAPPROXY feature (only IMP, AFAIK), and Timo is/was considering adding a similar state saving feature to Dovecot 2.2. michael From tss at iki.fi Fri Jun 22 01:12:04 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 22 Jun 2012 01:12:04 +0300 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <20120621155801.Horde.YXauVYF5lbhP45jpl_ezE_A@bigworm.curecanti.org> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38547.4060407@thelounge.net> <8A2BA8AE-3A0A-4131-9C15-7811D9E688CE@iki.fi> <4FE38883.8000808@thelounge.net> <2ABE733D-E478-4B40-93FB-8F1CDAB72193@iki.fi> <4FE389FF.2080106@thelounge.net> <4FE396AF.4070309@wildgooses.com> <20120621155801.Horde.YXauVYF5lbhP45jpl_ezE_A@bigworm.curecanti.org> Message-ID: On 22.6.2012, at 0.58, Michael M Slusarz wrote: >> I think the conclusion is that imapproxy is not necessary. There are some advantages (eg with high network latency between web and imap server, and reducing apparent login count), and some disadvantages (extra complexity, slowdown) > > Not entirely true. See this thread: > > http://markmail.org/thread/z7ctwle2go6zafas > > Thread in short: imapproxy provides benefits for more MUAs that take advantage of the XIMAPPROXY feature (only IMP, AFAIK), and Timo is/was considering adding a similar state saving feature to Dovecot 2.2. Well, I had completely forgotten about it :) Reading my old mail: > There isn't a whole lot of state to be saved really. Mailbox GUID, UIDVALIDITY, > HIGHESTMODSEQ gives the mailbox state. Then you have the language/etc. states. > Clients could restore their earlier state from days ago, as long as Dovecot > still has the necessary .log records available (similar to how QRESYNC works). Yeah .. Perhaps something like: 1. if client issues LOGOUT XSTATE 2. And server sees that it can actually save all of the state (some things are a bit tricky, and probably not worth the trouble in initial implementation) 3. Then the server server sends * OK XSTATE * BYE 4. The client can pipeline after LOGIN/AUTHENTICATE: a XSTATERESTORE a OK Yeah! or a NO Not gonna work. Perhaps even a real RFC for this thing? .. If it's worth it.. Would save at least a few X bytes from network traffic :) From yggdrasil at gmx.co.uk Fri Jun 22 02:28:10 2012 From: yggdrasil at gmx.co.uk (Johnny) Date: Fri, 22 Jun 2012 00:28:10 +0100 Subject: [Dovecot] Dovecot LDA, Offlineimap and Sieve Message-ID: <87y5ng1bzp.fsf@gmx.co.uk> Hi, I am trying to st up Offlineimap to use Dovecots LDA to be able to use Sieve for mail filtering, but am not sure how to get this working. I think the right way would be to use 'preauthtunnel' in .offlineimaprc and try the setup below, which doesn't work. ,----.offlineimaprc | [Repository LocalRepository] | type = IMAP | preauthtunnel = ssh -q localhost '/usr/libexec/dovecot/deliver -d myloginid' `---- If I go via the network card, the snch is fine, but Sieve can't be used? ,---- | [Repository LocalRepository] | type = IMAP | preauthtunnel = MAIL=maildir:$HOME/Maildir/myMailDir /usr/libexec/dovecot/deliver -d mylogonid | remotehost = localhost | port = 143 | remoteuser = mylogonid | remotepass = mypassword `---- Has anyone got any tips on how to get offlineimap to send mail to Dovecot in a way that Siev3e can be used? thanks! -- Johnny From a.kostyrev at serverc.ru Fri Jun 22 05:27:38 2012 From: a.kostyrev at serverc.ru (=?koi8-r?B?68/T1NnSxdcg4czFy9PBzsTSIOHMxcvTxcXXyd4=?=) Date: Fri, 22 Jun 2012 13:27:38 +1100 Subject: [Dovecot] GlusterFS + Dovecot In-Reply-To: <7f9a01cd4efc$732ac3c0$59804b40$@h-st.com> References: <7f9a01cd4efc$732ac3c0$59804b40$@h-st.com> Message-ID: <213B51F00051AE48A9F0E112880177178F7A43@Delta.sc.local> We've considered using gluster for our mail storage a month ago. I've seen index corruption even if mail was delivered by lmtp sequentially some split-brains with no clear reason with more than 2000 mails in box we had to wait for 40sec to open mailbox through roundcube, so we've decided to go for dsync replication instead with common mysql database for user storage and imap/pop3/lmtp proxy. -----Original Message----- From: dovecot-bounces at dovecot.org [mailto:dovecot-bounces at dovecot.org] On Behalf Of Romer Ventura Sent: Thursday, June 21, 2012 2:51 AM To: dovecot at dovecot.org Subject: [Dovecot] GlusterFS + Dovecot Hello, Has anyone used GlusterFS as storage file system for dovecot or any other email system..? It says that it can be presented as a NFS, CIFS and as GlusterFS using the native client, technically using the client would allow the machine to read and write to it, therefore, I think that Dovecot would not care about it. Correct? Anyone out there used this setup?? Thanks. From emailbuilder88 at yahoo.com Fri Jun 22 05:28:50 2012 From: emailbuilder88 at yahoo.com (email builder) Date: Thu, 21 Jun 2012 19:28:50 -0700 (PDT) Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <03B002D3-5C2D-49CB-A94E-C0F2CC086746@iki.fi> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38547.4060407@thelounge.net> <8A2BA8AE-3A0A-4131-9C15-7811D9E688CE@iki.fi> <4FE38883.8000808@thelounge.net> <03B002D3-5C2D-49CB-A94E-C0F2CC086746@iki.fi> Message-ID: <1340332130.74182.YahooMailNeo@web39301.mail.mud.yahoo.com> > Oh, and of course it also depends on Dovecot configuration :) Authentication > cache is needed and login processes must be in high performance mode. I.e., I think: http://wiki2.dovecot.org/LoginProcess http://wiki2.dovecot.org/Authentication/Caching > There is > still the extra work of forking a new imap process (could also be avoided with > yet another config option) Are you referring to client_limit or service_count or something else as yet undeveloped? Speaking of which, I cannot understand the different between those two.? Hints in the configuration file (10-master.conf) and the wiki make them sound like they do the same thing -- ?? From tss at iki.fi Fri Jun 22 05:44:18 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 22 Jun 2012 05:44:18 +0300 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <1340332130.74182.YahooMailNeo@web39301.mail.mud.yahoo.com> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38547.4060407@thelounge.net> <8A2BA8AE-3A0A-4131-9C15-7811D9E688CE@iki.fi> <4FE38883.8000808@thelounge.net> <03B002D3-5C2D-49CB-A94E-C0F2CC086746@iki.fi> <1340332130.74182.YahooMailNeo@web39301.mail.mud.yahoo.com> Message-ID: On 22.6.2012, at 5.28, email builder wrote: >> Oh, and of course it also depends on Dovecot configuration :) Authentication >> cache is needed and login processes must be in high performance mode. > > I.e., I think: > > http://wiki2.dovecot.org/LoginProcess > http://wiki2.dovecot.org/Authentication/Caching Yes. >> There is >> still the extra work of forking a new imap process (could also be avoided with >> yet another config option) > > Are you referring to client_limit or service_count or something else as yet undeveloped? service imap { service_count = 0 } (default=1) allows imap processes to be reused for more than 1 connection. The downside is that if there are any bugs in Dovecot, they might accidentally expose another user's email data to the wrong user. That's very unlikely to happen but since this isn't a performance problem in most (if any) systems I don't want to enable it by default. Dovecot code is written so that write buffer overflows (= arbitrary code execution) is minimized to be as zero possibility as I could think of, but read buffer overflows (= exposing data within the process) isn't treated nearly as much with paranoia. > Speaking of which, I cannot understand the different between those two. Hints in the > configuration file (10-master.conf) and the wiki make them sound like they do the same > thing -- ?? service_count limits the maximum of client_limit. One connection = one service. Once a process has serviced "service_count" number of connections it disconnects itself. There can never be more than "client_limit" number of simultaneous connections. The important stuff to understand about these are: * service_count=1: The most secure setting for a process. The process serves a single connection and kills itself. No possibility of data leaking to unintended connection. * service_count=0, client_limit=1: The process does blocking operations (e.g. blocking disk IO). You don't want one connection's blocking operation to affect other connections. But you're not paranoid about security, since in case of some bugs some data might leak to unintended connection. * service_count>0: Restart process ever N connections, just in case it leaks some memory. * client_limit>1: Limit the amount of CPU/memory a single process takes. The process should never be blocking on disk I/O or locks or anything else. This means it shouldn't be used for imap/pop3/lmtp processes. For CPU bound processes it's fine. Maybe these could be copy&pasted to the wiki2/Services. From emailbuilder88 at yahoo.com Fri Jun 22 08:27:18 2012 From: emailbuilder88 at yahoo.com (email builder) Date: Thu, 21 Jun 2012 22:27:18 -0700 (PDT) Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38547.4060407@thelounge.net> <8A2BA8AE-3A0A-4131-9C15-7811D9E688CE@iki.fi> <4FE38883.8000808@thelounge.net> <03B002D3-5C2D-49CB-A94E-C0F2CC086746@iki.fi> <1340332130.74182.YahooMailNeo@web39301.mail.mud.yahoo.com> Message-ID: <1340342838.42261.YahooMailNeo@web39303.mail.mud.yahoo.com> >>> Oh, and of course it also depends on Dovecot configuration :) >>> Authentication >>> cache is needed and login processes must be in high performance mode. >> >> I.e., I think: >> >> http://wiki2.dovecot.org/LoginProcess >> http://wiki2.dovecot.org/Authentication/Caching > > Yes. > >>> There is >>> still the extra work of forking a new imap process (could also be >>> avoided with >>> yet another config option) >> >> Are you referring to client_limit or service_count or something else as yet >> undeveloped? > > service imap { service_count = 0 } (default=1) allows imap processes to be > reused for more than 1 connection. The downside is that if there are any bugs in > Dovecot, they might accidentally expose another user's email data to the > wrong user. That's very unlikely to happen but since this isn't a > performance problem in most (if any) systems I don't want to enable it by > default. Dovecot code is written so that write buffer overflows (= arbitrary > code execution) is minimized to be as zero possibility as I could think of, but > read buffer overflows (= exposing data within the process) isn't treated > nearly as much with paranoia. > >> Speaking of which, I cannot understand the different between those two.? >> Hints in the >> configuration file (10-master.conf) and the wiki make them sound like they >> do the same >> thing -- ?? > > service_count limits the maximum of client_limit. One connection = one service. > Once a process has serviced "service_count" number of connections it > disconnects itself. There can never be more than "client_limit" number > of simultaneous connections. The important stuff to understand about these are: > > * service_count=1: The most secure setting for a process. The process serves a > single connection and kills itself. No possibility of data leaking to unintended > connection. > * service_count=0, client_limit=1: The process does blocking operations (e.g. > blocking disk IO). You don't want one connection's blocking operation to > affect other connections. But you're not paranoid about security, since in > case of some bugs some data might leak to unintended connection. > * service_count>0: Restart process ever N connections, just in case it leaks > some memory. > * client_limit>1: Limit the amount of CPU/memory a single process takes. The > process should never be blocking on disk I/O or locks or anything else. This > means it shouldn't be used for imap/pop3/lmtp processes. For CPU bound > processes it's fine. So really, a new process is created under *two* circumstances?? 1. when a process reaches client_limit number of *simultaneous* connections or? 2. when a process has serviced service_count number of connections.? Is this correct? So for service *-login, is it OK to do something like service_count=5000, client_limit=2000 Thanks for the help!??? From aerion82 at gmail.com Fri Jun 22 08:49:54 2012 From: aerion82 at gmail.com (Aerion Stevens) Date: Fri, 22 Jun 2012 15:49:54 +1000 Subject: [Dovecot] Dovecot proxy/director and mail pop3/imap backend service on same server Message-ID: Hi all, I am interested in running a Dovecot Proxy(with Director) on the same server as the main Dovecot IMAP/POP3 service. I have a basic Proxy/Director configuration working, however I am struggling with getting the Proxy and IMAP/POP3 service to coexist on the same server. I plan to use three IMAP/POP3 servers with a NFS/maildir backend, and I am playing with Dovecot 2.1.5 at the moment. I have two seperate configurations, one for the Proxy/Director and one for the Dovecot IMAP/POP3 "mail backend servers". For this to work my thoughts are that I will need to run the Proxy/Director imap/pop3 login process on the standard ports 143, 110, 993, 995 and for the Dovecot IMAP/POP3 mail backend service running on the same server will need to use different ports (I decided to be 9143, 9110, 9993, 9995 for example). How do I tell the director to proxy incoming imap/pop3 connection to the mail backend servers running on ports 9143, 9110, 9993, 9995 rather than the default imap/pop3 ports? Using the default ports will clearly cause loops. Can anyone kindly provide an example snippet of config that tells the director to use different port for IMAP and POP3 proxy? I have so far found the following pages helpful to what I am working on: http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy http://wiki2.dovecot.org/PasswordDatabase/ExtraFields http://wiki2.dovecot.org/Director Cheers, Aerion. From a.kostyrev at serverc.ru Fri Jun 22 09:29:25 2012 From: a.kostyrev at serverc.ru (=?koi8-r?B?68/T1NnSxdcg4czFy9PBzsTSIOHMxcvTxcXXyd4=?=) Date: Fri, 22 Jun 2012 17:29:25 +1100 Subject: [Dovecot] Dovecot proxy/director and mail pop3/imap backend serviceon same server In-Reply-To: References: Message-ID: <213B51F00051AE48A9F0E112880177178F7A46@Delta.sc.local> I've already tortured Timo about that. check this thread out: http://www.dovecot.org/list/dovecot/2012-June/066315.html -----Original Message----- From: dovecot-bounces at dovecot.org [mailto:dovecot-bounces at dovecot.org] On Behalf Of Aerion Stevens Sent: Friday, June 22, 2012 4:50 PM To: dovecot at dovecot.org Subject: [Dovecot] Dovecot proxy/director and mail pop3/imap backend serviceon same server Hi all, I am interested in running a Dovecot Proxy(with Director) on the same server as the main Dovecot IMAP/POP3 service. I have a basic Proxy/Director configuration working, however I am struggling with getting the Proxy and IMAP/POP3 service to coexist on the same server. I plan to use three IMAP/POP3 servers with a NFS/maildir backend, and I am playing with Dovecot 2.1.5 at the moment. I have two seperate configurations, one for the Proxy/Director and one for the Dovecot IMAP/POP3 "mail backend servers". For this to work my thoughts are that I will need to run the Proxy/Director imap/pop3 login process on the standard ports 143, 110, 993, 995 and for the Dovecot IMAP/POP3 mail backend service running on the same server will need to use different ports (I decided to be 9143, 9110, 9993, 9995 for example). How do I tell the director to proxy incoming imap/pop3 connection to the mail backend servers running on ports 9143, 9110, 9993, 9995 rather than the default imap/pop3 ports? Using the default ports will clearly cause loops. Can anyone kindly provide an example snippet of config that tells the director to use different port for IMAP and POP3 proxy? I have so far found the following pages helpful to what I am working on: http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy http://wiki2.dovecot.org/PasswordDatabase/ExtraFields http://wiki2.dovecot.org/Director Cheers, Aerion. From stephan at rename-it.nl Fri Jun 22 10:08:05 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 22 Jun 2012 09:08:05 +0200 Subject: [Dovecot] Manual manipulation of Sieve files In-Reply-To: <1340303566.38480.YahooMailNeo@web39306.mail.mud.yahoo.com> References: <1340303566.38480.YahooMailNeo@web39306.mail.mud.yahoo.com> Message-ID: <4FE419D5.1060409@rename-it.nl> On 6/21/2012 8:32 PM, email builder wrote: > We have some scripts that take care of some tasks when creating new email accounts, such as creating some default mail filter rules. > > I know Sieve scripts are plain text files, but need to be compiled for use. I see that you can use seivec to compile scripts manually, which can help me create .dovecot.svbin which can be placed where needed and permissioned correctly. But a couple questions: > > * Sieve has the concept of an active script - is this merely whatever is compiled into the .dovecot.svbin file? This is the script file that the sieve= setting points to. The term 'active' only has real meaning when ManageSieve is used. Then, the active script file is a symbolic link that points into the sieve_dir= directory, thereby selecting which script is active. > * Does dovecot (managesieve) do any other housekeeping when a user sieve script is installed and set as the active script? I would need to replicate this manually. It makes the symbolic link. Compiling the script is done automatically when the script is first executed at delivery. > * If the default script is always the same (sorry, for us, the solution isn't global scripts), would it work to compile that script once, keep the compiled version somewhere and merely copy it into the correct place for a new user? Are there issues with this? You can pre-compile it, but the plaintext script must also exist at the indicated location. Sieve always looks for the plaintext script and only when that is found it checks for the presence of an earlier compiled binary. > * Should we always have the plain text version along with the compiled one for proper managesieve operation going forward (users can edit their sieve scripts) Yes. Regards, Stephan. From stephan at rename-it.nl Fri Jun 22 10:10:20 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 22 Jun 2012 09:10:20 +0200 Subject: [Dovecot] Dovecot LDA, Offlineimap and Sieve In-Reply-To: <87y5ng1bzp.fsf@gmx.co.uk> References: <87y5ng1bzp.fsf@gmx.co.uk> Message-ID: <4FE41A5C.4050609@rename-it.nl> On 6/22/2012 1:28 AM, Johnny wrote: > Hi, > > I am trying to st up Offlineimap to use Dovecots LDA to be able to use > Sieve for mail filtering, but am not sure how to get this working. I > think the right way would be to use 'preauthtunnel' in .offlineimaprc > and try the setup below, which doesn't work. [...] > Has anyone got any tips on how to get offlineimap to send mail to > Dovecot in a way that Siev3e can be used? Could you show your dovecot config (dovecot -n output) here? I'm wondering whether you have enabled the Sieve plugin for LDA. Regards, Stephan. From emailbuilder88 at yahoo.com Fri Jun 22 10:32:12 2012 From: emailbuilder88 at yahoo.com (email builder) Date: Fri, 22 Jun 2012 00:32:12 -0700 (PDT) Subject: [Dovecot] Manual manipulation of Sieve files In-Reply-To: <4FE419D5.1060409@rename-it.nl> References: <1340303566.38480.YahooMailNeo@web39306.mail.mud.yahoo.com> <4FE419D5.1060409@rename-it.nl> Message-ID: <1340350332.34438.YahooMailNeo@web39301.mail.mud.yahoo.com> Thanks for the reply -- >> We have some scripts that take care of some tasks when creating new email > accounts, such as creating some default mail filter rules. >> >> I know Sieve scripts are plain text files, but need to be compiled for >> use.? I see that you can use seivec to compile scripts manually, which can help >> me create .dovecot.svbin which can be placed where needed and permissioned >> correctly.? But a couple questions: >> >> * Sieve has the concept of an active script - is this merely whatever is >> compiled into the .dovecot.svbin file? > > This is the script file that the sieve= setting points to. The term > 'active' only has real meaning when ManageSieve is used. Then, the > active script file is a symbolic link that points into the sieve_dir= directory, > thereby selecting which script is active. > >> * Does dovecot (managesieve) do any other housekeeping when a user sieve >> script is installed and set as the active script?? I would need to replicate >> this manually. > > It makes the symbolic link. Compiling the script is done automatically when the > script is first executed at delivery. > >> * If the default script is always the same (sorry, for us, the solution >> isn't global scripts), would it work to compile that script once, keep the >> compiled version somewhere and merely copy it into the correct place for a new >> user?? Are there issues with this? > > You can pre-compile it, but the plaintext script must also exist at the > indicated location. Sieve always looks for the plaintext script and only when > that is found it checks for the presence of an earlier compiled binary. Oh, so it's even easier.? Our setup script can just put the plain text sieve script in the right place, create the .dovecot.sieve symlink and that's enough? Pasting in a precompiled would save a few CPU cycles upon first delivery? Great, thanks again. From emailbuilder88 at yahoo.com Fri Jun 22 10:42:47 2012 From: emailbuilder88 at yahoo.com (email builder) Date: Fri, 22 Jun 2012 00:42:47 -0700 (PDT) Subject: [Dovecot] LDA vs maildrop... LDA *and* maildrop? Message-ID: <1340350967.56083.YahooMailNeo@web39305.mail.mud.yahoo.com> We're considering a move from Courier to Dovecot.? So far, looks like it's not too bad, but the most challenging obstacle is what to do about our local delivery.? Factors: 1. we use a lot of maildrop "features" that are impossible in sieve without piping to an external program (would rather not re-write our working maildrop scripts in another language) 2. would love to try dbox 3. we use IMAP/Maildir++ quotas (looks like with a little finesse it's possible to get maildrop and dovecot to play nice on this account, yes?) I saw it suggested to just call LDA from maildrop for any maildrop "to" commands (hmmm, what about "cc"?) here: http://article.gmane.org/gmane.mail.imap.dovecot/56120 How much overhead will this take?? Would it be possible or advisable to use LMTP instead if that would help?? Is this idea just too crazy? From emailbuilder88 at yahoo.com Fri Jun 22 11:24:27 2012 From: emailbuilder88 at yahoo.com (email builder) Date: Fri, 22 Jun 2012 01:24:27 -0700 (PDT) Subject: [Dovecot] LDA vs maildrop... LDA *and* maildrop? In-Reply-To: <1340350967.56083.YahooMailNeo@web39305.mail.mud.yahoo.com> References: <1340350967.56083.YahooMailNeo@web39305.mail.mud.yahoo.com> Message-ID: <1340353467.4539.YahooMailNeo@web39306.mail.mud.yahoo.com> > We're considering a move from Courier to Dovecot.? So far, looks like > it's not too bad, but the most challenging obstacle is what to do about > our local delivery.? Factors: > > 1. we use a lot of maildrop "features" that are impossible in sieve > > without piping to an external program (would rather not re-write our > working maildrop scripts in another language) > > 2. would love to try dbox > > 3. we use IMAP/Maildir++ quotas (looks like with a little finesse > it's possible to get maildrop and dovecot to play nice on this > account, yes?) > > > I saw it suggested to just call LDA from maildrop for any maildrop > "to" commands (hmmm, what about "cc"?) here: > > http://article.gmane.org/gmane.mail.imap.dovecot/56120 > > How much overhead will this take?? Would it be possible or > advisable to use LMTP instead if that would help?? Is this > idea just too crazy? Oh, doing this would also have benefit of updating dovecot indexes upon delivery, and we could ignore point 3 about the quotas and just let dovecot handle deliver time quotas too right?? (remove quota support from maildrop) Also saw a suggestion to do it a little different: http://article.gmane.org/gmane.mail.imap.dovecot/44897 So maildrop to "| foo" to "! foo at bar.com" cc "| foo" cc "! foo at bar.com" are left as is then to "" is replaced with either: xfilter "/usr/lib/dovecot/dovecot-lda -m " to "| /dev/null" or just: to "| /usr/lib/dovecot/dovecot-lda -m " and cc "" is replaced with either: xfilter "/usr/lib/dovecot/dovecot-lda -m " or just: cc "| /usr/lib/dovecot/dovecot-lda -m " and the default end-of-script (INBOX) delivery for maildrop (an assumed "to 'INBOX'" command) can probably be replaced with one or the other of: xfilter "/usr/lib/dovecot/dovecot-lda" to "| /dev/null" or: to "| /usr/lib/dovecot/dovecot-lda" Does any of this make sense?? I wonder how it will look to the MTA (postfix here) when delivery fails.? It's also creating duplicate user lookups for the two delivery agents which isn't great. Maybe it'd be better to consider learning how to re-write our needed maildrop scripts as shell scripts (maildrop is close enough to bash I guess) and making sieve pipe out to them? From Ralf.Hildebrandt at charite.de Fri Jun 22 11:48:32 2012 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Fri, 22 Jun 2012 10:48:32 +0200 Subject: [Dovecot] LDA vs maildrop... LDA *and* maildrop? In-Reply-To: <1340350967.56083.YahooMailNeo@web39305.mail.mud.yahoo.com> References: <1340350967.56083.YahooMailNeo@web39305.mail.mud.yahoo.com> Message-ID: <20120622084832.GH16499@charite.de> * email builder : > 1. we use a lot of maildrop "features" that are impossible in sieve We're calling deliver from maildropc > 2. would love to try dbox For that you'd need to call deliver from maildropc > 3. we use IMAP/Maildir++ quotas (looks like with a little finesse > it's possible to get maildrop and dovecot to play nice on this > account, yes?) deliver/dovecot is handling Maildir++ quotas just fine. > How much overhead will this take?? Would it be possible or > advisable to use LMTP instead if that would help?? Is this > idea just too crazy? does maildrop speak LMTP? -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From emailbuilder88 at yahoo.com Fri Jun 22 11:59:19 2012 From: emailbuilder88 at yahoo.com (email builder) Date: Fri, 22 Jun 2012 01:59:19 -0700 (PDT) Subject: [Dovecot] LDA vs maildrop... LDA *and* maildrop? In-Reply-To: <20120622084832.GH16499@charite.de> References: <1340350967.56083.YahooMailNeo@web39305.mail.mud.yahoo.com> <20120622084832.GH16499@charite.de> Message-ID: <1340355559.56885.YahooMailNeo@web39306.mail.mud.yahoo.com> >> 1. we use a lot of maildrop "features" that are impossible in >> sieve > > We're calling deliver from maildropc Ah, so this is actually sane enough of an idea that someone really uses it?? Is the performance reasonable?? Bounces or deferred mail all work as expected?? What syntax did you use to replace to/cc with calls to LDA? >> 2. would love to try dbox > > For that you'd need to call deliver from maildropc I take it you didn't try this >> 3. we use IMAP/Maildir++ quotas (looks like with a little finesse >> it's possible to get maildrop and dovecot to play nice on this >> account, yes?) > > deliver/dovecot is handling Maildir++ quotas just fine. But if you call dovecot LDA you're not limited to Maildir++ quotas, right?? You can strip quota support out of maildrop and just let dovecot LDA and dovecot IMAP enforce quotas which keeps things more simple, no? >> How much overhead will this take?? Would it be possible or >> advisable to use LMTP instead if that would help?? Is this >> idea just too crazy? > > does maildrop speak LMTP? Good point From Ralf.Hildebrandt at charite.de Fri Jun 22 12:27:13 2012 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Fri, 22 Jun 2012 11:27:13 +0200 Subject: [Dovecot] LDA vs maildrop... LDA *and* maildrop? In-Reply-To: <1340355559.56885.YahooMailNeo@web39306.mail.mud.yahoo.com> References: <1340350967.56083.YahooMailNeo@web39305.mail.mud.yahoo.com> <20120622084832.GH16499@charite.de> <1340355559.56885.YahooMailNeo@web39306.mail.mud.yahoo.com> Message-ID: <20120622092713.GJ16499@charite.de> * email builder : > > >> 1. we use a lot of maildrop "features" that are impossible in > > >> sieve > > > > We're calling deliver from maildropc > > Ah, so this is actually sane enough of an idea that someone > really uses it?? Is the performance reasonable?? Bounces or > deferred mail all work as expected?? What syntax did you use > to replace to/cc with calls to LDA? I'll send you my /etc/maildroprc it's working OK. I'm using deliver where I can, only a few things are done by maildrop/mailbot > >> 2. would love to try dbox > > > > For that you'd need to call deliver from maildropc > > I take it you didn't try this Exactly. > >> 3. we use IMAP/Maildir++ quotas (looks like with a little finesse > >> it's possible to get maildrop and dovecot to play nice on this > >> account, yes?) > > > > deliver/dovecot is handling Maildir++ quotas just fine. > > But if you call dovecot LDA you're not limited to Maildir++ > quotas, right? Correct. > ? You can strip quota support out of maildrop and just let dovecot LDA > and dovecot IMAP enforce quotas which keeps things more simple, no? Since I'm delegating all delivery to deliver, except for pipes, I'm using the quota facilities of deliver/dovecot -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From tss at iki.fi Fri Jun 22 12:47:31 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 22 Jun 2012 12:47:31 +0300 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <1340342838.42261.YahooMailNeo@web39303.mail.mud.yahoo.com> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38547.4060407@thelounge.net> <8A2BA8AE-3A0A-4131-9C15-7811D9E688CE@iki.fi> <4FE38883.8000808@thelounge.net> <03B002D3-5C2D-49CB-A94E-C0F2CC086746@iki.fi> <1340332130.74182.YahooMailNeo@web39301.mail.mud.yahoo.com> <1340342838.42261.YahooMailNeo@web39303.mail.mud.yahoo.com> Message-ID: <33DFF34D-EC88-4DBB-8B10-EA6BA1597F64@iki.fi> On 22.6.2012, at 8.27, email builder wrote: > So really, a new process is created under *two* circumstances? 1. when a > process reaches client_limit number of *simultaneous* connections or 2. when > a process has serviced service_count number of connections. Is this correct? Yes. > So for service *-login, is it OK to do something like service_count=5000, client_limit=2000 It would work, but for login processes the service_count can be 0. I haven't seen them leaking any memory recently. One somewhat annoying thing with service_count>1 is that the processes have to wait until all of the connections have disconnected before shutting down. For processes handling long running connections (especially IMAP) this can mean that you'll end up with a lot of processes that are ready to shutdown but a couple of connections prevent it from doing this. From yggdrasil at gmx.co.uk Fri Jun 22 14:35:09 2012 From: yggdrasil at gmx.co.uk (Johnny) Date: Fri, 22 Jun 2012 12:35:09 +0100 Subject: [Dovecot] Dovecot LDA, Offlineimap and Sieve In-Reply-To: <4FE41A5C.4050609@rename-it.nl> (Stephan Bosch's message of "Fri, 22 Jun 2012 09:10:20 +0200") References: <87y5ng1bzp.fsf@gmx.co.uk> <4FE41A5C.4050609@rename-it.nl> Message-ID: <87wr2zinpu.fsf@gmx.co.uk> Hi Stephan, Stephan Bosch writes: > On 6/22/2012 1:28 AM, Johnny wrote: >> Hi, >> >> I am trying to st up Offlineimap to use Dovecots LDA to be able to use >> Sieve for mail filtering, but am not sure how to get this working. I >> think the right way would be to use 'preauthtunnel' in .offlineimaprc >> and try the setup below, which doesn't work. > [...] >> Has anyone got any tips on how to get offlineimap to send mail to >> Dovecot in a way that Siev3e can be used? > > Could you show your dovecot config (dovecot -n output) here? I'm > wondering whether you have enabled the Sieve plugin for LDA. > I haven't set up Sieve yet, as I haven't been able to figure out how to use the Dovecot LDA. Or is this not required to run Sieve? Here's my config: ,---- | mbox_write_locks = fcntl | | namespace inbox { | | hidden = no | | inbox = yes | | list = yes | | location = | | mailbox Drafts { | | special_use = \Drafts | | } | | mailbox Junk { | | special_use = \Junk | | } | | mailbox Sent { | | special_use = \Sent | | } | | mailbox "Sent Messages" { | | special_use = \Sent | | } | | mailbox Trash { | | special_use = \Trash | | } | | prefix = | | separator = . | | subscriptions = yes | | type = private | | } | | passdb { | | args = scheme=MD5 username_format=%u /etc/dovecot/users | | driver = passwd-file | | } | | protocols = imap | | service auth { | | unix_listener auth-userdb { | | mode = 0666 | | } | | } | | ssl = required | | ssl_cert = Hi Timo, any idea whats this related too ? dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 21703727 < 25193928 -- Best Regards MfG Robert Schetterer From tss at iki.fi Fri Jun 22 16:34:33 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 22 Jun 2012 16:34:33 +0300 Subject: [Dovecot] dovecot stats error In-Reply-To: <4FE46641.4030801@schetterer.org> References: <4FE46641.4030801@schetterer.org> Message-ID: <494CA511-4DC1-402B-9A00-D0678BBB1BF4@iki.fi> On 22.6.2012, at 15.34, Robert Schetterer wrote: > Hi Timo, > any idea whats this related too ? > > dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats > shrank: mrbytes 21703727 < 25193928 Which Dovecot version? I thought I fixed this already.. From Benoit.Branciard at univ-paris1.fr Fri Jun 22 16:59:18 2012 From: Benoit.Branciard at univ-paris1.fr (Benoit Branciard) Date: Fri, 22 Jun 2012 15:59:18 +0200 Subject: [Dovecot] cumulative userdb ? Message-ID: <4FE47A36.5090003@univ-paris1.fr> in Dovecot 2.0, is it possible to have kind of "cumulative" multiple userdb ? that is, for all users: - extract some attributes (let's say: uid, gid, home) from a first userdb (Passwd for example), - an extract some other attributes (mail for example, but overwriting those from the first userdb in case of redundancy) from a second userdb (LDAP for example) ? This is *different* from the "multiple databases" setup described in http://wiki2.dovecot.org/Authentication/MultipleDatabases, where it is meant as "failover": the second database is looked up only if the user isn't found in the first database. -- Benoit BRANCIARD Service InfraStructures (SIS) - Direction du Syst?me d'Information (DSI) Universit? Paris 1 Panth?on-Sorbonne Centre Pierre Mend?s France B 406 - 90, rue de Tolbiac - 75634 Paris cedex 13 - France T?l : +33 1 44 07 89 68 - Fax : +33 1 44 07 89 66 Accueil t?l. : +33 1 44 07 89 65 Assistance : assistance-dsi at univ-paris1.fr Web : http://dsi.univ-paris1.fr -- Ce message a ete verifie par MailScanner pour des virus ou des polluriels et rien de suspect n'a ete trouve. From robertcoore at yahoo.com Fri Jun 22 18:46:35 2012 From: robertcoore at yahoo.com (robert coore) Date: Fri, 22 Jun 2012 15:46:35 +0000 (UTC) Subject: [Dovecot] permissions on auth-userdb References: Message-ID: googlemail.com> writes: > > Hi.. > > im still trying to upgrade to 2.0. > Im getting: > dovecot: lda: Error: userdb lookup: > connect(/var/run/dovecot/auth-userdb) failed: Permission denied > (euid=10000(vmail) egid=10000(vmail) missing +r perm: > /var/run/dovecot/auth-userdb, euid is not dir owner) > > the error is correct caus its owned by root. My Questions is who should own it ? > Im not sure how that works, what process/user calls the auth-userdb ? > The auth-userdb returns the args generated in master.conf, right ? > > i think comment out the user and group setting in master.conf will fix > it but im not sure if that is the securest way. > > the mails come from postfix via dovecot-lda > > Hans > > master.conf > service auth { > # auth_socket_path points to this userdb socket by default. It's typically > # used by dovecot-lda, doveadm, possibly imap process, etc. Its default > # permissions make it readable only by root, but you may need to relax these > # permissions. Users that have access to this socket are able to get a list > # of all usernames and get results of everyone's userdb lookups. > unix_listener auth-userdb { > mode = 0600 > #user = vmail > #group = vmail > } > > auth-ldap.conf.ext > passdb { > driver = ldap > args = /etc/dovecot/dovecot-ldap.conf.ext > } > userdb { > driver = static > args = uid=vmail gid=vmail home=/home/MAILBOXES/%u/ > mail=/home/MAILBOXES/%u/mail > } > > Hi all was getting the same errors took me 2 days to understand what it was saying to me but i finally solved it if you do an ls -l /var/run/dovecot/auth-userdb you will seet that root is the owner and the premissions are srw-------- so vmail has not right to call or even use the process What i did was a chown -R vmail:vmail /var/run/dovecot/auth-userdb I also did a chmod g+r /var/run/dovecot/auth-userdb ls -l /var/run/dovecot/auth-userdb srw----r-- 1 vmail vmail my unix_listener auth-userdb { mode = 600 { protocol lda { auth_socket_path = /var/run/dovecot/auth-userdb log_path = /home/vmail/dovecot-deliver.log that worked for me 1. havent restarted the dovecot service dont know if it will keep the settings. From tss at iki.fi Fri Jun 22 21:46:06 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 22 Jun 2012 21:46:06 +0300 Subject: [Dovecot] cumulative userdb ? In-Reply-To: <4FE47A36.5090003@univ-paris1.fr> References: <4FE47A36.5090003@univ-paris1.fr> Message-ID: <643DEB67-BA15-4D0A-B157-5DAAC0A4276D@iki.fi> On 22.6.2012, at 16.59, Benoit Branciard wrote: > in Dovecot 2.0, is it possible to have kind of "cumulative" multiple userdb ? > > that is, for all users: > - extract some attributes (let's say: uid, gid, home) from a first userdb (Passwd for example), > - an extract some other attributes (mail for example, but overwriting those from the first userdb in case of redundancy) from a second userdb (LDAP for example) ? I've also wanted this a few times. But no, not possible currently. From ncjeffgus at zimage.com Sat Jun 23 00:24:36 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Fri, 22 Jun 2012 14:24:36 -0700 Subject: [Dovecot] dsync error: "Mailboxes don't have unique GUIDs" Message-ID: <1340400276.12426.9.camel@maclinux> I'm getting an error backing up mailboxes. I'm using the mirror command: dsync -fvo mail_home=/home/users/bob mirror ssh vmail at 10.1.4.1 dsync -o mail_home=/home/.incoming_mail_migrations/users/bob dsync-remote(vmail): Error: Mailboxes don't have unique GUIDs: 1ef6ee37c694894d783100000581a675 is shared by INBOX and INBOX dsync-remote(vmail): Error: command BOX-LIST failed dsync-local(vmail): Error: Worker server's mailbox iteration failed The mail user doesn't yet exist on the destination yet, thus the use of the mail_home parameter. I found a mailing list message where a person was having a similar problem but I couldn't find confirmation that the issue was resolved. In our case, the backup goes from maildir to mdbox format (we can't to convert to mdbox). Things seemed to be moving along, but there are quite a few examples of dsync failing. I think the issue happens more often with large mailboxes ( > 50GB ). We're running version 2.0.13. doveconf -n: # 2.0.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-274.12.1.el5 x86_64 CentOS release 5.7 (Final) auth_mechanisms = plain login default_client_limit = 15000 default_process_limit = 10000 disable_plaintext_auth = no listen = * mail_gid = vmail mail_location = maildir:~/Maildir mail_plugins = zlib mail_uid = vmail mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. separator = . } passdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { zlib_save = gz } protocols = imap pop3 service auth { client_limit = 10000 unix_listener auth-userdb { mode = 0666 } } service imap-postlogin { executable = script-login /usr/bin/postlogin-imap.sh user = $default_internal_user } service imap { drop_priv_before_exec = yes executable = imap process_limit = 10000 } service pop3-postlogin { executable = script-login /usr/bin/postlogin-pop.sh user = $default_internal_user } } service pop3 { drop_priv_before_exec = yes executable = pop3 process_limit = 2500 } ssl_cert = References: <1339873707.2732.11.camel@amito> <20120616201636.GB6858@state-of-mind.de> Message-ID: <1340415602.12632.2.camel@amito> On Sun, 2012-06-17 at 14:04 +0200, Wojciech Puchar wrote: > >> maildir form. Reviews of kmail are very bad, and thunderbird uses the > >> mbox format for storage. > > > > If it is native maildir you can configure that/your account to use maildir and > > simply copy your mailbox over to Dovecot. When Dovecot accesses the mailbox it > > will create the necessary index files and you are ready to use it. > > if you want to use any of those hopeless programs just turn message > caching in them (folder synchronization off in thunderbird) and login to > dovecot, even on localhost. > > kmail v.3 is barely usable, v4 is good. It looks like you don't like any of the email programs we've discussed. Which email programs do you like? BTW: kmail on my system is 4.8.3 -- In more detail: $ kmail --version Qt: 4.8.2 KDE Development Platform: 4.8.3 (4.8.3) KMail: 4.8.3 Thanks - jon From jonrysh at pacbell.net Sat Jun 23 05:02:55 2012 From: jonrysh at pacbell.net (Jonathan Ryshpan) Date: Fri, 22 Jun 2012 19:02:55 -0700 Subject: [Dovecot] Import from Evolution In-Reply-To: <20120616201636.GB6858@state-of-mind.de> References: <1339873707.2732.11.camel@amito> <20120616201636.GB6858@state-of-mind.de> Message-ID: <1340416975.12632.19.camel@amito> On Sat, 2012-06-16 at 22:16 +0200, Patrick Ben Koetter wrote: > * Jonathan Ryshpan : > > I need to import the mail database generated by the evolution mail > > reader into dovecot. Evolution stores its mail in maildir format (fully > > standards compatible, I think); I would be using the maildir format in > > dovecot. Is there anything in the wiki, etc. explaining exactly how to > > do this? > > > > Why do this? Evolution is hopelessly broken, and is not likely to be > > fixed in the forseeable future, and I would like to keep my mails in > > maildir form. Reviews of kmail are very bad, and thunderbird uses the > > mbox format for storage. > > If it is native maildir you can configure that/your account to use maildir and > simply copy your mailbox over to Dovecot. When Dovecot accesses the mailbox it > will create the necessary index files and you are ready to use it. I have now set up dovecot on my system, and should now be in business, but when Thunderbird connects to Dovecot it doesn't see any folders. Here is the situation. Please excuse the length of this message; I have tried to include all useful information. My system is Fedora-17 Linux with all updates running on x86_64 hardware. Dovecot is installed and running with this configuration: $ dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.4.3-1.fc17.x86_64 x86_64 Fedora release 17 (Beefy Miracle) mail_location = mbox:~/Dovecot:INBOX=/var/spool/mail/%u mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } ssl = required ssl_cert = References: <1340400276.12426.9.camel@maclinux> Message-ID: <746A0B68-368B-40D3-ACAB-8A39BDFDA99D@mediatemple.net> Hey, just a point of clarification. In at least some of the cases (possibly all, I'll leave that up to Jeff to state) an initial dsync (as documented in Jeff's message) was completed successfully and the problem occurred when we ran a second (using exactly the same cmd) time to catch any changes since the original sync (since the initial sync took many hours). Doug On Jun 22, 2012, at 2:24 PM, Jeff Gustafson wrote: > I'm getting an error backing up mailboxes. I'm using the mirror > command: > > dsync -fvo mail_home=/home/users/bob mirror ssh vmail at 10.1.4.1 dsync -o > mail_home=/home/.incoming_mail_migrations/users/bob > > dsync-remote(vmail): Error: Mailboxes don't have unique GUIDs: > 1ef6ee37c694894d783100000581a675 is shared by INBOX and INBOX > dsync-remote(vmail): Error: command BOX-LIST failed > dsync-local(vmail): Error: Worker server's mailbox iteration failed > > The mail user doesn't yet exist on the destination yet, thus the use of > the mail_home parameter. > I found a mailing list message where a person was having a similar > problem but I couldn't find confirmation that the issue was resolved. > In our case, the backup goes from maildir to mdbox format (we can't to > convert to mdbox). Things seemed to be moving along, but there are quite > a few examples of dsync failing. I think the issue happens more often > with large mailboxes ( > 50GB ). > We're running version 2.0.13. > doveconf -n: > > # 2.0.13: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.18-274.12.1.el5 x86_64 CentOS release 5.7 (Final) > auth_mechanisms = plain login > default_client_limit = 15000 > default_process_limit = 10000 > disable_plaintext_auth = no > listen = * > mail_gid = vmail > mail_location = maildir:~/Maildir > mail_plugins = zlib > mail_uid = vmail > mmap_disable = yes > namespace { > inbox = yes > location = > prefix = INBOX. > separator = . > } > passdb { > args = /etc/dovecot/conf.d/dovecot-sql.conf.ext > driver = sql > } > plugin { > zlib_save = gz > } > protocols = imap pop3 > service auth { > client_limit = 10000 > unix_listener auth-userdb { > mode = 0666 > } > } > service imap-postlogin { > executable = script-login /usr/bin/postlogin-imap.sh > user = $default_internal_user > } > service imap { > drop_priv_before_exec = yes > executable = imap > process_limit = 10000 > } > service pop3-postlogin { > executable = script-login /usr/bin/postlogin-pop.sh > user = $default_internal_user > } > } > service pop3 { > drop_priv_before_exec = yes > executable = pop3 > process_limit = 2500 > } > ssl_cert = ssl_key = userdb { > driver = prefetch > } > userdb { > args = /etc/dovecot/conf.d/dovecot-sql.conf.ext > driver = sql > } > protocol lmtp { > mail_plugins = zlib > } > protocol lda { > mail_plugins = zlib > } > protocol imap { > mail_max_userip_connections = 100 > mail_plugins = zlib > } > protocol pop3 { > mail_max_userip_connections = 30 > mail_plugins = zlib > } > > > ...Jeff > From manu at netbsd.org Sat Jun 23 08:04:30 2012 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Sat, 23 Jun 2012 07:04:30 +0200 Subject: [Dovecot] pop3-throttle Message-ID: <1km4rjc.f50hxq1iocthjM%manu@netbsd.org> Hello I am having a hard time with users using POP while leaving mailboxes of several gigabyte cumulated. This causes a lot of disk I/O and kills performancs for everyone. I try to encourage people migrating to IMAP, but that migration will take some time, and therefore I am looking for alterantive ways to workaround the problem. I found pop3-throttle-plugin.c, which seems a smart way to solve the problem, unfortunately it comes with no documentation. I was able to build it and load it, bu itsays nothing in the logs. Is there any doc somewhere? Any advices on how to set it up? -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu at netbsd.org From wojtek at wojtek.tensor.gdynia.pl Sat Jun 23 11:20:23 2012 From: wojtek at wojtek.tensor.gdynia.pl (Wojciech Puchar) Date: Sat, 23 Jun 2012 10:20:23 +0200 (CEST) Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> Message-ID: > > We are building a new system that will support a large number of users (high volume, high concurrent usage, etc). what is large? >? We have played with Dovecot, but in most serious applications we have traditionally used Courier IMAP. >? It's my (lay) understanding that with indexing and perhaps other things >in Dovecot, it might perform better than Courier in larger environments >like this.? Am I correct or is it less clear-cut? No idea how well courier IMAP performs. But have idea how well dovecot performs. I don't have large configs like thousands of users as i don't handle "herd of random users" style cases, but in every place i have dovecot IMAP takes unnoticable amount of server load. Just make a test. Definitely use maildir format, not mbox. dovecot heavily accesses it's index files. they are not large relative to e-mail sizes. With really large case if I/O will limit you i would recommend using SSD storage to keep just indexes. From wojtek at wojtek.tensor.gdynia.pl Sat Jun 23 11:21:38 2012 From: wojtek at wojtek.tensor.gdynia.pl (Wojciech Puchar) Date: Sat, 23 Jun 2012 10:21:38 +0200 (CEST) Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <1340310164.5967.86.camel@hurina> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> Message-ID: > > Nearly all of them are non-caching. (I don't know of any caching ones.) which is definite adventage in spite of it's numerous security holes. From wojtek at wojtek.tensor.gdynia.pl Sat Jun 23 11:22:37 2012 From: wojtek at wojtek.tensor.gdynia.pl (Wojciech Puchar) Date: Sat, 23 Jun 2012 10:22:37 +0200 (CEST) Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <4FE38623.5050303@necoro.eu> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38623.5050303@necoro.eu> Message-ID: >> Nearly all of them are non-caching. (I don't know of any caching ones.) > > At least roundcube (v0.7.1 here) has some caching options: > > ------------------[excerpt from roundcubes main.inc.php]------------- > // Type of IMAP indexes cache. Supported values: 'db', 'apc' and 'memcache'. > $rcmail_config['imap_cache'] = null; > > // Enables messages cache. Only 'db' cache is supported. > $rcmail_config['messages_cache'] = false; > -------------------------[end]---------------------------------------- > > But I don't know, whether this is the sort of caching you are referring to. what's a point of caching imap, except your webmail service is not locally connected (localhost or LAN) to imap server? From wojtek at wojtek.tensor.gdynia.pl Sat Jun 23 11:30:18 2012 From: wojtek at wojtek.tensor.gdynia.pl (Wojciech Puchar) Date: Sat, 23 Jun 2012 10:30:18 +0200 (CEST) Subject: [Dovecot] Import from Evolution In-Reply-To: <1340415602.12632.2.camel@amito> References: <1339873707.2732.11.camel@amito> <20120616201636.GB6858@state-of-mind.de> <1340415602.12632.2.camel@amito> Message-ID: >> kmail v.3 is barely usable, v4 is good. > > It looks like you don't like any of the email programs we've discussed. > Which email programs do you like? it depends whether you ask what I personally use or what i recommend to my clients. I personally use alpine exclusively. I don't like GUI interfaces. And i use alpine directly handling maildir so it's not about IMAP. But if you need mail client over IMAP - alpine can do this, but cannot cache. mutt can cache if you like that program. i don't - in spite of much better functionality. alpine have lowest keypress to amount of word done ratio of any mail program i know. For my clients it depends - windoze: exclusively thunderbird. It's FAR FAR from perfect but still best you can get under windoze. - X11 terminal based config: well... it's funny but too thunderbird. All QT based programs are useless with X11 over network. Thunderbird works fine. I disable "folder synchronization" as well as indexing in it, so it's acceptably fast. The need to connecting over localhost from account X to account X to dovecot-imap is quite stupid but not a problem. For now it is thunderbird 10.0.5esr - both windows and FreeBSD From wojtek at wojtek.tensor.gdynia.pl Sat Jun 23 11:32:39 2012 From: wojtek at wojtek.tensor.gdynia.pl (Wojciech Puchar) Date: Sat, 23 Jun 2012 10:32:39 +0200 (CEST) Subject: [Dovecot] Import from Evolution In-Reply-To: <1340415602.12632.2.camel@amito> References: <1339873707.2732.11.camel@amito> <20120616201636.GB6858@state-of-mind.de> <1340415602.12632.2.camel@amito> Message-ID: For Jonathan Ryshpan: for no obvious reason my IP is blocked at AT&T mail server you use. From michael at think-for-yourself.org Sat Jun 23 12:20:18 2012 From: michael at think-for-yourself.org (Michael Wessel) Date: Sat, 23 Jun 2012 02:20:18 -0700 Subject: [Dovecot] Hardware infrastructure for email system Message-ID: <4FE58A52.8050708@think-for-yourself.org> Hi, I'm currently (re-)planning my email setup and have been doing some research. I have done some searches and read several threads in the areas of my questions here. While there are some that come close I haven't yet been able to get all my questions answered. I currently run a postfix, dovecot & roundcube setup and have about 2000 active accounts. I have a separate SMTP server for outbound mail and auth is done against a separate LDAP server. In front of the POP/IMAP server I have another SMTP (4 in parallel actually) server that receives and filters inbound mail through a company specific, proprietary filter before the mail hits the POP/IMAP server. LDAP & SMTP servers are ESXi VMs. So right now both dovecot and roundcube run on the same box which is a Dell PE2950 with dual quad-core Xeon, 16GB RAM and 6 1TB disks in RAID 6, so only local storage using maildir. So far it's been holding up fine, but it's beginning to show signs of overload now. I also expect an increase in users over the next few months up to somewhere between 10 - 20,000 mail boxes. Hence the re-planning. My first priority in redesigning my setup is reliability. I definitely need something fail-save and as close to always on as possible. Next is performance. And while the budget is of course limited for the moment I'm setting that aside and will worry about that when the time comes. Now here is my question(s): In order to support up to 20,000 mailboxes (distributed over several times-zones so they won't all be used at the same time) with a very reliable service with good performance, what do I actually need? Do I need(ul) SAN or is it just a "would be nice to have"? If yes, why and what would be appropriate for my needs? Or will a setup with a few more servers like the ones I already have, using something like DRBD and distributing services (imap, http, spamd etc) onto different boxes do? I know I have more reading to do on all the different options out there, but would like some input from people that have experience in this area so I can focus on the stuff that's right for my situation. Michael From jonrysh at pacbell.net Sat Jun 23 12:23:35 2012 From: jonrysh at pacbell.net (Jonathan Ryshpan) Date: Sat, 23 Jun 2012 02:23:35 -0700 Subject: [Dovecot] Import from Evolution In-Reply-To: References: <1339873707.2732.11.camel@amito> <20120616201636.GB6858@state-of-mind.de> <1340415602.12632.2.camel@amito> Message-ID: <1340443415.20888.8.camel@amito> On Sat, 2012-06-23 at 10:30 +0200, Wojciech Puchar wrote: > >> kmail v.3 is barely usable, v4 is good. > > > > It looks like you don't like any of the email programs we've discussed. > > Which email programs do you like? > > it depends whether you ask what I personally use or what i recommend to my > clients. > > I personally use alpine exclusively. I don't like GUI interfaces. And i > use alpine directly handling maildir so it's not about IMAP. But if you > need mail client over IMAP - alpine can do this, but cannot cache. > > mutt can cache if you like that program. i don't - in spite of much better > functionality. alpine have lowest keypress to amount of word done ratio of > any mail program i know. > > For my clients it depends > > - windoze: exclusively thunderbird. It's FAR FAR from perfect but still > best you can get under windoze. > > - X11 terminal based config: well... it's funny but too thunderbird. All > QT based programs are useless with X11 over network. Thunderbird works > fine. I disable "folder synchronization" as well as indexing in it, so > it's acceptably fast. The need to connecting over localhost from account > X to account X to dovecot-imap is quite stupid but not a problem. > > For now it is thunderbird 10.0.5esr - both windows and FreeBSD I want to be able to read and write HTML, since my correspondents use and expect it, so alpine is out. I had been happy with evolution, but it is now badly broken under KDE, and I am in process of changing to Thunderbird, as you see. Thanks for the advice - jon From wojtek at wojtek.tensor.gdynia.pl Sat Jun 23 13:01:30 2012 From: wojtek at wojtek.tensor.gdynia.pl (Wojciech Puchar) Date: Sat, 23 Jun 2012 12:01:30 +0200 (CEST) Subject: [Dovecot] Import from Evolution In-Reply-To: <1340442919.20888.4.camel@amito> References: <1339873707.2732.11.camel@amito> <20120616201636.GB6858@state-of-mind.de> <1340415602.12632.2.camel@amito> <1340442919.20888.4.camel@amito> Message-ID: sorry for replying through that links but - as you may see - replying to Jonathan will not work. If AT&T have such strange policy then i am just sorry. It sings the beginning of end of open internet if more companies will start to do this, and result in few huge corporations handling everything. Not happy world to live. On Sat, 23 Jun 2012, Jonathan Ryshpan wrote: > On Sat, 2012-06-23 at 10:32 +0200, Wojciech Puchar wrote: >> For Jonathan Ryshpan: >> >> for no obvious reason my IP is blocked at AT&T mail server you use. > > I'm not sure what's going on, but I suspect the problem is this: Many US > mail servers refuse to accept mail from any servers that they have not > approved; if mail is coming direct from you to ATT, rather than via some > large ISP, it will likely be refused. This is supposed to reduce the > amount of spam (fat chance). > > Thanks for your reply - jon > > > From lists at wildgooses.com Sat Jun 23 13:21:02 2012 From: lists at wildgooses.com (Ed W) Date: Sat, 23 Jun 2012 11:21:02 +0100 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38623.5050303@necoro.eu> Message-ID: <4FE5988E.3010101@wildgooses.com> On 23/06/2012 09:22, Wojciech Puchar wrote: >>> Nearly all of them are non-caching. (I don't know of any caching ones.) >> >> At least roundcube (v0.7.1 here) has some caching options: >> >> ------------------[excerpt from roundcubes main.inc.php]------------- >> // Type of IMAP indexes cache. Supported values: 'db', 'apc' and >> 'memcache'. >> $rcmail_config['imap_cache'] = null; >> >> // Enables messages cache. Only 'db' cache is supported. >> $rcmail_config['messages_cache'] = false; >> -------------------------[end]---------------------------------------- >> >> But I don't know, whether this is the sort of caching you are >> referring to. > > what's a point of caching imap, except your webmail service is not > locally connected (localhost or LAN) to imap server? Asking for items 600-615 from a threaded list, sorted by something, can be an expensive operation, especially if you just asked for items 585-600 a moment ago? Ed From wojtek at wojtek.tensor.gdynia.pl Sat Jun 23 13:24:20 2012 From: wojtek at wojtek.tensor.gdynia.pl (Wojciech Puchar) Date: Sat, 23 Jun 2012 12:24:20 +0200 (CEST) Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <4FE5988E.3010101@wildgooses.com> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38623.5050303@necoro.eu> <4FE5988E.3010101@wildgooses.com> Message-ID: >>> But I don't know, whether this is the sort of caching you are referring >>> to. >> >> what's a point of caching imap, except your webmail service is not locally >> connected (localhost or LAN) to imap server? > > Asking for items 600-615 from a threaded list, sorted by something, can be an > expensive operation, especially if you just asked for items 585-600 a moment > ago? > fine. how about overhead of cache itself? From p at state-of-mind.de Sat Jun 23 13:25:56 2012 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Sat, 23 Jun 2012 12:25:56 +0200 Subject: [Dovecot] Hardware infrastructure for email system In-Reply-To: <4FE58A52.8050708@think-for-yourself.org> References: <4FE58A52.8050708@think-for-yourself.org> Message-ID: <20120623102555.GA5497@state-of-mind.de> Michael, * Michael Wessel : > I'm currently (re-)planning my email setup and have been doing some > research. I have done some searches and read several threads in the > areas of my questions here. While there are some that come close I > haven't yet been able to get all my questions answered. > > I currently run a postfix, dovecot & roundcube setup and have about > 2000 active accounts. I have a separate SMTP server for outbound > mail and auth is done against a separate LDAP server. In front of > the POP/IMAP server I have another SMTP (4 in parallel actually) > server that receives and filters inbound mail through a company > specific, proprietary filter before the mail hits the POP/IMAP > server. LDAP & SMTP servers are ESXi VMs. Do people use 'real' mail clients to connect and IDLE too? > So right now both dovecot and roundcube run on the same box which is > a Dell PE2950 with dual quad-core Xeon, 16GB RAM and 6 1TB disks in > RAID 6, so only local storage using maildir. So far it's been > holding up fine, but it's beginning to show signs of overload now. I > also expect an increase in users over the next few months up to > somewhere between 10 - 20,000 mail boxes. Hence the re-planning. > > My first priority in redesigning my setup is reliability. I > definitely need something fail-save and as close to always on as > possible. Next is performance. And while the budget is of course > limited for the moment I'm setting that aside and will worry about > that when the time comes. > > Now here is my question(s): > > In order to support up to 20,000 mailboxes (distributed over several > times-zones so they won't all be used at the same time) with a very > reliable service with good performance, what do I actually need? > > Do I need(ul) SAN or is it just a "would be nice to have"? If yes, > why and what would be appropriate for my needs? Or will a setup with > a few more servers like the ones I already have, using something > like DRBD and distributing services (imap, http, spamd etc) onto > different boxes do? Will the server enforce quota? What will be the average mailbox size? Do people share content e.g. mailings with attachments that go out to all recipients? What might be the maximum number of clients using the server at one time? Will all users use the same client product e.g. roundcube? What's your backup strategy? What do you use to backup mailboxes? p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From CMarcus at Media-Brokers.com Sat Jun 23 13:29:26 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sat, 23 Jun 2012 06:29:26 -0400 Subject: [Dovecot] dsync error: "Mailboxes don't have unique GUIDs" In-Reply-To: <1340400276.12426.9.camel@maclinux> References: <1340400276.12426.9.camel@maclinux> Message-ID: <4FE59A86.7020208@Media-Brokers.com> On 2012-06-22 5:24 PM, Jeff Gustafson wrote: > I'm getting an error backing up mailboxes. I'm using the mirror > command: > > dsync -fvo mail_home=/home/users/bob mirror ssh vmail at 10.1.4.1 dsync -o > mail_home=/home/.incoming_mail_migrations/users/bob > # 2.0.13: /etc/dovecot/dovecot.conf As you are aware (since you participated in the thread discussion about this months ago), Timo is working on a total rewrite of dsync, and if memory serves, it is mainly for 2.1+, and it is not recommend to use it in earlier versions if you need reliability (ie, 2.0.x, as you are using)... So, by all means, update and help timo make it better! Timo? Care to elaborate on where you are with this, and how much of the rewrite is being applied to 2.1 (all of it?), or backported to earlier versions? -- Best regards, Charles From CMarcus at Media-Brokers.com Sat Jun 23 13:34:06 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sat, 23 Jun 2012 06:34:06 -0400 Subject: [Dovecot] permissions on auth-userdb In-Reply-To: References:

Message-ID: <4FE59B9E.1050009@Media-Brokers.com> It would be nice if there were a wiki page specifically describing how permissions should be set for all of the services/directories that dovecot uses. Even better would be a dovecot/doveconf command that would test the permissions and, if possible, even fix them (like the postfix 'set-permissions' command)... On 2012-06-22 11:46 AM, robert coore wrote: > googlemail.com> writes: > >> >> Hi.. >> >> im still trying to upgrade to 2.0. >> Im getting: >> dovecot: lda: Error: userdb lookup: >> connect(/var/run/dovecot/auth-userdb) failed: Permission denied >> (euid=10000(vmail) egid=10000(vmail) missing +r perm: >> /var/run/dovecot/auth-userdb, euid is not dir owner) >> >> the error is correct caus its owned by root. My Questions is who should own > it ? >> Im not sure how that works, what process/user calls the auth-userdb ? >> The auth-userdb returns the args generated in master.conf, right ? >> >> i think comment out the user and group setting in master.conf will fix >> it but im not sure if that is the securest way. >> >> the mails come from postfix via dovecot-lda >> >> Hans >> >> master.conf >> service auth { >> # auth_socket_path points to this userdb socket by default. It's typically >> # used by dovecot-lda, doveadm, possibly imap process, etc. Its default >> # permissions make it readable only by root, but you may need to relax > these >> # permissions. Users that have access to this socket are able to get a list >> # of all usernames and get results of everyone's userdb lookups. >> unix_listener auth-userdb { >> mode = 0600 >> #user = vmail >> #group = vmail >> } >> >> auth-ldap.conf.ext >> passdb { >> driver = ldap >> args = /etc/dovecot/dovecot-ldap.conf.ext >> } >> userdb { >> driver = static >> args = uid=vmail gid=vmail home=/home/MAILBOXES/%u/ >> mail=/home/MAILBOXES/%u/mail >> } >> >> > > > Hi all was getting the same errors took me 2 days to understand what it was > saying to me but i finally solved it > > > > if you do an ls -l /var/run/dovecot/auth-userdb you will seet that root is the > owner and the premissions are srw-------- so vmail has not right to call or > even use the process > What i did was a chown -R vmail:vmail /var/run/dovecot/auth-userdb > I also did a chmod g+r /var/run/dovecot/auth-userdb > ls -l /var/run/dovecot/auth-userdb > srw----r-- 1 vmail vmail > my unix_listener auth-userdb { > mode = 600 > { > > protocol lda { > auth_socket_path = /var/run/dovecot/auth-userdb > log_path = /home/vmail/dovecot-deliver.log > > that worked for me > 1. havent restarted the dovecot service dont know if it will keep the settings. > > > > > > -- Best regards, Charles Marcus I.T. Director Media Brokers International, Inc. 678.514.6200 x224 | 678.514.6299 fax From robert at schetterer.org Sat Jun 23 13:52:26 2012 From: robert at schetterer.org (Robert Schetterer) Date: Sat, 23 Jun 2012 12:52:26 +0200 Subject: [Dovecot] Hardware infrastructure for email system In-Reply-To: <4FE58A52.8050708@think-for-yourself.org> References: <4FE58A52.8050708@think-for-yourself.org> Message-ID: <4FE59FEA.80002@schetterer.org> Am 23.06.2012 11:20, schrieb Michael Wessel: > So right now both dovecot and roundcube run on the same box which is a > Dell PE2950 with dual quad-core Xeon, 16GB RAM and 6 1TB disks in RAID > 6, so only local storage using maildir. So far it's been holding up > fine, but it's beginning to show signs of overload now. I also expect an > increase in users over the next few months up to somewhere between 10 - > 20,000 mail boxes. Hence the re-planning. you should ask for paid support at Timo , or some other dovcot geeks near you -- Best Regards MfG Robert Schetterer From CMarcus at Media-Brokers.com Sat Jun 23 13:53:26 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sat, 23 Jun 2012 06:53:26 -0400 Subject: [Dovecot] Import from Evolution In-Reply-To: <1340416975.12632.19.camel@amito> References: <1339873707.2732.11.camel@amito> <20120616201636.GB6858@state-of-mind.de> <1340416975.12632.19.camel@amito> Message-ID: <4FE5A026.20203@Media-Brokers.com> On 2012-06-22 10:02 PM, Jonathan Ryshpan wrote: > and /var/log/maillog shows the corresponding error: > > Jun 22 18:23:10 amito dovecot: imap(jonrysh): Error: > chown(/home/jonrysh/Dovecot/.imap/INBOX, group=12(mail)) failed: > Operation not permitted (egid=1000(jonrysh), group based on > /var/spool/mail/jonrysh - seehttp://wiki2.dovecot.org/Errors/ChgrpNoPerm) > > As a complete Dovecot/IMAP newbie, I am completely confused. Any > advice will be much appreciated. Obviously a permissions problem... This may help: http://wiki2.dovecot.org/SharedMailboxes/Permissions But again, a dovecot tool to check and/or fix these itself would be nice... -- Best regards, Charles From wojtek at wojtek.tensor.gdynia.pl Sat Jun 23 14:09:18 2012 From: wojtek at wojtek.tensor.gdynia.pl (Wojciech Puchar) Date: Sat, 23 Jun 2012 13:09:18 +0200 (CEST) Subject: [Dovecot] Hardware infrastructure for email system In-Reply-To: <4FE58A52.8050708@think-for-yourself.org> References: <4FE58A52.8050708@think-for-yourself.org> Message-ID: > > I'm currently (re-)planning my email setup and have been doing some research. > I have done some searches and read several threads in the areas of my > questions here. While there are some that come close I haven't yet been able > to get all my questions answered. > > I currently run a postfix, dovecot & roundcube setup and have about 2000 > active accounts. I have a separate SMTP server for outbound mail and auth is > done against a separate LDAP server. In front of the POP/IMAP server I have > another SMTP (4 in parallel actually) server that receives and filters > inbound mail through a company specific, proprietary filter before the mail > hits the POP/IMAP server. LDAP & SMTP servers are ESXi VMs. it is already enormous overshoot in hardware specs. And i do not really catch why you have "4 in parallel" servers. And finally i cannot understand this dividing of servers just to merging it back using VMWare. Finally i would recommend to get rid of RAID6. It's terribly slow on writes and writes are common on mail server. Buy cheapest but largest SATA drive and use RAID1 (or RAID1+0) setup. From h.reindl at thelounge.net Sat Jun 23 14:17:44 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 23 Jun 2012 13:17:44 +0200 Subject: [Dovecot] Hardware infrastructure for email system In-Reply-To: References: <4FE58A52.8050708@think-for-yourself.org> Message-ID: <4FE5A5D8.2050908@thelounge.net> Am 23.06.2012 13:09, schrieb Wojciech Puchar: >> >> I'm currently (re-)planning my email setup and have been doing some research. I have done some searches and read >> several threads in the areas of my questions here. While there are some that come close I haven't yet been able >> to get all my questions answered. >> >> I currently run a postfix, dovecot & roundcube setup and have about 2000 active accounts. I have a separate SMTP >> server for outbound mail and auth is done against a separate LDAP server. In front of the POP/IMAP server I have >> another SMTP (4 in parallel actually) server that receives and filters inbound mail through a company specific, >> proprietary filter before the mail hits the POP/IMAP server. LDAP & SMTP servers are ESXi VMs. > > it is already enormous overshoot in hardware specs. And i do not really catch why you have "4 in parallel" servers. > And finally i cannot understand this dividing of servers just to merging it back using VMWare. because it is a big difference if you have anything in a single machine or splittet in virtual machines - you can move them at runtime to different hosts and if you run out of ressources for one of them you can buy a phyisclal machine, add it to the cluster and move the virtual machine without any downtime if you have all on one machine or VM you are not scaleable -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From tss at iki.fi Sat Jun 23 14:23:02 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 23 Jun 2012 14:23:02 +0300 Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <4FE5988E.3010101@wildgooses.com> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38623.5050303@necoro.eu> <4FE5988E.3010101@wildgooses.com> Message-ID: <51EF9BC7-BE99-4DE9-800A-E8FDF7779A4B@iki.fi> On 23.6.2012, at 13.21, Ed W wrote: >>> But I don't know, whether this is the sort of caching you are referring to. >> >> what's a point of caching imap, except your webmail service is not locally connected (localhost or LAN) to imap server? > > Asking for items 600-615 from a threaded list, sorted by something, can be an expensive operation, especially if you just asked for items 585-600 a moment ago? Can be, but is it? :) Dovecot attempts to cache/index stuff as well. Normally there shouldn't be a need for extra caching layer except in cases of higher network latency. From h.reindl at thelounge.net Sat Jun 23 14:23:57 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 23 Jun 2012 13:23:57 +0200 Subject: [Dovecot] Hardware infrastructure for email system In-Reply-To: References: <4FE58A52.8050708@think-for-yourself.org> Message-ID: <4FE5A74D.2010201@thelounge.net> Am 23.06.2012 13:09, schrieb Wojciech Puchar: > Finally i would recommend to get rid of RAID6. It's terribly slow on writes and > writes are common on mail server. depends, it is slower than RAID5, but safer > Buy cheapest but largest SATA drive and use RAID1 (or RAID1+0) setup. oh no please do not recommend SATA crap with RAID1 and think it is faster than RAID6 - the additional writes doe snot matter if the whole disk-system is much faster and RAID1 has no benefit in performance nobody will use SATA disks for high peformance servers in production - really nobody these days! -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From wojtek at wojtek.tensor.gdynia.pl Sat Jun 23 15:20:12 2012 From: wojtek at wojtek.tensor.gdynia.pl (Wojciech Puchar) Date: Sat, 23 Jun 2012 14:20:12 +0200 (CEST) Subject: [Dovecot] Hardware infrastructure for email system In-Reply-To: <4FE5A5D8.2050908@thelounge.net> References: <4FE58A52.8050708@think-for-yourself.org> <4FE5A5D8.2050908@thelounge.net> Message-ID: >> >> it is already enormous overshoot in hardware specs. And i do not really catch why you have "4 in parallel" servers. >> And finally i cannot understand this dividing of servers just to merging it back using VMWare. > > because it is a big difference if you have anything in a single > machine or splittet in virtual machines - you can move them at > runtime to different hosts and if you run out of ressources ok - for me it is just likes. You have higher change to have the need to move at the first place doing this :) From wojtek at wojtek.tensor.gdynia.pl Sat Jun 23 15:21:41 2012 From: wojtek at wojtek.tensor.gdynia.pl (Wojciech Puchar) Date: Sat, 23 Jun 2012 14:21:41 +0200 (CEST) Subject: [Dovecot] Hardware infrastructure for email system In-Reply-To: <4FE5A74D.2010201@thelounge.net> References: <4FE58A52.8050708@think-for-yourself.org> <4FE5A74D.2010201@thelounge.net> Message-ID: >> Buy cheapest but largest SATA drive and use RAID1 (or RAID1+0) setup. > > oh no please do not recommend SATA crap with RAID1 and think > it is faster than RAID6 - the additional writes doe snot matter > if the whole disk-system is much faster and RAID1 has no benefit > in performance OK i would not recommend anything anymore. Normally my advices are for money. > > nobody will use SATA disks for high peformance servers in > production - really nobody these days! > at least one person. and getting a bit of money helping other increasing performance of their setup. guess who. From wojtek at wojtek.tensor.gdynia.pl Sat Jun 23 16:04:47 2012 From: wojtek at wojtek.tensor.gdynia.pl (Wojciech Puchar) Date: Sat, 23 Jun 2012 15:04:47 +0200 (CEST) Subject: [Dovecot] Dovecot performance under high load (vs. Courier) In-Reply-To: <51EF9BC7-BE99-4DE9-800A-E8FDF7779A4B@iki.fi> References: <1340301924.56701.YahooMailNeo@web39301.mail.mud.yahoo.com> <5266B92B-3883-4105-839E-4D4B9B84A964@iki.fi> <1340309125.61246.YahooMailNeo@web39306.mail.mud.yahoo.com> <1340310164.5967.86.camel@hurina> <4FE38623.5050303@necoro.eu> <4FE5988E.3010101@wildgooses.com> <51EF9BC7-BE99-4DE9-800A-E8FDF7779A4B@iki.fi> Message-ID: >> >> Asking for items 600-615 from a threaded list, sorted by something, can be an expensive operation, especially if you just asked for items 585-600 a moment ago? > > Can be, but is it? :) Dovecot attempts to cache/index stuff as well. Normally there shouldn't be a need for extra caching layer except in cases of higher network latency. that is my point. and - esp. with webmail, i see no point to run such service in different place than dovecot server runs. Best - same server. Maybe - other server connected with fast LAN. From joe at tao.org.uk Sat Jun 23 18:18:40 2012 From: joe at tao.org.uk (Dr Josef Karthauser) Date: Sat, 23 Jun 2012 16:18:40 +0100 Subject: [Dovecot] Problems getting auto create plugin to work Message-ID: Hi there, I've configured the 'autocreate' plugin (in v.2.1.6), but it doesn't appear to be working. Can someone help me work out how to work out why please? I've got this in my 20-imap.conf file: protocol imap { mail_plugins = $mail_plugins antispam autocreate } and this in my 90-plugins.conf file: plugin { autocreate = Trash autocreate2 = Spam autosubscribe = Trash autosubscribe2 = Spam ... etc } But, the spam does not get created upon login. I've restart dovecot and restarted my mail client, but there's no hint of an spam folder. Is there something else that I also need to do? Thanks, Joe From user+dovecot at localhost.localdomain.org Sat Jun 23 19:08:37 2012 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 23 Jun 2012 18:08:37 +0200 Subject: [Dovecot] Problems getting auto create plugin to work In-Reply-To: References: Message-ID: <4FE5EA05.2090804@localhost.localdomain.org> On 06/23/2012 05:18 PM Dr Josef Karthauser wrote: > Hi there, > > I've configured the 'autocreate' plugin (in v.2.1.6), but it doesn't appear to be working. Can someone help me work out how to work out why please? > > I've got this in my 20-imap.conf file: > > protocol imap { > mail_plugins = $mail_plugins antispam autocreate > } > > and this in my 90-plugins.conf file: > > plugin { > autocreate = Trash > autocreate2 = Spam > autosubscribe = Trash > autosubscribe2 = Spam > > ... etc > } Don't show us configuration file snippets, always paste `doveconf -n` output. > But, the spam does not get created upon login. I've restart dovecot and restarted my mail client, but there's no hint of an spam folder. > > Is there something else that I also need to do? ,--[ http://dovecot.org/doc/NEWS-2.1 ]-- | ? | + Added mailbox {} sections, which deprecate autocreate plugin | ? `-- Have a look at the mailbox definitions configuration file: http://hg.dovecot.org/dovecot-2.1/file/tip/doc/example-config/conf.d/15-mailboxes.conf Regards, Pascal -- The trapper recommends today: deadbeef.1217518 at localdomain.org From acrow at integrafin.co.uk Sat Jun 23 20:00:52 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Sat, 23 Jun 2012 18:00:52 +0100 Subject: [Dovecot] Dovecot list IMAP archives with thunderbird? In-Reply-To: <4FE1FCDB.6080503@integrafin.co.uk> References: <4FE1FCDB.6080503@integrafin.co.uk> Message-ID: <4FE5F644.8000606@integrafin.co.uk> On 20/06/12 17:39, Alex Crow wrote: > Hi, > > I'm trying to access the IMAP archives with Thunderbird but can't seem > to get it to work. I have tried an unencrypted connection, SSL and TLS > but with no success. Any ideas? > > Thanks > > Alex > Hi, Still stuck here - would really like to be able to access the archives in my email client... Anyone able to see the mailing list archives in Thunderbird or other IMAP clients? Are they currently down? Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856) From patrickdk at patrickdk.com Sat Jun 23 20:04:40 2012 From: patrickdk at patrickdk.com (Patrick Domack) Date: Sat, 23 Jun 2012 13:04:40 -0400 Subject: [Dovecot] Hardware infrastructure for email system In-Reply-To: <4FE5A5D8.2050908@thelounge.net> References: <4FE58A52.8050708@think-for-yourself.org> <4FE5A5D8.2050908@thelounge.net> Message-ID: <20120623130440.Horde.n_x2XJLnE6FP5fcoWOKAhaA@mail.patrickdk.com> Quoting Reindl Harald : > Am 23.06.2012 13:09, schrieb Wojciech Puchar: >> it is already enormous overshoot in hardware specs. And i do not >> really catch why you have "4 in parallel" servers. >> And finally i cannot understand this dividing of servers just to >> merging it back using VMWare. > > because it is a big difference if you have anything in a single > machine or splittet in virtual machines - you can move them at > runtime to different hosts and if you run out of ressources > for one of them you can buy a phyisclal machine, add it to the > cluster and move the virtual machine without any downtime > > if you have all on one machine or VM you are not scaleable Personally I found going from real hardware E51xx servers to E56xx servers to give double the performance per same speed and amount of cores for my mail server. Then moving it onto vmware slowed it down approx 15%. Overall still a let win, and using vmware for extra HA and easier maintenance is deferentially worth the slowdown. From tss at iki.fi Sat Jun 23 20:06:28 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 23 Jun 2012 20:06:28 +0300 Subject: [Dovecot] Dovecot list IMAP archives with thunderbird? In-Reply-To: <4FE5F644.8000606@integrafin.co.uk> References: <4FE1FCDB.6080503@integrafin.co.uk> <4FE5F644.8000606@integrafin.co.uk> Message-ID: <1340471188.5967.88.camel@hurina> On Sat, 2012-06-23 at 18:00 +0100, Alex Crow wrote: > > I'm trying to access the IMAP archives with Thunderbird but can't seem > > to get it to work. I have tried an unencrypted connection, SSL and TLS > > but with no success. Any ideas? > > > > Thanks > > > > Alex > > > Hi, > > Still stuck here - would really like to be able to access the archives > in my email client... > > Anyone able to see the mailing list archives in Thunderbird or other > IMAP clients? Are they currently down? It works fine as far as I can see, even with Thunderbird. What error do you get? From andrzej.filip at gmail.com Sat Jun 23 20:09:40 2012 From: andrzej.filip at gmail.com (Andrzej A. Filip) Date: Sat, 23 Jun 2012 19:09:40 +0200 Subject: [Dovecot] Hardware infrastructure for email system In-Reply-To: <4FE5A74D.2010201@thelounge.net> References: <4FE58A52.8050708@think-for-yourself.org> <4FE5A74D.2010201@thelounge.net> Message-ID: <4FE5F854.4050804@gmail.com> On 06/23/2012 01:23 PM, Reindl Harald wrote: > > Am 23.06.2012 13:09, schrieb Wojciech Puchar: >> Finally i would recommend to get rid of RAID6. It's terribly slow on writes and >> writes are common on mail server. > depends, it is slower than RAID5, but safer > >> Buy cheapest but largest SATA drive and use RAID1 (or RAID1+0) setup. > oh no please do not recommend SATA crap with RAID1 and think > it is faster than RAID6 - the additional writes doe snot mat > if the whole disk-system is much faster and RAID1 has no benefit > in performance > > nobody will use SATA disks for high peformance servers in > production - really nobody these days! Could you specify/define your idea of "high performance servers" land border? It may reduce the flame war. From dmalolepszy at optusnet.com.au Sat Jun 23 20:36:52 2012 From: dmalolepszy at optusnet.com.au (Dominic Malolepszy) Date: Sun, 24 Jun 2012 03:36:52 +1000 Subject: [Dovecot] SQLite dovecot query caching Message-ID: <4FE5FEB4.2050801@optusnet.com.au> Hi, I am wondering if Dovecot caches SQLite queries, and how well it works in high performance setups. I am particularly interested because in the below thread SQLite has been suggested as a means of Dovecot proxying connections to different ports. http://old.nabble.com/director%3A-non-standart-ports-at-backends-td33991991.html Cheers, Dominic. From tss at iki.fi Sat Jun 23 20:39:07 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 23 Jun 2012 20:39:07 +0300 Subject: [Dovecot] SQLite dovecot query caching In-Reply-To: <4FE5FEB4.2050801@optusnet.com.au> References: <4FE5FEB4.2050801@optusnet.com.au> Message-ID: <1340473147.5967.89.camel@hurina> On Sun, 2012-06-24 at 03:36 +1000, Dominic Malolepszy wrote: > Hi, > > I am wondering if Dovecot caches SQLite queries, and how well it works > in high performance setups. I am particularly interested because in the > below thread SQLite has been suggested as a means of Dovecot proxying > connections to different ports. You can enable auth cache: http://wiki2.dovecot.org/Authentication/Caching From acrow at integrafin.co.uk Sat Jun 23 21:10:37 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Sat, 23 Jun 2012 19:10:37 +0100 Subject: [Dovecot] Hardware infrastructure for email system In-Reply-To: <4FE5F854.4050804@gmail.com> References: <4FE58A52.8050708@think-for-yourself.org> <4FE5A74D.2010201@thelounge.net> <4FE5F854.4050804@gmail.com> Message-ID: <4FE6069D.2050703@integrafin.co.uk> On 23/06/12 18:09, Andrzej A. Filip wrote: > On 06/23/2012 01:23 PM, Reindl Harald wrote: >> Am 23.06.2012 13:09, schrieb Wojciech Puchar: >>> Finally i would recommend to get rid of RAID6. It's terribly slow on writes and >>> writes are common on mail server. >> depends, it is slower than RAID5, but safer >> >>> Buy cheapest but largest SATA drive and use RAID1 (or RAID1+0) setup. >> oh no please do not recommend SATA crap with RAID1 and think >> it is faster than RAID6 - the additional writes doe snot mat >> if the whole disk-system is much faster and RAID1 has no benefit >> in performance >> >> nobody will use SATA disks for high peformance servers in >> production - really nobody these days! > Could you specify/define your idea of "high performance servers" land > border? > It may reduce the flame war. > Hi, With dovecot, you can separate indexes and email, and with dbox/mdbox, have ALT storage, so for instance you could keep your indexes in a RAID10 of SSDs, recent email on a RAID10 of 10kRPM/15kRPM SAS drives, and older email can go on a load of 5k/7.2k SATA drives in RAID6, or on a NAS via NFS. Note: with *dbox your indexes are the only place your mail flags are kept, so don't risk a single drive or even RAID5 for your index store. This is what I am moving into production from dovecot 1.x on a single RAID6 array (hardware, LSI controller, 6 10k SAS drives in RAID10) which has served very well for a while but is not getting too small for all our mail. Performance has been good for up to 350 users, average mailbox size >4G, about 25-35k incoming mails per day. Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856) From dmalolepszy at optusnet.com.au Sat Jun 23 21:20:24 2012 From: dmalolepszy at optusnet.com.au (Dominic Malolepszy) Date: Sun, 24 Jun 2012 04:20:24 +1000 Subject: [Dovecot] SQLite dovecot query caching In-Reply-To: <1340473147.5967.89.camel@hurina> References: <4FE5FEB4.2050801@optusnet.com.au> <1340473147.5967.89.camel@hurina> Message-ID: <4FE608E8.6090106@optusnet.com.au> On 24/06/12 3:39 AM, Timo Sirainen wrote: > On Sun, 2012-06-24 at 03:36 +1000, Dominic Malolepszy wrote: >> Hi, >> >> I am wondering if Dovecot caches SQLite queries, and how well it works >> in high performance setups. I am particularly interested because in the >> below thread SQLite has been suggested as a means of Dovecot proxying >> connections to different ports. > You can enable auth cache: > http://wiki2.dovecot.org/Authentication/Caching > > This is a per user caching though, it will still have to perform a sql look up each time a unique user authenticates to determine what port the proxy should forward each connection. Is that accurate? From wojtek at wojtek.tensor.gdynia.pl Sat Jun 23 21:21:05 2012 From: wojtek at wojtek.tensor.gdynia.pl (Wojciech Puchar) Date: Sat, 23 Jun 2012 20:21:05 +0200 (CEST) Subject: [Dovecot] Hardware infrastructure for email system In-Reply-To: <4FE6069D.2050703@integrafin.co.uk> References: <4FE58A52.8050708@think-for-yourself.org> <4FE5A74D.2010201@thelounge.net> <4FE5F854.4050804@gmail.com> <4FE6069D.2050703@integrafin.co.uk> Message-ID: > ALT storage, so for instance you could keep your indexes in a RAID10 of SSDs, > recent email on a RAID10 of 10kRPM/15kRPM SAS drives, and older email can go > on a load of 5k/7.2k SATA drives in RAID6, or on a NAS via NFS. far better solution but still about 2-3 times more $/performance than needed, and more complex than needed. But at least an improvement From tss at iki.fi Sat Jun 23 21:57:08 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 23 Jun 2012 21:57:08 +0300 Subject: [Dovecot] SQLite dovecot query caching In-Reply-To: <4FE608E8.6090106@optusnet.com.au> References: <4FE5FEB4.2050801@optusnet.com.au> <1340473147.5967.89.camel@hurina> <4FE608E8.6090106@optusnet.com.au> Message-ID: <1340477828.5967.91.camel@hurina> On Sun, 2012-06-24 at 04:20 +1000, Dominic Malolepszy wrote: > On 24/06/12 3:39 AM, Timo Sirainen wrote: > > On Sun, 2012-06-24 at 03:36 +1000, Dominic Malolepszy wrote: > >> Hi, > >> > >> I am wondering if Dovecot caches SQLite queries, and how well it works > >> in high performance setups. I am particularly interested because in the > >> below thread SQLite has been suggested as a means of Dovecot proxying > >> connections to different ports. > > You can enable auth cache: > > http://wiki2.dovecot.org/Authentication/Caching > > > > > > This is a per user caching though, it will still have to perform a sql > look up each time a unique user authenticates to determine what port the > proxy should forward each connection. Is that accurate? It caches the passdb lookup. The cache key consists of the given % variables in the SQL query. So if your SQL query doesn't contain %n/%u then the cache doesn't add per-user entries. From acrow at integrafin.co.uk Sat Jun 23 22:06:31 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Sat, 23 Jun 2012 20:06:31 +0100 Subject: [Dovecot] Dovecot list IMAP archives with thunderbird? In-Reply-To: <1340471188.5967.88.camel@hurina> References: <4FE1FCDB.6080503@integrafin.co.uk> <4FE5F644.8000606@integrafin.co.uk> <1340471188.5967.88.camel@hurina> Message-ID: <4FE613B7.7080809@integrafin.co.uk> On 23/06/12 18:06, Timo Sirainen wrote: > On Sat, 2012-06-23 at 18:00 +0100, Alex Crow wrote: >>> I'm trying to access the IMAP archives with Thunderbird but can't seem >>> to get it to work. I have tried an unencrypted connection, SSL and TLS >>> but with no success. Any ideas? >>> >>> Thanks >>> >>> Alex >>> >> Hi, >> >> Still stuck here - would really like to be able to access the archives >> in my email client... >> >> Anyone able to see the mailing list archives in Thunderbird or other >> IMAP clients? Are they currently down? > It works fine as far as I can see, even with Thunderbird. What error do > you get? > > > Hi Timo, No errors at all, I just never see any folder list or messages - tcpdump shows a few packets only when TLS mode is selected, but nothing after that, Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856) From dmalolepszy at optusnet.com.au Sat Jun 23 22:07:48 2012 From: dmalolepszy at optusnet.com.au (Dominic Malolepszy) Date: Sun, 24 Jun 2012 05:07:48 +1000 Subject: [Dovecot] SQLite dovecot query caching In-Reply-To: <1340477828.5967.91.camel@hurina> References: <4FE5FEB4.2050801@optusnet.com.au> <1340473147.5967.89.camel@hurina> <4FE608E8.6090106@optusnet.com.au> <1340477828.5967.91.camel@hurina> Message-ID: <4FE61404.1030102@optusnet.com.au> On 24/06/12 4:57 AM, Timo Sirainen wrote: > On Sun, 2012-06-24 at 04:20 +1000, Dominic Malolepszy wrote: >> On 24/06/12 3:39 AM, Timo Sirainen wrote: >>> On Sun, 2012-06-24 at 03:36 +1000, Dominic Malolepszy wrote: >>>> Hi, >>>> >>>> I am wondering if Dovecot caches SQLite queries, and how well it works >>>> in high performance setups. I am particularly interested because in the >>>> below thread SQLite has been suggested as a means of Dovecot proxying >>>> connections to different ports. >>> You can enable auth cache: >>> http://wiki2.dovecot.org/Authentication/Caching >>> >>> >> This is a per user caching though, it will still have to perform a sql >> look up each time a unique user authenticates to determine what port the >> proxy should forward each connection. Is that accurate? > It caches the passdb lookup. The cache key consists of the given % > variables in the SQL query. So if your SQL query doesn't contain %n/%u > then the cache doesn't add per-user entries. > > Thanks Timo, I re-read the link you sent me, and it makes a lot more sense now. I will play around with the different variables (especially the port related ones), to get the desired result. Gah its late I should go to sleep! From lists at svrinformatica.it Sat Jun 23 23:39:43 2012 From: lists at svrinformatica.it (Mailing List SVR) Date: Sat, 23 Jun 2012 22:39:43 +0200 Subject: [Dovecot] 2.0.19 segfault Message-ID: <4FE6298F.6050502@svrinformatica.it> Hi, after the upgrade from dovecot 2.0.13 (ubuntu oneiric) to dovecot 2.0.19 (ubuntu precise), in my logs I have a lot of these errors: Jun 23 00:20:29 server1 dovecot: master: Error: service(imap-login): child 6714 killed with signal 11 (core dumps disabled) I tested 2.0.21 and the problem is still here. The problem seems to appear only when the client is ms outlook, thunderbird works fine Here is the captured trace (I hope this is enough and I don't need to install debug symbols for everythings): Core was generated by `dovecot/imap-login -D'. Program terminated with signal 11, Segmentation fault. #0 0x00007f4d01c1a031 in RC4 () from /lib/x86_64-linux-gnu/libcrypto.so.1.0.0 (gdb) bt full #0 0x00007f4d01c1a031 in RC4 () from /lib/x86_64-linux-gnu/libcrypto.so.1.0.0 No symbol table info available. #1 0x0000000000000134 in ?? () No symbol table info available. #2 0x00000000000000cd in ?? () No symbol table info available. #3 0x00007f4d03e97470 in ?? () No symbol table info available. #4 0x00007f4d01c80629 in ?? () from /lib/x86_64-linux-gnu/libcrypto.so.1.0.0 No symbol table info available. #5 0x00007f4d01f82bcf in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #6 0x00007f4d01f79e04 in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #7 0x00007f4d01f7a134 in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #8 0x00007f4d027fed6f in ssl_write (proxy=0x7f4d03e7c0a0) at ssl-proxy-openssl.c:499 ret = #9 0x00007f4d027fee68 in plain_read (proxy=0x7f4d03e7c0a0) at ssl-proxy-openssl.c:308 ret = corked = true ---Type to continue, or q to quit--- #10 0x00007f4d025b5c98 in io_loop_call_io (io=0x7f4d03e84b10) at ioloop.c:384 ioloop = 0x7f4d03e3e680 t_id = 2 #11 0x00007f4d025b6d27 in io_loop_handler_run (ioloop=) at ioloop-epoll.c:213 ctx = 0x7f4d03e505a0 events = 0x6579351d event = 0x7f4d03e50610 list = 0x7f4d03e93690 io = tv = {tv_sec = 59, tv_usec = 999832} msecs = ret = 1 i = call = #12 0x00007f4d025b5c28 in io_loop_run (ioloop=0x7f4d03e3e680) at ioloop.c:405 No locals. #13 0x00007f4d025a3e33 in master_service_run (service=0x7f4d03e3e550, callback=) at master-service.c:481 No locals. #14 0x00007f4d027f7cc2 in main (argc=2, argv=0x7f4d03e3e370) at main.c:371 set_pool = 0x7f4d03e3e880 allow_core_dumps = ---Type to continue, or q to quit--- login_socket = 0x7f4d02800763 "login" c = #15 0x00007f4d021d676d in __libc_start_main () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #16 0x00007f4d02c2d5a9 in _start () No symbol table info available. Nicola From acrow at integrafin.co.uk Sun Jun 24 00:13:28 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Sat, 23 Jun 2012 22:13:28 +0100 Subject: [Dovecot] Hardware infrastructure for email system In-Reply-To: References: <4FE58A52.8050708@think-for-yourself.org> <4FE5A74D.2010201@thelounge.net> <4FE5F854.4050804@gmail.com> <4FE6069D.2050703@integrafin.co.uk> Message-ID: <4FE63178.9040203@integrafin.co.uk> On 23/06/12 19:21, Wojciech Puchar wrote: >> ALT storage, so for instance you could keep your indexes in a RAID10 >> of SSDs, recent email on a RAID10 of 10kRPM/15kRPM SAS drives, and >> older email can go on a load of 5k/7.2k SATA drives in RAID6, or on a >> NAS via NFS. > > far better solution but still about 2-3 times more $/performance than > needed, and more complex than needed. > > But at least an improvement > I'd respectfully disagree. If you only keep the most recent few weeks of email you could use reasonably priced SSDs for the indexes and perhaps downgrade to SATA for your "hot" store, both of which should be max 10% of your total space with more than a few months of email. My driving factor was to have different spindle sets for each purpose. Who knows, I might have overspent and could have done it with 3 separate SATA arrays. OTOH what about an SSD caching kit on your server? Supermicro at least do them (well, my UK vendor offers them). Just have a load of big SATA drives and use the kit for caching. The last time I looked a 256GB kit was about UKP 500. Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856) From lists at svrinformatica.it Sun Jun 24 00:34:47 2012 From: lists at svrinformatica.it (Mailing List SVR) Date: Sat, 23 Jun 2012 23:34:47 +0200 Subject: [Dovecot] 2.0.19 segfault In-Reply-To: <4FE6298F.6050502@svrinformatica.it> References: <4FE6298F.6050502@svrinformatica.it> Message-ID: <4FE63677.9080900@svrinformatica.it> Il 23/06/2012 22:39, Mailing List SVR ha scritto: > Hi, > > after the upgrade from dovecot 2.0.13 (ubuntu oneiric) to dovecot > 2.0.19 (ubuntu precise), in my logs I have a lot of these errors: > > Jun 23 00:20:29 server1 dovecot: master: Error: service(imap-login): > child 6714 killed with signal 11 (core dumps disabled) > > I tested 2.0.21 and the problem is still here. The problem seems to > appear only when the client is ms outlook, thunderbird works fine > > Here is the captured trace (I hope this is enough and I don't need to > install debug symbols for everythings): > > Core was generated by `dovecot/imap-login -D'. > Program terminated with signal 11, Segmentation fault. > #0 0x00007f4d01c1a031 in RC4 () from > /lib/x86_64-linux-gnu/libcrypto.so.1.0.0 > (gdb) bt full > #0 0x00007f4d01c1a031 in RC4 () from > /lib/x86_64-linux-gnu/libcrypto.so.1.0.0 > No symbol table info available. > #1 0x0000000000000134 in ?? () > No symbol table info available. > #2 0x00000000000000cd in ?? () > No symbol table info available. > #3 0x00007f4d03e97470 in ?? () > No symbol table info available. > #4 0x00007f4d01c80629 in ?? () from > /lib/x86_64-linux-gnu/libcrypto.so.1.0.0 > No symbol table info available. > #5 0x00007f4d01f82bcf in ?? () from > /lib/x86_64-linux-gnu/libssl.so.1.0.0 > No symbol table info available. > #6 0x00007f4d01f79e04 in ?? () from > /lib/x86_64-linux-gnu/libssl.so.1.0.0 > No symbol table info available. > #7 0x00007f4d01f7a134 in ?? () from > /lib/x86_64-linux-gnu/libssl.so.1.0.0 > No symbol table info available. > #8 0x00007f4d027fed6f in ssl_write (proxy=0x7f4d03e7c0a0) > at ssl-proxy-openssl.c:499 > ret = > #9 0x00007f4d027fee68 in plain_read (proxy=0x7f4d03e7c0a0) > at ssl-proxy-openssl.c:308 > ret = > corked = true > ---Type to continue, or q to quit--- > #10 0x00007f4d025b5c98 in io_loop_call_io (io=0x7f4d03e84b10) at > ioloop.c:384 > ioloop = 0x7f4d03e3e680 > t_id = 2 > #11 0x00007f4d025b6d27 in io_loop_handler_run (ioloop=) > at ioloop-epoll.c:213 > ctx = 0x7f4d03e505a0 > events = 0x6579351d > event = 0x7f4d03e50610 > list = 0x7f4d03e93690 > io = > tv = {tv_sec = 59, tv_usec = 999832} > msecs = > ret = 1 > i = > call = > #12 0x00007f4d025b5c28 in io_loop_run (ioloop=0x7f4d03e3e680) at > ioloop.c:405 > No locals. > #13 0x00007f4d025a3e33 in master_service_run (service=0x7f4d03e3e550, > callback=) at master-service.c:481 > No locals. > #14 0x00007f4d027f7cc2 in main (argc=2, argv=0x7f4d03e3e370) at > main.c:371 > set_pool = 0x7f4d03e3e880 > allow_core_dumps = > ---Type to continue, or q to quit--- > login_socket = 0x7f4d02800763 "login" > c = > #15 0x00007f4d021d676d in __libc_start_main () > from /lib/x86_64-linux-gnu/libc.so.6 > No symbol table info available. > #16 0x00007f4d02c2d5a9 in _start () > No symbol table info available. > > Nicola > Here is a more detailed trace, Core was generated by `dovecot/imap-login -D'. Program terminated with signal 11, Segmentation fault. #0 RC4 () at rc4-x86_64.s:343 343 rc4-x86_64.s: File o directory non esistente. (gdb) bt full #0 RC4 () at rc4-x86_64.s:343 No locals. #1 0x0000000000000134 in ?? () No symbol table info available. #2 0x00000000000000cd in ?? () No symbol table info available. #3 0x00007f4d03e97470 in ?? () No symbol table info available. #4 0x00007f4d01c80629 in rc4_hmac_md5_cipher (ctx=, out=0x7f4d03e8d0b8 "\314V\347\335Lc\024\205\221'?\006\177\313\326?\313\317\303c\266\360\347\364\263\242\316z\326\307\320\303?\242`\303\321?\313?\177\315\305\313?\320\307u\307\320\320\303\316?z?\307\314\303\300\316v\242\313\306\316?\321c\030T SORT=DISPLAY\301\021\222RC\005D=R\244\237T\342\004\"\020ES TH\003\246AD=\247\032FS \351ULTIA&\315\025N8\032\341\255\364EZ\376\236\062 CHILDREN\\\b{\250\240\255PACE U\216\331\nLUS LIST-EXTENDED I18NLEVEL=h CO"..., in=, len=0) at e_rc4_hmac_md5.c:163 key = 0x1a rc4_off = 139968754799079 md5_off = blocks = l = plen = #5 0x00007f4d01f82bcf in tls1_enc (s=0x7f4d03e7b700, send=1) at t1_enc.c:828 ---Type to continue, or q to quit--- rec = 0x7f4d03e7bcb8 ds = 0x7f4d03e95cf0 l = 308 bs = 1 i = ii = j = k = pad = enc = 0x7f4d01f4eae0 #6 0x00007f4d01f79e04 in do_ssl3_write (s=0x7f4d03e7b700, type=23, buf=0x7f4d03e7c514 "A0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CO"..., len=292, create_empty_fragment=0) at s3_pkt.c:815 p = plen = 0x7f4d03e8d0b6 "" i = mac_size = 0 clear = prefix_len = eivlen = align = ---Type to continue, or q to quit--- wr = 0x7f4d03e7bcb8 wb = 0x7f4d03e7bc68 sess = #7 0x00007f4d01f7a134 in ssl3_write_bytes (s=0x7f4d03e7b700, type=23, buf_=0x7f4d03e7c514, len=) at s3_pkt.c:605 buf = 0x7f4d03e7c514 "A0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CO"... tot = 0 n = 292 nw = i = #8 0x00007f4d027fed6f in ssl_write (proxy=0x7f4d03e7c0a0) at ssl-proxy-openssl.c:499 ret = #9 0x00007f4d027fee68 in plain_read (proxy=0x7f4d03e7c0a0) at ssl-proxy-openssl.c:308 ret = corked = true #10 0x00007f4d025b5c98 in io_loop_call_io (io=0x7f4d03e84b10) at ioloop.c:384 ioloop = 0x7f4d03e3e680 t_id = 2 #11 0x00007f4d025b6d27 in io_loop_handler_run (ioloop=) ---Type to continue, or q to quit--- at ioloop-epoll.c:213 ctx = 0x7f4d03e505a0 events = 0x6579351d event = 0x7f4d03e50610 list = 0x7f4d03e93690 io = tv = {tv_sec = 59, tv_usec = 999832} msecs = ret = 1 i = call = #12 0x00007f4d025b5c28 in io_loop_run (ioloop=0x7f4d03e3e680) at ioloop.c:405 No locals. #13 0x00007f4d025a3e33 in master_service_run (service=0x7f4d03e3e550, callback=) at master-service.c:481 No locals. #14 0x00007f4d027f7cc2 in main (argc=2, argv=0x7f4d03e3e370) at main.c:371 set_pool = 0x7f4d03e3e880 allow_core_dumps = login_socket = 0x7f4d02800763 "login" c = #15 0x00007f4d021d676d in __libc_start_main (main=0x7f4d027f7a60

, argc=2, ubp_av=0x7fff37290a68, init=, fini=, ---Type to continue, or q to quit--- rtld_fini=, stack_end=0x7fff37290a58) at libc-start.c:226 result = unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, -1085834845464457622, 139968735532416, 140734118824544, 0, 0, 1085429787565592170, 1041548453329079914}, mask_was_saved = 0}}, priv = {pad = { 0x0, 0x0, 0x7fff37290a80, 0x1}, data = {prev = 0x0, cleanup = 0x0, canceltype = 925436544}}} not_first_call = #16 0x00007f4d02c2d5a9 in _start () Nicola From bdh at machinehum.com Sun Jun 24 01:01:47 2012 From: bdh at machinehum.com (Brian Hayden) Date: Sat, 23 Jun 2012 17:01:47 -0500 Subject: [Dovecot] Hardware infrastructure for email system In-Reply-To: <4FE63178.9040203@integrafin.co.uk> References: <4FE58A52.8050708@think-for-yourself.org> <4FE5A74D.2010201@thelounge.net> <4FE5F854.4050804@gmail.com> <4FE6069D.2050703@integrafin.co.uk> <4FE63178.9040203@integrafin.co.uk> Message-ID: > On 23/06/12 19:21, Wojciech Puchar wrote: >>> ALT storage, so for instance you could keep your indexes in a RAID10 of SSDs, recent email on a RAID10 of 10kRPM/15kRPM SAS drives, and older email can go on a load of 5k/7.2k SATA drives in RAID6, or on a NAS via NFS. >> >> far better solution but still about 2-3 times more $/performance than needed, and more complex than needed. >> >> But at least an improvement Wojciech, how many users, does your installation serve? Not raw account numbers, but real users? The things you're saying sound mostly applicable to a small, easily-dictated env. -Brian From tss at iki.fi Sun Jun 24 01:05:09 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 24 Jun 2012 01:05:09 +0300 Subject: [Dovecot] 2.0.19 segfault In-Reply-To: <4FE6298F.6050502@svrinformatica.it> References: <4FE6298F.6050502@svrinformatica.it> Message-ID: <1340489109.5967.94.camel@hurina> On Sat, 2012-06-23 at 22:39 +0200, Mailing List SVR wrote: > after the upgrade from dovecot 2.0.13 (ubuntu oneiric) to dovecot 2.0.19 > (ubuntu precise), in my logs I have a lot of these errors: > > Jun 23 00:20:29 server1 dovecot: master: Error: service(imap-login): > child 6714 killed with signal 11 (core dumps disabled) > > I tested 2.0.21 and the problem is still here. The problem seems to > appear only when the client is ms outlook, thunderbird works fine Looks to me more like OpenSSL library bug. The only reason why it could be Dovecot bug is if Dovecot is causing memory corruption. Could you run imap-login via valgrind to see if this is the case? service imap-login { executable = /usr/bin/valgrind -q --vgdb=no /usr/local/libexec/dovecot/imap-login chroot = } Also have you changed any ssl-related settings in dovecot.conf? From lists at svrinformatica.it Sun Jun 24 01:27:45 2012 From: lists at svrinformatica.it (Mailing List SVR) Date: Sun, 24 Jun 2012 00:27:45 +0200 Subject: [Dovecot] 2.0.19 segfault In-Reply-To: <1340489109.5967.94.camel@hurina> References: <4FE6298F.6050502@svrinformatica.it> <1340489109.5967.94.camel@hurina> Message-ID: <4FE642E1.5070609@svrinformatica.it> Il 24/06/2012 00:05, Timo Sirainen ha scritto: > On Sat, 2012-06-23 at 22:39 +0200, Mailing List SVR wrote: > >> after the upgrade from dovecot 2.0.13 (ubuntu oneiric) to dovecot 2.0.19 >> (ubuntu precise), in my logs I have a lot of these errors: >> >> Jun 23 00:20:29 server1 dovecot: master: Error: service(imap-login): >> child 6714 killed with signal 11 (core dumps disabled) >> >> I tested 2.0.21 and the problem is still here. The problem seems to >> appear only when the client is ms outlook, thunderbird works fine > Looks to me more like OpenSSL library bug. The only reason why it could > be Dovecot bug is if Dovecot is causing memory corruption. Could you run > imap-login via valgrind to see if this is the case? > > service imap-login { > executable = /usr/bin/valgrind -q --vgdb=no /usr/local/libexec/dovecot/imap-login > chroot = > } > > Also have you changed any ssl-related settings in dovecot.conf? > attached my complete configuration, I hope there is a mistake in my config I looked at the code and there was no relevant change from dovecot 2.0.13 and dovecot 2.0.19, upgrading between ubuntu releases updated openssl too and this could be the problem, however is not clear to me while imap over ssl works fine with thunderdird and I see the crash in the logs for customers that seems to use ms outlook, Nicola > -------------- next part -------------- # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-25-generic x86_64 Ubuntu 12.04 LTS ext4 auth_cache_size = 10 M auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb auth_worker_max_count = 128 base_dir = /var/run/dovecot/ default_process_limit = 200 disable_plaintext_auth = no first_valid_gid = 2000 first_valid_uid = 2000 hostname = mail.svrinformatica.it last_valid_gid = 2000 last_valid_uid = 2000 listen = * login_greeting = SVR ready. mail_location = maildir:/srv/panel/mail/%d/%t/Maildir mail_plugins = " quota trash autocreate" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autocreate = Trash autocreate2 = Junk autocreate3 = Drafts autocreate4 = Sent autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Drafts autosubscribe4 = Sent quota = maildir:User quota quota_rule = *:storage=300MB quota_rule2 = Trash:ignore quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/move-spam.sieve sieve_dir = ~/sieve sieve_max_actions = 32 sieve_max_redirects = 4 sieve_max_script_size = 1M sieve_quota_max_scripts = 10 sieve_quota_max_storage = 2M trash = /etc/dovecot/dovecot-trash.conf.ext } postmaster_address = postmaster at svrinformatica.it protocols = imap pop3 sieve service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = vmail mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } user = $default_internal_user } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /srv/panel/django/systemcp/systemutils/mail/quota-warning.py unix_listener quota-warning { user = vmail } user = dovecot } ssl_cert = References: <4FE6298F.6050502@svrinformatica.it> <1340489109.5967.94.camel@hurina> Message-ID: <4FE647FD.4060400@svrinformatica.it> Il 24/06/2012 00:05, Timo Sirainen ha scritto: > On Sat, 2012-06-23 at 22:39 +0200, Mailing List SVR wrote: > >> after the upgrade from dovecot 2.0.13 (ubuntu oneiric) to dovecot 2.0.19 >> (ubuntu precise), in my logs I have a lot of these errors: >> >> Jun 23 00:20:29 server1 dovecot: master: Error: service(imap-login): >> child 6714 killed with signal 11 (core dumps disabled) >> >> I tested 2.0.21 and the problem is still here. The problem seems to >> appear only when the client is ms outlook, thunderbird works fine > Looks to me more like OpenSSL library bug. the bug seems related to this patch: http://cvs.openssl.org/chngview?cn=22415 I'm applying just now > The only reason why it could > be Dovecot bug is if Dovecot is causing memory corruption. Could you run > imap-login via valgrind to see if this is the case? > > service imap-login { > executable = /usr/bin/valgrind -q --vgdb=no /usr/local/libexec/dovecot/imap-login > chroot = > } > > Also have you changed any ssl-related settings in dovecot.conf? > > > From lists at svrinformatica.it Sun Jun 24 02:05:43 2012 From: lists at svrinformatica.it (Mailing List SVR) Date: Sun, 24 Jun 2012 01:05:43 +0200 Subject: [Dovecot] 2.0.19 segfault In-Reply-To: <4FE647FD.4060400@svrinformatica.it> References: <4FE6298F.6050502@svrinformatica.it> <1340489109.5967.94.camel@hurina> <4FE647FD.4060400@svrinformatica.it> Message-ID: <4FE64BC7.7020204@svrinformatica.it> Il 24/06/2012 00:49, Mailing List SVR ha scritto: > Il 24/06/2012 00:05, Timo Sirainen ha scritto: >> On Sat, 2012-06-23 at 22:39 +0200, Mailing List SVR wrote: >> >>> after the upgrade from dovecot 2.0.13 (ubuntu oneiric) to dovecot >>> 2.0.19 >>> (ubuntu precise), in my logs I have a lot of these errors: >>> >>> Jun 23 00:20:29 server1 dovecot: master: Error: service(imap-login): >>> child 6714 killed with signal 11 (core dumps disabled) >>> >>> I tested 2.0.21 and the problem is still here. The problem seems to >>> appear only when the client is ms outlook, thunderbird works fine >> Looks to me more like OpenSSL library bug. > > the bug seems related to this patch: > > http://cvs.openssl.org/chngview?cn=22415 > > I'm applying just now I can confirm that the patch listed above solve the problem, thanks for pointing me to openssl, Nicola > >> The only reason why it could >> be Dovecot bug is if Dovecot is causing memory corruption. Could you run >> imap-login via valgrind to see if this is the case? >> >> service imap-login { >> executable = /usr/bin/valgrind -q --vgdb=no >> /usr/local/libexec/dovecot/imap-login >> chroot = >> } >> >> Also have you changed any ssl-related settings in dovecot.conf? >> >> >> > > > From dovecot at r.paypc.com Sun Jun 24 02:57:09 2012 From: dovecot at r.paypc.com (Robin) Date: Sat, 23 Jun 2012 16:57:09 -0700 Subject: [Dovecot] 2.0.19 segfault In-Reply-To: <4FE642E1.5070609@svrinformatica.it> References: <4FE6298F.6050502@svrinformatica.it> <1340489109.5967.94.camel@hurina> <4FE642E1.5070609@svrinformatica.it> Message-ID: <4FE657D5.8060205@r.paypc.com> On 6/23/2012 3:27 PM, Mailing List SVR wrote: > I looked at the code and there was no relevant change from dovecot > 2.0.13 and dovecot 2.0.19, upgrading between ubuntu releases updated > openssl too and this could be the problem, > > however is not clear to me while imap over ssl works fine with > thunderdird and I see the crash in the logs for customers that seems to > use ms outlook, There have been many interactions between OpenSSL (and some other SSL implementations) and some versions of schannel.dll (the system library responsible for SSL connections, used by Outlook and Internet Explorer, amongst other tools). M$ has released hotfixes addressing various problems in schannel.dll in the past, such as: http://support.microsoft.com/kb/933430 There is a fair bit of write-up online about how to configure your SSL servers to avoid problematic ciphers and socket configurations that help you avoid tripping over most of the bugs. For example: http://httpd.apache.org/docs/2.2/ssl/ssl_faq.html#msie Whenever SSL is involved in the transaction process, always include it in your debug process as SSL negotiation is non-trivial and has been often fraught with some peril. =R= From spraker at yahoo.com Sun Jun 24 03:10:29 2012 From: spraker at yahoo.com (Brian Spraker) Date: Sat, 23 Jun 2012 17:10:29 -0700 (PDT) Subject: [Dovecot] Dovecot Quotas in Version 2 Message-ID: <1340496629.79833.YahooMailClassic@web111409.mail.gq1.yahoo.com> Hello all, Just upgraded from Ubuntu 10.04 to 12.04 on a server today and went through a few issues that I finally got corrected with many different services. However, one of them - I absolutely cannot figure out. I was using Dovecot 1 in Ubuntu 10.04 - but in Ubuntu 12.04, it has been upgraded to Dovecot 2. Finally managed to get the configuration to work and get it to use MySQL as the back-end authentication method (had to install the dovecot-mysql package). But, I cannot get quotas to work. The moment I uncomment a quota line, Dovecot fails to start. Would appreciate any help with this. I am not using any of the individual configuration files on the conf.d folder - simply the dovecot.conf and dovecot-sql.conf file. Here is a copy of those. You can see the one commented line (mail_plugins under imap) simply will not work - but yet the one under POP works (although I don't think it is used): base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_uid = 33 last_valid_uid = 33 listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " mail_privileged_group = www-data passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { quota = maildir quota_rule = Trash:storage=100M } protocols = imap pop3 service auth { user = root } service imap-login { executable = /usr/lib/dovecot/imap-login } service imap { executable = /usr/lib/dovecot/imap } ssl = no userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol imap { imap_client_workarounds = mail_plugin_dir = /usr/lib/dovecot/modules/imap # mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota pop3_uidl_format = %08Xu%08Xv } And for the dovecot-sql.conf file (passwords changed, of course): driver = mysql connect = dbname=horde user= password= host=localhost default_pass_scheme = PLAIN password_query = SELECT user_uid as user, user_pass as password FROM horde_users WHERE user_uid = '%u'; user_query = SELECT uid, gid, home, maildir, concat('maildir:storage=', quota) AS quota FROM horde_users WHERE user_uid = '%u'; I did not update the dovecot-sql.conf file at all - so I don't know if there maybe be some configuration issue with how it is pulling the quota limit from the database. Quotas are in bytes in the database. Certainly would appreciate any help with this. I went through the Dovecot Quota Configuration in the wiki but it wasn't any help - as I basically already have that line in the config file, but it will fail to start Dovecot. Thank you! Brian S. From tss at iki.fi Sun Jun 24 03:23:16 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 24 Jun 2012 03:23:16 +0300 Subject: [Dovecot] Dovecot Quotas in Version 2 In-Reply-To: <1340496629.79833.YahooMailClassic@web111409.mail.gq1.yahoo.com> References: <1340496629.79833.YahooMailClassic@web111409.mail.gq1.yahoo.com> Message-ID: On 24.6.2012, at 3.10, Brian Spraker wrote: > plugin { > quota = maildir > quota_rule = Trash:storage=100M This should be quota_rule2. Otherwise you'll just overwrite this here: > } > user_query = SELECT uid, gid, home, maildir, concat('maildir:storage=', quota) AS quota FROM horde_users WHERE user_uid = '%u'; You didn't update the quota configuration in here. Should be: concat('*:storage=', quota) AS quota_rule. BTW. This change happened during Dovecot v1.0 -> v1.1 change. Years ago for most people. :) From spraker at yahoo.com Sun Jun 24 03:29:47 2012 From: spraker at yahoo.com (Brian Spraker) Date: Sat, 23 Jun 2012 17:29:47 -0700 (PDT) Subject: [Dovecot] Dovecot Quotas in Version 2 In-Reply-To: Message-ID: <1340497787.45659.YahooMailClassic@web111404.mail.gq1.yahoo.com> --- On Sat, 6/23/12, Timo Sirainen wrote: > From: Timo Sirainen > Subject: Re: [Dovecot] Dovecot Quotas in Version 2 > To: "Brian Spraker" > Cc: dovecot at dovecot.org > Date: Saturday, June 23, 2012, 7:23 PM > On 24.6.2012, at 3.10, Brian Spraker > wrote: > > > plugin { > >? quota = maildir > >? quota_rule = Trash:storage=100M > > This should be quota_rule2. Otherwise you'll just overwrite > this here: > > > } > > > user_query = SELECT uid, gid, home, maildir, > concat('maildir:storage=', quota) AS quota FROM horde_users > WHERE user_uid = '%u'; > > You didn't update the quota configuration in here. Should > be: concat('*:storage=', quota) AS quota_rule. > > BTW. This change happened during Dovecot v1.0 -> v1.1 > change. Years ago for most people. :) > > Thank you, Timo. I have made this change. However, I do remember before when I set set something as "quota_rule2", it was being ignored for some reason. I have updated at your response though. This still didn't correct the issue - and Dovecot won't start when I have the mail_plugins line under 'protocol imap' uncommented. Error in the syslog says: init: dovecot main process (xxxxx) terminated with status 89 Brian S. From tss at iki.fi Sun Jun 24 03:33:14 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 24 Jun 2012 03:33:14 +0300 Subject: [Dovecot] Dovecot Quotas in Version 2 In-Reply-To: <1340497787.45659.YahooMailClassic@web111404.mail.gq1.yahoo.com> References: <1340497787.45659.YahooMailClassic@web111404.mail.gq1.yahoo.com> Message-ID: On 24.6.2012, at 3.29, Brian Spraker wrote: > This still didn't correct the issue - and Dovecot won't start when I have the mail_plugins line under 'protocol imap' uncommented. You should also enable quota globally so it will work for doveadm and other tools you may end up using. > Error in the syslog says: > > init: dovecot main process (xxxxx) terminated with status 89 There should be another error message before this. From spraker at yahoo.com Sun Jun 24 03:45:03 2012 From: spraker at yahoo.com (Brian Spraker) Date: Sat, 23 Jun 2012 17:45:03 -0700 (PDT) Subject: [Dovecot] Dovecot Quotas in Version 2 In-Reply-To: Message-ID: <1340498703.67452.YahooMailClassic@web111404.mail.gq1.yahoo.com> --- On Sat, 6/23/12, Timo Sirainen wrote: > From: Timo Sirainen > Subject: Re: [Dovecot] Dovecot Quotas in Version 2 > To: "Brian Spraker" > Cc: dovecot at dovecot.org > Date: Saturday, June 23, 2012, 7:33 PM > On 24.6.2012, at 3.29, Brian Spraker > wrote: > > > This still didn't correct the issue - and Dovecot won't > start when I have the mail_plugins line under 'protocol > imap' uncommented. > > You should also enable quota globally so it will work for > doveadm and other tools you may end up using. > > > Error in the syslog says: > > > > init: dovecot main process (xxxxx) terminated with > status 89 > > There should be another error message before this. > > Thank you for the fast replies Timo. I'm not sure I understand how to enable quota to work globally..? But what would be preventing it from working under 'protocol imap' as it did before? As for the log, here is the other lines that appeared above it: Jun 23 19:31:13 server dovecot: master: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Jun 23 19:31:13 server dovecot: log: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) Jun 23 19:31:13 server kernel: [100996.340925] init: dovecot main process (11580) terminated with status 89 From tss at iki.fi Sun Jun 24 03:51:12 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 24 Jun 2012 03:51:12 +0300 Subject: [Dovecot] Dovecot Quotas in Version 2 In-Reply-To: <1340498703.67452.YahooMailClassic@web111404.mail.gq1.yahoo.com> References: <1340498703.67452.YahooMailClassic@web111404.mail.gq1.yahoo.com> Message-ID: On 24.6.2012, at 3.45, Brian Spraker wrote: > I'm not sure I understand how to enable quota to work globally..? Just put "mail_plugins = quota" outside protocol {} sections. > But what would be preventing it from working under 'protocol imap' as it did before? No idea, the error log should say the reason. > As for the log, here is the other lines that appeared above it: > > Jun 23 19:31:13 server dovecot: master: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) > Jun 23 19:31:13 server dovecot: log: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) These mean that dovecot master process was stopped by init process. Why it's doing that I have no idea. > Jun 23 19:31:13 server kernel: [100996.340925] init: dovecot main process (11580) terminated with status 89 Status 89 means that Dovecot should have logged an error about it. But I see no error here. I think Ubuntu is doing something weird. See what happens if you start dovecot using "dovecot -F" instead of any init script or such. From spraker at yahoo.com Sun Jun 24 04:01:46 2012 From: spraker at yahoo.com (Brian Spraker) Date: Sat, 23 Jun 2012 18:01:46 -0700 (PDT) Subject: [Dovecot] Dovecot Quotas in Version 2 In-Reply-To: Message-ID: <1340499706.74316.YahooMailClassic@web111404.mail.gq1.yahoo.com> --- On Sat, 6/23/12, Timo Sirainen wrote: > From: Timo Sirainen > Subject: Re: [Dovecot] Dovecot Quotas in Version 2 > To: "Brian Spraker" > Cc: dovecot at dovecot.org > Date: Saturday, June 23, 2012, 7:51 PM > On 24.6.2012, at 3.45, Brian Spraker > wrote: > > > I'm not sure I understand how to enable quota to work > globally..? > > Just put "mail_plugins = quota" outside protocol {} > sections. > > >? But what would be preventing it from working > under 'protocol imap' as it did before? > > No idea, the error log should say the reason. > > > As for the log, here is the other lines that appeared > above it: > > > > Jun 23 19:31:13 server dovecot: master: Warning: Killed > with signal 15 (by pid=1 uid=0 code=kill) > > Jun 23 19:31:13 server dovecot: log: Warning: Killed > with signal 15 (by pid=1 uid=0 code=kill) > > These mean that dovecot master process was stopped by init > process. Why it's doing that I have no idea. > > > Jun 23 19:31:13 server kernel: [100996.340925] init: > dovecot main process (11580) terminated with status 89 > > Status 89 means that Dovecot should have logged an error > about it. But I see no error here. I think Ubuntu is doing > something weird. See what happens if you start dovecot using > "dovecot -F" instead of any init script or such. > > Perfect! doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: mail_plugin_dir: access(/usr/lib/dovecot/modules/imap) failed: No such file or directory I changed it to /usr/lib/dovecot/modules and now it works fine. Thank you for the help again! Brian S. From michael at think-for-yourself.org Sun Jun 24 04:21:34 2012 From: michael at think-for-yourself.org (Michael Wessel) Date: Sat, 23 Jun 2012 18:21:34 -0700 Subject: [Dovecot] Hardware infrastructure for email system In-Reply-To: <20120623102555.GA5497@state-of-mind.de> References: <4FE58A52.8050708@think-for-yourself.org> <20120623102555.GA5497@state-of-mind.de> Message-ID: <4FE66B9E.1080901@think-for-yourself.org> Hi p at rick and thanks for the response. On 6/23/2012 3:25 AM, Patrick Ben Koetter wrote: > Michael, > > * Michael Wessel : >> I'm currently (re-)planning my email setup and have been doing some >> research. I have done some searches and read several threads in the >> areas of my questions here. While there are some that come close I >> haven't yet been able to get all my questions answered. >> >> I currently run a postfix, dovecot & roundcube setup and have about >> 2000 active accounts. I have a separate SMTP server for outbound >> mail and auth is done against a separate LDAP server. In front of >> the POP/IMAP server I have another SMTP (4 in parallel actually) >> server that receives and filters inbound mail through a company >> specific, proprietary filter before the mail hits the POP/IMAP >> server. LDAP & SMTP servers are ESXi VMs. > Do people use 'real' mail clients to connect and IDLE too? Yes, though not sure of the percentage. Most will likely use webmail, some will use POP and some will use IMAP with "real clients". Right now my guess would be about 20% IMAP with Outlook, Thunderbird and such, 10% POP and the rest webmail. > > >> So right now both dovecot and roundcube run on the same box which is >> a Dell PE2950 with dual quad-core Xeon, 16GB RAM and 6 1TB disks in >> RAID 6, so only local storage using maildir. So far it's been >> holding up fine, but it's beginning to show signs of overload now. I >> also expect an increase in users over the next few months up to >> somewhere between 10 - 20,000 mail boxes. Hence the re-planning. >> >> My first priority in redesigning my setup is reliability. I >> definitely need something fail-save and as close to always on as >> possible. Next is performance. And while the budget is of course >> limited for the moment I'm setting that aside and will worry about >> that when the time comes. >> >> Now here is my question(s): >> >> In order to support up to 20,000 mailboxes (distributed over several >> times-zones so they won't all be used at the same time) with a very >> reliable service with good performance, what do I actually need? >> >> Do I need(ul) SAN or is it just a "would be nice to have"? If yes, >> why and what would be appropriate for my needs? Or will a setup with >> a few more servers like the ones I already have, using something >> like DRBD and distributing services (imap, http, spamd etc) onto >> different boxes do? > Will the server enforce quota? Yes, default quota is 200MB right now, some have larger quotas and a few of those hit several GB. > > What will be the average mailbox size? Since the quota is probably going to go up some I'd guess around 400MB on average. > > Do people share content e.g. mailings with attachments that go out to all > recipients? No, only on a limited basis (like cc'ing maybe 15 or so people but even that's rare) There will be somewhat large attachments involved (20-30MB) but that's mostly between individual users and users outside my system. > > What might be the maximum number of clients using the server at one time? Hard to say with the data at hand. I have a caching IMAP proxy for webmail and that has so far recorded 50 as the highest concurrent connections. So adding IMAP users to that and then extrapolating this to 20000 total boxes I'd say 4-500. > > Will all users use the same client product e.g. roundcube? No, they have their choice of any POP3/IMAP client or webmail > > What's your backup strategy? What do you use to backup mailboxes? I was afraid someone was going to ask that question... there isn't one (it hurts just writing that!) The only "backup" currently in place is redundancy on the hardware-side plus limited (i.e. only parts of the mail store) to disk backup. The VMs are easily replaced, but if my maildir goes up in smoke tomorrow then I will probably follow shortly after! So that's definitely part of what I'm working out here. Wanted to nail down the general approach first though before looking at that. > > p at rick > From CMarcus at Media-Brokers.com Sun Jun 24 12:24:01 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 24 Jun 2012 05:24:01 -0400 Subject: [Dovecot] Dovecot Quotas in Version 2 In-Reply-To: <1340496629.79833.YahooMailClassic@web111409.mail.gq1.yahoo.com> References: <1340496629.79833.YahooMailClassic@web111409.mail.gq1.yahoo.com> Message-ID: <4FE6DCB1.6000807@Media-Brokers.com> On 2012-06-23 8:10 PM, Brian Spraker wrote: > Would appreciate any help with this. I am not using any of the > individual configuration files on the conf.d folder - simply the > dovecot.conf and dovecot-sql.conf file. Here is a copy of those. Please don't just copy/paste from your configs, always provide doveconf -n output. This will prove that you are using the config that you *think* you are using (one problem with debian derivatives is that they often use chroot by default which can cause problems). So, if you have something in one of those other individual conf files in conf.d causing the problem, you'll see it in the doveconf -n output. Then, when providing logs, try not to censor them too much... often the real problem can be evident one or more lines above or below the line that you *think* is the most relevant... -- Best regards, Charles From c at roessner-network-solutions.com Sun Jun 24 12:58:43 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Sun, 24 Jun 2012 11:58:43 +0200 Subject: [Dovecot] 2.1.7 TLS issues Message-ID: <824886E0-DD88-4B91-BE32-1839F449906F@roessner-network-solutions.com> Hi, I have an interesting problem: I am building dovecot packages for Ubuntu since 10.04. Never had bigger trouble with it. Now since 2.1.6 or 2.1.7 (I can not say more precisely), Thunderbird 10ESR and Outlook 2010 can no longer use 143/TLS correctly. Automx delvers 143/TLS and Outlook tells me that it can not create a secure connection. I changed automx to use 993/SSL and everything works. Under Thunderbird 10ESR, I get a box that tells me that I need to change settings. When I sent mail, TB told me that it could not copy the mail to the sent folder. I also changed to 993/SSL and everything is perfect. At the other and, Apples Mail.app and iOS devices work perfectly over 143/TLS. So my guess is that it has to do with OpenSSL. Did something change in dovecot concerning TLS? Can I change options in the built process? Thanks in advance -Christian R??ner --- Roessner-Network-Solutions Bachelor of Science Informatik Nahrungsberg 81, 35390 Gie?en F: +49 641 5879091, M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From CMarcus at Media-Brokers.com Sun Jun 24 13:06:07 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 24 Jun 2012 06:06:07 -0400 Subject: [Dovecot] 2.1.7 TLS issues In-Reply-To: <824886E0-DD88-4B91-BE32-1839F449906F@roessner-network-solutions.com> References: <824886E0-DD88-4B91-BE32-1839F449906F@roessner-network-solutions.com> Message-ID: <4FE6E68F.6080803@Media-Brokers.com> On 2012-06-24 5:58 AM, Christian R??ner wrote: > I have an interesting problem: I am building dovecot packages for > Ubuntu since 10.04. Never had bigger trouble with it. Now since 2.1.6 > or 2.1.7 (I can not say more precisely), Thunderbird 10ESR and > Outlook 2010 can no longer use 143/TLS correctly. Automx delvers > 143/TLS and Outlook tells me that it can not create a secure > connection. I changed automx to use 993/SSL and everything works. > Under Thunderbird 10ESR, I get a box that tells me that I need to > change settings. When I sent mail, TB told me that it could not copy > the mail to the sent folder. I also changed to 993/SSL and everything > is perfect. > > At the other and, Apples Mail.app and iOS devices work perfectly over > 143/TLS. So my guess is that it has to do with OpenSSL. Did something > change in dovecot concerning TLS? Can I change options in the built > process? Maybe related to the OpenSSL bug that caused the problem (it sometimes helps to read/search emails on this list before posting) discussed just yesterday in this thread: http://www.mail-archive.com/dovecot at dovecot.org/msg45828.html ? -- Best regards, Charles From ckubu at so36.net Sun Jun 24 13:21:15 2012 From: ckubu at so36.net (ckubu) Date: Sun, 24 Jun 2012 12:21:15 +0200 Subject: [Dovecot] dict Panic after upgrade to 2.1.7 Message-ID: <201206241221.16044.ckubu@so36.net> Hello, after upgrade my mailsystem to dovecot version 2.1.7, dovecot doesn't work properly. something went wrong in dict service connecting the postgres backend. that happens not on every connection. the db connection data are correct, no difference connecting via tcp or linux socket. dovecot log entries: Jun 23 23:19:10 mx dovecot: dict: Panic: file driver-pgsql.c: line 84 (driver_pgsql_set_state): assertion failed: (state == SQL_DB_STATE_BUSY || db- >cur_result == NULL) Jun 23 23:19:10 mx dovecot: dict: Error: Raw backtrace: /usr/local/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(+0x4478a) [0x7ffc7d8e578a] -> /usr/local/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(+0x447d6) [0x7ffc7d8e57d6] -> /usr/local/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(i_error+0) [0x7ffc7d8bc5ef] -> dovecot/dict() [0x40a9a6] -> dovecot/dict() [0x40aa01] -> dovecot/dict() [0x40be43] -> dovecot/dict() [0x409474] -> dovecot/dict(sql_db_cache_deinit+0x20) [0x4089d0] -> dovecot/dict(main+0x169) [0x4059f9] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7ffc7d335c8d] -> dovecot/dict() [0x404b59] Jun 23 23:19:10 mx dovecot: dict: Fatal: master: service(dict): child 13812 killed with signal 6 (core dumps disabled) Jun 23 23:23:09 mx dovecot: dict: Error: dict sql iterate failed: Not connected to database Jun 23 23:23:09 mx dovecot: pop3(xxx at yyy.zz): Error: acl: dict iteration failed, can't update dict Jun 23 23:23:09 mx dovecot: dict: Error: dict sql iterate failed: Not connected to database Jun 23 23:23:09 mx dovecot: pop3(xxx at yyy.zz): Error: acl: dict iteration failed, can't update dict Jun 23 23:23:17 mx dovecot: dict: Error: dict sql lookup failed: Not connected to database Jun 23 23:23:17 mx dovecot: imap(xxx at yyy.zz): Error: Internal quota calculation error Jun 23 23:23:19 mx dovecot: dict: Error: dict sql lookup failed: Not connected to database Jun 23 23:23:40 mx dovecot: dict: Error: dict sql lookup failed: Not connected to database maybe i have missconfigured the dovecot system, but i don't find the mistake. can anybody give me a hint ? best wiches christoph ----- doveconf -n # 2.1.7: /usr/local/dovecot-2.1.7/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-vserver-amd64 x86_64 Debian 6.0.5 ext3 auth_mechanisms = plain login digest-md5 cram-md5 apop auth_socket_path = /var/run/dovecot/auth-userdb auth_username_translation = %@ auth_verbose = yes auth_verbose_passwords = plain base_dir = /var/run/dovecot/ dict { acl = pgsql:/usr/local/dovecot/etc/dovecot/sql-dict.conf.ext expire = pgsql:/usr/local/dovecot/etc/dovecot/sql-dict.conf.ext quota = pgsql:/usr/local/dovecot/etc/dovecot/sql-dict.conf.ext } disable_plaintext_auth = no first_valid_gid = 5000 first_valid_uid = 5000 hostname = mx.warenform.de last_valid_gid = 5000 last_valid_uid = 5000 listen = 178.63.63.151 2a01:4f8:121:c5::2 mail_gid = vmail mail_location = maildir:/var/vmail/%d/%n/Maildir mail_plugins = autocreate quota expire acl mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = children location = maildir:/var/vmail/%%d/%%n/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /usr/local/dovecot/etc/dovecot/sql-connect.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl autocreate = Spam autocreate2 = Sent autocreate3 = Trash autocreate4 = Drafts autosubscribe = Spam autosubscribe2 = Sent autosubscribe3 = Trash autosubscribe4 = Drafts expire = Trash expire2 = Trash.* expire3 = Spam expire_dict = proxy::expire quota = dict:User quota::proxy::quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+200M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u recipient_delimiter = sieve = ~/.dovecot.sieve sieve_before = /usr/local/dovecot/etc/dovecot/sieve/move-spam.sieve sieve_dir = ~/sieve sieve_global_dir = /usr/local/dovecot/etc/dovecot/sieve/global/ } postmaster_address = admin at warenform.de protocols = imap pop3 sieve lmtp service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imap { address = 127.0.0.1 178.63.63.151 2a01:4f8:121:c5::2 } inet_listener imaps { address = 178.63.63.151 2a01:4f8:121:c5::2 } process_min_avail = 16 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } service pop3-login { inet_listener pop3 { address = 178.63.63.151 2a01:4f8:121:c5::2 } inet_listener pop3s { address = 178.63.63.151 2a01:4f8:121:c5::2 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } shutdown_clients = no ssl_cert = References: <824886E0-DD88-4B91-BE32-1839F449906F@roessner-network-solutions.com> <4FE6E68F.6080803@Media-Brokers.com> Message-ID: <46FA7370-959B-47CD-B0EB-0BCDFA1B3511@roessner-network-solutions.com> > Maybe related to the OpenSSL bug that caused the problem (it sometimes helps to read/search emails on this list before posting) discussed just yesterday in this thread: > > http://www.mail-archive.com/dovecot at dovecot.org/msg45828.html well, the packages I built are still running under 10.04 and therefor the library has not been upgraded to 1.0.1. This is the reason for this post. My question is, if doevcot got some code or anything else that focuses on the newer 1.0.1 library, and maybe broke something in older versions? -Christian R??ner --- Roessner-Network-Solutions Bachelor of Science Informatik Nahrungsberg 81, 35390 Gie?en F: +49 641 5879091, M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From CMarcus at Media-Brokers.com Sun Jun 24 14:22:58 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 24 Jun 2012 07:22:58 -0400 Subject: [Dovecot] 2.1.7 TLS issues In-Reply-To: <46FA7370-959B-47CD-B0EB-0BCDFA1B3511@roessner-network-solutions.com> References: <824886E0-DD88-4B91-BE32-1839F449906F@roessner-network-solutions.com> <4FE6E68F.6080803@Media-Brokers.com> <46FA7370-959B-47CD-B0EB-0BCDFA1B3511@roessner-network-solutions.com> Message-ID: <4FE6F892.5010004@Media-Brokers.com> On 2012-06-24 6:42 AM, Christian R??ner wrote: >> Maybe related to the OpenSSL bug that caused the problem (it >> sometimes helps to read/search emails on this list before posting) >> discussed just yesterday in this thread: >> >> http://www.mail-archive.com/dovecot at dovecot.org/msg45828.html > well, the packages I built are still running under 10.04 and therefor > the library has not been upgraded to 1.0.1. This is the reason for > this post. My question is, if doevcot got some code or anything else > that focuses on the newer 1.0.1 library, and maybe broke something in > older versions? Ah, ok, missed that... Well, sorry I can't help, hopefully Timo will have an answer for you... -- Best regards, Charles From tss at iki.fi Sun Jun 24 17:19:15 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 24 Jun 2012 17:19:15 +0300 Subject: [Dovecot] 2.1.7 TLS issues In-Reply-To: <824886E0-DD88-4B91-BE32-1839F449906F@roessner-network-solutions.com> References: <824886E0-DD88-4B91-BE32-1839F449906F@roessner-network-solutions.com> Message-ID: On 24.6.2012, at 12.58, Christian R??ner wrote: > I have an interesting problem: I am building dovecot packages for Ubuntu since 10.04. Never had bigger trouble with it. Now since 2.1.6 or 2.1.7 (I can not say more precisely), Thunderbird 10ESR and Outlook 2010 can no longer use 143/TLS correctly. Automx delvers 143/TLS and Outlook tells me that it can not create a secure connection. I changed automx to use 993/SSL and everything works. Under Thunderbird 10ESR, I get a box that tells me that I need to change settings. When I sent mail, TB told me that it could not copy the mail to the sent folder. I also changed to 993/SSL and everything is perfect. > > At the other and, Apples Mail.app and iOS devices work perfectly over 143/TLS. So my guess is that it has to do with OpenSSL. Did something change in dovecot concerning TLS? Can I change options in the built process? What was the Dovecot version you were using previously which worked? From r.vicinus at metaways.de Sun Jun 24 18:57:29 2012 From: r.vicinus at metaways.de (Reinhard Vicinus) Date: Sun, 24 Jun 2012 17:57:29 +0200 Subject: [Dovecot] Mail migration to dovecot with doveadm backup Message-ID: <4FE738E9.6040706@metaways.de> Hi, i try to migrate mails from a non dovecot imap server to a dovecot imap server with doveadm backup as described there: http://wiki2.dovecot.org/Migration/Dsync i first tried (local-mailbox port 18143 is the non dovecot imap server): /usr/bin/doveadm -o imapc_user=user at example.org -o imapc_password=imappw -o imapc_host=local-mailbox -o imapc_features=rfc822.size -o imapc_port=18143 -o mailbox_list_index=no -v -D backup -R -f -u user at example.org -m Sent imapc: and got the following error: dsync(user at example.org): Fatal: dsync backup: Looks like you're trying to run backup in wrong direction. Source is empty and destination is not. As the dovecot imap account is newly created and therefore empty it seams to try to backup from the dovecot imap server to the non dovecot imap server. So i tried instead: /usr/bin/doveadm -o imapc_user=user at example.org -o imapc_password=imappw -o imapc_host=local-mailbox -o imapc_features=rfc822.size -o imapc_port=18143 -o mailbox_list_index=no -v -D backup -f -u user at example.org -m Sent imapc: Sometimes (every other time?) i got the following segmentation fault: bt #0 0x00007f15e2c9ed74 in strcasecmp () from /lib/libc.so.6 #1 0x00007f15e327eaff in imapc_save_callback (reply=0x7fff56096a70, context=) at imapc-save.c:168 #2 0x00007f15e32853fe in imapc_command_reply_free (conn=0x72f040) at imapc-connection.c:946 #3 imapc_connection_input_tagged (conn=0x72f040) at imapc-connection.c:1039 #4 0x00007f15e3285668 in imapc_connection_input_one (conn=0x72f040) at imapc-connection.c:1085 #5 imapc_connection_input_pending (conn=0x72f040) at imapc-connection.c:1407 #6 0x00007f15e3285922 in imapc_connection_input (conn=0x72f040) at imapc-connection.c:1100 #7 0x00007f15e2fe6176 in io_loop_call_io (io=0x792510) at ioloop.c:379 #8 0x00007f15e2fe71ff in io_loop_handler_run (ioloop=) at ioloop-epoll.c:213 #9 0x00007f15e2fe6118 in io_loop_run (ioloop=0x7529a0) at ioloop.c:398 #10 0x00007f15e3281e49 in imapc_client_run_pre (client=0x7333e0) at imapc-client.c:142 #11 imapc_client_run (client=0x7333e0) at imapc-client.c:161 #12 0x00007f15e3280f24 in imapc_storage_run (storage=0x732bd0) at imapc-storage.c:118 #13 0x00007f15e327f003 in imapc_save_append (_ctx=0x74dcb0) at imapc-save.c:232 #14 imapc_save_finish (_ctx=0x74dcb0) at imapc-save.c:255 #15 0x00007f15e1bf06a1 in quota_save_finish (ctx=0x74dcb0) at quota-storage.c:227 #16 0x00007f15e3292487 in mailbox_save_finish (_ctx=0x7f15e2d4ca40) at mail-storage.c:1669 #17 0x000000000042b736 in local_worker_save_msg_continue (worker=0x73c770) at dsync-worker-local.c:1681 #18 0x000000000042b98c in local_worker_msg_save (_worker=0x73c770, msg=0x7f15e38e4298, data=0x7fff56096db0, callback=0x4269f0 , context=0x78a610) at dsync-worker-local.c:1739 #19 0x000000000042b0d9 in dsync_worker_msg_save (worker=0x73c770, msg=, data=0x7fff56096db0, callback=0x4269f0 , context=0x78a610) at dsync-worker.c:234 #20 0x0000000000426ac5 in msg_get_callback (result=, data=0x7fff56096db0, context=0x78a610) at dsync-brain-msgs-new.c:79 #21 0x000000000042dca9 in local_worker_msg_get_next (worker=0x726f30, get=0x7fff56096e00) at dsync-worker-local.c:1844 #22 0x000000000042def8 in local_worker_msg_get (_worker=0x0, mailbox=, uid=3805596224, callback=0x2670, context=0x58) at dsync-worker-local.c:1865 #23 0x000000000042ace6 in dsync_worker_msg_get (worker=0x726f30, mailbox=0x7f15e38e40f1, uid=1, callback=0x426a40 , context=) at dsync-worker.c:261 #24 0x000000000042689e in dsync_brain_msg_sync_add_new_msg (iter=0x7f15e38e41d8) at dsync-brain-msgs-new.c:181 #25 dsync_brain_mailbox_add_new_msgs (iter=0x7f15e38e41d8) at dsync-brain-msgs-new.c:216 #26 dsync_brain_msg_sync_add_new_msgs (iter=0x7f15e38e41d8) at dsync-brain-msgs-new.c:315 #27 0x0000000000426164 in dsync_brain_msg_sync_more (sync=0x7f15e38e4050) at dsync-brain-msgs.c:436 #28 0x0000000000424979 in dsync_brain_sync_msgs (brain=0x7351c0) at dsync-brain.c:736 #29 dsync_brain_sync (brain=0x7351c0) at dsync-brain.c:857 #30 0x0000000000425849 in dsync_brain_subs_list_finished (context=0x750fa0) at dsync-brain.c:169 #31 dsync_worker_subs_input (context=0x750fa0) at dsync-brain.c:222 #32 0x0000000000424cbd in dsync_brain_sync (brain=0x7351c0) at dsync-brain.c:842 #33 0x00000000004256bc in dsync_brain_mailbox_list_finished (context=0x743a60) at dsync-brain.c:98 #34 dsync_worker_mailbox_input (context=0x743a60) at dsync-brain.c:125 #35 0x0000000000424afe in dsync_brain_sync (brain=0x7351c0) at dsync-brain.c:833 #36 0x0000000000425568 in dsync_brain_sync_all (brain=0x7351c0) at dsync-brain.c:897 #37 0x0000000000422ad6 in cmd_dsync_start (ctx=0x706560, worker1=, worker2=) at doveadm-dsync.c:342 #38 0x0000000000422dfa in cmd_dsync_run (_ctx=0x706560, user=0x7209c0) at doveadm-dsync.c:387 #39 0x000000000040f888 in doveadm_mail_next_user (ctx=0x706560, input=, error_r=0x7fff560973d0) at doveadm-mail.c:311 #40 0x0000000000410071 in doveadm_mail_cmd (cmd=0x704880, argc=7, argv=0x6fe418) at doveadm-mail.c:518 #41 0x0000000000410501 in doveadm_mail_try_run (cmd_name=0x6fe4e4 "backup", argc=1443460960, argv=0x4377c7) at doveadm-mail.c:577 #42 0x00000000004170d1 in main (argc=7, argv=0x6fe3e8) at doveadm.c:373 The other times it shows the following error message (It seams to connect both times to the non dovecot imap server): doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_lookup (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so doveadm(root): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(user at example.org): Debug: auth input: user at example.org home=/mail/dovecot/example.org/user uid=1000 gid=1000 quota_rule=*:bytes=2000M:messages=0 doveadm(user at example.org): Debug: Added userdb setting: plugin/quota_rule=*:bytes=2000M:messages=0 doveadm(user at example.org): Debug: Effective uid=1000, gid=1000, home=/mail/dovecot/example.org/user doveadm(user at example.org): Debug: Quota root: name=User quota backend=dict args=:proxy::quota doveadm(user at example.org): Debug: Quota rule: root=User quota mailbox=* bytes=2097152000 messages=0 doveadm(user at example.org): Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 doveadm(user at example.org): Debug: Quota warning: bytes=1992294400 (95%) messages=0 reverse=no command=quota-warning 95 user at example.org doveadm(user at example.org): Debug: Quota warning: bytes=1677721600 (80%) messages=0 reverse=no command=quota-warning 80 user at example.org doveadm(user at example.org): Debug: dict quota: user=user at example.org, uri=proxy::quota, noenforcing=0 doveadm(user at example.org): Debug: fs: root=/mail/dovecot/example.org/user/mail, index=, control=, inbox=, alt= doveadm(user at example.org): Debug: Namespace : Using permissions from /mail/dovecot/example.org/user/mail: mode=0700 gid=-1 dsync(user at example.org): Debug: Effective uid=1000, gid=1000, home=/mail/dovecot/example.org/user dsync(user at example.org): Debug: Quota root: name=User quota backend=dict args=:proxy::quota dsync(user at example.org): Debug: Quota rule: root=User quota mailbox=* bytes=2097152000 messages=0 dsync(user at example.org): Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 dsync(user at example.org): Debug: Quota warning: bytes=1992294400 (95%) messages=0 reverse=no command=quota-warning 95 user at example.org dsync(user at example.org): Debug: Quota warning: bytes=1677721600 (80%) messages=0 reverse=no command=quota-warning 80 user at example.org dsync(user at example.org): Debug: dict quota: user=user at example.org, uri=proxy::quota, noenforcing=0 dsync(user at example.org): Debug: imapc: root=, index=, control=, inbox=, alt= dsync(user at example.org): Debug: imapc(local-mailbox:18143): Looking up IP address dsync(user at example.org): Debug: imapc(local-mailbox:18143): Connecting to 10.10.10.10:18143 dsync(user at example.org): Debug: imapc(local-mailbox:18143): Server capabilities: IMAP4 IMAP4rev1 AUTH=LOGIN ACL NAMESPACE CHILDREN SORT QUOTA THREAD=ORDEREDSUBJECT UNSELECT IDLE dsync(user at example.org): Debug: imapc(local-mailbox:18143): Authenticating as user at example.org dsync(user at example.org): Debug: imapc(local-mailbox:18143): Authenticated successfully dsync(user at example.org): Debug: imapc(local-mailbox:18143): Looking up IP address dsync(user at example.org): Debug: imapc(local-mailbox:18143): Connecting to 10.10.10.10:18143 dsync(user at example.org): Debug: imapc(local-mailbox:18143): Server capabilities: IMAP4 IMAP4rev1 AUTH=LOGIN ACL NAMESPACE CHILDREN SORT QUOTA THREAD=ORDEREDSUBJECT UNSELECT IDLE dsync(user at example.org): Debug: imapc(local-mailbox:18143): Authenticating as user at example.org dsync(user at example.org): Debug: imapc(local-mailbox:18143): Authenticated successfully dsync(user at example.org): Warning: Destination mailbox Sent has been modified, need to recreate it before we can continue syncing dsync(user at example.org): Warning: Mailbox changes caused a desync. You may want to run dsync again. dsync(user at example.org): Debug: imapc(local-mailbox:18143): Disconnected dsync(user at example.org): Debug: imapc(local-mailbox:18143): Disconnected i think the problem could be that the account name on the remote server and the local server is absolute identical and doveadm backup has therefore problems discerning between the two locations. But that's only a stab in the dark and any help is appreciated. Kind regards Reinhard From robert at schetterer.org Sun Jun 24 20:42:39 2012 From: robert at schetterer.org (Robert Schetterer) Date: Sun, 24 Jun 2012 19:42:39 +0200 Subject: [Dovecot] 2.1.7 TLS issues In-Reply-To: References: <824886E0-DD88-4B91-BE32-1839F449906F@roessner-network-solutions.com> Message-ID: <4FE7518F.60200@schetterer.org> Am 24.06.2012 16:19, schrieb Timo Sirainen: > On 24.6.2012, at 12.58, Christian R??ner wrote: > >> I have an interesting problem: I am building dovecot packages for Ubuntu since 10.04. Never had bigger trouble with it. Now since 2.1.6 or 2.1.7 (I can not say more precisely), Thunderbird 10ESR and Outlook 2010 can no longer use 143/TLS correctly. Automx delvers 143/TLS and Outlook tells me that it can not create a secure connection. I changed automx to use 993/SSL and everything works. Under Thunderbird 10ESR, I get a box that tells me that I need to change settings. When I sent mail, TB told me that it could not copy the mail to the sent folder. I also changed to 993/SSL and everything is perfect. >> >> At the other and, Apples Mail.app and iOS devices work perfectly over 143/TLS. So my guess is that it has to do with OpenSSL. Did something change in dovecot concerning TLS? Can I change options in the built process? > > What was the Dovecot version you were using previously which worked? > Hi Christian, i made all the way trough all versions of dovecot trunk 2.0.x and since 2.1.5 on lucid 64 no problems at , but i recent had big problems with compile other stuff on ubuntu 12.4 with openssl ( didnt checked dovecot yet ) so my bet goes to the new ssl lib on 12.04 also there were workarounds in postfix to reflect this ssl update stuff, as far i remember hte ssl lib has some more and new features wich makes software not reflecting this ,may not work or fail sometimes, it may fixed with setup parameters i.e see here http://comments.gmane.org/gmane.mail.postfix.user/229196 --snip Viktor Dukhovni: > The OpenSSL API does not provide an interface to allow older programs > to disable new protocol versions defined in later versions of the API. > > Therefore, to disable TLS 1.1 or 1.2 one has to add code that uses > the new constants introduced with OpenSSL 1.0.1. > > Proposed patch attached. That will be a solution for Postfix 2.10. Meanwhile, for earlier Postfix releases, how much of the problem can be solved by changing from: mumble_tls_mandatory_protocols = SSLv3, TLSv1 (i.e. the current default) to: mumble_tls_mandatory_protocols = !SSLv2 I don't mind that the older Postfix versions would not be able to turn on/off protocols that didn't exist at the time Postfix was released. Wietse --snipend i guees there are equal workarounds settings possible in dovecot perhaps with ssl_cipher_list ? http://wiki.dovecot.org/SSL/DovecotConfiguration sorry lot of speculate here until not testet myself -- Best Regards MfG Robert Schetterer From role.Dovecot-Readers at JLAssocs.com Sun Jun 24 21:23:46 2012 From: role.Dovecot-Readers at JLAssocs.com (J E Lyon) Date: Sun, 24 Jun 2012 19:23:46 +0100 Subject: [Dovecot] The deleted_to_trash Plugin (workaround Outlook 2007 behaviour) Message-ID: <9F4DE9B0-5EDB-4F8E-8EC9-B98856EDD4FB@JLAssocs.com> Hi, I see the plugin exists for v1 & v2, all very interesting... Surprised no one seems to have created an RPM and it looks like deleted_to_trash is one of the very few plugins to not be shipped as part of the default install with CentOS 5.5 or CentOS 6 (i.e. Dovecot v1 & v2 respectively.) Am I missing something, or does everyone really build from source? Thanks, James. From c at roessner-network-solutions.com Sun Jun 24 23:20:05 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Sun, 24 Jun 2012 22:20:05 +0200 Subject: [Dovecot] 2.1.7 TLS issues In-Reply-To: References: <824886E0-DD88-4B91-BE32-1839F449906F@roessner-network-solutions.com> Message-ID: <451CA0A8-E296-49DB-859A-BADACA1EFC78@roessner-network-solutions.com> >> I have an interesting problem: I am building dovecot packages for Ubuntu since 10.04. Never had bigger trouble with it. Now since 2.1.6 or 2.1.7 (I can not say more precisely), Thunderbird 10ESR and Outlook 2010 can no longer use 143/TLS correctly. Automx delvers 143/TLS and Outlook tells me that it can not create a secure connection. I changed automx to use 993/SSL and everything works. Under Thunderbird 10ESR, I get a box that tells me that I need to change settings. When I sent mail, TB told me that it could not copy the mail to the sent folder. I also changed to 993/SSL and everything is perfect. >> >> At the other and, Apples Mail.app and iOS devices work perfectly over 143/TLS. So my guess is that it has to do with OpenSSL. Did something change in dovecot concerning TLS? Can I change options in the built process? > > What was the Dovecot version you were using previously which worked? I am not sure which version worked. My best guess is 2.1.4 or 2.1.5, because I skipped 2.1.6. But 2.1.6 has the same issues, as my friend Uwe did report the same issues with that one. @Robert: I am talking about Ubuntu 10.04, so this can not be a problem with openssl itself, as that did not change -Christian R??ner --- Roessner-Network-Solutions Bachelor of Science Informatik Nahrungsberg 81, 35390 Gie?en F: +49 641 5879091, M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From role.Dovecot-Readers at JLAssocs.com Sun Jun 24 23:28:21 2012 From: role.Dovecot-Readers at JLAssocs.com (J E Lyon) Date: Sun, 24 Jun 2012 21:28:21 +0100 Subject: [Dovecot] 2.1.7 TLS issues In-Reply-To: <451CA0A8-E296-49DB-859A-BADACA1EFC78@roessner-network-solutions.com> References: <824886E0-DD88-4B91-BE32-1839F449906F@roessner-network-solutions.com> <451CA0A8-E296-49DB-859A-BADACA1EFC78@roessner-network-solutions.com> Message-ID: <2FD79483-C77E-4FB8-8C93-2A2C93014B83@JLAssocs.com> On 24 Jun 2012, at 21:20, Christian R??ner wrote: >>> I have an interesting problem: I am building dovecot packages for Ubuntu since 10.04. Never had bigger trouble with it. Now since 2.1.6 or 2.1.7 (I can not say more precisely), Thunderbird 10ESR and Outlook 2010 can no longer use 143/TLS correctly. Automx delvers 143/TLS and Outlook tells me that it can not create a secure connection. I changed automx to use 993/SSL and everything works. Under Thunderbird 10ESR, I get a box that tells me that I need to change settings. When I sent mail, TB told me that it could not copy the mail to the sent folder. I also changed to 993/SSL and everything is perfect. >>> >>> At the other and, Apples Mail.app and iOS devices work perfectly over 143/TLS. So my guess is that it has to do with OpenSSL. Did something change in dovecot concerning TLS? Can I change options in the built process? >> >> What was the Dovecot version you were using previously which worked? > > I am not sure which version worked. My best guess is 2.1.4 or 2.1.5, because I skipped 2.1.6. But 2.1.6 has the same issues, as my friend Uwe did report the same issues with that one. > > @Robert: I am talking about Ubuntu 10.04, so this can not be a problem with openssl itself, as that did not change I've seen problems with all kinds of clients and servers, even with Dovecot 1.x where TLS/Auto settings fail and I simply always instruct end users to explicitly choose 993/SSL to get a good TLS connection reliably. It seems like it might not be so version-specific or even anything wrong at the server end. James. From juergen at pabel.net Sun Jun 24 23:37:00 2012 From: juergen at pabel.net (=?ISO-8859-1?Q?J=FCrgen?= Pabel) Date: Sun, 24 Jun 2012 22:37:00 +0200 Subject: [Dovecot] Additional passdb result status Message-ID: <1340570220.13783.23.camel@P7230> Dear Dovecot-Team, I am implementing a plugin (for the pop3/imap process) that requires some data to provided from the authentication phase (a derivative of the password). For that, I have now implemented a passdb plugin that generates this data and I would like to "pass" this data down to the mail process (pop3/imap) via extra_fields in the reply of the authentication. The general idea is that my custom passdb plugin calculates the data, sets the extra_field and returns some error (authentication was not successful) so that the "real" passdb backend can be invoked to "really" validate the authentication data. However, in auth_request_handle_passdb_callback() the extra_fields are reseted unless the return code is PASSDB_RESULT_USER_DISABLED. But if that return code is used then any following passdb's aren't invoked any more - which makes sense with respect to user authenticiation. I would therefore like to propose that some IGNORE/CONTINUE-status to be introduced in auth/passdb.h, that would be handled in that extra_fields and possible other values are not reseted in order to allow such propagation of data from authentication process down to the mail process (which could be extracted from the reply string by parsing it). As a further implementation alternative (to the parsing of the reply string), I also propose that some new "environment" item be introduced (in auth_request) in order to allow such data passing in a generic manner. I hope you consider my proposal to be reasonable. If desired, I could implement this myself and provide a patch for merging (based on 2.0.x). If my proposal is generally unfavored, it would be great if any alternative approaches for my situation were suggested. Thanks. Regards, J?rgen PS: please reply to my e-mail (or CC me), as I have not subscribed to the dovecot list From c at roessner-network-solutions.com Mon Jun 25 01:09:10 2012 From: c at roessner-network-solutions.com (=?utf-8?Q?Christian_R=C3=B6=C3=9Fner?=) Date: Mon, 25 Jun 2012 00:09:10 +0200 Subject: [Dovecot] 2.1.7 TLS issues In-Reply-To: <2FD79483-C77E-4FB8-8C93-2A2C93014B83@JLAssocs.com> References: <824886E0-DD88-4B91-BE32-1839F449906F@roessner-network-solutions.com> <451CA0A8-E296-49DB-859A-BADACA1EFC78@roessner-network-solutions.com> <2FD79483-C77E-4FB8-8C93-2A2C93014B83@JLAssocs.com> Message-ID: <13AD4EF2-00E8-46E1-A5BE-39D8CFABBFD8@roessner-network-solutions.com> > >>>> I have an interesting problem: I am building dovecot packages for Ubuntu since 10.04. Never had bigger trouble with it. Now since 2.1.6 or 2.1.7 (I can not say more precisely), Thunderbird 10ESR and Outlook 2010 can no longer use 143/TLS correctly. Automx delvers 143/TLS and Outlook tells me that it can not create a secure connection. I changed automx to use 993/SSL and everything works. Under Thunderbird 10ESR, I get a box that tells me that I need to change settings. When I sent mail, TB told me that it could not copy the mail to the sent folder. I also changed to 993/SSL and everything is perfect. >>>> >>>> At the other and, Apples Mail.app and iOS devices work perfectly over 143/TLS. So my guess is that it has to do with OpenSSL. Did something change in dovecot concerning TLS? Can I change options in the built process? >>> >>> What was the Dovecot version you were using previously which worked? >> >> I am not sure which version worked. My best guess is 2.1.4 or 2.1.5, because I skipped 2.1.6. But 2.1.6 has the same issues, as my friend Uwe did report the same issues with that one. >> >> @Robert: I am talking about Ubuntu 10.04, so this can not be a problem with openssl itself, as that did not change > > I've seen problems with all kinds of clients and servers, even with Dovecot 1.x where TLS/Auto settings fail and I simply always instruct end users to explicitly choose 993/SSL to get a good TLS connection reliably. > > It seems like it might not be so version-specific or even anything wrong at the server end. I never had such problems before. When I was coding automx, all tests succeeded with Dovecot and Outlook 2007/2010 and also Thunderbird was working perfectly. So in my opinion this is a version specific problem, as it started somewhere in 2.1.4+. I am using Dovecot since 1.0 (something like this) and never had 143/TLS problems Best regards Christian -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4873 bytes Desc: not available URL: From robert at schetterer.org Mon Jun 25 01:26:41 2012 From: robert at schetterer.org (Robert Schetterer) Date: Mon, 25 Jun 2012 00:26:41 +0200 Subject: [Dovecot] 2.1.7 TLS issues In-Reply-To: <451CA0A8-E296-49DB-859A-BADACA1EFC78@roessner-network-solutions.com> References: <824886E0-DD88-4B91-BE32-1839F449906F@roessner-network-solutions.com> <451CA0A8-E296-49DB-859A-BADACA1EFC78@roessner-network-solutions.com> Message-ID: <4FE79421.2000908@schetterer.org> Am 24.06.2012 22:20, schrieb Christian R??ner: > @Robert: I am talking about Ubuntu 10.04, so this can not be a problem with openssl itself, as that did not change > > -Christian R??ner miracle, i have no known problems with 10.04 ssl/tls 2.1.7 -- Best Regards MfG Robert Schetterer From tss at iki.fi Mon Jun 25 05:20:55 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 25 Jun 2012 05:20:55 +0300 Subject: [Dovecot] 2.1.7 TLS issues In-Reply-To: <451CA0A8-E296-49DB-859A-BADACA1EFC78@roessner-network-solutions.com> References: <824886E0-DD88-4B91-BE32-1839F449906F@roessner-network-solutions.com> <451CA0A8-E296-49DB-859A-BADACA1EFC78@roessner-network-solutions.com> Message-ID: <702E15F4-4689-477E-BE7D-6F1AB67C27E9@iki.fi> On 24.6.2012, at 23.20, Christian R??ner wrote: >>> I have an interesting problem: I am building dovecot packages for Ubuntu since 10.04. Never had bigger trouble with it. Now since 2.1.6 or 2.1.7 (I can not say more precisely), Thunderbird 10ESR and Outlook 2010 can no longer use 143/TLS correctly. Automx delvers 143/TLS and Outlook tells me that it can not create a secure connection. I changed automx to use 993/SSL and everything works. Under Thunderbird 10ESR, I get a box that tells me that I need to change settings. When I sent mail, TB told me that it could not copy the mail to the sent folder. I also changed to 993/SSL and everything is perfect. >>> >>> At the other and, Apples Mail.app and iOS devices work perfectly over 143/TLS. So my guess is that it has to do with OpenSSL. Did something change in dovecot concerning TLS? Can I change options in the built process? >> >> What was the Dovecot version you were using previously which worked? > > I am not sure which version worked. My best guess is 2.1.4 or 2.1.5, because I skipped 2.1.6. But 2.1.6 has the same issues, as my friend Uwe did report the same issues with that one. Well, there hasn't been many changes in the SSL code. The only thing I can think of is this memory leak fix, which temporarily wasn't implemented correctly. You could try what happens if you revert it: changeset: 14418:85ad4baedd43 user: Timo Sirainen date: Thu Apr 12 10:48:55 2012 +0300 summary: login: Another attempt at fixing SSL memory leak. changeset: 14417:f80f18d0ffa3 user: Timo Sirainen date: Thu Apr 12 10:41:44 2012 +0300 summary: login: Reverted memory leak fix, because it broke some SSL setups? changeset: 14416:584bd77c38fd user: Timo Sirainen date: Wed Apr 11 19:06:44 2012 +0300 summary: Memory leak fixes. From zdy0818 at gmail.com Mon Jun 25 05:52:55 2012 From: zdy0818 at gmail.com (DongYu.Zhen) Date: Mon, 25 Jun 2012 10:52:55 +0800 Subject: [Dovecot] dovecot support ms-tnef mail parser? Message-ID: <4FE7D287.6020507@gmail.com> Hello everybody, I used iRedMail Server with dovecot-1.2.0. I used OutLook2007 send a RTF mail and the mail can't be parsed normal. In dovecot maildir storage the mail body appeared ,/ / /------=_NextPart_000_0007_01CD52BC.99E1BE10 Content-Type: application/ms-tnef; name="winmail.dat" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="winmail.dat"/ How to parse ms-tnef mail by dovecot? Thank you. From ott at mirix.org Mon Jun 25 09:15:38 2012 From: ott at mirix.org (Matthias-Christian Ott) Date: Mon, 25 Jun 2012 08:15:38 +0200 Subject: [Dovecot] dovecot support ms-tnef mail parser? In-Reply-To: <4FE7D287.6020507@gmail.com> References: <4FE7D287.6020507@gmail.com> Message-ID: <4FE8020A.7080806@mirix.org> On 2012-06-25 04:52, DongYu.Zhen wrote: > How to parse ms-tnef mail by dovecot? You can't do that directly in Dovecot. What you can do is to use a utility called tnef [1] (available in major GNU/Linux distributions) on the client to extract the data on the client. Otherwise you could use ytnef [2] with procmail or Dovecot sieve_pipe [3] on the server (see [4]). I tried tnef on rare occasions and it worked. Regards, Matthias-Christian [1] http://sourceforge.net/projects/tnef/ [2] http://sourceforge.net/projects/ytnef/ [3] http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Pipe [4] http://wiki.clug.org.za/wiki/Automatic_winmail.dat_decoding From kayasaman at gmail.com Mon Jun 25 10:20:39 2012 From: kayasaman at gmail.com (Kaya Saman) Date: Mon, 25 Jun 2012 08:20:39 +0100 Subject: [Dovecot] Virtual users - what is better Maildir or mbox? Message-ID: Hi, I'm trying to configure a server to use SAMBA and Winbind to authenticate to Active Directory.... I managed to get this portion up and running even the Dovecot portion. For reference something similar to this guide: http://www.whitneytechnologies.com/?p=119 However PAM is slightly different: # cat /etc/pam.d/dovecot auth sufficient pam_krb5.so no_user_check validate account sufficient pam_permit.so This is what my dovecot.conf file looks like: # cat dovecot.conf # v1.2+: auth_use_winbind = yes auth_winbind_helper_path = /usr/local/bin/ntlm_auth protocols = imap # It's nice to have separate log files for Dovecot. You could do this # by changing syslog configuration also, but this is easier. log_path = /var/log/dovecot.log info_log_path = /var/log/dovecot-info.log # Disable SSL for now. ssl = no disable_plaintext_auth = no # We're using Maildir format #mail_location = maildir:~/Maildir mail_location = mbox:/mail:INBOX=/mail/%u # Authentication configuration: auth_verbose = yes auth_debug = yes auth_username_format = %n auth_mechanisms = plain ntlm login userdb { driver = static # args = uid=501 gid=1001 home=/mail/%u args = home=/mail/%u driver = static } passdb { driver = pam args = failure_show_msg=yes } Now what I would like to know is, which is better for "virtual hosting" Maildir or mbox? Basically my requirement is that I would like to separate users via either individual folders and then put each user's mbox or Maildir in the created directory, or simply name each mbox or Maildir according to the user name. First up is this possible? Secondly, how would I go about doing it? My users are not allowed to login to the system outside of IMAP as it's a Mail only server. Currently I've been looking at many links: http://satish-linuxbug.blogspot.co.uk/2008/08/freebsd-with-active-directory-single.html http://joseph.randomnetworks.com/2005/11/08/freebsd-users-and-groups-with-samba-winbind-and-active-directory/ http://wiki2.dovecot.org/HowTo/ActiveDirectoryNtlm http://wiki2.dovecot.org/Authentication/Mechanisms/Winbind http://wiki2.dovecot.org/TestInstallation http://wiki2.dovecot.org/VirtualUsers http://www.linuxmail.info/active-directory-dovecot-pam-authentication/ http://wiki2.dovecot.org/HowTo/SimpleVirtualInstall I'm running dovecot version 2.1.7 on FreeBSD 8.2 x64 RELEASE. The system is not being used as an MTA server meaning that only IMAP transfers are being done using MS Outlook then filtered by Thunderbird. Regards, Kaya From trever at middleearth.sapphiresunday.org Mon Jun 25 10:27:41 2012 From: trever at middleearth.sapphiresunday.org (Trever L. Adams) Date: Mon, 25 Jun 2012 01:27:41 -0600 Subject: [Dovecot] Virtual users - what is better Maildir or mbox? In-Reply-To: References: Message-ID: <4FE812ED.9060604@middleearth.sapphiresunday.org> On 06/25/2012 01:20 AM, Kaya Saman wrote: > Hi, > > I'm trying to configure a server to use SAMBA and Winbind to > authenticate to Active Directory.... I managed to get this portion up > and running even the Dovecot portion. > > For reference something similar to this guide: > > http://www.whitneytechnologies.com/?p=119 > > > However PAM is slightly different: > > > # cat /etc/pam.d/dovecot > auth sufficient pam_krb5.so no_user_check validate > account sufficient pam_permit.so > > > This is what my dovecot.conf file looks like: If you are using Samba 4 (possibly recent versions of S3), any reason you are not doing krb5 and ldap (for account verification, not authentication) on dovecot instead of through pam? It is a bit harder to setup, but no text passwords. I still do pam_krb5 for devices that cannot do kerberos. I am using Maildir, but my setup is currently largely idle. Trever -- "Marxist Law of Distribution of Wealth: Shortages will be divided equally among the peasants." -- Unknown From role.Dovecot-Readers at JLAssocs.com Mon Jun 25 10:28:00 2012 From: role.Dovecot-Readers at JLAssocs.com (J E Lyon) Date: Mon, 25 Jun 2012 08:28:00 +0100 Subject: [Dovecot] Virtual users - what is better Maildir or mbox? In-Reply-To: References: Message-ID: <201BCC0D-AD89-4A07-A4F0-13C42AFC2A63@JLAssocs.com> On 25 Jun 2012, at 08:20, Kaya Saman wrote: > Now what I would like to know is, which is better for "virtual > hosting" Maildir or mbox? I always use Maildir in preference to mbox . . it's just such a lovely solution, imho :) (Mind you, I'm on a *nix server, so filesystem behaviour may be a consideration for non-*nix hosts.) > Basically my requirement is that I would like to separate users via > either individual folders and then put each user's mbox or Maildir in > the created directory, or simply name each mbox or Maildir according > to the user name. > > First up is this possible? > > Secondly, how would I go about doing it? In haste, I haven't been able to check your email thoroughly, but I have used passwd with an extra field appended to each user, to identify the mailbox location. If you're authenticating against ActiveDirectory, then I guess that means generating a passwd-file style 'database' from the users in ActiveDirectory and I have no idea if that's trivial. Sorry if my rushed thoughts are too sketchy to be of use, but thought I'd share my experience in case it offers any pointers. J. From trever at middleearth.sapphiresunday.org Mon Jun 25 10:37:42 2012 From: trever at middleearth.sapphiresunday.org (Trever L. Adams) Date: Mon, 25 Jun 2012 01:37:42 -0600 Subject: [Dovecot] Virtual users - what is better Maildir or mbox? In-Reply-To: References: Message-ID: <4FE81546.8000202@middleearth.sapphiresunday.org> On 06/25/2012 01:20 AM, Kaya Saman wrote: > Now what I would like to know is, which is better for "virtual > hosting" Maildir or mbox? > > > Basically my requirement is that I would like to separate users via > either individual folders and then put each user's mbox or Maildir in > the created directory, or simply name each mbox or Maildir according > to the user name. > > > First up is this possible? > > > Secondly, how would I go about doing it? > Sorry, I missed this at first. It is quite simple. I don't store it in passwd or any other place, since you are doing vmail, you might find this easiest: in /etc/dovecot/conf.d/10-mail.conf (where mail_location is): mail_home = /home/vmail/%Ld/%Ln mail_location = maildir:~/Maildir in /etc/dovecot/conf.d/10-mail.conf (after paragraph ?# System user and group used to access mails...?): mail_uid=vmail mail_gid=vmail Obviously, vmail may not be your user for vmail. Also, some of my notes may no longer be accurate for location, just find where it exists and edit. I hope this helps. Of course, this is a Maildir setup. mbox is probably very similar, but I have had too many mbox style mail queues go south losing all of the mail (or more than one would like), so I do Maildir, even though it isn't necessarily the best use of disk space. Trever -- "I do not fear computers. I fear the lack of them." -- Isaac Asimov From kayasaman at gmail.com Mon Jun 25 10:52:51 2012 From: kayasaman at gmail.com (Kaya Saman) Date: Mon, 25 Jun 2012 08:52:51 +0100 Subject: [Dovecot] Virtual users - what is better Maildir or mbox? In-Reply-To: <4FE81546.8000202@middleearth.sapphiresunday.org> References: <4FE81546.8000202@middleearth.sapphiresunday.org> Message-ID: On Mon, Jun 25, 2012 at 8:37 AM, Trever L. Adams wrote: > On 06/25/2012 01:20 AM, Kaya Saman wrote: > > Now what I would like to know is, which is better for "virtual > hosting" Maildir or mbox? > > > Basically my requirement is that I would like to separate users via > either individual folders and then put each user's mbox or Maildir in > the created directory, or simply name each mbox or Maildir according > to the user name. > > > First up is this possible? > > > Secondly, how would I go about doing it? > > Sorry, I missed this at first. It is quite simple. I don't store it in > passwd or any other place, since you are doing vmail, you might find this > easiest: > > in /etc/dovecot/conf.d/10-mail.conf (where mail_location is): > > mail_home = /home/vmail/%Ld/%Ln > mail_location = maildir:~/Maildir > > in /etc/dovecot/conf.d/10-mail.conf (after paragraph ?# System user and > group used to access mails...?): > > mail_uid=vmail > mail_gid=vmail > > Obviously, vmail may not be your user for vmail. Also, some of my notes may > no longer be accurate for location, just find where it exists and edit. > > I hope this helps. Of course, this is a Maildir setup. mbox is probably very > similar, but I have had too many mbox style mail queues go south losing all > of the mail (or more than one would like), so I do Maildir, even though it > isn't necessarily the best use of disk space. > > Trever > -- > "I do not fear computers. I fear the lack of them." -- Isaac Asimov Thanks for the responses! Sorry if I reply to every single one in this email however, I am using Gmail's awful Web UI so I don't really have much control over what I'm doing...... To start with the reason I'm not using LDAP is because I couldn't find enough information on how to set it up! I did post here a couple of times but got no responses...... so I figured it was something that people either didn't know or found trivial. I'll take a look at the above config for Maildir format as briefly playing around with mbox it seems that folders on the / root (parent) IMAP directory are stored separately. It may be better if everything got stored under the Maildir heading.... I've previously **only** ever worked with Maildir but I was told that there are some benefits to mbox which is why I decided to try to use it here! Regards, Kaya From role.Dovecot-Readers at JLAssocs.com Mon Jun 25 10:58:45 2012 From: role.Dovecot-Readers at JLAssocs.com (J E Lyon) Date: Mon, 25 Jun 2012 08:58:45 +0100 Subject: [Dovecot] Virtual users - what is better Maildir or mbox? In-Reply-To: References: <4FE81546.8000202@middleearth.sapphiresunday.org> Message-ID: <267BC57F-B747-4F58-B309-ACE4BDA3A88C@JLAssocs.com> On 25 Jun 2012, at 08:52, Kaya Saman wrote: > I've previously **only** ever worked with Maildir but I was told that there are some benefits to mbox which is why I decided to try to use it here! I used mbox before Dovecot, but once I found Maildir, I never looked back. I've not come up with any significant advantages of mbox that count for much in my experiences and installations . . Would be interested to hear of suggested advantages that I might have overlooked or know of reasons why they're not an issue . . not sure how much the list wants to hear, but feel free to email me direct if you want. J. From CMarcus at Media-Brokers.com Mon Jun 25 11:45:15 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 25 Jun 2012 04:45:15 -0400 Subject: [Dovecot] dovecot support ms-tnef mail parser? In-Reply-To: <4FE8020A.7080806@mirix.org> References: <4FE7D287.6020507@gmail.com> <4FE8020A.7080806@mirix.org> Message-ID: <4FE8251B.8010008@Media-Brokers.com> On 2012-06-25 2:15 AM, Matthias-Christian Ott wrote: > On 2012-06-25 04:52, DongYu.Zhen wrote: >> How to parse ms-tnef mail by dovecot? > > You can't do that directly in Dovecot. What you can do is to use a > utility called tnef [1] (available in major GNU/Linux distributions) on > the client to extract the data on the client. Otherwise you could use > ytnef [2] with procmail or Dovecot sieve_pipe [3] on the server (see [4]). > > I tried tnef on rare occasions and it worked. > > Regards, > Matthias-Christian > > [1] http://sourceforge.net/projects/tnef/ > [2] http://sourceforge.net/projects/ytnef/ > [3] http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Pipe > [4] http://wiki.clug.org.za/wiki/Automatic_winmail.dat_decoding Sounds like a good candidate for a plug-in. Currently I use the Lookout extension in Thunderbird to do this, but it isn't perfect... -- Best regards, Charles From CMarcus at Media-Brokers.com Mon Jun 25 11:47:55 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 25 Jun 2012 04:47:55 -0400 Subject: [Dovecot] Additional passdb result status In-Reply-To: <1340570220.13783.23.camel@P7230> References: <1340570220.13783.23.camel@P7230> Message-ID: <4FE825BB.4030105@Media-Brokers.com> On 2012-06-24 4:37 PM, J?rgen Pabel wrote: > I am implementing a plugin (for the pop3/imap process) that requires > some data to provided from the authentication phase (a derivative of the > password). For that, I have now implemented a passdb plugin that > generates this data and I would like to "pass" this data down to the > mail process (pop3/imap) via extra_fields in the reply of the > authentication. The general idea is that my custom passdb plugin > calculates the data, sets the extra_field and returns some error > (authentication was not successful) so that the "real" passdb backend > can be invoked to "really" validate the authentication data. What specifically is the *purpose* of this? > I hope you consider my proposal to be reasonable. If desired, I could > implement this myself and provide a patch for merging (based on 2.0.x). > If my proposal is generally unfavored, it would be great if any > alternative approaches for my situation were suggested. Thanks. I think it is usually preferred that you do things like this against either the current shipping/stable branch (2.1.x), or even hg (2.2)... much better chance that it would be accepted. -- Best regards, Charles From CMarcus at Media-Brokers.com Mon Jun 25 12:31:24 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 25 Jun 2012 05:31:24 -0400 Subject: [Dovecot] Virtual users - what is better Maildir or mbox? In-Reply-To: References: Message-ID: <4FE82FEC.1070109@Media-Brokers.com> On 2012-06-25 3:20 AM, Kaya Saman wrote: > # cat dovecot.conf > # v1.2+: > auth_use_winbind = yes Please always only provide output of doveconf -n, not copy/pastes from the config files. This proves (to yourself and everyone else) that you are using the config that dovecot is actually using - it this shows you mistakes like typos, certain deprecated/invalid settings, and even if you are editing the wrong config file(s). -- Best regards, Charles From kayasaman at gmail.com Mon Jun 25 12:34:35 2012 From: kayasaman at gmail.com (Kaya Saman) Date: Mon, 25 Jun 2012 10:34:35 +0100 Subject: [Dovecot] Virtual users - what is better Maildir or mbox? In-Reply-To: <4FE82FEC.1070109@Media-Brokers.com> References: <4FE82FEC.1070109@Media-Brokers.com> Message-ID: On Mon, Jun 25, 2012 at 10:31 AM, Charles Marcus wrote: > On 2012-06-25 3:20 AM, Kaya Saman wrote: >> >> # cat dovecot.conf >> # v1.2+: >> auth_use_winbind = yes > > > Please always only provide output of doveconf -n, not copy/pastes from the > config files. > > This proves (to yourself and everyone else) that you are using the config > that dovecot is actually using - it this shows you mistakes like typos, > certain deprecated/invalid settings, and even if you are editing the wrong > config file(s). > > -- > > Best regards, > > Charles Thanks for the tip! I didn't know of the dovecot -n command so thanks for pointing that out to me...... It's strange as I've been fiddling around with mail servers for some time in test labs at home but I still feel like I'm on the outside looking in; oh well at least this design at work is much better even though it took forever to get the PAM potion for AD sorted out. Regards, Kaya From CMarcus at Media-Brokers.com Mon Jun 25 12:44:19 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 25 Jun 2012 05:44:19 -0400 Subject: [Dovecot] Virtual users - what is better Maildir or mbox? In-Reply-To: <267BC57F-B747-4F58-B309-ACE4BDA3A88C@JLAssocs.com> References: <4FE81546.8000202@middleearth.sapphiresunday.org> <267BC57F-B747-4F58-B309-ACE4BDA3A88C@JLAssocs.com> Message-ID: <4FE832F3.3000405@Media-Brokers.com> On 2012-06-25 3:58 AM, J E Lyon wrote: > I've not come up with any significant advantages of mbox that count > for much in my experiences and installations . . Would be interested > to hear of suggested advantages that I might have overlooked One major advantage of mbox (and now mdbox) over maildir is the time it takes to back things up for larger mail stores. It takes much less time to compare a single mbox file that contains 20,000 messages (and rsync only the changed bits) than it does to compare read/compare 20,000 individual files (maildir)... I too like maildir, but am seriously considering implementing a solution where older mail is automatically archived to slower/cheaper SATA III based storage using mdbox format. -- Best regards, Charles From ef at math.uni-bonn.de Mon Jun 25 12:54:02 2012 From: ef at math.uni-bonn.de (Edgar =?iso-8859-1?B?RnXf?=) Date: Mon, 25 Jun 2012 11:54:02 +0200 Subject: [Dovecot] specifying home/sieve/sieve_dir relative to mail_location In-Reply-To: <20120619131413.GN48358@trav.math.uni-bonn.de> References: <20120619131413.GN48358@trav.math.uni-bonn.de> Message-ID: <20120625095401.GT50872@trav.math.uni-bonn.de> > With 1.2, is it possible to specify home, sieve and sieve_dir relative to mail_location? No-one, this one? Too simple? Too stupid? Too obvious? Not possible? From branko at majic.rs Mon Jun 25 13:01:40 2012 From: branko at majic.rs (Branko Majic) Date: Mon, 25 Jun 2012 12:01:40 +0200 Subject: [Dovecot] Virtual users - what is better Maildir or mbox? In-Reply-To: References: <4FE81546.8000202@middleearth.sapphiresunday.org> Message-ID: <20120625120140.033c2297@zetkin.int.primekey.se> On Mon, 25 Jun 2012 08:52:51 +0100 Kaya Saman wrote: > To start with the reason I'm not using LDAP is because I couldn't find > enough information on how to set it up! I did post here a couple of > times but got no responses...... so I figured it was something that > people either didn't know or found trivial. For my own use I've switched to the LDAP as provider of user information and credentials (for Dovecot/Postfix/ejabberd/anything I can get to talk to the LDAP). It's not that hard to figure out, but getting used to LDAP itself can take a little bit of time. In my case I'm using the LDAP just for checking if a user is present on the system and for authentication purposes (for the mail server). Haven't tried using quota etc with LDAP. Anything in particular you're having problems coping with? :) -- Branko Majic Jabber: branko at majic.rs Please use only Free formats when sending attachments to me. ?????? ????? ?????: branko at majic.rs ????? ??? ?? ??????? ?????? ????????? ? ????????? ?????????. From role.Dovecot-Readers at JLAssocs.com Mon Jun 25 13:04:43 2012 From: role.Dovecot-Readers at JLAssocs.com (J E Lyon) Date: Mon, 25 Jun 2012 11:04:43 +0100 Subject: [Dovecot] Virtual users - what is better Maildir or mbox? In-Reply-To: <4FE832F3.3000405@Media-Brokers.com> References: <4FE81546.8000202@middleearth.sapphiresunday.org> <267BC57F-B747-4F58-B309-ACE4BDA3A88C@JLAssocs.com> <4FE832F3.3000405@Media-Brokers.com> Message-ID: On 25 Jun 2012, at 10:44, Charles Marcus wrote: > On 2012-06-25 3:58 AM, J E Lyon wrote: >> I've not come up with any significant advantages of mbox that count >> for much in my experiences and installations . . Would be interested >> to hear of suggested advantages that I might have overlooked > > One major advantage of mbox (and now mdbox) over maildir is the time it takes to back things up for larger mail stores. > > It takes much less time to compare a single mbox file that contains 20,000 messages (and rsync only the changed bits) than it does to compare read/compare 20,000 individual files (maildir)... > > I too like maildir, but am seriously considering implementing a solution where older mail is automatically archived to slower/cheaper SATA III based storage using mdbox format. Very interesting. I use "rdiff-backup" as a cronjob in the wee hours (, so the fact it takes a while to work out what to incrementally save, doesn't matter to me -- but the point is that I know it's an issue and have addressed it that way. I too have contemplated some automated archiving of older mail . . it's getting closer to needing to be addressed at some point soon I think. J. From CMarcus at Media-Brokers.com Mon Jun 25 14:39:35 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 25 Jun 2012 07:39:35 -0400 Subject: [Dovecot] Mail migration to dovecot with doveadm backup In-Reply-To: <4FE738E9.6040706@metaways.de> References: <4FE738E9.6040706@metaways.de> Message-ID: <4FE84DF7.7030707@Media-Brokers.com> On 2012-06-24 11:57 AM, Reinhard Vicinus wrote: > i try to migrate mails from a non dovecot imap server to a dovecot imap > server with doveadm backup as described there: What version of dovecot (doveconf -n output_? > http://wiki2.dovecot.org/Migration/Dsync > > i first tried (local-mailbox port 18143 is the non dovecot imap server): > > /usr/bin/doveadm -o imapc_user=user at example.org -o imapc_password=imappw > -o imapc_host=local-mailbox -o imapc_features=rfc822.size -o > imapc_port=18143 -o mailbox_list_index=no -v -D backup -R -f -u > user at example.org -m Sent imapc: > > and got the following error: > > dsync(user at example.org): Fatal: dsync backup: Looks like you're trying > to run backup in wrong direction. Source is empty and destination is not. -- Best regards, Charles Marcus I.T. Director Media Brokers International, Inc. 678.514.6200 x224 | 678.514.6299 fax From r.vicinus at metaways.de Mon Jun 25 15:55:48 2012 From: r.vicinus at metaways.de (Reinhard Vicinus) Date: Mon, 25 Jun 2012 14:55:48 +0200 Subject: [Dovecot] Mail migration to dovecot with doveadm backup In-Reply-To: <4FE84DF7.7030707@Media-Brokers.com> References: <4FE738E9.6040706@metaways.de> <4FE84DF7.7030707@Media-Brokers.com> Message-ID: <4FE85FD4.8090708@metaways.de> On 25/06/12 13:39, Charles Marcus wrote: > On 2012-06-24 11:57 AM, Reinhard Vicinus wrote: >> i try to migrate mails from a non dovecot imap server to a dovecot imap >> server with doveadm backup as described there: > > What version of dovecot (doveconf -n output_? dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-40-server x86_64 Ubuntu 10.04.4 LTS auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_cache_ttl = 1 mins auth_verbose = yes auth_verbose_passwords = sha1 deliver_log_format = mailbox: deliver: msgid=%m from=%f: %$ dict { quota = mysql:/etc/dovecot/conf.d/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no doveadm_password = xxx instance_name = dovecot-mailbox lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_greeting = Mailbox login_log_format = mailbox: login: %$: %s login_trusted_networks = 10.10.10.0/24 mail_debug = yes mail_fsync = always mail_gid = vmail mail_home = /mail/dovecot/%d/%n mail_location = mdbox:~/mail mail_log_prefix = "mailbox: mail: %s(%u): " mail_plugins = quota mail_privileged_group = vmail mail_uid = vmail managesieve_implementation_string = Sieve managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 50 M mmap_disable = yes passdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quota quota_rule = *:storage=10G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = dovecot mode = 0660 user = dovecot } } service dict { unix_listener dict { group = vmail mode = 0660 } } service doveadm { inet_listener doveadm-server { port = 19000 } } service imap-login { inet_listener imap { port = 19143 } } service imap-postlogin { executable = script-login /usr/local/bin/dovecot-postlogin user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { inet_listener lmtp { address = * port = 19024 } } service managesieve-login { inet_listener sieve { port = 19200 } } service pop3-login { inet_listener pop3 { port = 19110 } } service pop3-postlogin { executable = script-login /usr/local/bin/dovecot-postlogin user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin } service quota-warning { executable = script /usr/local/bin/quota-warning extra_groups = dovecot unix_listener quota-warning { user = vmail } user = vmail } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_plugins = quota imap_quota } protocol lmtp { mail_plugins = quota sieve } From tss at iki.fi Mon Jun 25 17:35:35 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 25 Jun 2012 17:35:35 +0300 Subject: [Dovecot] specifying home/sieve/sieve_dir relative to mail_location In-Reply-To: <20120625095401.GT50872@trav.math.uni-bonn.de> References: <20120619131413.GN48358@trav.math.uni-bonn.de> <20120625095401.GT50872@trav.math.uni-bonn.de> Message-ID: On 25.6.2012, at 12.54, Edgar Fu? wrote: >> With 1.2, is it possible to specify home, sieve and sieve_dir relative to mail_location? > No-one, this one? > > Too simple? Too stupid? Too obvious? Not possible? Mail/Sieve dirs can be relative to home dir, not vice versa.. > I know it's possible to specify everything relative to home, so I could probably use relative ~/../-type paths for mail_locatin etc., but that looks a bit awkward. Yeah, that would probably work. Maybe look into changing your directory hierarchy so mails are under home. From ef at math.uni-bonn.de Mon Jun 25 17:42:49 2012 From: ef at math.uni-bonn.de (Edgar =?iso-8859-1?B?RnXf?=) Date: Mon, 25 Jun 2012 16:42:49 +0200 Subject: [Dovecot] specifying home/sieve/sieve_dir relative to mail_location In-Reply-To: References: <20120619131413.GN48358@trav.math.uni-bonn.de> <20120625095401.GT50872@trav.math.uni-bonn.de> Message-ID: <20120625144248.GW50872@trav.math.uni-bonn.de> > Mail/Sieve dirs can be relative to home dir, not vice versa. OK, thanks. > Yeah, that would probably work. I'll try that. > Maybe look into chang