Timo Sirainen tss@iki.fi Wrote:
On Mon, 2010-09-06 at 14:26 +0100, Alan Brown wrote:
Is there any way of enforcing a Maildir per-folder message limit in Dovecot?
No.
Would you consider it as a feature request?
We're finding major performance hits once a threshold of files/directory is exceeded. This applies across all common filesystems with the threshold differing depending on the FS. GFS2 pretty much _STOPS_ for 10 minutes when users put 65k+ messages in one folder...
mdbox would probably work nicely. :)
Yes, it probably would, however I have several layers of resistance to get past in order to implement that (ie, up to 2 years to get approval to switch to dbox)
I'm currently running 1.1.20 but looking to update (RHEL5 cluster installation)
With v1.2+ you could also try maildir_very_dirty_syncs=yes
That won't help much for initial directory opens, which is where most of the pain is. Past that point, the index of ~/Maildir/.folder/cur is mostly cached until you hit about 16,000 messages(files) on GFS2 and some people are insisting on 32k+ files in one folder with the odd few trying 65k or more (I'm surprised their clients don't break).
For info sake: we have Dovecot running on a pair of dedicated dual E5530 (quad-core X86 1300MHZ FSB cpu) servers (RH cluster+GFS2) with 24Gb RAM apiece and ~2TB of 8Gb/s san-attached storage available.
There are only ~250 accounts but there's around 600Gb in the maildir folder areas and another 300Gb in a separate dedicated inbox area - and I believe there's another 1TB of stuff in client local folders we're trying to pull back to the servers in order to simplify backups.
Even with this kind of horsepower available, over-large folders can render the setup completely unresponsive for minutes at a time. I know this is a case of "work smarter, not harder", but I'm facing major delays until we're able to change the on-disk storage format.
Alan