[Dovecot] index performance issues
Netserve
john at nsnoc.com
Mon Mar 12 20:01:00 EET 2007
Running 1.0.rc22
We have a single file server, running NFS (Single large sas disk) with
about 80Gb of mail.
mount -o remount,rsize=2048,wsize=2044,actimeo=0,soft,rw
xx.xx.xx.xx:/mailboxes /nfs1
There are 3 front end pop/imap servers using an LVS director.
Indexes are stored on each front end server.
-rw------- 1 admin 500 144 Mar 12 17:47 dovecot.index
-rw------- 1 admin 500 10272 Mar 12 17:47 dovecot.index.cache
-rw------- 1 admin 500 120 Mar 12 17:47 dovecot.index.log
Normally everything runs fine, there are about 1500 active pop
accounts and 100 Imap.
Typically, 10 to 20 pop accounts are downloading at anyone time, and
there may be 10 or 20 active Imap sessions.
If we find that the index partition has got to 100% full and corrupted
the indexes then we'll delete the entire index dir and let dovecot
rebuild all the indexes however, we end up with 100mbit / 10Mb/sec of
network traffic between the NFS server and the pop/imap servers. The
nfs server load climbs to 20+ as does the load on the front end mail
servers.
It can take 4 or 5 hours for the indexes to rebuild during which time
imap is slow but works and pop downloads all end up with dead
processes that need clearing every few minutes.
admin 5869 0.0 0.1 4384 1060 ? D 17:56 0:00 \_
pop3 [info at .co.uk 180.98]
admin 5877 0.0 0.1 4392 1112 ? D 17:57 0:00 \_
pop3 [bro94 62.182]
admin 5879 0.0 0.1 4396 1052 ? D 17:57 0:00 \_
pop3 [spamcatch at .com 81.163]
admin 5884 0.0 0.1 4392 1056 ? D 17:57 0:00 \_
pop3 [ctaylor at .com 81.175]
Normally the nfs server delivers possibly 200Kbytes of traffic average
spiking to 400Kbytes but the 900+Kbytes per second sustained rate for
5 or 6 hours is killing the service.
Is there something we've got wrong here?
(I know a Scsi raid NFS would help as would Gbit networking but I
can't see the setup we've got as needing that sort of hardware spec?)
Thanks
John
More information about the dovecot
mailing list