[Dovecot] best practises for mail systems
Костырев Александр Алексеевич
a.kostyrev at serverc.ru
Tue Jun 5 06:14:44 EEST 2012
Can someone point me to some best practices in building high-available scalable mail system or! share your own success stories.
I've read article in LJ "Building a Scalable High-Availability E-Mail System with Active Directory and More"
but it seemed to be outdated and there's a single point of failure (Master node).
What I want to achieve:
with no single point of failure
intel mfsys25 modular server with 2 storage controllers, 2 switches, 4 power supply blocks
- 2 blade-servers in mfsys with:
2xIntel Xeon E5620 @ 2.40GHz with 8 cores each
- promise vtrak e610s (2 storage controllers, 2 power supply blocks)
- 6x 2TB SATA Hitachi HDS72302
We decided to go for KVM virtualization
and glusterfs for live migration for vm image but that's not what this is all about :)
We installed centos on host systems.
for now while we could think of two ways to go:
The first way (currently at testing stage):
On each host system we created one VM and passed through 3x2TB disks into it.
In guests vms on top of this disks we made XFS and fired up glusterfs with distributed replicated volumes for our mailstorage.
so it looks like this:
vm1 replicate vm2
disk1 ------------> disk4
disk2 ------------> disk5
disk3 ------------> disk6
in each vm we mounted glusterfs and pointed dovecot to that dir for mail creation (as ltmp) and imap4 user access.
also we use exim as smtp.
So, with glusterfs as mailstorage we can go for LVS to load balancing for exim and dovecot.
so wherenever one of host systems (hence one of mail vms) goes down, users don't notice that
'cause LVS points them to working smtp and imap4 servers
and they get their mail 'cause of glusterfs.
- horizontaly scalable
- with no single point of failure
- not quite sure if glusterfs is production ready solution 'cause I've experienced split-brains during setting it up
- IO performance issue. Though we didn't yet run any io tests, but glusterfs uses fuse to mount on clients. And guys on #gluster told me writing to the glusterfs mount will not be strictly local io.
The second way:
split up the users mail with:
two back-end VMs each other on DIFFERENT host system with
- fat mailstorage with raid1+linear mode (mdadm)+XFS
two VMs for nginx-based proxy servers for imap4 and smtp - nginx can redirect user to right back-end through HTTP-php-based logic.
- we split up not only load for exim/dovecot but users mail IOs too
- no split-brains
- If one of the host systems (hence one of back-end VMs with storage) goes down, half of our users is unhappy
P.S. Sorry if this place is way wrong to ask for such things.
More information about the dovecot