Hi everybody,
We use a Dovecot setup with GlusterFS. Dovecot 1.1.2 and GlusterFS 1.3.9. I enabled the following options (I don't have posix-locks translators):
lock_method = dotlock dotlock_use_excl = no mmap_disable = yes mail_nfs_index = yes mail_nfs_storage = yes
I receive the following error message.
Aug 7 09:38:51 mta2 dovecot: POP3(somebody@domain.tld): nfs_flush_fcntl: fcntl(/var/vmail/domain.tld/somebody/Maildir/dovecot.index, F_RDLCK) failed: Function not implemented
I think that I can disable mail_nfs_index to fix these messages. Has anybody had the same problem, if so, how did you solve it?
Kind regards, Jeroen Koekkoek
Pawel Panek wrote:
We use a Dovecot setup with GlusterFS. Dovecot 1.1.2 and GlusterFS
OT: beside fcntl problem, how is GlusterFS doing for you? I have some miserable remarks using GlusterFS and FUSE. What about your experience?
I'm also interested to hear how it works out? It appears that the straightline speed is high for gluster, but it's per file performance has enough overhead that it's a signficant problem for maildir type applications which manipulate lots of small files? Possibly it works very well if you go mbox though?
Ed W
From: "Ed W" lists@wildgooses.com Sent: Sunday, August 10, 2008 11:09 AM
I'm also interested to hear how it works out? It appears that the straightline speed is high for gluster, but it's per file performance has enough overhead that it's a signficant problem for maildir type applications which manipulate lots of small files? Possibly it works very well if you go mbox though?
FUSE kernel driver from 2.6.24 was unusable. Fuse client saw changed file modes ie: from 640 to 666. With fuse driver delivered with glusterfs file modes were the same as on exporting server. It was performing very well when clients were moving some large files, but when it comes to mail traffic wait time and system load on client nodes started increasing. At last glusterfs stop working due segfault in io-cache.so or libglusterfs.so. Mail nodes were using glusterfs-1.3.7 and fuse-2.7.2glfs8, mail was delivered into maildirs
Pawel.
On Aug 7, 2008, at 3:57 AM, Jeroen Koekkoek wrote:
I receive the following error message.
Aug 7 09:38:51 mta2 dovecot: POP3(somebody@domain.tld): nfs_flush_fcntl: fcntl(/var/vmail/domain.tld/somebody/Maildir/dovecot.index, F_RDLCK) failed: Function not implemented
Dovecot tries to flush kernel's data cache.
I think that I can disable mail_nfs_index to fix these messages. Has anybody had the same problem, if so, how did you solve it?
You could disable mail_nfs_index, but that if the same mailbox is
accessed concurrently from multiple servers that will probably cause
index corruption.
On Aug 11, 2008, at 10:22 AM, Timo Sirainen wrote:
On Aug 7, 2008, at 3:57 AM, Jeroen Koekkoek wrote:
I receive the following error message.
Aug 7 09:38:51 mta2 dovecot: POP3(somebody@domain.tld): nfs_flush_fcntl: fcntl(/var/vmail/domain.tld/somebody/Maildir/dovecot.index, F_RDLCK) failed: Function not implemented
Dovecot tries to flush kernel's data cache.
You might need
volume plocks type features/posix-locks subvolumes posix end-volume
Or equivalent in your glusterfs configuration
I think that I can disable mail_nfs_index to fix these messages. Has anybody had the same problem, if so, how did you solve it?
You could disable mail_nfs_index, but that if the same mailbox is
accessed concurrently from multiple servers that will probably cause
index corruption.
Aria Stewart aredridel@nbtsc.org
I was afraid somebody was going to say that. Thanks for your reply, I'll try that sometime later this week. I'll report back how it all went.
Kind regards, Jeroen Koekkoek
-----Original Message----- From: dovecot-bounces+j.koekkoek=perrit.nl@dovecot.org [mailto:dovecot-bounces+j.koekkoek=perrit.nl@dovecot.org] On Behalf Of Aria Stewart Sent: Monday, August 11, 2008 6:32 PM To: Dovecot Mailing List Subject: Re: [Dovecot] GlusterFS
On Aug 11, 2008, at 10:22 AM, Timo Sirainen wrote:
On Aug 7, 2008, at 3:57 AM, Jeroen Koekkoek wrote:
I receive the following error message.
Aug 7 09:38:51 mta2 dovecot: POP3(somebody@domain.tld): nfs_flush_fcntl: fcntl(/var/vmail/domain.tld/somebody/Maildir/dovecot.index, F_RDLCK) failed: Function not implemented
Dovecot tries to flush kernel's data cache.
You might need
volume plocks type features/posix-locks subvolumes posix end-volume
Or equivalent in your glusterfs configuration
I think that I can disable mail_nfs_index to fix these messages. Has anybody had the same problem, if so, how did you solve it?
You could disable mail_nfs_index, but that if the same mailbox is
accessed concurrently from multiple servers that will probably cause
index corruption.
Aria Stewart aredridel@nbtsc.org
participants (5)
-
Aria Stewart
-
Ed W
-
Jeroen Koekkoek
-
Pawel Panek
-
Timo Sirainen