[]'sf.rique
On Fri, Jan 21, 2011 at 2:14 AM, Stan Hoeppner <stan@hardwarefreak.com>wrote:
Henrique Fernandes put forth on 1/20/2011 11:55 AM:
Even the storage system is not SUN those ocfs2 servers are connect via iSCSI from the storage with ocfs2 in virtual machine
Storage are an EMC CX4 ( don't have all info about it right now )
Please provide a web link to the iSCSI storage array product you are using, and tell us how many 1GbE ports you are link aggregating to the switch.
Just one, the EMC have one interface and we are exporting iSCSI over it. Right now is what we can do, we are waiting to be able to buy an SUN to make everything works.
Also, are you using Oracle OCFS2 or IBM GPFS? You mentioned both. Considering you are experiencing severe performance issues with metadata operations due to the distributed lock manager...
OCFS2 1.4 Because it is free. Have no money for anything else, we have
considered swith it to NFS.
Have you considered SGI CXFS? It's the fastest cluster FS on the planet by an order of magnitude. It uses dedicated metadata servers instead of a DLM, which is why it's so fast. Directory traversal operations would be orders of magnitude faster than what you have now.
http://en.wikipedia.org/wiki/CXSGI CXFSFS<http://en.wikipedia.org/wiki/CXFS> http://www.sgi.com/products/storage/software/cxfs.html
We don't considerd buying an clustered filesystem.
We are out of ideias to make it faster. We only came up making more ocfs2 cluster with smaller disks. With this we are gettng better performance. We have now 2 cluster one with 4 TB other with 1 TB and are migrating some os emails form 4TB to 1TB and already have ready another cluster with 1 TB. So we have 3 machines and those 3 mount 3 disks each from the storage and mount 3 ocfs2 cluster. So we think the each DLM gets less work. Are we right?
Thanks!
-- Stan