Question regarding NFS and RAID performance/options

From: Scott W (wegster@mindcore.net)
Date: Mon Nov 10 2003 - 00:10:20 EST


Hey all- I've got a few options I'm considering, and wanted the
'collective opinion' on-

I've currently got a Eurologic FC2501/SanBloc attached via a QLA2200 HBA
to a Sun E250 (in the 66MHz PCI slot).

The FC2501 is a 1Gb fiber channel array, currently full with 14 Seagate
FC 10k drives, single RAID-5 across 12 drives, battery backup,
write-back enabled..the internal (to the FC2501) raid controller is a
Mylex of one kind or another. E250 is a dual 300MHz, 512M RAM.

The questions-
I'm getting OK throughput locally, but not what I expected- I'm seeing
about 30MB/second writes, timed via multiple runs of:
    dd if=/dev/zero of=/export/bigfile bs=16384 count=100000 (1.6G file
created, takes 50-60 seconds), reads a bit higher at ~35MB/second. This
is using the Solaris 9 (8/3 media) native QLogic driver and the Sun FC
ssd driver.
1. Anyone out there with a similar setup for some comparison numbers?
2. I attempted on another system to update to the QLogic supplied
driver, but it seems to then ignore the ssd driver and got
_significantly_ lower throughput- any suggestions/comments on with the
Sun native driver vs QLogics and using ssd or not?

That level of throughput I could deal with if need be, although it seems
low for the number of spindles, but NFS times are pretty bad-
using client options of async, a bit of rsize and wsize testing
(currently at 16k read, 64k write), ensuring tcp_xmit and recv buffers
are at 64k on the 250, and I'm seeing a max of 4-6MB/second, averaging
out around 5MB/s.
iostat is showing svc_t ranging from 30-65, with the buffer generally
being 30% full, and the system is NOT I/O bound, sitting at only 1-3%
I/O wait. The particular client I'm using for testing is a freeBSD
system, with neither system running anything significant during
testing. Both systems are currently running via 100Mbit NICs through a
Gig switch, the Sun the onboard hme, and BSD system an Intel Pro/100.
So....
1. Any suggestions for improvement here? Something's going on that
isn't jiving with the slow throughput here, considering the lack of I/O
waits, but I'm not too sure what. The NIC on the client is new, not
(very) likely at fault, as ftp transfers seem speedy enough...

2. I do have other systems I could use for NFS, but they would be
running Linux or FreeBSD. While I DO like both, Linux has genrally
always been slower than Suns as NFS servers, and I'm not sure I'm seeing
this being a CPU issue (the Linux system is dual Athlon2200s with 2G RAM)...

Lastly, I do have a SysKonnect 9822 Dual GigEthernet adapter for the
Sun...however, attempting to mount the NFS share from the (100Mbit)
client via the gig interface returns UDP timeouts, although netstat and
rpcinfo are showing nfsd, portmap/rpc and mountd binding to the GigE
IP...suggestions on this one welcome as well.

Sorry for the many questions in one email, but they ARE
related...any/all comments/advice welcome!

Thanks,

Scott
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers



This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:27:26 EDT