Performance issues with SunFire V480Rs in a veritas cluster

From: Mark Andrews (marka@calibredigital.com)
Date: Tue Jan 27 2004 - 15:24:18 EST


Hi all,

We've got two Sun Fire V480Rs with the following configuration:

# /usr/platform/sun4u/sbin/prtdiag
System Configuration: Sun Microsystems sun4u Sun Fire 480R
System clock frequency: 150 MHz
Memory size: 4096 Megabytes
 
========================= CPUs
===============================================
 
          Run E$ CPU CPU
Brd CPU MHz MB Impl. Mask
--- --- --- ---- ------- ----
 A 0 900 8.0 US-III+ 2.2
 A 2 900 8.0 US-III+ 2.2
 
========================= Memory Configuration
===============================
 
          Logical Logical Logical
     MC Bank Bank Bank DIMM Interleave Interleaved
Brd ID num size Status Size Factor with
--- --- ---- ------ ----------- ------ ---------- -----------
 A 0 0 512MB no_status 256MB 8-way 0
 A 0 1 512MB no_status 256MB 8-way 0
 A 0 2 512MB no_status 256MB 8-way 0
 A 0 3 512MB no_status 256MB 8-way 0
 A 2 0 512MB no_status 256MB 8-way 0
 A 2 1 512MB no_status 256MB 8-way 0
 A 2 2 512MB no_status 256MB 8-way 0
 A 2 3 512MB no_status 256MB 8-way 0
 
========================= IO Cards =========================
 
                    Bus Max
 IO Port Bus Freq Bus Dev,
Type ID Side Slot MHz Freq Func State
Name Model
---- ---- ---- ---- ---- ---- ---- -----
-------------------------------- ----------------------
PCI 8 B 2 33 33 2,0 ok SUNW,qlc-pci1077,2300.1077.106.1+
PCI 8 B 3 33 33 3,0 ok SUNW,qlc-pci1077,2300.1077.106.1+
PCI 8 B 4 33 33 4,0 ok
network-pci108e,2bad SUNW,pci-gem
PCI 8 B 5 33 33 5,0 ok
network-pci108e,2bad SUNW,pci-gem
PCI 8 A 0 66 66 1,0 ok SUNW,qlc-pci1077,2300.1077.106.1+
PCI 8 A 1 66 66 2,0 ok SUNW,qlc-pci1077,2300.1077.106.1+

The machines are configured in a Veritas cluster, using the gem cards as
heartbeat and cassini
gigabit ethernet connected to a Fast Iron 1500 switch.

Veritas 3.5MP2 is installed on both machines and a Sun Storedge array is
connected to four fibre-channel
cards. Both machines share a clustered filesystem using SanPoint
filesystem 3.5MP2. The version of
vxfs installed on the machine is 3.5_REV-MP2d,RP2.

Both SunFire machines are running Solaris 9 with the August 2003 patch
set installed.

We're having throughput problems when writing to the Sun machine, while
reads are fast. Using ftp
as a benchmark, we're seeing 40-45Mb/s during a read from a 1gig file in
/tmp and 15-16Mb/s when
writing a file to the same partition. We don't know if the veritas
filesystem is the culprit or are there
are some system variables we can tweak.

Any insight is welcomed.

Thanks

Mark
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers



This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:27:54 EDT