slow EMC disk performance on solaris 9

From: Dan Simoes (dans@audifans.com)
Date: Fri Nov 07 2003 - 09:59:54 EST


This may not have anything to do with Solaris, we are pursuing with EMC
as well but so far no great improvement so I figured I'd ask here.
Host is a Sun v480 with Emulex HBA, latest EMC drivers.
Disk is presented from the EMC and appears to Solaris as a native drive,
for all it knows:
# format
Searching for disks...done

AVAILABLE DISK SELECTIONS:
       0. c1t0d0 <SUN36G cyl 24620 alt 2 hd 27 sec 107>
          /pci@9,600000/SUNW,qlc@2/fp@0,0/ssd@w21000004cfd7228b,0
       1. c1t1d0 <SUN36G cyl 24620 alt 2 hd 27 sec 107>
          /pci@9,600000/SUNW,qlc@2/fp@0,0/ssd@w21000004cfd7326b,0
       2. c2t1d0 <DGC-RAID5-0841 cyl 61438 alt 2 hd 2 sec 2048>
          /pci@8,700000/lpfc@2/sd@1,0
# mount
/ on /dev/md/dsk/d0
read/write/setuid/intr/largefiles/xattr/onerror=panic/dev=1540000 on Mon
Sep 22 13:07:03 2003
/proc on /proc read/write/setuid/dev=3c00000 on Mon Sep 22 13:07:03 2003
/etc/mnttab on mnttab read/write/setuid/dev=3cc0000 on Mon Sep 22
13:07:03 2003
/dev/fd on fd read/write/setuid/dev=3d00000 on Mon Sep 22 13:07:04 2003
/var on /dev/md/dsk/d3
read/write/setuid/intr/largefiles/xattr/onerror=panic/dev=1540003 on Mon
Sep 22 13:07:05 2003
/var/run on swap read/write/setuid/xattr/dev=1 on Mon Sep 22 13:07:05 2003
/tmp on swap read/write/setuid/xattr/dev=2 on Mon Sep 22 13:07:08 2003
/emc_db on /dev/dsk/c2t1d0s0
read/write/setuid/intr/largefiles/xattr/onerror=panic/dev=800088 on Mon
Sep 22 13:07:08 2003
/cdrom/oracle8i_se on /vol/dev/dsk/c0t0d0/oracle8i_se read
only/nosuid/maplcase/noglobal/rr/traildot/dev=16c0001 on Mon Sep 22
13:07:17 2003

OK, onto performance. Here's a performance test using 100mb files. The
results are even more dramatic when using a 1Gb file size, but files of
that size will be far fewer than those of the 100mb flavor.
As I said, EMC has made some tweaks, but compared to local disk, this is
still looking slow to me.

Local disk (/):
# /usr/local/bin/bonnie
File './Bonnie.22111', size: 104857600
Writing with putc()...done
Rewriting...done
Writing intelligently...done
Reading with getc()...done
Reading intelligently...done
Seeker 2...Seeker Seeker 1...3...start 'em...done...done...done...
              -------Sequential Output-------- ---Sequential Input--
--Random--
              -Per Char- --Block--- -Rewrite-- -Per Char- --Block---
--Seeks---
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU
/sec %CPU
                  100 28227 88.9 57831 27.9 64532 34.9 39369 99.7 503429
95.9 19705.8 99.7

EMC disk (/emc_db)
# cd /emc*
# pwd
/emc_db
# /usr/local/bin/bonnie
File './Bonnie.22129', size: 104857600
Writing with putc()...done
Rewriting...done
Writing intelligently...done
Reading with getc()...done
Reading intelligently...done
Seeker 1...Seeker 2...Seeker 3...start 'em...done...done...done...
              -------Sequential Output-------- ---Sequential Input--
--Random--
              -Per Char- --Block--- -Rewrite-- -Per Char- --Block---
--Seeks---
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU
/sec %CPU
                  100 29737 95.3 80041 42.0 100270 53.3 31156 79.8
488668 92.9 19802.3 139.1

As always, thanks for feedback.
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers



This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:27:26 EDT