Sol10 to Netapp connection over 1GB NFS link for Sybase DB

From: John.Hallman@wellsfargo.com
Date: Fri Feb 01 2008 - 00:10:31 EST


### NetAPP Sybase Volume
###
netapp1:/vol/syb_data01 - /syb_data nfs - yes
hard,intr,bg,vers=3,proto=tcp,rsize=32768,wsize=32768,forcedirectio

We have a v445 with 4 CPUS connected (2 Cisco 2970's) via 1GB IPMP
(ce0/ce1) link to a pair of netapp filers.
On the server runs Sybase15 - DB is located on the Netapp

I just want to make sure the server - network - netapp are optimially
configured. Users are complaining of slowness - I see lots of busy time.

It looks like at times there are more writes than reads but the reads
are pretty significant in the amount of data returned.

Looking from some advise on monitoring the NFS - possible areas to tune
- things to check on the cisco switches (I have console and enable
access)
and the netapp (NetApp Release 7.0.3:)

We are looking at connecting to the netapp via Fiber (which means we
need to install Veritas on the server) and SSD devices to improve
performance.

Lastly we are building a v490 4CPU box to eventually replace this DB.

Thanks again

SERVER:

-bash-3.00$ netstat -in
Name Mtu Net/Dest Address Ipkts Ierrs Opkts Oerrs Collis
Queue
lo0 8232 127.0.0.0 127.0.0.1 6125985 0 6125985 0 0
0
bge0 1500 10.45.21.0 10.45.21.204 349699125 0 432708911 0
0 0
ce0 1500 192.168.10.0 192.168.10.140 28375610 0 2323026 0 0
0

-bash-3.00$ iostat -xnTd -z 5
Thu Jan 31 20:59:28 2008
                    extended device statistics
    r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
    0.0 0.0 0.5 4.9 0.0 0.0 1.6 14.6 0 0 d0
    0.2 0.0 1.8 2.7 0.0 0.0 0.1 11.1 0 0 d1
    0.0 0.0 0.1 0.4 0.0 0.0 2.4 11.5 0 0 d3
    0.0 0.1 0.0 0.7 0.0 0.0 4.6 12.4 0 0 d4
    0.0 0.0 0.4 0.1 0.0 0.0 2.1 15.5 0 0 d5
    0.0 0.0 0.0 0.0 0.0 0.0 0.7 9.8 0 0 d6
    0.0 0.1 0.8 3.4 0.0 0.0 0.9 13.5 0 0 d7
    0.5 0.7 35.1 83.1 0.0 0.0 0.0 7.3 0 0 d8
    0.0 0.0 0.3 4.9 0.0 0.0 0.0 15.6 0 0 d10
    0.1 0.0 0.9 2.7 0.0 0.0 0.0 17.0 0 0 d11
    0.0 0.0 0.0 0.4 0.0 0.0 0.0 10.6 0 0 d13
    0.0 0.1 0.0 0.7 0.0 0.0 0.0 10.8 0 0 d14
    0.0 0.0 0.2 0.1 0.0 0.0 0.0 14.3 0 0 d15
    0.0 0.0 0.0 0.0 0.0 0.0 0.0 10.3 0 0 d16
    0.0 0.1 0.4 3.4 0.0 0.0 0.0 12.7 0 0 d17
    0.2 0.7 17.6 83.1 0.0 0.0 0.0 7.0 0 0 d18
    0.0 0.0 0.2 4.9 0.0 0.0 0.0 15.5 0 0 d20
    0.1 0.0 0.9 2.7 0.0 0.0 0.0 17.0 0 0 d21
    0.0 0.0 0.0 0.4 0.0 0.0 0.0 10.5 0 0 d23
    0.0 0.1 0.0 0.7 0.0 0.0 0.0 10.5 0 0 d24
    0.0 0.0 0.2 0.1 0.0 0.0 0.0 15.1 0 0 d25
    0.0 0.0 0.0 0.0 0.0 0.0 0.0 10.9 0 0 d26
    0.0 0.1 0.4 3.4 0.0 0.0 0.0 12.6 0 0 d27
    0.2 0.7 17.6 83.1 0.0 0.0 0.0 7.0 0 0 d28
    0.1 0.4 1.4 8.9 0.0 0.0 0.0 13.0 0 0 c0t0d0
    0.0 0.0 0.0 0.0 0.0 0.0 0.5 17.0 0 0 c1t0d0
    0.3 0.8 18.0 86.5 0.0 0.0 0.0 7.6 0 0 c0t1d0
    0.1 0.4 1.4 8.9 0.0 0.0 0.0 13.0 0 0 c0t2d0
    0.3 0.8 18.0 86.5 0.0 0.0 0.0 7.6 0 0 c0t3d0
    0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.0 0 0
sigsa0112104:vold(pid379)
   34.8 22.0 471.9 125.5 0.0 0.3 0.0 4.5 0 8
netapp1:/vol/syb_data01
Thu Jan 31 20:59:33 2008
                    extended device statistics
    r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
    0.0 0.2 0.0 205.0 0.0 0.0 0.0 19.6 0 0 d0
    0.0 0.6 0.0 0.4 0.0 0.0 0.0 9.4 0 0 d4
    0.0 0.2 0.0 205.0 0.0 0.0 0.0 19.5 0 0 d10
    0.0 0.6 0.0 0.4 0.0 0.0 0.0 9.4 0 0 d14
    0.0 0.2 0.0 205.0 0.0 0.0 0.0 19.2 0 0 d20
    0.0 0.6 0.0 0.4 0.0 0.0 0.0 8.0 0 0 d24
    0.0 2.2 0.0 205.4 0.0 0.0 0.0 12.8 0 1 c0t0d0
    0.0 2.2 0.0 205.4 0.0 0.0 0.0 12.2 0 1 c0t2d0
    9.4 112.7 18.8 449.2 0.0 0.2 0.0 1.2 0 11
netapp1:/vol/syb_data01

-bash-3.00$ nfsstat -c

Client rpc:
Connection oriented:
calls badcalls badxids timeouts newcreds badverfs timers
281804342 1 0 0 0 0 0
cantconn nomem interrupts
0 0 0
Connectionless:
calls badcalls retrans badxids timeouts newcreds
badverfs
628 1 0 0 0 0 0
timers nomem cantsend
16 0 0

Client nfs:
calls badcalls clgets cltoomany
281749065 2 281672458 30668
Version 2: (627 calls)
null getattr setattr root lookup readlink read wrcache
0 0% 549 87% 0 0% 0 0% 46 7% 0 0% 0 0% 0 0%
write create remove rename link symlink mkdir rmdir
0 0% 0 0% 0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
readdir statfs
30 4% 2 0%
Version 3: (281746459 calls)
null getattr setattr lookup access
0 0% 3273 0% 7 0% 99 0% 1492 0%
readlink read write create mkdir
0 0% 172620400 61% 109121115 38% 11 0% 0 0%
symlink mknod remove rmdir rename
0 0% 0 0% 7 0% 0 0% 0 0%
link readdir readdirplus fsstat fsinfo
0 0% 0 0% 20 0% 34 0% 1 0%
pathconf commit
0 0% 0 0%
Version 4: (0 calls)
null compound
0 0% 0 0%
Version 4: (0 operations)
reserved access close commit
0 0% 0 0% 0 0% 0 0%
create delegpurge delegreturn getattr
0 0% 0 0% 0 0% 0 0%
getfh link lock lockt
0 0% 0 0% 0 0% 0 0%
locku lookup lookupp nverify
0 0% 0 0% 0 0% 0 0%
open openattr open_confirm
open_downgrade
0 0% 0 0% 0 0% 0 0%
putfh putpubfh putrootfh read
0 0% 0 0% 0 0% 0 0%
readdir readlink remove rename
0 0% 0 0% 0 0% 0 0%
renew restorefh savefh secinfo
0 0% 0 0% 0 0% 0 0%
setattr setclientid setclientid_confirm verify
0 0% 0 0% 0 0% 0 0%
write
0 0%

Client nfs_acl:
Version 2: (1 calls)
null getacl setacl getattr access getxattrdir
0 0% 0 0% 0 0% 1 100% 0 0% 0 0%
Version 3: (1 calls)
null getacl setacl getxattrdir
0 0% 1 100% 0 0% 0 0%

--------------------------------

netapp1> nfsstat

Server rpc:
TCP:
calls badcalls nullrecv badlen xdrcall
690371837 42 0 0 42

UDP:
calls badcalls nullrecv badlen xdrcall
96 90 0 6 84

Server nfs:
calls badcalls
690371790 0

Server nfs V2: (0 calls)
null getattr setattr root lookup readlink read
0 0% 0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
wrcache write create remove rename link
symlink
0 0% 0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
mkdir rmdir readdir statfs
0 0% 0 0% 0 0% 0 0%

Read request stats (version 2)
0-511 512-1023 1K-2047 2K-4095 4K-8191 8K-16383
16K-32767 32K-65535 64K-131071
0 0 0 0 0 0 0
0 0
Write request stats (version 2)
0-511 512-1023 1K-2047 2K-4095 4K-8191 8K-16383
16K-32767 32K-65535 64K-131071
0 0 0 0 0 0 0
0 0

Server nfs V3: (690371790 calls)
null getattr setattr lookup access readlink read
0 0% 6373234 1% 588373 0% 1207395 0% 161925 0% 0 0%
360504548 52%
write create mkdir symlink mknod remove rmdir
320699142 46% 197314 0% 0 0% 0 0% 0 0% 196713 0% 0
0%
rename link readdir readdir+ fsstat fsinfo
pathconf
390326 0% 0 0% 1250 0% 348 0% 51222 0% 0 0% 0 0%
commit
0 0%

Read request stats (version 3)
0-511 512-1023 1K-2047 2K-4095 4K-8191 8K-16383
16K-32767 32K-65535 64K-131071
11264334 10369743 33830 127226696 588736 7864215
133293757 69863236 0
Write request stats (version 3)
0-511 512-1023 1K-2047 2K-4095 4K-8191 8K-16383
16K-32767 32K-65535 64K-131071
179303410 5582191 2952214 64618801 44513260 786325
10732171 12210770 0
sigsa0112001>
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers



This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:42:44 EDT