From: Liam Carey (LCarey@telecomsys.com)
Date: Tue Feb 06 2007 - 13:44:00 EST
february 6th
Hello -
I'm running Solaris 8 (5.8 Generic_117350-44) on a SUN Enterprise 220R
server with the following configs :
System Configuration: Sun Microsystems sun4u Sun Enterprise 220R (2 X
UltraSPARC-II 450MHz)
System clock frequency: 113 MHz
Memory size: 2048 Megabytes
We have an external SAN connected via fiber to this server and we are
experiencing severe I/O wait times. The system has become unusable at
this point. After much trouble shooting, I have come up empty handed.
Your help is very appreciated!
Mpstat, Iostat and vmstat are listed below. Notice the massive wait
time in I/O. Also notice the blocked processes in vmstat that are
waiting for I/O resources. The SAN and the Fiber line itself have been
tested and apparently are functioning correctly. Could the issue be in
some system settings? This server worked fine until December and now we
have intermittent issues that seem to slow the entire I/O to a
standstill. No errors in /var/adm/messages or in prtdiag. Fibre Card
(IntraServer,fc-pci13e9,624/t+ LSI,919) has been replaced.
Please email! I will post summary to group.
bash-2.03# mpstat 5 5
CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt
idl
0 24 8 560 207 72 531 8 40 51 3 100 0 9 35
56
2 23 11 582 105 100 699 2 40 53 7 106 0 6 39
54
CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt
idl
0 1 1 110 464 364 73 0 6 81 0 24 0 1 83
16
2 0 2 18 102 100 83 1 6 68 0 23 0 0 99
1
CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt
idl
0 0 3 124 2236 2130 1327 2 14 4 1 29 0 12 77
11
2 0 4 17 106 100 2388 3 14 4 1 40 0 8 91
1
CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt
idl
0 0 2 114 476 375 78 0 9 43 0 29 0 5 84
11
2 0 3 17 101 100 92 0 10 37 0 41 0 6 92
2
CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt
idl
0 0 3 115 508 408 73 1 4 0 0 54 0 0 100
0
2 0 0 5 102 100 115 0 5 0 0 10 0 1 97
2
# iostat -nzx 5
extended device statistics
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
1.4 2.2 9.2 3.0 0.0 5.5 0.0 1522.1 0 100 c3t0d0
2.0 0.4 10.4 1.7 0.0 4.0 0.0 1660.6 0 100 c3t0d1
extended device statistics
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
2.2 0.6 15.4 1.8 0.0 4.3 0.0 1548.4 0 100 c3t0d0
1.8 0.6 9.0 0.3 0.0 4.0 0.0 1664.0 0 100 c3t0d1
extended device statistics
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
4.2 1.2 27.0 5.1 0.0 5.4 0.0 994.3 0 100 c3t0d0
3.8 1.0 24.4 3.5 0.0 4.0 0.0 831.4 0 100 c3t0d1
extended device statistics
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
1.6 4.0 9.6 8.4 0.0 6.0 0.0 1067.9 0 100 c3t0d0
2.2 0.6 13.6 1.9 0.0 4.0 0.0 1426.1 0 100 c3t0d1
bash-2.03# vmstat 5 5
procs memory page disk faults
cpu
r b w swap free re mf pi po fr de sr m0 m1 m4 m1 in sy cs us
sy id
0 1 0 5463320 1375960 190 47 351 6 6 0 0 1 0 0 0 213 207 194 0
8 92
0 3 0 5437472 1346408 314 2173 1254 0 0 0 0 0 0 0 0 1832 3799 2447 5
25 70
0 4 0 5437584 1347376 0 0 289 0 0 0 0 0 0 0 0 799 277 799 0
3 97
0 5 0 5437584 1347408 1 0 203 0 0 0 0 0 0 0 0 656 194 450 0
3 97
0 5 0 5437576 1347360 4 0 128 0 0 0 0 0 0 0 0 523 105 241 0
1 99
Liam Carey
IT Dept
TCS, Oakland
The information contained in this message may be privileged and/or
confidential. If you are not the intended recipient, or responsible for
delivering this message to the intended recipient, any review, forwarding,
dissemination, distribution or copying of this communication or any
attachment(s) is strictly prohibited. If you have received this message in
error, please so notify the sender immediately, and delete it and all
attachments from your computer and network.
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers
This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:41:36 EDT