Virtual memory usage 4.0g ES40

From: Siebert, Aaron (aaron.siebert@nagrastar.com)
Date: Mon Feb 02 2004 - 17:57:09 EST


Managers, the system 4.0G has ES40, 4 cpus, 16Gb memory, and 24 GB swap.
This is an oracle server only and we witnessed a high load (15%) during
a period of 4 minutes that created a bit of a denial of service for us.
We are trying to understand why. It looks like we are swapping quite a
bit. Below I have included much statistics generated from the time in
question. I am also including my sysconfigtab, proc and swapon params
for any suggestion/input. The original problem is below. Thanks to
anyone who can help evaluate why the system perf stopped and previous
responses from Martin and Udo. Here is some more info.

Swap partition /dev/rz0b (default swap):
    Allocated space: 3107213 pages (24275MB)
    In-use space: 949352 pages ( 30%)
    Free space: 2157861 pages ( 69%)

Total swap allocation:
    Allocated space: 3107213 pages (24275MB)
    Reserved space: 1073060 pages ( 34%)
    In-use space: 949352 pages ( 30%)
    Available space: 2034153 pages ( 65%)

proc:
     max-proc-per-user=1024
     max-threads-per-user=2048
     per-proc-data-size=10000000000
     max-per-proc-data-size=10000000000
     max-per-proc-address-space=10000000000
     per-proc-address-space=10000000000
     maxusers=128
     task-max=16384
     thread-max=32768

ipc:
        msg-mni = 1024
        msg-tql = 1024
        shm-max = 2147483647
        shm-seg = 512
        shm-mni = 2048
        sem-mni = 512
        sem-msl = 512
     num-of-sems=2500
     ssm-threshold=0
     msg-max=16384

rt:
     aio-max-num=3000
     aio-task-max-num=1000
     aio-max-percent=2

dli:
     max-ifq-length=1024

snmpinfo:
     snmp_devs=30

vm:
        vm-maxvas = 7516192768
        vm-mapentries = 400
     ubc-minpercent=5
     ubc-maxpercent=20
     ubc-borrowpercent=15
     vm-vpagemax=917504
     vm-ubcseqstartpercent=15
     vm-aggressive-swap=1

advfs:
     AdvfsFavorBlockingQueue=0

Virtual Memory Statistics: (pagesize = 8192)
  procs memory pages intr cpu
  r w u act free wire fault cow zero react pin pout in sy cs us
sy id
  6 573 42 1M 225 906K 46K 3701 9684 35 4545 0 2K 15K 7K 13
9 78
  7 572 41 1M 780 918K 65K 10K 9746 2138 8561 273 4K 22K 14K 18
19 63
  5 569 46 1M 126 919K 56K 5042 13K 1127 5287 90 2K 18K 7K 16
11 74
  6 574 41 1M 127 919K 28K 551 1718 45 1404 0 3K 18K 11K 17
9 74
  5 573 43 1M 125 919K 38K 3434 9125 216 3737 0 2K 14K 6K 11
8 81
  5 573 42 1M 110 919K 30K 624 1914 310 1777 0 3K 18K 11K 17
9 74
 15 565 44 1M 2020 917K 5193 56 643 13 186 0 1K 12K 3K 7
82 11
 16 561 41 1M 5873 910K 0 0 0 0 0 0 846 13K 2K 9
89 2
 10 567 42 1M 9764 903K 0 0 0 0 0 0 720 10K 2K 9
71 19
  7 572 40 1M 15K 896K 0 0 0 0 0 0 570 6K 2K 7
38 55
  7 572 39 1M 18K 892K 0 0 0 0 0 0 397 4K 1K 3
67 30
  8 569 41 1M 23K 887K 0 0 0 0 0 0 238 1K 963 2
32 66
  8 576 38 1M 27K 883K 0 0 0 0 0 0 174 1K 770 1
47 52
  8 571 39 1M 30K 879K 0 0 0 0 0 0 140 1K 513 1
37 63
  8 574 37 1M 33K 877K 0 0 0 0 0 0 163 2K 602 1
48 51
  9 568 40 1M 35K 874K 0 0 0 0 0 0 221 1K 780 1
46 52
 10 567 41 1M 37K 871K 0 0 0 0 0 0 556 8K 2K 7
40 54
 10 570 38 1M 40K 866K 0 0 0 0 0 0 583 6K 2K 8
59 33
 14 569 40 1M 40K 863K 0 0 0 0 0 0 503 7K 1K 10
59 31
 10 586 38 1M 41K 860K 0 0 0 0 0 0 307 5K 1K 6
79 15
 10 580 38 1M 45K 857K 0 0 0 0 0 0 313 3K 1K 4
45 51
Virtual Memory Statistics: (pagesize = 8192)
  procs memory pages intr cpu
  r w u act free wire fault cow zero react pin pout in sy cs us
sy id
  8 605 38 1M 44K 855K 0 0 0 0 0 0 222 3K 806 3
56 41
 10 600 38 1M 47K 851K 0 0 0 0 0 0 324 3K 1K 3
57 41
  8 593 38 1M 52K 847K 0 0 0 0 0 0 259 3K 914 2
59 38
  7 594 38 1M 56K 843K 0 0 0 0 0 0 310 2K 1K 3
43 54
  5 613 44 1M 30K 839K 709K 37K 92K 962 59K 63 1K 20K 5K 12
63 25
  6 599 43 1M 21K 835K 79K 1701 5015 0 3023 0 1K 14K 6K 9
12 78
  9 569 42 1M 25K 828K 106K 3553 9272 4 4420 0 5K 36K 12K 40
18 42
 12 565 43 1M 17K 829K 84K 1174 3381 0 2557 0 5K 39K 13K 47
15 38
 10 572 39 1M 7719 829K 88K 5752 12K 2 5719 0 5K 39K 13K 38
17 45
 13 562 45 1M 381 829K 71K 3285 7911 2 3787 0 5K 38K 12K 37
14 49
  6 571 42 1M 394 830K 66K 1140 3034 38 2044 0 6K 39K 14K 42
16 43
  5 573 42 1M 116 830K 84K 3068 8324 40 3622 0 5K 38K 14K 40
15 45
 11 564 45 1M 344 831K 64K 684 2036 63 1775 0 5K 37K 13K 39
13 48
  8 571 41 1M 51 831K 73K 3427 10K 122 3627 0 5K 37K 13K 32
16 53
  6 572 42 1M 293 831K 44K 585 1794 24 1398 0 4K 28K 13K 24
12 65
  6 574 40 1M 126 831K 53K 3564 9431 52 3833 0 3K 22K 10K 17
11 72
  6 573 41 1M 60 831K 27K 829 2408 105 1791 0 2K 17K 9K 14
11 75
  6 575 39 1M 87 848K 20K 811 2489 29 1426 0 2K 10K 6K 8
5 87
  6 572 40 1M 111 903K 51K 3409 9128 22 3430 0 2K 17K 8K 11
11 77
  5 576 39 1M 367 905K 26K 3392 9053 2 3365 0 695 4K 2K 2
4 94

ESC[HESC[2JHOST, 1 user, load average: 15.06, 3.57, 2.48
%CPU %MEM PID TIME PRI NI S RUSER COMMAND
16.0 0.0 2686 8:08.31 44 0 R operat ksh /usr/local/bin/lproc
60 24
15.0 0.0 15996 0:00.94 44 0 R operat ps -eocommand
103.9 3.7 -18:05:11 38 -6 R < root [kernel idle]
10.2 14.7 14406 29:12.30 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 9.9 7.7 10477 4:44.51 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 9.9 1.6 4552 4:43.27 44 0 R oracle oracleCASDB1 (LOCAL=NO)
 8.5 15.2 12442 30:26.29 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 8.2 3.6 7007 9:48.45 44 0 R oracle oracleCASDB1 (LOCAL=NO)
 6.9 15.7 11873 30:35.45 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 6.3 14.9 26634 30:28.34 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 6.1 11.0 28896 30:06.40 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 5.8 15.3 20608 30:50.58 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 5.8 3.6 24009 9:40.03 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 5.8 0.0 16158 46:24.14 44 0 S oracle
/u00/app/oracle/product/8.1.7.2.1/
 5.2 0.0 26 10:56:59 44 0 S root /sbin/update
 5.0 10.6 14843 30:11.42 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 4.8 15.6 28367 30:06.97 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 3.4 14.1 14877 30:05.95 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 3.3 0.0 3223 01:23:28 44 0 S operat ksh
/soft/local/common/current/bin
 3.2 14.7 15449 31:01.06 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 3.1 15.3 28652 30:18.33 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 3.0 3.5 1457 4:43.45 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 3.0 2.8 605 3:47.19 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 2.8 14.8 15257 29:55.25 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 2.7 15.9 18753 30:24.39 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 2.7 15.5 14795 30:31.75 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 2.5 11.0 27308 29:58.18 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 2.5 8.2 15337 4:42.69 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 2.1 6.8 14240 4:43.12 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.9 8.2 10528 4:44.26 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.8 3.6 28320 9:41.13 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.7 16.0 28330 30:10.34 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.6 15.4 17754 30:32.34 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.6 0.6 23533 3:47.80 44 0 TW oracle oracleCASDB1 (LOCAL=NO)
 1.5 11.5 27094 30:19.27 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.5 11.5 16617 30:18.15 44 0 U oracle oracleCASDB1 (LOCAL=NO)
 1.5 5.7 21102 4:49.19 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.3 14.9 19832 30:32.67 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.2 14.9 6245 30:36.75 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.0 33.0 25027 19:02:18 44 0 U oracle ora_dbw0_CASDB1
 1.0 23.8 21031 02:28:46 44 0 R oracle oracleCASDB1 (LOCAL=NO)
 1.0 3.3 28727 9:36.63 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.9 14.9 11183 29:14.56 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.9 3.4 27448 9:47.64 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.7 3.7 25234 9:35.46 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.7 0.0 24595 12:19:42 44 0 R oracle ora_lgwr_CASDB1
 0.6 11.1 14730 30:53.80 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.6 2.8 12044 3:50.40 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.4 14.5 25171 30:09.46 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.4 8.2 15513 4:43.93 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.4 2.8 26686 4:46.42 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.3 21.7 30209 01:19:35 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.3 14.5 6553 29:42.61 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.3 14.4 32231 29:50.36 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.3 10.8 18379 30:49.34 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.3 10.6 18997 25:15.04 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.3 0.0 1 09:26:23 44 0 S root /sbin/init -a
 0.2 15.5 5641 30:15.26 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.2 11.4 26808 30:09.75 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.2 6.7 23292 4:40.55 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.2 5.2 1906 4:43.73 44 0 S oracle oracleCASDB1 (LOCAL=NO)
294.4 590.4 <= totals
ESC[HESC[2JHOST, 1 user, load average: 15.06, 3.57, 2.48
%CPU %MEM PID TIME PRI NI S RUSER COMMAND
61.5 0.0 19796 0:03.15 44 0 R operat ps xgww -o
pcpu,pmem,pid,time,pri,
35.9 0.0 12599 0:01.02 44 0 R oracle oracleCASDB1 (LOCAL=NO)
13.9 0.1 23544 3:49.60 44 0 S oracle oracleCASDB1 (LOCAL=NO)
12.4 0.0 20478 0:00.84 44 0 R operat ../bin/procinfo
11.1 8.0 10438 4:41.14 44 0 S oracle oracleCASDB1 (LOCAL=NO)
10.1 14.4 14016 29:35.04 44 0 S oracle oracleCASDB1 (LOCAL=NO)
100.8 3.7 -18:06:21 38 -6 R < root [kernel idle]
 9.9 0.0 19595 1:18.93 44 0 S operat
/soft/local/nsm1/osmon/current/bin
 5.8 2.8 26686 4:46.93 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 5.8 0.0 16158 46:27.40 44 0 S oracle
/u00/app/oracle/product/8.1.7.2.1/
 5.1 3.7 30279 9:37.99 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 4.6 0.0 27912 3:44.90 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 4.4 3.7 32096 9:41.44 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 4.0 0.1 25462 9:50.00 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 3.7 3.5 27180 4:45.48 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.9 1.8 25231 3:49.45 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.5 24.2 13524 02:59:59 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.1 33.0 25027 19:02:19 44 0 U oracle ora_dbw0_CASDB1
 0.9 14.9 11183 29:14.97 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.5 13.9 10247 29:58.71 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.3 14.9 6168 30:13.56 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.3 14.8 9981 29:40.98 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.2 5.0 12539 4:40.04 44 0 R oracle oracleCASDB1 (LOCAL=NO)
 0.2 0.1 25139 9:41.17 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.2 0.0 10315 03:17:11 44 0 S operat vmstat 15
 0.1 15.6 4579 30:13.46 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 15.2 1194 30:14.06 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 14.7 14406 29:14.08 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 8.0 7470 4:35.81 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.1 27463 9:35.42 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.0 24595 12:19:42 44 0 S oracle ora_lgwr_CASDB1
 0.0 24.0 6336 09:43:52 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 23.8 21031 02:28:46 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 21.7 30209 01:19:36 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 19.5 25760 50:09.73 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 19.4 26508 01:54:59 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 16.2 17672 28:14.22 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 16.0 28330 30:10.35 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 26514 30:09.22 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 25862 29:49.77 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 23428 29:52.64 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 18753 30:24.59 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.8 26754 30:00.69 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 31107 30:27.17 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 30996 30:13.75 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 27017 29:45.10 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 17031 30:40.14 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 15384 30:05.05 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 11873 30:35.53 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.6 30395 30:00.78 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.6 28367 30:06.98 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 24546 28:05.00 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 22716 30:34.13 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 21049 29:54.45 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 16288 30:43.41 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 14795 30:31.98 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 12123 30:49.55 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 11226 30:45.91 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 5641 30:15.47 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.4 28130 30:05.05 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.4 27455 30:14.73 44 0 I oracle oracleCASDB1 (LOCAL=NO)
296.7 716.4 <= totals
ESC[HESC[2JHOST, 1 user, load average: 15.06, 3.57, 2.48
%CPU %MEM PID TIME PRI NI S RUSER COMMAND
99.9 3.7 0 18:07:30 38 -6 R < root [kernel idle]
23.5 0.0 2686 8:09.25 44 0 S operat ksh /usr/local/bin/lproc
60 24
13.3 0.0 10072 0:01.02 44 0 R operat ps xgww -o
pcpu,pmem,pid,time,pri,
10.3 0.0 8909 0:00.28 44 0 S operat gawk BEGIN{FIELDWIDTHS="4
5 7 12 4
 9.4 0.1 23518 9:36.68 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 8.5 0.0 16158 46:31.09 44 0 S oracle
/u00/app/oracle/product/8.1.7.2.1/
 5.1 0.0 14561 0:00.14 44 0 S operat sort -dr
 3.9 2.8 26686 4:47.25 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 3.1 3.2 15791 4:43.57 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 2.5 2.7 22234 3:51.01 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.3 0.0 10315 03:17:17 44 0 S operat vmstat 15
 1.0 2.9 31667 9:39.20 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.6 3.1 28045 4:48.23 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 3.5 1457 4:43.90 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.1 32459 3:46.83 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.1 28889 2:50.40 44 0 S oracle ora_smon_CASDB1
 0.0 33.0 25027 19:02:19 44 0 S oracle ora_dbw0_CASDB1
 0.0 24.2 13524 02:59:59 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 24.0 6336 09:43:52 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 23.8 21031 02:28:46 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 21.7 30209 01:19:36 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 19.5 25760 50:09.73 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 19.4 26508 01:54:59 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 16.2 17672 28:14.22 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 16.0 28330 30:10.35 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 26514 30:09.22 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 25862 29:49.77 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 23428 29:52.64 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 18753 30:24.60 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.8 26754 30:00.69 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 31107 30:27.17 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 30996 30:13.75 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 27017 29:45.10 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 17031 30:40.14 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 15384 30:05.05 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 11873 30:35.53 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.6 30395 30:00.78 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.6 28367 30:06.98 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.6 4579 30:13.46 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 24546 28:05.00 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 22716 30:34.13 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 21049 29:54.45 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 16288 30:43.46 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 14795 30:31.98 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 12123 30:49.55 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 11226 30:45.91 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 5641 30:15.47 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.4 28130 30:05.05 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.4 27455 30:14.73 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.4 26497 30:09.35 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.4 26264 30:11.73 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.4 26186 30:01.03 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.4 23477 29:56.88 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.4 17754 30:32.41 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.4 17634 31:02.55 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.4 16005 29:58.82 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.3 32037 29:54.49 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.3 28652 30:18.45 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.3 26152 30:13.46 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.3 23615 30:06.33 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.3 20608 30:51.03 44 0 I oracle oracleCASDB1 (LOCAL=NO)
182.7 779.5 <= totals
ESC[HESC[2JHOST, 1 user, load average: 15.06, 3.57, 2.48
%CPU %MEM PID TIME PRI NI S RUSER COMMAND
46.5 0.0 18123 0:01.65 44 0 R operat ps xgww -o
pcpu,pmem,pid,time,pri,
17.8 14.8 15257 29:57.83 44 0 S oracle oracleCASDB1 (LOCAL=NO)
15.7 0.0 2686 8:09.88 44 0 S operat ksh /usr/local/bin/lproc
60 24
14.8 0.0 10315 03:17:25 44 0 S operat vmstat 15
100.6 3.7 -18:08:36 38 -6 R < root [kernel idle]
 9.4 14.7 17206 30:34.16 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 7.9 10.7 18997 25:15.69 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 7.9 3.5 25669 9:40.31 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 7.9 0.0 18595 0:00.25 44 0 S operat gawk BEGIN{FIELDWIDTHS="4
5 7 12 4
 6.0 3.6 28320 9:41.55 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 5.2 0.1 27971 3:45.82 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 3.0 0.0 16158 46:34.43 44 0 S oracle
/u00/app/oracle/product/8.1.7.2.1/
 2.7 15.3 1194 30:14.58 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 2.1 14.7 17867 30:34.64 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.9 11.9 17520 30:16.76 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.8 14.2 7725 31:19.97 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.8 13.7 2560 29:56.56 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.4 33.0 25027 19:02:20 44 0 S oracle ora_dbw0_CASDB1
 1.2 0.2 32407 9:44.47 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.8 15.4 17634 31:03.01 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.6 15.5 22716 30:34.51 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.5 0.0 24595 12:19:43 44 0 S oracle ora_lgwr_CASDB1
 0.5 0.0 20455 0:00.01 44 0 S operat gawk
!/^%CPU/{cpu+=$1;mem+=$2} {pr
 0.4 2.8 32734 3:47.83 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.4 0.0 19595 1:21.48 44 0 S operat
/soft/local/nsm1/osmon/current/bin
 0.4 0.0 18249 0:00.01 44 0 S operat head -n 62
 0.3 15.5 11226 30:45.98 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.3 14.8 9706 30:43.65 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.3 14.5 18135 30:55.82 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.3 3.7 25234 9:35.74 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 15.2 20761 16:15.79 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 15.0 17372 30:59.00 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 14.8 10103 29:22.15 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 11.1 14730 30:54.46 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.0 21512 6:11.37 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.0 4449 6:14.05 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 24.2 13524 03:00:00 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 24.0 6336 09:43:52 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 23.8 21031 02:28:46 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 21.8 30209 01:19:36 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 19.5 25760 50:09.82 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 19.4 26508 01:54:59 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 16.2 17672 28:14.31 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 16.0 28330 30:10.35 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 26514 30:09.22 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 25862 29:49.77 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 23428 29:52.64 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 18753 30:24.62 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.8 26754 30:00.69 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 31107 30:27.17 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 30996 30:13.75 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 27017 29:45.10 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 17031 30:40.14 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 15384 30:05.05 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 11873 30:35.78 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.6 30395 30:00.78 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.6 28367 30:06.98 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.6 12123 30:49.60 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.6 4579 30:13.54 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 24546 28:05.14 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.5 21049 29:54.45 44 0 S oracle oracleCASDB1 (LOCAL=NO)
261.0 724.3 <= totals
ESC[HESC[2JHOST, 1 user, load average: 15.06, 3.57, 2.48
%CPU %MEM PID TIME PRI NI S RUSER COMMAND
65.6 0.0 18369 0:03.09 44 0 R operat ps xgww -o
pcpu,pmem,pid,time,pri,
11.1 0.0 10315 03:17:31 44 0 S operat vmstat 15
10.3 14.2 7725 31:20.39 44 0 S oracle oracleCASDB1 (LOCAL=NO)
101.0 3.7 -18:09:42 38 -6 R < root [kernel idle]
 4.2 0.0 16158 46:42.33 44 0 S oracle
/u00/app/oracle/product/8.1.7.2.1/
 2.4 0.0 2686 8:09.97 44 0 S operat ksh /usr/local/bin/lproc
60 24
 2.0 14.7 17867 30:35.06 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.9 2.7 27111 4:43.91 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 1.7 0.1 1296 9:52.06 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.9 33.0 25027 19:02:21 44 0 S oracle ora_dbw0_CASDB1
 0.4 0.1 601 3:49.45 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.4 0.0 5421 0:00.23 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.3 0.0 19669 0:00.02 44 0 S operat gawk
!/^%CPU/{cpu+=$1;mem+=$2} {pr
 0.3 0.0 14933 0:00.02 44 0 S operat head -n 62
 0.3 0.0 13639 0:00.32 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.3 0.0 13347 0:00.38 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.3 0.0 12050 0:00.22 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.2 15.5 16288 30:43.93 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.2 15.4 17754 30:32.54 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.2 14.8 9706 30:43.87 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.2 14.5 18135 30:56.14 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.2 0.0 17698 0:00.09 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 15.5 11226 30:46.21 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 15.1 11474 30:56.27 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 15.0 17372 30:59.14 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 14.5 10794 30:53.77 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 13.7 2560 29:57.12 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 12.4 20522 30:26.61 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 11.9 4765 30:43.22 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 10.7 18997 25:16.09 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 3.6 7007 9:48.90 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 3.5 27448 9:47.74 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.2 6648 9:42.44 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.1 17396 0:00.10 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.0 24950 0:00.09 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.0 24595 12:19:43 44 0 S oracle ora_lgwr_CASDB1
 0.1 0.0 21618 0:00.24 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.0 19549 0:00.09 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.0 19315 0:00.13 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.0 18539 0:00.08 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.0 18117 0:00.08 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.0 11231 0:00.32 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.1 0.0 9989 0:00.01 44 0 S operat gawk BEGIN{FIELDWIDTHS="4
5 7 12 4
 0.1 0.0 7179 0:00.01 44 0 S operat sort -dr
 0.1 0.0 26 10:57:01 44 0 S root /sbin/update
 0.0 24.2 13524 03:00:00 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 24.0 6336 09:43:52 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 23.8 21031 02:28:46 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 21.8 30209 01:19:36 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 19.5 25760 50:09.82 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 19.4 26508 01:54:59 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 16.2 17672 28:14.31 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 16.0 28330 30:10.35 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 26514 30:09.22 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 25862 29:49.77 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 23428 29:52.65 44 0 S oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.9 18753 30:24.70 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.8 26754 30:00.69 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 31107 30:27.17 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 30996 30:13.75 44 0 I oracle oracleCASDB1 (LOCAL=NO)
 0.0 15.7 27017 29:45.10 44 0 I oracle oracleCASDB1 (LOCAL=NO)
206.7 536.3 <= totals

      tty rz0 rz1 rz2 rz3 cpu
 tin tout bps tps bps tps bps tps bps tps us ni sy id
   0 0 42 5 707 55 805 99 450 22 9 0 34 58
   0 0 67 7 987 78 997 125 560 26 8 0 50 41
   0 0 70 9 1352 116 1616 190 752 40 10 0 31 59
   0 0 136 15 922 75 864 108 558 31 5 0 33 61
   0 0 24 3 643 61 1050 129 290 20 6 0 35 59
   0 0 17 1 545 54 926 115 269 16 2 0 59 39
   0 0 48 1 462 51 1112 138 131 9 2 0 88 9
   0 0 13 0 514 55 1199 148 139 8 3 0 58 39
   0 0 6 1 261 31 584 72 70 7 1 0 29 70
   0 0 138 12 158 15 360 45 66 4 1 0 29 70
   0 0 0 0 48 6 85 11 19 2 1 0 42 57
   0 0 10 1 48 6 100 13 11 1 1 0 39 60
   0 0 2 0 101 12 115 14 37 4 1 0 29 70
   0 0 3 0 53 6 98 12 18 2 1 0 63 36
   0 0 13 0 16 2 34 4 3 0 1 0 59 40
   0 0 93 9 85 7 90 11 48 2 1 0 29 71
   0 0 3 0 32 3 99 6 18 2 1 0 29 70
   0 0 5 1 86 9 160 20 30 2 1 0 36 63
   0 0 104 12 56 5 85 11 14 1 1 0 31 68
      tty rz0 rz1 rz2 rz3 cpu
 tin tout bps tps bps tps bps tps bps tps us ni sy id
   0 0 8 0 59 7 75 9 24 2 1 0 75 24
   0 0 53 2 53 7 82 10 14 1 1 0 46 53
   0 0 101 9 32 3 32 4 34 4 1 0 71 29
   0 0 18 2 110 13 176 22 37 4 2 0 34 65
   0 0 8 1 149 12 91 11 82 3 1 0 29 71
   0 0 13 0 38 4 66 8 16 2 1 0 60 40
   0 0 2 0 45 5 110 14 18 1 1 0 29 70
   0 0 112 14 1520 116 1422 176 971 48 17 0 36 47
   0 0 108 12 816 64 1175 145 496 24 7 0 47 46
   0 0 66 7 769 59 725 91 514 27 8 0 90 2
   0 0 37 5 622 48 830 102 368 17 8 0 59 33
   0 0 34 4 920 81 1626 202 454 22 9 0 31 60
   0 0 24 2 627 66 1333 165 168 10 5 0 58 36
   0 0 11 1 394 36 534 65 179 9 3 0 70 27
   0 0 269 27 957 64 1033 128 648 25 17 0 49 34
   0 0 26 2 696 64 1243 155 272 11 9 0 56 35
   0 0 29 2 290 30 496 55 80 4 7 0 83 10
   0 0 72 5 229 22 322 40 96 5 5 0 90 5
   0 0 18 1 192 18 262 33 91 5 7 0 63 30
      tty rz0 rz1 rz2 rz3 cpu
 tin tout bps tps bps tps bps tps bps tps us ni sy id
   0 0 405 29 355 33 561 69 77 4 4 0 61 35
   0 0 98 10 206 18 312 39 126 8 3 0 29 69
   0 0 21 1 238 21 358 45 110 5 6 0 51 43
   0 0 21 1 286 30 592 73 91 6 3 0 40 57
   0 0 2 0 170 16 285 36 72 4 2 0 35 63
   0 0 24 2 139 15 264 33 54 5 4 0 81 15
   0 0 30 1 158 15 216 27 70 4 4 0 68 28
   0 0 93 10 299 31 568 70 93 6 3 0 63 34
   0 0 62 2 109 13 144 18 38 3 4 0 66 30

Aaron Siebert
Nagrastar Customer Support Engineer
303-706-5492 fax 303-706-5719
Aaron.Siebert@NagraStar.com



This archive was generated by hypermail 2.1.7 : Sat Apr 12 2008 - 10:49:50 EDT