From: Siebert, Aaron (aaron.siebert@nagrastar.com)
Date: Thu Jan 29 2004 - 19:31:17 EST
Managers, we are trying to understand the vmstat output we generate on
our db host during the day. We had an unusual occurrence of high load
average during the time we got a denial of service on our system. We
cannot determine what created the high load scenario but have a lot of
information to look at. I am including a vmstat output during the time.
There are some odd numbers for fault/free/cow/zero during the duration
of the outage. Can someone help explain what might be happening with the
virtual memory of the system?
TIA
18:34:31.624: Virtual Memory Statistics: (pagesize = 8192)
18:34:31.624: procs memory pages
intr cpu
18:34:31.624: r w u act free wire fault cow zero react pin pout
in sy cs us sy id
18:34:31.624: 6 571 43 1M 116 918K 43K 3457 9179 2644 4678 617
2K 16K 9K 15 13 73
18:34:46.789: 7 570 44 1M 128 919K 27K 541 1662 2390 2320 171
2K 17K 10K 17 13 70
18:35:01.878: 5 571 44 1M 78 919K 61K 8084 12K 5479 7961 121
2K 21K 9K 18 17 65
18:35:16.975: 6 567 47 1M 137 907K 48K 7364 10K 1650 6737 60
2K 15K 7K 13 15 72
18:35:32.084: 8 568 45 1M 81 907K 51K 3216 8476 55 4556 0
4K 24K 12K 25 16 59
18:35:47.163: 5 573 43 1M 268 907K 31K 754 2365 119 2423 0
3K 15K 9K 16 8 75
18:36:02.245: 7 570 43 1M 243 907K 48K 3373 9102 97 4408 0
3K 21K 11K 23 12 65
18:36:17.338: 7 570 43 1M 265 907K 39K 882 3532 122 2498 0
3K 22K 11K 24 11 65
18:36:32.431: 7 573 40 1M 123 907K 44K 3182 8353 74 3578 0
3K 20K 9K 21 11 67
18:36:47.521: 9 570 41 1M 233 907K 26K 823 2489 16 1875 0
2K 13K 8K 14 8 78
18:37:02.638: 5 578 42 1M 106 908K 43K 3385 8829 28 3997 0
2K 15K 8K 17 10 73
18:37:17.728: 6 574 43 1M 220 908K 28K 946 4057 57 2013 0
8K 21K 12K 38 16 46
18:37:32.815: 7 572 41 1M 120 908K 48K 3297 8736 22 4115 0
7K 25K 14K 33 18 49
18:37:47.896: 6 572 42 1M 136 908K 23K 789 2420 19 1749 0
2K 14K 7K 11 7 81
18:38:02.978: 6 574 40 1M 125 908K 39K 3192 8419 13 3578 0
2K 15K 8K 13 9 78
18:38:18.086: 6 571 44 1M 91 908K 32K 1145 4410 13 2541 0
2K 16K 9K 13 9 79
18:38:33.164: 7 572 41 1M 105 909K 40K 3243 8476 20 3555 0
2K 15K 8K 13 9 78
18:38:48.260: 7 571 43 1M 68 911K 27K 765 2364 2025 1653 34
3K 16K 9K 14 14 72
18:39:03.344: 6 572 42 1M 101 912K 29K 1660 4882 9441 2333 405
3K 15K 11K 14 15 72
18:39:18.434: 5 574 41 1M 116 914K 35K 2474 7499 7305 3153 213
3K 13K 10K 10 9 81
18:39:33.574: 9 569 42 1M 167 915K 26K 798 1982 3707 1761 279
4K 16K 13K 15 10 75
18:39:48.657: Virtual Memory Statistics: (pagesize = 8192)
18:39:48.657: procs memory pages
intr cpu
18:39:48.658: r w u act free wire fault cow zero react pin pout
in sy cs us sy id
18:39:48.658: 5 573 43 1M 122 916K 45K 3774 9607 1909 4054 158
4K 16K 11K 14 13 74
18:40:03.758: 7 572 41 1M 780 918K 65K 10K 9746 2138 8561 273
4K 22K 14K 18 19 63
18:40:18.841: 5 569 46 1M 126 919K 56K 5042 13K 1127 5287 90
2K 18K 7K 16 11 74
18:40:33.921: 6 574 41 1M 127 919K 28K 551 1718 45 1404 0
3K 18K 11K 17 9 74
18:40:49.003: 5 573 43 1M 125 919K 38K 3434 9125 216 3737 0
2K 14K 6K 11 8 81
18:41:04.087: 5 573 42 1M 110 919K 30K 624 1914 310 1777 0
3K 18K 11K 17 9 74
18:41:27.521: 15 565 44 1M 2020 917K 5193 56 643 13 186 0
1K 12K 3K 7 82 11
18:41:50.731: 16 561 41 1M 5873 910K 0 0 0 0 0 0
846 13K 2K 9 89 2
18:42:07.666: 10 567 42 1M 9764 903K 0 0 0 0 0 0
720 10K 2K 9 71 19
18:42:22.888: 7 572 40 1M 15K 896K 0 0 0 0 0 0
570 6K 2K 7 38 55
18:42:38.947: 7 572 39 1M 18K 892K 0 0 0 0 0 0
397 4K 1K 3 67 30
18:42:55.938: 8 569 41 1M 23K 887K 0 0 0 0 0 0
238 1K 963 2 32 66
18:43:13.171: 8 576 38 1M 27K 883K 0 0 0 0 0 0
174 1K 770 1 47 52
18:43:29.197: 8 571 39 1M 30K 879K 0 0 0 0 0 0
140 1K 513 1 37 63
18:43:45.540: 8 574 37 1M 33K 877K 0 0 0 0 0 0
163 2K 602 1 48 51
18:44:03.561: 9 568 40 1M 35K 874K 0 0 0 0 0 0
221 1K 780 1 46 52
18:44:21.963: 10 567 41 1M 37K 871K 0 0 0 0 0 0
556 8K 2K 7 40 54
18:44:39.381: 10 570 38 1M 40K 866K 0 0 0 0 0 0
583 6K 2K 8 59 33
18:44:55.634: 14 569 40 1M 40K 863K 0 0 0 0 0 0
503 7K 1K 10 59 31
18:45:11.736: 10 586 38 1M 41K 860K 0 0 0 0 0 0
307 5K 1K 6 79 15
18:45:27.693: 10 580 38 1M 45K 857K 0 0 0 0 0 0
313 3K 1K 4 45 51
18:45:45.275: Virtual Memory Statistics: (pagesize = 8192)
18:45:45.275: procs memory pages
intr cpu
18:45:45.275: r w u act free wire fault cow zero react pin pout
in sy cs us sy id
18:45:45.275: 8 605 38 1M 44K 855K 0 0 0 0 0 0
222 3K 806 3 56 41
18:46:01.547: 10 600 38 1M 47K 851K 0 0 0 0 0 0
324 3K 1K 3 57 41
18:46:19.375: 8 593 38 1M 52K 847K 0 0 0 0 0 0
259 3K 914 2 59 38
18:46:35.260: 7 594 38 1M 56K 843K 0 0 0 0 0 0
310 2K 1K 3 43 54
18:46:50.357: 5 613 44 1M 30K 839K 709K 37K 92K 962 59K 63
1K 20K 5K 12 63 25
18:47:05.449: 6 599 43 1M 21K 835K 79K 1701 5015 0 3023 0
1K 14K 6K 9 12 78
18:47:20.544: 9 569 42 1M 25K 828K 106K 3553 9272 4 4420 0
5K 36K 12K 40 18 42
18:47:35.649: 12 565 43 1M 17K 829K 84K 1174 3381 0 2557 0
5K 39K 13K 47 15 38
18:47:50.740: 10 572 39 1M 7719 829K 88K 5752 12K 2 5719 0
5K 39K 13K 38 17 45
18:48:05.849: 13 562 45 1M 381 829K 71K 3285 7911 2 3787 0
5K 38K 12K 37 14 49
18:48:20.990: 6 571 42 1M 394 830K 66K 1140 3034 38 2044 0
6K 39K 14K 42 16 43
18:48:36.071: 5 573 42 1M 116 830K 84K 3068 8324 40 3622 0
5K 38K 14K 40 15 45
18:48:51.172: 11 564 45 1M 344 831K 64K 684 2036 63 1775 0
5K 37K 13K 39 13 48
18:49:06.269: 8 571 41 1M 51 831K 73K 3427 10K 122 3627 0
5K 37K 13K 32 16 53
18:49:21.358: 6 572 42 1M 293 831K 44K 585 1794 24 1398 0
4K 28K 13K 24 12 65
18:49:36.440: 6 574 40 1M 126 831K 53K 3564 9431 52 3833 0
3K 22K 10K 17 11 72
18:49:51.527: 6 573 41 1M 60 831K 27K 829 2408 105 1791 0
2K 17K 9K 14 11 75
18:50:06.608: 8 570 42 1M 303 831K 76K 14K 20K 30 11K 0
1K 18K 6K 12 16 72
18:50:21.687: 5 575 40 1M 151 831K 30K 896 2433 54 1924 0
2K 13K 7K 12 7 81
Aaron Siebert
Nagrastar Customer Support Engineer
303-706-5492 fax 303-706-5719
Aaron.Siebert@NagraStar.com
This archive was generated by hypermail 2.1.7 : Sat Apr 12 2008 - 10:49:50 EDT