mail from Vijay Raghavan

From: Raghavan, Vijay (vijay.raghavan@skanska.se)
Date: Tue Apr 01 2003 - 04:02:27 EST


I am monitoring performance for Sun-Solaris 2.6/2.7/2.8 for
CPU,memory,kernel,etc.

Now there is a Solaris 2.6 box ,it is a Ultra Enterprise 6500 and it gives
some

weird results when I run the command lockstat sleep 5.

I am attaching a txt file which has all details.Well some info regarding the
versions

we have are

Hardware Platform:Ultra Enterprise 6500

OS version: SunOS 5.6 Generic_105181-33 sun 4u

Vxfs version : 3.3.2

I went through a lot of docementation for lock contention,but really not
able to

understand what is the problem.Well give me some technical doc or web sites

where it expalins what exactly has to be done ie any tunable kernel
parameters,any

patches to be installed.I would appreciate if you can reply asap.

Thanks and regards and do keep in touch.

VIJAY RAGHAVAN

 

 

 

 

  _____

Do you Yahoo!?
Yahoo! Tax <http://us.rd.yahoo.com/finance/mailsig/*http://tax.yahoo.com>
Center - File online, calculators, forms, and more
Adaptive mutex spin: 3881 events

Count indv cuml rcnt spin Lock Caller
-------------------------------------------------------------------------------
  440 11% 11% 1.00 140 0x65975820 qfestart+0x1f8
  312 8% 19% 1.00 189 service_queue qenable_locked+0x34
  151 4% 23% 1.00 5091 vx_sched_lk vx_worklist_thread+0x2c
  140 4% 27% 1.00 134 0x65975820 qfeintr+0x2bc
  135 3% 30% 1.00 272 service_queue background+0xdc
  116 3% 33% 1.00 15 0x607796b8 sync_stream_buf+0x24
  111 3% 36% 1.00 212 service_queue background+0x120
   89 2% 38% 1.00 3555 vx_sched_lk vx_worklist_thread+0x38
   88 2% 41% 1.00 135 ph_mutex+0xc0 page_create_va+0x368
   80 2% 43% 1.00 281 vx_worklist_lk vx_worklist_process+0xb4
   75 2% 45% 1.00 243 ph_mutex+0xd8 page_create_va+0x368
   62 2% 46% 1.00 48 0x65a7d844 queuerun+0x198
   57 1% 48% 1.00 30 0x65a7d844 background+0xa8
   56 1% 49% 1.00 21 0x6085501c putnext+0xc
   49 1% 51% 1.00 6 0x65a7d844 putq+0x38
   47 1% 52% 1.00 2 0x60857f90 putnext+0x30
   44 1% 53% 1.00 518 vx_bc_bfree_lk vx_bc_getblk+0x80
   42 1% 54% 1.00 5 0x65a7d844 getq_noenab+0x18
   36 1% 55% 1.00 193 ph_mutex+0xf8 page_create_va+0x368
   35 1% 56% 1.00 111 ph_mutex+0xb8 page_create_va+0x368
   35 1% 57% 1.00 23 0x60cddf0c segmap_smapadd+0xc
   32 1% 58% 1.00 12 ctr_mutex+0x18 page_ctr_add+0x30
   31 1% 58% 1.00 17 hblk8_lock sfmmu_hblk_tofreelist+0x38
   28 1% 59% 1.00 242 ph_mutex+0xc8 page_create_va+0x368
   28 1% 60% 1.00 13 ctr_mutex+0x30 page_ctr_sub+0x30
   26 1% 60% 1.00 20 fpc_mutex+0x68 page_list_add+0xb8
   26 1% 61% 1.00 1061 0x63d040a8 fca_tran_start+0x58
   26 1% 62% 1.00 32 fpc_mutex+0x60 page_list_add+0xb8
   26 1% 62% 1.00 3 0x65a7d8c8 entersq+0x10
   25 1% 63% 1.00 14 ctr_mutex+0x30 page_ctr_add+0x30
  
Adaptive mutex block: 999 events

Count indv cuml rcnt nsec Lock Caller
-------------------------------------------------------------------------------
  503 50% 50% 1.00 21309 0x62920000 fca_pkt_complete+0x24
  469 47% 97% 1.00 18843 0x63d04000 fca_pkt_complete+0x24
    4 0% 98% 1.00 36946 0x65975820 qfeintr+0x2bc
    3 0% 98% 1.00 142322 service_queue qenable_locked+0x34
    1 0% 98% 1.00 37705 0x7dc20870 background+0xa8
    1 0% 98% 1.00 62160 fpc_mutex+0x50 page_get_mnode_freelist+0xe
c
    1 0% 98% 1.00 58170 hblk8_lock sfmmu_hblk_tofreelist+0x38
    1 0% 98% 1.00 24777 0x6075c030 timeout_common+0x4
    1 0% 98% 1.00 43971 0x6d9c209c cv_wait_sig+0x1b8
    1 0% 99% 1.00 50792 service_queue background+0xdc
    1 0% 99% 1.00 102254 0x65a7d8c8 putnext+0x30
    1 0% 99% 1.00 23015 0x61dc5978 clock+0x29c
    1 0% 99% 1.00 96497 0x808e97a4 cv_wait_sig+0x1b8
    1 0% 99% 1.00 58140 fpc_mutex+0x8 page_get_mnode_freelist+0xe
c
    1 0% 99% 1.00 89494 smap_mtx+0x120 segmap_release+0xb0
    1 0% 99% 1.00 192859 0x7308d120 background+0xa8

Spin lock spin: 33736 events

Count indv cuml rcnt spin Lock Caller
-------------------------------------------------------------------------------
 1886 6% 6% 1.00 688 cpu[7]+0x44 disp_getbest+0x4
 1865 6% 11% 1.00 62 cpu[7]+0x44 disp+0x78
 1845 5% 17% 1.00 57 cpu[11]+0x44 disp+0x78
 1601 5% 21% 1.00 62 cpu[8]+0x44 disp+0x78
 1506 4% 26% 1.00 114 cpu[9]+0x44 disp+0x78
 1475 4% 30% 1.00 693 cpu[4]+0x44 disp_getbest+0x4
 1437 4% 34% 1.00 684 cpu[9]+0x44 disp_getbest+0x4
 1397 4% 39% 1.00 64 cpu[4]+0x44 disp+0x78
 1368 4% 43% 1.00 698 cpu[11]+0x44 disp_getbest+0x4
 1336 4% 47% 1.00 647 cpu[8]+0x44 disp_getbest+0x4
 1210 4% 50% 1.00 700 cpu[1]+0x44 disp_getbest+0x4
 1189 4% 54% 1.00 113 cpu[21]+0x44 disp+0x78
 1119 3% 57% 1.00 715 cpu[17]+0x44 disp_getbest+0x4
 1118 3% 60% 1.00 98 cpu[10]+0x44 disp+0x78
 1085 3% 64% 1.00 68 cpu[1]+0x44 disp+0x78
 1070 3% 67% 1.00 68 cpu[17]+0x44 disp+0x78
  937 3% 69% 1.00 753 cpu[21]+0x44 disp_getbest+0x4
  928 3% 72% 1.00 717 cpu[20]+0x44 disp_getbest+0x4

Thread lock spin: 33 events

Count indv cuml rcnt spin Lock Caller
-------------------------------------------------------------------------------
    2 6% 6% 1.00 119 cpu[21]+0x44 ts_tick+0x8
    2 6% 12% 1.00 2037 lwpsleepq+0x9c4 ts_tick+0x8
    2 6% 18% 1.00 2243 lwpsleepq+0xc4 ts_tick+0x8
    1 3% 21% 1.00 827 lwpsleepq+0xa44 ts_tick+0x8
    1 3% 24% 1.00 121 sleepq_head+0x9bc ts_tick+0x8
    1 3% 27% 1.00 337 sleepq_head+0x6c ts_tick+0x8
    1 3% 30% 1.00 2 cpu[1]+0x68 ts_tick+0x8
    1 3% 33% 1.00 176 sleepq_head+0x174 ts_tick+0x8
    1 3% 36% 1.00 4056 lwpsleepq+0x7c4 ts_update_list+0x60
    1 3% 39% 1.00 4668 lwpsleepq+0x344 ts_update_list+0x60
    1 3% 42% 1.00 295 cpu[9]+0x68 ts_tick+0x8
    1 3% 45% 1.00 2767 lwpsleepq+0x344 ts_tick+0x8
    1 3% 48% 1.00 3 cpu[1]+0x68 preempt+0x1c
    1 3% 52% 1.00 128 cpu[1]+0x68 ts_update_list+0x60
    1 3% 55% 1.00 3079 lwpsleepq+0xc44 ts_update_list+0x60
    1 3% 58% 1.00 13 cpu[25]+0x68 cv_wait_sig+0xb0

Lockstat record failure: 1 events

Count indv cuml rcnt Lock Caller
-------------------------------------------------------------------------------
    1 100% 100% 0.00 lockstat_lock lockstat_add_to_hash
-------------------------------------------------------------------------------
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers



This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:26:06 EDT