Extreem system slowdown occurs approximately every 24 hours

From: Noboom2@aol.com
Date: Tue Feb 18 2003 - 13:46:48 EST


Hi-

We have a Tru 64 5.1a system, patch kit 3, that once a day experiences an
extreem
system slowdown. The system is still up, but response is very sluggish. It
seems to
clear itself up about 20-30 minutes after it starts. The system is a GS-160
in a
cluster with 2 AlphaServer 4100 systems, both of which are presently down.

Once major thing I noticed was my personal login took a long time to process.
 I have
a command like

    grep '^noboom2:' /etc/passwd

in my .cshrc, and I see it sitting on that command when I do a 'ps' in
another window.

I ran a 'ps' and removed processes I could account for from the output. I've
attached it
below.

I looked at the output from 'dia -R' and didn't see anything out of the
ordinary (there was
a 'timestamp' event during the problem time, but that seems to occur now and
then with
no noramal ill effects. BTW, I also got the following when using dia:

    # dia -R|more
    _DIAGNOSE-FAT: Automatic analysis is still running. Please shutdown and
reissue command.
    #

Anyone see that before and know what it means?)

Just to do 'something', I've eliminated the xntpd from the system, thinking
that maybe
it was causing some hangup somewhere, although I suspect this is unlikely.

If anyone has any ideas of what might be causing this, please let me know.

USER PID %CPU %MEM VSZ RSS TTY S STARTED TIME
COMMAND
root 524288 19.1 4.7 7.68G 288M ?? R < 07:43:18 32:06.10
[kernel idle]
root 526049 4.9 0.0 2.23M 152K ?? S 07:44:53 4:53.33 -RAD0
child (inetd)
root 776396 18.9 0.1 10.4M 6.8M pts/71 S + 12:07:49 1:52.61 top
root 525359 0.5 0.0 2.71M 192K ?? S 07:44:37 1:06.44
/usr/sbin/syslogd -e
root 524598 0.2 0.0 3.98M 664K ?? S 07:44:23 0:16.68
/usr/sbin/evmd
root 525500 0.1 0.0 4.72M 496K ?? S 07:44:46 0:01.82
/usr/sbin/gated -f /etc/gated.conf.member1
root 524649 0.1 0.0 2.91M 272K ?? S 07:44:24 0:14.09
/usr/sbin/evmlogger -o /var/run/evmlogger.info -l /var/evm/adm/logfile
s/evmlogger.log
noboom2 784499 0.0 0.0 2.87M 368K console I <+ 12:15:14 0:00.01 awk
-F: {print $6}
g3at64 782199 0.0 0.0 0K 0K ?? < - 0:00.00
<defunct>
sa7563 780536 0.0 0.0 0K 0K ?? < - 0:00.00
<defunct>
root 780343 0.0 0.0 2.30M 264K console U <+ 12:15:14 0:00.13 grep
^noboom2: /etc/passwd
root 777353 0.0 0.0 0K 0K ?? < - 0:00.00
<defunct>
root 785343 0.0 0.1 10.6M 8.0M pts/69 R <+ 12:16:13 0:00.15 ps
auxwwww
root 544771 0.0 0.0 3.13M 600K ?? S 07:47:31 0:00.35
/usr/sbin/rdginit
root 544764 0.0 0.0 2.59M 192K ?? I 07:47:31 0:00.00
/usr/sbin/clu_wall -d
root 544758 0.0 0.0 2.96M 360K ?? I 07:47:31 0:00.02
/usr/sbin/rpc.lockd -c
root 544754 0.0 0.0 2.84M 328K ?? I 07:47:31 0:00.02
/usr/sbin/rpc.statd -c
root 544709 0.0 0.1 9.55M 3.3M ?? S 07:47:31 0:00.70
/usr/opt/java118/bin/../bin/alpha/native_threads/java -mx2m authentica
tion/server/AuthenticationServer
root 544521 0.0 0.0 4.84M 800K ?? S 07:47:26 0:00.37
/usr/opt/networker/bin/nsrexecd
root 544520 0.0 0.0 4.84M 824K ?? S 07:47:26 0:00.10
/usr/opt/networker/bin/nsrexecd
root 526137 0.0 0.0 3.03M 312K ?? I 07:44:55 0:00.22
/usr/lbin/lpd
root 526119 0.0 0.0 2.23M 240K ?? S 07:44:55 0:07.42 comsat
root 526077 0.0 0.0 4.23M 224K ?? S 07:44:54 0:03.38
/usr/sbin/cron
root 526050 0.0 0.0 2.23M 144K ?? I 07:44:53 0:00.04 -RAD1
child (inetd)
root 526048 0.0 0.0 2.14M 96K ?? I 07:44:53 0:00.01
/usr/sbin/inetd
root 526010 0.0 0.0 3.22M 336K ?? S < 07:44:53 0:00.18
/usr/sbin/xntpd -c /etc/ntp.conf
root 525525 0.0 0.0 7.66M 1.4M ?? S 07:44:47 0:12.10
/usr/sbin/prpasswdd
root 525524 0.0 0.0 4.88M 328K ?? S 07:44:47 0:00.04
/usr/sbin/prpasswdd
root 525484 0.0 0.0 19.0M 1.3M ?? S 07:44:46 0:09.21
/usr/sbin/caad -0
root 525481 0.0 0.0 0K 0K ?? U 07:44:45 0:00.55
[icssvr_daemon_pe]
root 525479 0.0 0.0 2.75M 272K ?? S 07:44:45 0:00.66
/usr/sbin/portmap
root 525471 0.0 0.0 2.70M 312K ?? I 07:44:45 0:00.02
aliasd_niff
root 525469 0.0 0.0 2.79M 200K ?? I 07:44:44 0:00.05 aliasd
root 525363 0.0 0.0 4.54M 1.2M ?? I 07:44:37 0:00.11
/usr/sbin/binlogd
root 525323 0.0 0.0 2.64M 176K ?? I 07:44:28 0:00.03
/usr/sbin/niffd
root 524650 0.0 0.0 2.62M 328K ?? I 07:44:24 0:00.06
/usr/sbin/evmchmgr -l /var/evm/adm/logfiles/evmchmgr.log
root 524482 0.0 0.0 2.02M 120K ?? I 07:44:20 0:21.66
/sbin/update
root 524471 0.0 0.0 2.88M 392K ?? I 07:44:19 0:00.06
/usr/sbin/esmd
root 524384 0.0 0.0 4.91M 1.3M ?? S 07:43:34 0:03.88
/sbin/vold -k
root 524327 0.0 0.0 2.98M 440K ?? S 07:43:27 0:00.02
/sbin/hotswapd
root 524325 0.0 0.0 1.66M 1.1M ?? I 07:43:27 0:00.10
/sbin/kloadsrv
root 524307 0.0 0.0 0K 0K ?? U 07:43:18 0:00.01
[icssvr_daemon_pe]
root 524306 0.0 0.0 0K 0K ?? U 07:43:18 0:00.02
[icssvr_daemon_fr]
root 524305 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[icssvr_daemon_fr]
root 524304 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[icssvr_daemon_pe]
root 524303 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[icssvr_daemon_pe]
root 524302 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00 [CFS
daemon]
root 524301 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[icssvr_daemon_fr]
root 524300 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[icssvr_daemon_fr]
root 524299 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[icssvr_daemon_fr]
root 524298 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[icssvr_daemon_fr]
root 524297 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[icssvr_daemon_fr]
root 524296 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[icscli_throttle_]
root 524295 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[icssvr_nanny]
root 524294 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[icssvr_daemon_fr]
root 524293 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[icssvr_daemon_fr]
root 524292 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[icssvr_throttle_]
root 524291 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[icssvr_nomem_dae]
root 524290 0.0 0.0 0K 0K ?? U 07:43:18 0:00.00
[kproc_creator_da]
root 524289 0.0 0.0 520K 32K ?? SL 07:43:24 0:10.38
/sbin/init -a



This archive was generated by hypermail 2.1.7 : Sat Apr 12 2008 - 10:49:08 EDT