Message: Panic[cpu0] Sunfire 280r

From: dirstein@iinet.net.au
Date: Thu Apr 07 2005 - 01:47:12 EDT

Next message: john@nemean.com: "Sun Hostid"
Previous message: Burtenshaw, Craig: "SUMMARY: Samba Errors"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ] [ attachment ]

My Sunfire (SunOs sesame 5.8 Generic_108528-27 sun4u sparc SUNW, Sun-Fire-
280R) has for the last year been operating without problems. This week
(Tuesday) the computer "sesame" 'hung'. We could not rlogin to the machine and
the terminal attached to sesame was also unresponsive.

I following message was visible on the terminal screen"
#
Syncing File system ... done
dumping to /dev/dsk/c1t0d0s3 offset 1678704640 95% done
panic [cpu0]/ thread=2a10004bd20:BAD TRAP: type=34 rp=10423290
addr=3000ald53f9 0 dump aborted : plse record to above information panic
[cpu0]/thread=2a100004bd20:BAD TRAP: type=31 rp=10422730 addr=3000000000030 0
dump aborted : plse record to above information panic
[cpu0]/thread=2a100004bd20:BAD TRAP: type=31 rp=10421ab0 addr=3000000000030
panic [cpu0]/thread=2a100004bd20:BAD TRAP: type=31 rp=10420e30
addr=3000000000030 panic [cpu0]/thread=2a100004bd20:BAD TRAP: type=31
rp=10420e30 addr=3000000000030 panic [cpu0]/thread=2a100004bd20:BAD TRAP:
type=31 rp=104201b0 addr=3000000000030
#

I then manually turned the computer 'on' and 'off' using power
switch. 'sesame' appeared to come back OK.

Today.Thursday.. "sesame" hangs as it did on Tuesday.

Todays messages:
#
..panic [cpu0]/thread=2a10006bd20:BAD TRAP: type=31 rp=10422c90
addr=30fcfdc3220 0 Rebooting with command: boot Boot device : /pci@8,
600000/sunw, glc@4/fp@0, 0/disk@w 500000e010425271, 0:a File a corrected ECC
Error
#
However today the system comes back in single user mode ie. 'ok' prompt.

I tried the "Boot " command, however this repeats the last message and does
not work. Once again I had to turn system on and off using power switch.

System comes back fine and is currently functional.

As we have not installed any new software, hardware or patches recently, I
suspect we have an issue with a CPU0 or a scsi transport.

I have attached output from
'dmesg'
'pkginfo'
'pkginfo -l'
which may offer additional insights.

Any suggests on how best to identify the source of the problem would be
appreciated.

Regards,

Jim D
dmesg

Thu Apr 7 13:00:33 WST 2005
Mar 15 13:29:26 sesame nfs: [ID 563706 kern.notice] NFS server seistor ok
Mar 15 13:31:47 sesame nfs: [ID 333984 kern.notice] NFS server seistor not responding still trying
Mar 15 13:31:47 sesame nfs: [ID 563706 kern.notice] NFS server seistor ok
Mar 15 13:31:47 sesame nfs: [ID 333984 kern.notice] NFS server seistor not responding still trying
Mar 15 13:31:47 sesame nfs: [ID 563706 kern.notice] NFS server seistor ok
Mar 17 13:53:07 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6,1 (glm1):
Mar 17 13:53:07 sesame Cmd (0x3ccaf58) dump for Target 5 Lun 0:
Mar 17 13:53:07 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6,1 (glm1):
Mar 17 13:53:07 sesame cdb=[ 0x8 0x0 0x0 0x4e 0x20 0x0 ]
Mar 17 13:53:07 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6,1 (glm1):
Mar 17 13:53:07 sesame pkt_flags=0x0 pkt_statistics=0x61 pkt_state=0x7
Mar 17 13:53:07 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6,1 (glm1):
Mar 17 13:53:07 sesame pkt_scbp=0x0 cmd_flags=0x8e1
Mar 17 13:53:07 sesame scsi: [ID 107833 kern.warning] WARNING: /pci@8,700000/scsi@6,1 (glm1):
Mar 17 13:53:07 sesame Disconnected command timeout for Target 5.0
Mar 17 13:53:07 sesame genunix: [ID 408822 kern.info] NOTICE: glm1: fault detected in device; service still available
Mar 17 13:53:07 sesame genunix: [ID 611667 kern.info] NOTICE: glm1: Disconnected command timeout for Target 5.0
Mar 17 13:53:07 sesame glm: [ID 160360 kern.warning] WARNING: ID[SUNWpd.glm.cmd_timeout.6016]
Mar 17 13:53:07 sesame scsi: [ID 107833 kern.warning] WARNING: /pci@8,700000/scsi@6,1/st@5,0 (st12):
Mar 17 13:53:07 sesame SCSI transport failed: reason 'timeout': giving up
Mar 17 14:44:47 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6,1 (glm1):
Mar 17 14:44:47 sesame Cmd (0x3cca628) dump for Target 5 Lun 0:
Mar 17 14:44:47 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6,1 (glm1):
Mar 17 14:44:47 sesame cdb=[ 0x8 0x0 0x0 0x20 0x30 0x0 ]
Mar 17 14:44:47 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6,1 (glm1):
Mar 17 14:44:47 sesame pkt_flags=0x0 pkt_statistics=0x61 pkt_state=0x7
Mar 17 14:44:47 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6,1 (glm1):
Mar 17 14:44:47 sesame pkt_scbp=0x0 cmd_flags=0x8e1
Mar 17 14:44:47 sesame scsi: [ID 107833 kern.warning] WARNING: /pci@8,700000/scsi@6,1 (glm1):
Mar 17 14:44:47 sesame Disconnected command timeout for Target 5.0
Mar 17 14:44:47 sesame genunix: [ID 408822 kern.info] NOTICE: glm1: fault detected in device; service still available
Mar 17 14:44:47 sesame genunix: [ID 611667 kern.info] NOTICE: glm1: Disconnected command timeout for Target 5.0
Mar 17 14:44:47 sesame glm: [ID 160360 kern.warning] WARNING: ID[SUNWpd.glm.cmd_timeout.6016]
Mar 17 14:44:47 sesame scsi: [ID 107833 kern.warning] WARNING: /pci@8,700000/scsi@6,1/st@5,0 (st12):
Mar 17 14:44:47 sesame SCSI transport failed: reason 'timeout': giving up
Mar 17 14:58:27 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6,1 (glm1):
Mar 17 14:58:27 sesame Cmd (0x3cca938) dump for Target 5 Lun 0:
Mar 17 14:58:27 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6,1 (glm1):
Mar 17 14:58:27 sesame cdb=[ 0x8 0x0 0x0 0x20 0x30 0x0 ]
Mar 17 14:58:27 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6,1 (glm1):
Mar 17 14:58:27 sesame pkt_flags=0x0 pkt_statistics=0x61 pkt_state=0x7
Mar 17 14:58:27 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6,1 (glm1):
Mar 17 14:58:27 sesame pkt_scbp=0x0 cmd_flags=0x8e1
Mar 17 14:58:27 sesame scsi: [ID 107833 kern.warning] WARNING: /pci@8,700000/scsi@6,1 (glm1):
Mar 17 14:58:27 sesame Disconnected command timeout for Target 5.0
Mar 17 14:58:27 sesame genunix: [ID 408822 kern.info] NOTICE: glm1: fault detected in device; service still available
Mar 17 14:58:27 sesame genunix: [ID 611667 kern.info] NOTICE: glm1: Disconnected command timeout for Target 5.0
Mar 17 14:58:27 sesame glm: [ID 160360 kern.warning] WARNING: ID[SUNWpd.glm.cmd_timeout.6016]
Mar 17 14:58:27 sesame scsi: [ID 107833 kern.warning] WARNING: /pci@8,700000/scsi@6,1/st@5,0 (st12):
Mar 17 14:58:27 sesame SCSI transport failed: reason 'timeout': giving up
Apr 5 15:23:51 sesame genunix: [ID 540533 kern.notice] ^MSunOS Release 5.8 Version Generic_108528-27 64-bit
Apr 5 15:23:51 sesame genunix: [ID 913632 kern.notice] Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
Apr 5 15:23:51 sesame genunix: [ID 678236 kern.info] Ethernet address = 0:3:ba:33:a0:f0
Apr 5 15:23:51 sesame krtld: [ID 469452 kern.info] NOTICE: sf: 64-bit driver module not found
Apr 5 15:23:51 sesame unix: [ID 389951 kern.info] mem = 6291456K (0x180000000)
Apr 5 15:23:51 sesame unix: [ID 930857 kern.info] avail mem = 6181085184
Apr 5 15:23:51 sesame rootnex: [ID 466748 kern.info] root nexus = Sun Fire 280R (2 X UltraSPARC-III+)
Apr 5 15:23:51 sesame rootnex: [ID 349649 kern.info] pcisch0 at root: SAFARI 0x8 0x700000
Apr 5 15:23:51 sesame genunix: [ID 936769 kern.info] pcisch0 is /pci@8,700000
Apr 5 15:23:51 sesame rootnex: [ID 349649 kern.info] pcisch1 at root: SAFARI 0x8 0x600000
Apr 5 15:23:51 sesame genunix: [ID 936769 kern.info] pcisch1 is /pci@8,600000
Apr 5 15:23:51 sesame qlc: [ID 486054 kern.info] Qlogic FCA Driver v0.40.5 (0): F/W version 2.01.112
Apr 5 15:23:52 sesame qlc: [ID 686697 kern.info] NOTICE: Qlogic qlc(0): Loop ONLINE
Apr 5 15:23:52 sesame pcisch: [ID 370704 kern.info] PCI-device: SUNW,qlc@4, qlc0
Apr 5 15:23:52 sesame genunix: [ID 936769 kern.info] qlc0 is /pci@8,600000/SUNW,qlc@4
Apr 5 15:23:52 sesame genunix: [ID 936769 kern.info] fp0 is /pci@8,600000/SUNW,qlc@4/fp@0,0
Apr 5 15:23:53 sesame scsi: [ID 799468 kern.info] ssd0 at fp0: name w500000e010425271,0, bus address ef
Apr 5 15:23:53 sesame genunix: [ID 936769 kern.info] ssd0 is /pci@8,600000/SUNW,qlc@4/fp@0,0/ssd@w500000e010425271,0
Apr 5 15:23:53 sesame scsi: [ID 365881 kern.info] <SUN72G cyl 14087 alt 2 hd 24 sec 424>
Apr 5 15:23:53 sesame genunix: [ID 408114 kern.info] /pci@8,600000/SUNW,qlc@4/fp@0,0/ssd@w500000e010425271,0 (ssd0) online
Apr 5 15:23:53 sesame scsi: [ID 799468 kern.info] ssd1 at fp0: name w500000e010428dd1,0, bus address e8
Apr 5 15:23:53 sesame genunix: [ID 936769 kern.info] ssd1 is /pci@8,600000/SUNW,qlc@4/fp@0,0/ssd@w500000e010428dd1,0
Apr 5 15:23:53 sesame scsi: [ID 365881 kern.info] <SUN72G cyl 14087 alt 2 hd 24 sec 424>
Apr 5 15:23:53 sesame genunix: [ID 408114 kern.info] /pci@8,600000/SUNW,qlc@4/fp@0,0/ssd@w500000e010428dd1,0 (ssd1) online
Apr 5 15:23:53 sesame swapgeneric: [ID 308332 kern.info] root on /pci@8,600000/SUNW,qlc@4/fp@0,0/disk@w500000e010425271,0:a fstype ufs
Apr 5 15:23:53 sesame pcisch: [ID 370704 kern.info] PCI-device: ebus@5, ebus0
Apr 5 15:23:53 sesame ebus: [ID 521012 kern.info] todds12870 at ebus0: offset 1,300070
Apr 5 15:23:53 sesame genunix: [ID 936769 kern.info] todds12870 is /pci@8,700000/ebus@5/rtc@1,300070
Apr 5 15:23:53 sesame rootnex: [ID 349649 kern.info] mc-us30 at root: SAFARI 0x0 0x400000 ...
Apr 5 15:23:53 sesame genunix: [ID 936769 kern.info] mc-us30 is /memory-controller@0,400000
Apr 5 15:23:53 sesame rootnex: [ID 349649 kern.info] mc-us31 at root: SAFARI 0x1 0x400000 ...
Apr 5 15:23:53 sesame genunix: [ID 936769 kern.info] mc-us31 is /memory-controller@1,400000
Apr 5 15:23:54 sesame ebus: [ID 521012 kern.info] se0 at ebus0: offset 1,400000
Apr 5 15:23:54 sesame genunix: [ID 936769 kern.info] se0 is /pci@8,700000/ebus@5/serial@1,400000
Apr 5 15:23:54 sesame unix: [ID 987524 kern.info] cpu0: SUNW,UltraSPARC-III+ (upaid 0 impl 0x15 ver 0xb0 clock 1200 MHz)
Apr 5 15:23:54 sesame unix: [ID 987524 kern.info] cpu1: SUNW,UltraSPARC-III+ (upaid 1 impl 0x15 ver 0xb0 clock 1200 MHz)
Apr 5 15:23:54 sesame unix: [ID 721127 kern.info] cpu 1 initialization complete - online
Apr 5 15:23:54 sesame ebus: [ID 521012 kern.info] su0 at ebus0: offset 1,3062f8
Apr 5 15:23:54 sesame genunix: [ID 936769 kern.info] su0 is /pci@8,700000/ebus@5/rsc-control@1,3062f8
Apr 5 15:23:54 sesame ebus: [ID 521012 kern.info] su1 at ebus0: offset 1,3083f8
Apr 5 15:23:54 sesame genunix: [ID 936769 kern.info] su1 is /pci@8,700000/ebus@5/rsc-console@1,3083f8
Apr 5 15:23:55 sesame pcisch: [ID 370704 kern.info] PCI-device: pci@2, pci_pci0
Apr 5 15:23:55 sesame genunix: [ID 936769 kern.info] pci_pci0 is /pci@8,700000/pci@2
Apr 5 15:23:57 sesame genunix: [ID 454863 kern.info] dump on /dev/dsk/c1t0d0s3 size 8004 MB
Apr 5 15:24:01 sesame pseudo: [ID 129642 kern.info] pseudo-device: devinfo0
Apr 5 15:24:01 sesame genunix: [ID 936769 kern.info] devinfo0 is /pseudo/devinfo@0
Apr 5 15:24:08 sesame genunix: [ID 408822 kern.info] NOTICE: ce0: no fault external to device; service available
Apr 5 15:24:08 sesame genunix: [ID 611667 kern.info] NOTICE: ce0: xcvr addr:0x01 - link up 1000 Mbps full duplex
Apr 5 15:24:39 sesame pseudo: [ID 129642 kern.info] pseudo-device: tod0
Apr 5 15:24:39 sesame genunix: [ID 936769 kern.info] tod0 is /pseudo/tod@0
Apr 5 15:24:39 sesame pseudo: [ID 129642 kern.info] pseudo-device: pm0
Apr 5 15:24:39 sesame genunix: [ID 936769 kern.info] pm0 is /pseudo/pm@0
Apr 5 15:24:41 sesame pseudo: [ID 129642 kern.info] pseudo-device: vol0
Apr 5 15:24:41 sesame genunix: [ID 936769 kern.info] vol0 is /pseudo/vol@0
Apr 5 15:24:42 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6 (glm0):
Apr 5 15:24:42 sesame glm0 supports power management.
Apr 5 15:24:42 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6 (glm0):
Apr 5 15:24:42 sesame Rev. 7 Symbios 53c875 found.
Apr 5 15:24:42 sesame pcisch: [ID 370704 kern.info] PCI-device: scsi@6, glm0
Apr 5 15:24:42 sesame genunix: [ID 936769 kern.info] glm0 is /pci@8,700000/scsi@6
Apr 5 15:24:42 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6,1 (glm1):
Apr 5 15:24:42 sesame glm1 supports power management.
Apr 5 15:24:42 sesame scsi: [ID 365881 kern.info] /pci@8,700000/scsi@6,1 (glm1):
Apr 5 15:24:42 sesame Rev. 7 Symbios 53c875 found.
Apr 5 15:24:42 sesame pcisch: [ID 370704 kern.info] PCI-device: scsi@6,1, glm1
Apr 5 15:24:42 sesame genunix: [ID 936769 kern.info] glm1 is /pci@8,700000/scsi@6,1
Apr 5 15:24:44 sesame scsi: [ID 193665 kern.info] sd6 at glm0: target 6 lun 0
Apr 5 15:24:44 sesame genunix: [ID 936769 kern.info] sd6 is /pci@8,700000/scsi@6/sd@6,0
Apr 5 15:24:59 sesame pseudo: [ID 129642 kern.info] pseudo-device: devinfo0
Apr 5 15:24:59 sesame genunix: [ID 936769 kern.info] devinfo0 is /pseudo/devinfo@0
Apr 5 15:24:59 sesame pcisch: [ID 370704 kern.info] PCI-device: usb@5,3, ohci0
Apr 5 15:24:59 sesame genunix: [ID 936769 kern.info] ohci0 is /pci@8,700000/usb@5,3
Apr 5 15:24:59 sesame genunix: [ID 107833 kern.warning] WARNING: Unexpected token '(ape' on line 25 of /kernel/drv/sgen.conf
Apr 5 15:24:59 sesame genunix: [ID 107833 kern.warning] WARNING: Unexpected token '0x04' on line 25 of /kernel/drv/sgen.conf
Apr 5 15:24:59 sesame genunix: [ID 107833 kern.warning] WARNING: Unexpected token ')x04' on line 25 of /kernel/drv/sgen.conf
Apr 7 09:09:20 sesame genunix: [ID 540533 kern.notice] ^MSunOS Release 5.8 Version Generic_108528-27 64-bit
Apr 7 09:09:20 sesame genunix: [ID 913632 kern.notice] Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
Apor patches recently, I
suspect we have an issue with a CPU0 or a scsi transport.

I have attached output from
'dmesg'
'pkginfo'
'pkginfo -l'
which may offer additional insights.

Any suggests on how best to identify the source of the problem would be
appreciated.

Regards,

Jim D
dmesg