From: Mouaz Alnouri (eng.moz@gmail.com)
Date: Sat Feb 09 2008 - 04:35:52 EST
Dear Managers,
A power failure has occurred to one of my servers, and the server is only
booting into single user mode..
I don't know what to do, please help...
Please find the log during the boot and some of my tries to fix the problem
attached to the mail
The server is sunfire V245 and the operating system in Solaris 9
Thanks,
--
Moz ...
sc> console -f
Warning: User <auto> currently has write permission to this console and forcibly removing them will terminate any current write actions and all work will be lost. Would you like to continue? [y/n]y
Enter #. to return to ALOM.
Done
0>Interrupt Crosscall.....Done
0>Init Memory.....Done
0>PLL Reset.....Done
0>Init Memory.....Done
0>Test Memory.....Done
0>Test CPU Caches.....Done
0>Functional CPU Tests.....Done
0>IO-Bridge Tests.....Done
0>INFO:
0> POST Passed all devices.
0>
0>POST: Return to OBP.
SC Alert: Host System has Reset
Configuring system memory & CPU(s)
Probing system devices
Probing memory
Probing I/O buses
screen not found.
keyboard not found.
Keyboard not present. Using ttya for input and output.
Probing system devices
Probing memory
Probing I/O buses
Sun Fire V245, No Keyboard
Copyright 2007 Sun Microsystems, Inc. All rights reserved.
OpenBoot 4.22.33, 4096 MB memory installed, Serial #78213874.
Ethernet address 0:14:4f:a9:72:f2, Host ID: 84a972f2.
Running diagnostic script obdiag/normal
Testing /ebus@1f,464000/serial@2,80
Testing /ebus@1f,464000/serial@2,40
Testing /ebus@1f,464000/flashprom@0,0
Testing /ebus@1f,464000/env-monitor@3,0
Initializing 1MB of memory at addr 127ff0a000 -
Initializing 1MB of memory at addr 127ff06000 -
Initializing 1MB of memory at addr 127ff00000 -
Initializing 1MB of memory at addr 127fee4000 -
Initializing 1MB of memory at addr 127fe90000 -
Initializing 1MB of memory at addr 127fdea000 -
Initializing 14MB of memory at addr 127f000000 -
Initializing 2032MB of memory at addr 1200000000 -
Initializing 1024MB of memory at addr 200000000 /
Initializing 1024MB of memory at addr 0 /
Probing system devices
Probing memory
Probing I/O buses
screen not found.
keyboard not found.
Keyboard not present. Using ttya for input and output.
Probing system devices
Probing memory
Probing I/O buses
Sun Fire V245, No Keyboard
Copyright 2007 Sun Microsystems, Inc. All rights reserved.
OpenBoot 4.22.33, 4096 MB memory installed, Serial #78213874.
Ethernet address 0:14:4f:a9:72:f2, Host ID: 84a972f2.
Initializing 1MB of memory at addr 127ff0a000 -
Initializing 1MB of memory at addr 127ff06000 -
Initializing 1MB of memory at addr 127ff00000 -
Initializing 1MB of memory at addr 127fee0000 -
Initializing 1MB of memory at addr 127fe90000 -
Initializing 1MB of memory at addr 127fdea000 -
Initializing 14MB of memory at addr 127f000000 -
Initializing 2032MB of memory at addr 1200000000 -
Initializing 1024MB of memory at addr 200000000 /
Initializing 1024MB of memory at addr 0 /
Rebooting with command: boot
Boot device: disk:a File and args:
SunOS Release 5.9 Version Generic_122300-13 64-bit
Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.
WARNING: /pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@2,0 (sd4):
Corrupt label; wrong magic number
WARNING: /pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@3,0 (sd5):
Corrupt label; wrong magic number
WARNING: forceload of misc/md_trans failed
WARNING: forceload of misc/md_raid failed
WARNING: forceload of misc/md_hotspares failed
WARNING: forceload of misc/md_sp failed
Hardware watchdog enabled
configuring IPv4 interfaces: bge0 bge1.
Hostname: jhgwy1
The /var file system (/dev/md/rdsk/d140) is being checked.
/dev/md/rdsk/d140: FRAGMENT 4375680 DUP I=4121 LFN 104
/dev/md/rdsk/d140: UNEXPECTED INCONSISTENCY; RUN fsck MANUALLY.
WARNING - Unable to repair the /var filesystem. Run fsck
manually (fsck -F ufs /dev/md/rdsk/d140). Exit the shell when
done to continue the boot process.
Type control-d to proceed with normal startup,
(or give root password for system maintenance):
single-user privilege assigned to /dev/console.
Entering System Maintenance Mode
Feb 9 11:42:22 su: 'su root' succeeded for root on /dev/console
Sun Microsystems Inc. SunOS 5.9 Generic May 2002
Sourcing //.profile-EIS.....
root@jhgwy1 #
root@jhgwy1 # echo | format
Searching for disks...WARNING: /pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@2,0 (sd4):
Corrupt label; wrong magic number
WARNING: /pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@2,0 (sd4):
Corrupt label; wrong magic number
WARNING: /pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@3,0 (sd5):
Corrupt label; wrong magic number
WARNING: /pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@3,0 (sd5):
Corrupt label; wrong magic number
done
c1t2d0: configured with capacity of 68.35GB
c1t3d0: configured with capacity of 68.35GB
AVAILABLE DISK SELECTIONS:
0. c1t0d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@0,0
1. c1t1d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@1,0
2. c1t2d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@2,0
3. c1t3d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@1e,600000/pci@0/pci@a/pci@0/pci@8/scsi@1/sd@3,0
Specify disk (enter its number): Specify disk (enter its number):
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 # metastat | more
d100: Mirror
Submirror 0: d101
State: Needs maintenance
Submirror 1: d102
State: Needs maintenance
Pass: 1
Read option: roundrobin (default)
Write option: parallel (default)
Size: 14683968 blocks (7.0 GB)
d101: Submirror of d100
State: Needs maintenance
Invoke: metasync d100
Size: 14683968 blocks (7.0 GB)
Stripe 0:
Device Start Block Dbase State Reloc Hot Spare
c1t0d0s0 0 No Okay Yes
d102: Submirror of d100
State: Needs maintenance
Invoke: metasync d100
Size: 14683968 blocks (7.0 GB)
Stripe 0:
Device Start Block Dbase State Reloc Hot Spare
c1t1d0s0 0 No Okay Yes
d150: Mirror
Submirror 0: d151
State: Needs maintenance
Submirror 1: d152
State: Needs maintenance
Pass: 1
Read option: roundrobin (default)
Write option: parallel (default)
Size: 14683968 blocks (7.0 GB)
d151: Submirror of d150
State: Needs maintenance
Invoke: metasync d150
Size: 14683968 blocks (7.0 GB)
Stripe 0:
Device Start Block Dbase State Reloc Hot Spare
c1t0d0s5 0 No Okay Yes
d152: Submirror of d150
State: Needs maintenance
Invoke: metasync d150
Size: 14683968 blocks (7.0 GB)
Stripe 0:
Device Start Block Dbase State Reloc Hot Spare
c1t1d0s5 0 No Okay Yes
d140: Mirror
Submirror 0: d141
State: Needs maintenance
Submirror 1: d142
State: Needs maintenance
Pass: 1
Read option: roundrobin (default)
Write option: parallel (default)
Size: 41945472 blocks (20 GB)
d141: Submirror of d140
State: Needs maintenance
Invoke: metasync d140
Size: 41945472 blocks (20 GB)
Stripe 0:
Device Start Block Dbase State Reloc Hot Spare
c1t0d0s4 0 No Okay Yes
d142: Submirror of d140
State: Needs maintenance
Invoke: metasync d140
Size: 41945472 blocks (20 GB)
Stripe 0:
Device Start Block Dbase State Reloc Hot Spare
c1t1d0s4 0 No Okay Yes
d130: Mirror
Submirror 0: d131
State: Needs maintenance
Submirror 1: d132
State: Needs maintenance
Pass: 1
Read option: roundrobin (default)
Write option: parallel (default)
Size: 56629440 blocks (27 GB)
d131: Submirror of d130
State: Needs maintenance
Invoke: metasync d130
Size: 56629440 blocks (27 GB)
Stripe 0:
Device Start Block Dbase State Reloc Hot Spare
c1t0d0s3 0 No Okay Yes
d132: Submirror of d130
State: Needs maintenance
Invoke: metasync d130
Size: 56629440 blocks (27 GB)
Stripe 0:
Device Start Block Dbase State Reloc Hot Spare
c1t1d0s3 0 No Okay Yes
d110: Mirror
Submirror 0: d111
State: Needs maintenance
Submirror 1: d112
State: Needs maintenance
Pass: 1
Read option: roundrobin (default)
Write option: parallel (default)
Size: 14683968 blocks (7.0 GB)
d111: Submirror of d110
State: Needs maintenance
Invoke: metasync d110
Size: 14683968 blocks (7.0 GB)
Stripe 0:
Device Start Block Dbase State Reloc Hot Spare
c1t0d0s1 0 No Okay Yes
d112: Submirror of d110
State: Needs maintenance
Invoke: metasync d110
Size: 14683968 blocks (7.0 GB)
Stripe 0:
Device Start Block Dbase State Reloc Hot Spare
c1t1d0s1 0 No Okay Yes
Device Relocation Information:
Device Reloc Device ID
c1t1d0 Yes id1,sd@w500000e017aa1550
c1t0d0 Yes id1,sd@w500000e0177d4da0
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 # newfs -N /dev/dsk/c1t0d0s2
/dev/rdsk/c1t0d0s2: 143349312 sectors in 14087 cylinders of 24 tracks, 424 sectors
69994.8MB in 1409 cyl groups (10 c/g, 49.69MB/g, 6016 i/g)
super-block backups (for fsck -F ufs -o b=#) at:
32, 102224, 204416, 306608, 408800, 510992, 613184, 715376, 817568, 919760,
Initializing cylinder groups:
...........................
super-block backups for last 10 cylinder groups at:
142372208, 142474400, 142576592, 142678784, 142780976, 142883168, 142985360,
143087552, 143189744, 143278112,
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 # newfs -N /dev/dsk/c1t0d0s4
/dev/rdsk/c1t0d0s4: 41945472 sectors in 4122 cylinders of 24 tracks, 424 sectors
20481.2MB in 413 cyl groups (10 c/g, 49.69MB/g, 6016 i/g)
super-block backups (for fsck -F ufs -o b=#) at:
32, 102224, 204416, 306608, 408800, 510992, 613184, 715376, 817568, 919760,
Initializing cylinder groups:
........
super-block backups for last 10 cylinder groups at:
41017520, 41119712, 41221904, 41324096, 41426288, 41528480, 41630672,
41732864, 41835056, 41937248,
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 # fsck -F ufs /dev/md/rdsk/d140
** /dev/md/rdsk/d140
** Last Mounted on /var
** Phase 1 - Check Blocks and Sizes
FRAGMENT 4375680 DUP I=4121 LFN 104
FRAGMENT 4375681 DUP I=4121 LFN 105
FRAGMENT 4375682 DUP I=4121 LFN 106
FRAGMENT 4375683 DUP I=4121 LFN 107
FRAGMENT 4375684 DUP I=4121 LFN 108
FRAGMENT 4375685 DUP I=4121 LFN 109
FRAGMENT 4375686 DUP I=4121 LFN 110
FRAGMENT 4375687 DUP I=4121 LFN 111
** Phase 1b - Rescan For More DUPS
FRAGMENT 4375680 DUP I=4121 LFN 96
FRAGMENT 4375681 DUP I=4121 LFN 97
FRAGMENT 4375682 DUP I=4121 LFN 98
FRAGMENT 4375683 DUP I=4121 LFN 99
FRAGMENT 4375684 DUP I=4121 LFN 100
FRAGMENT 4375685 DUP I=4121 LFN 101
FRAGMENT 4375686 DUP I=4121 LFN 102
FRAGMENT 4375687 DUP I=4121 LFN 103
FRAGMENT 4375680 DUP I=4121 LFN 104
FRAGMENT 4375681 DUP I=4121 LFN 105
FRAGMENT 4375682 DUP I=4121 LFN 106
FRAGMENT 4375683 DUP I=4121 LFN 107
FRAGMENT 4375684 DUP I=4121 LFN 108
FRAGMENT 4375685 DUP I=4121 LFN 109
FRAGMENT 4375686 DUP I=4121 LFN 110
FRAGMENT 4375687 DUP I=4121 LFN 111
** Phase 2 - Check Pathnames
DUP/BAD I=4121 OWNER=root MODE=100644
SIZE=180057 MTIME=Nov 23 10:58 2007
FILE=/adm/messages.3
REMOVE DIRECTORY ENTRY FROM I=76? no
** Phase 3a - Check Connectivity
** Phase 3b - Verify Shadows/ACLs
** Phase 4 - Check Reference Counts
LINK COUNT FILE I=4121 OWNER=root MODE=100644
SIZE=180057 MTIME=Nov 23 10:58 2007 COUNT 2 SHOULD BE 3
ADJUST? yes
** Phase 5 - Check Cylinder Groups
LIST REMAINING DUPS? yes
Some blocks that were found to be in multiple files are still
assigned to file(s).
Fragments sorted by inode and logical offsets:
Inode 4121:
Logical Offset 0x00018000 Physical Fragment 4375680
Logical Offset 0x00018800 Physical Fragment 4375682
Logical Offset 0x00019000 Physical Fragment 4375684
Logical Offset 0x00019800 Physical Fragment 4375686
Logical Offset 0x0001a000 Physical Fragment 4375680
Logical Offset 0x0001a800 Physical Fragment 4375682
Logical Offset 0x0001b000 Physical Fragment 4375684
Logical Offset 0x0001b800 Physical Fragment 4375686
WARNING: DATA LOSS MAY HAVE OCCURRED DUE TO DUP BLOCKS.
VERIFY FILE CONTENTS BEFORE USING.
FILESYSTEM MAY STILL BE INCONSISTENT.
8074 files, 199397 used, 20456132 free (1092 frags, 2556880 blocks, 0.0% fragmentation)
***** FILE SYSTEM WAS MODIFIED *****
***** FILE SYSTEM IS BAD *****
***** PLEASE RERUN FSCK *****
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 # fsck -F ufs /dev/md/rdsk/d140
** /dev/md/rdsk/d140
** Last Mounted on /var
** Phase 1 - Check Blocks and Sizes
FRAGMENT 4375680 DUP I=4121 LFN 104
FRAGMENT 4375681 DUP I=4121 LFN 105
FRAGMENT 4375682 DUP I=4121 LFN 106
FRAGMENT 4375683 DUP I=4121 LFN 107
FRAGMENT 4375684 DUP I=4121 LFN 108
FRAGMENT 4375685 DUP I=4121 LFN 109
FRAGMENT 4375686 DUP I=4121 LFN 110
FRAGMENT 4375687 DUP I=4121 LFN 111
** Phase 1b - Rescan For More DUPS
FRAGMENT 4375680 DUP I=4121 LFN 96
FRAGMENT 4375681 DUP I=4121 LFN 97
FRAGMENT 4375682 DUP I=4121 LFN 98
FRAGMENT 4375683 DUP I=4121 LFN 99
FRAGMENT 4375684 DUP I=4121 LFN 100
FRAGMENT 4375685 DUP I=4121 LFN 101
FRAGMENT 4375686 DUP I=4121 LFN 102
FRAGMENT 4375687 DUP I=4121 LFN 103
FRAGMENT 4375680 DUP I=4121 LFN 104
FRAGMENT 4375681 DUP I=4121 LFN 105
FRAGMENT 4375682 DUP I=4121 LFN 106
FRAGMENT 4375683 DUP I=4121 LFN 107
FRAGMENT 4375684 DUP I=4121 LFN 108
FRAGMENT 4375685 DUP I=4121 LFN 109
FRAGMENT 4375686 DUP I=4121 LFN 110
FRAGMENT 4375687 DUP I=4121 LFN 111
** Phase 2 - Check Pathnames
DUP/BAD I=4121 OWNER=root MODE=100644
SIZE=180057 MTIME=Nov 23 10:58 2007
FILE=/adm/messages.3
REMOVE DIRECTORY ENTRY FROM I=76? no
** Phase 3a - Check Connectivity
** Phase 3b - Verify Shadows/ACLs
** Phase 4 - Check Reference Counts
LINK COUNT FILE I=4121 OWNER=root MODE=100644
SIZE=180057 MTIME=Nov 23 10:58 2007 COUNT 3 SHOULD BE 4
ADJUST? yes
** Phase 5 - Check Cylinder Groups
LIST REMAINING DUPS? no
WARNING: DATA LOSS MAY HAVE OCCURRED DUE TO DUP BLOCKS.
VERIFY FILE CONTENTS BEFORE USING.
FILESYSTEM MAY STILL BE INCONSISTENT.
8074 files, 199397 used, 20456132 free (1092 frags, 2556880 blocks, 0.0% fragmentation)
***** FILE SYSTEM WAS MODIFIED *****
***** FILE SYSTEM IS BAD *****
***** PLEASE RERUN FSCK *****
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 # cd /var
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 # ls
root@jhgwy1 #
root@jhgwy1 #
root@jhgwy1 # pwd
/var
root@jhgwy1 #
root@jhgwy1 #
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers
This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:42:45 EDT