Unable to add new metadatabase-devices. System will not accept th em.

From: daniel.bergman@seb.se
Date: Tue Apr 22 2003 - 11:46:46 EDT


Hi,

I'm having huge problems adding new metadatabase-devices. Somehow the system
will not accept the new ones as seen below.
What am I doing wrong? The system will not go up upon reboot, complaining
that less than 51% of meta replicas are available.
So, it seems like the system will not accept the new replicas.

I suppose I could set md:mirrored_root_flag=1 in /etc/system to get around
this but that's not a solution to the real problem - that the new replicas
are not accepted.

The current replicas are located on IDE-disks while the new ones are located
on SCSI-disks. This shouldn't be a problem - should it?

I've also noticed that while I'm running 32-bit kernel both the 32 and
64-bit Solstice DiskSuite drivers are installed. Could this cause problems?

Regards,
Daniel Bergman

[/root]
[root@prdlog(PRDLOG)]>cat /etc/release
                        Solaris 8 1/01 s28s_u3wos_08 SPARC
           Copyright 2000 Sun Microsystems, Inc. All Rights Reserved.
                           Assembled 28 November 2000
                     Solaris 8 Maintenance Update 6 applied
[/root]
[root@prdlog(PRDLOG)]>

[root@prdlog(PRDLOG)]>pkginfo -l SUNWmdx SUNWmdu SUNWmdr
   PKGINST: SUNWmdr
      NAME: Solstice DiskSuite Drivers
  CATEGORY: system
      ARCH: sparc
   VERSION: 4.2.1,REV=1999.12.03.10.00
   BASEDIR: /
    VENDOR: Sun Microsystems, Inc.
      DESC: Solstice DiskSuite Drivers
    PSTAMP: 11/04/99-18:30:51
  INSTDATE: Mar 31 2003 15:21
    VSTOCK: 258-6252-11
   HOTLINE: Please contact your local service provider
    STATUS: completely installed
     FILES: 28 installed pathnames
                   7 shared pathnames
                   8 directories
                  11 executables
                1027 blocks used (approx)

   PKGINST: SUNWmdu
      NAME: Solstice DiskSuite Commands
  CATEGORY: system
      ARCH: sparc
   VERSION: 4.2.1,REV=1999.11.04.18.29
   BASEDIR: /
    VENDOR: Sun Microsystems, Inc.
      DESC: Solstice DiskSuite Commands
    PSTAMP: 11/04/99-18:31:00
  INSTDATE: Mar 31 2003 15:21
    VSTOCK: 258-6252-11
   HOTLINE: Please contact your local service provider
    STATUS: completely installed
     FILES: 59 installed pathnames
                   8 shared pathnames
                  12 directories
                  21 executables
               12892 blocks used (approx)

   PKGINST: SUNWmdx
      NAME: Solstice DiskSuite Drivers(64-bit)
  CATEGORY: system
      ARCH: sparc
   VERSION: 4.2.1,REV=1999.11.04.18.29
   BASEDIR: /
    VENDOR: Sun Microsystems, Inc.
      DESC: Solstice DiskSuite Drivers(64-bit)
    PSTAMP: 11/04/99-18:31:26
  INSTDATE: Mar 31 2003 15:21
    VSTOCK: 258-6252-11
   HOTLINE: Please contact your local service provider
    STATUS: completely installed
     FILES: 13 installed pathnames
                   5 shared pathnames
                   5 directories
                   8 executables
                1348 blocks used (approx)

[/root]
[root@prdlog(PRDLOG)]>isainfo -kv
32-bit sparc kernel modules
[/root]
[root@prdlog(PRDLOG)]>

--- Console message while booting ---

Sun Ultra 5/10 UPA/PCI (UltraSPARC-IIi 440MHz), No Keyboard
OpenBoot 3.25, 256 MB (50 ns) memory installed, Serial #15189956.
Ethernet address 8:0:20:e7:c7:c4, Host ID: 80e7c7c4.

Rebooting with command: boot
Boot device: disk File and args:
SunOS Release 5.8 Version Generic_108528-15 32-bit
Copyright 1983-2001 Sun Microsystems, Inc. All rights reserved.
WARNING: forceload of misc/md_trans failed
WARNING: forceload of misc/md_raid failed
WARNING: forceload of misc/md_hotspares failed
configuring IPv4 interfaces: hme0.
Hostname: prdlog
The system is coming up. Please wait.
Setting /dev/arp arp_cleanup_interval to 60000
Setting /dev/ip ip_forward_directed_broadcasts to 0
Setting /dev/ip ip_forward_src_routed to 0
Setting /dev/ip ip_ignore_redirect to 1
Setting /dev/ip ip_respond_to_address_mask_broadcast to 0
Setting /dev/ip ip_respond_to_echo_broadcast to 0
Setting /dev/ip ip_respond_to_timestamp to 0
Setting /dev/ip ip_respond_to_timestamp_broadcast to 0
Setting /dev/ip ip_send_redirects to 0
Setting /dev/ip ip_strict_dst_multihoming to 1
Setting /dev/ip ip_def_ttl to 255
Setting /dev/tcp tcp_conn_req_max_q0 to 4096
Setting /dev/tcp tcp_conn_req_max_q to 1024
Setting /dev/tcp tcp_smallest_anon_port to 32768
Setting /dev/tcp tcp_largest_anon_port to 65535
Setting /dev/udp udp_smallest_anon_port to 32768
Setting /dev/udp udp_largest_anon_port to 65535
Setting /dev/tcp tcp_smallest_nonpriv_port to 1024
Setting /dev/udp udp_smallest_nonpriv_port to 1024
Setting /dev/ip ip_ire_arp_interval to 60000
Setting /dev/tcp tcp_extra_priv_ports_add to 6112
Setting /dev/tcp tcp_rev_src_routes to 0
Adding static routing entries
Starting NTP4...
syslog service starting.
starting audit daemon
Configured 235 kernel events.
Configured non-attributable events.
OpenSSH Daemon starting.
SSH Daemon starting.
The system is ready.

|-----------------------------------------------------------------|
| This system is for the use of authorized users only. |
| Individuals using this computer system without authority, or in |
| excess of their authority, are subject to having all of their |
| activities on this system monitored and recorded by system |
| personnel. |
| |
| In the course of monitoring individuals improperly using this |
| system, or in the course of system maintenance, the activities |
| of authorized users may also be monitored. |
| |
| Anyone using this system expressly consents to such monitoring |
| and is advised that if such monitoring reveals possible |
| evidence of criminal activity, system personnel may provide the |
| evidence of such monitoring to law enforcement officials. |
|-----------------------------------------------------------------|

prdlog console login: root
Password:
Apr 22 11:51:51 prdlog login: ROOT LOGIN /dev/console
Last login: Thu Apr 17 11:49:57 on console

|-----------------------------------------------------------------|
| This system is for the use of authorized users only. |
| Individuals using this computer system without authority, or in |
| excess of their authority, are subject to having all of their |
| activities on this system monitored and recorded by system |
| personnel. |
| |
| In the course of monitoring individuals improperly using this |
| system, or in the course of system maintenance, the activities |
| of authorized users may also be monitored. |
| |
| Anyone using this system expressly consents to such monitoring |
| and is advised that if such monitoring reveals possible |
| evidence of criminal activity, system personnel may provide the |
| evidence of such monitoring to law enforcement officials. |
|-----------------------------------------------------------------|

[root@prdlog(PRDLOG)]>metastat
d1: Mirror
    Submirror 0: d10
      State: Okay
    Submirror 1: d11
      State: Okay
    Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 8192016 blocks

d10: Submirror of d1
    State: Okay
    Size: 8192016 blocks
    Stripe 0:
        Device Start Block Dbase State Hot Spare
        c0t0d0s0 0 No Okay

d11: Submirror of d1
    State: Okay
    Size: 8192016 blocks
    Stripe 0:
        Device Start Block Dbase State Hot Spare
        c0t1d0s0 0 No Okay

d2: Mirror
    Submirror 0: d20
      State: Okay
    Submirror 1: d21
      State: Okay
    Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 2048256 blocks

d20: Submirror of d2
    State: Okay
    Size: 2048256 blocks
    Stripe 0:
        Device Start Block Dbase State Hot Spare
        c0t0d0s1 0 No Okay

d21: Submirror of d2
    State: Okay
    Size: 2048256 blocks
    Stripe 0:
        Device Start Block Dbase State Hot Spare
        c0t1d0s1 0 No Okay

d3: Mirror
    Submirror 0: d30
      State: Okay
    Submirror 1: d31
      State: Okay
    Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 4096512 blocks

d30: Submirror of d3
    State: Okay
    Size: 4096512 blocks
    Stripe 0:
        Device Start Block Dbase State Hot Spare
        c0t0d0s3 0 No Okay

d31: Submirror of d3
    State: Okay
    Size: 4096512 blocks
    Stripe 0:
        Device Start Block Dbase State Hot Spare
        c0t1d0s3 0 No Okay

d5: Mirror
    Submirror 0: d50
      State: Okay
    Submirror 1: d51
      State: Okay
    Pass: 1
    Read option: roundrobin (default)
    Write option: parallel (default)
    Size: 31457312 blocks

d50: Submirror of d5
    State: Okay
    Size: 31457312 blocks
    Stripe 0:
        Device Start Block Dbase State Hot Spare
        c1t3d0s0 0 No Okay

d51: Submirror of d5
    State: Okay
    Size: 31457312 blocks
    Stripe 0:
        Device Start Block Dbase State Hot Spare
        c1t5d0s0 0 No Okay

[/root]
[root@prdlog(PRDLOG)]>format
Searching for disks...done

AVAILABLE DISK SELECTIONS:
       0. c0t0d0 <ST39120A cyl 17660 alt 2 hd 16 sec 63>
          /pci@1f,0/pci@1,1/ide@3/dad@0,0
       1. c0t1d0 <ST39120A cyl 17660 alt 2 hd 16 sec 63>
          /pci@1f,0/pci@1,1/ide@3/dad@1,0
       2. c1t3d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
          /pci@1f,0/pci@1/scsi@1/sd@3,0
       3. c1t5d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
          /pci@1f,0/pci@1/scsi@1/sd@5,0
Specify disk (enter its number): 2
selecting c1t3d0
[disk formatted]

FORMAT MENU:
        disk - select a disk
        type - select (define) a disk type
        partition - select (define) a partition table
        current - describe the current disk
        format - format and analyze the disk
        repair - repair a defective sector
        label - write label to the disk
        analyze - surface analysis
        defect - defect list management
        backup - search for backup labels
        verify - read and display labels
        save - save new disk/partition definitions
        inquiry - show vendor, product and revision
        volname - set 8-character volume name
        !<cmd> - execute <cmd>, then return
        quit
format> p

PARTITION MENU:
        0 - change `0' partition
        1 - change `1' partition
        2 - change `2' partition
        3 - change `3' partition
        4 - change `4' partition
        5 - change `5' partition
        6 - change `6' partition
        7 - change `7' partition
        select - select a predefined table
        modify - modify a predefined partition table
        name - name the current table
        print - display the current table
        label - write partition map and label to the disk
        !<cmd> - execute <cmd>, then return
        quit
partition> p
Current partition table (original):
Total disk cylinders available: 7506 + 2 (reserved cylinders)

Part Tag Flag Cylinders Size Blocks
  0 unassigned wm 10 - 6685 15.00GB (6676/0/0) 31457312
  1 unassigned wm 0 0 (0/0/0) 0
  2 backup wu 0 - 7505 16.86GB (7506/0/0) 35368272
  3 unassigned wu 0 0 (0/0/0) 0
  4 unassigned wu 0 0 (0/0/0) 0
  5 unassigned wm 0 0 (0/0/0) 0
  6 unassigned wm 0 0 (0/0/0) 0
  7 unassigned wm 0 - 9 23.01MB (10/0/0) 47120

partition> label
Ready to label disk, continue? y

partition> q

FORMAT MENU:
        disk - select a disk
        type - select (define) a disk type
        partition - select (define) a partition table
        current - describe the current disk
        format - format and analyze the disk
        repair - repair a defective sector
        label - write label to the disk
        analyze - surface analysis
        defect - defect list management
        backup - search for backup labels
        verify - read and display labels
        save - save new disk/partition definitions
        inquiry - show vendor, product and revision
        volname - set 8-character volume name
        !<cmd> - execute <cmd>, then return
        quit
format> disk

AVAILABLE DISK SELECTIONS:
       0. c0t0d0 <ST39120A cyl 17660 alt 2 hd 16 sec 63>
          /pci@1f,0/pci@1,1/ide@3/dad@0,0
       1. c0t1d0 <ST39120A cyl 17660 alt 2 hd 16 sec 63>
          /pci@1f,0/pci@1,1/ide@3/dad@1,0
       2. c1t3d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
          /pci@1f,0/pci@1/scsi@1/sd@3,0
       3. c1t5d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
          /pci@1f,0/pci@1/scsi@1/sd@5,0
Specify disk (enter its number)[2]: 3
selecting c1t5d0
[disk formatted]
format> p

PARTITION MENU:
        0 - change `0' partition
        1 - change `1' partition
        2 - change `2' partition
        3 - change `3' partition
        4 - change `4' partition
        5 - change `5' partition
        6 - change `6' partition
        7 - change `7' partition
        select - select a predefined table
        modify - modify a predefined partition table
        name - name the current table
        print - display the current table
        label - write partition map and label to the disk
        !<cmd> - execute <cmd>, then return
        quit
partition> p
Current partition table (original):
Total disk cylinders available: 7506 + 2 (reserved cylinders)

Part Tag Flag Cylinders Size Blocks
  0 unassigned wm 10 - 6685 15.00GB (6676/0/0) 31457312
  1 unassigned wu 0 0 (0/0/0) 0
  2 backup wu 0 - 7505 16.86GB (7506/0/0) 35368272
  3 unassigned wu 0 0 (0/0/0) 0
  4 unassigned wu 0 0 (0/0/0) 0
  5 unassigned wu 0 0 (0/0/0) 0
  6 unassigned wu 0 0 (0/0/0) 0
  7 unassigned wm 0 - 9 23.01MB (10/0/0) 47120

partition> label
Ready to label disk, continue? y

partition> q

FORMAT MENU:
        disk - select a disk
        type - select (define) a disk type
        partition - select (define) a partition table
        current - describe the current disk
        format - format and analyze the disk
        repair - repair a defective sector
        label - write label to the disk
        analyze - surface analysis
        defect - defect list management
        backup - search for backup labels
        verify - read and display labels
        save - save new disk/partition definitions
        inquiry - show vendor, product and revision
        volname - set 8-character volume name
        !<cmd> - execute <cmd>, then return
        quit
format> q
[/root]
[root@prdlog(PRDLOG)]>

[/root]
[root@prdlog(PRDLOG)]>metadb
        flags first blk block count
     a m p luo 16 1034 /dev/dsk/c0t0d0s7
     a p luo 1050 1034 /dev/dsk/c0t0d0s7
     a p luo 2084 1034 /dev/dsk/c0t0d0s7
     a p luo 16 1034 /dev/dsk/c0t1d0s7
     a p luo 1050 1034 /dev/dsk/c0t1d0s7
     a p luo 2084 1034 /dev/dsk/c0t1d0s7

[root@prdlog(PRDLOG)]>tail -16 /etc/system
* Begin MDD root info (do not edit)
forceload: misc/md_trans
forceload: misc/md_raid
forceload: misc/md_hotspares
forceload: misc/md_stripe
forceload: misc/md_mirror
forceload: drv/pcipsy
forceload: drv/simba
forceload: drv/uata
forceload: drv/dad
rootdev:/pseudo/md@0:0,1,blk
* End MDD root info (do not edit)
* Begin MDD database info (do not edit)
set md:mddb_bootlist1="dad:7:16 dad:7:1050 dad:7:2084 dad:15:16 dad:15:1050"
set md:mddb_bootlist2="dad:15:2084"
* End MDD database info (do not edit)

[/root]
[root@prdlog(PRDLOG)]>metadb -a -c 3 /dev/rdsk/c1t3d0s7 /dev/rdsk/c1t5d0s7
[/root]
[root@prdlog(PRDLOG)]>metadb
        flags first blk block count
     a m p luo 16 1034 /dev/dsk/c0t0d0s7
     a p luo 1050 1034 /dev/dsk/c0t0d0s7
     a p luo 2084 1034 /dev/dsk/c0t0d0s7
     a p luo 16 1034 /dev/dsk/c0t1d0s7
     a p luo 1050 1034 /dev/dsk/c0t1d0s7
     a p luo 2084 1034 /dev/dsk/c0t1d0s7
     a u 16 1034 /dev/dsk/c1t3d0s7
     a u 1050 1034 /dev/dsk/c1t3d0s7
     a u 2084 1034 /dev/dsk/c1t3d0s7
     a u 16 1034 /dev/dsk/c1t5d0s7
     a u 1050 1034 /dev/dsk/c1t5d0s7
     a u 2084 1034 /dev/dsk/c1t5d0s7

[root@prdlog(PRDLOG)]>tail -16 /etc/system
forceload: misc/md_trans
forceload: misc/md_raid
forceload: misc/md_hotspares
forceload: misc/md_stripe
forceload: misc/md_mirror
forceload: drv/pcipsy
forceload: drv/simba
forceload: drv/uata
forceload: drv/dad
rootdev:/pseudo/md@0:0,1,blk
* End MDD root info (do not edit)
* Begin MDD database info (do not edit)
set md:mddb_bootlist1="dad:7:16 dad:7:1050 dad:7:2084 dad:15:16 dad:15:1050"
set md:mddb_bootlist2="dad:15:2084 sd:31:16 sd:31:1050 sd:31:2084 sd:47:16"
set md:mddb_bootlist3="sd:47:1050 sd:47:2084"
* End MDD database info (do not edit)

[/root]
[root@prdlog(PRDLOG)]>reboot
Apr 22 16:40:22 prdlog last message repeated 1 time
Apr 22 16:41:13 prdlog reboot: rebooted by root

|-----------------------------------------------------------------|
| This system is for the use of authorized users only. |
| Individuals using this computer system without authority, or in |
| excess of their authority, are subject to having all of their |
| activities on this system monitored and recorded by system |
| personnel. |
| |
| In the course of monitoring individuals improperly using this |
| system, or in the course of system maintenance, the activities |
| of authorized users may also be monitored. |
| |
| Anyone using this system expressly consents to such monitoring |
| and is advised that if such monitoring reveals possible |
| evidence of criminal activity, system personnel may provide the |
| evidence of such monitoring to law enforcement officials. |
|-----------------------------------------------------------------|

prdlog console login: syncing file systems... done
rebooting...
Resetting ...

|
z A few lines been accidentally removed ..
|

WARNING: forceload of misc/md_trans failed
WARNING: forceload of misc/md_raid failed
WARNING: forceload of misc/md_hotspares failed
configuring IPv4 interfaces: hme0.
Hostname: prdlog
metainit: prdlog: stale databases

Insufficient metadevice database replicas located.

Use metadb to delete databases which are broken.
Ignore any "Read-only file system" error messages.
Reboot the system when finished to reload the metadevice database.
After reboot, repair any broken database replicas which were deleted.

Type control-d to proceed with normal startup,
(or give root password for system maintenance):

single-user privilege assigned to /dev/console.
Entering System Maintenance Mode

Apr 22 16:43:58 su: 'su root' succeeded for root on /dev/console

|-----------------------------------------------------------------|
| This system is for the use of authorized users only. |
| Individuals using this computer system without authority, or in |
| excess of their authority, are subject to having all of their |
| activities on this system monitored and recorded by system |
| personnel. |
| |
| In the course of monitoring individuals improperly using this |
| system, or in the course of system maintenance, the activities |
| of authorized users may also be monitored. |
| |
| Anyone using this system expressly consents to such monitoring |
| and is advised that if such monitoring reveals possible |
| evidence of criminal activity, system personnel may provide the |
| evidence of such monitoring to law enforcement officials. |
|-----------------------------------------------------------------|

[root@prdlog(PRDLOG)]>metadb
        flags first blk block count
     a m p lu 16 1034 /dev/dsk/c0t0d0s7
     a p l 1050 1034 /dev/dsk/c0t0d0s7
     a p l 2084 1034 /dev/dsk/c0t0d0s7
     a p l 16 1034 /dev/dsk/c0t1d0s7
     a p l 1050 1034 /dev/dsk/c0t1d0s7
     a p l 2084 1034 /dev/dsk/c0t1d0s7
    M p unknown unknown /dev/dsk/c1t3d0s7
    M p unknown unknown /dev/dsk/c1t3d0s7
    M p unknown unknown /dev/dsk/c1t3d0s7
    M p unknown unknown /dev/dsk/c1t5d0s7
    M p unknown unknown /dev/dsk/c1t5d0s7
    M p unknown unknown /dev/dsk/c1t5d0s7
[/root]
[root@prdlog(PRDLOG)]>

--
Daniel Bergman        +46   8 639 30 39		
S|E|B IT Service      +46 70 289 30 39
Internet Application Services
daniel.bergman@seb.se 		    
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers


This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:26:14 EDT