From: De Smaele Kim (Kim.DeSmaele@bpo.be)
Date: Thu Oct 25 2007 - 08:57:12 EDT
Hi guru's,
I have a very strange issue with VXDMP and VXVM.
I replaced a storage array (clariion replaced by hds) connected to a
Solaris 8 2/4, configured with vxvm and vxdmp 3.5.
The intention is to use raid 1 hostbased mirroring. On solaris I can see
my both path's, I verified the zoning and the assigned luns on the
array.
However, in vxvm, I'm unable to setup the raid 1 mirrors (see data and
vxdg adddisk errors below).
Have a look at the vxdmp enclosure list, I don't realy like the output.
I already restarted the vxdmp restore deamon with check_all and
check_disabled, and the usual storage drill (devfsadm, cfgadm configure,
luxadm forcelip, ...).
I wonder, what would happen if I delete array info from
/etc/vx/array.info with afterwards running devfsadm ; cfgadm configure ;
vxdctl enable vxdmpadm start restore with check_all policy. However, I
don't think this would be a wise idea.
I'm not able to reboot the system before 18h00.
Tips and tricks are welcome.
Cheers,
Kim
PS. There is production running with storage on controller c1 or
enclosure name cx500
root@solcta:/root> luxadm -e port
Found path to 3 HBA ports
/devices/pci@8,700000/SUNW,qlc@5/fp@0,0:devctl
CONNECTED
/devices/pci@8,600000/SUNW,qlc@2/fp@0,0:devctl
CONNECTED
/devices/pci@9,700000/SUNW,qlc@4/fp@0,0:devctl
CONNECTED
root@solcta:/root>
Qlogic dual port hba is c4:
root@solcta:/root> cfgadm -al
Ap_Id Type Receptacle Occupant
Condition
SBa cpu/mem connected configured ok
SBa::memory memory connected configured ok
SBb cpu/mem connected configured ok
SBb::memory memory connected configured ok
SBc cpu/mem connected unconfigured ok
SBd cpu/mem connected unconfigured ok
c0 scsi-bus connected configured
unknown
c0::/dev/lus unknown connected configured
unknown
c0::dsk/c0t6d0 CD-ROM connected configured
unknown
c1 fc-private connected configured
unknown
c1::21000004cfc2781a disk connected configured
unknown
c1::2100000c50ebb01d disk connected configured
unknown
c1::2100000c50ebb1ab disk connected configured
unknown
c1::2100000c50ebc4a4 disk connected configured
unknown
c1::21000011c6bd1312 disk connected configured
unknown
c1::500000e0134e7b11 disk connected configured
unknown
c1::50800200001f0290 ESI connected configured
unknown
c3 fc-fabric connected configured
unknown
c3::50060169302048bd disk connected configured
unknown
c4 fc-fabric connected configured
unknown
c4::50060e801002a912 disk connected configured
unknown
c4::50060e801002a916 disk connected configured
unknown
pcisch0:hpc1_slot0 fibre/hp connected configured ok
pcisch0:hpc1_slot1 pci-pci/hp connected configured ok
pcisch0:hpc1_slot2 unknown empty unconfigured
unknown
pcisch0:hpc1_slot3 unknown empty unconfigured
unknown
pcisch2:hpc2_slot4 fibre/hp connected configured ok
pcisch2:hpc2_slot5 unknown empty unconfigured
unknown
pcisch2:hpc2_slot6 unknown empty unconfigured
unknown
pcisch3:hpc0_slot7 unknown empty unconfigured
unknown
pcisch3:hpc0_slot8 fibre/hp connected configured ok
root@solcta:/root>
root@solcta:/root> luxadm display /dev/rdsk/c4t50060E801002A916d5s2
DEVICE PROPERTIES for disk: /dev/rdsk/c4t50060E801002A916d5s2
Status(Port A): O.K.
Vendor: HITACHI
Product ID: DF600F
WWN(Node): 50060e801002a912
WWN(Port A): 50060e801002a912
Revision: 0000
Serial Num: 770108970011
Unformatted capacity: 184320.000 MBytes
Read Cache: Enabled
Minimum prefetch: 0x0
Maximum prefetch: 0x0
Device Type: Disk device
Path(s):
/dev/rdsk/c4t50060E801002A912d5s2
/devices/pci@9,700000/SUNW,qlc@4/fp@0,0/ssd@w50060e801002a912,5:c,raw
/dev/rdsk/c4t50060E801002A916d5s2
/devices/pci@9,700000/SUNW,qlc@4/fp@0,0/ssd@w50060e801002a916,5:c,raw
root@solcta:/root>
root@solcta:/etc/vx> vxdisk list
DEVICE TYPE DISK GROUP STATUS
cx500_0 sliced cx500_1 datadg online
cx500_1 sliced cx500_2 datadg online
cx500_2 sliced cx500_3 datadg online
cx500_3 sliced cx500_4 datadg online
cx500_4 sliced cx500_5 datadg online
cx500_5 sliced cx500_6 datadg online
cx500_6 sliced cx500_7 datadg online
cx500_7 sliced cx500_8 datadg online
cx500_8 sliced cx500_9 datadg online
cx500_9 sliced cx500_10 datadg online
cx500_10 sliced cx500_11 datadg online
cx500_11 sliced cx500_0 datadg online
c1t0d0s2 sliced - - error
c1t1d0s2 sliced - - error
c1t2d0s2 sliced - - error
c1t3d0s2 sliced - - error
c1t4d0s2 sliced rootdisk rootdg online
c1t5d0s2 sliced rootmirror rootdg online
fabric_0 sliced fabric_0 testdg online
fabric_1 sliced fabric_1 testdg online
fabric_2 sliced fabric_2 testdg online
fabric_3 sliced fabric_3 testdg online
fabric_4 sliced - - online
fabric_5 sliced - - online
fabric_6 sliced - - online
fabric_7 sliced - - online
fabric_8 sliced - - online
fabric_9 sliced - - online
fabric_10 sliced - - online
fabric_11 sliced - - online
fabric_12 sliced - - online
fabric_13 sliced - - online
fabric_14 sliced - - online
fabric_15 sliced - - online
fabric_16 sliced - - online
fabric_17 sliced - - online
fabric_18 sliced - - online
fabric_19 sliced - - online
fabric_20 sliced - - online
fabric_21 sliced - - online
fabric_22 sliced - - online
fabric_23 sliced - - online
root@solcta:/etc/vx>
root@solcta:/etc/vx> vxdg init testdg fabric_0
root@solcta:/etc/vx> vxdg -g testdg adddisk fabric_1
root@solcta:/etc/vx> vxdg -g testdg adddisk fabric_2
root@solcta:/etc/vx> vxdg -g testdg adddisk fabric_3
root@solcta:/etc/vx> vxdg -g testdg adddisk fabric_12
vxvm:vxdg: ERROR: Device fabric_12 appears to be owned by disk group
testdg.
root@solcta:/etc/vx> vxdg -g testdg adddisk fabric_13
vxvm:vxdg: ERROR: Device fabric_13 appears to be owned by disk group
testdg.
root@solcta:/etc/vx> vxdg -g testdg adddisk fabric_14
vxvm:vxdg: ERROR: Device fabric_14 appears to be owned by disk group
testdg.
root@solcta:/etc/vx> vxdisk list fabric_0
Device: fabric_0
devicetag: fabric_0
type: sliced
hostid:
disk: name= id=1193309514.11923.solcta
group: name= id=
flags: online ready private autoconfig autoimport
pubpaths: block=/dev/vx/dmp/fabric_0s4 char=/dev/vx/rdmp/fabric_0s4
privpaths: block=/dev/vx/dmp/fabric_0s3 char=/dev/vx/rdmp/fabric_0s3
version: 2.2
iosize: min=512 (bytes) max=2048 (blocks)
public: slice=4 offset=0 len=377318400
private: slice=3 offset=1 len=38143
update: time=1193310019 seqno=0.6
headers: 0 248
configs: count=1 len=28130
logs: count=1 len=4262
Defined regions:
config priv 000017-000247[000231]: copy=01 offset=000000 enabled
config priv 000249-028147[027899]: copy=01 offset=000231 enabled
log priv 028148-032409[004262]: copy=01 offset=000000 enabled
Multipathing information:
numpaths: 1
c4t50060E801002A912d11s2 state=enabled
root@solcta:/etc/vx> vxdisk list fabric_12
Device: fabric_12
devicetag: fabric_12
type: sliced
hostid: solcta
disk: name= id=1193309514.11923.solcta
group: name=testdg id=1193316467.12012.solcta
flags: online ready private autoconfig autoimport
pubpaths: block=/dev/vx/dmp/fabric_12s4 char=/dev/vx/rdmp/fabric_12s4
privpaths: block=/dev/vx/dmp/fabric_12s3 char=/dev/vx/rdmp/fabric_12s3
version: 2.2
iosize: min=512 (bytes) max=2048 (blocks)
public: slice=4 offset=0 len=377318400
private: slice=3 offset=1 len=38143
update: time=1193316468 seqno=0.8
headers: 0 248
configs: count=1 len=28130
logs: count=1 len=4262
Defined regions:
config priv 000017-000247[000231]: copy=01 offset=000000 enabled
config priv 000249-028147[027899]: copy=01 offset=000231 enabled
log priv 028148-032409[004262]: copy=01 offset=000000 enabled
Multipathing information:
numpaths: 1
c4t50060E801002A916d11s2 state=enabled
root@solcta:/etc/vx>
root@solcta:/root> vxdmpadm listctlr all
CTLR-NAME ENCLR-TYPE STATE ENCLR-NAME
=====================================================
c1 Disk ENABLED Disk
c3 EMC_CLARiiON ENABLED cx500
c4 EMC_CLARiiON DISABLED cx500
c1 OTHER_DISKS ENABLED OTHER_DISKS
c4 OTHER_DISKS ENABLED OTHER_DISKS
root@solcta:/root>
root@solcta:/root> vxdmpadm listenclosure all
ENCLR_NAME ENCLR_TYPE ENCLR_SNO STATUS
============================================================
Disk Disk DISKS CONNECTED
OTHER_DISKS OTHER_DISKS OTHER_DISKS CONNECTED
oldcx500 EMC_CLARiiON 36415351333030363131 DISCONNECTED
cx500 EMC_CLARiiON 6ASQ300611 CONNECTED
cx3-20 EMC_CLARiiON CK200062100335 DISCONNECTED
root@solcta:/root>
root@solcta:/root> vxdmpadm getsubpaths ctlr=c4
NAME STATE PATH-TYPE DMPNODENAME ENCLR-TYPE
ENCLR-NAME
======================================================================
NONAME DISABLED SECONDARY cx500_0 EMC_CLARiiON cx500
NONAME DISABLED SECONDARY cx500_1 EMC_CLARiiON cx500
NONAME DISABLED SECONDARY cx500_2 EMC_CLARiiON cx500
NONAME DISABLED SECONDARY cx500_3 EMC_CLARiiON cx500
NONAME DISABLED SECONDARY cx500_4 EMC_CLARiiON cx500
NONAME DISABLED SECONDARY cx500_5 EMC_CLARiiON cx500
NONAME DISABLED PRIMARY cx500_6 EMC_CLARiiON cx500
NONAME DISABLED PRIMARY cx500_7 EMC_CLARiiON cx500
NONAME DISABLED PRIMARY cx500_8 EMC_CLARiiON cx500
NONAME DISABLED PRIMARY cx500_9 EMC_CLARiiON cx500
NONAME DISABLED PRIMARY cx500_10 EMC_CLARiiON cx500
NONAME DISABLED PRIMARY cx500_11 EMC_CLARiiON cx500
c4t50060E801002A912d11s2 ENABLED - fabric_0
OTHER_DISKS OTHER_DISKS
c4t50060E801002A912d10s2 ENABLED - fabric_1
OTHER_DISKS OTHER_DISKS
c4t50060E801002A912d9s2 ENABLED - fabric_2 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A912d8s2 ENABLED - fabric_3 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A912d7s2 ENABLED - fabric_4 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A912d6s2 ENABLED - fabric_5 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A912d5s2 ENABLED - fabric_6 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A912d4s2 ENABLED - fabric_7 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A912d3s2 ENABLED - fabric_8 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A912d2s2 ENABLED - fabric_9 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A912d1s2 ENABLED - fabric_10 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A912d0s2 ENABLED - fabric_11 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A916d11s2 ENABLED - fabric_12
OTHER_DISKS OTHER_DISKS
c4t50060E801002A916d10s2 ENABLED - fabric_13
OTHER_DISKS OTHER_DISKS
c4t50060E801002A916d9s2 ENABLED - fabric_14 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A916d8s2 ENABLED - fabric_15 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A916d7s2 ENABLED - fabric_16 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A916d6s2 ENABLED - fabric_17 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A916d5s2 ENABLED - fabric_18 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A916d4s2 ENABLED - fabric_19 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A916d3s2 ENABLED - fabric_20 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A916d2s2 ENABLED - fabric_21 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A916d1s2 ENABLED - fabric_22 OTHER_DISKS
OTHER_DISKS
c4t50060E801002A916d0s2 ENABLED - fabric_23 OTHER_DISKS
OTHER_DISKS
root@solcta:/root>
root@solcta:/etc/vx> cat array.info
DISKS
Disk
0
Disk
OTHER_DISKS
OTHER_DISKS
0
OTHER_DISKS
36415351333030363131000000000000
oldcx500
0
EMC_CLARiiON
6ASQ300611
cx500
0
EMC_CLARiiON
CK200062100335
cx3-20
0
EMC_CLARiiON
root@solcta:/etc/vx>
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers
This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:42:27 EDT