From: Eric Deblon (eric@deblon.org)
Date: Wed Feb 13 2008 - 14:36:18 EST
Hello Guru's,
I have a machine with two InfiniBand ports ibd0 and ibd1.
# ifconfig -a
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu
8232 index 1
inet 127.0.0.1 netmask ff000000
e1000g0: flags=201100843<UP,BROADCAST,RUNNING,MULTICAST,ROUTER,IPv4,CoS>
mtu 1500 index 2
inet 10.100.100.16 netmask ffff0000 broadcast 10.100.255.255
ether 0:4:23:d9:96:10
ibd0: flags=201100843<UP,BROADCAST,RUNNING,MULTICAST,ROUTER,IPv4,CoS>
mtu 2044 index 3
inet 192.168.102.16 netmask ffffff00 broadcast 192.168.102.255
ipib 0:0:4:8:fe:80:0:0:0:0:0:0:0:8:f1:4:3:98:91:39
ibd1: flags=201100843<UP,BROADCAST,RUNNING,MULTICAST,ROUTER,IPv4,CoS>
mtu 2044 index 4
inet 192.168.102.21 netmask ffffff00 broadcast 192.168.102.255
ipib 0:0:4:9:fe:80:0:0:0:0:0:0:0:8:f1:4:3:98:91:3a
lo0: flags=2002000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv6,VIRTUAL> mtu
8252 index 1
inet6 ::1/128
The same iscsi target disk is visible throught both paths.
# iscsiadm list target -S
Target: iqn.2003-03.com.qdomain:disk1
Alias: -
TPGT: 1
ISID: 4000002a0001
Connections: 1
LUN: 0
Vendor: IET
Product: VIRTUAL-DISK
OS Device Name: /dev/rdsk/c3t2d0s2
Target: iqn.2003-03.com.qdomain:disk1
Alias: -
TPGT: 1
ISID: 4000002a0000
Connections: 1
LUN: 0
Vendor: IET
Product: VIRTUAL-DISK
OS Device Name: /dev/rdsk/c3t1d0s2
# format
Searching for disks...done
AVAILABLE DISK SELECTIONS:
0. c1d0 <DEFAULT cyl 38910 alt 2 hd 255 sec 63>
/pci@0,0/pci-ide@1f,2/ide@0/cmdk@0,0
1. c1d1 <WDC WD32- WD-WCAPD323815-0001-298.09GB>
/pci@0,0/pci-ide@1f,2/ide@0/cmdk@1,0
2. c2d0 <DEFAULT cyl 37606 alt 2 hd 255 sec 63>
/pci@0,0/pci-ide@1f,2/ide@1/cmdk@0,0
3. c2d1 <WDC WD32- WD-WCAPD324298-0001-298.09GB>
/pci@0,0/pci-ide@1f,2/ide@1/cmdk@1,0
4. c3t1d0 <DEFAULT cyl 2044 alt 2 hd 128 sec 32>
/iscsi/disk@0000iqn.2003-03.com.qdomain%3Adisk10001,0
5. c3t2d0 <DEFAULT cyl 2044 alt 2 hd 128 sec 32>
/iscsi/disk@0001iqn.2003-03.com.qdomain%3Adisk10001,0
Specify disk (enter its number):
MPxIO is enabled.
# grep mpxio /kernel/drv/fp.conf /kernel/drv/iscsi.conf
/kernel/drv/fp.conf:# mpxio-disable property. Setting mpxio-disable="no"
will activate
/kernel/drv/fp.conf:# I/O multipathing; setting mpxio-disable="yes"
disables the feature.
/kernel/drv/fp.conf:# Global mpxio-disable property:
/kernel/drv/fp.conf:# mpxio-disable="no";
/kernel/drv/fp.conf:# mpxio-disable="yes";
/kernel/drv/fp.conf:# Per port mpxio-disable property:
/kernel/drv/fp.conf:# name="fp" parent="/pci@8,600000/SUNW,qlc@4" port=0
mpxio-disable="yes";
/kernel/drv/fp.conf:mpxio-disable="no";
/kernel/drv/iscsi.conf:# mpxio-disable property. Setting
mpxio-disable="no" will activate
/kernel/drv/iscsi.conf:# I/O multipathing; setting mpxio-disable="yes"
disables the feature.
/kernel/drv/iscsi.conf:# Global mpxio-disable property:
/kernel/drv/iscsi.conf:# mpxio-disable="no";
/kernel/drv/iscsi.conf:# mpxio-disable="yes";
/kernel/drv/iscsi.conf:mpxio-disable="no";
# devfsadm -Cv
# mpathadm list lu
It does not work. I cannot have those two disks under mpxio control or
at least, mpxio does not show anything.
So I have added those three lines to the file /kernel/drv/scsi_vhci.conf
and then rebooted the machine. And it respects (at least I hope) the
picky format 8+16 char.
# cat /kernel/drv/scsi_vhci.conf
...
device-type-scsi-options-list =
"IET VIRTUAL-DISK ", "symmetric-option";
symmetric-option = 0x1000000;
...
But nothing changes...
mpathadm does not even show the modification.
# mpathadm show mpath-support libmpscsi_vhci.so | grep IET
I suspect something going wrong in /kernel/drv/scsi_vhci.conf, but what?
Thank you all,
Kind regards,
Eric Deblon
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers
This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:42:46 EDT