SUMMARY: Sun Qlogic HBA + Compaq/HP SAN Switch Issues

From: Bruno S. Delbono (Bruno.S.Delbono@Mail.AC)
Date: Wed Mar 01 2006 - 20:38:54 EST


Hello folks,

I would like to thank Aaron Lineberger, Victor Harrison and others for
pointing me to the right direction. When I had initially sent this mail,
I had failed to specify exactly which HBA card I was using. Well, the
card I had was a Qlogic 2100F/66 HBA San Card.

Qlogic QLA2100F which doesn't support Fabric Mode...which
is why this wasn't working. After a "very" exhaustive research, I've
found that the T3 array always talks loop mode (which a switch can
handle properly), but more importantly it's the HBA card which needs to
talk Fabric Mode (or connect on the F_Port in order for proper switch
Fabric zoning to work). However, the Qlogic 2100F Card in the Netra T1
cannot do Fabric Mode...only Loop mode which is why this is not working.

However, the Qlogic 2100F Card in the Netra T1 cannot do Fabric
Mode...only Loop mode which is why this is not working. After the
switch firmware upgrade, I now can enable Quick Loop which should allow
me to connect these two devices. But, sadly, I need a license key for
Quick Loop. As this product is End-Of-Life...there is no key ;-) . The
only keys installed on the switch are for Fabric mode

So, the Solution (I chose #1, #2 is an alternative):

1) Replace the HBA card with one that does do Fabric mode via SAN...In
my case a Qlogic 2200F PCI Card. Once I put this in...everything started
working. The card cost me an extra $40 on ebay and it works like a charm..

dmesg:

....
Feb 25 13:37:42 san qla2200: [ID 857577 kern.notice] QLogic qla2200
Fibre Channel Driver v4.13.01 Instance: 0 Firmware v2.2.6
Feb 25 13:37:50 san qla2200: [ID 169035 kern.info] qla2200(0): Fibre
Channel Loop is Down (8013)
Feb 25 13:37:51 san qla2200: [ID 567540 kern.info] qla2200(0): Fibre
Channel Loop is Up (8014)
Feb 25 13:37:51 san qla2200: [ID 364886 kern.info]
qla2200-hba0-adapter-node-name="200000e08b0567b8";
Feb 25 13:37:51 san qla2200: [ID 358785 kern.info]
qla2200-hba0-adapter-port-name="210000e08b0567b8";
Feb 25 13:37:51 san qla2200: [ID 332924 kern.info]
qla2200-hba0-adapter-port-id="010100";
Feb 25 13:37:51 san qla2200: [ID 823690 kern.info]
qla2200-hba0-SCSI-target-id-1-fibre-channel-node-name="50020f20000043d4";
Feb 25 13:37:51 san qla2200: [ID 817589 kern.info]
qla2200-hba0-SCSI-target-id-1-fibre-channel-port-name="50020f23000043d4";
Feb 25 13:37:51 san qla2200: [ID 699766 kern.info]
qla2200-hba0-SCSI-target-id-1-port-id="0100e8";
Feb 25 13:37:51 san qla2200: [ID 418604 kern.info]
qla2200-hba0-SCSI-target-id-1-lun-0-enable;
Feb 25 13:37:51 san pci_pci: [ID 370704 kern.info] PCI-device: scsi@f,
qla22000
Feb 25 13:37:51 san genunix: [ID 936769 kern.info] qla22000 is
/pci@1f,0/pci@1/pci@1/scsi@f
....

-----------------------------------------------------------------------------
Host Name : san
OS Type : SunOS:sun4u
OS Version : 5.9
FO API Version : 1.4.9.0 qlfoapi.a
SDM API Version : 3.07
-----------------------------------------------------------------------------
0 - QLA/QCP/QSB22xx OS: 0 WWPN: 21-00-00-E0-8B-05-67-B8 SN: D74887 FW:
2.2.6 IP
-----------------------------------------------------------------------------
Total QLogic HBA(s) : 1

==== HBA General Information =====================

-----------------------------------------------------------------------------
Host Name : san
HBA Number : 0
OS Instance : 0
HBA Model : QLA/QCP/QSB 22xx
HBA Node Name : 20-00-00-E0-8B-05-67-B8
HBA Port Name : 21-00-00-E0-8B-05-67-B8
HBA Port ID : 01-01-00
Serial Number : D74887
Driver Version : 4.13.01
FCode Version : 0.0
Firmware Version : 2.2.6 IP
Device Target Count : 1
Actual Connection Mode : Point to Point
Actual Data Rate : 1 Gbps
PortType (Topology) : FPort
HBA Status : Online

==== HBA NVRAM Settings Information ==============

-----------------------------------------------------------------------------
QLogic HBA 0 - QLA/QCP/QSB22xx OS: 0 WWPN: 21-00-00-E0-8B-05-67-B8
-----------------------------------------------------------------------------
Connection Options : 2 - Loop Preferred, Otherwise Point-to-Point
Frame Size : 1024
Hard Loop ID : 0
Loop Reset Delay (seconds) : 5
Enable Hard Loop ID : Disabled
Enable FC Tape Support : Enabled
Execution Throttle : 16
Enable Extended Error Logging: Disabled
Login Retry Count : 8
Enable LIP Reset : Disabled
Port Down Retry Count : 8
Enable LIP Full Login : Enabled
Link Down Timeout (seconds) : 60
Enable Target Reset : Disabled
LUNs Per Target : 8
Link Down Error : Enabled
Fast Error Reporting : Disabled

==== Attached Devices/LUNs Information ===========

-----------------------------------------------------------------------------
QLogic HBA 0 - QLA/QCP/QSB22xx OS: 0 WWPN: 21-00-00-E0-8B-05-67-B8
-----------------------------------------------------------------------------
Path : 0
Target : 1
Device ID : 0x01
Port ID : 01-00-E8
Product Vendor : SUN
Product ID : T300
Product Revision : 0118
Node Name : 50-02-0F-20-00-00-43-D4
Port Name : 50-02-0F-23-00-00-43-D4
Product Type : Disk
Number of LUN(s) : 1
Status : Online
-----------------------------------------------------------------------------
Product Vendor : SUN
Product ID : T300
Product Revision : 0118
LUN : 0
Size : 303.50 GB
WWULN :
60-02-0F-20-00-00-43-D4-43-FD-DE-9C-00-0A-AE-1B

==== Target Persistent Binding Information =======

No target persistent data found on HBA 0.

==== Selective LUNs Information ==================

==== Boot Device Information =====================

-----------------------------------------------------------------------------
QLogic HBA 0 - QLA/QCP/QSB22xx OS: 0 WWPN: 21-00-00-E0-8B-05-67-B8
-----------------------------------------------------------------------------
Primary Boot Device Information:
--------------------------------------
Selectable Boot: Disabled
--------------------------------------
Device Node Name Device Port Name Device ID LUN ID
----------------------- ----------------------- --------- ------
00-00-00-00-00-00-00-00 00-00-00-00-00-00-00-00 0 0

==== Driver Settings Information =================

-----------------------------------------------------------------
QLogic HBA 0 - QLA/QCP/QSB22xx OS: 0 WWPN: 21-00-00-E0-8B-05-67-B8
-----------------------------------------------------------------
-----------------------------------
Driver Settings - Group: Persistent
-----------------------------------
Present targets that are persistently bound plus any new target(s) :
Enable
Present targets that are persistently bound Only :
Disable
--------------------------------
Driver Settings - Group: Binding
--------------------------------
Bind by World Wide Port Name: Enable
Bind by Port ID : Disable

                 Press <Enter> to continue:

root bdelbono # format
Searching for disks...done

AVAILABLE DISK SELECTIONS:
        0. c0t0d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
           /pci@1f,0/pci@1,1/scsi@2/sd@0,0
        1. c0t1d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>
           /pci@1f,0/pci@1,1/scsi@2/sd@1,0
        2. c4t1d0 <SUN-T300-0118 cyl 34530 alt 2 hd 144 sec 128> T3-Blue
           /pci@1f,0/pci@1/pci@1/scsi@f/sd@1,0
Specify disk (enter its number): ^D
root bdelbono # cfgadm -al
Ap_Id Type Receptacle Occupant Condition
c0 scsi-bus connected configured unknown
c0::dsk/c0t0d0 disk connected configured unknown
c0::dsk/c0t1d0 disk connected configured unknown
c1 scsi-bus connected configured unknown
c1::dsk/c1t2d0 CD-ROM connected configured unknown

root bdelbono # prtdiag -v
System Configuration: Sun Microsystems sun4u Netra t1 (UltraSPARC-IIi
360MHz)
System clock frequency: 90 MHz
Memory size: 320 Megabytes
-----------------------------------------------------------------------------

========================= CPUs =========================

                     Run Ecache CPU CPU
Brd CPU Module MHz MB Impl. Mask
--- --- ------- ----- ------ ------ ----
  0 0 0 360 1.0 12 9.1

========================= IO Cards =========================

      Bus# Freq
Brd Type MHz Slot Name Model
--- ---- ---- ---- --------------------------------
----------------------
  0 PCI-1 33 1 ebus

  0 PCI-1 33 1 network-SUNW,hme

  0 PCI-1 33 2 scsi-glm Symbios,53C875

  0 PCI-1 33 3 network-SUNW,hme

  0 PCI-2 33 1 pci-pci1011,22

No failures found in System
===========================

========================= HW Revisions =========================

ASIC Revisions:
---------------
Cheerio: ebus Rev 1

System PROM revisions:
----------------------
   OBP 3.10.27 2000/06/22 16:45 POST 1.17.0 2000/03/06 12:18

root bdelbono # uname -a
SunOS san 5.9 Generic_118558-22 sun4u sparc SUNW,UltraSPARC-IIi-cEngine

---------------------------------------------------------------------------
Switch Information Report for san
---------------------------------------------------------------------------

List of Switches
Switch ID Worldwide Name Enet IP Addr FC IP Addr Name
-------------------------------------------------------------------------
   1: fffc01 10:00:00:60:69:30:1a:b9 10.10.33.199 0.0.0.0 >"san"

Ethernet IP Address: 10.10.33.199
Ethernet Subnetmask: 255.255.255.0
Fibre Channel IP Address: none
Fibre Channel Subnetmask: none
Gateway Address: 10.10.33.1

Kernel: 5.4
Fabric OS: v2.6.2c
Made on: Wed Jan 26 15:08:33 PST 2005
Flash: Wed Jan 26 15:09:13 PST 2005
BootProm: Wed Sep 22 13:48:55 PDT 1999

List of Inter-Switch Links
Local Domain ID: 1

Local Port Domain Remote Port State
-------------------------------------------------------

List of Ports
switchName: san
switchType: 4.1
switchState: Online
switchMode: Native
switchRole: Principal
switchDomain: 1
switchId: fffc01
switchWwn: 10:00:00:60:69:30:1a:b9
switchBeacon: ON
Zoning: ON (sancfg)
port 0: sw Online L-Port 1 private, 2 phantom
port 1: sw Online F-Port 21:00:00:e0:8b:05:67:b8
port 2: sw No_Light
port 3: sw No_Light
port 4: sw No_Light
port 5: sw No_Light
port 6: sw No_Light
port 7: -- No_Module

Name Server
{
   0100e8 010100
2 Nx_Ports in the Fabric }

{
  Type Pid COS PortName NodeName
TTL(sec)
  NL 0100e8; 3;50:02:0f:23:00:00:43:d4;50:02:0f:20:00:00:43:d4; na
     FC4s: FCP [SUN T300 0118]
     Fabric Port Name: 20:00:00:60:69:30:1a:b9
  N 010100; 3;21:00:00:e0:8b:05:67:b8;20:00:00:e0:8b:05:67:b8; na
     FC4s: FCP
     Fabric Port Name: 20:01:00:60:69:30:1a:b9

The Local Name Server has 2 entries }

Zoning Information
Defined configuration:
  cfg: sancfg zone
  zone: zone alias
  alias: alias 50:02:0f:23:00:00:43:d4; 21:00:00:e0:8b:05:67:b8

Effective configuration:
  cfg: sancfg
  zone: zone Protocol:ALL
                50:02:0f:23:00:00:43:d4
                21:00:00:e0:8b:05:67:b8

GBIC Serial ID Information
port 0: sw
port 1: sw
port 2: sw
port 3: sw
port 4: sw
port 5: sw
port 6: sw
port 7: --

---------------------------------------------------------------------------

2) A second solution is to use a FC-AL Hub instead of a switch. This
should get around the problem as it would do L_port rather than a Fabric
  port/mode.

Thanks again everyone.

Warm Regards,

--
Bruno Delbono
Open-Systems Group
http://www.open-systems.org/users/bruno/
Bruno S. Delbono wrote:
> Hi Gurus,
> 
> I need some help and promise that I'll summarize. I recently acquired 
> two used Storedge T3 (9 x 36 GB FC-AL), a Netra T1 with a QLogic (ifp0) 
> SAN HBA card and a Compaq/HP 1 GB/s 8-EL Switch [*]. I am running 
> Solaris 9 on the server and have installed SAN 4.4.8 for Solaris 9.
> 
> I've created a raid 0 volume on the T3 and if I connect the T3 directly 
> to the Netra's SAN HBA card...I can see my new volume/disk. So...this 
> works (using FC-AL loop).
> 
> BUT, if I connect the T3 and the netra to the Fiber Switch, Solaris 
> cannot see the disk. Here's what I get in /var/adm/messages (tons of 
> these).
> 
> Feb 23 18:32:46 san scsi: [ID 243001 kern.info] 
> /pci@1f,0/pci@1/pci@1/SUNW,ifp@f (ifp0):
> Feb 23 18:32:46 san     Loop reconfigure in progress
> Feb 23 18:32:46 san scsi: [ID 243001 kern.warning] WARNING: 
> /pci@1f,0/pci@1/pci@1/SUNW,ifp@f (ifp0):
> Feb 23 18:32:46 san     mbox cmd failed for alpa: 0xef, rval: 0x4006
> Feb 23 18:32:46 san scsi: [ID 243001 kern.info] 
> /pci@1f,0/pci@1/pci@1/SUNW,ifp@f (ifp0):
> Feb 23 18:32:46 san     Unable to allocate target structure for switch 
> setting 0
> Feb 23 18:32:46 san     reason: Unable to get port database
> 
> Here's the uname -a:
> 
> SunOS san 5.9 Generic_117171-07 sun4u sparc SUNW,UltraSPARC-IIi-cEngine
> 
> The switch can see both the Netra's SAN card "and" the T3. I've created 
> the a zone with both their WWN's but for some reason I keep getting 
> these errors and am unable to see the disk.
> 
> PS - This is a Fabric Switch. Do I need cfgadm -al to configure it (if I 
> can around this problem)? Or do I need luxadm insert?
> 
> I've spent a lot of time going over reports on sunsolve, hp.com's 
> support but I have come up with zilch. I don't understand why this works 
> directly but fails to work. Here's a screenshot in case it helps.
> 
> http://www.open-systems.org/users/bruno/SANerror.JPG
> 
> I would sincerely appreciate any help. Better yet, IOU a beer if you can 
> help me figure this out.
> 
> [*] - 
> http://h20000.www2.hp.com/bizsupport/TechSupport/Home.jsp?&lang=en&cc=us&prodTypeId=12169&prodSeriesId=311232&lang=en&cc=us
> 
> Thanks again
> 
> Warm Regards,
> 
> --
> Bruno Delbono
> Open-Systems Group
> http://www.open-systems.org/users/bruno/
> _______________________________________________
> sunmanagers mailing list
> sunmanagers@sunmanagers.org
> http://www.sunmanagers.org/mailman/listinfo/sunmanagers
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers


This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:39:10 EDT