mpxio (io multipathing) question

From: Andrey Dmitriev (admitriev@mentora.com)
Date: Wed Sep 05 2007 - 01:50:45 EDT


Dear Sun Managers,

Following sun documentation I have gotten mpxio to work with my NexSAN
SATABeast. I have originally configured it with 2 10Disk RAID5 LUNs so I
could stripe on them via ZFS. I have determined from IO tests that I am
getting best performance with mirror caching disabled, while writing to
two LUNs (I haven't striped across them yet, so I could be testing). Of
course, in real life, I'll probably want to enable mirror caching, as it
seems with a controller failure I risk to lose the whole file system
(which is going to be used for D2D backups). It seems, however,
counter-intuitive to me that IO goes to different controllers in
Round-Robin, as each controller in turn writes to different sets of
disks in round robin.

Am I out of my mind, or should I 'somehow' configure each disk to have a
preferential path, and disable RR? The 'somehow' part is very foggy to
me, as I couldn't really find good docs on this.

I have also looked into HBAnywhere (this is a Qlogic QLE2462 4Gbps dual
port card), but it doesn't look like I can do 'failover' across ports,
probably need another card.

The setup is
hostFibrePort0->switchA->arrayController0port0
hostFibrePort1->switchB->arrayController1port1

Docs followed:
http://docs.sun.com/source/819-0139/ch_4_config_multi_SW.html
http://docs.sun.com/source/819-0139/ch_3_admin_multi_devices.html

This was format prior to MPXIO

       1. c4t5000402102FC424Fd0 <NEXSAN-SATABeast-Gj60-8.19TB>

/pci@0,0/pci10de,5d@e/pci1077,143@0/fp@0,0/disk@w5000402102fc424f,0
       2. c4t5000402102FC424Fd1 <NEXSAN-SATABeast-Gj60-8.19TB>

/pci@0,0/pci10de,5d@e/pci1077,143@0/fp@0,0/disk@w5000402102fc424f,1
       3. c5t5000402202FC424Fd0 <NEXSAN-SATABeast-Gj60-8.19TB>

/pci@0,0/pci10de,5d@e/pci1077,143@0,1/fp@0,0/disk@w5000402202fc424f,0
       4. c5t5000402202FC424Fd1 <NEXSAN-SATABeast-Gj60-8.19TB>

mpathadm list lu
        /dev/rdsk/c7t6000402002FC424F6CE7A40C00000000d0s2
                Total Path Count: 2
                Operational Path Count: 2
        /dev/rdsk/c7t6000402002FC424F6CE7BB9400000000d0s2
                Total Path Count: 2
                Operational Path Count: 2

IO testing
213MB dd to single LUN RR (no mirror cache)
300MB dd to two LUNs RR (combined)
enable mirror cache
236MB dd to two LUNs RR (combined)
disable RR
172MB dd to two LUNs no RR (combined)
enable RR
238MB dd to two LUNs RR (combined)
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers



This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:42:17 EDT