SVM multi-owner diskset problem under Sun cluster 3.1 Update 4

From: Tim Tse (cytse@asl.com.hk)
Date: Wed Feb 08 2006 - 21:56:23 EST


Hi Gurus,

We are installing Sun Cluster 3.1 Update 4 on Solaris 10 platform with Oracle
10g RAC. However, after installed the SC3.1 framework, UDLM and SVM. The
mulit-owner diskset cannot work properly.

The new problem is that:
if two nodes are up, then the multi-owner diskset can be access via two nodes.
But either one node is down, the remain node will lost its multi-owner diskset
membership, therefore it no longer can access the diskset (but the scstat
status is fine). As a result, both node can't work.

For example:
If node2 is down, node1 is up. Then multi-owner diskset membership of node1 is
lost.
If node1 is down, node2 is up. Then multi-owner diskset membership of node2 is
lost.
After both nodes become online again, the diskset will resume to normal and
can be access.

Below attached the output of normal status of scstat and metaset
------------------------------------------------------------------

-- Cluster Nodes --

Node name Status
--------- ------
Cluster node: node2 Online
Cluster node: node1 Online

------------------------------------------------------------------

-- Cluster Transport Paths --

Endpoint Endpoint Status
-------- -------- ------
Transport path: node2:qfe1 node1:qfe1 Path online
Transport path: node2:qfe0 node1:qfe0 Path online

------------------------------------------------------------------

-- Quorum Summary --

Quorum votes possible: 3
Quorum votes needed: 2
Quorum votes present: 3

-- Quorum Votes by Node --

Node Name Present Possible Status
--------- ------- -------- ------
Node votes: node2 1 1 Online
Node votes: node1 1 1 Online

-- Quorum Votes by Device --

Device Name Present Possible Status
----------- ------- -------- ------
Device votes: /dev/did/rdsk/d2s2 1 1 Online

------------------------------------------------------------------

-- Device Group Servers --

Device Group Primary Secondary
------------ ------- ---------

-- Device Group Status --

Device Group Status
------------ ------

-- Multi-owner Device Groups --

Device Group Online Status
------------ -------------
Multi-owner device group: racset node1,node2

------------------------------------------------------------------

-- Resource Groups and Resources --

Group Name Resources
---------- ---------
Resources: rac-rg rac-framework-rs rac-udlm-rs rac-svm-rs

-- Resource Groups --

Group Name Node Name State
---------- --------- -----
Group: rac-rg node1 Online
Group: rac-rg node2 Online

-- Resources --

Resource Name Node Name State Status Message
------------- --------- ----- --------------
Resource: rac-framework-rs node1 Online Online
Resource: rac-framework-rs node2 Online Online

Resource: rac-udlm-rs node1 Online Online
Resource: rac-udlm-rs node2 Online Online

Resource: rac-svm-rs node1 Online Online
Resource: rac-svm-rs node2 Online Online

------------------------------------------------------------------

-- IPMP Groups --

Node Name Group Status Adapter Status
--------- ----- ------ ------- ------
IPMP Group: node2 sc_ipmp0 Online hme1 Online
IPMP Group: node2 sc_ipmp0 Online hme0 Online

IPMP Group: node1 sc_ipmp0 Online hme1 Online
IPMP Group: node1 sc_ipmp0 Online hme0 Online

------------------------------------------------------------------
Multi-owner Set name = racset, Set number = 1, Master = node1

Host Owner Member
node1 multi-owner Yes
node2 multi-owner Yes

Mediator Host(s) Aliases
node1
node2

Driv Dbase

d2 Yes

------------------------------------------------------------------------

After shutdown node1, node2 remain running

-- Cluster Nodes --

Node name Status
--------- ------
Cluster node: node2 Online
Cluster node: node1 Offline

------------------------------------------------------------------

-- Cluster Transport Paths --

Endpoint Endpoint Status
-------- -------- ------
Transport path: node2:qfe1 node1:qfe1 faulted
Transport path: node2:qfe0 node1:qfe0 faulted

------------------------------------------------------------------

-- Quorum Summary --

Quorum votes possible: 3
Quorum votes needed: 2
Quorum votes present: 2

-- Quorum Votes by Node --

Node Name Present Possible Status
--------- ------- -------- ------
Node votes: node2 1 1 Online
Node votes: node1 0 1 Offline

-- Quorum Votes by Device --

Device Name Present Possible Status
----------- ------- -------- ------
Device votes: /dev/did/rdsk/d2s2 1 1 Online

------------------------------------------------------------------

-- Device Group Servers --

Device Group Primary Secondary
------------ ------- ---------

-- Device Group Status --

Device Group Status
------------ ------

-- Multi-owner Device Groups --

Device Group Online Status
------------ -------------
Multi-owner device group: racset node2

------------------------------------------------------------------

-- Resource Groups and Resources --

Group Name Resources
---------- ---------
Resources: rac-rg rac-framework-rs rac-udlm-rs rac-svm-rs

-- Resource Groups --

Group Name Node Name State
---------- --------- -----
Group: rac-rg node1 Offline
Group: rac-rg node2 Online

-- Resources --

Resource Name Node Name State Status Message
------------- --------- ----- --------------
Resource: rac-framework-rs node1 Offline Offline
Resource: rac-framework-rs node2 Online Online

Resource: rac-udlm-rs node1 Offline Offline
Resource: rac-udlm-rs node2 Online Online

Resource: rac-svm-rs node1 Offline Offline
Resource: rac-svm-rs node2 Online Online

------------------------------------------------------------------

-- IPMP Groups --

Node Name Group Status Adapter Status
--------- ----- ------ ------- ------
IPMP Group: node2 sc_ipmp0 Online hme1 Online
IPMP Group: node2 sc_ipmp0 Online hme0 Online

------------------------------------------------------------------

Multi-owner Set name = racset, Set number = 1, Master = node1

Host Owner Member
node1 multi-owner Yes
node2 No

Mediator Host(s) Aliases
node1
node2

Driv Dbase

d2 Yes

Thank!!

Tim
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers



This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:38:55 EDT