Recovering a node and including it back into the cluster

After a node or an I/O group fails, you can use the following procedure to recover a node and include it back into the cluster.

Steps

Perform the following steps to recover a node and include it back into the cluster:

  1. Verify that the node is offline. Issue the following command:
    svcinfo lsnode
  2. Remove the old instance of the offline node from the cluster. Issue the following command:
    svctask rmnode <nodename/id>
    where <NODENAME> is the name of the node.
  3. Verify that the node can be seen on the fabric. Issue the following command:
    svcinfo lsnodecandidate
    You should see the nodes listed as a candidate.
    Note:Note: Remember the WWNNs for each node, you will need it in the following step.
  4. If the nodes are repaired by replacing the front panel module or a node is repaired by replacing it with another node, then the WWNN for the node will change. In this case, the following additional steps are required:
    1. At the end of the recovery process it will be necessary to follow the SDD procedure to discover the new paths and to check that each vpath is now presenting the correct number of paths. See the IBM TotalStorage Subsystem Device Driver: User's Guide sections on dynamic reconfiguration, specifically adding paths to existing vpaths.
    2. You may also need to modify the configuration of your disk controllers. If your controller uses a mapping technique to present its RAID arrays or partitions to the cluster you will need to modify the port groups that belong to the cluster because the WWNN or WWPN's of the node have changed.
    Attention: Attention: If more than one I/O group is affected, ensure that you are adding the node to the same I/O group that it was removed from. Failure to do this can result in data corruption. Use the information that was recorded when the node was originally added to the cluster. This can avoid a possible data corruption exposure if the node must be removed from and re-added to the cluster. If you do not have access to this information, call IBM Service to add the node back into the cluster without corrupting the data.
    Attention: Attention: If you are adding the node into the cluster for the first time, record the following information:
    Note:Note: This warning also is displayed on the SAN Volume Controller Console panel when adding the node.
  5. Add the node back into the cluster. Issue the following command:
    svctask addnode -wwnodename <WWNN> -iogrp
    <IOGRPNAME/ID> [-name <NODENAME>]

    where <WWNN> is the worldwide node name <IOGRPNAME/ID> is the I/O group name or ID.
  6. Verify that the node is online. Issue the following command:
    svcinfo lsnode
Related topics

(C) Copyright International Business Machines Corporation 2003, 2004