2 Replies Latest reply: Oct 15, 2012 8:48 AM by HartmutStreppel RSS

    Replacing network adapter from IPMP group (Sun cluster 3.3)

    968068
      Hello!

      I need to change network devices from IPMP group that have devices ge0 ge1 ge2 to ce5 ce6 ce7

      I can do this procedure online? something like:
      Creating files adding to the ipmp groups: /etc/hostname.ce5 ,ce6, c7
      unmonitoring resources group
      umplumb old devices and plumb up new devices

      # scstat -i

      -- IPMP Groups --

      Node Name Group Status Adapter Status
      --------- ----- ------ ------- ------
      IPMP Group: node0 ipmp0 Online ge1 Online
      IPMP Group: node0 ipmp0 Online ge0 Online
      IPMP Group: node0 ipmp1 Online ce2 Online
      IPMP Group: node0 ipmp1 Online ce0 Online

      IPMP Group: node1 ipmp0 Online ge1 Online
      IPMP Group: node1 ipmp0 Online ge0 Online
      IPMP Group: node1 ipmp1 Online ce2 Online
      IPMP Group: node1 ipmp1 Online ce0 Online
      ::::::::::::::
      /etc/hostname.ge0
      ::::::::::::::
      n0-testge0 netmask + broadcast + group ipmp0 deprecated -failover up
      addif node0 netmask + broadcast + up
      ::::::::::::::
      /etc/hostname.ge1
      ::::::::::::::
      n0-testge1 netmask + broadcast + group ipmp0 deprecated -failover up
      ::::::::::::::
      /etc/hostname.ge2
      ::::::::::::::
      backupn0 mtu 1500

      # ifconfig -a
      lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
      inet 127.0.0.1 netmask ff000000
      ce0: flags=9040843<UP,BROADCAST,RUNNING,MULTICAST,DEPRECATED,IPv4,NOFAILOVER> mtu 1500 index 2
      inet 172.19.1.25 netmask ffffff00 broadcast 172.19.1.255
      groupname ipmp1
      ether 0:14:4f:23:1d:9
      ce0:1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 2
      inet 172.19.1.10 netmask ffffff00 broadcast 172.19.1.255
      ce1: flags=1008843<UP,BROADCAST,RUNNING,MULTICAST,PRIVATE,IPv4> mtu 1500 index 9
      inet 172.16.0.129 netmask ffffff80 broadcast 172.16.0.255
      ether 0:14:4f:23:1d:a
      ce2: flags=9040843<UP,BROADCAST,RUNNING,MULTICAST,DEPRECATED,IPv4,NOFAILOVER> mtu 1500 index 3
      inet 172.19.1.26 netmask ffffff00 broadcast 172.19.1.255
      groupname ipmp1
      ether 0:14:4f:26:a4:83
      ce2:1: flags=1001040843<UP,BROADCAST,RUNNING,MULTICAST,DEPRECATED,IPv4,FIXEDMTU> mtu 1500 index 3
      inet 172.19.1.23 netmask ffffff00 broadcast 172.19.1.255
      ce4: flags=1008843<UP,BROADCAST,RUNNING,MULTICAST,PRIVATE,IPv4> mtu 1500 index 8
      inet 172.16.1.1 netmask ffffff80 broadcast 172.16.1.127
      ether 0:14:4f:42:7f:28
      dman0: flags=1008843<UP,BROADCAST,RUNNING,MULTICAST,PRIVATE,IPv4> mtu 1500 index 4
      inet 192.168.103.6 netmask ffffffe0 broadcast 192.168.103.31
      ether 0:0:be:aa:1c:58
      ge0: flags=9040843<UP,BROADCAST,RUNNING,MULTICAST,DEPRECATED,IPv4,NOFAILOVER> mtu 1500 index 5
      inet 10.1.0.25 netmask ffffff00 broadcast 10.1.0.255
      groupname ipmp0
      ether 8:0:20:e6:61:a7
      ge0:1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 5
      inet 10.1.0.10 netmask ffffff00 broadcast 10.1.0.255
      ge1: flags=9040843<UP,BROADCAST,RUNNING,MULTICAST,DEPRECATED,IPv4,NOFAILOVER> mtu 1500 index 6
      inet 10.1.0.26 netmask ffffff00 broadcast 10.1.0.255
      groupname ipmp0
      ether 0:3:ba:c:74:62
      ge1:1: flags=1001040843<UP,BROADCAST,RUNNING,MULTICAST,DEPRECATED,IPv4,FIXEDMTU> mtu 1500 index 6
      inet 10.1.0.23 netmask ffffff00 broadcast 10.1.0.255
      ge2: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 7
      inet 10.1.2.10 netmask ffffff00 broadcast 10.1.2.255
      ether 8:0:20:b5:25:88
      clprivnet0: flags=1009843<UP,BROADCAST,RUNNING,MULTICAST,MULTI_BCAST,PRIVATE,IPv4> mtu 1500 index 10
      inet 172.16.4.1 netmask fffffe00 broadcast 172.16.5.255
      ether 0:0:0:0:0:1

      Thanks in advance!
        • 1. Re: Replacing network adapter from IPMP group (Sun cluster 3.3)
          Soory
          Before any such operation you need to evacuate the cluster nodes one by one for the operation to be completed. Doing unplumb on NICs may give unexpected results in active cluster, mainly the cluster will panic as it will not find the member available.
          • 2. Re: Replacing network adapter from IPMP group (Sun cluster 3.3)
            HartmutStreppel
            You should be able to replace adapters in an IPMP group one-by-one without affecting the cluster operation.

            BUT: You must make sure that the status of the new adapter in the IPMP group gets back to normal, before you start replacing the next adapter.

            Solaris Cluster only reacts to IPMP group failures, not to failures of individual NICs.

            Note, that IPMP is only used for the public network. Cluster interconnects are not configured using IPMP. Nevertheless the same technique can be applied to replace adapters in the cluster interconnect. You need to use the clintr command (IIRC) to replace individual NICs. Again, make sure that all the NICs of the interconnect are healthy before you continue replacing the next adapater.