6 Replies Latest reply: Jul 28, 2014 1:59 AM by Marc Schömehl RSS

    Oracle Windows RAC (11g) communicates over wrong IP adresses

    Marc Schömehl

      Hello to all.

      I am looking for a solution for the following problem:
      We have two HP DL380 servers with Windows 2008 Enterprise Server as a Platform
      and Oracle RAC 11g Enterprise installed.

      The network configuration in windows is the following:
      Each two Nics were bundled via HP Network Tool to one virtual interface for fail safety.
      Nic1 -> Public

      Nic2 -> Private


      On the DNS two VIP and SCAN addresses have been reserved and can be

      questioned via RoundRobin.

      During the installation of die GRID on Node1 everything ran smoothly. On Node2 the following occurred.
      The System is now partially working over the wrong IP adresses (those addresses who are virtual written to the IPCONFIG).

      System services such as SNMP or Kaspersky anti virus updates are now trying to communicate over the wrong

      IP address. Kaspersky can´t achieve any pattern updates because it tries to communicate over the SCAN IP address of the RAC.

      This behavior is only on Node2, Node1 on everything is normal.

      Is it possible to fix this behavior, so that the right addresses are working again ?

      Thank you very much
      Marc

        • 1. Re: Oracle Windows RAC (11g) communicates over wrong IP adresses
          Hemant K Chitale

          Do you mean that :

          1. node2 DOES have a Public IP, a Private IP, a VIP and a SCAN IP --all four ?

          2. Non-Oracle applications (Kaspersky) are using the SCAN IP and not the Public IP ?

           

          Does this happen even after a restart ?  Do these non-Oracle applications configure which IP to use ?

           

          This sounds like a non-Oracle problem.

           

          Hemant K Chitale


          • 2. Re: Oracle Windows RAC (11g) communicates over wrong IP adresses
            Marc Schömehl

            Hello,

             

            1. node2 DOES have a Public IP, a Private IP, a VIP and a SCAN IP --all four ?

             

            here is the ipconfig output, from both nodes.

            node 1

            Ethernet adapter public:

               Connection-specific DNS Suffix  . : 12345678.de

               IPv4 Address. . . . . . . . . . . : 10.31.81.8 (SCAN)

               Subnet Mask . . . . . . . . . . . : 255.255.255.128

               IPv4 Address. . . . . . . . . . . : 10.31.81.10 (VIP)

               Subnet Mask . . . . . . . . . . . : 255.255.255.128

               IPv4 Address. . . . . . . . . . . : 10.31.81.15 (PROD-NET)

               Subnet Mask . . . . . . . . . . . : 255.255.255.128

               Default Gateway . . . . . . . . . : 10.31.81.1

             

            Ethernet adapter private:

               Connection-specific DNS Suffix  . :

               IPv4 Address. . . . . . . . . . . : 192.168.20.11 (CLUSTER-ICON)

               Subnet Mask . . . . . . . . . . . : 255.255.255.0

               Default Gateway . . . . . . . . . :

             

            Ethernet adapter iSCSI:

               Connection-specific DNS Suffix  . :

               IPv4 Address. . . . . . . . . . . : 172.16.20.11 (iSCSI NETWORK)

               Subnet Mask . . . . . . . . . . . : 255.255.255.0

               Default Gateway . . . . . . . . . :

             

            here node 2:

            Ethernet adapter public:

               Connection-specific DNS Suffix  . : 12345678.de

               IPv4 Address. . . . . . . . . . . : 10.31.81.9 (SCAN)

               Subnet Mask . . . . . . . . . . . : 255.255.255.128

               IPv4 Address. . . . . . . . . . . : 10.31.81.11 (VIP)

               Subnet Mask . . . . . . . . . . . : 255.255.255.128

               IPv4 Address. . . . . . . . . . . : 10.31.81.16 (PROD-NET)

               Subnet Mask . . . . . . . . . . . : 255.255.255.128

               Default Gateway . . . . . . . . . : 10.31.81.1

             

            Ethernet adapter private:

               Connection-specific DNS Suffix  . :

               IPv4 Address. . . . . . . . . . . : 192.168.20.21 (CLUSTER-ICON)

               Subnet Mask . . . . . . . . . . . : 255.255.255.0

               Default Gateway . . . . . . . . . :

             

            Ethernet adapter iSCSI:

               Connection-specific DNS Suffix  . :

               IPv4 Address. . . . . . . . . . . : 172.16.20.21 (iSCSI NETWORK)

               Subnet Mask . . . . . . . . . . . : 255.255.255.0

               Default Gateway . . . . . . . . . :

             

            here the output of nslookup for the SCAN adresses:

            Server:  123-dns1.123-123-123.12345678.de

            Address:  10.4.32.251

             

            Name:    abc-abc-SCAN.12345678.de

            Addresses:  10.31.81.8

                  10.31.81.9

             

            here the output of nslookup for the VIP adresses:

            node1:

            Server:  123-dns1.123-123-123.12345678.de

            Address:  10.4.32.251

             

            Name:    node1-vip.12345678.de

            Address:  10.31.81.10

             

            node2:

            Server:  123-dns1.123-123-123.12345678.de

            Address:  10.4.32.251

             

            Name:    node2-vip.12345678.de

            Address:  10.31.81.11

             

            2. Non-Oracle applications (Kaspersky) are using the SCAN IP and not the Public IP ?

            - SNMP responses over node1 from the "right" public ip-address 10.31.81.15

            - SNMP responses over node2 from the "wrong" public ip-address 10.31.81.11 which is in real the VIP address.

            - Kaspersky works on node1 from the "right" address 10.31.81.15, on node2 it tries over the "wrong" address 10.31.91.11 (VIP) to update and communicate.

             

            Does this happen even after a restart ?

            - this goes still on, after a reboot

             

            Do these non-Oracle applications configure which IP to use ?

            - the applications (kaspersky) are working over DNS. On the Nagios system we can see, that the SNMP query works now over the VIP address and not the PROD-NET address anymore (only on node2).

             

            Greets

            Marc

            • 3. Re: Oracle Windows RAC (11g) communicates over wrong IP adresses
              Hemant K Chitale

              Check the DNS entries.  There should be separate DNS entries, for the Public and the VIP.  You might need to refresh or restart DNS.

               

              Hemant K Chitale

              • 4. Re: Oracle Windows RAC (11g) communicates over wrong IP adresses
                Marc Schömehl

                Here are the DNS entries for the servers:

                 

                node 1 - public adapter

                Ethernet adapter public:

                   Connection-specific DNS Suffix  . : 12345678.de

                   Description . . . . . . . . . . . : PRODNET - HP Network Team #1

                   DHCP Enabled. . . . . . . . . . . : No

                   Autoconfiguration Enabled . . . . : Yes

                   IPv4 Address. . . . . . . . . . . : 10.31.81.8 (SCAN)

                   Subnet Mask . . . . . . . . . . . : 255.255.255.128

                   IPv4 Address. . . . . . . . . . . : 10.31.81.10 (VIP)

                   Subnet Mask . . . . . . . . . . . : 255.255.255.128

                   IPv4 Address. . . . . . . . . . . : 10.31.81.15 (PROD-NET)

                   Subnet Mask . . . . . . . . . . . : 255.255.255.128

                   Default Gateway . . . . . . . . . : 10.31.81.1

                   DNS Servers . . . . . . . . . . . : 10.4.32.251

                                                              10.4.32.252

                   NetBIOS over Tcpip. . . . . . . . : Enabled

                 

                node 2 - public adapter

                Ethernet adapter public:

                   Connection-specific DNS Suffix  . : 12345678.de

                   Description . . . . . . . . . . . : PRODNET - HP Network Team #1

                   DHCP Enabled. . . . . . . . . . . : No

                   Autoconfiguration Enabled . . . . : Yes

                   IPv4 Address. . . . . . . . . . . : 10.31.81.9 (SCAN)

                   Subnet Mask . . . . . . . . . . . : 255.255.255.128

                   IPv4 Address. . . . . . . . . . . : 10.31.81.11 (VIP)

                   Subnet Mask . . . . . . . . . . . : 255.255.255.128

                   IPv4 Address. . . . . . . . . . . : 10.31.81.16 (PROD-NET)

                   Subnet Mask . . . . . . . . . . . : 255.255.255.128

                   Default Gateway . . . . . . . . . : 10.31.81.1

                   DNS Servers . . . . . . . . . . . : 10.4.32.251

                                                              10.4.32.252

                   NetBIOS over Tcpip. . . . . . . . : Enabled

                 

                But, i didn`t configured any ip-adresses in windows for the scan- or vip-address. my oracle colleague said, that these addresses are virtually configured during the GRID installation.

                I only configured the server with these ipconfig:

                Ethernet adapter public:

                   Connection-specific DNS Suffix  . : 12345678.de

                   Description . . . . . . . . . . . : PRODNET - HP Network Team #1

                   DHCP Enabled. . . . . . . . . . . : No

                   Autoconfiguration Enabled . . . . : Yes

                   IPv4 Address. . . . . . . . . . . : 10.31.81.15 (PROD-NET)

                   Subnet Mask . . . . . . . . . . . : 255.255.255.128

                   Default Gateway . . . . . . . . . : 10.31.81.1

                   DNS Servers . . . . . . . . . . . : 10.4.32.251

                                                              10.4.32.252

                   NetBIOS over Tcpip. . . . . . . . : Enabled

                 

                Greets

                Marc

                • 5. Re: Oracle Windows RAC (11g) communicates over wrong IP adresses
                  ora_tech

                  Hi,

                   

                  You need to check these entiries in DNS server itself as updated by hemant.

                   

                  thanks,

                  X A H E E R

                  • 6. Re: Oracle Windows RAC (11g) communicates over wrong IP adresses
                    Marc Schömehl

                    Hello ora_tech & hemant,

                     

                    because I myself do not administrate the DNS server, i have to open a ticket for it. Could you give me a screenshot or an example of how the entries should look like?


                    Thanks

                    Marc