12 Replies Latest reply: Nov 6, 2013 4:23 AM by Mahir M. Quluzade RSS

    Node connectivity error during prerequisite check in grid installation

    user10341747

      Hello,

       

      I am doing 2 node rac installation on oracle VMware(version-4.2) grid installation-11.2

      My runcluvfy was successful, below are the details. But when I started my grid installation it failed in prerequisite checks has node connectivity failure. Is this is because of VIP of both the nodes?. Can I ignore this error and proceed further?. Please guide me on this

       

      =======================================================================================================================================================

       

      [oracle@rac3 grid]$ more clusterverify_new4.log

      Performing pre-checks for cluster services setup

      Checking node reachability...

      Check: Node reachability from node "rac3"
        Destination Node                      Reachable?             
        ------------------------------------  ------------------------
        rac3                                  yes                    
        rac4                                  yes                    
      Result: Node reachability check passed from node "rac3"


      Checking user equivalence...

      Check: User equivalence for user "oracle"
        Node Name                             Comment                
        ------------------------------------  ------------------------
        rac4                                  passed                 
        rac3                                  passed                 
      Result: User equivalence check passed for user "oracle"

      Checking node connectivity...

      Checking hosts config file...
        Node Name     Status                    Comment                
        ------------  ------------------------  ------------------------
        rac4          passed                                           
        rac3          passed                                           

      Verification of the hosts config file successful


      Interface information for node "rac4"
      Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU  
      ------ --------------- --------------- --------------- --------------- ----------------- ------
      eth0   192.168.1.111   192.168.1.0     0.0.0.0         192.168.1.1     08:00:27:D7:DD:28 1500 


      Interface information for node "rac3"
      Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU  
      ------ --------------- --------------- --------------- --------------- ----------------- ------
      eth0   192.168.1.101   192.168.1.0     0.0.0.0         192.168.1.1     08:00:27:12:7C:93 1500 
      eth1   192.168.2.101   192.168.2.0     0.0.0.0         192.168.1.1     08:00:27:98:E0:86 1500 


      Check: Node connectivity of subnet "192.168.1.0"
        Source                          Destination                     Connected?     
        ------------------------------  ------------------------------  ----------------
        rac4:eth0                       rac3:eth0                       yes            
      Result: Node connectivity passed for subnet "192.168.1.0" with node(s) rac4,rac3


      Check: TCP connectivity of subnet "192.168.1.0"
        Source                          Destination                     Connected?     
        ------------------------------  ------------------------------  ----------------
        rac3:192.168.1.101              rac4:192.168.1.111              passed         
      Result: TCP connectivity check passed for subnet "192.168.1.0"


      Check: Node connectivity of subnet "192.168.2.0"
      Result: Node connectivity passed for subnet "192.168.2.0" with node(s) rac3


      Check: TCP connectivity of subnet "192.168.2.0"
      Result: TCP connectivity check passed for subnet "192.168.2.0"


      Interfaces found on subnet "192.168.1.0" that are likely candidates for VIP are:
      rac4 eth0:192.168.1.111
      rac3 eth0:192.168.1.101

      WARNING:
      Could not find a suitable set of interfaces for the private interconnect

      Result: Node connectivity check passed


      Check: Total memory
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          1.98GB (2075468.0KB)      1.5GB (1572864.0KB)       passed   
        rac3          1.98GB (2075468.0KB)      1.5GB (1572864.0KB)       passed   
      Result: Total memory check passed

      Check: Available memory
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          1.87GB (1959736.0KB)      50MB (51200.0KB)          passed   
        rac3          1.84GB (1931904.0KB)      50MB (51200.0KB)          passed   
      Result: Available memory check passed

      Check: Swap space
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          3.94GB (4128760.0KB)      2.97GB (3113202.0KB)      passed   
        rac3          3.94GB (4128760.0KB)      2.97GB (3113202.0KB)      passed   
      Result: Swap space check passed

      Check: Free disk space for "rac4:/tmp"
        Path              Node Name     Mount point   Available     Required      Comment    
        ----------------  ------------  ------------  ------------  ------------  ------------
        /tmp              rac4          /             11.49GB       1GB           passed     
      Result: Free disk space check passed for "rac4:/tmp"

      Check: Free disk space for "rac3:/tmp"
        Path              Node Name     Mount point   Available     Required      Comment    
        ----------------  ------------  ------------  ------------  ------------  ------------
        /tmp              rac3          /             16.66GB       1GB           passed     
      Result: Free disk space check passed for "rac3:/tmp"

      Check: User existence for "oracle"
        Node Name     Status                    Comment                
        ------------  ------------------------  ------------------------
        rac4          exists                    passed                 
        rac3          exists                    passed                 
      Result: User existence check passed for "oracle"

      Check: Group existence for "oinstall"
        Node Name     Status                    Comment                
        ------------  ------------------------  ------------------------
        rac4          exists                    passed                 
        rac3          exists                    passed                 
      Result: Group existence check passed for "oinstall"

      Check: Group existence for "dba"
        Node Name     Status                    Comment                
        ------------  ------------------------  ------------------------
        rac4          exists                    passed                 
        rac3          exists                    passed                 
      Result: Group existence check passed for "dba"

      Check: Membership of user "oracle" in group "oinstall" [as Primary]
        Node Name         User Exists   Group Exists  User in Group  Primary       Comment    
        ----------------  ------------  ------------  ------------  ------------  ------------
        rac4              yes           yes           yes           yes           passed     
        rac3              yes           yes           yes           yes           passed     
      Result: Membership check for user "oracle" in group "oinstall" [as Primary] passed

      Check: Membership of user "oracle" in group "dba"
        Node Name         User Exists   Group Exists  User in Group  Comment        
        ----------------  ------------  ------------  ------------  ----------------
        rac4              yes           yes           yes           passed         
        rac3              yes           yes           yes           passed         
      Result: Membership check for user "oracle" in group "dba" passed

      Check: Run level
        Node Name     run level                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          5                         3,5                       passed   
        rac3          5                         3,5                       passed   
      Result: Run level check passed

      Check: Hard limits for "maximum open file descriptors"
        Node Name         Type          Available     Required      Comment        
        ----------------  ------------  ------------  ------------  ----------------
        rac4              hard          65536         65536         passed         
        rac3              hard          65536         65536         passed         
      Result: Hard limits check passed for "maximum open file descriptors"

      Check: Soft limits for "maximum open file descriptors"
        Node Name         Type          Available     Required      Comment        
        ----------------  ------------  ------------  ------------  ----------------
        rac4              soft          1024          1024          passed         
        rac3              soft          1024          1024          passed         
      Result: Soft limits check passed for "maximum open file descriptors"

      Check: Hard limits for "maximum user processes"
        Node Name         Type          Available     Required      Comment        
        ----------------  ------------  ------------  ------------  ----------------
        rac4              hard          16384         16384         passed         
        rac3              hard          16384         16384         passed         
      Result: Hard limits check passed for "maximum user processes"

      Check: Soft limits for "maximum user processes"
        Node Name         Type          Available     Required      Comment        
        ----------------  ------------  ------------  ------------  ----------------
        rac4              soft          2047          2047          passed         
        rac3              soft          2047          2047          passed         
      Result: Soft limits check passed for "maximum user processes"

      Check: System architecture
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          i686                      x86                       passed   
        rac3          i686                      x86                       passed   
      Result: System architecture check passed

      Check: Kernel version
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          2.6.18-194.el5            2.6.18                    passed   
        rac3          2.6.18-194.el5            2.6.18                    passed   
      Result: Kernel version check passed

      Check: Kernel parameter for "semmsl"
        Node Name     Configured                Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          250                       250                       passed   
        rac3          250                       250                       passed   
      Result: Kernel parameter check passed for "semmsl"

      Check: Kernel parameter for "semmns"
        Node Name     Configured                Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          32000                     32000                     passed   
        rac3          32000                     32000                     passed   
      Result: Kernel parameter check passed for "semmns"

      Check: Kernel parameter for "semopm"
        Node Name     Configured                Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          100                       100                       passed   
        rac3          100                       100                       passed   
      Result: Kernel parameter check passed for "semopm"

      Check: Kernel parameter for "semmni"
        Node Name     Configured                Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          128                       128                       passed   
        rac3          128                       128                       passed   
      Result: Kernel parameter check passed for "semmni"

      Check: Kernel parameter for "shmmax"
        Node Name     Configured                Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          1054504960                536870912                 passed   
        rac3          1054504960                536870912                 passed   
      Result: Kernel parameter check passed for "shmmax"

      Check: Kernel parameter for "shmmni"
        Node Name     Configured                Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          4096                      4096                      passed   
        rac3          4096                      4096                      passed   
      Result: Kernel parameter check passed for "shmmni"

      Check: Kernel parameter for "shmall"
        Node Name     Configured                Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          2097152                   2097152                   passed   
        rac3          2097152                   2097152                   passed   
      Result: Kernel parameter check passed for "shmall"

      Check: Kernel parameter for "file-max"
        Node Name     Configured                Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          6815744                   6815744                   passed   
        rac3          6815744                   6815744                   passed   
      Result: Kernel parameter check passed for "file-max"

      Check: Kernel parameter for "ip_local_port_range"
        Node Name     Configured                Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          between 9000 & 65500      between 9000 & 65500      passed   
        rac3          between 9000 & 65500      between 9000 & 65500      passed   
      Result: Kernel parameter check passed for "ip_local_port_range"

      Check: Kernel parameter for "rmem_default"
        Node Name     Configured                Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          262144                    262144                    passed   
        rac3          262144                    262144                    passed   
      Result: Kernel parameter check passed for "rmem_default"

      Check: Kernel parameter for "rmem_max"
        Node Name     Configured                Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          4194304                   4194304                   passed   
        rac3          4194304                   4194304                   passed   
      Result: Kernel parameter check passed for "rmem_max"

      Check: Kernel parameter for "wmem_default"
        Node Name     Configured                Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          262144                    262144                    passed   
        rac3          262144                    262144                    passed   
      Result: Kernel parameter check passed for "wmem_default"

      Check: Kernel parameter for "wmem_max"
        Node Name     Configured                Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          1048586                   1048576                   passed   
        rac3          1048586                   1048576                   passed   
      Result: Kernel parameter check passed for "wmem_max"

      Check: Kernel parameter for "aio-max-nr"
        Node Name     Configured                Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          1048576                   1048576                   passed   
        rac3          1048576                   1048576                   passed   
      Result: Kernel parameter check passed for "aio-max-nr"

      Check: Package existence for "make-3.81"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          make-3.81-3.el5           make-3.81                 passed   
        rac3          make-3.81-3.el5           make-3.81                 passed   
      Result: Package existence check passed for "make-3.81"

      Check: Package existence for "binutils-2.17.50.0.6"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          binutils-2.17.50.0.6-14.el5  binutils-2.17.50.0.6      passed   
        rac3          binutils-2.17.50.0.6-14.el5  binutils-2.17.50.0.6      passed   
      Result: Package existence check passed for "binutils-2.17.50.0.6"

      Check: Package existence for "gcc-4.1.2"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          gcc-4.1.2-48.el5          gcc-4.1.2                 passed   
        rac3          gcc-4.1.2-48.el5          gcc-4.1.2                 passed   
      Result: Package existence check passed for "gcc-4.1.2"

      Check: Package existence for "gcc-c++-4.1.2"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          gcc-c++-4.1.2-48.el5      gcc-c++-4.1.2             passed   
        rac3          gcc-c++-4.1.2-48.el5      gcc-c++-4.1.2             passed   
      Result: Package existence check passed for "gcc-c++-4.1.2"

      Check: Package existence for "libgomp-4.1.2"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          libgomp-4.4.0-6.el5       libgomp-4.1.2             passed   
        rac3          libgomp-4.4.0-6.el5       libgomp-4.1.2             passed   
      Result: Package existence check passed for "libgomp-4.1.2"

      Check: Package existence for "libaio-0.3.106"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          libaio-0.3.106-5          libaio-0.3.106            passed   
        rac3          libaio-0.3.106-5          libaio-0.3.106            passed   
      Result: Package existence check passed for "libaio-0.3.106"

      Check: Package existence for "glibc-2.5-24"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          glibc-2.5-49              glibc-2.5-24              passed   
        rac3          glibc-2.5-49              glibc-2.5-24              passed   
      Result: Package existence check passed for "glibc-2.5-24"

      Check: Package existence for "compat-libstdc++-33-3.2.3"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          compat-libstdc++-33-3.2.3-61  compat-libstdc++-33-3.2.3  passed   
        rac3          compat-libstdc++-33-3.2.3-61  compat-libstdc++-33-3.2.3  passed   
      Result: Package existence check passed for "compat-libstdc++-33-3.2.3"

      Check: Package existence for "elfutils-libelf-0.125"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          elfutils-libelf-0.137-3.el5  elfutils-libelf-0.125     passed   
        rac3          elfutils-libelf-0.137-3.el5  elfutils-libelf-0.125     passed   
      Result: Package existence check passed for "elfutils-libelf-0.125"

      Check: Package existence for "elfutils-libelf-devel-0.125"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          elfutils-libelf-devel-0.137-3.el5  elfutils-libelf-devel-0.125  passed   
        rac3          elfutils-libelf-devel-0.137-3.el5  elfutils-libelf-devel-0.125  passed   
      Result: Package existence check passed for "elfutils-libelf-devel-0.125"

      Check: Package existence for "glibc-common-2.5"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          glibc-common-2.5-49       glibc-common-2.5          passed   
        rac3          glibc-common-2.5-49       glibc-common-2.5          passed   
      Result: Package existence check passed for "glibc-common-2.5"

      Check: Package existence for "glibc-devel-2.5"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          glibc-devel-2.5-49        glibc-devel-2.5           passed   
        rac3          glibc-devel-2.5-49        glibc-devel-2.5           passed   
      Result: Package existence check passed for "glibc-devel-2.5"

      Check: Package existence for "glibc-headers-2.5"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          glibc-headers-2.5-49      glibc-headers-2.5         passed   
        rac3          glibc-headers-2.5-49      glibc-headers-2.5         passed   
      Result: Package existence check passed for "glibc-headers-2.5"

      Check: Package existence for "libaio-devel-0.3.106"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          libaio-devel-0.3.106-5    libaio-devel-0.3.106      passed   
        rac3          libaio-devel-0.3.106-5    libaio-devel-0.3.106      passed   
      Result: Package existence check passed for "libaio-devel-0.3.106"

      Check: Package existence for "libgcc-4.1.2"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          libgcc-4.1.2-48.el5       libgcc-4.1.2              passed   
        rac3          libgcc-4.1.2-48.el5       libgcc-4.1.2              passed   
      Result: Package existence check passed for "libgcc-4.1.2"

      Check: Package existence for "libstdc++-4.1.2"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          libstdc++-4.1.2-48.el5    libstdc++-4.1.2           passed   
        rac3          libstdc++-4.1.2-48.el5    libstdc++-4.1.2           passed   
      Result: Package existence check passed for "libstdc++-4.1.2"

      Check: Package existence for "libstdc++-devel-4.1.2"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          libstdc++-devel-4.1.2-48.el5  libstdc++-devel-4.1.2     passed   
        rac3          libstdc++-devel-4.1.2-48.el5  libstdc++-devel-4.1.2     passed   
      Result: Package existence check passed for "libstdc++-devel-4.1.2"

      Check: Package existence for "sysstat-7.0.2"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          sysstat-7.0.2-3.el5       sysstat-7.0.2             passed   
        rac3          sysstat-7.0.2-3.el5       sysstat-7.0.2             passed   
      Result: Package existence check passed for "sysstat-7.0.2"

      Check: Package existence for "unixODBC-2.2.11"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          unixODBC-2.2.11-7.1       unixODBC-2.2.11           passed   
        rac3          unixODBC-2.2.11-7.1       unixODBC-2.2.11           passed   
      Result: Package existence check passed for "unixODBC-2.2.11"

      Check: Package existence for "unixODBC-devel-2.2.11"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          unixODBC-devel-2.2.11-7.1  unixODBC-devel-2.2.11     passed   
        rac3          unixODBC-devel-2.2.11-7.1  unixODBC-devel-2.2.11     passed   
      Result: Package existence check passed for "unixODBC-devel-2.2.11"

      Check: Package existence for "ksh-20060214"
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          ksh-20100202-1.el5        ksh-20060214              passed   
        rac3          ksh-20100202-1.el5        ksh-20060214              passed   
      Result: Package existence check passed for "ksh-20060214"

      Checking for multiple users with UID value 0
      Result: Check for multiple users with UID value 0 passed

      Check: Current group ID
      Result: Current group ID check passed
      Checking Core file name pattern consistency...
      Core file name pattern consistency check passed.

      Checking to make sure user "oracle" is not in "root" group
        Node Name     Status                    Comment                
        ------------  ------------------------  ------------------------
        rac4          does not exist            passed                 
        rac3          does not exist            passed                 
      Result: User "oracle" is not part of "root" group. Check passed

      Check default user file creation mask
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        rac4          0022                      0022                      passed   
        rac3          0022                      0022                      passed   
      Result: Default user file creation mask check passed

      Starting Clock synchronization checks using Network Time Protocol(NTP)...

      NTP Configuration file check started...
      Network Time Protocol(NTP) configuration file not found on any of the nodes. Oracle Cluster Time
      Synchronization Service(CTSS) can be used instead of NTP for time synchronization on the cluster
      nodes

      Result: Clock synchronization check using Network Time Protocol(NTP) passed


      Pre-check for cluster services setup was successful.

       

       

      ===============================================================================================================================================================

      Regards,