5 Replies Latest reply: Dec 12, 2012 6:41 PM by onedbguru RSS

    asm disk group did not find while install oracle 11g grid infra

    Robinson
      Hi Guys,

      I encountered no asm disk group found while install oracle 11g grid infra. The following are my env.
      oracle enterprise 5.5(32) + oracle 11g r2(32) + vmware server 2.0.2
      [grid@node1 ~]$ oracleasm listdisks
      ASM_DATA
      ASM_FRA
      OCR_VOTE

      [grid@node2 ~]$ oracleasm listdisks
      ASM_DATA
      ASM_FRA
      OCR_VOTE

      #permission
      [grid@node1 disks]$ ls -hltr
      total 0
      brw-rw---- 1 grid asmadmin 8, 17 Dec 11 11:49 OCR_VOTE
      brw-rw---- 1 grid asmadmin 8, 33 Dec 11 11:49 ASM_DATA
      brw-rw---- 1 grid asmadmin 8, 49 Dec 11 11:49 ASM_FRA

      #rpm package cvuqdisk
      [grid@node1 ~]$ CVUQDISK_GRP=oinstall; export CVUQDISK_GRP
      [grid@node1 ~]$ rpm -qa | grep cvuqdisk
      cvuqdisk-1.0.7-1
      [grid@node2 ~]$ CVUQDISK_GRP=oinstall; export CVUQDISK_GRP
      [grid@node2 ~]$ rpm -qa | grep cvuqdisk
      cvuqdisk-1.0.7-1

      Verify by CUV:
      +++++++++++++++++++++++++++++
      [grid@node1 grid]$ ./runcluvfy.sh stage -pre crsinst -fixup -n node1,node2 -verbose
      
      Performing pre-checks for cluster services setup 
      
      Checking node reachability...
      
      Check: Node reachability from node "node1"
        Destination Node                      Reachable?              
        ------------------------------------  ------------------------
        node1                                 yes                     
        node2                                 yes                     
      Result: Node reachability check passed from node "node1"
      
      
      Checking user equivalence...
      
      Check: User equivalence for user "grid"
        Node Name                             Comment                 
        ------------------------------------  ------------------------
        node2                                 passed                  
        node1                                 passed                  
      Result: User equivalence check passed for user "grid"
      
      Checking node connectivity...
      
      Checking hosts config file...
        Node Name     Status                    Comment                 
        ------------  ------------------------  ------------------------
        node2         passed                                            
        node1         passed                                            
      
      Verification of the hosts config file successful
      
      
      Interface information for node "node2"
       Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU   
       ------ --------------- --------------- --------------- --------------- ----------------- ------
       eth0   192.168.7.72    192.168.7.0     0.0.0.0         192.168.7.254   00:0C:29:BE:13:D3 1500  
       eth1   10.10.7.72      10.10.7.0       0.0.0.0         192.168.7.254   00:0C:29:BE:13:DD 1500  
      
      
      Interface information for node "node1"
       Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU   
       ------ --------------- --------------- --------------- --------------- ----------------- ------
       eth0   192.168.7.71    192.168.7.0     0.0.0.0         192.168.7.254   00:0C:29:ED:CF:A9 1500  
       eth1   10.10.7.71      10.10.7.0       0.0.0.0         192.168.7.254   00:0C:29:ED:CF:B3 1500  
      
      
      Check: Node connectivity of subnet "192.168.7.0"
        Source                          Destination                     Connected?      
        ------------------------------  ------------------------------  ----------------
        node2:eth0                      node1:eth0                      yes             
      Result: Node connectivity passed for subnet "192.168.7.0" with node(s) node2,node1
      
      
      Check: TCP connectivity of subnet "192.168.7.0"
        Source                          Destination                     Connected?      
        ------------------------------  ------------------------------  ----------------
        node1:192.168.7.71              node2:192.168.7.72              passed          
      Result: TCP connectivity check passed for subnet "192.168.7.0"
      
      
      Check: Node connectivity of subnet "10.10.7.0"
        Source                          Destination                     Connected?      
        ------------------------------  ------------------------------  ----------------
        node2:eth1                      node1:eth1                      yes             
      Result: Node connectivity passed for subnet "10.10.7.0" with node(s) node2,node1
      
      
      Check: TCP connectivity of subnet "10.10.7.0"
        Source                          Destination                     Connected?      
        ------------------------------  ------------------------------  ----------------
        node1:10.10.7.71                node2:10.10.7.72                passed          
      Result: TCP connectivity check passed for subnet "10.10.7.0"
      
      
      Interfaces found on subnet "192.168.7.0" that are likely candidates for VIP are:
      node2 eth0:192.168.7.72
      node1 eth0:192.168.7.71
      
      Interfaces found on subnet "10.10.7.0" that are likely candidates for a private interconnect are:
      node2 eth1:10.10.7.72
      node1 eth1:10.10.7.71
      
      Result: Node connectivity check passed
      
      
      Check: Total memory 
        Node Name     Available                 Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         1.98GB (2075488.0KB)      1.5GB (1572864.0KB)       passed    
        node1         1.98GB (2075488.0KB)      1.5GB (1572864.0KB)       passed    
      Result: Total memory check passed
      
      Check: Available memory 
        Node Name     Available                 Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         1.92GB (2010144.0KB)      50MB (51200.0KB)          passed    
        node1         1.79GB (1874612.0KB)      50MB (51200.0KB)          passed    
      Result: Available memory check passed
      
      Check: Swap space 
        Node Name     Available                 Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         2.98GB (3120464.0KB)      2.97GB (3113232.0KB)      passed    
        node1         3GB (3145040.0KB)         2.97GB (3113232.0KB)      passed    
      Result: Swap space check passed
      
      Check: Free disk space for "node2:/tmp" 
        Path              Node Name     Mount point   Available     Required      Comment     
        ----------------  ------------  ------------  ------------  ------------  ------------
        /tmp              node2         /             12.79GB       1GB           passed      
      Result: Free disk space check passed for "node2:/tmp"
      
      Check: Free disk space for "node1:/tmp" 
        Path              Node Name     Mount point   Available     Required      Comment     
        ----------------  ------------  ------------  ------------  ------------  ------------
        /tmp              node1         /             7.87GB        1GB           passed      
      Result: Free disk space check passed for "node1:/tmp"
      
      Check: User existence for "grid" 
        Node Name     Status                    Comment                 
        ------------  ------------------------  ------------------------
        node2         exists                    passed                  
        node1         exists                    passed                  
      Result: User existence check passed for "grid"
      
      Check: Group existence for "oinstall" 
        Node Name     Status                    Comment                 
        ------------  ------------------------  ------------------------
        node2         exists                    passed                  
        node1         exists                    passed                  
      Result: Group existence check passed for "oinstall"
      
      Check: Group existence for "dba" 
        Node Name     Status                    Comment                 
        ------------  ------------------------  ------------------------
        node2         exists                    passed                  
        node1         exists                    passed                  
      Result: Group existence check passed for "dba"
      
      Check: Membership of user "grid" in group "oinstall" [as Primary]
        Node Name         User Exists   Group Exists  User in Group  Primary       Comment     
        ----------------  ------------  ------------  ------------  ------------  ------------
        node2             yes           yes           yes           yes           passed      
        node1             yes           yes           yes           yes           passed      
      Result: Membership check for user "grid" in group "oinstall" [as Primary] passed
      
      Check: Membership of user "grid" in group "dba" 
        Node Name         User Exists   Group Exists  User in Group  Comment         
        ----------------  ------------  ------------  ------------  ----------------
        node2             yes           yes           yes           passed          
        node1             yes           yes           yes           passed          
      Result: Membership check for user "grid" in group "dba" passed
      
      Check: Run level 
        Node Name     run level                 Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         5                         3,5                       passed    
        node1         5                         3,5                       passed    
      Result: Run level check passed
      
      Check: Hard limits for "maximum open file descriptors" 
        Node Name         Type          Available     Required      Comment         
        ----------------  ------------  ------------  ------------  ----------------
        node2             hard          65536         65536         passed          
        node1             hard          65536         65536         passed          
      Result: Hard limits check passed for "maximum open file descriptors"
      
      Check: Soft limits for "maximum open file descriptors" 
        Node Name         Type          Available     Required      Comment         
        ----------------  ------------  ------------  ------------  ----------------
        node2             soft          1024          1024          passed          
        node1             soft          1024          1024          passed          
      Result: Soft limits check passed for "maximum open file descriptors"
      
      Check: Hard limits for "maximum user processes" 
        Node Name         Type          Available     Required      Comment         
        ----------------  ------------  ------------  ------------  ----------------
        node2             hard          16384         16384         passed          
        node1             hard          16384         16384         passed          
      Result: Hard limits check passed for "maximum user processes"
      
      Check: Soft limits for "maximum user processes" 
        Node Name         Type          Available     Required      Comment         
        ----------------  ------------  ------------  ------------  ----------------
        node2             soft          2047          2047          passed          
        node1             soft          2047          2047          passed          
      Result: Soft limits check passed for "maximum user processes"
      
      Check: System architecture 
        Node Name     Available                 Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         i686                      x86                       passed    
        node1         i686                      x86                       passed    
      Result: System architecture check passed
      
      Check: Kernel version 
        Node Name     Available                 Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         2.6.18-194.el5PAE         2.6.18                    passed    
        node1         2.6.18-194.el5PAE         2.6.18                    passed    
      Result: Kernel version check passed
      
      Check: Kernel parameter for "semmsl" 
        Node Name     Configured                Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         250                       250                       passed    
        node1         250                       250                       passed    
      Result: Kernel parameter check passed for "semmsl"
      
      Check: Kernel parameter for "semmns" 
        Node Name     Configured                Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         32000                     32000                     passed    
        node1         32000                     32000                     passed    
      Result: Kernel parameter check passed for "semmns"
      
      Check: Kernel parameter for "semopm" 
        Node Name     Configured                Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         100                       100                       passed    
        node1         100                       100                       passed    
      Result: Kernel parameter check passed for "semopm"
      
      Check: Kernel parameter for "semmni" 
        Node Name     Configured                Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         142                       128                       passed    
        node1         142                       128                       passed    
      Result: Kernel parameter check passed for "semmni"
      
      Check: Kernel parameter for "shmmax" 
        Node Name     Configured                Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         4294967295                536870912                 passed    
        node1         4294967295                536870912                 passed    
      Result: Kernel parameter check passed for "shmmax"
      
      Check: Kernel parameter for "shmmni" 
        Node Name     Configured                Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         4096                      4096                      passed    
        node1         4096                      4096                      passed    
      Result: Kernel parameter check passed for "shmmni"
      
      Check: Kernel parameter for "shmall" 
        Node Name     Configured                Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         1073741824                2097152                   passed    
        node1         1073741824                2097152                   passed    
      Result: Kernel parameter check passed for "shmall"
      
      Check: Kernel parameter for "file-max" 
        Node Name     Configured                Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         6815744                   6815744                   passed    
        node1         6815744                   6815744                   passed    
      Result: Kernel parameter check passed for "file-max"
      
      Check: Kernel parameter for "ip_local_port_range" 
        Node Name     Configured                Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         between 9000 & 65500      between 9000 & 65500      passed    
        node1         between 9000 & 65500      between 9000 & 65500      passed    
      Result: Kernel parameter check passed for "ip_local_port_range"
      
      Check: Kernel parameter for "rmem_default" 
        Node Name     Configured                Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         262144                    262144                    passed    
        node1         262144                    262144                    passed    
      Result: Kernel parameter check passed for "rmem_default"
      
      Check: Kernel parameter for "rmem_max" 
        Node Name     Configured                Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         4194304                   4194304                   passed    
        node1         4194304                   4194304                   passed    
      Result: Kernel parameter check passed for "rmem_max"
      
      Check: Kernel parameter for "wmem_default" 
        Node Name     Configured                Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         262144                    262144                    passed    
        node1         262144                    262144                    passed    
      Result: Kernel parameter check passed for "wmem_default"
      
      Check: Kernel parameter for "wmem_max" 
        Node Name     Configured                Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         1048576                   1048576                   passed    
        node1         1048576                   1048576                   passed    
      Result: Kernel parameter check passed for "wmem_max"
      
      Check: Kernel parameter for "aio-max-nr" 
        Node Name     Configured                Required                  Comment   
        ------------  ------------------------  ------------------------  ----------
        node2         3145728                   1048576                   passed    
        node1         3145728                   1048576                   passed    
      Result: Kernel parameter check passed for "aio-max-nr" 
      Edited by: Robinson on Dec 11, 2012 3:11 PM
        • 1. Re: asm disk group did not find while install oracle 11g grid infra
          Robinson
          Check: Package existence for "make-3.81" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         make-3.81-3.el5           make-3.81                 passed    
            node1         make-3.81-3.el5           make-3.81                 passed    
          Result: Package existence check passed for "make-3.81"
          
          Check: Package existence for "binutils-2.17.50.0.6" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         binutils-2.17.50.0.6-14.el5  binutils-2.17.50.0.6      passed    
            node1         binutils-2.17.50.0.6-14.el5  binutils-2.17.50.0.6      passed    
          Result: Package existence check passed for "binutils-2.17.50.0.6"
          
          Check: Package existence for "gcc-4.1.2" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         gcc-4.1.2-48.el5          gcc-4.1.2                 passed    
            node1         gcc-4.1.2-48.el5          gcc-4.1.2                 passed    
          Result: Package existence check passed for "gcc-4.1.2"
          
          Check: Package existence for "gcc-c++-4.1.2" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         gcc-c++-4.1.2-48.el5      gcc-c++-4.1.2             passed    
            node1         gcc-c++-4.1.2-48.el5      gcc-c++-4.1.2             passed    
          Result: Package existence check passed for "gcc-c++-4.1.2"
          
          Check: Package existence for "libgomp-4.1.2" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         libgomp-4.4.0-6.el5       libgomp-4.1.2             passed    
            node1         libgomp-4.4.0-6.el5       libgomp-4.1.2             passed    
          Result: Package existence check passed for "libgomp-4.1.2"
          
          Check: Package existence for "libaio-0.3.106" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         libaio-0.3.106-5          libaio-0.3.106            passed    
            node1         libaio-0.3.106-5          libaio-0.3.106            passed    
          Result: Package existence check passed for "libaio-0.3.106"
          
          Check: Package existence for "glibc-2.5-24" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         glibc-2.5-49              glibc-2.5-24              passed    
            node1         glibc-2.5-49              glibc-2.5-24              passed    
          Result: Package existence check passed for "glibc-2.5-24"
          
          Check: Package existence for "compat-libstdc++-33-3.2.3" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         compat-libstdc++-33-3.2.3-61  compat-libstdc++-33-3.2.3  passed    
            node1         compat-libstdc++-33-3.2.3-61  compat-libstdc++-33-3.2.3  passed    
          Result: Package existence check passed for "compat-libstdc++-33-3.2.3"
          
          Check: Package existence for "elfutils-libelf-0.125" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         elfutils-libelf-0.137-3.el5  elfutils-libelf-0.125     passed    
            node1         elfutils-libelf-0.137-3.el5  elfutils-libelf-0.125     passed    
          Result: Package existence check passed for "elfutils-libelf-0.125"
          
          Check: Package existence for "elfutils-libelf-devel-0.125" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         elfutils-libelf-devel-0.137-3.el5  elfutils-libelf-devel-0.125  passed    
            node1         elfutils-libelf-devel-0.137-3.el5  elfutils-libelf-devel-0.125  passed    
          Result: Package existence check passed for "elfutils-libelf-devel-0.125"
          
          Check: Package existence for "glibc-common-2.5" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         glibc-common-2.5-49       glibc-common-2.5          passed    
            node1         glibc-common-2.5-49       glibc-common-2.5          passed    
          Result: Package existence check passed for "glibc-common-2.5"
          
          Check: Package existence for "glibc-devel-2.5" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         glibc-devel-2.5-49        glibc-devel-2.5           passed    
            node1         glibc-devel-2.5-49        glibc-devel-2.5           passed    
          Result: Package existence check passed for "glibc-devel-2.5"
          
          Check: Package existence for "glibc-headers-2.5" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         glibc-headers-2.5-49      glibc-headers-2.5         passed    
            node1         glibc-headers-2.5-49      glibc-headers-2.5         passed    
          Result: Package existence check passed for "glibc-headers-2.5"
          
          Check: Package existence for "libaio-devel-0.3.106" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         libaio-devel-0.3.106-5    libaio-devel-0.3.106      passed    
            node1         libaio-devel-0.3.106-5    libaio-devel-0.3.106      passed    
          Result: Package existence check passed for "libaio-devel-0.3.106"
          
          Check: Package existence for "libgcc-4.1.2" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         libgcc-4.1.2-48.el5       libgcc-4.1.2              passed    
            node1         libgcc-4.1.2-48.el5       libgcc-4.1.2              passed    
          Result: Package existence check passed for "libgcc-4.1.2"
          
          Check: Package existence for "libstdc++-4.1.2" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         libstdc++-4.1.2-48.el5    libstdc++-4.1.2           passed    
            node1         libstdc++-4.1.2-48.el5    libstdc++-4.1.2           passed    
          Result: Package existence check passed for "libstdc++-4.1.2"
          
          Check: Package existence for "libstdc++-devel-4.1.2" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         libstdc++-devel-4.1.2-48.el5  libstdc++-devel-4.1.2     passed    
            node1         libstdc++-devel-4.1.2-48.el5  libstdc++-devel-4.1.2     passed    
          Result: Package existence check passed for "libstdc++-devel-4.1.2"
          
          Check: Package existence for "sysstat-7.0.2" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         sysstat-7.0.2-3.el5       sysstat-7.0.2             passed    
            node1         sysstat-7.0.2-3.el5       sysstat-7.0.2             passed    
          Result: Package existence check passed for "sysstat-7.0.2"
          
          Check: Package existence for "unixODBC-2.2.11" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         unixODBC-2.2.11-7.1       unixODBC-2.2.11           passed    
            node1         unixODBC-2.2.11-7.1       unixODBC-2.2.11           passed    
          Result: Package existence check passed for "unixODBC-2.2.11"
          
          Check: Package existence for "unixODBC-devel-2.2.11" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         unixODBC-devel-2.2.11-7.1  unixODBC-devel-2.2.11     passed    
            node1         unixODBC-devel-2.2.11-7.1  unixODBC-devel-2.2.11     passed    
          Result: Package existence check passed for "unixODBC-devel-2.2.11"
          
          Check: Package existence for "ksh-20060214" 
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         ksh-20100202-1.el5        ksh-20060214              passed    
            node1         ksh-20100202-1.el5        ksh-20060214              passed    
          Result: Package existence check passed for "ksh-20060214"
          
          Checking for multiple users with UID value 0
          Result: Check for multiple users with UID value 0 passed 
          
          Check: Current group ID 
          Result: Current group ID check passed
          Checking Core file name pattern consistency...
          Core file name pattern consistency check passed.
          
          Checking to make sure user "grid" is not in "root" group
            Node Name     Status                    Comment                 
            ------------  ------------------------  ------------------------
            node2         does not exist            passed                  
            node1         does not exist            passed                  
          Result: User "grid" is not part of "root" group. Check passed
          
          Check default user file creation mask
            Node Name     Available                 Required                  Comment   
            ------------  ------------------------  ------------------------  ----------
            node2         0022                      0022                      passed    
            node1         0022                      0022                      passed    
          Result: Default user file creation mask check passed
          
          Starting Clock synchronization checks using Network Time Protocol(NTP)...
          
          NTP Configuration file check started...
          The NTP configuration file "/etc/ntp.conf" is available on all nodes
          NTP Configuration file check passed
          
          Checking daemon liveness...
          
          Check: Liveness for "ntpd"
            Node Name                             Running?                
            ------------------------------------  ------------------------
            node2                                 yes                     
            node1                                 yes                     
          Result: Liveness check passed for "ntpd"
          
          Checking NTP daemon command line for slewing option "-x"
          Check: NTP daemon command line
            Node Name                             Slewing Option Set?     
            ------------------------------------  ------------------------
            node2                                 yes                     
            node1                                 yes                     
          Result: 
          NTP daemon slewing option check passed
          
          Checking NTP daemon's boot time configuration, in file "/etc/sysconfig/ntpd", for slewing option "-x"
          
          Check: NTP daemon's boot time configuration
            Node Name                             Slewing Option Set?     
            ------------------------------------  ------------------------
            node2                                 yes                     
            node1                                 yes                     
          Result: 
          NTP daemon's boot time configuration check for slewing option passed
          
          NTP common Time Server Check started...
          NTP Time Server ".LOCL." is common to all nodes on which the NTP daemon is running
          Check of common NTP Time Server passed
          
          Clock time offset check from NTP Time Server started...
          Checking on nodes "[node2, node1]"... 
          Check: Clock time offset from NTP Time Server
          
          Time Server: .LOCL. 
          Time Offset Limit: 1000.0 msecs
            Node Name     Time Offset               Status                  
            ------------  ------------------------  ------------------------
            node2         0.0                       passed                  
            node1         0.0                       passed                  
          Time Server ".LOCL." has time offsets that are within permissible limits for nodes "[node2, node1]". 
          Clock time offset check passed
          
          Result: Clock synchronization check using Network Time Protocol(NTP) passed
          
          
          Pre-check for cluster services setup was successful. 
          
          
          
          
          
          [grid@node1 grid]$ ./runcluvfy.sh stage -post hwos -n node1,node2 -verbose
          
          Performing post-checks for hardware and operating system setup 
          
          Checking node reachability...
          
          Check: Node reachability from node "node1"
            Destination Node                      Reachable?              
            ------------------------------------  ------------------------
            node1                                 yes                     
            node2                                 yes                     
          Result: Node reachability check passed from node "node1"
          
          
          Checking user equivalence...
          
          Check: User equivalence for user "grid"
            Node Name                             Comment                 
            ------------------------------------  ------------------------
            node2                                 passed                  
            node1                                 passed                  
          Result: User equivalence check passed for user "grid"
          
          Checking node connectivity...
          
          Checking hosts config file...
            Node Name     Status                    Comment                 
            ------------  ------------------------  ------------------------
            node2         passed                                            
            node1         passed                                            
          
          Verification of the hosts config file successful
          
          
          Interface information for node "node2"
           Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU   
           ------ --------------- --------------- --------------- --------------- ----------------- ------
           eth0   192.168.7.72    192.168.7.0     0.0.0.0         192.168.7.254   00:0C:29:BE:13:D3 1500  
           eth1   10.10.7.72      10.10.7.0       0.0.0.0         192.168.7.254   00:0C:29:BE:13:DD 1500  
          
          
          Interface information for node "node1"
           Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU   
           ------ --------------- --------------- --------------- --------------- ----------------- ------
           eth0   192.168.7.71    192.168.7.0     0.0.0.0         192.168.7.254   00:0C:29:ED:CF:A9 1500  
           eth1   10.10.7.71      10.10.7.0       0.0.0.0         192.168.7.254   00:0C:29:ED:CF:B3 1500  
          
          
          Check: Node connectivity of subnet "192.168.7.0"
            Source                          Destination                     Connected?      
            ------------------------------  ------------------------------  ----------------
            node2:eth0                      node1:eth0                      yes             
          Result: Node connectivity passed for subnet "192.168.7.0" with node(s) node2,node1
          
          
          Check: TCP connectivity of subnet "192.168.7.0"
            Source                          Destination                     Connected?      
            ------------------------------  ------------------------------  ----------------
            node1:192.168.7.71              node2:192.168.7.72              passed          
          Result: TCP connectivity check passed for subnet "192.168.7.0"
          
          
          Check: Node connectivity of subnet "10.10.7.0"
            Source                          Destination                     Connected?      
            ------------------------------  ------------------------------  ----------------
            node2:eth1                      node1:eth1                      yes             
          Result: Node connectivity passed for subnet "10.10.7.0" with node(s) node2,node1
          
          
          Check: TCP connectivity of subnet "10.10.7.0"
            Source                          Destination                     Connected?      
            ------------------------------  ------------------------------  ----------------
            node1:10.10.7.71                node2:10.10.7.72                passed          
          Result: TCP connectivity check passed for subnet "10.10.7.0"
          
          
          Interfaces found on subnet "192.168.7.0" that are likely candidates for VIP are:
          node2 eth0:192.168.7.72
          node1 eth0:192.168.7.71
          
          Interfaces found on subnet "10.10.7.0" that are likely candidates for a private interconnect are:
          node2 eth1:10.10.7.72
          node1 eth1:10.10.7.71
          
          Result: Node connectivity check passed
          
          
          Checking for multiple users with UID value 0
          Result: Check for multiple users with UID value 0 passed 
          
          Post-check for hardware and operating system setup was successful. 
          ++++++++++++++++++++++++++++++++++++++++++++++=

          Could someone give some advices about it? Thanks.
          • 2. Re: asm disk group did not find while install oracle 11g grid infra
            Robinson
            When i click next, then error message returned.
            [INS-30507] Empty ASM disk group.

            Below is my oracleasm lib configuration:
            [root@node1 disks]# oracleasm configure
            ORACLEASM_ENABLED=true
            ORACLEASM_UID=grid
            ORACLEASM_GID=asmadmin
            ORACLEASM_SCANBOOT=true
            ORACLEASM_SCANORDER=""
            ORACLEASM_SCANEXCLUDE=""

            [root@node1 disks]# id grid
            uid=1100(grid) gid=1000(oinstall) groups=1000(oinstall),1100(asmadmin),1200(dba),1300(asmdba),1301(asmoper)
            • 3. Re: asm disk group did not find while install oracle 11g grid infra
              861120
              Hi Robinson

              I went through this problem and this thread help me -> Issue for choosing disk from managed ASM

              See, if this can help you ... and put here your tests.

              Regards
              Flávio Soares
              • 4. Re: asm disk group did not find while install oracle 11g grid infra
                Robinson
                Thanks Flávio Soares .

                I went through from your URL and reconfigure asmlib, then removed asm disk and recreate them. finally, it still does not work.

                Seem no oracleasm-discover or oracleasm command with parameter discover. Thanks anyway.
                [root@node1 sbin]# ls -hltr oracle*
                -rwxr-xr-x 1 root root 13K Mar 21  2009 oracleasm
                [root@node1 sbin]# oracleasm -discover
                oracleasm: '-discover' is not an oracleasm command
                Usage: oracleasm [--exec-path=<exec_path>] <command> [ <args> ]
                       oracleasm --exec-path
                       oracleasm -h
                       oracleasm -V
                
                The basic oracleasm commands are:
                    configure        Configure the Oracle Linux ASMLib driver
                    init             Load and initialize the ASMLib driver
                    exit             Stop the ASMLib driver
                    scandisks        Scan the system for Oracle ASMLib disks
                    status           Display the status of the Oracle ASMLib driver
                    listdisks        List known Oracle ASMLib disks
                    querydisk        Determine if a disk belongs to Oracle ASMlib
                    createdisk       Allocate a device for Oracle ASMLib use
                    deletedisk       Return a device to the operating system
                    renamedisk       Change the label of an Oracle ASMlib disk
                    update-driver    Download the latest ASMLib driver
                • 5. Re: asm disk group did not find while install oracle 11g grid infra
                  onedbguru
                  I would HIGHLY recommend redoing your configuration WITHOUT asmlib - it is headed for desupport and is NOT supported in RHEL 6.x. Not only is it headed for de-support, but is completely unnecessary. I have configured > 75 clusters (10g and 11g) on Linux, HP and Solaris and never used asmlib on any of the Linux clusters.

                  When ASM cannot find a device, you HAVE a permission/ownership issue and/or an incorrect ASM device path.

                  Remember, when using grid user and rdbms user (oracle), the rdbms user must have a shared group with grid AND both users must be able to read and write those devices.