3 Replies Latest reply: Sep 12, 2013 5:44 AM by Pradeepcmst RSS

    11.2.0.3 Grid infra installation on OEL 6.1 | runcluvfy checks  failed

    956822
      Hi All,

      Pardon me in case the below error has been encountered previously. While performing the runcluvfy checks i am facing the sharedness of the disk could not be determined. Kindly assist.

      Below are the complete configuration details :
      OS - OEL 6.1 , NODE1,NODE2

      Grid infrastructure - 11.2.0.3


      NODE1 : Oracle RPM installed: rpm -qa |grep -i oracleasm

      oracleasmlib-2.0.4-1.el6.x86_64
      oracleasm-support-2.1.5-1.el6.x86_64



      NODE2: Oracle RPM installed: rpm -qa |grep oracleasm
      oracleasmlib-2.0.4-1.el6.x86_64
      oracleasm-support-2.1.5-1.el6.x86_64


      NODE1 :
      id grid
      uid=60000(grid) gid=11001(oinstall) groups=8500(dba),59031(asmadmin),59032(asmdba),59033(asmoper),11001(oinstall)

      NODE2 :
      id grid
      uid=60000(grid) gid=11001(oinstall) groups=8500(dba),59031(asmadmin),59032(asmdba),59033(asmoper),11001(oinstall)


      Storage provided as LUNS
      Disk Size
      /dev/sda 4294 MB


      [root@NODE1 ]# ls -tlr /dev/sd[a-n]
      brw-rw---- 1 root disk 8, 0 Feb 21 23:37 /dev/sda


      [root@NODE2 vijaynk]# ls -tlr /dev/sd[a-n]
      brw-rw---- 1 root disk 8, 0 Feb 22 00:09 /dev/sda


      Configured oracleasm both on NODE1 and NODE2
      /usr/sbin/oracleasm configure -i

      Configuring the Oracle ASM library driver.
      Default user to own the driver interface [grid]: grid
      Default group to own the driver interface [asmadmin]: asmadmin
      Start Oracle ASM library driver on boot (y/n) [y]: Y
      Scan for Oracle ASM disks on boot (y/n) [y]: Y
      Writing Oracle ASM library driver configuration: done



      Loaded the oracleasm
      [root@NODE1]# /usr/sbin/oracleasm init
      [root@NODE1]]# /usr/sbin/oracleasm status
      Checking if ASM is loaded: yes
      Checking if /dev/oracleasm is mounted: yes


      Formatted first disk.
      [root@NODE1 disks]# fdisk /dev/sda
      Command (m for help): p
      Disk /dev/sda: 4294 MB, 4294967296 bytes
      133 heads, 62 sectors/track, 1017 cylinders
      Units = cylinders of 8246 * 512 = 4221952 bytes
      Sector size (logical/physical): 512 bytes / 512 bytes
      I/O size (minimum/optimal): 512 bytes / 512 bytes
      Disk identifier: 0xd8c4f16a
      Device Boot Start End Blocks Id System
      Command (m for help): n
      Command action
      e extended
      p primary partition (1-4)
      p
      Partition number (1-4): 1
      First cylinder (1-1017, default 1):
      Using default value 1
      Last cylinder, cylinders or size{K,M,G} (1-1017, default 1017):
      Using default value 1017
      Command (m for help): p
      Device Boot Start End Blocks Id System
      /dev/sda1 1 1017 4193060 83 Linux
      Command (m for help): w
      The partition table has been altered!
      Calling ioctl() to re-read partition table.
      Syncing disks.
      [root@NODE1 disks]# partprobe /dev/sda


      Created ASM disk DISK1
      [root@NODE1 disks]# /usr/sbin/oracleasm createdisk DISK1 /dev/sda1
      Writing disk header: done
      Instantiating disk: done
      [root@NODE1 disks]# /usr/sbin/oracleasm listdisks
      DISK1

      [root@NODE1 disks]# ls -ltr /dev/oracleasm/disks/
      total 0
      brw-rw---- 1 grid asmadmin 8, 1 Feb 22 00:21 DISK1


      Verified if the DISK2
      [root@NODE2 vijaynk]# /usr/sbin/oracleasm init
      [root@NODE2 vijaynk]# /usr/sbin/oracleasm scandisks
      Reloading disk partitions: done
      Cleaning any stale ASM disks...
      Scanning system for ASM disks...
      Instantiating disk "DISK1"
      [root@NODE2 vijaynk]# /usr/sbin/oracleasm listdisks
      DISK1



      Did even Disk Discovery:
      [root@NODE1 disks]# /usr/sbin/oracleasm-discover
      Using ASMLib from /opt/oracle/extapi/64/asm/orcl/1/libasm.so
      [ASM Library - Generic Linux, version 2.0.4 (KABI_V2)]
      Discovered disk: ORCL:DISK1 [8386120 blocks (4293693440 bytes), maxio 512]

      [root@NODE2 vijaynk]# /usr/sbin/oracleasm-discover
      Using ASMLib from /opt/oracle/extapi/64/asm/orcl/1/libasm.so
      [ASM Library - Generic Linux, version 2.0.4 (KABI_V2)]
      Discovered disk: ORCL:DISK1 [8386120 blocks (4293693440 bytes), maxio 512]


      Please Suggest on the highlighted error message. I refereed the following link to perform the pre checks.
      http://docs.oracle.com/cd/E14072_01/rac.112/e10717/cvu.htm#CJGDBBII


      *./runcluvfy.sh stage -pre crsinst -n NODE1,NODE2 -r 11gR2 -asm -asmdev /dev/sda1 –verbose*

      ################CLUVFY LOG##################
      Performing pre-checks for cluster services setup

      Check: Package existence for "cvuqdisk"
      Node Name Available Required Status
      ------------ ------------------------ ------------------------ ----------
      NODE2 cvuqdisk-1.0.9-1 cvuqdisk-1.0.9-1 passed
      NODE1 cvuqdisk-1.0.9-1 cvuqdisk-1.0.9-1 passed
      Result: Package existence check passed for "cvuqdisk"
      .............|
      .............|===> Apart from the below checks rest all passed.
      .............|
      Checking Devices for ASM...


      ERROR:  /dev/sda1
      NODE2:Unable to determine the sharedness of /dev/sda on nodes:
      NODE1,NODE2
      Checking for shared devices...
      PRVF-5149 : WARNING: Storage "/dev/sda1" is not shared on all nodes
      UDev attributes check for ASM Disks started...
      ERROR:
      PRVF-9802 : Attempt to get udev info from node "NODE2" failed
      ERROR:
      PRVF-9802 : Attempt to get udev info from node "NODE1" failed
      Result: UDev attributes check failed for ASM Disks
      Result: Devices check for ASM failed
      Pre-check for cluster services setup was unsuccessful on all the nodes.
      ############################################


      Thanks,

      Vijay