2 Replies Latest reply: Apr 7, 2013 8:48 AM by vasuoracledba RSS

    changing the Voting disk permission in RAC

    vasuoracledba
      Hi Oracle Guru's,

      I installed oracle RAC 11gr2 on 2 nodes under Linux 5.3 64 bit. all the clusterware services are running fine. I rebooted both nodes then the clusterware services are not running properly..

      [root@RAC-NODE1 ~]# /grid1/app/11.2.0/grid_home/bin/crsctl check crs
      CRS-4638: Oracle High Availability Services is online
      CRS-4535: Cannot communicate with Cluster Ready Services
      CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
      CRS-4533: Event Manager is online

      I checked the cssd log file which has following contents..

      cssd.log file:
      **************
      2013-04-04 12:18:51.056: [    CSSD][1141049664]clssnmvDiskVerify: file is not a voting file, cannot recognize on-disk signature for a voting
      2013-04-04 12:18:51.057: [    CSSD][1141049664]clssnmvDiskVerify: file is not a voting file, cannot recognize on-disk signature for a voting
      2013-04-04 12:18:51.057: [    CSSD][1141049664]clssnmvDiskVerify: file is not a voting file, cannot recognize on-disk signature for a voting
      2013-04-04 12:18:51.057: [    CSSD][1141049664]clssnmvDiskVerify: file is not a voting file, cannot recognize on-disk signature for a voting
      2013-04-04 12:18:51.057: [    CSSD][1141049664]clssnmvDiskVerify: file is not a voting file, cannot recognize on-disk signature for a voting
      2013-04-04 12:18:51.057: [    CSSD][1141049664]clssnmvDiskVerify: file is not a voting file, cannot recognize on-disk signature for a voting
      2013-04-04 12:18:51.057: [    CSSD][1141049664]clssnmvDiskVerify: file is not a voting file, cannot recognize on-disk signature for a voting
      2013-04-04 12:18:51.057: [    CSSD][1141049664]clssnmvDiskVerify: file is not a voting file, cannot recognize on-disk signature for a voting
      2013-04-04 12:18:51.057: [    CSSD][1141049664]clssnmvDiskVerify: file is not a voting file, cannot recognize on-disk signature for a voting
      2013-04-04 12:18:51.057: [    CSSD][1141049664]clssnmvDiskVerify: file is not a voting file, cannot recognize on-disk signature for a voting
      2013-04-04 12:18:51.057: [    CSSD][1141049664]clssnmvDiskVerify: file is not a voting file, cannot recognize on-disk signature for a voting
      2013-04-04 12:18:51.057: [    CSSD][1141049664]clssnmvDiskVerify: file is not a voting file, cannot recognize on-disk signature for a voting

      i googled and come to know that clusterware is unable to recognize the voting disks.

      [root@RAC-NODE1 ~]# ls -l /dev/sd*
      brw-r----- 1 root disk 8, 0 Apr 7 09:49 /dev/sda
      brw-r----- 1 root disk 8, 1 Apr 7 09:50 /dev/sda1
      brw-r----- 1 root disk 8, 2 Apr 7 09:49 /dev/sda2
      brw-r----- 1 root disk 8, 3 Apr 7 09:49 /dev/sda3
      brw-r----- 1 root disk 8, 4 Apr 7 09:49 /dev/sda4
      brw-r----- 1 root disk 8, 5 Apr 7 09:50 /dev/sda5
      brw-r----- 1 root disk 8, 6 Apr 7 09:50 /dev/sda6
      brw-r----- 1 root disk 8, 7 Apr 7 09:49 /dev/sda7
      brw-r----- 1 root disk 8, 8 Apr 7 09:49 /dev/sda8
      brw-r----- 1 root disk 8, 16 Apr 7 09:49 /dev/sdb
      brw-r----- 1 root disk 8, 17 Apr 7 09:50 /dev/sdb1
      brw-r----- 1 root disk 8, 18 Apr 7 09:50 /dev/sdb2
      brw-r----- 1 root disk 8, 19 Apr 7 09:50 /dev/sdb3
      brw-r----- 1 root disk 8, 20 Apr 7 09:50 /dev/sdb4
      brw-r----- 1 root disk 8, 32 Apr 7 09:49 /dev/sdc
      brw-r----- 1 root disk 8, 33 Apr 7 09:50 /dev/sdc1
      brw-r----- 1 root disk 8, 34 Apr 7 09:50 /dev/sdc2
      brw-r----- 1 root disk 8, 35 Apr 7 09:50 /dev/sdc3
      brw-r----- 1 root disk 8, 36 Apr 7 09:50 /dev/sdc4
      brw-r----- 1 root disk 8, 48 Apr 7 09:49 /dev/sdd
      brw-r----- 1 root disk 8, 49 Apr 7 09:50 /dev/sdd1
      brw-r----- 1 root disk 8, 50 Apr 7 09:50 /dev/sdd2
      brw-r----- 1 root disk 8, 51 Apr 7 09:50 /dev/sdd3
      brw-r----- 1 root disk 8, 52 Apr 7 09:50 /dev/sdd4
      brw-r----- 1 root disk 8, 64 Apr 7 09:49 /dev/sde
      brw-r----- 1 root disk 8, 65 Apr 7 09:50 /dev/sde1
      brw-r----- 1 root disk 8, 66 Apr 7 09:50 /dev/sde2
      brw-r----- 1 root disk 8, 67 Apr 7 09:50 /dev/sde3
      brw-r----- 1 root disk 8, 68 Apr 7 09:50 /dev/sde4
      brw-r----- 1 root disk 8, 80 Apr 7 09:49 /dev/sdf
      brw-r----- 1 root disk 8, 81 Apr 7 09:50 /dev/sdf1
      brw-r----- 1 root disk 8, 82 Apr 7 09:50 /dev/sdf2
      brw-r----- 1 root disk 8, 83 Apr 7 09:50 /dev/sdf3
      brw-r----- 1 root disk 8, 84 Apr 7 09:50 /dev/sdf4
      brw-r----- 1 root disk 8, 96 Apr 7 09:49 /dev/sdg
      brw-r----- 1 root disk 8, 97 Apr 7 09:50 /dev/sdg1
      brw-r----- 1 root disk 8, 98 Apr 7 09:50 /dev/sdg2
      brw-r----- 1 root disk 8, 99 Apr 7 09:50 /dev/sdg3
      brw-r----- 1 root disk 8, 100 Apr 7 09:50 /dev/sdg4
      brw-r----- 1 root disk 8, 112 Apr 7 09:49 /dev/sdh
      brw-r----- 1 root disk 8, 113 Apr 7 09:50 /dev/sdh1
      brw-r----- 1 root disk 8, 114 Apr 7 09:50 /dev/sdh2
      brw-r----- 1 root disk 8, 115 Apr 7 09:50 /dev/sdh3
      brw-r----- 1 root disk 8, 116 Apr 7 09:50 /dev/sdh4

      How to change the Voting disk permission.The permissions and ownership of ocr and voting disk permanent even after the reboot.

      Regards,
        • 1. Re: changing the Voting disk permission in RAC
          Balazs Papp
          Disks used by Oracle (including voting disk, OCR and data) should be owned by oracle:dba, not root:disk.

          Do the following on both nodes:

          - as root stop the clusterware (if anything left alive from it): crsctl stop crs -f
          - identify the disks used by Oracle, and the owner to oracle:dba: chown oracle:dba /dev/...
          - then start the clusterware: crsctl start crs

          There are several ways to make the permission settings permanent, depending on your storage configuration.
          The simplest (and dirtiest) way I use on virtual machines is to append "chown oracle:dba /dev/..." into /etc/rc.local
          The better way is to set permissions by udev, or the storage configuration itself if its possible with the used method.
          • 2. Re: changing the Voting disk permission in RAC
            vasuoracledba
            Thanks alot..
            Now am able to start all services..