9 Replies Latest reply: Apr 29, 2009 9:51 AM by 698941 RSS

    Oracle 10g Clusterware Install

    529937
      This is my first time installing Oracle Clusterware. During the Specify Cluster Registry (OCR) Location I get the following error:


      location /dev/sda, for OCR, is not shared across all the nodes

      1st node:
      [oracle@db-1-sfm ]# ls -ltr /dev/sda
      brw-rw---- 1 root disk 8, 0 Mar 27 22:48 /dev/sda

      2nd node:
      [oracle@db-2-sfm ]# ls -lt /dev/sda
      brw-rw---- 1 root disk 8, 0 Mar 27 22:48 /dev/sda


      Any help would be appreciated.
        • 1. Re: Oracle 10g Clusterware Install
          516450
          Can you try doing the following from both the nodes as oracle:

          dd if=/dev/zero of=/dev/sda bs=1M count=128
          - I am assuming that the size of your /dev/sda partition to be at least 128MB.

          Thanks
          -Chandra
          • 2. Re: Oracle 10g Clusterware Install
            PhilipRN-Oracle
            Q1 is /dev/sda on the shared disk ?

            Also
            your permissions are wrong - at the start of the install I like to set the devices to be owned by oracle:oinstall (or whatever) - the script run at the end of the install will set them correctly.
            You must then ensure that the permissions are set correctly after a reboot, you don't mention which OS / Version or Clusterware version - all this info helps refine answers. Most people use udev - or similar to correctly persist permissions across a reboot.
            • 3. Re: Oracle 10g Clusterware Install
              529937
              I changed the permissions.

              I'm using Red Hat Linux ES 4. The clusterware is 10.2.0.1.

              1st node:
              [oracle@db-1-sfm ]# ls -l /dev/sda
              brwxrwxrwx 1 root disk 8, 0 Mar 27 22:48 /dev/sda


              2nd node:
              [oracle@db-2-sfm ]# ls -l /dev/sda
              brwxrwxrwx 1 root disk 8, 0 Mar 27 22:48 /dev/sda
              • 4. Re: Oracle 10g Clusterware Install
                529937
                It turns out that I wasn't even looking at the right device. I needed to use /dev/sdc, but I'm still running into the same problem.
                • 5. Re: Oracle 10g Clusterware Install
                  529937
                  dd if=/dev/zero of=/dev/sdc bs=1M count=128
                  128+0 records in
                  128+0 records out
                  • 6. Re: Oracle 10g Clusterware Install
                    153001
                    As you mentioned this is Linux , can you check if the Serial Number returned by this command for the Shared partition(s) for the OCR / Voting disks from both the nodes are the same

                    /usr/sbin/smartctl -i /dev/sdb

                    If both the nodes are looking at the same Shared disks / partitions , then their Serial Numbers should match.

                    Let us know the results.

                    Vishwa
                    • 7. Re: Oracle 10g Clusterware Install
                      494282
                      Hi,

                      when you reboot your machine, raw devices are remapped. The ownership is getting changed and assigned to root, this is by default behavior. You need to overwrite this, you can overwrite by modifying /etc/udev/permissions.d/50-udev.permissions file on all nodes,

                      add the below lines in udev file,

                      # raw devices
                      ram*:root:disk:0660
                      #raw/*:root:disk:0660
                      raw/*:oracle:dba:0660

                      I think this should resolve your issue.

                      Thanks,
                      P
                      • 8. Re: Oracle 10g Clusterware Install
                        PhilipRN-Oracle
                        ok so now knowing that this is 10g (not 11g) you are setting permissions on the wrong devices (as indicated above)

                        You must set the raw devices to map to the block devices and then use the raw devices as part of the install.

                        Also it's not a good idea to set ownership of all devices to oracle:dba as the previous post indicated.
                        Better to look at what oracle sets them to after the install and configure udev to recrete those settings.
                        • 9. Re: Oracle 10g Clusterware Install
                          698941
                          Hello

                          I have the same problem.
                          By the way: when have created file in /opt/app/crs (my mount point) on one node i can't see it on another until remount ocfs2 filesystem.

                          My mount command is mount -t ocfs2 -o datavolume,nointr -L "oracrsfiles" /opt/app/crs/

                          Nick


                          crosspost: Re: Problem of using OCFS2 as shared storage to install RAC 10g on VMware