4 Replies Latest reply: Sep 26, 2013 9:52 AM by mkeskin RSS

    oracle 11g rac installation error

    user11062519

      hi,

      I am installing RAC 11g R2 on linux operating system , facing an  error while running root.sh on second node.

       

      Below are the alert log file .

       

       

       

       

      Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.

      2013-09-23 18:47:57.308

      [client(26000)]CRS-2106:The OLR location /u01/app/11.2.0/grid/cdata/ifbr-rac2.olr is inaccessible. Details in /u01/app/11.2.0/grid/log/ifbr-rac2/client/ocrconfig_26000.log.

      2013-09-23 18:47:57.371

      [client(26000)]CRS-2101:The OLR was formatted using version 3.

      2013-09-23 18:48:12.906

      [ohasd(26043)]CRS-2112:The OLR service started on node ifbr-rac2.

      2013-09-23 18:48:13.108

      [ohasd(26043)]CRS-2772:Server 'ifbr-rac2' has been assigned to pool 'Free'.

      2013-09-23 18:48:39.611

      [cssd(27305)]CRS-1713:CSSD daemon is started in exclusive mode

      2013-09-23 18:49:12.399

      [cssd(27305)]CRS-1707:Lease acquisition for node ifbr-rac2 number 2 completed

      [cssd(27305)]CRS-1636:The CSS daemon was started in exclusive mode but found an active CSS daemon on node ifbr-rac1 and is terminating; details at (:CSSNM00006:) in /u01/app/11.2.0/grid/log/ifbr-rac2/cssd/ocssd.log

      2013-09-23 18:49:12.449

      [cssd(27305)]CRS-1603:CSSD on node ifbr-rac2 shutdown by user.

      2013-09-23 18:49:12.599

      [ohasd(26043)]CRS-2765:Resource 'ora.cssdmonitor' has failed on server 'ifbr-rac2'.

      2013-09-23 18:49:34.241

      [cssd(27552)]CRS-1713:CSSD daemon is started in clustered mode

      2013-09-23 18:49:45.465

      [cssd(27552)]CRS-1707:Lease acquisition for node ifbr-rac2 number 2 completed

      2013-09-23 18:49:45.498

      [cssd(27552)]CRS-1605:CSSD voting file is online: /dev/raw/raw1; details in /u01/app/11.2.0/grid/log/ifbr-rac2/cssd/ocssd.log.

      2013-09-23 18:49:56.585

      [cssd(27552)]CRS-1601:CSSD Reconfiguration complete. Active nodes are ifbr-rac1 ifbr-rac2 .

      2013-09-23 18:49:58.080

      [ctssd(27611)]CRS-2403:The Cluster Time Synchronization Service on host ifbr-rac2 is in observer mode.

      2013-09-23 18:49:58.086

      [ctssd(27611)]CRS-2407:The new Cluster Time Synchronization Service reference node is host ifbr-rac1.

      2013-09-23 18:49:59.032

      [ctssd(27611)]CRS-2401:The Cluster Time Synchronization Service started on host ifbr-rac2.

      [client(27641)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.

      [client(27645)]CRS-10001:ACFS-9322: done.

      2013-09-23 18:50:15.542

      [crsd(27763)]CRS-1012:The OCR service started on node ifbr-rac2.

      2013-09-23 18:50:17.365

      [crsd(27763)]CRS-1201:CRSD started on node ifbr-rac2.

      2013-09-23 19:01:04.063

      [ctssd(27611)]CRS-2409:The clock on host ifbr-rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.

        • 1. Re: oracle 11g rac installation error
          saurabh

          [ctssd(27611)]CRS-2409:The clock on host ifbr-rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.

           

          The above error is because on your both the nodes time is not syncronized. there is time difference on both the node.

           

          The same has been answered on the below link

           

          https://forums.oracle.com/thread/2447918

          • 2. Re: oracle 11g rac installation error
            Levi Pereira

            @user11062519


            You probably ignored the prerequisites.

            For a successful installation you cant ignore the prerequisites, unless you are sure of what you are doing.

            Preparing Your Cluster

            * Install and Configure NTP

             

            Message was edited by: Levi-Pereira

            • 3. Re: oracle 11g rac installation error
              user11062519

              hi,

               

              Thanks for your reply.

              I have configured ntp with -x flaq on both linux machine as you can see below  the output of date and contents of  ntpd files of both machine.

              Pre requisites are executed successfully only two below warnings are given which i ignore. Also i have found that my storage machine (openfiler) date are not synchronize with linux machines does this is the issue?

               

              1) Cannot find interface for vip

              2) PRVF-5416 : Query of NTP daemon failed on all nodes

               

               

              [oracle@ifbr-rac2 ~]$ ssh ifbr-rac1 date

              Tue Sep 24 12:30:22 PKST 2013

               

              [oracle@ifbr-rac2 ~]$ date

              Tue Sep 24 12:30:24 PKST 2013

               

               

              Machine 1

              ************

              # Drop root to id 'ntp:ntp' by default.

              OPTIONS="-x -u ntp:ntp -p /var/run/ntpd.pid"

               

               

              # Set to 'yes' to sync hw clock after successful ntpdate

              SYNC_HWCLOCK=no

               

               

              # Additional options for ntpdate

              NTPDATE_OPTIONS=""

               

              Machine 2

              ************

               

              # Drop root to id 'ntp:ntp' by default.

              OPTIONS="-x -u ntp:ntp -p /var/run/ntpd.pid"

               

               

              # Set to 'yes' to sync hw clock after successful ntpdate

              SYNC_HWCLOCK=no

               

               

              # Additional options for ntpdate

              NTPDATE_OPTIONS=""

               

              Output of NTP Verification utility

              ************************************

               

              Verifying Clock Synchronization across the cluster nodes

               

               

              Checking if Clusterware is installed on all nodes...

              Check of Clusterware install passed

               

               

              Checking if CTSS Resource is running on all nodes...

              Check: CTSS Resource running on all nodes

                Node Name                             Status                 

                ------------------------------------  ------------------------

                ifbr-rac2                             passed                 

                ifbr-rac1                             passed                 

              Result: CTSS resource check passed

               

               

               

               

              Querying CTSS for time offset on all nodes...

              Result: Query of CTSS for time offset passed

               

               

              Check CTSS state started...

              Check: CTSS state

                Node Name                             State                  

                ------------------------------------  ------------------------

                ifbr-rac2                             Observer               

                ifbr-rac1                             Observer               

              CTSS is in Observer state. Switching over to clock synchronization checks using NTP

               

               

               

               

              Starting Clock synchronization checks using Network Time Protocol(NTP)...

               

               

              NTP Configuration file check started...

              The NTP configuration file "/etc/ntp.conf" is available on all nodes

              NTP Configuration file check passed

               

               

              Checking daemon liveness...

               

               

              Check: Liveness for "ntpd"

                Node Name                             Running?               

                ------------------------------------  ------------------------

                ifbr-rac2                             yes                    

                ifbr-rac1                             yes                    

              Result: Liveness check passed for "ntpd"

               

               

              Checking NTP daemon command line for slewing option "-x"

              Check: NTP daemon command line

                Node Name                             Slewing Option Set?    

                ------------------------------------  ------------------------

                ifbr-rac2                             yes                    

                ifbr-rac1                             yes                    

              Result:

              NTP daemon slewing option check passed

               

               

              Checking NTP daemon's boot time configuration, in file "/etc/sysconfig/ntpd", for slewing option "-x"

               

               

              Check: NTP daemon's boot time configuration

                Node Name                             Slewing Option Set?    

                ------------------------------------  ------------------------

                ifbr-rac2                             yes                    

                ifbr-rac1                             yes                    

              Result:

              NTP daemon's boot time configuration check for slewing option passed

               

               

              NTP common Time Server Check started...

              PRVF-5408 : NTP Time Server ".LOCL." is common only to the following nodes "ifbr-rac1"

              PRVF-5416 : Query of NTP daemon failed on all nodes

               

               

              Result: Clock synchronization check using Network Time Protocol(NTP) passed

               

               

               

               

              Oracle Cluster Time Synchronization Services check passed

               

               

              Verification of Clock Synchronization across the cluster nodes was successful.

               

               

              host file machine 1

              **********************

              # Do not remove the following line, or various programs

              # that require network functionality will fail.

              127.0.0.1  ifbr-rac1.ifbr.net ifbr-rac1 localhost.localdomain localhost ifbr-rac1

              ::1 localhost6.localdomain6 localhost6

              ## Public Node names

               

              10.16.14.61 ifbr-rac1.ifbr.net ifbr-rac1 /eth0

              10.16.14.62 ifbr-rac2.ifbr.net ifbr-rac2 /eth0

               

              ## Private Network (interconnect)

               

              10.0.1.10 ifbr-rac1-priv ifbr-rac1-prv

              10.0.1.20 ifbr-rac2-priv ifbr-rac2-prv

               

              ## Virtual IPs

               

              10.16.14.71 ifbr-rac1-vip.ifbr.net ifbr-rac1-vip

              10.16.14.72 ifbr-rac2-vip.ifbr.net ifbr-rac2-vip

               

              ## SCAN IP

              10.16.14.65 crs-scan.ifbr.net crs-scan

               

              ## Storage

               

              10.16.14.20 storage-01.ifbr.net storage-01 //eth0

              10.0.1.30 storage-01.ifbr.net storage-01

               

              host file machine 2

              **********************

               

              # Do not remove the following line, or various programs

              # that require network functionality will fail.

              #127.0.0.1      ifbr-rac2  localhost.localdomain localhost

              127.0.0.1  ifbr-rac2.ifbr.net           ifbr-rac2 localhost.localdomain localhos

              t ifbr-rac2

               

               

              ::1             localhost6.localdomain6 localhost6

              ## Public Node names

               

               

              10.16.14.61     ifbr-rac1.ifbr.net      ifbr-rac1 /eth0

              10.16.14.62     ifbr-rac2.ifbr.net      ifbr-rac2 /eth0

               

               

              ## Private Network (interconnect)

               

               

              10.0.1.10       ifbr-rac1-priv  ifbr-rac1-prv

              10.0.1.20       ifbr-rac2-priv  ifbr-rac2-prv

               

               

              ## Virtual IPs

               

               

              10.16.14.71     ifbr-rac1-vip.ifbr.net  ifbr-rac1-vip

              10.16.14.72     ifbr-rac2-vip.ifbr.net  ifbr-rac2-vip

               

               

              ## SCAN IP

              10.16.14.65     crs-scan.ifbr.net       crs-scan

               

               

              ## Storage

               

               

              10.16.14.20     storage-01.ifbr.net     storage-01      //eth0

              10.0.1.30       storage-01.ifbr.net     storage-01

              • 4. Re: oracle 11g rac installation error
                mkeskin

                Could you send the output of below command ?

                 

                ntpstat && echo $?

                 

                Also check the delay and offset values

                 

                watch ntpq -pn

                 

                Here is the sample ;

                 

                Every 2.0s: ntpq -pn                                                                                                                                                                                   

                 

                 

                     remote           refid      st t when poll reach   delay   offset  jitter

                ==============================================================================

                *NTP_SERVER_IP   129.6.15.29      2 u  129 1024  377    0.395    0.594   2.147