This discussion is archived
4 Replies Latest reply: Sep 26, 2013 7:52 AM by mkeskin RSS

oracle 11g rac installation error

user361671 Newbie
Currently Being Moderated

hi,

I am installing RAC 11g R2 on linux operating system , facing an  error while running root.sh on second node.

 

Below are the alert log file .

 

 

 

 

Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.

2013-09-23 18:47:57.308

[client(26000)]CRS-2106:The OLR location /u01/app/11.2.0/grid/cdata/ifbr-rac2.olr is inaccessible. Details in /u01/app/11.2.0/grid/log/ifbr-rac2/client/ocrconfig_26000.log.

2013-09-23 18:47:57.371

[client(26000)]CRS-2101:The OLR was formatted using version 3.

2013-09-23 18:48:12.906

[ohasd(26043)]CRS-2112:The OLR service started on node ifbr-rac2.

2013-09-23 18:48:13.108

[ohasd(26043)]CRS-2772:Server 'ifbr-rac2' has been assigned to pool 'Free'.

2013-09-23 18:48:39.611

[cssd(27305)]CRS-1713:CSSD daemon is started in exclusive mode

2013-09-23 18:49:12.399

[cssd(27305)]CRS-1707:Lease acquisition for node ifbr-rac2 number 2 completed

[cssd(27305)]CRS-1636:The CSS daemon was started in exclusive mode but found an active CSS daemon on node ifbr-rac1 and is terminating; details at (:CSSNM00006:) in /u01/app/11.2.0/grid/log/ifbr-rac2/cssd/ocssd.log

2013-09-23 18:49:12.449

[cssd(27305)]CRS-1603:CSSD on node ifbr-rac2 shutdown by user.

2013-09-23 18:49:12.599

[ohasd(26043)]CRS-2765:Resource 'ora.cssdmonitor' has failed on server 'ifbr-rac2'.

2013-09-23 18:49:34.241

[cssd(27552)]CRS-1713:CSSD daemon is started in clustered mode

2013-09-23 18:49:45.465

[cssd(27552)]CRS-1707:Lease acquisition for node ifbr-rac2 number 2 completed

2013-09-23 18:49:45.498

[cssd(27552)]CRS-1605:CSSD voting file is online: /dev/raw/raw1; details in /u01/app/11.2.0/grid/log/ifbr-rac2/cssd/ocssd.log.

2013-09-23 18:49:56.585

[cssd(27552)]CRS-1601:CSSD Reconfiguration complete. Active nodes are ifbr-rac1 ifbr-rac2 .

2013-09-23 18:49:58.080

[ctssd(27611)]CRS-2403:The Cluster Time Synchronization Service on host ifbr-rac2 is in observer mode.

2013-09-23 18:49:58.086

[ctssd(27611)]CRS-2407:The new Cluster Time Synchronization Service reference node is host ifbr-rac1.

2013-09-23 18:49:59.032

[ctssd(27611)]CRS-2401:The Cluster Time Synchronization Service started on host ifbr-rac2.

[client(27641)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.

[client(27645)]CRS-10001:ACFS-9322: done.

2013-09-23 18:50:15.542

[crsd(27763)]CRS-1012:The OCR service started on node ifbr-rac2.

2013-09-23 18:50:17.365

[crsd(27763)]CRS-1201:CRSD started on node ifbr-rac2.

2013-09-23 19:01:04.063

[ctssd(27611)]CRS-2409:The clock on host ifbr-rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.

  • 1. Re: oracle 11g rac installation error
    saurabh Pro
    Currently Being Moderated

    [ctssd(27611)]CRS-2409:The clock on host ifbr-rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.

     

    The above error is because on your both the nodes time is not syncronized. there is time difference on both the node.

     

    The same has been answered on the below link

     

    https://forums.oracle.com/thread/2447918

  • 2. Re: oracle 11g rac installation error
    Levi-Pereira Guru
    Currently Being Moderated

    @user11062519


    You probably ignored the prerequisites.

    For a successful installation you cant ignore the prerequisites, unless you are sure of what you are doing.

    Preparing Your Cluster

    * Install and Configure NTP

     

    Message was edited by: Levi-Pereira

  • 3. Re: oracle 11g rac installation error
    user361671 Newbie
    Currently Being Moderated

    hi,

     

    Thanks for your reply.

    I have configured ntp with -x flaq on both linux machine as you can see below  the output of date and contents of  ntpd files of both machine.

    Pre requisites are executed successfully only two below warnings are given which i ignore. Also i have found that my storage machine (openfiler) date are not synchronize with linux machines does this is the issue?

     

    1) Cannot find interface for vip

    2) PRVF-5416 : Query of NTP daemon failed on all nodes

     

     

    [oracle@ifbr-rac2 ~]$ ssh ifbr-rac1 date

    Tue Sep 24 12:30:22 PKST 2013

     

    [oracle@ifbr-rac2 ~]$ date

    Tue Sep 24 12:30:24 PKST 2013

     

     

    Machine 1

    ************

    # Drop root to id 'ntp:ntp' by default.

    OPTIONS="-x -u ntp:ntp -p /var/run/ntpd.pid"

     

     

    # Set to 'yes' to sync hw clock after successful ntpdate

    SYNC_HWCLOCK=no

     

     

    # Additional options for ntpdate

    NTPDATE_OPTIONS=""

     

    Machine 2

    ************

     

    # Drop root to id 'ntp:ntp' by default.

    OPTIONS="-x -u ntp:ntp -p /var/run/ntpd.pid"

     

     

    # Set to 'yes' to sync hw clock after successful ntpdate

    SYNC_HWCLOCK=no

     

     

    # Additional options for ntpdate

    NTPDATE_OPTIONS=""

     

    Output of NTP Verification utility

    ************************************

     

    Verifying Clock Synchronization across the cluster nodes

     

     

    Checking if Clusterware is installed on all nodes...

    Check of Clusterware install passed

     

     

    Checking if CTSS Resource is running on all nodes...

    Check: CTSS Resource running on all nodes

      Node Name                             Status                 

      ------------------------------------  ------------------------

      ifbr-rac2                             passed                 

      ifbr-rac1                             passed                 

    Result: CTSS resource check passed

     

     

     

     

    Querying CTSS for time offset on all nodes...

    Result: Query of CTSS for time offset passed

     

     

    Check CTSS state started...

    Check: CTSS state

      Node Name                             State                  

      ------------------------------------  ------------------------

      ifbr-rac2                             Observer               

      ifbr-rac1                             Observer               

    CTSS is in Observer state. Switching over to clock synchronization checks using NTP

     

     

     

     

    Starting Clock synchronization checks using Network Time Protocol(NTP)...

     

     

    NTP Configuration file check started...

    The NTP configuration file "/etc/ntp.conf" is available on all nodes

    NTP Configuration file check passed

     

     

    Checking daemon liveness...

     

     

    Check: Liveness for "ntpd"

      Node Name                             Running?               

      ------------------------------------  ------------------------

      ifbr-rac2                             yes                    

      ifbr-rac1                             yes                    

    Result: Liveness check passed for "ntpd"

     

     

    Checking NTP daemon command line for slewing option "-x"

    Check: NTP daemon command line

      Node Name                             Slewing Option Set?    

      ------------------------------------  ------------------------

      ifbr-rac2                             yes                    

      ifbr-rac1                             yes                    

    Result:

    NTP daemon slewing option check passed

     

     

    Checking NTP daemon's boot time configuration, in file "/etc/sysconfig/ntpd", for slewing option "-x"

     

     

    Check: NTP daemon's boot time configuration

      Node Name                             Slewing Option Set?    

      ------------------------------------  ------------------------

      ifbr-rac2                             yes                    

      ifbr-rac1                             yes                    

    Result:

    NTP daemon's boot time configuration check for slewing option passed

     

     

    NTP common Time Server Check started...

    PRVF-5408 : NTP Time Server ".LOCL." is common only to the following nodes "ifbr-rac1"

    PRVF-5416 : Query of NTP daemon failed on all nodes

     

     

    Result: Clock synchronization check using Network Time Protocol(NTP) passed

     

     

     

     

    Oracle Cluster Time Synchronization Services check passed

     

     

    Verification of Clock Synchronization across the cluster nodes was successful.

     

     

    host file machine 1

    **********************

    # Do not remove the following line, or various programs

    # that require network functionality will fail.

    127.0.0.1  ifbr-rac1.ifbr.net ifbr-rac1 localhost.localdomain localhost ifbr-rac1

    ::1 localhost6.localdomain6 localhost6

    ## Public Node names

     

    10.16.14.61 ifbr-rac1.ifbr.net ifbr-rac1 /eth0

    10.16.14.62 ifbr-rac2.ifbr.net ifbr-rac2 /eth0

     

    ## Private Network (interconnect)

     

    10.0.1.10 ifbr-rac1-priv ifbr-rac1-prv

    10.0.1.20 ifbr-rac2-priv ifbr-rac2-prv

     

    ## Virtual IPs

     

    10.16.14.71 ifbr-rac1-vip.ifbr.net ifbr-rac1-vip

    10.16.14.72 ifbr-rac2-vip.ifbr.net ifbr-rac2-vip

     

    ## SCAN IP

    10.16.14.65 crs-scan.ifbr.net crs-scan

     

    ## Storage

     

    10.16.14.20 storage-01.ifbr.net storage-01 //eth0

    10.0.1.30 storage-01.ifbr.net storage-01

     

    host file machine 2

    **********************

     

    # Do not remove the following line, or various programs

    # that require network functionality will fail.

    #127.0.0.1      ifbr-rac2  localhost.localdomain localhost

    127.0.0.1  ifbr-rac2.ifbr.net           ifbr-rac2 localhost.localdomain localhos

    t ifbr-rac2

     

     

    ::1             localhost6.localdomain6 localhost6

    ## Public Node names

     

     

    10.16.14.61     ifbr-rac1.ifbr.net      ifbr-rac1 /eth0

    10.16.14.62     ifbr-rac2.ifbr.net      ifbr-rac2 /eth0

     

     

    ## Private Network (interconnect)

     

     

    10.0.1.10       ifbr-rac1-priv  ifbr-rac1-prv

    10.0.1.20       ifbr-rac2-priv  ifbr-rac2-prv

     

     

    ## Virtual IPs

     

     

    10.16.14.71     ifbr-rac1-vip.ifbr.net  ifbr-rac1-vip

    10.16.14.72     ifbr-rac2-vip.ifbr.net  ifbr-rac2-vip

     

     

    ## SCAN IP

    10.16.14.65     crs-scan.ifbr.net       crs-scan

     

     

    ## Storage

     

     

    10.16.14.20     storage-01.ifbr.net     storage-01      //eth0

    10.0.1.30       storage-01.ifbr.net     storage-01

  • 4. Re: oracle 11g rac installation error
    mkeskin Explorer
    Currently Being Moderated

    Could you send the output of below command ?

     

    ntpstat && echo $?

     

    Also check the delay and offset values

     

    watch ntpq -pn

     

    Here is the sample ;

     

    Every 2.0s: ntpq -pn                                                                                                                                                                                   

     

     

         remote           refid      st t when poll reach   delay   offset  jitter

    ==============================================================================

    *NTP_SERVER_IP   129.6.15.29      2 u  129 1024  377    0.395    0.594   2.147

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points