9 Replies Latest reply: Jun 14, 2011 6:30 PM by user12090988 RSS

    11g R2 GRID instillation (RAC) failed

    poorna
      Hi,

      Oracle Version : 11gR2
      Operating system: Cent OS 5

      when we are trying to install grid at the end of the grid instillation we get this error

      [INS-20802] Oracle Cluster Verification Utility failed



      and the log file contains
      INFO: Checking name resolution setup for "qfund-rac.qfund.net"...
      INFO: Verification of SCAN VIP and Listener setup passed
      INFO: OCR detected on ASM. Running ACFS Integrity checks...
      INFO: Starting check to see if ASM is running on all cluster nodes...
      INFO: ASM Running check passed. ASM is running on all cluster nodes
      INFO: Starting Disk Groups check to see if at least one Disk Group configured...
      INFO: Disk Group Check passed. At least one Disk Group configured
      INFO: Task ACFS Integrity check passed
      INFO: Checking Oracle Cluster Voting Disk configuration...
      INFO: Oracle Cluster Voting Disk configuration check passed
      INFO: User "grid" is not part of "root" group. Check passed
      INFO: Checking if Clusterware is installed on all nodes...
      INFO: Check of Clusterware install passed
      INFO: Checking if CTSS Resource is running on all nodes...
      INFO: CTSS resource check passed
      INFO: Querying CTSS for time offset on all nodes...
      INFO: Query of CTSS for time offset passed
      INFO: Check CTSS state started...
      INFO: CTSS is in Observer state. Switching over to clock synchronization checks using NTP
      INFO: Starting Clock synchronization checks using Network Time Protocol(NTP)...
      INFO: NTP Configuration file check started...
      INFO: NTP Configuration file check passed
      INFO: Checking daemon liveness...
      INFO: Liveness check failed for "ntpd"
      INFO: Check failed on nodes: 
      INFO:      rac2,rac1
      INFO: PRVF-5415 : Check to see if NTP daemon is running failed
      INFO: Clock synchronization check using Network Time Protocol(NTP) failed
      INFO: PRVF-9652 : Cluster Time Synchronization Services check failed
      INFO: Post-check for cluster services setup was unsuccessful on all the nodes. 
      INFO: 
      WARNING: 
      INFO: Completed Plugin named: Oracle Cluster Verification Utility
      INFO: Oracle Cluster Verification Utility failed.
      INFO: Oracle Cluster Verification Utility failed.
      INFO: ConfigClient.executeToolsInAggregate action performed
      INFO: Exiting ConfigClient.executeToolsInAggregate method
      INFO: Calling event ConfigToolsExecuted
      INFO: 
       The Runconfig command constructed is /u01/11.2.0/grid/oui/bin/runConfig.sh ORACLE_HOME=/u01/11.2.0/grid MODE=perform ACTION=configure RERUN=false $*
      INFO: Created a new file /u01/11.2.0/grid/cfgtoollogs/configToolFailedCommands
      INFO: Since the option is to overwrite the existing /u01/11.2.0/grid/cfgtoollogs/configToolFailedCommands file, backing it up
      INFO: The backed up file name is /u01/11.2.0/grid/cfgtoollogs/configToolFailedCommands.bak
      INFO: ConfigClient.saveSession method called
      INFO: Calling event ConfigSessionEnding
      INFO: ConfigClient.endSession method called
      INFO: Completed Configuration
      INFO: Shutting down OUISetupDriver.JobExecutorThread
      INFO: Cleaning up, please wait...
      INFO: Dispose the install area control object
      INFO: Update the state machine to STATE_CLEAN
      INFO: All forked task are completed at state setup
      INFO: Completed background operations
      INFO: Moved to state <setup>
      INFO: Performing Configuration
      INFO: Entering ConfigClient.init method
      INFO: ConfigClient.init sOracleHomeLoc=/u01/11.2.0/grid, sTopAggId=oracle.crs
      INFO: Entering ConfigClient.initClientAndSession method
      INFO: ConfigClient.initClientAndSession status : connected to the config framework
      INFO: ConfigClient.initClientAndSession session begun oracle.sysman.emCfg.client.CfwSession@822467d
      INFO: ConfigClient.initClientAndSession m_oAggregate=[Loracle.sysman.emCfg.common.IAggregate;@241bcb7
      INFO: Configuration log directory - /u01/11.2.0/grid/cfgtoollogs
      INFO: Exiting ConfigClient.init method
      INFO: Calling event ConfigSessionInitialized
      INFO: ConfigClient.registerOutErrStream method called
      INFO: Entering ConfigClient.getToolsList method
      INFO: Selecting job named 'Oracle Cluster Verification Utility' for retry
      INFO: Updating Transient Parameters in the Aggregates
      INFO: Updating Transient Parameters for oracle.crs
      INFO: Updating Transient Parameters for oracle.assistants.netca.client
      INFO: Updating Transient Parameters for OuiConfigVariables
      INFO: Updating Transient Parameters for oracle.assistants.asm
      INFO: Setting value to transient variable S_ASMMONITORPASSWORD
      INFO: Setting value to transient variable S_ASMPASSWORD
      INFO: Setting value to transient variable s_asmcaArgs
      INFO: Setting value to transient variable s_ASMPasswordFlag
      INFO: Setting value to transient variable s_ASMMonitorPasswordFlag
      INFO: Successfully updated Transient Parameters in the Aggregates
      INFO: Configuration log directory - /u01/11.2.0/grid/cfgtoollogs
      INFO: 
       The Runconfig command constructed is /u01/11.2.0/grid/oui/bin/runConfig.sh ORACLE_HOME=/u01/11.2.0/grid MODE=perform ACTION=configure RERUN=true $*
      INFO: Since the option is to overwrite the existing /u01/11.2.0/grid/cfgtoollogs/configToolAllCommands file, backing it up
      INFO: The backed up file name is /u01/11.2.0/grid/cfgtoollogs/configToolAllCommands.bak.1
      INFO: Entering ConfigClient.executeSelectedToolsInAggregate method
      INFO: ConfigClient.executeSelectedToolsInAggregate oAggregate=oracle.crs:oracle.crs:11.2.0.1.0:common
      INFO: Entering ConfigClient.assignAction method
      INFO: ConfigClient.assignAction actionref=[Loracle.sysman.emCfg.common.IActionReference;@580d84b4
      INFO: ConfigClient.assignAction action is of type :configuration
      INFO: Exiting ConfigClient.assignAction method
      INFO: ConfigClient.executeSelectedToolsInAggregate action assigned
      INFO: Started Plugin named: Oracle Cluster Verification Utility
      INFO: Found associated job
      INFO: Starting 'Oracle Cluster Verification Utility'
      INFO: Starting 'Oracle Cluster Verification Utility'
      INFO: Performing post-checks for cluster services setup 
      INFO: Checking node reachability...
      INFO: Node reachability check passed from node "rac1"
      INFO: Checking user equivalence...
      INFO: User equivalence check passed for user "grid"
      INFO: Checking time zone consistency...
      INFO: Time zone consistency check passed.
      INFO: Checking Cluster manager integrity... 
      INFO: Checking CSS daemon...
      INFO: Oracle Cluster Synchronization Services appear to be online.
      INFO: Cluster manager integrity check passed
      INFO: UDev attributes check for OCR locations started...
      INFO: UDev attributes check passed for OCR locations 
      INFO: UDev attributes check for Voting Disk locations started...
      INFO: UDev attributes check passed for Voting Disk locations 
      INFO: Default user file creation mask check passed
      INFO: Checking cluster integrity...
      INFO: Cluster integrity check passed
      INFO: Checking OCR integrity...
      INFO: Checking the absence of a non-clustered configuration...
      INFO: All nodes free of non-clustered, local-only configurations
      INFO: ASM Running check passed. ASM is running on all cluster nodes
      INFO: Checking OCR config file "/etc/oracle/ocr.loc"...
      INFO: OCR config file "/etc/oracle/ocr.loc" check successful
      INFO: Disk group for ocr location "+GRID" available on all the nodes
      INFO: Checking size of the OCR location "+GRID" ...
      INFO: Size check for OCR location "+GRID" successful...
      INFO: Size check for OCR location "+GRID" successful...
      INFO: WARNING: 
      INFO: This check does not verify the integrity of the OCR contents. Execute 'ocrcheck' as a privileged user to verify the contents of OCR.
      INFO: OCR integrity check passed
      INFO: Checking CRS integrity...
      INFO: CRS integrity check passed
      INFO: Checking node application existence...
      INFO: Checking existence of VIP node application (required)
      INFO: Check passed. 
      INFO: Checking existence of ONS node application (optional)
      INFO: Check passed. 
      INFO: Checking existence of GSD node application (optional)
      INFO: Check ignored. 
      INFO: Checking existence of EONS node application (optional)
      INFO: Check passed. 
      INFO: Checking existence of NETWORK node application (optional)
      INFO: Check passed. 
      INFO: Checking Single Client Access Name (SCAN)...
      INFO: Checking name resolution setup for "qfund-rac.qfund.net"...
      INFO: Verification of SCAN VIP and Listener setup passed
      INFO: OCR detected on ASM. Running ACFS Integrity checks...
      INFO: Starting check to see if ASM is running on all cluster nodes...
      INFO: ASM Running check passed. ASM is running on all cluster nodes
      INFO: Starting Disk Groups check to see if at least one Disk Group configured...
      INFO: Disk Group Check passed. At least one Disk Group configured
      INFO: Task ACFS Integrity check passed
      INFO: Checking Oracle Cluster Voting Disk configuration...
      INFO: Oracle Cluster Voting Disk configuration check passed
      INFO: User "grid" is not part of "root" group. Check passed
      INFO: Checking if Clusterware is installed on all nodes...
      INFO: Check of Clusterware install passed
      INFO: Checking if CTSS Resource is running on all nodes...
      INFO: CTSS resource check passed
      INFO: Querying CTSS for time offset on all nodes...
      INFO: Query of CTSS for time offset passed
      INFO: Check CTSS state started...
      INFO: CTSS is in Observer state. Switching over to clock synchronization checks using NTP
      INFO: Starting Clock synchronization checks using Network Time Protocol(NTP)...
      INFO: NTP Configuration file check started...
      INFO: NTP Configuration file check passed
      INFO: Checking daemon liveness...
      INFO: Liveness check failed for "ntpd"
      INFO: Check failed on nodes: 
      INFO:      rac2,rac1
      INFO: PRVF-5415 : Check to see if NTP daemon is running failed
      INFO: Clock synchronization check using Network Time Protocol(NTP) failed
      INFO: PRVF-9652 : Cluster Time Synchronization Services check failed
      INFO: Post-check for cluster services setup was unsuccessful on all the nodes. 
      INFO: 
      WARNING: 
      INFO: Completed Plugin named: Oracle Cluster Verification Utility
      INFO: Oracle Cluster Verification Utility failed.
      INFO: Oracle Cluster Verification Utility failed.
      INFO: ConfigClient.executeSelectedToolsInAggregate action performed
      INFO: Exiting ConfigClient.executeSelectedToolsInAggregate method
      INFO: 
       The Runconfig command constructed is /u01/11.2.0/grid/oui/bin/runConfig.sh ORACLE_HOME=/u01/11.2.0/grid MODE=perform ACTION=configure RERUN=false $*
      INFO: Since the option is to overwrite the existing /u01/11.2.0/grid/cfgtoollogs/configToolFailedCommands file, backing it up
      INFO: The backed up file name is /u01/11.2.0/grid/cfgtoollogs/configToolFailedCommands.bak.1
      INFO: ConfigClient.saveSession method called
      INFO: Calling event ConfigSessionEnding
      INFO: ConfigClient.endSession method called
      INFO: Completed Configuration
      Please help me how to solve this problem

      Thanks & Regards,
      Poorna Prasad.S

      Edited by: SIDDABATHUNI on Apr 27, 2011 6:20 PM
        • 1. Re: 11g R2 GRID instillation (RAC) failed
          854421
          It sounds like CRS installed but it is not passing the cluster verification. Run the post-install cluvfy check and post the output:

          cluvfy stage -post crsinst -n <your nodes> -verbose
          • 2. Re: 11g R2 GRID instillation (RAC) failed
            poorna
            Hi AllyourDatabase,

            Here is the output for the command mentioned below.
            [grid@rac1 bin]$  ./cluvfy stage -post crsinst -n rac1 -verbose
            
            Performing post-checks for cluster services setup
            
            Checking node reachability...
            
            Check: Node reachability from node "rac1"
              Destination Node                      Reachable?
              ------------------------------------  ------------------------
              rac1                                  yes
            Result: Node reachability check passed from node "rac1"
            
            
            Checking user equivalence...
            
            Check: User equivalence for user "grid"
              Node Name                             Comment
              ------------------------------------  ------------------------
              rac1                                  passed
            Result: User equivalence check passed for user "grid"
            Checking time zone consistency...
            Time zone consistency check passed.
            
            
            Checking Cluster manager integrity...
            
            Checking CSS daemon...
            
              Node Name                             Status
              ------------------------------------  ------------------------
              rac1                                  running
            
            Oracle Cluster Synchronization Services appear to be online.
            
            Cluster manager integrity check passed
            
            
            UDev attributes check for OCR locations started...
            Result: UDev attributes check passed for OCR locations
            
            
            UDev attributes check for Voting Disk locations started...
            Result: UDev attributes check passed for Voting Disk locations
            
            
            Check default user file creation mask
              Node Name     Available                 Required                  Comment
              ------------  ------------------------  ------------------------  ----------
              rac1          0022                      0022                      passed
            Result: Default user file creation mask check passed
            
            Checking cluster integrity...
            
              Node Name
              ------------------------------------
              rac1
              rac2
            
            Cluster integrity check passed
            
            
            Checking OCR integrity...
            
            Checking the absence of a non-clustered configuration...
            All nodes free of non-clustered, local-only configurations
            
            
            ASM Running check passed. ASM is running on all cluster nodes
            
            Checking OCR config file "/etc/oracle/ocr.loc"...
            
            OCR config file "/etc/oracle/ocr.loc" check successful
            
            
            Disk group for ocr location "+GRID" available on all the nodes
            
            
            Checking size of the OCR location "+GRID" ...
            
            Size check for OCR location "+GRID" successful...
            
            WARNING:
            This check does not verify the integrity of the OCR contents. Execute 'ocrcheck' as a privileged user to verify the contents of OCR.
            
            OCR integrity check passed
            
            Checking CRS integrity...
            The Oracle clusterware is healthy on node "rac1"
            
            CRS integrity check passed
            
            Checking node application existence...
            
            Checking existence of VIP node application
              Node Name     Required                  Status                    Comment
              ------------  ------------------------  ------------------------  ----------
              rac1          yes                       online                    passed
            Result: Check passed.
            
            Checking existence of ONS node application
              Node Name     Required                  Status                    Comment
              ------------  ------------------------  ------------------------  ----------
              rac1          no                        online                    passed
            Result: Check passed.
            
            Checking existence of GSD node application
              Node Name     Required                  Status                    Comment
              ------------  ------------------------  ------------------------  ----------
              rac1          no                        does not exist            ignored
            Result: Check ignored.
            
            Checking existence of EONS node application
              Node Name     Required                  Status                    Comment
              ------------  ------------------------  ------------------------  ----------
              rac1          no                        online                    passed
            Result: Check passed.
            
            Checking existence of NETWORK node application
              Node Name     Required                  Status                    Comment
              ------------  ------------------------  ------------------------  ----------
              rac1          no                        online                    passed
            Result: Check passed.
            
            
            Checking Single Client Access Name (SCAN)...
              SCAN VIP name     Node          Running?      ListenerName  Port          Running?
              ----------------  ------------  ------------  ------------  ------------  ------------
              qfund-rac.qfund.net  rac2          true          LISTENER      1521          true
            
            Checking name resolution setup for "qfund-rac.qfund.net"...
              SCAN Name     IP Address                Status                    Comment
              ------------  ------------------------  ------------------------  ----------
              qfund-rac.qfund.net  192.168.8.118             passed
              qfund-rac.qfund.net  192.168.8.119             passed
              qfund-rac.qfund.net  192.168.8.117             passed
            
            Verification of SCAN VIP and Listener setup passed
            OCR detected on ASM. Running ACFS Integrity checks...
            
            Starting check to see if ASM is running on all cluster nodes...
            
            ASM Running check passed. ASM is running on all cluster nodes
            
            Starting Disk Groups check to see if at least one Disk Group configured...
            Disk Group Check passed. At least one Disk Group configured
            
            Task ACFS Integrity check passed
            
            Checking Oracle Cluster Voting Disk configuration...
            
            Oracle Cluster Voting Disk configuration check passed
            
            Checking to make sure user "grid" is not in "root" group
              Node Name     Status                    Comment
              ------------  ------------------------  ------------------------
              rac1          does not exist            passed
            Result: User "grid" is not part of "root" group. Check passed
            
            Checking if Clusterware is installed on all nodes...
            Check of Clusterware install passed
            
            Checking if CTSS Resource is running on all nodes...
            Check: CTSS Resource running on all nodes
              Node Name                             Status
              ------------------------------------  ------------------------
              rac1                                  passed
            Result: CTSS resource check passed
            
            
            Querying CTSS for time offset on all nodes...
            Result: Query of CTSS for time offset passed
            
            Check CTSS state started...
            Check: CTSS state
              Node Name                             State
              ------------------------------------  ------------------------
              rac1                                  Observer
            CTSS is in Observer state. Switching over to clock synchronization checks using NTP
            
            
            Starting Clock synchronization checks using Network Time Protocol(NTP)...
            
            NTP Configuration file check started...
            The NTP configuration file "/etc/ntp.conf" is available on all nodes
            NTP Configuration file check passed
            
            Checking daemon liveness...
            
            Check: Liveness for "ntpd"
              Node Name                             Running?
              ------------------------------------  ------------------------
              rac1                                  no
            Result: Liveness check failed for "ntpd"
            PRVF-5415 : Check to see if NTP daemon is running failed
            Result: Clock synchronization check using Network Time Protocol(NTP) failed
            
            
            PRVF-9652 : Cluster Time Synchronization Services check failed
            
            Post-check for cluster services setup was unsuccessful on all the nodes.
            Thanks & Regards,
            Poorna Prasad.S
            • 3. Re: 11g R2 GRID instillation (RAC) failed
              poorna
              Hi,

              Here is the output for the command with both nodes.
              [grid@rac1 bin]$  ./cluvfy stage -post crsinst -n  rac1,rac2 -verbose
              
              Performing post-checks for cluster services setup
              
              Checking node reachability...
              
              Check: Node reachability from node "rac1"
                Destination Node                      Reachable?
                ------------------------------------  ------------------------
                rac2                                  yes
                rac1                                  yes
              Result: Node reachability check passed from node "rac1"
              
              
              Checking user equivalence...
              
              Check: User equivalence for user "grid"
                Node Name                             Comment
                ------------------------------------  ------------------------
                rac2                                  passed
                rac1                                  passed
              Result: User equivalence check passed for user "grid"
              Checking time zone consistency...
              Time zone consistency check passed.
              
              
              Checking Cluster manager integrity...
              
              Checking CSS daemon...
              
                Node Name                             Status
                ------------------------------------  ------------------------
                rac2                                  running
                rac1                                  running
              
              Oracle Cluster Synchronization Services appear to be online.
              
              Cluster manager integrity check passed
              
              
              UDev attributes check for OCR locations started...
              Result: UDev attributes check passed for OCR locations
              
              
              UDev attributes check for Voting Disk locations started...
              Result: UDev attributes check passed for Voting Disk locations
              
              
              Check default user file creation mask
                Node Name     Available                 Required                  Comment
                ------------  ------------------------  ------------------------  ----------
                rac2          0022                      0022                      passed
                rac1          0022                      0022                      passed
              Result: Default user file creation mask check passed
              
              Checking cluster integrity...
              
                Node Name
                ------------------------------------
                rac1
                rac2
              
              Cluster integrity check passed
              
              
              Checking OCR integrity...
              
              Checking the absence of a non-clustered configuration...
              All nodes free of non-clustered, local-only configurations
              
              
              ASM Running check passed. ASM is running on all cluster nodes
              
              Checking OCR config file "/etc/oracle/ocr.loc"...
              
              OCR config file "/etc/oracle/ocr.loc" check successful
              
              
              Disk group for ocr location "+GRID" available on all the nodes
              
              
              Checking size of the OCR location "+GRID" ...
              
              Size check for OCR location "+GRID" successful...
              Size check for OCR location "+GRID" successful...
              
              WARNING:
              This check does not verify the integrity of the OCR contents. Execute 'ocrcheck' as a privileged user to verify the contents of OCR.
              
              OCR integrity check passed
              
              Checking CRS integrity...
              The Oracle clusterware is healthy on node "rac2"
              The Oracle clusterware is healthy on node "rac1"
              
              CRS integrity check passed
              
              Checking node application existence...
              
              Checking existence of VIP node application
                Node Name     Required                  Status                    Comment
                ------------  ------------------------  ------------------------  ----------
                rac2          yes                       online                    passed
                rac1          yes                       online                    passed
              Result: Check passed.
              
              Checking existence of ONS node application
                Node Name     Required                  Status                    Comment
                ------------  ------------------------  ------------------------  ----------
                rac2          no                        online                    passed
                rac1          no                        online                    passed
              Result: Check passed.
              
              Checking existence of GSD node application
                Node Name     Required                  Status                    Comment
                ------------  ------------------------  ------------------------  ----------
                rac2          no                        does not exist            ignored
                rac1          no                        does not exist            ignored
              Result: Check ignored.
              
              Checking existence of EONS node application
                Node Name     Required                  Status                    Comment
                ------------  ------------------------  ------------------------  ----------
                rac2          no                        online                    passed
                rac1          no                        online                    passed
              Result: Check passed.
              
              Checking existence of NETWORK node application
                Node Name     Required                  Status                    Comment
                ------------  ------------------------  ------------------------  ----------
                rac2          no                        online                    passed
                rac1          no                        online                    passed
              Result: Check passed.
              
              
              Checking Single Client Access Name (SCAN)...
                SCAN VIP name     Node          Running?      ListenerName  Port          Running?
                ----------------  ------------  ------------  ------------  ------------  ------------
                qfund-rac.qfund.net  rac2          true          LISTENER      1521          true
              
              Checking name resolution setup for "qfund-rac.qfund.net"...
                SCAN Name     IP Address                Status                    Comment
                ------------  ------------------------  ------------------------  ----------
                qfund-rac.qfund.net  192.168.8.117             passed
                qfund-rac.qfund.net  192.168.8.119             passed
                qfund-rac.qfund.net  192.168.8.118             passed
              
              Verification of SCAN VIP and Listener setup passed
              OCR detected on ASM. Running ACFS Integrity checks...
              
              Starting check to see if ASM is running on all cluster nodes...
              
              ASM Running check passed. ASM is running on all cluster nodes
              
              Starting Disk Groups check to see if at least one Disk Group configured...
              Disk Group Check passed. At least one Disk Group configured
              
              Task ACFS Integrity check passed
              
              Checking Oracle Cluster Voting Disk configuration...
              
              Oracle Cluster Voting Disk configuration check passed
              
              Checking to make sure user "grid" is not in "root" group
                Node Name     Status                    Comment
                ------------  ------------------------  ------------------------
                rac2          does not exist            passed
                rac1          does not exist            passed
              Result: User "grid" is not part of "root" group. Check passed
              
              Checking if Clusterware is installed on all nodes...
              Check of Clusterware install passed
              
              Checking if CTSS Resource is running on all nodes...
              Check: CTSS Resource running on all nodes
                Node Name                             Status
                ------------------------------------  ------------------------
                rac2                                  passed
                rac1                                  passed
              Result: CTSS resource check passed
              
              
              Querying CTSS for time offset on all nodes...
              Result: Query of CTSS for time offset passed
              
              Check CTSS state started...
              Check: CTSS state
                Node Name                             State
                ------------------------------------  ------------------------
                rac2                                  Observer
                rac1                                  Observer
              CTSS is in Observer state. Switching over to clock synchronization checks using NTP
              
              
              Starting Clock synchronization checks using Network Time Protocol(NTP)...
              
              NTP Configuration file check started...
              The NTP configuration file "/etc/ntp.conf" is available on all nodes
              NTP Configuration file check passed
              
              Checking daemon liveness...
              
              Check: Liveness for "ntpd"
                Node Name                             Running?
                ------------------------------------  ------------------------
                rac2                                  no
                rac1                                  no
              Result: Liveness check failed for "ntpd"
              PRVF-5415 : Check to see if NTP daemon is running failed
              Result: Clock synchronization check using Network Time Protocol(NTP) failed
              
              
              PRVF-9652 : Cluster Time Synchronization Services check failed
              
              Post-check for cluster services setup was unsuccessful on all the nodes.
              Thanks & Regards,
              Poorna Prasad.S

              Edited by: SIDDABATHUNI on Apr 27, 2011 6:32 PM
              • 4. Re: 11g R2 GRID instillation (RAC) failed
                854421
                It looks like everything passed except the time synchronization sections.

                You either need to set up and run ntpd, or remove/rename /etc/ntp.conf so CTSS knows that it should be active.
                • 5. Re: 11g R2 GRID instillation (RAC) failed
                  poorna
                  Hi AllYourDataBase,

                  Thanks for your replay now my problem was solved and was successfully installed but after running the same command there is one problem .
                   [grid@rac1 bin]$  ./cluvfy stage -post crsinst -n  rac1,rac2 -verbose
                   
                  Performing post-checks for cluster services setup
                   
                  Checking node reachability...
                   
                  Check: Node reachability from node "rac1"
                    Destination Node                      Reachable?
                    ------------------------------------  ------------------------
                    rac2                                  yes
                    rac1                                  yes
                  Result: Node reachability check passed from node "rac1"
                   
                   
                  Checking user equivalence...
                   
                  Check: User equivalence for user "grid"
                    Node Name                             Comment
                    ------------------------------------  ------------------------
                    rac2                                  passed
                    rac1                                  passed
                  Result: User equivalence check passed for user "grid"
                  Checking time zone consistency...
                  Time zone consistency check passed.
                   
                   
                  Checking Cluster manager integrity...
                   
                  Checking CSS daemon...
                   
                    Node Name                             Status
                    ------------------------------------  ------------------------
                    rac2                                  running
                    rac1                                  running
                   
                  Oracle Cluster Synchronization Services appear to be online.
                   
                  Cluster manager integrity check passed
                   
                  
                  Cluster integrity check passed
                  
                  
                  Checking OCR integrity...
                  
                  Checking the absence of a non-clustered configuration...
                  All nodes free of non-clustered, local-only configurations
                  
                  
                  ASM Running check passed. ASM is running on all cluster nodes
                  
                  Checking OCR config file "/etc/oracle/ocr.loc"...
                  
                  OCR config file "/etc/oracle/ocr.loc" check successful
                  
                  
                  Disk group for ocr location "+GRID" available on all the nodes
                  
                  
                  Checking size of the OCR location "+GRID" ...
                  
                  Size check for OCR location "+GRID" successful...
                  Size check for OCR location "+GRID" successful...
                  
                  WARNING:
                  This check does not verify the integrity of the OCR contents. Execute 'ocrcheck'
                   as a privileged user to verify the contents of OCR.
                  
                  OCR integrity check passed
                  
                  Checking CRS integrity...
                  The Oracle clusterware is healthy on node "rac2"
                  The Oracle clusterware is healthy on node "rac1"
                  
                  CRS integrity check passed
                  
                  Checking node application existence...
                  
                  Checking existence of VIP node application
                    Node Name     Required                  Status                    Comment
                    ------------  ------------------------  ------------------------  ----------
                    rac2          yes                       online                    passed
                    rac1          yes                       online                    passed
                  Result: Check passed.
                  
                  Checking existence of ONS node application
                    Node Name     Required                  Status                    Comment
                    ------------  ------------------------  ------------------------  ----------
                    rac2          no                        online                    passed
                    rac1          no                        online                    passed
                  Result: Check passed.
                  
                  Checking existence of GSD node application
                    Node Name     Required                  Status                    Comment
                    ------------  ------------------------  ------------------------  ----------
                    rac2          no                        does not exist            ignored
                    rac1          no                        does not exist            ignored
                  Result: Check ignored.
                  
                  Checking existence of EONS node application
                    Node Name     Required                  Status                    Comment
                    ------------  ------------------------  ------------------------  ----------
                    rac2          no                        online                    passed
                    rac1          no                        online                    passed
                  Result: Check passed.
                  
                  Checking existence of NETWORK node application
                    Node Name     Required                  Status                    Comment
                    ------------  ------------------------  ------------------------  ----------
                    rac2          no                        online                    passed
                    rac1          no                        online                    passed
                  Result: Check passed.
                  
                  
                  Checking Single Client Access Name (SCAN)...
                    SCAN VIP name     Node          Running?      ListenerName  Port          Runn
                  ing?
                    ----------------  ------------  ------------  ------------  ------------  ----
                  --------
                    qfund-rac.qfund.net  rac2          true          LISTENER      1521          t
                  rue
                  
                  Checking name resolution setup for "qfund-rac.qfund.net"...
                    SCAN Name     IP Address                Status                    Comment
                    ------------  ------------------------  ------------------------  ----------
                    qfund-rac.qfund.net  192.168.8.119             passed
                  
                    qfund-rac.qfund.net  192.168.8.117             passed
                  
                    qfund-rac.qfund.net  192.168.8.118             passed
                  
                  
                  Verification of SCAN VIP and Listener setup passed
                  OCR detected on ASM. Running ACFS Integrity checks...
                  
                  Starting check to see if ASM is running on all cluster nodes...
                  
                  ASM Running check passed. ASM is running on all cluster nodes
                  
                  Starting Disk Groups check to see if at least one Disk Group configured...
                  Disk Group Check passed. At least one Disk Group configured
                  
                  Task ACFS Integrity check passed
                  
                  Checking Oracle Cluster Voting Disk configuration...
                  
                  Oracle Cluster Voting Disk configuration check passed
                  
                  Checking to make sure user "grid" is not in "root" group
                    Node Name     Status                    Comment
                    ------------  ------------------------  ------------------------
                    rac2          does not exist            passed
                    rac1          does not exist            passed
                  Result: User "grid" is not part of "root" group. Check passed
                  
                  Checking if Clusterware is installed on all nodes...
                  Check of Clusterware install passed
                  
                  Checking if CTSS Resource is running on all nodes...
                  Check: CTSS Resource running on all nodes
                    Node Name                             Status
                    ------------------------------------  ------------------------
                    rac2                                  passed
                    rac1                                  passed
                  Result: CTSS resource check passed
                  
                  
                  Querying CTSS for time offset on all nodes...
                  Result: Query of CTSS for time offset passed
                  
                  Check CTSS state started...
                  Check: CTSS state
                    Node Name                             State
                    ------------------------------------  ------------------------
                    rac2                                  Observer
                    rac1                                  Observer
                  CTSS is in Observer state. Switching over to clock synchronization checks using
                  NTP
                  
                  
                  Starting Clock synchronization checks using Network Time Protocol(NTP)...
                  
                  NTP Configuration file check started...
                  The NTP configuration file "/etc/ntp.conf" is available on all nodes
                  NTP Configuration file check passed
                  
                  Checking daemon liveness...
                  
                  Check: Liveness for "ntpd"
                    Node Name                             Running?
                    ------------------------------------  ------------------------
                    rac2                                  yes
                    rac1                                  yes
                  Result: Liveness check passed for "ntpd"
                  
                  Checking NTP daemon command line for slewing option "-x"
                  Check: NTP daemon command line
                    Node Name                             Slewing Option Set?
                    ------------------------------------  ------------------------
                    rac2                                  yes
                    rac1                                  yes
                  Result:
                  NTP daemon slewing option check passed
                  
                  Checking NTP daemon's boot time configuration, in file "/etc/sysconfig/ntpd", fo
                  r slewing option "-x"
                  
                  Check: NTP daemon's boot time configuration
                    Node Name                             Slewing Option Set?
                    ------------------------------------  ------------------------
                    rac2                                  yes
                    rac1                                  yes
                  Result:
                  NTP daemon's boot time configuration check for slewing option passed
                  
                  NTP common Time Server Check started...
                  PRVF-5408 : NTP Time Server "208.201.242.2" is common only to the following node
                  s "rac1"
                  PRVF-5408 : NTP Time Server "128.4.40.12" is common only to the following nodes
                  "rac2"
                  PRVF-5408 : NTP Time Server "173.14.55.9" is common only to the following nodes
                  "rac1"
                  PRVF-5408 : NTP Time Server "204.152.184.72" is common only to the following nod
                  es "rac2"
                  NTP Time Server "128.174.38.133" is common to all nodes on which the NTP daemon
                  is running
                  NTP Time Server ".LOCL." is common to all nodes on which the NTP daemon is runni
                  ng
                  Check of common NTP Time Server passed
                  
                  Clock time offset check from NTP Time Server started...
                  Checking on nodes "[rac2, rac1]"...
                  Check: Clock time offset from NTP Time Server
                  
                  Time Server: 128.174.38.133
                  Time Offset Limit: 1000.0 msecs
                    Node Name     Time Offset               Status
                    ------------  ------------------------  ------------------------
                    rac2          16.615                    passed
                    rac1          -24.403                   passed
                  Time Server "128.174.38.133" has time offsets that are within permissible limits
                   for nodes "[rac2, rac1]".
                  Time Server: .LOCL.
                  Time Offset Limit: 1000.0 msecs
                    Node Name     Time Offset               Status
                    ------------  ------------------------  ------------------------
                  PRVF-5413 : Node "rac2" has a time offset of -245270.0 that is beyond permissibl
                  e limit of 1000.0 from NTP Time Server ".LOCL."
                    rac2          -245270.0                 failed
                  PRVF-5413 : Node "rac1" has a time offset of -245333.0 that is beyond permissibl
                  e limit of 1000.0 from NTP Time Server ".LOCL."
                    rac1          -245333.0                 failed
                  Clock time offset check passed
                  
                  Result: Clock synchronization check using Network Time Protocol(NTP) passed
                  
                  
                  Oracle Cluster Time Synchronization Services check passed
                  
                  Post-check for cluster services setup was successful.
                  Regards,
                  Poorna Prasad.S
                  • 6. Re: 11g R2 GRID instillation (RAC) failed
                    854421
                    It looks like your local clock isn't synchronizing with NTP. However, I'm not an NTP expert so I don't know what to do to fix it...
                    • 7. Re: 11g R2 GRID instillation (RAC) failed
                      poorna
                      Hi AllYourDataBase ,


                      Can you please give me steps for how to deinstall 11gR2 Grid .

                      Thanks & Regards,
                      Poorna Prasad.S
                      • 8. Re: 11g R2 GRID instillation (RAC) failed
                        854421
                        run $CRS_HOME/deinstall/deinstall
                        • 9. Re: 11g R2 GRID instillation (RAC) failed
                          user12090988
                          Hi, I am also facing the similar error message. I would like to know how to restart the installation? Should I remove everything and start from scratch?