8 Replies Latest reply: May 14, 2014 12:42 PM by A.A.-Oracle RSS

    Post Cluvfy is failing with below error , some one please help

    1027476

      Hi ,

       

      After installing clusterware , when i run post cluvfy script its giving below error.

       

      Could some one please help me in this to resolve.

       

      Version :  Oracle Clusterware active version on the cluster is [11.2.0.2.0]

       

      Post Cluvfy script :  ./cluvfy stage -post crsinst -n all –verbose

       

      error output :

       

      Oracle Cluster Synchronization Services appear to be online.

       

       

      Cluster manager integrity check passed

       

       

       

       

      UDev attributes check for OCR locations started...

      Result: UDev attributes check passed for OCR locations

       

       

       

       

      UDev attributes check for Voting Disk locations started...

       

       

      ERROR:

      PRVF-9806 : Failed to get storage attributes to compare udev attributes against, udev attributes check aborted

      Result: UDev attributes check failed for Voting Disk locations

       

      Regards

        • 1. Re: Post Cluvfy is failing with below error , some one please help
          J.A.

          Where are you storing your OCR and Voting disk ?

          Did you get an error when you were installing ?

           

          Regards

          • 2. Re: Post Cluvfy is failing with below error , some one please help
            A.A.-Oracle

            Hi,

             

            Even am facing the same issue. We were trying to upgrade the DB to the 11gR3 so did a post check before going ahead (same cluster version currently as above). Voting disks are file based, and no errors while installing which was done more than a month back, any idea?

             

            Regards

             

            • 3. Re: Post Cluvfy is failing with below error , some one please help
              J.A.

              Please run this and send output:

               

              ./crsctl query css votedisk

               

               

              crsctl check crs <<-- for the local node

              ./crsctl check cluster <<-- for remote nodes in the cluster

               

               

              Al run this:

               

               

              ./ocrcheck

               

              Regards

              • 4. Re: Post Cluvfy is failing with below error , some one please help
                A.A.-Oracle

                Here are all the outputs:

                 

                [root@vmsomxyia011 tmp]#  crsctl query css votedisk

                ##  STATE    File Universal Id                File Name Disk group

                --  -----    -----------------                --------- ---------

                1. ONLINE   4b5a1ce8f0e74ffebf88983fc8184a80 (/oracrs/oradata/vote/voting1) []

                2. ONLINE   67be2fc5d20b4f83bf8f1608927a3b20 (/oracrs/oradata/vote/voting2) []

                3. ONLINE   92130e6a24944fb3bf93a85f01f426b8 (/oracrs/oradata/vote/voting3) []

                Located 3 voting disk(s).

                 

                [root@vmsomxyia011 tmp]# crsctl check crs

                CRS-4638: Oracle High Availability Services is online

                CRS-4537: Cluster Ready Services is online

                CRS-4529: Cluster Synchronization Services is online

                CRS-4533: Event Manager is online

                 

                [root@vmsomxyia011 tmp]# crsctl check cluster

                CRS-4537: Cluster Ready Services is online

                CRS-4529: Cluster Synchronization Services is online

                CRS-4533: Event Manager is online

                 

                [root@vmsomxyia011 tmp]# ocrcheck

                Status of Oracle Cluster Registry is as follows :

                         Version                  :          3

                         Total space (kbytes)     :     262120

                         Used space (kbytes)      :       2732

                         Available space (kbytes) :     259388

                         ID                       :  971699623

                         Device/File Name         : /oracrs/oradata/ocr

                                                    Device/File integrity check succeeded

                         Device/File Name         : /oracrs/oradata/ocr2

                                                    Device/File integrity check succeeded

                         Device/File Name         : /oracrs/oradata/ocr3

                                                    Device/File integrity check succeeded

                 

                                                    Device/File not configured

                 

                                                    Device/File not configured

                 

                         Cluster registry integrity check succeeded

                 

                         Logical corruption check succeeded

                 

                [root@vmsomxyia011 tmp]#

                 

                 

                Regards

                AA

                 

                 

                • 5. Re: Post Cluvfy is failing with below error , some one please help
                  J.A.

                  Could you please run this:

                   

                  ./cluvfy stage -post nodeadd -n all -verbose

                   

                  It will check your RAC configuration. Please send output

                   

                  Regards

                  • 6. Re: Post Cluvfy is failing with below error , some one please help
                    A.A.-Oracle

                    All passed, output below:

                    ----------------------------------------------------------------------------------------------

                    bash-3.2$ cluvfy stage -post nodeadd -n all -verbose

                     

                    Performing post-checks for node addition

                     

                    Checking node reachability...

                     

                    Check: Node reachability from node "vmsomxyia011"

                      Destination Node                      Reachable?

                      ------------------------------------  ------------------------

                      vmsomxyia011                          yes

                    Result: Node reachability check passed from node "vmsomxyia011"

                     

                     

                    Checking user equivalence...

                     

                    Check: User equivalence for user "ororacrs"

                      Node Name                             Comment

                      ------------------------------------  ------------------------

                      vmsomxyia011                          passed

                    Result: User equivalence check passed for user "ororacrs"

                     

                    Checking node connectivity...

                     

                    Checking hosts config file...

                      Node Name     Status                    Comment

                      ------------  ------------------------  ------------------------

                      vmsomxyia011  passed

                     

                    Verification of the hosts config file successful

                     

                     

                    Interface information for node "vmsomxyia011"

                    Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU

                    ------ --------------- --------------- --------------- --------------- ----------------- ------

                    eth0   10.115.240.121  10.115.240.0    0.0.0.0         129.91.212.1    00:21:F6:02:02:74 9000

                    eth1   129.91.212.31   129.91.212.0    0.0.0.0         129.91.212.1    00:21:F6:02:00:D6 9000

                    eth1   129.91.212.32   129.91.212.0    0.0.0.0         129.91.212.1    00:21:F6:02:00:D6 9000

                    eth1   129.91.212.34   129.91.212.0    0.0.0.0         129.91.212.1    00:21:F6:02:00:D6 9000

                    eth1   129.91.212.33   129.91.212.0    0.0.0.0         129.91.212.1    00:21:F6:02:00:D6 9000

                    eth2   10.115.248.16   10.115.248.0    0.0.0.0         129.91.212.1    00:21:F6:02:02:82 9000

                    eth2   169.254.246.136 169.254.0.0     0.0.0.0         129.91.212.1    00:21:F6:02:02:82 9000

                     

                     

                    Check: Node connectivity for interface "eth1"

                      Source                          Destination                     Connected?

                      ------------------------------  ------------------------------  ----------------

                      vmsomxyia011[129.91.212.31]     vmsomxyia011[129.91.212.32]     yes

                      vmsomxyia011[129.91.212.31]     vmsomxyia011[129.91.212.34]     yes

                      vmsomxyia011[129.91.212.31]     vmsomxyia011[129.91.212.33]     yes

                      vmsomxyia011[129.91.212.32]     vmsomxyia011[129.91.212.34]     yes

                      vmsomxyia011[129.91.212.32]     vmsomxyia011[129.91.212.33]     yes

                      vmsomxyia011[129.91.212.34]     vmsomxyia011[129.91.212.33]     yes

                    Result: Node connectivity passed for interface "eth1"

                     

                    Result: Node connectivity check passed

                     

                     

                    Checking cluster integrity...

                     

                      Node Name

                      ------------------------------------

                      vmsomxyia011

                     

                    Cluster integrity check passed

                     

                     

                    Checking CRS integrity...

                    The Oracle Clusterware is healthy on node "vmsomxyia011"

                     

                    CRS integrity check passed

                     

                    Checking shared resources...

                     

                    Checking CRS home location...

                    The location "/oracrs/oracle/grid/112" is not shared but is present/creatable on all nodes

                    Result: Shared resources check for node addition passed

                     

                     

                    Checking node connectivity...

                     

                    Checking hosts config file...

                      Node Name     Status                    Comment

                      ------------  ------------------------  ------------------------

                      vmsomxyia011  passed

                     

                    Verification of the hosts config file successful

                     

                     

                    Interface information for node "vmsomxyia011"

                    Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU

                    ------ --------------- --------------- --------------- --------------- ----------------- ------

                    eth0   10.115.240.121  10.115.240.0    0.0.0.0         129.91.212.1    00:21:F6:02:02:74 9000

                    eth1   129.91.212.31   129.91.212.0    0.0.0.0         129.91.212.1    00:21:F6:02:00:D6 9000

                    eth1   129.91.212.32   129.91.212.0    0.0.0.0         129.91.212.1    00:21:F6:02:00:D6 9000

                    eth1   129.91.212.34   129.91.212.0    0.0.0.0         129.91.212.1    00:21:F6:02:00:D6 9000

                    eth1   129.91.212.33   129.91.212.0    0.0.0.0         129.91.212.1    00:21:F6:02:00:D6 9000

                    eth2   10.115.248.16   10.115.248.0    0.0.0.0         129.91.212.1    00:21:F6:02:02:82 9000

                    eth2   169.254.246.136 169.254.0.0     0.0.0.0         129.91.212.1    00:21:F6:02:02:82 9000

                     

                     

                    Check: Node connectivity for interface "eth1"

                      Source                          Destination                     Connected?

                      ------------------------------  ------------------------------  ----------------

                      vmsomxyia011[129.91.212.31]     vmsomxyia011[129.91.212.32]     yes

                      vmsomxyia011[129.91.212.31]     vmsomxyia011[129.91.212.34]     yes

                      vmsomxyia011[129.91.212.31]     vmsomxyia011[129.91.212.33]     yes

                      vmsomxyia011[129.91.212.32]     vmsomxyia011[129.91.212.34]     yes

                      vmsomxyia011[129.91.212.32]     vmsomxyia011[129.91.212.33]     yes

                      vmsomxyia011[129.91.212.34]     vmsomxyia011[129.91.212.33]     yes

                    Result: Node connectivity passed for interface "eth1"

                     

                    Check: Node connectivity for interface "eth2"

                    Result: Node connectivity passed for interface "eth2"

                     

                    Result: Node connectivity check passed

                     

                     

                    Checking node application existence...

                     

                    Checking existence of VIP node application (required)

                      Node Name     Required                  Running?                  Comment

                      ------------  ------------------------  ------------------------  ----------

                      vmsomxyia011  yes                       yes                       passed

                    VIP node application check passed

                     

                    Checking existence of NETWORK node application (required)

                      Node Name     Required                  Running?                  Comment

                      ------------  ------------------------  ------------------------  ----------

                      vmsomxyia011  yes                       yes                       passed

                    NETWORK node application check passed

                     

                    Checking existence of GSD node application (optional)

                      Node Name     Required                  Running?                  Comment

                      ------------  ------------------------  ------------------------  ----------

                      vmsomxyia011  no                        no                        exists

                    GSD node application is offline on nodes "vmsomxyia011"

                     

                    Checking existence of ONS node application (optional)

                      Node Name     Required                  Running?                  Comment

                      ------------  ------------------------  ------------------------  ----------

                      vmsomxyia011  no                        yes                       passed

                    ONS node application check passed

                     

                     

                    Checking Single Client Access Name (SCAN)...

                      SCAN Name         Node          Running?      ListenerName  Port          Running?

                      ----------------  ------------  ------------  ------------  ------------  ------------

                      scan-xyia-12      vmsomxyia011  true          LISTENER_SCAN1  30110         true

                      scan-xyia-12      vmsomxyia011  true          LISTENER_SCAN2  30110         true

                     

                    Checking TCP connectivity to SCAN Listeners...

                      Node          ListenerName              TCP connectivity?

                      ------------  ------------------------  ------------------------

                      localnode     LISTENER_SCAN1            yes

                      localnode     LISTENER_SCAN2            yes

                    TCP connectivity to SCAN Listeners exists on all cluster nodes

                     

                    Checking name resolution setup for "scan-xyia-12"...

                      SCAN Name     IP Address                Status                    Comment

                      ------------  ------------------------  ------------------------  ----------

                      scan-xyia-12  129.91.212.34             passed

                      scan-xyia-12  129.91.212.33             passed

                     

                    Verification of SCAN VIP and Listener setup passed

                     

                    Checking to make sure user "ororacrs" is not in "root" group

                      Node Name     Status                    Comment

                      ------------  ------------------------  ------------------------

                      vmsomxyia011  does not exist            passed

                    Result: User "ororacrs" is not part of "root" group. Check passed

                     

                    Checking if Clusterware is installed on all nodes...

                    Check of Clusterware install passed

                     

                    Checking if CTSS Resource is running on all nodes...

                    Check: CTSS Resource running on all nodes

                      Node Name                             Status

                      ------------------------------------  ------------------------

                      vmsomxyia011                          passed

                    Result: CTSS resource check passed

                     

                     

                    Querying CTSS for time offset on all nodes...

                    Result: Query of CTSS for time offset passed

                     

                    Check CTSS state started...

                    Check: CTSS state

                      Node Name                             State

                      ------------------------------------  ------------------------

                      vmsomxyia011                          Observer

                    CTSS is in Observer state. Switching over to clock synchronization checks using NTP

                     

                     

                    Starting Clock synchronization checks using Network Time Protocol(NTP)...

                     

                    NTP Configuration file check started...

                    The NTP configuration file "/etc/ntp.conf" is available on all nodes

                    NTP Configuration file check passed

                     

                    Checking daemon liveness...

                     

                    Check: Liveness for "ntpd"

                      Node Name                             Running?

                      ------------------------------------  ------------------------

                      vmsomxyia011                          yes

                    Result: Liveness check passed for "ntpd"

                    Check for NTP daemon or service alive passed on all nodes

                     

                    Checking NTP daemon command line for slewing option "-x"

                    Check: NTP daemon command line

                      Node Name                             Slewing Option Set?

                      ------------------------------------  ------------------------

                      vmsomxyia011                          yes

                    Result:

                    NTP daemon slewing option check passed

                     

                    Checking NTP daemon's boot time configuration, in file "/etc/sysconfig/ntpd", for slewing option "-x"

                     

                    Check: NTP daemon's boot time configuration

                      Node Name                             Slewing Option Set?

                      ------------------------------------  ------------------------

                      vmsomxyia011                          yes

                    Result:

                    NTP daemon's boot time configuration check for slewing option passed

                     

                    Checking whether NTP daemon or service is using UDP port 123 on all nodes

                     

                    Check for NTP daemon or service using UDP port 123

                      Node Name                             Port Open?

                      ------------------------------------  ------------------------

                      vmsomxyia011                          yes

                     

                    NTP common Time Server Check started...

                    NTP Time Server ".LOCL." is common to all nodes on which the NTP daemon is running

                    Check of common NTP Time Server passed

                     

                    Clock time offset check from NTP Time Server started...

                    Checking on nodes "[vmsomxyia011]"...

                    Check: Clock time offset from NTP Time Server

                     

                    Time Server: .LOCL.

                    Time Offset Limit: 1000.0 msecs

                      Node Name     Time Offset               Status

                      ------------  ------------------------  ------------------------

                      vmsomxyia011  -12.463                   passed

                    Time Server ".LOCL." has time offsets that are within permissible limits for nodes "[vmsomxyia011]".

                    Clock time offset check passed

                     

                    Result: Clock synchronization check using Network Time Protocol(NTP) passed

                     

                     

                    Oracle Cluster Time Synchronization Services check passed

                     

                    Post-check for node addition was successful.

                    bash-3.2$

                    ------------------------------------------------------------------

                     

                    Regards

                     

                     

                     

                    • 7. Re: Post Cluvfy is failing with below error , some one please help
                      J.A.

                      I think the problem its with your UDEV disks for your OCR_Voting Diskgroup.

                       

                      Everything else seems fine and I didn't find anything on MOS.

                       

                      Could you implement asmlib ? or why are you using UDEV ?

                       

                      Maybe you can move your OCR_Voting disk to a diskgroup using ASMLib disks

                       

                      Also it will help you if you create a SR on MOS.

                       

                      Regards

                      • 8. Re: Post Cluvfy is failing with below error , some one please help
                        A.A.-Oracle

                        Thanks. Yes, we've been checking up on UDEV settings, but since the Voting Disks are on the filer, we don't see any rules for the voting disks. And since OCR is in under the same parent folder, we were expecting to have issues with it too, but that's not the case.

                         

                        bash-3.2$ pwd

                        /oracrs/oradata

                        bash-3.2$ ls -ltr

                        total 10011

                        drwxrwxr-x 2 ororacrs oinstall         5 Mar 27 18:44 vote

                        -rw-r----- 1 root     oinstall 272756736 May 15 03:02 ocr

                        -rw-r----- 1 root     oinstall 272756736 May 15 03:02 ocr2

                        -rw-r----- 1 root     oinstall 272756736 May 15 03:02 ocr3

                        bash-3.2$

                         

                         

                        Regards