1 2 Previous Next 18 Replies Latest reply: Sep 2, 2010 8:58 AM by Christian RSS

    root.sh Script - Failed to call clsssinit (21)

    Christian
      Hey, I try to setup an RAC on SLES 10 with 10gR2

      I have 5 shared disk - 2 OCR Disks - 3 Voting disks

      The clusterware installations is starting, when executing the root.sh script I get an error - see below.

      Where can I get further informations ?

      node01:~ # /opt/oracle/product/10.2/crs/root.sh
      WARNING: directory '/opt/oracle/product/10.2' is not owned by root
      WARNING: directory '/opt/oracle/product' is not owned by root
      WARNING: directory '/opt/oracle' is not owned by root
      Checking to see if Oracle CRS stack is already configured

      Setting the permissions on OCR backup directory
      Setting up NS directories
      Failed to upgrade Oracle Cluster Registry configuration

      The logfiles shows:
      Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle. All rights reserved.
      2010-09-01 11:02:35.435: [ OCRCONF][1582586592]ocrconfig starts...
      2010-09-01 11:02:35.435: [ OCRCONF][1582586592]Upgrading OCR data
      2010-09-01 11:02:35.479: [ OCRCONF][1582586592]OCR already in current version.
      2010-09-01 11:02:35.518: [ OCRCONF][1582586592]Failed to call clsssinit (21)
      2010-09-01 11:02:35.518: [ OCRCONF][1582586592]Failed to make a backup copy of OCR
      2010-09-01 11:02:35.518: [ OCRCONF][1582586592]Exiting [status=failed]...

      #raw -qa
      /dev/raw/raw1: bound to major 8, minor 16
      /dev/raw/raw2: bound to major 8, minor 32
      /dev/raw/raw3: bound to major 8, minor 48
      /dev/raw/raw4: bound to major 8, minor 64
      /dev/raw/raw5: bound to major 8, minor 80

      node01:~ # ls -al /dev/raw/raw1
      crw-r----- 1 root oinstall 162, 1 Sep 1 10:04 /dev/raw/raw1
      node01:~ # ls -al /dev/raw/raw2
      crw-r----- 1 root oinstall 162, 2 Sep 1 10:04 /dev/raw/raw2
      node01:~ # ls -al /dev/raw/raw3
      crw-r--r-- 1 oracle oinstall 162, 3 Sep 1 10:04 /dev/raw/raw3
      node01:~ # ls -al /dev/raw/raw4
      crw-r--r-- 1 oracle oinstall 162, 4 Sep 1 10:04 /dev/raw/raw4
      node01:~ # ls -al /dev/raw/raw5
      crw-r--r-- 1 oracle oinstall 162, 5 Sep 1 10:04 /dev/raw/raw5

      node01:/opt/oracle/product/10.2 # ll
      total 1
      drwxr-xr-x 42 root oinstall 1144 Sep 1 10:55 crs
      drwxrwxr-x 2 oracle dba 48 Aug 27 09:45 db_1
        • 1. Re: root.sh Script - Failed to call clsssinit (21)
          Sebastian Solbach -Dba Community-Oracle
          Hi Christian,

          could it be that you are trying this for a second/multiple times?

          2010-09-01 11:02:35.435: [ OCRCONF][1582586592]Upgrading OCR data
          2010-09-01 11:02:35.479: [ OCRCONF][1582586592]OCR already in current version.

          indicates he already has an OCR on the existing place.
          So it seems your /dev/raw/raw devices are not really empty and already contain data.

          If you try to reinstall, make sure you do a dd on the raw devices before reinstalling.

          Sebastian
          • 2. Re: root.sh Script - Failed to call clsssinit (21)
            Christian
            I formated the disks again - dd if=/dev/zero....

            Is still failing...

            Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle. All rights reserved.
            2010-09-01 12:44:23.443: [ OCRCONF][2282207968]ocrconfig starts...
            2010-09-01 12:44:23.443: [ OCRCONF][2282207968]Upgrading OCR data
            2010-09-01 12:44:23.639: [  OCRRAW][2282207968]propriogid:1: INVALID FORMAT
            2010-09-01 12:44:23.640: [  OCRRAW][2282207968]propriogid:1: INVALID FORMAT
            2010-09-01 12:44:23.640: [  OCRRAW][2282207968]proprioini: both disks are not OCR formatted
            2010-09-01 12:44:23.640: [  OCRRAW][2282207968]proprinit: Could not open raw device
            2010-09-01 12:44:23.640: [ default][2282207968]a_init:7!: Backend init unsuccessful : [26]
            2010-09-01 12:44:23.640: [ OCRCONF][2282207968]Exporting OCR data to [OCRUPGRADEFILE]
            2010-09-01 12:44:23.640: [  OCRAPI][2282207968]a_init:7!: Backend init unsuccessful : [33]
            2010-09-01 12:44:23.640: [ OCRCONF][2282207968]There was no previous version of OCR. error:[PROC-33: Oracle Cluster Registry is not configured
            ]
            2010-09-01 12:44:23.652: [  OCRRAW][2282207968]propriogid:1: INVALID FORMAT
            2010-09-01 12:44:23.653: [  OCRRAW][2282207968]propriogid:1: INVALID FORMAT
            2010-09-01 12:44:23.653: [  OCRRAW][2282207968]proprioini: both disks are not OCR formatted
            2010-09-01 12:44:23.653: [  OCRRAW][2282207968]proprinit: Could not open raw device
            2010-09-01 12:44:23.653: [ default][2282207968]a_init:7!: Backend init unsuccessful : [26]
            2010-09-01 12:44:23.665: [  OCRRAW][2282207968]propriogid:1: INVALID FORMAT
            2010-09-01 12:44:23.665: [  OCRRAW][2282207968]propriogid:1: INVALID FORMAT
            2010-09-01 12:44:23.666: [  OCRRAW][2282207968]ibctx:1:ERROR: INVALID FORMAT
            2010-09-01 12:44:23.666: [  OCRRAW][2282207968]proprinit:problem reading the bootblock or superbloc 22

            2010-09-01 12:44:23.679: [  OCRRAW][2282207968]propriogid:1: INVALID FORMAT
            2010-09-01 12:44:23.680: [  OCRRAW][2282207968]propriogid:1: INVALID FORMAT
            2010-09-01 12:44:23.687: [  OCRRAW][2282207968]propriowv: Vote information on disk 0 [dev/raw/raw1] is adjusted from [0/0] to [1/2]
            2010-09-01 12:44:23.687: [  OCRRAW][2282207968]propriowv: Vote information on disk 1 [dev/raw/raw2] is adjusted from [0/0] to [1/2]
            2010-09-01 12:44:23.705: [  OCRRAW][2282207968]propriniconfig:No 92 configuration
            2010-09-01 12:44:23.705: [  OCRAPI][2282207968]a_init:6a: Backend init successful
            2010-09-01 12:44:23.757: [ OCRCONF][2282207968]Initialized DATABASE keys in OCR
            2010-09-01 12:44:23.773: [ OCRCONF][2282207968]csetskgfrblock0: clsfmt returned with error [4].
            2010-09-01 12:44:23.773: [ OCRCONF][2282207968]Failure in setting block0 [-1]
            2010-09-01 12:44:23.773: [ OCRCONF][2282207968]OCR block 0 is not set !
            2010-09-01 12:44:23.773: [ OCRCONF][2282207968]Exiting [status=failed]...
            • 3. Re: root.sh Script - Failed to call clsssinit (21)
              Christian
              Hey Sebastian,

              can you tell me correct permissions for the raw devices and the /crs folder ?

              All documentation are telling me different settings.

              Do I need to configure the udev file like described in: http://expobadge.com/dldev/dc/file/Linux_device-mapper-udev-CRS-ASM_final9.pdf ??

              Do I need to create a partition on the raw devices ?
              • 4. Re: root.sh Script - Failed to call clsssinit (21)
                Sebastian Solbach -Dba Community-Oracle
                a.) Are the RAW devices you are using partitions or full disks? They have to be partitions.
                b.) The second error is totally different to the first one, so I want to make sure what you did... (since you cannot easily restart just the root.sh in 10.2 you have to deinstall the whole stack and start from scratch).
                Did you clean up the whole install, dd the devices and started new?
                • 5. Re: root.sh Script - Failed to call clsssinit (21)
                  Sebastian Solbach -Dba Community-Oracle
                  Your permissions are o.k. (checked that).

                  OCR: root oinstall 640
                  Vote: oracle oinstall 640
                  ASM: oracle dba 660

                  Regarding the udev. That depends... are you using multipathing?
                  The problem is that 10.2.0.1 had some issues with multipathing... if possible I would use a newer version of the clusterware (even if you use a 10.2 database).

                  - 11.1 does not have the need to setup RAW devices, you can directly use block devices.
                  - 11.2 even does not need that anymore... simple use ASM. However 11.2 introduces a whole lot of new functionality and 11.1 clusterware is pretty much a bugfix to 10.2.

                  Yes: Please use partitions if possible. 11.1 and 11.2 does not need that anymore, but it is still recommended.

                  Sebastian
                  • 6. Re: root.sh Script - Failed to call clsssinit (21)
                    Christian
                    Yeah, missing partitions were the problem.

                    Now the root.sh scripts works - at least a bit ...

                    it does not run on the 2nd node.
                    Looks like a missing rpm

                    /opt/oracle/product/10.2/crs/jdk/jre//bin/java: error while loading shared libraries: libpthread.so.0: cannot open shared object file: No such file or directory

                    # /opt/oracle/product/10.2/crs/root.sh
                    WARNING: directory '/opt/oracle/product/10.2' is not owned by root
                    WARNING: directory '/opt/oracle/product' is not owned by root
                    WARNING: directory '/opt/oracle' is not owned by root
                    Checking to see if Oracle CRS stack is already configured

                    Setting the permissions on OCR backup directory
                    Setting up NS directories
                    Oracle Cluster Registry configuration upgraded successfully
                    WARNING: directory '/opt/oracle/product/10.2' is not owned by root
                    WARNING: directory '/opt/oracle/product' is not owned by root
                    WARNING: directory '/opt/oracle' is not owned by root
                    clscfg: EXISTING configuration version 3 detected.
                    clscfg: version 3 is 10G Release 2.
                    Successfully accumulated necessary OCR keys.
                    Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
                    node <nodenumber>: <nodename> <private interconnect name> <hostname>
                    node 1: node01 node01-priv node01
                    node 2: node02 node02-priv node02
                    clscfg: Arguments check out successfully.

                    NO KEYS WERE WRITTEN. Supply -force parameter to override.
                    -force is destructive and will destroy any previous cluster
                    configuration.
                    Oracle Cluster Registry for cluster has already been initialized
                    Startup will be queued to init within 90 seconds.
                    Adding daemons to inittab
                    Expecting the CRS daemons to be up within 600 seconds.
                    CSS is active on these nodes.
                    node01
                    node02
                    CSS is active on all nodes.
                    Waiting for the Oracle CRSD and EVMD to start
                    Oracle CRS stack installed and running under init(1M)
                    Running vipca(silent) for configuring nodeapps
                    /opt/oracle/product/10.2/crs/jdk/jre//bin/java: error while loading shared libraries: libpthread.so.0: cannot open shared object file: No such file or directory
                    node02:~ # cd /opt/oracle/product/10.2/crs/bin/
                    • 7. Re: root.sh Script - Failed to call clsssinit (21)
                      Sebastian Solbach -Dba Community-Oracle
                      Hi Chris,

                      good news is: It stopped at VIPCA, so you actually are done with root.sh and only need to start VIPCA manually on the second node.

                      Now regarding the missing package: Its probably not a missing package..

                      The problem is that the VIPCA script has a "export LD_ASSUME_KERNEL=2.4.19" in it, which causes the error.

                      Patch 10.2.0.4 resolves that problem for the other tools (like srvctl).

                      See if you can access Note 414163.1 for further explanation.
                      Sebastian
                      • 8. Re: root.sh Script - Failed to call clsssinit (21)
                        Christian
                        Thx. Can I upgrade clusterware before installing the database software or before creating the asm instance ?
                        • 9. Re: root.sh Script - Failed to call clsssinit (21)
                          Sebastian Solbach -Dba Community-Oracle
                          Hi Chris,

                          yes. Thats what I usually do.

                          - Install CRS
                          - Upgrade CRS
                          - Install DB Software (ASM / DB)
                          - Upgrade DB Software (ASM and DB)
                          - Create ASM Instance
                          - Create database.

                          Sebastian
                          • 10. Re: root.sh Script - Failed to call clsssinit (21)
                            Christian
                            I still get this error while starting vipca --> I can start xeyes - to display is working

                            I did an
                            unset LD_ASSUME_KERNEL for the vipca in the crs home.
                            also I tried to comment out the lines for this part

                            No Success


                            node02:/opt/oracle/product/10.2/crs/bin # ./vipca
                            PRKH-1010 : Unable to communicate with CRS services.
                            [PRKH-1000 : Unable to load the SRVM HAS shared library
                              [PRKN-1008 : Unable to load the shared library "srvmhas10"
                              or a dependent library, from
                              LD_LIBRARY_PATH="/opt/oracle/product/10.2/crs/jdk/jre/lib/i386/client:/opt/oracle/product/10.2/crs/jdk/jre/lib/i386:/opt/oracle/product/10.2/crs/jdk/jre/../lib/i386:/opt/oracle/product/10.2/crs/lib32:/opt/oracle/product/10.2/crs/srvm/lib32:/opt/oracle/product/10.2/crs/lib:/opt/oracle/product/10.2/crs/srvm/lib:"
                              [java.lang.UnsatisfiedLinkError: /opt/oracle/product/10.2/crs/lib32/libsrvmhas10.so: libclntsh.so.10.1: wrong ELF class: ELFCLASS64]]]
                            PRKH-1010 : Unable to communicate with CRS services.
                            [PRKH-1000 : Unable to load the SRVM HAS shared library
                              [PRKN-1008 : Unable to load the shared library "srvmhas10"
                              or a dependent library, from
                              LD_LIBRARY_PATH="/opt/oracle/product/10.2/crs/jdk/jre/lib/i386/client:/opt/oracle/product/10.2/crs/jdk/jre/lib/i386:/opt/oracle/product/10.2/crs/jdk/jre/../lib/i386:/opt/oracle/product/10.2/crs/lib32:/opt/oracle/product/10.2/crs/srvm/lib32:/opt/oracle/product/10.2/crs/lib:/opt/oracle/product/10.2/crs/srvm/lib:"
                              [java.lang.UnsatisfiedLinkError: /opt/oracle/product/10.2/crs/lib32/libsrvmhas10.so: libclntsh.so.10.1: wrong ELF class: ELFCLASS64]]]
                            PRKH-1010 : Unable to communicate with CRS services.
                            [PRKH-1000 : Unable to load the SRVM HAS shared library
                              [PRKN-1008 : Unable to load the shared library "srvmhas10"
                              or a dependent library, from
                              LD_LIBRARY_PATH="/opt/oracle/product/10.2/crs/jdk/jre/lib/i386/client:/opt/oracle/product/10.2/crs/jdk/jre/lib/i386:/opt/oracle/product/10.2/crs/jdk/jre/../lib/i386:/opt/oracle/product/10.2/crs/lib32:/opt/oracle/product/10.2/crs/srvm/lib32:/opt/oracle/product/10.2/crs/lib:/opt/oracle/product/10.2/crs/srvm/lib:"
                              [java.lang.UnsatisfiedLinkError: /opt/oracle/product/10.2/crs/lib32/libsrvmhas10.so: libclntsh.so.10.1: wrong ELF class: ELFCLASS64]]]
                            • 11. Re: root.sh Script - Failed to call clsssinit (21)
                              Sebastian Solbach -Dba Community-Oracle
                              Hi Chris,

                              now this error is a missing package...

                              glibc-32bit-8.1-9
                              glibc-devel-32bit-8.1-9

                              If you are on 64-bit Linux, you will need these 32-bit libraries as well.
                              Please also check with the installation guide for other packages.

                              Sebastian
                              • 12. Re: root.sh Script - Failed to call clsssinit (21)
                                Christian
                                Its still not working.

                                I don´t have these versions on SLES10.
                                glibc-32bit-8.1-9
                                glibc-devel-32bit-8.1-9

                                but I do have those, which are installed....

                                glibc-32bit-2.4-31.74.1.x86_64.rpm
                                glibc-devel-2.4-31.74.1.x86_64.rpm

                                Do I need a different version of libclntsh.so.10.1 ???

                                2:/opt/oracle/product/10.2/crs/lib:/opt/oracle/product/10.2/crs/srvm/lib:"
                                [java.lang.UnsatisfiedLinkError: /opt/oracle/product/10.2/crs/lib32/libsrvmhas10.so: libclntsh.so.10.1: wrong ELF class: ELFCLASS64]]]
                                • 13. Re: root.sh Script - Failed to call clsssinit (21)
                                  Sebastian Solbach -Dba Community-Oracle
                                  Hi Chris,
                                  sorry... when posting necessary libraries I always forget to remove the version.
                                  Newer is normally o.k.

                                  However where the Problem lies is that you need the 32-bit RPM for the devel package as well not only the 64-bit RPMs.

                                  Here from the installation guide:
                                  http://download.oracle.com/docs/cd/E11882_01/install.112/e10812/prelinux.htm#BABFDJJF

                                  glibc-2.4-31.63
                                  glibc-devel-2.4
                                  glibc-devel-32bit-2.4

                                  The glibc-devel-32bit seems to be missing.

                                  Sebastian
                                  • 14. Re: root.sh Script - Failed to call clsssinit (21)
                                    Christian
                                    I installed every glib* packages - no success....

                                    node02:~ # rpm -qa glib*
                                    glibc-i18ndata-2.4-31.74.1
                                    glibc-devel-2.4-31.74.1
                                    glib-devel-1.2.10-609.2
                                    glibc-32bit-2.4-31.74.1
                                    glib-sharp2-2.8.3-43.10
                                    glibc-profile-2.4-31.74.1
                                    glibc-2.4-31.74.1
                                    glibc-locale-32bit-2.4-31.74.1
                                    glib-1.2.10-609.2
                                    glibc-devel-32bit-2.4-31.74.1
                                    glibc-profile-32bit-2.4-31.74.1
                                    glib2-32bit-2.8.6-0.13
                                    glib2-2.8.6-0.13
                                    glibc-html-2.4-31.74.1
                                    glib-32bit-1.2.10-609.2
                                    glibc-info-2.4-31.74.1
                                    glibc-locale-2.4-31.74.1
                                    glib-devel-32bit-1.2.10-609.2
                                    node02:~ #
                                    1 2 Previous Next