13 Replies Latest reply: Apr 5, 2011 11:29 AM by Dude! RSS

    ASM creation problem Initializing the Oracle ASMLib driver:  failed

    661723
      hi

      oel 5.6 64bit
      db 11gR2 64bit
      [root@rac-1 ASM]# rpm -qa | grep ora
      oracleasm-2.6.18-164.el5xen-2.0.5-1.el5
      libtheora-1.0alpha7-1
      oracleasm-2.6.18-164.el5debug-2.0.5-1.el5
      oracleasm-2.6.18-164.el5-2.0.5-1.el5
      oracle-logos-4.9.17-10
      oracle-validated-1.1.0-7.el5
      oraclelinux-release-5-6.0.1
      oracleasm-support-2.1.4-1.el5
      [root@rac-1 ASM]# rpm -qa | grep asm
      nasm-0.98.39-3.2.2
      oracleasm-2.6.18-164.el5xen-2.0.5-1.el5
      oracleasm-2.6.18-164.el5debug-2.0.5-1.el5
      oracleasm-2.6.18-164.el5-2.0.5-1.el5
      oracleasm-support-2.1.4-1.el5
      [root@rac-1 ASM]#
      [root@rac-1 ASM]# oracleasm configure
      ORACLEASM_ENABLED=true
      ORACLEASM_UID=oracle
      ORACLEASM_GID=asmadmin
      ORACLEASM_SCANBOOT=true
      ORACLEASM_SCANORDER=""
      ORACLEASM_SCANEXCLUDE=""
      
      
      [root@rac-1 ASM]# service oracleasm restart
      Dropping Oracle ASMLib disks:                              [  OK  ]
      Shutting down the Oracle ASMLib driver:                    [  OK  ]
      Initializing the Oracle ASMLib driver:                     [FAILED]
      [root@rac-1 ASM]#
      can anyone help??
        • 1. Re: ASM creation problem Initializing the Oracle ASMLib driver:  failed
          389403
          Hi,

          First of all check log file /var/log/oracleasm

          Regards
          • 2. Re: ASM creation problem Initializing the Oracle ASMLib driver:  failed
            661723
            Creating /dev/oracleasm mount point: /dev/oracleasm
            Loading module "oracleasm": failed
            Unable to load module "oracleasm"
            Loading module "oracleasm": failed
            Unable to load module "oracleasm"
            Loading module "oracleasm": failed
            Unable to load module "oracleasm"
            Loading module "oracleasm": failed
            Unable to load module "oracleasm"
            Loading module "oracleasm": failed
            Unable to load module "oracleasm"
            Loading module "oracleasm": failed
            Unable to load module "oracleasm"
            Cleaning any stale ASM disks...
            Loading module "oracleasm": failed
            Unable to load module "oracleasm"
            Loading module "oracleasm": failed
            Unable to load module "oracleasm"
            Creating /dev/oracleasm mount point: /dev/oracleasm
            Loading module "oracleasm": failed
            Unable to load module "oracleasm"
            Loading module "oracleasm": failed
            Unable to load module "oracleasm"
            Reloading disk partitions: done
            Cleaning any stale ASM disks...
            Scanning system for ASM disks...
            oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directory
            oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directory
            oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directory
            oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directory
            oracleasm-read-label: Unable to open device "/dev/dm-6": No such file or directory
            oracleasm-read-label: Unable to open device "/dev/dm-6": No such file or directory
            oracleasm-read-label: Unable to open device "/dev/dm-6": No such file or directory
            oracleasm-read-label: Unable to open device "/dev/dm-6": No such file or directory
            Creating /dev/oracleasm mount point: /dev/oracleasm
            Loading module "oracleasm": failed
            Unable to load module "oracleasm"
            Creating /dev/oracleasm mount point: /dev/oracleasm
            Loading module "oracleasm": failed
            Unable to load module "oracleasm"
            Loading module "oracleasm": failed
            Unable to load module "oracleasm"
            Creating /dev/oracleasm mount point: /dev/oracleasm
            Loading module "oracleasm": failed
            Unable to load module "oracleasm"
            [root@rac-1 ~]#
            [root@rac-1 ~]# fdisk -l
            
            Disk /dev/sda: 1000.2 GB, 1000204886016 bytes
            255 heads, 63 sectors/track, 121601 cylinders
            Units = cylinders of 16065 * 512 = 8225280 bytes
            
               Device Boot      Start         End      Blocks   Id  System
            /dev/sda1   *           1          13      104391   83  Linux
            /dev/sda2              14        3929    31455270   8e  Linux LVM
            /dev/sda3            3930      121601   945200340    5  Extended
            /dev/sda5            3930       24410   164513601   8e  Linux LVM
            /dev/sda6           24411       28146    30009388+  8e  Linux LVM
            /dev/sda7           28147       28769     5004216   83  Linux
            
            Disk /dev/dm-0: 21.4 GB, 21474836480 bytes
            255 heads, 63 sectors/track, 2610 cylinders
            Units = cylinders of 16065 * 512 = 8225280 bytes
            
            Disk /dev/dm-0 doesn't contain a valid partition table
            
            Disk /dev/dm-1: 5368 MB, 5368709120 bytes
            255 heads, 63 sectors/track, 652 cylinders
            Units = cylinders of 16065 * 512 = 8225280 bytes
            
            Disk /dev/dm-1 doesn't contain a valid partition table
            
            Disk /dev/dm-2: 5368 MB, 5368709120 bytes
            255 heads, 63 sectors/track, 652 cylinders
            Units = cylinders of 16065 * 512 = 8225280 bytes
            
            Disk /dev/dm-2 doesn't contain a valid partition table
            
            Disk /dev/dm-3: 21.4 GB, 21474836480 bytes
            255 heads, 63 sectors/track, 2610 cylinders
            Units = cylinders of 16065 * 512 = 8225280 bytes
            
            Disk /dev/dm-3 doesn't contain a valid partition table
            
            Disk /dev/dm-4: 2147 MB, 2147483648 bytes
            255 heads, 63 sectors/track, 261 cylinders
            Units = cylinders of 16065 * 512 = 8225280 bytes
            
            Disk /dev/dm-4 doesn't contain a valid partition table
            [root@rac-1 ~]#
            • 3. Re: ASM creation problem Initializing the Oracle ASMLib driver:  failed
              389403
              This can be the reason of incorrect version of the asmlib package, it is very sensitive to the kernel version.

              Execute the "uname -a" command and check that you downloaded correct version.

              Regards.
              • 4. Re: ASM creation problem Initializing the Oracle ASMLib driver:  failed
                661723
                hi
                [root@rac-1 ~]# uname -a
                Linux rac-1.<xxx>.de 2.6.18-238.el5 #1 SMP Tue Jan 4 15:41:11 EST 2011 x86_64 x86_64 x86_64 GNU/Linux
                [root@rac-1 ~]# rpm -qa | grep oracl
                oracleasmlib-2.0.4-1.el5
                oracleasm-2.6.18-238.el5-debuginfo-2.0.5-1.el5
                oracleasm-2.6.18-164.el5xen-2.0.5-1.el5
                oracleasm-2.6.18-164.el5debug-2.0.5-1.el5
                oracleasm-2.6.18-164.el5-2.0.5-1.el5
                oracle-logos-4.9.17-10
                oracleasm-2.6.18-238.el5debug-2.0.5-1.el5
                oracle-validated-1.1.0-7.el5
                oraclelinux-release-5-6.0.1
                oracleasm-2.6.18-238.1.1.el5-2.0.5-1.el5
                oracleasm-support-2.1.4-1.el5
                oracleasm-2.6.18-238.el5-2.0.5-1.el5
                [root@rac-1 ~]#
                [root@rac-1 ~]# rpm -ivh oracleasm-2.6.18-238.el5-2.0.5-1.el5.x86_64.rpm
                Preparing...                ########################################### [100%]
                   1:oracleasm-2.6.18-238.el########################################### [100%]
                WARNING: Can't read module /lib/modules/2.6.18-238.el5/weak-updates/kmod-kvm/kvm.ko: No such file or directory
                WARNING: Can't read module /lib/modules/2.6.18-238.el5/weak-updates/kmod-kvm/kvm-amd.ko: No such file or directory
                WARNING: Can't read module /lib/modules/2.6.18-238.el5/weak-updates/kmod-kvm/ksm.ko: No such file or directory
                WARNING: Can't read module /lib/modules/2.6.18-238.el5/weak-updates/kmod-kvm/kvm-intel.ko: No such file or directory
                 
                check and i verify.i found three types of version for same 238 kernel.
                help me to find the correct one.


                kind regards
                • 5. Re: ASM creation problem Initializing the Oracle ASMLib driver:  failed
                  Dude!
                  Perhaps you are confusing the oracleasmlib package with oracleasm. The oracleasm package contains only the kernel driver, which is included in the Oracle Unbreakable Enterprise kernel and does not need to be installed. If I remember correctly, OEL 5.6 installed the UEK kernel by default.

                  The oracleasm-support and oracelasmlib packages however are still required. If you do not have paid access to the ULN network you can install the oracleasm-support rpm from Oracle's public yum repository (http://public-yum.oracle.com/). Using yum is easy and will also resolve package dependency issues.

                  To install oracleasmlib you can try:
                  rpm -ivh 'http://download.oracle.com/otn_software/asmlib/oracleasmlib-2.0.4-1.el5.x86_64.rpm'
                  • 6. Re: ASM creation problem Initializing the Oracle ASMLib driver:  failed
                    661723
                    hi
                    [root@rac-1 ~]# rpm -ivh 'http://download.oracle.com/otn_software/asmlib/oracleasmlib-2.0.4-1.el5.x86_64.rpm'
                    Retrieving http://download.oracle.com/otn_software/asmlib/oracleasmlib-2.0.4-1.el5.x86_64.rpm
                    Preparing...                ########################################### [100%]
                            package oracleasmlib-2.0.4-1.el5.x86_64 is already installed
                    [root@rac-1 ~]#
                    [root@rac-1 ~]# yum install oracleasm-support
                    Loaded plugins: security
                    Setting up Install Process
                    Package oracleasm-support-2.1.4-1.el5.x86_64 already installed and latest version
                    Nothing to do
                    [root@rac-1 ~]#
                    [root@rac-1 ~]# rpm -ivh 'http://download.oracle.com/otn_software/asmlib/oracleasmlib-2.0.4-1.el5.x86_64.rpm'
                    Retrieving http://download.oracle.com/otn_software/asmlib/oracleasmlib-2.0.4-1.el5.x86_64.rpm
                    Preparing...                ########################################### [100%]
                            package oracleasmlib-2.0.4-1.el5.x86_64 is already installed
                    [root@rac-1 ~]# yum install oracleasm-support
                    Loaded plugins: security
                    Setting up Install Process
                    Package oracleasm-support-2.1.4-1.el5.x86_64 already installed and latest version
                    Nothing to do
                    [root@rac-1 ~]# yum install oracleasm
                    Loaded plugins: security
                    Setting up Install Process
                    Resolving Dependencies
                    --> Running transaction check
                    ---> Package kernel-uek-debug.x86_64 0:2.6.32-100.26.2.el5 set to be updated
                    --> Finished Dependency Resolution
                    
                    Dependencies Resolved
                    
                    ================================================================================
                     Package              Arch       Version                  Repository       Size
                    ================================================================================
                    Installing:
                     kernel-uek-debug     x86_64     2.6.32-100.26.2.el5      ol5_u6_base      25 M
                    
                    Transaction Summary
                    ================================================================================
                    Install       1 Package(s)
                    Upgrade       0 Package(s)
                    
                    Total download size: 25 M
                    Is this ok [y/N]: y
                    Downloading Packages:
                    kernel-uek-debug-2.6.32-100.26.2.el5.x86_64.rpm          |  25 MB     02:12
                    Running rpm_check_debug
                    Running Transaction Test
                    Finished Transaction Test
                    Transaction Test Succeeded
                    Running Transaction
                      Installing     : kernel-uek-debug                                         1/1
                    
                    Installed:
                      kernel-uek-debug.x86_64 0:2.6.32-100.26.2.el5
                    
                    Complete!
                    [root@rac-1 ~]# yum install oracleasm-support
                    Loaded plugins: security
                    Setting up Install Process
                    Package oracleasm-support-2.1.4-1.el5.x86_64 already installed and latest version
                    Nothing to do
                    [root@rac-1 ~]# /etc/init.d/oracleasm configure
                    Configuring the Oracle ASM library driver.
                    
                    This will configure the on-boot properties of the Oracle ASM library
                    driver.  The following questions will determine whether the driver is
                    loaded on boot and what permissions it will have.  The current values
                    will be shown in brackets ('[]').  Hitting <ENTER> without typing an
                    answer will keep that current value.  Ctrl-C will abort.
                    
                    Default user to own the driver interface [oracle]:
                    Default group to own the driver interface [oinstall]:
                    Start Oracle ASM library driver on boot (y/n) [y]:
                    Scan for Oracle ASM disks on boot (y/n) [y]:
                    Writing Oracle ASM library driver configuration: done
                    Initializing the Oracle ASMLib driver:                     [  OK  ]
                    Scanning the system for Oracle ASMLib disks:               [  OK  ]
                    [root@rac-1 ~]#
                    [root@rac-1 ~]# oracleasm createdisk VOL1 /dev/sda7
                    Writing disk header: done
                    Instantiating disk: done
                    [root@rac-1 ~]#
                    1.can you confirm one thing this ASM disks is created by root user will this disks be available to OSDBA user also??

                    2.After creation of ASM instance Can i convert it to ADVM for single instance database (planned to be in data guard)??

                    kind regards
                    • 7. Re: ASM creation problem Initializing the Oracle ASMLib driver:  failed
                      389403
                      Hi again,

                      1. Yes, but You need to chown oracle:dba /dev/<device name>
                      2. Yes You can use ASM instance to create ADVM

                      Regards
                      • 8. Re: ASM creation problem Initializing the Oracle ASMLib driver:  failed
                        661723
                        hi

                        according to the output posted in previous post oracleasmlib driver owner is set to oinstall group.so you are still suggesting to give permission to oracle.dba or oracle.oinstall ??

                        just confirming with it.


                        kind regards
                        • 9. Re: ASM creation problem Initializing the Oracle ASMLib driver:  failed
                          389403
                          It depend on Your configuration, in other words You must provide read and write access to the oracle background and foreground processes to your device under /dev. If Your oracle binaries runs under the user oracle then what is the primary group of the oracle user, if it is oinstall than use oinstall.
                          • 10. Re: ASM creation problem Initializing the Oracle ASMLib driver:  failed
                            661723
                            hi

                            just another confirmation i need :

                            i have some raw devices using /etc/rawdevices file and losetup to /dev/loop(n); can you say what are the udev rules to set so that all the permission and loop(n) devices come up before ASMLib driver initialization ?? eg.

                            http://www.idevelopment.info/data/Oracle/DBA_tips/Automatic_Storage_Management/ASM_20.shtml
                            [root@rac-1 ~]# oracleasm listdisks
                            VOL1
                            [root@rac-1 ~]# oracleasm createdisk VOL2 /dev/loop1
                            Unable to access device "/dev/loop1"
                            [root@rac-1 ~]# losetup /dev/loop1 /oracle_ASM_SWAP/ASM/ASM_FILE1
                            [root@rac-1 ~]# oracleasm createdisk VOL2 /dev/loop1
                            Writing disk header: done
                            Instantiating disk: done
                            [root@rac-1 ~]# losetup /dev/loop2 /oracle_ASM_SWAP/ASM/ASM_FILE2
                            [root@rac-1 ~]# oracleasm createdisk VOL3 /dev/loop3
                            Unable to access device "/dev/loop3"
                            [root@rac-1 ~]# oracleasm createdisk VOL3 /dev/loop2
                            Writing disk header: done
                            Instantiating disk: done
                            [root@rac-1 ~]# losetup /dev/loop3 /oracle_ASM_SWAP/ASM/ASM_FILE3
                            [root@rac-1 ~]# oracleasm createdisk VOL4 /dev/loop3
                            Writing disk header: done
                            Instantiating disk: done
                            [root@rac-1 ~]# losetup /dev/loop4 /oracle_ASM_SWAP/ASM/ASM_FILE4
                            [root@rac-1 ~]# oracleasm createdisk VOL5 /dev/loop5
                            Unable to access device "/dev/loop5"
                            [root@rac-1 ~]# oracleasm createdisk VOL5 /dev/loop4
                            Writing disk header: done
                            Instantiating disk: done
                            [root@rac-1 ~]# losetup /dev/loop5 /oracle_ASM_SWAP/ASM/ASM_FILE5
                            [root@rac-1 ~]# oracleasm createdisk VOL6 /dev/loop5
                            Writing disk header: done
                            Instantiating disk: done
                            [root@rac-1 ~]# oracleasm listdisks
                            VOL1
                            VOL2
                            VOL3
                            VOL4
                            VOL5
                            VOL6
                            [root@rac-1 ~]#
                            http://admindba.com/forum.php?gcm=2&grid=115612

                            assigning to /etc/rc.local making the disk available only VOL1 not others.
                            can i still use ADVM ??
                            [oracle@rac-1 dbs]$ . ~/.orcl_ASM.profile
                            [oracle@rac-1 dbs]$ sqlplus / as sysdba
                            
                            SQL*Plus: Release 11.2.0.1.0 Production on Mon Apr 4 11:34:51 2011
                            
                            Copyright (c) 1982, 2009, Oracle.  All rights reserved.
                            
                            Connected to an idle instance.
                            
                            SQL> !
                            [oracle@rac-1 dbs]$ ls
                            hc_orcl.dat   init.ora      lkORCL     spfileorcl.ora
                            init+ASM.ora  initorcl.ora  orapworcl
                            [oracle@rac-1 dbs]$ exit
                            
                            SQL> startup
                            ORA-01078: failure in processing system parameters
                            ORA-29701: unable to connect to Cluster Synchronization Service
                            SQL> startup pfile='/oracle_db/oracle/product/11.2.0/dbhome_1/dbs/init+ASM.ora';
                            ORA-29701: unable to connect to Cluster Synchronization Service
                            ORA-01078: failure in processing system parameters
                            SQL> Disconnected
                            [oracle@rac-1 dbs]$ cd /oracle_db/oracle/product/11.2.0/dbhome_1/bin/l
                            lbuilder      ldapcompare   ldapsearch    loadpsp       lxchknlb
                            lcsscan       ldapdelete    ldifmigrator  loadpspO      lxegen
                            ldapadd       ldapmoddn     linkshlib     lsnodes       lxinst
                            ldapaddmt     ldapmodify    lmsgen        lsnrctl
                            ldapbind      ldapmodifymt  loadjava      lsnrctl0
                            [oracle@rac-1 dbs]$ sqlplus / as sysdba
                            
                            SQL*Plus: Release 11.2.0.1.0 Production on Mon Apr 4 11:47:18 2011
                            
                            Copyright (c) 1982, 2009, Oracle.  All rights reserved.
                            
                            Connected to an idle instance.
                            
                            SQL> create spfile from pfile='/oracle_db/oracle/product/11.2.0/dbhome_1/dbs/init+ASM.ora';
                            
                            File created.
                            
                            SQL> startup
                            ORA-29701: unable to connect to Cluster Synchronization Service
                            SQL> Disconnected
                            [oracle@rac-1 dbs]$ vi .orcl_ASM.profile
                            [oracle@rac-1 dbs]$ vi .orcl_ASM.profile
                            [oracle@rac-1 dbs]$ . .orcl_ASM.profile
                            [oracle@rac-1 dbs]$ sqlplus / as sysdba
                            
                            SQL*Plus: Release 11.2.0.1.0 Production on Mon Apr 4 11:50:29 2011
                            
                            Copyright (c) 1982, 2009, Oracle.  All rights reserved.
                            
                            Connected to an idle instance.
                            
                            SQL> startup mount
                            ORA-29701: unable to connect to Cluster Synchronization Service
                            SQL> Disconnected
                            [oracle@rac-1 dbs]$ ls
                            hc_orcl.dat   init.ora      lkORCL     spfile+ASM.ora
                            init+ASM.ora  initorcl.ora  orapworcl  spfileorcl.ora
                            [oracle@rac-1 dbs]$ vi init+ASM.ora
                            [oracle@rac-1 dbs]$ sqlplus / as sysdba
                            
                            SQL*Plus: Release 11.2.0.1.0 Production on Mon Apr 4 11:51:25 2011
                            
                            Copyright (c) 1982, 2009, Oracle.  All rights reserved.
                            
                            Connected to an idle instance.
                            
                            SQL>  create spfile from pfile='/oracle_db/oracle/product/11.2.0/dbhome_1/dbs/init+ASM.ora';
                            
                            File created.
                            
                            SQL> startup mount
                            ORA-29701: unable to connect to Cluster Synchronization Service
                            SQL>
                            how to get rid of ORA-29071 for this new ASM instance creation??


                            http://www.oracledba.org/10g/asm/asm_install.html

                            this is 10g related.
                            kind regards
                            • 11. Re: ASM creation problem Initializing the Oracle ASMLib driver:  failed
                              Dude!
                              Oracleasm will take care of setting the ownership of your devices according to what name you specified when you configured the service, and there is no need to set extra permissions on the device files.

                              Regarding the ora-29701 error...

                              Log into grid/asm home:

                              crsctl status resource -t
                              -> check if services are offline

                              crsctl status resource -p
                              -> what are auto_start settings?

                              If they are offline, you can try to set the following:

                              crsctl modify resource "ora.cssd" -attr "AUTO_START=1"
                              crsctl modify resource "ora.diskmon" -attr "AUTO_START=1"
                              crs_start -all

                              Btw, it is better to start a new thread when there is a new problem.
                              • 12. Re: ASM creation problem Initializing the Oracle ASMLib driver:  failed
                                661723
                                hi

                                its single instance installation.there is no grid home or grid user exists.do i need to install clusterware ??
                                ok i would like to but i thought as it is a very small problem to the mastro like you so it can be resolute out here .... just within one or two reply.

                                kind regards
                                • 13. Re: ASM creation problem Initializing the Oracle ASMLib driver:  failed
                                  Dude!
                                  Oracle ASM and related files are installed in the Oracle Grid home directory, so you will need to export $ORACLE_HOME and modify $PATH accordingly to use the ASM utilities. Oracle CRSCTL and Oracle Restart are also installed in the Grid home when you install ASM, regardless of whether you use a cluster or not.