1 2 Previous Next 22 Replies Latest reply: Jan 1, 2013 8:49 AM by SaikatBanerjee RSS

    configuring grid infra, asm 11gr2

    SaikatBanerjee
      Hi,

      We are configuring 11gR2 grid on oracle linux 5.8(x86-64).


      When I am rebooting my nodes the raw disk permission is getting changed from grid:asmadmin to root:disk.


      I followed the url:-"http://docs.oracle.com/cd/E11882_01/install.112/e17212/storage.htm#CDEBFDEH". But I am unable to find what to put instead of RESULT=="14f70656e66696c00000000" in my case?


      I tried with asmlib too. But I am getting the following error:-
      "[root@VM-PAGRAC4 media]# rpm -ivh oracleasm*.rpm
      warning: oracleasmlib-2.0.4-1.el6.x86_64.rpm: Header V3 RSA/SHA256 signature: NOKEY, key ID ec551f03
      error: Failed dependencies:
      rpmlib(FileDigests) <= 4.6.0-1 is needed by oracleasmlib-2.0.4-1.el6.x86_64
      rpmlib(PayloadIsXz) <= 5.2-1 is needed by oracleasmlib-2.0.4-1.el6.x86_64
      [root@VM-PAGRAC4 media]#
      "


      Please help.

      Regards,
      Saikat
        • 1. Re: configuring grid infra, asm 11gr2
          rcc50886
          Install oracleasm libraries properly and configure it by providing details like who owns the disks and what group.


          http://www.oracle.com/technetwork/server-storage/linux/downloads/rhel5-084877.html
          • 2. Re: configuring grid infra, asm 11gr2
            onedbguru
            I would not use oracleasm... it is superfluous.

            use the udev or the multipathd rules for setting these permissions.

            http://www.oracle.com/technetwork/database/device-mapper-udev-crs-asm.pdf
            • 3. Re: configuring grid infra, asm 11gr2
              SaikatBanerjee
              my kernel version is:-


              [root@VM-PAGRAC4 /]# uname -r
              2.6.32-300.10.1.el5uek


              unable to find the oracleasm library for this.
              Please help.

              Regards,
              Saikat
              • 4. Re: configuring grid infra, asm 11gr2
                rcc50886
                post the following results:
                rpm -qa oracleasm*
                You are using kernel version 2.6

                So download the oracleasm support and oracleasm libraries and install it.

                For Intel EM64T (x86_64) Architecture
                Library and Tools:
                
                oracleasm-support-2.1.7-1.el5.x86_64.rpm
                oracleasmlib-2.0.4-1.el5.x86_64.rpm
                • 5. Re: configuring grid infra, asm 11gr2
                  SaikatBanerjee
                  [root@VM-PAGRAC3 asmca]# rpm -qa oracleasm*
                  oracleasm-support-2.1.7-1.el5
                  oracleasm-2.6.18-308.el5-2.0.5-1.el5
                  oracleasm-2.6.18-308.el5debug-2.0.5-1.el5
                  oracleasm-2.6.18-308.el5xen-2.0.5-1.el5


                  okay I got it..I will install and update
                  • 6. Re: configuring grid infra, asm 11gr2
                    SaikatBanerjee
                    rpm -Uvh oracleasm*
                    warning: oracleasm-2.6.18-308.el5-2.0.5-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159
                    Preparing... ########################################### [100%]
                    package oracleasm-support-2.1.7-1.el5.x86_64 is already installed
                    package oracleasm-2.6.18-308.el5-2.0.5-1.el5.x86_64 is already installed
                    package oracleasm-2.6.18-308.el5xen-2.0.5-1.el5.x86_64 is already installed
                    file /usr/lib/oracleasm/oracleasm-candidate-p from install of oracleasm-support-2.1.7-1.el5.x86_64 conflicts with file from package oracleasm-support-2.1.7-1.el5.x86_64
                    file /usr/lib/oracleasm/oracleasm-clean-disk from install of oracleasm-support-2.1.7-1.el5.x86_64 conflicts with file from package oracleasm-support-2.1.7-1.el5.x86_64
                    file /usr/lib/oracleasm/oracleasm-instantiate-disk from install of oracleasm-support-2.1.7-1.el5.x86_64 conflicts with file from package oracleasm-support-2.1.7-1.el5.x86_64
                    file /usr/lib/oracleasm/oracleasm-read-label from install of oracleasm-support-2.1.7-1.el5.x86_64 conflicts with file from package oracleasm-support-2.1.7-1.el5.x86_64
                    file /usr/lib/oracleasm/oracleasm-reload-partitions from install of oracleasm-support-2.1.7-1.el5.x86_64 conflicts with file from package oracleasm-support-2.1.7-1.el5.x86_64
                    file /usr/lib/oracleasm/oracleasm-scan-partitions from install of oracleasm-support-2.1.7-1.el5.x86_64 conflicts with file from package oracleasm-support-2.1.7-1.el5.x86_64
                    file /usr/lib/oracleasm/oracleasm-write-label from install of oracleasm-support-2.1.7-1.el5.x86_64 conflicts with file from package oracleasm-support-2.1.7-1.el5.x86_64



                    But I got, the following error

                    [root@VM-PAGRAC4 asmlib]# /etc/init.d/oracleasm createdisk DATA /dev/sda
                    Marking disk "DATA" as an ASM disk: [FAILED]


                    [root@VM-PAGRAC4 asmlib]# /etc/init.d/oracleasm deletedisk DATA /dev/sda
                    Removing ASM disk "DATA": [FAILED]

                    Edited by: Saikat Banerjee on Dec 31, 2012 9:56 PM
                    • 7. Re: configuring grid infra, asm 11gr2
                      rcc50886
                      did you installed oracleasm libraries at all ?

                      post again following results:
                      rpm -qa oracleasm*
                      did you configure the oracleasm at first ?
                      /etc/init.d/oracleasm configure
                      The above configure command will prompts for the owner and group who needs to own the disks (in general: grid, oinstall)

                      also post following results:
                      /etc/init.d/oracleasm status
                      Edited by: rcc50886 on Dec 31, 2012 8:33 AM
                      • 8. Re: configuring grid infra, asm 11gr2
                        SaikatBanerjee
                        yes, I downloaded

                        Intel EM64T (x86_64) Architecture
                        Library and Tools
                        oracleasm-support-2.1.7-1.el5.x86_64.rpm
                        • 9. Re: configuring grid infra, asm 11gr2
                          SaikatBanerjee
                          Hi,

                          yes I have already configured oracleasm.Showing you the o/p:-


                          [root@VM-PAGRAC3 asmlib]# oracleasm configure -i
                          Configuring the Oracle ASM library driver.

                          This will configure the on-boot properties of the Oracle ASM library
                          driver. The following questions will determine whether the driver is
                          loaded on boot and what permissions it will have. The current values
                          will be shown in brackets ('[]'). Hitting <ENTER> without typing an
                          answer will keep that current value. Ctrl-C will abort.

                          Default user to own the driver interface [grid]:
                          Default group to own the driver interface [asmadmin]:
                          Start Oracle ASM library driver on boot (y/n) [y]: y
                          Scan for Oracle ASM disks on boot (y/n) [y]: y
                          Writing Oracle ASM library driver configuration: done
                          Initializing the Oracle ASMLib driver: [  OK  ]
                          Scanning the system for Oracle ASMLib disks: [  OK  ]
                          [root@VM-PAGRAC3 asmlib]#




                          [root@VM-PAGRAC3 asmlib]# /etc/init.d/oracleasm status
                          Checking if ASM is loaded: yes
                          Checking if /dev/oracleasm is mounted: yes
                          • 10. Re: configuring grid infra, asm 11gr2
                            rcc50886
                            post error message in following logfile: /var/log/oracleasm

                            also post ls -ltr /dev/oracleasm

                            Edited by: rcc50886 on Dec 31, 2012 8:42 AM
                            • 11. Re: configuring grid infra, asm 11gr2
                              SaikatBanerjee
                              Pasting contents obtained by cat command:-



                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdd, opened
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device /dev/sdd: using '-d sat' for ATA disk behind SAT layer.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdd, opened
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdd, not found in smartd database.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdd, lacks SMART capability
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdd, to proceed anyway, use '-T permissive' Directive.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sde, opened
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device /dev/sde: using '-d sat' for ATA disk behind SAT layer.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sde, opened
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sde, not found in smartd database.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sde, lacks SMART capability
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sde, to proceed anyway, use '-T permissive' Directive.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdf, opened
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device /dev/sdf: using '-d sat' for ATA disk behind SAT layer.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdf, opened
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdf, not found in smartd database.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdf, lacks SMART capability
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdf, to proceed anyway, use '-T permissive' Directive.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdg, opened
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device /dev/sdg: using '-d sat' for ATA disk behind SAT layer.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdg, opened
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdg, not found in smartd database.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdg, lacks SMART capability
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdg, to proceed anyway, use '-T permissive' Directive.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdh, opened
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device /dev/sdh: using '-d sat' for ATA disk behind SAT layer.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdh, opened
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdh, not found in smartd database.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdh, lacks SMART capability
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdh, to proceed anyway, use '-T permissive' Directive.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdi, opened
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device /dev/sdi: using '-d sat' for ATA disk behind SAT layer.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdi, opened
                              Dec 31 17:25:09 VM-PAGRAC3 avahi-daemon[3590]: Server startup complete. Host name is VM-PAGRAC3.local. Local service cookie is 2500236256.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdi, not found in smartd database.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdi, lacks SMART capability
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdi, to proceed anyway, use '-T permissive' Directive.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdj, opened
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device /dev/sdj: using '-d sat' for ATA disk behind SAT layer.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdj, opened
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdj, not found in smartd database.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdj, lacks SMART capability
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdj, to proceed anyway, use '-T permissive' Directive.
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Monitoring 0 ATA and 0 SCSI devices
                              Dec 31 17:25:09 VM-PAGRAC3 smartd[3678]: smartd has fork()ed into background mode. New PID=3678.
                              Dec 31 17:25:09 VM-PAGRAC3 gconfd (paguser-3698): starting (version 2.14.0), pid 3698 user 'paguser'
                              Dec 31 17:25:09 VM-PAGRAC3 gconfd (paguser-3698): Resolved address "xml:readonly:/etc/gconf/gconf.xml.mandatory" to a read-only configuration source at position 0
                              Dec 31 17:25:09 VM-PAGRAC3 gconfd (paguser-3698): Resolved address "xml:readwrite:/home/paguser/.gconf" to a writable configuration source at position 1
                              Dec 31 17:25:09 VM-PAGRAC3 gconfd (paguser-3698): Resolved address "xml:readonly:/etc/gconf/gconf.xml.defaults" to a read-only configuration source at position 2
                              Dec 31 17:25:11 VM-PAGRAC3 hcid[2824]: Default passkey agent (:1.4, /org/bluez/applet) registered
                              Dec 31 17:25:11 VM-PAGRAC3 pcscd: winscard.c:304:SCardConnect() Reader E-Gate 0 0 Not Found
                              Dec 31 17:25:11 VM-PAGRAC3 last message repeated 2 times
                              Dec 31 17:25:12 VM-PAGRAC3 nm-system-settings: Loaded plugin ifcfg-rh: (c) 2007 - 2008 Red Hat, Inc. To report bugs please use the NetworkManager mailing list.
                              Dec 31 17:25:12 VM-PAGRAC3 gconfd (paguser-3698): Resolved address "xml:readwrite:/home/paguser/.gconf" to a writable configuration source at position 0
                              Dec 31 17:25:15 VM-PAGRAC3 pcscd: winscard.c:304:SCardConnect() Reader E-Gate 0 0 Not Found
                              Dec 31 17:25:16 VM-PAGRAC3 nm-system-settings: ifcfg-rh: parsing /etc/sysconfig/network-scripts/ifcfg-eth1 ...
                              Dec 31 17:25:16 VM-PAGRAC3 nm-system-settings: ifcfg-rh: read connection 'System eth1'
                              Dec 31 17:25:16 VM-PAGRAC3 nm-system-settings: ifcfg-rh: parsing /etc/sysconfig/network-scripts/ifcfg-eth0 ...
                              Dec 31 17:25:16 VM-PAGRAC3 nm-system-settings: ifcfg-rh: read connection 'System eth0'
                              Dec 31 17:25:16 VM-PAGRAC3 nm-system-settings: ifcfg-rh: parsing /etc/sysconfig/network-scripts/ifcfg-lo ...
                              Dec 31 17:39:30 VM-PAGRAC3 avahi-daemon[3590]: Invalid query packet.
                              Dec 31 17:40:11 VM-PAGRAC3 last message repeated 15 times
                              Dec 31 17:50:25 VM-PAGRAC3 last message repeated 3 times
                              Dec 31 17:51:05 VM-PAGRAC3 last message repeated 7 times
                              Dec 31 17:51:53 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
                              Dec 31 18:21:53 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
                              Dec 31 18:51:55 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
                              Dec 31 19:21:55 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
                              Dec 31 19:51:55 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
                              Dec 31 20:26:46 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
                              Dec 31 20:26:47 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
                              Dec 31 20:41:10 VM-PAGRAC3 init: Re-reading inittab
                              Dec 31 20:41:15 VM-PAGRAC3 init: Re-reading inittab
                              Dec 31 20:41:15 VM-PAGRAC3 logger: exec /oracle/app/11.2.0/grid/perl/bin/perl -I/oracle/app/11.2.0/grid/perl/lib /oracle/app/11.2.0/grid/bin/crswrapexece.pl /oracle/app/11.2.0/grid/crs/install/s_crsconfig_vm-pagrac3_env.txt /oracle/app/11.2.0/grid/bin/ohasd.bin "reboot"
                              Dec 31 20:42:31 VM-PAGRAC3 avahi-daemon[3590]: Registering new address record for 169.254.181.91 on eth1.
                              Dec 31 20:48:15 VM-PAGRAC3 avahi-daemon[3590]: Withdrawing address record for 169.254.181.91 on eth1.
                              Dec 31 20:49:11 VM-PAGRAC3 avahi-daemon[3590]: Registering new address record for 169.254.181.91 on eth1.
                              Dec 31 20:57:14 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
                              Dec 31 21:01:56 VM-PAGRAC3 avahi-daemon[3590]: Withdrawing address record for 169.254.181.91 on eth1.
                              Dec 31 21:02:52 VM-PAGRAC3 avahi-daemon[3590]: Registering new address record for 169.254.181.91 on eth1.
                              Dec 31 21:27:15 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
                              Dec 31 21:57:10 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
                              Dec 31 22:09:09 VM-PAGRAC3 kernel: sdc: unknown partition table
                              Dec 31 22:09:09 VM-PAGRAC3 kernel: sdd: unknown partition table
                              Dec 31 22:09:09 VM-PAGRAC3 kernel: sde: unknown partition table
                              Dec 31 22:09:09 VM-PAGRAC3 kernel: sdf: unknown partition table
                              Dec 31 22:09:09 VM-PAGRAC3 kernel: sdg: unknown partition table
                              Dec 31 22:09:09 VM-PAGRAC3 kernel: sdh: unknown partition table
                              Dec 31 22:09:09 VM-PAGRAC3 kernel: sdi: unknown partition table
                              Dec 31 22:09:09 VM-PAGRAC3 kernel: sdj: unknown partition tabl
                              • 12. Re: configuring grid infra, asm 11gr2
                                rcc50886
                                its my bad, /var/log/oracleasm is the logfile, so look for error message in that log

                                post error message in following logfile:
                                /var/log/oracleasm  
                                also post
                                ls -ltr /dev/oracleasm
                                • 13. Re: configuring grid infra, asm 11gr2
                                  SaikatBanerjee
                                  logfile content:-
                                  ---------------------
                                  Reloading disk partitions: done
                                  Cleaning any stale ASM disks...
                                  Scanning system for ASM disks...
                                  oracleasm-read-label: Unable to open device "/dev/sdg1": No such file or directo
                                  ry
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  Reloading disk partitions: done
                                  Cleaning any stale ASM disks...
                                  Scanning system for ASM disks...
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  Reloading disk partitions: done
                                  Cleaning any stale ASM disks...
                                  Scanning system for ASM disks...
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  Device "/dev/sdg" is not a partition
                                  Creating /dev/oracleasm mount point: /dev/oracleasm
                                  Loading module "oracleasm": oracleasm
                                  Mounting ASMlib driver filesystem: /dev/oracleasm
                                  Reloading disk partitions: done
                                  Cleaning any stale ASM disks...
                                  Scanning system for ASM disks...
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  Reloading disk partitions: done
                                  Cleaning any stale ASM disks...
                                  Scanning system for ASM disks...
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  ry
                                  oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
                                  More(92%)









                                  [root@VM-PAGRAC3 log]# ls -ltr /dev/oracleasm
                                  total 0
                                  drwxrwx--- 1 grid asmadmin 0 Dec 31 17:24 iid
                                  drwxr-xr-x 1 root root 0 Dec 31 17:24 disks
                                  • 14. Re: configuring grid infra, asm 11gr2
                                    rcc50886
                                    did you partitioned the disks at first ?

                                    form the above logfile:
                                    Device "/dev/sdg" is not a partition
                                    also post the results of
                                    cd /dev/oracleasm/disks/
                                    ls -ltr    --> we must see partitioned disks here.
                                    1 2 Previous Next