This discussion is archived
1 2 Previous Next 22 Replies Latest reply: Jan 1, 2013 6:49 AM by SaikatBanerjee RSS

configuring grid infra, asm 11gr2

SaikatBanerjee Newbie
Currently Being Moderated
Hi,

We are configuring 11gR2 grid on oracle linux 5.8(x86-64).


When I am rebooting my nodes the raw disk permission is getting changed from grid:asmadmin to root:disk.


I followed the url:-"http://docs.oracle.com/cd/E11882_01/install.112/e17212/storage.htm#CDEBFDEH". But I am unable to find what to put instead of RESULT=="14f70656e66696c00000000" in my case?


I tried with asmlib too. But I am getting the following error:-
"[root@VM-PAGRAC4 media]# rpm -ivh oracleasm*.rpm
warning: oracleasmlib-2.0.4-1.el6.x86_64.rpm: Header V3 RSA/SHA256 signature: NOKEY, key ID ec551f03
error: Failed dependencies:
rpmlib(FileDigests) <= 4.6.0-1 is needed by oracleasmlib-2.0.4-1.el6.x86_64
rpmlib(PayloadIsXz) <= 5.2-1 is needed by oracleasmlib-2.0.4-1.el6.x86_64
[root@VM-PAGRAC4 media]#
"


Please help.

Regards,
Saikat
  • 1. Re: configuring grid infra, asm 11gr2
    rcc50886 Journeyer
    Currently Being Moderated
    Install oracleasm libraries properly and configure it by providing details like who owns the disks and what group.


    http://www.oracle.com/technetwork/server-storage/linux/downloads/rhel5-084877.html
  • 2. Re: configuring grid infra, asm 11gr2
    onedbguru Pro
    Currently Being Moderated
    I would not use oracleasm... it is superfluous.

    use the udev or the multipathd rules for setting these permissions.

    http://www.oracle.com/technetwork/database/device-mapper-udev-crs-asm.pdf
  • 3. Re: configuring grid infra, asm 11gr2
    SaikatBanerjee Newbie
    Currently Being Moderated
    my kernel version is:-


    [root@VM-PAGRAC4 /]# uname -r
    2.6.32-300.10.1.el5uek


    unable to find the oracleasm library for this.
    Please help.

    Regards,
    Saikat
  • 4. Re: configuring grid infra, asm 11gr2
    rcc50886 Journeyer
    Currently Being Moderated
    post the following results:
    rpm -qa oracleasm*
    You are using kernel version 2.6

    So download the oracleasm support and oracleasm libraries and install it.

    For Intel EM64T (x86_64) Architecture
    Library and Tools:
    
    oracleasm-support-2.1.7-1.el5.x86_64.rpm
    oracleasmlib-2.0.4-1.el5.x86_64.rpm
  • 5. Re: configuring grid infra, asm 11gr2
    SaikatBanerjee Newbie
    Currently Being Moderated
    [root@VM-PAGRAC3 asmca]# rpm -qa oracleasm*
    oracleasm-support-2.1.7-1.el5
    oracleasm-2.6.18-308.el5-2.0.5-1.el5
    oracleasm-2.6.18-308.el5debug-2.0.5-1.el5
    oracleasm-2.6.18-308.el5xen-2.0.5-1.el5


    okay I got it..I will install and update
  • 6. Re: configuring grid infra, asm 11gr2
    SaikatBanerjee Newbie
    Currently Being Moderated
    rpm -Uvh oracleasm*
    warning: oracleasm-2.6.18-308.el5-2.0.5-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159
    Preparing... ########################################### [100%]
    package oracleasm-support-2.1.7-1.el5.x86_64 is already installed
    package oracleasm-2.6.18-308.el5-2.0.5-1.el5.x86_64 is already installed
    package oracleasm-2.6.18-308.el5xen-2.0.5-1.el5.x86_64 is already installed
    file /usr/lib/oracleasm/oracleasm-candidate-p from install of oracleasm-support-2.1.7-1.el5.x86_64 conflicts with file from package oracleasm-support-2.1.7-1.el5.x86_64
    file /usr/lib/oracleasm/oracleasm-clean-disk from install of oracleasm-support-2.1.7-1.el5.x86_64 conflicts with file from package oracleasm-support-2.1.7-1.el5.x86_64
    file /usr/lib/oracleasm/oracleasm-instantiate-disk from install of oracleasm-support-2.1.7-1.el5.x86_64 conflicts with file from package oracleasm-support-2.1.7-1.el5.x86_64
    file /usr/lib/oracleasm/oracleasm-read-label from install of oracleasm-support-2.1.7-1.el5.x86_64 conflicts with file from package oracleasm-support-2.1.7-1.el5.x86_64
    file /usr/lib/oracleasm/oracleasm-reload-partitions from install of oracleasm-support-2.1.7-1.el5.x86_64 conflicts with file from package oracleasm-support-2.1.7-1.el5.x86_64
    file /usr/lib/oracleasm/oracleasm-scan-partitions from install of oracleasm-support-2.1.7-1.el5.x86_64 conflicts with file from package oracleasm-support-2.1.7-1.el5.x86_64
    file /usr/lib/oracleasm/oracleasm-write-label from install of oracleasm-support-2.1.7-1.el5.x86_64 conflicts with file from package oracleasm-support-2.1.7-1.el5.x86_64



    But I got, the following error

    [root@VM-PAGRAC4 asmlib]# /etc/init.d/oracleasm createdisk DATA /dev/sda
    Marking disk "DATA" as an ASM disk: [FAILED]


    [root@VM-PAGRAC4 asmlib]# /etc/init.d/oracleasm deletedisk DATA /dev/sda
    Removing ASM disk "DATA": [FAILED]

    Edited by: Saikat Banerjee on Dec 31, 2012 9:56 PM
  • 7. Re: configuring grid infra, asm 11gr2
    rcc50886 Journeyer
    Currently Being Moderated
    did you installed oracleasm libraries at all ?

    post again following results:
    rpm -qa oracleasm*
    did you configure the oracleasm at first ?
    /etc/init.d/oracleasm configure
    The above configure command will prompts for the owner and group who needs to own the disks (in general: grid, oinstall)

    also post following results:
    /etc/init.d/oracleasm status
    Edited by: rcc50886 on Dec 31, 2012 8:33 AM
  • 8. Re: configuring grid infra, asm 11gr2
    SaikatBanerjee Newbie
    Currently Being Moderated
    yes, I downloaded

    Intel EM64T (x86_64) Architecture
    Library and Tools
    oracleasm-support-2.1.7-1.el5.x86_64.rpm
  • 9. Re: configuring grid infra, asm 11gr2
    SaikatBanerjee Newbie
    Currently Being Moderated
    Hi,

    yes I have already configured oracleasm.Showing you the o/p:-


    [root@VM-PAGRAC3 asmlib]# oracleasm configure -i
    Configuring the Oracle ASM library driver.

    This will configure the on-boot properties of the Oracle ASM library
    driver. The following questions will determine whether the driver is
    loaded on boot and what permissions it will have. The current values
    will be shown in brackets ('[]'). Hitting <ENTER> without typing an
    answer will keep that current value. Ctrl-C will abort.

    Default user to own the driver interface [grid]:
    Default group to own the driver interface [asmadmin]:
    Start Oracle ASM library driver on boot (y/n) [y]: y
    Scan for Oracle ASM disks on boot (y/n) [y]: y
    Writing Oracle ASM library driver configuration: done
    Initializing the Oracle ASMLib driver: [  OK  ]
    Scanning the system for Oracle ASMLib disks: [  OK  ]
    [root@VM-PAGRAC3 asmlib]#




    [root@VM-PAGRAC3 asmlib]# /etc/init.d/oracleasm status
    Checking if ASM is loaded: yes
    Checking if /dev/oracleasm is mounted: yes
  • 10. Re: configuring grid infra, asm 11gr2
    rcc50886 Journeyer
    Currently Being Moderated
    post error message in following logfile: /var/log/oracleasm

    also post ls -ltr /dev/oracleasm

    Edited by: rcc50886 on Dec 31, 2012 8:42 AM
  • 11. Re: configuring grid infra, asm 11gr2
    SaikatBanerjee Newbie
    Currently Being Moderated
    Pasting contents obtained by cat command:-



    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdd, opened
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device /dev/sdd: using '-d sat' for ATA disk behind SAT layer.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdd, opened
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdd, not found in smartd database.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdd, lacks SMART capability
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdd, to proceed anyway, use '-T permissive' Directive.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sde, opened
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device /dev/sde: using '-d sat' for ATA disk behind SAT layer.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sde, opened
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sde, not found in smartd database.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sde, lacks SMART capability
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sde, to proceed anyway, use '-T permissive' Directive.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdf, opened
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device /dev/sdf: using '-d sat' for ATA disk behind SAT layer.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdf, opened
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdf, not found in smartd database.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdf, lacks SMART capability
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdf, to proceed anyway, use '-T permissive' Directive.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdg, opened
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device /dev/sdg: using '-d sat' for ATA disk behind SAT layer.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdg, opened
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdg, not found in smartd database.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdg, lacks SMART capability
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdg, to proceed anyway, use '-T permissive' Directive.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdh, opened
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device /dev/sdh: using '-d sat' for ATA disk behind SAT layer.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdh, opened
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdh, not found in smartd database.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdh, lacks SMART capability
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdh, to proceed anyway, use '-T permissive' Directive.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdi, opened
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device /dev/sdi: using '-d sat' for ATA disk behind SAT layer.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdi, opened
    Dec 31 17:25:09 VM-PAGRAC3 avahi-daemon[3590]: Server startup complete. Host name is VM-PAGRAC3.local. Local service cookie is 2500236256.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdi, not found in smartd database.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdi, lacks SMART capability
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdi, to proceed anyway, use '-T permissive' Directive.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdj, opened
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device /dev/sdj: using '-d sat' for ATA disk behind SAT layer.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdj, opened
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdj, not found in smartd database.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdj, lacks SMART capability
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Device: /dev/sdj, to proceed anyway, use '-T permissive' Directive.
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3674]: Monitoring 0 ATA and 0 SCSI devices
    Dec 31 17:25:09 VM-PAGRAC3 smartd[3678]: smartd has fork()ed into background mode. New PID=3678.
    Dec 31 17:25:09 VM-PAGRAC3 gconfd (paguser-3698): starting (version 2.14.0), pid 3698 user 'paguser'
    Dec 31 17:25:09 VM-PAGRAC3 gconfd (paguser-3698): Resolved address "xml:readonly:/etc/gconf/gconf.xml.mandatory" to a read-only configuration source at position 0
    Dec 31 17:25:09 VM-PAGRAC3 gconfd (paguser-3698): Resolved address "xml:readwrite:/home/paguser/.gconf" to a writable configuration source at position 1
    Dec 31 17:25:09 VM-PAGRAC3 gconfd (paguser-3698): Resolved address "xml:readonly:/etc/gconf/gconf.xml.defaults" to a read-only configuration source at position 2
    Dec 31 17:25:11 VM-PAGRAC3 hcid[2824]: Default passkey agent (:1.4, /org/bluez/applet) registered
    Dec 31 17:25:11 VM-PAGRAC3 pcscd: winscard.c:304:SCardConnect() Reader E-Gate 0 0 Not Found
    Dec 31 17:25:11 VM-PAGRAC3 last message repeated 2 times
    Dec 31 17:25:12 VM-PAGRAC3 nm-system-settings: Loaded plugin ifcfg-rh: (c) 2007 - 2008 Red Hat, Inc. To report bugs please use the NetworkManager mailing list.
    Dec 31 17:25:12 VM-PAGRAC3 gconfd (paguser-3698): Resolved address "xml:readwrite:/home/paguser/.gconf" to a writable configuration source at position 0
    Dec 31 17:25:15 VM-PAGRAC3 pcscd: winscard.c:304:SCardConnect() Reader E-Gate 0 0 Not Found
    Dec 31 17:25:16 VM-PAGRAC3 nm-system-settings: ifcfg-rh: parsing /etc/sysconfig/network-scripts/ifcfg-eth1 ...
    Dec 31 17:25:16 VM-PAGRAC3 nm-system-settings: ifcfg-rh: read connection 'System eth1'
    Dec 31 17:25:16 VM-PAGRAC3 nm-system-settings: ifcfg-rh: parsing /etc/sysconfig/network-scripts/ifcfg-eth0 ...
    Dec 31 17:25:16 VM-PAGRAC3 nm-system-settings: ifcfg-rh: read connection 'System eth0'
    Dec 31 17:25:16 VM-PAGRAC3 nm-system-settings: ifcfg-rh: parsing /etc/sysconfig/network-scripts/ifcfg-lo ...
    Dec 31 17:39:30 VM-PAGRAC3 avahi-daemon[3590]: Invalid query packet.
    Dec 31 17:40:11 VM-PAGRAC3 last message repeated 15 times
    Dec 31 17:50:25 VM-PAGRAC3 last message repeated 3 times
    Dec 31 17:51:05 VM-PAGRAC3 last message repeated 7 times
    Dec 31 17:51:53 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
    Dec 31 18:21:53 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
    Dec 31 18:51:55 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
    Dec 31 19:21:55 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
    Dec 31 19:51:55 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
    Dec 31 20:26:46 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
    Dec 31 20:26:47 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
    Dec 31 20:41:10 VM-PAGRAC3 init: Re-reading inittab
    Dec 31 20:41:15 VM-PAGRAC3 init: Re-reading inittab
    Dec 31 20:41:15 VM-PAGRAC3 logger: exec /oracle/app/11.2.0/grid/perl/bin/perl -I/oracle/app/11.2.0/grid/perl/lib /oracle/app/11.2.0/grid/bin/crswrapexece.pl /oracle/app/11.2.0/grid/crs/install/s_crsconfig_vm-pagrac3_env.txt /oracle/app/11.2.0/grid/bin/ohasd.bin "reboot"
    Dec 31 20:42:31 VM-PAGRAC3 avahi-daemon[3590]: Registering new address record for 169.254.181.91 on eth1.
    Dec 31 20:48:15 VM-PAGRAC3 avahi-daemon[3590]: Withdrawing address record for 169.254.181.91 on eth1.
    Dec 31 20:49:11 VM-PAGRAC3 avahi-daemon[3590]: Registering new address record for 169.254.181.91 on eth1.
    Dec 31 20:57:14 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
    Dec 31 21:01:56 VM-PAGRAC3 avahi-daemon[3590]: Withdrawing address record for 169.254.181.91 on eth1.
    Dec 31 21:02:52 VM-PAGRAC3 avahi-daemon[3590]: Registering new address record for 169.254.181.91 on eth1.
    Dec 31 21:27:15 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
    Dec 31 21:57:10 VM-PAGRAC3 avahi-daemon[3590]: server.c: Packet too short or invalid while reading response record. (Maybe an UTF8 problem?)
    Dec 31 22:09:09 VM-PAGRAC3 kernel: sdc: unknown partition table
    Dec 31 22:09:09 VM-PAGRAC3 kernel: sdd: unknown partition table
    Dec 31 22:09:09 VM-PAGRAC3 kernel: sde: unknown partition table
    Dec 31 22:09:09 VM-PAGRAC3 kernel: sdf: unknown partition table
    Dec 31 22:09:09 VM-PAGRAC3 kernel: sdg: unknown partition table
    Dec 31 22:09:09 VM-PAGRAC3 kernel: sdh: unknown partition table
    Dec 31 22:09:09 VM-PAGRAC3 kernel: sdi: unknown partition table
    Dec 31 22:09:09 VM-PAGRAC3 kernel: sdj: unknown partition tabl
  • 12. Re: configuring grid infra, asm 11gr2
    rcc50886 Journeyer
    Currently Being Moderated
    its my bad, /var/log/oracleasm is the logfile, so look for error message in that log

    post error message in following logfile:
    /var/log/oracleasm  
    also post
    ls -ltr /dev/oracleasm
  • 13. Re: configuring grid infra, asm 11gr2
    SaikatBanerjee Newbie
    Currently Being Moderated
    logfile content:-
    ---------------------
    Reloading disk partitions: done
    Cleaning any stale ASM disks...
    Scanning system for ASM disks...
    oracleasm-read-label: Unable to open device "/dev/sdg1": No such file or directo
    ry
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    Reloading disk partitions: done
    Cleaning any stale ASM disks...
    Scanning system for ASM disks...
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    Reloading disk partitions: done
    Cleaning any stale ASM disks...
    Scanning system for ASM disks...
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    Device "/dev/sdg" is not a partition
    Creating /dev/oracleasm mount point: /dev/oracleasm
    Loading module "oracleasm": oracleasm
    Mounting ASMlib driver filesystem: /dev/oracleasm
    Reloading disk partitions: done
    Cleaning any stale ASM disks...
    Scanning system for ASM disks...
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    Reloading disk partitions: done
    Cleaning any stale ASM disks...
    Scanning system for ASM disks...
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    ry
    oracleasm-read-label: Unable to open device "/dev/dm-5": No such file or directo
    More(92%)









    [root@VM-PAGRAC3 log]# ls -ltr /dev/oracleasm
    total 0
    drwxrwx--- 1 grid asmadmin 0 Dec 31 17:24 iid
    drwxr-xr-x 1 root root 0 Dec 31 17:24 disks
  • 14. Re: configuring grid infra, asm 11gr2
    rcc50886 Journeyer
    Currently Being Moderated
    did you partitioned the disks at first ?

    form the above logfile:
    Device "/dev/sdg" is not a partition
    also post the results of
    cd /dev/oracleasm/disks/
    ls -ltr    --> we must see partitioned disks here.
1 2 Previous Next

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points