1 2 3 Previous Next 31 Replies Latest reply: Jan 3, 2012 1:58 PM by Catch_22 RSS

    oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash

    908245
      Hello,

      Does anyone know about oracleasm causes kernel crash while configuring it?
      I have oracle linux support fot 99$ and I can install and download latest updates.
      While am trying to configure oracleasm my system goes down and without hardware reset it is not possible to use system again.

      oracleasm configure output:

      [root@www ~]# /etc/init.d/oracleasm configure
      Configuring the Oracle ASM library driver.

      This will configure the on-boot properties of the Oracle ASM library
      driver. The following questions will determine whether the driver is
      loaded on boot and what permissions it will have. The current values
      will be shown in brackets ('[]'). Hitting <ENTER> without typing an
      answer will keep that current value. Ctrl-C will abort.

      Default user to own the driver interface [54322]:
      Default group to own the driver interface [54324]:
      Start Oracle ASM library driver on boot (y/n) [y]:
      Scan for Oracle ASM disks on boot (y/n) [y]:
      Writing Oracle ASM library driver configuration: done
      Initializing the Oracle ASMLib driver: [  OK  ]
      Scanning the system for Oracle ASMLib disks:

      On scanning kernel goes in panic. I have default install of oracle linux with all the packages and services running.

      I have such a kernel:
      [root@www ~]# uname -r
      2.6.32-200.23.1.el5uek

      Kernel kernel-uek-2.6.32-300.4.1.el5uek also goes down while scanning.
      I think that for kernel-uek-2.6.32-100 it will the same problem.
      2.6.18 I can't use because of Oracle DB.

      So I read already all the forums and docs and installed oracleasmlib oracleasmlib-2.0.4-1.el5.x86_64.rpm, oracleasm-support.x86_64 and I still did solve this problem.

      I would appreciate any help. Oracle Linux Basic support for $1k will be possible to purchase just in 5 days.

      Thanks in advance.

      Regards
        • 1. Re: oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash
          Catch_22
          I'm afraid it will be necessary to receive more information from you in order to troubleshoot this issue:

          To get started, please provide the following info:
          rpm -qa |grep asm
          What clues exist in the log files:
          dmesg
          cat /var/log/messages
          cat /var/log/oracleasm 
          Based on the symptoms you described, I suspect a problem with your storage hardware or driver configuration.

          What is your system and storage and I/O controller? Are you using mulitpath?

          Edited by: Dude on Dec 30, 2011 12:07 PM

          I just noticed you wrote you installed "oracleasmlib". Do you mean the oracleasm kernel driver? The Oracle ASMLib kernel driver is now included in the Unbreakable Enterprise Kernel. No driver package needs to be installed when using this kernel. The driver is also kernel dependent and will most likely cause a problem when a wrong version is being used. The oracleasm-support and oracleasmlib packages still need to be installed.
          • 2. Re: oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash
            908245
            rpm

            [root@www ~]# rpm -qa |grep asm
            oracleasm-support-2.1.7-1.el5
            oracleasmlib-2.0.4-1.el5

            selinux is off

            dmesg:

            Initializing cgroup subsys cpuset
            Initializing cgroup subsys cpu
            Linux version 2.6.32-200.23.1.el5uek (mockbuild@ca-build56.us.oracle.com) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-50)) #1 SMP Thu Nov 24 08:30:48 EST 2011
            Command line: ro root=/dev/md2 numa=off
            KERNEL supported cpus:
            Intel GenuineIntel
            AMD AuthenticAMD
            Centaur CentaurHauls
            BIOS-provided physical RAM map:
            BIOS-e820: 0000000000000000 - 000000000009d800 (usable)
            BIOS-e820: 000000000009d800 - 00000000000a0000 (reserved)
            BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
            BIOS-e820: 0000000000100000 - 0000000020000000 (usable)
            BIOS-e820: 0000000020000000 - 0000000020200000 (reserved)
            BIOS-e820: 0000000020200000 - 0000000040000000 (usable)
            BIOS-e820: 0000000040000000 - 0000000040200000 (reserved)
            BIOS-e820: 0000000040200000 - 00000000bac15000 (usable)
            BIOS-e820: 00000000bac15000 - 00000000bac71000 (ACPI NVS)
            BIOS-e820: 00000000bac71000 - 00000000bada4000 (reserved)
            BIOS-e820: 00000000bada4000 - 00000000badb5000 (ACPI NVS)
            BIOS-e820: 00000000badb5000 - 00000000badcc000 (reserved)
            BIOS-e820: 00000000badcc000 - 00000000badce000 (usable)
            BIOS-e820: 00000000badce000 - 00000000badd6000 (reserved)
            BIOS-e820: 00000000badd6000 - 00000000bade0000 (ACPI NVS)
            BIOS-e820: 00000000bade0000 - 00000000bae3a000 (reserved)
            BIOS-e820: 00000000bae3a000 - 00000000bae7d000 (ACPI NVS)
            BIOS-e820: 00000000bae7d000 - 00000000bb000000 (usable)
            BIOS-e820: 00000000bb800000 - 00000000bfa00000 (reserved)
            BIOS-e820: 00000000fed1c000 - 00000000fed20000 (reserved)
            BIOS-e820: 00000000ff000000 - 0000000100000000 (reserved)
            BIOS-e820: 0000000100000000 - 000000043fe00000 (usable)
            DMI 2.6 present.
            AMI BIOS detected: BIOS may corrupt low RAM, working around it.
            e820 update range: 0000000000000000 - 0000000000010000 (usable) ==> (reserved)
            last_pfn = 0x43fe00 max_arch_pfn = 0x400000000
            MTRR default type: uncachable
            MTRR fixed ranges enabled:
            00000-9FFFF write-back
            A0000-BFFFF uncachable
            C0000-CFFFF write-protect
            D0000-E7FFF uncachable
            E8000-FFFFF write-protect
            MTRR variable ranges enabled:
            0 base 000000000 mask C00000000 write-back
            1 base 400000000 mask FC0000000 write-back
            2 base 0BB800000 mask FFF800000 uncachable
            3 base 0BC000000 mask FFC000000 uncachable
            4 base 0C0000000 mask FC0000000 uncachable
            5 base 43FE00000 mask FFFE00000 uncachable
            6 disabled
            7 disabled
            8 disabled
            9 disabled
            x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
            original variable MTRRs
            reg 0, base: 0GB, range: 16GB, type WB
            reg 1, base: 16GB, range: 1GB, type WB
            reg 2, base: 3000MB, range: 8MB, type UC
            reg 3, base: 3008MB, range: 64MB, type UC
            reg 4, base: 3GB, range: 1GB, type UC
            reg 5, base: 17406MB, range: 2MB, type UC
            total RAM covered: 16310M
            Found optimal setting for mtrr clean up
            gran_size: 64K      chunk_size: 128M      num_reg: 8      lose cover RAM: 0G
            New variable MTRRs
            reg 0, base: 0GB, range: 2GB, type WB
            reg 1, base: 2GB, range: 1GB, type WB
            reg 2, base: 3000MB, range: 8MB, type UC
            reg 3, base: 3008MB, range: 64MB, type UC
            reg 4, base: 4GB, range: 4GB, type WB
            reg 5, base: 8GB, range: 8GB, type WB
            reg 6, base: 16GB, range: 1GB, type WB
            reg 7, base: 17406MB, range: 2MB, type UC
            e820 update range: 00000000bb800000 - 0000000100000000 (usable) ==> (reserved)
            last_pfn = 0xbb000 max_arch_pfn = 0x400000000
            initial memory mapped : 0 - 20000000
            init_memory_mapping: 0000000000000000-00000000bb000000
            0000000000 - 00bb000000 page 2M
            kernel direct mapping tables up to bb000000 @ 10000-14000
            init_memory_mapping: 0000000100000000-000000043fe00000
            0100000000 - 043fe00000 page 2M
            kernel direct mapping tables up to 43fe00000 @ 12000-24000
            RAMDISK: 1fce0000 - 1ffef58c
            ACPI: RSDP 00000000000f0420 00024 (v02 ALASKA)
            ACPI: XSDT 00000000bac63068 0004C (v01 ALASKA A M I 01072009 AMI 00010013)
            ACPI: FACP 00000000bac6cfa0 000F4 (v04 ALASKA A M I 01072009 AMI 00010013)
            ACPI: DSDT 00000000bac63140 09E5F (v02 ALASKA A M I 00000000 INTL 20051117)
            ACPI: FACS 00000000badd7f80 00040
            ACPI: APIC 00000000bac6d098 00092 (v03 ALASKA A M I 01072009 AMI 00010013)
            ACPI: SSDT 00000000bac6d130 001D6 (v01 AMICPU PROC 00000001 MSFT 03000001)
            ACPI: MCFG 00000000bac6d308 0003C (v01 ALASKA A M I 01072009 MSFT 00000097)
            ACPI: HPET 00000000bac6d348 00038 (v01 ALASKA A M I 01072009 AMI. 00000004)
            ACPI: Local APIC address 0xfee00000
            NUMA turned off
            Faking a node at 0000000000000000-000000043fe00000
            Bootmem setup node 0 0000000000000000-000000043fe00000
            NODE_DATA [000000000001f000 - 0000000000034fff]
            bootmap [0000000000100000 - 0000000000187fbf] pages 88
            (8 early reservations) ==> bootmem [0000000000 - 043fe00000]
            #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000]
            #1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000]
            #2 [0001000000 - 000224b73c] TEXT DATA BSS ==> [0001000000 - 000224b73c]
            #3 [001fce0000 - 001ffef58c] RAMDISK ==> [001fce0000 - 001ffef58c]
            #4 [000009d800 - 0000100000] BIOS reserved ==> [000009d800 - 0000100000]
            #5 [000224c000 - 000224c26e] BRK ==> [000224c000 - 000224c26e]
            #6 [0000010000 - 0000012000] PGTABLE ==> [0000010000 - 0000012000]
            #7 [0000012000 - 000001f000] PGTABLE ==> [0000012000 - 000001f000]
            found SMP MP-table at [ffff8800000fccd0] fccd0
            [ffffea0000000000-ffffea000edfffff] PMD -> [ffff88002c600000-ffff88003a5fffff] on node 0
            Zone PFN ranges:
            DMA 0x00000010 -> 0x00001000
            DMA32 0x00001000 -> 0x00100000
            Normal 0x00100000 -> 0x0043fe00
            Movable zone start PFN for each node
            early_node_map[7] active PFN ranges
            0: 0x00000010 -> 0x0000009d
            0: 0x00000100 -> 0x00020000
            0: 0x00020200 -> 0x00040000
            0: 0x00040200 -> 0x000bac15
            0: 0x000badcc -> 0x000badce
            0: 0x000bae7d -> 0x000bb000
            0: 0x00100000 -> 0x0043fe00
            On node 0 totalpages: 4171559
            DMA zone: 56 pages used for memmap
            DMA zone: 116 pages reserved
            DMA zone: 3809 pages, LIFO batch:0
            DMA32 zone: 14280 pages used for memmap
            DMA32 zone: 745938 pages, LIFO batch:31
            Normal zone: 46585 pages used for memmap
            Normal zone: 3360775 pages, LIFO batch:31
            ACPI: PM-Timer IO Port: 0x408
            ACPI: Local APIC address 0xfee00000
            ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
            ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
            ACPI: LAPIC (acpi_id[0x03] lapic_id[0x04] enabled)
            ACPI: LAPIC (acpi_id[0x04] lapic_id[0x06] enabled)
            ACPI: LAPIC (acpi_id[0x05] lapic_id[0x01] enabled)
            ACPI: LAPIC (acpi_id[0x06] lapic_id[0x03] enabled)
            ACPI: LAPIC (acpi_id[0x07] lapic_id[0x05] enabled)
            ACPI: LAPIC (acpi_id[0x08] lapic_id[0x07] enabled)
            ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
            ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
            IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
            ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
            ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
            ACPI: IRQ0 used by override.
            ACPI: IRQ2 used by override.
            ACPI: IRQ9 used by override.
            Using ACPI (MADT) for SMP configuration information
            ACPI: HPET id: 0x8086a701 base: 0xfed00000
            SMP: Allowing 8 CPUs, 0 hotplug CPUs
            nr_irqs_gsi: 24
            PM: Registered nosave memory: 000000000009d000 - 000000000009e000
            PM: Registered nosave memory: 000000000009e000 - 00000000000a0000
            PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000
            PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
            PM: Registered nosave memory: 0000000020000000 - 0000000020200000
            PM: Registered nosave memory: 0000000040000000 - 0000000040200000
            PM: Registered nosave memory: 00000000bac15000 - 00000000bac71000
            PM: Registered nosave memory: 00000000bac71000 - 00000000bada4000
            PM: Registered nosave memory: 00000000bada4000 - 00000000badb5000
            PM: Registered nosave memory: 00000000badb5000 - 00000000badcc000
            PM: Registered nosave memory: 00000000badce000 - 00000000badd6000
            PM: Registered nosave memory: 00000000badd6000 - 00000000bade0000
            PM: Registered nosave memory: 00000000bade0000 - 00000000bae3a000
            PM: Registered nosave memory: 00000000bae3a000 - 00000000bae7d000
            PM: Registered nosave memory: 00000000bb000000 - 00000000bb800000
            PM: Registered nosave memory: 00000000bb800000 - 00000000bfa00000
            PM: Registered nosave memory: 00000000bfa00000 - 00000000fed1c000
            PM: Registered nosave memory: 00000000fed1c000 - 00000000fed20000
            PM: Registered nosave memory: 00000000fed20000 - 00000000ff000000
            PM: Registered nosave memory: 00000000ff000000 - 0000000100000000
            Allocating PCI resources starting at bfa00000 (gap: bfa00000:3f31c000)
            Booting paravirtualized kernel on bare hardware
            NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:8 nr_node_ids:1
            PERCPU: Embedded 29 pages/cpu @ffff88002c200000 s88280 r8192 d22312 u262144
            pcpu-alloc: s88280 r8192 d22312 u262144 alloc=1*2097152
            pcpu-alloc: [0] 0 1 2 3 4 5 6 7
            Built 1 zonelists in Zone order, mobility grouping on. Total pages: 4110522
            Policy zone: Normal
            Kernel command line: ro root=/dev/md2 numa=off
            PID hash table entries: 4096 (order: 3, 32768 bytes)
            Initializing CPU#0
            xsave/xrstor: enabled xstate_bv 0x7, cntxt size 0x340
            Checking aperture...
            No AGP bridge found
            Calgary: detecting Calgary via BIOS EBDA area
            Calgary: Unable to locate Rio Grande table in EBDA - bailing!
            PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
            Placing 64MB software IO TLB between ffff880024000000 - ffff880028000000
            software IO TLB at phys 0x24000000 - 0x28000000
            Memory: 16367660k/17823744k available (4454k kernel code, 1137508k absent, 318576k reserved, 7191k data, 1720k init)
            Hierarchical RCU implementation.
            NR_IRQS:4352 nr_irqs:472
            Extended CMOS year: 2000
            Console: colour VGA+ 80x25
            console [tty0] enabled
            allocated 167772160 bytes of page_cgroup
            please try 'cgroup_disable=memory' option if you don't want memory cgroups
            hpet clockevent registered
            Fast TSC calibration using PIT
            Detected 3411.494 MHz processor.
            Calibrating delay loop (skipped), value calculated using timer frequency.. 6822.98 BogoMIPS (lpj=3411494)
            Security Framework initialized
            SELinux: Initializing.
            SELinux: Starting in permissive mode
            Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
            Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
            Mount-cache hash table entries: 256
            Initializing cgroup subsys ns
            Initializing cgroup subsys cpuacct
            Initializing cgroup subsys memory
            Initializing cgroup subsys devices
            Initializing cgroup subsys freezer
            Initializing cgroup subsys net_cls
            CPU: Physical Processor ID: 0
            CPU: Processor Core ID: 0
            CPU: L1 I cache: 32K, L1 D cache: 32K
            CPU: L2 cache: 256K
            CPU: L3 cache: 8192K
            CPU 0/0x0 -> Node 0
            mce: CPU supports 9 MCE banks
            CPU0: Thermal monitoring enabled (TM1)
            CPU 0 MCA banks CMCI:0 CMCI:1 CMCI:3 SHD:5 SHD:6 SHD:7 CMCI:8
            using mwait in idle threads.
            Performance Events: Nehalem/Corei7 events, Intel PMU driver.
            ... version: 3
            ... bit width: 48
            ... generic registers: 4
            ... value mask: 0000ffffffffffff
            ... max period: 000000007fffffff
            ... fixed-purpose events: 3
            ... event mask: 000000070000000f
            ACPI: Core revision 20090903
            ftrace: converting mcount calls to 0f 1f 44 00 00
            ftrace: allocating 26669 entries in 105 pages
            Not enabling x2apic, Intr-remapping init failed.
            Setting APIC routing to flat
            ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
            CPU0: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz stepping 07
            Booting processor 1 APIC 0x2 ip 0x6000
            Initializing CPU#1
            CPU: Physical Processor ID: 0
            CPU: Processor Core ID: 1
            CPU: L1 I cache: 32K, L1 D cache: 32K
            CPU: L2 cache: 256K
            CPU: L3 cache: 8192K
            CPU 1/0x2 -> Node 0
            CPU1: Thermal monitoring enabled (TM1)
            CPU 1 MCA banks CMCI:0 CMCI:1 CMCI:3 SHD:5 SHD:6 SHD:7 SHD:8
            CPU1: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz stepping 07
            checking TSC synchronization [CPU#0 -> CPU#1]: passed.
            Booting processor 2 APIC 0x4 ip 0x6000
            Initializing CPU#2
            CPU: Physical Processor ID: 0
            CPU: Processor Core ID: 2
            CPU: L1 I cache: 32K, L1 D cache: 32K
            CPU: L2 cache: 256K
            CPU: L3 cache: 8192K
            CPU 2/0x4 -> Node 0
            CPU2: Thermal monitoring enabled (TM1)
            CPU 2 MCA banks CMCI:0 CMCI:1 CMCI:3 SHD:5 SHD:6 SHD:7 SHD:8
            CPU2: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz stepping 07
            checking TSC synchronization [CPU#0 -> CPU#2]: passed.
            Booting processor 3 APIC 0x6 ip 0x6000
            Initializing CPU#3
            CPU: Physical Processor ID: 0
            CPU: Processor Core ID: 3
            CPU: L1 I cache: 32K, L1 D cache: 32K
            CPU: L2 cache: 256K
            CPU: L3 cache: 8192K
            CPU 3/0x6 -> Node 0
            CPU3: Thermal monitoring enabled (TM1)
            CPU 3 MCA banks CMCI:0 CMCI:1 CMCI:3 SHD:5 SHD:6 SHD:7 SHD:8
            CPU3: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz stepping 07
            checking TSC synchronization [CPU#0 -> CPU#3]: passed.
            Booting processor 4 APIC 0x1 ip 0x6000
            Initializing CPU#4
            CPU: Physical Processor ID: 0
            CPU: Processor Core ID: 0
            CPU: L1 I cache: 32K, L1 D cache: 32K
            CPU: L2 cache: 256K
            CPU: L3 cache: 8192K
            CPU 4/0x1 -> Node 0
            CPU4: Thermal monitoring enabled (TM1)
            CPU 4 MCA banks SHD:0 SHD:1 SHD:3 SHD:5 SHD:6 SHD:7 SHD:8
            CPU4: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz stepping 07
            checking TSC synchronization [CPU#0 -> CPU#4]: passed.
            Booting processor 5 APIC 0x3 ip 0x6000
            Initializing CPU#5
            CPU: Physical Processor ID: 0
            CPU: Processor Core ID: 1
            CPU: L1 I cache: 32K, L1 D cache: 32K
            CPU: L2 cache: 256K
            CPU: L3 cache: 8192K
            CPU 5/0x3 -> Node 0
            CPU5: Thermal monitoring enabled (TM1)
            CPU 5 MCA banks SHD:0 SHD:1 SHD:3 SHD:5 SHD:6 SHD:7 SHD:8
            CPU5: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz stepping 07
            checking TSC synchronization [CPU#0 -> CPU#5]: passed.
            Booting processor 6 APIC 0x5 ip 0x6000
            Initializing CPU#6
            CPU: Physical Processor ID: 0
            CPU: Processor Core ID: 2
            CPU: L1 I cache: 32K, L1 D cache: 32K
            CPU: L2 cache: 256K
            CPU: L3 cache: 8192K
            CPU 6/0x5 -> Node 0
            CPU6: Thermal monitoring enabled (TM1)
            CPU 6 MCA banks SHD:0 SHD:1 SHD:3 SHD:5 SHD:6 SHD:7 SHD:8
            CPU6: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz stepping 07
            checking TSC synchronization [CPU#0 -> CPU#6]: passed.
            Booting processor 7 APIC 0x7 ip 0x6000
            Initializing CPU#7
            CPU: Physical Processor ID: 0
            CPU: Processor Core ID: 3
            CPU: L1 I cache: 32K, L1 D cache: 32K
            CPU: L2 cache: 256K
            CPU: L3 cache: 8192K
            CPU 7/0x7 -> Node 0
            CPU7: Thermal monitoring enabled (TM1)
            CPU 7 MCA banks SHD:0 SHD:1 SHD:3 SHD:5 SHD:6 SHD:7 SHD:8
            CPU7: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz stepping 07
            checking TSC synchronization [CPU#0 -> CPU#7]: passed.
            Brought up 8 CPUs
            Total of 8 processors activated (54583.17 BogoMIPS).
            CPU0 attaching sched-domain:
            domain 0: span 0,4 level SIBLING
            groups: 0 (cpu_power = 589) 4 (cpu_power = 589)
            domain 1: span 0-7 level MC
            groups: 0,4 (cpu_power = 1178) 1,5 (cpu_power = 1178) 2,6 (cpu_power = 1178) 3,7 (cpu_power = 1178)
            CPU1 attaching sched-domain:
            domain 0: span 1,5 level SIBLING
            groups: 1 (cpu_power = 589) 5 (cpu_power = 589)
            domain 1: span 0-7 level MC
            groups: 1,5 (cpu_power = 1178) 2,6 (cpu_power = 1178) 3,7 (cpu_power = 1178) 0,4 (cpu_power = 1178)
            CPU2 attaching sched-domain:
            domain 0: span 2,6 level SIBLING
            groups: 2 (cpu_power = 589) 6 (cpu_power = 589)
            domain 1: span 0-7 level MC
            groups: 2,6 (cpu_power = 1178) 3,7 (cpu_power = 1178) 0,4 (cpu_power = 1178) 1,5 (cpu_power = 1178)
            CPU3 attaching sched-domain:
            domain 0: span 3,7 level SIBLING
            groups: 3 (cpu_power = 589) 7 (cpu_power = 589)
            domain 1: span 0-7 level MC
            groups: 3,7 (cpu_power = 1178) 0,4 (cpu_power = 1178) 1,5 (cpu_power = 1178) 2,6 (cpu_power = 1178)
            CPU4 attaching sched-domain:
            domain 0: span 0,4 level SIBLING
            groups: 4 (cpu_power = 589) 0 (cpu_power = 589)
            domain 1: span 0-7 level MC
            groups: 0,4 (cpu_power = 1178) 1,5 (cpu_power = 1178) 2,6 (cpu_power = 1178) 3,7 (cpu_power = 1178)
            CPU5 attaching sched-domain:
            domain 0: span 1,5 level SIBLING
            groups: 5 (cpu_power = 589) 1 (cpu_power = 589)
            domain 1: span 0-7 level MC
            groups: 1,5 (cpu_power = 1178) 2,6 (cpu_power = 1178) 3,7 (cpu_power = 1178) 0,4 (cpu_power = 1178)
            CPU6 attaching sched-domain:
            domain 0: span 2,6 level SIBLING
            groups: 6 (cpu_power = 589) 2 (cpu_power = 589)
            domain 1: span 0-7 level MC
            groups: 2,6 (cpu_power = 1178) 3,7 (cpu_power = 1178) 0,4 (cpu_power = 1178) 1,5 (cpu_power = 1178)
            CPU7 attaching sched-domain:
            domain 0: span 3,7 level SIBLING
            groups: 7 (cpu_power = 589) 3 (cpu_power = 589)
            domain 1: span 0-7 level MC
            groups: 3,7 (cpu_power = 1178) 0,4 (cpu_power = 1178) 1,5 (cpu_power = 1178) 2,6 (cpu_power = 1178)
            regulator: core version 0.5
            Time: 19:24:04 Date: 12/30/11
            NET: Registered protocol family 16
            ACPI: bus type pci registered
            PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 63
            PCI: Not using MMCONFIG.
            PCI: Using configuration type 1 for base access
            bio: create slab <bio-0> at 0
            ACPI: EC: Look up EC in DSDT
            ACPI: Executed 1 blocks of module-level executable AML code
            ACPI Error (psargs-0359): [RAMB] Namespace lookup failure, AE_NOT_FOUND
            ACPI Exception: AE_NOT_FOUND, Could not execute arguments for [RAMW] (Region) (20090903/nsinit-338)
            ACPI: Interpreter enabled
            ACPI: (supports S0 S1 S3 S4 S5)
            ACPI: Using IOAPIC for interrupt routing
            PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 63
            PCI: MCFG area at e0000000 reserved in ACPI motherboard resources
            PCI: Using MMCONFIG at e0000000 - e3ffffff
            ACPI: BIOS _OSI(Linux) query ignored
            ACPI: No dock devices found.
            ACPI: PCI Root Bridge [PCI0] (0000:00)
            pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
            pci 0000:00:01.0: PME# disabled
            pci 0000:00:02.0: reg 10 64bit mmio: [0xfe000000-0xfe3fffff]
            pci 0000:00:02.0: reg 18 64bit mmio pref: [0xc0000000-0xcfffffff]
            pci 0000:00:02.0: reg 20 io port: [0xf000-0xf03f]
            pci 0000:00:16.0: reg 10 64bit mmio: [0xfe504000-0xfe50400f]
            pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
            pci 0000:00:16.0: PME# disabled
            pci 0000:00:1a.0: reg 10 32bit mmio: [0xfe503000-0xfe5033ff]
            pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
            pci 0000:00:1a.0: PME# disabled
            pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
            pci 0000:00:1c.0: PME# disabled
            pci 0000:00:1c.5: PME# supported from D0 D3hot D3cold
            pci 0000:00:1c.5: PME# disabled
            pci 0000:00:1c.6: PME# supported from D0 D3hot D3cold
            pci 0000:00:1c.6: PME# disabled
            pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
            pci 0000:00:1c.7: PME# disabled
            pci 0000:00:1d.0: reg 10 32bit mmio: [0xfe502000-0xfe5023ff]
            pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
            pci 0000:00:1d.0: PME# disabled
            pci 0000:00:1f.2: reg 10 io port: [0xf0b0-0xf0b7]
            pci 0000:00:1f.2: reg 14 io port: [0xf0a0-0xf0a3]
            pci 0000:00:1f.2: reg 18 io port: [0xf090-0xf097]
            pci 0000:00:1f.2: reg 1c io port: [0xf080-0xf083]
            pci 0000:00:1f.2: reg 20 io port: [0xf060-0xf07f]
            pci 0000:00:1f.2: reg 24 32bit mmio: [0xfe501000-0xfe5017ff]
            pci 0000:00:1f.2: PME# supported from D3hot
            pci 0000:00:1f.2: PME# disabled
            pci 0000:00:1f.3: reg 10 64bit mmio: [0xfe500000-0xfe5000ff]
            pci 0000:00:1f.3: reg 20 io port: [0xf040-0xf05f]
            pci 0000:03:00.0: reg 10 64bit mmio: [0xfe400000-0xfe407fff]
            pci 0000:03:00.0: PME# supported from D3hot D3cold
            pci 0000:03:00.0: PME# disabled
            pci 0000:00:1c.5: bridge 32bit mmio: [0xfe400000-0xfe4fffff]
            pci 0000:04:00.0: reg 10 io port: [0xe000-0xe0ff]
            pci 0000:04:00.0: reg 18 64bit mmio pref: [0xd0004000-0xd0004fff]
            pci 0000:04:00.0: reg 20 64bit mmio pref: [0xd0000000-0xd0003fff]
            pci 0000:04:00.0: supports D1 D2
            pci 0000:04:00.0: PME# supported from D0 D1 D2 D3hot D3cold
            pci 0000:04:00.0: PME# disabled
            pci 0000:00:1c.6: bridge io port: [0xe000-0xefff]
            pci 0000:00:1c.6: bridge 64bit mmio pref: [0xd0000000-0xd00fffff]
            pci 0000:00:1c.7: transparent bridge
            pci 0000:05:00.0: transparent bridge
            • 3. Re: oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash
              908245
              ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
              ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.P0P1._PRT]
              ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX0._PRT]
              ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX5._PRT]
              ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX6._PRT]
              ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEX7.BR19._PRT]
              ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15)
              ACPI: PCI Interrupt Link [LNKB] (IRQs *3 4 5 6 7 10 11 12 14 15)
              ACPI: PCI Interrupt Link [LNKC] (IRQs 3 *4 5 6 10 11 12 14 15)
              ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
              ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 *10 11 12 14 15)
              ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 *10 11 12 14 15)
              ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 12 14 15) *0
              ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 *5 6 7 10 11 12 14 15)
              vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
              vgaarb: loaded
              SCSI subsystem initialized
              libata version 3.00 loaded.
              usbcore: registered new interface driver usbfs
              usbcore: registered new interface driver hub
              usbcore: registered new device driver usb
              PCI: Using ACPI for IRQ routing
              NetLabel: Initializing
              NetLabel: domain hash size = 128
              NetLabel: protocols = UNLABELED CIPSOv4
              NetLabel: unlabeled traffic allowed by default
              hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
              hpet0: 8 comparators, 64-bit 14.318180 MHz counter
              Switching to clocksource tsc
              pnp: PnP ACPI init
              ACPI: bus type pnp registered
              pnp: PnP ACPI: found 12 devices
              ACPI: ACPI bus type pnp unregistered
              system 00:01: iomem range 0xfed10000-0xfed19fff has been reserved
              system 00:01: iomem range 0xe0000000-0xe3ffffff has been reserved
              system 00:01: iomem range 0xfed90000-0xfed93fff has been reserved
              system 00:01: iomem range 0xfed20000-0xfed3ffff has been reserved
              system 00:01: iomem range 0xfee00000-0xfee0ffff has been reserved
              system 00:02: ioport range 0x290-0x29f has been reserved
              system 00:06: ioport range 0x4d0-0x4d1 has been reserved
              system 00:09: ioport range 0x400-0x453 has been reserved
              system 00:09: ioport range 0x458-0x47f has been reserved
              system 00:09: ioport range 0x500-0x57f has been reserved
              system 00:09: iomem range 0xfed1c000-0xfed1ffff has been reserved
              system 00:09: iomem range 0xfec00000-0xfecfffff could not be reserved
              system 00:09: iomem range 0xfed08000-0xfed08fff has been reserved
              system 00:09: iomem range 0xff000000-0xffffffff has been reserved
              system 00:0a: ioport range 0x454-0x457 has been reserved
              pci 0000:00:01.0: PCI bridge, secondary bus 0000:01
              pci 0000:00:01.0: IO window: disabled
              pci 0000:00:01.0: MEM window: disabled
              pci 0000:00:01.0: PREFETCH window: disabled
              pci 0000:00:1c.0: PCI bridge, secondary bus 0000:02
              pci 0000:00:1c.0: IO window: disabled
              pci 0000:00:1c.0: MEM window: disabled
              pci 0000:00:1c.0: PREFETCH window: disabled
              pci 0000:00:1c.5: PCI bridge, secondary bus 0000:03
              pci 0000:00:1c.5: IO window: disabled
              pci 0000:00:1c.5: MEM window: 0xfe400000-0xfe4fffff
              pci 0000:00:1c.5: PREFETCH window: disabled
              pci 0000:00:1c.6: PCI bridge, secondary bus 0000:04
              pci 0000:00:1c.6: IO window: 0xe000-0xefff
              pci 0000:00:1c.6: MEM window: disabled
              pci 0000:00:1c.6: PREFETCH window: 0x000000d0000000-0x000000d00fffff
              pci 0000:05:00.0: PCI bridge, secondary bus 0000:06
              pci 0000:05:00.0: IO window: disabled
              pci 0000:05:00.0: MEM window: disabled
              pci 0000:05:00.0: PREFETCH window: disabled
              pci 0000:00:1c.7: PCI bridge, secondary bus 0000:05
              pci 0000:00:1c.7: IO window: disabled
              pci 0000:00:1c.7: MEM window: disabled
              pci 0000:00:1c.7: PREFETCH window: disabled
              alloc irq_desc for 16 on node -1
              alloc kstat_irqs on node -1
              pci 0000:00:01.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
              pci 0000:00:01.0: setting latency timer to 64
              alloc irq_desc for 17 on node -1
              alloc kstat_irqs on node -1
              pci 0000:00:1c.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
              pci 0000:00:1c.0: setting latency timer to 64
              pci 0000:00:1c.5: PCI INT B -> GSI 16 (level, low) -> IRQ 16
              pci 0000:00:1c.5: setting latency timer to 64
              alloc irq_desc for 18 on node -1
              alloc kstat_irqs on node -1
              pci 0000:00:1c.6: PCI INT C -> GSI 18 (level, low) -> IRQ 18
              pci 0000:00:1c.6: setting latency timer to 64
              alloc irq_desc for 19 on node -1
              alloc kstat_irqs on node -1
              pci 0000:00:1c.7: PCI INT D -> GSI 19 (level, low) -> IRQ 19
              pci 0000:00:1c.7: setting latency timer to 64
              pci 0000:05:00.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
              pci 0000:05:00.0: setting latency timer to 64
              pci_bus 0000:00: resource 0 io: [0x00-0xffff]
              pci_bus 0000:00: resource 1 mem: [0x000000-0xffffffffffffffff]
              pci_bus 0000:03: resource 1 mem: [0xfe400000-0xfe4fffff]
              pci_bus 0000:04: resource 0 io: [0xe000-0xefff]
              pci_bus 0000:04: resource 2 pref mem [0xd0000000-0xd00fffff]
              pci_bus 0000:05: resource 3 io: [0x00-0xffff]
              pci_bus 0000:05: resource 4 mem: [0x000000-0xffffffffffffffff]
              pci_bus 0000:06: resource 6 io: [0x00-0xffff]
              pci_bus 0000:06: resource 7 mem: [0x000000-0xffffffffffffffff]
              NET: Registered protocol family 2
              IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
              TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
              TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
              TCP: Hash tables configured (established 524288 bind 65536)
              TCP reno registered
              NET: Registered protocol family 1
              pci 0000:00:02.0: Boot video device
              Trying to unpack rootfs image as initramfs...
              Freeing initrd memory: 3133k freed
              audit: initializing netlink socket (disabled)
              type=2000 audit(1325273043.887:1): initialized
              HugeTLB registered 2 MB page size, pre-allocated 0 pages
              VFS: Disk quotas dquot_6.5.2
              Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
              msgmni has been set to 31974
              SELinux: Registering netfilter hooks
              alg: No test for stdrng (krng)
              ksign: Installing public key data
              Loading keyring
              - Added public key 2DE6175E5739F513
              - User ID: Oracle America, Inc. (Kernel Module GPG key)
              Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
              io scheduler noop registered
              io scheduler anticipatory registered
              io scheduler deadline registered (default)
              io scheduler cfq registered
              alloc irq_desc for 24 on node -1
              alloc kstat_irqs on node -1
              pcieport 0000:00:01.0: irq 24 for MSI/MSI-X
              pcieport 0000:00:01.0: setting latency timer to 64
              alloc irq_desc for 25 on node -1
              alloc kstat_irqs on node -1
              pcieport 0000:00:1c.0: irq 25 for MSI/MSI-X
              pcieport 0000:00:1c.0: setting latency timer to 64
              alloc irq_desc for 26 on node -1
              alloc kstat_irqs on node -1
              pcieport 0000:00:1c.5: irq 26 for MSI/MSI-X
              pcieport 0000:00:1c.5: setting latency timer to 64
              alloc irq_desc for 27 on node -1
              alloc kstat_irqs on node -1
              pcieport 0000:00:1c.6: irq 27 for MSI/MSI-X
              pcieport 0000:00:1c.6: setting latency timer to 64
              pci_hotplug: PCI Hot Plug PCI Core version: 0.5
              pciehp: PCI Express Hot Plug Controller Driver version: 0.4
              acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
              input: Power Button as /class/input/input0
              ACPI: Power Button [PWRB]
              input: Power Button as /class/input/input1
              ACPI: Power Button [PWRF]
              ACPI: SSDT 00000000baddf898 006F4 (v01 AMI IST 00000001 MSFT 03000001)
              ACPI: SSDT 00000000badd6d98 000E4 (v01 AMI CST 00000001 MSFT 03000001)
              Monitor-Mwait will be used to enter C-2 state
              Monitor-Mwait will be used to enter C-3 state
              processor LNXCPU:00: registered as cooling_device0
              processor LNXCPU:01: registered as cooling_device1
              processor LNXCPU:02: registered as cooling_device2
              processor LNXCPU:03: registered as cooling_device3
              processor LNXCPU:04: registered as cooling_device4
              processor LNXCPU:05: registered as cooling_device5
              processor LNXCPU:06: registered as cooling_device6
              processor LNXCPU:07: registered as cooling_device7
              Non-volatile memory driver v1.3
              Linux agpgart interface v0.103
              Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
              brd: module loaded
              loop: module loaded
              input: Macintosh mouse button emulation as /class/input/input2
              Fixed MDIO Bus: probed
              ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
              alloc irq_desc for 23 on node -1
              alloc kstat_irqs on node -1
              ehci_hcd 0000:00:1a.0: PCI INT A -> GSI 23 (level, low) -> IRQ 23
              ehci_hcd 0000:00:1a.0: setting latency timer to 64
              ehci_hcd 0000:00:1a.0: EHCI Host Controller
              ehci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
              ehci_hcd 0000:00:1a.0: debug port 2
              ehci_hcd 0000:00:1a.0: cache line size of 32 is not supported
              ehci_hcd 0000:00:1a.0: irq 23, io mem 0xfe503000
              ehci_hcd 0000:00:1a.0: USB 2.0 started, EHCI 1.00
              usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
              usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
              usb usb1: Product: EHCI Host Controller
              usb usb1: Manufacturer: Linux 2.6.32-200.23.1.el5uek ehci_hcd
              usb usb1: SerialNumber: 0000:00:1a.0
              usb usb1: configuration #1 chosen from 1 choice
              hub 1-0:1.0: USB hub found
              hub 1-0:1.0: 2 ports detected
              ehci_hcd 0000:00:1d.0: PCI INT A -> GSI 23 (level, low) -> IRQ 23
              ehci_hcd 0000:00:1d.0: setting latency timer to 64
              ehci_hcd 0000:00:1d.0: EHCI Host Controller
              ehci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
              ehci_hcd 0000:00:1d.0: debug port 2
              ehci_hcd 0000:00:1d.0: cache line size of 32 is not supported
              ehci_hcd 0000:00:1d.0: irq 23, io mem 0xfe502000
              ehci_hcd 0000:00:1d.0: USB 2.0 started, EHCI 1.00
              usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
              usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
              usb usb2: Product: EHCI Host Controller
              usb usb2: Manufacturer: Linux 2.6.32-200.23.1.el5uek ehci_hcd
              usb usb2: SerialNumber: 0000:00:1d.0
              usb usb2: configuration #1 chosen from 1 choice
              hub 2-0:1.0: USB hub found
              hub 2-0:1.0: 2 ports detected
              ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
              uhci_hcd: USB Universal Host Controller Interface driver
              xhci_hcd 0000:03:00.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
              xhci_hcd 0000:03:00.0: setting latency timer to 64
              xhci_hcd 0000:03:00.0: xHCI Host Controller
              xhci_hcd 0000:03:00.0: new USB bus registered, assigned bus number 3
              xhci_hcd 0000:03:00.0: irq 17, io mem 0xfe400000
              usb usb3: config 1 interface 0 altsetting 0 endpoint 0x81 has no SuperSpeed companion descriptor
              usb usb3: New USB device found, idVendor=1d6b, idProduct=0003
              usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
              usb usb3: Product: xHCI Host Controller
              usb usb3: Manufacturer: Linux 2.6.32-200.23.1.el5uek xhci_hcd
              usb usb3: SerialNumber: 0000:03:00.0
              usb usb3: configuration #1 chosen from 1 choice
              xHCI xhci_add_endpoint called for root hub
              xHCI xhci_check_bandwidth called for root hub
              hub 3-0:1.0: USB hub found
              hub 3-0:1.0: 4 ports detected
              PNP: PS/2 Controller [PNP0303:PS2K] at 0x60,0x64 irq 1
              PNP: PS/2 appears to have AUX port disabled, if this is incorrect please boot with i8042.nopnp
              serio: i8042 KBD port at 0x60,0x64 irq 1
              mice: PS/2 mouse device common for all mice
              rtc_cmos 00:04: RTC can wake from S4
              rtc_cmos 00:04: rtc core: registered rtc_cmos as rtc0
              rtc0: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
              device-mapper: uevent: version 1.0.3
              device-mapper: ioctl: 4.15.0-ioctl (2009-04-01) initialised: dm-devel@redhat.com
              cpuidle: using governor ladder
              cpuidle: using governor menu
              usbcore: registered new interface driver hiddev
              usbcore: registered new interface driver usbhid
              usbhid: v2.6:USB HID core driver
              TCP cubic registered
              Initializing XFRM netlink socket
              NET: Registered protocol family 17
              PM: Resume from disk failed.
              registered taskstats version 1
              No TPM chip found, activating TPM-bypass!
              Magic number: 7:682:446
              pci 0000:00:1c.7: hash matches
              rtc_cmos 00:04: setting system clock to 2011-12-30 19:24:04 UTC (1325273044)
              Initalizing network drop monitor service
              Freeing unused kernel memory: 1720k freed
              Write protecting the kernel read-only data: 6760k
              input: AT Translated Set 2 keyboard as /class/input/input3
              md: raid1 personality registered for level 1
              usb 1-1: new high speed USB device using ehci_hcd and address 2
              ahci 0000:00:1f.2: version 3.0
              alloc irq_desc for 20 on node -1
              alloc kstat_irqs on node -1
              ahci 0000:00:1f.2: PCI INT B -> GSI 20 (level, low) -> IRQ 20
              alloc irq_desc for 28 on node -1
              alloc kstat_irqs on node -1
              ahci 0000:00:1f.2: irq 28 for MSI/MSI-X
              ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3 impl SATA mode
              ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst
              ahci 0000:00:1f.2: setting latency timer to 64
              scsi0 : ahci
              scsi1 : ahci
              scsi2 : ahci
              scsi3 : ahci
              scsi4 : ahci
              scsi5 : ahci
              ata1: SATA max UDMA/133 abar m2048@0xfe501000 port 0xfe501100 irq 28
              ata2: SATA max UDMA/133 irq_stat 0x00400040, connection status changed
              ata3: DUMMY
              ata4: DUMMY
              ata5: DUMMY
              ata6: DUMMY
              usb 1-1: New USB device found, idVendor=8087, idProduct=0024
              usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
              usb 1-1: configuration #1 chosen from 1 choice
              hub 1-1:1.0: USB hub found
              hub 1-1:1.0: 6 ports detected
              usb 2-1: new high speed USB device using ehci_hcd and address 2
              ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
              ata1.00: ATA-8: ST33000651AS, CC45, max UDMA/133
              ata1.00: 5860533168 sectors, multi 16: LBA48 NCQ (depth 31/32)
              ata1.00: configured for UDMA/133
              scsi 0:0:0:0: Direct-Access ATA ST33000651AS CC45 PQ: 0 ANSI: 5
              sd 0:0:0:0: Attached scsi generic sg0 type 0
              sd 0:0:0:0: [sda] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
              sd 0:0:0:0: [sda] Write Protect is off
              sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
              sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
              sda:
              usb 2-1: New USB device found, idVendor=8087, idProduct=0024
              usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
              usb 2-1: configuration #1 chosen from 1 choice
              hub 2-1:1.0: USB hub found
              hub 2-1:1.0: 8 ports detected
              sda1 sda2 sda3 sda4 < sda5 >
              sd 0:0:0:0: [sda] Attached SCSI disk
              ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
              ata2.00: ATA-8: ST33000651AS, CC45, max UDMA/133
              ata2.00: 5860533168 sectors, multi 16: LBA48 NCQ (depth 31/32)
              ata2.00: configured for UDMA/133
              scsi 1:0:0:0: Direct-Access ATA ST33000651AS CC45 PQ: 0 ANSI: 5
              sd 1:0:0:0: Attached scsi generic sg1 type 0
              sd 1:0:0:0: [sdb] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
              sd 1:0:0:0: [sdb] Write Protect is off
              sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00
              sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
              sdb: sdb1 sdb2 sdb3 sdb4 < sdb5 >
              sd 1:0:0:0: [sdb] Attached SCSI disk
              3ware Storage Controller device driver for Linux v1.26.02.003.
              3ware 9000 Storage Controller device driver for Linux v2.26.02.014.
              Adaptec aacraid driver 1.1-5[26400]-ms
              md: raid0 personality registered for level 0
              async_tx: api initialized (async)
              xor: automatically using best checksumming function: generic_sse
              generic_sse: 15236.000 MB/sec
              xor: using function: generic_sse (15236.000 MB/sec)
              raid6: int64x1 3597 MB/s
              raid6: int64x2 4332 MB/s
              raid6: int64x4 3300 MB/s
              raid6: int64x8 3136 MB/s
              raid6: sse2x1 9113 MB/s
              raid6: sse2x2 11496 MB/s
              raid6: sse2x4 13421 MB/s
              raid6: using algorithm sse2x4 (13421 MB/s)
              md: raid6 personality registered for level 6
              md: raid5 personality registered for level 5
              md: raid4 personality registered for level 4
              md: raid10 personality registered for level 10
              md: Autodetecting RAID arrays.
              md: Scanned 8 and added 8 devices.
              md: autorun ...
              md: considering sdb5 ...
              md: adding sdb5 ...
              md: sdb3 has different UUID to sdb5
              md: sdb2 has different UUID to sdb5
              md: sdb1 has different UUID to sdb5
              md: adding sda5 ...
              md: sda3 has different UUID to sdb5
              md: sda2 has different UUID to sdb5
              md: sda1 has different UUID to sdb5
              md: created md3
              md: bind<sda5>
              md: bind<sdb5>
              md: running: <sdb5><sda5>
              raid1: raid set md3 active with 2 out of 2 mirrors
              md3: detected capacity change from 0 to 1866184130560
              md: considering sdb3 ...
              md: adding sdb3 ...
              md: sdb2 has different UUID to sdb3
              md: sdb1 has different UUID to sdb3
              md: adding sda3 ...
              md: sda2 has different UUID to sdb3
              md: sda1 has different UUID to sdb3
              md: created md2
              md: bind<sda3>
              md: bind<sdb3>
              md: running: <sdb3><sda3>
              raid1: md2 is not clean -- starting background reconstruction
              raid1: raid set md2 active with 2 out of 2 mirrors
              md2: detected capacity change from 0 to 1099511562240
              md: considering sdb2 ...
              md: resync of RAID array md2
              md: minimum guaranteed speed: 1000 KB/sec/disk.
              md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for resync.
              md: using 128k window, over a total of 1073741760 blocks.
              md: adding sdb2 ...
              md: sdb1 has different UUID to sdb2
              md: adding sda2 ...
              md: sda1 has different UUID to sdb2
              md: created md1
              md: bind<sda2>
              md: bind<sdb2>
              md: running: <sdb2><sda2>
              raid1: raid set md1 active with 2 out of 2 mirrors
              md1: detected capacity change from 0 to 536805376
              md: considering sdb1 ...
              md: adding sdb1 ...
              md: adding sda1 ...
              md: created md0
              md: bind<sda1>
              md: bind<sdb1>
              md: running: <sdb1><sda1>
              raid1: raid set md0 active with 2 out of 2 mirrors
              md0: detected capacity change from 0 to 34358624256
              md: ... autorun DONE.
              md0: unknown partition table
              md: Autodetecting RAID arrays.
              md: Scanned 0 and added 0 devices.
              md: autorun ...
              md: ... autorun DONE.
              md2: unknown partition table
              md3: unknown partition table
              md1: unknown partition table
              EXT3-fs: INFO: recovery required on readonly filesystem.
              EXT3-fs: write access will be enabled during recovery.
              kjournald starting. Commit interval 5 seconds
              EXT3-fs: recovery complete.
              EXT3-fs: mounted filesystem with ordered data mode.
              SELinux: Disabled at runtime.
              SELinux: Unregistering netfilter hooks
              type=1404 audit(1325273066.632:2): selinux=0 auid=4294967295 ses=4294967295
              i801_smbus 0000:00:1f.3: PCI INT C -> GSI 18 (level, low) -> IRQ 18
              shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
              input: PC Speaker as /class/input/input4
              iTCO_vendor_support: vendor-support=0
              iTCO_wdt: Intel TCO WatchDog Timer Driver v1.05
              iTCO_wdt: Found a Cougar Point TCO device (Version=2, TCOBASE=0x0460)
              iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
              Error: Driver 'pcspkr' is already registered, aborting...
              r8169 Gigabit Ethernet driver 2.3LK-NAPI loaded
              r8169 0000:04:00.0: PCI INT A -> GSI 18 (level, low) -> IRQ 18
              r8169 0000:04:00.0: setting latency timer to 64
              r8169 0000:04:00.0: unknown MAC, using family default
              alloc irq_desc for 29 on node -1
              alloc kstat_irqs on node -1
              r8169 0000:04:00.0: irq 29 for MSI/MSI-X
              eth0: RTL8168b/8111b at 0xffffc90006680000, 14:da:e9:b8:53:a7, XID 0c200000 IRQ 29
              floppy0: no floppy controllers found
              lp: driver loaded but no devices found
              md: Autodetecting RAID arrays.
              md: Scanned 0 and added 0 devices.
              md: autorun ...
              md: ... autorun DONE.
              EXT3 FS on md2, internal journal
              kjournald starting. Commit interval 5 seconds
              EXT3 FS on md1, internal journal
              EXT3-fs: recovery complete.
              EXT3-fs: mounted filesystem with ordered data mode.
              kjournald starting. Commit interval 5 seconds
              EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
              EXT3 FS on md3, internal journal
              EXT3-fs: recovery complete.
              EXT3-fs: mounted filesystem with ordered data mode.
              Adding 33553336k swap on /dev/md0. Priority:-1 extents:1 across:33553336k
              microcode: CPU0 sig=0x206a7, pf=0x2, revision=0x18
              platform microcode: firmware: requesting intel-ucode/06-2a-07
              microcode: CPU1 sig=0x206a7, pf=0x2, revision=0x18
              platform microcode: firmware: requesting intel-ucode/06-2a-07
              microcode: CPU2 sig=0x206a7, pf=0x2, revision=0x18
              platform microcode: firmware: requesting intel-ucode/06-2a-07
              microcode: CPU3 sig=0x206a7, pf=0x2, revision=0x18
              platform microcode: firmware: requesting intel-ucode/06-2a-07
              microcode: CPU4 sig=0x206a7, pf=0x2, revision=0x18
              platform microcode: firmware: requesting intel-ucode/06-2a-07
              microcode: CPU5 sig=0x206a7, pf=0x2, revision=0x18
              platform microcode: firmware: requesting intel-ucode/06-2a-07
              microcode: CPU6 sig=0x206a7, pf=0x2, revision=0x18
              platform microcode: firmware: requesting intel-ucode/06-2a-07
              microcode: CPU7 sig=0x206a7, pf=0x2, revision=0x18
              platform microcode: firmware: requesting intel-ucode/06-2a-07
              Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
              Microcode Update Driver: v2.00 removed.
              warning: process `kudzu' used the deprecated sysctl system call with 1.23.
              Loading iSCSI transport class v2.0-870.
              libcxgbi:libcxgbi_init_module: tag itt 0x1fff, 13 bits, age 0xf, 4 bits.
              libcxgbi:ddp_setup_host_page_size: system PAGE 4096, ddp idx 0.
              Chelsio T3 iSCSI Driver cxgb3i v2.0.0 (Jun. 2010)
              iscsi: registered transport (cxgb3i)
              NET: Registered protocol family 10
              cnic: Broadcom NetXtreme II CNIC Driver cnic v2.2.14 (Mar 30, 2011)
              Broadcom NetXtreme II iSCSI Driver bnx2i v2.6.2.3 (Jan 06, 2010)
              iscsi: registered transport (bnx2i)
              iscsi: registered transport (tcp)
              iscsi: registered transport (iser)
              iscsi: registered transport (be2iscsi)
              ip6_tables: (C) 2000-2006 Netfilter Core Team
              ip_tables: (C) 2000-2006 Netfilter Core Team
              r8169: eth0: link up
              r8169: eth0: link up
              RPC: Registered udp transport module.
              RPC: Registered tcp transport module.
              RPC: Registered tcp NFSv4.1 backchannel transport module.
              warning: `dbus-daemon' uses 32-bit capabilities (legacy support in use)
              eth0: no IPv6 routers present
              Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
              NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
              NFSD: starting 90-second grace period
              rpcbind: server localhost not responding, timed out
              rpcbind: server localhost not responding, timed out
              rpcbind: server localhost not responding, timed out
              rpcbind: server localhost not responding, timed out
              svc: failed to register nfsdv2 RPC service (errno 5).
              nfsd: last server has exited, flushing export cache
              rpcbind: server localhost not responding, timed out
              rpcbind: server localhost not responding, timed out
              rpcbind: server localhost not responding, timed out
              mtrr: no more MTRRs available
              mtrr: no more MTRRs available
              mtrr: no more MTRRs available
              mtrr: no more MTRRs available
              mtrr: no more MTRRs available
              mtrr: no more MTRRs available
              mtrr: no more MTRRs available
              mtrr: no more MTRRs available

              ORACLEASM SERVICE:

              After reboot or HWReset and before oracleasm starts in init[2] system writes a message:
              Dec 30 17:00:03 www automount[2955]: lookup_read_master: lookup(nisplus): couldn't locate nis+ table auto.master
              Dec 30 17:00:03 www kernel: ------------[ cut here ]------------
              Dec 30 17:00:03 www kernel: kernel BUG at fs/notify/dnotify/dnotify.c:171!

              After that system goes down in kernel panic and it needs HWreset.
              There is unfortunately nothing else in /var/log/messages.

              */var/log/oracleasm has*

              Creating /dev/oracleasm mount point: /dev/oracleasm
              Loading module "oracleasm": oracleasm
              Mounting ASMlib driver filesystem: /dev/oracleasm
              Reloading disk partitions: Creating /dev/oracleasm mount point: /dev/oracleasm
              Loading module "oracleasm": oracleasm
              Mounting ASMlib driver filesystem: /dev/oracleasm
              Reloading disk partitions: Creating /dev/oracleasm mount point: /dev/oracleasm
              Loading module "oracleasm": oracleasm
              Mounting ASMlib driver filesystem: /dev/oracleasm
              Reloading disk partitions: Creating /dev/oracleasm mount point: /dev/oracleasm
              Loading module "oracleasm": oracleasm
              Mounting ASMlib driver filesystem: /dev/oracleasm
              Reloading disk partitions: Reloading disk partitions:


              LSMOD
              [root@www ~]# lsmod
              Module Size Used by
              nfsd 272268 1
              nfs_acl 2599 1 nfsd
              auth_rpcgss 39798 1 nfsd
              exportfs 3599 1 nfsd
              autofs4 23630 3
              lockd 68384 1 nfsd
              sunrpc 207823 5 nfsd,nfs_acl,auth_rpcgss,lockd
              cpufreq_ondemand 9002 8
              acpi_cpufreq 6735 1
              freq_table 3788 2 cpufreq_ondemand,acpi_cpufreq
              iptable_filter 2735 0
              ip_tables 15910 1 iptable_filter
              ip6table_filter 2831 0
              ip6_tables 17392 1 ip6table_filter
              x_tables 20263 2 ip_tables,ip6_tables
              be2iscsi 56932 0
              ib_iser 28263 0
              rdma_cm 26039 1 ib_iser
              ib_cm 32296 1 rdma_cm
              iw_cm 8178 1 rdma_cm
              ib_sa 19227 2 rdma_cm,ib_cm
              ib_mad 34920 2 ib_cm,ib_sa
              ib_core 61605 6 ib_iser,rdma_cm,ib_cm,iw_cm,ib_sa,ib_mad
              ib_addr 6022 1 rdma_cm
              iscsi_tcp 9524 0
              bnx2i 37137 0
              cnic 44673 1 bnx2i
              uio 10245 1 cnic
              ipv6 291197 47 ib_addr,cnic
              cxgb3i 21833 0
              libcxgbi 48029 1 cxgb3i
              cxgb3 136055 1 cxgb3i
              mdio 4386 1 cxgb3
              libiscsi_tcp 15026 3 iscsi_tcp,cxgb3i,libcxgbi
              libiscsi 39405 7 be2iscsi,ib_iser,iscsi_tcp,bnx2i,cxgb3i,libcxgbi,libiscsi_tcp
              scsi_transport_iscsi 35096 8 be2iscsi,ib_iser,iscsi_tcp,bnx2i,libcxgbi,libiscsi
              sbs 11502 0
              sbshc 4571 1 sbs
              parport_pc 22270 0
              lp 9527 0
              parport 36498 2 parport_pc,lp
              video 20871 0
              output 2351 1 video
              r8169 35898 0
              mii 4838 1 r8169
              snd_seq_dummy 1726 0
              serio_raw 4528 0
              snd_seq_oss 30685 0
              snd_seq_midi_event 6801 1 snd_seq_oss
              snd_seq 54633 5 snd_seq_dummy,snd_seq_oss,snd_seq_midi_event
              snd_seq_device 6474 3 snd_seq_dummy,snd_seq_oss,snd_seq
              snd_pcm_oss 42481 0
              snd_mixer_oss 14143 1 snd_pcm_oss
              snd_pcm 84139 1 snd_pcm_oss
              snd_timer 20353 2 snd_seq,snd_pcm
              snd 66322 8 snd_seq_dummy,snd_seq_oss,snd_seq,snd_seq_device,snd_pcm_oss,snd_mixer_oss,snd_pcm,snd_timer
              soundcore 7165 1 snd
              snd_page_alloc 8002 1 snd_pcm
              iTCO_wdt 11261 0
              iTCO_vendor_support 2927 1 iTCO_wdt
              pcspkr 2168 0
              shpchp 29356 0
              i2c_i801 10489 0
              i2c_core 29159 1 i2c_i801
              raid10 18394 0
              raid456 62246 0
              async_raid6_recov 6193 1 raid456
              async_pq 4994 2 raid456,async_raid6_recov
              raid6_pq 78908 2 async_raid6_recov,async_pq
              async_xor 3803 3 raid456,async_raid6_recov,async_pq
              xor 4794 1 async_xor
              async_memcpy 2129 2 raid456,async_raid6_recov
              async_tx 2968 5 raid456,async_raid6_recov,async_pq,async_xor,async_memcpy
              raid0 6075 0
              sata_nv 21343 0
              aacraid 67507 0
              3w_9xxx 30841 0
              3w_xxxx 22695 0
              sata_sil 8126 0
              sata_via 9132 0
              ahci 35220 8
              raid1 19547 4


              [root@www ~]# lspci
              00:00.0 Host bridge: Intel Corporation 2nd Generation Core Processor Family DRAM Controller (rev 09)
              00:01.0 PCI bridge: Intel Corporation Xeon E3-1200/2nd Generation Core Processor Family PCI Express Root Port (rev 09)
              00:02.0 VGA compatible controller: Intel Corporation 2nd Generation Core Processor Family Integrated Graphics Controller (rev 09)
              00:16.0 Communication controller: Intel Corporation 6 Series/C200 Series Chipset Family HECI Controller #1 (rev 04)
              00:1a.0 USB Controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #2 (rev 05)
              00:1c.0 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 1 (rev b5)
              00:1c.5 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 6 (rev b5)
              00:1c.6 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 7 (rev b5)
              00:1c.7 PCI bridge: Intel Corporation 82801 PCI Bridge (rev b5)
              00:1d.0 USB Controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #1 (rev 05)
              00:1f.0 ISA bridge: Intel Corporation H67 Express Chipset Family LPC Controller (rev 05)
              00:1f.2 SATA controller: Intel Corporation 6 Series/C200 Series Chipset Family 6 port SATA AHCI Controller (rev 05)
              00:1f.3 SMBus: Intel Corporation 6 Series/C200 Series Chipset Family SMBus Controller (rev 05)
              03:00.0 USB Controller: Device 1b21:1042
              04:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller (rev 06)
              05:00.0 PCI bridge: Device 1b21:1080 (rev 01)

              I am renting the server with intel i7-2600 and 2x3TB SATA drives with soft RAID 1 and 16GB of ram.

              Could you please tell me, how to trace oracleasm scandiscks and find the problem in software or in hardware?
              • 4. Re: oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash
                908245
                Thanks for your answer.

                Normally I am not using multipath, but for this snapshot of dmesg etc I have activated multipath on boot and rebooted the system.
                • 5. Re: oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash
                  908245
                  Dude wrote:
                  I'm afraid it will be necessary to receive more information from you in order to troubleshoot this issue:

                  To get started, please provide the following info:
                  rpm -qa |grep asm
                  What clues exist in the log files:
                  dmesg
                  cat /var/log/messages
                  cat /var/log/oracleasm 
                  Based on the symptoms you described, I suspect a problem with your storage hardware or driver configuration.

                  What is your system and storage and I/O controller? Are you using mulitpath?

                  Edited by: Dude on Dec 30, 2011 12:07 PM

                  I just noticed you wrote you installed "oracleasmlib". Do you mean the oracleasm kernel driver? The Oracle ASMLib kernel driver is now included in the Unbreakable Enterprise Kernel. No driver package needs to be installed when using this kernel. The driver is also kernel dependent and will most likely cause a problem when a wrong version is being used. The oracleasm-support and oracleasmlib packages still need to be installed.
                  Edited by: Dude on Dec 30, 2011 12:07 PM


                  oracleasmlib is:

                  [root@www ~]# yum info oracleasmlib.x86_64
                  Loaded plugins: rhnplugin, security
                  Installed Packages
                  Name : oracleasmlib
                  Arch : x86_64
                  Version : 2.0.4
                  Release : 1.el5
                  Size : 25 k
                  Repo : installed
                  Summary : The Oracle Automatic Storage Management library userspace code.
                  URL : http://oss.oracle.com/
                  License : Oracle Corporation
                  Description: The Oracle userspace library for Oracle Automatic Storage Management


                  It isn't kernel driver. In oracle uek kernel the driver is already in the kernel.


                  On this page: http://www.oracle.com/technetwork/topics/linux/asmlib/index-101839.html

                  Is written:

                  ASMLib in the Unbreakable Enterprise Kernel

                  The Oracle ASMLib kernel driver is now included in the Unbreakable Enterprise Kernel. No driver package needs to be installed when using this kernel. The oracleasm-support and oracleasmlib packages still need to be installed from ULN.

                  In repositories there are just these packages:

                  [root@www ~]# yum search asm
                  Loaded plugins: rhnplugin, security
                  ================================================================================== Matched: asm ==================================================================================
                  elfutils-devel.i386 : Development libraries to handle compiled objects
                  elfutils-devel.x86_64 : Development libraries to handle compiled objects
                  nasm.x86_64 : Ein portierbarer x86-Assembler, der eine Intel-ähnliche Syntax verwendet.
                  nasm-doc.x86_64 : Dokumentation für NASM
                  nasm-rdoff.x86_64 : Tools für das RDOFF-Binärformat, das manchmal in Verbindung mit NASM verwendet wird.
                  oracleasm-2.6.18-238.0.0.0.1.el5.x86_64 : The Oracle Automatic Storage Management library driver.
                  oracleasm-2.6.18-238.0.0.0.1.el5debug.x86_64 : The Oracle Automatic Storage Management library driver for debug systems.
                  oracleasm-2.6.18-238.0.0.0.1.el5xen.x86_64 : The Oracle Automatic Storage Management library driver for Xen systems.
                  oracleasm-2.6.18-238.1.1.0.1.el5.x86_64 : The Oracle Automatic Storage Management library driver.
                  oracleasm-2.6.18-238.1.1.0.1.el5debug.x86_64 : The Oracle Automatic Storage Management library driver for debug systems.
                  oracleasm-2.6.18-238.1.1.0.1.el5xen.x86_64 : The Oracle Automatic Storage Management library driver for Xen systems.
                  oracleasm-2.6.18-238.12.1.0.1.el5.x86_64 : The Oracle Automatic Storage Management library driver.
                  oracleasm-2.6.18-238.12.1.0.1.el5debug.x86_64 : The Oracle Automatic Storage Management library driver for debug systems.
                  oracleasm-2.6.18-238.12.1.0.1.el5xen.x86_64 : The Oracle Automatic Storage Management library driver for Xen systems.
                  oracleasm-2.6.18-238.19.1.0.1.el5.x86_64 : The Oracle Automatic Storage Management library driver.
                  oracleasm-2.6.18-238.19.1.0.1.el5debug.x86_64 : The Oracle Automatic Storage Management library driver for debug systems.
                  oracleasm-2.6.18-238.19.1.0.1.el5xen.x86_64 : The Oracle Automatic Storage Management library driver for Xen systems.
                  oracleasm-2.6.18-238.5.1.0.1.el5.x86_64 : The Oracle Automatic Storage Management library driver.
                  oracleasm-2.6.18-238.5.1.0.1.el5debug.x86_64 : The Oracle Automatic Storage Management library driver for debug systems.
                  oracleasm-2.6.18-238.5.1.0.1.el5xen.x86_64 : The Oracle Automatic Storage Management library driver for Xen systems.
                  oracleasm-2.6.18-238.9.1.0.1.el5.x86_64 : The Oracle Automatic Storage Management library driver.
                  oracleasm-2.6.18-238.9.1.0.1.el5debug.x86_64 : The Oracle Automatic Storage Management library driver for debug systems.
                  oracleasm-2.6.18-238.9.1.0.1.el5xen.x86_64 : The Oracle Automatic Storage Management library driver for Xen systems.
                  oracleasm-2.6.18-238.el5.x86_64 : The Oracle Automatic Storage Management library driver.
                  oracleasm-2.6.18-238.el5debug.x86_64 : The Oracle Automatic Storage Management library driver for debug systems.
                  oracleasm-2.6.18-238.el5xen.x86_64 : The Oracle Automatic Storage Management library driver for Xen systems.
                  oracleasm-2.6.18-274.0.0.0.1.el5.x86_64 : The Oracle Automatic Storage Management library driver.
                  oracleasm-2.6.18-274.0.0.0.1.el5debug.x86_64 : The Oracle Automatic Storage Management library driver for debug systems.
                  oracleasm-2.6.18-274.0.0.0.1.el5xen.x86_64 : The Oracle Automatic Storage Management library driver for Xen systems.
                  oracleasm-2.6.18-274.12.1.0.1.el5.x86_64 : The Oracle Automatic Storage Management library driver.
                  oracleasm-2.6.18-274.12.1.0.1.el5debug.x86_64 : The Oracle Automatic Storage Management library driver for debug systems.
                  oracleasm-2.6.18-274.12.1.0.1.el5xen.x86_64 : The Oracle Automatic Storage Management library driver for Xen systems.
                  oracleasm-2.6.18-274.3.1.0.1.el5.x86_64 : The Oracle Automatic Storage Management library driver.
                  oracleasm-2.6.18-274.3.1.0.1.el5debug.x86_64 : The Oracle Automatic Storage Management library driver for debug systems.
                  oracleasm-2.6.18-274.3.1.0.1.el5xen.x86_64 : The Oracle Automatic Storage Management library driver for Xen systems.
                  oracleasm-2.6.18-274.7.1.0.1.el5.x86_64 : The Oracle Automatic Storage Management library driver.
                  oracleasm-2.6.18-274.7.1.0.1.el5debug.x86_64 : The Oracle Automatic Storage Management library driver for debug systems.
                  oracleasm-2.6.18-274.7.1.0.1.el5xen.x86_64 : The Oracle Automatic Storage Management library driver for Xen systems.
                  oracleasm-2.6.18-274.el5.x86_64 : The Oracle Automatic Storage Management library driver.
                  oracleasm-2.6.18-274.el5debug.x86_64 : The Oracle Automatic Storage Management library driver for debug systems.
                  oracleasm-2.6.18-274.el5xen.x86_64 : The Oracle Automatic Storage Management library driver for Xen systems.

                  There is no package oracleasmlib in default repositories.
                  Oracleasmlib I have downloaded from linux.oracle.com.

                  There is no oracleasm-2.6.32-300.4.1.el5uek in repositories, but this is because driver is already in kernel 2.6.32-300.4.1.el5uek.

                  [root@www ~]# oracleasm
                  Usage: oracleasm [--exec-path=<exec_path>] <command> [ <args> ]
                  oracleasm --exec-path
                  oracleasm -h
                  oracleasm -V

                  The basic oracleasm commands are:
                  configure Configure the Oracle Linux ASMLib driver
                  init Load and initialize the ASMLib driver
                  exit Stop the ASMLib driver
                  scandisks Scan the system for Oracle ASMLib disks
                  status Display the status of the Oracle ASMLib driver
                  listdisks List known Oracle ASMLib disks
                  querydisk Determine if a disk belongs to Oracle ASMlib
                  createdisk Allocate a device for Oracle ASMLib use
                  deletedisk Return a device to the operating system
                  renamedisk Change the label of an Oracle ASMlib disk
                  update-driver Download the latest ASMLib driver
                  [root@www ~]# oracleasm update-driver
                  Kernel:          2.6.32-300.4.1.el5uek x86_64
                  Driver name:     oracleasm-2.6.32-300.4.1.el5uek

                  Fetching Obsoletes list for channel: el5_x86_64_addons...

                  Fetching Obsoletes list for channel: ol5_x86_64_latest...

                  Fetching rpm headers...

                  Name Version Rel
                  ----------------------------------------------------------


                  The following packages you requested were not found:
                  oracleasm-2.6.32-300.4.1.el5uek
                  • 6. Re: oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash
                    908245
                    Any needed info I will provide immediately.
                    I trying to solve this problem already 8 hours and I would like to solve it.
                    • 7. Re: oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash
                      908245
                      [root@www log]# oracleasm init
                      Creating /dev/oracleasm mount point: /dev/oracleasm
                      Loading module "oracleasm": oracleasm
                      Mounting ASMlib driver filesystem: /dev/oracleasm

                      [root@www log]# oracleasm status
                      Checking if ASM is loaded: yes
                      Checking if /dev/oracleasm is mounted: yes

                      Everything is going great. But oracleasm scandiscs will hang up the whole system.
                      • 8. Re: oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash
                        Catch_22
                        What is your output of:
                        modinfo oracleasm
                        • 9. Re: oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash
                          908245
                          [root@www log]# lsmod|grep oracle
                          oracleasm 48820 1


                          [root@www log]# modinfo oracleasm
                          [root@www log]#


                          Output is null.
                          • 10. Re: oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash
                            Catch_22
                            Have you tried to restart the system using a previous UEK kernel from the grub boot menu?
                            • 11. Re: oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash
                              908245
                              Yep, I did it. I have removed 2.6.32-300.4.1 and installed 2.6.32-200 and I switched on all the services an so on.
                              But there is the same problem.
                              • 12. Re: oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash
                                Tommyreynolds-Oracle
                                <ul>
                                <li>How are ALL of your disks connected?
                                <li>Sometimes scanning will reset SCSI interfaces or HBAs which get upset.
                                <li>Edit "/etc/sysconfig/oracleasm" so that:
                                <ol>
                                <li>ORACLEASM_SCANORDER lists the disk patterns where your ASM storage will be found.
                                <li>ORACLEASM_SCANEXCLUDE lists the physical disks never to check for ASM storage.
                                </ol>
                                It is essential that the physical paths used for multipath devices NEVER be scanned.
                                </ul>
                                • 13. Re: oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash
                                  Catch_22
                                  Perhaps there is more info when tracing the application. For this you will need to install "strace".
                                  yum install strace
                                  Do you see any clues using:
                                  strace -s 255 -f /etc/init.d/oracleasm scandisks
                                  • 14. Re: oracleasm scandisks 2.6.32-300.3.1.el5uek x86_64 kernel crash
                                    908245
                                    pid 4168] <... close resumed> ) = 0
                                    [pid  4168] open("/dev/sda1", O_RDONLY <unfinished ...>
                                    [pid  4163] <... wait4 resumed> [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], 0, NULL) = 4167
                                    [pid  4168] <... open resumed> ) = 4
                                    [pid  4163] wait4(-1, Process 4163 suspended
                                    <unfinished ...>
                                    [pid  4168] ioctl(4, 0x301, 0x7fffb1d7f080) = 0
                                    [pid  4168] close(4) = 0
                                    [pid  4168] open("/dev/sda2", O_RDONLY) = 4
                                    [pid  4168] ioctl(4, 0x301, 0x7fffb1d7f080) = 0
                                    [pid  4168] close(4) = 0
                                    [pid  4168] open("/dev/sda3", O_RDONLY) = 4
                                    [pid  4168] ioctl(4, 0x301, 0x7fffb1d7f080) = 0
                                    [pid  4168] close(4) = 0
                                    [pid  4168] open("/dev/sda4", O_RDONLY) = 4
                                    [pid  4168] ioctl(4, 0x301, 0x7fffb1d7f080) = 0
                                    [pid  4168] close(4) = 0
                                    [pid  4168] open("/dev/sda5", O_RDONLY) = 4
                                    [pid  4168] ioctl(4, 0x301, 0x7fffb1d7f080) = 0
                                    [pid  4168] close(4) = 0
                                    [pid  4168] open("/dev/sdb", O_RDONLY) = 4
                                    [pid  4168] ioctl(4, 0x301, 0x7fffb1d7f080) = 0
                                    [pid  4168] close(4) = 0
                                    [pid  4168] open("/dev/sdb", O_RDONLY) = 4
                                    [pid  4168] ioctl(4, BLKRRPART, 0) = -1 EBUSY (Device or resource busy)
                                    [pid  4168] close(4) = 0
                                    [pid  4168] open("/dev/sdb1", O_RDONLY) = 4
                                    [pid  4168] ioctl(4, 0x301, 0x7fffb1d7f080) = 0
                                    [pid  4168] close(4) = 0
                                    [pid  4168] open("/dev/sdb2", O_RDONLY) = 4
                                    [pid  4168] ioctl(4, 0x301, 0x7fffb1d7f080) = 0
                                    [pid  4168] close(4) = 0
                                    [pid  4168] open("/dev/sdb3", O_RDONLY) = 4
                                    [pid  4168] ioctl(4, 0x301, 0x7fffb1d7f080) = 0
                                    [pid  4168] close(4) = 0
                                    [pid  4168] open("/dev/sdb4", O_RDONLY) = 4
                                    [pid  4168] ioctl(4, 0x301, 0x7fffb1d7f080) = 0
                                    [pid  4168] close(4) = 0
                                    [pid  4168] open("/dev/sdb5", O_RDONLY) = 4
                                    [pid  4168] ioctl(4, 0x301, 0x7fffb1d7f080) = 0
                                    [pid  4168] close(4) = 0
                                    [pid  4168] open("/dev/md2", O_RDONLY) = 4
                                    [pid  4168] ioctl(4, 0x301, 0x7fffb1d7f080) = 0
                                    [pid  4168] close(4) = 0
                                    [pid  4168] open("/dev/md2", O_RDONLY) = 4
                                    [pid  4168] ioctl(4, BLKRRPART

                                    It looks like something is wrong while accessing RAID partitions.
                                    cat /etc/fstab

                                    tmpfs /dev/shm tmpfs size=12228m 0 0
                                    devpts /dev/pts devpts gid=5,mode=620 0 0
                                    sysfs /sys sysfs defaults 0 0
                                    proc /proc proc defaults 0 0
                                    /dev/md0 none swap sw 0 0
                                    /dev/md1 /boot ext3 defaults 0 0
                                    /dev/md2 / ext3 defaults 0 0
                                    /dev/md3 /home ext3 defaults 0 0
                                    1 2 3 Previous Next