7 Replies Latest reply on Feb 5, 2011 11:25 PM by 837193

    Checking O2CB heartbeat: Not active

    761559
      Dears,,

      I am trying to install RAC on both n nodes.
      And verifying that O2CB is online on both nodes , i made the following . . .

      *[root@rac2 ~]# /etc/init.d/o2cb status*
      Module "configfs": Loaded
      Filesystem "configfs": Mounted
      Module "ocfs2_nodemanager": Loaded
      Module "ocfs2_dlm": Loaded
      Module "ocfs2_dlmfs": Loaded
      Filesystem "ocfs2_dlmfs": Mounted
      Checking O2CB cluster ocfs2: Online
      Heartbeat dead threshold: 31
      Network idle timeout: 30000
      Network keepalive delay: 2000
      Network reconnect delay: 2000
      Checking O2CB heartbeat: Not active <<< Why this ? and how solve?

      Thanks & regards,,
        • 1. Re: Checking O2CB heartbeat: Not active
          20378
          As you haven't specified OS or DB version I am guessing a little bit.

          The o2cb heartbeat starts when a volume is mounted. Is that volume mounted on the second node?

          I would suggest you check cluster.conf to ensure that the ip addresses are correct.
          Also, shutting down iptables or adding rules to allow traffic on the private network. Look for any firewalls between the nodes. dmesg should have more information. In short, cluster mount requires the
          nodes to connect to each other.

          -Andy
          • 2. Re: Checking O2CB heartbeat: Not active
            761559
            Sorry ,,

            I am using Oracle Enterprise Linux 32-bit
            and Oracle Clusterware 10g

            volume mounted on the first node but failed on second node as following
            *[root@rac2 /]# mount -t ocfs2 /dev/sdb1 /ocfs/*
            mount.ocfs2: Invalid argument while mounting /dev/sdb1 on /ocfs/. Check 'dmesg' for more information on this error.

            How solve this please?

            Thanks & Regards,,
            • 3. Re: Checking O2CB heartbeat: Not active
              sb92075
              How solve this please?
              Check 'dmesg' for more information on this error.
              • 4. Re: Checking O2CB heartbeat: Not active
                20378
                10g is not a version of a database, it's a marketing brand name neither is Oracle Enterprise Linux 32-bit.

                -Andy
                • 5. Re: Checking O2CB heartbeat: Not active
                  sb92075
                  ALWAYS
                  Post Operating System (OS) name & version for DB server system.(uname -a)
                  Post results of
                  SELECT * from v$version
                  • 6. Re: Checking O2CB heartbeat: Not active
                    761559
                    [root@rac2 ~]# uname -a
                    Linux rac2.mycorpdomain.com 2.6.9-67.0.0.0.1.ELhugemem #1 SMP Sun Nov 18 00:31:12 EST 2007 i686 i686 i386 GNU/Linux
                    SELECT * from v$version
                    I did not install Oracle database yet
                    I am in Oracle cluster ware Release 2 (10.2.0.1.0) installation step now . . .

                    I executed the command again . . .
                    [root@rac2 ~]# mount -t ocfs2 -o datavolume,nointr /dev/sdb1 /ocfs
                    ocfs2_hb_ctl: OCFS2 directory corrupted while reading uuid
                    mount.ocfs2: Error when attempting to run /sbin/ocfs2_hb_ctl: "Operation not per mitted"

                    dmesg is big as following . . .
                    I have little experience in Linux.
                    Sorry for attaching all of it , but i cannot find the problem
                    ***********************************************

                    Linux version 2.6.9-67.0.0.0.1.ELhugemem (mockbuild@ca-build15.us.oracle.com) (gcc version 3.4.6 20060404 (Red Hat 3.4.6-3)) #1 SMP Sun Nov 18 0 0:31:12 EST 2007
                    BIOS-provided physical RAM map:
                    BIOS-e820: 0000000000000000 - 000000000009f800 (usable)
                    BIOS-e820: 000000000009f800 - 00000000000a0000 (reserved)
                    BIOS-e820: 00000000000ca000 - 00000000000cc000 (reserved)
                    BIOS-e820: 00000000000dc000 - 0000000000100000 (reserved)
                    BIOS-e820: 0000000000100000 - 000000003e6f0000 (usable)
                    BIOS-e820: 000000003e6f0000 - 000000003e6ff000 (ACPI data)
                    BIOS-e820: 000000003e6ff000 - 000000003e700000 (ACPI NVS)
                    BIOS-e820: 000000003e700000 - 000000003e800000 (usable)
                    BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
                    BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
                    BIOS-e820: 00000000fffe0000 - 0000000100000000 (reserved)
                    0MB HIGHMEM available.
                    1000MB LOWMEM available.
                    found SMP MP-table at 000f6cd0
                    NX (Execute Disable) protection: active
                    On node 0 totalpages: 256000
                    DMA zone: 4096 pages, LIFO batch:1
                    Normal zone: 251904 pages, LIFO batch:16
                    HighMem zone: 0 pages, LIFO batch:1
                    DMI present.
                    Using APIC driver default
                    ACPI: RSDP (v000 PTLTD ) @ 0x000f6c60
                    ACPI: RSDT (v001 PTLTD RSDT 0x06040000 LTP 0x00000000) @ 0x3e6fab68
                    ACPI: FADT (v001 INTEL 440BX 0x06040000 PTL 0x000f4240) @ 0x3e6fef14
                    ACPI: MADT (v001 PTLTD APIC 0x06040000 LTP 0x00000000) @ 0x3e6fef88
                    ACPI: BOOT (v001 PTLTD $SBFTBL$ 0x06040000 LTP 0x00000001) @ 0x3e6fefd8
                    ACPI: DSDT (v001 PTLTD Custom 0x06040000 MSFT 0x0100000d) @ 0x00000000
                    ACPI: PM-Timer IO Port: 0x1008
                    ACPI: Local APIC address 0xfee00000
                    ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
                    Processor #0 6:7 APIC version 17
                    ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
                    Enabling APIC mode: Flat. Using 0 I/O APICs
                    ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
                    IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
                    ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
                    ACPI: IRQ0 used by override.
                    ACPI: IRQ2 used by override.
                    ACPI: IRQ9 used by override.
                    Using ACPI (MADT) for SMP configuration information
                    Allocating PCI resources starting at 40000000 (gap: 3e800000:c0400000)
                    Built 1 zonelists
                    Kernel command line: ro root=LABEL=/ rhgb quiet
                    mapped APIC to ffffd000 (fee00000)
                    mapped 4G/4G trampoline to fffec000.
                    Initializing CPU#0
                    CPU 0 irqstacks, hard=023ed000 soft=023cd000
                    PID hash table entries: 4096 (order: 12, 65536 bytes)
                    Detected 2095.178 MHz processor.
                    Using pmtmr for high-res timesource
                    Console: colour VGA+ 80x25
                    Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
                    Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
                    Memory: 1009232k/1024000k available (1864k kernel code, 14092k reserved, 760k data, 192k init, 0k highmem)
                    Calibrating delay using timer specific routine.. 4194.14 BogoMIPS (lpj=2097071)
                    Security Scaffold v1.0.0 initialized
                    SELinux: Initializing.
                    SELinux: Starting in permissive mode
                    There is already a security framework initialized, register_security failed.
                    selinux_register_security: Registering secondary module capability
                    Capability LSM initialized as secondary
                    Mount-cache hash table entries: 512 (order: 0, 4096 bytes)
                    CPU: After generic identify, caps: 0febfbff 00100000 00000000 00000000
                    CPU: After vendor identify, caps: 0febfbff 00100000 00000000 00000000
                    CPU: L1 I cache: 32K, L1 D cache: 32K
                    CPU: L2 cache: 3072K
                    CPU: After all inits, caps: 0febfbff 00100000 00000000 00000040
                    Intel machine check architecture supported.
                    Intel machine check reporting enabled on CPU#0.
                    Enabling fast FPU save and restore... done.
                    Enabling unmasked SIMD FPU exception support... done.
                    Checking 'hlt' instruction... OK.
                    CPU0: Intel(R) Core(TM)2 Duo CPU T8100 @ 2.10GHz stepping 08
                    per-CPU timeslice cutoff: 8776.80 usecs.
                    task migration cache decay timeout: 8 msecs.
                    Total of 1 processors activated (4194.14 BogoMIPS).
                    ENABLING IO-APIC IRQs
                    ..TIMER: vector=0x31 pin1=2 pin2=-1
                    Brought up 1 CPUs
                    zapping low mappings.
                    checking if image is initramfs... it is
                    Freeing initrd memory: 571k freed
                    NET: Registered protocol family 16
                    PCI: PCI BIOS revision 2.10 entry at 0xfd9a0, last bus=2
                    PCI: Using configuration type 1
                    mtrr: v2.0 (20020519)
                    ACPI: Subsystem revision 20040816
                    ACPI: Interpreter enabled
                    ACPI: Using IOAPIC for interrupt routing
                    ACPI: PCI Root Bridge [PCI0] (00:00)
                    PCI: Probing PCI hardware (bus 00)
                    PCI: Transparent bridge - 0000:00:11.0
                    ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
                    ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 *5 6 7 9 10 11 14 15)
                    ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 10 *11 14 15)
                    ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 9 *10 11 14 15)
                    ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 *9 10 11 14 15)
                    Linux Plug and Play Support v0.97 (c) Adam Belay
                    usbcore: registered new driver usbfs
                    usbcore: registered new driver hub
                    PCI: Using ACPI for IRQ routing
                    ACPI: PCI Interrupt 0000:00:07.2[D] -> GSI 19 (level, low) -> IRQ 169
                    ACPI: PCI Interrupt 0000:00:10.0[A] -> GSI 17 (level, low) -> IRQ 177
                    ACPI: PCI Interrupt 0000:00:11.0[A] -> GSI 18 (level, low) -> IRQ 185
                    ACPI: PCI Interrupt 0000:02:00.0[A] -> GSI 18 (level, low) -> IRQ 185
                    ACPI: PCI Interrupt 0000:02:01.0[A] -> GSI 19 (level, low) -> IRQ 169
                    ACPI: PCI Interrupt 0000:02:02.0[A] -> GSI 16 (level, low) -> IRQ 193
                    ACPI: PCI Interrupt 0000:02:03.0[A] -> GSI 17 (level, low) -> IRQ 177
                    ACPI: PCI Interrupt 0000:02:04.0[A] -> GSI 18 (level, low) -> IRQ 185
                    PCI: Cannot allocate resource region 4 of device 0000:00:07.1
                    Simple Boot Flag at 0x36 set to 0x80
                    apm: BIOS version 1.2 Flags 0x03 (Driver version 1.16ac)
                    apm: overridden by ACPI.
                    audit: initializing netlink socket (disabled)
                    audit(1272894837.845:1): initialized
                    Total HugeTLB memory allocated, 0
                    VFS: Disk quotas dquot_6.5.1
                    Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
                    SELinux: Registering netfilter hooks
                    Initializing Cryptographic API
                    ksign: Installing public key data
                    Loading keyring
                    - Added public key B012ABD5559E644A
                    - User ID: Oracle USA, Inc. (Kernel Module GPG key)
                    Limiting direct PCI/PCI transfers.
                    pci_hotplug: PCI Hot Plug PCI Core version: 0.5
                    ACPI: Processor [CPU0] (supports C1, 8 throttling states)
                    Real Time Clock Driver v1.12
                    Linux agpgart interface v0.100 (c) Dave Jones
                    agpgart: Detected an Intel 440BX Chipset.
                    agpgart: Maximum main memory to use for agp memory: 918M
                    agpgart: AGP aperture is 256M @ 0x0
                    serio: i8042 AUX port at 0x60,0x64 irq 12
                    serio: i8042 KBD port at 0x60,0x64 irq 1
                    Serial: 8250/16550 driver $Revision: 1.90 $ 68 ports, IRQ sharing enabled
                    ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
                    ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
                    RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
                    divert: not allocating divert_blk for non-ethernet device lo
                    Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
                    ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
                    PIIX4: IDE controller at PCI slot 0000:00:07.1
                    PIIX4: chipset revision 1
                    PIIX4: not 100% native mode: will probe irqs later
                    ide1: BM-DMA at 0x1418-0x141f, BIOS settings: hdcMA, hddio
                    Probing IDE interface ide1...
                    hdc: VMware Virtual IDE CDROM Drive, ATAPI CD/DVD-ROM drive
                    Using cfq io scheduler
                    ide1 at 0x170-0x177,0x376 on irq 15
                    Probing IDE interface ide0...
                    Probing IDE interface ide2...
                    Probing IDE interface ide3...
                    Probing IDE interface ide4...
                    Probing IDE interface ide5...
                    hdc: ATAPI 24X DVD-ROM DVD-R-RAM CD-R/RW drive, 2048kB Cache, UDMA(33)
                    Uniform CD-ROM driver Revision: 3.20
                    ide-floppy driver 0.99.newide
                    usbcore: registered new driver hiddev
                    usbcore: registered new driver usbhid
                    drivers/usb/input/hid-core.c: v2.0:USB HID core driver
                    mice: PS/2 mouse device common for all mice
                    input: AT Translated Set 2 keyboard on isa0060/serio0
                    input: ImPS/2 Generic Wheel Mouse on isa0060/serio1
                    md: md driver 0.90.0 MAX_MD_DEVS=256, MD_SB_DISKS=27
                    NET: Registered protocol family 2
                    IP route cache hash table entries: 32768 (order: 5, 131072 bytes)
                    TCP established hash table entries: 131072 (order: 9, 2097152 bytes)
                    TCP bind hash table entries: 131072 (order: 8, 1572864 bytes)
                    TCP: Hash tables configured (established 131072 bind 131072)
                    Initializing IPsec netlink socket
                    NET: Registered protocol family 1
                    NET: Registered protocol family 17
                    ACPI wakeup devices:
                    USB
                    ACPI: (supports S0 S1 S4 S5)
                    Freeing unused kernel memory: 192k freed
                    SCSI subsystem initialized
                    Fusion MPT base driver 3.02.99.00rh
                    Copyright (c) 1999-2007 LSI Logic Corporation
                    Fusion MPT SPI Host driver 3.02.99.00rh
                    ACPI: PCI Interrupt 0000:00:10.0[A] -> GSI 17 (level, low) -> IRQ 177
                    mptbase: Initiating ioc0 bringup
                    ioc0: 53C1030: Capabilities={Initiator}
                    scsi0 : ioc0: LSI53C1030, FwRev=01032920h, Ports=1, MaxQ=128, IRQ=177
                    Vendor: VMware, Model: VMware Virtual S Rev: 1.0
                    Type: Direct-Access ANSI SCSI revision: 02
                    SCSI device sda: 41943040 512-byte hdwr sectors (21475 MB)
                    sda: cache data unavailable
                    sda: assuming drive cache: write through
                    SCSI device sda: 41943040 512-byte hdwr sectors (21475 MB)
                    sda: cache data unavailable
                    sda: assuming drive cache: write through
                    sda: sda1 sda2 sda3
                    Attached scsi disk sda at scsi0, channel 0, id 0, lun 0
                    ACPI: PCI Interrupt 0000:02:00.0[A] -> GSI 18 (level, low) -> IRQ 185
                    mptbase: Initiating ioc1 bringup
                    ioc1: 53C1030: Capabilities={Initiator}
                    scsi1 : ioc1: LSI53C1030, FwRev=01032920h, Ports=1, MaxQ=128, IRQ=185
                    Vendor: VMware, Model: VMware Virtual S Rev: 1.0
                    Type: Direct-Access ANSI SCSI revision: 02
                    SCSI device sdb: 1048576 512-byte hdwr sectors (537 MB)
                    sdb: cache data unavailable
                    sdb: assuming drive cache: write through
                    SCSI device sdb: 1048576 512-byte hdwr sectors (537 MB)
                    sdb: cache data unavailable
                    sdb: assuming drive cache: write through
                    sdb: sdb1
                    Attached scsi disk sdb at scsi1, channel 0, id 0, lun 0
                    Vendor: VMware, Model: VMware Virtual S Rev: 1.0
                    Type: Direct-Access ANSI SCSI revision: 02
                    SCSI device sdc: 6291456 512-byte hdwr sectors (3221 MB)
                    sdc: cache data unavailable
                    sdc: assuming drive cache: write through
                    SCSI device sdc: 6291456 512-byte hdwr sectors (3221 MB)
                    sdc: cache data unavailable
                    sdc: assuming drive cache: write through
                    sdc: sdc1
                    Attached scsi disk sdc at scsi1, channel 0, id 1, lun 0
                    Vendor: VMware, Model: VMware Virtual S Rev: 1.0
                    Type: Direct-Access ANSI SCSI revision: 02
                    SCSI device sdd: 6291456 512-byte hdwr sectors (3221 MB)
                    sdd: cache data unavailable
                    sdd: assuming drive cache: write through
                    SCSI device sdd: 6291456 512-byte hdwr sectors (3221 MB)
                    sdd: cache data unavailable
                    sdd: assuming drive cache: write through
                    sdd: sdd1
                    Attached scsi disk sdd at scsi1, channel 0, id 2, lun 0
                    Vendor: VMware, Model: VMware Virtual S Rev: 1.0
                    Type: Direct-Access ANSI SCSI revision: 02
                    SCSI device sde: 4194304 512-byte hdwr sectors (2147 MB)
                    sde: cache data unavailable
                    sde: assuming drive cache: write through
                    SCSI device sde: 4194304 512-byte hdwr sectors (2147 MB)
                    sde: cache data unavailable
                    sde: assuming drive cache: write through
                    sde: sde1
                    Attached scsi disk sde at scsi1, channel 0, id 3, lun 0
                    Fusion MPT SAS Host driver 3.02.99.00rh
                    libata version 2.00 loaded.
                    EXT3-fs: INFO: recovery required on readonly filesystem.
                    EXT3-fs: write access will be enabled during recovery.
                    kjournald starting. Commit interval 5 seconds
                    EXT3-fs: recovery complete.
                    EXT3-fs: mounted filesystem with ordered data mode.
                    security: 3 users, 4 roles, 356 types, 26 bools
                    security: 55 classes, 22665 rules
                    SELinux: Completing initialization.
                    SELinux: Setting up existing superblocks.
                    SELinux: initialized (dev sda1, type ext3), uses xattr
                    SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
                    SELinux: initialized (dev selinuxfs, type selinuxfs), uses genfs_contexts
                    SELinux: initialized (dev mqueue, type mqueue), not configured for labeling
                    SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses genfs_contexts
                    SELinux: initialized (dev devpts, type devpts), uses transition SIDs
                    SELinux: initialized (dev eventpollfs, type eventpollfs), uses genfs_contexts
                    SELinux: initialized (dev pipefs, type pipefs), uses task SIDs
                    SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
                    SELinux: initialized (dev futexfs, type futexfs), uses genfs_contexts
                    SELinux: initialized (dev sockfs, type sockfs), uses task SIDs
                    SELinux: initialized (dev proc, type proc), uses genfs_contexts
                    SELinux: initialized (dev bdev, type bdev), uses genfs_contexts
                    SELinux: initialized (dev rootfs, type rootfs), uses genfs_contexts
                    SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
                    SELinux: initialized (dev usbfs, type usbfs), uses genfs_contexts
                    inserting floppy driver for 2.6.9-67.0.0.0.1.ELhugemem
                    Floppy drive(s): fd0 is 1.44M
                    FDC 0 is a post-1991 82077
                    vmxnet: module license 'unspecified' taints kernel.
                    VMware vmxnet virtual NIC driver
                    ACPI: PCI Interrupt 0000:02:01.0[A] -> GSI 19 (level, low) -> IRQ 169
                    Found vmxnet/PCI at 0x20a4, irq 169.
                    features:
                    divert: allocating divert_blk for eth0
                    ACPI: PCI Interrupt 0000:02:02.0[A] -> GSI 16 (level, low) -> IRQ 193
                    Found vmxnet/PCI at 0x2424, irq 193.
                    features:
                    divert: allocating divert_blk for eth1
                    pcnet32.c:v1.31 29.04.2005 tsbogend@alpha.franken.de
                    ACPI: PCI Interrupt 0000:02:03.0[A] -> GSI 17 (level, low) -> IRQ 177
                    ACPI: PCI Interrupt 0000:02:04.0[A] -> GSI 18 (level, low) -> IRQ 185
                    ehci_hcd 0000:02:04.0: EHCI Host Controller
                    ehci_hcd 0000:02:04.0: irq 185, pci mem 41024000
                    SELinux: initialized (dev usbdevfs, type usbdevfs), uses genfs_contexts
                    ehci_hcd 0000:02:04.0: new USB bus registered, assigned bus number 1
                    PCI: cache line size of 32 is not supported by device 0000:02:04.0
                    ehci_hcd 0000:02:04.0: USB 2.0 enabled, EHCI 1.00, driver 2004-May-10
                    hub 1-0:1.0: USB hub found
                    hub 1-0:1.0: 6 ports detected
                    USB Universal Host Controller Interface driver v2.2
                    ACPI: PCI Interrupt 0000:00:07.2[D] -> GSI 19 (level, low) -> IRQ 169
                    uhci_hcd 0000:00:07.2: UHCI Host Controller
                    uhci_hcd 0000:00:07.2: irq 169, io base 00001060
                    uhci_hcd 0000:00:07.2: new USB bus registered, assigned bus number 2
                    hub 2-0:1.0: USB hub found
                    hub 2-0:1.0: 2 ports detected
                    md: Autodetecting RAID arrays.
                    md: autorun ...
                    md: ... autorun DONE.
                    SELinux: initialized (dev ramfs, type ramfs), uses genfs_contexts
                    NET: Registered protocol family 10
                    Disabled Privacy Extensions on device 02341440(lo)
                    IPv6 over IPv4 tunneling driver
                    divert: not allocating divert_blk for non-ethernet device sit0
                    ACPI: AC Adapter [ACAD] (on-line)
                    ACPI: Power Button (FF) [PWRF]
                    EXT3 FS on sda1, internal journal
                    device-mapper: 4.5.5-ioctl (2006-12-01) initialised: dm-devel@redhat.com
                    SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
                    kjournald starting. Commit interval 5 seconds
                    EXT3 FS on sda3, internal journal
                    EXT3-fs: mounted filesystem with ordered data mode.
                    SELinux: initialized (dev sda3, type ext3), uses xattr
                    VMware hgfs: HGFS is disabled in the host
                    Adding 2088440k swap on /dev/sda2. Priority:-1 extents:1
                    SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses genfs_contexts
                    *******************************************************************************************

                    Help , please
                    __________________
                    Thanks & Regards,,
                    • 7. Re: Checking O2CB heartbeat: Not active
                      837193
                      Hello

                      I know this was originally posted long time ago but I recently bumped into this problem. I hope following solution will help whoever is reading this thread. Here is what I faced and here is how I fixed it:

                      I was setting up RAC using VMWare. I prepared rac1 [installed OS, configured disks, users, etc] and the made a copy of it as rac2. So far so good. When, as per the guide I was following for RAC configuration, I started OCFS2 configuration, faced the following error on RAC2 when I tried to mount the /dev/adb1:

                      ===================================================
                      [Root @ *rac2* ~] # mount - t ocfs2 - o datavolume, nointr / dev / sdb1 / ocfs
                      ocfs2_hb_ctl: OCFS2 DIRECTORY corrupted WHILE reading uuid ocfs2_hb_ctl: OCFS2 DIRECTORY corrupted WHILE reading uuid
                      mount.ocfs2: Error WHEN attempting TO run / sbin / ocfs2_hb_ctl: "Operation not permitted" mount.ocfs2: Error WHEN attempting TO run / sbin / ocfs2_hb_ctl: "Operation not permitted"
                      ===================================================

                      After a lot of "googling around", I finally bumped into a page, the kind person who posted the solution said [in my words below and more detailed ]:

                      o shutdown both rac1 and rac2
                      o in VMWare, "edit virtual machine settings" for rac1
                      o remove the disk [make sure you drop the correct one]
                      o recreate it and select *"allocate all disk space now"* [with same name and in the same directory where it was before]
                      o start rac1 and login as *"root"* and *"fdisk /dev/sdb"* [or whichever is/was your disk where you r installing ocfs2]

                      Once done, repeat the steps for configuring OCFS2. I was successfully able to mount the disk on both machines.

                      All this problem was apparently caused by not choosing "allocate space now" option while creating the disk to be used for OCFS2.

                      If you still have any questions or problem, email me at saeedamer@yahoo.com and I'll try to get back to you at my earliest.

                      All credit to [randyamor column] where I found the hint. The original post was in a language other than English - thanks to "Google Translate" feature, I was able to read it.

                      Good luck!

                      Muhammad Amer
                      saeedamer@yahoo.com