1 2 3 Previous Next 30 Replies Latest reply on Mar 15, 2010 5:37 PM by 760267 Go to original post
      • 15. Re: After OCFS2 install/configure ~ Shared storage check check fails
        yakub21
        on node1:
        [root@rac1 sysconfig]# md5sum /etc/ocfs2/cluster.conf
        f7421b943c94d9eade01b7e535281d72 /etc/ocfs2/cluster.conf
        [root@rac1 sysconfig]#


        on node2:
        [root@rac2 sysconfig]# md5sum /etc/ocfs2/cluster.conf
        f7421b943c94d9eade01b7e535281d72 /etc/ocfs2/cluster.conf
        [root@rac2 sysconfig]#


        on node1:
        [root@rac1 sysconfig]# nc -zv 192.168.1.12 7777
        Connection to 192.168.1.12 7777 port [tcp/cbt] succeeded!
        [root@rac1 sysconfig]#


        on node2:
        [root@rac2 sysconfig]# nc -zv 192.168.1.13 7777
        Connection to 192.168.1.13 7777 port [tcp/cbt] succeeded!
        [root@rac2 sysconfig]#



        on node1:
        [root@rac1 sysconfig]# iptables --list
        Chain INPUT (policy ACCEPT)
        target prot opt source destination

        Chain FORWARD (policy ACCEPT)
        target prot opt source destination

        Chain OUTPUT (policy ACCEPT)
        target prot opt source destination
        [root@rac1 sysconfig]#



        on node2:
        [root@rac2 sysconfig]# iptables --list
        Chain INPUT (policy ACCEPT)
        target prot opt source destination

        Chain FORWARD (policy ACCEPT)
        target prot opt source destination

        Chain OUTPUT (policy ACCEPT)
        target prot opt source destination
        [root@rac2 sysconfig]




        on node1:
        [root@rac1 sysconfig]# blkid | grep ocfs
        /dev/xvda11: LABEL="/ocfs2S" UUID="261257eb-6dc3-4070-a324-cbb6c1f49e33" TYPE="ocfs2"
        [root@rac1 sysconfig]#


        on node2:
        [root@rac2 sysconfig]# blkid | grep ocfs
        [root@rac2 sysconfig]#



        on node1:
        [root@rac1 sysconfig]# dd if=/dev/xvda11 count=256 | strings | grep -A 2 OCFSV2
        256+0 records in
        256+0 records out
        131072 bytes (131 kB) copied, 0.064742 seconds, 2.0 MB/s
        OCFSV2
        TgAJ
        TgAJ
        [root@rac1 sysconfig]#


        on node2:
        [root@rac2 sysconfig]# blkid | grep ocfs
        [root@rac2 sysconfig]# service ocfs2 restart
        Stopping Oracle Cluster File System (OCFS2) [  OK  ]
        Starting Oracle Cluster File System (OCFS2) mount.ocfs2: Device name specified was not found while opening device LABEL=/ocfs2S
        [FAILED]
        [root@rac2 sysconfig]# service ocfs2 status
        Configured OCFS2 mountpoints: /ocfs2S
        [root@rac2 sysconfig]#
        • 16. Re: After OCFS2 install/configure ~ Shared storage check check fails
          Surachart Opun
          I think on node2 you don't know about ocfs2S Label.

          By the way you should mount (don't use Label) and no prpblem

          mount -t ocfs2 -o datavolume,nointr /dev/xvda11 /ocfs2S

          /etc/fstab file
          /dev/xvda11 /ocfs2S ocfs2 _netdev,datavolume,nointr 0 0

          I use OCFS2 too, I don't use Label...

          on node1:
          # blkid | grep ocfs
          /dev/emcpowera1: LABEL="ocfs" UUID="65563985-f5ce-48e0-a5ab-3c1334ba0bd5" TYPE="ocfs2"
          # fsck.ocfs2 -n /dev/emcpowera1
          Checking OCFS2 filesystem in /dev/emcpowera1:
          label: ocfs

          on node2
          # blkid | grep ocfs
          # fsck.ocfs2 -n /dev/emcpowera1
          Checking OCFS2 filesystem in /dev/emcpowera1:
          label: ocfs

          Idea to change label on ocfs2 read http://oss.oracle.com/projects/ocfs2/dist/documentation/v1.2/ocfs2_users_guide.pdf
          To change the volume label using the command line tool, tunefs.ocfs, do:
          # tunefs.ocfs2 -L "old datafiles" /dev/sdf2
          tunefs.ocfs2 1.2.0
          Changing volume label from datafiles to old datafiles
          Proceed (y/N): y
          Changed volume label
          Wrote Superblock
          http://oss.oracle.com/projects/ocfs2-tools/dist/documentation/tunefs.ocfs2.html


          Or use "ocfs2console" help to mount on node2
          Good Luck
          • 17. Re: After OCFS2 install/configure ~ Shared storage check check fails
            Babu Baskar
            Hello yakub21,

            As per Surachart Opun ; exeucte mount statement.

            Thanks
            • 18. Re: After OCFS2 install/configure ~ Shared storage check check fails
              yakub21
              Thank you very much for your support on this issue.

              I've reviewed the "Installing Oracle RAC 10g Release 2 onLinux x86" and OCFS2_Users_Guide, and there is some configuration that I'm missing.

              From node1:
              [root@rac1 init.d]# ./ocfs2 stop
              Stopping Oracle Cluster File System (OCFS2) [  OK  ]
              [root@rac1 init.d]# ./o2cb status
              Module "configfs": Loaded
              Filesystem "configfs": Mounted
              Module "ocfs2_nodemanager": Loaded
              Module "ocfs2_dlm": Loaded
              Module "ocfs2_dlmfs": Loaded
              Filesystem "ocfs2_dlmfs": Mounted
              Checking O2CB cluster ocfs2rac: Online
              Heartbeat dead threshold: 61
              Network idle timeout: 10000
              Network keepalive delay: 5000
              Network reconnect delay: 2000
              Checking O2CB heartbeat: Not active
              [root@rac1 init.d]# tunefs.ocfs2 -L "old datafiles" /dev/xvda11
              tunefs.ocfs2 1.2.7
              Changing volume label from /ocfs2S to old datafiles
              Proceed (y/N): y
              Changed volume label
              Wrote Superblock
              [root@rac1 init.d]#

              on node1:
              [root@rac1 init.d]# fsck.ocfs2 -n /dev/xvda11
              Checking OCFS2 filesystem in /dev/xvda11:
              label: old datafiles
              uuid: e2 b1 35 f0 fa 94 4a 94 a0 15 51 14 5f a9 5a 0a
              number of blocks: 3664816
              bytes per block: 4096
              number of clusters: 458102
              bytes per cluster: 32768
              max slots: 4

              /dev/xvda11 is clean. It will be checked after 20 additional mounts.
              [root@rac1 init.d]#



              on node1:
              [root@rac1 init.d]# blkid | grep ocfs
              /dev/xvda11: LABEL="old datafiles" UUID="e2b135f0-fa94-4a94-a015-51145fa95a0a" TYPE="ocfs2"
              [root@rac1 init.d]#


              on node1:
              [root@rac1 init.d]# cat /etc/fstab
              LABEL=/ / ext3 defaults 1 1
              LABEL=/var /var ext3 defaults 1 2
              LABEL=/home /home ext3 defaults 1 2
              LABEL=/tmp /tmp ext3 defaults 1 2
              LABEL=/opt /opt ext3 defaults 1 2
              LABEL=/usr /usr ext3 defaults 1 2
              LABEL=/u01 /u01 ext3 defaults 1 2
              LABEL=/boot /boot ext3 defaults 1 2
              tmpfs /dev/shm tmpfs defaults 0 0
              devpts /dev/pts devpts gid=5,mode=620 0 0
              sysfs /sys sysfs defaults 0 0
              proc /proc proc defaults 0 0
              LABEL=SWAP-xvda5 swap swap defaults 0 0
              /dev/xvda11 /ocfs2S ocfs2 datavolume,nointr 0 0
              [root@rac1 init.d]#



              on node2:
              [root@rac2 init.d]# ./ocfs2 start
              Starting Oracle Cluster File System (OCFS2) mount.ocfs2: Device name specified was not found while opening device /dev/xvda11
              [FAILED]
              [root@rac2 init.d]# cat /etc/fstab
              LABEL=/ / ext3 defaults 1 1
              LABEL=/var /var ext3 defaults 1 2
              LABEL=/home /home ext3 defaults 1 2
              LABEL=/tmp /tmp ext3 defaults 1 2
              LABEL=/opt /opt ext3 defaults 1 2
              LABEL=/usr /usr ext3 defaults 1 2
              LABEL=/u01 /u01 ext3 defaults 1 2
              LABEL=/boot /boot ext3 defaults 1 2
              tmpfs /dev/shm tmpfs defaults 0 0
              devpts /dev/pts devpts gid=5,mode=620 0 0
              sysfs /sys sysfs defaults 0 0
              proc /proc proc defaults 0 0
              LABEL=SWAP-xvda5 swap swap defaults 0 0
              /dev/xvda11 /ocfs2S ocfs2 datavolume,nointr 0 0
              [root@rac2 init.d]#

              [root@rac2 init.d]# ./o2cb status
              Module "configfs": Loaded
              Filesystem "configfs": Mounted
              Module "ocfs2_nodemanager": Loaded
              Module "ocfs2_dlm": Loaded
              Module "ocfs2_dlmfs": Loaded
              Filesystem "ocfs2_dlmfs": Mounted
              Checking O2CB cluster ocfs2rac: Online
              Heartbeat dead threshold: 61
              Network idle timeout: 10000
              Network keepalive delay: 5000
              Network reconnect delay: 2000
              Checking O2CB heartbeat: Not active
              [root@rac2 init.d]#


              on node2:
              [root@rac2 init.d]# fsck.ocfs2 -n /dev/xvda11
              fsck.ocfs2: Device name specified was not found while opening "/dev/xvda11"
              [root@rac2 init.d]#


              on node2:
              [root@rac2 init.d]# mount -t ocfs2 -o datavolume,nointr /dev/xvda11 /ocfs2S
              mount.ocfs2: Device name specified was not found while opening device /dev/xvda11
              [root@rac2 init.d]#


              I don't understand why on Node2 that "Checking O2CB heartbeat: Not Active"
              [root@rac2 init.d]# ./o2cb status
              Module "configfs": Loaded
              Filesystem "configfs": Mounted
              Module "ocfs2_nodemanager": Loaded
              Module "ocfs2_dlm": Loaded
              Module "ocfs2_dlmfs": Loaded
              Filesystem "ocfs2_dlmfs": Mounted
              Checking O2CB cluster ocfs2rac: Online
              Heartbeat dead threshold: 61
              Network idle timeout: 10000
              Network keepalive delay: 5000
              Network reconnect delay: 2000
              Checking O2CB heartbeat: Not active
              [root@rac2 init.d]#
              • 19. Re: After OCFS2 install/configure ~ Shared storage check check fails
                Surachart Opun
                Interesting???
                I don't understand why on Node2 that "Checking O2CB heartbeat: Not Active
                Because OCFS2 don't mount
                Example:
                # /etc/init.d/o2cb status
                Module "configfs": Loaded
                Filesystem "configfs": Mounted
                Module "ocfs2_nodemanager": Loaded
                Module "ocfs2_dlm": Loaded
                Module "ocfs2_dlmfs": Loaded
                Filesystem "ocfs2_dlmfs": Mounted
                Checking O2CB cluster ocfs2: Online
                Heartbeat dead threshold: 31
                Network idle timeout: 30000
                Network keepalive delay: 2000
                Network reconnect delay: 2000
                Checking O2CB heartbeat: *Not active*

                # /etc/init.d/ocfs2 start
                Starting Oracle Cluster File System (OCFS2) [  OK  ]

                # /etc/init.d/ocfs2 status
                Configured OCFS2 mountpoints: /shares
                Active OCFS2 mountpoints: /shares

                # /etc/init.d/o2cb status
                Module "configfs": Loaded
                Filesystem "configfs": Mounted
                Module "ocfs2_nodemanager": Loaded
                Module "ocfs2_dlm": Loaded
                Module "ocfs2_dlmfs": Loaded
                Filesystem "ocfs2_dlmfs": Mounted
                Checking O2CB cluster ocfs2: Online
                Heartbeat dead threshold: 31
                Network idle timeout: 30000
                Network keepalive delay: 2000
                Network reconnect delay: 2000
                Checking O2CB heartbeat: *Active*

                Please

                *ls -la /dev/xvda11*

                I think you don't find it... perhaps it's another device name

                > ls -la /dev/xvd*

                show us....

                Example:
                # fsck.ocfs2 -n /dev/emcpowerb
                fsck.ocfs2: Device name specified was not found while opening "/dev/emcpowerb"
                # ls -la /dev/emcpowerb
                ls: /dev/emcpowerb: No such file or directory

                By the way ... if i guess right! ... you should resolve about device name before , and mount it again ;)
                • 20. Re: After OCFS2 install/configure ~ Shared storage check check fails
                  Babu Baskar
                  Hello,

                  Still your NOT mounting using OCFS2;

                  @Surachart Opun; I have one more doubt; I think mount points not formated using mkfs.ocfs2

                  Thanks
                  • 21. Re: After OCFS2 install/configure ~ Shared storage check check fails
                    Surachart Opun
                    Maybe...

                    However I wish he checks about device name and makes sure about it on NODE2 before ;)

                    ls -la /dev/xvda11
                    • 22. Re: After OCFS2 install/configure ~ Shared storage check check fails
                      yakub21
                      I've deinstalled OCFS2 project and installed OCFS2 Project on both nodes (rac1 and rac2)
                      ocfs2-2.6.18-128 *

                      I've also deinstalled OCFS2 Tools on both nodes and installed OCFS2 Tools.

                      Verified the installation.

                      I've mounted node1 (rac1)
                      mount -o datavolume,nointr -t ocfs2 /dev/xvda11 /ocfs2

                      Tried to mount node2 (rac2)
                      [root@rac2 init.d]# mount -o datavolume,nointr -t ocfs2 /dev/xvda11 /ocfs2
                      mount.ocfs2: Device name specified was not found while opening device /dev/xvda11

                      node1:
                      brw-r----- 1 root disk 202, 11 Jul 12 16:07 /dev/xvda1

                      [root@rac2 init.d]# ls -l /dev/xvda1*
                      brw-r----- 1 root disk 202, 1 Jul 12 11:46 /dev/xvda1
                      brw-r----- 1 root disk 202, 10 Jul 12 11:46 /dev/xvda10
                      [root@rac2 init.d]#


                      Does anyone have any experience with OCFS2 on Red Hat Linux 5 with Oracle OCFS2?

                      [root@rac1 init.d]# uname -a
                      Linux rac1.respecti.com 2.6.18-128.el5xen #1 SMP Wed Dec 17 12:01:40 EST 2008 x86_64 x86_64 x86_64 GNU/Linux


                      [root@rac2 init.d]# ./o2cb status
                      Driver for "configfs": Loaded
                      Filesystem "configfs": Mounted
                      Driver for "ocfs2_dlmfs": Loaded
                      Filesystem "ocfs2_dlmfs": Mounted
                      Checking O2CB cluster ocfs2: Online
                      Heartbeat dead threshold = 31
                      Network idle timeout: 30000
                      Network keepalive delay: 2000
                      Network reconnect delay: 2000
                      Checking O2CB heartbeat: Not active
                      [root@rac2 init.d]#



                      How does one share a device on one node onto another using OCFS2 ?

                      Thanks
                      • 23. Re: After OCFS2 install/configure ~ Shared storage check check fails
                        Surachart Opun
                        Yes... may be, But need him to check device name before.

                        ;)
                        • 24. Re: After OCFS2 install/configure ~ Shared storage check check fails
                          Babu Baskar
                          Hello,

                          Before posting pls read the above response; We already explanied well

                          Thanks
                          • 25. Re: After OCFS2 install/configure ~ Shared storage check check fails
                            yakub21
                            It continues to be unclear "Why isn't node2 able to see the OCFS2 partition from node1" ?

                            Appreciate Assistance in resolving this issue!


                            node1:
                            [root@rac1 init.d]# cat /etc/mtab
                            /dev/xvda3 / ext3 rw 0 0
                            proc /proc proc rw 0 0
                            sysfs /sys sysfs rw 0 0
                            devpts /dev/pts devpts rw,gid=5,mode=620 0 0
                            /dev/xvda10 /var ext3 rw 0 0
                            /dev/xvda9 /home ext3 rw 0 0
                            /dev/xvda8 /tmp ext3 rw 0 0
                            /dev/xvda7 /opt ext3 rw 0 0
                            /dev/xvda6 /usr ext3 rw 0 0
                            /dev/xvda2 /u01 ext3 rw 0 0
                            /dev/xvda1 /boot ext3 rw 0 0
                            tmpfs /dev/shm tmpfs rw 0 0
                            none /proc/sys/fs/binfmt_misc binfmt_misc rw 0 0
                            sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw 0 0
                            configfs /sys/kernel/config configfs rw 0 0
                            ocfs2_dlmfs /dlm ocfs2_dlmfs rw 0 0
                            /dev/xvda11 /ocfs2 ocfs2 rw,_netdev,datavolume,nointr,heartbeat=local 0 0
                            [root@rac1 init.d]#


                            node2:
                            [root@rac2 init.d]# cat /etc/mtab
                            /dev/xvda3 / ext3 rw 0 0
                            proc /proc proc rw 0 0
                            sysfs /sys sysfs rw 0 0
                            devpts /dev/pts devpts rw,gid=5,mode=620 0 0
                            /dev/xvda10 /var ext3 rw 0 0
                            /dev/xvda9 /home ext3 rw 0 0
                            /dev/xvda8 /tmp ext3 rw 0 0
                            /dev/xvda7 /opt ext3 rw 0 0
                            /dev/xvda6 /usr ext3 rw 0 0
                            /dev/xvda2 /u01 ext3 rw 0 0
                            /dev/xvda1 /boot ext3 rw 0 0
                            tmpfs /dev/shm tmpfs rw 0 0
                            none /proc/sys/fs/binfmt_misc binfmt_misc rw 0 0
                            sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw 0 0
                            configfs /sys/kernel/config configfs rw 0 0
                            ocfs2_dlmfs /dlm ocfs2_dlmfs rw 0 0
                            [root@rac2 init.d]#


                            node1:
                            [root@rac1 init.d]# ls -l /dev/xvda*
                            brw-r----- 1 root disk 202, 0 Jul 12 11:46 /dev/xvda
                            brw-r----- 1 root disk 202, 1 Jul 12 11:46 /dev/xvda1
                            brw-r----- 1 root disk 202, 10 Jul 12 11:46 /dev/xvda10
                            brw-r----- 1 root disk 202, 11 Jul 12 16:07 /dev/xvda11
                            brw-r----- 1 root disk 202, 2 Jul 12 11:46 /dev/xvda2
                            brw-r----- 1 root disk 202, 3 Jul 12 11:46 /dev/xvda3
                            brw-r----- 1 root disk 202, 4 Jul 12 11:46 /dev/xvda4
                            brw-r----- 1 root disk 202, 5 Jul 12 11:46 /dev/xvda5
                            brw-r----- 1 root disk 202, 6 Jul 12 11:46 /dev/xvda6
                            brw-r----- 1 root disk 202, 7 Jul 12 11:46 /dev/xvda7
                            brw-r----- 1 root disk 202, 8 Jul 12 11:46 /dev/xvda8
                            brw-r----- 1 root disk 202, 9 Jul 12 11:46 /dev/xvda9
                            [root@rac1 init.d]#


                            node2:
                            [root@rac2 init.d]# ls -l /dev/xvda*
                            brw-r----- 1 root disk 202, 0 Jul 12 11:46 /dev/xvda
                            brw-r----- 1 root disk 202, 1 Jul 12 11:46 /dev/xvda1
                            brw-r----- 1 root disk 202, 10 Jul 12 11:46 /dev/xvda10
                            brw-r----- 1 root disk 202, 2 Jul 12 11:46 /dev/xvda2
                            brw-r----- 1 root disk 202, 3 Jul 12 11:46 /dev/xvda3
                            brw-r----- 1 root disk 202, 4 Jul 12 11:46 /dev/xvda4
                            brw-r----- 1 root disk 202, 5 Jul 12 11:46 /dev/xvda5
                            brw-r----- 1 root disk 202, 6 Jul 12 11:46 /dev/xvda6
                            brw-r----- 1 root disk 202, 7 Jul 12 11:46 /dev/xvda7
                            brw-r----- 1 root disk 202, 8 Jul 12 11:46 /dev/xvda8
                            brw-r----- 1 root disk 202, 9 Jul 12 11:46 /dev/xvda9
                            [root@rac2 init.d]#


                            node1:
                            [root@rac1 init.d]# ./ocfs2 status
                            Active OCFS2 mountpoints: /ocfs2
                            [root@rac1 init.d]#


                            node2:
                            [root@rac2 init.d]# ./ocfs2 status
                            Configured OCFS2 mountpoints: /ocfs2
                            [root@rac2 init.d]#

                            node1:
                            [root@rac1 init.d]# mounted.ocfs2 -f
                            Device FS Nodes
                            /dev/xvda11 ocfs2 rac1.respecti.com
                            [root@rac1 init.d]#


                            node2:
                            [root@rac2 permissions.d]# mounted.ocfs2 -d
                            Device FS UUID Label
                            [root@rac2 permissions.d]#


                            node1:
                            [root@rac1 init.d]# md5sum /etc/ocfs2/cluster.conf
                            6a748f8d3c39b0b42d23d7f0299e4e89 /etc/ocfs2/cluster.conf
                            [root@rac1 init.d]#


                            node2:
                            [root@rac2 permissions.d]# md5sum /etc/ocfs2/cluster.conf
                            6a748f8d3c39b0b42d23d7f0299e4e89 /etc/ocfs2/cluster.conf
                            [root@rac2 permissions.d]#

                            Network Check
                            node1:
                            [root@rac1 init.d]# nc -zv 192.168.1.12 7777
                            Connection to 192.168.1.12 7777 port [tcp/cbt] succeeded!
                            [root@rac1 init.d]#


                            node2:
                            [root@rac2 permissions.d]# nc -zv 192.168.1.13 7777
                            Connection to 192.168.1.13 7777 port [tcp/cbt] succeeded!
                            [root@rac2 permissions.d]#

                            Observation: I did not configure to the Private IP
                            node1:
                            # Do not remove the following line, or various programs
                            # that require network functionality will fail.
                            127.0.0.1 localhost.localdomain localhost
                            ::1 localhost6.localdomain6 localhost6
                            192.168.1.12 rac1.respecti.com rac1
                            192.168.1.14 rac1-priv.respecti.com rac1-priv
                            192.168.1.16 rac1-vip.respecti.com rac1-vip
                            192.168.1.13 rac2.respecti.com rac2
                            192.168.1.15 rac2-priv.respecti.com rac2-priv
                            192.168.1.17 rac2-vip.respecti.com rac2-vip
                            192.168.1.11 vms.respecti.com vms
                            [root@rac1 init.d]#


                            node2:
                            # Do not remove the following line, or various programs
                            # that require network functionality will fail.
                            127.0.0.1 localhost.localdomain localhost
                            ::1 localhost6.localdomain6 localhost6
                            192.168.1.12 rac1.respecti.com rac1
                            192.168.1.14 rac1-priv.respecti.com rac1-priv
                            192.168.1.16 rac1-vip.respecti.com rac1-vip
                            192.168.1.13 rac2.respecti.com rac2
                            192.168.1.15 rac2-priv.respecti.com rac2-priv
                            192.168.1.17 rac2-vip.respecti.com rac2-vip
                            192.168.1.11 vms.respecti.com vms
                            [root@rac2 permissions.d]#


                            node1:
                            [root@rac1 init.d]# iptables --list
                            Chain INPUT (policy ACCEPT)
                            target prot opt source destination

                            Chain FORWARD (policy ACCEPT)
                            target prot opt source destination

                            Chain OUTPUT (policy ACCEPT)
                            target prot opt source destination
                            [root@rac1 init.d]#


                            node2:
                            [root@rac2 permissions.d]# iptables --list
                            Chain INPUT (policy ACCEPT)
                            target prot opt source destination

                            Chain FORWARD (policy ACCEPT)
                            target prot opt source destination

                            Chain OUTPUT (policy ACCEPT)
                            target prot opt source destination
                            [root@rac2 permissions.d]#


                            node1:
                            [root@rac1 init.d]# blkid | grep ocfs
                            /dev/xvda11: LABEL="ocfs2" UUID="f43c19f3-36fa-4888-a806-a2b9d2ac31a0" TYPE="ocfs2"
                            [root@rac1 init.d]#


                            node2:
                            # blkid | grep ocfs
                            [root@rac2 permissions.d]#

                            Test that the ocfs2 headers are physically readable
                            node1:
                            [root@rac1 init.d]# dd if=/dev/xvda11 count=256 | strings | grep -A 2 OCFSV2
                            256+0 records in
                            256+0 records out
                            131072 bytes (131 kB) copied, 0.042234 seconds, 3.1 MB/s
                            OCFSV2
                            QBZJ
                            QBZJ
                            [root@rac1 init.d]#

                            node1:
                            [root@rac2 init.d]# dd if=/dev/xvda11 count=256 | strings | grep -A 2 OCFSV2
                            dd: opening `/dev/xvda11': No such file or directory
                            [root@rac2 init.d]#


                            node1:
                            [root@rac1 init.d]# ./o2cb status
                            Driver for "configfs": Loaded
                            Filesystem "configfs": Mounted
                            Driver for "ocfs2_dlmfs": Loaded
                            Filesystem "ocfs2_dlmfs": Mounted
                            Checking O2CB cluster ocfs2: Online
                            Heartbeat dead threshold = 31
                            Network idle timeout: 30000
                            Network keepalive delay: 2000
                            Network reconnect delay: 2000
                            Checking O2CB heartbeat: Active
                            [root@rac1 init.d]#


                            node2:
                            [root@rac2 init.d]# ./o2cb status
                            Driver for "configfs": Loaded
                            Filesystem "configfs": Mounted
                            Driver for "ocfs2_dlmfs": Loaded
                            Filesystem "ocfs2_dlmfs": Mounted
                            Checking O2CB cluster ocfs2: Online
                            Heartbeat dead threshold = 31
                            Network idle timeout: 30000
                            Network keepalive delay: 2000
                            Network reconnect delay: 2000
                            Checking O2CB heartbeat: Not active
                            [root@rac2 init.d]#

                            node1:
                            [root@rac1 init.d]# rpm -qa | grep -i ocfs2
                            ocfs2console-1.4.2-1.el5
                            ocfs2-2.6.18-128.el5xen-1.4.2-1.el5
                            ocfs2-tools-debuginfo-1.4.2-1.el5
                            ocfs2-2.6.18-128.el5-debuginfo-1.4.2-1.el5
                            ocfs2-tools-devel-1.4.2-1.el5
                            ocfs2-tools-1.4.2-1.el5
                            ocfs2-2.6.18-128.el5debug-1.4.2-1.el5
                            ocfs2-2.6.18-128.el5-1.4.2-1.el5
                            [root@rac1 init.d]#


                            node2:
                            [root@rac2 init.d]# rpm -qa | grep -i ocfs2
                            ocfs2-2.6.18-128.el5debug-1.4.2-1.el5
                            ocfs2-tools-1.4.2-1.el5
                            ocfs2-tools-debuginfo-1.4.2-1.el5
                            ocfs2-2.6.18-128.el5xen-1.4.2-1.el5
                            ocfs2console-1.4.2-1.el5
                            ocfs2-2.6.18-128.el5-debuginfo-1.4.2-1.el5
                            ocfs2-2.6.18-128.el5-1.4.2-1.el5
                            ocfs2-tools-devel-1.4.2-1.el5
                            [root@rac2 init.d]#
                            • 26. Re: After OCFS2 install/configure ~ Shared storage check check fails
                              Surachart Opun
                              It continues to be unclear "Why isn't node2 able to see the OCFS2 partition from node1" ?
                              From your post, I think you should point at */dev/xvda11* (not about OCFS2)

                              You have to configure about OS or VM(if you use)... Why node2 don't see /dev/xvda11.

                              Check from /var/log/messages about errors... if you can.

                              find out about share strage on /dev/xvda device
                              • 27. Re: After OCFS2 install/configure ~ Shared storage check check fails
                                yakub21
                                Thanks Surachart,

                                You've brought up a valid point:

                                node2:
                                /var/log/messages


                                Jul 12 16:04:01 rac2 modprobe: FATAL: Module ocfs2_stackglue not found.
                                Jul 12 16:04:02 rac2 kernel: OCFS2 Node Manager 1.4.2 Mon May 11 12:41:29 PDT 2009 (build 0b9eb999c4d39c0d4b66219a2752cda6)
                                Jul 12 16:04:02 rac2 kernel: OCFS2 DLM 1.4.2 Mon May 11 12:41:30 PDT 2009 (build 0faae8d4263a8c594749be558d8d7edd)
                                Jul 12 16:04:02 rac2 kernel: OCFS2 DLMFS 1.4.2 Mon May 11 12:41:30 PDT 2009 (build 0faae8d4263a8c594749be558d8d7edd)
                                Jul 12 16:04:02 rac2 kernel: OCFS2 User DLM kernel interface loaded
                                Jul 12 16:04:20 rac2 modprobe: FATAL: Module ocfs2_stackglue not found.
                                Jul 12 16:26:23 rac2 gconfd (root-4059): starting (version 2.14.0), pid 4059 user 'root'
                                Jul 12 16:26:23 rac2 gconfd (root-4059): Resolved address "xml:readonly:/etc/gconf/gconf.xml.mandatory" to a read-only configuration source at position 0
                                Jul 12 16:26:23 rac2 gconfd (root-4059): Resolved address "xml:readwrite:/root/.gconf" to a writable configuration source at position 1
                                Jul 12 16:26:23 rac2 gconfd (root-4059): Resolved address "xml:readonly:/etc/gconf/gconf.xml.defaults" to a read-only configuration source at position 2
                                Jul 12 16:26:23 rac2 pcscd: winscard.c:304:SCardConnect() Reader E-Gate 0 0 Not Found
                                Jul 12 16:26:23 rac2 last message repeated 4 times
                                Jul 12 16:26:23 rac2 hcid[1971]: Default passkey agent (:1.9, /org/bluez/applet) registered
                                Jul 12 16:26:24 rac2 nm-system-settings: Loaded plugin ifcfg-rh: (c) 2007 - 2008 Red Hat, Inc. To report bugs please use the NetworkManager mailing list.
                                Jul 12 16:26:24 rac2 nm-system-settings: ifcfg-rh: parsing /etc/sysconfig/network-scripts/ifcfg-eth0 ...
                                Jul 12 16:26:24 rac2 nm-system-settings: ifcfg-rh: read connection 'System eth0'
                                Jul 12 16:26:24 rac2 nm-system-settings: ifcfg-rh: parsing /etc/sysconfig/network-scripts/ifcfg-lo ...
                                Jul 12 16:26:24 rac2 nm-system-settings: ifcfg-rh: error: Ignoring loopback device config.
                                Jul 12 16:26:24 rac2 nm-system-settings: ifcfg-rh: parsing /etc/sysconfig/network-scripts/ifcfg-eth1 ...
                                Jul 12 16:26:24 rac2 nm-system-settings: ifcfg-rh: read connection 'System eth1'
                                Jul 13 20:26:09 rac2 modprobe: FATAL: Module ocfs2_stackglue not found.
                                Jul 13 20:26:14 rac2 modprobe: FATAL: Module ocfs2_stackglue not found.
                                Jul 13 20:34:31 rac2 kernel: ip_tables: (C) 2000-2006 Netfilter Core Team
                                • 28. Re: After OCFS2 install/configure ~ Shared storage check check fails
                                  yakub21
                                  From
                                  node1:

                                  Jul 13 20:16:13 rac1 modprobe: FATAL: Module ocfs2_stackglue not found.
                                  Jul 13 20:25:32 rac1 modprobe: FATAL: Module ocfs2_stackglue not found.
                                  Jul 13 20:25:40 rac1 modprobe: FATAL: Module ocfs2_stackglue not found.
                                  Jul 13 20:32:14 rac1 kernel: (3680,0):o2net_connect_expired:1667 ERROR: no connection established with node 0 after 30.0 seconds, giving up and returning errors.
                                  Jul 13 20:33:14 rac1 last message repeated 2 times
                                  Jul 13 20:33:44 rac1 kernel: (3680,0):o2net_connect_expired:1667 ERROR: no connection established with node 0 after 30.0 seconds, giving up and returning errors.
                                  Jul 13 20:34:10 rac1 kernel: ip_tables: (C) 2000-2006 Netfilter Core Team
                                  Jul 13 20:34:14 rac1 kernel: (3680,0):o2net_connect_expired:1667 ERROR: no connection established with node 0 after 30.0 seconds, giving up and returning errors.
                                  Jul 13 20:35:14 rac1 last message repeated 2 times
                                  Jul 13 20:36:44 rac1 last message repeated 3 times
                                  Jul 13 20:38:14 rac1 last message repeated 3 times
                                  • 29. Re: After OCFS2 install/configure ~ Shared storage check check fails
                                    Surachart Opun
                                    Hi yakub21 ...

                                    I have no idea about VM... (/dev/xvda* device name)
                                    I think your problem is about /dev/xvda11 device name on node02. find out error about xvda11 in /var/log/messges file to investigate it.

                                    don't think about OCFS2 on node02... solve /dev/xvda11 before.

                                    If you use VM you have to find out information to help about make share storage (/dev/xvda11)