9 Replies Latest reply: Jun 6, 2014 11:01 AM by Balazs Papp RSS

    'No shared storage found'   'Shared storage check failed on nodes'

    Eugen-Oracle

      By running the following command:

      cluvfy comp ssa -verbose

       

      I received the following:

       

      'No shared storage found' 

      'Shared storage check failed on nodes'


      I am using Oracle VirtualBox and the issue is only in one node, in the ther one is working fine.

      I marked my disks as Shareable.

       

      What could be the reason ?

       

      Thank you
      Eugen

        • 1. Re: 'No shared storage found'   'Shared storage check failed on nodes'
          Billy~Verreynne

          Marking your disks as shareable, how?

           

          What VM feature or option did you use to make a virtual disk visible to both VMs?

           

          Have you confirmed that said disk is seen by both VMs when booting, and that changes written to the disk via one VM is seen by the other VM? (e.g. partitioning on one, should make the partition visible on the other after a kpartx refresh)

          • 2. Re: 'No shared storage found'   'Shared storage check failed on nodes'
            Eugen-Oracle

            By setting the Shareable of disks in VM in Settings from Oracle Virtual Box window on host. Maybe is something that I missed?

            Strange is, on the other node is fine.

             

            How can I mark my disks as shareable?

             

            If I run "oracleasm listdisks", I see all 4 disks:

            DISK1

            DISK2

            DISK3

            DISK4

             

            Thank you

            Eugen

            • 3. Re: 'No shared storage found'   'Shared storage check failed on nodes'
              Billy~Verreynne

              I use a separate VM as storage server (NAS) - as that is in my view a more realistic virtualisation of the real thing.

               

              Forget about ASMlib for starters. You need to confirm that the shared virtual disk is seen (and usable) by both VMs.

               

              To do that, you need to identify the virtual device name in the VM. It should be something like /dev/sdb.

               

              You then need to write to that device in one VM, and read that device in the other to confirm what was written. fdisk can be used (creating/dropping partitions as the disk change). Or dd and od can be used to write data to, and read data from, disk.

               

              My concern would be the WWID of the disk. It should be identical for that disk device on both VMs. This is the primary means for uniquely identifying a disk across h/w platforms. If it is not the same, how will the VMs know that the disk is the same disk across VMs? As I've never used VM shared device option, I'm not sure how the WWID works when not using a separate storage/NAS VM.

              • 4. Re: 'No shared storage found'   'Shared storage check failed on nodes'
                Eugen-Oracle

                Manny thanks for your update.

                 

                From VM all are  shareable.

                 

                Ex:

                 

                C:\Program Files\Oracle\VirtualBox>VBoxManage showhdinfo "D:\Servici\Virtual Box

                \sda.vdi"

                 

                UUID:           67e7d9bb-8873-4bc4-bb40-ca6a8b6add35

                Parent UUID:    base

                State:          locked read

                Type:           shareable

                Location:       D:\Servici\Virtual Box\sda.vdi

                Storage format: VDI

                Format variant: fixed default

                Capacity:       5120 MBytes

                Size on disk:   5122 MBytes

                In use by VMs:  ol6-121-rac1 (UUID: 5d143623-a350-42f8-9ab4-5dec20ed4230)

                 

                I used fdisk:

                 

                # cd /dev

                # ls sd*

                sda sda1 sda2 sdb sdb1 sdc sdc1 sdd sdd1 sde sde1 sdf sdf1

                 

                #

                 

                regarding the WWID I should run the following ?

                scsi_id -g -u ./block/sda

                 

                I run it but nothing happened. Maybe I run it from a wrong location ?

                 

                Thank you

                Eugen

                • 5. Re: 'No shared storage found'   'Shared storage check failed on nodes'
                  Eugen-Oracle

                  I think I can run also the following command to see the WWID:

                   

                  ll /dev/disk/by-id/

                   

                  Am I right ?

                   

                  Thank you
                  Eugen

                  • 6. Re: 'No shared storage found'   'Shared storage check failed on nodes'
                    Billy~Verreynne

                    It is unlikely that /dev/sda would the shared device. Typically it is a local device containing the boot and root partitions for the server.

                     

                    Install lssci - e.g. yum install lsscsi-0.17-3.el5.x86_64

                     

                    Do a scsi listing to see the controllers and devices per controller. You should be able to define 2 controllers for a VM as I recall? Using the first controller for local disks and second controller for shared disks, can serve as a sanity check.

                     

                    To list the WWID, code page 0x80 or 0x83 can be used. Depending on how the storage layer look, one code page can provide a better/unique WWID that the other one cannot.

                     

                    E.g.

                    -- wwid returned for local disk

                    [root@dev1 ~]# /sbin/scsi_id -p 0x80 -g -u -s /block/sda
                    SSEAGATE_ST373307LC_3HZ9KN8100007519GKWV

                    -- nothing returned for local disk
                    [root@dev1 ~]# /sbin/scsi_id -p 0x83 -g -u -s /block/sda

                    [root@dev1 ~]#

                     

                    -- wwids returned with both for a iscsi/iser device

                    [root@dev1 ~]# /sbin/scsi_id -p 0x80 -g -u -s /block/sdax
                    SSTORAGE3ST31000640SS_9QJ2RB5Q000099189ZWT
                    [root@dev1 ~]# /sbin/scsi_id -p 0x83 -g -u -s /block/sdax
                    1IET_00010001
                    [root@dev1 ~]#

                    • 7. Re: 'No shared storage found'   'Shared storage check failed on nodes'
                      Balazs Papp

                      Your virtual disk, attached to 1 virtual machine:

                       

                      C:\Program Files\Oracle\VirtualBox>VBoxManage showhdinfo "D:\Servici\Virtual Box\sda.vdi"

                       

                      UUID:           67e7d9bb-8873-4bc4-bb40-ca6a8b6add35

                      Parent UUID:    base

                      State:          locked read

                      Type:           shareable

                      Location:       D:\Servici\Virtual Box\sda.vdi

                      Storage format: VDI

                      Format variant: fixed default

                      Capacity:       5120 MBytes

                      Size on disk:   5122 MBytes

                      In use by VMs:  ol6-121-rac1 (UUID: 5d143623-a350-42f8-9ab4-5dec20ed4230)

                       

                      And this is my sandbox:

                       

                      "C:\Program Files\Oracle\VirtualBox\VBoxManage.exe" showhdinfo "L:\VirtualBox\12.1_RAC\C_OCR_1.vdi"

                       

                      UUID:           c0eeadcd-5c39-4a8a-8634-0899bbd8f30f

                      Parent UUID:    base

                      State:          created

                      Type:           shareable

                      Location:       L:\VirtualBox\12.1_RAC\C_OCR_1.vdi

                      Storage format: VDI

                      Format variant: fixed default

                      Capacity:       8192 MBytes

                      Size on disk:   8194 MBytes

                      In use by VMs:  C2 (UUID: 0f275619-61a8-4bce-9638-1012f2f6ba17)

                                      C1 (UUID: b79370a0-7a4d-44a3-a2b4-f8723f973d5a)


                      Marking a disk as shareable alone is not enough, you still have to explicitly attach the disk to the other VMs.

                      • 8. Re: 'No shared storage found'   'Shared storage check failed on nodes'
                        Eugen-Oracle

                        Hi Balazs,

                         

                        Thank you very much, but how can I do that ?

                         

                        Thank you

                        Eugen

                        • 9. Re: 'No shared storage found'   'Shared storage check failed on nodes'
                          Balazs Papp

                          Hi,

                           

                          add a new virtual disk to the second virtual machine (should be powered off), but choose the existing disk instead of creating a new one.