1 2 Previous Next 21 Replies Latest reply: Feb 19, 2013 10:20 PM by 960874 RSS

    OVM 3.2.1 doesn't discover local disk

    user739062
      OVM 3.2.1 doesn't discover local disk on a SUN FIRE X4170 M3. I created 1TB lvdisk1, but OVM manager doesn't see it. Below is some output asked in similar situation in other threads:

      # vgdisplay
      --- Volume group ---
      VG Name DomUVol
      System ID
      Format lvm2
      Metadata Areas 1
      Metadata Sequence No 4
      VG Access read/write
      VG Status resizable
      MAX LV 0
      Cur LV 1
      Open LV 0
      Max PV 0
      Cur PV 1
      Act PV 1
      VG Size 3.76 TB
      PE Size 32.00 MB
      Total PE 123360
      Alloc PE / Size 32768 / 1.00 TB
      Free PE / Size 90592 / 2.76 TB
      VG UUID WNg82A-zsuW-fcin-evtY-NSAU-dWN7-35k9pX

      # lvdisplay
      --- Logical volume ---
      LV Name /dev/DomUVol/lvdisk1
      VG Name DomUVol
      LV UUID l2bZ0D-LDse-bHbc-BrsY-iwCf-CXsi-bKkdeu
      LV Write Access read/write
      LV Status available
      # open 0
      LV Size 1.00 TB
      Current LE 32768
      Segments 1
      Allocation inherit
      Read ahead sectors auto
      - currently set to 256
      Block device 252:0

      # df
      Filesystem 1K-blocks Used Available Use% Mounted on
      /dev/sda2 49571696 1115204 45897740 3% /
      /dev/sda1 194442 27845 156558 16% /boot
      tmpfs 2829952 0 2829952 0% /dev/shm
      none 2829952 48 2829904 1% /var/lib/xenstored

      # blkid
      /dev/sda1: LABEL="/boot" UUID="89bbdaaa-1177-4ec7-8c99-8b698c068f8f" TYPE="ext3"
      /dev/sda2: LABEL="/" UUID="7ff3ecea-0b01-4986-a914-9f0741023e82" TYPE="ext3"
      /dev/sda3: LABEL="SWAP-sda31" UUID="18d8494e-ce62-4b60-88b1-ea8bc3616bd9" TYPE="swap"
      /dev/sdc1: LABEL="ORACLE_SSM" UUID="6275-6275" TYPE="vfat"

      # storage_discover --infoDumpType=disk_XML
      <SCSI>
      </SCSI>
      <DiskScanIssues>
      <Errors Num="0"><![CDATA[
      ]]></Errors>
      <Warnings Num="0"><![CDATA[
      ]]></Warnings>
      </DiskScanIssues>
        • 1. Re: OVM 3.2.1 doesn't discover local disk
          user12273962
          Don't out a logical volume on the disk. Leave it raw.
          • 2. Re: OVM 3.2.1 doesn't discover local disk
            user739062
            Could you please elaborate it a little? I have another 2.4GB without lv - and it doesn't see it either.
            • 3. Re: OVM 3.2.1 doesn't discover local disk
              user12273962
              The RAID volume that contains the VM Server installation can not be used as storage. For example. Lets say you have 4 disks. Create two separate RAID 1 volumes. One RAID volume will be used for the VM server installation and the other will be used for storage. Don't partition or put anything on the the RAID volume to be used for storage. You then be able to see the volume. You can then use it as repository. Just remember, you can't share this repo with another server.
              • 4. Re: OVM 3.2.1 doesn't discover local disk
                user739062
                Well, I believe that it is exactly what I have - but it still doesn't see the volume.

                Any way to verify that? I don't know much about disk configuration in linux - any hints would be much appreciated.

                Thanks,

                Alex
                • 5. Re: OVM 3.2.1 doesn't discover local disk
                  user12273962
                  Do a fdisk -l from your VM server itself and post the output.
                  • 6. Re: OVM 3.2.1 doesn't discover local disk
                    user739062
                    # fdisk -l

                    WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk doesn't support GPT. Use GNU Parted.


                    WARNING: The size of this disk is 4.1 TB (4139306450944 bytes).
                    DOS partition table format can not be used on drives for volumes
                    larger than 2.2 TB (2199023255040 bytes). Use parted(1) and GUID
                    partition table format (GPT).


                    Disk /dev/sdb: 4139.3 GB, 4139306450944 bytes
                    255 heads, 63 sectors/track, 503242 cylinders
                    Units = cylinders of 16065 * 512 = 8225280 bytes

                    Device Boot Start End Blocks Id System
                    /dev/sdb1 1 267350 2147483647+ ee EFI GPT

                    Disk /dev/sda: 53.6 GB, 53686829056 bytes
                    255 heads, 63 sectors/track, 6527 cylinders
                    Units = cylinders of 16065 * 512 = 8225280 bytes

                    Device Boot Start End Blocks Id System
                    /dev/sda1 * 1 25 200781 83 Linux
                    /dev/sda2 26 6396 51175057+ 83 Linux
                    /dev/sda3 6397 6527 1052257+ 82 Linux swap / Solaris

                    Disk /dev/sdc: 3880 MB, 3880452096 bytes
                    4 heads, 32 sectors/track, 59211 cylinders
                    Units = cylinders of 128 * 512 = 65536 bytes

                    Device Boot Start End Blocks Id System
                    /dev/sdc1 * 17 57344 3668992 ef EFI (FAT-12/16/32)
                    #
                    • 7. Re: OVM 3.2.1 doesn't discover local disk
                      user12273962
                      I don't know exactly what disk you're wanting to see but

                      Disk /dev/sdb: 4139.3 GB, 4139306450944 bytes
                      255 heads, 63 sectors/track, 503242 cylinders
                      Units = cylinders of 16065 * 512 = 8225280 bytes

                      Device Boot Start End Blocks Id System
                      /dev/sdb1 1 267350 2147483647+ ee EFI GPT

                      SDB Has a partition. If this is the right disk. Then remove the partition. Oracle VM does not expect anything to be on a disk used as a repository. Not even a partition.

                      Disk /dev/sdc: 3880 MB, 3880452096 bytes
                      4 heads, 32 sectors/track, 59211 cylinders
                      Units = cylinders of 128 * 512 = 65536 bytes

                      Device Boot Start End Blocks Id System
                      /dev/sdc1 * 17 57344 3668992 ef EFI (FAT-12/16/32)

                      SBC has a partition. If this is the right disk, remove the partition. Reboot

                      You should then be able to see it as available for a repository. Repositoty creating on Local/FC and iSCSI disk expects to create a OCFS2 filesystem for use a repo. This requires there be nothing on the disk. Not even a partition. No filesystem. Nothing.
                      • 8. Re: OVM 3.2.1 doesn't discover local disk
                        user739062
                        Yes, I want to use the sdb disk. I have removed the sdb partition and rebooted it. Current fdisk -l output is below.

                        Unfortunately it still doesn't see it - I tried to rescan physical disks, rediscover server, but no luck yet.



                        # fdisk -l

                        WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk doesn't support GPT. Use GNU Parted.


                        WARNING: The size of this disk is 4.1 TB (4139306450944 bytes).
                        DOS partition table format can not be used on drives for volumes
                        larger than 2.2 TB (2199023255040 bytes). Use parted(1) and GUID
                        partition table format (GPT).


                        Disk /dev/sdb: 4139.3 GB, 4139306450944 bytes
                        255 heads, 63 sectors/track, 503242 cylinders
                        Units = cylinders of 16065 * 512 = 8225280 bytes

                        Device Boot Start End Blocks Id System

                        Disk /dev/sda: 53.6 GB, 53686829056 bytes
                        255 heads, 63 sectors/track, 6527 cylinders
                        Units = cylinders of 16065 * 512 = 8225280 bytes

                        Device Boot Start End Blocks Id System
                        /dev/sda1 * 1 25 200781 83 Linux
                        /dev/sda2 26 6396 51175057+ 83 Linux
                        /dev/sda3 6397 6527 1052257+ 82 Linux swap / Solaris

                        Disk /dev/sdc: 3880 MB, 3880452096 bytes
                        4 heads, 32 sectors/track, 59211 cylinders
                        Units = cylinders of 128 * 512 = 65536 bytes

                        Device Boot Start End Blocks Id System
                        /dev/sdc1 * 17 57344 3668992 ef EFI (FAT-12/16/32)
                        #
                        • 9. Re: OVM 3.2.1 doesn't discover local disk
                          user12273962
                          Interesting. I run several 4270s and I have local repos. I have one 4170 but I use it for something else not VM related.

                          Can you see it under the local view under you server? What type of raid controllers are on the M3s?
                          It might be interesting to see if you removed the partition on SDC and see it shows up then.
                          • 10. Re: OVM 3.2.1 doesn't discover local disk
                            991320
                            Hi

                            I had the same problem , in my case what I had done was during OVS 3.2.1 install I had setup /dev/sdb disk , then once OVS 3.2.1 was installed I formated /dev/sdb , even that was not seen by OVM Manager 3.2.1 and last resort was to re-install OVS , left /dev/sdb untouched during OVS installation, after that OVM was able to see the /dev/sdb as Local File System, which I used as Repository.

                            Dharmin
                            • 11. Re: OVM 3.2.1 doesn't discover local disk
                              user739062
                              What is "local view"? On the "Server and VMs" tab, nothing is under server. Nothing is in the "Physical Disks" perspective. But there are two lines in the "Storage Initiators" perspective:
                              <server name>:iqn.1988-12.com.oracle:87ccc85127f4
                              <server name>:storage.LocalStorageInitiator in e0:22:...

                              How can I check the type of raid contollers? I have no physicall access to the machine.

                              I can do whatever is needed remotely, but I don't have physical access - so re-installing OVM server is problematic.

                              Thanks,

                              Alex
                              • 12. Re: OVM 3.2.1 doesn't discover local disk
                                user12273962
                                Post the output of multipath -ll

                                also post the output of lspci
                                • 13. Re: OVM 3.2.1 doesn't discover local disk
                                  user739062
                                  # multipath -ll
                                  Feb 15 19:56:43 | DM multipath kernel driver not loaded
                                  Feb 15 19:56:43 | DM multipath kernel driver not loaded
                                  #
                                  # lspci
                                  00:00.0 Host bridge: Intel Corporation Sandy Bridge DMI2 (rev 07)
                                  00:02.0 PCI bridge: Intel Corporation Sandy Bridge IIO PCI Express Root Port 2a (rev 07)
                                  00:02.2 PCI bridge: Intel Corporation Sandy Bridge IIO PCI Express Root Port 2c (rev 07)
                                  00:03.0 PCI bridge: Intel Corporation Sandy Bridge IIO PCI Express Root Port 3a in PCI Express Mode (rev 07)
                                  00:03.2 PCI bridge: Intel Corporation Sandy Bridge IIO PCI Express Root Port 3c (rev 07)
                                  00:04.0 System peripheral: Intel Corporation Sandy Bridge DMA Channel 0 (rev 07)
                                  00:04.1 System peripheral: Intel Corporation Sandy Bridge DMA Channel 1 (rev 07)
                                  00:04.2 System peripheral: Intel Corporation Sandy Bridge DMA Channel 2 (rev 07)
                                  00:04.3 System peripheral: Intel Corporation Sandy Bridge DMA Channel 3 (rev 07)
                                  00:04.4 System peripheral: Intel Corporation Sandy Bridge DMA Channel 4 (rev 07)
                                  00:04.5 System peripheral: Intel Corporation Sandy Bridge DMA Channel 5 (rev 07)
                                  00:04.6 System peripheral: Intel Corporation Sandy Bridge DMA Channel 6 (rev 07)
                                  00:04.7 System peripheral: Intel Corporation Sandy Bridge DMA Channel 7 (rev 07)
                                  00:05.0 System peripheral: Intel Corporation Sandy Bridge Address Map, VTd_Misc, System Management (rev 07)
                                  00:05.2 System peripheral: Intel Corporation Sandy Bridge Control Status and Global Errors (rev 07)
                                  00:05.4 PIC: Intel Corporation Sandy Bridge I/O APIC (rev 07)
                                  00:11.0 PCI bridge: Intel Corporation Patsburg PCI Express Virtual Root Port (rev 06)
                                  00:1a.0 USB Controller: Intel Corporation Patsburg USB2 Enhanced Host Controller #2 (rev 06)
                                  00:1c.0 PCI bridge: Intel Corporation Patsburg PCI Express Root Port 1 (rev b6)
                                  00:1c.7 PCI bridge: Intel Corporation Patsburg PCI Express Root Port 8 (rev b6)
                                  00:1d.0 USB Controller: Intel Corporation Patsburg USB2 Enhanced Host Controller #1 (rev 06)
                                  00:1f.0 ISA bridge: Intel Corporation Patsburg LPC Controller (rev 06)
                                  00:1f.2 SATA controller: Intel Corporation Patsburg 6-Port SATA AHCI Controller (rev 06)
                                  00:1f.3 SMBus: Intel Corporation Patsburg SMBus Controller (rev 06)
                                  00:1f.6 Signal processing controller: Intel Corporation Patsburg Thermal Management Controller (rev 06)
                                  20:00.0 Ethernet controller: Intel Corporation Ethernet Controller 10 Gigabit X540-AT2 (rev 01)
                                  20:00.1 Ethernet controller: Intel Corporation Ethernet Controller 10 Gigabit X540-AT2 (rev 01)
                                  50:00.0 RAID bus controller: LSI Logic / Symbios Logic LSI MegaSAS 9260 (rev 05)
                                  61:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev 02)
                                  62:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 21)
                                  7f:0c.0 System peripheral: Intel Corporation Sandy Bridge Unicast Register 0 (rev 07)
                                  7f:0c.6 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller System Address Decoder 0 (rev 07)
                                  7f:0c.7 System peripheral: Intel Corporation Sandy Bridge System Address Decoder (rev 07)
                                  7f:0d.0 System peripheral: Intel Corporation Sandy Bridge Unicast Register 0 (rev 07)
                                  7f:0d.6 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller System Address Decoder 1 (rev 07)
                                  7f:0e.0 System peripheral: Intel Corporation Sandy Bridge Processor Home Agent (rev 07)
                                  7f:0e.1 Performance counters: Intel Corporation Sandy Bridge Processor Home Agent Performance Monitoring (rev 07)
                                  7f:0f.0 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller Registers (rev 07)
                                  7f:0f.1 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller RAS Registers (rev 07)
                                  7f:0f.2 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller Target Address Decoder 0 (rev 07)
                                  7f:0f.3 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller Target Address Decoder 1 (rev 07)
                                  7f:0f.4 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller Target Address Decoder 2 (rev 07)
                                  7f:0f.5 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller Target Address Decoder 3 (rev 07)
                                  7f:0f.6 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller Target Address Decoder 4 (rev 07)
                                  7f:10.0 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller Channel 0-3 Thermal Control 0 (rev 07)
                                  7f:10.2 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller ERROR Registers 0 (rev 07)
                                  7f:10.3 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller ERROR Registers 1 (rev 07)
                                  7f:10.6 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller ERROR Registers 2 (rev 07)
                                  7f:10.7 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller ERROR Registers 3 (rev 07)
                                  80:00.0 PCI bridge: Intel Corporation Sandy Bridge DMI2 in PCI Express Mode (rev 07)
                                  80:01.0 PCI bridge: Intel Corporation Sandy Bridge IIO PCI Express Root Port 1a (rev 07)
                                  80:03.0 PCI bridge: Intel Corporation Sandy Bridge IIO PCI Express Root Port 3a in PCI Express Mode (rev 07)
                                  80:04.0 System peripheral: Intel Corporation Sandy Bridge DMA Channel 0 (rev 07)
                                  80:04.1 System peripheral: Intel Corporation Sandy Bridge DMA Channel 1 (rev 07)
                                  80:04.2 System peripheral: Intel Corporation Sandy Bridge DMA Channel 2 (rev 07)
                                  80:04.3 System peripheral: Intel Corporation Sandy Bridge DMA Channel 3 (rev 07)
                                  80:04.4 System peripheral: Intel Corporation Sandy Bridge DMA Channel 4 (rev 07)
                                  80:04.5 System peripheral: Intel Corporation Sandy Bridge DMA Channel 5 (rev 07)
                                  80:04.6 System peripheral: Intel Corporation Sandy Bridge DMA Channel 6 (rev 07)
                                  80:04.7 System peripheral: Intel Corporation Sandy Bridge DMA Channel 7 (rev 07)
                                  80:05.0 System peripheral: Intel Corporation Sandy Bridge Address Map, VTd_Misc, System Management (rev 07)
                                  80:05.2 System peripheral: Intel Corporation Sandy Bridge Control Status and Global Errors (rev 07)
                                  80:05.4 PIC: Intel Corporation Sandy Bridge I/O APIC (rev 07)
                                  88:00.0 Ethernet controller: Intel Corporation Ethernet Controller 10 Gigabit X540-AT2 (rev 01)
                                  88:00.1 Ethernet controller: Intel Corporation Ethernet Controller 10 Gigabit X540-AT2 (rev 01)
                                  ff:0c.0 System peripheral: Intel Corporation Sandy Bridge Unicast Register 0 (rev 07)
                                  ff:0c.6 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller System Address Decoder 0 (rev 07)
                                  ff:0c.7 System peripheral: Intel Corporation Sandy Bridge System Address Decoder (rev 07)
                                  ff:0d.0 System peripheral: Intel Corporation Sandy Bridge Unicast Register 0 (rev 07)
                                  ff:0d.6 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller System Address Decoder 1 (rev 07)
                                  ff:0e.0 System peripheral: Intel Corporation Sandy Bridge Processor Home Agent (rev 07)
                                  ff:0e.1 Performance counters: Intel Corporation Sandy Bridge Processor Home Agent Performance Monitoring (rev 07)
                                  ff:0f.0 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller Registers (rev 07)
                                  ff:0f.1 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller RAS Registers (rev 07)
                                  ff:0f.2 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller Target Address Decoder 0 (rev 07)
                                  ff:0f.3 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller Target Address Decoder 1 (rev 07)
                                  ff:0f.4 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller Target Address Decoder 2 (rev 07)
                                  ff:0f.5 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller Target Address Decoder 3 (rev 07)
                                  ff:0f.6 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller Target Address Decoder 4 (rev 07)
                                  ff:10.0 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller Channel 0-3 Thermal Control 0 (rev 07)
                                  ff:10.2 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller ERROR Registers 0 (rev 07)
                                  ff:10.3 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller ERROR Registers 1 (rev 07)
                                  ff:10.6 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller ERROR Registers 2 (rev 07)
                                  ff:10.7 System peripheral: Intel Corporation Sandy Bridge Integrated Memory Controller ERROR Registers 3 (rev 07)
                                  • 14. Re: OVM 3.2.1 doesn't discover local disk
                                    budachst
                                    Afaik, OVM will only recognize local storage if it's present under /dev/mapper, isn't it?
                                    So, you should try to fire up multipathd, which seems not to be running on your host, which is quite strange in the first place since I thought multipath would be on by default on OVM VM servers.
                                    1 2 Previous Next