7 Replies Latest reply: Nov 5, 2012 8:23 AM by Isti RSS

    Oracle Server 3.1.1 don't see local HDDs. How to diagnose?

    YuryVelikanov
      Hello Oracle VM Gurus and geeks,

      We are in the middle of implementing our sandbox for Oracle VM research and training purposes (support Oracle VM in prod later on).
      We have installed Oracle VM 3.1.1 server and Manager. However hit a roadblock on the implementation highway.

      We have 3 local HDD we have planned to use for Storage (1x170GB, 2x2TB). The problem is that no HDDs reflected under "Unassigned Server" => "Server name" => "Physical Disks". We kind of stack and can't move forward. Please Please Please help me to troubleshoot it.

      Some details:
      -- All 3 disks available under /dev/sd_ (sda,sdb,sdc).
      -- The dom0 is installed under "sdc" (it could be the root cause of our problem). The reason for that was the fact that the smallest HDD (170GB) was reflected as /dev/sdc

      I tried to use "Rescan Physical Disks" button and look for any log files updated by result of the operation. Unfortunately didn't find any footprint.
      Is there anyway I can switch any debug options to get a bit more information on how Oracle VM discovers local HDDs?

      Thank you in advance for any input and time you have spent reading this message :)

      Yury
        • 1. Re: Oracle Server 3.1.1 don't see local HDDs. How to diagnose?
          Avi Miller-Oracle
          YuryVelikanov wrote:
          Some details:
          -- All 3 disks available under /dev/sd_ (sda,sdb,sdc).
          -- The dom0 is installed under "sdc" (it could be the root cause of our problem). The reason for that was the fact that the smallest HDD (170GB) was reflected as /dev/sdc
          Check if device-mapper-multipath is running (multipathd) and the devices are created in /dev/mapper for your local disks. Make sure there are no partitions on the unused disks and that multipath is not blacklisting them for some reason. The ovs-agent and UI will only discover disks that have no partitions and are seen by dm-multipath.
          • 2. Re: Oracle Server 3.1.1 don't see local HDDs. How to diagnose?
            YuryVelikanov
            THX For prompt response. Checking now.
            Forgot to mention that there are no partitions on sda and sdb.

            As always you are super duper awesome Avi :)
            THX Again for your support.
            • 3. Re: Oracle Server 3.1.1 don't see local HDDs. How to diagnose?
              YuryVelikanov
              Solved in no time! MEGA THX!

              [root@team5lab ~]# service multipathd start
              Starting multipathd daemon: [  OK  ]
              [root@team5lab ~]# ls -l /dev/mapper
              total 0
              brw-rw---- 1 root disk 252, 0 Oct 11 15:30 36d4ae5208bfc2900173116a40a49ba26
              brw-rw---- 1 root disk 252, 1 Oct 11 15:30 36d4ae5208bfc2900173116a50a5695a2
              crw------- 1 root root 10, 236 Oct 10 13:13 control
              [root@team5lab ~]#
              • 4. Re: Oracle Server 3.1.1 don't see local HDDs. How to diagnose?
                Avi Miller-Oracle
                YuryVelikanov wrote:
                [root@team5lab ~]# service multipathd start
                Don't forget to also do:
                 # chkconfig multipathd on 
                So that it starts automatically on reboot.
                • 5. Re: Oracle Server 3.1.1 don't see local HDDs. How to diagnose?
                  YuryVelikanov
                  For one reason or another multipath was off for the system.
                  I wonder why :) ?

                  [root@team5lab ~]# chkconfig --list multipathd
                  multipathd 0:off 1:off 2:off 3:off 4:off 5:off 6:off
                  [root@team5lab ~]# chkconfig multipathd on
                  [root@team5lab ~]# chkconfig --list multipathd
                  multipathd 0:off 1:off 2:on 3:on 4:on 5:on 6:off
                  [root@team5lab ~]#

                  All good now.
                  • 6. Re: Oracle Server 3.1.1 don't see local HDDs. How to diagnose?
                    Isti
                    Hi,
                    This is my first OVM install so more things area unclear, than are clear.
                    When I'm trying to create a repository based on a physical disk, no device is found. I tried rescanning the server but still no device.

                    Here are some outputs from my OVM Server:

                    [root@ovs-94-b2-d4 OVS]# fdisk -l

                    Disk /dev/sda: 53.6 GB, 53687091200 bytes
                    255 heads, 63 sectors/track, 6527 cylinders
                    Units = cylinders of 16065 * 512 = 8225280 bytes

                    Device Boot Start End Blocks Id System
                    /dev/sda1 * 1 13 104391 83 Linux
                    /dev/sda2 14 1058 8393962+ 82 Linux swap / Solaris
                    /dev/sda3 1059 1450 3148740 83 Linux
                    /dev/sda4 1451 6527 40781002+ 5 Extended
                    /dev/sda5 1451 6527 40780971 83 Linux

                    Disk /dev/sdb: 168.1 GB, 17179869184 bytes
                    255 heads, 63 sectors/track, 2088 cylinders
                    Units = cylinders of 16065 * 512 = 8225280 bytes

                    Device Boot Start End Blocks Id System

                    [root@ovs-94-b2-d4 OVS]# ls -l /dev/mapper
                    total 0
                    crw------- 1 root root 10, 236 Nov 4 16:09 control

                    [root@ovs-94-b2-d4 OVS]# service multipathd status
                    multipathd (pid  2225) is running...

                    [root@ovs-94-b2-d4 OVS]# multipath -ll
                    Nov 04 17:17:39 | DM multipath kernel driver not loaded

                    [root@ovs-94-b2-d4 OVS]# storage_discover --infoDumpType=disk_XML
                    <SCSI>
                    </SCSI>
                    <DiskScanIssues>
                    <Errors Num="0"><![CDATA[
                    ]]></Errors>
                    <Warnings Num="0"><![CDATA[
                    ]]></Warnings>
                    </DiskScanIssues>

                    I presume the "DM multipath kernel driver not loaded" is the cause of my issue, but don't know how to solve it. Could you please help?
                    • 7. Re: Oracle Server 3.1.1 don't see local HDDs. How to diagnose?
                      Isti
                      I omitted to mention that my OVM environment was a test on top of a VMWare one, and http://www.dizwell.com/2011/05/21/the-case-of-vmware-and-the-missing-scsi-id/ solved my issue (Thank you Sören).