3 Replies Latest reply: Nov 20, 2012 1:54 PM by Dude! RSS

    OEL 5.5 Lost 2 Hard Drives Now I Receive 2 Couldn't find device with uuid

    user702295-Oracle
      Hello! A team member removed one of the drives from the box without performing LVM commands. The other drive is in the box. Is there a rock solid procedure to fix this error?

      Thanks!
        • 1. Re: OEL 5.5 Lost 2 Hard Drives Now I Receive 2 Couldn't find device with uuid
          Dude!
          We cannot guess your LVM configuration. If you receive any error, please provide it. Generally, when you use LVM to mirror a volume (LV), and one of leg fails, LVM converts the mirror into a single linear volume. If it is not a mirror, the LVM cannot start the volume and it will fail. In any case, you should start with putting the drive back in and unless it's hot-plug media, shutdown the server, put the drives back in, restart the server.

          To rebuild the mirrored volume, see the documentation, which provides examples and explains it quite well:
          https://linux.oracle.com/documentation/OL5/Red_Hat_Enterprise_Linux-5-Logical_Volume_Manager_Administration-en-US.pdf
          • 2. Re: OEL 5.5 Lost 2 Hard Drives Now I Receive 2 Couldn't find device with uuid
            user702295-Oracle
            Thanks for replying. I have reviewed the manual previous. I am attaching:

            pvdisplay -v
            pvscan
            the latest known config
            fdisk -l
            fdisk -l -u /dev/sdc (which is the volume I am trying to add)
            fstab


            When I issue pvcreate, I receive this:

            [root@ptolemy lvm]# pvcreate /dev/sdc
            Couldn't find device with uuid 'FUf58F-aclv-ryIv-Pf2O-75D2-VJFN-FBEL3J'.
            Couldn't find device with uuid 'Xj0Nfc-AzUI-LlW3-36Wf-tWjs-31Yd-Iv4glm'.
            Device /dev/sdc not found (or ignored by filtering).

            When I receive the drive, I will put it back in. In this case can I use pvcreate with restorefile?

            Regards!

            I do not see a link to upload. Please find below:

            [root@ptolemy dbs]# pvdisplay -v
            Scanning for physical volume names
            Wiping cache of LVM-capable devices
            Couldn't find device with uuid 'FUf58F-aclv-ryIv-Pf2O-75D2-VJFN-FBEL3J'.
            Couldn't find device with uuid 'Xj0Nfc-AzUI-LlW3-36Wf-tWjs-31Yd-Iv4glm'.
            There are 2 physical volumes missing.
            Couldn't find device with uuid 'FUf58F-aclv-ryIv-Pf2O-75D2-VJFN-FBEL3J'.
            Couldn't find device with uuid 'Xj0Nfc-AzUI-LlW3-36Wf-tWjs-31Yd-Iv4glm'.
            There are 2 physical volumes missing.
            --- Physical volume ---
            PV Name unknown device
            VG Name VolGroup00
            PV Size 465.66 GB / not usable 3.56 MB
            Allocatable yes (but full)
            PE Size (KByte) 32768
            Total PE 14901
            Free PE 0
            Allocated PE 14901
            PV UUID FUf58F-aclv-ryIv-Pf2O-75D2-VJFN-FBEL3J

            Couldn't find device with uuid 'FUf58F-aclv-ryIv-Pf2O-75D2-VJFN-FBEL3J'.
            Couldn't find device with uuid 'Xj0Nfc-AzUI-LlW3-36Wf-tWjs-31Yd-Iv4glm'.
            There are 2 physical volumes missing.
            --- Physical volume ---
            PV Name /dev/sdb
            VG Name VolGroup00
            PV Size 931.51 GB / not usable 13.71 MB
            Allocatable yes (but full)
            PE Size (KByte) 32768
            Total PE 29808
            Free PE 0
            Allocated PE 29808
            PV UUID jl5vjP-ApeL-KtCO-Gl7K-0rl8-LWtJ-qPSLuG

            Couldn't find device with uuid 'FUf58F-aclv-ryIv-Pf2O-75D2-VJFN-FBEL3J'.
            Couldn't find device with uuid 'Xj0Nfc-AzUI-LlW3-36Wf-tWjs-31Yd-Iv4glm'.
            There are 2 physical volumes missing.
            --- Physical volume ---
            PV Name unknown device
            VG Name VolGroup00
            PV Size 465.66 GB / not usable 3.56 MB
            Allocatable yes (but full)
            PE Size (KByte) 32768
            Total PE 14901
            Free PE 0
            Allocated PE 14901
            PV UUID FUf58F-aclv-ryIv-Pf2O-75D2-VJFN-FBEL3J

            --- Physical volume ---
            PV Name /dev/sda2
            VG Name VolGroup01
            PV Size 465.66 GB / not usable 3.56 MB
            Allocatable yes (but full)
            PE Size (KByte) 32768
            Total PE 14901
            Free PE 0
            Allocated PE 14901
            PV UUID A9IEub-edqB-vTe5-PA60-Mx3h-ZHMg-o0sKcE





            [root@ptolemy dbs]# pvscan
            Couldn't find device with uuid 'FUf58F-aclv-ryIv-Pf2O-75D2-VJFN-FBEL3J'.
            Couldn't find device with uuid 'Xj0Nfc-AzUI-LlW3-36Wf-tWjs-31Yd-Iv4glm'.
            PV unknown device VG VolGroup00 lvm2 [465.66 GB / 0 free]
            PV /dev/sdb VG VolGroup00 lvm2 [931.50 GB / 0 free]
            PV unknown device VG VolGroup00 lvm2 [1.82 TB / 0 free]
            PV /dev/sda2 VG VolGroup01 lvm2 [465.66 GB / 0 free]
            Total: 4 [3.64 TB] / in use: 4 [3.64 TB] / in no VG: 0 [0 ]



            [root@ptolemy archive]# ls -ail
            total 36
            95683085 drwx------ 2 root root 4096 Nov 19 13:31 .
            95682562 drwxr-xr-x 5 root root 4096 Oct 7 22:45 ..
            95684520 -rw-r--r-- 1 root root 2981 Nov 19 13:18 jjg
            95682569 -rw------- 1 root root 2952 Jul 26 2011 VolGroup00_00000.vg
            95683088 -rw------- 1 root root 2981 Oct 7 23:57 VolGroup00_00001.vg
            95683911 -rw------- 1 root root 1527 Jul 26 2011 VolGroup01_00000.vg



            [root@ptolemy archive]# cat VolGroup00_00001.vg

            # Generated by LVM2 version 2.02.56(1)-RHEL5 (2010-02-08): Sun Oct 7 23:57:21 2012

            contents = "Text Format Volume Group"
            version = 1

            description = "Created *before* executing 'vgreduce --removemissing VolGroup00'"

            creation_host = "ptolemy.us.oracle.com" # Linux ptolemy.us.oracle.com 2.6.18-194.el5 #1 SMP Mon Mar 29 22:10:29 EDT 2010 x86_64
            creation_time = 1349675841 # Sun Oct 7 23:57:21 2012

            VolGroup00 {
            id = "WVKuLd-ssxO-knGY-JhzT-mvne-6ewp-OCcIUt"
            seqno = 11
            status = ["RESIZEABLE", "READ", "WRITE"]
            flags = []
            extent_size = 65536 # 32 Megabytes
            max_lv = 0
            max_pv = 0

            physical_volumes {
            pv0 {
            id = "FUf58F-aclv-ryIv-Pf2O-75D2-VJFN-FBEL3J"
            device = "unknown device" # Hint only

            status = ["ALLOCATABLE"]
            flags = ["MISSING"]
            dev_size = 976559220 # 465.66 Gigabytes
            pe_start = 384
            pe_count = 14901 # 465.656 Gigabytes
            }

            pv1 {
            id = "jl5vjP-ApeL-KtCO-Gl7K-0rl8-LWtJ-qPSLuG"
            device = "/dev/sdb" # Hint only

            status = ["ALLOCATABLE"]
            flags = []
            dev_size = 1953525168 # 931.513 Gigabytes
            pe_start = 384
            pe_count = 29808 # 931.5 Gigabytes
            }
            pv2 {
            id = "Xj0Nfc-AzUI-LlW3-36Wf-tWjs-31Yd-Iv4glm"
            device = "unknown device" # Hint only

            status = ["ALLOCATABLE"]
            flags = ["MISSING"]
            dev_size = 3907029167 # 1.81935 Terabytes
            pe_start = 384
            pe_count = 59616 # 1.81934 Terabytes
            }
            }

            logical_volumes {

            LogVol00 {
            id = "bRJNe2-0cc9-Q6HW-a14J-xROL-Xltk-rV4MHp"
            status = ["READ", "WRITE", "VISIBLE"]
            flags = []
            segment_count = 1

            segment1 {
            start_extent = 0

            extent_count = 938 # 29.3125 Gigabytes

            type = "striped"
            stripe_count = 1 # linear

            stripes = [
            "pv0", 0
            ]
            }
            }

            LogVol03 {
            id = "Ym6vUS-KW48-PH9E-MLns-KgzY-1I1r-pdJs04"
            status = ["READ", "WRITE", "VISIBLE"]
            flags = []
            segment_count = 1

            segment1 {
            start_extent = 0
            extent_count = 13688 # 427.75 Gigabytes

            type = "striped"
            stripe_count = 1 # linear

            stripes = [
            "pv0", 938
            ]
            }
            }

            LogVol01 {
            id = "vfpPS6-o4hG-Ebf3-vBnl-81X8-Ud1n-YBjSlr"
            status = ["READ", "WRITE", "VISIBLE"]
            flags = []
            segment_count = 1

            segment1 {
            start_extent = 0
            extent_count = 275 # 8.59375 Gigabytes

            type = "striped"
            stripe_count = 1 # linear

            stripes = [

            "pv0", 14626
            ]
            }
            }

            LogVol04 {
            id = "QAys44-Cz3k-Kbez-s6yV-4aZI-2DMo-QtCyTj"
            status = ["READ", "WRITE", "VISIBLE"]
            flags = []
            segment_count = 1

            segment1 {
            start_extent = 0
            extent_count = 29808 # 931.5 Gigabytes

            type = "striped"
            stripe_count = 1 # linear

            stripes = [
            "pv1", 0
            ]
            }
            }

            LogVol05 {
            id = "P4r1lc-1Z8y-lDbM-eojg-uH0B-C3Mf-fmS2L1"
            status = ["READ", "WRITE", "VISIBLE"]
            flags = []
            segment_count = 1

            segment1 {
            start_extent = 0
            extent_count = 59616 # 1.81934 Terabytes

            type = "striped"
            stripe_count = 1 # linear

            stripes = [
            "pv2", 0
            ]
            }
            }
            }
            }



            [root@ptolemy archive]# fdisk -l

            Disk /dev/sda: 500.1 GB, 500107862016 bytes
            255 heads, 63 sectors/track, 60801 cylinders
            Units = cylinders of 16065 * 512 = 8225280 bytes

            Device Boot Start End Blocks Id System
            /dev/sda1 * 1 13 104391 83 Linux
            /dev/sda2 14 60801 488279610 8e Linux LVM

            Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes
            255 heads, 63 sectors/track, 121601 cylinders
            Units = cylinders of 16065 * 512 = 8225280 bytes

            Disk /dev/sdb doesn't contain a valid partition table

            Disk /dev/sdc: 2000.4 GB, 2000409722880 bytes
            255 heads, 63 sectors/track, 243202 cylinders
            Units = cylinders of 16065 * 512 = 8225280 bytes

            Device Boot Start End Blocks Id System
            /dev/sdc1 1 243202 1953520033+ 83 Linux



            [root@ptolemy archive]# fdisk -l -u /dev/sdc

            Disk /dev/sdc: 2000.4 GB, 2000409722880 bytes
            255 heads, 63 sectors/track, 243202 cylinders, total 3907050240 sectors
            Units = sectors of 1 * 512 = 512 bytes

            Device Boot Start End Blocks Id System
            /dev/sdc1 63 3907040129 1953520033+ 83 Linux
            [root@ptolemy archive]#





            [root@ptolemy etc]# cat fstab
            /dev/VolGroup01/LogVol00 / ext3 defaults 1 1
            LABEL=/boot /boot ext3 defaults 1 2
            tmpfs /dev/shm tmpfs defaults 0 0
            devpts /dev/pts devpts gid=5,mode=620 0 0
            sysfs /sys sysfs defaults 0 0
            proc /proc proc defaults 0 0
            /dev/VolGroup01/LogVol01 swap swap defaults 0 0
            /dev/VolGroup00/LogVol04 /u01 ext3 defaults 1 1
            ##/dev/VolGroup00/LogVol03 /u02 ext3 defaults 1 1
            ##/dev/VolGroup00/LogVol05 /u03 ext3 defaults 1 1

            Edited by: user702295 on Nov 20, 2012 6:49 AM
            • 3. Re: OEL 5.5 Lost 2 Hard Drives Now I Receive 2 Couldn't find device with uuid
              Dude!
              I can't really get a clear view of your configuration from your output. What the following show you:

              <pre>
              lvs -a -o +devices
              pvs -v
              </pre>
              Couldn't find device with uuid 'FUf58F-aclv-ryIv-Pf2O-75D2-VJFN-FBEL3J'.
              Couldn't find device with uuid 'Xj0Nfc-AzUI-LlW3-36Wf-tWjs-31Yd-Iv4glm'.
              There are 2 physical volumes missing.
              The error message means that the 2 drives you put do not match the expected LVM configuration. Are these the same drives? Have they been erased or put them back in wrong order?

              If the drives are new I suggest to create the same partitions as the drives that are missing and add the partitions back setting the UUID of the existing LVM setup. For instance: pvcreate -UUID xxxxxxxxxxxxxxxxx /dev/sdc2

              If the missing drives were LVM mirrored drives then the mirror will rebuild, otherwise linear volumes will be lost and you need to restore from backup.