9 Replies Latest reply: Feb 21, 2012 4:14 AM by nicco RSS

    boot-device to boot to d20

    nicco
      Hi,

      how should I set eeprom to be able to boot to dettached mirrored disk d20?
      Right now I have:

      boot-device=mirror /pci@400/pci@1/pci@0/pci@4/scsi@0/disk@w5000c5003a00ab19,0:a /pci@400/pci@2/pci@0/pci@4/scsi@0/disk@w5000c5003a00ab19,0:a disk ne

      And mirror is:

      $ metastat d0
      Submirror 0: d10
      Submirror 1: d20

      d10: Submirror of d0
      /dev/dsk/c0t5000C5003A00AB1Bd0s0

      d20: Submirror of d0
      /dev/dsk/c0t5000C5003A1FDA4Bd0s0

      $ ls -al /dev/dsk/c0t5000C5003A00AB1Bd0s0
      lrwxrwxrwx 1 root root 48 Oct 24 21:32 /dev/dsk/c0t5000C5003A00AB1Bd0s0 -> ../../devices/scsi_vhci/disk@g5000c5003a00ab1b:a

      $ ls -al /dev/dsk/c0t5000C5003A1FDA4Bd0s0
      lrwxrwxrwx 1 root root 48 Oct 24 21:32 /dev/dsk/c0t5000C5003A1FDA4Bd0s0 -> ../../devices/scsi_vhci/disk@g5000c5003a1fda4b:a

      I want to detach d20 from d0 and boot into d20.
      Thank you
        • 1. Re: boot-device to boot to d20
          Soory
          This is from my host system, change the entries accordingly, according to your requirement.

          eeprom use-nvramrc?=true
          eeprom nvramrc="devalias disk /pci@400/pci@2/pci@0/pci@4/scsi@0/disk@w5000cca012c552a1,0:a
          devalias root_backup /pci@400/pci@1/pci@0/pci@4/scsi@0/disk@w5000cca012c7ef8d,0:a
          devalias net /pci@400/pci@2/pci@0/pci@6/network@0"

          with the above eeprom setting from PROM you boot by 'boot mirror'
          • 2. Re: boot-device to boot to d20
            nicco
            Thank you for your response Soorya,

            but I'm not sure what should I use.
            I don't know whether this is correct in my eeprom:

            disk@w5000c5003a00ab *19,0:a*

            because I don't know where it is coming from as here I don't have 19,0:a but 1b:a

            $ ls -al /dev/dsk/c0t5000C5003A00AB1Bd0s0
            lrwxrwxrwx 1 root root 48 Oct 24 21:32 /dev/dsk/c0t5000C5003A00AB *1Bd0s0* -> ../../devices/scsi_vhci/disk@g5000c5003a00ab *1b:a*
            • 3. Re: boot-device to boot to d20
              Soory
              I used get it from OK prom using probe-scsi-all and check for the disks. In your case, if w5000c5003a00ab is shown in format, then it may be disk@w5000c5003a00ac, you can only confirm it from probe-scsi-all and you have to select the correct SCSI targets.

              c0t5000CCA012C552A0d0 --> this i will get it from format output
              disk@w5000cca012c552a1 --> this no. i get it from probe-scsi-all

              so the last no. should be +1 from the format output.

              What is your hardware?

              Edited by: Soorya on Feb 14, 2012 8:16 AM
              • 4. SPARC T3-1 SAS multipathing and boot-device
                nicco
                My HW is SPARC T3-1 and I can't use console access to prom so I must set everything from OS via eeprom.
                I'm getting closer. This seems to be multipathing with SAS disk drives and mpt_sas scsi controler.
                The 2 disk paths in my boot-device parameter are pointing to scsi channel 6 and 14 on two separate controllers for redundancy.
                I sill don't fully understand this concept and whether is possible to boot into d20:



                disk, instance #6
                Driver properties:
                name='ddi-no-autodetach' type=int items=1 dev=none
                value=00000001
                name='inquiry-serial-no' type=string items=1 dev=none
                value='00111673NHGJ 6SE3NHGJ'
                name='pm-components' type=string items=3 dev=none
                value='NAME=spindle-motor' + '0=off' + '1=on'
                name='pm-hardware-state' type=string items=1 dev=none
                value='needs-suspend-resume'
                name='ddi-failfast-supported' type=boolean dev=none
                name='ddi-kernel-ioctl' type=boolean dev=none
                name='device-nblocks' type=int64 items=1 dev=none
                value=0000000022ecb25c
                Hardware properties:
                name='devid' type=string items=1
                value='id1,sd@n5000c5003a00ab1b'
                name='class' type=string items=1
                value='scsi'
                name='inquiry-revision-id' type=string items=1
                value='0B70'
                name='inquiry-product-id' type=string items=1
                value='ST930003SSUN300G'
                name='inquiry-vendor-id' type=string items=1
                value='SEAGATE'
                name='inquiry-device-type' type=int items=1
                value=00000000
                name='compatible' type=string items=4
                value='scsiclass,00.vSEAGATE.pST930003SSUN300G.r0B70' + 'scsiclass,00.vSEAGATE.pST930003SSUN300G' + 'scsiclass,00' + 'scsiclass'
                name='client-guid' type=string items=1
                value='5000c5003a00ab1b'


                Paths from multipath bus adapters:


                Path 6: /pci@400/pci@1/pci@0/pci@4/scsi@0/iport@f/disk@w5000c5003a00ab19,0
                mpt_sas#5 (online)
                name='wwn' type=string items=1
                value='5000c5003a00ab1b' <--------------------
                name='lun' type=int items=1
                value=00000000
                name='target-port' type=string items=1
                value='5000c5003a00ab19' <--------------------
                name='obp-path' type=string items=1
                value='/pci@400/pci@1/pci@0/pci@4/scsi@0/disk@w5000c5003a00ab19,0'
                name='phy-num' type=int items=1
                value=00000001
                name='path-class' type=string items=1
                value='primary'



                Path 14: /pci@400/pci@2/pci@0/pci@4/scsi@0/iport@f/disk@w5000c5003a00ab19,0
                mpt_sas#2 (online)
                name='wwn' type=string items=1
                value='5000c5003a00ab1b'
                name='lun' type=int items=1
                value=00000000
                name='target-port' type=string items=1
                value='5000c5003a00ab19'
                name='obp-path' type=string items=1
                value='/pci@400/pci@2/pci@0/pci@4/scsi@0/disk@w5000c5003a00ab19,0'
                name='phy-num' type=int items=1
                value=00000001
                name='path-class' type=string items=1
                value='primary'





                Device Minor Nodes:
                dev=(32,48)
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:a
                spectype=blk type=minor
                dev_link=/dev/dsk/c0t5000C5003A00AB1Bd0s0
                dev_link=/dev/sd6a
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:a,raw
                spectype=chr type=minor
                dev_link=/dev/rdsk/c0t5000C5003A00AB1Bd0s0
                dev_link=/dev/rsd6a
                dev=(32,49)
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:b
                spectype=blk type=minor
                dev_link=/dev/dsk/c0t5000C5003A00AB1Bd0s1
                dev_link=/dev/sd6b
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:b,raw
                spectype=chr type=minor
                dev_link=/dev/rdsk/c0t5000C5003A00AB1Bd0s1
                dev_link=/dev/rsd6b
                dev=(32,50)
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:c
                spectype=blk type=minor
                dev_link=/dev/dsk/c0t5000C5003A00AB1Bd0s2
                dev_link=/dev/sd6c
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:c,raw
                spectype=chr type=minor
                dev_link=/dev/rdsk/c0t5000C5003A00AB1Bd0s2
                dev_link=/dev/rsd6c
                dev=(32,51)
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:d
                spectype=blk type=minor
                dev_link=/dev/dsk/c0t5000C5003A00AB1Bd0s3
                dev_link=/dev/sd6d
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:d,raw
                spectype=chr type=minor
                dev_link=/dev/rdsk/c0t5000C5003A00AB1Bd0s3
                dev_link=/dev/rsd6d
                dev=(32,52)
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:e
                spectype=blk type=minor
                dev_link=/dev/dsk/c0t5000C5003A00AB1Bd0s4
                dev_link=/dev/sd6e
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:e,raw
                spectype=chr type=minor
                dev_link=/dev/rdsk/c0t5000C5003A00AB1Bd0s4
                dev_link=/dev/rsd6e
                dev=(32,53)
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:f
                spectype=blk type=minor
                dev_link=/dev/dsk/c0t5000C5003A00AB1Bd0s5
                dev_link=/dev/sd6f
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:f,raw
                spectype=chr type=minor
                dev_link=/dev/rdsk/c0t5000C5003A00AB1Bd0s5
                dev_link=/dev/rsd6f
                dev=(32,54)
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:g
                spectype=blk type=minor
                dev_link=/dev/dsk/c0t5000C5003A00AB1Bd0s6
                dev_link=/dev/sd6g
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:g,raw
                spectype=chr type=minor
                dev_link=/dev/rdsk/c0t5000C5003A00AB1Bd0s6
                dev_link=/dev/rsd6g
                dev=(32,55)
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:h
                spectype=blk type=minor
                dev_link=/dev/dsk/c0t5000C5003A00AB1Bd0s7
                dev_link=/dev/sd6h
                dev_path=/scsi_vhci/disk@g5000c5003a00ab1b:h,raw
                spectype=chr type=minor
                dev_link=/dev/rdsk/c0t5000C5003A00AB1Bd0s7
                dev_link=/dev/rsd6h
                • 5. Re: SPARC T3-1 SAS multipathing and boot-device
                  mbrown_ofi
                  mpathadm should give you the information you need. I have a similar T3-1 that looks like this:

                  root@dptshost2 /root: mpathadm list lu
                  /dev/rdsk/c0t5000C5003343A5A3d0s2
                  Total Path Count: 1
                  Operational Path Count: 1
                  /dev/rdsk/c0t5000C5003346EC6Bd0s2
                  Total Path Count: 1
                  Operational Path Count: 1

                  root@dptshost2 /root: mpathadm show lu /dev/rdsk/c0t5000C5003343A5A3d0s2
                  Logical Unit: /dev/rdsk/c0t5000C5003343A5A3d0s2
                  mpath-support: libmpscsi_vhci.so
                  Vendor: SEAGATE
                  Product: ST930003SSUN300G
                  Revision: 0B70
                  Name Type: unknown type
                  Name: 5000c5003343a5a3
                  Asymmetric: no
                  Current Load Balance: round-robin
                  Logical Unit Group ID: NA
                  Auto Failback: on
                  Auto Probing: NA

                  Paths:
                  Initiator Port Name: 5080020000f69e91
                  Target Port Name: 5000c5003343a5a1
                  Override Path: NA
                  Path State: OK
                  Disabled: no

                  Target Ports:
                  Name: *5000c5003343a5a1* Relative ID: 0

                  root@dptshost2 /root: mpathadm show lu /dev/rdsk/c0t5000C5003346EC6Bd0s2
                  Logical Unit: /dev/rdsk/c0t5000C5003346EC6Bd0s2
                  mpath-support: libmpscsi_vhci.so
                  Vendor: SEAGATE
                  Product: ST930003SSUN300G
                  Revision: 0B70
                  Name Type: unknown type
                  Name: 5000c5003346ec6b
                  Asymmetric: no
                  Current Load Balance: round-robin
                  Logical Unit Group ID: NA
                  Auto Failback: on
                  Auto Probing: NA

                  Paths:
                  Initiator Port Name: 5080020000f69e90
                  Target Port Name: 5000c5003346ec69
                  Override Path: NA
                  Path State: OK
                  Disabled: no

                  Target Ports:
                  Name: 5000c5003346ec69
                  Relative ID: 0

                  root@dptshost2 /root: eeprom boot-device
                  boot-device=/pci@400/pci@2/pci@0/pci@4/scsi@0/disk@w5000c5003343a5a1,0:a

                  Note that the Target Port matches the WWN in the boot-device definition. So to boot from the mirror disk, I would use:

                  boot-device=/pci@400/pci@2/pci@0/pci@4/scsi@0/disk@w5000c5003346ec69,0:a

                  Edited by: user10935347 on Feb 15, 2012 7:49 AM
                  • 6. Re: SPARC T3-1 SAS multipathing and boot-device
                    nicco
                    In my case I've got 9 drives from mpathadm.
                    The /dev/rdsk/c0t5000C5003A000F97d0s2 is the one which is already present in boot-device, but which one from those 8 remaining is the mirror drive?

                    bash-3.00# mpathadm list lu
                    /dev/rdsk/c0t5000C5003A1F6233d0s2
                    Total Path Count: 2
                    Operational Path Count: 2
                    /dev/rdsk/c0t5000C5003A21BDE3d0s2
                    Total Path Count: 2
                    Operational Path Count: 2
                    /dev/rdsk/c0t5000C5003A000F97d0s2
                    Total Path Count: 2
                    Operational Path Count: 2
                    /dev/rdsk/c0t5000C5003A2141FBd0s2
                    Total Path Count: 2
                    Operational Path Count: 2
                    /dev/rdsk/c0t5000C5003A21885Bd0s2
                    Total Path Count: 2
                    Operational Path Count: 2
                    /dev/rdsk/c0t5000C5003A21AF8Bd0s2
                    Total Path Count: 2
                    Operational Path Count: 2
                    /dev/rdsk/c0t5000C5003A20834Fd0s2
                    Total Path Count: 2
                    Operational Path Count: 2
                    /dev/rdsk/c0t5000C5003A180DDFd0s2
                    Total Path Count: 2
                    Operational Path Count: 2
                    bash-3.00#
                    • 7. Re: SPARC T3-1 SAS multipathing and boot-device
                      Soory
                      Show your metastat -p output.
                      • 8. Re: SPARC T3-1 SAS multipathing and boot-device
                        nicco
                        Here you go:

                        # metastat -p
                        d7 -m d17 d27 1
                        d17 1 1 /dev/dsk/c0t5000C5003A000F97d0s7
                        d27 1 1 /dev/dsk/c0t5000C5003A1F6233d0s7
                        d6 -m d16 d26 1
                        d16 1 1 /dev/dsk/c0t5000C5003A000F97d0s6
                        d26 1 1 /dev/dsk/c0t5000C5003A1F6233d0s6
                        d5 -m d15 d25 1
                        d15 1 1 /dev/dsk/c0t5000C5003A000F97d0s5
                        d25 1 1 /dev/dsk/c0t5000C5003A1F6233d0s5
                        d3 -m d13 1
                        d13 1 1 /dev/dsk/c0t5000C5003A000F97d0s3
                        d1 -m d11 d21 1
                        d11 1 1 /dev/dsk/c0t5000C5003A000F97d0s1
                        d21 1 1 /dev/dsk/c0t5000C5003A1F6233d0s1
                        d0 -m d10 1
                        d10 1 1 /dev/dsk/c0t5000C5003A000F97d0s0
                        d23 1 1 /dev/dsk/c0t5000C5003A1F6233d0s3
                        d20 1 1 /dev/dsk/c0t5000C5003A1F6233d0s0
                        #



                        # metastat d20
                        d20: Concat/Stripe
                        Size: 83887500 blocks (40 GB)
                        Stripe 0:
                        Device Start Block Dbase Reloc
                        /dev/dsk/c0t5000C5003A1F6233d0s0 0 No Yes

                        Device Relocation Information:
                        Device Reloc Device ID
                        /dev/dsk/c0t5000C5003A1F6233d0 Yes id1,sd@n5000c5003a1f6233
                        #
                        #
                        # metastat d10
                        d10: Concat/Stripe
                        Size: 83887500 blocks (40 GB)
                        Stripe 0:
                        Device Start Block Dbase State Reloc Hot Spare
                        /dev/dsk/c0t5000C5003A000F97d0s0 0 No Okay Yes

                        Device Relocation Information:
                        Device Reloc Device ID
                        /dev/dsk/c0t5000C5003A000F97d0 Yes id1,sd@n5000c5003a000f97
                        #




                        I used this drive
                        /dev/rdsk/c0t5000C5003A1F6233d0s2 (because it seems to be d20 if look above into metastat d20)
                        according mbrown_ofi's advice


                        # mpathadm show lu /dev/rdsk/c0t5000C5003A1F6233d0s2
                        Logical Unit: /dev/rdsk/c0t5000C5003A1F6233d0s2
                        mpath-support: libmpscsi_vhci.so
                        Vendor: SEAGATE
                        Product: ST930003SSUN300G
                        Revision: 0B70
                        Name Type: unknown type
                        Name: 5000c5003a1f6233
                        Asymmetric: no
                        Current Load Balance: round-robin
                        Logical Unit Group ID: NA
                        Auto Failback: on
                        Auto Probing: NA

                        Paths:
                        Initiator Port Name: 5080020000fa5cb1
                        Target Port Name: 5000c5003a1f6231
                        Override Path: NA
                        Path State: OK
                        Disabled: no

                        Initiator Port Name: 5080020000fa5cb0
                        Target Port Name: 5000c5003a1f6231
                        Override Path: NA
                        Path State: OK
                        Disabled: no

                        Target Ports:
                        Name: *5000c5003a1f6231*
                        Relative ID: 0
                        #


                        After restart system was waiting for fsck and after that it booted-up into maintenance mode:

                        # mount
                        / on /pseudo/md@0:0,0,blk read/write/setuid/devices/rstchown/dev=1540000 on Thu Jan 1 00:00:00 1970
                        ...
                        • 9. Re: SPARC T3-1 SAS multipathing and boot-device
                          nicco
                          The above steps are correct. You just need to change /etc/vfstab and /etc/system to start it up from mirrored drive.
                          Thanks to all for help!