8 Replies Latest reply on Jan 31, 2014 4:21 PM by Cindys-Oracle

    zfs boot issues




      I've got next issues: when I try to boot my server I'm getting following message:


      Executing last command: boot disk11
      Boot device: /pci@8f,2000/scsi@1/disk@1,0  File and args: 
      SunOS Release 5.10 Version Generic_147440-26 64-bit
      Copyright (c) 1983, 2012, Oracle and/or its affiliates. All rights reserved.
      NOTICE: Can not read the pool label from '/pci@8f,2000/scsi@1/disk@1,0:a'
      NOTICE: spa_import_rootpool: error 5
      Cannot mount root on /pci@8f,2000/scsi@1/disk@1,0:a fstype zfs
      panic[cpu0]/thread=1810000: vfs_mountroot: cannot mount root
      000000000180d950 genunix:vfs_mountroot+370 (1898400, 18c2000, 0, 1295400, 1299000, 1)
        %l0-3: 00000300038a6008 000000000188f9e8 000000000113a400 00000000018f8c00
        %l4-7: 0000000000000600 0000000000000200 0000000000000800 0000000000000200
      000000000180da10 genunix:main+120 (189c400, 18eb000, 184ee40, 0, 1, 18f5800)
        %l0-3: 0000000000000001 0000000070002000 0000000070002000 0000000000000000
        %l4-7: 0000000000000000 000000000181d400 000000000181d6a8 0000000001297c00
      skipping system dump - no dump device configured
      Resetting ...

      I'm able to boot server in failsafe mode and successfuly import zfs-pool. The pool is fine.


      Here is zfs pool configuration:

      # zpool status
        pool: zfsroot
       state: ONLINE
       scan: scrub repaired 0 in 0h35m with 0 errors on Thu Jan 30 13:10:36 2014
              NAME          STATE     READ WRITE CKSUM
              zfsroot       ONLINE       0     0     0
                mirror-0    ONLINE       0     0     0
                  c2t0d0s2  ONLINE       0     0     0
                  c2t1d0s2  ONLINE       0     0     0
      errors: No known data errors


      Could somebody help?


      Thanks in advance.



      SunOS Release 5.10 Version Generic_147440-01 64-bit

      Server: Fujitsu PRIMEPOWER850 2-slot 12x SPARC64 V

      OBP: 3.21.9-1

        • 1. Re: zfs boot issues



          Can you please tell how this issue happened? Did you try to change the boot device, add new device to root pool etc?


          Does the server boot from the other disk (check boot-device parameter on OBP)?


          Maybe you need to install the boot blocks on the boot disk:


          #cd /usr/platform/`uname -i`/lib/fs/zfs

          #installboot -F zfs bootblk /dev/rdsk/cxtxdxsx




          • 2. Re: zfs boot issues

            Hi Reidod,


            There was zfspool with two disks on the server. Both disks was 76G (or something like this). First of all, I've replaced one of them by another one with 150G disk and waited when it resilver. At second step I've replaced remained small disk with bigger new one.

            As result I've got old zfs pool with totaly new disks. I've installed bootblock on both disks. Than I rebooted the serever and got what I described early.


            There is zpool history output:

            zpool offline zfsroot c0t0d0s2

            zpool detach zfsroot c0t0d0s2

            zpool attach zfsroot c0t1d0s2 c4t0d0s2

            zpool offline zfsroot c0t1d0s2

            zpool detach zfsroot c0t1d0s2

            zpool attach zfsroot c4t0d0s2 c4t1d0s2

            zpool set autoexpand=on zfsroot

            c0tXd0 - old disks

            c4tXd0 - new disks


            But when I boot int failsafe mode (or from dvd in single mode) I see my new disks as c2tXd0 (may be it's significant)


            Thank you.

            • 3. Re: zfs boot issues

              What is the output of show-disks command in OBP? What is the output of the format utility?

              Also check the boot-device parameter in OBP, maybe you need to change the aliases to point to the new disks.




              • 4. Re: zfs boot issues

                Here are


                format output


                       0. c0t1d0 <FUJITSU-MAP3735NC-3701 cyl 24345 alt 2 hd 8 sec 737>


                       1. c2t0d0 <COMPAQ-BD14689BB9-HPB1 cyl 65533 alt 2 hd 5 sec 875>


                       2. c2t1d0 <COMPAQ-BD14689BB9-HPB1 cyl 65533 alt 2 hd 5 sec 875>


                show-disks in OBP:

                {0} ok show-disks

                a) /pci@8d,4000/scsi@3,1/disk

                b) /pci@8d,4000/scsi@3/disk

                c) /pci@8f,2000/scsi@1,1/disk

                d) /pci@8f,2000/scsi@1/disk

                e) /pci@85,4000/scsi@3,1/disk

                f) /pci@85,4000/scsi@3/disk

                g) /pci@87,2000/scsi@1,1/disk

                h) /pci@87,2000/scsi@1/disk

                q) NO SELECTION

                Enter Selection, q to quit:


                boot-device  value is "disk1:c" but I switch off autoboot (for debug purposes) and boot server manualy with command "boot disk11..."


                Here is devalias output:

                {0} ok devalias

                tape                     /pci@87,2000/scsi@1,1/tape@5,0

                cdrom                    /pci@87,2000/scsi@1,1/disk@4,0:f

                disk11                   /pci@8f,2000/scsi@1/disk@1,0

                disk10                   /pci@8f,2000/scsi@1/disk@0,0

                disk1                    /pci@87,2000/scsi@1/disk@1,0

                disk0                    /pci@87,2000/scsi@1/disk@0,0

                disk                     /pci@87,2000/scsi@1/disk@0,0

                scsi                     /pci@87,2000/scsi@1

                obp-net                  /pci@87,4000/network@1,1

                net                      /pci@87,4000/network@1,1

                ttyb                     /pci@87,4000/ebus@1/FJSV,se@14,400000:b

                ttya                     /pci@87,4000/ebus@1/FJSV,se@14,400000:a

                scf                      /pci@87,4000/ebus@1/FJSV,scfc@14,200000

                • 5. Re: zfs boot issues

                  does it boot from disk10 alias?

                  • 6. Re: zfs boot issues

                    no,nor from disk10 nor from disk11 - the same error

                    • 7. Re: zfs boot issues

                      Reidod, I've fixed issie.


                      My unbootable pool occupied whole disks space on every disks (You can see s2 partitions (c4t0d0s2 etc))

                      I detached disk from pool, create one slice on it and attach it back but with slice - s0 (c4t0d0s0 etc), and did it for another disk. So now pool looks like this:

                      # zpool status

                        pool: zfsroot

                      state: ONLINE

                      scan: resilvered 31.7G in 0h39m with 0 errors on Fri Jan 31 09:10:40 2014


                              NAME          STATE     READ WRITE CKSUM

                              zfsroot       ONLINE       0     0     0

                                mirror-0    ONLINE       0     0     0

                                  c4t1d0s0  ONLINE       0     0     0

                                  c4t0d0s0  ONLINE       0     0     0

                      And now I'm able boot the server.


                      Apparently OBP can boot OS from slices only. (Or I didn't find option for other variant)


                      Thank so much you for help!

                      • 8. Re: zfs boot issues

                        Good job fixing this problem. Don't use slice 2 for anything. Slice 2 represents the whole disk.


                        You can only boot from disk slice on an  VTOC (SMI) labeled boot disk.


                        Thanks, Cindy