1 Reply Latest reply: Aug 1, 2012 10:20 AM by 836970 RSS

    Unable to install OS into new LDOM

    836970
      I've recently received two T3 servers, which are our first T3s. I've created multiple LDOMs on each one of them, but when I try to install Solaris 10u10 on to them, I get the following error.


      Preparing system for Solaris install

      Configuring disk (c0d0)
      - Creating Solaris disk label (VTOC)

      ERROR: Could not create Solaris disk label (VTOC)

      ERROR: Could not label disks

      ERROR: Could not update disks with new configuration
      mkdir: "/a/var/sadm/launcher": Read-only file system

      Could not update disks with new configuration
      Fatal Error
      Solaris installation program exited.


      From the prompt, I can mount the drives, write to them, partition them, perform fmthard, etc.. all without issue.

      This is the first instance of using Oracle VM for SPARC v2.2 as all of our other systems, T51x0 are all running LDOM 1.3. Since I'm having the issue across both servers, I'd assume either I'm doing something wrong, but I've not been able to determine where the issue is. Any help with this would be appreciated.

      Below is our LDOM config.


      bash-3.2# ldm list-bindings
      NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
      primary active -n-cv- UART 4 3G 0.8% 22h 45m

      UUID
      584a9407-ae85-4c5b-c9d3-cb510fe5e573

      MAC
      00:10:e0:0c:bf:98

      HOSTID
      0x860cbf98

      CONTROL
      failure-policy=ignore
      extended-mapin-space=off
      cpu-arch=native

      DEPENDENCY
      master=

      CORE
      CID CPUSET
      0 (0, 1, 2)
      9 (74)

      VCPU
      VID PID CID UTIL STRAND
      0 0 0 1.3% 100%
      1 1 0 0.6% 100%
      2 2 0 0.7% 100%
      74 74 9 0.4% 100%

      MEMORY
      RA PA SIZE
      0xf40000000 0xf40000000 3G

      CONSTRAINT
      threading=max-throughput

      VARIABLES
      boot-device=/pci@400/pci@1/pci@0/pci@4/scsi@0/disk@w318c9c3f9965e083,0:a disk net
      keyboard-layout=US-English
      nvramrc=devalias mydisk /pci@400/pci@1/pci@0/pci@4/scsi@0/disk
      ." ChassisSerialNumber 1226BDR021 " cr
      use-nvramrc?=true

      IO
      DEVICE PSEUDONYM OPTIONS
      pci@400 pci_0
      niu@480 niu_0
      pci@400/pci@1/pci@0/pci@8 /SYS/MB/RISER0/PCIE0
      pci@400/pci@2/pci@0/pci@8 /SYS/MB/RISER1/PCIE1
      pci@400/pci@1/pci@0/pci@6 /SYS/MB/RISER2/PCIE2
      pci@400/pci@2/pci@0/pci@c /SYS/MB/RISER0/PCIE3
      pci@400/pci@1/pci@0/pci@0 /SYS/MB/RISER1/PCIE4
      pci@400/pci@2/pci@0/pci@a /SYS/MB/RISER2/PCIE5
      pci@400/pci@1/pci@0/pci@4 /SYS/MB/SASHBA0
      pci@400/pci@2/pci@0/pci@4 /SYS/MB/SASHBA1
      pci@400/pci@2/pci@0/pci@6 /SYS/MB/NET0
      pci@400/pci@2/pci@0/pci@7 /SYS/MB/NET2

      VCC
      NAME PORT-RANGE
      primary-vcc0 5000-5010
      CLIENT PORT
      intg3@primary-vcc0 5000
      intg4@primary-vcc0 5001
      qualt@primary-vcc0 5002
      ldom4@primary-vcc0 5003

      VSW
      NAME MAC NET-DEV ID DEVICE LINKPROP DEFAULT-VLAN-ID PVID VID MTU MODE INTER-VNET-LINK
      primary-vsw0 00:14:4f:f9:f2:8a aggr1 0 switch@0 1 1 1500 on
      PEER MAC PVID VID MTU LINKPROP INTERVNETLINK
      vnet0@intg3 00:14:4f:fb:2e:5b 1 1500
      vnet0@intg4 00:14:4f:fa:cc:65 1 1500
      vnet0@qualt 00:14:4f:fa:ad:49 1 1500
      vnet0@ldom4 00:14:4f:fb:c5:c0 1 1500
      NAME MAC NET-DEV ID DEVICE LINKPROP DEFAULT-VLAN-ID PVID VID MTU MODE INTER-VNET-LINK
      primary-vsw1 00:14:4f:f8:a3:2f aggr2 1 switch@1 1 1 1500 on
      PEER MAC PVID VID MTU LINKPROP INTERVNETLINK
      vnet1@intg3 00:14:4f:f8:d4:95 1 224 1500
      vnet1@intg4 00:14:4f:fb:7f:6b 1 224 1500
      vnet1@qualt 00:14:4f:f9:43:fe 1 224 1500
      vnet1@ldom4 00:14:4f:fb:97:29 1 224 1500

      VDS
      NAME VOLUME OPTIONS MPGROUP DEVICE
      primary-vds0 intg3_root /dev/dsk/c8t60060160F260300020A75F4CD2D1E111d0s6
      intg4_root /dev/dsk/c8t60060160F260300022A75F4CD2D1E111d0s6
      qualt_root /dev/dsk/c8t60060160F260300024A75F4CD2D1E111d0s6
      ldom4_root /dev/dsk/c8t60060160F260300026A75F4CD2D1E111d0s6
      intg3_swap /ldoms/swap/intg3
      intg4_swap /ldoms/swap/intg4
      ldom4_swap /ldoms/swap/ldom4
      qualt_swap /ldoms/swap/qualt
      cdrom /iso/sol-10-u10-ga2-sparc-dvd.iso
      CLIENT VOLUME
      intg3_root@intg3 intg3_root
      intg3_swap@intg3 intg3_swap
      intg4_root@intg4 intg4_root
      intg4_swap@intg4 intg4_swap
      qualt_root@qualt qualt_root
      qualt_swap@qualt qualt_swap
      ldom4_root@ldom4 ldom4_root
      ldom4_swap@ldom4 ldom4_swap
      cdrom@intg3 cdrom

      VCONS
      NAME SERVICE PORT
      UART

      ------------------------------------------------------------------------------
      NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
      intg3 active -n---- 5000 31 15G 0.1% 20h 32m

      UUID
      62740e55-f38b-ca17-8f93-de3b7a66a315

      MAC
      00:14:4f:fb:65:64

      HOSTID
      0x84fb6564

      CONTROL
      failure-policy=ignore
      extended-mapin-space=off
      cpu-arch=native

      DEPENDENCY
      master=

      CORE
      CID CPUSET
      1 (8, 9, 10, 11, 12, 13, 14, 15)
      2 (16, 17, 18, 19, 20, 21, 22, 23)
      3 (24, 25, 26, 27, 28, 29, 30, 31)
      4 (32, 33, 34, 35, 36, 37, 38)

      VCPU
      VID PID CID UTIL STRAND
      0 8 1 0.3% 100%
      1 9 1 0.3% 100%
      2 10 1 0.1% 100%
      3 11 1 0.0% 100%
      4 12 1 0.0% 100%
      5 13 1 0.0% 100%
      6 14 1 0.0% 100%
      7 15 1 0.3% 100%
      8 16 2 0.0% 100%
      9 17 2 0.0% 100%
      10 18 2 0.0% 100%
      11 19 2 0.0% 100%
      12 20 2 0.0% 100%
      13 21 2 0.1% 100%
      14 22 2 0.0% 100%
      15 23 2 0.0% 100%
      16 24 3 0.1% 100%
      17 25 3 0.0% 100%
      18 26 3 0.0% 100%
      19 27 3 0.0% 100%
      20 28 3 0.0% 100%
      21 29 3 0.0% 100%
      22 30 3 0.0% 100%
      23 31 3 0.0% 100%
      24 32 4 0.0% 100%
      25 33 4 0.0% 100%
      26 34 4 0.0% 100%
      27 35 4 0.0% 100%
      28 36 4 0.0% 100%
      29 37 4 0.0% 100%
      30 38 4 0.0% 100%

      MAU
      ID CPUSET
      1 (8, 9, 10, 11, 12, 13, 14, 15)

      MEMORY
      RA PA SIZE
      0x10000000 0x20000000 15G

      CONSTRAINT
      threading=max-throughput

      VARIABLES
      auto-boot?=false

      NETWORK
      NAME SERVICE ID DEVICE MAC MODE PVID VID MTU LINKPROP
      vnet0 primary-vsw0@primary 0 network@0 00:14:4f:fb:2e:5b 1 1500
      PEER MAC MODE PVID VID MTU LINKPROP
      primary-vsw0@primary 00:14:4f:f9:f2:8a 1 1500
      vnet0@intg4 00:14:4f:fa:cc:65 1 1500
      vnet0@qualt 00:14:4f:fa:ad:49 1 1500
      vnet0@ldom4 00:14:4f:fb:c5:c0 1 1500
      NAME SERVICE ID DEVICE MAC MODE PVID VID MTU LINKPROP
      vnet1 primary-vsw1@primary 1 network@1 00:14:4f:f8:d4:95 1 224 1500
      PEER MAC MODE PVID VID MTU LINKPROP
      primary-vsw1@primary 00:14:4f:f8:a3:2f 1 1500
      vnet1@intg4 00:14:4f:fb:7f:6b 1 224 1500
      vnet1@qualt 00:14:4f:f9:43:fe 1 224 1500
      vnet1@ldom4 00:14:4f:fb:97:29 1 224 1500

      DISK
      NAME VOLUME TOUT ID DEVICE SERVER MPGROUP
      intg3_root intg3_root@primary-vds0 0 disk@0 primary
      intg3_swap intg3_swap@primary-vds0 1 disk@1 primary
      cdrom cdrom@primary-vds0 2 disk@2 primary

      VCONS
      NAME SERVICE PORT
      intg3 primary-vcc0@primary 5000

      ------------------------------------------------------------------------------
      NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
      intg4 bound ------ 5001 31 15G

      UUID
      38f810dc-0b36-4a0f-a9cb-bb9f2890e2b8

      MAC
      00:14:4f:fb:8a:8d

      HOSTID
      0x84fb8a8d

      CONTROL
      failure-policy=ignore
      extended-mapin-space=off
      cpu-arch=native

      DEPENDENCY
      master=

      CORE
      CID CPUSET
      5 (40, 41, 42, 43, 44, 45, 46, 47)
      6 (48, 49, 50, 51, 52, 53, 54, 55)
      7 (56, 57, 58, 59, 60, 61, 62, 63)
      8 (64, 65, 66, 67, 68, 69, 70)

      VCPU
      VID PID CID UTIL STRAND
      0 40 5 100%
      1 41 5 100%
      2 42 5 100%
      3 43 5 100%
      4 44 5 100%
      5 45 5 100%
      6 46 5 100%
      7 47 5 100%
      8 48 6 100%
      9 49 6 100%
      10 50 6 100%
      11 51 6 100%
      12 52 6 100%
      13 53 6 100%
      14 54 6 100%
      15 55 6 100%
      16 56 7 100%
      17 57 7 100%
      18 58 7 100%
      19 59 7 100%
      20 60 7 100%
      21 61 7 100%
      22 62 7 100%
      23 63 7 100%
      24 64 8 100%
      25 65 8 100%
      26 66 8 100%
      27 67 8 100%
      28 68 8 100%
      29 69 8 100%
      30 70 8 100%

      MAU
      ID CPUSET
      5 (40, 41, 42, 43, 44, 45, 46, 47)

      MEMORY
      RA PA SIZE
      0x10000000 0x3e0000000 15G

      CONSTRAINT
      threading=max-throughput

      VARIABLES
      auto-boot?=false

      NETWORK
      NAME SERVICE ID DEVICE MAC MODE PVID VID MTU LINKPROP
      vnet0 primary-vsw0@primary 0 network@0 00:14:4f:fa:cc:65 1 1500
      PEER MAC MODE PVID VID MTU LINKPROP
      primary-vsw0@primary 00:14:4f:f9:f2:8a 1 1500
      vnet0@intg3 00:14:4f:fb:2e:5b 1 1500
      vnet0@qualt 00:14:4f:fa:ad:49 1 1500
      vnet0@ldom4 00:14:4f:fb:c5:c0 1 1500
      NAME SERVICE ID DEVICE MAC MODE PVID VID MTU LINKPROP
      vnet1 primary-vsw1@primary 1 network@1 00:14:4f:fb:7f:6b 1 224 1500
      PEER MAC MODE PVID VID MTU LINKPROP
      primary-vsw1@primary 00:14:4f:f8:a3:2f 1 1500
      vnet1@intg3 00:14:4f:f8:d4:95 1 224 1500
      vnet1@qualt 00:14:4f:f9:43:fe 1 224 1500
      vnet1@ldom4 00:14:4f:fb:97:29 1 224 1500

      DISK
      NAME VOLUME TOUT ID DEVICE SERVER MPGROUP
      intg4_root intg4_root@primary-vds0 0 disk@0 primary
      intg4_swap intg4_swap@primary-vds0 1 disk@1 primary

      VCONS
      NAME SERVICE PORT
      intg4 primary-vcc0@primary 5001

      ------------------------------------------------------------------------------
      NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
      ldom4 bound ------ 5003 31 15G

      UUID
      f01e1450-7e89-cf40-b7cd-90494714c509

      MAC
      00:14:4f:fb:1f:44

      HOSTID
      0x84fb1f44

      CONTROL
      failure-policy=ignore
      extended-mapin-space=off
      cpu-arch=native

      DEPENDENCY
      master=

      CORE
      CID CPUSET
      0 (3, 4, 5, 6, 7)
      4 (39)
      8 (71)
      9 (72, 73, 75, 76, 77, 78, 79)
      13 (111)
      14 (112, 113, 114, 115, 116, 117, 118, 119)
      15 (120, 121, 122, 123, 124, 125, 126, 127)

      VCPU
      VID PID CID UTIL STRAND
      0 3 0 100%
      1 4 0 100%
      2 5 0 100%
      3 6 0 100%
      4 7 0 100%
      5 39 4 100%
      6 71 8 100%
      7 72 9 100%
      8 73 9 100%
      9 75 9 100%
      10 76 9 100%
      11 77 9 100%
      12 78 9 100%
      13 79 9 100%
      14 111 13 100%
      15 112 14 100%
      16 113 14 100%
      17 114 14 100%
      18 115 14 100%
      19 116 14 100%
      20 117 14 100%
      21 118 14 100%
      22 119 14 100%
      23 120 15 100%
      24 121 15 100%
      25 122 15 100%
      26 123 15 100%
      27 124 15 100%
      28 125 15 100%
      29 126 15 100%
      30 127 15 100%

      MAU
      ID CPUSET
      0 (3, 4, 5, 6, 7)

      MEMORY
      RA PA SIZE
      0x10000000 0xb60000000 15G

      CONSTRAINT
      threading=max-throughput

      VARIABLES
      auto-boot?=false

      NETWORK
      NAME SERVICE ID DEVICE MAC MODE PVID VID MTU LINKPROP
      vnet0 primary-vsw0@primary 0 network@0 00:14:4f:fb:c5:c0 1 1500
      PEER MAC MODE PVID VID MTU LINKPROP
      primary-vsw0@primary 00:14:4f:f9:f2:8a 1 1500
      vnet0@intg3 00:14:4f:fb:2e:5b 1 1500
      vnet0@intg4 00:14:4f:fa:cc:65 1 1500
      vnet0@qualt 00:14:4f:fa:ad:49 1 1500
      NAME SERVICE ID DEVICE MAC MODE PVID VID MTU LINKPROP
      vnet1 primary-vsw1@primary 1 network@1 00:14:4f:fb:97:29 1 224 1500
      PEER MAC MODE PVID VID MTU LINKPROP
      primary-vsw1@primary 00:14:4f:f8:a3:2f 1 1500
      vnet1@intg3 00:14:4f:f8:d4:95 1 224 1500
      vnet1@intg4 00:14:4f:fb:7f:6b 1 224 1500
      vnet1@qualt 00:14:4f:f9:43:fe 1 224 1500

      DISK
      NAME VOLUME TOUT ID DEVICE SERVER MPGROUP
      ldom4_root ldom4_root@primary-vds0 0 disk@0 primary
      ldom4_swap ldom4_swap@primary-vds0 1 disk@1 primary

      VCONS
      NAME SERVICE PORT
      ldom4 primary-vcc0@primary 5003

      ------------------------------------------------------------------------------
      NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
      qualt bound ------ 5002 31 15G

      UUID
      b2ca331d-9885-6d58-c52b-e6684800c88d

      MAC
      00:14:4f:f9:dc:0d

      HOSTID
      0x84f9dc0d

      CONTROL
      failure-policy=ignore
      extended-mapin-space=off
      cpu-arch=native

      DEPENDENCY
      master=

      CORE
      CID CPUSET
      10 (80, 81, 82, 83, 84, 85, 86, 87)
      11 (88, 89, 90, 91, 92, 93, 94, 95)
      12 (96, 97, 98, 99, 100, 101, 102, 103)
      13 (104, 105, 106, 107, 108, 109, 110)

      VCPU
      VID PID CID UTIL STRAND
      0 80 10 100%
      1 81 10 100%
      2 82 10 100%
      3 83 10 100%
      4 84 10 100%
      5 85 10 100%
      6 86 10 100%
      7 87 10 100%
      8 88 11 100%
      9 89 11 100%
      10 90 11 100%
      11 91 11 100%
      12 92 11 100%
      13 93 11 100%
      14 94 11 100%
      15 95 11 100%
      16 96 12 100%
      17 97 12 100%
      18 98 12 100%
      19 99 12 100%
      20 100 12 100%
      21 101 12 100%
      22 102 12 100%
      23 103 12 100%
      24 104 13 100%
      25 105 13 100%
      26 106 13 100%
      27 107 13 100%
      28 108 13 100%
      29 109 13 100%
      30 110 13 100%

      MAU
      ID CPUSET
      10 (80, 81, 82, 83, 84, 85, 86, 87)

      MEMORY
      RA PA SIZE
      0x10000000 0x7a0000000 15G

      CONSTRAINT
      threading=max-throughput

      VARIABLES
      auto-boot?=false

      NETWORK
      NAME SERVICE ID DEVICE MAC MODE PVID VID MTU LINKPROP
      vnet0 primary-vsw0@primary 0 network@0 00:14:4f:fa:ad:49 1 1500
      PEER MAC MODE PVID VID MTU LINKPROP
      primary-vsw0@primary 00:14:4f:f9:f2:8a 1 1500
      vnet0@intg3 00:14:4f:fb:2e:5b 1 1500
      vnet0@intg4 00:14:4f:fa:cc:65 1 1500
      vnet0@ldom4 00:14:4f:fb:c5:c0 1 1500
      NAME SERVICE ID DEVICE MAC MODE PVID VID MTU LINKPROP
      vnet1 primary-vsw1@primary 1 network@1 00:14:4f:f9:43:fe 1 224 1500
      PEER MAC MODE PVID VID MTU LINKPROP
      primary-vsw1@primary 00:14:4f:f8:a3:2f 1 1500
      vnet1@intg3 00:14:4f:f8:d4:95 1 224 1500
      vnet1@intg4 00:14:4f:fb:7f:6b 1 224 1500
      vnet1@ldom4 00:14:4f:fb:97:29 1 224 1500

      DISK
      NAME VOLUME TOUT ID DEVICE SERVER MPGROUP
      qualt_root qualt_root@primary-vds0 0 disk@0 primary
      qualt_swap qualt_swap@primary-vds0 1 disk@1 primary

      VCONS
      NAME SERVICE PORT
      qualt primary-vcc0@primary 5002

      Edited by: user13014014 on Aug 1, 2012 7:32 AM
        • 1. Re: Unable to install OS into new LDOM
          836970
          Answering my own question, I set my partitions up as below and it worked.


          Customize Disk: c0d0
          Boot Device: c0d0s0

          Entry: / Recommended: 6458 MB Minimum: 5489 MB
          ================================================================================
          Slice Mount Point Size (MB)
          0 / 50941
          1 0
          2 overlap 50941
          3 0
          4 0
          5 0
          6 0
          7 0
          ================================================================================
          Capacity: 50941 MB
          Allocated: 50941 MB
          Free: 0 MB

          Customize Disk: c0d1
          Boot Device: c0d0s0

          Entry: swap Recommended: 0 MB Minimum: 0 MB
          ================================================================================
          Slice Mount Point Size (MB)
          0 swap 20376
          1 0
          2 overlap 20376
          3 0
          4 0
          5 0
          6 0
          7 0
          ================================================================================
          Capacity: 20376 MB
          Allocated: 20376 MB
          Free: 0 MB