Forum Stats

  • 3,873,327 Users
  • 2,266,535 Discussions
  • 7,911,507 Comments

Discussions

T5-2 Fault Lights source

1893556
1893556 Member Posts: 8
edited Jan 9, 2019 12:11PM in SPARC Servers

I am hoping someone is able to help me, even if it is basic troubleshooting steps since I am starting to get baffled.

I have a set of about five T5-2 servers. Of those, 3 currently have the fault light illuminated on the front of the server. When I go to any of them though, I cannot see what is actually turning on the light (i.e. nothing appears to be showing a "fault still detected"). Taking just one of the 3 as an example (which all three show the same behavior outlined):

  • Starting with the iLOM interface, the "Open Problems" shows nothing:

     -> show /System/Open_Problems

     Open Problems (0)

     Date/Time                 Subsystems          Component

     ------------------------  ------------------  ------------

  • Looking at faultmgt from the iLOM side shows:

     -> start /sp/faultmgmt/shell

     Are you sure you want to start /SP/faultmgmt/shell (y/n)? y

     faultmgmtsp> fmadm faulty

     No faults found

  • And finally, from faultmgt from inside Solaris 11 shows (everything is "solved"):

     # fmadm faulty | grep -i status

     Problem Status    : solved

        Status      : faulted but still in service

     Problem Status    : solved

        Status      : faulted but still in service

     Problem Status    : solved

        Status      : faulted but still in service

So is there somewhere else I can look for what fault still may be present? I have also tried to simply "clear the fault" by several different methods going up to "set /SYS/ clear_fault_action=true", (of which, no /SYS/XXX_FAULT shows a fault either).

So I am really scratching my head. Updating firmware/OS is mostly out of the question given the locations of most of these servers, but the versions of each are:

     -> version

     SP firmware 3.2.1.9.b

     SP firmware build number: 90525

     SP firmware date: Fri Jul 11 14:18:00 PDT 2014

     SP filesystem version: 0.2.7

and

     # pkg list entire

     NAME (PUBLISHER)                                  VERSION                    IFO

     entire (solaris)                                  0.5.11-0.175.2.7.0.4.0     i--

Is there a way to reset the light? To have it re-poll status and report the actual error? Any help someone can provide would be appreciated.

Thanks.

Answers

  • Nik
    Nik Blocked Member Posts: 2,879 Bronze Crown
    edited Oct 25, 2018 10:32AM

    Hi.

    Can you show from Solaris (controla domain) result of command: /usr/sbin/prtdiag -v

    Regards,

    Nik

  • 1893556
    1893556 Member Posts: 8
    edited Oct 30, 2018 10:22AM

    Thanks for showing interest. Here is a printout; I don't see anything jumping out at me aside from SYS SERVICE steady. Hopefully you are able to see something though:

    # /usr/sbin/prtdiag -v

    System Configuration:  Oracle Corporation  sun4v SPARC T5-2

    Memory size: 130048 Megabytes

    ================================ Virtual CPUs ================================

    CPU ID Frequency Implementation         Status

    ------ --------- ---------------------- -------

    0 3600 MHz SPARC-T5 on-line

    1 3600 MHz SPARC-T5 on-line

    2 3600 MHz SPARC-T5 on-line

    3 3600 MHz SPARC-T5 on-line

    4 3600 MHz SPARC-T5 on-line

    5 3600 MHz SPARC-T5 on-line

    6 3600 MHz SPARC-T5 on-line

    7 3600 MHz SPARC-T5 on-line

    8 3600 MHz SPARC-T5 no-intr

    9 3600 MHz SPARC-T5 spare

    10 3600 MHz  SPARC-T5 spare

    11 3600 MHz SPARC-T5 spare

    12 3600 MHz SPARC-T5 spare

    13 3600 MHz SPARC-T5 spare

    14 3600 MHz SPARC-T5 spare

    15 3600 MHz SPARC-T5 spare

    16 3600 MHz SPARC-T5 on-line

    17 3600 MHz SPARC-T5 on-line

    18 3600 MHz SPARC-T5 on-line

    19 3600 MHz SPARC-T5 on-line

    20 3600 MHz SPARC-T5 on-line

    21 3600 MHz  SPARC-T5 on-line

    22 3600 MHz  SPARC-T5 on-line

    23 3600 MHz SPARC-T5 on-line

    24 3600 MHz SPARC-T5 no-intr

    25 3600 MHz SPARC-T5 spare

    26 3600 MHz SPARC-T5 spare

    27 3600 MHz SPARC-T5 spare

    28 3600 MHz SPARC-T5 spare

    29 3600 MHz SPARC-T5 spare

    30 3600 MHz SPARC-T5 spare

    31 3600 MHz SPARC-T5 spare

    32 3600 MHz  SPARC-T5 on-line

    33 3600 MHz SPARC-T5 on-line

    34 3600 MHz SPARC-T5 on-line

    35 3600 MHz SPARC-T5 on-line

    36 3600 MHz SPARC-T5 on-line

    37 3600 MHz SPARC-T5 on-line

    38 3600 MHz SPARC-T5 on-line

    39 3600 MHz SPARC-T5 on-line

    40 3600 MHz SPARC-T5 no-intr

    41 3600 MHz SPARC-T5 spare

    42 3600 MHz SPARC-T5 spare

    43 3600 MHz SPARC-T5 spare

    44 3600 MHz SPARC-T5 spare

    45 3600 MHz SPARC-T5 spare

    46 3600 MHz SPARC-T5 spare

    47 3600 MHz SPARC-T5 spare

    48 3600 MHz SPARC-T5 on-line

    49 3600 MHz SPARC-T5 on-line

    50 3600 MHz SPARC-T5 on-line

    51 3600 MHz SPARC-T5 on-line

    52 3600 MHz SPARC-T5 on-line

    53 3600 MHz SPARC-T5 on-line

    54 3600 MHz SPARC-T5 on-line

    55 3600 MHz SPARC-T5 on-line

    56 3600 MHz SPARC-T5 on-line

    57 3600 MHz SPARC-T5 on-line

    58 3600 MHz SPARC-T5 on-line

    59 3600 MHz  SPARC-T5 on-line

    60 3600 MHz SPARC-T5 on-line

    61 3600 MHz SPARC-T5 on-line

    62 3600 MHz SPARC-T5 on-line

    63 3600 MHz SPARC-T5 on-line

    64 3600 MHz SPARC-T5 on-line

    65 3600 MHz  SPARC-T5 on-line

    66 3600 MHz SPARC-T5 on-line

    67 3600 MHz SPARC-T5 on-line

    68 3600 MHz SPARC-T5 on-line

    69 3600 MHz SPARC-T5 on-line

    70 3600 MHz SPARC-T5 on-line

    71 3600 MHz SPARC-T5 on-line

    72 3600 MHz SPARC-T5 no-intr

    73 3600 MHz SPARC-T5 spare

    74 3600 MHz SPARC-T5 spare

    75 3600 MHz  SPARC-T5 spare

    76 3600 MHz SPARC-T5 spare

    77 3600 MHz SPARC-T5 spare

    78 3600 MHz SPARC-T5 spare

    79 3600 MHz SPARC-T5 spare

    80 3600 MHz SPARC-T5 on-line

    81 3600 MHz SPARC-T5 on-line

    82 3600 MHz SPARC-T5 on-line

    83 3600 MHz SPARC-T5 on-line

    84 3600 MHz SPARC-T5 on-line

    85 3600 MHz SPARC-T5 on-line

    86 3600 MHz  SPARC-T5 on-line

    87 3600 MHz SPARC-T5 on-line

    88 3600 MHz SPARC-T5 no-intr

    89 3600 MHz SPARC-T5 spare

    90 3600 MHz SPARC-T5 spare

    91 3600 MHz SPARC-T5 spare

    92 3600 MHz SPARC-T5 spare

    93 3600 MHz SPARC-T5 spare

    94 3600 MHz SPARC-T5 spare

    95 3600 MHz SPARC-T5 spare

    96 3600 MHz SPARC-T5 on-line

    97 3600 MHz SPARC-T5 on-line

    98 3600 MHz SPARC-T5 on-line

    99 3600 MHz SPARC-T5 on-line

    100    3600 MHz SPARC-T5 on-line

    101    3600 MHz SPARC-T5 on-line

    102    3600 MHz  SPARC-T5 on-line

    103    3600 MHz SPARC-T5 on-line

    104    3600 MHz SPARC-T5 no-intr

    105    3600 MHz SPARC-T5 spare

    106    3600 MHz SPARC-T5 spare

    107    3600 MHz SPARC-T5 spare

    108    3600 MHz  SPARC-T5 spare

    109    3600 MHz SPARC-T5 spare

    110    3600 MHz SPARC-T5 spare

    111    3600 MHz SPARC-T5 spare

    112    3600 MHz SPARC-T5 on-line

    113    3600 MHz  SPARC-T5 on-line

    114    3600 MHz SPARC-T5 on-line

    115    3600 MHz SPARC-T5 on-line

    116    3600 MHz SPARC-T5 on-line

    117    3600 MHz SPARC-T5 on-line

    118    3600 MHz SPARC-T5 on-line

    119    3600 MHz SPARC-T5 on-line

    120    3600 MHz SPARC-T5 on-line

    121    3600 MHz SPARC-T5 on-line

    122    3600 MHz SPARC-T5 on-line

    123    3600 MHz SPARC-T5 on-line

    124    3600 MHz  SPARC-T5 on-line

    125    3600 MHz SPARC-T5 on-line

    126    3600 MHz SPARC-T5 on-line

    127    3600 MHz SPARC-T5 on-line

    ======================= Physical Memory Configuration ========================

    Segment Table:

    --------------------------------------------------------------

    Base Segment  Interleave   Bank     Contains

    Address Size     Factor Size     Modules

    --------------------------------------------------------------

    0x0 128 GB 4 32 GB    /SYS/MB/CM0/CMP/MR0/BOB0/CH0/D0

    /SYS/MB/CM0/CMP/MR0/BOB0/CH1/D0

    /SYS/MB/CM0/CMP/MR0/BOB1/CH0/D0

    /SYS/MB/CM0/CMP/MR0/BOB1/CH1/D0

    32 GB    /SYS/MB/CM0/CMP/MR1/BOB0/CH0/D0

    /SYS/MB/CM0/CMP/MR1/BOB0/CH1/D0

    /SYS/MB/CM0/CMP/MR1/BOB1/CH0/D0

    /SYS/MB/CM0/CMP/MR1/BOB1/CH1/D0

    32 GB    /SYS/MB/CM0/CMP/MR2/BOB0/CH0/D0

    /SYS/MB/CM0/CMP/MR2/BOB0/CH1/D0

    /SYS/MB/CM0/CMP/MR2/BOB1/CH0/D0

    /SYS/MB/CM0/CMP/MR2/BOB1/CH1/D0

    32 GB    /SYS/MB/CM0/CMP/MR3/BOB0/CH0/D0

    /SYS/MB/CM0/CMP/MR3/BOB0/CH1/D0

    /SYS/MB/CM0/CMP/MR3/BOB1/CH0/D0

    /SYS/MB/CM0/CMP/MR3/BOB1/CH1/D0

    ======================================== IO Devices =======================================

    Slot + Bus   Name + Model      Max Speed  Cur Speed

    Status Type Path /Width /Width

    -------------------------------------------------------------------------------------------

    /SYS/MB/XGBE1 PCIE network-pciex8086,1528 5.0GT/x8   5.0GT/x8

    /[email protected]/[email protected]/[email protected]/[email protected]/[email protected]

    /SYS/MB/NET3 PCIE  network-pciex8086,1528 5.0GT/x8   5.0GT/x8

    /[email protected]/[email protected]/[email protected]/[email protected]/[email protected],1

    /SYS/MB/SASHBA1 PCIE scsi-pciex1000,87 LSI,2308_2 8.0GT/x4   8.0GT/x4

    /[email protected]/[email protected]/[email protected]/[email protected]/[email protected]

    /SYS/MB/USB PCIE usb-pciexclass,0c0330 5.0GT/x1   5.0GT/x1

    /[email protected]/[email protected]/[email protected]/[email protected]/[email protected]

    /SYS/MB/PCIE8 PCIE  network-pciex8086,1521 SUNW,pcie-igb 5.0GT/x4   5.0GT/x4

    /[email protected]/[email protected]/[email protected]/[email protected]/[email protected]

    /SYS/MB/PCIE8 PCIE network-pciex8086,1521 SUNW,pcie-igb 5.0GT/x4   5.0GT/x4

    /[email protected]/[email protected]/[email protected]/[email protected]/[email protected],1

    /SYS/MB/PCIE8 PCIE  network-pciex8086,1521 SUNW,pcie-igb 5.0GT/x4   5.0GT/x4

    /[email protected]/[email protected]/[email protected]/[email protected]/[email protected],2

    /SYS/MB/PCIE8 PCIE network-pciex8086,1521 SUNW,pcie-igb 5.0GT/x4   5.0GT/x4

    /[email protected]/[email protected]/[email protected]/[email protected]/[email protected],3

    /SYS/MB/XGBE0 PCIE network-pciex8086,1528 5.0GT/x8   5.0GT/x8

    /[email protected]/[email protected]/[email protected]/[email protected]/[email protected]

    /SYS/MB/NET1 PCIE network-pciex8086,1528 5.0GT/x8   5.0GT/x8

    /[email protected]/[email protected]/[email protected]/[email protected]/[email protected],1

    /SYS/MB/SASHBA0 PCIE scsi-pciex1000,87 LSI,2308_2 8.0GT/x4   8.0GT/x4

    /[email protected]/[email protected]/[email protected]/[email protected]/[email protected]

    /SYS/RIO/VIDEO PCIE  display-pciex102b,522 2.5GT/x1   2.5GT/x1

    /[email protected]/[email protected]/[email protected]/[email protected]/[email protected]

    /SYS/MB/PCIE1 PCIE LSI,sas-pciex1000,72 LSI,2008   5.0GT/x8   5.0GT/x8

    /[email protected]/[email protected]/[email protected]/[email protected]/LSI,[email protected]

    /SYS/MB/PCIE2 PCIE pci12e2,4013 --         --

    /[email protected]/[email protected]/[email protected]/[email protected]/[email protected]/pci12e2,[email protected]

    ============================ Environmental Status ============================

    Fan sensors:

    ----------------------------------------------------------------

    Location Sensor Status

    ----------------------------------------------------------------

    SYS/FANBD/F0 TACH ok

    SYS/FANBD/F1 TACH ok

    SYS/FANBD/F2 TACH ok

    SYS/FANBD/F3 TACH ok

    SYS/FANBD/F4 TACH ok

    SYS/FANBD/F5 TACH ok

    Temperature sensors:

    ----------------------------------------------------------------

    Location Sensor Status

    ----------------------------------------------------------------

    SYS/MB/1V0_SAS0_OBPS T_INT ok

    SYS/MB/1V0_SAS1_OBPS T_INT ok

    SYS/MB/1V0_SW0_OBPS T_INT ok

    SYS/MB/1V0_SW1_OBPS T_INT ok

    SYS/MB/CM0/1V0_OBPS0 T_INT ok

    SYS/MB/CM0/1V0_OBPS1 T_INT ok

    SYS/MB/CM0/1V0_OBPS2 T_INT ok

    SYS/MB/CM0/1V5_OBPS T_INT ok

    SYS/MB/CM0/CMP/MR0/BOB0/CH0/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR0/BOB0/CH1/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR0/BOB0 T_AMB ok

    SYS/MB/CM0/CMP/MR0/BOB1/CH0/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR0/BOB1/CH1/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR0/BOB1 T_AMB ok

    SYS/MB/CM0/CMP/MR0/VDD_CORE_OBPS T_INT ok

    SYS/MB/CM0/CMP/MR1/BOB0/CH0/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR1/BOB0/CH1/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR1/BOB0 T_AMB ok

    SYS/MB/CM0/CMP/MR1/BOB1/CH0/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR1/BOB1/CH1/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR1/BOB1 T_AMB ok

    SYS/MB/CM0/CMP/MR1/VDD_CORE_OBPS T_INT ok

    SYS/MB/CM0/CMP/MR2/BOB0/CH0/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR2/BOB0/CH1/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR2/BOB0 T_AMB ok

    SYS/MB/CM0/CMP/MR2/BOB1/CH0/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR2/BOB1/CH1/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR2/BOB1 T_AMB ok

    SYS/MB/CM0/CMP/MR2/VDD_CORE_OBPS T_INT ok

    SYS/MB/CM0/CMP/MR3/BOB0/CH0/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR3/BOB0/CH1/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR3/BOB0 T_AMB ok

    SYS/MB/CM0/CMP/MR3/BOB1/CH0/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR3/BOB1/CH1/D0 T_AMB ok

    SYS/MB/CM0/CMP/MR3/BOB1 T_AMB ok

    SYS/MB/CM0/CMP/MR3/VDD_CORE_OBPS T_INT ok

    SYS/MB/CM0/CMP T_CORE0            ok

    SYS/MB/CM0/CMP T_CORE1            ok

    SYS/MB/CM0/CMP T_CORE2            ok

    SYS/MB/CM0/CMP T_CORE3            ok

    SYS/MB/CM0 T_BUS_BAR          ok

    SYS/MB T_BUS_BAR0         ok

    SYS/MB T_BUS_BAR1         ok

    SYS/MB T_OUTLET0 ok

    SYS/MB T_OUTLET1          ok

    SYS/MB/XGBE0 T_AMB ok

    SYS/MB/XGBE1 T_AMB ok

    SYS/PS0 T_OUT ok

    SYS/PS1 T_OUT ok

    SYS T_AMB ok

    Current sensors:

    ----------------------------------------------------------------

    Location Sensor Status

    ----------------------------------------------------------------

    SYS/MB/CM0/CMP I_VCORE            ok

    SYS/MB/CM0/CMP/MR0 I_MEM ok

    SYS/MB/CM0/CMP/MR1 I_MEM ok

    SYS/MB/CM0/CMP/MR2 I_MEM ok

    SYS/MB/CM0/CMP/MR3 I_MEM ok

    Voltage sensors:

    ----------------------------------------------------------------

    Location Sensor Status

    ----------------------------------------------------------------

    SYS/MB/CM0/CMP/MR0 VDD_IO ok

    SYS/MB/CM0/CMP/MR0 VDD_TERM           ok

    SYS/MB/CM0/CMP/MR0 VMEM ok

    SYS/MB/CM0/CMP/MR0 VTT ok

    SYS/MB/CM0/CMP/MR0 V_VCORE            ok

    SYS/MB/CM0/CMP/MR0 V_VIN ok

    SYS/MB/CM0/CMP/MR1 VDD_IO ok

    SYS/MB/CM0/CMP/MR1 VDD_TERM           ok

    SYS/MB/CM0/CMP/MR1 VMEM ok

    SYS/MB/CM0/CMP/MR1 VTT ok

    SYS/MB/CM0/CMP/MR1 V_VCORE            ok

    SYS/MB/CM0/CMP/MR1 V_VIN ok

    SYS/MB/CM0/CMP/MR2 VDD_IO ok

    SYS/MB/CM0/CMP/MR2 VDD_TERM           ok

    SYS/MB/CM0/CMP/MR2 VMEM ok

    SYS/MB/CM0/CMP/MR2 VTT ok

    SYS/MB/CM0/CMP/MR2 V_VCORE            ok

    SYS/MB/CM0/CMP/MR2 V_VIN ok

    SYS/MB/CM0/CMP/MR3 VDD_IO ok

    SYS/MB/CM0/CMP/MR3 VDD_TERM           ok

    SYS/MB/CM0/CMP/MR3 VMEM ok

    SYS/MB/CM0/CMP/MR3 VTT ok

    SYS/MB/CM0/CMP/MR3 V_VCORE            ok

    SYS/MB/CM0/CMP/MR3 V_VIN ok

    SYS/MB/CM0/CMP V_VCORE            ok

    SYS/MB/CM0/CMP V_VNW ok

    SYS/MB/CM0/CMP V_VSB ok

    SYS/MB/CM0 V_+1V0_OBPS0       ok

    SYS/MB/CM0 V_+1V0_OBPS1       ok

    SYS/MB/CM0 V_+1V0_OBPS2       ok

    SYS/MB/CM0 V_+1V5_OBPS        ok

    SYS/MB/SP V_+1V0 ok

    SYS/MB/SP V_+1V5 ok

    SYS/MB/SP V_+1V8 ok

    SYS/MB/SP V_+3V3 ok

    SYS/MB V_+0V8_XGBE0       ok

    SYS/MB V_+0V8_XGBE1       ok

    SYS/MB V_+0V67_XGBE0      ok

    SYS/MB V_+0V67_XGBE1      ok

    SYS/MB V_+1V0_SAS0        ok

    SYS/MB V_+1V0_SAS0_OBPS   ok

    SYS/MB V_+1V0_SAS1        ok

    SYS/MB V_+1V0_SAS1_OBPS   ok

    SYS/MB V_+1V0_SW0 ok

    SYS/MB V_+1V0_SW1         ok

    SYS/MB V_+1V0_USB         ok

    SYS/MB V_+1V2_XGBE0       ok

    SYS/MB V_+1V2_XGBE1       ok

    SYS/MB V_+1V8_SAS0        ok

    SYS/MB V_+1V8_SAS1        ok

    SYS/MB V_+1V8_SW0         ok

    SYS/MB V_+1V8_SW1         ok

    SYS/MB V_+2V5_XGBE0       ok

    SYS/MB V_+2V5_XGBE1       ok

    SYS/MB V_+3V3_MAIN        ok

    SYS/MB V_+5V0_USB         ok

    SYS/MB V_+12_CM ok

    SYS/MB V_VBAT             ok

    SYS/PS0 V_+3V3 ok

    SYS/PS0 V_+12V ok

    SYS/PS0 V_IN ok

    SYS/PS1 V_+3V3 ok

    SYS/PS1 V_+12V ok

    SYS/PS1 V_IN ok

    LEDs:

    ----------------------------------------------------------------

    Location LED State

    ----------------------------------------------------------------

    SYS CPU_FAULT          off

    SYS/FANBD/F0 OK steady

    SYS/FANBD/F0 SERVICE off

    SYS/FANBD/F1 OK steady

    SYS/FANBD/F1 SERVICE            off

    SYS/FANBD/F2 OK steady

    SYS/FANBD/F2 SERVICE            off

    SYS/FANBD/F3 OK steady

    SYS/FANBD/F3 SERVICE            off

    SYS/FANBD/F4 OK steady

    SYS/FANBD/F4 SERVICE            off

    SYS/FANBD/F5 OK steady

    SYS/FANBD/F5 SERVICE            off

    SYS FAN_FAULT          off

    SYS LOCATE off

    SYS/MB/CM0/CMP/MR0/BOB0/CH0/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR0/BOB0/CH1/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR0/BOB1/CH0/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR0/BOB1/CH1/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR0 SERVICE            off

    SYS/MB/CM0/CMP/MR1/BOB0/CH0/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR1/BOB0/CH1/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR1/BOB1/CH0/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR1/BOB1/CH1/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR1 SERVICE            off

    SYS/MB/CM0/CMP/MR2/BOB0/CH0/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR2/BOB0/CH1/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR2/BOB1/CH0/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR2/BOB1/CH1/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR2 SERVICE            off

    SYS/MB/CM0/CMP/MR3/BOB0/CH0/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR3/BOB0/CH1/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR3/BOB1/CH0/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR3/BOB1/CH1/D0 SERVICE            off

    SYS/MB/CM0/CMP/MR3 SERVICE            off

    SYS MEMORY_FAULT       off

    SYS OK steady

    SYS PS_FAULT           off

    SYS/SASBP/HDD0 OK2RM off

    SYS/SASBP/HDD0 SERVICE            off

    SYS SERVICE            steady

    SYS SP_OK steady

    SYS TEMP_FAULT         off

    ============================ FRU Status ============================

    Location Name      Status

    ------------------------------------------------------

    SYS FANBD     enabled

    SYS/FANBD F0        enabled

    SYS/FANBD F1        enabled

    SYS/FANBD F2        enabled

    SYS/FANBD F3 enabled

    SYS/FANBD F4        enabled

    SYS/FANBD F5        enabled

    SYS MB        enabled

    SYS/MB BAT       enabled

    SYS/MB/CM0/CMP MR0 enabled

    SYS/MB/CM0/CMP/MR0/BOB0/CH0 D0        enabled

    SYS/MB/CM0/CMP/MR0/BOB0/CH1 D0        enabled

    SYS/MB/CM0/CMP/MR0/BOB1/CH0 D0        enabled

    SYS/MB/CM0/CMP/MR0/BOB1/CH1 D0        enabled

    SYS/MB/CM0/CMP MR1       enabled

    SYS/MB/CM0/CMP/MR1/BOB0/CH0 D0        enabled

    SYS/MB/CM0/CMP/MR1/BOB0/CH1 D0        enabled

    SYS/MB/CM0/CMP/MR1/BOB1/CH0 D0        enabled

    SYS/MB/CM0/CMP/MR1/BOB1/CH1 D0        enabled

    SYS/MB/CM0/CMP MR2       enabled

    SYS/MB/CM0/CMP/MR2/BOB0/CH0 D0        enabled

    SYS/MB/CM0/CMP/MR2/BOB0/CH1 D0        enabled

    SYS/MB/CM0/CMP/MR2/BOB1/CH0 D0        enabled

    SYS/MB/CM0/CMP/MR2/BOB1/CH1 D0        enabled

    SYS/MB/CM0/CMP MR3       enabled

    SYS/MB/CM0/CMP/MR3/BOB0/CH0 D0        enabled

    SYS/MB/CM0/CMP/MR3/BOB0/CH1 D0        enabled

    SYS/MB/CM0/CMP/MR3/BOB1/CH0 D0        enabled

    SYS/MB/CM0/CMP/MR3/BOB1/CH1 D0        enabled

    SYS/MB SCC       enabled

    SYS/MB SP        enabled

    SYS PS0       enabled

    SYS PS1       enabled

    SYS SASBP enabled

    SYS/SASBP DVD       enabled

    SYS/SASBP HDD0      enabled

    ============================ FW Version ============================

    Version

    ------------------------------------------------------------

    Sun System Firmware 9.2.1.b 2014/07/11 14:46

    ====================== System PROM revisions =======================

    Version

    ------------------------------------------------------------

    OBP 4.36.1 2014/06/26 12:20

  • Jens
    Jens Member Posts: 91 Blue Ribbon
    edited Oct 31, 2018 1:30PM

    Hi,

    I started hating myself before beginning to actually type this as it does not contribute to the analysis part of your problem but have you tried to turn the led off using ipmi, e.g. giving

    ipmitool sunoem sbled set SERVICE off

    Just in case you postponed it while heading to fm shell and alike: Did you check the system event log entries for unusual events?

    Best regards

    Jens

  • 1893556
    1893556 Member Posts: 8
    edited Jan 3, 2019 7:23PM

    Jens,

    Sorry it has taken me so long to respond, it has been busy leading up to the holiday season. Thanks too for your response.

    I have been able to look at the servers again and they still exhibit the problem as before. I have tried your ipmitool command as suggested to at least see if the light can be turned off manually, but I get this response:

      # ipmitool sunoem sbled set SERVICE off

      Sun OEM Set LED command failed: Insufficient privilege level

    I have tried various -L and -U options (but probably not the right syntax), but nothing appears to work. Is there something else I need to do to get this type of command to work? And will the light still turn on upon another fault still?

    And to answer your other question, I have looked at the event logs and nothing jumps out at me as wrong either.

    Thanks for showing interest

  • Jens
    Jens Member Posts: 91 Blue Ribbon
    edited Jan 9, 2019 12:11PM

    Hi,

    my fault. The suggested command was derived by analogy rather than field tested for that specific led. Again just a guess (failed to find some documentation on it) but I would not be entirely astonished if 'SERVICE'  is restricted to service personnel with elevated privileges on the ilom (cros/'service' or aucro/'admin' roles do not seem to be enough):

    ~#  /sbin/ipmitool -U <sp-user> -a sunoem sbled set LOCATE off

    LOCATE           | OFF

    ~# /sbin/ipmitool -U <sp-user> -a sunoem sbled set SERVICE off

    Password:

    Sun OEM Set LED command failed: Insufficient privilege level

    Best regards

    Jens