This discussion is archived
5 Replies Latest reply: Apr 25, 2013 8:10 AM by DarrenMoffat RSS

T4-1: panic occurred in module "genunix" due to a NULL pointer dereference

908246 Newbie
Currently Being Moderated
I have (2) SPARC T4-1 Systems. They were transported and brought online and both of them are behaving the same. On boot, they panic and reboot.

--- OUTPUT BELOW (repeats)


[CPU 0:0:0] NOTICE: Configuring MDs
[CPU 0:0:0] NOTICE: Loading PRI template
[CPU 0:0:0] NOTICE: Configuring PRI
[CPU 0:0:0] NOTICE: Product serial number: 1227BDY4F2
[CPU 0:0:0] NOTICE: Product part number: 30904337+1+1
[CPU 0:0:0] NOTICE: Storing PRI to memory
[CPU 0:0:0] NOTICE: Booting config = base1
[CPU 0:0:0] NOTICE: Storing PRI to data flash ("factory-default")
[CPU 0:0:0] NOTICE: Storing mini MD to data flash ("factory-default")
[CPU 0:0:0] NOTICE: Updating Config Information for Guest Manager
[CPU 0:0:0] NOTICE: Jumping to hypervisor
Hypervisor version: @(#)Hypervisor 1.11.0.b 2012/05/23 15:38



SPARC T4-1, No Keyboard
Copyright (c) 1998, 2012, Oracle and/or its affiliates. All rights reserved.
OpenBoot 4.34.0, 8192 MB memory available, Serial #101500076.
Ethernet address 0:10:e0:c:c4:ac, Host ID: 860cc4ac.



Boot device: disk File and args:
SunOS Release 5.11 Version 11.0 64-bit
Copyright (c) 1983, 2011, Oracle and/or its affiliates. All rights reserved.
WARNING: ixgbe2: failed callback (action=1, ret=-1)

WARNING: ixgbe2: failed to release interrupts (nintrs=16, navail=15).

WARNING: ixgbe2: failed callback (action=1, ret=-1)

WARNING: ixgbe2: failed to release interrupts (nintrs=16, navail=13).


panic[cpu11]/thread=2a100fcdc60: BAD TRAP: type=31 rp=2a100fcd410 addr=0 mmu_fsr=0 occurred in module "genunix" due to a NULL pointer dereference

sched: trap type = 0x31
pid=0, pc=0x118b4c0, sp=0x2a100fcccb1, tstate=0x9980001602, context=0x0
g1-g7: 7bf27e70, 300081ff768, 300081ff760, 8, 1, 0, 2a100fcdc60

000002a100fcd160 unix:die+7c (31, 2a100fcd410, 0, 0, 0, 10d5800)
%l0-3: 0000000000000031 0000000001000000 0000000000002000 00000000010d58c8
%l4-7: 00000000010d5800 0000000000000000 0000000000000005 000002a100fcd220
000002a100fcd240 unix:trap+9a0 (2a100fcd410, 1c00, c0700000, 5, 0, 1)
%l0-3: 00000000c1680000 0000000000000031 00000000018a62c0 00000000c1780000
%l4-7: 0000000000000001 0000000000000000 00000000d472e000 0000000000000000
000002a100fcd360 unix:ktl0+64 (6001ad3efa0, 6001ad3d098, 6001ad3d098, 0, 6001ad3efb0, 0)
%l0-3: 0000030007a3c000 0000000000000058 0000009980001602 000000000101ea40
%l4-7: 0000000000000000 ffffffffffffffff 0000000000000000 000002a100fcd410
000002a100fcd4b0 genunix:numaio_group_add_object+98 (6001ad3ef80, 6001ad3d098, 1, 1, 1957c00, 1)
%l0-3: 0000000000000001 0000000000000000 0000000000040000 00000000ff800000
%l4-7: 0000000001957e88 0000000002000000 0000029ebc78e000 00000000000061e8
000002a100fcd560 mac:mac_cpu_intr_modify+1c (6001ad3ea80, 6001bb55ac0, 6001bb55ac0, 60015466d28, 7bf35c00, 0)
%l0-3: 0000000000007c00 000000008000ffff 0000000000000000 0000000000007de4
%l4-7: 0000000000007c00 0000029ebc78e000 0000000000000001 000006001bb55ac0
000002a100fcd610 mac:mac_ring_intr_set+ac (6001bb55ac0, 600155c0aa8, 0, 0, 6001afab6c0, 0)
%l0-3: 0000000000000008 0000000000001670 0000000000007c98 0000000000000002
%l4-7: 0000000000000001 0000000000001400 0000000000001628 ffffffffffffffff
000002a100fcd6c0 ixgbe:ixgbe_intr_adjust+4f4 (0, 3eadf, 60015ebb080, 60019b7c000, 6001594a080, 1630)
%l0-3: 0000060019b7d838 0000000000001820 0000000000000001 0000000000000000
%l4-7: 0000000000000000 000006001594a080 0000000000001628 0000000000001400
000002a100fcd790 ixgbe:ixgbe_cb_func+44 (1400, 1, 4, 60019b7c000, 0, 10)
%l0-3: 00000300062fc2f8 ffffffffffffffff 0000000000000004 0000000000000010
%l4-7: ffffffffffffffff 0000000000000001 0000000000000010 00000000000017fc
000002a100fcd840 genunix:i_ddi_irm_notify+74 (300062fc290, 600155d6550, c, 1, 600155d6588, 38)
%l0-3: 000000000000000c 0000000000000004 0000000000000000 000002a101841c60
%l4-7: 0000002145434e1c 0000000000000004 0000000000000001 0000000000000010
000002a100fcd8f0 genunix:i_ddi_irm_balance+e8 (300062fc290, 0, 176f, 300062fc2d8, 600155d6550, 300062fc2f8)
%l0-3: 00000300062fc2b8 0000000000000010 00000000019930a0 0000000000000000
%l4-7: 0000030007a38000 0000000001991418 0000000001991400 00000000000001c8
000002a100fcd9a0 genunix:irm_balance_thread+b8 (300062fc290, 7, 1, 11, 300062fc2b0, 1939b4c)
%l0-3: 00000300062fc2c0 000000000000003c 00000000000e4de0 000000000001c9bc
%l4-7: 0000000000000ec4 000000000001d880 0000000000000f00 0000000000000003

syncing file systems... done
dumping to /dev/zvol/dsk/rpool/dump, offset 65536, content: kernel
0:02 100% done
100% done: 187691 pages dumped, dump succeeded
rebooting...
Resetting...


SPARC T4-1, No Keyboard
Copyright (c) 1998, 2012, Oracle and/or its affiliates. All rights reserved.
OpenBoot 4.34.0, 8192 MB memory available, Serial #101500076.
Ethernet address 0:10:e0:c:c4:ac, Host ID: 860cc4ac.



Boot device: disk File and args:
SunOS Release 5.11 Version 11.0 64-bit
Copyright (c) 1983, 2011, Oracle and/or its affiliates. All rights reserved.
WARNING: ixgbe2: failed callback (action=1, ret=-1)

WARNING: ixgbe2: failed to release interrupts (nintrs=16, navail=15).

WARNING: ixgbe2: failed callback (action=1, ret=-1)

WARNING: ixgbe2: failed to release interrupts (nintrs=16, navail=13).


panic[cpu2]/thread=2a102245c60: BAD TRAP: type=31 rp=2a102245410 addr=0 mmu_fsr=0 occurred in module "genunix" due to a NULL pointer dereference

sched: trap type = 0x31
pid=0, pc=0x118b4c0, sp=0x2a102244cb1, tstate=0x9980001602, context=0x0
g1-g7: 7bf27e70, 300070de6f8, 300070de6e0, 18, 3, 10, 2a102245c60

000002a102245160 unix:die+7c (31, 2a102245410, 0, 0, 0, 10d5800)
%l0-3: 0000000000000031 0000000001000000 0000000000002000 00000000010d58c8
%l4-7: 00000000010d5800 0000000000000000 0000000000000005 000002a102245220
000002a102245240 unix:trap+9a0 (2a102245410, 1c00, c0700000, 5, 0, 1)
%l0-3: 00000000c1680000 0000000000000031 00000000018a62c0 00000000c1780000
%l4-7: 0000000000000001 0000000000000000 00000000d472e000 0000000000000000
000002a102245360 unix:ktl0+64 (6001a7a2fa0, 6001a7a1098, 6001a7a1098, 0, 6001a7a2fb0, 0)
%l0-3: 0000030007a02000 0000000000000010 0000009980001602 000000000101ea40
%l4-7: 0000000000000000 ffffffffffffffff 0000000000000000 000002a102245410
000002a1022454b0 genunix:numaio_group_add_object+98 (6001a7a2f80, 6001a7a1098, 1, 1, 1957c00, 1)
%l0-3: 0000000000000002 0000030007a02000 0000000000000001 0000030007a4a000
%l4-7: 0000000001957e88 0000000000000070 0000000000000001 0000000000000002
000002a102245560 mac:mac_cpu_intr_modify+1c (6001a7a2a80, 6001c373ac0, 6001c373ac0, 600184688f8, 7bf35c00, 0)
%l0-3: 0000060012e9b450 ffffffffffffffff 0000000000000000 0000000000000000
%l4-7: 0000030007a02000 0000018306a3d35a 0000000000000001 000006001c373ac0
000002a102245610 mac:mac_ring_intr_set+ac (6001c373ac0, 60016b1a7a8, 0, 0, 6001b9df6c0, 0)
%l0-3: 0000000000000002 000000000198f000 0000000000000000 0000000000000002
%l4-7: 0000000000000001 0000000000001400 0000000000001628 ffffffffffffffff
000002a1022456c0 ixgbe:ixgbe_intr_adjust+4f4 (0, 3eadf, 600153ffe00, 6001a5a8000, 60016a3e940, 1630)
%l0-3: 000006001a5a9838 0000000000001820 0000000000000001 0000000000000000
%l4-7: 0000000000000000 0000060016a3e940 0000000000001628 0000000000001400
000002a102245790 ixgbe:ixgbe_cb_func+44 (1400, 1, 4, 6001a5a8000, 0, 10)
%l0-3: 00000300062fc2f8 ffffffffffffffff 0000000000000004 0000000000000010
%l4-7: ffffffffffffffff 0000000000000001 0000000000000010 00000000000017fc
000002a102245840 genunix:i_ddi_irm_notify+74 (300062fc290, 6001a0661e8, c, 1, 6001a066220, 38)
%l0-3: 000000000000000c 0000000000000004 0000000000000000 000002a1013d9c60
%l4-7: 0000003fe16f53ee 0000000000000004 0000000000000001 0000000000000010
000002a1022458f0 genunix:i_ddi_irm_balance+e8 (300062fc290, 0, 176f, 300062fc2d8, 6001a0661e8, 300062fc2f8)
%l0-3: 00000300062fc2b8 0000000000000010 00000000019930a0 0000000000000000
%l4-7: 0000030007a02000 0000000001991418 0000000001991400 00000000000001c8
000002a1022459a0 genunix:irm_balance_thread+b8 (300062fc290, 7, 1, 11, 300062fc2b0, 1939b4c)
%l0-3: 00000300062fc2c0 000000000000003c 00000000000e4de0 000000000001c9bc
%l4-7: 0000000000000ec4 000000000001d880 0000000000000f00 0000000000000003

syncing file systems... done
dumping to /dev/zvol/dsk/rpool/dump, offset 65536, content: kernel
0:02 100% done
100% done: 187716 pages dumped, dump succeeded
rebooting...
Resetting...


SPARC T4-1, No Keyboard
Copyright (c) 1998, 2012, Oracle and/or its affiliates. All rights reserved.
OpenBoot 4.34.0, 8192 MB memory available, Serial #101500076.
Ethernet address 0:10:e0:c:c4:ac, Host ID: 860cc4ac.



Boot device: disk File and args:
SunOS Release 5.11 Version 11.0 64-bit
Copyright (c) 1983, 2011, Oracle and/or its affiliates. All rights reserved.
WARNING: ixgbe2: failed callback (action=1, ret=-1)

WARNING: ixgbe2: failed to release interrupts (nintrs=16, navail=15).

WARNING: ixgbe2: failed callback (action=1, ret=-1)

WARNING: ixgbe2: failed to release interrupts (nintrs=16, navail=13).


panic[cpu11]/thread=2a101339c60: BAD TRAP: type=31 rp=2a101339410 addr=0 mmu_fsr=0 occurred in module "genunix" due to a NULL pointer dereference

sched: trap type = 0x31
pid=0, pc=0x118b4c0, sp=0x2a101338cb1, tstate=0x9980001603, context=0x0
g1-g7: 7bf27e70, 30008343cd8, 30008343cc0, 18, 3, 0, 2a101339c60

000002a101339160 unix:die+7c (31, 2a101339410, 0, 0, 0, 10d5800)
%l0-3: 0000000000000031 0000000001000000 0000000000002000 00000000010d58c8
%l4-7: 00000000010d5800 0000000000000000 0000000000000005 000002a101339220
000002a101339240 unix:trap+9a0 (2a101339410, 1c00, c0700000, 5, 0, 1)
%l0-3: 00000000c1680000 0000000000000031 00000000018a62c0 00000000c1780000
%l4-7: 0000000000000001 0000000000000000 00000000d472e000 0000000000000000
000002a101339360 unix:ktl0+64 (6001b0fafa0, 6001b0f9098, 6001b0f9098, 0, 6001b0fafb0, 0)
%l0-3: 0000030007a3c000 0000000000000058 0000009980001603 000000000101ea40
%l4-7: 0000000000000000 ffffffffffffffff 0000000000000000 000002a101339410
000002a1013394b0 genunix:numaio_group_add_object+98 (6001b0faf80, 6001b0f9098, 1, 1, 1957c00, 1)
%l0-3: 000000000000000b 0000030007a3c000 0000000000000001 0000030007a06000
%l4-7: 0000000001957e88 0000000000000010 0000000000000001 000000000000000b
000002a101339560 mac:mac_cpu_intr_modify+1c (6001b0faa80, 6001bf83ac0, 6001bf83ac0, 6001888ec78, 7bf35c00, 0)
%l0-3: 000006001635cd98 ffffffffffffffff 0000000000000000 0000000000000000
%l4-7: 0000030007a3c000 000001830689974a 0000000000000001 000006001bf83ac0
000002a101339610 mac:mac_ring_intr_set+ac (6001bf83ac0, 60016309368, 0, 0, 6001b6a96c0, 0)
%l0-3: 0000000000000001 000000000198f000 0000000000000000 0000000000000002
%l4-7: 0000000000000001 0000000000001400 0000000000001628 ffffffffffffffff
000002a1013396c0 ixgbe:ixgbe_intr_adjust+4f4 (0, 3eadf, 60017ba5180, 60019f26000, 6001637f200, 1630)
%l0-3: 0000060019f27838 0000000000001820 0000000000000001 0000000000000000
%l4-7: 0000000000000000 000006001637f200 0000000000001628 0000000000001400
000002a101339790 ixgbe:ixgbe_cb_func+44 (1400, 1, 4, 60019f26000, 0, 10)
%l0-3: 00000300062fc2f8 ffffffffffffffff 0000000000000004 0000000000000010
%l4-7: ffffffffffffffff 0000000000000001 0000000000000010 00000000000017fc
000002a101339840 genunix:i_ddi_irm_notify+74 (300062fc290, 60017857c20, c, 1, 60017857c58, 38)
%l0-3: 000000000000000c 0000000000000004 0000000000000000 000002a1018c1c60
%l4-7: 0000005e8e1ee0aa 0000000000000004 0000000000000001 0000000000000010
000002a1013398f0 genunix:i_ddi_irm_balance+e8 (300062fc290, 0, 176f, 300062fc2d8, 60017857c20, 300062fc2f8)
%l0-3: 00000300062fc2b8 0000000000000010 00000000019930a0 0000000000000000
%l4-7: 0000030007a3c000 0000000001991418 0000000001991400 00000000000001c8
000002a1013399a0 genunix:irm_balance_thread+b8 (300062fc290, 7, 1, 11, 300062fc2b0, 1939b4c)
%l0-3: 00000300062fc2c0 000000000000003c 00000000000e4de0 000000000001c9bc
%l4-7: 0000000000000ec4 000000000001d880 0000000000000f00 0000000000000003

syncing file systems... done
dumping to /dev/zvol/dsk/rpool/dump, offset 65536, content: kernel
0:02 100% done
100% done: 187712 pages dumped, dump succeeded
rebooting...
Resetting...


SPARC T4-1, No Keyboard
Copyright (c) 1998, 2012, Oracle and/or its affiliates. All rights reserved.
OpenBoot 4.34.0, 8192 MB memory available, Serial #101500076.
Ethernet address 0:10:e0:c:c4:ac, Host ID: 860cc4ac.



Boot device: disk File and args:
SunOS Release 5.11 Version 11.0 64-bit
Copyright (c) 1983, 2011, Oracle and/or its affiliates. All rights reserved.
WARNING: ixgbe2: failed callback (action=1, ret=-1)

WARNING: ixgbe2: failed to release interrupts (nintrs=16, navail=15).

WARNING: ixgbe2: failed callback (action=1, ret=-1)

WARNING: ixgbe2: failed to release interrupts (nintrs=16, navail=13).


panic[cpu4]/thread=2a10281dc60: BAD TRAP: type=31 rp=2a10281d410 addr=0 mmu_fsr=0 occurred in module "genunix" due to a NULL pointer dereference

sched: trap type = 0x31
pid=0, pc=0x118b4c0, sp=0x2a10281ccb1, tstate=0x9980001602, context=0x0
g1-g7: 7bf27e70, 300082a1188, 300082a1180, 8, 1, 1c, 2a10281dc60

000002a10281d160 unix:die+7c (31, 2a10281d410, 0, 0, 0, 10d5800)
%l0-3: 0000000000000031 0000000001000000 0000000000002000 00000000010d58c8
%l4-7: 00000000010d5800 0000000000000000 0000000000000005 000002a10281d220
000002a10281d240 unix:trap+9a0 (2a10281d410, 1c00, c0700000, 5, 0, 1)
%l0-3: 00000000c1680000 0000000000000031 00000000018a62c0 00000000c1780000
%l4-7: 0000000000000001 0000000000000000 00000000d472e000 0000000000000000
000002a10281d360 unix:ktl0+64 (6001bc72fa0, 6001bc70db8, 6001bc70db8, 0, 6001bc72fb0, 0)
%l0-3: 0000030007a14000 0000000000000020 0000009980001602 000000000101ea40
%l4-7: 0000000000000000 ffffffffffffffff 0000000000000000 000002a10281d410
000002a10281d4b0 genunix:numaio_group_add_object+98 (6001bc72f80, 6001bc70db8, 1, 1, 1957c00, 1)
%l0-3: 0000000000000004 0000030007a14000 0000000000000001 0000030007a3c000
%l4-7: 0000000001957e88 0000000000000058 0000000000000001 0000000000000004
000002a10281d560 mac:mac_cpu_intr_modify+1c (6001bc72a80, 6001cecfac0, 6001cecfac0, 6001471a010, 7bf35c00, 0)
%l0-3: 0000060010833840 ffffffffffffffff 0000000000000000 0000000000000000
%l4-7: 0000030007a14000 000001830520b31a 0000000000000001 000006001cecfac0
000002a10281d610 mac:mac_ring_intr_set+ac (6001cecfac0, 6001a058b98, 0, 0, 6001be976c0, 0)
%l0-3: 0000000000000002 000000000198f000 0000000000000000 0000000000000002
%l4-7: 0000000000000001 0000000000001400 0000000000001628 ffffffffffffffff
000002a10281d6c0 ixgbe:ixgbe_intr_adjust+4f4 (0, 3eadf, 60014645900, 600145a0000, 60014d636c0, 1630)
%l0-3: 00000600145a1838 0000000000001820 0000000000000001 0000000000000000
%l4-7: 0000000000000000 0000060014d636c0 0000000000001628 0000000000001400
000002a10281d790 ixgbe:ixgbe_cb_func+44 (1400, 1, 4, 600145a0000, 0, 10)
%l0-3: 00000300062fc2f8 ffffffffffffffff 0000000000000004 0000000000000010
%l4-7: ffffffffffffffff 0000000000000001 0000000000000010 00000000000017fc
000002a10281d840 genunix:i_ddi_irm_notify+74 (300062fc290, 6001a342ed0, c, 1, 6001a342f08, 38)
%l0-3: 000000000000000c 0000000000000004 0000000000000000 000002a1014dfc60
%l4-7: 0000007d519ee0d4 0000000000000004 0000000000000001 0000000000000010
000002a10281d8f0 genunix:i_ddi_irm_balance+e8 (300062fc290, 0, 176f, 300062fc2d8, 6001a342ed0, 300062fc2f8)
%l0-3: 00000300062fc2b8 0000000000000010 00000000019930a0 0000000000000000
%l4-7: 0000030007a08000 0000000001991418 0000000001991400 00000000000001c8
000002a10281d9a0 genunix:irm_balance_thread+b8 (300062fc290, 7, 1, 11, 300062fc2b0, 1939b4c)
%l0-3: 00000300062fc2c0 000000000000003c 00000000000e4de0 000000000001c9bc
%l4-7: 0000000000000ec4 000000000001d880 0000000000000f00 0000000000000003

syncing file systems... done
dumping to /dev/zvol/dsk/rpool/dump, offset 65536, content: kernel
0:02 100% done
100% done: 187914 pages dumped, dump succeeded
rebooting...
Resetting...


SPARC T4-1, No Keyboard
Copyright (c) 1998, 2012, Oracle and/or its affiliates. All rights reserved.
OpenBoot 4.34.0, 8192 MB memory available, Serial #101500076.
Ethernet address 0:10:e0:c:c4:ac, Host ID: 860cc4ac.



Boot device: disk File and args:
SunOS Release 5.11 Version 11.0 64-bit
Copyright (c) 1983, 2011, Oracle and/or its affiliates. All rights reserved.
WARNING: ixgbe2: failed callback (action=1, ret=-1)

WARNING: ixgbe2: failed to release interrupts (nintrs=16, navail=15).

WARNING: ixgbe2: failed callback (action=1, ret=-1)

WARNING: ixgbe2: failed to release interrupts (nintrs=16, navail=13).


panic[cpu0]/thread=2a101339c60: BAD TRAP: type=31 rp=2a101339410 addr=0 mmu_fsr=0 occurred in module "genunix" due to a NULL pointer dereference

sched: trap type = 0x31
pid=0, pc=0x118b4c0, sp=0x2a101338cb1, tstate=0x9980001606, context=0x0
g1-g7: 7bf27e70, 300082dd7a8, 300082dd7a0, 8, 1, 1c, 2a101339c60

000002a101339160 unix:die+7c (31, 2a101339410, 0, 0, 0, 10d5800)
%l0-3: 0000000000000031 0000000001000000 0000000000002000 00000000010d58c8
%l4-7: 00000000010d5800 0000000000000000 0000000000000005 000002a101339220
000002a101339240 unix:trap+9a0 (2a101339410, 1c00, c0700000, 5, 0, 1)
%l0-3: 00000000c1680000 0000000000000031 00000000018a62c0 00000000c1780000
%l4-7: 0000000000000001 0000000000000000 00000000d472e000 0000000000000000
000002a101339360 unix:ktl0+64 (6001a60cfa0, 6001a60b098, 6001a60b098, 0, 6001a60cfb0, 0)
%l0-3: 000000000180c000 0000000000000000 0000009980001606 000000000101ea40
%l4-7: 0000000000000000 ffffffffffffffff 0000000000000000 000002a101339410
000002a1013394b0 genunix:numaio_group_add_object+98 (6001a60cf80, 6001a60b098, 1, 1, 1957c00, 1)
%l0-3: 0000000000000000 000000000180c000 0000000000000001 0000030007a50000
%l4-7: 0000000001957e88 0000000000000078 0000000000000001 0000000000000000
000002a101339560 mac:mac_cpu_intr_modify+1c (6001a60ca80, 6001c0bbac0, 6001c0bbac0, 600169ee488, 7bf35c00, 0)
%l0-3: 0000060016593198 ffffffffffffffff 0000000000000000 0000000000000000
%l4-7: 000000000180c000 00000183069d669a 0000000000000001 000006001c0bbac0
000002a101339610 mac:mac_ring_intr_set+ac (6001c0bbac0, 600165b0fe8, 0, 0, 6001a7a16c0, 0)
%l0-3: 0000000000000002 000000000198f000 0000000000000000 0000000000000002
%l4-7: 0000000000000001 0000000000001400 0000000000001628 ffffffffffffffff
000002a1013396c0 ixgbe:ixgbe_intr_adjust+4f4 (0, 3eadf, 600151f1e00, 6001a410000, 600146c0480, 1630)
%l0-3: 000006001a411838 0000000000001820 0000000000000001 0000000000000000
%l4-7: 0000000000000000 00000600146c0480 0000000000001628 0000000000001400
000002a101339790 ixgbe:ixgbe_cb_func+44 (1400, 1, 4, 6001a410000, 0, 10)
%l0-3: 00000300062fc2f8 ffffffffffffffff 0000000000000004 0000000000000010
%l4-7: ffffffffffffffff 0000000000000001 0000000000000010 00000000000017fc
000002a101339840 genunix:i_ddi_irm_notify+74 (300062fc290, 6001a32ee18, c, 1, 6001a32ee50, 38)
%l0-3: 000000000000000c 0000000000000004 0000000000000000 000002a101aebc60
%l4-7: 0000009bf848ad34 0000000000000004 0000000000000001 0000000000000010
000002a1013398f0 genunix:i_ddi_irm_balance+e8 (300062fc290, 0, 176f, 300062fc2d8, 6001a32ee18, 300062fc2f8)
%l0-3: 00000300062fc2b8 0000000000000010 00000000019930a0 0000000000000000
%l4-7: 0000030007a50000 0000000001991418 0000000001991400 00000000000001c8
000002a1013399a0 genunix:irm_balance_thread+b8 (300062fc290, 7, 1, 11, 300062fc2b0, 1939b4c)
%l0-3: 00000300062fc2c0 000000000000003c 00000000000e4de0 000000000001c9bc
%l4-7: 0000000000000ec4 000000000001d880 0000000000000f00 0000000000000003

syncing file systems... done
dumping to /dev/zvol/dsk/rpool/dump, offset 65536, content: kernel
0:02 100% done
100% done: 187700 pages dumped, dump succeeded
rebooting...
Resetting...


SPARC T4-1, No Keyboard
Copyright (c) 1998, 2012, Oracle and/or its affiliates. All rights reserved.
OpenBoot 4.34.0, 8192 MB memory available, Serial #101500076.
Ethernet address 0:10:e0:c:c4:ac, Host ID: 860cc4ac.



Boot device: disk File and args:
SunOS Release 5.11 Version 11.0 64-bit
Copyright (c) 1983, 2011, Oracle and/or its affiliates. All rights reserved.
\
panic[cpu6]/thread=2a1021e5c60: BAD TRAP: type=31 rp=2a1021e5410 addr=0 mmu_fsr=0 occurred in module "genunix" due to a NULL pointer dereference

sched: trap type = 0x31
pid=0, pc=0x118b4c0, sp=0x2a1021e4cb1, tstate=0x9980001604, context=0x0
g1-g7: 7bf27e70, 300082975b8, 300082975a0, 18, 3, 0, 2a1021e5c60

000002a1021e5160 unix:die+7c (31, 2a1021e5410, 0, 0, 0, 10d5800)
%l0-3: 0000000000000031 0000000001000000 0000000000002000 00000000010d58c8
%l4-7: 00000000010d5800 0000000000000000 0000000000000005 000002a1021e5220
000002a1021e5240 unix:trap+9a0 (2a1021e5410, 1c00, c0700000, 5, 0, 1)
%l0-3: 00000000c1680000 0000000000000031 00000000018a62c0 00000000c1780000
%l4-7: 0000000000000001 0000000000000000 00000000d472e000 0000000000000000
000002a1021e5360 unix:ktl0+64 (600148b6060, 6001bbfd710, 6001bbfd710, 0, 600148b6070, 0)
%l0-3: 0000030007a1c000 0000000000000030 0000009980001604 000000000101ea40
%l4-7: 0000000000000000 ffffffffffffffff 0000000000000000 000002a1021e5410
000002a1021e54b0 genunix:numaio_group_add_object+98 (600148b6040, 6001bbfd710, 1, 1, 1957c00, 1)
%l0-3: 0000000000000001 0000000000000000 0000000000040000 00000000ff800000
%l4-7: 0000000001957e88 0000000002000000 0000029ebc78e000 00000000000061e8
000002a1021e5560 mac:mac_cpu_intr_modify+1c (6001bc51480, 6001abbe680, 6001abbe680, 6001662a398, 7bf35c00, 0)
%l0-3: 0000000000007c00 000000008000ffff 0000000000000000 0000000000007de4
%l4-7: 0000000000007c00 0000029ebc78e000 0000000000000001 000006001abbe680
000002a1021e5610 mac:mac_ring_intr_set+ac (6001abbe680, 60016647220, 0, 0, 60014885180, 0)
%l0-3: 0000000000000008 0000000000001670 0000000000007c98 0000000000000002
%l4-7: 0000000000000001 0000000000001400 0000000000001628 ffffffffffffffff
000002a1021e56c0 ixgbe:ixgbe_intr_adjust+4f4 (80, 3eadf, 60016a8f700, 6001ac2e000, 6001521ea00, 1630)
%l0-3: 000006001ac2f838 0000000000001820 0000000000000002 0000000000000008
%l4-7: 0000000000000001 000006001521e980 0000000000001628 0000000000001400
000002a1021e5790 ixgbe:ixgbe_cb_func+44 (1400, 1, 2, 6001ac2e000, 0, f)
%l0-3: 00000300062fc2f8 ffffffffffffffff 0000000000000003 0000000000000010
%l4-7: ffffffffffffffff 0000000000000001 000000000000000f 00000000000017fc
000002a1021e5840 genunix:i_ddi_irm_notify+74 (300062fc290, 6001aa680a8, d, 1, 6001aa680e0, 38)
%l0-3: 000000000000000d 0000000000000002 0000000000000000 000002a1015e7c60
%l4-7: 000000ba8af1880e 0000000000000004 0000000000000001 000000000000000f
000002a1021e58f0 genunix:i_ddi_irm_balance+e8 (300062fc290, 0, 176f, 300062fc2d8, 6001aa680a8, 300062fc2f8)
%l0-3: 00000300062fc2b8 000000000000000f 00000000019930a0 0000000000000000
%l4-7: 0000030007a1c000 0000000001991418 0000000001991400 00000000000001c8
000002a1021e59a0 genunix:irm_balance_thread+b8 (300062fc290, 7, 1, 11, 300062fc2b0, 1939b4c)
%l0-3: 00000300062fc2c0 000000000000003c 00000000000e4de0 000000000001c9bc
%l4-7: 0000000000000ec4 000000000001d880 0000000000000f00 0000000000000003

syncing file systems... done
dumping to /dev/zvol/dsk/rpool/dump, offset 65536, content: kernel
0:02 100% done
100% done: 187812 pages dumped, dump succeeded
rebooting...
Resetting...
  • 1. Re: T4-1: panic occurred in module "genunix" due to a NULL pointer dereference
    cindys Pro
    Currently Being Moderated
    Hi,

    You are hitting a bug but I'm not sure which one yet.

    I have a few comments around your comment here:
    I have (2) SPARC T4-1 Systems. They were transported and brought online and both of them are behaving the same. On boot, they panic and reboot.
    1. Were either of these systems stable at some point? Did they run previous Solaris versions? Is the only difference that they
    were moved?
    2. Is this the Solaris 11 FCS release?
    3. You need to file a MOS service request.
    4. Do you have the crash dumps? I can guide you through this process if you need it, but MOS support might know what this problem is already.

    Thanks, Cindy
  • 2. Re: T4-1: panic occurred in module "genunix" due to a NULL pointer dereference
    827481 Newbie
    Currently Being Moderated
    Hi,

    the fastest path forward, if you have a support account with
    oracle/sun, is to open a service request (escalation in my days) ...

    the stack trace that you have attached, is a signature for
    the problem ... if it is a known bug, they can very quickly
    point you to a bug/patch ...

    hopefully you have enabled savecore(1m), which will then
    -- which will upon the next reboot -- copy the system's state,
    from the dump area, to crashdump files, that the engineers
    can analyze to find the problem.

    unless your problem's signature is [well-]known, most of
    us (at least me) on this list, will not likely to be of much help ...

    analyzing the crash dump, would require:

    1. disassembly of the functions in the stack trace,
    2. map that to the actual c source code for the functions,
    3. from there, either the problem is obvious, or
    4. dependency analysis of the contents of the register in
    question (from assignments, stack states etc),
    5. the escalation engineers will be able to tell you if
    it is a software or hardware problem ..

    or if you had previously used beadm(1m) to snapshot the
    OS, then at the grub menu, you can choose to boot
    a last snapshot.

    this may not remove the root-cause, but may get you up ...

    if even after booting a previous OS version, you
    still see the problem, then it is likely a HW problem..

    again, the crashdump, will have enough clues to
    pinpoint the faulty HW ...

    sorry, not much help; good luck,
    sam
  • 3. Re: T4-1: panic occurred in module "genunix" due to a NULL pointer dereference
    1005516 Newbie
    Currently Being Moderated
    This is a known Solaris 11 bug, that has been fixed.

    You need to request the fix via your normal Oracle service channels.
  • 4. Re: T4-1: panic occurred in module "genunix" due to a NULL pointer dereference
    user12869221 Newbie
    Currently Being Moderated
    This look like a known bug

    Bug 15782522 : SUNBT7157906 PANIC TRIGGERED BY IRM CALLBACK DURING AGGR SETUP

    which is only fixed in Solaris 11 Update 1 or later.

    There is no backport for Solaris 11 yet.

    Please open a SR with MOS to let Oracle Support to analyse the crash dump and to advise further action. Thanks.
  • 5. Re: T4-1: panic occurred in module "genunix" due to a NULL pointer dereference
    DarrenMoffat Explorer
    Currently Being Moderated
    Neither will there be a backport. The support train for Solaris 11 is continuous and cumulative . The Solaris 11 SRU train stopped when Solaris 11.1 came out and the SRU train continues there.

    If you are on Solaris 11 or Solaris 11 + SRUs you need to move to Solaris 11.1 or Solaris 11.1 to get fixes there will not be any more SRU's published to the /support repository for Solaris 11.

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points