We are oberving more frequent JVM crashes recently. The stack frame always points to retransformation workflow. Was not sure if this is a known issue with the JDK version I am using, or is there a fix/workaround for the same.
<p>
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00000036c7489a14, pid=19100, tid=0x00007fa677765700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_121-b13) (build 1.8.0_121-b13)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.121-b13 mixed mode linux-amd64 )
# Problematic frame:
# C [libc.so.6+0x89a14] memcpy+0x3a4
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
# http://bugreport.java.com/bugreport/crash.jsp
#
--------------- T H R E A D ---------------
Current thread (0x00007faa58024800): JavaThread "AD Thread Pool-Global278" daemon [_thread_in_vm, id=1025, stack(0x00007fa677665000,0x00007fa677766000)]
siginfo: si_signo: 11 (SIGSEGV), si_code: 2 (SEGV_ACCERR), si_addr: 0x00007fa6a25db000
Registers:
RAX=0x0000000000000000, RBX=0x00007faa814a87a8, RCX=0x0000000000b35a79, RDX=0x000000005bfd4ffa
RSP=0x00007fa677763398, RBP=0x00007fa677763420, RSI=0x00007fa6a25daff8, RDI=0x00007fac572abadc
R8 =0x0000000000000000, R9 =0x0000000000000041, R10=0x0000000000000000, R11=0x0000000000000000
R12=0x0000000000000000, R13=0x0000000000000000, R14=0x0000000000000000, R15=0x00007faa716d58d8
RIP=0x00000036c7489a14, EFLAGS=0x0000000000010203, CSGSFS=0x0000000000000033, ERR=0x0000000000000004
TRAPNO=0x000000000000000e
Top of Stack: (sp=0x00007fa677763398)
0x00007fa677763398: 00007fbcb694fcfb 00007fa6777633c0
0x00007fa6777633a8: 00007fa6a0035d74 00007faa58024800
0x00007fa6777633b8: 0000000000000000 00007fbcb723fc60
0x00007fa6777633c8: 00007faa716d58c0 00007faa58024800
0x00007fa6777633d8: 00007fbcb6964617 00007faa58024800
0x00007fa6777633e8: 00007faa580249f8 00007fbcb000b4f0
0x00007fa6777633f8: 0000000000000000 00007faa580249f8
0x00007fa677763408: 00007fbcb000b4f0 0000000000000001
0x00007fa677763418: 00007faa716d58c0 00007fa6777634a0
0x00007fa677763428: 00007fbcb5b3edfc 00007faa58024800
0x00007fa677763438: 0000000000000000 00007fa677763480
0x00007fa677763448: 00007faa716d58c8 00007faa716d58b8
0x00007fa677763458: 00007faa716d58d0 00007faa716d58d8
0x00007fa677763468: 00007fbcb000b510 0000000000000000
0x00007fa677763478: 00007fa6a0035d74 00007fbcb000b510
0x00007fa677763488: 00007faa580249f8 00007fa677763610
0x00007fa677763498: 00007fa67776361c 00007fa677763530
0x00007fa6777634a8: 00007fbcb5b3be06 00007fa65c078ffe
0x00007fa6777634b8: 00007fa6a0035d74 00007fa67776361c
0x00007fa6777634c8: 00007fa677763610 00007faa00000001
0x00007fa6777634d8: 5c078ffe1b2531d0 00007faa716d58c0
0x00007fa6777634e8: 00007faa64e3de00 00007faa716d58b8
0x00007fa6777634f8: 00007faa716d58c8 0000000000000000
0x00007fa677763508: 00007faa716d58c8 00007fa677763660
0x00007fa677763518: 00007faa58024800 00007faa716d58c0
0x00007fa677763528: 00007faa716d58b8 00007fa677763650
0x00007fa677763538: 00007fbcb6a23b65 00007fbc5c078ffe
0x00007fa677763548: 00007fa6a0035d74 00007fa67776361c
0x00007fa677763558: 00007fa677763610 00007fa6777635a0
0x00007fa677763568: 00007fa6777635a0 01007faa7107c7d0
0x00007fa677763578: 00007fbcb000bab0 00007fa677763d60
0x00007fa677763588: 00007faa64e3de00 00007faa6505bac0
Instructions: (pc=0x00000036c7489a14)
0x00000036c74899f4: 6c 24 e8 4c 89 64 24 e0 0f 1f 40 00 0f 18 86 00
0x00000036c7489a04: 03 00 00 0f 18 86 40 03 00 00 48 ff c9 48 8b 06
0x00000036c7489a14: 4c 8b 46 08 4c 8b 4e 10 4c 8b 56 18 4c 8b 5e 20
0x00000036c7489a24: 4c 8b 66 28 4c 8b 6e 30 4c 8b 76 38 48 0f c3 07
Register to memory mapping:
RAX=0x0000000000000000 is an unknown value
RBX=0x00007faa814a87a8 is pointing into metadata
RCX=0x0000000000b35a79 is an unknown value
RDX=0x000000005bfd4ffa is an unknown value
RSP=0x00007fa677763398 is pointing into the stack for thread: 0x00007faa58024800
RBP=0x00007fa677763420 is pointing into the stack for thread: 0x00007faa58024800
RSI=0x00007fa6a25daff8 is an unknown value
RDI=
[error occurred during error reporting (printing register info), id 0xb]
Stack: [0x00007fa677665000,0x00007fa677766000], sp=0x00007fa677763398, free space=1016k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C [libc.so.6+0x89a14] memcpy+0x3a4
C [libinstrument.so+0x4dfc] transformClassFile+0x12c
C [libinstrument.so+0x1e06] eventHandlerClassFileLoadHook+0x96
V [libjvm.so+0x7a4b65] JvmtiClassFileLoadHookPoster::post_to_env(JvmtiEnv*, bool)+0x1a5
V [libjvm.so+0x79b8ff] JvmtiExport::post_class_file_load_hook(Symbol*, Handle, Handle, unsigned char**, unsigned char**, JvmtiCachedClassFileData**)+0x10f
V [libjvm.so+0x4601d7] ClassFileParser::parseClassFile(Symbol*, ClassLoaderData*, Handle, KlassHandle, GrowableArray<Handle>*, TempNewSymbol&, bool, Thread*)+0x2f7
V [libjvm.so+0xa3acfa] SystemDictionary::parse_stream(Symbol*, Handle, Handle, ClassFileStream*, KlassHandle, GrowableArray<Handle>*, Thread*)+0xda
V [libjvm.so+0x7bc849] VM_RedefineClasses::load_new_class_versions(Thread*)+0x389
V [libjvm.so+0x7bd3c0] VM_RedefineClasses::doit_prologue()+0xc0
V [libjvm.so+0xace67b] VMThread::execute(VM_Operation*)+0x16b
V [libjvm.so+0x78a4a3] JvmtiEnv::RetransformClasses(int, _jclass* const*)+0x2d3
V [libjvm.so+0x74be4d] jvmti_RetransformClasses+0x14d
C [libinstrument.so+0x4020] retransformClasses+0x1e0
j sun.instrument.InstrumentationImpl.retransformClasses0(J[Ljava/lang/Class;)V+0
<p>