0 Replies Latest reply on Jun 5, 2017 5:42 PM by vishalj

    Observing JVM crash on JDK8 u121

    vishalj

      We are oberving more frequent JVM crashes recently. The stack frame always points to retransformation workflow. Was not sure if this is a known issue with the JDK version I am using, or is there a fix/workaround for the same.

       

       

      <p>

      #

      # A fatal error has been detected by the Java Runtime Environment:

      #

      #  SIGSEGV (0xb) at pc=0x00000036c7489a14, pid=19100, tid=0x00007fa677765700

      #

      # JRE version: Java(TM) SE Runtime Environment (8.0_121-b13) (build 1.8.0_121-b13)

      # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.121-b13 mixed mode linux-amd64 )

      # Problematic frame:

      # C  [libc.so.6+0x89a14]  memcpy+0x3a4

      #

      # Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again

      #

      # If you would like to submit a bug report, please visit:

      #   http://bugreport.java.com/bugreport/crash.jsp

      #

       

       

      ---------------  T H R E A D  ---------------

       

       

      Current thread (0x00007faa58024800):  JavaThread "AD Thread Pool-Global278" daemon [_thread_in_vm, id=1025, stack(0x00007fa677665000,0x00007fa677766000)]

       

       

      siginfo: si_signo: 11 (SIGSEGV), si_code: 2 (SEGV_ACCERR), si_addr: 0x00007fa6a25db000

       

       

      Registers:

      RAX=0x0000000000000000, RBX=0x00007faa814a87a8, RCX=0x0000000000b35a79, RDX=0x000000005bfd4ffa

      RSP=0x00007fa677763398, RBP=0x00007fa677763420, RSI=0x00007fa6a25daff8, RDI=0x00007fac572abadc

      R8 =0x0000000000000000, R9 =0x0000000000000041, R10=0x0000000000000000, R11=0x0000000000000000

      R12=0x0000000000000000, R13=0x0000000000000000, R14=0x0000000000000000, R15=0x00007faa716d58d8

      RIP=0x00000036c7489a14, EFLAGS=0x0000000000010203, CSGSFS=0x0000000000000033, ERR=0x0000000000000004

        TRAPNO=0x000000000000000e

       

       

      Top of Stack: (sp=0x00007fa677763398)

      0x00007fa677763398:   00007fbcb694fcfb 00007fa6777633c0

      0x00007fa6777633a8:   00007fa6a0035d74 00007faa58024800

      0x00007fa6777633b8:   0000000000000000 00007fbcb723fc60

      0x00007fa6777633c8:   00007faa716d58c0 00007faa58024800

      0x00007fa6777633d8:   00007fbcb6964617 00007faa58024800

      0x00007fa6777633e8:   00007faa580249f8 00007fbcb000b4f0

      0x00007fa6777633f8:   0000000000000000 00007faa580249f8

      0x00007fa677763408:   00007fbcb000b4f0 0000000000000001

      0x00007fa677763418:   00007faa716d58c0 00007fa6777634a0

      0x00007fa677763428:   00007fbcb5b3edfc 00007faa58024800

      0x00007fa677763438:   0000000000000000 00007fa677763480

      0x00007fa677763448:   00007faa716d58c8 00007faa716d58b8

      0x00007fa677763458:   00007faa716d58d0 00007faa716d58d8

      0x00007fa677763468:   00007fbcb000b510 0000000000000000

      0x00007fa677763478:   00007fa6a0035d74 00007fbcb000b510

      0x00007fa677763488:   00007faa580249f8 00007fa677763610

      0x00007fa677763498:   00007fa67776361c 00007fa677763530

      0x00007fa6777634a8:   00007fbcb5b3be06 00007fa65c078ffe

      0x00007fa6777634b8:   00007fa6a0035d74 00007fa67776361c

      0x00007fa6777634c8:   00007fa677763610 00007faa00000001

      0x00007fa6777634d8:   5c078ffe1b2531d0 00007faa716d58c0

      0x00007fa6777634e8:   00007faa64e3de00 00007faa716d58b8

      0x00007fa6777634f8:   00007faa716d58c8 0000000000000000

      0x00007fa677763508:   00007faa716d58c8 00007fa677763660

      0x00007fa677763518:   00007faa58024800 00007faa716d58c0

      0x00007fa677763528:   00007faa716d58b8 00007fa677763650

      0x00007fa677763538:   00007fbcb6a23b65 00007fbc5c078ffe

      0x00007fa677763548:   00007fa6a0035d74 00007fa67776361c

      0x00007fa677763558:   00007fa677763610 00007fa6777635a0

      0x00007fa677763568:   00007fa6777635a0 01007faa7107c7d0

      0x00007fa677763578:   00007fbcb000bab0 00007fa677763d60

      0x00007fa677763588:   00007faa64e3de00 00007faa6505bac0

       

       

      Instructions: (pc=0x00000036c7489a14)

      0x00000036c74899f4:   6c 24 e8 4c 89 64 24 e0 0f 1f 40 00 0f 18 86 00

      0x00000036c7489a04:   03 00 00 0f 18 86 40 03 00 00 48 ff c9 48 8b 06

      0x00000036c7489a14:   4c 8b 46 08 4c 8b 4e 10 4c 8b 56 18 4c 8b 5e 20

      0x00000036c7489a24:   4c 8b 66 28 4c 8b 6e 30 4c 8b 76 38 48 0f c3 07

       

       

      Register to memory mapping:

       

       

      RAX=0x0000000000000000 is an unknown value

      RBX=0x00007faa814a87a8 is pointing into metadata

      RCX=0x0000000000b35a79 is an unknown value

      RDX=0x000000005bfd4ffa is an unknown value

      RSP=0x00007fa677763398 is pointing into the stack for thread: 0x00007faa58024800

      RBP=0x00007fa677763420 is pointing into the stack for thread: 0x00007faa58024800

      RSI=0x00007fa6a25daff8 is an unknown value

      RDI=

      [error occurred during error reporting (printing register info), id 0xb]

       

       

      Stack: [0x00007fa677665000,0x00007fa677766000],  sp=0x00007fa677763398,  free space=1016k

      Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)

      C  [libc.so.6+0x89a14]  memcpy+0x3a4

      C  [libinstrument.so+0x4dfc]  transformClassFile+0x12c

      C  [libinstrument.so+0x1e06]  eventHandlerClassFileLoadHook+0x96

      V  [libjvm.so+0x7a4b65]  JvmtiClassFileLoadHookPoster::post_to_env(JvmtiEnv*, bool)+0x1a5

      V  [libjvm.so+0x79b8ff]  JvmtiExport::post_class_file_load_hook(Symbol*, Handle, Handle, unsigned char**, unsigned char**, JvmtiCachedClassFileData**)+0x10f

      V  [libjvm.so+0x4601d7]  ClassFileParser::parseClassFile(Symbol*, ClassLoaderData*, Handle, KlassHandle, GrowableArray<Handle>*, TempNewSymbol&, bool, Thread*)+0x2f7

      V  [libjvm.so+0xa3acfa]  SystemDictionary::parse_stream(Symbol*, Handle, Handle, ClassFileStream*, KlassHandle, GrowableArray<Handle>*, Thread*)+0xda

      V  [libjvm.so+0x7bc849]  VM_RedefineClasses::load_new_class_versions(Thread*)+0x389

      V  [libjvm.so+0x7bd3c0]  VM_RedefineClasses::doit_prologue()+0xc0

      V  [libjvm.so+0xace67b]  VMThread::execute(VM_Operation*)+0x16b

      V  [libjvm.so+0x78a4a3]  JvmtiEnv::RetransformClasses(int, _jclass* const*)+0x2d3

      V  [libjvm.so+0x74be4d]  jvmti_RetransformClasses+0x14d

      C  [libinstrument.so+0x4020]  retransformClasses+0x1e0

      j  sun.instrument.InstrumentationImpl.retransformClasses0(J[Ljava/lang/Class;)V+0

      <p>