0 Replies Latest reply on Jan 24, 2017 2:33 AM by 3182359

    Java Crash @ C  [libverify.so+0x68a0]  pop_stack+0x0

    3182359

      Hi Java team,

       

      I'm experiencing a random Java crash due to C  [libverify.so+0x68a0]  pop_stack+0x0, here you are portions of the fatal error file:

       

      #

      # A fatal error has been detected by the Java Runtime Environment:

      #

      #  SIGSEGV (0xb) at pc=0x00007f9c7b6738a0, pid=24636, tid=140310098609920

      #

      # JRE version: Java(TM) SE Runtime Environment (8.0_60-b27) (build 1.8.0_60-b27)

      # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.60-b23 mixed mode linux-amd64 compressed oops)

      # Problematic frame:

      # C  [libverify.so+0x68a0]  pop_stack+0x0

       

      ---------------  T H R E A D  ---------------

       

      Current thread (0x00007f9c7400b000):  JavaThread "main" [_thread_in_native, id=24637, stack(0x00007f9c7d860000,0x00007f9c7d961000)]

       

      siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 0x0000000000000000

       

      Registers:

      RAX=0x0000000000000000, RBX=0x00007f9c7422d378, RCX=0x0000000000020009, RDX=0x00007f9c7d95ea90

      RSP=0x00007f9c7d95e928, RBP=0x00007f9c7d95eaf0, RSI=0x0000000000000000, RDI=0x00007f9c7d95ec80

      R8 =0x0000000000000009, R9 =0x0000000000000000, R10=0x00007f9c7d95e720, R11=0x00007f9c7cee2170

      R12=0x0000000000000009, R13=0x0000000000000000, R14=0x00007f9c7d95ec80, R15=0x00007f9c7422d718

      RIP=0x00007f9c7b6738a0, EFLAGS=0x0000000000010293, CSGSFS=0x0000000000000033, ERR=0x0000000000000006

        TRAPNO=0x000000000000000e

       

      Top of Stack: (sp=0x00007f9c7d95e928)

      0x00007f9c7d95e928:   00007f9c7b674a25 00007f9c7d95e960

      0x00007f9c7d95e938:   00000005c3e71428 00007f9c7400b5f8

      0x00007f9c7d95e948:   00007f9c7b67203d 00007f9c7423f072

      0x00007f9c7d95e958:   00007f9c7d95ec80 0000000000000010

      0x00007f9c7d95e968:   00007f9c7d95ea90 0000000000000370

      0x00007f9c7d95e978:   00007f9c7423f075 0000000000000000

      0x00007f9c7d95e988:   00007f9c7d95ec00 000000027d95eaf0

      0x00007f9c7d95e998:   00007f9c7422d378 000000007d95ea10

      0x00007f9c7d95e9a8:   00007f9c7423f084 00007f9c7d95ec0c

      0x00007f9c7d95e9b8:   00007f9c7d95ec80 6e616c2f6176616a

      0x00007f9c7d95e9c8:   007373616c432f67 00007f9c7d95ea00

      0x00007f9c7d95e9d8:   00007f9c7415d360 00007f9c7415d368

      0x00007f9c7d95e9e8:   00007f9c7415d368 00007f9c7d95ea60

      0x00007f9c7d95e9f8:   00007f9c7b87b1a8 0000000000000000

      0x00007f9c7d95ea08:   00007f9c7d95ec80 00007f9c7422d378

      0x00007f9c7d95ea18:   00007f9c7d95ec0c 00007f9c7d95ec40

      0x00007f9c7d95ea28:   000000017d766776 0000000000000000

      0x00007f9c7d95ea38:   0000000000000000 0000000000030009

      0x00007f9c7d95ea48:   00007f9c7b678658 00007f9c7b678658

      0x00007f9c7d95ea58:   00007f9c7b678658 00007f9c7422d718

      0x00007f9c7d95ea68:   0000000000000025 00007f9be409e600

      0x00007f9c7d95ea78:   0000000000000007 00007f9c7d95eaa0

      0x00007f9c7d95ea88:   00007f9c7c7a839a 00007f9c7400b000

      0x00007f9c7d95ea98:   00007f9c7423f060 00007f9c7d95eaf0

      0x00007f9c7d95eaa8:   00007f9c7c49c1ff 00007f9c7400b000

      0x00007f9c7d95eab8:   00007f9c7415d320 0000000000000007

      0x00007f9c7d95eac8:   00007f9c7422d71c 00007f9c7d95ec00

      0x00007f9c7d95ead8:   00007f9c7d95ec80 00007f9c7422d378

      0x00007f9c7d95eae8:   00007f9c7d95ec0c 00007f9c7d95ec40

      0x00007f9c7d95eaf8:   00007f9c7b676c82 0000000000000000

      0x00007f9c7d95eb08:   00007f9c7400b1f8 00007f9c7422ee00

      0x00007f9c7d95eb18:   00007f9c7cd35320 00007f9c7d95ebf0

       

      Instructions: (pc=0x00007f9c7b6738a0)

      0x00007f9c7b673880:   82 65 1d 4e 00 00 00 01 00 06 c1 30 00 4e 0c 00

      0x00007f9c7b673890:   00 a8 c1 cb 00 00 00 00 00 00 00 83 00 00 00 01

      0x00007f9c7b6738a0:   00 06 c1 30 00 5c d5 80 00 a8 c5 11 00 00 01 59

      0x00007f9c7b6738b0:   82 65 35 b7 00 00 01 73 00 00 01 59 82 65 35 41

       

      Register to memory mapping:

       

      RAX=0x0000000000000000 is an unknown value

      RBX=0x00007f9c7422d378 is an unknown value

      RCX=0x0000000000020009 is an unknown value

      RDX=0x00007f9c7d95ea90 is pointing into the stack for thread: 0x00007f9c7400b000

      RSP=0x00007f9c7d95e928 is pointing into the stack for thread: 0x00007f9c7400b000

      RBP=0x00007f9c7d95eaf0 is pointing into the stack for thread: 0x00007f9c7400b000

      RSI=0x0000000000000000 is an unknown value

      RDI=0x00007f9c7d95ec80 is pointing into the stack for thread: 0x00007f9c7400b000

      R8 =0x0000000000000009 is an unknown value

      R9 =0x0000000000000000 is an unknown value

      R10=0x00007f9c7d95e720 is pointing into the stack for thread: 0x00007f9c7400b000

      R11=0x00007f9c7cee2170: <offset 0x182170> in /lib64/libc.so.6 at 0x00007f9c7cd60000

      R12=0x0000000000000009 is an unknown value

      R13=0x0000000000000000 is an unknown value

      R14=0x00007f9c7d95ec80 is pointing into the stack for thread: 0x00007f9c7400b000

      R15=0x00007f9c7422d718 is an unknown value

       

       

      Stack: [0x00007f9c7d860000,0x00007f9c7d961000],  sp=0x00007f9c7d95e928,  free space=1018k

      Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)

      C  [libverify.so+0x68a0]  pop_stack+0x0

      C  [libverify.so+0x9c82]  verify_method+0xdb2

      C  [libverify.so+0xad45]  VerifyClassForMajorVersion+0x635

      V  [libjvm.so+0xa97362]  Verifier::inference_verify(instanceKlassHandle, char*, unsigned long, Thread*)+0x182

      V  [libjvm.so+0xaa91c7]  Verifier::verify(instanceKlassHandle, Verifier::Mode, bool, Thread*)+0x257

      V  [libjvm.so+0x63eea1]  InstanceKlass::link_class_impl(instanceKlassHandle, bool, Thread*)+0x361

      V  [libjvm.so+0x63f0d4]  InstanceKlass::link_class(Thread*)+0x54

      V  [libjvm.so+0x723c49]  get_class_declared_methods_helper(JNIEnv_*, _jclass*, unsigned char, bool, Klass*, Thread*)+0xc9

      V  [libjvm.so+0x72448b]  JVM_GetClassDeclaredMethods+0xcb

      j  java.lang.Class.getDeclaredMethods0(Z)[Ljava/lang/reflect/Method;+0

      j  java.lang.Class.privateGetDeclaredMethods(Z)[Ljava/lang/reflect/Method;+37

      j  java.lang.Class.privateGetMethodRecursive(Ljava/lang/String;[Ljava/lang/Class;ZLjava/lang/Class$MethodArray;)Ljava/lang/reflect/Method;+2

      j  java.lang.Class.getMethod0(Ljava/lang/String;[Ljava/lang/Class;Z)Ljava/lang/reflect/Method;+16

      j  java.lang.Class.getMethod(Ljava/lang/String;[Ljava/lang/Class;)Ljava/lang/reflect/Method;+13

      j  sun.launcher.LauncherHelper.validateMainClass(Ljava/lang/Class;)V+12

      j  sun.launcher.LauncherHelper.checkAndLoadMain(ZILjava/lang/String;)Ljava/lang/Class;+214

      v  ~StubRoutines::call_stub

      V  [libjvm.so+0x68bbe6]  JavaCalls::call_helper(JavaValue*, methodHandle*, JavaCallArguments*, Thread*)+0x1056

      V  [libjvm.so+0x6cd182]  jni_invoke_static(JNIEnv_*, JavaValue*, _jobject*, JNICallType, _jmethodID*, JNI_ArgumentPusher*, Thread*)+0x362

      V  [libjvm.so+0x6eb5f5]  jni_CallStaticObjectMethod+0x175

      C  [libjli.so+0x7e62]  JavaMain+0xaa2

      C  [libpthread.so.0+0x7dc5]  start_thread+0xc5

       

      Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)

      j  java.lang.Class.getDeclaredMethods0(Z)[Ljava/lang/reflect/Method;+0

      j  java.lang.Class.privateGetDeclaredMethods(Z)[Ljava/lang/reflect/Method;+37

      j  java.lang.Class.privateGetMethodRecursive(Ljava/lang/String;[Ljava/lang/Class;ZLjava/lang/Class$MethodArray;)Ljava/lang/reflect/Method;+2

      j  java.lang.Class.getMethod0(Ljava/lang/String;[Ljava/lang/Class;Z)Ljava/lang/reflect/Method;+16

      j  java.lang.Class.getMethod(Ljava/lang/String;[Ljava/lang/Class;)Ljava/lang/reflect/Method;+13

      j  sun.launcher.LauncherHelper.validateMainClass(Ljava/lang/Class;)V+12

      j  sun.launcher.LauncherHelper.checkAndLoadMain(ZILjava/lang/String;)Ljava/lang/Class;+214

      v  ~StubRoutines::call_stub

       

      ---------------  P R O C E S S  ---------------

       

      Java Threads: ( => current thread )

        0x00007f9c741c5000 JavaThread "Service Thread" daemon [_thread_blocked, id=24686, stack(0x00007f9bce8f1000,0x00007f9bce9f2000)]

        0x00007f9c741bf800 JavaThread "C1 CompilerThread11" daemon [_thread_blocked, id=24685, stack(0x00007f9bce9f2000,0x00007f9bceaf3000)]

        0x00007f9c741bd800 JavaThread "C1 CompilerThread10" daemon [_thread_blocked, id=24684, stack(0x00007f9bceaf3000,0x00007f9bcebf4000)]

        0x00007f9c741bb000 JavaThread "C1 CompilerThread9" daemon [_thread_blocked, id=24683, stack(0x00007f9bcebf4000,0x00007f9bcecf5000)]

        0x00007f9c741b9000 JavaThread "C1 CompilerThread8" daemon [_thread_blocked, id=24682, stack(0x00007f9bcecf5000,0x00007f9bcedf6000)]

        0x00007f9c741b6800 JavaThread "C2 CompilerThread7" daemon [_thread_blocked, id=24681, stack(0x00007f9bcedf6000,0x00007f9bceef7000)]

        0x00007f9c741b4800 JavaThread "C2 CompilerThread6" daemon [_thread_blocked, id=24680, stack(0x00007f9bceef7000,0x00007f9bceff8000)]

        0x00007f9c741b2000 JavaThread "C2 CompilerThread5" daemon [_thread_blocked, id=24679, stack(0x00007f9bceff8000,0x00007f9bcf0f9000)]

        0x00007f9c741b0000 JavaThread "C2 CompilerThread4" daemon [_thread_blocked, id=24678, stack(0x00007f9bcf0f9000,0x00007f9bcf1fa000)]

        0x00007f9c741a5800 JavaThread "C2 CompilerThread3" daemon [_thread_blocked, id=24677, stack(0x00007f9bcf1fa000,0x00007f9bcf2fb000)]

        0x00007f9c741a3800 JavaThread "C2 CompilerThread2" daemon [_thread_blocked, id=24676, stack(0x00007f9bcf2fb000,0x00007f9bcf3fc000)]

        0x00007f9c741a1800 JavaThread "C2 CompilerThread1" daemon [_thread_blocked, id=24675, stack(0x00007f9bcf3fc000,0x00007f9bcf4fd000)]

        0x00007f9c7419f000 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=24674, stack(0x00007f9bcf4fd000,0x00007f9bcf5fe000)]

        0x00007f9c7419d000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=24673, stack(0x00007f9bcf5fe000,0x00007f9bcf6ff000)]

        0x00007f9c7419b800 JavaThread "Surrogate Locker Thread (Concurrent GC)" daemon [_thread_blocked, id=24672, stack(0x00007f9bcf6ff000,0x00007f9bcf800000)]

        0x00007f9c74163000 JavaThread "Finalizer" daemon [_thread_blocked, id=24671, stack(0x00007f9bd40c5000,0x00007f9bd41c6000)]

        0x00007f9c74161000 JavaThread "Reference Handler" daemon [_thread_blocked, id=24670, stack(0x00007f9bd41c6000,0x00007f9bd42c7000)]

      =>0x00007f9c7400b000 JavaThread "main" [_thread_in_native, id=24637, stack(0x00007f9c7d860000,0x00007f9c7d961000)]

       

      Other Threads:

        0x00007f9c7415b800 VMThread [stack: 0x00007f9bd42c7000,0x00007f9bd43c8000] [id=24669]

        0x00007f9c741c7800 WatcherThread [stack: 0x00007f9bce7f0000,0x00007f9bce8f1000] [id=24687]

       

      VM state:not at safepoint (normal execution)

       

      VM Mutex/Monitor currently owned by a thread: None

       

      Heap:

      garbage-first heap   total 65536K, used 0K [0x00000005c0000000, 0x00000005c0200100, 0x00000007c0000000)

        region size 2048K, 1 young (2048K), 0 survivors (0K)

      Metaspace       used 2691K, capacity 4490K, committed 4864K, reserved 1056768K

        class space    used 287K, capacity 386K, committed 512K, reserved 1048576K

      CodeCache: size=245760Kb used=2804Kb max_used=2804Kb free=242955Kb

      bounds [0x00007f9c65000000, 0x00007f9c652c0000, 0x00007f9c74000000]

      total_blobs=251 nmethods=17 adapters=146

      compilation: enabled

       

      Compilation events (10 events):

      Event: 0.147 Thread 0x00007f9c741bd800 nmethod 12 0x00007f9c652b36d0 code [0x00007f9c652b3880, 0x00007f9c652b3cb8]

      Event: 0.150 Thread 0x00007f9c741bf800   13       3       java.util.jar.Attributes$Name::isValid (32 bytes)

      Event: 0.150 Thread 0x00007f9c741b9000   14       3       java.util.jar.Attributes$Name::isAlpha (30 bytes)

      Event: 0.150 Thread 0x00007f9c741bb000   15       3       sun.nio.cs.UTF_8$Decoder::decode (779 bytes)

      Event: 0.150 Thread 0x00007f9c741b9000 nmethod 14 0x00007f9c652b3ed0 code [0x00007f9c652b4040, 0x00007f9c652b4270]

      Event: 0.151 Thread 0x00007f9c741bf800 nmethod 13 0x00007f9c652b42d0 code [0x00007f9c652b4460, 0x00007f9c652b48f0]

      Event: 0.152 Thread 0x00007f9c741bd800   16       3       sun.misc.ASCIICaseInsensitiveComparator::toLower (16 bytes)

      Event: 0.152 Thread 0x00007f9c741b9000   17       3       sun.misc.ASCIICaseInsensitiveComparator::isUpper (18 bytes)

      Event: 0.152 Thread 0x00007f9c741bd800 nmethod 16 0x00007f9c652b4bd0 code [0x00007f9c652b4d40, 0x00007f9c652b4f90]

      Event: 0.152 Thread 0x00007f9c741b9000 nmethod 17 0x00007f9c652b5050 code [0x00007f9c652b51c0, 0x00007f9c652b5370]

       

      GC Heap History (0 events):

      No events

       

      Deoptimization events (0 events):

      No events

       

      Internal exceptions (2 events):

      Event: 0.083 Thread 0x00007f9c7400b000 Exception <a 'java/lang/NoSuchMethodError': Method sun.misc.Unsafe.defineClass(Ljava/lang/String;[BII)Ljava/lang/Class; name or signature does not match> (0x00000005c3e12ba8) thrown at [/HUDSON/workspace/8-2-build-linux-amd64/jdk8u60/4407/hotspot/src/shar

      Event: 0.083 Thread 0x00007f9c7400b000 Exception <a 'java/lang/NoSuchMethodError': Method sun.misc.Unsafe.prefetchRead(Ljava/lang/Object;J)V name or signature does not match> (0x00000005c3e12e90) thrown at [/HUDSON/workspace/8-2-build-linux-amd64/jdk8u60/4407/hotspot/src/share/vm/prims/jni.cpp

       

      Events (10 events):

      Event: 0.156 loading class java/security/UnresolvedPermission

      Event: 0.156 loading class java/security/UnresolvedPermission done

      Event: 0.156 loading class java/security/BasicPermissionCollection

      Event: 0.156 loading class java/security/BasicPermissionCollection done

      Event: 0.157 loading class org/tanukisoftware/wrapper/WrapperListener

      Event: 0.157 loading class org/tanukisoftware/wrapper/WrapperListener done

      Event: 0.158 loading class sun/launcher/LauncherHelper$FXHelper

      Event: 0.158 loading class sun/launcher/LauncherHelper$FXHelper done

      Event: 0.158 loading class java/lang/Class$MethodArray

      Event: 0.158 loading class java/lang/Class$MethodArray done

       

      CPU:total 16 (8 cores per cpu, 1 threads per core) family 6 model 45 stepping 2, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, aes, clmul, tsc, tscinvbit, tscinv

       

      Memory: 4k page, physical 16266844k(12163768k free), swap 4194300k(4031056k free)

       

      vm_info: Java HotSpot(TM) 64-Bit Server VM (25.60-b23) for linux-amd64 JRE (1.8.0_60-b27), built on Aug  4 2015 12:19:40 by "java_re" with gcc 4.3.0 20080428 (Red Hat 4.3.0-8)

       

      time: Mon Jan  9 09:37:57 2017

      elapsed time: 0 seconds (0d 0h 0m 0s)

       

      Unfortunately I've been searching for known issues without success, is there any points that can cause the issue?  Maybe environmental?

       

      Cheers,

       

      /V