0 Replies Latest reply on Jul 17, 2019 2:31 AM by 2746731

    JVM is getting crashed and generating java dump

    2746731

      Hi Everyone,

      We are facing issue with one of our JVM (owned by Pivotal Tc server tomcat) for which we are using Oracle JDK 1.8.0_202.

      We can see that whenever we are starting our JVM its getting crashed within 5-10 min and generating java crash and in java crash we can see that below as problematic frame:

       

       

      # Problematic frame:

      # V [libjvm.so+0x6caaf7] jni_GetStringUTFChars+0x67

       

       

      Below is our java version:

      $ java -version

      java version "1.8.0_202"

      Java(TM) SE Runtime Environment (build 1.8.0_202-b26)

      Java HotSpot(TM) 64-Bit Server VM (build 25.202-b26, mixed mode)

       

      Below is tomcat details:

      Server version: Pivotal tc Runtime 3.2.14.RELEASE/8.5.38.B.RELEASE

      Server built: Feb 20 2019 19:23:29 UTC

      Server number: 8.5.38.0

      OS Name: Linux

      OS Version: 3.10.0-957.5.1.el7.x86_64

      Architecture: amd64

      JVM Version: 1.8.0_202-b26

      JVM Vendor: Oracle Corporatio

       

       

      PFB hs_err_pid file:

       

       

      #

      # A fatal error has been detected by the Java Runtime Environment:

      #

      #  SIGSEGV (0xb) at pc=0x00007febb0c16af7, pid=96637, tid=0x00007feb9d0ef700

      #

      # JRE version: Java(TM) SE Runtime Environment (8.0_202-b26) (build 1.8.0_202-b26)

      # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.202-b26 mixed mode linux-amd64 compressed oops)

      # Problematic frame:

      # V  [libjvm.so+0x6caaf7]  jni_GetStringUTFChars+0x67

      #

      # Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again

      #

      # If you would like to submit a bug report, please visit:

      #   http://bugreport.java.com/bugreport/crash.jsp

      #

       

       

      ---------------  T H R E A D  ---------------

       

       

      Current thread (0x00007feae113a800):  JavaThread "Final initializer" daemon [_thread_in_vm, id=96870, stack(0x00007feb9d0af000,0x00007feb9d0f0000)]

       

       

      siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 0x0000000000000000

       

       

      Registers:

      RAX=0x00007febb150ba24, RBX=0x00007feae113a800, RCX=0x0000000000000130, RDX=0x00007feb44b4e548

      RSP=0x00007feb9d0c5e90, RBP=0x00007feb9d0c5f10, RSI=0x00007feae113a800, RDI=0x00007feae113a800

      R8 =0x00007feb9da02eb8, R9 =0x0000000000000027, R10=0x6c6c61436176616a, R11=0x0000000000000000

      R12=0x0000000000000000, R13=0x0000000000000000, R14=0x00007feb9d0c6a10, R15=0x00007feb9d0c6100

      RIP=0x00007febb0c16af7, EFLAGS=0x0000000000010206, CSGSFS=0x0000000000000033, ERR=0x0000000000000004

        TRAPNO=0x000000000000000e

       

       

      Top of Stack: (sp=0x00007feb9d0c5e90)

      0x00007feb9d0c5e90:   00007feae113a800 00007feb44b4e540

      0x00007feb9d0c5ea0:   00007feb00000182 00007febb1096c00

      0x00007feb9d0c5eb0:   00007feba5170c3a 00007feae113a800

      0x00007feb9d0c5ec0:   00007feb9d0c5f10 00007febb0c13855

      0x00007feb9d0c5ed0:   00007feae113a800 00007feb44b4e540

      0x00007feb9d0c5ee0:   00007feb00000182 00007feb240212f0

      0x00007feb9d0c5ef0:   00007feb9d0c6a10 0000000000000000

      0x00007feb9d0c5f00:   00007feb9d0c6a10 00007feb9d0c6100

      0x00007feb9d0c5f10:   00007feb9d0c7160 00007feba50196fa

      0x00007feb9d0c5f20:   00007feb9d0c7160 00007feba516fc8c

      0x00007feb9d0c5f30:   00007feb9d0c6100 00007feb240212b8

      0x00007feb9d0c5f40:   00007feb9d0c73f0 00007feba50170c7

      0x00007feb9d0c5f50:   00007feb9d0c6040 00007feb9d0c7160

      0x00007feb9d0c5f60:   00007febacf68790 00007feb9d0c6a10

      0x00007feb9d0c5f70:   00007feb9d0c6100 00007feb240212b8

      0x00007feb9d0c5f80:   00007feb9d0c73f0 00007feba5019907

      0x00007feb9d0c5f90:   00007feb9d0c6100 00007feba4ff8af0

      0x00007feb9d0c5fa0:   000000000000001c 00007febacf68790

      0x00007feb9d0c5fb0:   00007feb9d0c6100 00007febacf68790

      0x00007feb9d0c5fc0:   0000000000000000 00007feb9d0c6100

      0x00007feb9d0c5fd0:   00007feb240212d0 00007feba501a991

      0x00007feb9d0c5fe0:   00007feb240212b8 00000006a4bd5a08

      0x00007feb9d0c5ff0:   00007feb9d0c6a10 00007feb9d0c7160

      0x00007feb9d0c6000:   00007feb240212e0 00007feb240212e8

      0x00007feb9d0c6010:   0000000000000000 00000000e113a800

      0x00007feb9d0c6020:   00007feb9d0c6040 00007febb0c0fe7e

      0x00007feb9d0c6030:   00007feb9d0c7160 00007feae113a800

      0x00007feb9d0c6040:   00007feba5412830 00007feba5173af0

      0x00007feb9d0c6050:   000000000000001e 00007feae1130100

      0x00007feb9d0c6060:   0000000000000000 00007febb0c0fe7e

      0x00007feb9d0c6070:   00007feb9d0c7160 00007feb9d0c69b0

      0x00007feb9d0c6080:   00007feb9d0c7160 00007feba5016fc8

       

       

      Instructions: (pc=0x00007febb0c16af7)

      0x00007febb0c16ad7:   08 00 48 89 5d 80 48 c7 45 88 00 00 00 00 74 09

      0x00007febb0c16ae7:   48 8d 7d 80 e8 70 33 2a 00 48 8d 05 2d 4f 8f 00

      0x00007febb0c16af7:   4d 8b 6d 00 48 8d 15 e8 38 8f 00 48 63 00 4c 01

      0x00007febb0c16b07:   e8 80 3a 00 74 1b 8b 00 85 c0 74 54 48 8d 15 96

       

       

      Register to memory mapping:

       

       

      RAX=0x00007febb150ba24: <offset 0xfbfa24> in /usr/mware/mwpackage-oracle-jdk8u202/jdk1.8.0_202/jre/lib/amd64/server/libjvm.so at 0x00007febb054c000

      RBX=0x00007feae113a800 is a thread

      RCX=0x0000000000000130 is an unknown value

      RDX=0x00007feb44b4e548 is an unknown value

      RSP=0x00007feb9d0c5e90 is pointing into the stack for thread: 0x00007feae113a800

      RBP=0x00007feb9d0c5f10 is pointing into the stack for thread: 0x00007feae113a800

      RSI=0x00007feae113a800 is a thread

      RDI=0x00007feae113a800 is a thread

      R8 ={method} {0x00007feb9da02eb8} 'toString' '()Ljava/lang/String;' in 'java/lang/Throwable'

      R9 =0x0000000000000027 is an unknown value

      R10=0x6c6c61436176616a is an unknown value

      R11=0x0000000000000000 is an unknown value

      R12=0x0000000000000000 is an unknown value

      R13=0x0000000000000000 is an unknown value

      R14=0x00007feb9d0c6a10 is pointing into the stack for thread: 0x00007feae113a800

      R15=0x00007feb9d0c6100 is pointing into the stack for thread: 0x00007feae113a800

       

       

       

       

      Stack: [0x00007feb9d0af000,0x00007feb9d0f0000],  sp=0x00007feb9d0c5e90,  free space=91k

      Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)

      V  [libjvm.so+0x6caaf7]  jni_GetStringUTFChars+0x67

      C  [..+0x7f6fa]

      C  0x00007f0000000000

       

       

      Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)

      J 1670  java.lang.ClassLoader.defineClass1(Ljava/lang/String;[BIILjava/security/ProtectionDomain;Ljava/lang/String;)Ljava/lang/Class; (0 bytes) @ 0x00002aaaab24a0e1 [0x00002aaaab24a040+0xa1]

      J 7519 C2 java.security.SecureClassLoader.defineClass(Ljava/lang/String;[BIILjava/security/CodeSource;)Ljava/lang/Class; (16 bytes) @ 0x00002aaaac4600d8 [0x00002aaaac45fac0+0x618]

      J 7124 C2 org.apache.catalina.loader.WebappClassLoaderBase.findClassInternal(Ljava/lang/String;)Ljava/lang/Class; (693 bytes) @ 0x00002aaaac35c5bc [0x00002aaaac359800+0x2dbc]

      J 7121 C2 org.apache.catalina.loader.WebappClassLoaderBase$PrivilegedFindClassByName.run()Ljava/lang/Object; (5 bytes) @ 0x00002aaaabf10cac [0x00002aaaabf10c60+0x4c]

      v  ~StubRoutines::call_stub

      J 170  java.security.AccessController.doPrivileged(Ljava/security/PrivilegedAction;)Ljava/lang/Object; (0 bytes) @ 0x00002aaaaad6fc5f [0x00002aaaaad6fc00+0x5f]

      J 7051 C2 org.apache.catalina.loader.WebappClassLoaderBase.findClass(Ljava/lang/String;)Ljava/lang/Class; (561 bytes) @ 0x00002aaaab203e2c [0x00002aaaab2037e0+0x64c]

      J 8580 C2 org.apache.catalina.loader.WebappClassLoaderBase.loadClass(Ljava/lang/String;Z)Ljava/lang/Class; (690 bytes) @ 0x00002aaaac78194c [0x00002aaaac780940+0x100c]

      J 6160 C2 org.apache.catalina.loader.WebappClassLoaderBase.loadClass(Ljava/lang/String;)Ljava/lang/Class; (7 bytes) @ 0x00002aaaaadc9ad4 [0x00002aaaaadc9aa0+0x34]

      v  ~StubRoutines::call_stub

      J 1670  java.lang.ClassLoader.defineClass1(Ljava/lang/String;[BIILjava/security/ProtectionDomain;Ljava/lang/String;)Ljava/lang/Class; (0 bytes) @ 0x00002aaaab24a0e1 [0x00002aaaab24a040+0xa1]

      J 7519 C2 java.security.SecureClassLoader.defineClass(Ljava/lang/String;[BIILjava/security/CodeSource;)Ljava/lang/Class; (16 bytes) @ 0x00002aaaac4600d8 [0x00002aaaac45fac0+0x618]

      J 7124 C2 org.apache.catalina.loader.WebappClassLoaderBase.findClassInternal(Ljava/lang/String;)Ljava/lang/Class; (693 bytes) @ 0x00002aaaac35c5bc [0x00002aaaac359800+0x2dbc]

      J 7121 C2 org.apache.catalina.loader.WebappClassLoaderBase$PrivilegedFindClassByName.run()Ljava/lang/Object; (5 bytes) @ 0x00002aaaabf10cac [0x00002aaaabf10c60+0x4c]

      v  ~StubRoutines::call_stub

      J 170  java.security.AccessController.doPrivileged(Ljava/security/PrivilegedAction;)Ljava/lang/Object; (0 bytes) @ 0x00002aaaaad6fc5f [0x00002aaaaad6fc00+0x5f]

      J 7051 C2 org.apache.catalina.loader.WebappClassLoaderBase.findClass(Ljava/lang/String;)Ljava/lang/Class; (561 bytes) @ 0x00002aaaab203e2c [0x00002aaaab2037e0+0x64c]

      J 8580 C2 org.apache.catalina.loader.WebappClassLoaderBase.loadClass(Ljava/lang/String;Z)Ljava/lang/Class; (690 bytes) @ 0x00002aaaac78194c [0x00002aaaac780940+0x100c]

      J 6160 C2 org.apache.catalina.loader.WebappClassLoaderBase.loadClass(Ljava/lang/String;)Ljava/lang/Class; (7 bytes) @ 0x00002aaaaadc9ad4 [0x00002aaaaadc9aa0+0x34]

      v  ~StubRoutines::call_stub

      J 1670  java.lang.ClassLoader.defineClass1(Ljava/lang/String;[BIILjava/security/ProtectionDomain;Ljava/lang/String;)Ljava/lang/Class; (0 bytes) @ 0x00002aaaab24a0e1 [0x00002aaaab24a040+0xa1]

      J 7519 C2 java.security.SecureClassLoader.defineClass(Ljava/lang/String;[BIILjava/security/CodeSource;)Ljava/lang/Class; (16 bytes) @ 0x00002aaaac4600d8 [0x00002aaaac45fac0+0x618]

      J 7124 C2 org.apache.catalina.loader.WebappClassLoaderBase.findClassInternal(Ljava/lang/String;)Ljava/lang/Class; (693 bytes) @ 0x00002aaaac35c5bc [0x00002aaaac359800+0x2dbc]

      J 7121 C2 org.apache.catalina.loader.WebappClassLoaderBase$PrivilegedFindClassByName.run()Ljava/lang/Object; (5 bytes) @ 0x00002aaaabf10cac [0x00002aaaabf10c60+0x4c]

      v  ~StubRoutines::call_stub

      J 170  java.security.AccessController.doPrivileged(Ljava/security/PrivilegedAction;)Ljava/lang/Object; (0 bytes) @ 0x00002aaaaad6fc5f [0x00002aaaaad6fc00+0x5f]

      J 7051 C2 org.apache.catalina.loader.WebappClassLoaderBase.findClass(Ljava/lang/String;)Ljava/lang/Class; (561 bytes) @ 0x00002aaaab203e2c [0x00002aaaab2037e0+0x64c]

      J 8580 C2 org.apache.catalina.loader.WebappClassLoaderBase.loadClass(Ljava/lang/String;Z)Ljava/lang/Class; (690 bytes) @ 0x00002aaaac78194c [0x00002aaaac780940+0x100c]

      J 6160 C2 org.apache.catalina.loader.WebappClassLoaderBase.loadClass(Ljava/lang/String;)Ljava/lang/Class; (7 bytes) @ 0x00002aaaaadc9ad4 [0x00002aaaaadc9aa0+0x34]

      v  ~StubRoutines::call_stub

      J 3722  java.lang.Class.getDeclaredMethods0(Z)[Ljava/lang/reflect/Method; (0 bytes) @ 0x00002aaaaba0ae08 [0x00002aaaaba0adc0+0x48]

      J 5821 C2 java.lang.Class.privateGetDeclaredMethods(Z)[Ljava/lang/reflect/Method; (67 bytes) @ 0x00002aaaac007678 [0x00002aaaac0075e0+0x98]

      J 7800 C1 org.springframework.util.ReflectionUtils.__AW_getDeclaredMethods(Ljava/lang/Class;)[Ljava/lang/reflect/Method; (186 bytes) @ 0x00002aaaab9599fc [0x00002aaaab9590c0+0x93c]

      J 7818 C1 org.springframework.util.ReflectionUtils.getDeclaredMethods(Ljava/lang/Class;)[Ljava/lang/reflect/Method; (72 bytes) @ 0x00002aaaab9581ac [0x00002aaaab957fe0+0x1cc]

      J 10372 C1 org.springframework.util.ReflectionUtils.__AW_doWithMethods(Ljava/lang/Class;Lorg/springframework/util/ReflectionUtils$MethodCallback;Lorg/springframework/util/ReflectionUtils$MethodFilter;)V (176 bytes) @ 0x00002aaaacb48ef4 [0x00002aaaacb48e80+0x74]

      J 10450 C1 org.springframework.util.ReflectionUtils.doWithMethods(Ljava/lang/Class;Lorg/springframework/util/ReflectionUtils$MethodCallback;Lorg/springframework/util/ReflectionUtils$MethodFilter;)V (72 bytes) @ 0x00002aaaacba7714 [0x00002aaaacba7520+0x1f4]

      J 10551 C1 org.springframework.util.ReflectionUtils.doWithMethods(Ljava/lang/Class;Lorg/springframework/util/ReflectionUtils$MethodCallback;)V (7 bytes) @ 0x00002aaaacc3a524 [0x00002aaaacc3a4c0+0x64]

      j  org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.__AW_determineCandidateConstructors(Ljava/lang/Class;Ljava/lang/String;)[Ljava/lang/reflect/Constructor;+21

      j  org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.determineCandidateConstructors(Ljava/lang/Class;Ljava/lang/String;)[Ljava/lang/reflect/Constructor;+23

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.__AW_determineConstructorsFromBeanPostProcessors(Ljava/lang/Class;Ljava/lang/String;)[Ljava/lang/reflect/Constructor;+60

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.determineConstructorsFromBeanPostProcessors(Ljava/lang/Class;Ljava/lang/String;)[Ljava/lang/reflect/Constructor;+23

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.__AW_createBeanInstance(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Lorg/springframework/beans/BeanWrapper;+183

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Lorg/springframework/beans/BeanWrapper;+28

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.__AW_doCreateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+34

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+28

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.__AW_createBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+169

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+28

      j  org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+4

      j  org.springframework.beans.factory.support.AbstractBeanFactory$$Lambda$28.getObject()Ljava/lang/Object;+16

      j  org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.__AW_getSingleton(Ljava/lang/String;Lorg/springframework/beans/factory/ObjectFactory;)Ljava/lang/Object;+132

      j  org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(Ljava/lang/String;Lorg/springframework/beans/factory/ObjectFactory;)Ljava/lang/Object;+26

      J 10524 C1 org.springframework.beans.factory.support.AbstractBeanFactory.__AW_doGetBean(Ljava/lang/String;Ljava/lang/Class;[Ljava/lang/Object;Z)Ljava/lang/Object; (833 bytes) @ 0x00002aaaacc154a4 [0x00002aaaacc134e0+0x1fc4]

      J 10528 C1 org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(Ljava/lang/String;Ljava/lang/Class;[Ljava/lang/Object;Z)Ljava/lang/Object; (86 bytes) @ 0x00002aaaacc2ced4 [0x00002aaaacc2cca0+0x234]

      J 10547 C1 org.springframework.beans.factory.support.AbstractBeanFactory.getBean(Ljava/lang/String;Ljava/lang/Class;)Ljava/lang/Object; (9 bytes) @ 0x00002aaaacc2ee1c [0x00002aaaacc2ed00+0x11c]

      J 10592 C1 org.springframework.context.annotation.CommonAnnotationBeanPostProcessor.__AW_autowireResource(Lorg/springframework/beans/factory/BeanFactory;Lorg/springframework/context/annotation/CommonAnnotationBeanPostProcessor$LookupElement;Ljava/lang/String;)Ljava/lang/Object; (182 bytes) @ 0x00002aaaacc5e88c [0x00002aaaacc5e460+0x42c]

      J 10593 C1 org.springframework.context.annotation.CommonAnnotationBeanPostProcessor.autowireResource(Lorg/springframework/beans/factory/BeanFactory;Lorg/springframework/context/annotation/CommonAnnotationBeanPostProcessor$LookupElement;Ljava/lang/String;)Ljava/lang/Object; (84 bytes) @ 0x00002aaaacc7f604 [0x00002aaaacc7f3e0+0x224]

      J 10546 C1 org.springframework.context.annotation.CommonAnnotationBeanPostProcessor.getResource(Lorg/springframework/context/annotation/CommonAnnotationBeanPostProcessor$LookupElement;Ljava/lang/String;)Ljava/lang/Object; (85 bytes) @ 0x00002aaaacc2f504 [0x00002aaaacc2f1a0+0x364]

      J 10545 C1 org.springframework.context.annotation.CommonAnnotationBeanPostProcessor$ResourceElement.getResourceToInject(Ljava/lang/Object;Ljava/lang/String;)Ljava/lang/Object; (29 bytes) @ 0x00002aaaacc3a99c [0x00002aaaacc3a860+0x13c]

      J 10591 C1 org.springframework.beans.factory.annotation.InjectionMetadata$InjectedElement.inject(Ljava/lang/Object;Ljava/lang/String;Lorg/springframework/beans/PropertyValues;)V (91 bytes) @ 0x00002aaaacc60eac [0x00002aaaacc60aa0+0x40c]

      J 10498 C1 org.springframework.beans.factory.annotation.InjectionMetadata.__AW_inject(Ljava/lang/Object;Ljava/lang/String;Lorg/springframework/beans/PropertyValues;)V (123 bytes) @ 0x00002aaaacbc51fc [0x00002aaaacbc3c80+0x157c]

      J 10497 C1 org.springframework.beans.factory.annotation.InjectionMetadata.inject(Ljava/lang/Object;Ljava/lang/String;Lorg/springframework/beans/PropertyValues;)V (77 bytes) @ 0x00002aaaacbc9f84 [0x00002aaaacbc9d60+0x224]

      j  org.springframework.context.annotation.CommonAnnotationBeanPostProcessor.postProcessProperties(Lorg/springframework/beans/PropertyValues;Ljava/lang/Object;Ljava/lang/String;)Lorg/springframework/beans/PropertyValues;+17

      J 10590 C1 org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.__AW_populateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;Lorg/springframework/beans/BeanWrapper;)V (412 bytes) @ 0x00002aaaacc64bcc [0x00002aaaacc61e80+0x2d4c]

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;Lorg/springframework/beans/BeanWrapper;)V+25

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.__AW_doCreateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+237

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+28

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.__AW_createBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+169

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+28

      j  org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+4

      j  org.springframework.beans.factory.support.AbstractBeanFactory$$Lambda$28.getObject()Ljava/lang/Object;+16

      j  org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.__AW_getSingleton(Ljava/lang/String;Lorg/springframework/beans/factory/ObjectFactory;)Ljava/lang/Object;+132

      j  org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(Ljava/lang/String;Lorg/springframework/beans/factory/ObjectFactory;)Ljava/lang/Object;+26

      J 10524 C1 org.springframework.beans.factory.support.AbstractBeanFactory.__AW_doGetBean(Ljava/lang/String;Ljava/lang/Class;[Ljava/lang/Object;Z)Ljava/lang/Object; (833 bytes) @ 0x00002aaaacc154a4 [0x00002aaaacc134e0+0x1fc4]

      J 10528 C1 org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(Ljava/lang/String;Ljava/lang/Class;[Ljava/lang/Object;Z)Ljava/lang/Object; (86 bytes) @ 0x00002aaaacc2ced4 [0x00002aaaacc2cca0+0x234]

      J 10547 C1 org.springframework.beans.factory.support.AbstractBeanFactory.getBean(Ljava/lang/String;Ljava/lang/Class;)Ljava/lang/Object; (9 bytes) @ 0x00002aaaacc2ee1c [0x00002aaaacc2ed00+0x11c]

      J 10592 C1 org.springframework.context.annotation.CommonAnnotationBeanPostProcessor.__AW_autowireResource(Lorg/springframework/beans/factory/BeanFactory;Lorg/springframework/context/annotation/CommonAnnotationBeanPostProcessor$LookupElement;Ljava/lang/String;)Ljava/lang/Object; (182 bytes) @ 0x00002aaaacc5e88c [0x00002aaaacc5e460+0x42c]

      J 10593 C1 org.springframework.context.annotation.CommonAnnotationBeanPostProcessor.autowireResource(Lorg/springframework/beans/factory/BeanFactory;Lorg/springframework/context/annotation/CommonAnnotationBeanPostProcessor$LookupElement;Ljava/lang/String;)Ljava/lang/Object; (84 bytes) @ 0x00002aaaacc7f604 [0x00002aaaacc7f3e0+0x224]

      J 10546 C1 org.springframework.context.annotation.CommonAnnotationBeanPostProcessor.getResource(Lorg/springframework/context/annotation/CommonAnnotationBeanPostProcessor$LookupElement;Ljava/lang/String;)Ljava/lang/Object; (85 bytes) @ 0x00002aaaacc2f504 [0x00002aaaacc2f1a0+0x364]

      J 10545 C1 org.springframework.context.annotation.CommonAnnotationBeanPostProcessor$ResourceElement.getResourceToInject(Ljava/lang/Object;Ljava/lang/String;)Ljava/lang/Object; (29 bytes) @ 0x00002aaaacc3a99c [0x00002aaaacc3a860+0x13c]

      J 10591 C1 org.springframework.beans.factory.annotation.InjectionMetadata$InjectedElement.inject(Ljava/lang/Object;Ljava/lang/String;Lorg/springframework/beans/PropertyValues;)V (91 bytes) @ 0x00002aaaacc60eac [0x00002aaaacc60aa0+0x40c]

      J 10498 C1 org.springframework.beans.factory.annotation.InjectionMetadata.__AW_inject(Ljava/lang/Object;Ljava/lang/String;Lorg/springframework/beans/PropertyValues;)V (123 bytes) @ 0x00002aaaacbc51fc [0x00002aaaacbc3c80+0x157c]

      J 10497 C1 org.springframework.beans.factory.annotation.InjectionMetadata.inject(Ljava/lang/Object;Ljava/lang/String;Lorg/springframework/beans/PropertyValues;)V (77 bytes) @ 0x00002aaaacbc9f84 [0x00002aaaacbc9d60+0x224]

      j  org.springframework.context.annotation.CommonAnnotationBeanPostProcessor.postProcessProperties(Lorg/springframework/beans/PropertyValues;Ljava/lang/Object;Ljava/lang/String;)Lorg/springframework/beans/PropertyValues;+17

      J 10590 C1 org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.__AW_populateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;Lorg/springframework/beans/BeanWrapper;)V (412 bytes) @ 0x00002aaaacc64bcc [0x00002aaaacc61e80+0x2d4c]

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;Lorg/springframework/beans/BeanWrapper;)V+25

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.__AW_doCreateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+237

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+28

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.__AW_createBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+169

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+28

      j  org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+4

      j  org.springframework.beans.factory.support.AbstractBeanFactory$$Lambda$28.getObject()Ljava/lang/Object;+16

      j  org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.__AW_getSingleton(Ljava/lang/String;Lorg/springframework/beans/factory/ObjectFactory;)Ljava/lang/Object;+132

      j  org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(Ljava/lang/String;Lorg/springframework/beans/factory/ObjectFactory;)Ljava/lang/Object;+26

      J 10524 C1 org.springframework.beans.factory.support.AbstractBeanFactory.__AW_doGetBean(Ljava/lang/String;Ljava/lang/Class;[Ljava/lang/Object;Z)Ljava/lang/Object; (833 bytes) @ 0x00002aaaacc154a4 [0x00002aaaacc134e0+0x1fc4]

      J 10528 C1 org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(Ljava/lang/String;Ljava/lang/Class;[Ljava/lang/Object;Z)Ljava/lang/Object; (86 bytes) @ 0x00002aaaacc2ced4 [0x00002aaaacc2cca0+0x234]

      j  org.springframework.beans.factory.support.AbstractBeanFactory.getBean(Ljava/lang/String;)Ljava/lang/Object;+5

      j  org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(Ljava/lang/String;Ljava/lang/Class;Lorg/springframework/beans/factory/BeanFactory;)Ljava/lang/Object;+2

      j  org.springframework.beans.factory.support.DefaultListableBeanFactory.__AW_doResolveDependency(Lorg/springframework/beans/factory/config/DependencyDescriptor;Ljava/lang/String;Ljava/util/Set;Lorg/springframework/beans/TypeConverter;)Ljava/lang/Object;+412

      j  org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(Lorg/springframework/beans/factory/config/DependencyDescriptor;Ljava/lang/String;Ljava/util/Set;Lorg/springframework/beans/TypeConverter;)Ljava/lang/Object;+30

      j  org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(Lorg/springframework/beans/factory/config/DependencyDescriptor;Ljava/lang/String;Ljava/util/Set;Lorg/springframework/beans/TypeConverter;)Ljava/lang/Object;+108

      J 10592 C1 org.springframework.context.annotation.CommonAnnotationBeanPostProcessor.__AW_autowireResource(Lorg/springframework/beans/factory/BeanFactory;Lorg/springframework/context/annotation/CommonAnnotationBeanPostProcessor$LookupElement;Ljava/lang/String;)Ljava/lang/Object; (182 bytes) @ 0x00002aaaacc5eff4 [0x00002aaaacc5e460+0xb94]

      J 10593 C1 org.springframework.context.annotation.CommonAnnotationBeanPostProcessor.autowireResource(Lorg/springframework/beans/factory/BeanFactory;Lorg/springframework/context/annotation/CommonAnnotationBeanPostProcessor$LookupElement;Ljava/lang/String;)Ljava/lang/Object; (84 bytes) @ 0x00002aaaacc7f604 [0x00002aaaacc7f3e0+0x224]

      J 10546 C1 org.springframework.context.annotation.CommonAnnotationBeanPostProcessor.getResource(Lorg/springframework/context/annotation/CommonAnnotationBeanPostProcessor$LookupElement;Ljava/lang/String;)Ljava/lang/Object; (85 bytes) @ 0x00002aaaacc2f504 [0x00002aaaacc2f1a0+0x364]

      J 10545 C1 org.springframework.context.annotation.CommonAnnotationBeanPostProcessor$ResourceElement.getResourceToInject(Ljava/lang/Object;Ljava/lang/String;)Ljava/lang/Object; (29 bytes) @ 0x00002aaaacc3a99c [0x00002aaaacc3a860+0x13c]

      J 10591 C1 org.springframework.beans.factory.annotation.InjectionMetadata$InjectedElement.inject(Ljava/lang/Object;Ljava/lang/String;Lorg/springframework/beans/PropertyValues;)V (91 bytes) @ 0x00002aaaacc60eac [0x00002aaaacc60aa0+0x40c]

      J 10498 C1 org.springframework.beans.factory.annotation.InjectionMetadata.__AW_inject(Ljava/lang/Object;Ljava/lang/String;Lorg/springframework/beans/PropertyValues;)V (123 bytes) @ 0x00002aaaacbc51fc [0x00002aaaacbc3c80+0x157c]

      J 10497 C1 org.springframework.beans.factory.annotation.InjectionMetadata.inject(Ljava/lang/Object;Ljava/lang/String;Lorg/springframework/beans/PropertyValues;)V (77 bytes) @ 0x00002aaaacbc9f84 [0x00002aaaacbc9d60+0x224]

      j  org.springframework.context.annotation.CommonAnnotationBeanPostProcessor.postProcessProperties(Lorg/springframework/beans/PropertyValues;Ljava/lang/Object;Ljava/lang/String;)Lorg/springframework/beans/PropertyValues;+17

      J 10590 C1 org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.__AW_populateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;Lorg/springframework/beans/BeanWrapper;)V (412 bytes) @ 0x00002aaaacc64bcc [0x00002aaaacc61e80+0x2d4c]

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;Lorg/springframework/beans/BeanWrapper;)V+25

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.__AW_doCreateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+237

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+28

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.__AW_createBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+169

      j  org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+28

      j  org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+4

      j  org.springframework.beans.factory.support.AbstractBeanFactory$$Lambda$28.getObject()Ljava/lang/Object;+16

      j  org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.__AW_getSingleton(Ljava/lang/String;Lorg/springframework/beans/factory/ObjectFactory;)Ljava/lang/Object;+132

      j  org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(Ljava/lang/String;Lorg/springframework/beans/factory/ObjectFactory;)Ljava/lang/Object;+26

      J 10524 C1 org.springframework.beans.factory.support.AbstractBeanFactory.__AW_doGetBean(Ljava/lang/String;Ljava/lang/Class;[Ljava/lang/Object;Z)Ljava/lang/Object; (833 bytes) @ 0x00002aaaacc154a4 [0x00002aaaacc134e0+0x1fc4]

      J 10528 C1 org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(Ljava/lang/String;Ljava/lang/Class;[Ljava/lang/Object;Z)Ljava/lang/Object; (86 bytes) @ 0x00002aaaacc2ced4 [0x00002aaaacc2cca0+0x234]

      j  org.springframework.beans.factory.support.AbstractBeanFactory.getBean(Ljava/lang/String;)Ljava/lang/Object;+5

      j  org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(Ljava/lang/String;Ljava/lang/Class;Lorg/springframework/beans/factory/BeanFactory;)Ljava/lang/Object;+2

      j  org.springframework.beans.factory.support.DefaultListableBeanFactory.__AW_doResolveDependency(Lorg/springframework/beans/factory/config/DependencyDescriptor;Ljava/lang/String;Ljava/util/Set;Lorg/springframework/beans/TypeConverter;)Ljava/lang/Object;+412

      j  org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(Lorg/springframework/beans/factory/config/DependencyDescriptor;Ljava/lang/String;Ljava/util/Set;Lorg/springframework/beans/TypeConverter;)Ljava/lang/Object;+30

      j  org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(Lorg/springframework/beans/factory/config/DependencyDescriptor;Ljava/lang/String;Ljava/util/Set;Lorg/springframework/beans/TypeConverter;)Ljava/lang/Object;+108

      J 10592 C1

      Other Threads:

        0x00007febacf71800 VMThread [stack: 0x00007feb9d70d000,0x00007feb9d80d000] [id=96654]

        0x00007febad0a2800 WatcherThread [stack: 0x00007feb9d1c7000,0x00007feb9d2c7000] [id=96665]

       

       

      VM state:not at safepoint (normal execution)

       

       

      VM Mutex/Monitor currently owned by a thread: None

       

       

      OutOfMemory and StackOverflow Exception counts:

      StackOverflowErrors=2

       

       

      heap address: 0x00000005e0800000, size: 8192 MB, Compressed Oops mode: Zero based, Oop shift amount: 3

      Narrow klass base: 0x00000007e0800000, Narrow klass shift: 0

      Compressed class space size: 1073741824 Address: 0x00000007e0800000

       

       

      Heap:

      garbage-first heap   total 4194304K, used 1112515K [0x00000005e0800000, 0x00000005e0a04000, 0x00000007e0800000)

        region size 2048K, 545 young (1116160K), 66 survivors (135168K)

      Metaspace       used 97122K, capacity 98716K, committed 99072K, reserved 1136640K

        class space    used 11566K, capacity 12012K, committed 12032K, reserved 1048576K

       

       

      Heap Regions: (Y=young(eden), SU=young(survivor), HS=humongous(starts), HC=humongous(continues), CS=collection set, F=free, TS=gc time stamp, PTAMS=previous top-at-mark-start, NTAMS=next top-at-mark-start)

       

       

      Card table byte_map: [0x00002aaabbc00000,0x00002aaabcc00000] byte_map_base: 0x00002aaab8cfc000

       

       

      Marking Bits (Prev, Next): (CMBitMap*) 0x00007febac0f9ad8, (CMBitMap*) 0x00007febac0f9b30

      Prev Bits: [0x00002aaabdc00000, 0x00002aaac5c00000)

      Next Bits: [0x00002aaac5c00000, 0x00002aaacdc00000)

       

       

      Polling page: 0x00007febb235f000

       

       

      CodeCache: size=245760Kb used=33298Kb max_used=33323Kb free=212461Kb

      bounds [0x00002aaaaac00000, 0x00002aaaaccd0000, 0x00002aaab9c00000]

      total_blobs=9732 nmethods=8739 adapters=905

      compilation: enabled

       

       

      Compilation events (10 events):

      Event: 25.693 Thread 0x00007febad030800 10633       1       java.util.HashMap::afterNodeRemoval (1 bytes)

      Event: 25.693 Thread 0x00007febad030800 nmethod 10633 0x00002aaaac0b8dd0 code [0x00002aaaac0b8f20, 0x00002aaaac0b9038]

      Event: 25.701 Thread 0x00007febad030800 10634       3       java.beans.FeatureDescriptor::<init> (69 bytes)

      Event: 25.702 Thread 0x00007febad030800 nmethod 10634 0x00002aaaac7d68d0 code [0x00002aaaac7d6ac0, 0x00002aaaac7d7330]

      Event: 25.702 Thread 0x00007febad030800 10635       3       org.springframework.context.annotation.CommonAnnotationBeanPostProcessor$$Lambda$47/148240455::get$Lambda (10 bytes)

      Event: 25.702 Thread 0x00007febad030800 nmethod 10635 0x00002aaaab40bd50 code [0x00002aaaab40bec0, 0x00002aaaab40c1f8]

      Event: 25.702 Thread 0x00007febad030800 10636       3       org.springframework.context.annotation.CommonAnnotationBeanPostProcessor$$Lambda$47/148240455::<init> (15 bytes)

      Event: 25.702 Thread 0x00007febad030800 nmethod 10636 0x00002aaaac3c11d0 code [0x00002aaaac3c1340, 0x00002aaaac3c15d8]

      Event: 25.702 Thread 0x00007febad030800 10637       3       org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$$Lambda$49/223148926::get$Lambda (10 bytes)

      Event: 25.702 Thread 0x00007febad030800 nmethod 10637 0x00002aaaac7c5fd0 code [0x00002aaaac7c6140, 0x00002aaaac7c6478]

       

       

       

       

       

       

       

       

      Memory: 4k page, physical 65789936k(49326140k free), swap 1048572k(1048572k free)

       

       

      vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b26) for linux-amd64 JRE (1.8.0_202-b26), built on Jan  8 2019 22:32:24 by "java_re" with gcc 7.3.0

       

       

      time: Sat Jul 13 08:35:01 2019

      timezone: GMT

      elapsed time: 25 seconds (0d 0h 0m 25s)