5 Replies Latest reply: Apr 21, 2010 8:29 PM by 843829 RSS

    JVM crash - JRE version: 6.0_18-b07 - JVM 16.0-b13 mixed mode solaris-amd64

    843829
      Hi,
      I am facing JVM crash issue. It is SIGSEGV, SEGV_MAPERR issue. The release notes say that the bug is fixed in this version..
      Here are parts from hs file (cannot paste whole file due to message size limitation):
      Any idea what can I do to recover from it?

      Thanks
      Abdul Haleem

      #
      # A fatal error has been detected by the Java Runtime Environment:
      #
      # SIGSEGV (0xb) at pc=0xfffffd7fff242352, pid=23259, tid=95
      #
      # JRE version: 6.0_18-b07
      # Java VM: Java HotSpot(TM) 64-Bit Server VM (16.0-b13 mixed mode solaris-amd64 )
      # Problematic frame:
      # C [libc.so.1+0x52352] _memcpy+0x19f2
      #
      # If you would like to submit a bug report, please visit:
      # http://java.sun.com/webapps/bugreport/crash.jsp
      # The crash happened outside the Java Virtual Machine in native code.
      # See problematic frame for where to report the bug.
      #

      T H R E A D

      Current thread (0x00000000011db800): JavaThread "pool-3-thread-11" [_thread_in_native, id=95, stack(0xfffffd7fb1129000,0xfffffd7fb1229000)]

      siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR), si_addr=0xfffffd7ffe28e000

      Registers:
      RAX=0x000000000112e2b0, RBX=0x000000000000003d, RCX=0x000000000112e830, RDX=0xfffffd7ffe28dfed
      RSP=0xfffffd7fb1225fc8, RBP=0xfffffd7fb1226010, RSI=0xfffffd7ffe28da6d, RDI=0x000000000112e2b0
      , R8=0x00000000000005fa, R9=0x0000000000000000, R10=0x0000000000000000, R11=0x0000000000000000, R12=0x0000000000a67620, R13=0xfffffd7ffe28da3f, R14=0x0000000000845b70, R15=0x0000000000000bba
      RIP=0xfffffd7fff242352, RFLAGS=0x0000000000010206

      Stack: [0xfffffd7fb1129000,0xfffffd7fb1229000], sp=0xfffffd7fb1225fc8, free space=3f30000000000000001k
      Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
      C [libc.so.1+0x52352] _memcpy+0x19f2
      C [libzip.so+0xde61] ZIP_GetEntry+0x91
      C [libzip.so+0x4f11] Java_java_util_zip_ZipFile_getEntry+0xa1
      J java.util.zip.ZipFile.getEntry(JLjava/lang/String;Z)J

      Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
      J java.util.zip.ZipFile.getEntry(JLjava/lang/String;Z)J
      J sun.misc.URLClassPath$JarLoader.getResource(Ljava/lang/String;Z)Lsun/misc/Resource;
      J sun.misc.URLClassPath.getResource(Ljava/lang/String;Z)Lsun/misc/Resource;
      j java.net.URLClassLoader$1.run()Ljava/lang/Object;+26
      v ~StubRoutines::call_stub
      j java.security.AccessController.doPrivileged(Ljava/security/PrivilegedExceptionAction;Ljava/security/AccessControlContext;)Ljava/lang/Object;+0
      j java.net.URLClassLoader.findClass(Ljava/lang/String;)Ljava/lang/Class;+13
      j java.lang.ClassLoader.loadClass(Ljava/lang/String;Z)Ljava/lang/Class;+47
      j sun.misc.Launcher$AppClassLoader.loadClass(Ljava/lang/String;Z)Ljava/lang/Class;+41
      j java.lang.ClassLoader.loadClass(Ljava/lang/String;)Ljava/lang/Class;+3
      v ~StubRoutines::call_stub

      Heap
      PSYoungGen total 191552K, used 124594K [0xfffffd7fe5600000, 0xfffffd7ffac00000, 0xfffffd7ffac00000)
      eden space 191296K, 64% used [0xfffffd7fe5600000,0xfffffd7fecf6c8d0,0xfffffd7ff10d0000)
      from space 256K, 100% used [0xfffffd7ffabc0000,0xfffffd7ffac00000,0xfffffd7ffac00000)
      to space 320K, 0% used [0xfffffd7ffab60000,0xfffffd7ffab60000,0xfffffd7ffabb0000)
      PSOldGen total 350208K, used 166805K [0xfffffd7fbaa00000, 0xfffffd7fd0000000, 0xfffffd7fe5600000)
      object space 350208K, 47% used [0xfffffd7fbaa00000,0xfffffd7fc4ce55f8,0xfffffd7fd0000000)
      PSPermGen total 24576K, used 22945K [0xfffffd7fb5600000, 0xfffffd7fb6e00000, 0xfffffd7fbaa00000)
      object space 24576K, 93% used [0xfffffd7fb5600000,0xfffffd7fb6c68490,0xfffffd7fb6e00000)

      Signal Handlers:
      SIGSEGV: [libjvm.so+0xb0c330], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
      SIGBUS: [libjvm.so+0xb0c330], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
      SIGFPE: [libjvm.so+0x3cdd40], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
      SIGPIPE: [libjvm.so+0x3cdd40], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
      SIGXFSZ: [libjvm.so+0x3cdd40], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
      SIGILL: [libjvm.so+0x3cdd40], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
      SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
      SIGUSR2: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
      SIGQUIT: [libjvm.so+0x9e1b90], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
      SIGHUP: [libjvm.so+0x9e1b90], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
      SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
      SIGTERM: [libjvm.so+0x9e1b90], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
      SIG39: [libjvm.so+0x9e46d0], sa_mask[0]=0x00000000, sa_flags=0x00000008
      SIG40: [libjvm.so+0x3cdd40], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c

      S Y S T E M

      OS: Solaris 10 5/09 s10x_u7wos_08 X86
      Copyright 2009 Sun Microsystems, Inc. All Rights Reserved.
      Use is subject to license terms.
      Assembled 30 March 2009

      uname:SunOS 5.10 Generic_139556-08 i86pc (T2 libthread)
      rlimit: STACK 10240k, CORE infinity, NOFILE 65536, AS infinity
      load average:3.87 3.44 3.66

      CPU:total 2 (2 cores per cpu, 1 threads per core) family 15 model 67 stepping 3, cmov, cx8, fxsr, mmx, sse, sse2, sse3, mmxext, 3dnow, 3dnowext

      Memory: 4k page, physical 8388156k(1389524k free)

      vm_info: Java HotSpot(TM) 64-Bit Server VM (16.0-b13) for solaris-amd64 JRE (1.6.0_18-b07), built on Dec 17 2009 21:31:38 by "" with Workshop 5.8

      time: Fri Jan 22 19:42:49 2010
      elapsed time: 2574 seconds
        • 1. Re: JVM crash - JRE version: 6.0_18-b07 - JVM 16.0-b13 mixed mode solaris-amd64
          843829
          I am seeing the same error in Linux and in Solaris-x86

          In Linux :
          JRE version: 6.0_18-b07
          # Java VM: Java HotSpot(TM) Server VM (16.0-b13 mixed mode linux-x86 )
          # Problematic frame:
          # C [libzip.so+0xbc53]

          In Solaris :
          JRE version: 6.0_18-b07
          # Java VM: Java HotSpot(TM) Server VM (16.0-b13 mixed mode solaris-x86 )
          # Problematic frame:
          # C [libc.so.1+0x2545f] _memcpy+0xff

          Does any bug created to track this issue?
          • 2. Re: JVM crash - JRE version: 6.0_18-b07 - JVM 16.0-b13 mixed mode solaris-amd64
            843829
            Same problem! I tried the fixes suggested for the "Card-Marking Optimization Issue" located in the release notes at http://java.sun.com/javase/6/webnotes/6u18.html, but no luck! Here is part of my log file, can post the whole thing if desired: (emphasis added in certain areas)
            #
            # A fatal error has been detected by the Java Runtime Environment:
            #
            #  SIGSEGV (0xb) at pc=0x00000036c98703cb, pid=15012, tid=1104709952
            #
            # JRE version: 6.0_18-b07
            # Java VM: Java HotSpot(TM) 64-Bit Server VM (16.0-b13 mixed mode linux-amd64 )
            # Problematic frame:
            # C  [libc.so.6+0x703cb]
            #
            # If you would like to submit a bug report, please visit:
            #   http://java.sun.com/webapps/bugreport/crash.jsp
            # The crash happened outside the Java Virtual Machine in native code.
            # See problematic frame for where to report the bug.
            #
            
            ---------------  T H R E A D  ---------------
            
            Current thread (0x000000005d32a000):  JavaThread "main" [\_thread_in_native, id=15013, stack(0x0000000041c88000,0x0000000041d89000)]
            
            siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR), si_addr=0x0000000000000018
            
            .
            .
            .
            
            Stack: [0x0000000041c88000,0x0000000041d89000],  sp=0x0000000041d86e50,  free space=3fb0000000000000018k
            Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
            C  [libc.so.6+0x703cb]
            
            Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
            j  com.sun.jna.Function.invokeInt(I[Ljava/lang/Object;)I+0
            j  com.sun.jna.Function.invoke([Ljava/lang/Object;Ljava/lang/Class;Z)Ljava/lang/Object;+315
            j  com.sun.jna.Function.invoke(Ljava/lang/Class;[Ljava/lang/Object;Ljava/util/Map;)Ljava/lang/Object;+214
            j  com.sun.jna.Library$Handler.invoke(Ljava/lang/Object;Ljava/lang/reflect/Method;[Ljava/lang/Object;)Ljava/lang/Object;+341
            j  $Proxy0.MPI_Finalize()I+9
            j  MPI.Finalize()V+3                               <=============== This is a direct JNI link to MPI_Finalize(), a C function that takes no arguments
            j  Main.main([Ljava/lang/String;)V+132                                      and cannot POSSIBLY be screwed up by me!
            v  ~StubRoutines::call_stub
            
            ---------------  P R O C E S S  ---------------
            
            Java Threads: ( => current thread )
              0x000000005d3c2800 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=15041, stack(0x0000000041f18000,0x0000000042019000)]
              0x000000005d3c0800 JavaThread "CompilerThread1" daemon [_thread_blocked, id=15040, stack(0x0000000041e17000,0x0000000041f18000)]
              0x000000005d3bb000 JavaThread "CompilerThread0" daemon [_thread_blocked, id=15039, stack(0x000000004020c000,0x000000004030d000)]
              0x000000005d3b9000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=15038, stack(0x000000004010b000,0x000000004020c000)]
              0x000000005d394800 JavaThread "Finalizer" daemon [_thread_blocked, id=15029, stack(0x00000000407d8000,0x00000000408d9000)]
              0x000000005d392800 JavaThread "Reference Handler" daemon [_thread_blocked, id=15028, stack(0x00000000406d7000,0x00000000407d8000)]
            =>0x000000005d32a000 JavaThread "main" [_thread_in_native, id=15013, stack(0x0000000041c88000,0x0000000041d89000)]
            
            Other Threads:
              0x000000005d38d800 VMThread [stack: 0x00000000405d6000,0x00000000406d7000] [id=15025]
              0x000000005d3c5000 WatcherThread [stack: 0x0000000042019000,0x000000004211a000] [id=15042]
            
            VM state:not at safepoint (normal execution)
            
            VM Mutex/Monitor currently owned by a thread: None
            
            Heap
             PSYoungGen      total 112448K, used 1928K [0x00002aabae2d0000, 0x00002aabb6040000, 0x00002aac2ba20000)
              eden space 96448K, 2% used [0x00002aabae2d0000,0x00002aabae4b23e8,0x00002aabb4100000)
              from space 16000K, 0% used [0x00002aabb50a0000,0x00002aabb50a0000,0x00002aabb6040000)
              to   space 16000K, 0% used [0x00002aabb4100000,0x00002aabb4100000,0x00002aabb50a0000)
             PSOldGen        total 256896K, used 0K [0x00002aaab3420000, 0x00002aaac2f00000, 0x00002aabae2d0000)
              object space 256896K, 0% used [0x00002aaab3420000,0x00002aaab3420000,0x00002aaac2f00000)
             PSPermGen       total 21248K, used 4253K [0x00002aaaae020000, 0x00002aaaaf4e0000, 0x00002aaab3420000)
              object space 21248K, 20% used [0x00002aaaae020000,0x00002aaaae447418,0x00002aaaaf4e0000)
            
            .
            .
            .
            
            VM Arguments:
            jvm_args: -XX:-ReduceInitialCardMarks -XX:-CMSPrecleaningEnabled  <=================== Note how this is the suggested fix!
            java_command: Main
            Launcher Type: SUN_STANDARD
            
            Environment Variables:
            PATH=/usr/kerberos/bin:/usr/cluster/mvapich2/1.4rc2/pgi/9.0/bin:/usr/cluster/pgi/linux86-64/9.0/bin:/opt/env-switcher/bin:/usr/cluster/gaussian/09/g09/bsd:/usr/cluster/gaussian$
            LD_LIBRARY_PATH=/usr/lib/jvm/java-1.6.0-sun-1.6.0.18.x86_64/jre/lib/amd64/server:/usr/lib/jvm/java-1.6.0-sun-1.6.0.18.x86_64/jre/lib/amd64:/usr/lib/jvm/java-1.6.0-sun-1.6.0.18.$
            SHELL=/bin/bash
            DISPLAY=localhost:12.0
            
            Signal Handlers:
            SIGSEGV: [libjvm.so+0x70f1a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
            SIGBUS: [libjvm.so+0x70f1a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
            SIGFPE: [libjvm.so+0x5d7f70], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
            SIGPIPE: [libjvm.so+0x5d7f70], sa_mask[0]=0x00001000, sa_flags=0x00000000, flags was changed from 0x10000004, consider using jsig library
            SIGXFSZ: [libjvm.so+0x5d7f70], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
            SIGILL: [libjvm.so+0x5d7f70], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
            SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
            SIGUSR2: [libjvm.so+0x5da790], sa_mask[0]=0x00000004, sa_flags=0x10000004
            SIGHUP: [libjvm.so+0x5da4e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
            SIGINT: [libjvm.so+0x5da4e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
            SIGTERM: [libjvm.so+0x5da4e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
            SIGQUIT: [libjvm.so+0x5da4e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
            
            
            ---------------  S Y S T E M  ---------------
            
            OS:Red Hat Enterprise Linux Server release 5.5 (Tikanga)
            
            
            uname:Linux 2.6.18-194.el5 #1 SMP Tue Mar 16 21:52:39 EDT 2010 x86_64
            libc:glibc 2.5 NPTL 2.5
            rlimit: STACK 10240k, CORE 0k, NPROC 212992, NOFILE 1024, AS infinity
            load average:0.00 0.00 0.00
            
            CPU:total 8 (8 cores per cpu, 2 threads per core) family 6 model 26 stepping 5, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, ht
            
            Memory: 4k page, physical 24660212k(23498960k free), swap 8385888k(8277752k free)
            
            vm_info: Java HotSpot(TM) 64-Bit Server VM (16.0-b13) for linux-amd64 JRE (1.6.0_18-b07), built on Dec 17 2009 13:42:22 by "java_re" with gcc 3.2.2 (SuSE Linux)
            
            time: Mon Apr 12 20:28:07 2010
            elapsed time: 0 seconds
            Edited by: bharris1 on Apr 12, 2010 5:49 PM
            • 3. Re: JVM crash - JRE version: 6.0_18-b07 - JVM 16.0-b13 mixed mode solaris-amd64
              843829
              Crash is because of modifying the jar while enumerating it.
              • 4. Re: JVM crash - JRE version: 6.0_18-b07 - JVM 16.0-b13 mixed mode solaris-amd64
                jschellSomeoneStoleMyAlias
                Seetharama wrote:
                Crash is because of modifying the jar while enumerating it.
                There is no way that you are getting both a SIGSEGV and SIGBUS (per the other thread.)
                Which makes you suggestion as to the cause for everyone else suspect.
                • 5. Re: JVM crash - JRE version: 6.0_18-b07 - JVM 16.0-b13 mixed mode solaris-amd64
                  843829
                  Thanks, you are correct, I am getting only SIGBUS

                  SIGBUS (0xa) at pc=0xfee5545f, pid=11158, tid=2
                  #
                  # JRE version: 6.0_18-b07
                  # Java VM: Java HotSpot(TM) Server VM (16.0-b13 mixed mode solaris-x86 )
                  # Problematic frame:
                  # C [libc.so.1+0x2545f] _memcpy+0xff