0 Replies Latest reply: Jul 30, 2010 8:43 AM by 843798 RSS

    OOM Exception during GC

    843798
      Hi All, I'm hoping this is the correct forum to discussing this problem. If not please direct me to the best place.

      We've recently experienced this OOM in one of our busiest sites and I've had to do a fair amount of research on Java's memory management.
      Unfortunately I couldn't find much regarding this specific error but have figured out the follow:

      - The crash occured during GC
      - The crash appears to be in native code

      From the tips I've read up on, it appears that I don't have enough PermGen size as the hs_err file says my PermGen size is at 98% at 27745K. The problem is I'm using the default size at 64M. So how could the error file show that PermGen size is full?

      Unfortunately I can't add the entire hs_err file. But the important bits are:

      #
      # An unexpected error has been detected by Java Runtime Environment:
      #
      # java.lang.OutOfMemoryError: requested 4096000 bytes for GrET in /BUILD_AREA/jdk6_02/hotspot/src/share/vm/utilities/growableArray.cpp. Out of swap space?
      #
      # Internal Error (414C4C4F434154494F4E0E494E4C494E450E4850500017), pid=8534, tid=1885957024
      #
      # Java VM: Java HotSpot(TM) Server VM (1.6.0_02-b05 mixed mode)
      # If you would like to submit a bug report, please visit:
      # http://java.sun.com/webapps/bugreport/crash.jsp
      #

      --------------- T H R E A D ---------------

      Current thread (0x0813c000): VMThread [id=8540]

      Stack: [0x70616000,0x70697000), sp=0x70695cf0, free space=511k
      Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
      V [libjvm.so+0x53b707]
      V [libjvm.so+0x225fe1]
      V [libjvm.so+0x2910fc]
      V [libjvm.so+0x21bd5e]
      V [libjvm.so+0x41d4ac]
      V [libjvm.so+0x2a0e10]
      V [libjvm.so+0x41d5df]
      V [libjvm.so+0x488414]
      V [libjvm.so+0x4875db]
      V [libjvm.so+0x491fbf]
      V [libjvm.so+0x45fae9]
      V [libjvm.so+0x53cbbd]
      V [libjvm.so+0x54ea67]
      V [libjvm.so+0x54e0ec]
      V [libjvm.so+0x54e2ba]
      V [libjvm.so+0x54de9f]
      V [libjvm.so+0x453139]
      C [libpthread.so.0+0x53cc]

      VM_Operation (0x6c54c8e0): parallel gc failed allocation, mode: safepoint, requested by thread 0x085f7800

      ........................................

      Heap
      PSYoungGen total 37248K, used 936K [0xadc90000, 0xb08b0000, 0xb4e50000)
      eden space 36288K, 0% used [0xadc90000,0xadc90000,0xb0000000)
      from space 960K, 97% used [0xb07c0000,0xb08aa010,0xb08b0000)
      to space 4032K, 0% used [0xb00d0000,0xb00d0000,0xb04c0000)
      PSOldGen total 417600K, used 416570K [0x74e50000, 0x8e620000, 0xadc90000)
      object space 417600K, 99% used [0x74e50000,0x8e51e8f8,0x8e620000)
      PSPermGen total 28032K, used 27745K [0x70e50000, 0x729b0000, 0x74e50000)
      object space 28032K, 98% used [0x70e50000,0x72968560,0x729b0000)


      .................................................


      VM Arguments:
      jvm_args: -Xmx1024m -Dcom.sun.management.jmxremote.port=8998 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false
      java_command: vitel.jar
      Launcher Type: SUN_STANDARD

      Environment Variables:
      PATH=/opt/java/jdk1.6.0_02/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/var/lib/asterisk/bin
      LD_LIBRARY_PATH=/opt/java/jdk1.6.0_02/jre/lib/i386/server:/opt/java/jdk1.6.0_02/jre/lib/i386:/opt/java/jdk1.6.0_02/jre/../lib/i386
      SHELL=/bin/bash

      Signal Handlers:
      SIGSEGV: [libjvm.so+0x53c2c0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGBUS: [libjvm.so+0x53c2c0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGFPE: [libjvm.so+0x4518e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGPIPE: [libjvm.so+0x4518e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGILL: [libjvm.so+0x4518e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
      SIGUSR2: [libjvm.so+0x453910], sa_mask[0]=0x00000000, sa_flags=0x10000004
      SIGHUP: [libjvm.so+0x453330], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
      SIGQUIT: [libjvm.so+0x453330], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGTERM: [libjvm.so+0x453330], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGUSR2: [libjvm.so+0x453910], sa_mask[0]=0x00000000, sa_flags=0x10000004


      --------------- S Y S T E M ---------------

      OS:CentOS release 4.7 (Final)

      uname:Linux 2.6.9-78.0.13.ELsmp #1 SMP Wed Jan 14 16:12:46 EST 2009 i686
      libc:glibc 2.3.4 NPTL 2.3.4
      rlimit: STACK 10240k, CORE 0k, NPROC 77823, NOFILE 1024, AS infinity
      load average:2.22 1.98 1.96

      CPU:total 4 (2 cores per cpu, 1 threads per core) family 6 model 15 stepping 6, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3

      Memory: 4k page, physical 4147680k(21476k free), swap 2031608k(1719448k free)

      vm_info: Java HotSpot(TM) Server VM (1.6.0_02-b05) for linux-x86, built on Jun 14 2007 15:52:09 by "java_re" with gcc 3.2.1-7a (J2SE release)