This discussion is archived
0 Replies Latest reply: Jul 30, 2010 6:43 AM by 843798 RSS

OOM Exception during GC

843798 Newbie
Currently Being Moderated
Hi All, I'm hoping this is the correct forum to discussing this problem. If not please direct me to the best place.

We've recently experienced this OOM in one of our busiest sites and I've had to do a fair amount of research on Java's memory management.
Unfortunately I couldn't find much regarding this specific error but have figured out the follow:

- The crash occured during GC
- The crash appears to be in native code

From the tips I've read up on, it appears that I don't have enough PermGen size as the hs_err file says my PermGen size is at 98% at 27745K. The problem is I'm using the default size at 64M. So how could the error file show that PermGen size is full?

Unfortunately I can't add the entire hs_err file. But the important bits are:

#
# An unexpected error has been detected by Java Runtime Environment:
#
# java.lang.OutOfMemoryError: requested 4096000 bytes for GrET in /BUILD_AREA/jdk6_02/hotspot/src/share/vm/utilities/growableArray.cpp. Out of swap space?
#
# Internal Error (414C4C4F434154494F4E0E494E4C494E450E4850500017), pid=8534, tid=1885957024
#
# Java VM: Java HotSpot(TM) Server VM (1.6.0_02-b05 mixed mode)
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
#

--------------- T H R E A D ---------------

Current thread (0x0813c000): VMThread [id=8540]

Stack: [0x70616000,0x70697000), sp=0x70695cf0, free space=511k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x53b707]
V [libjvm.so+0x225fe1]
V [libjvm.so+0x2910fc]
V [libjvm.so+0x21bd5e]
V [libjvm.so+0x41d4ac]
V [libjvm.so+0x2a0e10]
V [libjvm.so+0x41d5df]
V [libjvm.so+0x488414]
V [libjvm.so+0x4875db]
V [libjvm.so+0x491fbf]
V [libjvm.so+0x45fae9]
V [libjvm.so+0x53cbbd]
V [libjvm.so+0x54ea67]
V [libjvm.so+0x54e0ec]
V [libjvm.so+0x54e2ba]
V [libjvm.so+0x54de9f]
V [libjvm.so+0x453139]
C [libpthread.so.0+0x53cc]

VM_Operation (0x6c54c8e0): parallel gc failed allocation, mode: safepoint, requested by thread 0x085f7800

........................................

Heap
PSYoungGen total 37248K, used 936K [0xadc90000, 0xb08b0000, 0xb4e50000)
eden space 36288K, 0% used [0xadc90000,0xadc90000,0xb0000000)
from space 960K, 97% used [0xb07c0000,0xb08aa010,0xb08b0000)
to space 4032K, 0% used [0xb00d0000,0xb00d0000,0xb04c0000)
PSOldGen total 417600K, used 416570K [0x74e50000, 0x8e620000, 0xadc90000)
object space 417600K, 99% used [0x74e50000,0x8e51e8f8,0x8e620000)
PSPermGen total 28032K, used 27745K [0x70e50000, 0x729b0000, 0x74e50000)
object space 28032K, 98% used [0x70e50000,0x72968560,0x729b0000)


.................................................


VM Arguments:
jvm_args: -Xmx1024m -Dcom.sun.management.jmxremote.port=8998 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false
java_command: vitel.jar
Launcher Type: SUN_STANDARD

Environment Variables:
PATH=/opt/java/jdk1.6.0_02/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/var/lib/asterisk/bin
LD_LIBRARY_PATH=/opt/java/jdk1.6.0_02/jre/lib/i386/server:/opt/java/jdk1.6.0_02/jre/lib/i386:/opt/java/jdk1.6.0_02/jre/../lib/i386
SHELL=/bin/bash

Signal Handlers:
SIGSEGV: [libjvm.so+0x53c2c0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGBUS: [libjvm.so+0x53c2c0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGFPE: [libjvm.so+0x4518e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGPIPE: [libjvm.so+0x4518e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGILL: [libjvm.so+0x4518e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: [libjvm.so+0x453910], sa_mask[0]=0x00000000, sa_flags=0x10000004
SIGHUP: [libjvm.so+0x453330], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGQUIT: [libjvm.so+0x453330], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGTERM: [libjvm.so+0x453330], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGUSR2: [libjvm.so+0x453910], sa_mask[0]=0x00000000, sa_flags=0x10000004


--------------- S Y S T E M ---------------

OS:CentOS release 4.7 (Final)

uname:Linux 2.6.9-78.0.13.ELsmp #1 SMP Wed Jan 14 16:12:46 EST 2009 i686
libc:glibc 2.3.4 NPTL 2.3.4
rlimit: STACK 10240k, CORE 0k, NPROC 77823, NOFILE 1024, AS infinity
load average:2.22 1.98 1.96

CPU:total 4 (2 cores per cpu, 1 threads per core) family 6 model 15 stepping 6, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3

Memory: 4k page, physical 4147680k(21476k free), swap 2031608k(1719448k free)

vm_info: Java HotSpot(TM) Server VM (1.6.0_02-b05) for linux-x86, built on Jun 14 2007 15:52:09 by "java_re" with gcc 3.2.1-7a (J2SE release)