This discussion is archived
2 Replies Latest reply: Nov 1, 2012 7:14 PM by 972050 RSS

JVM crashing on Linux VM (CentOS) Guest machine

958630 Newbie
Currently Being Moderated
Hi All

We have headless CentOS VirtualBox VMs configured over headless CentOS (6) machine (32 bit machine). The guest VM has Sun JDK 1.7 installed on the system with Tomcat 7 as the app server.

Recently the tomcat JVM has started crashing giving Segmentation faults. The issue is fixed after the whole VM is restarted. Am attaching the JVM crash logs which might help in further investigation.

Please let us know if anyone has faced similar issue in the past and possible configurations the we might be missing.

Thanks
Sudhir

Sample JVM Crash Log


++#++
++# A fatal error has been detected by the Java Runtime Environment:++
++#++
++# SIGSEGV (0xb) at pc=0x011a164b, pid=2118, tid=2708867952++
++#++
++# JRE version: 7.0-b147++
++# Java VM: Java HotSpot(TM) Client VM (21.0-b17 mixed mode linux-x86 )++
++# Problematic frame:++
++# V [libjvm.so+0x1ba64b] FastScanClosure::do_oop(oopDesc**)+0xb++
++#++
++# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again++
++#++
++# If you would like to submit a bug report, please visit:++
++# http://bugreport.sun.com/bugreport/crash.jsp++
++#++




(gdb) backtrace
#0 0x00fbd416 in __kernel_vsyscall ()
#1 0x002c7b01 in raise () from /lib/libc.so.6
#2 0x002c93da in abort () from /lib/libc.so.6
#3 0x01338bb1 in os::abort(bool) ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#4 0x0141b054 in VMError::report_and_die() ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#5 0x0133cf53 in JVM_handle_linux_signal ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#6 0x013351f6 in signalHandler(int, siginfo*, void*) ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#7 <signal handler called>
#8 0x01178656 in FastScanClosure::do_oop(oopDesc**) ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#9 0x012d1635 in LoaderConstraintTable::oops_do(OopClosure*) ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#10 0x013ba627 in SystemDictionary::oops_do(OopClosure*) ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#11 0x01381879 in SharedHeap::process_strong_roots(bool, bool, SharedHeap::ScanningOption, OopClosure*, CodeBlobClosure*, OopsInGenClosure*) ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#12 0x011c55fb in GenCollectedHeap::gen_process_strong_roots(int, bool, bool, bool, SharedHeap::ScanningOption, OopsInGenClosure*, bool, OopsInGenClosure*) ()
---Type <return> to continue, or q <return> to quit---
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#13 0x011797b8 in DefNewGeneration::collect(bool, bool, unsigned int, bool) ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#14 0x011c7467 in GenCollectedHeap::do_collection(bool, bool, unsigned int, bool, int) () from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#15 0x0112ba50 in GenCollectorPolicy::satisfy_failed_allocation(unsigned int, bool) () from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#16 0x0141bc94 in VM_GenCollectForAllocation::doit() ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#17 0x01422e61 in VM_Operation::evaluate() ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#18 0x01421808 in VMThread::evaluate_operation(VM_Operation*) ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#19 0x01421d47 in VMThread::loop() ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#20 0x014223d5 in VMThread::run() ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#21 0x01339f11 in java_start(Thread*) ()
from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so
#22 0x0045fa49 in start_thread () from /lib/libpthread.so.0
#23 0x0037be5e in clone () from /lib/libc.so.6

Edited by: user13695872 on Aug 29, 2012 5:23 AM
  • 1. Re: JVM crashing on Linux VM (CentOS) Guest machine
    958630 Newbie
    Currently Being Moderated
    Attaching some more threaddump from core file



    ++(gdb) backtrace++
    ++#0 0x00fbd416 in __kernel_vsyscall ()++
    ++#1 0x002c7b01 in raise () from /lib/libc.so.6++
    ++#2 0x002c93da in abort () from /lib/libc.so.6++
    ++#3 0x01338bb1 in os::abort(bool) ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#4 0x0141b054 in VMError::report_and_die() ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#5 0x0133cf53 in JVM_handle_linux_signal ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#6 0x013351f6 in signalHandler(int, siginfo*, void*) ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#7 <signal handler called>++
    ++#8 0x01178656 in FastScanClosure::do_oop(oopDesc**) ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#9 0x012d1635 in LoaderConstraintTable::oops_do(OopClosure*) ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#10 0x013ba627 in SystemDictionary::oops_do(OopClosure*) ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#11 0x01381879 in SharedHeap::process_strong_roots(bool, bool, SharedHeap::ScanningOption, OopClosure*, CodeBlobClosure*, OopsInGenClosure*) ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#12 0x011c55fb in GenCollectedHeap::gen_process_strong_roots(int, bool, bool, bool, SharedHeap::ScanningOption, OopsInGenClosure*, bool, OopsInGenClosure*) ()++
    ++---Type <return> to continue, or q <return> to quit---++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#13 0x011797b8 in DefNewGeneration::collect(bool, bool, unsigned int, bool) ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#14 0x011c7467 in GenCollectedHeap::do_collection(bool, bool, unsigned int, bool, int) () from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#15 0x0112ba50 in GenCollectorPolicy::satisfy_failed_allocation(unsigned int, bool) () from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#16 0x0141bc94 in VM_GenCollectForAllocation::doit() ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#17 0x01422e61 in VM_Operation::evaluate() ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#18 0x01421808 in VMThread::evaluate_operation(VM_Operation*) ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#19 0x01421d47 in VMThread::loop() ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#20 0x014223d5 in VMThread::run() ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#21 0x01339f11 in java_start(Thread*) ()++
    ++from /usr/local/jdk1.7.0/jre/lib/i386/client/libjvm.so++
    ++#22 0x0045fa49 in start_thread () from /lib/libpthread.so.0++
    ++#23 0x0037be5e in clone () from /lib/libc.so.6++
  • 2. Re: JVM crashing on Linux VM (CentOS) Guest machine
    972050 Newbie
    Currently Being Moderated
    Hi,
    Recently, I've faces the similar issues. We installed "jdk-6u26-linux-x64-rpm.bin" on our server(64 bit machine) with OS being SUSE/linux.
    Somebody claimed that this bug has been fixed in jdk-6u29(http://hllvm.group.iteye.com/group/topic/28201). However, after reading your message, I doubt about it.

    I attach the crashing logs as follows:
    #0 0x00007fd0fa8ef945 in raise () from /lib64/libc.so.6
    #1 0x00007fd0fa8f0f21 in abort () from /lib64/libc.so.6
    #2 0x00007fd0fb326637 in os::abort(bool) () from /usr/java/jdk1.6.0_26/jre/lib/amd64/server/libjvm.so
    #3 0x00007fd0fb479cf8 in VMError::report_and_die() () from /usr/java/jdk1.6.0_26/jre/lib/amd64/server/libjvm.so
    #4 0x00007fd0fb32cfe5 in JVM_handle_linux_signal () from /usr/java/jdk1.6.0_26/jre/lib/amd64/server/libjvm.so
    #5 0x00007fd0fb32930e in signalHandler(int, siginfo*, void*) () from /usr/java/jdk1.6.0_26/jre/lib/amd64/server/libjvm.so
    #6 <signal handler called>
    #7 0x00007fd0fbe490f6 in buf_get (buf=0x7fd0e80d56b0) at src/libmm/ztjk_mm.c:143
    #8 0x000000000040c6a2 in deliever_msg (buffer=0x7fd0e80d56b0, queue=0x7fd0e80da9d0, msgtype=0, buf=0x7fd0fce6e010 "\002\030\037K", len=536) at src/tsp/tsp_business.c:1338
    #9 0x000000000040919e in proc_new_file (buf=0x7fd0fce6e010 "\002\030\037K", len=536) at src/tsp/tsp_business.c:62
    #10 0x00000000004021d0 in msg_handler (sip=2728919628, sport=10042, buf=0x7fd0fce6e010 "\002\030\037K", len=536) at src/tsp/tsp_main.c:322
    #11 0x00007fd0fc05703c in comm_in_rcv_th (arg=0x6e3800) at src/libcomm/ztcomm.c:3659
    #12 0x00007fd0fcbbb5f0 in start_thread () from /lib64/libpthread.so.0
    #13 0x00007fd0fa99184d in clone () from /lib64/libc.so.6
    #14 0x0000000000000000 in ?? ()

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points