2 Replies Latest reply: Jan 11, 2012 2:13 AM by ddevienne RSS

    OCI causing JVM crash

    905175
      #
      # A fatal error has been detected by the Java Runtime Environment:
      #
      # java.lang.OutOfMemoryError: requested 746 bytes for jbyte in /BUILD_AREA/jdk6_21/hotspot/src/share/vm/prims/jni.cpp. Out of swap space?
      #
      # Internal Error (allocation.inline.hpp:39), pid=21129, tid=667401120
      # Error: jbyte in /BUILD_AREA/jdk6_21/hotspot/src/share/vm/prims/jni.cpp
      #
      # JRE version: 6.0_21-b06
      # Java VM: Java HotSpot(TM) Server VM (17.0-b16 mixed mode linux-x86 )
      # If you would like to submit a bug report, please visit:
      # http://java.sun.com/webapps/bugreport/crash.jsp
      #

      --------------- T H R E A D ---------------

      Current thread (0x2f929000): JavaThread "DRIVER:mm7adapter:12:7" [_thread_in_vm, id=21834, stack(0x27c5b000,0x27c7c000)]

      Stack: [0x27c5b000,0x27c7c000], sp=0x27c7a874, free space=7e27c7c000k
      Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
      V [libjvm.so+0x6a9262]
      V [libjvm.so+0x2b277f]
      V [libjvm.so+0x3c0b0f]
      C [libocijdbc10.so+0x108ff]
      C [libocijdbc10.so+0x11788] Java_oracle_jdbc_driver_T2CConnection_lobGetLength+0x30
      J oracle.jdbc.driver.T2CConnection.lobGetLength(J[BI)J

      Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
      J oracle.jdbc.driver.T2CConnection.lobGetLength(J[BI)J
      J oracle.jdbc.driver.T2CConnection.length(Loracle/sql/BLOB;)J
      J com.firsthop.common.database.ReadConnectionImpl.getByteArray(Ljava/lang/String;Ljava/sql/ResultSet;I)[B
      J com.firsthop.common.database.ReadConnectionWrapper.getByteArray(Ljava/lang/String;Ljava/sql/ResultSet;I)[B
      J com.firsthop.mr.storage.MultiJDBCStorage.fillInitiator(Lcom/firsthop/common/database/ReadConnection;Ljava/lang/String;Ljava/sql/ResultSet;Lcom/firsthop/mr/router/TransactionResponder;)Lcom/firsthop/mr/router/TransactionInitiator;
      J com.firsthop.mr.storage.MultiJDBCStorage.addInitiators(Lcom/firsthop/mr/router/TransactionResponder;Ljava/util/Collection;)V
      J com.firsthop.mr.storage.CacheStorage.getResponderByTransactionID(Ljava/lang/String;)Lcom/firsthop/mr/router/TransactionResponder;
      j com.firsthop.mr.router.RoutingEngine.getResponderByTransactionID(Ljava/lang/String;)Lcom/firsthop/mr/router/TransactionResponder;+5
      j com.firsthop.mr.router.RoutingEngine.scheduleStatusResend(Ljava/lang/String;)Z+53
      j com.firsthop.mr.router.RoutingEngine.scheduleResend(Lcom/firsthop/mr/message/Message;I)Z+68
      j com.firsthop.mr.drivers.Driver.getMessage(Ljava/lang/Object;)Lcom/firsthop/mr/message/Message;+260
      J com.firsthop.mr.drivers.Driver$QueueWorker.run()V
      j com.firsthop.common.threadpool.ThreadControl.run()V+47
      j com.firsthop.common.threadpool.ThreadPool$PoolThread.run()V+467
      v ~StubRoutines::call_stub



      VM Arguments:
      jvm_args: -Xms1024M -Xmx2048M -Dcom.firsthop.common.database.tracefile=log/%m-db.trace -Dcom.firsthop.common.database.debug=true -Dcom.firsthop.common.database.trace=log/%m-db.trace -enableassertions -Dnetworkaddress.cache.ttl=3600 -Dnetworkaddress.cache.negative.ttl=1800 -Djava.security.auth.login.config=conf/jaas.conf -Dorg.apache.commons.logging.Log=com.firsthop.common.log.JakartaInfoDLogBridge -Djava.net.preferIPv4Stack=true -Dhttp.maxConnections=50 -Dsun.net.client.defaultReadTimeout=30000 -Dsun.net.client.defaultConnectTimeout=10000 -Djava.awt.headless=true -Dsun.net.http.retryPost=false -Dcom.firsthop.mr.common.plugin.usageLogDir=/apps/gateway/current/cdr/.usagelog/ -verbose:gc -XX:+HeapDumpOnOutOfMemoryError -Xss128k -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintCommandLineFlags -XX:+HeapDumpOnOutOfMemoryError -Dmodule.name=mmsrouter -Dmodule.home=/apps/gateway/current -Dhost.name=mmsgwy3 -Dmodule.config_file=conf/mmsrouter.conf -Dmodule.xml_config_file=conf/mmsrouter.xml -Dmodule.pid_file=var/mmsrouter.pid -Dmodule.log_file=log/mmsrouter.log -Dmodule.output_prefix=log/mmsrouter
      java_command: com.firsthop.common.platform.ModuleStarter mmsrouter conf/mmsrouter.xml log/mmsrouter.log
      Launcher Type: SUN_STANDARD

      Environment Variables:
      JAVA_HOME=/apps/jdk
      PATH=/apps/jdk/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/bin:/sbin:/home/ins/bin:/apps/oracle/10.2.0.3/client/bin:/usr/sbin
      LD_LIBRARY_PATH=/apps/jdk1.6.0_21/jre/lib/i386/server:/apps/jdk1.6.0_21/jre/lib/i386:/apps/jdk1.6.0_21/jre/../lib/i386:/apps/oracle/10.2.0.3/client/lib32
      SHELL=/bin/bash

      Signal Handlers:
      SIGSEGV: [libjvm.so+0x6a9eb0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGBUS: [libjvm.so+0x6a9eb0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGFPE: [libjvm.so+0x578180], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGPIPE: SIG_IGN, sa_mask[0]=0x3e7bf217, sa_flags=0x10000004
      SIGXFSZ: [libjvm.so+0x578180], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGILL: [libjvm.so+0x578180], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
      SIGUSR2: [libjvm.so+0x57adc0], sa_mask[0]=0x00000000, sa_flags=0x10000004
      SIGHUP: [libjvm.so+0x57aaf0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
      SIGTERM: [libjvm.so+0x57aaf0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGQUIT: [libjvm.so+0x57aaf0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004


      --------------- S Y S T E M ---------------

      OS:Red Hat Enterprise Linux AS release 4 (Nahant Update 6)

      uname:Linux 2.6.9-67.ELsmp #1 SMP Wed Nov 7 13:58:04 EST 2007 i686
      libc:glibc 2.3.4 NPTL 2.3.4
      rlimit: STACK 10240k, CORE infinity, NPROC 274431, NOFILE 4096, AS infinity
      load average:2.62 2.52 2.43

      CPU:total 4 (2 cores per cpu, 1 threads per core) family 15 model 65 stepping 3, cmov, cx8, fxsr, mmx, sse, sse2, sse3, mmxext, 3dnow, 3dnowext

      Memory: 4k page, physical 16631944k(153644k free), swap 18940592k(18821620k free)

      vm_info: Java HotSpot(TM) Server VM (17.0-b16) for linux-x86 JRE (1.6.0_21-b06), built on Jun 22 2010 01:04:46 by "java_re" with gcc 3.2.1-7a (J2SE release)

      time: Fri Sep 30 17:09:15 2011
      elapsed time: 712510 seconds
        • 1. Re: OCI causing JVM crash
          905175
          oci version - 10.2.0.3
          • 2. Re: OCI causing JVM crash
            ddevienne
            Technically, the crash appears to happen in Java_oracle_jdbc_driver_T2CConnection_lobGetLength, i.e. the JNI native impl behind the Java method native, and not in OCI itself. I'm sure that method makes OCI calls (like OCILobGetLength2), but not in this particular stack trace. So this is a bug in the native part of OCI-based Java driver for Oracle, supplied by Oracle, which you should report to Oracle. There's nothing anyone can do I'm afraid in this forum. --DD