This discussion is archived
8 Replies Latest reply: Mar 6, 2013 7:34 AM by 994937 RSS

OC4J_SOA Jvm Crashes due to the Jamagent deployed on that JVM

994937 Newbie
Currently Being Moderated
Hi,
Am new to this Forum. I have Been working on Implementing OEM 11g Diagnostics tool (JVMD & ADP) In Our environment.I have Installed the JVMD manager in OMS and installed the Jamagent in oc4j_SOA Target.
All the JvmdUI functionality has been working with out any Issues, but the Issue is SOA_JVM getting crashed due to the JAmagent,Prior to Crashing it generates huge Thread dump.
I could see the Following error in the JVM.Is any One Come across with this Issue.Please help me out if you have any Info on this

"Exception in thread "Thread-3519" Jam Agent : Get Field ID Fail Field sqlObject Signature : Loracle/jdbc/driver/OracleSql;
Taking 1024 threads
Jam Agent: Buffer Overflow in JamStrncat
Jam Agent: Buffer Overflow in JamStrncat
Jam Agent: Buffer Overflow in JamStrncat
Exception in thread "Thread-3519" Jam Agent : Get Field ID Fail Field sqlObject Signature : Loracle/jdbc/driver/OracleSql;
Jam Agent: Source greater than destination
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGBUS (0xa) at pc=0xfffffff9a20b263c, pid=98130, tid=22955
#
# JRE version: 6.0_31-b04
# Java VM: Java HotSpot(TM) 64-Bit Server VM (20.6-b01 mixed mode solaris-sparc compressed oops)
# Problematic frame:
# C [libjamagent.so.2+0xb263c] InsertOcammDmsData+0x1148
#
# An error report file with more information is saved as:
# /opt/webapps/oracle/product/APP_RAC_OH1/j2ee/home/hs_err_pid98130.log
#
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

--------
13/03/01 17:00:35 Stop process"

Thanks & Regards
Santhosh
  • 1. Re: OC4J_SOA Jvm Crashes due to the Jamagent deployed on that JVM
    Vishal_EM_assist Explorer
    Currently Being Moderated
    Hello,

    Can you please provide the following:
    1) Full JVMD agent log (i.e. console output from the target server)
    2) hs_err_pid98130.log?
    3) Is there a core file? If so, can we have the core file?

    Which customer does this query represent? Are you using Oracle SOA? If yes, then what is the version of SOA?

    Thanks.
  • 2. Re: OC4J_SOA Jvm Crashes due to the Jamagent deployed on that JVM
    994937 Newbie
    Currently Being Moderated
    Vishal, Please Let me know how to send those logs..am not seeing any link to attach files...

    Which customer does this query represent? Are you using Oracle SOA? If yes, then what is the version of SOA
    Cummins / Yes / 10g(10.1.3.5.0)

    Regards
    Santhosh
  • 3. Re: OC4J_SOA Jvm Crashes due to the Jamagent deployed on that JVM
    Vishal_EM_assist Explorer
    Currently Being Moderated
    Can you copy past the content log files here if that fits in?
  • 4. Re: OC4J_SOA Jvm Crashes due to the Jamagent deployed on that JVM
    994937 Newbie
    Currently Being Moderated
    hs_err_pid98130.log


    #
    # A fatal error has been detected by the Java Runtime Environment:
    #
    # SIGBUS (0xa) at pc=0xfffffff9a20b263c, pid=98130, tid=22955
    #
    # JRE version: 6.0_31-b04
    # Java VM: Java HotSpot(TM) 64-Bit Server VM (20.6-b01 mixed mode solaris-sparc compressed oops)
    # Problematic frame:
    # C [libjamagent.so.2+0xb263c] InsertOcammDmsData+0x1148
    #
    # If you would like to submit a bug report, please visit:
    # http://java.sun.com/webapps/bugreport/crash.jsp
    # The crash happened outside the Java Virtual Machine in native code.
    # See problematic frame for where to report the bug.
    #

    --------------- T H R E A D ---------------

    Current thread (0x0000000116cea800): JavaThread "Thread-3519" [_thread_in_native, id=22955, stack(0x00000001165b2000,0x00000001166b09c0)]

    siginfo:si_signo=SIGBUS: si_errno=0, si_code=1 (BUS_ADRALN), si_addr=0x656e67696e652e43

    Registers:
    G1=0x656e67696e652e43 G2=0x0000000000000a80 G3=0x0000000000000001 G4=0xfffffff9a21fd4fc
    G5=0x00000000816c3800 G6=0xfffffffa0000e000 G7=0xfffffff9b223c200 Y=0x0000000000000000
    O0=0x0000000000100145 O1=0x0000000061000000 O2=0x000000011845b9d5 O3=0x0000000080808080
    O4=0x0000000000ff0000 O5=0x0000000080808080 O6=0x00000001166898b1 O7=0xfffffff9a20b2600
    L0=0x0000000112fce2f0 L1=0x0000000000000000 L2=0x000000007fffffff L3=0x0000000000002000
    L4=0x00000000000023d0 L5=0x0000000001000000 L6=0xffffffff7eb4bfc4 L7=0xfffffff9a21e6970
    I0=0xfffffff9a236b430 I1=0x00000001132cd070 I2=0x000000000000010a I3=0x0000000000008000
    I4=0xfffffff9b223c200 I5=0x0000000000000000 I6=0x00000001166899e1 I7=0xfffffff9a20b14d0
    PC=0xfffffff9a20b263c nPC=0xfffffff9a20b2640


    Top of Stack: (sp=0x000000011668a0b0)
    0x000000011668a0b0: 0000000112fce2f0 0000000000000000
    0x000000011668a0c0: 000000007fffffff 0000000000002000
    0x000000011668a0d0: 00000000000023d0 0000000001000000
    0x000000011668a0e0: ffffffff7eb4bfc4 fffffff9a21e6970
    0x000000011668a0f0: fffffff9a236b430 00000001132cd070
    0x000000011668a100: 000000000000010a 0000000000008000
    0x000000011668a110: fffffff9b223c200 0000000000000000
    0x000000011668a120: 00000001166899e1 fffffff9a20b14d0
    0x000000011668a130: fffffff9a246525c fffffff9a20e0b80
    0x000000011668a140: 0000000000000031 0000000111b70b40
    0x000000011668a150: 000000000000010a fffffff9a21fd5f8
    0x000000011668a160: 00000000000fa000 000001d300100145
    0x000000011668a170: 0000000117f6e35b 0000000117f6e36c
    0x000000011668a180: fffffff9a246525c fffffff9a246525c
    0x000000011668a190: 0000000000102fab 000000011835b890
    0x000000011668a1a0: 0000000117f676b0 0000000111b70b40

    Instructions: (pc=0xfffffff9a20b263c)
    0xfffffff9a20b261c: 82 10 60 90 c8 5d c0 01 82 10 20 01 c2 21 00 00
    0xfffffff9a20b262c: 03 00 00 0e 82 10 63 a0 c2 5d c0 01 c2 58 40 00
    0xfffffff9a20b263c: c8 58 40 00 03 00 00 0e 82 10 63 a0 c2 5d c0 01
    0xfffffff9a20b264c: c8 59 25 50 d0 58 40 00 d2 5f a7 e7 d4 5f a7 bf

    Register to memory mapping:

    G1=0x656e67696e652e43 is an unknown value
    G2=0x0000000000000a80 is an unknown value
    G3=0x0000000000000001 is an unknown value
    G4=0xfffffff9a21fd4fc: _edata+0x14 in /tmp/libjamagent.so.2 at 0xfffffff9a2000000
    G5=0x00000000816c3800 is an unknown value
    G6=0xfffffffa0000e000 is an unknown value
    G7=0xfffffff9b223c200 is an unknown value

    O0=0x0000000000100145 is an unknown value
    O1=0x0000000061000000 is an unknown value
    O2=0x000000011845b9d5 is an unknown value
    O3=0x0000000080808080 is an unknown value
    O4=0x0000000000ff0000 is an unknown value
    O5=0x0000000080808080 is an unknown value
    O6=0x00000001166898b1 is pointing into the stack for thread: 0x0000000116cea800
    O7=0xfffffff9a20b2600: Java_jamagent_jamagent_setLibName+0x88244 in /tmp/libjamagent.so.2 at 0xfffffff9a2000000

    L0=0x0000000112fce2f0 is an unknown value
    L1=0x0000000000000000 is an unknown value
    L2=0x000000007fffffff is an unknown value
    L3=0x0000000000002000 is an unknown value
    L4=0x00000000000023d0 is an unknown value
    L5=0x0000000001000000 is an unknown value
    L6=0xffffffff7eb4bfc4: _uberdata+0x1cc4 in /lib/sparcv9/libc.so.1 at 0xffffffff7e900000
    L7=0xfffffff9a21e6970: GLOBALOFFSET_TABLE_+0 in /tmp/libjamagent.so.2 at 0xfffffff9a2000000

    I0=0xfffffff9a236b430: _edata+0x16df48 in /tmp/libjamagent.so.2 at 0xfffffff9a2000000
    I1=0x00000001132cd070 is an unknown value
    I2=0x000000000000010a is an unknown value
    I3=0x0000000000008000 is an unknown value
    I4=0xfffffff9b223c200 is an unknown value
    I5=0x0000000000000000 is an unknown value
    I6=0x00000001166899e1 is pointing into the stack for thread: 0x0000000116cea800
    I7=0xfffffff9a20b14d0: Java_jamagent_jamagent_setLibName+0x87114 in /tmp/libjamagent.so.2 at 0xfffffff9a2000000


    Stack: [0x00000001165b2000,0x00000001166b09c0], sp=0x000000011668a0b0, free space=864k
    Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
    C [libjamagent.so.2+0xb263c] InsertOcammDmsData+0x1148


    --------------- P R O C E S S ---------------

    Java Threads: ( => current thread )
    0x000000011718d800 JavaThread "EstablishConnection (mwhaprd-stg.cummins.com:80)" daemon [_thread_in_native, id=23084, stack(0xfffffff9a4300000,0xfffffff9a4400000)]
    0x0000000117aac000 JavaThread "HTTPThreadGroup-1258" [_thread_blocked, id=23083, stack(0xfffffff9a0600000,0xfffffff9a0700000)]
    0x0000000115dd7000 JavaThread "HTTPThreadGroup-1257" [_thread_blocked, id=23082, stack(0xfffffff99e600000,0xfffffff99e700000)]
    0x000000011400b800 JavaThread "AJPRequestHandler-RMICallHandler-1256" [_thread_blocked, id=23081, stack(0xfffffff99e200000,0xfffffff99e300000)]
    0x00000001177fb000 JavaThread "RMI RenewClean-[cidcmspinf006.cidc.cummins.com:55003,com.acsera.rmi.client.AcseraRMIClientSocketFactory@2c3e4b23]" daemon [_thread_blocked, id=23080, stack(0xfffffff99e400000,0xfffffff99e500000)]
    0x0000000114892000 JavaThread "SystemThreadGroup-44" [_thread_blocked, id=23070, stack(0xfffffff9a0a00000,0xfffffff9a0b00000)]
    0x0000000113b90000 JavaThread "RMICallHandler-1255" [_thread_blocked, id=23069, stack(0xfffffff9a0000000,0xfffffff9a0100000)]
    0x000000011935d800 JavaThread "AJPRequestHandler-RMICallHandler-1253" [_thread_blocked, id=23041, stack(0xfffffff99ea00000,0xfffffff99eb00000)]
    0x0000000111677000 JavaThread "RMICallHandler-1251" [_thread_blocked, id=23039, stack(0xfffffff99ee00000,0xfffffff99ef00000)]
    0x0000000111676800 JavaThread "AJPRequestHandler-RMICallHandler-1250" [_thread_blocked, id=23038, stack(0xfffffff9a0400000,0xfffffff9a0500000)]
    0x0000000116334800 JavaThread "RMICallHandler-1246" [_thread_blocked, id=23023, stack(0xfffffff9fee00000,0xfffffff9fef00000)]
    0x0000000114cd0800 JavaThread "RMICallHandler-1245" [_thread_blocked, id=23022, stack(0xfffffff9a6700000,0xfffffff9a6800000)]
    0x00000001132ff000 JavaThread "AJPRequestHandler-RMICallHandler-1244" [_thread_blocked, id=23021, stack(0xfffffff9a4000000,0xfffffff9a4100000)]
    0x00000001131a3000 JavaThread "RMICallHandler-1241" [_thread_blocked, id=23018, stack(0xfffffff9a1800000,0xfffffff9a1900000)]
    0x00000001194d0000 JavaThread "AJPRequestHandler-RMICallHandler-1239" [_thread_in_native, id=23013, stack(0xfffffff99f400000,0xfffffff99f500000)]
    0x000000011723e000 JavaThread "RMICallHandler-1237" [_thread_blocked, id=23011, stack(0xfffffff99f800000,0xfffffff99f900000)]
    0x0000000113027800 JavaThread "AJPRequestHandler-RMICallHandler-1236" [_thread_blocked, id=23010, stack(0xfffffff99fa00000,0xfffffff99fb00000)]
    0x000000011297d000 JavaThread "AJPRequestHandler-RMICallHandler-1235" [_thread_blocked, id=23009, stack(0xfffffff99fc00000,0xfffffff99fd00000)]
    0x000000011160b800 JavaThread "RMICallHandler-1233" [_thread_blocked, id=23007, stack(0xfffffff99fe00000,0xfffffff99ff00000)]
    0x0000000112929000 JavaThread "RMICallHandler-1231" [_thread_in_native, id=23004, stack(0xfffffff9a0200000,0xfffffff9a0300000)]
    0x0000000112c15800 JavaThread "Timer-57" daemon [_thread_blocked, id=22987, stack(0xfffffff9a0800000,0xfffffff9a0900000)]
    0x0000000112a9e000 JavaThread "RMICallHandler-1225" [_thread_blocked, id=22980, stack(0xfffffff9a0e00000,0xfffffff9a0f00000)]
    0x000000011291c000 JavaThread "JCA-work-instance:Database Adapter-11" [_thread_blocked, id=22967, stack(0xfffffff9a1c00000,0xfffffff9a1d00000)]
    0x0000000119c4e000 JavaThread "JCA-work-instance:Database Adapter-10" [_thread_blocked, id=22966, stack(0xfffffff9a1e00000,0xfffffff9a1f00000)]
    0x0000000114b3b800 JavaThread "JCA-work-instance:FTP Adapter-6" [_thread_blocked, id=22965, stack(0xfffffff9a2600000,0xfffffff9a2700000)]
    0x0000000114664800 JavaThread "JCA-work-instance:Database Adapter-9" [_thread_blocked, id=22964, stack(0xfffffff9a2a00000,0xfffffff9a2b00000)]
    0x0000000117765800 JavaThread "JCA-work-instance:Database Adapter-8" [_thread_blocked, id=22963, stack(0xfffffff9a4a00000,0xfffffff9a4b00000)]
    0x000000011191d800 JavaThread "JCA-work-instance:Database Adapter-7" [_thread_blocked, id=22962, stack(0xfffffff9f9f00000,0xfffffff9fa000000)]
    0x0000000113287800 JavaThread "JCA-work-instance:Database Adapter-6" [_thread_blocked, id=22961, stack(0xffffffff32e00000,0xffffffff32f00000)]
    0x0000000115328800 JavaThread "JCA-work-instance:FTP Adapter-5" [_thread_blocked, id=22960, stack(0xffffffff32400000,0xffffffff32500000)]
    0x0000000115327000 JavaThread "JCA-work-instance:Database Adapter-5" [_thread_blocked, id=22959, stack(0xfffffff9ed600000,0xfffffff9ed700000)]
    0x000000011454a800 JavaThread "AJPRequestHandler-RMICallHandler-1220" [_thread_in_native, id=22957, stack(0xfffffff9a5b00000,0xfffffff9a5c00000)]
    =>0x0000000116cea800 JavaThread "Thread-3519" [_thread_in_native, id=22955, stack(0x00000001165b2000,0x00000001166b09c0)]
    0x0000000115c3f000 JavaThread "Thread-3518" [_thread_in_native, id=22953, stack(0xfffffff9a4e00000,0xfffffff9a4f00000)]
    0x0000000112b76000 JavaThread "Timer-55" [_thread_blocked, id=22951, stack(0xffffffff3af00000,0xffffffff3b000000)]
    0x000000011a4b5800 JavaThread "RMI RenewClean-[cidcmspinf006.cidc.cummins.com:55003,com.acsera.rmi.client.AcseraRMIClientSocketFactory@30c57db0]" daemon [_thread_blocked, id=22796, stack(0xfffffff9a2800000,0xfffffff9a2900000)]
    0x0000000113dc7800 JavaThread "WorkExecutorWorkerThread-116" daemon [_thread_blocked, id=21911, stack(0xfffffff9a5900000,0xfffffff9a5a00000)]
    0x0000000111ccb000 JavaThread "WorkExecutorWorkerThread-115" daemon [_thread_blocked, id=21889, stack(0xfffffff9aea00000,0xfffffff9aeb00000)]
    0x0000000117b5f800 JavaThread "RMIServerConnectionThread-1135" [_thread_in_native, id=21236, stack(0xfffffff9a5f00000,0xfffffff9a6000000)]
    0x0000000117d76800 JavaThread "RMIServerConnectionThread-1130" [_thread_in_native, id=21216, stack(0xfffffff9a7200000,0xfffffff9a7300000)]
    0x0000000117586800 JavaThread "WorkExecutorWorkerThread-114" daemon [_thread_blocked, id=20803, stack(0xfffffff9a7000000,0xfffffff9a7100000)]
    0x0000000114bfa800 JavaThread "WorkExecutorWorkerThread-113" daemon [_thread_blocked, id=20770, stack(0xfffffff9a5d00000,0xfffffff9a5e00000)]
    0x0000000114b35000 JavaThread "WorkExecutorWorkerThread-112" daemon [_thread_blocked, id=20762, stack(0xfffffff9a6100000,0xfffffff9a6200000)]
    0x0000000117643000 JavaThread "RMIServerConnectionThread-1093" [_thread_in_native, id=20091, stack(0xfffffff9a6e00000,0xfffffff9a6f00000)]
    0x00000001118f5000 JavaThread "RMIServerConnectionThread-1084" [_thread_in_native, id=20080, stack(0xfffffff9a6c00000,0xfffffff9a6d00000)]
    0x0000000111861000 JavaThread "RMICallHandler-949" [_thread_blocked, id=18496, stack(0xfffffff9ffa00000,0xfffffff9ffb00000)]
    0x0000000115cbd000 JavaThread "WorkExecutorWorkerThread-110" daemon [_thread_in_native, id=11308, stack(0xfffffff9a6500000,0xfffffff9a6600000)]
    0x00000001146ad000 JavaThread "OracleTimeoutPollingThread" daemon [_thread_blocked, id=8603, stack(0xfffffff9a6900000,0xfffffff9a6a00000)]
    0x0000000116955000 JavaThread "oracle.dms.aggregator.Timer@15000" daemon [_thread_blocked, id=7226, stack(0xfffffff9af600000,0xfffffff9af700000)]
    0x0000000112469800 JavaThread "oracle.dms.aggregator.Timer@300000" daemon [_thread_blocked, id=7225, stack(0xfffffff9b1200000,0xfffffff9b1300000)]
    0x00000001150ad800 JavaThread "oracle.dms.aggregator.Timer@30000" daemon [_thread_blocked, id=7224, stack(0xfffffff9a5600000,0xfffffff9a5700000)]
    0x0000000116dbe800 JavaThread "RMIServerConnectionThread-161" [_thread_in_native, id=6398, stack(0xfffffff9a6300000,0xfffffff9a6400000)]
    0x0000000112f23800 JavaThread "pool-2-thread-350" [_thread_in_native, id=5213, stack(0xfffffff9a7400000,0xfffffff9a7500000)]
    0x0000000112f21800 JavaThread "pool-2-thread-349" [_thread_in_native, id=5212, stack(0xfffffff9a7600000,0xfffffff9a7700000)]
    0x0000000112f1f800 JavaThread "pool-2-thread-348" [_thread_in_native, id=5211, stack(0xfffffff9a7800000,0xfffffff9a7900000)]
    0x00000001148b3000 JavaThread "pool-2-thread-347" [_thread_blocked, id=5210, stack(0xfffffff9a7a00000,0xfffffff9a7b00000)]
    0x00000001148b1000 JavaThread "pool-2-thread-346" [_thread_blocked, id=5209, stack(0xfffffff9a7c00000,0xfffffff9a7d00000)]
    0x00000001148af000 JavaThread "pool-2-thread-345" [_thread_in_native, id=5208, stack(0xfffffff9a7e00000,0xfffffff9a7f00000)]
    0x0000000117a16800 JavaThread "pool-2-thread-344" [_thread_in_native, id=5207, stack(0xfffffff9a8000000,0xfffffff9a8100000)]
    Code Cache [0xffffffff77800000, 0xffffffff7a390000, 0xffffffff7a800000)
    total_blobs=9932 nmethods=9125 adapters=728 free_code_cache=5521984 largest_free_block=103680

    Dynamic libraries:
    0x0000000100000000      /opt/webapps/oracle/product/APP_RAC_OH1/jdk/bin/sparcv9/java
    0xffffffff7f200000      /lib/64/libthread.so.1
    0xffffffff7ef00000      /opt/webapps/oracle/product/APP_RAC_OH1/jdk/bin/sparcv9/../../jre/lib/sparcv9/jli/libjli.so
    0xffffffff7ed00000      /lib/64/libdl.so.1
    0xffffffff7e900000      /lib/64/libc.so.1
    0xffffffff7f000000      /platform/sun4v/lib/sparcv9/libc_psr.so.1
    0xffffffff7d800000      /opt/webapps/oracle/product/APP_RAC_OH1/jdk/jre/lib/sparcv9/server/libjvm.so
    0xffffffff7d600000      /lib/64/libsocket.so.1
    0xffffffff7e600000      /usr/lib/64/libsched.so.1
    0xffffffff7d400000      /lib/64/libm.so.1
    0xffffffff7d200000      /usr/lib/64/libCrun.so.1
    0xffffffff7d000000      /lib/64/libdoor.so.1
    0xffffffff7ce00000      /usr/lib/64/libdemangle.so.1
    0xffffffff7cc00000      /lib/64/libkstat.so.1
    0xffffffff7ca00000      /lib/64/libnsl.so.1
    0xffffffff7c800000      /lib/64/libm.so.2
    0xffffffff7c600000      /lib/64/libscf.so.1
    0xffffffff7c400000      /lib/64/libuutil.so.1
    0xffffffff7c200000      /lib/64/libgen.so.1
    0xffffffff7c000000      /lib/64/libmd.so.1
    0xffffffff7be00000      /platform/sun4v/lib/sparcv9/libmd_psr.so.1
    0xffffffff7bc00000      /lib/64/libmp.so.2
    0xffffffff7b800000      /opt/webapps/oracle/product/APP_RAC_OH1/jdk/jre/lib/sparcv9/libverify.so
    0xffffffff7b600000      /opt/webapps/oracle/product/APP_RAC_OH1/jdk/jre/lib/sparcv9/libjava.so
    0xffffffff7b400000      /opt/webapps/oracle/product/APP_RAC_OH1/jdk/jre/lib/sparcv9/libinstrument.so
    0xffffffff7b200000      /usr/lib/iconv/sparcv9/UTF-8%646.so
    0xffffffff7b000000      /usr/lib/iconv/sparcv9/646%UTF-8.so
    0xffffffff7ac00000      /opt/webapps/oracle/product/APP_RAC_OH1/jdk/jre/lib/sparcv9/libzip.so
    0xffffffff5b600000      /opt/webapps/oracle/product/APP_RAC_OH1/jdk/jre/lib/sparcv9/libmanagement.so
    0xffffffff5b100000      /opt/webapps/oracle/product/APP_RAC_OH1/jdk/jre/lib/sparcv9/libnet.so
    0xffffffff5a500000      /opt/webapps/oracle/product/APP_RAC_OH1/jdk/jre/lib/sparcv9/libj2pkcs11.so
    0xffffffff5a300000      /usr/lib/sparcv9/libpkcs11.so
    0xffffffff5a100000      /usr/lib/64/libcryptoutil.so.1
    0xffffffff59f00000      /usr/lib/security/64/pkcs11_softtoken.so
    0xffffffff58600000      /opt/webapps/oracle/product/APP_RAC_OH1/jdk/jre/lib/sparcv9/libnio.so
    0xffffffff58300000      /lib/64/librt.so.1
    0xffffffff58100000      /lib/64/libsendfile.so.1
    0xffffffff57f00000      /lib/64/libaio.so.1
    0xfffffff9f5e00000      /opt/webapps/oracle/product/APP_RAC_OH1/jdk/jre/lib/sparcv9/libawt.so
    0xfffffff9f5c00000      /opt/webapps/oracle/product/APP_RAC_OH1/jdk/jre/lib/sparcv9/headless/libmawt.so
    0xfffffff9f4d00000      /opt/webapps/oracle/product/APP_RAC_OH1/jdk/jre/lib/sparcv9/librmi.so
    0xfffffff9a2c00000      /tmp/libjamagent.so.1
    0xfffffff9e2d00000      /lib/64/libpthread.so.1
    0xfffffff9a2000000      /tmp/libjamagent.so.2

    VM Arguments:
    jvm_args: -Dcom.sun.management.jmxremote -Xmx20480m -Xms20480m -XX:NewSize=8192m -XX:MaxNewSize=8192m -XX:PermSize=768M -XX:MaxPermSize=768M -XX:SurvivorRatio=6 -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+CMSParallelRemarkEnabled -XX:+CMSPermGenSweepingEnabled -XX:+CMSClassUnloadingEnabled -XX:+UseStringCache -XX:+OptimizeStringConcat -XX:+UseCompressedStrings -XX:+UseTLAB -XX:ParallelGCThreads=43 -XX:+AggressiveOpts -XX:+UseCompressedOops -XX:MaxTenuringThreshold=5 -Xloggc:/opt/webapps/oracle/product/APP_RAC_OH1/logs/oc4j_soa_gc.log -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -Dcom.sun.management.jmxremote -Djava.security.policy=/opt/webapps/oracle/product/APP_RAC_OH1/j2ee/OC4J_SOA/config/java2.policy -Djava.awt.headless=true -Dhttp.webdir.enable=false -Doc4j.userThreads=true -Doracle.mdb.fastUndeploy=60 -Doc4j.formauth.redirect=true -Djava.net.preferIPv4Stack=true -Dorabpel.home=/opt/webapps/oracle/product/APP_RAC_OH1/bpel -Xbootclasspath/p:/opt/webapps/oracle/product/APP_RAC_OH1/bpel/lib/orabpel-boot.jar:/opt/webapps/oracle/product/APP_RAC_OH1/j2ee/OC4J_SOA/applib/charset-Tony4.jar -Doraesb.home=/opt/webapps/oracle/product/APP_RAC_OH1/integration/esb -Dhttp.proxySet=false -Dbpel.delivery.operationNameCheck=true -Dbpel.dms=false -Dstdstream.filesize=10 -Dstdstream.filenumber=10 -Daia.home=/opt/webapps/oracle/product/AIA_RAC -Dsun.lang.ClassLoader.allowArraySyntax=true -DBEGINACSERA -Xbootclasspath/p:/opt/webapps/oracle/product/APP_RAC_OH1/AcseraAgent/lib/oracleaj.jar:/opt/webapps/oracle/product/APP_RAC_OH1/AcseraAgent/lib/aspectj.jar:/opt/webapps/oracle/product/APP_RAC_OH1/AcseraAgent/lib/bcel.jar:/opt/webapps/oracle/product/APP_RAC_OH1/AcseraAgent/lib/axion.jar:/opt/webapps/oracle/product/APP_RAC_OH1/AcseraAgent/lib/strutslegacy.jar -javaagent:/opt/webapps/oracle/product/APP_RAC_OH1/AcseraAgent/lib/jagent1.5.jar -Dacsera.config=/opt/webapps/oracle/product/APP_RAC_OH1/AcseraAgent/config/OracleJAgent.properties -Dacsera.server.name=SOA_GROUP.OC4J_SOA -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000 -DENDACSERA -Doracle.ons.oraclehome=/opt/webapps/oracle/product/APP_RAC_OH1 -Doracle.home=/opt/webapps/oracle/product/APP_RAC_OH1 -Doracle.ons.oracleconfighome=/opt/webapps/oracle/product/APP_RAC_OH1 -Doracle.ons.clustername=default -Doracle.ons.instancename=J2EE_RAC.ftdcsssapp079.ftdc.cummins.com -Dopmn.compatible=904 -Doracle.ons.indexid=OC4J_SOA.SOA_GROUP.1 -Doracle.ons.numprocs=1 -Doracle.ons.uid=256028058 -Doracle.oc4j.groupname=SOA_GROUP -Doracle.oc4j.instancename=OC4J_SOA -Doracle.oc4j.islandname=SOA_GROUP -Doracle.opmn.routingid=g_rt_id -DOPMN=true
    java_command: oc4j.jar -config /opt/webapps/oracle/product/APP_RAC_OH1/j2ee/OC4J_SOA/config/server.xml -properties -out /opt/webapps/oracle/product/APP_RAC_OH1/opmn/logs/opmn_soa_out.log -err /opt/webapps/oracle/product/APP_RAC_OH1/opmn/logs/opmn_soa_err.log -ports default-web-site:ajp:12502,rmi:12402,rmis:12702,jms:12602
    Launcher Type: SUN_STANDARD

    Environment Variables:
    LD_LIBRARY_PATH=/opt/webapps/oracle/product/APP_RAC_OH1/jdk/jre/lib/sparcv9/server
    SHELL=/bin/ksh

    Signal Handlers:
    SIGSEGV: [libjvm.so+0x9b1278], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
    SIGBUS: [libjvm.so+0x9b1278], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
    SIGFPE: [libjvm.so+0x23f2d0], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
    SIGPIPE: [libjvm.so+0x23f2d0], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
    SIGXFSZ: [libjvm.so+0x23f2d0], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
    SIGILL: [libjvm.so+0x23f2d0], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
    SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
    SIGUSR2: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
    SIGQUIT: [libjvm.so+0x867978], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
    SIGHUP: [libjvm.so+0x867978], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
    SIGINT: [libjvm.so+0x867978], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
    SIGTERM: [libjvm.so+0x867978], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
    SIG39: [libjvm.so+0x86b108], sa_mask[0]=0x00000000, sa_flags=0x00000008
    SIG40: [libjvm.so+0x23f2d0], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c


    --------------- S Y S T E M ---------------

    OS: Oracle Solaris 10 8/11 s10s_u10wos_17 SPARC
    Copyright (c) 1983, 2011, Oracle and/or its affiliates. All rights reserved.
    Assembled 06 July 2011

    uname:SunOS 5.10 Generic_147440-09 sun4v (T2 libthread)
    rlimit: STACK 8192k, CORE infinity, NOFILE 65536, AS infinity
    load average:2.74 2.62 2.50

    CPU:total 64 has_v8, has_v9, popc, has_vis1, has_vis2, has_vis3, has_blk_init, is_ultra3, is_sun4v, is_niagara, is_niagara_plus

    Memory: 8k page, physical 66584576k(13389312k free)

    vm_info: Java HotSpot(TM) 64-Bit Server VM (20.6-b01) for solaris-sparc JRE (1.6.0_31-b04), built on Jan 20 2012 10:42:16 by "" with Workshop 5.8

    time: Fri Mar 1 16:45:55 2013
    elapsed time: 323172 seconds


    Thanks
    Santhosh
  • 5. Re: OC4J_SOA Jvm Crashes due to the Jamagent deployed on that JVM
    994937 Newbie
    Currently Being Moderated
    Oc4j_SOA log details SPecific To JAmagent:

    Getting New Thread Class
    jmm_ext NULL
    OSNAME Returned SunOS-5.10
    JVM VENDOR=Sun Microsystems Inc., VERSION=1.6.0_31, OSNAME=SunOS-5.10, CPU ARCHITECTURE=64 bit
    JAM Agent: Console Host Addr is 143.222.222.140
    JAM Agent: Port is 53997
    OSNAME Returned ti: SunOS-5.10 (64 bit)
    Succesfully read IP Config Structures
    Attaching Current Thread
    Attach Current Thread returning 0
    JAM Agent: Received 38 bytes 4|NoProcessing|jamheapdir|/tmp/| | || from console
    Changed jamheapdir to /tmp/
    Jam Agent: Process Data - process time : 0 sec,36 usec
    JAM Agent: Received 156 bytes 4|NoProcessing|activethreads|global|currcall|weblogic.socket.PosixSocketMuxer->processSockets
    global|currcall|weblogic.socket.PosixSocketMuxer->poll
    | | || from console
    Adding global currcall weblogic.socket.PosixSocketMuxer->processSockets
    Adding global currcall weblogic.socket.PosixSocketMuxer->poll
    Adding
    Adding 168.53.179,ftdcsssapp079.ftdcsbk, J2EE_RAC.OC4J_SOA.S NA
    Jam Agent: Process Data - process time : 0 sec,198 usec
    Taking 1024 threads
    JAM Agent: Received 24 bytes 65|showstack|8192| | || from console
    Taking 1024 threads
    Taking 1024 threads
    JAM Agent: Received 24 bytes 65|showstack|8192| | || from console
    Taking 1024 threads
    Taking 1024 threads
    JAM Agent: Received 74 bytes 65|showstack|512|ARG,0=RMIServerConnectionThread-1207,1=98130-22685| | || from console
    Taking 1024 threads
    JAM Agent: Received 59 bytes 1|showstack|4096|ARG,0=22685,1=0,2=379754200,3=2,4=3| | || from console
    Taking 1024 threads
    Taking 1024 threads
    Taking 1024 threads
    Taking 1024 threads
    Exception in thread "Thread-3519" Jam Agent : Get Field ID Fail Field sqlObject Signature : Loracle/jdbc/driver/OracleSql;
    Exception in thread "Thread-3519" Jam Agent : Get Field ID Fail Field sqlObject Signature : Loracle/jdbc/driver/OracleSql;
    Taking 1024 threads
    Exception in thread "Thread-3519" Jam Agent : Get Field ID Fail Field sqlObject Signature : Loracle/jdbc/driver/OracleSql;
    Exception in thread "Thread-3519" Jam Agent : Get Field ID Fail Field sqlObject Signature : Loracle/jdbc/driver/OracleSql;
    Taking 1024 threads
    Exception in thread "Thread-3519" Jam Agent : Get Field ID Fail Field sqlObject Signature : Loracle/jdbc/driver/OracleSql;
    Exception in thread "Thread-3519" Jam Agent : Get Field ID Fail Field sqlObject Signature : Loracle/jdbc/driver/OracleSql;

    Exception in thread "Thread-3519" Jam Agent : Get Field ID Fail Field sqlObject Signature : Loracle/jdbc/driver/OracleSql;
    Taking 1024 threads
    Jam Agent: Buffer Overflow in JamStrncat
    Jam Agent: Buffer Overflow in JamStrncat
    Jam Agent: Buffer Overflow in JamStrncat
    Jam Agent: Buffer Overflow in JamStrncat
    Jam Agent: Buffer Overflow in JamStrncat
    Jam Agent: Buffer Overflow in JamStrncat
    Exception in thread "Thread-3519" Jam Agent : Get Field ID Fail Field sqlObject Signature : Loracle/jdbc/driver/OracleSql;
    Exception in thread "Thread-3519" Jam Agent : Get Field ID Fail Field sqlObject Signature : Loracle/jdbc/driver/OracleSql;
    Jam Agent: Source greater than destination
    #
    # A fatal error has been detected by the Java Runtime Environment:
    #
    # SIGBUS (0xa) at pc=0xfffffff9a20b263c, pid=98130, tid=22955
    #
    # JRE version: 6.0_31-b04
    # Java VM: Java HotSpot(TM) 64-Bit Server VM (20.6-b01 mixed mode solaris-sparc compressed oops)
    # Problematic frame:
    # C [libjamagent.so.2+0xb263c] InsertOcammDmsData+0x1148
    #
    # An error report file with more information is saved as:
    # /opt/webapps/oracle/product/APP_RAC_OH1/j2ee/home/hs_err_pid98130.log
    #
    # If you would like to submit a bug report, please visit:
    # http://java.sun.com/webapps/bugreport/crash.jsp
    # The crash happened outside the Java Virtual Machine in native code.
    # See problematic frame for where to report the bug.
    #

    --------
    13/03/01 17:00:35 Stop process
    --------
    Thanks
    Santhosh
  • 6. Re: OC4J_SOA Jvm Crashes due to the Jamagent deployed on that JVM
    994937 Newbie
    Currently Being Moderated
    I have Removed This Content since it has been Posted Earlier..

    Thanks & Regards
    Santhosh.

    Edited by: 991934 on Mar 5, 2013 2:04 PM
  • 7. Re: OC4J_SOA Jvm Crashes due to the Jamagent deployed on that JVM
    Vishal_EM_assist Explorer
    Currently Being Moderated
    Do you already have a SR for this?
  • 8. Re: OC4J_SOA Jvm Crashes due to the Jamagent deployed on that JVM
    994937 Newbie
    Currently Being Moderated
    Yes i have Opened the SR 3-6682643941 for this ..and we have been working with them for almost a month..but still no luck.


    Regards
    Santhosh

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points