2 Replies Latest reply: Nov 8, 2012 7:39 PM by 972862 RSS

    Error Message: Illegal memory access. [54]

    972862
      The problem only happens sometimes.


      JRockit dump produced after 15 days, 08:25:04 on Wed Nov 7 00:27:08 2012

      **********************************************************
      * If you see this dump, please go to *
      * http://edocs.bea.com/jrockit/go2troubleshooting.html *
      * for troubleshooting information. *
      **********************************************************

      Additional information is available in:
      /root/jrockit.19530.dump
      No snapshot file (core dump) will be created because core dumps have been
      disabled. To enable core dumping, try "ulimit -c unlimited"
      before starting JRockit again.

      Error Message: Illegal memory access. [54]
      Signal info : si_signo=11, si_code=128 si_addr=(nil)
      Version : BEA JRockit(R) R27.6.0-50_o-100423-1.6.0_05-20080626-2104-linux-x86_64
      GC Strategy : Mode: throughput. Currently using strategy: genparpar
      GC Status : OC currently running, in phase: marking. This is OC#44446.
      : YC is not running. Last finished YC was YC#48406.
      OC History : Strategy genparpar was used for OC#43816.
      : Strategy singleparpar was used for OC#43817.
      : Strategy genparpar was used for OC#43818.
      : Strategy singleparpar was used for OC#43819.
      : Strategy genparpar was used for OC#43820 to OC#44446.
      YC History : Ran 1 YCs before OC#44442.
      : Ran 1 YCs before OC#44443.
      : Ran 1 YCs before OC#44444.
      : Ran 1 YCs before OC#44445.
      : Ran 1 YCs before OC#44446.
      YC Promotion : Last YC successfully promoted all objects
      Heap : 0x41d00000 - 0x584fd000 (Size: 359 MB)
      Compaction : 0x4ba7eb00 - 0x4d0fe800 (Current compaction type: internal)
      NurseryList : 0x5098bdd0 - 0x56e0f3e8
      KeepArea : 0x542b3408 - 0x54788a10
      NurseryMarker: [ 0x529916b8,  0x539372d0 ]
      CompRefs : References are compressed, with heap base 0x0.
      CPU : AMD Opteron/Athlon64 SSE SSE2 SSE3 EM64T
      Number CPUs : 4
      Tot Phys Mem : 4214972416 (4019 MB)
      OS version : CentOS release 5.5 (Final)
      Linux version 2.6.18-194.el5 (mockbuild@builder10.centos.org) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-48)) #1 SMP Fri Apr 2 14:58:14 EDT 2010 (x86_64)
      Thread System: NPTL
      Java locking : Lazy unlocking enabled (class banning) (transfer banning)
      State : JVM is running
      Command Line : -Xmx2500m -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/usr/local/tomcat-6.0.18/conf/logging.properties -Djava.endorsed.dirs=/usr/local/tomcat-6.0.18/endorsed -Dcatalina.base=/usr/local/tomcat-6.0.18 -Dcatalina.home=/usr/local/tomcat-6.0.18 -Djava.io.tmpdir=/usr/local/tomcat-6.0.18/temp -Dsun.java.launcher=SUN_STANDARD org.apache.catalina.startup.Bootstrap start
      java.home : /usr/java/jrrt-3.0.0-1.6.0/jre
      j.class.path : :/usr/local/tomcat-6.0.18/bin/bootstrap.jar
      j.lib.path : /usr/java/jrrt-3.0.0-1.6.0/jre/lib/amd64/jrockit:/usr/java/jrrt-3.0.0-1.6.0/jre/lib/amd64:/usr/java/jrrt-3.0.0-1.6.0/jre/../lib/amd64
      JAVA_HOME : /usr/java/jrrt-3.0.0-1.6.0
      JAVAOPTIONS: <not set>
      LD_LIBRARY_PATH: /usr/java/jrrt-3.0.0-1.6.0/jre/lib/amd64/jrockit:/usr/java/jrrt-3.0.0-1.6.0/jre/lib/amd64:/usr/java/jrrt-3.0.0-1.6.0/jre/../lib/amd64
      LD_ASSUME_KERNEL: <not set>
      C Heap : Good; no memory allocations have failed
      StackOverFlow: 0 StackOverFlowErrors have occured
      OutOfMemory : 0 OutOfMemoryErrors have occured

      Registers (from ThreadContext: 0x4113a980 / OS context: 0x4113aa40):
      rax = 0000000000000000 rcx = 534754a0542b3f70
      rdx = 0000000000000001 rbx = 000000004113af60
      rsp = 000000004113ae80 rbp = 000000004113ae90
      rsi = 00000000542b3d68 rdi = 00000000542b3dc8
      r8 = 0000000000000001 r9 = 0002220051800220
      r10 = 0000000000004c72 r11 = 0000000000000206
      r12 = 0000000000000001 r13 = 0000000000300033
      r14 = 00000000542b3d68 r15 = 0000000000000001
      cs = 0000000000000033 fs = 0000000000000000
      gs = 0000000000000000
      rip = 00002b1ca5f87a86 flags = 0000000000000202

      Stack:
      (* marks the word pointed to by the stack pointer)
      000000004113ae80: 0000000000000032* 000000004113af60 000000004113af00 00002b1ca5f880da
      000000004113aea0: 000000004113aee0 00002b1ca6282660 000000004113aee0 000000004113af60
      000000004113aec0: 00002b1ca622e7c0 0000000006b00eb0 000000004113aee0 00000000542c12c0
      000000004113aee0: 000000004113af50 00000000542b3d68 000000004113af60 0000000000000001
      000000004113af00: 000000004113b060 00002b1ca5f9324a 0000000006b01210 000000004113b000
      000000004113af20: 00002b1ca6282660 0000000006b01210 00000000542c1270 0000000000000000

      Code:
      (* marks the word pointed to by the instruction pointer)
      00002b1ca5f87a20: 834808568be58948 63485077894810c6 00291a08058b48d2 b60fc0940f003883
      00002b1ca5f87a40: 00000485048d48c0 f20148d0af0f4800 4855c3c958578948 894810ec8348e589
      00002b1ca5f87a60: 48082464894c241c d48941f78948fb89 c18948ffee7ba7e8 c9854800000000b8
      00002b1ca5f87a80: 834800000096840f* 39740000000110b9 4800000110818b48 1891b70f48604389
      00002b1ca5f87aa0: 1996058b48000002 c0940f0038830029 0485048d48c0b60f 48d0af0f48000000
      00002b1ca5f87ac0: eb68538948605303 0000006843c74808 79834818418d4800 7043894806740018

      Loaded modules:
      (* denotes the module causing the exception)
      0000000000400000-0000000000412ffb /usr/java/jrrt-3.0.0-1.6.0/bin/java
      0000003bb3c00000-0000003bb3c15b4f /lib64/libpthread.so.0
      0000003bb3800000-0000003bb388122f /lib64/libm.so.6
      0000003bb3400000-0000003bb3401f93 /lib64/libdl.so.2
      0000003bb3000000-0000003bb314ca47 /lib64/libc.so.6
      0000003bb2c00000-0000003bb2c1bbe7 /lib64/ld-linux-x86-64.so.2
      00002b1ca5e26000-00002b1ca6054a8f */usr/java/jrrt-3.0.0-1.6.0/jre/lib/amd64/jrockit/libjvm.so
      0000003bb4000000-0000003bb4006f5b /lib64/librt.so.1
      00002aaaaaabd000-00002aaaaaac664b /lib64/libnss_files.so.2
      00002aaaaad3e000-00002aaaaad4a337 /usr/java/jrrt-3.0.0-1.6.0/jre/lib/amd64/libverify.so
      00002aaaaae4d000-00002aaaaae74ff3 /usr/java/jrrt-3.0.0-1.6.0/jre/lib/amd64/libjava.so
      0000003bb6800000-0000003bb6814107 /lib64/libnsl.so.1
      00002aaaeb00c000-00002aaaeb01265f /usr/java/jrrt-3.0.0-1.6.0/jre/lib/amd64/native_threads/libhpi.so
      00002aaaee768000-00002aaaee7759d3 /usr/java/jrrt-3.0.0-1.6.0/jre/lib/amd64/libzip.so
      00002aaaee930000-00002aaaee942687 /usr/java/jrrt-3.0.0-1.6.0/jre/lib/amd64/libnet.so
      00002aab00000000-00002aab000068ab /usr/java/jrrt-3.0.0-1.6.0/jre/lib/amd64/libnio.so
      00002aaaef8e6000-00002aaaef8e8a0b /usr/lib64/gconv/EUC-CN.so
      00002aaaefaea000-00002aaaefaf94db /usr/lib64/gconv/libGB.so

      Scan Dump Helper:
      Iterating in objIter over object at address 0x542b3d68 (bogus or broken object).
      The object is on the heap, but the class block seems broken.
      Dumping memory around the area. * marks where object should have started.
      00000000542b3d38: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
      00000000542b3d58: 0000000000000000 0000000000000000 000000005455cc30* 00000000002a8e10
      00000000542b3d78: 566c1a3000000000 566c1aa0542b3d88 080000000052fe28 006e006f00000001
      00000000542b3d98: 0000000000000000 08000000000e5d30 00000000420c8718 0000000002fcfd60
      00000000542b3db8: 00000000542b3df8 542b65a0420c8718 534754a0542b3f70 542b3e8842855668
      00000000542b3dd8: 542b3ec0420c9270 0000000000000000 0000000000000000 0000000000000000
      00000000542b3df8: 000000000058ec30 0062003a00000020 542ba72800000000 542bc878542ba828
      00000000542b3e18: 0000000000000000 5347541800000000 5347725800000000 0000000000000000

      Raw data of address referred to by reference follows:
      00000000542c1290: 0000000000000002 00010000ffffffff 0000000000000000 0000000000000000
      00000000542c12b0: 0000043800000000 08010000005214e8 08010000005214e8* 00000000066fd180
      00000000542c12d0: 0000000000000000 0000000000000000 08000000004358a8 00000000ffffffff
      00000000542c12f0: 0800000005931610 0000000000000000 00000001c0a8a046 0000000000572108
      00000000542c1310: 0000000000002328 0000000000572108 0000000000000064 080002240044a400
      00000000542c1330: 56b66468542c1348 0000000000000000 00000000ffffffff 08000000000fc6b0


      NOTE: Dump Helper crashed and was aborted

      "(GC Worker Thread 2)" id=? idx=0x14 tid=19570 lastJavaFrame=0xfffffffffffffffc

      Stack 0: start=0x410fa000, end=0x4113c000, guards=0x410ff000 (ok), forbidden=0x410fd000
      Thread Stack Trace:
      at objIterSetupClass+48()@0x2b1ca5f87a86
      at objIterInitInner+223()@0x2b1ca5f880da
      at mmParMarkWorkers+178()@0x2b1ca5f9324a
      at mmGCWorkerThread+144()@0x2b1ca5ebc1c9
      at tsiCallStartFunction+67()@0x2b1ca5f36e33
      at tsiThreadStub+308()@0x2b1ca5f3803d
      at ptiThreadStub+14()@0x2b1ca5f9f692
      at start_thread+221()@0x3bb3c0677d
      -- Java stack --

      Extended, platform specific info:
      libc release: 2.5-stable
      Elf headers:
      libc ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 0000003bb301da90 PHOFF: 0000000000000040 SHOFF: 00000000001a2498 EF: 0x0 HS: 64 PS: 56 PHN; 10 SS: 64 SHN: 77 STIDX: 76
      libpthread ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 0000003bb3c057e0 PHOFF: 0000000000000040 SHOFF: 0000000000023010 EF: 0x0 HS: 64 PS: 56 PHN; 9 SS: 64 SHN: 39 STIDX: 38
      libjvm ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 000000000002de68 PHOFF: 0000000000000040 SHOFF: 000000000252a9e8 EF: 0x0 HS: 64 PS: 56 PHN; 3 SS: 64 SHN: 30 STIDX: 27

      **********************************************************
      * If you see this dump, please go to *
      * http://edocs.bea.com/jrockit/go2troubleshooting.html *
      * for troubleshooting information. *
      **********************************************************

      ===== END DUMP ===============================================================