1 Reply Latest reply: Mar 18, 2009 7:50 AM by 843829 RSS

    about  jvm  dump file EXCEPTION_ACCESS_VIOLATION (0xc0000005)

    843829
      Hi folks,
      Well, Unfortunately We are facing some issue which cause a Tomcat service is down in the following environment.
      OS : Windows Server 2003 R2 SP2
      TOMCAT version=5.5.23
      JVM version=1.5.0_12

      We try to find the cause using attached dump file which generated the one. but not sure why this issue happen in sometime(about once a month)

      Could anyone know what could be wrong? i am baz, did you get to solve this same problem?
      Thanks in advance...


      ---following a dump file

      #
      # An unexpected error has been detected by HotSpot Virtual Machine:
      #
      # EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x7c97be3e, pid=3608, tid=5976
      #
      # Java VM: Java HotSpot(TM) Client VM (1.5.0_12-b04 mixed mode, sharing)
      # Problematic frame:
      # C [ntdll.dll+0x2be3e]
      #

      --------------- T H R E A D ---------------

      Current thread (0x02d88850): JavaThread "http-8080-Processor18" daemon [_thread_in_native, id=5976]

      siginfo: ExceptionCode=0xc0000005, reading address 0xfffffff8

      Registers:
      EAX=0x00000380, EBX=0x00000000, ECX=0x0000037f, EDX=0x00000000
      ESP=0x0383f068, EBP=0x0383f074, ESI=0x00570178, EDI=0x00800000
      EIP=0x7c97be3e, EFLAGS=0x00010206

      Top of Stack: (sp=0x0383f068)
      0x0383f068: 00570000 00000581 02fb9000 0383f098
      0x0383f078: 7c97b561 00570178 00000581 02fb9000
      0x0383f088: 00570000 02f80000 02f80000 03800000
      0x0383f098: 0383f0e0 7c97ba81 00000581 00fb9000
      0x0383f0a8: 00000581 00570000 02fb9000 00000000
      0x0383f0b8: 00000c08 02fbb000 0383f0dc 02f80000
      0x0383f0c8: 00000000 00000000 02fb8e70 00000000
      0x0383f0d8: 00000000 00000181 0383f1c4 7c97b646

      Instructions: (pc=0x7c97be3e)
      0x7c97be2e: 57 64 8b 14 8a 83 c2 08 3b f2 0f 84 d5 fe ff ff
      0x7c97be3e: 0f b7 5a f8 3b 5d 0c 73 0b 8b 12 3b f2 75 f1 e9


      Stack: [0x03800000,0x03840000), sp=0x0383f068, free space=252k
      Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
      C [ntdll.dll+0x2be3e]
      C [ntdll.dll+0x2b561]
      C [ntdll.dll+0x2ba81]
      C [ntdll.dll+0x2b646]
      C [MSVCRT.dll+0x1cef6]
      C [net.dll+0x6a86]
      J java.net.SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I
      J java.net.SocketInputStream.read([BII)I
      J org.apache.coyote.http11.InternalInputBuffer.fill()Z
      J org.apache.coyote.http11.InternalInputBuffer.parseRequestLine()V
      J org.apache.coyote.http11.Http11Processor.process(Ljava/io/InputStream;Ljava/io/OutputStream;)V
      j org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Lorg/apache/tomcat/util/net/TcpConnection;[Ljava/lang/Object;)V+113
      j org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(Ljava/net/Socket;Lorg/apache/tomcat/util/net/TcpConnection;[Ljava/lang/Object;)V+45
      j org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt([Ljava/lang/Object;)V+102
      j org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run()V+167
      j java.lang.Thread.run()V+11
      v ~StubRoutines::call_stub
      V [jvm.dll+0x87599]
      V [jvm.dll+0xdfbb2]
      V [jvm.dll+0x8746a]
      V [jvm.dll+0x871c7]
      V [jvm.dll+0xa2048]
      V [jvm.dll+0x1110d8]
      V [jvm.dll+0x1110a6]
      C [MSVCRT.dll+0x2b530]
      C [kernel32.dll+0x24829]

      Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
      J java.net.SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I
      J java.net.SocketInputStream.read([BII)I
      J org.apache.coyote.http11.InternalInputBuffer.fill()Z
      J org.apache.coyote.http11.InternalInputBuffer.parseRequestLine()V
      J org.apache.coyote.http11.Http11Processor.process(Ljava/io/InputStream;Ljava/io/OutputStream;)V
      j org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Lorg/apache/tomcat/util/net/TcpConnection;[Ljava/lang/Object;)V+113
      j org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(Ljava/net/Socket;Lorg/apache/tomcat/util/net/TcpConnection;[Ljava/lang/Object;)V+45
      j org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt([Ljava/lang/Object;)V+102
      j org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run()V+167
      j java.lang.Thread.run()V+11
      v ~StubRoutines::call_stub

      --------------- P R O C E S S ---------------

      Java Threads: ( => current thread )
      0x02ee7820 JavaThread "File Reaper" daemon [_thread_blocked, id=4744]
      0x02e23958 JavaThread "TP-Monitor" daemon [_thread_blocked, id=6000]
      0x033159e8 JavaThread "TP-Processor4" daemon [_thread_in_native, id=7532]
      0x033153c8 JavaThread "TP-Processor3" daemon [_thread_blocked, id=5932]
      0x03305b28 JavaThread "TP-Processor2" daemon [_thread_blocked, id=6036]
      0x02e2bd10 JavaThread "TP-Processor1" daemon [_thread_blocked, id=4816]
      0x03102020 JavaThread "http-8080-Monitor" [_thread_blocked, id=4708]
      0x031562f0 JavaThread "http-8080-Processor25" daemon [_thread_blocked, id=2668]
      0x03155790 JavaThread "http-8080-Processor24" daemon [_thread_blocked, id=2092]
      0x032d8410 JavaThread "http-8080-Processor23" daemon [_thread_blocked, id=5984]
      0x03250808 JavaThread "http-8080-Processor22" daemon [_thread_blocked, id=7388]
      0x02f80ba8 JavaThread "http-8080-Processor21" daemon [_thread_blocked, id=7956]
      0x02f80048 JavaThread "http-8080-Processor20" daemon [_thread_blocked, id=8020]
      0x02fc0448 JavaThread "http-8080-Processor19" daemon [_thread_in_native, id=1636]
      =>0x02d88850 JavaThread "http-8080-Processor18" daemon [_thread_in_native, id=5976]
      0x02ff2b20 JavaThread "http-8080-Processor17" daemon [_thread_blocked, id=2832]
      0x02ff2058 JavaThread "http-8080-Processor16" daemon [_thread_blocked, id=7988]
      0x03056468 JavaThread "http-8080-Processor15" daemon [_thread_blocked, id=2856]
      0x031c55e0 JavaThread "http-8080-Processor14" daemon [_thread_blocked, id=2164]
      0x02f7e808 JavaThread "http-8080-Processor13" daemon [_thread_blocked, id=3368]
      0x0337ca28 JavaThread "http-8080-Processor12" daemon [_thread_blocked, id=2824]
      0x0337c008 JavaThread "http-8080-Processor11" daemon [_thread_blocked, id=2820]
      0x0315dc60 JavaThread "http-8080-Processor10" daemon [_thread_blocked, id=2888]
      0x0325f408 JavaThread "http-8080-Processor9" daemon [_thread_blocked, id=5112]
      0x02f24780 JavaThread "http-8080-Processor8" daemon [_thread_blocked, id=4692]
      0x02ee4a48 JavaThread "http-8080-Processor7" daemon [_thread_blocked, id=2860]
      0x02efcb80 JavaThread "http-8080-Processor6" daemon [_thread_blocked, id=5952]
      0x031bbd58 JavaThread "http-8080-Processor5" daemon [_thread_blocked, id=7168]
      0x031bb298 JavaThread "http-8080-Processor4" daemon [_thread_blocked, id=5940]
      0x0335f910 JavaThread "http-8080-Processor3" daemon [_thread_blocked, id=2848]
      0x03185b68 JavaThread "http-8080-Processor2" daemon [_thread_blocked, id=2672]
      0x03339528 JavaThread "http-8080-Processor1" daemon [_thread_blocked, id=2800]
      0x031e3e60 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=4752]
      0x009080b0 JavaThread "Thread-1" [_thread_in_native, id=2152]
      0x008d0998 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=3040]
      0x008cf6b8 JavaThread "CompilerThread0" daemon [_thread_blocked, id=6844]
      0x008bf4b8 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=4916]
      0x008a9ac0 JavaThread "Finalizer" daemon [_thread_blocked, id=1072]
      0x008a8ee8 JavaThread "Reference Handler" daemon [_thread_blocked, id=1948]
      0x00575ee0 JavaThread "main" [_thread_in_native, id=5488]

      Other Threads:
      0x008a7c98 VMThread [id=3224]
      0x008d1dc8 WatcherThread [id=6332]

      VM state:not at safepoint (normal execution)

      VM Mutex/Monitor currently owned by a thread: None

      Heap
      def new generation total 36288K, used 1273K [0x06b50000, 0x092b0000, 0x092b0000)
      eden space 32256K, 2% used [0x06b50000, 0x06c02b20, 0x08ad0000)
      from space 4032K, 13% used [0x08ad0000, 0x08b5baf8, 0x08ec0000)
      to space 4032K, 0% used [0x08ec0000, 0x08ec0000, 0x092b0000)
      tenured generation total 483968K, used 17895K [0x092b0000, 0x26b50000, 0x26b50000)
      the space 483968K, 3% used [0x092b0000, 0x0a429c30, 0x0a429e00, 0x26b50000)
      compacting perm gen total 14336K, used 14104K [0x26b50000, 0x27950000, 0x2ab50000)
      the space 14336K, 98% used [0x26b50000, 0x27916088, 0x27916200, 0x27950000)
      ro space 8192K, 63% used [0x2ab50000, 0x2b060590, 0x2b060600, 0x2b350000)
      rw space 12288K, 46% used [0x2b350000, 0x2b8f21b0, 0x2b8f2200, 0x2bf50000)

      Dynamic libraries:
      0x00400000 - 0x0040e000      D:\App\Tomcat\bin\tomcat5.exe
      0x7c950000 - 0x7ca2a000      C:\WINDOWS\system32\ntdll.dll
      0x7c800000 - 0x7c941000      C:\WINDOWS\system32\kernel32.dll
      0x77e90000 - 0x77f20000      C:\WINDOWS\system32\USER32.dll
      0x77ba0000 - 0x77be8000      C:\WINDOWS\system32\GDI32.dll
      0x77de0000 - 0x77e8a000      C:\WINDOWS\system32\ADVAPI32.dll
      0x77bf0000 - 0x77c8f000      C:\WINDOWS\system32\RPCRT4.dll
      0x76e60000 - 0x76e73000      C:\WINDOWS\system32\Secur32.dll
      0x77b40000 - 0x77b9a000      C:\WINDOWS\system32\MSVCRT.dll
      0x7ca30000 - 0x7d218000      C:\WINDOWS\system32\SHELL32.dll
      0x773d0000 - 0x77422000      C:\WINDOWS\system32\SHLWAPI.dll
      0x76120000 - 0x7613d000      C:\WINDOWS\system32\IMM32.DLL
      0x7f000000 - 0x7f009000      C:\WINDOWS\system32\LPK.DLL
      0x75220000 - 0x75285000      C:\WINDOWS\system32\USP10.dll
      0x77ca0000 - 0x77da3000      C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.3790.3959_x-ww_D8713E55\comctl32.dll
      0x6d640000 - 0x6d7dd000      D:\App\jre\jre1.5.0_12\bin\client\jvm.dll
      0x76990000 - 0x769bb000      C:\WINDOWS\system32\WINMM.dll
      0x71a60000 - 0x71a68000      C:\WINDOWS\system32\rdpsnd.dll
      0x77ab0000 - 0x77ac1000      C:\WINDOWS\system32\WINSTA.dll
      0x71ae0000 - 0x71b37000      C:\WINDOWS\system32\NETAPI32.dll
      0x76a60000 - 0x76a6b000      C:\WINDOWS\system32\PSAPI.DLL
      0x6d290000 - 0x6d298000      D:\App\jre\jre1.5.0_12\bin\hpi.dll
      0x6d610000 - 0x6d61c000      D:\App\jre\jre1.5.0_12\bin\verify.dll
      0x6d310000 - 0x6d32d000      D:\App\jre\jre1.5.0_12\bin\java.dll
      0x6d630000 - 0x6d63f000      D:\App\jre\jre1.5.0_12\bin\zip.dll
      0x6d4d0000 - 0x6d4e3000      D:\App\jre\jre1.5.0_12\bin\net.dll
      0x71aa0000 - 0x71ab7000      C:\WINDOWS\system32\WS2_32.dll
      0x71a90000 - 0x71a98000      C:\WINDOWS\system32\WS2HELP.dll
      0x719c0000 - 0x71a01000      C:\WINDOWS\system32\mswsock.dll
      0x5ba20000 - 0x5ba78000      C:\WINDOWS\system32\hnetcfg.dll
      0x71980000 - 0x71988000      C:\WINDOWS\System32\wshtcpip.dll
      0x76de0000 - 0x76e0b000      C:\WINDOWS\system32\DNSAPI.dll
      0x76e80000 - 0x76e87000      C:\WINDOWS\System32\winrnr.dll
      0x76e20000 - 0x76e4e000      C:\WINDOWS\system32\WLDAP32.dll
      0x76e90000 - 0x76e95000      C:\WINDOWS\system32\rasadhlp.dll
      0x68000000 - 0x68035000      C:\WINDOWS\system32\rsaenh.dll

      VM Arguments:
      jvm_args: -Dcatalina.home=D:\App\Tomcat -Dcatalina.base=D:\App\Tomcat -Djava.endorsed.dirs=D:\App\Tomcat\common\endorsed -Djava.io.tmpdir=D:\App\Tomcat\temp -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=D:\App\Tomcat\conf\logging.properties vfprintf -Xms512m -Xmx512m
      java_command: <unknown>
      Launcher Type: generic

      Environment Variables:
      PATH=C:\Program Files\Windows Resource Kits\Tools\;D:\App\Oracle\product\10.2.0\db_1\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\PROGRA~1\HITACHI\SERVER~1\SERVER~1\PROGRAM;C:\Program Files\Intel\DMIX;C:\Program Files\Common Files\Hitachi;C:\Program Files\Hitachi\JP1Base\bin;C:\Program Files\HITACHI\JP1AJS2\bin;C:\WINDOWS\hitachi;C:\Program Files\Hitachi\Script\Bin
      OS=Windows_NT
      PROCESSOR_IDENTIFIER=x86 Family 15 Model 6 Stepping 4, GenuineIntel



      --------------- S Y S T E M ---------------

      OS: Windows Server 2003 family Build 3790 Service Pack 2

      CPU:total 8 (cores per cpu 2, threads per core 2) family 15 model 6 stepping 4, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ht

      Memory: 4k page, physical 2097151k(1993784k free), swap 4194303k(4194303k free)

      vm_info: Java HotSpot(TM) Client VM (1.5.0_12-b04) for windows-x86, built on May 2 2007 02:07:59 by "java_re" with MS VC++ 6.0
        • 1. Re: about  jvm  dump file EXCEPTION_ACCESS_VIOLATION (0xc0000005)
          843829
          Did you ever find the root cause of this?
          We are also seeing this on various machines, all on 2003 server...
          (his is an embedded Jetty engine)
          Thanks!


          #
          # An unexpected error has been detected by HotSpot Virtual Machine:
          #
          # EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x7c97a36b, pid=900, tid=956
          #
          # Java VM: Java HotSpot(TM) Server VM (1.5.0_11-b03 mixed mode)
          # Problematic frame:
          # C [ntdll.dll+0x2a36b]
          #

          --------------- T H R E A D ---------------

          Current thread (0x00968150): JavaThread "SharedThreadPool-8" [_thread_in_native, id=956]

          siginfo: ExceptionCode=0xc0000005, reading address 0x320a0d2d

          Registers:
          EAX=0x2d0a0d32, EBX=0x003d0000, ECX=0x320a0d2d, EDX=0x00c02f90
          ESP=0x1d03ef28, EBP=0x1d03f144, ESI=0x00c02f88, EDI=0x00000401
          EIP=0x7c97a36b, EFLAGS=0x00010202

          Top of Stack: (sp=0x1d03ef28)
          0x1d03ef28: 00002000 00000000 7c979fd6 00968150
          0x1d03ef38: 6d9d990d 00000000 00968150 1d03efd8
          0x1d03ef48: 00000002 00c37700 0000000a 1d03f058
          0x1d03ef58: 00968150 0096b500 0096b800 0096b848
          0x1d03ef68: 0096bbf4 1d03fc04 00968150 00938670
          0x1d03ef78: 045b9448 16183618 1d03f988 00d3d565
          0x1d03ef88: 00000000 2d0a0d32 00000000 1d03f050
          0x1d03ef98: 6db014b4 0096b838 00000000 1d03f090

          Instructions: (pc=0x7c97a36b)
          0x7c97a35b: 02 89 85 48 fe ff ff 8b 4a 04 89 8d f8 fe ff ff
          0x7c97a36b: 8b 39 3b 78 04 0f 85 51 73 01 00 3b fa 0f 85 49


          Stack: [0x1cf40000,0x1d040000), sp=0x1d03ef28, free space=1019k
          Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
          C [ntdll.dll+0x2a36b]
          C [MSVCRT.dll+0x1d08c]
          C [net.dll+0x693c]
          J java.net.SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I

          Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
          J java.net.SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I
          J java.net.SocketInputStream.read([BII)I
          J org.mortbay.util.LineInput.fill()V
          J org.mortbay.util.LineInput.fillLine(I)I
          J org.mortbay.http.HttpConnection.handleNext()Z
          J org.mortbay.http.HttpConnection.handle()V
          J org.mortbay.http.SocketListener.handleConnection(Ljava/net/Socket;)V
          J org.mortbay.util.ThreadedServer.handle(Ljava/lang/Object;)V
          J org.mortbay.util.ThreadPool$PoolThread.run()V
          v ~I2CAdapter
          v ~StubRoutines::call_stub

          <snip/>

          VM Arguments:
          jvm_args: -Xms256M -Xmx256M -Djava.library.path=lib -Dfms.home=C:\UGS\TEAMCE~1\TC2007~1.4\fsc -Dfms.config=fmsmaster_FSC_pnj1_vol02.xml -Dfsc.config=FSC_pnj1_vol02.xml -Dsun.net.client.defaultConnectTimeout=90000 -Dsun.net.client.defaultReadTimeout=90000 -Dcom.teamcenter.mld.logging.prefix=FSC_pnj1_vol02 exit
          java_command: <unknown>
          Launcher Type: generic

          Environment Variables:
          JAVA_HOME=C:\UGS\Teamcenter\Tc2007\install\install\jre
          PATH=C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\Program Files\Intel\DMIX;C:\Program Files\HITACHI\DynamicLinkManager\bin;C:\Program Files\HITACHI\DynamicLinkManager\lib;C:\Program Files\HDVM\HBaseAgent\bin;C:\Program Files\HDVM\HBaseAgent\util\bin;C:\Program Files\Common Files\Hitachi;C:\PROGRA~1\HITACHI\SERVER~1\SERVER~1\PROGRAM;lib
          USERNAME=infodba
          OS=Windows_NT
          PROCESSOR_IDENTIFIER=x86 Family 6 Model 15 Stepping 6, GenuineIntel



          --------------- S Y S T E M ---------------

          OS: Windows Server 2003 family Build 3790 Service Pack 2

          CPU:total 4 (cores per cpu 2, threads per core 1) family 6 model 15 stepping 6, cmov, cx8, fxsr, mmx, sse, sse2

          Memory: 4k page, physical 2097151k(2097151k free), swap 4194303k(4194303k free)

          vm_info: Java HotSpot(TM) Server VM (1.5.0_11-b03) for windows-x86, built on Dec 15 2006 00:54:53 by "java_re" with MS VC++ 6.0