12 Replies Latest reply: Jan 3, 2013 10:04 PM by Joe Weinstein-Oracle Branched to a new discussion. RSS

    Blocked trying to get lock: java.lang.Class@[fat lock]

    698529
      I'm getting a lot of the error below under weblogic 10. The last class to appear in the stack trace is DriveManager and the methods are deregisterDriver e registerDriver.
      When it hapen the number of http sessions are high, but the connection pool count seems to be alright.


      Short message:

      +Thread-49 "[STUCK] ExecuteThread: '6' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, in native, suspended, blocked, priority=1, DAEMON> {+
      +-- +*Blocked trying to get lock: java.lang.Class@1448bf7[fat lock]*++
      +java.sql.DriverManager.deregisterDriver(DriverManager.java:311)+

      Complete message:


      +<28/12/2010 13h31min07s GMT-02:00> <Error> <WebLogicServer> <BEA-000337> <[STUCK] ExecuteThread: '6' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "622" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@1ab7082[+
      GET /rheportal/contracheq.jsp?tipocc=rhe HTTP/1.1
      Accept: image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, application/x-ms-application, application/vnd.ms-xpsdocument, application/xamlxml, application/x-ms-xbap, application/x-shockwave-flash, */*+
      Referer: https://xyz/mensagens.jsp
      Accept-Language: pt-br
      UA-CPU: x86
      Accept-Encoding: gzip, deflate
      User-Agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; .NET CLR 3.0.30729)
      Cookie: JSESSIONID=hpdGNhQJJ8nfg5QFPxcgzc0KVwf52pQ92LK2pdQhjJTGCwG411Nj!479820704
      Connection: Keep-Alive
      Proxy-Client-IP: 10.44.0.12
      X-Forwarded-For: 10.44.0.12
      X-WebLogic-KeepAliveSecs: 30
      X-WebLogic-Force-JVMID: 479820704

      +]", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:+
      +Thread-49 "[STUCK] ExecuteThread: '6' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, in native, suspended, blocked, priority=1, DAEMON> {+
      +-- Blocked trying to get lock: java.lang.Class@1448bf7[fat lock]+
      +java.sql.DriverManager.deregisterDriver(DriverManager.java:311)+
      +oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:400)+
      +weblogic.jdbc.common.internal.ConnectionEnvFactory.makeConnection(ConnectionEnvFactory.java:275)+
      +weblogic.jdbc.common.internal.ConnectionEnvFactory.createResource(ConnectionEnvFactory.java:180)+
      +weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1139)+
      +weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1104)+
      +weblogic.common.resourcepool.ResourcePoolImpl.reserveResourceInternal(ResourcePoolImpl.java:357)+
      +weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:329)+
      +weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:322)+
      +weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:322)+
      +weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:316)+
      +weblogic.jdbc.common.internal.ConnectionPoolManager.reserve(ConnectionPoolManager.java:85)+
      +weblogic.jdbc.common.internal.ConnectionPoolManager.reserve(ConnectionPoolManager.java:106)+
      +weblogic.jdbc.pool.Driver.connect(Driver.java:76)+
      +weblogic.jdbc.jts.Driver.getNonTxConnection(Driver.java:632)+
      +weblogic.jdbc.jts.Driver.connect(Driver.java:104)+
      +weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:353)+
      +ergon.DBUtil.createConnection(DBUtil.java:114)+
      +ergon.DBUtil.createConnection(DBUtil.java:264)+
      +ergon.LoginUtil.getOpcao(LoginUtil.java:192)+
      +ergon.LoginUtil.habilitaMenu(LoginUtil.java:226)+
      +jsp_servlet.__topo._jspService(__topo.java:286)+
      +weblogic.servlet.jsp.JspBase.service(JspBase.java:34)+
      +weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:224)+
      +weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:108)+
      +weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:198)+
      +weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)+
      +weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)+
      +ergon.ErgonFilter.doFilter(ErgonFilter.java:46)+
      +weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)+
      +weblogic.servlet.internal.RequestDispatcherImpl.invokeServlet(RequestDispatcherImpl.java:493)+
      +weblogic.servlet.internal.RequestDispatcherImpl.include(RequestDispatcherImpl.java:336)+
      +weblogic.servlet.jsp.PageContextImpl.include(PageContextImpl.java:163)+
      +weblogic.servlet.jsp.PageContextImpl.include(PageContextImpl.java:181)+
      +jsp_servlet.__contracheq._jspService(__contracheq.java:259)+
      +weblogic.servlet.jsp.JspBase.service(JspBase.java:34)+
      +weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:224)+
      +weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:108)+
      +weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:198)+
      +weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)+
      +weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)+
      +ergon.ErgonFilter.doFilter(ErgonFilter.java:46)+
      +weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)+
      +weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3564)+
      +weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:308)+
      +weblogic.security.service.SecurityManager.runAs(SecurityManager.java:117)+
      +weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2138)+
      +weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2060)+
      +weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1399)+
      +weblogic.work.ExecuteThread.execute(ExecuteThread.java:198)+
      +weblogic.work.ExecuteThread.run(ExecuteThread.java:165)+
      +}+


      Can somebody give some help?
      Thanks. Mauro.

      Edited by: Mauro Flores on 31/01/2011 10:56
        • 1. Re: Blocked trying to get lock: java.lang.Class@[fat lock]
          Joe Weinstein-Oracle
          I would upgrade the version of the Oracle driver in your server/lib directory. It is sad that
          the driver is calling DriverManager calls.

          Also, if you can define your pool to make all it's connections at startup, this issue
          will be mostly avoided.
          • 2. Re: Blocked trying to get lock: java.lang.Class@[fat lock]
            698529
            We are working with the driver ojdbc6.jar(11.2.0.1.0) and weblogic server version is 10.3.2.
            I'm getting the connection using DataSource getConnetion.
            The datasource is configured to use the class 'oracle.jdbc.OracleDriver'.
            The class DriverManager is being used internally.
            Do you mean that this class is deprecated? Should I use another jdbc driver?


            Manifest-Version: 1.0
            Ant-Version: Apache Ant 1.6.5
            Created-By: 1.5.0_17-b02 (Sun Microsystems Inc.)
            Implementation-Vendor: Oracle Corporation
            Implementation-Title: JDBC
            Implementation-Version: 11.2.0.1.0
            Specification-Vendor: Sun Microsystems Inc.
            Specification-Title: JDBC
            Specification-Version: 4.0
            Main-Class: oracle.jdbc.OracleDriver
            sealed: true

            Name: oracle/sql/converter/
            Sealed: false

            Name: oracle/sql/
            Sealed: false

            Name: oracle/sql/converter_xcharset/
            Sealed: false
            • 3. Re: Blocked trying to get lock: java.lang.Class@[fat lock]
              Joe Weinstein-Oracle
              Hi, I suggest filing an Oracle driver bug. I believe there may be a patch for this to prevent the driver doing this constant registering/deregistering every time a connection is being made.
              Joe

              Edited by: Joe Weinstein on Jan 31, 2011 11:58 AM
              • 4. Re: Blocked trying to get lock: java.lang.Class@[fat lock]
                698529
                "Hi, I suggest filing an Oracle driver bug. "

                I will do it.

                But, why I'm getting a thread stuck (fat lock). I use the same drive with other applications and I don't get this problem.
                Woudn't I just being facing a lost of performance?

                Thanks. Mauro.
                • 5. Re: Blocked trying to get lock: java.lang.Class@[fat lock]
                  Joe Weinstein-Oracle
                  A complete thread dump would be necessary to do a correct analysis.
                  Your driver bug case might be the best place to send that too.
                  Joe
                  • 6. Re: Blocked trying to get lock: java.lang.Class@[fat lock]
                    698529
                    Joe Weinstein wrote:
                    Your driver bug case might be the best place to send that too.
                    I opend the SR 3-3001032781 at My Oracle Support.
                    Joe Weinstein wrote:
                    A complete thread dump would be necessary to do a correct analysis.
                    Follow excerpts of thread dump (it's huge).

                    Thanks, Joe.


                    ===== FULL THREAD DUMP ===============

                    Wed Feb 16 12:24:49 2011

                    BEA JRockit(R) R27.6.5-32_o-121899-1.6.0_14-20091001-2113-linux-ia32

                    "Main Thread" id=1 idx=0x4 tid=18974 prio=5 alive, in native, waiting

                    -- Waiting for notification on: weblogic/t3/srvr/T3Srvr@0xa637318[fat lock]

                    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                    at java/lang/Object.wait(J)V(Native Method)

                    at java/lang/Object.wait(Object.java:485)

                    at weblogic/t3/srvr/T3Srvr.waitForDeath(T3Srvr.java:849)

                    ^-- Lock released while waiting: weblogic/t3/srvr/T3Srvr@0xa637318[fat lock]

                    at weblogic/t3/srvr/T3Srvr.run(T3Srvr.java:465)

                    at weblogic/Server.main(Server.java:67)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "(Signal Handler)" id=2 idx=0x8 tid=18975 prio=5 alive, in native, daemon

                    "(GC Main Thread)" id=3 idx=0xc tid=18976 prio=5 alive, in native, native_waiting, daemon

                    "(GC Worker Thread 1)" id=? idx=0x10 tid=18977 prio=5 alive, in native, daemon

                    "(GC Worker Thread 2)" id=? idx=0x14 tid=18978 prio=5 alive, in native, daemon

                    "(GC Worker Thread 3)" id=? idx=0x18 tid=18979 prio=5 alive, in native, daemon

                    "(GC Worker Thread 4)" id=? idx=0x1c tid=18980 prio=5 alive, in native, daemon

                    "(GC Worker Thread 5)" id=? idx=0x20 tid=18981 prio=5 alive, in native, daemon

                    "(GC Worker Thread 6)" id=? idx=0x24 tid=18982 prio=5 alive, in native, daemon

                    "(GC Worker Thread 7)" id=? idx=0x28 tid=18983 prio=5 alive, in native, daemon

                    "(GC Worker Thread 8)" id=? idx=0x2c tid=18984 prio=5 alive, in native, daemon

                    "(Code Generation Thread 1)" id=4 idx=0x30 tid=18985 prio=5 alive, in native, native_waiting, daemon

                    "(Code Optimization Thread 1)" id=5 idx=0x34 tid=18986 prio=5 alive, in native, native_waiting, daemon

                    "(VM Periodic Task)" id=6 idx=0x38 tid=18987 prio=10 alive, in native, daemon

                    "Finalizer" id=7 idx=0x3c tid=18988 prio=8 alive, in native, native_waiting, daemon

                    at jrockit/memory/Finalizer.waitForFinalizees([Ljava/lang/Object;)I(Native Method)

                          at jrockit/memory/Finalizer.access$500(Finalizer.java:12)

                          at jrockit/memory/Finalizer$4.run(Finalizer.java:159)

                          at java/lang/Thread.run(Thread.java:619)

                          at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                          -- end of trace

                      "Reference Handler" id=8 idx=0x40 tid=18989 prio=10 alive, in native, native_waiting, daemon

                          at java/lang/ref/Reference.waitForActivatedQueue()Ljava/lang/ref/Reference;(Native Method)

                          at java/lang/ref/Reference.access$100(Reference.java:11)

                          at java/lang/ref/Reference$ReferenceHandler.run(Reference.java:79)

                          at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                          -- end of trace

                      "(Sensor Event Thread)" id=9 idx=0x44 tid=18990 prio=5 alive, in native, daemon

                      "Configuration Watch Heartbeat Heartbeat" id=11 idx=0x48 tid=18991 prio=5 alive, in native, sleeping, native_waiting, daemon

                          at java/lang/Thread.sleep(J)V(Native Method)

                          at com/wily/util/heartbeat/IntervalHeartbeat$HeartbeatRunnable.run(IntervalHeartbeat.java:670)

                          at java/lang/Thread.run(Thread.java:619)

                          at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                          -- end of trace

                      "Remove Metric Data Watch Heartbeat Heartbeat" id=12 idx=0x4c tid=18992 prio=5 alive, in native, sleeping, native_waiting, daemon

                          at java/lang/Thread.sleep(J)V(Native Method)

                          at com/wily/util/heartbeat/IntervalHeartbeat$HeartbeatRunnable.run(IntervalHeartbeat.java:670)

                          at java/lang/Thread.run(Thread.java:619)

                          at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                          -- end of trace

                      "Agent Heartbeat" id=10 idx=0x50 tid=18993 prio=5 alive, in native, sleeping, native_waiting, daemon

                          at java/lang/Thread.sleep(J)V(Native Method)

                          at com/wily/util/heartbeat/IntervalHeartbeat$HeartbeatRunnable.run(IntervalHeartbeat.java:670)

                          at java/lang/Thread.run(Thread.java:619)

                          at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                          -- end of trace

                      "Agent Execution" id=14 idx=0x54 tid=18994 prio=5 alive, in native, waiting, daemon

                          -- Waiting for notification on: com/wily/util/adt/BlockingQueue@0xac6e6a8[fat lock]

                    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                    at jrockit/vm/Locks.wait(Locks.java:2261)[inlined]

                    at java/lang/Object.wait(Object.java:485)[optimized]

                    at com/wily/util/adt/BlockingQueue.interruptableDequeue(BlockingQueue.java:123)

                    ^-- Lock released while waiting: com/wily/util/adt/BlockingQueue@0xac6e6a8[fat lock]

                    at com/wily/util/task/AsynchExecutionQueue.doTask(AsynchExecutionQueue.java:200)

                    at com/wily/util/task/ATask$CoreTask.run(ATask.java:132)

                    at java/lang/Thread.run(Thread.java:619)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "Agent ServerConnection" id=15 idx=0x58 tid=18995 prio=5 alive, in native, sleeping, native_waiting, daemon

                    at java/lang/Thread.sleep(J)V(Native Method)

                    at com/wily/introscope/agent/connection/ConnectionThread.sendData(ConnectionThread.java:312)

                    at com/wily/introscope/agent/connection/ConnectionThread.run(ConnectionThread.java:65)

                    at java/lang/Thread.run(Thread.java:619)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "UnknownHub Hub Transmit 1" id=16 idx=0x5c tid=18996 prio=5 alive, in native, waiting, daemon

                    -- Waiting for notification on: java/lang/Object@0xacffa08[fat lock]

                    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                    at java/lang/Object.wait(J)V(Native Method)[optimized]

                    at com/wily/EDU/oswego/cs/dl/util/concurrent/BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)[optimized]

                    ^-- Lock released while waiting: java/lang/Object@0xacffa08[fat lock]

                    at com/wily/isengard/postofficehub/link/v1/OutgoingMessageDeliveryTask.deliverNextMessageInternal(OutgoingMessageDeliveryTask.java:145)[optimized]

                    at com/wily/isengard/postofficehub/link/v1/OutgoingMessageDeliveryTask.deliverNextMessage(OutgoingMessageDeliveryTask.java:92)[optimized]

                    at com/wily/isengard/postofficehub/link/v1/OutgoingRouteConnector.sendOutgoingMessages(OutgoingRouteConnector.java:152)

                    at com/wily/isengard/postofficehub/link/v1/OutgoingRouteConnector.doTask(OutgoingRouteConnector.java:73)

                    at com/wily/isengard/util/thread/AThreadedExecutable.run(AThreadedExecutable.java:192)

                    at java/lang/Thread.run(Thread.java:619)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "UnknownHub Hub Receive 1" id=17 idx=0x60 tid=18997 prio=5 alive, in native, daemon

                    at jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native Method)

                          at jrockit/net/SocketNativeIO.socketRead(SocketNativeIO.java:46)[optimized]

                    at java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.java)[inlined]

                    at java/net/SocketInputStream.read(SocketInputStream.java:129)[optimized]

                    at com/wily/util/io/NonSyncBufferedInputStream.fill(NonSyncBufferedInputStream.java:54)

                    at com/wily/util/io/NonSyncBufferedInputStream.read(NonSyncBufferedInputStream.java:79)

                    at java/io/FilterInputStream.read(FilterInputStream.java:66)

                    at com/wily/util/io/EncryptInputStream.read(EncryptInputStream.java:64)

                    at com/wily/org/apache/commons/io/input/ProxyInputStream.read(ProxyInputStream.java:49)

                    at com/wily/org/apache/commons/io/input/CountingInputStream.read(CountingInputStream.java:70)

                    at java/io/DataInputStream.readInt(DataInputStream.java:370)

                    at com/wily/isengard/postofficehub/link/v1/IsengardObjectInputStream.readInt(IsengardObjectInputStream.java:1203)

                    at com/wily/isengard/postofficehub/link/v1/IsengardObjectInputStream.setUpStartObjectGraph(IsengardObjectInputStream.java:442)

                    at com/wily/isengard/postofficehub/link/v1/IsengardObjectInputStream.readObject(IsengardObjectInputStream.java:246)

                    at com/wily/isengard/postofficehub/link/v1/IncomingMessageDeliveryTask.deliverNextMessage(IncomingMessageDeliveryTask.java:75)[optimized]

                    at com/wily/isengard/postofficehub/link/v1/IncomingRouteConnector.receiveIncomingMessages(IncomingRouteConnector.java:168)

                    at com/wily/isengard/postofficehub/link/v1/IncomingRouteConnector.doTask(IncomingRouteConnector.java:89)

                    at com/wily/isengard/util/thread/AThreadedExecutable.run(AThreadedExecutable.java:192)

                    at java/lang/Thread.run(Thread.java:619)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "PO:client_main Mailman 1" id=18 idx=0x64 tid=18998 prio=5 alive, in native, waiting, daemon

                    -- Waiting for notification on: java/lang/Object@0xad00f68[fat lock]

                    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                    at java/lang/Object.wait(J)V(Native Method)

                    at com/wily/EDU/oswego/cs/dl/util/concurrent/BoundedLinkedQueue.poll(BoundedLinkedQueue.java:253)

                    ^-- Lock released while waiting: java/lang/Object@0xad00f68[fat lock]

                    at com/wily/util/concurrent/PooledVaryingExecutor.getTask(PooledVaryingExecutor.java:104)

                    at com/wily/EDU/oswego/cs/dl/util/concurrent/PooledExecutor$Worker.run(PooledExecutor.java:727)

                    at java/lang/Thread.run(Thread.java:619)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "Timer-0" id=20 idx=0x68 tid=18999 prio=5 alive, in native, waiting, daemon

                    -- Waiting for notification on: java/util/TaskQueue@0xa4a3858[fat lock]

                    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                    at jrockit/vm/Locks.wait(Locks.java:2261)[inlined]

                    at java/lang/Object.wait(Object.java:485)[optimized]

                    at java/util/TimerThread.mainLoop(Timer.java:483)

                    ^-- Lock released while waiting: java/util/TaskQueue@0xa4a3858[fat lock]

                    at java/util/TimerThread.run(Timer.java:462)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "Timer-1" id=21 idx=0x6c tid=19000 prio=5 alive, in native, waiting, daemon

                    -- Waiting for notification on: java/util/TaskQueue@0x9b45558[fat lock]

                    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                    at java/lang/Object.wait(J)V(Native Method)[optimized]

                    at java/util/TimerThread.mainLoop(Timer.java:509)

                    ^-- Lock released while waiting: java/util/TaskQueue@0x9b45558[fat lock]

                    at java/util/TimerThread.run(Timer.java:462)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "[STUCK] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'" id=22 idx=0x70 tid=19001 prio=1 alive, in native, daemon

                    at jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native Method)

                          at jrockit/net/SocketNativeIO.socketRead(SocketNativeIO.java:46)[optimized]

                    at java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.java)

                    at java/net/SocketInputStream.read(SocketInputStream.java:129)

                    at com/sun/mail/util/TraceInputStream.read(TraceInputStream.java:110)

                    at java/io/BufferedInputStream.fill(BufferedInputStream.java:218)

                    at java/io/BufferedInputStream.read(BufferedInputStream.java:237)

                    ^-- Holding lock: java/io/BufferedInputStream@0xd8fce78[biased lock]

                    at com/sun/mail/util/LineInputStream.readLine(LineInputStream.java:88)

                    at com/sun/mail/smtp/SMTPTransport.readServerResponse(SMTPTransport.java:1589)

                    at com/sun/mail/smtp/SMTPTransport.openServer(SMTPTransport.java:1369)

                    at com/sun/mail/smtp/SMTPTransport.protocolConnect(SMTPTransport.java:412)

                    at javax/mail/Service.connect(Service.java:288)

                    ^-- Holding lock: com/sun/mail/smtp/SMTPTransport@0xd8e5738[biased lock]

                    at javax/mail/Service.connect(Service.java:169)

                    at javax/mail/Service.connect(Service.java:118)

                    at javax/mail/Transport.send0(Transport.java:188)

                    at javax/mail/Transport.send(Transport.java:118)

                    at com/procergs/util/mail/Correio.enviaMensagem(Correio.java:354)

                    at ergon/web/Senha.sendMail3(Senha.java:230)

                    at ergon/web/Senha.enviaSenha2(Senha.java:491)

                    at jsp_servlet/__gerasenha._jspService(__gerasenha.java:367)

                    at weblogic/servlet/jsp/JspBase.service(JspBase.java:34)[optimized]

                    at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)[optimized]

                    at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)[inlined]

                    at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:292)[optimized]

                    at weblogic/servlet/internal/TailFilter.doFilter(TailFilter.java:26)[optimized]

                    at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[optimized]

                    at ergon/ErgonFilter.doFilter(ErgonFilter.java:91)[optimized]

                    at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[inlined]

                    at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3592)[optimized]

                    at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)[optimized]

                    at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:121)[inlined]

                    at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2202)[inlined]

                    at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2108)[optimized]

                    at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1432)[optimized]

                    at weblogic/work/ExecuteThread.execute(ExecuteThread.java:201)[optimized]

                    at weblogic/work/ExecuteThread.run(ExecuteThread.java:173)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "weblogic.time.TimeEventGenerator" id=23 idx=0x74 tid=19002 prio=9 alive, in native, waiting, daemon

                    -- Waiting for notification on: weblogic/time/common/internal/TimeTable@0x9b86820[fat lock]

                    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                    at java/lang/Object.wait(J)V(Native Method)[optimized]

                    at weblogic/time/common/internal/TimeTable.snooze(TimeTable.java:286)

                    ^-- Lock released while waiting: weblogic/time/common/internal/TimeTable@0x9b86820[fat lock]

                    at weblogic/time/common/internal/TimeEventGenerator.run(TimeEventGenerator.java:117)

                    at java/lang/Thread.run(Thread.java:619)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "JMAPI event thread" id=24 idx=0x78 tid=19003 prio=5 alive, in native, native_waiting, daemon

                    "weblogic.timers.TimerThread" id=25 idx=0x7c tid=19004 prio=9 alive, in native, waiting, daemon

                    -- Waiting for notification on: weblogic/timers/internal/TimerThread@0x99366c0[fat lock]

                    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                    at java/lang/Object.wait(J)V(Native Method)[optimized]

                    at weblogic/timers/internal/TimerThread$Thread.run(TimerThread.java:267)

                    ^-- Lock released while waiting: weblogic/timers/internal/TimerThread@0x99366c0[fat lock]

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "[STUCK] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'" id=26 idx=0x80 tid=19005 prio=1 alive, in native, daemon

                    at jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native Method)

                          at jrockit/net/SocketNativeIO.socketRead(SocketNativeIO.java:46)

                          at java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.java)

                          at java/net/SocketInputStream.read(SocketInputStream.java:129)

                          at com/sun/mail/util/TraceInputStream.read(TraceInputStream.java:110)

                          at java/io/BufferedInputStream.fill(BufferedInputStream.java:218)

                          at java/io/BufferedInputStream.read(BufferedInputStream.java:237)

                          ^-- Holding lock: java/io/BufferedInputStream@0xc6c4888[biased lock]

                    at com/sun/mail/util/LineInputStream.readLine(LineInputStream.java:88)

                    at com/sun/mail/smtp/SMTPTransport.readServerResponse(SMTPTransport.java:1589)

                    at com/sun/mail/smtp/SMTPTransport.openServer(SMTPTransport.java:1369)

                    at com/sun/mail/smtp/SMTPTransport.protocolConnect(SMTPTransport.java:412)

                    at javax/mail/Service.connect(Service.java:288)

                    ^-- Holding lock: com/sun/mail/smtp/SMTPTransport@0xc6c2640[biased lock]

                    at javax/mail/Service.connect(Service.java:169)

                    at javax/mail/Service.connect(Service.java:118)

                    at javax/mail/Transport.send0(Transport.java:188)

                    at javax/mail/Transport.send(Transport.java:118)

                    at com/procergs/util/mail/Correio.enviaMensagem(Correio.java:354)

                    at ergon/web/FaleConosco.sendMailProcergs(FaleConosco.java:142)

                    at ergon/web/FaleConosco.enviaEmail(FaleConosco.java:49)

                    at jsp_servlet/__faleconoscosaida._jspService(__faleconoscosaida.java:207)

                    at weblogic/servlet/jsp/JspBase.service(JspBase.java:34)[optimized]

                    at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)[optimized]

                    at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)[inlined]

                    at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:292)[optimized]

                    at weblogic/servlet/internal/TailFilter.doFilter(TailFilter.java:26)[optimized]

                    at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[optimized]

                    at ergon/ErgonFilter.doFilter(ErgonFilter.java:91)[optimized]

                    at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[inlined]

                    at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3592)[optimized]

                    at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)[optimized]

                    at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:121)[inlined]

                    at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2202)[inlined]

                    at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2108)[optimized]

                    at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1432)[optimized]

                    at weblogic/work/ExecuteThread.execute(ExecuteThread.java:201)[optimized]

                    at weblogic/work/ExecuteThread.run(ExecuteThread.java:173)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "Timer-2" id=29 idx=0x84 tid=19006 prio=5 alive, in native, waiting, daemon

                    -- Waiting for notification on: java/util/TaskQueue@0x9b76fb8[fat lock]

                    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                    at java/lang/Object.wait(J)V(Native Method)[optimized]

                    at java/util/TimerThread.mainLoop(Timer.java:509)

                    ^-- Lock released while waiting: java/util/TaskQueue@0x9b76fb8[fat lock]

                    at java/util/TimerThread.run(Timer.java:462)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "Thread-8" id=30 idx=0x88 tid=19007 prio=5 alive, in native, parked, daemon

                    -- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0x9926a40

                    at jrockit/vm/Locks.park0(J)V(Native Method)

                    at jrockit/vm/Locks.park(Locks.java:2517)

                    at sun/misc/Unsafe.park(ZJ)V(Native Method)

                    at java/util/concurrent/locks/LockSupport.park(LockSupport.java:158)

                    at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)

                    at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)

                    at weblogic/utils/concurrent/JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89)

                    at weblogic/store/internal/PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:567)

                    at weblogic/store/internal/PersistentStoreImpl.run(PersistentStoreImpl.java:615)

                    at weblogic/store/internal/PersistentStoreImpl$2.run(PersistentStoreImpl.java:383)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" id=31 idx=0x8c tid=19008 prio=5 alive, in native, blocked, daemon

                    -- Blocked trying to get lock: java/lang/String@0xb144bd0[fat lock]

                    at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)

                    at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1679)[optimized]

                    at jrockit/vm/Locks.lockFat(Locks.java:1780)[optimized]

                    at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1312)[optimized]

                    at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1259)[optimized]

                    at jrockit/vm/Locks.monitorEnter(Locks.java:2466)[optimized]

                    at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)

                    at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)

                    at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)

                    at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)

                    at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=32 idx=0x90 tid=19009 prio=5 alive, in native, daemon

                    at jrockit/ext/epoll/EPoll.epollWait0(IIII)I(Native Method)

                    at jrockit/ext/epoll/EPoll.epollWait(EPoll.java:103)

                    at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:156)

                    ^-- Holding lock: java/lang/String@0xb144bd0[fat lock]

                    at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)

                    at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)

                    at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)

                    at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" id=33 idx=0x94 tid=19010 prio=5 alive, in native, blocked, daemon

                    -- Blocked trying to get lock: java/lang/String@0xb144bd0[fat lock]

                    at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)

                    at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1679)[inlined]

                    at jrockit/vm/Locks.fatLockReacquire(Locks.java:1917)[optimized]

                    at jrockit/vm/Locks.lockFat(Locks.java:1785)[optimized]

                    at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1312)[optimized]

                    at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1259)[optimized]

                    at jrockit/vm/Locks.monitorEnter(Locks.java:2466)[optimized]

                    at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)

                    at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)

                    at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)

                    at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)

                    at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "ExecuteThread: '3' for queue: 'weblogic.socket.Muxer'" id=34 idx=0x98 tid=19011 prio=5 alive, in native, blocked, daemon

                    -- Blocked trying to get lock: java/lang/String@0xb144bd0[fat lock]

                    at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)

                    at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1679)[optimized]

                    at jrockit/vm/Locks.lockFat(Locks.java:1780)[optimized]

                    at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1312)[optimized]

                    at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1259)[optimized]

                    at jrockit/vm/Locks.monitorEnter(Locks.java:2466)[optimized]

                    at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)

                    at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)

                    at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)

                    at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)

                    at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace

                    "VDE Transaction Processor Thread" id=37 idx=0x9c tid=19016 prio=2 alive, in native, waiting, daemon

                    -- Waiting for notification on: com/octetstring/vde/backend/standard/TransactionProcessor@0x99495c8[fat lock]

                    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                    at java/lang/Object.wait(J)V(Native Method)

                    at java/lang/Object.wait(Object.java:485)

                    at com/octetstring/vde/backend/standard/TransactionProcessor.waitChange(TransactionProcessor.java:367)

                    ^-- Lock released while waiting: com/octetstring/vde/backend/standard/TransactionProcessor@0x99495c8[fat lock]

                    at com/octetstring/vde/backend/standard/TransactionProcessor.run(TransactionProcessor.java:212)

                    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                    -- end of trace


                    Blocked lock chains

                    ===================

                    Chain 2:

                    "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" id=33 idx=0x94 tid=19010 waiting for java/lang/String@0xb144bd0 held by:

                    "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=32 idx=0x90 tid=19009 in chain 1

                    Chain 3:

                    "ExecuteThread: '3' for queue: 'weblogic.socket.Muxer'" id=34 idx=0x98 tid=19011 waiting for java/lang/String@0xb144bd0 held by:

                    "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=32 idx=0x90 tid=19009 in chain 1

                    Chain 5:

                    "[ACTIVE] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)'" id=47 idx=0xc0 tid=19025 waiting for java/lang/Class@0x96194d0 held by:

                    "[ACTIVE] ExecuteThread: '34' for queue: 'weblogic.kernel.Default (self-tuning)'" id=77 idx=0x138 tid=11228 in chain 4

                    ...
                    Chain 225:

                    "[ACTIVE] ExecuteThread: '249' for queue: 'weblogic.kernel.Default (self-tuning)'" id=293 idx=0x494 tid=16226 waiting for java/lang/Class@0x96194d0 held by:

                    "[ACTIVE] ExecuteThread: '34' for queue: 'weblogic.kernel.Default (self-tuning)'" id=77 idx=0x138 tid=11228 in chain 4

                    Chain 226:

                    "[ACTIVE] ExecuteThread: '250' for queue: 'weblogic.kernel.Default (self-tuning)'" id=294 idx=0x498 tid=16227 waiting for java/lang/Class@0x96194d0 held by:

                    "[ACTIVE] ExecuteThread: '34' for queue: 'weblogic.kernel.Default (self-tuning)'" id=77 idx=0x138 tid=11228 in chain 4

                    Open lock chains

                    ================

                    Chain 1:

                    "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" id=31 idx=0x8c tid=19008 waiting for java/lang/String@0xb144bd0 held by:

                    "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=32 idx=0x90 tid=19009 (active)

                    Chain 4:

                    "[ACTIVE] ExecuteThread: '212' for queue: 'weblogic.kernel.Default (self-tuning)'" id=256 idx=0xa0 tid=16189 waiting for java/lang/Class@0x96194d0 held by:

                    "[ACTIVE] ExecuteThread: '34' for queue: 'weblogic.kernel.Default (self-tuning)'" id=77 idx=0x138 tid=11228 (active)

                    ===== END OF THREAD DUMP ===============
                    • 7. Re: Blocked trying to get lock: java.lang.Class@[fat lock]
                      Joe Weinstein-Oracle
                      There is nothing JDBC-related in that whole thread dump...
                      • 8. Re: Blocked trying to get lock: java.lang.Class@[fat lock]
                        698529
                        I'm really sorry. I sent the wrong thread dump. That's the correct one.



                        ===== FULL THREAD DUMP ===============

                        Thu Feb 17 10:44:49 2011

                        BEA JRockit(R) R27.6.5-32_o-121899-1.6.0_14-20091001-2113-linux-ia32

                        "Main Thread" id=1 idx=0x4 tid=3534 prio=5 alive, in native, waiting

                        -- Waiting for notification on: weblogic/t3/srvr/T3Srvr@0x9fd7b60[fat lock]

                        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                        at java/lang/Object.wait(J)V(Native Method)

                        at java/lang/Object.wait(Object.java:485)

                        at weblogic/t3/srvr/T3Srvr.waitForDeath(T3Srvr.java:849)

                        ^-- Lock released while waiting: weblogic/t3/srvr/T3Srvr@0x9fd7b60[fat lock]

                        at weblogic/t3/srvr/T3Srvr.run(T3Srvr.java:465)

                        at weblogic/Server.main(Server.java:67)

                        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                        -- end of trace

                        "(Signal Handler)" id=2 idx=0x8 tid=3535 prio=5 alive, in native, daemon

                        "(GC Main Thread)" id=3 idx=0xc tid=3536 prio=5 alive, in native, native_waiting, daemon

                        "(GC Worker Thread 1)" id=? idx=0x10 tid=3537 prio=5 alive, in native, daemon

                        "(GC Worker Thread 2)" id=? idx=0x14 tid=3538 prio=5 alive, in native, daemon

                        "(GC Worker Thread 3)" id=? idx=0x18 tid=3539 prio=5 alive, in native, daemon

                        "(GC Worker Thread 4)" id=? idx=0x1c tid=3540 prio=5 alive, in native, daemon

                        "(GC Worker Thread 5)" id=? idx=0x20 tid=3541 prio=5 alive, in native, daemon

                        "(GC Worker Thread 6)" id=? idx=0x24 tid=3542 prio=5 alive, in native, daemon

                        "(GC Worker Thread 7)" id=? idx=0x28 tid=3543 prio=5 alive, in native, daemon

                        "(GC Worker Thread 8)" id=? idx=0x2c tid=3544 prio=5 alive, in native, daemon

                        "(Code Generation Thread 1)" id=4 idx=0x30 tid=3545 prio=5 alive, in native, native_waiting, daemon

                        "(Code Optimization Thread 1)" id=5 idx=0x34 tid=3546 prio=5 alive, in native, native_waiting, daemon

                        "(VM Periodic Task)" id=6 idx=0x38 tid=3547 prio=10 alive, in native, daemon

                        "Finalizer" id=7 idx=0x3c tid=3548 prio=8 alive, in native, native_waiting, daemon

                        at jrockit/memory/Finalizer.waitForFinalizees([Ljava/lang/Object;)I(Native Method)

                               at jrockit/memory/Finalizer.access$500(Finalizer.java:12)

                               at jrockit/memory/Finalizer$4.run(Finalizer.java:159)

                               at java/lang/Thread.run(Thread.java:619)

                               at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                               -- end of trace

                        ...
                           "JMAPI event thread" id=24 idx=0x78 tid=3782 prio=5 alive, in native, native_waiting, daemon

                           "weblogic.timers.TimerThread" id=25 idx=0x7c tid=3783 prio=9 alive, in native, waiting, daemon

                               -- Waiting for notification on: weblogic/timers/internal/TimerThread@0xa0f5cc8[fat lock]

                        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                        at java/lang/Object.wait(J)V(Native Method)[optimized]

                        at weblogic/timers/internal/TimerThread$Thread.run(TimerThread.java:267)

                        ^-- Lock released while waiting: weblogic/timers/internal/TimerThread@0xa0f5cc8[fat lock]

                        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                        -- end of trace

                        "[ACTIVE] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'" id=26 idx=0x80 tid=3784 prio=5 alive, in native, daemon

                        at jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native Method)

                               at jrockit/net/SocketNativeIO.socketRead(SocketNativeIO.java:46)[optimized]

                        at java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.java)[inlined]

                        at java/net/SocketInputStream.read(SocketInputStream.java:129)[optimized]

                        at oracle/net/ns/Packet.receive(Packet.java:293)[optimized]

                        at oracle/net/ns/DataPacket.receive(DataPacket.java:92)

                        at oracle/net/ns/NetInputStream.getNextPacket(NetInputStream.java:174)[optimized]

                        at oracle/net/ns/NetInputStream.read(NetInputStream.java:119)[inlined]

                        at oracle/net/ns/NetInputStream.read(NetInputStream.java:94)[inlined]

                        at oracle/net/ns/NetInputStream.read(NetInputStream.java:79)[optimized]

                        at oracle/jdbc/driver/T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:122)[optimized]

                        at oracle/jdbc/driver/T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:78)[inlined]

                        at oracle/jdbc/driver/T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1040)[optimized]

                        at oracle/jdbc/driver/T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1016)[inlined]

                        at oracle/jdbc/driver/T4C8Oall.receive(T4C8Oall.java:589)[optimized]

                        at oracle/jdbc/driver/T4CCallableStatement.doOall8(T4CCallableStatement.java:191)[inlined]

                        at oracle/jdbc/driver/T4CCallableStatement.executeForRows(T4CCallableStatement.java:950)[optimized]

                        at oracle/jdbc/driver/OracleStatement.doExecuteWithTimeout(OracleStatement.java:1223)[optimized]

                        at oracle/jdbc/driver/OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3386)[inlined]

                        at oracle/jdbc/driver/OraclePreparedStatement.execute(OraclePreparedStatement.java:3487)[optimized]

                        ^-- Holding lock: oracle/jdbc/driver/T4CConnection@0x919fed0[recursive]

                        at oracle/jdbc/driver/OracleCallableStatement.execute(OracleCallableStatement.java:3858)[optimized]

                        ^-- Holding lock: oracle/jdbc/driver/T4CConnection@0x919fed0[thin lock]

                        at oracle/jdbc/driver/OraclePreparedStatementWrapper.execute(OraclePreparedStatementWrapper.java:1374)[optimized]

                        at weblogic/jdbc/wrapper/PreparedStatement.execute(PreparedStatement.java:98)[optimized]

                        at ergon/UtilRhe.setOpcaoContraCheqPapel(UtilRhe.java:403)

                        at jsp_servlet/__contracheqpapelsai._jspService(__contracheqpapelsai.java:163)

                        at weblogic/servlet/jsp/JspBase.service(JspBase.java:34)[optimized]

                        at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)[optimized]

                        at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)[inlined]

                        at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:292)[optimized]

                        at weblogic/servlet/internal/TailFilter.doFilter(TailFilter.java:26)[optimized]

                        at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[optimized]

                        at ergon/ErgonFilter.doFilter(ErgonFilter.java:91)[optimized]

                        at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[inlined]

                        at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3592)[optimized]

                        at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)[optimized]

                        at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:121)[inlined]

                        at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2202)[inlined]

                        at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2108)[optimized]

                        at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1432)[optimized]

                        at weblogic/work/ExecuteThread.execute(ExecuteThread.java:201)[optimized]

                        at weblogic/work/ExecuteThread.run(ExecuteThread.java:173)

                        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                        -- end of trace

                        "Timer-2" id=29 idx=0x84 tid=3785 prio=5 alive, in native, waiting, daemon

                        -- Waiting for notification on: java/util/TaskQueue@0x967adb0[fat lock]

                        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                        at java/lang/Object.wait(J)V(Native Method)

                        at java/util/TimerThread.mainLoop(Timer.java:509)

                        ^-- Lock released while waiting: java/util/TaskQueue@0x967adb0[fat lock]

                        at java/util/TimerThread.run(Timer.java:462)

                        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                        -- end of trace
                        ...
                        "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" id=31 idx=0x8c tid=3793 prio=5 alive, in native, daemon

                        at jrockit/ext/epoll/EPoll.epollWait0(IIII)I(Native Method)

                        at jrockit/ext/epoll/EPoll.epollWait(EPoll.java:103)

                        at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:156)

                        ^-- Holding lock: java/lang/String@0x944d758[fat lock]

                        at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)

                        at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)

                        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)

                        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)

                        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                        -- end of trace

                        "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=32 idx=0x90 tid=3803 prio=5 alive, in native, blocked, daemon

                        -- Blocked trying to get lock: java/lang/String@0x944d758[fat lock]

                        at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)

                        at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1679)[optimized]

                        at jrockit/vm/Locks.lockFat(Locks.java:1780)[optimized]

                        at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1312)[optimized]

                        at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1259)[optimized]

                        at jrockit/vm/Locks.monitorEnter(Locks.java:2466)[optimized]

                        at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)

                        at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)

                        at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)

                        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)

                        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)

                        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                        -- end of trace

                        ...
                        "[ACTIVE] ExecuteThread: '212' for queue: 'weblogic.kernel.Default (self-tuning)'" id=256 idx=0xa0 tid=25058 prio=5 alive, in native, blocked, daemon

                        -- Blocked trying to get lock: java/lang/Class@0x8c5d9b8[fat lock]

                        at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)

                        at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1679)[optimized]

                        at jrockit/vm/Locks.lockFat(Locks.java:1780)[optimized]

                        at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1312)[optimized]

                        at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1259)[optimized]

                        at java/sql/DriverManager.registerDriver(DriverManager.java:298)[optimized]

                        at ergon/DBUtil.createConnection(DBUtil.java:124)[optimized]

                        at ergon/DBUtil.createConnection(DBUtil.java:226)[optimized]

                        at ergon/DBUtil.createConnection(DBUtil.java:216)[inlined]

                        at ergon/DBUtil.createConnection(DBUtil.java:251)[inlined]

                        at ergon/UtilRhe.openConnORACLE(UtilRhe.java:54)[inlined]

                        at ergon/UtilRhe.executeQueryORACLE(UtilRhe.java:177)[optimized]

                        at jsp_servlet/__averbatempo._jspService(__averbatempo.java:169)

                        at weblogic/servlet/jsp/JspBase.service(JspBase.java:34)[optimized]

                        at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)[optimized]

                        at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)[inlined]

                        at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:292)[optimized]

                        at weblogic/servlet/internal/TailFilter.doFilter(TailFilter.java:26)[optimized]

                        at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[optimized]

                        at ergon/ErgonFilter.doFilter(ErgonFilter.java:91)[optimized]

                        at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[inlined]

                        at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3592)[optimized]

                        at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)[optimized]

                        at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:121)[inlined]

                        at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2202)[inlined]

                        at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2108)[optimized]

                        at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1432)[optimized]

                        at weblogic/work/ExecuteThread.execute(ExecuteThread.java:201)[inlined]

                        at weblogic/work/ExecuteThread.run(ExecuteThread.java:173)[optimized]

                        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                        -- end of trace

                        "DoSManager" id=40 idx=0xa4 tid=4356 prio=6 alive, in native, sleeping, native_waiting, daemon

                        at java/lang/Thread.sleep(J)V(Native Method)

                        at com/octetstring/vde/DoSManager.run(DoSManager.java:433)

                        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                        -- end of trace

                        "LDAPConnThread-0 ldap://arce.procergs.reders:8050" id=41 idx=0xa8 tid=4357 prio=5 alive, in native, daemon

                        at jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native Method)

                               at jrockit/net/SocketNativeIO.socketRead(SocketNativeIO.java:46)

                               at java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.java)

                               at java/net/SocketInputStream.read(SocketInputStream.java:129)

                               at java/io/BufferedInputStream.fill(BufferedInputStream.java:218)

                               at java/io/BufferedInputStream.read(BufferedInputStream.java:237)

                               ^-- Holding lock: java/io/BufferedInputStream@0x8c0ad58[biased lock]

                        at netscape/ldap/ber/stream/BERElement.getElement(BERElement.java:101)

                        at netscape/ldap/LDAPConnThread.run(LDAPConnThread.java:538)

                        at java/lang/Thread.run(Thread.java:619)

                        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                        -- end of trace

                        ...

                        "[ACTIVE] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)'" id=49 idx=0xc8 tid=20288 prio=5 alive, in native, blocked, daemon

                        -- Blocked trying to get lock: java/lang/Class@0x8c5d9b8[fat lock]

                        at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)

                        at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1679)[optimized]

                        at jrockit/vm/Locks.lockFat(Locks.java:1780)[optimized]

                        at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1312)[optimized]

                        at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1259)[optimized]

                        at java/sql/DriverManager.deregisterDriver(DriverManager.java:311)[inlined]

                        at oracle/jdbc/driver/OracleDriver.connect(OracleDriver.java:503)[optimized]

                        at weblogic/jdbc/common/internal/ConnectionEnvFactory.makeConnection(ConnectionEnvFactory.java:320)[inlined]

                        at weblogic/jdbc/common/internal/ConnectionEnvFactory.createResource(ConnectionEnvFactory.java:220)[optimized]

                        at weblogic/common/resourcepool/ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1180)

                        at weblogic/common/resourcepool/ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1104)[inlined]

                        at weblogic/common/resourcepool/ResourcePoolImpl.reserveResourceInternal(ResourcePoolImpl.java:428)[optimized]

                        at weblogic/common/resourcepool/ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:332)[optimized]

                        at weblogic/common/resourcepool/ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:322)[inlined]

                        at weblogic/jdbc/common/internal/ConnectionPool.reserve(ConnectionPool.java:431)[inlined]

                        at weblogic/jdbc/common/internal/ConnectionPool.reserve(ConnectionPool.java:316)[inlined]

                        at weblogic/jdbc/common/internal/ConnectionPoolManager.reserve(ConnectionPoolManager.java:93)[inlined]

                        at weblogic/jdbc/common/internal/ConnectionPoolManager.reserve(ConnectionPoolManager.java:106)[inlined]

                        at weblogic/jdbc/pool/Driver.connect(Driver.java:149)[optimized]

                        at weblogic/jdbc/jts/Driver.getNonTxConnection(Driver.java:652)[optimized]

                        at weblogic/jdbc/jts/Driver.connect(Driver.java:127)[optimized]

                        at weblogic/jdbc/common/internal/RmiDataSource.getConnection(RmiDataSource.java:355)[optimized]

                        at ergon/DBUtil.createConnection(DBUtil.java:200)[optimized]

                        at ergon/DBUtil.createConnection(DBUtil.java:275)[inlined]

                        at ergon/LoginUtil.getOpcao(LoginUtil.java:193)[inlined]

                        at ergon/LoginUtil.habilitaMenu(LoginUtil.java:227)[optimized]

                        at jsp_servlet/__topo._jspService(__topo.java:603)[optimized]

                        at weblogic/servlet/jsp/JspBase.service(JspBase.java:34)[optimized]

                        at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)[optimized]

                        at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)[inlined]

                        at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:292)[optimized]

                        at weblogic/servlet/internal/TailFilter.doFilter(TailFilter.java:26)[optimized]

                        at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[optimized]

                        at ergon/ErgonFilter.doFilter(ErgonFilter.java:91)[optimized]

                        at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[inlined]

                        at weblogic/servlet/internal/RequestDispatcherImpl.invokeServlet(RequestDispatcherImpl.java:500)[inlined]

                        at weblogic/servlet/internal/RequestDispatcherImpl.include(RequestDispatcherImpl.java:429)[optimized]

                        at weblogic/servlet/jsp/PageContextImpl.include(PageContextImpl.java:163)[inlined]

                        at weblogic/servlet/jsp/PageContextImpl.include(PageContextImpl.java:184)[optimized]

                        at jsp_servlet/__contrachequerhe._jspService(__contrachequerhe.java:461)

                        at weblogic/servlet/jsp/JspBase.service(JspBase.java:34)[optimized]

                        at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)[optimized]

                        at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)[inlined]

                        at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:292)[optimized]

                        at weblogic/servlet/internal/TailFilter.doFilter(TailFilter.java:26)[optimized]

                        at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[optimized]

                        at ergon/ErgonFilter.doFilter(ErgonFilter.java:91)[optimized]

                        at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[inlined]

                        at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3592)[optimized]

                        at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)[optimized]

                        at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:121)[inlined]

                        at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2202)[inlined]

                        at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2108)[optimized]

                        at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1432)[optimized]

                        at weblogic/work/ExecuteThread.execute(ExecuteThread.java:201)[inlined]

                        at weblogic/work/ExecuteThread.run(ExecuteThread.java:173)[optimized]

                        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                        -- end of trace
                        ...
                        "[ACTIVE] ExecuteThread: '15' for queue: 'weblogic.kernel.Default (self-tuning)'" id=59 idx=0xf0 tid=24854 prio=5 alive, daemon

                        at oracle/jdbc/driver/OracleDriver.connect(OracleDriver.java:503)[optimized]

                        ^-- Holding lock: java/lang/Class@0x8c5d9b8[fat lock]

                        at weblogic/jdbc/common/internal/ConnectionEnvFactory.makeConnection(ConnectionEnvFactory.java:320)[inlined]

                        at weblogic/jdbc/common/internal/ConnectionEnvFactory.createResource(ConnectionEnvFactory.java:220)[optimized]

                        at weblogic/common/resourcepool/ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1180)

                        at weblogic/common/resourcepool/ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1104)[inlined]

                        at weblogic/common/resourcepool/ResourcePoolImpl.reserveResourceInternal(ResourcePoolImpl.java:428)[optimized]

                        at weblogic/common/resourcepool/ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:332)[optimized]

                        at weblogic/common/resourcepool/ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:322)[inlined]

                        at weblogic/jdbc/common/internal/ConnectionPool.reserve(ConnectionPool.java:431)[inlined]

                        at weblogic/jdbc/common/internal/ConnectionPool.reserve(ConnectionPool.java:316)[inlined]

                        at weblogic/jdbc/common/internal/ConnectionPoolManager.reserve(ConnectionPoolManager.java:93)[inlined]

                        at weblogic/jdbc/common/internal/ConnectionPoolManager.reserve(ConnectionPoolManager.java:106)[inlined]

                        at weblogic/jdbc/pool/Driver.connect(Driver.java:149)[optimized]

                        at weblogic/jdbc/jts/Driver.getNonTxConnection(Driver.java:652)[optimized]

                        at weblogic/jdbc/jts/Driver.connect(Driver.java:127)[optimized]

                        at weblogic/jdbc/common/internal/RmiDataSource.getConnection(RmiDataSource.java:355)[optimized]

                        at ergon/DBUtil.createConnection(DBUtil.java:200)[optimized]

                        at ergon/DBUtil.createConnection(DBUtil.java:226)[optimized]

                        at ergon/DBUtil.createConnection(DBUtil.java:216)[inlined]

                        at ergon/DBUtil.createConnection(DBUtil.java:251)[inlined]

                        at ergon/UtilRhe.openConnORACLE(UtilRhe.java:54)[inlined]

                        at ergon/UtilRhe.executeQueryORACLE(UtilRhe.java:177)[optimized]

                        at jsp_servlet/__contrachequerhe._jspService(__contrachequerhe.java:372)

                        at weblogic/servlet/jsp/JspBase.service(JspBase.java:34)[optimized]

                        at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)[optimized]

                        at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)[inlined]

                        at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:292)[optimized]

                        at weblogic/servlet/internal/TailFilter.doFilter(TailFilter.java:26)[optimized]

                        at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[optimized]

                        at ergon/ErgonFilter.doFilter(ErgonFilter.java:91)[optimized]

                        at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[inlined]

                        at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3592)[optimized]

                        at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)[optimized]

                        at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:121)[inlined]

                        at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2202)[inlined]

                        at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2108)[optimized]

                        at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1432)[optimized]

                        at weblogic/work/ExecuteThread.execute(ExecuteThread.java:201)[inlined]

                        at weblogic/work/ExecuteThread.run(ExecuteThread.java:173)[optimized]

                        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)

                        -- end of trace

                        ....

                        Chain 393:

                        "[ACTIVE] ExecuteThread: '397' for queue: 'weblogic.kernel.Default (self-tuning)'" id=441 idx=0x6e4 tid=25258 waiting for java/lang/Class@0x8c5d9b8 held by:

                        "[ACTIVE] ExecuteThread: '15' for queue: 'weblogic.kernel.Default (self-tuning)'" id=59 idx=0xf0 tid=24854 in chain 4

                        Chain 394:

                        "[ACTIVE] ExecuteThread: '398' for queue: 'weblogic.kernel.Default (self-tuning)'" id=442 idx=0x6e8 tid=25259 waiting for java/lang/Class@0x8c5d9b8 held by:

                        "[ACTIVE] ExecuteThread: '15' for queue: 'weblogic.kernel.Default (self-tuning)'" id=59 idx=0xf0 tid=24854 in chain 4

                        Chain 395:

                        "[ACTIVE] ExecuteThread: '399' for queue: 'weblogic.kernel.Default (self-tuning)'" id=443 idx=0x6ec tid=25260 waiting for java/lang/Class@0x8c5d9b8 held by:

                        "[ACTIVE] ExecuteThread: '15' for queue: 'weblogic.kernel.Default (self-tuning)'" id=59 idx=0xf0 tid=24854 in chain 4

                        Open lock chains

                        ================

                        Chain 1:

                        "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=32 idx=0x90 tid=3803 waiting for java/lang/String@0x944d758 held by:

                        "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" id=31 idx=0x8c tid=3793 (active)

                        Chain 4:

                        "[ACTIVE] ExecuteThread: '212' for queue: 'weblogic.kernel.Default (self-tuning)'" id=256 idx=0xa0 tid=25058 waiting for java/lang/Class@0x8c5d9b8 held by:

                        "[ACTIVE] ExecuteThread: '15' for queue: 'weblogic.kernel.Default (self-tuning)'" id=59 idx=0xf0 tid=24854 (active)

                        ===== END OF THREAD DUMP ===============
                        • 9. Re: Blocked trying to get lock: java.lang.Class@[fat lock]
                          Joe Weinstein-Oracle
                          OK, that thread dump shows:

                          1 - one thread in JDBC waiting for the DBMS to respond

                          2 - one thread waiting for a lock while doing java.sql.DriverManager.registerDriver()
                          at ergon/DBUtil.createConnection(DBUtil.java:124)

                          which should be fixed. This DBUtil should avoid any repeat/redundant DriverManager
                          call because they are class-synchronized.

                          3 - a thread in the oracle driver, also blocked on the DriverManager class, trying
                          to deregister itself. This is something the driver shouldn't be doing.

                          4 - Another thread or two where WebLogic's pool is trying to make new connections.
                          This should be avoided at runtime, by populating the pool with an initial capacity setting
                          high enough that it makes all/most of the connections you'll need, ahead of time.

                          Joe
                          • 10. Re: Blocked trying to get lock: java.lang.Class@[fat lock]
                            698529
                            Joe Weinstein wrote:
                            3 - a thread in the oracle driver, also blocked on the DriverManager class, trying
                            to deregister itself. This is something the driver shouldn't be doing.
                            I'll report this to Oracle Support.

                            Joe Weinstein wrote:
                            2 - one thread waiting for a lock while doing java.sql.DriverManager.registerDriver()
                            at ergon/DBUtil.createConnection(DBUtil.java:124)

                            which should be fixed. This DBUtil should avoid any repeat/redundant DriverManager
                            call because they are class-synchronized.
                            We decompile DBUtil.class of production environment and found out that the source code we had were different.
                            We found this lost line in the middle of the code (without any sence): DriverManager.registerDriver(new OracleDriver());

                            We corrected it. We suppose we wont have more stuck threads.

                            Joe, I really appreciate your help!!!
                            • 11. Re: Blocked trying to get lock: java.lang.Class@[fat lock]
                              VIJAYTechM
                              hi
                              I got the same issue. I have thread dump. We have server node by name vgnvcmserver. Some time it is slow and not responding so we don't know what to do please check the thread dump once how to avoid this problem for ever.

                              Fri Jan 04 11:28:34 2013

                              Oracle JRockit(R) R28.1.1-14_BR11718574-141097-1.6.0_22-20110204-1552-windows-x86_64

                              "Main Thread" id=1 idx=0x4 tid=4244 prio=5 alive, waiting, native_blocked

                              -- Waiting for notification on: weblogic/t3/srvr/T3Srvr@0x000000000505A3F0[fat lock]

                              at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                              at java/lang/Object.wait(J)V(Native Method)

                              at java/lang/Object.wait(Object.java:485)

                              at weblogic/t3/srvr/T3Srvr.waitForDeath(T3Srvr.java:902)

                              ^-- Lock released while waiting: weblogic/t3/srvr/T3Srvr@0x000000000505A3F0[fat lock]

                              at weblogic/t3/srvr/T3Srvr.run(T3Srvr.java:465)

                              at weblogic/Server.main(Server.java:67)

                              at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)

                              -- end of trace

                              "(OC Main Thread)" id=2 idx=0x8 tid=7428 prio=5 alive, native_waiting, daemon

                              "(GC Worker Thread 1)" id=? idx=0xc tid=4808 prio=5 alive, daemon

                              "(GC Worker Thread 2)" id=? idx=0x10 tid=6996 prio=5 alive, daemon

                              "(GC Worker Thread 3)" id=? idx=0x14 tid=5844 prio=5 alive, daemon

                              "(GC Worker Thread 4)" id=? idx=0x18 tid=2656 prio=5 alive, daemon

                              "(Code Generation Thread 1)" id=3 idx=0x1c tid=5872 prio=5 alive, native_waiting, daemon

                              "(Code Optimization Thread 1)" id=4 idx=0x20 tid=7784 prio=5 alive, native_waiting, daemon

                              "(VM Periodic Task)" id=5 idx=0x24 tid=7860 prio=10 alive, native_blocked, daemon

                              "(Attach Listener)" id=6 idx=0x28 tid=3324 prio=5 alive, native_blocked, daemon

                              "Finalizer" id=7 idx=0x2c tid=7596 prio=8 alive, native_waiting, daemon

                              at jrockit/memory/Finalizer.waitForFinalizees(J[Ljava/lang/Object;)I(Native Method)
                                       
                                              at jrockit/memory/Finalizer.access$700(Finalizer.java:12)
                                       
                                              at jrockit/memory/Finalizer$4.run(Finalizer.java:189)
                                       
                                              at java/lang/Thread.run(Thread.java:662)
                                       
                                              at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
                                       
                                              -- end of trace
                                       
                                          "Reference Handler" id=8 idx=0x30 tid=7380 prio=10 alive, native_waiting, daemon
                                       
                                              at java/lang/ref/Reference.waitForActivatedQueue(J)Ljava/lang/ref/Reference;(Native Method)
                                       
                                              at java/lang/ref/Reference.access$100(Reference.java:11)
                                       
                                              at java/lang/ref/Reference$ReferenceHandler.run(Reference.java:82)
                                       
                                              at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
                                       
                                              -- end of trace
                                       
                                          "(Sensor Event Thread)" id=9 idx=0x34 tid=5556 prio=5 alive, native_blocked, daemon
                                       
                                          "VM JFR Buffer Thread" id=11 idx=0x38 tid=4496 prio=5 alive, in native, daemon
                                       
                                          "Timer-0" id=13 idx=0x3c tid=4812 prio=5 alive, waiting, native_blocked, daemon
                                       
                                              -- Waiting for notification on: java/util/TaskQueue@0x0000000004B47488[fat lock]

                              at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)

                              at java/lang/Object.wait(J)V(Native Method)

                              at java/lang/Object.wait(Object.java:485)

                              at java/util/TimerThread.mainLoop(Timer.java:483)

                              ^-- Lock released while waiting: java/util/TaskQueue@0x0000000004B47488[fat lock]

                              at java/util/TimerThread.run(Timer.java:462)

                              at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)

                              -- end of trace

                              Can you help me to how to trace this
                              Regards
                              Vijay
                              • 12. Re: Blocked trying to get lock: java.lang.Class@[fat lock]
                                Joe Weinstein-Oracle
                                Your issue is totally different. Nothing JDBC related in your thread dump.