1 Reply Latest reply: Mar 31, 2012 8:40 PM by Karol Muszynski-Oracle RSS

    Stuck Threads SOA

    866447
      Hello Folks,

      We are facing the below problem in the middle of our BPEL Process.

      In our product, we have 40 BPEL Processes, during the runtime of the BPEL Process, it gets stuck in one of the process which gives only the option to undeploy all the processes or sometime to restart the SOA.

      During our inspection of the problem, we have found the following things in the log for your quick introspection.

      1-> Transaction Timeout after 299 Seconds..

      weblogic.transaction.internal.TimedOutException: Transaction timed out after 300 seconds
      BEA1-02D585A468BD60994897
           at weblogic.ejb.container.internal.EJBRuntimeUtils.throwEJBException(EJBRuntimeUtils.java:154)
           at weblogic.ejb.container.internal.BaseLocalObject.postInvoke1(BaseLocalObject.java:595)
           at weblogic.ejb.container.internal.BaseLocalObject.__WL_postInvokeTxRetry(BaseLocalObject.java:455)
           at weblogic.ejb.container.internal.SessionLocalMethodInvoker.invoke(SessionLocalMethodInvoker.java:52)
           at com.collaxa.cube.engine.ejb.impl.bpel.BPELDeliveryBean_5k948i_ICubeDeliveryLocalBeanImpl.request(Unknown Source)
           at oracle.fabric.CubeServiceEngine.request(CubeServiceEngine.java:380)


      2-> Schema Lock

      "[STUCK] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)'" id=87 idx=0x14c tid=28287 prio=1 alive, parked, native_blocked, daemon
      -- Parking to wait for: java/util/concurrent/locks/ReentrantReadWriteLock$NonfairSync@0x1688ab8c0
      at jrockit/vm/Locks.park0(J)V(Native Method)
      at jrockit/vm/Locks.park(Locks.java:2230)
      at sun/misc/Unsafe.park(ZJ)V(Native Method)
      at java/util/concurrent/locks/LockSupport.park(LockSupport.java:158)
      at java/util/concurrent/locks/AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
      at java/util/concurrent/locks/AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:877)
      at java/util/concurrent/locks/AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1197)
      at java/util/concurrent/locks/ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:594)
      at oracle/fabric/common/wsdl/SchemaManager.lookupSchema(SchemaManager.java:294)
      at oracle/fabric/common/wsdl/SchemaManager.prepareDerivedTypeMap(SchemaManager.java:633)
      ^-- Holding lock: oracle/fabric/common/wsdl/SchemaManager@0x1688aab28[recursive]
      at oracle/fabric/common/wsdl/SchemaManager.lookupXSDTransitiveDerivedTypeDefinition(SchemaManager.java:593)
      ^-- Holding lock: oracle/fabric/common/wsdl/SchemaManager@0x1688aab28[thin lock]

      Your timely and quickly solutions is appreciated.
        • 1. Re: Stuck Threads SOA
          Karol Muszynski-Oracle
          Hi San,

          login to support.oracle.com and search for:
          1) Bug 12573835: STUCK THREADS(DEADLOCKS) ARE CREATED BY A BPEL 11.1.1.4.0 COMPOSITE IN CLUSTER
          2) BPEL Composite Under Load SOA 11.1.1.4: Stuck Threads and Deadlock Between Concurrent Threads Trying to Access a Schemamap [ID 1334888.1]
          3) SOA Server Hangs Waiting for WSDLManager to Load WSDL [ID 1331717.1]

          Check if you have a patch mentioned in those documents on your environment.

          Best Regards,
          Karol Muszynski