1 Reply Latest reply: May 3, 2012 9:39 AM by NarsingPumandla RSS

    ORA-02049: timeout: distributed transaction waiting for lock

    Roseanne
      Hello, I am testing a scenario which will take .xls file with 10,000 rows and will process it.
      How much Polling Frequecy and Minimum File age I should set.

      Currently, I have set Polling Frequecy= 180 sec and Minimum File Age: 120 sec.
      When I am testing with this settings, I am getting 'ORA-02049: timeout: distributed transaction waiting for lock" error in log files.

      Are we getting this error because dead lock in DB? How much value we should give for DISTRIBUTED_LOCK_TIMEOUT ?

      Complete details from log file:
      -----------------------------------------
      [2012-04-30T05:37:57.516+00:00] [OJDL] [NOTIFICATION:16] [ODL-52001] [oracle.core.ojdl.FileLogWriter] [org: Oracle] [host: usmtnz-dinfap20.dev.emrsn.org] [nwaddr: 10.22.136.29] [tid: orabpel.invoke.pool-4.thread-13] [userId: aoriond7] deleting log file: soa_ms_1-diagnostic-26.log, size: 10483529 bytes
      [2012-04-30T05:37:57.427+00:00] [soa_ms_1] [ERROR] [] [oracle.soa.adapter] [tid: orabpel.invoke.pool-4.thread-13] [userId: <anonymous>] [ecid: afc045960fbe82d9:1030c9fe:136c518bccd:-8000-00000000001c1718,0:1:100109695] [APP: soa-infra] [composite_name: RCH_BPEL_IPCXML] [component_name: RCH_BPEL_IPCXML] [component_instance_id: 4138570] JCABinding=> RCH_BPEL_IPCXML:RCH_DB_UPDT_FillformIPC [ RCH_DB_UPDT_FillformIPC_ptt::update(XxreachFillformIpcTbCollection) ] Could not invoke operation 'update' against the 'Database Adapter' due to: [[
      BINDING.JCA-11616
      DBWriteInteractionSpec Execute Failed Exception.
      update failed. Descriptor name: [RCHDBUPDTFillformIPC.XxreachFillformIpcTb].
      Caused by java.sql.BatchUpdateException: ORA-02049: timeout: distributed transaction waiting for lock
      .
      Please see the logs for the full DBAdapter logging output prior to this exception. This exception is considered not retriable, likely due to a modelling mistake. To classify it as retriable instead add property nonRetriableErrorCodes with value "-2049" to your deployment descriptor (i.e. weblogic-ra.xml). To auto retry a retriable fault set these composite.xml properties for this invoke: jca.retry.interval, jca.retry.count, and jca.retry.backoff. All properties are integers.

      ]]
      [2012-04-30T05:37:57.430+00:00] [soa_ms_1] [ERROR] [] [oracle.soa.bpel.engine.dispatch] [tid: orabpel.invoke.pool-4.thread-6] [userId: <anonymous>] [ecid: afc045960fbe82d9:1030c9fe:136c518bccd:-8000-00000000001c16f1,0:1:100109689] [APP: soa-infra] Failed to handle dispatch message ... exception ORABPEL-05002[[

      Message handle error.
      error while attempting to process the message "com.collaxa.cube.engine.dispatch.message.invoke.InvokeInstanceMessage"; the reported exception is: Fault not handled.
      failure to handle a fault thrown from a scope, by any blocks in the scope chain.
      This exception occurred because the fault thrown in the BPEL flow was not handled by any fault handlers and reached the top-level scope.
      A top-level fault handler should be added to the flow to handle faults not caught from within the flow.

      This error contained an exception thrown by the message handler.
      Check the exception trace in the log (with logging level set to debug mode).
      ORABPEL-05002

      Message handle error.
      error while attempting to process the message "com.collaxa.cube.engine.dispatch.message.invoke.InvokeInstanceMessage"; the reported exception is: Fault not handled.
      failure to handle a fault thrown from a scope, by any blocks in the scope chain.
      This exception occurred because the fault thrown in the BPEL flow was not handled by any fault handlers and reached the top-level scope.
      A top-level fault handler should be added to the flow to handle faults not caught from within the flow.

      This error contained an exception thrown by the message handler.
      Check the exception trace in the log (with logging level set to debug mode).

           at com.collaxa.cube.engine.dispatch.DispatchHelper.handleMessage(DispatchHelper.java:207)
           at com.collaxa.cube.engine.dispatch.BaseDispatchTask.process(BaseDispatchTask.java:88)
           at com.collaxa.cube.engine.dispatch.BaseDispatchTask.run(BaseDispatchTask.java:64)
           at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
           at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
           at java.lang.Thread.run(Thread.java:662)

      ]]
      [2012-04-30T05:37:57.523+00:00] [soa_ms_1] [NOTIFICATION] [] [oracle.soa.adapter] [tid: orabpel.invoke.pool-4.thread-13] [userId: <anonymous>] [ecid: afc045960fbe82d9:1030c9fe:136c518bccd:-8000-00000000001c1718,0:1:100109695] [APP: soa-infra] [composite_name: RCH_BPEL_IPCXML] [component_name: RCH_BPEL_IPCXML] [component_instance_id: 4138570] JCABinding=> RCH_BPEL_IPCXML:RCH_DB_UPDT_FillformIPC [ RCH_DB_UPDT_FillformIPC_ptt::update(XxreachFillformIpcTbCollection) ] Change logging level to TRACE:n to see full error stack
      [2012-04-30T05:37:57.551+00:00] [soa_ms_1] [ERROR] [] [oracle.soa.adapter] [tid: orabpel.invoke.pool-4.thread-13] [userId: <anonymous>] [ecid: afc045960fbe82d9:1030c9fe:136c518bccd:-8000-00000000001c1718,0:1:100109695] [APP: soa-infra] [composite_name: RCH_BPEL_IPCXML] [component_name: RCH_BPEL_IPCXML] [component_instance_id: 4138570] JCABinding=> [Reach/RCH_BPEL_IPCXML!1.0*soa_e7890f2c-b18d-4bf1-a17b-7662cded8ddf.RCH_DB_UPDT_FillformIPC]:update One-way operation update() failed
      [2012-04-30T05:37:57.556+00:00] [soa_ms_1] [ERROR] [] [oracle.soa.bpel.engine.ws] [tid: orabpel.invoke.pool-4.thread-13] [userId: <anonymous>] [ecid: afc045960fbe82d9:1030c9fe:136c518bccd:-8000-00000000001c1718,0:1:100109695] [APP: soa-infra] [composite_name: RCH_BPEL_IPCXML] [component_name: RCH_BPEL_IPCXML] [component_instance_id: 4138570] got FabricInvocationException[[
      java.sql.BatchUpdateException: ORA-02049: timeout: distributed transaction waiting for lock

           at oracle.jdbc.driver.OraclePreparedStatement.executeBatch(OraclePreparedStatement.java:13257)
           at oracle.jdbc.driver.OracleStatementWrapper.executeBatch(OracleStatementWrapper.java:234)
           at weblogic.jdbc.wrapper.PreparedStatement.executeBatch(PreparedStatement.java:210)
           at org.eclipse.persistence.platform.database.oracle.Oracle10Platform.executeBatch(Oracle10Platform.java:47)
           at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.executeJDK12BatchStatement(DatabaseAccessor.java:817)
           at org.eclipse.persistence.internal.databaseaccess.ParameterizedSQLBatchWritingMechanism.executeBatchedStatements(ParameterizedSQLBatchWritingMechanism.java:139)
           at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.writesCompleted(DatabaseAccessor.java:1632)
           at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.commitTransaction(DatabaseAccessor.java:399)
           at org.eclipse.persistence.internal.sessions.AbstractSession.basicCommitTransaction(AbstractSession.java:504)
           at org.eclipse.persistence.sessions.server.ClientSession.basicCommitTransaction(ClientSession.java:155)
           at org.eclipse.persistence.internal.sessions.AbstractSession.commitTransaction(AbstractSession.java:686)
           at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.commitTransaction(UnitOfWorkImpl.java:1581)
           at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.commitToDatabaseWithChangeSet(UnitOfWorkImpl.java:1536)
           at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.commitRootUnitOfWork(UnitOfWorkImpl.java:1330)
           at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.commit(UnitOfWorkImpl.java:1092)
           at oracle.tip.adapter.db.transaction.DBTransaction.commit(DBTransaction.java:193)
           at oracle.integration.platform.blocks.adapter.fw.jca.cci.JCAInteractionInvoker.executeJcaInteraction(JCAInteractionInvoker.java:323)
           at oracle.integration.platform.blocks.adapter.fw.jca.cci.JCAInteractionInvoker.invokeJcaReference(JCAInteractionInvoker.java:525)
           at oracle.integration.platform.blocks.adapter.fw.jca.cci.JCAInteractionInvoker.invokeAsyncJcaReference(JCAInteractionInvoker.java:508)
           at oracle.integration.platform.blocks.adapter.fw.jca.cci.JCAEndpointInteraction.performAsynchronousInteraction(JCAEndpointInteraction.java:491)
           at oracle.integration.platform.blocks.adapter.AdapterReference.post(AdapterReference.java:247)
           at oracle.integration.platform.blocks.mesh.AsynchronousMessageHandler.doPost(AsynchronousMessageHandler.java:142)
           at oracle.integration.platform.blocks.mesh.MessageRouter.post(MessageRouter.java:194)
           at oracle.integration.platform.blocks.mesh.MeshImpl.post(MeshImpl.java:215)
           at sun.reflect.GeneratedMethodAccessor1238.invoke(Unknown Source)
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
           at java.lang.reflect.Method.invoke(Method.java:597)
           at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:307)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
           at oracle.integration.platform.metrics.PhaseEventAspect.invoke(PhaseEventAspect.java:71)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
           at $Proxy302.post(Unknown Source)
           at oracle.fabric.CubeServiceEngine.postToMesh(CubeServiceEngine.java:806)
           at com.collaxa.cube.ws.WSInvocationManager.invoke(WSInvocationManager.java:258)
           at com.collaxa.cube.engine.ext.common.InvokeHandler.__invoke(InvokeHandler.java:1056)
           at com.collaxa.cube.engine.ext.common.InvokeHandler.handleNormalInvoke(InvokeHandler.java:583)
           at com.collaxa.cube.engine.ext.common.InvokeHandler.handle(InvokeHandler.java:130)
           at com.collaxa.cube.engine.ext.bpel.common.wmp.BPELInvokeWMP.__executeStatements(BPELInvokeWMP.java:74)
           at com.collaxa.cube.engine.ext.bpel.common.wmp.BaseBPELActivityWMP.perform(BaseBPELActivityWMP.java:158)
           at com.collaxa.cube.engine.CubeEngine._performActivity(CubeEngine.java:2463)
           at com.collaxa.cube.engine.CubeEngine.performActivity(CubeEngine.java:2334)
           at com.collaxa.cube.engine.CubeEngine.handleWorkItem(CubeEngine.java:1115)
           at com.collaxa.cube.engine.dispatch.message.instance.PerformMessageHandler.handleLocal(PerformMessageHandler.java:73)
           at com.collaxa.cube.engine.dispatch.DispatchHelper.handleLocalMessage(DispatchHelper.java:220)
           at com.collaxa.cube.engine.dispatch.DispatchHelper.sendMemory(DispatchHelper.java:328)
           at com.collaxa.cube.engine.CubeEngine.endRequest(CubeEngine.java:4350)
           at com.collaxa.cube.engine.CubeEngine.endRequest(CubeEngine.java:4281)
           at com.collaxa.cube.engine.CubeEngine.createAndInvoke(CubeEngine.java:679)
           at com.collaxa.cube.engine.delivery.DeliveryService.handleInvoke(DeliveryService.java:654)
           at com.collaxa.cube.engine.ejb.impl.CubeDeliveryBean.handleInvoke(CubeDeliveryBean.java:293)
           at sun.reflect.GeneratedMethodAccessor1242.invoke(Unknown Source)
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
           at java.lang.reflect.Method.invoke(Method.java:597)
           at com.bea.core.repackaged.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
           at com.bea.core.repackaged.springframework.jee.intercept.MethodInvocationInvocationContext.proceed(MethodInvocationInvocationContext.java:104)
           at oracle.security.jps.ee.ejb.JpsAbsInterceptor$1.run(JpsAbsInterceptor.java:94)
           at java.security.AccessController.doPrivileged(Native Method)
           at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:313)
           at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:413)
           at oracle.security.jps.ee.ejb.JpsAbsInterceptor.runJaasMode(JpsAbsInterceptor.java:81)
           at oracle.security.jps.ee.ejb.JpsAbsInterceptor.intercept(JpsAbsInterceptor.java:112)
           at oracle.security.jps.ee.ejb.JpsInterceptor.intercept(JpsInterceptor.java:105)
           at sun.reflect.GeneratedMethodAccessor1043.invoke(Unknown Source)
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
           at java.lang.reflect.Method.invoke(Method.java:597)
           at com.bea.core.repackaged.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310)
           at com.bea.core.repackaged.springframework.jee.intercept.JeeInterceptorInterceptor.invoke(JeeInterceptorInterceptor.java:69)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
           at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.jee.spi.MethodInvocationVisitorImpl.visit(MethodInvocationVisitorImpl.java:37)
           at weblogic.ejb.container.injection.EnvironmentInterceptorCallbackImpl.callback(EnvironmentInterceptorCallbackImpl.java:54)
           at com.bea.core.repackaged.springframework.jee.spi.EnvironmentInterceptor.invoke(EnvironmentInterceptor.java:50)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:89)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
           at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
           at $Proxy285.handleInvoke(Unknown Source)
           at com.collaxa.cube.engine.ejb.impl.bpel.BPELDeliveryBean_5k948i_ICubeDeliveryLocalBeanImpl.__WL_invoke(Unknown Source)
           at weblogic.ejb.container.internal.SessionLocalMethodInvoker.invoke(SessionLocalMethodInvoker.java:39)
           at com.collaxa.cube.engine.ejb.impl.bpel.BPELDeliveryBean_5k948i_ICubeDeliveryLocalBeanImpl.handleInvoke(Unknown Source)
           at com.collaxa.cube.engine.dispatch.message.invoke.InvokeInstanceMessageHandler.handle(InvokeInstanceMessageHandler.java:35)
           at com.collaxa.cube.engine.dispatch.DispatchHelper.handleMessage(DispatchHelper.java:140)
           at com.collaxa.cube.engine.dispatch.BaseDispatchTask.process(BaseDispatchTask.java:88)
           at com.collaxa.cube.engine.dispatch.BaseDispatchTask.run(BaseDispatchTask.java:64)
           at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
           at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
           at java.lang.Thread.run(Thread.java:662)

      Please help me on this.. Thanks!