4 Replies Latest reply on May 9, 2012 11:33 PM by 883982

    SOA 11.1.1.3.0 - Connection Pool has been suspended during weak load

    e.gherardini
      Hi,
      I have a SCA with different BPEL, all uses several db adapters.

      Each db adapter has retry count set to 1.
      Each bpel has the following properties:
          <property name="bpel.config.transaction" many="false">required</property>
          <property name="bpel.config.inMemoryOptimization">true</property>
          <property name="bpel.config.completionPersistPolicy">off</property>
      When I do a simple load testing (with 10 concurrent threads invoking the same SCA webservice) my connection pool is suspended.

      Here is my connection pool configuration:
      <?xml version='1.0' encoding='UTF-8'?>
      <jdbc-data-source xmlns="http://xmlns.oracle.com/weblogic/jdbc-data-source" xmlns:sec="http://xmlns.oracle.com/weblogic/security" xmlns:wls="http://xmlns.oracle.com/weblogic/security/wls" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://xmlns.oracle.com/weblogic/jdbc-data-source http://xmlns.oracle.com/weblogic/jdbc-data-source/1.0/jdbc-data-source.xsd">
        <name>DEV__DB</name>
        <jdbc-driver-params>
          <url>jdbc:oracle:thin:@10.17.5.50:1521:orcl</url>
          <driver-name>oracle.jdbc.xa.client.OracleXADataSource</driver-name>
          <properties>
            <property>
              <name>user</name>
              <value>DEV_</value>
            </property>
          </properties>
          <password-encrypted>{AES}UiaJC9d4Fl7jWHkcrYttu5E+wpOB4Jw1QKwTSA0ARtE=</password-encrypted>
          <use-xa-data-source-interface>true</use-xa-data-source-interface>
        </jdbc-driver-params>
        <jdbc-connection-pool-params>
          <initial-capacity>0</initial-capacity>
          <max-capacity>100</max-capacity>
          <capacity-increment>1</capacity-increment>
          <shrink-frequency-seconds>900</shrink-frequency-seconds>
          <highest-num-waiters>2147483647</highest-num-waiters>
          <connection-creation-retry-frequency-seconds>10</connection-creation-retry-frequency-seconds>
          <connection-reserve-timeout-seconds>10</connection-reserve-timeout-seconds>
          <test-frequency-seconds>300</test-frequency-seconds>
          <test-connections-on-reserve>true</test-connections-on-reserve>
          <ignore-in-use-connections-enabled>true</ignore-in-use-connections-enabled>
          <inactive-connection-timeout-seconds>0</inactive-connection-timeout-seconds>
          <test-table-name>SQL SELECT 1 FROM DUAL</test-table-name>
          <login-delay-seconds>0</login-delay-seconds>
          <statement-cache-size>100</statement-cache-size>
          <statement-cache-type>LRU</statement-cache-type>
          <remove-infected-connections>true</remove-infected-connections>
          <seconds-to-trust-an-idle-pool-connection>0</seconds-to-trust-an-idle-pool-connection>
          <statement-timeout>-1</statement-timeout>
          <jdbc-xa-debug-level>10</jdbc-xa-debug-level>
          <pinned-to-thread>false</pinned-to-thread>
        </jdbc-connection-pool-params>
        <jdbc-data-source-params>
          <jndi-name>jdbc/soSvilDB</jndi-name>
          <global-transactions-protocol>TwoPhaseCommit</global-transactions-protocol>
        </jdbc-data-source-params>
        <jdbc-xa-params>
          <keep-xa-conn-till-tx-complete>true</keep-xa-conn-till-tx-complete>
          <need-tx-ctx-on-close>false</need-tx-ctx-on-close>
          <xa-end-only-once>false</xa-end-only-once>
          <keep-logical-conn-open-on-release>false</keep-logical-conn-open-on-release>
          <resource-health-monitoring>true</resource-health-monitoring>
          <recover-only-once>false</recover-only-once>
          <xa-set-transaction-timeout>false</xa-set-transaction-timeout>
          <xa-transaction-timeout>0</xa-transaction-timeout>
          <rollback-local-tx-upon-conn-close>false</rollback-local-tx-upon-conn-close>
          <xa-retry-duration-seconds>300</xa-retry-duration-seconds>
          <xa-retry-interval-seconds>60</xa-retry-interval-seconds>
        </jdbc-xa-params>
      </jdbc-data-source>
      Here is the error:
      [2011-04-22T12:36:52.026+02:00] [OJDL] [NOTIFICATION:16] [ODL-52001] [oracle.core.ojdl.FileLogWriter] [org: Oracle] [host: soa.linux55.reply] [nwaddr: 10.17.5.69] [tid: [ACTIVE].ExecuteThread: '14' for queue: 'weblogic.kernel.Default (self-tuning)'] [userId: oracle] deleting log file: soa_server1-diagnostic-179.log, size: 10485438 bytes
      [2011-04-22T12:36:51.985+02:00] [soa_server1] [ERROR] [] [oracle.soa.mediator.serviceEngine] [tid: [ACTIVE].ExecuteThread: '14' for queue: 'weblogic.kernel.Default (self-tuning)'] [userId: <anonymous>] [ecid: 0000Ixwm9CqEcLH5yvs1yW1DgLRV000081,0] [WEBSERVICE_PORT.name: AlarmsRetrieverPortType_pt] [APP: soa-infra] [composite_name: AlarmRetreiverProject] [component_name: AlarmRetrieverMediator] [component_instance_id: 6E8716B06CCC11E0AF65F721A176C6C2] [J2EE_MODULE.name: fabric] [dcid: 0f2f96dd491b9522:5032bc97:12f7cbc8b1d:-7ffc-0000000000001701] [WEBSERVICE.name: AlarmRetrieverMediator_ep] [J2EE_APP.name: soa-infra] [composite_instance_id: 250014] Got an exception: oracle.fabric.common.FabricInvocationException: faultName: {{http://schemas.oracle.com/bpel/extension}remoteFault}[[
      parts: {{
      summary=<summary>Exception occured when binding was invoked.
      Exception occured during invocation of JCA binding: "JCA Binding execute of Reference operation 'GetTrainAlarms_dba' failed due to: Pure SQL Exception.
      Pure SQL Execute of select aa.* from <OMITTED>
      Caused by java.sql.SQLException: Internal error: Cannot obtain XAConnection weblogic.common.resourcepool.ResourceDisabledException: Pool DEV__DB is Suspended, cannot allocate resources to applications..
           at weblogic.common.resourcepool.ResourcePoolImpl.reserveResourceInternal(ResourcePoolImpl.java:357)
           at weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:332)
           at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:440)
           at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:317)
           at weblogic.jdbc.common.internal.ConnectionPoolManager.reserve(ConnectionPoolManager.java:93)
           at weblogic.jdbc.common.internal.ConnectionPoolManager.reserve(ConnectionPoolManager.java:61)
           at weblogic.jdbc.jta.DataSource.getXAConnectionFromPool(DataSource.java:1670)
           at weblogic.jdbc.jta.DataSource.refreshXAConnAndEnlist(DataSource.java:1438)
           at weblogic.jdbc.jta.DataSource.getConnection(DataSource.java:439)
           at weblogic.jdbc.jta.DataSource.connect(DataSource.java:396)
           at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:355)
           at org.eclipse.persistence.sessions.JNDIConnector.connect(JNDIConnector.java:126)
           at org.eclipse.persistence.sessions.JNDIConnector.connect(JNDIConnector.java:94)
           at org.eclipse.persistence.sessions.DatasourceLogin.connectToDatasource(DatasourceLogin.java:162)
           at org.eclipse.persistence.internal.databaseaccess.DatasourceAccessor.connectInternal(DatasourceAccessor.java:327)
           at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.connectInternal(DatabaseAccessor.java:295)
           at org.eclipse.persistence.internal.databaseaccess.DatasourceAccessor.reconnect(DatasourceAccessor.java:558)
           at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.reconnect(DatabaseAccessor.java:1437)
           at org.eclipse.persistence.internal.databaseaccess.DatasourceAccessor.incrementCallCount(DatasourceAccessor.java:303)
           at oracle.tip.adapter.db.DBConnection.getTopLinkSQLConnection(DBConnection.java:335)
           at oracle.tip.adapter.db.transaction.DBTransaction.beginInternal(DBTransaction.java:126)
           at oracle.tip.adapter.db.puresql.PureSQLInteraction.executePureSQL(PureSQLInteraction.java:165)
           at oracle.tip.adapter.db.DBInteraction.executePureSQL(DBInteraction.java:1178)
           at oracle.tip.adapter.db.DBInteraction.execute(DBInteraction.java:255)
           at oracle.integration.platform.blocks.adapter.fw.jca.cci.JCAInteractionInvoker.executeJcaInteraction(JCAInteractionInvoker.java:303)
           at oracle.integration.platform.blocks.adapter.fw.jca.cci.JCAInteractionInvoker.invokeJcaReference(JCAInteractionInvoker.java:519)
           at oracle.integration.platform.blocks.adapter.fw.jca.cci.JCAInteractionInvoker.invokeSyncJcaReference(JCAInteractionInvoker.java:492)
           at oracle.integration.platform.blocks.adapter.fw.jca.cci.JCAEndpointInteraction.performSynchronousInteraction(JCAEndpointInteraction.java:472)
           at oracle.integration.platform.blocks.adapter.AdapterReference.request(AdapterReference.java:166)
           at oracle.integration.platform.blocks.mesh.SynchronousMessageHandler.doRequest(SynchronousMessageHandler.java:139)
           at oracle.integration.platform.blocks.mesh.MessageRouter.request(MessageRouter.java:179)
           at oracle.integration.platform.blocks.mesh.MeshImpl.request(MeshImpl.java:155)
           at sun.reflect.GeneratedMethodAccessor925.invoke(Unknown Source)
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
           at java.lang.reflect.Method.invoke(Method.java:597)
           at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:307)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
           at oracle.integration.platform.metrics.PhaseEventAspect.invoke(PhaseEventAspect.java:71)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
           at $Proxy284.request(Unknown Source)
           at oracle.fabric.CubeServiceEngine.requestToMesh(CubeServiceEngine.java:797)
           at com.collaxa.cube.ws.WSInvocationManager.invoke(WSInvocationManager.java:262)
           at com.collaxa.cube.engine.ext.common.InvokeHandler.__invoke(InvokeHandler.java:1073)
           at com.collaxa.cube.engine.ext.common.InvokeHandler.handleNormalInvoke(InvokeHandler.java:526)
           at com.collaxa.cube.engine.ext.common.InvokeHandler.handle(InvokeHandler.java:127)
           at com.collaxa.cube.engine.ext.bpel.common.wmp.BPELInvokeWMP.__executeStatements(BPELInvokeWMP.java:70)
           at com.collaxa.cube.engine.ext.bpel.common.wmp.BaseBPELActivityWMP.perform(BaseBPELActivityWMP.java:162)
           at com.collaxa.cube.engine.CubeEngine.performActivity(CubeEngine.java:2465)
           at com.collaxa.cube.engine.CubeEngine.handleWorkItem(CubeEngine.java:1133)
           at com.collaxa.cube.engine.dispatch.message.instance.PerformMessageHandler.handleLocal(PerformMessageHandler.java:73)
           at com.collaxa.cube.engine.dispatch.DispatchHelper.handleLocalMessage(DispatchHelper.java:219)
           at com.collaxa.cube.engine.dispatch.DispatchHelper.sendMemory(DispatchHelper.java:327)
           at com.collaxa.cube.engine.CubeEngine.endRequest(CubeEngine.java:4350)
           at com.collaxa.cube.engine.CubeEngine.endRequest(CubeEngine.java:4282)
           at com.collaxa.cube.engine.CubeEngine._createAndInvoke(CubeEngine.java:713)
           at com.collaxa.cube.engine.CubeEngine.createAndInvoke(CubeEngine.java:545)
           at com.collaxa.cube.engine.ejb.impl.CubeEngineBean.createAndInvoke(CubeEngineBean.java:108)
           at com.collaxa.cube.engine.ejb.impl.CubeEngineBean.syncCreateAndInvokeParticipate(CubeEngineBean.java:186)
           at sun.reflect.GeneratedMethodAccessor930.invoke(Unknown Source)
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
           at java.lang.reflect.Method.invoke(Method.java:597)
           at com.bea.core.repackaged.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
           at com.bea.core.repackaged.springframework.jee.intercept.MethodInvocationInvocationContext.proceed(MethodInvocationInvocationContext.java:104)
           at oracle.security.jps.ee.ejb.JpsAbsInterceptor$1.run(JpsAbsInterceptor.java:88)
           at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:313)
           at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:414)
           at oracle.security.jps.wls.JpsWeblogicEjbInterceptor.runJaasMode(JpsWeblogicEjbInterceptor.java:61)
           at oracle.security.jps.ee.ejb.JpsAbsInterceptor.intercept(JpsAbsInterceptor.java:106)
           at oracle.security.jps.ee.ejb.JpsInterceptor.intercept(JpsInterceptor.java:106)
           at sun.reflect.GeneratedMethodAccessor833.invoke(Unknown Source)
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
           at java.lang.reflect.Method.invoke(Method.java:597)
           at com.bea.core.repackaged.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310)
           at com.bea.core.repackaged.springframework.jee.intercept.JeeInterceptorInterceptor.invoke(JeeInterceptorInterceptor.java:69)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
           at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.jee.spi.MethodInvocationVisitorImpl.visit(MethodInvocationVisitorImpl.java:37)
           at weblogic.ejb.container.injection.EnvironmentInterceptorCallbackImpl.callback(EnvironmentInterceptorCallbackImpl.java:54)
           at com.bea.core.repackaged.springframework.jee.spi.EnvironmentInterceptor.invoke(EnvironmentInterceptor.java:50)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:89)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
           at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
           at $Proxy282.syncCreateAndInvokeParticipate(Unknown Source)
           at com.collaxa.cube.engine.ejb.impl.bpel.BPELEngineBean_51369e_ICubeEngineLocalBeanImpl.syncCreateAndInvokeParticipate(BPELEngineBean_51369e_ICubeEngineLocalBeanImpl.java:328)
           at com.collaxa.cube.engine.delivery.DeliveryHandler.callCreateAndInvoke(DeliveryHandler.java:788)
           at com.collaxa.cube.engine.delivery.DeliveryHandler.initialRequestAnyType(DeliveryHandler.java:528)
           at com.collaxa.cube.engine.delivery.DeliveryHandler.initialRequest(DeliveryHandler.java:487)
           at com.collaxa.cube.engine.delivery.DeliveryHandler.request(DeliveryHandler.java:162)
           at com.collaxa.cube.engine.ejb.impl.CubeDeliveryBean.request(CubeDeliveryBean.java:607)
           at sun.reflect.GeneratedMethodAccessor933.invoke(Unknown Source)
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
           at java.lang.reflect.Method.invoke(Method.java:597)
           at com.bea.core.repackaged.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
           at com.bea.core.repackaged.springframework.jee.intercept.MethodInvocationInvocationContext.proceed(MethodInvocationInvocationContext.java:104)
           at oracle.security.jps.ee.ejb.JpsAbsInterceptor$1.run(JpsAbsInterceptor.java:88)
           at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:313)
           at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:414)
           at oracle.security.jps.wls.JpsWeblogicEjbInterceptor.runJaasMode(JpsWeblogicEjbInterceptor.java:61)
           at oracle.security.jps.ee.ejb.JpsAbsInterceptor.intercept(JpsAbsInterceptor.java:106)
           at oracle.security.jps.ee.ejb.JpsInterceptor.intercept(JpsInterceptor.java:106)
           at sun.reflect.GeneratedMethodAccessor833.invoke(Unknown Source)
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
           at java.lang.reflect.Method.invoke(Method.java:597)
           at com.bea.core.repackaged.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:310)
           at com.bea.core.repackaged.springframework.jee.intercept.JeeInterceptorInterceptor.invoke(JeeInterceptorInterceptor.java:69)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
           at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.jee.spi.MethodInvocationVisitorImpl.visit(MethodInvocationVisitorImpl.java:37)
           at weblogic.ejb.container.injection.EnvironmentInterceptorCallbackImpl.callback(EnvironmentInterceptorCallbackImpl.java:54)
           at com.bea.core.repackaged.springframework.jee.spi.EnvironmentInterceptor.invoke(EnvironmentInterceptor.java:50)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:89)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
           at com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119)
           at com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at com.bea.core.repackaged.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
           at $Proxy279.request(Unknown Source)
           at com.collaxa.cube.engine.ejb.impl.bpel.BPELDeliveryBean_5k948i_ICubeDeliveryLocalBeanImpl.request(BPELDeliveryBean_5k948i_ICubeDeliveryLocalBeanImpl.java:462)
           at oracle.fabric.CubeServiceEngine.request(CubeServiceEngine.java:358)
           at oracle.integration.platform.blocks.mesh.SynchronousMessageHandler.doRequest(SynchronousMessageHandler.java:139)
           at oracle.integration.platform.blocks.mesh.MessageRouter.request(MessageRouter.java:179)
           at oracle.integration.platform.blocks.mesh.MeshImpl.request(MeshImpl.java:155)
           at sun.reflect.GeneratedMethodAccessor925.invoke(Unknown Source)
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
           at java.lang.reflect.Method.invoke(Method.java:597)
           at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:307)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
           at oracle.integration.platform.metrics.PhaseEventAspect.invoke(PhaseEventAspect.java:71)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
           at $Proxy284.request(Unknown Source)
           at oracle.tip.mediator.serviceEngine.MediatorServiceEngine.request2Mesh(MediatorServiceEngine.java:1063)
           at oracle.tip.mediator.service.BaseActionHandler.requestProcess(BaseActionHandler.java:202)
           at oracle.tip.mediator.service.BaseActionHandler.requestProcess(BaseActionHandler.java:94)
           at oracle.tip.mediator.service.BaseActionHandler.requestProcess(BaseActionHandler.java:74)
           at oracle.tip.mediator.service.SyncRequestResponseHandler.process(SyncRequestResponseHandler.java:79)
           at oracle.tip.mediator.service.ActionProcessor.onMessage(ActionProcessor.java:64)
           at oracle.tip.mediator.dispatch.MessageDispatcher.executeCase(MessageDispatcher.java:140)
           at oracle.tip.mediator.dispatch.InitialMessageDispatcher.processCase(InitialMessageDispatcher.java:495)
           at oracle.tip.mediator.dispatch.InitialMessageDispatcher.processCases(InitialMessageDispatcher.java:393)
           at oracle.tip.mediator.dispatch.InitialMessageDispatcher.processNormalCases(InitialMessageDispatcher.java:276)
           at oracle.tip.mediator.dispatch.InitialMessageDispatcher.processCases(InitialMessageDispatcher.java:251)
           at oracle.tip.mediator.dispatch.InitialMessageDispatcher.dispatch(InitialMessageDispatcher.java:148)
           at oracle.tip.mediator.serviceEngine.MediatorServiceEngine.process(MediatorServiceEngine.java:860)
           at oracle.tip.mediator.serviceEngine.MediatorServiceEngine.request(MediatorServiceEngine.java:716)
           at oracle.integration.platform.blocks.mesh.SynchronousMessageHandler.doRequest(SynchronousMessageHandler.java:139)
           at oracle.integration.platform.blocks.mesh.MessageRouter.request(MessageRouter.java:179)
           at oracle.integration.platform.blocks.mesh.MeshImpl.request(MeshImpl.java:155)
           at sun.reflect.GeneratedMethodAccessor925.invoke(Unknown Source)
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
           at java.lang.reflect.Method.invoke(Method.java:597)
           at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:307)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
           at oracle.integration.platform.metrics.PhaseEventAspect.invoke(PhaseEventAspect.java:59)
           at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
           at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
           at $Proxy284.request(Unknown Source)
           at oracle.integration.platform.blocks.soap.WebServiceEntryBindingComponent.doMessageProcessing(WebServiceEntryBindingComponent.java:1169)
           at oracle.integration.platform.blocks.soap.WebServiceEntryBindingComponent.processIncomingMessage(WebServiceEntryBindingComponent.java:768)
           at oracle.integration.platform.blocks.soap.FabricProvider.processMessage(FabricProvider.java:113)
           at oracle.j2ee.ws.server.provider.ProviderProcessor.doEndpointProcessing(ProviderProcessor.java:1168)
           at oracle.j2ee.ws.server.WebServiceProcessor.invokeEndpointImplementation(WebServiceProcessor.java:996)
           at oracle.j2ee.ws.server.provider.ProviderProcessor.doRequestProcessing(ProviderProcessor.java:562)
           at oracle.j2ee.ws.server.WebServiceProcessor.processRequest(WebServiceProcessor.java:222)
           at oracle.j2ee.ws.server.WebServiceProcessor.doService(WebServiceProcessor.java:186)
           at oracle.j2ee.ws.server.WebServiceServlet.doPost(WebServiceServlet.java:430)
           at oracle.integration.platform.blocks.soap.FabricProviderServlet.doPost(FabricProviderServlet.java:477)
           at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
           at javax.servlet.http.HttpServlet.service(HttpServlet.java:821)
           at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
           at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
           at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:300)
           at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:27)
           at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:57)
           at oracle.dms.wls.DMSServletFilter.doFilter(DMSServletFilter.java:330)
           at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:57)
           at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.doIt(WebAppServletContext.java:3684)
           at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3650)
           at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
           at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
           at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2268)
           at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2174)
           at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1446)
           at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
           at weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
      .
      ". 
      The invoked JCA adapter raised a resource exception.
      Please examine the above error message carefully to determine a resolution.
      </summary>
      ,detail=<detail>Internal error: Cannot obtain XAConnection weblogic.common.resourcepool.ResourceDisabledException: Pool DEV__DB is Suspended, cannot allocate resources to applications..
           at weblogic.common.resourcepool.ResourcePoolImpl.reserveResourceInternal(ResourcePoolImpl.java:357)
           at weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:332)
           at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:440)
           at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:317)
           at weblogic.jdbc.common.internal.ConnectionPoolManager.reserve(ConnectionPoolManager.java:93)
           
      ....
      </detail>
      ,code=<code>0</code>}
       oracle.tip.mediator.infra.exception.MediatorException: ORAMED-03303:[Unexpected exception in case execution]Unexpected exception in request response operation "process" on reference "DEV_bpel_client". Possible Fix:Check whether the reference service is properly configured and running or look at exception for analysing the reason or contact oracle support.
           at oracle.tip.mediator.service.SyncRequestResponseHandler.handleFault(SyncRequestResponseHandler.java:215)
      ....
           at weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
      Caused by: oracle.fabric.common.FabricInvocationException: faultName: {{http://schemas.oracle.com/bpel/extension}remoteFault}
      I configured it using the Oracle User Guide For Technology Adapters, paragraph 2.21, but I still have the issue.



      Please can someone help me out?
        • 1. Re: SOA 11.1.1.3.0 - Connection Pool has been suspended during weak load
          e.gherardini
          Also, the strange thing is that if I monitor the Datasource (that has a 100 conn. capacity) I see that it is not overloaded:
          Server Sorted Ascending      Enabled      State      JDBC Driver      Active Connections Average Count      Active Connections Current Count      Active Connections High Count      Connection Delay Time      Connections Total Count      Curr Capacity High Count      Current Capacity      Failed Reserve Request Count      Failures To Reconnect Count      Highest Num Available      Leaked Connection Count      Num Available      Num Unavailable      Prep Stmt Cache Add Count      Prep Stmt Cache Current Size      Prep Stmt Cache Delete Count      Prep Stmt Cache Hit Count      Prep Stmt Cache Miss Count      PrepStmt Cache Access Count      Reserve Request Count      Wait Seconds High Count      Waiting For Connection Current Count      Waiting For Connection Failure Total      Waiting For Connection High Count      Waiting For Connection Success Total      Waiting For Connection Total 
          
          soa_server1     false     Suspended     oracle.jdbc.xa.client.OracleXADataSource     0     9     9     19049     36     10     9     81     0     10     0     0     9     18     18     0     0     18     18     380     0     0     0     0     35     0
          • 2. Re: SOA 11.1.1.3.0 - Connection Pool has been suspended during weak load
            Pierluigi Vernetto
            perhaps it would help enabling JDBC flags to try to track what is going wrong with the connections.... normally the pool is disabled when all connections to the DB are gone bad, so the pool driver assumes that the DB is in trouble.

            Also, monitor current JDBC transactions and do a thread dump....

            which version of DB are you using? Just to rule out incompatibilities between the driver and the DB...
            • 3. Re: SOA 11.1.1.3.0 - Connection Pool has been suspended during weak load
              e.gherardini
              hi, i thanks for answering, i solved increasing the db processes and sessions.. the datasource got suspended because requested more connections than the available ones from the db.
              • 4. Re: SOA 11.1.1.3.0 - Connection Pool has been suspended during weak load
                883982
                Hi,

                How to know the available connections from the db? IS that a setting that I can check in the DB? Also can you tell me how to increase the DB processes and sessions?

                Regards,
                Surya.