2 Replies Latest reply: May 30, 2013 3:24 AM by Grjozs RSS

    OAS 10g lost connection to database

    Grjozs
      We have two servers what running Oracle Appliaction Server 10g and one server what running WebCache.

      Servers with applications work fine but two times in 24 hours get critical error that users can't get access to application. Look OC4J log files - there is error about unable to get physical connection to DB. Check DB - its work fine.
      Help only full OAS restart. Some times it helps only on one server some times need to reload bought.

      ERROR log

      13/05/16 11:03:58 java.sql.SQLException: Unable to get a physical connection from the database...there are no connections available.
      13/05/16 11:03:58      at oracle.oc4j.sql.spi.ManagedConnectionImpl$GenericConnectionUseStrategy.initForUse(ManagedConnectionImpl.java:1188)
      13/05/16 11:03:58      at oracle.oc4j.sql.spi.ManagedConnectionImpl$OracleConnectionUseStrategy.initForUse(ManagedConnectionImpl.java:1233)
      13/05/16 11:03:58      at oracle.oc4j.sql.spi.ManagedConnectionImpl.initForUse(ManagedConnectionImpl.java:156)
      13/05/16 11:03:58      at oracle.oc4j.sql.spi.ManagedConnectionImpl.<init>(ManagedConnectionImpl.java:106)
      13/05/16 11:03:58      at oracle.oc4j.sql.spi.ManagedConnectionFactoryImpl.createManagedConnection(ManagedConnectionFactoryImpl.java:171)
      13/05/16 11:03:58      at com.evermind.server.connector.ApplicationConnectionManager.createManagedConnection(ApplicationConnectionManager.java:1461)
      13/05/16 11:03:58      at oracle.j2ee.connector.ConnectionPoolImpl.createManagedConnectionFromFactory(ConnectionPoolImpl.java:329)
      13/05/16 11:03:58      at oracle.j2ee.connector.ConnectionPoolImpl.access$900(ConnectionPoolImpl.java:100)
      13/05/16 11:03:58      at oracle.j2ee.connector.ConnectionPoolImpl$NonePoolingScheme.getManagedConnection(ConnectionPoolImpl.java:1233)
      13/05/16 11:03:58      at oracle.j2ee.connector.ConnectionPoolImpl.getManagedConnection(ConnectionPoolImpl.java:792)
      13/05/16 11:03:58      at oracle.oc4j.sql.ConnectionPoolImpl.getManagedConnection(ConnectionPoolImpl.java:45)
      13/05/16 11:03:58      at com.evermind.server.connector.ApplicationConnectionManager.getConnectionFromPool(ApplicationConnectionManager.java:1700)
      13/05/16 11:03:58      at com.evermind.server.connector.ApplicationConnectionManager.acquireConnectionContext(ApplicationConnectionManager.java:1640)
      13/05/16 11:03:58      at com.evermind.server.connector.ApplicationConnectionManager.allocateConnection(ApplicationConnectionManager.java:1580)
      13/05/16 11:03:58      at oracle.j2ee.connector.OracleConnectionManager.unprivileged_allocateConnection(OracleConnectionManager.java:265)
      13/05/16 11:03:58      at oracle.j2ee.connector.OracleConnectionManager.allocateConnection(OracleConnectionManager.java:214)
      13/05/16 11:03:58      at oracle.oc4j.sql.ManagedDataSource.getConnection(ManagedDataSource.java:272)
      13/05/16 11:03:58      at oracle.oc4j.sql.ManagedDataSource.getConnection(ManagedDataSource.java:200)
      13/05/16 11:03:58      at oracle.oc4j.sql.ManagedDataSource.getConnection(ManagedDataSource.java:142)
      13/05/16 11:03:58      at oracle.oc4j.sql.ManagedDataSource.getConnection(ManagedDataSource.java:127)
      13/05/16 11:03:58      at lv.dati.eks.helpers.PersistenceHelper.getConnection(PersistenceHelper.java:62)
      13/05/16 11:03:58      at lv.dati.eks.logging.LogImpl.writeLog(LogImpl.java:371)
      13/05/16 11:03:58      at lv.dati.eks.logging.LogManagerBean.log(LogManagerBean.java:29)
      13/05/16 11:03:58      at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
      13/05/16 11:03:58      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      13/05/16 11:03:58      at java.lang.reflect.Method.invoke(Method.java:585)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.joinpoint.EJBJoinPointImpl.invoke(EJBJoinPointImpl.java:35)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.SetContextActionInterceptor.invoke(SetContextActionInterceptor.java:44)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.DMSInterceptor.invoke(DMSInterceptor.java:52)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.TxNotSupportedInterceptor.invoke(TxNotSupportedInterceptor.java:43)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.DMSInterceptor.invoke(DMSInterceptor.java:52)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.InvocationContextPool.invoke(InvocationContextPool.java:55)
      13/05/16 11:03:58      at com.evermind.server.ejb.StatelessSessionEJBObject.OC4J_invokeMethod(StatelessSessionEJBObject.java:87)
      13/05/16 11:03:58      at LogManager_LocalProxy_3ldln8.log(Unknown Source)
      13/05/16 11:03:58      at lv.dati.eks.logging.LogImpl.ejbLog(LogImpl.java:173)
      13/05/16 11:03:58      at lv.dati.eks.logging.LogImpl.log(LogImpl.java:158)
      13/05/16 11:03:58      at lv.dati.eks.logging.LogImpl.error(LogImpl.java:309)
      13/05/16 11:03:58      at lv.dati.eks.services.external.MessageManagerBean.getEAAD(MessageManagerBean.java:338)
      13/05/16 11:03:58      at sun.reflect.GeneratedMethodAccessor836.invoke(Unknown Source)
      13/05/16 11:03:58      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      13/05/16 11:03:58      at java.lang.reflect.Method.invoke(Method.java:585)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.joinpoint.EJBJoinPointImpl.invoke(EJBJoinPointImpl.java:35)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.SetContextActionInterceptor.invoke(SetContextActionInterceptor.java:44)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.DMSInterceptor.invoke(DMSInterceptor.java:52)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.TxRequiredInterceptor.invoke(TxRequiredInterceptor.java:50)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.DMSInterceptor.invoke(DMSInterceptor.java:52)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.InvocationContextPool.invoke(InvocationContextPool.java:55)
      13/05/16 11:03:58      at com.evermind.server.ejb.StatelessSessionEJBObject.OC4J_invokeMethod(StatelessSessionEJBObject.java:87)
      13/05/16 11:03:58      at MessageManager_RemoteProxy_3ldln8.getEAAD(Unknown Source)
      13/05/16 11:03:58      at sun.reflect.GeneratedMethodAccessor835.invoke(Unknown Source)
      13/05/16 11:03:58      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      13/05/16 11:03:58      at java.lang.reflect.Method.invoke(Method.java:585)
      13/05/16 11:03:58      at com.evermind.server.rmi.RmiMethodCall.run(RmiMethodCall.java:67)
      13/05/16 11:03:58      at com.evermind.util.ReleasableResourcePooledExecutor$MyWorker.run(ReleasableResourcePooledExecutor.java:303)
      13/05/16 11:03:58      at java.lang.Thread.run(Thread.java:595)
      13/05/16 11:03:58 Class: WSManagerCmisBean | Message: Unable to get a physical connection from the database...there are no connections available. |
      13/05/16 11:03:58
      13/05/16 11:03:58 java.sql.SQLException: Unable to get a physical connection from the database...there are no connections available.
      13/05/16 11:03:58      at oracle.oc4j.sql.spi.ManagedConnectionImpl$GenericConnectionUseStrategy.initForUse(ManagedConnectionImpl.java:1188)
      13/05/16 11:03:58      at oracle.oc4j.sql.spi.ManagedConnectionImpl$OracleConnectionUseStrategy.initForUse(ManagedConnectionImpl.java:1233)
      13/05/16 11:03:58      at oracle.oc4j.sql.spi.ManagedConnectionImpl.initForUse(ManagedConnectionImpl.java:156)
      13/05/16 11:03:58      at oracle.oc4j.sql.spi.ManagedConnectionImpl.<init>(ManagedConnectionImpl.java:106)
      13/05/16 11:03:58      at oracle.oc4j.sql.spi.ManagedConnectionFactoryImpl.createManagedConnection(ManagedConnectionFactoryImpl.java:171)
      13/05/16 11:03:58      at com.evermind.server.connector.ApplicationConnectionManager.createManagedConnection(ApplicationConnectionManager.java:1461)
      13/05/16 11:03:58      at oracle.j2ee.connector.ConnectionPoolImpl.createManagedConnectionFromFactory(ConnectionPoolImpl.java:329)
      13/05/16 11:03:58      at oracle.j2ee.connector.ConnectionPoolImpl.access$900(ConnectionPoolImpl.java:100)
      13/05/16 11:03:58      at oracle.j2ee.connector.ConnectionPoolImpl$NonePoolingScheme.getManagedConnection(ConnectionPoolImpl.java:1233)
      13/05/16 11:03:58      at oracle.j2ee.connector.ConnectionPoolImpl.getManagedConnection(ConnectionPoolImpl.java:792)
      13/05/16 11:03:58      at oracle.oc4j.sql.ConnectionPoolImpl.getManagedConnection(ConnectionPoolImpl.java:45)
      13/05/16 11:03:58      at com.evermind.server.connector.ApplicationConnectionManager.getConnectionFromPool(ApplicationConnectionManager.java:1700)
      13/05/16 11:03:58      at com.evermind.server.connector.ApplicationConnectionManager.acquireConnectionContext(ApplicationConnectionManager.java:1640)
      13/05/16 11:03:58      at com.evermind.server.connector.ApplicationConnectionManager.allocateConnection(ApplicationConnectionManager.java:1580)
      13/05/16 11:03:58      at oracle.j2ee.connector.OracleConnectionManager.unprivileged_allocateConnection(OracleConnectionManager.java:265)
      13/05/16 11:03:58      at oracle.j2ee.connector.OracleConnectionManager.allocateConnection(OracleConnectionManager.java:214)
      13/05/16 11:03:58      at oracle.oc4j.sql.ManagedDataSource.getConnection(ManagedDataSource.java:272)
      13/05/16 11:03:58      at oracle.oc4j.sql.ManagedDataSource.getConnection(ManagedDataSource.java:200)
      13/05/16 11:03:58      at oracle.oc4j.sql.ManagedDataSource.getConnection(ManagedDataSource.java:142)
      13/05/16 11:03:58      at oracle.oc4j.sql.ManagedDataSource.getConnection(ManagedDataSource.java:127)
      13/05/16 11:03:58      at lv.dati.eks.helpers.PersistenceHelper.getConnection(PersistenceHelper.java:62)
      13/05/16 11:03:58      at lv.dati.eks.logging.LogImpl.writeLog(LogImpl.java:371)
      13/05/16 11:03:58      at lv.dati.eks.logging.LogManagerBean.log(LogManagerBean.java:29)
      13/05/16 11:03:58      at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
      13/05/16 11:03:58      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      13/05/16 11:03:58      at java.lang.reflect.Method.invoke(Method.java:585)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.joinpoint.EJBJoinPointImpl.invoke(EJBJoinPointImpl.java:35)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.SetContextActionInterceptor.invoke(SetContextActionInterceptor.java:44)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.DMSInterceptor.invoke(DMSInterceptor.java:52)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.TxNotSupportedInterceptor.invoke(TxNotSupportedInterceptor.java:43)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.DMSInterceptor.invoke(DMSInterceptor.java:52)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.InvocationContextPool.invoke(InvocationContextPool.java:55)
      13/05/16 11:03:58      at com.evermind.server.ejb.StatelessSessionEJBObject.OC4J_invokeMethod(StatelessSessionEJBObject.java:87)
      13/05/16 11:03:58      at LogManager_LocalProxy_3ldln8.log(Unknown Source)
      13/05/16 11:03:58      at lv.dati.eks.logging.LogImpl.ejbLog(LogImpl.java:173)
      13/05/16 11:03:58      at lv.dati.eks.logging.LogImpl.log(LogImpl.java:158)
      13/05/16 11:03:58      at lv.dati.eks.logging.LogImpl.error(LogImpl.java:309)
      13/05/16 11:03:58      at lv.dati.eks.services.ws.WSManagerCmisBean.logCmiswsEx(WSManagerCmisBean.java:666)
      13/05/16 11:03:58      at lv.dati.eks.services.ws.WSManagerCmisBean.submitRequest(WSManagerCmisBean.java:266)
      13/05/16 11:03:58      at sun.reflect.GeneratedMethodAccessor419.invoke(Unknown Source)
      13/05/16 11:03:58      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      13/05/16 11:03:58      at java.lang.reflect.Method.invoke(Method.java:585)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.joinpoint.EJBJoinPointImpl.invoke(EJBJoinPointImpl.java:35)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.SetContextActionInterceptor.invoke(SetContextActionInterceptor.java:44)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.DMSInterceptor.invoke(DMSInterceptor.java:52)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.TxNotSupportedInterceptor.invoke(TxNotSupportedInterceptor.java:43)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.system.DMSInterceptor.invoke(DMSInterceptor.java:52)
      13/05/16 11:03:58      at com.evermind.server.ejb.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:119)
      13/05/16 11:03:58      at com.evermind.server.ejb.InvocationContextPool.invoke(InvocationContextPool.java:55)
      13/05/16 11:03:58      at com.evermind.server.ejb.StatelessSessionEJBObject.OC4J_invokeMethod(StatelessSessionEJBObject.java:87)
      13/05/16 11:03:58      at WSManagerCmis_RemoteProxy_3ldln8.submitRequest(Unknown Source)
      13/05/16 11:03:58      at sun.reflect.GeneratedMethodAccessor418.invoke(Unknown Source)
      13/05/16 11:03:58      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      13/05/16 11:03:58      at java.lang.reflect.Method.invoke(Method.java:585)
      13/05/16 11:03:58      at com.evermind.server.rmi.RmiMethodCall.run(RmiMethodCall.java:67)
      13/05/16 11:03:58      at com.evermind.util.ReleasableResourcePooledExecutor$MyWorker.run(ReleasableResourcePooledExecutor.java:303)
      13/05/16 11:03:58      at java.lang.Thread.run(Thread.java:595)
      13/05/16 11:04:01 Class: CommonHelper | Message: ArrNotificationQueryParameters[mrn:13DE885776134252E2,lrn:null,clEntityKey:{IEPAZ},clStatusKey:{DVI},statusExit:{}] |