2 Replies Latest reply: Feb 7, 2013 12:40 AM by Anand Krishnan RSS

    Connection reset error while starting the weblogic service...

    Anand Krishnan
      Hi,

      We have installed the weblogic 10.3.5.0 version in RHEL 5.6 OS and Oracle database 11g with AIX OS. While restarting the weblogic service some of the managed servers cannot establish the datasource connection pool and shows the exception as follows. Please help me to find the root cause and resolving the issue.

      java.sql.SQLRecoverableException: IO Error: Connection reset
      at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:459)
      at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:670)
      at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:230)
      at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:34)
      at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:567)
      at weblogic.jdbc.common.internal.ConnectionEnvFactory.makeConnection(ConnectionEnvFactory.java:350)
      at weblogic.jdbc.common.internal.ConnectionEnvFactory.createResource(ConnectionEnvFactory.java:236)
      at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1249)
      at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1166)
      at weblogic.common.resourcepool.ResourcePoolImpl.start(ResourcePoolImpl.java:249)
      at weblogic.jdbc.common.internal.ConnectionPool.doStart(ConnectionPool.java:1154)
      at weblogic.jdbc.common.internal.ConnectionPool.start(ConnectionPool.java:154)
      at weblogic.jdbc.common.internal.ConnectionPoolManager.createAndStartPool(ConnectionPoolManager.java:454)
      at weblogic.jdbc.common.internal.ConnectionPoolManager.createAndStartPool(ConnectionPoolManager.java:372)
      at weblogic.jdbc.module.JDBCModule.prepare(JDBCModule.java:255)
      at weblogic.application.internal.flow.ModuleListenerInvoker.prepare(ModuleListenerInvoker.java:199)
      at weblogic.application.internal.flow.DeploymentCallbackFlow$1.next(DeploymentCallbackFlow.java:517)
      at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
      at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:159)
      at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:45)
      at weblogic.application.internal.BaseDeployment$1.next(BaseDeployment.java:613)
      at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
      at weblogic.application.internal.BaseDeployment.prepare(BaseDeployment.java:184)
      at weblogic.application.internal.SingleModuleDeployment.prepare(SingleModuleDeployment.java:43)
      at weblogic.application.internal.DeploymentStateChecker.prepare(DeploymentStateChecker.java:154)
      at weblogic.deploy.internal.targetserver.AppContainerInvoker.prepare(AppContainerInvoker.java:60)
      at weblogic.deploy.internal.targetserver.SystemResourceDeployment.prepare(SystemResourceDeployment.java:55)
      at weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdapter.java:39)
      at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:191)
      at weblogic.management.deploy.internal.AppTransition$1.transitionApp(AppTransition.java:21)
      at weblogic.management.deploy.internal.ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:240)
      at weblogic.management.deploy.internal.ConfiguredDeployments.prepare(ConfiguredDeployments.java:165)
      at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:122)
      at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:180)
      at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:96)
      at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
      at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
      at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
      Caused By: java.net.SocketException: Connection reset
      at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:96)
      at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
      at oracle.net.ns.DataPacket.send(DataPacket.java:202)
      at oracle.net.ns.NetOutputStream.flush(NetOutputStream.java:232)
      at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:314)
      at oracle.net.ns.NetInputStream.read(NetInputStream.java:262)
      at oracle.net.ns.NetInputStream.read(NetInputStream.java:187)
      at oracle.net.ns.NetInputStream.read(NetInputStream.java:104)
      at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:126)
      at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:82)
      at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1177)
      at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1153)
      at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:312)
      at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:204)
      at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.java:370)
      at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.java:817)
      at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:376)
      at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:670)
      at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:230)
      at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:34)
      at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:567)
      at weblogic.jdbc.common.internal.ConnectionEnvFactory.makeConnection(ConnectionEnvFactory.java:350)
      at weblogic.jdbc.common.internal.ConnectionEnvFactory.createResource(ConnectionEnvFactory.java:236)
      at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1249)
      at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1166)
      at weblogic.common.resourcepool.ResourcePoolImpl.start(ResourcePoolImpl.java:249)
      at weblogic.jdbc.common.internal.ConnectionPool.doStart(ConnectionPool.java:1154)
      at weblogic.jdbc.common.internal.ConnectionPool.start(ConnectionPool.java:154)
      at weblogic.jdbc.common.internal.ConnectionPoolManager.createAndStartPool(ConnectionPoolManager.java:454)
      at weblogic.jdbc.common.internal.ConnectionPoolManager.createAndStartPool(ConnectionPoolManager.java:372)
      at weblogic.jdbc.module.JDBCModule.prepare(JDBCModule.java:255)
      at weblogic.application.internal.flow.ModuleListenerInvoker.prepare(ModuleListenerInvoker.java:199)
      at weblogic.application.internal.flow.DeploymentCallbackFlow$1.next(DeploymentCallbackFlow.java:517)
      at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
      at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:159)
      at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:45)
      at weblogic.application.internal.BaseDeployment$1.next(BaseDeployment.java:613)
      at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
      at weblogic.application.internal.BaseDeployment.prepare(BaseDeployment.java:184)
      at weblogic.application.internal.SingleModuleDeployment.prepare(SingleModuleDeployment.java:43)
      at weblogic.application.internal.DeploymentStateChecker.prepare(DeploymentStateChecker.java:154)
      at weblogic.deploy.internal.targetserver.AppContainerInvoker.prepare(AppContainerInvoker.java:60)
      at weblogic.deploy.internal.targetserver.SystemResourceDeployment.prepare(SystemResourceDeployment.java:55)
      at weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdapter.java:39)
      at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:191)
      at weblogic.management.deploy.internal.AppTransition$1.transitionApp(AppTransition.java:21)
      at weblogic.management.deploy.internal.ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:240)
      at weblogic.management.deploy.internal.ConfiguredDeployments.prepare(ConfiguredDeployments.java:165)
      at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:122)
      at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:180)
      at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:96)
      at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
      at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
      at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)


      ####<Feb 5, 2013 1:41:53 AM IST> <Info> <JDBC> <chnlxnet09> <psMS2> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <e843b504d952350a:33f9c721:13ca6d32f64:-7ffd-0000000000000002> <1360008713980> <BEA-001508> <Destroying Connection Pool psms2DS.>
      ####<Feb 5, 2013 1:41:53 AM IST> <Info> <JDBC> <chnlxnet09> <psMS2> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <e843b504d952350a:33f9c721:13ca6d32f64:-7ffd-0000000000000002> <1360008713981> <BEA-001155> <The following exception has occurred:
      weblogic.common.ResourceException: Unknown Data Source psms2DS
      at weblogic.jdbc.common.internal.ConnectionPoolManager.shutdownConnectionPool(ConnectionPoolManager.java:563)
      at weblogic.jdbc.common.internal.ConnectionPoolManager.shutdownAndDestroyPool(ConnectionPoolManager.java:535)
      at weblogic.jdbc.module.JDBCModule.prepare(JDBCModule.java:295)
      at weblogic.application.internal.flow.ModuleListenerInvoker.prepare(ModuleListenerInvoker.java:199)
      at weblogic.application.internal.flow.DeploymentCallbackFlow$1.next(DeploymentCallbackFlow.java:518)
      at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
      at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:159)
      at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:47)
      at weblogic.application.internal.BaseDeployment$1.next(BaseDeployment.java:614)
      at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
      at weblogic.application.internal.BaseDeployment.prepare(BaseDeployment.java:184)
      at weblogic.application.internal.SingleModuleDeployment.prepare(SingleModuleDeployment.java:43)
      at weblogic.application.internal.DeploymentStateChecker.prepare(DeploymentStateChecker.java:154)
      at weblogic.deploy.internal.targetserver.AppContainerInvoker.prepare(AppContainerInvoker.java:60)
      at weblogic.deploy.internal.targetserver.SystemResourceDeployment.prepare(SystemResourceDeployment.java:55)
      at weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdapter.java:40)
      at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:191)
      at weblogic.management.deploy.internal.AppTransition$1.transitionApp(AppTransition.java:22)
      at weblogic.management.deploy.internal.ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:240)
      at weblogic.management.deploy.internal.ConfiguredDeployments.prepare(ConfiguredDeployments.java:166)
      at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:122)
      at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:181)
      at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:97)
      at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
      at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
      at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)

      ####<Feb 5, 2013 1:41:54 AM IST> <Error> <Deployer> <chnlxnet09> <psMS2> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <e843b504d952350a:33f9c721:13ca6d32f64:-7ffd-0000000000000002> <1360008714016> <BEA-149205> <Failed to initialize the application 'psms2DS' due to error weblogic.application.ModuleException: .
      weblogic.application.ModuleException:
      at weblogic.jdbc.module.JDBCModule.prepare(JDBCModule.java:302)
      at weblogic.application.internal.flow.ModuleListenerInvoker.prepare(ModuleListenerInvoker.java:199)
      at weblogic.application.internal.flow.DeploymentCallbackFlow$1.next(DeploymentCallbackFlow.java:518)
      at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
      at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:159)
      at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:47)
      at weblogic.application.internal.BaseDeployment$1.next(BaseDeployment.java:614)
      at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
      at weblogic.application.internal.BaseDeployment.prepare(BaseDeployment.java:184)
      at weblogic.application.internal.SingleModuleDeployment.prepare(SingleModuleDeployment.java:43)
      at weblogic.application.internal.DeploymentStateChecker.prepare(DeploymentStateChecker.java:154)
      at weblogic.deploy.internal.targetserver.AppContainerInvoker.prepare(AppContainerInvoker.java:60)
      at weblogic.deploy.internal.targetserver.SystemResourceDeployment.prepare(SystemResourceDeployment.java:55)
      at weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdapter.java:40)
      at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:191)
      at weblogic.management.deploy.internal.AppTransition$1.transitionApp(AppTransition.java:22)
      at weblogic.management.deploy.internal.ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:240)
      at weblogic.management.deploy.internal.ConfiguredDeployments.prepare(ConfiguredDeployments.java:166)
      at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:122)
      at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:181)
      at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:97)
      at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
      at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
      at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
      Caused By: weblogic.common.ResourceException: weblogic.common.ResourceException: Could not create pool connection. The DBMS driver exception was: IO Error: Connection reset
      at weblogic.jdbc.common.internal.ConnectionEnvFactory.createResource(ConnectionEnvFactory.java:276)
      at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1249)
      at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1166)
      at weblogic.common.resourcepool.ResourcePoolImpl.start(ResourcePoolImpl.java:249)
      at weblogic.jdbc.common.internal.ConnectionPool.doStart(ConnectionPool.java:1155)
      at weblogic.jdbc.common.internal.ConnectionPool.start(ConnectionPool.java:154)
      at weblogic.jdbc.common.internal.ConnectionPoolManager.createAndStartPool(ConnectionPoolManager.java:455)
      at weblogic.jdbc.common.internal.ConnectionPoolManager.createAndStartPool(ConnectionPoolManager.java:372)
      at weblogic.jdbc.module.JDBCModule.prepare(JDBCModule.java:255)
      at weblogic.application.internal.flow.ModuleListenerInvoker.prepare(ModuleListenerInvoker.java:199)
      at weblogic.application.internal.flow.DeploymentCallbackFlow$1.next(DeploymentCallbackFlow.java:518)
      at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
      at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:159)
      at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:47)
      at weblogic.application.internal.BaseDeployment$1.next(BaseDeployment.java:614)
      at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
      at weblogic.application.internal.BaseDeployment.prepare(BaseDeployment.java:184)
      at weblogic.application.internal.SingleModuleDeployment.prepare(SingleModuleDeployment.java:43)
      at weblogic.application.internal.DeploymentStateChecker.prepare(DeploymentStateChecker.java:154)
      at weblogic.deploy.internal.targetserver.AppContainerInvoker.prepare(AppContainerInvoker.java:60)
      at weblogic.deploy.internal.targetserver.SystemResourceDeployment.prepare(SystemResourceDeployment.java:55)
      at weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdapter.java:40)
      at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:191)
      at weblogic.management.deploy.internal.AppTransition$1.transitionApp(AppTransition.java:22)
      at weblogic.management.deploy.internal.ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:240)
      at weblogic.management.deploy.internal.ConfiguredDeployments.prepare(ConfiguredDeployments.java:166)
      at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:122)
      at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:181)
      at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:97)
      at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
      at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
      at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)

      Thanks and Regards,
      Anand.

      Edited by: user12279434 on Feb 5, 2013 9:28 PM
        • 1. Re: Connection reset error while starting the weblogic service...
          Joe Weinstein-Oracle
          You say 'some'. Does that mean that some others of the servers do make connections successfully, and that
          they are configured identically to talk to the same DBMS? The first thing I suggest is to set the pool initial
          capacity to zero. Then everything will boot and deploy, whether the DBMS is even running. Then see what
          happens if you test the datasource from the console. It will try to make a connection at that time. The issue
          just might be the DBMS being unable to handle the volume of connection requests when multple WebLogic
          engines all boot and want to fill their iniitial quotas...
          • 2. Re: Connection reset error while starting the weblogic service...
            Anand Krishnan
            Hi,

            Thanks for your reply.
            Also i would like provide you more data regarding the said issue. We are having 11 managed servers and assinged the seperate datasource for each managed server(i,e 11 datasource created).

            Parameters given for each datasource as follows:

            Initial capacity : 1

            Maximum Capacity : 1500

            Please help me to find out the issue.

            Actually we are facing the said issue after the RHEL 4.8 to RHEL 5.6 os migration.

            Regards,
            Anand

            Edited by: user12279434 on Feb 6, 2013 10:19 PM

            Edited by: user12279434 on Feb 6, 2013 10:40 PM