1 Reply Latest reply: Feb 15, 2008 6:32 AM by rahul_akkina RSS

    Problem with HADB on one the instances built SUNWappserver7 one solaris

    rahul_akkina
      Hi,

      I'm kind of newbie to this environment.I was handling setting up an Sun Java Application Server 7 instances for few critical application we normally hosts.

      let me give a overview of the senario.

      We have two Solaris SPARC 9.0 Server Instances created on to which we have installed SUN Java Application 7.0.We have created a domain and created HADB database instance on both the server and listed them on the same domain.

      Onto this we have created Server instance W X Y Z on both app servers.

      My problem is bit specific and a kind of Byzentine problem.

      On Appserver1 & AppServer2 all the things were properly setup.
      and all the instances were working fine intially.

      However,we recently had a unmount & remount of hard drives due to which.
      Z instance on appserver2 was having misc trouble.(However,Z instance on appserver1 and all other instances on appserver1 & appserver2 are working fine).

      Problem Description: We are unable to succesfully start Z server instance on appserver2 and this was due to HADB issue.
      To be more clear W,X,Y server instances are using the similar datasource HADB Connection Pool (With same configuration settings and they are working).However it is not with this instance.

      please check the server logs of problem creating instance.
      [30/Jan/2008:13:27:46] INFO ( 1341): CORE1116: Sun Java System Application Serve
      r 7 2004Q2UR4
      [30/Jan/2008:13:27:47] INFO ( 1342): CORE5076: Using [Java HotSpot(TM) Server VM
      , Version 1.4.2_12] from [Sun Microsystems Inc.]
      [30/Jan/2008:13:27:58] INFO ( 1342): JMS5023: JMS service successfully started.
      Instance Name = domain1_Z, Home = [/usr/bin].
      [30/Jan/2008:13:28:00] INFO ( 1342): JTS5014: Recoverable JTS instance, serverId
       = [100]
      [30/Jan/2008:13:28:00] INFO ( 1342): RAR5060: Install JDBC Datasources ...
      [30/Jan/2008:13:28:00] INFO ( 1342): RAR5059: Binding [JDBC DataSource Name: jdb
      c/hadbDatasource , Pool Name: HadbPool ]
      [30/Jan/2008:13:28:00] INFO ( 1342): RAR5059: Binding [JDBC DataSource Name: jdb
      c/ApplicationDB, Pool Name: ApplicationDBPool]
      [30/Jan/2008:13:28:01] INFO ( 1342): JMS5015: Install JMS resources ...
      [30/Jan/2008:13:28:03] INFO ( 1342): WEB0100: Loading web module [xyz]
       in virtual server [Z] at [/xyz]
      [30/Jan/2008:13:28:03] INFO ( 1342): WEB0120: Enabling ha-based persistence for
      web module [/xyz]'s sessions: persistence-type = [ha] / persistenceFre
      quency = [web-method] / persistenceScope = [session]
      [30/Jan/2008:13:28:03] INFO ( 1342): WEB0100: Loading web module [xyz1]
       in virtual server [ge_server02_ireland] at [/xyz1]
      [30/Jan/2008:13:28:03] INFO ( 1342): WEB0120: Enabling ha-based persistence for
      web module [/xyz2]'s sessions: persistence-type = [ha] / persistenceFre
      quency = [web-method] / persistenceScope = [session]
      [30/Jan/2008:13:28:08] INFO ( 1342): [/xyz] ServletContext.log():defau
      lt: init
      [30/Jan/2008:13:28:08] INFO ( 1342): [/xyz1] ServletContext.log():XFact
      orControllerServlet: init
      [30/Jan/2008:13:28:08] INFO ( 1342): [/xyz1] ServletContext.log():invok
      er: init
      [30/Jan/2008:13:28:08] INFO ( 1342): [/xyz1] ServletContext.log():jsp:
      init
      [30/Jan/2008:13:28:12] INFO ( 1342): [/xyz2] ServletContext.log():defau
      lt: init
      [30/Jan/2008:13:28:12] INFO ( 1342): [/xyz2] ServletContext.log():XFact
      orControllerServlet: init
      [30/Jan/2008:13:28:12] INFO ( 1342): [/xyz2] ServletContext.log():invok
      er: init
      [30/Jan/2008:13:28:12] INFO ( 1342): [/xyz2] ServletContext.log():jsp:
      init
      [30/Jan/2008:13:28:13] INFO ( 1342): [] ServletContext.log():default: init
      [30/Jan/2008:13:28:13] INFO ( 1342): [] ServletContext.log():invoker: init
      [30/Jan/2008:13:28:13] INFO ( 1342): [] ServletContext.log():jsp: init
      [30/Jan/2008:13:28:13] INFO ( 1342): HTTP3072: HTTP listener http-listener-1 [ht
      tp://appserver2:5470] ready to accept requests
      [30/Jan/2008:13:28:13] INFO ( 1342): CORE3274: successful server startup
      [30/Jan/2008:13:28:13] INFO ( 1342): CORE5053: Application onReady complete.
      [30/Jan/2008:13:29:04] WARNING ( 1342): CORE3283: stderr: java.lang.NullPointerE
      xception
      [30/Jan/2008:13:29:04] WARNING ( 1342): CORE3283: stderr:       at java.util.Has
      htable.put(Hashtable.java:393)
      [30/Jan/2008:13:29:04] WARNING ( 1342): CORE3283: stderr:       at java.util.Pro
      perties.setProperty(Properties.java:102)
      [30/Jan/2008:13:29:04] WARNING ( 1342): CORE3283: stderr:       at com.sun.appse
      rv.ee.web.sessmgmt.ConnectionUtil.getConnection(ConnectionUtil.java:392)
      [30/Jan/2008:13:29:04] WARNING ( 1342): CORE3283: stderr:       at com.sun.appse
      rv.ee.web.sessmgmt.HAStore.getConnection(HAStore.java:2701)
      [30/Jan/2008:13:29:04] WARNING ( 1342): CORE3283: stderr:       at com.sun.appse
      rv.ee.web.sessmgmt.HAStore.getConnectionValidated(HAStore.java:2456)
      [30/Jan/2008:13:29:04] WARNING ( 1342): CORE3283: stderr:       at com.sun.appse
      rv.ee.web.sessmgmt.HAManagerBase.insureValidConnection(HAManagerBase.java:34)
      [30/Jan/2008:13:29:04] WARNING ( 1342): CORE3283: stderr:       at com.sun.appse
      rv.ee.web.sessmgmt.HAManagerBase.processExpires(HAManagerBase.java:43)
      [30/Jan/2008:13:29:04] WARNING ( 1342): CORE3283: stderr:       at org.apache.ca
      talina.session.PersistentManagerBase.run(PersistentManagerBase.java:1244)
      [30/Jan/2008:13:29:04] WARNING ( 1342): CORE3283: stderr:       at java.lang.Thr
      ead.run(Thread.java:534)
      [30/Jan/2008:13:29:09] WARNING ( 1342): CORE3283: stderr: java.lang.NullPointerE
      xception
      [30/Jan/2008:13:29:09] WARNING ( 1342): CORE3283: stderr:       at java.util.Has
      htable.put(Hashtable.java:393)
      [30/Jan/2008:13:29:09] WARNING ( 1342): CORE3283: stderr:       at java.util.Pro
      perties.setProperty(Properties.java:102)
      [30/Jan/2008:13:29:09] WARNING ( 1342): CORE3283: stderr:       at com.sun.appse
      rv.ee.web.sessmgmt.ConnectionUtil.getConnection(ConnectionUtil.java:392)
      [30/Jan/2008:13:29:09] WARNING ( 1342): CORE3283: stderr:       at com.sun.appse
      rv.ee.web.sessmgmt.HAStore.getConnection(HAStore.java:2701)
      [30/Jan/2008:13:29:09] WARNING ( 1342): CORE3283: stderr:       at com.sun.appse
      rv.ee.web.sessmgmt.HAStore.getConnectionValidated(HAStore.java:2456)
      [30/Jan/2008:13:29:09] WARNING ( 1342): CORE3283: stderr:       at com.sun.appse
      rv.ee.web.sessmgmt.HAManagerBase.insureValidConnection(HAManagerBase.java:34)
      [30/Jan/2008:13:29:09] WARNING ( 1342): CORE3283: stderr:       at com.sun.appse
      rv.ee.web.sessmgmt.HAManagerBase.processExpires(HAManagerBase.java:43)
      [30/Jan/2008:13:29:09] WARNING ( 1342): CORE3283: stderr:       at org.apache.ca
      talina.session.PersistentManagerBase.run(PersistentManagerBase.java:1244)
      [30/Jan/2008:13:29:09] WARNING ( 1342): CORE3283: stderr:       at java.lang.Thr
      ead.run(Thread.java:534)
      [30/Jan/2008:13:36:56] INFO ( 1342): CORE5073: Application server shutdown in pr
      ogress
      [30/Jan/2008:13:36:56] INFO ( 1342): CORE5051: Shutting down all J2EE applicatio
      ns ...
      Cause:Unable to establish connection HADB to save caching sessiondata of server instance

      Steps tried

      1).Recreation Datasource (Both JNDI & POOL). --> Failed
      2).Manipulated Datasource (Both JNDI & POOL). --> Failed.

      I kind of struck with this.Our next was to recreate this instance all together.However,i personally don't want to land on to it.

      i'd like to know if i'm missing some other checks or troubleshoot which i can to fix it.

      Again as i said the instance was working fine earlier after the unmount/remount which we had started all this.

      I believe i've provided the information which was running in mind now.
      I'd be really glad to share if you need other info aswell.

      I'd be really glad if someone from my SDN brotherhood can help me(Guide me) further on this issue.


      Thanks in advance !!


      REGARDS,
      RaHuL