7 Replies Latest reply: Sep 13, 2013 11:48 AM by Sh!va RSS

    Servlet failed with Exception java.lang.NullPointerException

    Mike Paladino

      What drove me to finding this is we had a user call about slowness in a form driven by a task list using a link to a differnet application, the form was opening fine directly but when we opened it through the task list invoking the link we encountered intermittent slowness.  I went out to the logs and noticed a ton of the exceptions below.  I am not sure if it is related as the slowness is intermittent and not always reported, my guess is it is not because of the sheer volume of them but not sure so I figured I mention it

       

      I am on

      11.1.2.1.600

       

      Weve had it for about a year, just seeing these recently

       

      ####<Sep 11, 2013 2:51:55 PM EDT> <Notice> <Diagnostics> <servername> <Planning2> <[ACTIVE] ExecuteThread: '18' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1378925515427> <BEA-320068> <Watch 'UncheckedException' with severity 'Notice' on server 'Planning2' has triggered at Sep 11, 2013 2:51:55 PM EDT. Notification details:

      WatchRuleType: Log

      WatchRule: (SEVERITY = 'Error') AND ((MSGID = 'WL-101020') OR (MSGID = 'WL-101017') OR (MSGID = 'WL-000802') OR (MSGID = 'BEA-101020') OR (MSGID = 'BEA-101017') OR (MSGID = 'BEA-000802'))

      WatchData: DATE = Sep 11, 2013 2:51:55 PM EDT SERVER = Planning2 MESSAGE = [ServletContext@370778047[app:PLANNING module:HyperionPlanning path:/HyperionPlanning spec-version:2.5 version:11.1.2.0]] Servlet failed with Exception

      java.lang.NullPointerException

              at jsp_servlet.__tl_navigator._jspService(__tl_navigator.java:1637)

              at weblogic.servlet.jsp.JspBase.service(JspBase.java:34)

              at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)

              at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)

              at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:300)

              at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)

              at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)

              at HspValidationFilter.doFilter(Unknown Source)

              at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)

              at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:111)

              at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:313)

              at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:413)

              at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:94)

              at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:161)

              at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:71)

              at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)

              at oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:136)

              at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)

              at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3715)

              at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3681)

              at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)

              at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)

              at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2277)

              at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2183)

              at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1454)

              at weblogic.work.ExecuteThread.execute(ExecuteThread.java:207)

              at weblogic.work.ExecuteThread.run(ExecuteThread.java:176)

      SUBSYSTEM = HTTP USERID = <WLS Kernel> SEVERITY = Error THREAD = [ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)' MSGID = BEA-101020 MACHINE = servername TXID =  CONTEXTID =  TIMESTAMP = 1378925515418

      WatchAlarmType: AutomaticReset

      WatchAlarmResetPeriod: 30000

      >

      ####<Sep 11, 2013 2:51:56 PM EDT> <Info> <JDBC> <cphypdv3v.sherwin.com> <Planning2> <[ACTIVE] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1378925516620> <BEA-001128> <Connection for pool "EPMSystemRegistry" closed.>

      ####<Sep 11, 2013 2:51:58 PM EDT> <Alert> <Diagnostics> <cphypdv3v.sherwin.com> <Planning2> <oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl - Incident Dump Executor (created: Wed Sep 11 14:51:58 EDT 2013)> <<WLS Kernel>> <> <> <1378925518582> <BEA-320016> <Creating diagnostic image in /swpkg/oracle/hyperion/Oracle/Middleware/user_projects/domains/EPMSystem/servers/Planning2/adr/diag/ofm/EPMSystem/Planning2/incident/incdir_1419 with a lockout minute period of 1

        • 2. Re: Servlet failed with Exception java.lang.NullPointerException
          Mike Paladino

          Info from the JVM dump

          Blocked lock chains
          ===================
          Chain 2:
          "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" id=23 idx=0x5c tid=5640 waiting for java/lang/String@0xa5437ba8 held by:
          "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=22 idx=0x58 tid=5639 in chain 1

          Chain 3:
          "ExecuteThread: '3' for queue: 'weblogic.socket.Muxer'" id=24 idx=0x60 tid=5641 waiting for java/lang/String@0xa5437ba8 held by:
          "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=22 idx=0x58 tid=5639 in chain 1

          Open lock chains
          ================
          Chain 1:
          "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" id=21 idx=0x54 tid=5638 waiting for java/lang/String@0xa5437ba8 held by:
          "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=22 idx=0x58 tid=5639 (active)

          ===== END OF THREAD DUMP ===============

          "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" id=21 idx=0x54 tid=5638 prio=5 alive, blocked, native_blocked, daemon
              -- Blocked trying to get lock: java/lang/String@0xa5437ba8[fat lock]
              at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
              at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1402)[optimized]
              at jrockit/vm/Locks.lockFat(Locks.java:1503)[optimized]
              at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1045)[optimized]
              at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:996)[optimized]
              at jrockit/vm/Locks.monitorEnter(Locks.java:2170)[optimized]
              at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
              at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
              at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
              at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
              at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
              at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)

          "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=22 idx=0x58 tid=5639 prio=5 alive, in native, daemon
              at jrockit/ext/epoll/EPoll.epollWait0(ILjava/nio/ByteBuffer;II)I(Native Method)
              at jrockit/ext/epoll/EPoll.epollWait(EPoll.java:115)
              at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:156)
              ^-- Holding lock: java/lang/String@0xa5437ba8[fat lock]
              at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
              at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
              at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
              at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
              at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
          "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" id=23 idx=0x5c tid=5640 prio=5 alive, blocked, native_blocked, daemon
              -- Blocked trying to get lock: java/lang/String@0xa5437ba8[fat lock]
              at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
              at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1402)[optimized]
              at jrockit/vm/Locks.lockFat(Locks.java:1503)[optimized]
              at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1045)[optimized]
              at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:996)[optimized]
              at jrockit/vm/Locks.monitorEnter(Locks.java:2170)[optimized]
              at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
              at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
              at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
              at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
              at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
              at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
              -- end of trace

          "ExecuteThread: '3' for queue: 'weblogic.socket.Muxer'" id=24 idx=0x60 tid=5641 prio=5 alive, blocked, native_blocked, daemon
              -- Blocked trying to get lock: java/lang/String@0xa5437ba8[fat lock]
              at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
              at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1402)[inlined]
              at jrockit/vm/Locks.fatLockReacquire(Locks.java:1640)[optimized]
              at jrockit/vm/Locks.lockFat(Locks.java:1508)[optimized]
              at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1045)[optimized]
              at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:996)[optimized]
              at jrockit/vm/Locks.monitorEnter(Locks.java:2170)[optimized]
              at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
              at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
              at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
              at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
              at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
              at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)

          • 3. Re: Servlet failed with Exception java.lang.NullPointerException
            Sh!va

            As mentioned in :https://forums.oracle.com/message/11185153#11185153

             

            Can you look into below steps:

             

            I would suggest , to avoid using task list for a day and keep on opening that webform and monitor the JVM...

             

            We should also look on optimizing the webform by simple funda's like " Supress missing" , " Fit to default/middium" -  can't  able to recall the exact name and also design of webform

             

            Cheers!

             

            Sh!va

            • 4. Re: Servlet failed with Exception java.lang.NullPointerException
              AmarnathK

              How much time does the form takes to open?

               

              As you said, the form is opening fine and it's been running for almost an Year. What recent changes have happened?

               

              Can you create a new task list and assign this form and see?

               

              Amarnath

              http://amarnath-essbase-blog.blogspot.com


              • 5. Re: Servlet failed with Exception java.lang.NullPointerException
                Mike Paladino

                DEV is looking into creating a new task list for it now

                • 6. Re: Servlet failed with Exception java.lang.NullPointerException
                  Sh!va

                  So are we able to reproduce the issue on DEV???

                   

                  Cheers!

                   

                  Sh!va

                  • 7. Re: Servlet failed with Exception java.lang.NullPointerException
                    Mike Paladino

                    not yet, dont imagine development wil get to it til monday now, i keep trying w no luck