Forum Stats

  • 3,727,564 Users
  • 2,245,413 Discussions
  • 7,852,880 Comments

Discussions

weblogic down机问题分析

673652
673652 Member Posts: 23
edited December 2008 in 中间件
此信息为server.log日志,写多了点,希望能给高手多一些信息,帮忙分析一下是哪里问题。谢谢
####<2008-12-22 下午05时35分03秒 CST> <Error> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[ACTIVE] ExecuteThread: '245' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229938503610> <BEA-000337> <[STUCK] ExecuteThread: '241' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "716" seconds working on the request "Http Request: /hyxglxt/reportAction.do", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
java.net.SocketInputStream.socketRead0(Native Method)
java.net.SocketInputStream.read(SocketInputStream.java:129)
oracle.net.ns.Packet.receive(Unknown Source)
oracle.net.ns.DataPacket.receive(Unknown Source)
oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1099)
oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1070)
oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:478)
oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:216)
oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:955)
oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1060)
oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:839)
oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1132)
oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3316)
oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3361)
org.hibernate.jdbc.AbstractBatcher.getResultSet(AbstractBatcher.java:139)
org.hibernate.loader.Loader.getResultSet(Loader.java:1669)
org.hibernate.loader.Loader.doQuery(Loader.java:662)
org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:224)
org.hibernate.loader.Loader.doList(Loader.java:2145)
org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2029)
org.hibernate.loader.Loader.list(Loader.java:2024)
org.hibernate.hql.classic.QueryTranslatorImpl.list(QueryTranslatorImpl.java:887)
org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:153)
org.hibernate.impl.SessionImpl.list(SessionImpl.java:1129)
org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)
com.cpic.hyxglxt.hibernate.util.HibernateDAO.getObjects(HibernateDAO.java:36)
com.cpic.hyxglxt.dao.impl.FinanceTranstraceDAOImpl.getFinanceTranstraces(FinanceTranstraceDAOImpl.java:42)
com.cpic.hyxglxt.service.impl.FinanceTranstraceServiceImpl.getFinanceTranstraces(FinanceTranstraceServiceImpl.java:26)
com.cpic.hyxglxt.web.rjd.action.ReportAction.reportPrint(ReportAction.java:489)
sun.reflect.GeneratedMethodAccessor292.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:585)
org.apache.struts.actions.DispatchAction.dispatchMethod(DispatchAction.java:274)
org.apache.struts.actions.DispatchAction.execute(DispatchAction.java:194)
org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:419)
org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:224)
org.apache.struts.action.ActionServlet.process(ActionServlet.java:1194)
org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:432)
javax.servlet.http.HttpServlet.service(HttpServlet.java:763)
javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:223)
weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:283)
weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42)
com.cpic.hyxglxt.common.filter.EncodingFilter.doFilter(EncodingFilter.java:57)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42)
weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3243)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2003)
weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:1909)
weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1359)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
weblogic.work.ExecuteThread.run(ExecuteThread.java:181)





####<2008-12-22 下午07时30分06秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '201' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229945406863> <BEA-101020> <[[email protected] - appName: 'hyxglxt', name: 'hyxglxt.war', context-path: '/hyxglxt'] Servlet failed with Exception
java.lang.IllegalStateException: Cannot forward a response that is already committed
at weblogic.servlet.internal.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:97)
at org.apache.struts.action.RequestProcessor.doForward(RequestProcessor.java:1063)
at org.apache.struts.action.RequestProcessor.processForwardConfig(RequestProcessor.java:386)
at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:229)
at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1194)
at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:432)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:763)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:223)
at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:283)
at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42)
at com.cpic.hyxglxt.common.filter.EncodingFilter.doFilter(EncodingFilter.java:57)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3243)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2003)
at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:1909)
at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1359)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
>
####<2008-12-22 下午07时30分06秒 CST> <Info> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '201' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229945406864> <BEA-000339> <[STUCK] ExecuteThread: '201' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>
####<2008-12-22 下午07时30分07秒 CST> <Info> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '232' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229945407328> <BEA-000339> <[STUCK] ExecuteThread: '232' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>
####<2008-12-22 下午07时30分07秒 CST> <Info> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '230' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229945407637> <BEA-000339> <[STUCK] ExecuteThread: '230' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>
####<2008-12-22 下午07时30分08秒 CST> <Info> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '219' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229945408567> <BEA-000339> <[STUCK] ExecuteThread: '219' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>
####<2008-12-22 下午07时30分09秒 CST> <Info> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '234' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229945409161> <BEA-000339> <[STUCK] ExecuteThread: '234' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>
####<2008-12-22 下午07时30分09秒 CST> <Info> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '199' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229945409540> <BEA-000339> <[STUCK] ExecuteThread: '199' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>
####<2008-12-22 下午07时30分11秒 CST> <Info> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '238' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229945411604> <BEA-000339> <[STUCK] ExecuteThread: '238' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>
####<2008-12-22 下午07时30分29秒 CST> <Info> <Health> <LIF_HYX_WB> <AdminServer> <weblogic.GCMonitor> <<WLS Kernel>> <> <> <1229945429709> <BEA-310002> <52% of the total memory in the server is free>
####<2008-12-22 下午07时30分49秒 CST> <Info> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '237' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229945449725> <BEA-000339> <[STUCK] ExecuteThread: '237' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>
####<2008-12-22 下午07时31分00秒 CST> <Info> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '242' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229945460214> <BEA-000339> <[STUCK] ExecuteThread: '242' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>
####<2008-12-22 下午07时31分11秒 CST> <Info> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '243' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229945471928> <BEA-000339> <[STUCK] ExecuteThread: '243' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>
####<2008-12-22 下午07时31分20秒 CST> <Info> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '241' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229945480662> <BEA-000339> <[STUCK] ExecuteThread: '241' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>
####<2008-12-23 上午12时03分45秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961825643> <BEA-101215> <Malformed Request "/<script>alert(document.domain)</script>.cfm". Request parsing failed, Code: -1>
####<2008-12-23 上午12时03分52秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961832164> <BEA-101215> <Malformed Request "/</em><script>alert(nudgeaaa)</script>". Request parsing failed, Code: -1>
####<2008-12-23 上午12时03分57秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '4' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961837892> <BEA-101215> <Malformed Request "/<script>alert('nudgeaaaa')</script>". Request parsing failed, Code: -1>
####<2008-12-23 上午12时03分59秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '4' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961839440> <BEA-101215> <Malformed Request "/webapp/examples/<SCRIPT>alert(document.cookie)</SCRIPT>". Request parsing failed, Code: -1>
####<2008-12-23 上午12时03分59秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961839442> <BEA-101215> <Malformed Request "/<SCRIPT>alert(document.cookie)</SCRIPT>.jsp". Request parsing failed, Code: -1>
####<2008-12-23 上午12时04分15秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '4' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961855286> <BEA-101215> <Malformed Request "/<script>alert(document.cookie)</script>.cfm". Request parsing failed, Code: -1>
####<2008-12-23 上午12时04分33秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '4' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961873910> <BEA-101215> <Malformed Request "/<script>alert('vulnerable')</script>". Request parsing failed, Code: -1>
####<2008-12-23 上午12时04分34秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '4' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961874066> <BEA-101215> <Malformed Request "/pls/help/<SCRIPT>alert(document.domain)</SCRIPT>". Request parsing failed, Code: -1>
####<2008-12-23 上午12时04分50秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961890988> <BEA-101215> <Malformed Request "/cgi-bin/campas". Request parsing failed, Code: -1>
####<2008-12-23 上午12时04分53秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961893974> <BEA-101215> <Malformed Request "/NONexistant.jsp/<SCRIPT>alert('GOTCHA')></SCRIPT>". Request parsing failed, Code: -1>
####<2008-12-23 上午12时04分54秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961894909> <BEA-101215> <Malformed Request "/<script>alert('nudgeaaaa')</script>". Request parsing failed, Code: -1>
####<2008-12-23 上午12时04分55秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961895410> <BEA-101215> <Malformed Request "/<SCRIPT>alert(document.domain)</SCRIPT>". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分00秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961900066> <BEA-101215> <Malformed Request "/<SCRIPT>alert(document.domain)</SCRIPT>.jsp". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分01秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961901521> <BEA-101215> <Malformed Request "/nosuch.shtml". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分01秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961901522> <BEA-101215> <Malformed Request "/servlet/allaire.jrun.ssi.SSIFilter". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分01秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961901524> <BEA-101215> <Malformed Request "/servlet/com.livesoftware.jrun.plugins.ssi.SSIFilter". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分01秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961901525> <BEA-101215> <Malformed Request "/nosuch.shtml". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分01秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961901526> <BEA-101215> <Malformed Request "/servlet/allaire.jrun.ssi.SSIFilter". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分01秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961901527> <BEA-101215> <Malformed Request "/servlet/com.livesoftware.jrun.plugins.ssi.SSIFilter". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分01秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961901528> <BEA-101215> <Malformed Request "/nosuch.shtml". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分01秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961901529> <BEA-101215> <Malformed Request "/servlet/allaire.jrun.ssi.SSIFilter". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分01秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961901531> <BEA-101215> <Malformed Request "/servlet/com.livesoftware.jrun.plugins.ssi.SSIFilter". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分03秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961903644> <BEA-101215> <Malformed Request "/<script>alert('vulnerable')</script>". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分16秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961916645> <BEA-101215> <Malformed Request "/jsp-examples/snp/snoop.jsp". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分16秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961916646> <BEA-101215> <Malformed Request "/examples/jsp/snp/snoop.jsp". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分16秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961916648> <BEA-101215> <Malformed Request "/examples/snp/snoop.jsp". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分24秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961924879> <BEA-101215> <Malformed Request "/COM2.<SCRIPT>alert('hi')</SCRIPT>". Request parsing failed, Code: -1>
####<2008-12-23 上午12时05分26秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961926097> <BEA-101215> <Malformed Request "/<Script>alert(document.domain)</Script>". Request parsing failed, Code: -1>
####<2008-12-23 上午12时06分12秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961972178> <BEA-101215> <Malformed Request "/servlet/org.apache.catalina.ContainerServlet/<SCRIPT>alert('hi')</SCRIPT>". Request parsing failed, Code: -1>
####<2008-12-23 上午12时06分12秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961972180> <BEA-101215> <Malformed Request "/servlet/org.apache.catalina.servlets.WebdavStatus/<SCRIPT>alert('hi')</SCRIPT>". Request parsing failed, Code: -1>
####<2008-12-23 上午12时06分12秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961972181> <BEA-101215> <Malformed Request "/servlet/org.apache.catalina.Context/<SCRIPT>alert('hi')</SCRIPT>". Request parsing failed, Code: -1>
####<2008-12-23 上午12时06分12秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'> <<WLS Kernel>> <> <> <1229961972183> <BEA-101215> <Malformed Request "/servlet/org.apache.catalina.Globals/<SCRIPT>alert('hi')</SCRIPT>". Request parsing failed, Code: -1>
####<2008-12-23 上午09时03分55秒 CST> <Info> <Health> <LIF_HYX_WB> <AdminServer> <weblogic.GCMonitor> <<WLS Kernel>> <> <> <1229994235100> <BEA-310002> <4% of the total memory in the server is free>
####<2008-12-23 上午09时06分56秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <[ACTIVE] ExecuteThread: '241' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229994416389> <BEA-101017> <[[email protected] - appName: 'hyxglxt', name: 'hyxglxt.war', context-path: '/hyxglxt'] Root cause of ServletException.
java.lang.OutOfMemoryError: Java heap space
>
####<2008-12-23 上午09时06分59秒 CST> <Error> <Server> <LIF_HYX_WB> <AdminServer> <DynamicListenThread[Default]> <<WLS Kernel>> <> <> <1229994419273> <BEA-002608> <The ListenThread because of an error: java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
>
####<2008-12-23 上午09时11分24秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <[ACTIVE] ExecuteThread: '219' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229994684623> <BEA-101017> <[[email protected] - appName: 'hyxglxt', name: 'hyxglxt.war', context-path: '/hyxglxt'] Root cause of ServletException.
java.lang.OutOfMemoryError: Java heap space
>
####<2008-12-23 上午09时15分46秒 CST> <Info> <Health> <LIF_HYX_WB> <AdminServer> <weblogic.GCMonitor> <<WLS Kernel>> <> <> <1229994946131> <BEA-310002> <70% of the total memory in the server is free>
####<2008-12-23 上午09时15分46秒 CST> <Error> <HTTP> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '230' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229994946135> <BEA-101017> <[[email protected] - appName: 'hyxglxt', name: 'hyxglxt.war', context-path: '/hyxglxt'] Root cause of ServletException.
java.lang.OutOfMemoryError: Java heap space
>
####<2008-12-23 上午09时15分46秒 CST> <Info> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '230' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229994946136> <BEA-000339> <[STUCK] ExecuteThread: '230' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>
####<2008-12-23 上午09时15分46秒 CST> <Error> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[ACTIVE] ExecuteThread: '220' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229994946151> <BEA-000337> <[STUCK] ExecuteThread: '225' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "685" seconds working on the request "Http Request: /hyxglxt/reportAction.do", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
org.apache.poi.hssf.usermodel.HSSFSheet.createRow(HSSFSheet.java:192)
com.cpic.hyxglxt.web.rjd.action.ReportAction.reportPrint(ReportAction.java:603)
sun.reflect.GeneratedMethodAccessor292.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:585)
org.apache.struts.actions.DispatchAction.dispatchMethod(DispatchAction.java:274)
org.apache.struts.actions.DispatchAction.execute(DispatchAction.java:194)
org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:419)
org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:224)
org.apache.struts.action.ActionServlet.process(ActionServlet.java:1194)
org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:432)
javax.servlet.http.HttpServlet.service(HttpServlet.java:763)
javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:223)
weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:283)
weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42)
com.cpic.hyxglxt.common.filter.EncodingFilter.doFilter(EncodingFilter.java:57)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42)
weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3243)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2003)
weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:1909)
weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1359)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
>
####<2008-12-23 上午09时15分46秒 CST> <Info> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[STUCK] ExecuteThread: '225' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229994946172> <BEA-000339> <[STUCK] ExecuteThread: '225' for queue: 'weblogic.kernel.Default (self-tuning)' has become "unstuck".>
####<2008-12-23 上午09时15分46秒 CST> <Error> <WebLogicServer> <LIF_HYX_WB> <AdminServer> <[ACTIVE] ExecuteThread: '220' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1229994946176> <BEA-000337> <[STUCK] ExecuteThread: '231' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "662" seconds working on the request "Http Request: /hyxglxt/reportAction.do", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
java.net.SocketInputStream.socketRead0(Native Method)
java.net.SocketInputStream.read(SocketInputStream.java:129)
oracle.net.ns.Packet.receive(Unknown Source)
oracle.net.ns.DataPacket.receive(Unknown Source)
oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1099)
oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1070)
oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:478)
oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:216)
oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1027)
oracle.jdbc.driver.OracleResultSetImpl.close_or_fetch_from_next(OracleResultSetImpl.java:291)
oracle.jdbc.driver.OracleResultSetImpl.next(OracleResultSetImpl.java:213)
org.hibernate.loader.Loader.doQuery(Loader.java:685)
org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:224)
org.hibernate.loader.Loader.doList(Loader.java:2145)
org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2029)
org.hibernate.loader.Loader.list(Loader.java:2024)
org.hibernate.hql.classic.QueryTranslatorImpl.list(QueryTranslatorImpl.java:887)
org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:153)
org.hibernate.impl.SessionImpl.list(SessionImpl.java:1129)
org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)
com.cpic.hyxglxt.hibernate.util.HibernateDAO.getObjects(HibernateDAO.java:36)
com.cpic.hyxglxt.dao.impl.FinanceTranstraceDAOImpl.getFinanceTranstraces(FinanceTranstraceDAOImpl.java:42)
com.cpic.hyxglxt.service.impl.FinanceTranstraceServiceImpl.getFinanceTranstraces(FinanceTranstraceServiceImpl.java:26)
com.cpic.hyxglxt.web.rjd.action.ReportAction.reportPrint(ReportAction.java:489)
sun.reflect.GeneratedMethodAccessor292.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:585)
org.apache.struts.actions.DispatchAction.dispatchMethod(DispatchAction.java:274)
org.apache.struts.actions.DispatchAction.execute(DispatchAction.java:194)
org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:419)
org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:224)
org.apache.struts.action.ActionServlet.process(ActionServlet.java:1194)
org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:432)
javax.servlet.http.HttpServlet.service(HttpServlet.java:763)
javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:223)
weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:283)
weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42)
com.cpic.hyxglxt.common.filter.EncodingFilter.doFilter(EncodingFilter.java:57)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42)
weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3243)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2003)
weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:1909)
weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1359)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
>
我一直怀疑线程在内存处理中僵死在哪里,以至于访问的线程不能再进入内存处理。从而造成down机的可能。stuck线程太多了。不知道怎么会那么多

Answers

  • 656992
    656992 Member Posts: 34
    从你的日志信息来看有很多阻塞的线程,当达到weblogic设置的600秒后就会报错,原因有很多最常见的有两种:
    一种是当线程请求数据库连接时没有可用的连接因此在等待然后超时,解决方法是看看weblogic和数据库方面对新连接有没有限制,有的话把限制解除。
    第二种就是代码问题了,对于这个问题简单来说就是内存泄露和线程死锁导致wls hang,可能是你的代码问题也可能是使用的三方框架的bug,通常是使用命令工具查找是哪个线程泄露和死锁,解决wls hang可用参照以下方法:
    Hang产生的原因一般为:
    *–系统内存不足*
    *–系统cpu忙*
    *–系统文件描述符数目不足*
    *–线程死锁*
    *–JVM有GC方面的bug*
    *–对于一些特定的情况可以使用truss命令跟踪系统调用来进行分析*


    线程死锁

    –对于原因不明的hang或是响应慢,最根本的方法就是获取thread dump信息
    •对于windows系统,在运行java的窗口按Ctrl+Break
    •对于unix系统,首先用ps找到运行weblogic的java进程的pid,然后执行kill –3pid
    •JVM将负责将所有java进程的状态、执行堆栈dump到其标准输出
    •为了方便获取thread dump信息,在weblogic启动的时候,最好将其标准输出重定向到一个文件
    •为了反映线程状态的动态变化,需要接连多次做thread dump,每次间隔10-20s
    对于thread dump信息,主要关注的是线程的状态和其执行堆栈
    –线程的状态一般为三类
    •Runnable(R):当前可以运行的线程
    •Waiting on monitor(CW):线程主动wait
    •Waiting for monitor entry(MW):线程等锁
    –一般关注的都是第一和第三种状态的线程
    •Cpu很忙则关注runnable的线程
    •Cpu闲则关注waiting for monitor entry的线程
    –一种典型的死锁是由于在server端应用(比如servlet)中请求由同一weblogic实例serve的资源
    •解决办法就是将该servlet放到另外的执行队列里去执行
    可以看我以前给你的帖子weblogic高CPU的分析---就在本论坛http://cn.forums.oracle.com/forums/thread.jspa?threadID=833336&tstart=0
    656992
  • 673652
    673652 Member Posts: 23
    我看了有内存泄露,当时机器down掉时我不知道,他们重启之后才和我联系,没有获取当时的thread dump信息。
    请问你不是bea的人吧。回答我问题真快,呵呵,谢谢
This discussion has been closed.