This discussion is archived
5 Replies Latest reply: Nov 13, 2012 1:30 AM by FabianScherpenzeel RSS

UCM service becomes unaccessible though Managed Server seems running fine

Prateek Mohan Newbie
Currently Being Moderated
Hi All,

I am facing an issue with one of the UCM 11g servers on a test machine.
I have a single domain "dev_ocs" with AdminServer, UCM_server1, soa_server1 & wls_ods1 installed.

We have some custom UCM Services that make use of class "intradoc.apputilities.idccommand.IdcExecuteServer" to execute certain standard services inside their code.

What happens is that - each time any such custom UCM service is fired, the server throws an error and becomes inaccessible!

The managed server seems to run fine but any attempts to access UCM service (http://<host>:<port>/ucm) reaches a dead-end.
User sees a HTTP/1.1 500 Internal Server Error! Any pointers from past experience will be helpful.

In EM, I can see the error when the custom service fails is:

intradoc.common.ServiceException: !csUnableToExecMethod,createEmployeeFolder
*ScriptStack CREATE_EMPLOYEE_FOLDER
3:createEmployeeFolder,**no captured values**
at intradoc.server.ServiceRequestImplementor.buildServiceException(ServiceRequestImplementor.java:2115)
at intradoc.server.Service.buildServiceException(Service.java:2260)
at intradoc.server.Service.createServiceExceptionEx(Service.java:2254)
at intradoc.server.Service.createServiceException(Service.java:2249)
at intradoc.server.Service.doCodeEx(Service.java:584)
at intradoc.server.Service.doCode(Service.java:505)
at intradoc.server.ServiceRequestImplementor.doAction(ServiceRequestImplementor.java:1643)
at intradoc.server.Service.doAction(Service.java:477)
at intradoc.server.ServiceRequestImplementor.doActions(ServiceRequestImplementor.java:1458)
at intradoc.server.Service.doActions(Service.java:472)
at intradoc.server.ServiceRequestImplementor.executeActions(ServiceRequestImplementor.java:1391)
at intradoc.server.Service.executeActions(Service.java:458)
at intradoc.server.ServiceRequestImplementor.doRequest(ServiceRequestImplementor.java:737)
at intradoc.server.Service.doRequest(Service.java:1890)
at intradoc.server.ServiceManager.processCommand(ServiceManager.java:435)
at intradoc.server.IdcServerThread.processRequest(IdcServerThread.java:265)
at intradoc.idcwls.IdcServletRequestUtils.doRequest(IdcServletRequestUtils.java:1343)
at intradoc.idcwls.IdcServletRequestUtils.processFilterEvent(IdcServletRequestUtils.java:1715)
at intradoc.idcwls.IdcIntegrateWrapper.processFilterEvent(IdcIntegrateWrapper.java:222)
at sun.reflect.GeneratedMethodAccessor189.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at idcservlet.common.IdcMethodHolder.invokeMethod(IdcMethodHolder.java:87)
at idcservlet.common.ClassHelperUtils.executeMethodEx(ClassHelperUtils.java:305)
at idcservlet.common.ClassHelperUtils.executeMethodWithArgs(ClassHelperUtils.java:278)
at idcservlet.ServletUtils.executeContentServerIntegrateMethodOnConfig(ServletUtils.java:1600)
at idcservlet.IdcFilter.doFilter(IdcFilter.java:352)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:111)
at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:313)
at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:413)
at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:94)
at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:161)
at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:71)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
at oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:136)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:111)
at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:313)
at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:413)
at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:94)
at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:161)
at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:71)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3715)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3681)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2277)
at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2183)
at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1454)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:207)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:176)
Caused by: java.lang.ExceptionInInitializerError
at intradoc.apputilities.idccommand.IdcExecuteServer.executeCommandViaStandAlone(IdcExecuteServer.java:340)
at intradoc.apputilities.idccommand.IdcExecuteServer.executeCommand(IdcExecuteServer.java:290)
at com.oracle.ucm.xxemployeemgmt.AddEmployeeFolder.executeService(AddEmployeeFolder.java:295)
at com.oracle.ucm.xxemployeemgmt.AddEmployeeFolder.createEmployeeFolder(AddEmployeeFolder.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at intradoc.common.IdcMethodHolder.invokeMethod(IdcMethodHolder.java:86)
at intradoc.common.ClassHelperUtils.executeMethodEx(ClassHelperUtils.java:310)
at intradoc.common.ClassHelperUtils.executeMethod(ClassHelperUtils.java:295)
at intradoc.server.Service.doCodeEx(Service.java:550)
... 48 more
Caused by: java.awt.HeadlessException
at java.awt.GraphicsEnvironment.checkHeadless(GraphicsEnvironment.java:159)
at java.awt.Window.<init>(Window.java:432)
at java.awt.Frame.<init>(Frame.java:403)
at java.awt.Frame.<init>(Frame.java:368)
at javax.swing.JFrame.<init>(JFrame.java:158)
at intradoc.apps.shared.StandAloneApp.<clinit>(StandAloneApp.java:89)
at intradoc.apputilities.idccommand.IdcExecuteServer.executeCommandViaStandAlone(IdcExecuteServer.java:340)
at intradoc.apputilities.idccommand.IdcExecuteServer.executeCommand(IdcExecuteServer.java:290)
at com.oracle.ucm.xxemployeemgmt.AddEmployeeFolder.executeService(AddEmployeeFolder.java:295)
at com.oracle.ucm.xxemployeemgmt.AddEmployeeFolder.createEmployeeFolder(AddEmployeeFolder.java:104)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at intradoc.common.IdcMethodHolder.invokeMethod(IdcMethodHolder.java:87)
at intradoc.common.ClassHelperUtils.executeMethodEx(ClassHelperUtils.java:310)
at intradoc.common.ClassHelperUtils.executeMethod(ClassHelperUtils.java:295)
at intradoc.server.Service.doCodeEx(Service.java:551)
at intradoc.server.Service.doCode(Service.java:506)
... 47 more+
  • 1. Re: UCM service becomes unaccessible though Managed Server seems running fine
    Prateek Mohan Newbie
    Currently Being Moderated
    The next error in EM is like:


    +[ServletContext@153048627[app:Oracle Universal Content Management - Content Server module:/ path: spec-version:2.5]] Root cause of ServletException.+
    java.io.IOException: !csServletErrorExecutingRequest
    at intradoc.idcwls.IdcServletRequestUtils.doRequest(IdcServletRequestUtils.java:1372)
    at intradoc.idcwls.IdcServletRequestUtils.processFilterEvent(IdcServletRequestUtils.java:1715)
    at intradoc.idcwls.IdcIntegrateWrapper.processFilterEvent(IdcIntegrateWrapper.java:222)
    at sun.reflect.GeneratedMethodAccessor189.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at idcservlet.common.IdcMethodHolder.invokeMethod(IdcMethodHolder.java:87)
    at idcservlet.common.ClassHelperUtils.executeMethodEx(ClassHelperUtils.java:305)
    at idcservlet.common.ClassHelperUtils.executeMethodWithArgs(ClassHelperUtils.java:278)
    at idcservlet.ServletUtils.executeContentServerIntegrateMethodOnConfig(ServletUtils.java:1600)
    at idcservlet.IdcFilter.doFilter(IdcFilter.java:352)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:111)
    at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:313)
    at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:413)
    at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:94)
    at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:161)
    at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:71)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:136)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:111)
    at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:313)
    at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:413)
    at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:94)
    at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:161)
    at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:71)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3715)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3681)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2277)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2183)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1454)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:207)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:176)
    Caused By: java.lang.NullPointerException
    at intradoc.jdbc.JdbcWorkspace.addOrRemoveThreadTimeout(JdbcWorkspace.java:2557)
    at intradoc.jdbc.JdbcWorkspace.clearThreadTimeout(JdbcWorkspace.java:2493)
    at intradoc.server.ServiceManager.cleanup(ServiceManager.java:472)
    at intradoc.server.IdcServerThread.processRequest(IdcServerThread.java:297)
    at intradoc.idcwls.IdcServletRequestUtils.doRequest(IdcServletRequestUtils.java:1343)
    at intradoc.idcwls.IdcServletRequestUtils.processFilterEvent(IdcServletRequestUtils.java:1715)
    at intradoc.idcwls.IdcIntegrateWrapper.processFilterEvent(IdcIntegrateWrapper.java:222)
    at sun.reflect.GeneratedMethodAccessor189.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at idcservlet.common.IdcMethodHolder.invokeMethod(IdcMethodHolder.java:87)
    at idcservlet.common.ClassHelperUtils.executeMethodEx(ClassHelperUtils.java:305)
    at idcservlet.common.ClassHelperUtils.executeMethodWithArgs(ClassHelperUtils.java:278)
    at idcservlet.ServletUtils.executeContentServerIntegrateMethodOnConfig(ServletUtils.java:1600)
    at idcservlet.IdcFilter.doFilter(IdcFilter.java:352)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:111)
    at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:313)
    at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:413)
    at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:94)
    at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:161)
    at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:71)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:136)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:111)
    at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:313)
    at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:413)
    at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:94)
    at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:161)
    at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:71)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3715)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3681)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2277)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2183)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1454)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:207)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:176)
  • 2. Re: UCM service becomes unaccessible though Managed Server seems running fine
    Srinath Menon Guru
    Currently Being Moderated
    Hi ,

    "!csUnableToExecMethod,createEmployeeFolder " - This usually is an indication that a component which calls this service is not installed / deployed correctly on UCM server . To get more details set requestaudit, componentloader trace sections and then recreate the issue . This will give further details .

    Thanks
    Srinath
  • 3. Re: UCM service becomes unaccessible though Managed Server seems running fine
    Prateek Mohan Newbie
    Currently Being Moderated
    Dear Srinath,

    Thanks for replying. The next part in error is like:

    Caused by: java.lang.ExceptionInInitializerError
    at intradoc.apputilities.idccommand.IdcExecuteServer.executeCommandViaStandAlone(IdcExecuteServer.java:340)
    at intradoc.apputilities.idccommand.IdcExecuteServer.executeCommand(IdcExecuteServer.java:290)

    Caused by: java.awt.HeadlessException
    at java.awt.GraphicsEnvironment.checkHeadless(GraphicsEnvironment.java:159)
    at java.awt.Window.<init>(Window.java:432)
    at java.awt.Frame.<init>(Frame.java:403)
    at java.awt.Frame.<init>(Frame.java:368)
    at javax.swing.JFrame.<init>(JFrame.java:158)
    at intradoc.apps.shared.StandAloneApp.<clinit>(StandAloneApp.java:89)
    at intradoc.apputilities.idccommand.IdcExecuteServer.executeCommandViaStandAlone(IdcExecuteServer.java:340)
    at intradoc.apputilities.idccommand.IdcExecuteServer.executeCommand(IdcExecuteServer.java:290)

    I feel this is the culprit but have no clue why this error is popping up & how to fix it!
    The strange part is - after this error, the UCM deployment becomes inaccessible.... with error posted in my second update from the top of this thread.

    The same code was working fine until few months back on this particular instance, and is also running fine on our other instance.
    I tried to check JVM system properties for AWT, but those are same between the two instances!

    Any pointers will be helpful.
  • 4. Re: UCM service becomes unaccessible though Managed Server seems running fine
    user434745 Newbie
    Currently Being Moderated
    What changed on this instance from when the code worked to when it stopped working?

    - Is it on a VM that somehow changed?
    - Was it moved to a RAC machine?
    - Was the JVM or any switches to it changed?

    I have seen the "headless" errors before and it is basically the JVM saying it finds no place to "paint" its UI or dialog boxes.
    The code you are calling requires that since it is invoking stuff in the "apputilities" packages are used to support the admin applets and server apps and would generally requiring a place to display the awt and/or swing dialogs.

    I would say if you are just invoking a service, I would NOT do it using anything in the "apputilities" packages, for the above reason.
  • 5. Re: UCM service becomes unaccessible though Managed Server seems running fine
    FabianScherpenzeel Explorer
    Currently Being Moderated
    The java.awt.HeadlessException point towards a difference in the server with regard to display capabilities.
    If you are running on linux, did you have a running X server on one instance and not on the other?
    We have some custom UCM Services that make use of class "intradoc.apputilities.idccommand.IdcExecuteServer" to execute certain standard services inside their code.
    This is probably causing the reliance on a display. It is therefore better to use a different way of calling certain standard services from inside your code (there are numerous examples on this forum of how this should be done).

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points