This discussion is archived
4 Replies Latest reply: Feb 8, 2013 1:07 AM by 773086 RSS

Weblogic cluster deploy timeout

773086 Newbie
Currently Being Moderated
Hello!

We have domain Weblogic + Service bus.

We have a couple of managed servers on difference physical machines combined as a cluster.When we deployed an application via wlst on cluster, it fail after timeout. But if one managed server(any) stopped - deploy successfully.

What is incorrect in domain/cluster?

Weblogic 10.3.5, osb 11.1.1.5, RHEL 5.5

Regards,
lam
  • 1. Re: Weblogic cluster deploy timeout
    Kishore Rout Journeyer
    Currently Being Moderated
    Hi iam,
    Can you paste the complete trace here which, you got in wlst prompt?

    Regards,
    Kishore
  • 2. Re: Weblogic cluster deploy timeout
    773086 Newbie
    Currently Being Moderated
    Hello!

    Log:
    -bash-3.2$ ant deploy.app.prod
    Buildfile: build.xml
    
    -set.config.prod:
         [echo] ===== ORACLE_HOME: /oracle/ora_app1/middleware =====
         [echo] Using properties file: config/deploy.properties
    
    -deploy.app:
         [echo] ---------- Deploy applications ----------
         [echo] == Admin URL: t3://u05a1osb01.tc.egov.local:7001 ==
         [echo] == User name: weblogic ==
         [java]
         [java] Initializing WebLogic Scripting Tool (WLST) ...
         [java]
         [java] Welcome to WebLogic Server Administration Scripting Shell
         [java]
         [java] Type help() for help on available commands
         [java]
         [java] ----- PYTHON PATH FOR CONTROL -----
         [java] /oracle/ora_app1/middleware/wlserver_10.3/server/lib/weblogic.jar/Lib
         [java] /oracle/build/deploy/scripts
         [java] __classpath__
         [java] /oracle/ora_app1/middleware/wlserver_10.3/server/lib/weblogic.jar
         [java] /oracle/ora_app1/middleware/wlserver_10.3/common/wlst/modules/jython-modules.jar/Lib
         [java] /oracle/ora_app1/middleware/wlserver_10.3/common/wlst
         [java] /oracle/ora_app1/middleware/wlserver_10.3/common/wlst/lib
         [java] /oracle/ora_app1/middleware/wlserver_10.3/common/wlst/modules
         [java] .
         [java] ----- PYTHON PATH FOR CONTROL -----
         [java] --- Reading config from file [config/config.xml] ---
         [java] --- Parsing config ---
         [java] Reading application [0] config
         [java] Connecting to t3://u05a1osb01.tc.egov.local:7001 with userid weblogic ...
         [java] Successfully connected to Admin Server 'AdminServer' that belongs to domain 'osb_domain'.
         [java]
         [java] Warning: An insecure protocol was used to connect to the
         [java] server. To ensure on-the-wire security, the SSL port or
         [java] Admin port should be used instead.
         [java]
         [java] ================= Applications deploy START =================
         [java] Location changed to edit tree. This is a writable tree with
         [java] DomainMBean as the root. To make changes you will need to start
         [java] an edit session via startEdit().
         [java]
         [java] For more help, use help(edit)
         [java]
         [java] Starting an edit session ...
         [java] Started edit session, please be sure to save and activate your
         [java] changes once you are done.
         [java] Applications for processing: [1]
         [java] Searching deployed application: [a1-subscribe-services]
         [java] Finding MBean of type AppDeployment in all the instances ...
         [java] /InternalAppDeployments/a1-subscribe-services
         [java] Deployed application search result: [/InternalAppDeployments/a1-subscribe-services]
         [java] Undeploying application: [a1-subscribe-services]
         [java] Undeploying application a1-subscribe-services ...
         [java] <Feb 1, 2013 6:15:25 PM MSK> <Info> <J2EE Deployment SPI> <BEA-260121> <Initiating undeploy operation for application, a1-subscribe-services [archive: null], to u05a1osb_cluster1 .>
         [java] You have an edit session in progress, hence WLST will not
         [java]  block for your undeployment to complete.
         [java] Started the undeployment of Application. Please refer to the returned WLSTProgress object or variable LAST to track the status.
         [java] Application [a1-subscribe-services] undeploy SUCCESS
         [java] Deploying application: [a1-subscribe-services]
         [java] Deploying application from /oracle/build/deploy/../osb/a1-subscribe-services-1.13.ear to targets u05a1osb_cluster1 (upload=true) ...
         [java] <Feb 1, 2013 6:15:26 PM MSK> <Info> <J2EE Deployment SPI> <BEA-260121> <Initiating deploy operation for application, a1-subscribe-services [archive: /oracle/build/deploy/../osb/a1-subscribe-services-1.13.ear], to u05a1osb_cluster1 .>
         [java] You have an edit session in progress, hence WLST will not
         [java]  block for your deployment to complete.
         [java] Started the Deployment of Application. Please refer to the returned WLSTProgress object or variable LAST to track the status.
         [java] Application deploy [a1-subscribe-services] SUCCESS
         [java] Saving all your changes ...
         [java] Saved all your changes successfully.
         [java] Activating all your changes, this may take a while ...
         [java] The edit lock associated with this edit session is released
         [java] once the activation is completed.
         [java] This Exception occurred at Fri Feb 01 18:20:28 MSK 2013.
         [java] ================= Applications deploy ERROR =================
         [java] Error occured while performing activate : Error while Activating changes. : Timed out waiting for completion
         [java] Use dumpStack() to view the full stacktrace
         [java]
         [java] java.lang.RuntimeException: Timed out waiting for completion
         [java]     at weblogic.management.provider.internal.ActivateTaskImpl.waitForCompletion(ActivateTaskImpl.java:402)
         [java]     at weblogic.management.provider.internal.ActivateTaskImpl.waitForTaskCompletion(ActivateTaskImpl.java:377)
         [java]     at weblogic.management.provider.internal.EditAccessImpl.activateChangesAndWaitForCompletion(EditAccessImpl.java:879)
         [java]     at weblogic.management.mbeanservers.edit.internal.ConfigurationManagerMBeanImpl.activate(ConfigurationManagerMBeanImpl.java:354)
         [java]     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         [java]     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         [java]     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         [java]     at java.lang.reflect.Method.invoke(Method.java:597)
         [java]     at weblogic.management.jmx.modelmbean.WLSModelMBean.invoke(WLSModelMBean.java:437)
         [java]     at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
         [java]     at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
         [java]     at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:449)
         [java]     at java.security.AccessController.doPrivileged(Native Method)
         [java]     at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:447)
         [java]     at weblogic.management.mbeanservers.internal.JMXContextInterceptor.invoke(JMXContextInterceptor.java:263)
         [java]     at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:449)
         [java]     at java.security.AccessController.doPrivileged(Native Method)
         [java]     at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:447)
         [java]     at weblogic.management.mbeanservers.edit.internal.RecordingInterceptor.invoke(RecordingInterceptor.java:199)
         [java]     at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:449)
         [java]     at java.security.AccessController.doPrivileged(Native Method)
         [java]     at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:447)
         [java]     at weblogic.management.mbeanservers.internal.SecurityMBeanMgmtOpsInterceptor.invoke(SecurityMBeanMgmtOpsInterceptor.java:65)
         [java]     at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:449)
         [java]     at java.security.AccessController.doPrivileged(Native Method)
         [java]     at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:447)
         [java]     at weblogic.management.mbeanservers.edit.internal.EditLockInterceptor.invoke(EditLockInterceptor.java:112)
         [java]     at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:449)
         [java]     at java.security.AccessController.doPrivileged(Native Method)
         [java]     at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:447)
         [java]     at weblogic.management.mbeanservers.internal.SecurityInterceptor.invoke(SecurityInterceptor.java:444)
         [java]     at weblogic.management.jmx.mbeanserver.WLSMBeanServer.invoke(WLSMBeanServer.java:323)
         [java]     at weblogic.management.mbeanservers.internal.JMXConnectorSubjectForwarder$11$1.run(JMXConnectorSubjectForwarder.java:663)
         [java]     at java.security.AccessController.doPrivileged(Native Method)
         [java]     at weblogic.management.mbeanservers.internal.JMXConnectorSubjectForwarder$11.run(JMXConnectorSubjectForwarder.java:661)
         [java]     at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
         [java]     at weblogic.management.mbeanservers.internal.JMXConnectorSubjectForwarder.invoke(JMXConnectorSubjectForwarder.java:654)
         [java]     at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
         [java]     at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
         [java]     at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
         [java]     at java.security.AccessController.doPrivileged(Native Method)
         [java]     at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1367)
         [java]     at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
         [java]     at javax.management.remote.rmi.RMIConnectionImpl_WLSkel.invoke(Unknown Source)
         [java]     at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:667)
         [java]     at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:522)
         [java]     at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
         [java]     at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:146)
         [java]     at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:518)
         [java]     at weblogic.rmi.internal.wls.WLSExecuteRequest.run(WLSExecuteRequest.java:118)
         [java]     at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
         [java]     at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
         [java] Problem invoking WLST - Traceback (innermost last):
         [java]   File "/oracle/build/deploy/scripts/deploy_app.py", line 151, in ?
         [java]   File "/tmp/wlst_module1584673805786415765.py", line 376, in activate
         [java]   File "/tmp/wlst_module1584673805786415765.py", line 1848, in raiseWLSTException
         [java] WLSTException: Error occured while performing activate : Error while Activating changes. : Timed out waiting for completion
         [java] Use dumpStack() to view the full stacktrace
         [java]
         [java] <Feb 1, 2013 6:20:28 PM MSK> <Warning> <JNDI> <BEA-050001> <WLContext.close() was called in a different thread than the one in which it was created.>
    
    BUILD FAILED
    /oracle/build/deploy/build.xml:134: Java returned: 1
    
    Total time: 5 minutes 12 seconds
  • 3. Re: Weblogic cluster deploy timeout
    Kishore Rout Journeyer
    Currently Being Moderated
    Hi,
    This is a known issue in weblogic server from 10.3.3 to 10.3.5. Please check the below metalink id. I think you have to apply one patch to resove this issue.
    Diagnosing BEA-240003 Error Message [ID 1501767.1]
    [check the line: Timed out waiting for completion - WLS 10.3.3 to 10.3.5 - Bug 11773968]

    If this helps please mark.

    Regards,
    Kishore
  • 4. Re: Weblogic cluster deploy timeout
    773086 Newbie
    Currently Being Moderated
    Hi

    This Bug for deploy via console. We use WLST.

    Thx,
    lam

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points