4 Replies Latest reply: Jun 10, 2014 1:49 AM by Ratnesh Kumar Roy RSS

    Fusion IDM Provisioning STARTUP Failure - NodeManager Not starting

    Ashok Vijaya

      Friends,

                I am trying to execute the STARTUP setup of my IDM Provisioning part of FUSION Apps installation, but the phase fails with the below error. Any pointers or assistance greatly appreciated !!

       

      I triggered startNodeManager.sh/startNodeManagerWrapper.sh i runs without errors but when I do netstat  grep for 5556(NM port) i cannot find any service running. Same is the case when I run the startAll.sh script.

       

       

       

       

       

       

      [2014-06-07T13:47:52.839+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [] [runIDMProvisioning-startup] [tid: 17] [ecid: 0000KPoS5OBDwWWFLzESOA1J^cdb000008,0]  [exec]

      [2014-06-07T13:47:52.840+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [] [runIDMProvisioning-startup] [tid: 17] [ecid: 0000KPoS5OBDwWWFLzESOA1J^cdb000008,0]  [exec] Initializing WebLogic Scripting Tool (WLST) ...

      [2014-06-07T13:47:52.841+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [] [runIDMProvisioning-startup] [tid: 17] [ecid: 0000KPoS5OBDwWWFLzESOA1J^cdb000008,0]  [exec]

      [2014-06-07T13:48:07.404+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [] [runIDMProvisioning-startup] [tid: 17] [ecid: 0000KPoS5OBDwWWFLzESOA1J^cdb000008,0]  [exec] Welcome to WebLogic Server Administration Scripting Shell

      [2014-06-07T13:48:07.405+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [] [runIDMProvisioning-startup] [tid: 17] [ecid: 0000KPoS5OBDwWWFLzESOA1J^cdb000008,0]  [exec]

      [2014-06-07T13:48:07.405+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [] [runIDMProvisioning-startup] [tid: 17] [ecid: 0000KPoS5OBDwWWFLzESOA1J^cdb000008,0]  [exec] Type help() for help on available commands

      [2014-06-07T13:48:07.406+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [] [runIDMProvisioning-startup] [tid: 17] [ecid: 0000KPoS5OBDwWWFLzESOA1J^cdb000008,0]  [exec]

      [2014-06-07T13:48:07.461+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [] [runIDMProvisioning-startup] [tid: 17] [ecid: 0000KPoS5OBDwWWFLzESOA1J^cdb000008,0]  [exec] Connecting to Node Manager ...

      [2014-06-07T13:48:07.715+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [] [runIDMProvisioning-startup] [tid: 17] [ecid: 0000KPoS5OBDwWWFLzESOA1J^cdb000008,0]  [exec] This Exception occurred at Sat Jun 07 13:48:07 EST 2014.

      [2014-06-07T13:48:07.727+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [] [runIDMProvisioning-startup] [tid: 17] [ecid: 0000KPoS5OBDwWWFLzESOA1J^cdb000008,0]  [exec] weblogic.nodemanager.NMConnectException: Connection refused. Could not connect to NodeManager. Check that it is running at fusionidm.oracle.com:5556.

      [2014-06-07T13:48:07.739+10:00] [runIDMProvisioning-startup] [WARNING] [] [runIDMProvisioning-startup] [tid: 18] [ecid: 0000KPoSCivDwWWFLzESOA1J^cdb000009,0]  [exec] Problem invoking WLST - Traceback (innermost last):

      [2014-06-07T13:48:07.739+10:00] [runIDMProvisioning-startup] [WARNING] [] [runIDMProvisioning-startup] [tid: 18] [ecid: 0000KPoSCivDwWWFLzESOA1J^cdb000009,0]  [exec]   File "/media/fusionIDM/fusion/app/idmlcm/provisioning/idm-provisioning-build/config/nodemanager_stop_adminServer.py", line 1, in ?

      [2014-06-07T13:48:07.739+10:00] [runIDMProvisioning-startup] [WARNING] [] [runIDMProvisioning-startup] [tid: 18] [ecid: 0000KPoSCivDwWWFLzESOA1J^cdb000009,0]  [exec]   File "<iostream>", line 123, in nmConnect

      [2014-06-07T13:48:07.740+10:00] [runIDMProvisioning-startup] [WARNING] [] [runIDMProvisioning-startup] [tid: 18] [ecid: 0000KPoSCivDwWWFLzESOA1J^cdb000009,0]  [exec]   File "<iostream>", line 648, in raiseWLSTException

      [2014-06-07T13:48:07.740+10:00] [runIDMProvisioning-startup] [WARNING] [] [runIDMProvisioning-startup] [tid: 18] [ecid: 0000KPoSCivDwWWFLzESOA1J^cdb000009,0]  [exec] WLSTException: Error occured while performing nmConnect : Cannot connect to Node Manager. : Connection refused. Could not connect to NodeManager. Check that it is running at fusionidm.oracle.com:5556.

      [2014-06-07T13:48:07.740+10:00] [runIDMProvisioning-startup] [WARNING] [] [runIDMProvisioning-startup] [tid: 18] [ecid: 0000KPoSCivDwWWFLzESOA1J^cdb000009,0]  [exec] Use dumpStack() to view the full stacktrace

      [2014-06-07T13:48:07.740+10:00] [runIDMProvisioning-startup] [WARNING] [] [runIDMProvisioning-startup] [tid: 18] [ecid: 0000KPoSCivDwWWFLzESOA1J^cdb000009,0]  [exec]

      [2014-06-07T13:48:07.813+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [FAPROV-01571] [runIDMProvisioning-startup] [tid: 10] [ecid: 0000KPoRAJBDwWWFLzESOA1J^cdb000000,0] [arg: /media/fusionIDM/fusion/app/orcidm/products/app/idm/common/bin/wlst.sh] INFO: Invoking /media/fusionIDM/fusion/app/orcidm/products/app/idm/common/bin/wlst.sh

      [2014-06-07T13:48:07.830+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [] [runIDMProvisioning-startup] [tid: 19] [ecid: 0000KPoSCkMDwWWFLzESOA1J^cdb00000A,0]

      [2014-06-07T13:48:09.974+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [] [runIDMProvisioning-startup] [tid: 20] [ecid: 0000KPoSDHqDwWWFLzESOA1J^cdb00000B,0] [[

      CLASSPATH=/media/fusionIDM/fusion/app/orcidm/products/app/patch_wls1036/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/media/fusionIDM/fusion/app/orcidm/products/app/patch_ocp371/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/media/fusionIDM/fusion/app/orcidm/products/app/jdk6/lib/tools.jar:/media/fusionIDM/fusion/app/orcidm/products/app/wlserver_10.3/server/lib/weblogic_sp.jar:/media/fusionIDM/fusion/app/orcidm/products/app/wlserver_10.3/server/lib/weblogic.jar:/media/fusionIDM/fusion/app/orcidm/products/app/modules/features/weblogic.server.modules_10.3.6.0.jar:/media/fusionIDM/fusion/app/orcidm/products/app/wlserver_10.3/server/lib/webservices.jar:/media/fusionIDM/fusion/app/orcidm/products/app/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/media/fusionIDM/fusion/app/orcidm/products/app/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar::/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/modules/oracle.jrf_11.1.1/jrf-wlstman.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/lib/adfscripting.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/lib/adf-share-mbeans-wlst.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/lib/mdswlst.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/resources/auditwlst.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/resources/igfwlsthelp.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/resources/jps-wlst.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/resources/jps-wls-trustprovider.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/resources/jrf-wlst.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/resources/oamap_help.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/resources/oamAuthnProvider.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/resources/ossoiap_help.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/resources/ossoiap.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/resources/ovdwlsthelp.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/resources/sslconfigwlst.jar:/media/fusionIDM/fusion/app/orcidm/products/app/oracle_common/common/wlst/resources/wsm-wlst.jar:/media/fusionIDM/fusion/app/orcidm/products/app/utils/config/10.3/config-launch.jar::/media/fusionIDM/fusion/app/orcidm/products/app/wlserver_10.3/common/derby/lib/derbynet.jar:/media/fusionIDM/fusion/app/orcidm/products/app/wlserver_10.3/common/derby/lib/derbyclient.jar:/media/fusionIDM/fusion/app/orcidm/products/app/wlserver_10.3/common/derby/lib/derbytools.jar::

       

       

      ]]

      [2014-06-07T13:48:17.745+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [] [runIDMProvisioning-startup] [tid: 20] [ecid: 0000KPoSDHqDwWWFLzESOA1J^cdb00000B,0] [[

      Initializing WebLogic Scripting Tool (WLST) ...

       

       

      Welcome to WebLogic Server Administration Scripting Shell

       

       

      Type help() for help on available commands

       

       

      Connecting to Node Manager ...

      This Exception occurred at Sat Jun 07 13:48:17 EST 2014.

      weblogic.nodemanager.NMConnectException: Connection refused. Could not connect to NodeManager. Check that it is running at fusionidm.oracle.com:5556.

      Problem invoking WLST - Traceback (innermost last):

        File "/media/fusionIDM/fusion/app/idmlcm/provisioning/idm-provisioning-build/config/nodemanager_stop_adminServer.py", line 1, in ?

        File "<iostream>", line 123, in nmConnect

        File "<iostream>", line 648, in raiseWLSTException

      WLSTException: Error occured while performing nmConnect : Cannot connect to Node Manager. : Connection refused. Could not connect to NodeManager. Check that it is running at fusionidm.oracle.com:5556.

      Use dumpStack() to view the full stacktrace

       

       

       

       

      ]]

      [2014-06-07T13:48:17.747+10:00] [runIDMProvisioning-startup] [ERROR] [FAPROV-01093] [runIDMProvisioning-startup] [tid: 10] [ecid: 0000KPoRAJBDwWWFLzESOA1J^cdb000000,0] [arg: wlstScriptExecutor] [arg: Process execution failed with return code: 1. Check the logs for more information.] [arg: /media/fusionIDM/fusion/app/idmlcm/provisioning/idm-provisioning-build/config/nodemanager_stop_adminServer.py] [arg: ] [[

      **** Failed to execute wlstScriptExecutor:Process execution failed with return code: 1. Check the logs for more information.

       

       

      See /media/fusionIDM/fusion/app/idmlcm/provisioning/idm-provisioning-build/config/nodemanager_stop_adminServer.py

      ]]

      [2014-06-07T13:48:17.773+10:00] [runIDMProvisioning-startup] [NOTIFICATION] [] [runIDMProvisioning-startup] [tid: 10] [ecid: 0000KPoRAJBDwWWFLzESOA1J^cdb000000,0]  [logStatus] STATE=BUILD_ERROR!TIMESTAMP=2014-06-07 13:48:17 EST!TARGET=stop-admin-server!CATEGORY=BUILD_ERROR!DOMAIN=NONE!HOSTNAME=fusionidm.oracle.com!PRODUCTFAMILY=orchestration!PRODUCT=orchestration!TASK=wlstScriptExecutor!TASKID=orchestration.orchestration.BUILD_ERROR.stop-admin-server.wlstScriptExecutor!MESSAGE=Process execution failed with return code: 1. Check the logs for more information.!DETAIL=Process execution failed with return code: 1. Check the logs for more information.!BUILDFILE=/media/fusionIDM/fusion/app/idmlcm/provisioning/idm-provisioning-build/idm-common-install-build.xml!LINENUMBER=400!

      [2014-06-07T13:48:17.774+10:00] [runIDMProvisioning-startup] [ERROR] [FAPROV-00298] [runIDMProvisioning-startup] [tid: 10] [ecid: 0000KPoRAJBDwWWFLzESOA1J^cdb000000,0] An Error Occured: [[

      Process execution failed with return code: 1. Check the logs for more information.

        at oracle.apps.fnd.provisioning.ant.taskdefs.WLSTScriptExecutorTask.executeTask(WLSTScriptExecutorTask.java:120)