Forum Stats

  • 3,836,808 Users
  • 2,262,194 Discussions
  • 7,900,116 Comments

Discussions

Start OMS failed

user13148231
user13148231 Member Posts: 299
edited Aug 9, 2012 12:17PM in Enterprise Manager
Oracle 11g2 on redhat 5. Grid Control 11.1 installed on redhat 5. The client browser dead with mesage
Backend WLS or EM application seems to be down 
Start omd from the installed server
$ cd /u01/app/midware/oms11g/bin
[[email protected] bin]$ ./emctl start oms
Oracle Enterprise Manager 11g Release 1 Grid Control
Copyright (c) 1996, 2010 Oracle Corporation.  All rights reserved.
Starting WebTier...
WebTier Successfully Started
Starting Oracle Management Server...
Oracle Management Server is still in the process of getting started
Timed out waiting for Oracle Management Server to start
Oracle Management Server is Down
Please check /u01/app/gc_inst/em/EMGC_OMS1/sysman/log/emctl.log for error details
The log file is quite long. The relevant part is
2010-09-08 08:12:56,863 [main] DEBUG wls.OMSController main.167 - Log location is /u01/app/gc_inst/em/EMGC_OMS1/sysman/log/emctl.log
2010-09-08 08:12:56,866 [main] INFO  wls.OMSController startOMS.489 - admin start is false
2010-09-08 08:12:56,867 [main] INFO  wls.OMSController startOMS.490 - is service is false
2010-09-08 08:12:56,887 [main] INFO  wls.OMSController getEnvProps.348 - Setting trust store system properties: -Dweblogic.security.TrustKeyStore=DemoTrust -Dweblogic.security.SSL.ignoreHostnameVerification=true -Djava.security.egd=file:///dev/urandom
2010-09-08 08:12:56,888 [main] INFO  wls.OMSController startOMS.508 - Starting WebTier...
2010-09-08 08:12:56,904 [main] INFO  util.WebTierUtil execCmd.134 - Running the command: /u01/app/gc_inst/WebTierIH1/bin/opmnctl stopall
2010-09-08 08:12:57,005 [main] INFO  util.WebTierUtil getProcessResult.196 - opmnctl cmd output: opmnctl stopall: opmn is not running.

2010-09-08 08:12:57,007 [main] INFO  util.WebTierUtil getProcessResult.204 - opmnctl cmd error:
2010-09-08 08:12:57,008 [main] INFO  util.WebTierUtil getProcessResult.208 - opmnctl cmd exited with code 0
2010-09-08 08:12:57,012 [main] INFO  util.WebTierUtil execCmd.134 - Running the command: /u01/app/gc_inst/WebTierIH1/bin/opmnctl startall
2010-09-08 08:13:03,388 [main] INFO  util.WebTierUtil getProcessResult.196 - opmnctl cmd output: opmnctl startall: starting opmn and all managed processes...

2010-09-08 08:13:03,390 [main] INFO  util.WebTierUtil getProcessResult.204 - opmnctl cmd error:
2010-09-08 08:13:03,391 [main] INFO  util.WebTierUtil getProcessResult.208 - opmnctl cmd exited with code 0
2010-09-08 08:13:03,392 [main] INFO  wls.OMSController startOMS.519 - WebTier Successfully Started
2010-09-08 08:13:03,394 [main] INFO  wls.OMSController startOMS.545 - wlst command is /u01/app/midware/oracle_common/common/bin/wlst.sh /u01/app/midware/oms11g/bin/startOMS.py
2010-09-08 08:13:03,395 [main] INFO  wls.OMSController startOMS.546 - Executing the wlst command for startOMS...
2010-09-08 08:13:03,396 [main] INFO  wls.OMSController startOMS.556 - optional admin start is false
2010-09-08 08:13:03,525 [Thread-1] INFO  wls.OMSController run.1094 - 
.......
2010-09-08 08:13:10,422 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>Successfully Connected to Node Manager.
2010-09-08 08:13:10,424 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>status of node manager:
2010-09-08 08:13:10,426 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>Currently connected to Node Manager to monitor the domain GCDomain.
2010-09-08 08:13:10,427 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>current status of EMGC_ADMINSERVER:
2010-09-08 08:13:10,430 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>
2010-09-08 08:13:10,431 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>RUNNING
2010-09-08 08:13:10,431 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>
2010-09-08 08:13:10,432 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>current status of EMGC_OMS1:
2010-09-08 08:13:10,433 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>
2010-09-08 08:13:10,434 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>STARTING
2010-09-08 08:13:10,435 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>
2010-09-08 08:13:10,435 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>wait until EMGC_OMS1 becomes RUNNING
2010-09-08 08:13:10,437 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>
2010-09-08 08:13:10,438 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>STARTING
2010-09-08 08:13:10,438 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>
2010-09-08 08:13:10,439 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>sleep for 10 seconds...
2010-09-08 08:13:20,446 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>status of EMGC_OMS1:
.........
repeating starting many times
.........
2010-09-08 08:16:10,553 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>STARTING
2010-09-08 08:16:10,553 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>
2010-09-08 08:16:10,554 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>timed out waiting for EMGC_OMS1 to be RUNNING
2010-09-08 08:16:10,554 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>status of node manager:
2010-09-08 08:16:10,555 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>Currently connected to Node Manager to monitor the domain GCDomain.
2010-09-08 08:16:10,555 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>1
2010-09-08 08:16:10,556 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>Successfully disconnected from Node Manager.
2010-09-08 08:16:10,557 [Thread-1] INFO  wls.OMSController run.1094 - <OUT>_END_
2010-09-08 08:16:10,558 [Thread-2] INFO  wls.OMSController run.1094 - <ERR>_END_
2010-09-08 08:16:10,617 [main] INFO  wls.OMSController processCmd.988 - wlst process is finished
2010-09-08 08:16:10,617 [main] INFO  wls.OMSController processCmd.990 - wlst process exited with code 5
2010-09-08 08:16:10,617 [main] INFO  wls.OMSController processCmd.992 - wlst outstream joined
2010-09-08 08:16:10,618 [main] INFO  wls.OMSController processCmd.994 - wlst errstream joined
2010-09-08 08:16:10,621 [main] DEBUG oms.StatusOMSCmd processStatusOMS.138 - HTTP port in emgc property file: 7202
2010-09-08 08:16:10,621 [main] DEBUG oms.StatusOMSCmd processStatusOMS.139 - HTTPS port in emgc property file: 7301
2010-09-08 08:16:10,621 [main] DEBUG oms.StatusOMSCmd processStatusOMS.155 - Using http port.
2010-09-08 08:16:10,763 [main] DEBUG oms.StatusOMSCmd processStatusOMS.195 - Attempting to connect to http://cchbi.thinkstream.com:7202/em/console/logon/logon
2010-09-08 08:16:10,795 [main] INFO  oms.StatusOMSCmd processStatusOMS.233 - Failed to connect to em login page
2010-09-08 08:16:10,795 [main] INFO  oms.StatusOMSCmd processStatusOMS.234 - Connection refused
2010-09-08 08:16:10,795 [main] INFO  wls.OMSController statusOMS.950 - statusOMS finished with result: 8
2010-09-08 08:16:10,796 [main] INFO  wls.OMSController startOMS.603 - startOMS finished with result: 5
2010-09-08 08:16:10,797 [main] DEBUG oms.StatusOMSCmd processStatusOMS.138 - HTTP port in emgc property file: 7202
2010-09-08 08:16:10,797 [main] DEBUG oms.StatusOMSCmd processStatusOMS.139 - HTTPS port in emgc property file: 7301
2010-09-08 08:16:10,797 [main] DEBUG oms.StatusOMSCmd processStatusOMS.155 - Using http port.
2010-09-08 08:16:10,798 [main] DEBUG oms.StatusOMSCmd processStatusOMS.195 - Attempting to connect to http://cchbi.thinkstream.com:7202/em/console/logon/logon
2010-09-08 08:16:10,799 [main] INFO  oms.StatusOMSCmd processStatusOMS.233 - Failed to connect to em login page
2010-09-08 08:16:10,799 [main] INFO  oms.StatusOMSCmd processStatusOMS.234 - Connection refused
2010-09-08 08:16:10,800 [main] INFO  wls.OMSController statusOMS.950 - statusOMS finished with result: 8
Sorry for the long message, and thank for any help.

Answers

  • 796669
    796669 Member Posts: 1
    Did the server go down .

    You may want to check the following :

    1. The database (repository)
    2. the Listener
    3. OMS
    4. agent
  • cdcr
    cdcr Member Posts: 60 Blue Ribbon
    edited Sep 8, 2010 2:19PM
    Try this ... It works for me.

    $ORACLE_HOME/bin/lsnrctl start
    sleep 15

    $ORACLE_HOME/bin/sqlplus /nolog <<EOF1
    connect / as sysdba
    startup
    EOF1
    sleep 15

    $OMA_HOME/bin/emctl start agent

    $OMS_HOME/bin/emctl start oms

    $OMS_HOME/opmn/bin/opmnctl startall

    $OMS_HOME/opmn/bin/opmnctl status

    ==================================

    $OMS_HOME/opmn/bin/opmnctl stopall
    Note: If stopall seems to be hung, ps -ef and kill all oms processes

    $OMA_HOME/bin/emctl stop agent

    $OMS_HOME/bin/emctl stop oms

    $ORACLE_HOME/bin/sqlplus /nolog <<EOF1
    connect / as sysdba
    shutdown immediate
    EOF1

    $ORACLE_HOME/bin/lsnrctl stop

    Edited by: feverlove on Sep 8, 2010 11:18 AM
  • user13148231
    user13148231 Member Posts: 299
    $OMS_HOME/opmn/bin/opmnctl startall 
    I got error when doing this
    [[[email protected] bin]$ cd /u01/app/midware/oms11g/opmn/bin
    [[email protected] bin]$ ./opmnctl startall
    opmnctl: ORACLE_INSTANCE is not set.
    
    opmnctl startall requires that ORACLE_INSTANCE be correctly set in your
    environment.
    
    Make sure you are using ORACLE_INSTANCE/bin/opmnctl, or set ORACLE_INSTANCE
    in your environment.
    How to set the parameter ORACLE_INSTANCE?
  • user13148231
    user13148231 Member Posts: 299
    I searched for opmnctl
    [[email protected] midware]$ find . |grep opmnctl
    ./agent11g/opmn/bin/opmnctl.tmp
    ./agent11g/opmn/bin/opmnctl
    ./agent11g/inventory/Templates/opmn/bin/opmnctl.tmp
    ./oms11g/opmn/bin/opmnctl.tmplt
    ./oms11g/opmn/bin/opmnctl
    ./oms11g/inventory/Templates/opmn/bin/opmnctl.tmplt
    ./Oracle_WT/opmn/bin/opmnctl.tmplt
    ./Oracle_WT/opmn/bin/opmnctl
    ./Oracle_WT/inventory/Templates/opmn/bin/opmnctl.tmplt
    and run each opmnctl
    [[email protected] midware]$ ./Oracle_WT/opmn/bin/opmnctl status
    opmnctl: ORACLE_INSTANCE is not set.
    
    opmnctl status requires that ORACLE_INSTANCE be correctly set in your
    environment.
    
    Make sure you are using ORACLE_INSTANCE/bin/opmnctl, or set ORACLE_INSTANCE
    in your environment.
    [[email protected] midware]$ ./agent11g/opmn/bin/opmnctl status
    Unable to connect to opmn.
    Opmn may not be up.
    [[email protected] midware]$ ./agent11g/opmn/bin/opmnctl startall
    opmnctl: starting opmn and all managed processes...
    /u01/app/midware/agent11g/opmn/bin/opmn: error while loading shared libraries: libcxa.so.3: cannot open shared object file: No such file or directory
    [[email protected] midware]$ ./oms11g/opmn/bin/opmnctl status
    opmnctl: ORACLE_INSTANCE is not set.
    
    opmnctl status requires that ORACLE_INSTANCE be correctly set in your
    environment.
    
    Make sure you are using ORACLE_INSTANCE/bin/opmnctl, or set ORACLE_INSTANCE
    in your environment.
    Meantime there are 2 opmn processes running
    [[email protected] midware]$ ps -fe|grep opmn
    oracle    1047     1  0 Sep08 ?        00:00:00 /u01/app/midware/Oracle_WT/opmn/bin/opmn -d
    oracle    1048  1047  0 Sep08 ?        00:00:00 /u01/app/midware/Oracle_WT/opmn/bin/opmn -d
    Strange!
  • EricvdS
    EricvdS Member Posts: 976 Bronze Trophy
    edited Sep 10, 2010 4:50PM
    Try:
    export ORACLE_INSTANCE=/u01/app/midware/oms11g

    But did you follow feverlove's startup description?
    Read this how to stop/start it all: http://oracle-wiki.net/startdocsgridcontrollinuxknownissues11g#toc6

    Eric
  • user13148231
    user13148231 Member Posts: 299
    edited Sep 13, 2010 2:37PM
    Not work
    export ORACLE_INSTANCE=/u01/app/midware/oms11g
    [[email protected] dbs]$ $ORA_OMS_HOME/opmn/bin/opmnctl status
    opmnctl: Invalid ORACLE_INSTANCE (/u01/app/midware/oms11g/config/OPMN/opmn/opmn.xml is missing).
    Set ORACLE_INSTANCE=/u01/app/midware/agent11g got the same error. Find one and only one opmn.xml :
    /u01/app/midware/agent11g/opmn/conf/opmn.xml  
    It is not under anything like config/OPMN/opmn
    I looked into the reference
    http://oracle-wiki.net/startdocsgridcontrollinuxknownissues11g#toc6
    Accordint to the reference, I do not need to run opmn. It may alerady covered by start oms.

    Is that correct?
  • 613650
    613650 Member Posts: 10
    That is correct. Refer to Metalink 11.1.0.1 Grid Control: opmnctl startall Gives Error: opmnctl: ORACLE_INSTANCE is not set [ID 1160335.1] . For 11.1 opmnctl startall is no longer applicable.
  • Cause

    In the 11.1.0.1 Grid Control release, "opmnctl" is not a valid command for starting the OMS as the 11g OMS is deployed in Weblogic server unlike 10g version which is deployed on an OC4J.
    opmnctl utility should be used to start the OMS only in the 10g versions of Grid Control nad NOT in the 11g Grid Control version.

    Solution

    Grid Control 11.1.0.1 uses "emctl" command to start Grid Control:

    cd OMS_HOME/bin
    +./emctl start oms+

    This will start the Grid Control 11.1.0.1 OMS as well as starting the necessary Weblogic processes needed by the OMS.
This discussion has been closed.