EM Cloud Control 12c has no databases

David_Pasternak
    Hello @ all,

    i've installed Enterprise Manager Cloud Control 12.1.0.2.0 on a virtual machine with RedHat Linux 6 and configured the EM by installing it so, that he should connect to my test database server with Oracle 11g 11.2.0.3.0 to watch over that. The installer get a valid connection to that database server.

    Now, after install, i want to test the connection. So i started the Overview of EMCC in my browser, connected as SYSMAN, selected the "Database Home" and at the frame "Database Loadmap" there displays the message "no databases available". But the database at the test server is running without any problem:
    lsnrctl status
    
    LSNRCTL for Linux: Version 11.2.0.3.0 - Production on 07-JUN-2013 09:39:52
    
    Copyright (c) 1991, 2011, Oracle.  All rights reserved.
    
    Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=dbtest2.berl.axway.int)(PORT=1521)))
    STATUS of the LISTENER
    ------------------------
    Alias                     LISTENER
    Version                   TNSLSNR for Linux: Version 11.2.0.3.0 - Production
    Start Date                17-MAY-2013 10:05:48
    Uptime                    20 days 23 hr. 34 min. 3 sec
    Trace Level               off
    Security                  ON: Local OS Authentication
    SNMP                      OFF
    Listener Parameter File   /home/oracle/srv/ora/product/11.2.0/dbtest_2/network/admin/listener.ora
    Listener Log File         /home/oracle/srv/ora/diag/tnslsnr/dbtest2/listener/alert/log.xml
    Listening Endpoints Summary...
      (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=dbtest2.berl.axway.int)(PORT=1521)))
      (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC1521)))
      (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=dbtest2.berl.axway.int)(PORT=8080))(Presentation=HTTP)(Session=RAW))
    Services Summary...
    Service "<hostname>" has 1 instance(s).
      Instance "<hostname>", status READY, has 1 handler(s) for this service...
    Service "<hostname>" has 1 instance(s).
      Instance "dbtest2", status READY, has 1 handler(s) for this service...
    The command completed successfully
    SQL> select * from v$instance;
    
    INSTANCE_NUMBER INSTANCE_NAME    HOST_NAME                                                        VERSION           STARTUP_TIME        STATUS       PAR    THREAD# ARCHIVE LOG_SWITCH_WAIT LOGINS     SHU DATABASE_STATUS   INSTANCE_ROLE     ACTIVE_ST BLO
    --------------- ---------------- ---------------------------------------------------------------- ----------------- ------------------- ------------ --- ---------- ------- --------------- ---------- --- ----------------- ------------------ --------- ---
                  1 dbtest2          dbtest2                                                          11.2.0.3.0        06/06/2013 09:51:08 OPEN         NO           1 STARTED                 ALLOWED    NO  ACTIVE           PRIMARY_INSTANCE   NORMAL    NO
    Also the agent of EMCC is running too:
    ./emctl status agent
    Oracle Enterprise Manager Cloud Control 12c Release 2
    Copyright (c) 1996, 2012 Oracle Corporation.  All rights reserved.
    ---------------------------------------------------------------
    Agent Version     : 12.1.0.2.0
    OMS Version       : (unknown)
    Protocol Version  : 12.1.0.1.0
    Agent Home        : /path/to/agent_inst
    Agent Binaries    : /path/to/oracle/agent/core/12.1.0.2.0
    Agent Process ID  : 2814
    Parent Process ID : 2768
    Agent URL         : https://<hostname>:3872/emd/main/
    Repository URL    : https://<hostname>:4903/empbs/upload
    Started at        : 2013-06-07 11:18:13
    Started by user   : oracle
    Last Reload       : (none)
    Last successful upload                       : (none)
    Last attempted upload                        : 2013-06-07 11:18:36
    Total Megabytes of XML files uploaded so far : 0
    Number of XML files pending upload           : 73
    Size of XML files pending upload(MB)         : 0,27
    Available disk space on upload filesystem    : 45,74%
    Collection Status                            : Collections enabled
    Heartbeat Status                             : Agent is blocked
    Last attempted heartbeat to OMS              : 2013-06-07 11:39:36
    Last successful heartbeat to OMS             : (none)
    Next scheduled heartbeat to OMS              : 2013-06-07 11:42:36
    
    ---------------------------------------------------------------
    Agent is Running and Ready
    So what could i do more to find out the problem? Which logs would you need for more information?

    Thanks a lot and best regards,
    David
      • 1. Re: EM Cloud Control 12c has no databases
        Venkata Thiruveedhi-Oracle
        Hi David,

        Thanks for the outputs uploaded.

        The agent status output confirms there is some issue:

        OMS Version : (unknown)
        Last Reload : (none)
        Last successful upload : (none)
        Total Megabytes of XML files uploaded so far : 0

        So, need to confirm if the upload is happening fine & Agent to OMS server communication is happening correctly or not.

        Provide the following information:

        1. Output of the below commands:

        ./emctl upload
        ./emctl pingOMS

        2. Upload the targets.xml file from the location:
        .../agent_inst/sysman/emd/*

        3. What is the status of the agent in 12c Console? Navigate to the Agent Home page and confirm if every thing looks good with out errors. If you are not able to determine it, upload the screen shot of the same.

        Best Regards,
        Venkat
        • 2. Re: EM Cloud Control 12c has no databases
          David_Pasternak
          I've found a tip, that i have to resync the agent at this page:

          http://www.jaggy.com/community/thread/1040

          But after the steps i've tried to ping the OMS, but same error occured:
          emctl pingOMS
          Oracle Enterprise Manager Cloud Control 12c Release 2
          Copyright (c) 1996, 2012 Oracle Corporation.  All rights reserved.
          ---------------------------------------------------------------
          EMD pingOMS error: The agent is blocked by the OMS. Agent is out-of-sync with repository. This most likely means that the agent was reinstalled or recovered. Please contact an EM administrator to unblock the agent by performing an agent resync from the console.
          • 3. Re: EM Cloud Control 12c has no databases
            David_Pasternak
            Hi venkat,

            thanks for quick answer. Here more informations:

            ./emctl upload:
            Oracle Enterprise Manager Cloud Control 12c Release 2
            Copyright (c) 1996, 2012 Oracle Corporation.  All rights reserved.
            ---------------------------------------------------------------
            EMD upload error:full upload has failed: The agent is blocked by the OMS. Agent is out-of-sync with repository. This most likely means that the agent was reinstalled or recovered. Please contact an EM administrator to unblock the agent by performing an agent resync from the console. (AGENT_BLOCKED)
            ./emctl pingOMS:
            ./emctl pingOMS
            Oracle Enterprise Manager Cloud Control 12c Release 2
            Copyright (c) 1996, 2012 Oracle Corporation.  All rights reserved.
            ---------------------------------------------------------------
            EMD pingOMS error: The agent is blocked by the OMS. Agent is out-of-sync with repository. This most likely means that the agent was reinstalled or recovered. Please contact an EM administrator to unblock the agent by performing an agent resync from the console.
            Thats that, and here is a screenshot of the Agent Console:
            http://img811.imageshack.us/img811/3631/agentconsole.jpg

            Thanks and regards,
            David
            • 4. Re: EM Cloud Control 12c has no databases
              Venkata Thiruveedhi-Oracle
              Here are the steps for resync in 12c:

              1. Login to 12C console
              2. Navigate to Setup --> Agents
              3. Click on the problematic agent
              4. Click on drop down menu "Agent" and Choose "Resynchronization" in the menu list.
              5. Choose the option to "Unblock agent on successful completion of agent resynchronization." and Click on Continue

              NOTE: Make sure the Agent is available in 12c console.

              Best Regards,
              Venkat
              • 5. Re: EM Cloud Control 12c has no databases
                David_Pasternak
                Sorry for stupid questions, but that's my first time with EMCC. I have the link to 12c console, its that with port 7102, but what was the user for that in standard? I can't remember...
                • 6. Re: EM Cloud Control 12c has no databases
                  Venkata Thiruveedhi-Oracle
                  Hi,

                  The URL that had the port 7102 should be Admin Server Console and in the user would be "weblogic"

                  Best Regards,
                  Venkat
                  • 7. Re: EM Cloud Control 12c has no databases
                    David_Pasternak
                    I can't find that on 12c console...

                    EDIT: Now i've found the link. I was just too blind. The EM is now Resyncing the Agent. But it seems to take some time...

                    Edited by: David_Pasternak on 07.06.2013 03:42
                    • 8. Re: EM Cloud Control 12c has no databases
                      David_Pasternak
                      After some minutes he was ready with resyncronisation. But now the EM Console told me, that the agent woulnd't be available.

                      So i looked for it:
                      emctl status agent
                      Oracle Enterprise Manager Cloud Control 12c Release 2
                      Copyright (c) 1996, 2012 Oracle Corporation.  All rights reserved.
                      ---------------------------------------------------------------
                      Agent Version     : 12.1.0.2.0
                      OMS Version       : 12.1.0.2.0
                      Protocol Version  : 12.1.0.1.0
                      Agent Home        : /path/to/oracle/agent/agent_inst
                      Agent Binaries    : /path/to/oracle/agent/core/12.1.0.2.0
                      Agent Process ID  : 4529
                      Parent Process ID : 4483
                      Agent URL         : https://<hostname>:3872/emd/main/
                      Repository URL    : https://<hostname>:4903/empbs/upload
                      Started at        : 2013-06-07 14:32:22
                      Started by user   : oracle
                      Last Reload       : (none)
                      Last successful upload                       : 2013-06-07 14:53:07
                      Last attempted upload                        : 2013-06-07 14:53:12
                      Total Megabytes of XML files uploaded so far : 0,09
                      Number of XML files pending upload           : 13
                      Size of XML files pending upload(MB)         : 0,01
                      Available disk space on upload filesystem    : 45,32%
                      Collection Status                            : Collections enabled
                      Heartbeat Status                             : Ok
                      Last attempted heartbeat to OMS              : 2013-06-07 14:52:28
                      Last successful heartbeat to OMS             : 2013-06-07 14:52:28
                      Next scheduled heartbeat to OMS              : 2013-06-07 14:53:28
                      
                      ---------------------------------------------------------------
                      Agent is Running and Ready
                      Also a ping to OMS is successfully:
                      emctl pingOMS
                      Oracle Enterprise Manager Cloud Control 12c Release 2
                      Copyright (c) 1996, 2012 Oracle Corporation.  All rights reserved.
                      ---------------------------------------------------------------
                      EMD pingOMS completed successfully
                      Emctl upload says the same:
                      emctl upload
                      Oracle Enterprise Manager Cloud Control 12c Release 2
                      Copyright (c) 1996, 2012 Oracle Corporation.  All rights reserved.
                      ---------------------------------------------------------------
                      EMD upload completed successfully
                      But why is the agent now not available?


                      EDIT: i've restarted the agent and now he is up!!! Yes!

                      But in home screen he also tels me, that he can't find a database :(

                      Edited by: David_Pasternak on 07.06.2013 03:59
                      • 9. Re: EM Cloud Control 12c has no databases
                        EricvdS

                        Check note: How To Manually Add Database Targets in 12C Cloud Control and Known Issues

                        how you can do tahat.

                         

                        Eric