1 2 Previous Next 18 Replies Latest reply: Oct 9, 2012 11:36 AM by Marcelo Marques - ESRI RSS

    EM12c: Target SQL Server 32-bit shows "Status Pending"

    Marcelo Marques - ESRI
      ----------------------------------------------------------------
      Configuration:

      EM12c platform:
      Oracle Enterprise Linux 6.2(x86_64)
      Oracle Enterprise Database 11.2.0.3 (x86_64)
      Enterprise Manager Cloud Control 12c Release 1 (12.1.0.1) (x86_64)
      Microsoft SQL Server Plug-In 12.1.0.2.0 deployed in the Management Server

      Target:
      Windows Server 2003 Standard Edition Service Pack 2 (32-bit)
      SQL Server 2005 SP2 (Standard Edition) (32-bit)
      Microsoft SQL Server Plug-In 12.1.0.2.0 deployed in the Management Agent
      ----------------------------------------------------------------
      Problem:

      EM12C: Targets > Databases

      The SQL Server 32-bit target shows "Status Pending"

      Verified the Target Agent Logs and found.

      D:\oracle\Middleware\agent_inst\sysman\log\gcagent.log

      2012-09-20 17:36:25,833 [14939:C578F997] INFO - Adding a new target [microsoft_sqlserver_database.mssql_peregrine.esri.com]
      2012-09-20 17:36:28,271 [15029:7DDB51EF:GC.DPExecutor2.57 (CDProps:microsoft_sqlserver_database.mssql_peregrine.esri.com:agent_host)] WARN - Found a row with more columns than declared for the metric for TargetID = mssql_peregrine.esri.com, Metric = OSType_Agent_DynamicProperty
      Row = Microsoft Windows Server 2003 Standard Edition,,C:\\WINDOWS,\\Device\\Harddisk0\\Partition2
      2012-09-20 17:36:28,583 [15031:1C41A703:GC.DPExecutor2.58 (CDProps:microsoft_sqlserver_database.mssql_peregrine.esri.com:win_host_name)] WARN - Found a row with more columns than declared for the metric for TargetID = mssql_peregrine.esri.com, Metric = OSType_TargetHost_DynamicProperty
      Row = Microsoft Windows Server 2003 Standard Edition,,,C:\\WINDOWS,\\Device\\Harddisk0\\Partition2
      2012-09-20 17:36:28,755 [15073:9240A7B9:GC.DPExecutor.27 (CDynamic:microsoft_sqlserver_database.mssql_peregrine.esri.com)] INFO - Target: [microsoft_sqlserver_database.mssql_peregrine.esri.com] is broken: Dynamic Category property error
      2012-09-20 17:36:28,755 [15073:9240A7B9] INFO - Target: [microsoft_sqlserver_database.mssql_peregrine.esri.com] is broken: Dynamic Category property error,Get dynamic property error
      2012-09-20 17:36:29,286 [15073:9240A7B9] INFO - Starting collection for target: [microsoft_sqlserver_database.mssql_peregrine.esri.com$12]
      2012-09-20 17:36:29,286 [14939:C578F997] INFO - >>> Reporting response: AddTargetsResponse (request id 1) <<<
      2012-09-20 17:36:29,286 [14939:C578F997] INFO - (end processing requests for OMS@9151@mcsoracloud.esri.com=>[134818747370001])

      ----------------------------------------------------------------
      Tried the following without success:

      - remove target and add target again

      Database Username (Required for SQL Authentication): sa
      Password of Database User (Required for SQL Authentication): ****
      Role (Optional)     
      System Password (Needed when SQLServer is at remote location): <empty>
      System Username (Needed when SQLServer is at remote location): <empty>     
      Connect Using Windows Integrated Authentication (Yes/No): No
      JDBC Driver (Optional): com.microsoft.sqlserver.jdbc.SQLServerDriver
      JDBC URL (Example : jdbc:sqlserver://<host>:<port>): jdbc:sqlserver://peregrine.esri.com:1433

      - Add Target don't let me fill the System Password and System Username, get message that says is not required.

      - Configure target, usernames/passwords are set correctly, it let me fill the System Password and System Username, but the Target still shows "Pending Status".

      - Oracle support: EM12C : Agents Show As Status Pending After Fresh Install [ID 1478880.1]
      EM12c: Agents > peregrine.esri.com:3872 > Agent > Resynchronization

      Still Target shows "Pending Status"

      ----------------------------------------------------------------

      Have you seen this problem before? Any suggestions?

      Thanks,

      Marcelo Marques
      Esri-Technical Manager
        • 1. Re: EM12c: Target SQL Server 32-bit shows "Status Pending"
          caroy
          Is there a stacktrace in any of the agent logs which would indicate which dynamic category property failed or how?

          Can you enable the agent's metric browser and click on one or two of the metrics and see if the error message given there is more descriptive?
          • 2. Re: EM12c: Target SQL Server 32-bit shows "Status Pending"
            Marcelo Marques - ESRI
            #1. Is there a stacktrace in any of the agent logs which would indicate which dynamic category property failed or how?

            I have searched the other logs but didn't find any clue.
            cd D:\oracle\Middleware\agent_inst\sysman\log
            dir /o /b *.log
            emctl.log
            emdctlj.log
            gcagent.log
            gcagent_errors.log
            gcagent_mdu.log
            gcagent_targetinstaller.log
            Oracleagent12c1Agentexit.log
            Oracleagent12c1Agentsrvc.log
            patchAgtStPlugin.log
            secure.log

            #2. Can you enable the agent's metric browser and click on one or two of the metrics and see if the error message given there is more descriptive?

            I opened EM12c: Setup > Agents > peregrine.esri.com:3872 > Agent > Monitoring > All Metrics
            And, all metrics display fine

            Thanks, Marcelo.
            • 3. Re: EM12c: Target SQL Server 32-bit shows "Status Pending"
              caroy
              Add these 2 lines to your agent's emd.properties file:

              _enableMetricBrowser=true
              _metricBrowserNoLogin=true

              Restart your agent. Find the EMD_URL in your emd.properties file and the URL you want to go to is nearly the same but instead of "emd/main" on the end, you want "emd/browser/main"

              This gives you direct access to the target instances monitored by the agent. You can click on an instance and see all the metrics available. If you click on one of those metrics, it will do a live collection of the metric and present you with the results. You'll want to attempt to do that to see what error is returned (and if anything new appears in any of the logs).
              • 4. Re: EM12c: Target SQL Server 32-bit shows "Status Pending"
                Marcelo Marques - ESRI
                Hi,

                I made the change to emd.properties and restarted the agent.
                I opened the URL=https://peregrine.esri.com:3872/emd/browser/main/
                And, opened each metric, they all show "collection status = successfull collection".
                Below are the metrics that are displayed.
                ------------------------------------------------------------------------------------------------
                URL=https://peregrine.esri.com:3872/emd/browser/main/

                Target=(microsoft_sqlserver_database,mssql_peregrine.esri.com)
                Collection Item Name Metric Collections
                Response Response
                Status_Agent Status_Agent
                SQLServer MSSQL_SQLServer, MSSQL_RegistrySetting, MSSQL_DatabaseSetting
                MSSQL_Database MSSQL_Database
                MSSQL_DatabaseFile MSSQL_DatabaseFile
                MSSQL_TransactionLog MSSQL_TransactionLog
                MSSQL_Process MSSQL_Process, MSSQL_ProcessStats, MSSQL_Processor
                MSSQL_DatabaseParameter MSSQL_DatabaseParameter
                MSSQL_ErrorLogEntry_2005 MSSQL_ErrorLogEntry_2005
                MSSQL_DatabaseLock MSSQL_DatabaseLock
                MSSQL_DatabaseJob MSSQL_DatabaseJob
                MSSQL_ServerStatistics MSSQL_ServerStatistics
                MSSQL_MemoryStatistics MSSQL_MemoryStatistics
                MSSQL_LastDatabaseBackup MSSQL_LastDatabaseBackup
                MSSQL_db_index_physical_stats MSSQL_db_index_physical_stats
                MSSQL_NumClusterNodesForCluster MSSQL_NumClusterNodesForCluster
                MSSQL_ClusterNodes MSSQL_ClusterNodes
                MSCluster_Cluster MSCluster_Cluster
                MSCluster_Node MSCluster_Node
                MSCluster_Resource MSCluster_Resource
                MSCluster_NumNodes MSCluster_NumNodes
                MSCluster_ResourceTypeToResource MSCluster_ResourceTypeToResource
                MSCluster_ClusterToNetwork MSCluster_ClusterToNetwork
                MSCluster_ResourceGroupToResource MSCluster_ResourceGroupToResource
                MSCluster_NodeToActiveGroup MSCluster_NodeToActiveGroup
                MSCluster_ClusterToResourceGroup MSCluster_ClusterToResourceGroup
                MSCluster_NodeToActiveResource MSCluster_NodeToActiveResource
                MSCluster_ClusterToQuorumResource MSCluster_ClusterToQuorumResource
                MSCluster_ResourceToPossibleOwner MSCluster_ResourceToPossibleOwner
                MSCluster_ClusterToResource MSCluster_ClusterToResource
                MSCluster_ResourceGroupToPreferredNode MSCluster_ResourceGroupToPreferredNode

                Timestamp = 2012-09-24T17:00:53.933-07:00
                Logout https://peregrine.esri.com:3872/emd/browser/logout
                ------------------------------------------------------------------------------------------------

                In "EM12c >Targets > Databases > mssql_peregrine.esri.com" still shows the status as "Pending".
                (the status symbol is a clock, the other sqlserver instances show up with a green arrow.)

                Thanks, Marcelo.

                Edited by: Marcelo Marques - ESRI on Sep 24, 2012 5:17 PM
                • 5. Re: EM12c: Target SQL Server 32-bit shows "Status Pending"
                  caroy
                  Can you click on the Response metric and see what data you receive for that metric?
                  • 6. Re: EM12c: Target SQL Server 32-bit shows "Status Pending"
                    Marcelo Marques - ESRI
                    Hi, it returns "Response successful collection"

                    Target=(microsoft_sqlserver_database,mssql_peregrine.esri.com)

                    Collection Item Name     Metric Collections
                    Response     Response

                    Target=(microsoft_sqlserver_database,mssql_peregrine.esri.com)

                    Collection Item Name     collection status
                    Response     successful collection
                    Timestamp = 2012-09-25T10:02:06.838-07:00

                    Thanks, Marcelo.
                    • 7. Re: EM12c: Target SQL Server 32-bit shows "Status Pending"
                      caroy
                      If you click on "Response" it should show you a table where the metric columns of the metric are the table column headers and the value for each appear in the row below it.
                      • 8. Re: EM12c: Target SQL Server 32-bit shows "Status Pending"
                        Marcelo Marques - ESRI
                        Hi, I opened the URL https://peregrine.esri.com:3872/emd/browser/main/

                        This page shows up.
                        TargetType  TargetName  BrokenCode  BrokenReason  Status  Version  RunTime Version  Blackout Status  Severities  Schedule  CollectionItems
                        Agent     peregrine.esri.com:3872 0     MONITORED     2     false     Severities     Schedule     CollectionItems
                        Microsoft SQL Server     mssql_peregrine.esri.com 1028 MONITORED     1     false     Severities     Schedule     CollectionItems
                        ...

                        Then, clicked on the "Severities" link, this is what shows up.

                        Agent Severities:
                        Metric Name     ColumnName     KeyValue     Collection Name     Severity Level     Severity Timestamp
                        EMDAdditionalStatus          null     ProcessInfo     CLEAR     2012-09-20 17:37:35
                        EMDAdditionalStatus     OOM_Restart_Time          ProcessInfo     CLEAR     2012-09-20 17:04:52
                        EMDAllParameters          null     oracle_emd_config     CLEAR     2012-09-20 18:14:08
                        EMDConfigParams          null     oracle_emd_config     CLEAR     2012-09-20 18:14:08
                        EMDIdentity          null     EMDIdentity     CLEAR     2012-09-23 02:12:19
                        EMDJavaParams          null     oracle_emd_config     CLEAR     2012-09-20 18:14:08
                        EMDStatus          null     EMDUploadSystemMonitor     CLEAR     2012-09-20 17:25:40
                        EMDTargets          null     oracle_emd_config     CLEAR     2012-09-20 18:14:08
                        EMDUploadStats          null     EMDUploadSystemMonitor     CLEAR     2012-09-20 17:25:40
                        EMDUploadSystemMonitor          null     EMDUploadSystemMonitor     CLEAR     2012-09-20 17:25:40
                        EMDUserLimits          null     EMDUserLimits     CLEAR     2012-09-23 01:40:25
                        ProcessInfo          null     ProcessInfo     CLEAR     2012-09-20 17:37:35
                        Response     DefaultTimezoneInUse          Response     CLEAR     2012-09-24 16:58:09
                        Response     NmoSetuidStatus     null     Response     CLEAR     2012-09-21 18:02:09


                        Microsoft SQL Server Severities:
                        Metric Name     ColumnName     KeyValue     Collection Name     Severity Level     Severity Timestamp
                        *<the table is empty>*
                        Timestamp = 2012-09-25T13:22:18.869-07:00

                        Thanks, Marcelo.
                        • 9. Re: EM12c: Target SQL Server 32-bit shows "Status Pending"
                          caroy
                          Goto http://*/emd/browser/main
                          Click on your target instance (in the TargetName column)

                          This displays a list of metrics in a table for the target instance.

                          Click on the Response metric (in the MetricName column)

                          What is the output?

                          it should be a table with 4 columns, one of which is Status, but if there is an error that prevents your metrics from being collected successfully, it should show up here.
                          • 10. Re: EM12c: Target SQL Server 32-bit shows "Status Pending"
                            Marcelo Marques - ESRI
                            Hi,

                            https://peregrine.esri.com:3872/emd/browser/main/
                            Displays the page:
                            TargetType TargetName BrokenCode BrokenReason Status Version     RunTime Version Blackout Status     Severities     Schedule     CollectionItems
                            Host     peregrine.esri.com     0     MONITORED     1     false     Severities     Schedule     CollectionItems

                            Clicked on TargetName link "peregrine.esri.com"

                            This table displays

                            Target=(host,peregrine.esri.com)

                            Metric Name Collection History Detail  Merged History  Metric Definition  Execution Descriptor Query  Row source trace  Row source statistics  Incremental Config State
                            Response     ""     Response     Response     ""     Response     "" ""

                            Click on "Response" links and see follow.

                            Link column "Metric Name-Response":
                            "The following exception has occurred:
                                 Process invocation failure: java.io.IOException: Cannot run program "echo": CreateProcess error=2, The system cannot find the file specified"

                            Link column "Metric Definition-Response":
                            This XML file does not appear to have any style information associated with it. The document tree is shown below.
                            <metric metric_type="TABLE" metricLabel="Response" metricLabelNLSID="host_response" usageType="VIEW_COLLECT" keysFromMultiColls="false" test_Metric="false" keys_Only="false" long_Running="false" is_Config="false" is_Raw="false" is_Remote="false" is_Force_Cache="false" numCacheValues="1" is_Incremental="false" is_DeletionAllowed="true" is_Purgeable="true" isMetricExtension="false">
                            <tabledescriptor anyComputeExpr="">
                            <column column_name="Status" is_key="false" column_type="0" is_transient="false" is_timestamp="false" is_target_seperator="false" is_filename="false" is_clob="false" columnLabel="Status" columnLabelNLSID="host_response_status" replacedFetchedValue="false"/>
                            </tabledescriptor>
                            <QueryDescriptor cacheAggregation="false">
                            <QD fetchletId="OSLineToken"/>
                            <prop name="command" scope="GLOBAL" optional="false" content="echo"/>
                            <prop name="args" scope="GLOBAL" optional="false" content="em_result=1"/>
                            <prop name="startsWith" scope="GLOBAL" optional="false" content="em_result="/>
                            <prop name="delimiter" scope="GLOBAL" optional="false" content="|"/>
                            </QueryDescriptor>
                            </metric>

                            Link column "Row source trace - Response":
                            Metric=Response
                            Row source name     Table name     Operation     Row
                            TableRowSource          Alloc     
                            TableRowSource     Response     Start     
                            TableRowSource     Response     Rewind     
                            Timestamp = 2012-09-25T14:38:33.072-07:00

                            Thanks, Marcelo.
                            • 11. Re: EM12c: Target SQL Server 32-bit shows "Status Pending"
                              caroy
                              Make sure that you are clicking on the Response metric for your SQL Server target. You are clicking on the host instance.
                              • 12. Re: EM12c: Target SQL Server 32-bit shows "Status Pending"
                                Marcelo Marques - ESRI
                                Hi,

                                The SQL Server metrics table is empty, so I cannot open the "Response" metric.

                                https://peregrine.esri.com:3872/emd/browser/main/
                                TargetType TargetName BrokenCode BrokenReason Status Version RunTime Version Blackout Status Severities Schedule CollectionItems
                                Microsoft SQL Server     mssql_peregrine.esri.com 1028     MONITORED 1 false     Severities     Schedule     CollectionItems

                                Clicked on TargetName link "mssql_peregrine.esri.com"

                                The following page displays.

                                Target=(microsoft_sqlserver_database,mssql_peregrine.esri.com)

                                Metric Name Collection History Detail Merged History Metric Definition     Execution Descriptor Query Row source trace     Row source statistics     Incremental Config State
                                *<the table is empty, no rows, thus cannot open the "Response" metric>*
                                Timestamp = 2012-09-26T08:56:23.637-07:00
                                Logout https://peregrine.esri.com:3872/emd/browser/logout

                                Thanks, Marcelo
                                • 13. Re: EM12c: Target SQL Server 32-bit shows "Status Pending"
                                  caroy
                                  Can you confirm that the plug-in was deployed to the agent's plugins directory (plug-in ID is oracle.em.smss)?

                                  Can you also confirm that you put the jdbc drivers into the correct directory on the agent?
                                  • 14. Re: EM12c: Target SQL Server 32-bit shows "Status Pending"
                                    sxkumar
                                    At this stage, I would suggest creating a Service Request with Support so that we can resolve this issue faster.
                                    1 2 Previous Next