8 Replies Latest reply: Jun 24, 2011 4:54 AM by drbiloukos RSS

    Http Communication error: 404, While Starting Collector

    Hungry DBA
      Hi,

      Having setup of 2 Node 11gR2 RAC on RHEL 5.5. Installed AV Server and Agent on Standalone machine to collect DBAUD and REDO logs. Installed AV Agent on both RAC Nodes to collect OSAUD logs. My AV Server and AV Agent are on 10.2.3.2 version.

      When I initialized to start Collector for DBAUD, REDO and OSAUD. Getting following error. [although all agents are running on respective nodes]

      [oracle@HMCSPV0921 av]$ avctl start_collector -collname DBAUD_Collector -srcname SRCHIGHTIDE.HIGHMARK.INTRA
      Starting collector...
      Error executing command start_collector
      Http Communication error: Http Communication error: 404

      [oracle@HMCSPV0921 av]$ avctl start_collector -collname REDO_Collector -srcname SRCHIGHTIDE.HIGHMARK.INTRA
      Starting collector...
      Error executing command start_collector
      Http Communication error: Http Communication error: 404


      [oracle@HMCSPV0921 admin]$ avctl start_collector -collname OSAUD_Collector_HIGHTIDE2 -srcname SRCHIGHTIDE.HIGHMARK.INTRA
      Starting collector...
      Error executing command start_collector
      Http Communication error: Http Communication error: 404

      But Successfully started for OSAUD_Collector_HIGHTIDE1 and even could see UP from AV Enerprise Manager.

      [oracle@HMCSPV0921 av]$ avctl show_collector_status -collname OSAUD_Collector_HIGHTIDE1 -srcname SRCHIGHTIDE.HIGHMARK.INTRA
      Getting collector metrics...
      --------------------------------
      Collector is running
      Records per second = 0.00
      Bytes per second = 0.00
      --------------------------------

      Tried to stop agent and restarted again but didn't workout.

      My TNS entry is as follows in Agent Home on all Nodes..

      # Alias for SRCHIGHTIDE.HIGHMARK.INTRA
      #SRCDB1 = (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=HMCSPS01-VIP.HIGHMARK.INTRA)(PORT=1521))(CONNECT_DATA=(SERVICE_NAME=hightide.HIGHMARK.INTRA)))

      SRCDB1 =
      (DESCRIPTION=
      (LOAD_BALANCE=on)
      (FAILOVER=on)
      (ADDRESS=(PROTOCOL=tcp)(HOST=HMCSPS01-VIP.HIGHMARK.INTRA)(PORT=1521))
      (ADDRESS=(PROTOCOL=tcp)(HOST=HMCSPS02-VIP.HIGHMARK.INTRA)(PORT=1521))
      (CONNECT_DATA=
      (SERVICE_NAME=hightide.HIGHMARK.INTRA)
      )
      )

      Checked avca.log but not found and relevent info.

      02/03/11 08:00:19 Executing command start_collector, -collname, REDO_Collector, -srcname, SRCHIGHTIDE.HIGHMARK.INTRA
      02/03/11 08:00:19 Starting collector...
      02/03/11 08:00:19 xml - /avserver/product/10.2.3/av_1/oc4j/j2ee/OC4J_DBConsole_HMCSPV0921.HIGHMARK.INTRA_av/config/av-web-site.xml
      02/03/11 08:00:19 xml URL - file:/avserver/product/10.2.3/av_1/oc4j/j2ee/OC4J_DBConsole_HMCSPV0921.HIGHMARK.INTRA_av/config/av-web-site.xml
      02/03/11 08:00:21 Error executing command start_collector
      Http Communication error: Http Communication error: 404
      at oracle.av.common.AuditException.toAuditException(AuditException.java:252)
      at oracle.av.action.HttpActionContext.getData(HttpActionContext.java:182)
      at oracle.av.action.HttpActionContext.getData(HttpActionContext.java:228)
      at oracle.av.action.HttpActionContext.next(HttpActionContext.java:298)
      at oracle.av.action.ActionProcessor.next(ActionProcessor.java:72)
      at oracle.av.action.ActionProcessorDelegate.execute(ActionProcessorDelegate.java:79)
      at oracle.av.action.ActionProcessorDelegate.startCollector(ActionProcessorDelegate.java:207)
      at oracle.av.avca.control.StartCollectorTask.executeTask(StartCollectorTask.java:95)
      at oracle.av.avca.backend.BaseTask.execute(BaseTask.java:104)
      at oracle.av.avca.Avctl.startCTL(Avctl.java:163)
      at oracle.av.avca.Avctl.main(Avctl.java:193)
      Nested Exception:
      Http Communication error: 404
      at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
      at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
      at java.lang.reflect.Constructor.newInstance(Constructor.java:274)
      at oracle.av.common.AuditException.toAuditException(AuditException.java:249)
      at oracle.av.action.HttpActionContext.getData(HttpActionContext.java:182)
      at oracle.av.action.HttpActionContext.getData(HttpActionContext.java:228)
      at oracle.av.action.HttpActionContext.next(HttpActionContext.java:298)
      at oracle.av.action.ActionProcessor.next(ActionProcessor.java:72)
      at oracle.av.action.ActionProcessorDelegate.execute(ActionProcessorDelegate.java:79)
      at oracle.av.action.ActionProcessorDelegate.startCollector(ActionProcessorDelegate.java:207)
      at oracle.av.avca.control.StartCollectorTask.executeTask(StartCollectorTask.java:95)
      at oracle.av.avca.backend.BaseTask.execute(BaseTask.java:104)
      at oracle.av.avca.Avctl.startCTL(Avctl.java:163)
      at oracle.av.avca.Avctl.main(Avctl.java:193)
      02/03/11 08:02:17 Executing command show_collector_status, -collname, OSAUD_Collector_HIGHTIDE1, -srcname, SRCHIGHTIDE.HIGHMARK.INTRA
      02/03/11 08:02:17 Getting collector metrics...
      02/03/11 08:02:18 xml - /avserver/product/10.2.3/av_1/oc4j/j2ee/OC4J_DBConsole_HMCSPV0921.HIGHMARK.INTRA_av/config/av-web-site.xml
      02/03/11 08:02:18 xml URL - file:/avserver/product/10.2.3/av_1/oc4j/j2ee/OC4J_DBConsole_HMCSPV0921.HIGHMARK.INTRA_av/config/av-web-site.xml
      02/03/11 08:02:18 --------------------------------
      02/03/11 08:02:18 Collector is running
      02/03/11 08:02:18 Records per second = 0.00
      02/03/11 08:02:18 Bytes per second = 0.00
      02/03/11 08:02:18 --------------------------------



      What could be the issue ???

      Any help would be appreciated....

      Regards,
      Manish
        • 1. Re: Http Communication error: 404, While Starting Collector
          683924
          Dear Manesh,

          It looks like the comunication error between AV server and source database please make sure you have the entries in the TNSname.ora file of both AV server and source databse .
          Please add the source databse entry of TNSNAME.ora file in the tnsname.ora file of AV server.
          • 2. Re: Http Communication error: 404, While Starting Collector
            Hungry DBA
            Hi Abbas,

            The TNS Entry for Source database is already their in the tnsnames.ora of AV Server and even I could connect to source database.

            SRCDB1 =
            (DESCRIPTION=
            (LOAD_BALANCE=on)
            (FAILOVER=on)
            (ADDRESS=(PROTOCOL=tcp)(HOST=HMCSPS01-VIP.HIGHMARK.INTRA)(PORT=1521))
            (ADDRESS=(PROTOCOL=tcp)(HOST=HMCSPS02-VIP.HIGHMARK.INTRA)(PORT=1521))
            (CONNECT_DATA=
            (SERVICE_NAME=hightide.HIGHMARK.INTRA)
            )
            )


            [oracle@HMCSPV0921 admin]$ sqlplus system/Highmark123@SRCDB1

            SQL*Plus: Release 10.2.0.4.0 - Production on Thu Feb 3 20:58:07 2011

            Copyright (c) 1982, 2007, Oracle. All Rights Reserved.


            Connected to:
            Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
            With the Partitioning, Real Application Clusters, Automatic Storage Management, Oracle Label Security,
            OLAP, Data Mining and Real Application Testing options

            SQL> select name from v$database;

            NAME
            ---------
            HIGHTIDE


            and same from both RAC Nodes (source database), I could able connect to AV Server Database.

            [oracle@HMCSPS01 admin]$ sqlplus avadmin/Highmark+123@AV

            SQL*Plus: Release 11.2.0.1.0 Production on Thu Feb 3 15:39:05 2011

            Copyright (c) 1982, 2009, Oracle. All rights reserved.


            Connected to:
            Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
            With the Partitioning, Oracle Label Security, OLAP, Data Mining,
            Oracle Database Vault and Real Application Testing options

            SQL> select name from v$database;

            NAME
            ---------
            AV


            What could be the other possible issue ???

            Thanks for your response...

            Regards,
            Manish
            • 3. Re: Http Communication error: 404, While Starting Collector
              683924
              hi manesh,

              from here it looks like the problem is av server is unable to connect to the
              source db , so on the source db please do , login to the source db and issue:

              alter system register;

              If it fails, check what are the services of the listener on your source db host,

              in the AV environment we rely on automatic instance registration, so make sure the order
              of starting up components is listener first and then the dbs, so they can properly register

              also make sure that ping and tnsping are working mean from avserver just ping the source database and from source database ping the av server if it works the do same with tnsping.


              ALSO the problem seems to be with port you should change the port no of source database to 1522. hope fully this will fix the problem.
              • 4. Re: Http Communication error: 404, While Starting Collector
                user12296100
                Was this ever resolved? We have the same issue in our test environment with a server/source db that we have been using for agent testing. It was working the first couple times we installed the agent - we have uninstalled and reinstalled a few times and after about the third time it started getting the 404 error. We put the agent on a different server and it works fine but we would like to know how to solve this before putting in production in case we get in a bind and have to re-install and this happens there.
                • 5. Re: Http Communication error: 404, While Starting Collector
                  850752
                  Hello,

                  we have same error with similar configuration:
                  - 2 node RAC as source
                  - Audit Vault 10g Database Release 10.2.3.2.0
                  - one OSAUD collector is working right
                  - other OSAUD collector have an error: "Http Communication error: Http Communication error: 404"

                  We checked connection strings to source on both avserver and avagent, and it is working ok.

                  avca.log shows:
                  05/17/11 05:03:00 Error executing command start_collector
                  Http Communication error: Http Communication error: 404
                  at oracle.av.common.AuditException.toAuditException(AuditException.java:252)
                  at oracle.av.action.HttpActionContext.getData(HttpActionContext.java:182)
                  ...

                  Any idea how to troubleshoot further this issue?


                  Thanks!
                  • 6. Re: Http Communication error: 404, While Starting Collector
                    706614
                    Hi guys:

                    The HTTP communication error can occur when the Audit Vault Server tries to send a command to the Audit Vault Agent - such as "start a collector" or "stop a collector". If the agent process is not up and running, there's a communication error on the network, or if the agent is somehow mis-configured so that it can't find the right HTTP handler, you'll get this error.

                    The connect strings from the agent either to the AV Server or the source database are not relevant in this case. These are for specifying SQL*Net connections, not HTTP connections.

                    You need to take a look at $ORACLE_HOME/av/log/agent*log in the agent home to see if the command actually made it to the agent at all.

                    I'd recommend working with Oracle Support to resolve the issue.
                    • 7. Re: Http Communication error: 404, While Starting Collector
                      587885
                      Hi Manish,

                      Did run this command during your installation steps:

                      SQL> @/oracle/product/10.2.3/av_server/av/scripts/streams/source/zarsspriv.sql
                      Enter value for 1: <source user>
                      Enter value for 2: SETUP
                      Granting privileges to SRCUSER_ORA ... Done.
                      • 8. Re: Http Communication error: 404, While Starting Collector
                        drbiloukos
                        Check Ports between AV server and Agent Host.