5 Replies Latest reply: Feb 14, 2013 6:59 AM by RLJII RSS

    running graphs in clover etl is failing

    user549949
      Hi All,

      I upgraded Endeca 2.3 to Endeca 2.4 .Now when I am running graphs in clover ETL I am getting below error :

      INFO main - *** CloverETL framework/transformation graph, (c) 2002-2012 Javlin a.s, released under GNU Lesser General Public License ***
      INFO main - Running with CloverETL library version 3.3.0 build#021 compiled 15/10/2012 15:10:55
      INFO main - Running on 2 CPU(s), OS Windows 7, architecture amd64, Java version 1.7.0_07, max available memory for JVM 1343488 KB
      INFO main - Loading default properties from: defaultProperties
      INFO main - Graph definition file: graph/InitDataStore.grf
      INFO main - Graph revision: 1.159 Modified by: mkressirer Modified: Thu Apr 05 11:49:39 EDT 2012
      INFO main - Checking graph configuration...
      INFO main - Graph configuration is valid.
      INFO main - Graph initialization (InitDataStore)
      INFO main - Clover Initializing phase: 0
      ERROR main - Error during graph initialization !
      Element 1331002769234:InitDataStore-Phase 0 can't be initialized.
      at org.jetel.graph.TransformationGraph.init(TransformationGraph.java:477)
      at org.jetel.graph.runtime.EngineInitializer.initGraph(EngineInitializer.java:272)
      at org.jetel.graph.runtime.EngineInitializer.initGraph(EngineInitializer.java:239)
      at org.jetel.main.runGraph.runGraph(runGraph.java:377)
      at org.jetel.main.runGraph.main(runGraph.java:341)
      Caused by: WEB_SERVICE_CLIENT0 ...FAILED !
      at org.jetel.graph.Phase.init(Phase.java:174)
      at org.jetel.graph.TransformationGraph.init(TransformationGraph.java:475)
      ... 4 more
      Caused by: Unable to establish Web Service proxy.
      at com.opensys.cloveretl.component.WebServiceClient.g(Unknown Source)
      at com.opensys.cloveretl.component.WebServiceClient.init(Unknown Source)
      at org.jetel.graph.Phase.init(Phase.java:169)
      ... 5 more
      Caused by: com.opensys.cloveretl.component.ws.exception.WSMessengerConfigurationException: Unable to establish WSDL analyzer.
      at com.opensys.cloveretl.component.ws.proxy.a.a(Unknown Source)
      ... 8 more
      Caused by: com.opensys.cloveretl.component.ws.exception.WSDLAnalyzeException: Unable to read WSDL file from location 'http://localhost:7770/ws/control?wsdl'.
      Response status: HTTP/1.1 503 java.lang.NullPointerException
      at com.opensys.cloveretl.component.ws.WSDLAnalyzer.<init>(Unknown Source)
      ... 9 more
      Caused by: oracle.j2ee.ws.wsdl.LocalizedWSDLException: WSDLException: faultCode=INVALID_WSDL: The document: http://localhost:7770/ws/control?wsdl is not a wsdl file or does not have a root element of "definitions" in the "http://schemas.xmlsoap.org/wsdl/" namespace or the "http://www.w3.org/2004/08/wsdl" namespace.
      at oracle.j2ee.ws.wsdl.xml.WSDLReaderImpl.parseDefinition(WSDLReaderImpl.java:779)
      at oracle.j2ee.ws.wsdl.xml.WSDLReaderImpl.readWSDL(WSDLReaderImpl.java:707)
      at oracle.j2ee.ws.wsdl.xml.WSDLReaderImpl.readWSDL(WSDLReaderImpl.java:338)
      at oracle.j2ee.ws.wsdl.xml.WSDLReaderImpl.readWSDL(WSDLReaderImpl.java:294)
      at oracle.j2ee.ws.wsdl.xml.WSDLReaderImpl.readWSDL(WSDLReaderImpl.java:278)
      ... 10 more

      Can someone please tell me how can this issue be resolved.

      Thanks a lot.

      Regards,
      Amrit
        • 1. Re: running graphs in clover etl is failing
          user549949
          My issue has got resolved.It was due to multiple endeca server instances running
          • 2. Re: running graphs in clover etl is failing
            592142
            May I know how the issue is resolved.

            I got the following error when ran graph
            2013-02-12 18:52:41,168 INFO 299958 [WatchDog] Successfully started all nodes in phase!
            2013-02-12 18:52:41,169 ERROR 299958 [ENDECA_BULK_ADD_OR_REPLACE_RECORDS1_299958] Bulk load port already in use. Only one bulk load connection is allowed at a time.
            2013-02-12 18:52:41,169 ERROR 299958 [ENDECA_BULK_ADD_OR_REPLACE_RECORDS1_299958] Received abort message from server: Bulk load port already in use. Only one bulk load connection is allowed at a time.
            2013-02-12 18:52:41,169 ERROR 299958 [ENDECA_BULK_ADD_OR_REPLACE_RECORDS1_299958] Exception creating the Consumer:
                 java.io.IOException: Bulk load port already in use. Only one bulk load connection is allowed at a time.
            2013-02-12 18:52:41,169 ERROR 299958 [WatchDog] Graph execution finished with error
            2013-02-12 18:52:41,169 ERROR 299958 [WatchDog] Node ENDECA_BULK_ADD_OR_REPLACE_RECORDS1 finished with status: ERROR caused by: Component pre-execute initialization failed.
            2013-02-12 18:52:41,169 ERROR 299958 [WatchDog] Node ENDECA_BULK_ADD_OR_REPLACE_RECORDS1 error details:
            Element [ENDECA_BULK_ADD_OR_REPLACE_RECORDS1:Add ALL Records to Endeca Server]-Component pre-execute initialization failed.
                 at org.jetel.graph.Node.run(Node.java:446)
                 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
                 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
                 at java.lang.Thread.run(Thread.java:662)
            Caused by: Exception creating the Consumer:
                 java.io.IOException: Bulk load port already in use. Only one bulk load connection is allowed at a time.
                 at com.endeca.clover.adapters.BaseAdapter.preExecute(BaseAdapter.java:131)
                 at org.jetel.graph.Node.run(Node.java:444)
                 ... 3 more
            Caused by: java.io.IOException: Bulk load port already in use. Only one bulk load connection is allowed at a time.
                 at com.endeca.BulkLoad.BulkIngester.sendBeginMessage(BulkIngester.java:231)
                 at com.endeca.BulkLoad.BulkIngester.begin(BulkIngester.java:180)
                 at com.endeca.clover.adapters.BulkAddConsumer.<init>(BulkAddConsumer.java:129)
                 at com.endeca.clover.adapters.BulkAddOrReplaceRecordsAdapter.getConsumer(BulkAddOrReplaceRecordsAdapter.java:124)
                 at com.endeca.clover.adapters.BulkAddOrReplaceRecordsAdapter.createConsumerThreads(BulkAddOrReplaceRecordsAdapter.java:134)
                 at com.endeca.clover.adapters.BaseAdapter.preExecute(BaseAdapter.java:111)
                 ... 4 more

            I modify the graph to only bulk load once. When I ran the graph, I still got the same error.
            I then ran resetDataStore, and also finished in error

            2013-02-12 18:56:18,364 ERROR 299959 [ENDECA_RESET_DATA_STORE0_299959] Read timed out Error connecting to Endeca Server. If applicable, ensure your SSL settings are correct.
            2013-02-12 18:56:18,364 ERROR 299959 [WatchDog] Graph execution finished with error
            2013-02-12 18:56:18,364 ERROR 299959 [WatchDog] Node ENDECA_RESET_DATA_STORE0 finished with status: ERROR caused by: Read timed out Error connecting to Endeca Server. If applicable, ensure your SSL settings are correct.; nested exception is:
                 org.apache.axis2.AxisFault: Read timed out
            2013-02-12 18:56:18,364 ERROR 299959 [WatchDog] Node ENDECA_RESET_DATA_STORE0 error details:
            java.rmi.RemoteException: Read timed out Error connecting to Endeca Server. If applicable, ensure your SSL settings are correct.; nested exception is:
                 org.apache.axis2.AxisFault: Read timed out

            Does anyone know what happend here?
            • 3. Re: running graphs in clover etl is failing
              RLJII
              The problem is listed right at the beginning of the log you posted:
              Bulk load port already in use. Only one bulk load connection is allowed at a time.
              You may already have a graph running when you run this one. Alternatively, you may have multiple Bulk Add/Replace Records components running in the same phase of a graph. If you have multiple Bulk Loaders in the same graph, try running them in different phases.

              RLJII
              • 4. Re: running graphs in clover etl is failing
                592142
                Thanks, yes, I realized that I had two graph of bulk load running at the same phase. The issue is how can I get rid off the problem. I did remove one graph, so I only have one graph doing the buld load, still I kept getting the same error. I tried ResetDataStore, but again finished in error.
                • 5. Re: running graphs in clover etl is failing
                  RLJII
                  The second error says Integrator can't reach your Endeca Server. Any number of things could cause this problem. For example, the server may not be running. Even transitory network latency can cause problems like this.

                  Are you able to query the WSDLs from your browser? What happens when you submit a web service request (for example, a status request) directly to the server?

                  RLJII