1 2 Previous Next 16 Replies Latest reply: Nov 15, 2012 12:28 PM by 953835 RSS

    Urgent:Partial update not running

    965290
      Hi ,

      Below exception comes while running the partial update:

      [09.30.12 00:10:16] INFO: Updating provisioning for component 'DailyReportGenerator'.
      [09.30.12 00:10:16] FINE: Retrieving app definition from cache for 'DailyReportGenerator'. No EAC query required.
      [09.30.12 00:10:16] FINEST: Querying for status of component DailyReportGenerator
      [09.30.12 00:10:16] INFO: Updating definition for component 'DailyReportGenerator'.
      [09.30.12 00:20:16] SEVERE: Caught an exception while checking provisioning.

      Caused by com.endeca.soleng.eac.toolkit.exception.EacCommunicationException
      com.endeca.soleng.eac.toolkit.component.Component updateEacDefinition - Caught exception while updating component definition.
      Caused by org.apache.axis.AxisFault
      org.apache.axis.AxisFault makeFault - ; nested exception is:
      java.net.SocketTimeoutException: Read timed out
      Caused by java.net.SocketTimeoutException
      java.net.SocketInputStream socketRead0 - Read timed out

      Please advise.

      Regards,
      Diwaker

      Edited by: 962287 on Sep 30, 2012 5:01 AM
        • 1. Re: Urgent:Partial update not running
          965290
          after solving the exception mention into the last thread i can see one more exception please advise:

          [09.30.12 13:54:11] INFO: [MDEXHost1] Starting copy utility 'copy_index_to_host_MDEXHost1_Dgraph1'.
          [09.30.12 13:56:59] SEVERE: Error communicating with EAC agent while starting utility 'copy_index_to_host_MDEXHost1_Dgraph1'.
          Occurred while executing line 4 of valid BeanShell script:
          [[

          1|
          2|
          3| DgraphCluster.cleanDirs();
          4| DgraphCluster.copyIndexToDgraphServers();
          5| DgraphCluster.applyIndex();
          6|
          7|
          ]]

          [09.30.12 13:56:59] SEVERE: Error executing valid BeanShell script.
          Occurred while executing line 34 of valid BeanShell script:
          [[

          31| Dgidx.run();
          32|
          33| // distributed index, update Dgraphs
          34| DistributeIndexAndApply.run();
          35|
          36| // if Web Studio is integrated, update Web Studio with latest
          37| // dimension values

          ]]

          [09.30.12 13:56:59] SEVERE: Caught an exception while invoking method 'run' on object 'BaselineUpdate'. Releasing locks.

          Caused by java.lang.reflect.InvocationTargetException
          sun.reflect.NativeMethodAccessorImpl invoke0 - null
          Caused by com.endeca.soleng.eac.toolkit.exception.AppControlException
          com.endeca.soleng.eac.toolkit.script.Script runBeanShellScript - Error executing valid BeanShell script.
          Caused by com.endeca.soleng.eac.toolkit.exception.AppControlException
          com.endeca.soleng.eac.toolkit.script.Script runBeanShellScript - Error executing valid BeanShell script.
          Caused by com.endeca.soleng.eac.toolkit.exception.EacCommunicationException
          com.endeca.soleng.eac.toolkit.utility.Utility start - Error communicating with EAC agent while starting utility 'copy_index_to_host_MDEXHost1_Dgraph1'.
          Caused by com.endeca.eac.client.EACFault
          sun.reflect.NativeConstructorAccessorImpl newInstance0 - null

          [09.30.12 13:56:59] FINE: Removing flag update_lock
          [09.30.12 13:56:59] INFO: Released lock 'update_lock'.

          Edited by: 962287 on Sep 30, 2012 6:01 AM
          • 2. Re: Urgent:Partial update not running
            965290
            "EAC Admin Console" under merchandising workbench works very slow. please advise.
            • 3. Re: Urgent:Partial update not running
              Dan at Branchbird
              My suspicion based on your error message is that the EAC is not running on the server hosting Dgraph1. Is the server hosting Dgraph1 on a separate server? Can you confirm that your PlatformServices are running on the server hosting Dgraph1?

              I am not sure if you're running on windows or linux, but regardless you should be able to see a more detailed error message on your EAC Central Server in the following directory ./PlatformServices/workspace/logs/copy

              Thanks,
              Dan
              Branchbird
              • 4. Re: Urgent:Partial update not running
                Kristen G
                How many EAC components do you have? There are some known performance problems for large numbers of EAC hosts or components.
                • 5. Re: Urgent:Partial update not running
                  965290
                  I checked all the logs in /PlatformServices/workspace/logs/copy however did not find any exception or error.
                  Actually, EAC admin console runs very slow and also if i run partial update, i can see the below exception into BaselineUpdate.provisioned_script.log.

                  And also there are two Dgraph(Dgraph1 and Dgraph2), Dgraph1 is unreachable and don't show any option to start and stop. however Dgraph2 running fine.

                  Both are on same server.

                  Here is the exception while running Partial update:

                  [09.30.12 15:19:58] FINE: Listing directory contents for dir '/app/endeca/apps/ladbrokes/./data/dgraphs/local_dgraph_config'.
                  [09.30.12 15:19:58] FINE: Listing directory contents for dir '/app/endeca/apps/ladbrokes/./data/dgraphs/Dgraph2'.
                  [09.30.12 15:19:58] FINE: Listing directory contents for dir '/app/endeca/apps/ladbrokes/./data/dgraphs/Dgraph2'.
                  [09.30.12 15:19:58] INFO: [MDEXHost1] Starting copy utility 'copy_index_to_host_MDEXHost1_Dgraph1'.
                  [09.30.12 15:22:46] SEVERE: Error communicating with EAC agent while starting utility 'copy_index_to_host_MDEXHost1_Dgraph1'.
                  Occurred while executing line 4 of valid BeanShell script:
                  [[

                  1|
                  2|
                  3| DgraphCluster.cleanDirs();
                  4| DgraphCluster.copyIndexToDgraphServers();
                  5| DgraphCluster.applyIndex();
                  6|
                  7|
                  ]]

                  [09.30.12 15:22:46] SEVERE: Error executing valid BeanShell script.
                  Occurred while executing line 34 of valid BeanShell script:
                  [[

                  31| Dgidx.run();
                  32|
                  33| // distributed index, update Dgraphs
                  34| DistributeIndexAndApply.run();
                  35|
                  36| // if Web Studio is integrated, update Web Studio with latest
                  37| // dimension values

                  ]]

                  [09.30.12 15:22:46] SEVERE: Caught an exception while invoking method 'run' on object 'BaselineUpdate'. Releasing locks.

                  Caused by java.lang.reflect.InvocationTargetException
                  sun.reflect.NativeMethodAccessorImpl invoke0 - null
                  Caused by com.endeca.soleng.eac.toolkit.exception.AppControlException
                  com.endeca.soleng.eac.toolkit.script.Script runBeanShellScript - Error executing valid BeanShell script.
                  Caused by com.endeca.soleng.eac.toolkit.exception.AppControlException
                  com.endeca.soleng.eac.toolkit.script.Script runBeanShellScript - Error executing valid BeanShell script.
                  Caused by com.endeca.soleng.eac.toolkit.exception.EacCommunicationException
                  com.endeca.soleng.eac.toolkit.utility.Utility start - Error communicating with EAC agent while starting utility 'copy_index_to_host_MDEXHost1_Dgraph1'.
                  Caused by com.endeca.eac.client.EACFault
                  sun.reflect.NativeConstructorAccessorImpl newInstance0 - null

                  [09.30.12 15:22:46] FINE: Removing flag update_lock
                  [09.30.12 15:22:46] INFO: Released lock 'update_lock'.
                  • 6. Re: Urgent:Partial update not running
                    965290
                    here is some more exception i found into invoke.0.log

                    01-Oct-2012 05:53:22 ComponentControlPortSOAPBindingImpl
                    SEVERE: 'Get component status' request encountered an error for component 'Dgraph1' in application 'ladbrokes'
                    com.endeca.esf.shared.EsfException: Error connecting to http://server:8888/eac-agent/IDelegateServer: Could not invoke service.. Nested exception is org.codehaus.xfire.fault.XFireFault: Couldn't send message.
                    at com.endeca.esf.shared.RemoteLookup.lookupDelegateServer(RemoteLookup.java:56)
                    at com.endeca.esf.centralserver.CentralServices.getDelegateServer(CentralServices.java:115)
                    at com.endeca.esf.centralserver.AbstractServiceImpl.getDelegateServer(AbstractServiceImpl.java:58)
                    at com.endeca.esf.centralserver.ComponentControlImpl.getDelegateServerForComponent(ComponentControlImpl.java:66)

                    and also from main.log

                    01-Oct-2012 06:39:11 org.codehaus.xfire.transport.http.HttpChannel sendViaClient
                    SEVERE: java.net.ConnectException: Connection timed out
                    01-Oct-2012 06:39:11 ComponentControlPortSOAPBindingImpl
                    SEVERE: 'Get component status' request encountered an error for component 'Dgraph1' in application 'ladbrokes'
                    com.endeca.esf.shared.EsfException: Error connecting to http://server:8888/eac-agent/IDelegateServer: Could not invoke service.. Nested exception is org.codehaus.xfire.fault.XFireFault: Couldn't send message.
                    at com.endeca.esf.shared.RemoteLookup.lookupDelegateServer(RemoteLookup.java:56)
                    at com.endeca.esf.centralserver.CentralServices.getDelegateServer(CentralServices.java:115)
                    at com.endeca.esf.centralserver.AbstractServiceImpl.getDelegateServer(AbstractServiceImpl.java:58)
                    at com.endeca.esf.centralserver.ComponentControlImpl.getDelegateServerForComponent(ComponentControlImpl.java:66)
                    at com.endeca.esf.centralserver.ComponentControlImpl.getComponentStatus(ComponentControlImpl.java:51)
                    at com.endeca.esf.centralserver.ComponentControlLockingProxy.getComponentStatus(ComponentControlLockingProxy.java:38)
                    at com.endeca.esf.centralserver.service.ComponentControlPortSOAPBindingImpl.getComponentStatus(ComponentControlPortSOAPBindingImpl.java:46)
                    at sun.reflect.GeneratedMethodAccessor334.invoke(Unknown Source)
                    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
                    at java.lang.reflect.Method.invoke(Method.java:597)
                    at org.apache.axis.providers.java.RPCProvider.invokeMethod(RPCProvider.java:397)
                    at org.apache.axis.providers.java.RPCProvider.processMessage(RPCProvider.java:186)
                    at org.apache.axis.providers.java.JavaProvider.invoke(JavaProvider.java:323)
                    at org.apache.axis.strategies.InvocationStrategy.visit(InvocationStrategy.java:32)
                    at org.apache.axis.SimpleChain.doVisiting(SimpleChain.java:118)
                    at org.apache.axis.SimpleChain.invoke(SimpleChain.java:83)
                    at org.apache.axis.handlers.soap.SOAPService.invoke(SOAPService.java:454)
                    at org.apache.axis.server.AxisServer.invoke(AxisServer.java:281)
                    at org.apache.axis.transport.http.AxisServlet.doPost(AxisServlet.java:699)
                    at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
                    at org.apache.axis.transport.http.AxisServletBase.service(AxisServletBase.java:327)
                    at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
                    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
                    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                    at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
                    at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
                    at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:525)
                    at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
                    at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
                    at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:567)
                    at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
                    at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
                    at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:849)
                    at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
                    at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454)
                    at java.lang.Thread.run(Thread.java:619)
                    Caused by: org.codehaus.xfire.XFireRuntimeException: Could not invoke service.. Nested exception is org.codehaus.xfire.fault.XFireFault: Couldn't send message.

                    Edited by: 962287 on Sep 30, 2012 10:40 PM

                    Edited by: 962287 on Sep 30, 2012 10:41 PM
                    • 7. Re: Urgent:Partial update not running
                      Michael Peel-Oracle
                      Have you contacted Support? They'll be able to guide you through checking Platform Services is running on Dgraph2, firewall ports are open etc. (one of those is I'm guessing the cause of your problem).
                      • 8. Re: Urgent:Partial update not running
                        965290
                        This exception comes from the nohup.out:

                        Exception in thread "DeltaPollSchedulerThread" java.lang.RuntimeException: com.endeca.soleng.update_server_api.EacInterface$EacException: Script BaselineUpdate in application ladbrokes failed
                        at com.endeca.soleng.ladbrokes.openbet_updater.standalone.StandaloneUpdaterProcess$3.run(StandaloneUpdaterProcess.java:595)
                        at java.util.TimerThread.mainLoop(Timer.java:512)
                        at java.util.TimerThread.run(Timer.java:462)
                        Caused by: com.endeca.soleng.update_server_api.EacInterface$EacException: Script BaselineUpdate in application ladbrokes failed
                        at com.endeca.soleng.ladbrokes.openbet_updater.standalone.EacScriptCaller.waitForCompletion(EacScriptCaller.java:62)
                        at com.endeca.soleng.ladbrokes.openbet_updater.standalone.EacScriptCaller.callEacScript(EacScriptCaller.java:41)
                        at com.endeca.soleng.ladbrokes.openbet_updater.standalone.EacScriptCaller.callEacScript(EacScriptCaller.java:26)
                        at com.endeca.soleng.ladbrokes.openbet_updater.standalone.StandaloneUpdaterProcess$3.run(StandaloneUpdaterProcess.java:592)
                        ... 2 more
                        • 9. Re: Urgent:Partial update not running
                          965290
                          Hi Michael,

                          How could we contact to support, what is the process.

                          Please advise
                          • 10. Re: Urgent:Partial update not running
                            Michael Peel-Oracle
                            Logon to My Oracle Support to open new technical issues or track existing issues:
                            https://support.oracle.com/CSP/ui/flash.html

                            To contact Oracle Support by phone, refer to the list of Oracle Support Hotlines and Support Contact Information for your country:
                            http://www.oracle.com/us/support/contact-068555.html

                            Michael
                            • 11. Re: Urgent:Partial update not running
                              sabdelhalim
                              Hi,

                              seems you're having issues with the EAC agent installed on the MDEX (hosting dgraph 1 and 2),
                              can you check for any network issues if your MDEX is on a DMZ and you ITL on LAN (Telnet the MDEX on port 8888 from the ITL and the other way round the ITL from the MDEX)

                              can you run on your ITL a runcommand--print-status to see what processes are running and if your dgraph1 has a "failed" status ?
                              then you can try a runcommand dgraph1 start to see if it works ...

                              if not you should consider re starting the EAC agent \PlatformServices\6.1.0\tools\server\bin\startup (.bat or .sh depending on your OS)

                              complementary question are your 2 Dgraphs set to answer on default port 15000 and 15001 (different) ?

                              hope that helps

                              regards

                              Saleh
                              • 12. Re: Urgent:Partial update not running
                                965290
                                yes, this issue issue with Mdex1 as this is unreachable, i tried to to telnet it from the ITL machine however this is not connecting so i have reported this issue to system team to enable the port.

                                What do i need to do if i want to bypass the MDEX1 and want to use on MDEX2. MDEX2 is running fine.

                                Thanks all for your valuable response.
                                • 13. Re: Urgent:Partial update not running
                                  sabdelhalim
                                  Hi,

                                  Try and remove Dgraph1 from your DgraphCluster definition since the dgraph update in partial update script is run against Dgraphcluster definition

                                  "Distribute update to each server. A single copy of the partial update file is distributed to each server
                                  specified in the configuration.
                                  // distribute partial update, update Dgraphs
                                  DgraphCluster.copyPartialUpdateToDgraphServers();
                                  10. Update MDEX Engines. The Dgraph processes are updated. Engines are updated according to
                                  the updateGroup property specified for each Dgraph. The update process for each Dgraph is as
                                  follows:
                                  a. Copy update files into the dgraph_input/updates directory.
                                  b. Trigger a configuration update in the Dgraph by calling the URL admin?op=update.
                                  DgraphCluster.applyPartialUpdates();"

                                  try and see if it works but I am not sure you'll also need to comment the declaration of MDEX1 host in your Appconfig

                                  take a look at the Deployment Template Usage Guide for further details on scripts in your Appconfig

                                  Hope that helps

                                  regards
                                  Saleh
                                  • 14. Re: Urgent:Partial update not running
                                    965290
                                    Hi,

                                    Degraph1 and degraph2 are running on different server.


                                    Degraph1 is unreachable there is some blockage. How can i bypass degraph1 and use convert all flow to Degraph2, Degraph2 is running fine.

                                    Please Advise.
                                    1 2 Previous Next