1 Reply Latest reply: Mar 29, 2013 10:23 AM by user6126629 RSS

    Cannot add server to pool: OVMAPI_4004E, but hostname set to FQDN

    user6126629
      It's very simillar problem like thread "Cannot Add Server to Pool: OVMAPI_4010E Attempt to send command: dispatch..", but setting
      hostname with FQDN on Ora VM Manager and Ora VM Server, repairing all configuration files (using grep -R ...) and reboot OVM
      server and OVMM didn't brought any effect...

      Environment:
      Oracle VM Server version 3.2.2
      Build: 520

      Oracle VM Manager:
      Version: 3.2.2.520
      Build: 20130218_520

      Description:
      I have discovered and setup an OVM Server. Then I tried to create a new pool "ikr-pool". When I tried to attach discovered server ("srv01-xx.cssz.cz"),
      I got error attached bellow. After this actions svr01-xx stays incorrectly as "member of pool" in /etc/ovs-agent/db/server database, so I need on VM server
      to stop ovs-agent, remove file /etc/ovs-agent/db/server, start ovs-agent again, and then re-take ownership on VM server again. Then srv01-xx stays
      as "Unassigned server".

      Regards

      Vladislav Rames

      <-------------------------------------------------------------------------------------------------------------Begin of error message--------------------------------------------------------------------------->

      Job Construction Phase
      ----------------------
      Job ID: 1364477027337

      begin()
      Appended operation 'Server Join Server Pool' to object '31:33:37:35:32:32:5a:43:32:32:35:30:30:57:44:46 (srv01-xx.cssz.cz)'.
      Appended operation 'Server Pool Construct' to object '0004fb0000020000d0b83b23645cbca2 (ikr-pool)'.
      Appended operation 'Server Pool Virtual IP Configure' to object '0004fb0000020000d0b83b23645cbca2 (ikr-pool)'.
      Appended operation 'Server Pool Member Update' to object '0004fb0000020000d0b83b23645cbca2 (ikr-pool)'.
      Appended operation 'Server Cluster Configure' to object '31:33:37:35:32:32:5a:43:32:32:35:30:30:57:44:46 (srv01-xx.cssz.cz)'.
      Appended operation 'Server Cluster Construct' to object '31:33:37:35:32:32:5a:43:32:32:35:30:30:57:44:46 (srv01-xx.cssz.cz)'.
      commit()
      Completed Step: COMMIT

      Objects and Operations
      ----------------------
      Object (IN_USE): [Cluster] d0b83b23645cbca2
      Object (IN_USE): [Server] 31:33:37:35:32:32:5a:43:32:32:35:30:30:57:44:46 (srv01-xx.cssz.cz)
      Operation: Server Join Server Pool
      Operation: Server Cluster Configure
      Operation: Server Cluster Construct
      Object (IN_USE): [ServerPool] 0004fb0000020000d0b83b23645cbca2 (ikr-pool)
      Operation: Server Pool Construct
      Operation: Server Pool Virtual IP Configure
      Operation: Server Pool Member Update

      Job Running Phase at 2013-03-28 14:23:47,337
      ----------------------------------------------
      Job Participants: []


      Actioner
      --------
      14:23:47,909: Starting operation 'Server Join Server Pool' on object '31:33:37:35:32:32:5a:43:32:32:35:30:30:57:44:46 (srv01-xx.cssz.cz)'
      14:23:47,914: Completed operation 'Server Join Server Pool' with direction ==> LATER
      14:23:47,920: Starting operation 'Server Pool Construct' on object '0004fb0000020000d0b83b23645cbca2 (ikr-pool)'
      14:23:47,971: Completed operation 'Server Pool Construct' with direction ==> DONE
      14:23:47,977: Starting operation 'Server Pool Virtual IP Configure' on object '0004fb0000020000d0b83b23645cbca2 (ikr-pool)'
      14:23:53,221: Completed operation 'Server Pool Virtual IP Configure' with direction ==> DONE
      14:23:53,232: Starting operation 'Server Pool Member Update' on object '0004fb0000020000d0b83b23645cbca2 (ikr-pool)'
      Job Internal Error (Operation)com.oracle.ovm.mgr.api.exception.FailedOperationException: OVMAPI_4010E Attempt to send command: dispatch to server: srv01-xx.cssz.cz failed. OVMAPI_4004E Server Failed Command: dispatch https://?uname?:?pwd?@10.20.11.11:8899/api/3 set_pool_member_ip_list [10.20.11.11], Status: org.apache.xmlrpc.XmlRpcException: I/O error while communicating with HTTP server: Connection timed out [Thu Mar 28 14:36:30 CET 2013] [Thu Mar 28 14:36:30 CET 2013]
      at com.oracle.ovm.mgr.action.ActionEngine.sendCommandToServer(ActionEngine.java:512)
      at com.oracle.ovm.mgr.action.ActionEngine.sendDispatchedServerCommand(ActionEngine.java:449)
      at com.oracle.ovm.mgr.action.ActionEngine.sendServerCommand(ActionEngine.java:383)
      at com.oracle.ovm.mgr.action.ServerPoolAction.setServerPoolMembers(ServerPoolAction.java:138)
      at com.oracle.ovm.mgr.op.virtual.ServerPoolMemberUpdate.updateMemberList(ServerPoolMemberUpdate.java:363)
      at com.oracle.ovm.mgr.op.virtual.ServerPoolMemberUpdate.action(ServerPoolMemberUpdate.java:138)
      at com.oracle.ovm.mgr.api.collectable.ManagedObjectDbImpl.executeCurrentJobOperationAction(ManagedObjectDbImpl.java:1156)
      at com.oracle.odof.core.AbstractVessel.invokeMethod(AbstractVessel.java:356)
      at com.oracle.odof.core.AbstractVessel.invokeMethod(AbstractVessel.java:333)
      at com.oracle.odof.core.storage.Transaction.invokeMethod(Transaction.java:865)
      at com.oracle.odof.core.Exchange.invokeMethod(Exchange.java:244)
      at com.oracle.ovm.mgr.api.virtual.ServerPoolProxy.executeCurrentJobOperationAction(Unknown Source)
      at com.oracle.ovm.mgr.api.job.JobEngine.operationActioner(JobEngine.java:230)
      at com.oracle.ovm.mgr.api.job.JobEngine.operationActioner(JobEngine.java:264)
      at com.oracle.ovm.mgr.api.job.JobEngine.operationActioner(JobEngine.java:264)
      at com.oracle.ovm.mgr.api.job.JobEngine.objectActioner(JobEngine.java:322)
      at com.oracle.ovm.mgr.api.job.InternalJobDbImpl.objectCommitter(InternalJobDbImpl.java:1340)
      at com.oracle.odof.core.AbstractVessel.invokeMethod(AbstractVessel.java:356)
      at com.oracle.odof.core.AbstractVessel.invokeMethod(AbstractVessel.java:333)
      at com.oracle.odof.core.BasicWork.invokeMethod(BasicWork.java:106)
      at com.oracle.odof.command.InvokeMethodCommand.process(InvokeMethodCommand.java:92)
      at com.oracle.odof.core.BasicWork.processCommand(BasicWork.java:81)
      at com.oracle.odof.core.TransactionManager.processCommand(TransactionManager.java:752)
      at com.oracle.odof.core.WorkflowManager.processCommand(WorkflowManager.java:467)
      at com.oracle.odof.core.WorkflowManager.processWork(WorkflowManager.java:525)
      at com.oracle.odof.io.AbstractClient.run(AbstractClient.java:42)
      at java.lang.Thread.run(Thread.java:662)
      Caused by: com.oracle.ovm.mgr.api.exception.IllegalOperationException: OVMAPI_4004E Server Failed Command: dispatch https://?uname?:?pwd?@10.20.11.11:8899/api/3 set_pool_member_ip_list [10.20.11.11], Status: org.apache.xmlrpc.XmlRpcException: I/O error while communicating with HTTP server: Connection timed out [Thu Mar 28 14:36:30 CET 2013]
      at com.oracle.ovm.mgr.action.ActionEngine.sendAction(ActionEngine.java:803)
      at com.oracle.ovm.mgr.action.ActionEngine.sendCommandToServer(ActionEngine.java:508)
      ... 34 more


      FailedOperationCleanup
      ----------
      Starting failed operation 'Server Pool Member Update' cleanup on object 'ikr-pool'
      Complete rollback operation 'Server Pool Member Update' cleanup on object 'ikr-pool'

      Rollbacker
      ----------
      14:36:31,156: Starting rollbacker...
      Executing rollback operation 'Server Pool Member Update' on object '0004fb0000020000d0b83b23645cbca2 (ikr-pool)'

      <-------------------------------------------------------------------------------------------------------------End of error message----------------------------------------------------------------------------->
        • 1. Re: Cannot add server to pool: OVMAPI_4004E, but hostname set to FQDN
          user6126629
          Solved. Problem was the same like in thread "I/O error while communicating with HTTP server: Connection timed out" - it wasn't accessible IP connection between Ora VM Manager and Ora VM server IP alias for server pool. But there was very confusing message in errorlog: "dispatch https://?uname?:?pwd?@10.20.11.11:8899/api/3 set_pool_member_ip_list [10.20.11.11], Status: org.apache.xmlrpc.XmlRpcException: I/O error while communicating with HTTP server: Connection timed out [Thu Mar 28 14:36:30 CET 2013]". Noticed IP address was IP address for VM server, not for VM pool, which makes me quite angry.

          Best Regards

          Vladislav Rames