ODA node throwing "DCS-10001:Internal error encountered: Fail to start hand shake to localhost:7070"
2-node ODA 19.8. Trying to upgrade to 19.9 .
Upgraded DCS agent and now running odacli commands on node 0 generates subject error.
Seems to be related to zookeeper:
head /opt/oracle/dcs/log/dcsagent-stderr_20210126-1928.log
DcsException{errorHttpCode=InternalError, msg=Internal error encountered: DCS-10001:Internal error encountered: KeeperErrorCode = ConnectionLoss for /elections.., msgId=10001, causedBy=DcsException{errorHttpCode=InternalError, msg=Internal error encountered: KeeperErrorCode = ConnectionLoss for /elections., msgId=10001, causedBy=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /elections}}
Restarted zookeeper and DCS agent, no change.
Have validated that both nodes have correct time.
At this point, my only option is to re-image the node, which I'm hesitant to do since node 1 is OK.