Node 2 services suddenly stopped in a 2 Node RAC Database
Hi,
We have a 2 node RAC Database. The services on node 2 suddenly stopped and its VIP was switched over to the node 1.
Following errors are shown on node 2 OCR Dump log files:
grid@riysvbcd-004:/orabcare/11.2.0.4/grid$ more ./log/riysvbcd-004/client/ocrdump_24801.log
Oracle Database 11g Clusterware Release 11.2.0.4.0 - Production Copyright 1996, 2011 Oracle. All rights reserved.
2016-08-26 18:31:17.068: [ OCRDUMP][1]ocrdump starts...
2016-08-26 18:31:17.072: [ OCRMSG][1]prom_waitconnect: CONN NOT ESTABLISHED (0,29,1,2)
2016-08-26 18:31:17.072: [ OCRMSG][1]GIPC error [29] msg [gipcretConnectionRefused]
2016-08-26 18:31:17.072: [ OCRMSG][1]prom_connect: error while waiting for connection complete [24]
[ CLWAL][1]clsw_Initialize: OLR initlevel [30000]
2016-08-26 18:31:33.754: [ OCRASM][1]proprasmo: Failed to open file in dirty mode