Weblogic Cluster Hang Up & Many Coherence Warning
In server cpspap33 ( Domain name onl1-ms3a) , there are many warning to indicate coherence error at 09:18 20 Dec 2021 as below . After this point, the remaining weblogic server instance in the cluster also show those messages. The all weblogic instance (12 cluster) were auto restarting at ~ 09:49 20 Dec 2021. Whole cluster were down and user experience no response.
Meanwhile, one of server instance (domain name : onl1-ms3b ) can't shutdown by WLST command and consume high CPU.
Only we kill -9 the process of handing up server instance (domain name onl1-ms3b), the issue were resolved.
Would like to know why there are many coherence error ? and why this error clause whole cluster restart and failure.