0 Replies Latest reply: Apr 12, 2013 12:12 PM by 810721 RSS

    Stopping cluster due to unhandled exception: java.lang.ArrayIndexOutOfBound

    810721
      We had this problem in production where one node among the 16 node cluster terminated with this error.

      2013-04-12 11:39:00.533/1139.283 Oracle Coherence EE 3.6.1.4 <Warning> (thread=PacketPublisher, member=4): Experienced a 12316 ms communication delay (probable remote GC) with Member(Id=6, Timestamp=2013-04-12 11:20:08.733, Address=169.168.22.79:32120, MachineId=5967, Location=XXXX,machine:XXXXXXX,process:18088102,member:Container1u7, Role=XXXXXXXX); 114 packets rescheduled, PauseRate=0.0108, Threshold=1878
      2013-04-12 11:47:35.704/2528.573 Oracle Coherence EE 3.6.1.4 <Error> (thread=PacketReceiver, member=1): Stopping cluster due to unhandled exception: java.lang.ArrayIndexOutOfBoundsException
           at com.tangosol.coherence.component.net.Packet.extract(Packet.CDB:30)
           at com.tangosol.coherence.component.util.daemon.queueProcessor.packetProcessor.PacketReceiver.onNotify(PacketReceiver.CDB:28)
           at com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:42)
           at java.lang.Thread.run(Thread.java:777)

      After that that when the services which are configured to restart, tried to restart it failed with following exception. Any idea what would be causing this error. We have WKA configured.

      2013-04-12 11:47:35.951/2528.820 Oracle Coherence EE 3.6.1.4 <Error> (thread=DEFAULT_EDN-Thread-28, member=n/a): Error while starting cluster: (Wrapped) java.io.IOException: SystemSocketProvider unable find available port(s)
           at com.tangosol.util.Base.ensureRuntimeException(Base.java:293)
           at com.tangosol.util.Base.ensureRuntimeException(Base.java:269)
           at com.tangosol.coherence.component.net.Cluster.onStart(Cluster.CDB:232)
           at com.tangosol.coherence.component.net.Cluster.start(Cluster.CDB:11)
           at com.tangosol.coherence.component.util.SafeCluster.startCluster(SafeCluster.CDB:3)
           at com.tangosol.coherence.component.util.SafeCluster.restartCluster(SafeCluster.CDB:7)
           at com.tangosol.coherence.component.util.SafeCluster.ensureRunningCluster(SafeCluster.CDB:26)
           at com.tangosol.coherence.component.util.SafeService.restartService(SafeService.CDB:22)
           at com.tangosol.coherence.component.util.SafeService.ensureRunningService(SafeService.CDB:39)
           at com.tangosol.coherence.component.util.safeService.SafeCacheService.ensureRunningCacheService(SafeCacheService.CDB:3)
           at com.tangosol.coherence.component.util.SafeNamedCache$CacheAction.run(SafeNamedCache.CDB:3)
           at java.security.AccessController.doPrivileged(AccessController.java:252)
           at javax.security.auth.Subject.doAs(Subject.java:494)
           at com.tangosol.coherence.component.util.SafeNamedCache.restartNamedCache(SafeNamedCache.CDB:8)
           at com.tangosol.coherence.component.util.SafeNamedCache.ensureRunningNamedCache(SafeNamedCache.CDB:33)
           at com.tangosol.coherence.component.util.SafeNamedCache.getRunningNamedCache(SafeNamedCache.CDB:1)
           at com.tangosol.coherence.component.util.SafeNamedCache.lock(SafeNamedCache.CDB:1)
      ....
      ....
           at container.pool.BoundedThreadPool$PooledThread.run(BoundedThreadPool.java:591)
      Caused by: java.io.IOException: SystemSocketProvider unable find available port(s)
           at com.tangosol.coherence.component.net.Cluster$SocketManager.bindListeners(Cluster.CDB:117)
           at com.tangosol.coherence.component.net.Cluster.onStart(Cluster.CDB:228)
           ... 20 more