Forum Stats

  • 3,851,960 Users
  • 2,264,054 Discussions
  • 7,904,917 Comments

Discussions

About the EventDispatcher thread

We are bulk loading GBs of data for our initial load into a Coherence cluster (24 sotrage nodes/ 32 GB per JVM) and have event interceptors registered on caches (staging caches, cache service A) to populate another set of caches (final caches, cache service B) via entry processors.

[ standalone bulk data loader ] ---> [ [staging caches] -----> event interceptors ----> entry processors -----> [final caches] ]

What we noticed is that staging caches get populated quickly (std massive putAll), but the caches depending on event interceptors/entry processors get filled much slower, basically there is a x minutes lag before they are fully populated.

We are using asynchronous event intercepors (inserted, updated) and asynchronous entry processors.

But the problem seems to lie with the EventDispatcher, as we see EventBacklog metric (com.tangosol.coherence.component.manageable.modelAdapter.ServiceMBean) rising fast but decreasing slowly.

Questions:

- is the EventDispatcher single threaded, one thread per cache service/per node?

- is there a way to have it multithreaded?

- should we shut down event interceptors and find an alternate way to pupulate final caches in our bulk initial load phase?

This discussion has been closed.