Data Flows Monitoring in OAC

Question

Hi,

Is any one built any program / code to monitor data flows in OAC instance? We're familiar with Job feature, but we've noticed that it doesn't provide deeper insights into certain aspects we're interested in. Specifically, we're looking for more detailed information regarding the execution duration of the latest job, the length of time it spent in the queue, and, at a high level, the amount of data processed.

Our goal is to gain a clearer view of how long data flows are executing each day, the queue durations, and the processing volume. This would help us optimize our workload and better monitor performance.

Thanks & Regards,

Pavan

CPavan · Answer

Thank you @SteveF-Oracle

CPavan · Answer

Thank you @Sumanth V -Oracle , let me check this option.

Steve F-2 · Answer

To add to the previous reply about providing a notification service for dataflow or dataset failures, you can refer to this blog:

https://blogs.oracle.com/analytics/oracle-analytics-data-flow-notification-system

The Log filter task section allows you to configure how you’d like to filter the logs (in this particular example, we’ll be returning only the logs that indicate a data flow failure). To determine how best to fill out the Log filter task section for your use case, examine the JSON code associated with the OAC diagnostic logs.

You may be able to explore the log filters to see if you can be notified for other dataflow elements.