How to determine timing delay how long does it take for data to be committed to the audit tables?
We receive ad hoc tasks from business every time there's a compensation refresh happening. This process contains updates in the Assignment and Salary Section of the associates. We also have a job that sends delta information from Cloud to Peoplesoft, this runs every 15 mins. This job maintains the data in both systems are in sync.
This ad hoc request usually has 120K records in the HDL load (worker and salary component), as compared to our daily runs 6K (at max). With this number, a delay in committing data to audit tables is observed, creating a huge problem for us. Since HDL follows the hierarchy worker then salary in loading, NEW-Worker and OLD-salary are often sent first to Peoplesoft. We would like to seek your advice on a more feasible way to do this. Are there steps that we're missing or we can improve? In an SR, the support recommended BI Caching, but we