EBS 12.2.10 - Scaling Bank Statement SQL Loader through parallel processing
Context: We heavily use Bank Statement Import and Processing programs to load bank statements that we receive from various banking correspondence. Programmes we use are 1) Bank Statement Loader Execution Report 2) Bank Statement Import & AutoReconciliation
We understand that Bank Statement Loader program will intern call "SQL loader" to process the file one at a time. This is where we are struggling. Number of bank files are increasing gradually and we have limited time window to process all these incoming bank files. Currently we recieve 300+ bank statements on daily basis. Delay in statement processing adversely impacting reconciliation.
Our use case is to scale SQL Loader so that multiple bank files can be processed in parallel. We have reached to a limit due to the total processing time window available to us. Its hard constraint and we wanted to increase the number of bank files processed within this acceptable time frame as its . Apparently SQL Loader is roughly taking 1.5 minutes to process one file and this is limiting our total processing capacity as it runs as a single instance and process files sequentially.