Large volume file processing OIC
Summary:
OIC Integration takes very long time to process (> 8 hours for 50k records in the input source file). Looking forward for suggestions or corrections to improvise the performance. Here is the flow of the process:
- Scheduled Orchestration - Download file from SFTP and kick off another integration for each file (Expected multiple input files per pay period)
- App Driven Orchestration - Received input from #1 above. Flow as follows:
- Receive the input file reference and write to Stage
- Read 3 reports and store it in local variable as single call (Assignment number, Element mapping from UDT, Costing information for costing report)
- Read file in segments - Loop each record
Tagged:
0