Clarification on Data Handling and Memory Usage in OIC Integration
Dear Team,
We have an integration in OIC3, Soap connection that fetches data from Fusion SaaS without applying any date filters. As a result, each run retrieves approximately 15,000 records. These records are then processed using a DB Adapter (DBInvoke) to insert data into database tables.
Key points about the current design:
The integration is scheduled to run every 5 minutes.
Three additional integrations follow a similar pattern, scheduled every 10 minutes.
Data is fetched from SaaS in a single payload (segmentation/stage file streaming is not enabled).
The entire dataset is read at once.
Database inserts are performed sequentially (not in batches).
Tagged:
0