Cloud ODI - Processing multiple files from Object Storage
Summary:
Looking into how to process multiple files from Oracle Object Store into Autonomous Database in same tenancy.
Content (required):
New to ODI. Trying to work out the best way of processing multiple CSV files from Object Storage. In other tools like Talend I would loop through the file list, process each one.
From what I have seen of ODI the process that creates the files would need to call the ODI API and build an Integration task. This task would be using a pre-built dataflow with source being Object Storage and target our ATP instance, the file and target table would be parameterised and populated by the newly built task. Am I going down the right route here? The API examples I have seen for creating a task look pretty complex and look like they build the dataflow too.