Can someone explain me how incremental loading works in FDI?
As per my experience every time I import a csv file I can only use the data contained in it, not data uploaded in previous flows
Hi @Stefano_Mazzocca ,
if tomorrow’s file contains only the 3 changed employees, only those 3 rows will be processed by the incremental load. The previous employee records are not automatically retained from earlier CSV uploads.
All employees will still be visible only if the target is designed to preserve the full dataset, for example by using append or merge/upsert logic. If the target is overwritten or truncated on each run, then only the 3 rows from the new file will remain.
Regards,
Arindam
Hi Stefano,
For CSV loads in FDI, incremental behavior is file-based, not history-based. It typically picks up new or modified files since the last successful run, using the file/object timestamp. It does not reuse data from earlier CSV uploads unless you store it in a target table and manage history there.
Docs:
Regads,
Arindam.
Hi @Arindam Sadhukhan-Oracle , I'm a little bit confused. Let's say today I import all employees by reading a long file. Tomorrow one gets terminated and 2 gets hired so in tomorrow's file I'll have just 3 rows (1 update for termination and 2 new people).
Does this mean that tomorrow, when running my pipeline, I'll be able to see only 3 employees?
Where AI meets business outcomes Oracle AI World brings the Oracle community together to explore how AI and other technology innovations are driving real business outcomes across industries. Discover what’s new through: Mainstage keynotes to hear the latest directly from Oracle leadership Product demonstrations Customer…
HI, I am trying to get data from the Enterprise Contracts - Contracts subject area in FDI. However, it is not returning any records when I use this subject area. Are there additional configurations or setup tasks needed to pull enterprise contracts data in FDI? I have checked the following: In Oracle fusion, I have access…
How to Inject external data (Business central data) into Oracle Autonomous lakehouse via SFTP connector in FDI?
OOTB subject area fields are not available in DEV and PROD. Existing workbooks display "Error Loading Data" and report that standard fields are cannot be found. Local Subject Areas also display "Schema listing not available". The issue appears to affect the FDI semantic layer/metadata across environments. Can anyone facing…
I’m currently facing an issue with the Absence data in FDI. For example, in the screenshot, the Approved Absence measure is showing 1, while the correct value in Fusion 1,560. A few points: This is the standard/prebuilt dashboard; no customizations were made. There is no date filter applied. The FDI refresh runs daily, so…
Report 1 :We do have FRS report with 7 to 8 columns.HTML veiw of the report showing extra space .how to fit the output to the report .There should not be space in the html report.Attaching the report output. Report 1 output : Report2 : We do have an FRS Report where one connection has all ledgers except CSG IND STAT…
