Can someone explain me how incremental loading works in FDI?
As per my experience every time I import a csv file I can only use the data contained in it, not data uploaded in previous flows
Hi @Stefano_Mazzocca ,
if tomorrow’s file contains only the 3 changed employees, only those 3 rows will be processed by the incremental load. The previous employee records are not automatically retained from earlier CSV uploads.
All employees will still be visible only if the target is designed to preserve the full dataset, for example by using append or merge/upsert logic. If the target is overwritten or truncated on each run, then only the 3 rows from the new file will remain.
Regards,
Arindam
Hi Stefano,
For CSV loads in FDI, incremental behavior is file-based, not history-based. It typically picks up new or modified files since the last successful run, using the file/object timestamp. It does not reuse data from earlier CSV uploads unless you store it in a target table and manage history there.
Docs:
Regads,
Arindam.
Hi @Arindam Sadhukhan-Oracle , I'm a little bit confused. Let's say today I import all employees by reading a long file. Tomorrow one gets terminated and 2 gets hired so in tomorrow's file I'll have just 3 rows (1 update for termination and 2 new people).
Does this mean that tomorrow, when running my pipeline, I'll be able to see only 3 employees?
Description: Join our Product Management team to learn about new features that are part of 26.R3 Application release of Fusion Data Intelligence (SCM). The session will cover updates on Supply Chain Management and Procurement. Presented by: Anil Sebastian - Senior Director, SCM Product Management, Fusion Data Intelligence…
In FDI, most of the Hierarchy folder wont populating any data. This is one of the most required data from HR. Can anyone assist me how can I get that data in FDI.
Hello Oracle Team, Many organizations currently rely on both Oracle Transactional Business Intelligence (OTBI) and Oracle Fusion Data Intelligence (FDI) for reporting and analytics. While FDI continues to expand its subject area coverage, there are still several OTBI subject areas that are not yet available in FDI. Could…
We want a better grasp on what is considered custom data so we can plan ahead and scale properly before we get too big. Fortunately we are no where near the 50gb limit as found using the subject area for custom data but it doesn't tell us other than 'System' where the custom data is coming from. I found documentation here:…
Is there a way to refresh our development environments in OAC with production data? There a lot of developments that didn't make the cut into production and/or was only used for testing and we would like to clean up dashboards, datasets, data flows, etc… Possibly similar to how receive environment refreshes in our Oracle…
Managers want the ability to assign delegates in Fusion Data Intelligence (FDI) so that delegated users can access and use reports on their behalf. Is that available in FDI now? If yes, anyone share docs about steps to implement that in FDI Thanks
