Can someone explain me how incremental loading works in FDI?
As per my experience every time I import a csv file I can only use the data contained in it, not data uploaded in previous flows
Hi @Stefano_Mazzocca ,
if tomorrow’s file contains only the 3 changed employees, only those 3 rows will be processed by the incremental load. The previous employee records are not automatically retained from earlier CSV uploads.
All employees will still be visible only if the target is designed to preserve the full dataset, for example by using append or merge/upsert logic. If the target is overwritten or truncated on each run, then only the 3 rows from the new file will remain.
Regards,
Arindam
Hi Stefano,
For CSV loads in FDI, incremental behavior is file-based, not history-based. It typically picks up new or modified files since the last successful run, using the file/object timestamp. It does not reuse data from earlier CSV uploads unless you store it in a target table and manage history there.
Docs:
Regads,
Arindam.
Hi @Arindam Sadhukhan-Oracle , I'm a little bit confused. Let's say today I import all employees by reading a long file. Tomorrow one gets terminated and 2 gets hired so in tomorrow's file I'll have just 3 rows (1 update for termination and 2 new people).
Does this mean that tomorrow, when running my pipeline, I'll be able to see only 3 employees?
Learn how to deploy an AI Data Platform agent, register it to the AI Registry, and introduce it to business users through Agent Hub. This session covers how to prepare an agent for deployment, configure endpoint access and authentication, invoke a deployed agent, and monitor it after deployment. The session also introduces…
Hello Team, In the fusion source, we have the records maintained in multiple language say in english as well as in arabic.. ex: dept name is stored in both english and arabic in oracle fusion source with 2 records with different language code like EN and AR. But the same data in FDI is getting extracted only with the…
Hi Team, can oracle provide a standard decks to have a demo and presentation with new customer? Please share any links or attachments if available. Thanks, Manoj
All, I don't see there is a pre built data lieneage which gives more spectrum of solutions or answers for the BI leadership. 1.How many reports each users are owner and what is its path 2.Is these insights are sourced by Subject areas , data sets , Local Subject areas etc 3.Which content duty roles are associated to each…
hi All, The existing FDI pre-built artifacts/Common Subject Areas give us useful information about data reload and warehouse refresh activities. However, I see a gap when troubleshooting Data Augmentation execution at row level. For example, we have a BI Publisher report returning approximately 1M rows, but the…
hello, Is there a way to hide the "back" button in the FDI menu bar? Thank you in advance for your help!
