Is there a way to back up FDI tables and to reload the tables if a data refresh/reset is performed?

Kevin Riedy

Is there a way to back up FDI tables and to reload the tables if a data refresh/reset is performed?

Some of the tables in our source system have a data retention policy of less than 90 days. We are looking for potential methods to back up these tables or pipelines and then reload these into the system in the event that a data refresh or reset is performed that would wipe away data older than 90 days.

Sumanth V -Oracle

@Kevin Riedy -

ADW, where data is loaded as part of the FDI pipeline, is fully under your control. While backups are generally not necessary, if there is a specific business requirement, you can use standard database backup approaches to create a backup.

Kevin Riedy

Thanks, @Sumanth V -Oracle . Is there a way to load the back up table into the FDI table or to load it into the pipeline?

Sumanth V -Oracle

@Kevin Riedy -

A full load triggered as part of the data refresh will only bring the refreshed data into the warehouse. Therefore, there should be no need to restore data from a backup.

Kevin Riedy

@Sumanth V -Oracle but if a refresh is performed, the data that is older than our 90-day retention period in our source system will be wiped out in FDI, right? We are trying to find a way in which we can retain that data in FDI.

Sumanth V -Oracle

@Kevin Riedy -

The Data Warehouse will not wipe out any data, and there is no 90-day retention period in relation to the FDI ADW.

Kevin Riedy

@Sumanth V -Oracle the 90 day retention period is on our source system. If a refresh or reset is performed, we were under the impression that all of the data would need to be reloaded to FDI. Since the data older than 90 days in the source will no longer be in the source, FDI would not have that data to load in.