Is there a way to clear a database table daily before the pipeline loads?

Kevin Riedy

Is there a way to clear out a database table for one of our data augmentations before running the daily pipeline load?

We have a need to load in brand new data every day and we do not want to retain any cumulative records.

Ashish-Oracle

@Kevin Riedy The Versioned Dataset feature enables to run the corresponding Data Augmentation pipeline as a full load every time. This means the data in the target table will be truncated and reloaded every time.

• Refer: Optional: Select the Versioned Dataset check box to enable full load of the source table data everytime and then click Next.

https://docs.oracle.com/en/cloud/saas/analytics/25r1/fawag/augmenting-your-data.html#GUID-CE523E90-A30C-45B0-880B-6EC338E38B32

Kevin Riedy

Hi @Ashish-Oracle that was exactly what I was looking for. Thank you for the speedy response!