Categories
DV- Data should append in Dataset while running the dataflow next time.
Summary: When we run the Dataflow second time, data is updated. Is there any option or way to append(keep the old data) the data?
Content (required): We have weekly dataflows, if we run today data is saved in dataset. When we run next we want today's data to be retained and add next week's data after today's data. Is it possible?
Version (include the version you are using, if applicable): OAC - November 2022 Update
Code Snippet (add any code snippets that support your topic, if applicable):
Answers
-
Hi Subhakara, Data append is possible when using a database connection I think. Would it be possible to store the data in database table and use that for reporting.
0 -
As an alternative, if you don't want to store the data in a database table, you can add the dataset to your data flow and use a union rows step to append any new data before saving them to the same dataset.
0 -
Hi @Jahnavi-Oracle , database is not an option for us. It should be in dataset only.
0 -
Hi @Federico Venturin, Can you please give me steps on how to proceed? Is there any link or doc for this, please share. Thanks.
0 -
Please refer to the example in the screenshot to append new data (e.g. New Data) to an existing dataset (e.g. Sales Data):
The important thing is that in your Save Data step you have to provide the same name as your existing dataset (e.g. Sales Data). In this way the existing dataset will used first as an input, and then to store the entire result set (old rows + new ones).
0 -
Thanks @Federico Venturin, I will check this.
0
