Oracle Communities

Oracle Analytics and AI

Child Item

Data Flow Option to Automatically Add New Columns Without Having to Constantly check the Option

Hi.

We have many datasets that get pushed into a Data Flow that then get used later down the track for reporting. However we have many data flows & datasets where calculations & columns are constantly being added or removed that users constantly forget to check all columns in the Data Flows. Just wondering if it would be possible to add an option for a data flow to automatically add new columns before it is runs; this saves us time + the hassle of constantly checking if all columns have been bought through the data flows. Our data flows are very simple, read the dataset, save the dataset into a database.

Find more posts tagged with

Needs Votes

Status: Needs Votes

Comments

Gabby Rubin-Oracle

Can you provide a more detailed example? I'm not sure I understand which columns the data flow should add. Are you referring to the fact that 'add column' step before the 'select column' step will not automatically add the column to the selected list, but it will be in the removed list?

User_FBG8L

Hi, in a Data Flow for example, we might have an existing dataset with 77 columns that then goes to a Save Data step. Later, that same Dataset may have 4 additional columns (so 81 columns in total) & we need that to come through in the Save Data step. Currently you will need to go into the Data Flow, select all columns & then re-run the Data Flow in order for the new columns to come through.

Because we have this scenario so often across many data flows, we were wondering if it would be possible to create an option to auto add new columns without having to edit the Data Flows. We have Data Flows that rely on other Data Flows & preceding Data Flows may add a calculation in the first data flow for example, that will be used in a Data Flow 3 or 4 data flows later. Let me know if that doesn't make sense.