Unable to fetch dynamic data from MS SQL --> OAC --> ADW(APEX)

Ankan Chanda

Content

Dear team,

We are trying to migrate dynamic data from MS SQL server to OAC and then from OAC to ADW  through data flows, but we are able to migrate only static data which is saved as data sets. When we are inserting data inside MS SQL we are able to get data inside OAC as a connection was established, but the same data isn't reflected inside ADW from OAC where there is a connection already made. When we click the "Run Data Flow" button of the data flow from OAC to ADW (Apex) then we are able to see the updated data inside Oracle Apex.

 Is there any other way to get the dynamic data inside ADW (Apex) from OAC without clicking the "Run Data Flow" button?

 

Sumanth V -Oracle

You can schedule data flows to generate or update datasets regularly at a specific time. Please review the below document for detailed steps on how to enabled the same.

https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/generate-or-update-dataset-specific-time.html#GUID-2F5836C4-611E-4726-8AE0-0F156D63D5D1

Gianni Ceresa

Wrong tool for the job: OAC is not an ETL tool.

It can do part of it, but shouldn't be used as purely an ETL tool...

Christian Berg -Oracle

As Gianni said it's the wrong tool for the job but more than that it's architecturally the wrong approach. OAC is an analytics platform. Not a data platform or enterprise data integration tool. Lifting the data from a database into an analytical platform (where data is supposed to be utilized, not just transported) and then back "down" into a database makes little sense. ADW through its various data integration touchpoints can read from and ingest data from just about anywhere. Zero need to drag the data through an analytics tool. It's a wasteful and unnecessary intermediary step which causes more issues than brings benefits because the tools at your disposal when working on the level of the pure data platform are much more tailored to data engineering.