How to create a connection between Google BIG Query and Fusion Data Intelligence

AmarP

Hi,

Customer is looking for reports using data from different sources like ERP and Google BIG Query. Idea is to bring the required data from augmentation and prepare a subject area from Semantic Model Extensions to build reports out of it.
We checked in the documents for Third Party Connectors we don't have a connector for BigQuery. Please provide some suggestion to create a connection with Google Big Query.

Regards,
Amar

Sumanth V -Oracle

@AmarP - Please define a column in the Flow New Data Indicator field. Select a column that will be used to detect when new data is added.

Reference:

https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/configure-incremental-processing-data-flow.html

Sumanth V -Oracle

@AmarP - Welcome to the Oracle Analytics Community!

The Google BigQuery connector is not currently available in FDI. If this is a critical requirement, please submit an Idea with a valid business justification for our Product Management Team to review and consider for a future release.

However, you can still connect to BigQuery using OAC.

• Workaround: Individual datasets can be created from the data source and used in OAC for reporting.

Limitation: These datasets cannot be used with SME.But, we have an option to connect to it using OAC, please refer the below:

Thanks for reaching out to us on Oracle Analytics Community!

AmarP

We tried OAC's Connector and used Data Flow to create tables in ADW and utilize it SME to built Subject Area using existing subject area and tables created from Big Query Connection. However, we were not able to load the delta data, for example If we get new data in BigQuery tables and we want to load delta data only, we were unable to find any option in Dataset or dataflow to fetch new data only. In data flow we have 2 options: 1st is Replace data, 2nd is Add new data into existing data. We tried both options, 1st option at the beginning is ok as data volume is less but not a viable option to use in this scenario and 2nd option just inserts whatever data we have in existing table. Any suggestions to perform insert append like function using Data flow?

AmarP

Thanks Sumanth V for the suggestion.

I tried using that approach but I don't see the columns which I want to set it as a column indicator.
I tried with another table where I wanted to set customer_id or order_id but only see order_date and total_amount. I tried by re-creating the dataset, re-creating the connection then creating the data set. It didn't seem to identify the columns. Please find below for reference