Setup new Connection in ODI for Databricks

Question

We utilize Oracle OAC dashboards for data visualization. Our source system is Databricks, and we are attempting to establish a connection from ODI to access the catalog and schema for data reading and writing purposes. However, we are encountering difficulties in retrieving the schema within the new physical schema. Has anyone successfully connected to Databricks using ODI?

User_JD0JE · Answer

Hi  @User_WA0HA,

it is possible to connect to Databricks from odi12c. I did this few months ago.

In my case I used odi12c 12.2.1.4, I tried with 12.2.1.2 but it wasn`t possible beacause the authentication to Databricks was with PAT and this PAT was too long for  password field in 12.2.1.2.

You also need to download a driver for Databricks and put it in ODI studio folder for drivers and in the folder of the agent, if you are using agent (you need to restart agent so it can use the driver).

You have to make changes in instance.cmd(sh) file - remove %ODI_SSL_PROPERTIES% from ODI_instance_java_options.

Gianni Ceresa · Answer

Hi @User_WA0HA ,

ODI is not an Oracle Analytics product, therefore it isn't covered by this forum. As your question isn't linked to your OAC usage but about a direct connection between ODI and your current source, it is an ODI-only question.

Various other ODI questions have been pointed to this other forum:

https://forums.oracle.com/ords/apexds/domain/dev-community/category/analytics-software

(In the previous version of that forum there was a dedicated ODI category, now it has been merged into a generic on-premises analytics software, with a number of other products).

Bhaskar Konar · Answer

https://community.oracle.com/products/oracleanalytics/discussion/24450/setup-new-connection-in-odi-for-databricks

Hi @User_WA0HA,

It seems Databricks is not a certified technology under the certification matrix for Oracle Data Integrator.

Please take a look into the following Oracle Note which contains all details and might be useful.

https://support.oracle.com/knowledge/Oracle%20Cloud/3056680_1.html

Hope this help.

Cheers,