How to connect to Azure Databricks from Denodo

Goal

This document describes how to connect to Azure Databricks from Denodo Virtual DataPort.

Content

Azure Databricks is an Apache Spark-based analytics platform optimized for Microsoft Azure cloud services.

Connecting to Azure Databricks from Denodo

Note: For older versions of Denodo Platform, create a new JDBC data source by selecting Virtual Database > New > Data source > JDBC

• From the Denodo Design Studio, create a new JDBC data source by selecting Virtual Database > New > Data source.
  

• This will open the wizard to create a connection to a data source. Now, search for the data source that you want to connect. Here, we are using Databricks.

• Provide the Name for the JDBC Data source.

• By default, the respective Database version is selected based on the data source connection. In this example, Databricks Adapter is selected by default.

• Since Denodo 8.0 update 20220815, the default Driver classpath is databricks-2.
• Next, provide the  Database URI.  
  Format : ‘jdbc:databricks://<host_name>:<port>/<database_name>;’, also, some parameters are added to the URI after the database name like httpPath, SSL etc. To know more about the parameters refer to Configure the Databricks ODBC and JDBC drivers.

• If you are using a Databricks driver version < 2.6.25, you may need to change the Driver class to ‘com.simba.spark.jdbc.Driver’ and the Database URI to ‘jdbc:spark://<host_name>:<port>/<database_name>;’
• You can select what type of Transaction Isolation you want from the options provided. In this example, we use the ‘Database Default’.
•   Authentication: There are three options provided. In our example, we are using the ‘Use login and password’ using a personal access token.
•   In the User, enter ‘token’.
•   In the Password, provide the access key token.
•  After providing the connection, you can test the connection by clicking on the Test     Connection button.
• Save the data source.
• Once saved, click on the ‘Create base view’ tab to introspect source metadata available through the Data Source.
• To incorporate some of the tables into the Denodo virtual schema, you have to check the box near the tables or views you want to import and then click ‘Create selected’.
  
  

• Now, the base view will be created.

• You can also use the ‘Create from query’ option if you wish to custom your base view.

References

JDBC Sources

Supported JDBC Data Sources

Configure JDBC/ODBC connection