You can translate the question and the replies:

How to connect DeltaLake Tables from Denodo when cluster is down

I need help on Denodo connector to DeltaLake of DataBricks. I am using Simba Connector and able to connect Tables in DeltaLake. But when my DataBricks (cluster) goes down my VSQL query fails to access. So, It always need to start the cluster. which is cost expensive. How can I keep connecting to DeltaLake Tables from Denodo even though cluster is down.
deltalake databricks
user
17-05-2021 15:42:27 -0400
code

1 Answer

Hi, If these tables are used frequently, I would use the caching technique. One of the reasons for caching in Denodo is for protecting the data sources from costly queries. I would configure a cache engine in VDP to store local copies of data retrieved from the data source and for updating the cache tables, I would either use incremental cache methods or else I would configure a full refresh process using [Denodo Scheduler](https://community.denodo.com/docs/html/browse/8.0/scheduler/administration/creating_and_scheduling_jobs/configuring_new_jobs/vdpcache_extraction_section), invalidating all cached data and loading it again. For more information, you can refer to the [Caching](https://community.denodo.com/kb/en/view/document/Best%20Practices%20to%20Maximize%20Performance%20III:%20Caching#h.e1mubhjucm2w) Knowledge base article and[ Configuring the Cache](https://community.denodo.com/docs/html/browse/8.0/en/vdp/administration/server_configuration/configuring_the_cache/configuring_the_cache) of Virtual DataPort VQL Guide. Hope this helps!
Denodo Team
18-05-2021 17:42:41 -0400
code
You must sign in to add an answer. If you do not have an account, you can register here