You can translate the question and the replies:

Databricks utilization for cache

I would like to get better understanding on how the Denodo caching with Azure Databricks + ADLS v2 works. My understanding is that we could also use directly ADLS v2 as a cache, but thanks to its computing power of Databricks, it is enhancing even more the operation of read and write. ADLS v2 as a storage is not expencive itself, however for the Databricks we pay for all the VMs that are running the cluster. That means I will have to pay for that cluster running 24/7 to make sure the data in cache is available anytime, correct?
Azure databricks Cache Azure Data Lake Storage Gen2
user
10-03-2022 05:54:38 -0500
code

1 Answer

Hi, In Denodo Platform when Cache option is enabled for a view then the results of the queries against that view would be obtained from the cache database. Hence I would make sure that the cache source is available 24x7 in order for the denodo servers to access the data that is cached. Additionally, if you have any concern regarding the pricing of the Cache database (Databricks) then you could contact their support team. You can refer to [Configuring the Cache](https://community.denodo.com/docs/html/browse/8.0/en/vdp/administration/server_configuration/configuring_the_cache/configuring_the_cache ) section of the Virtual DataPort Administration Guide for more information. Hope this helps!
Denodo Team
11-03-2022 06:10:41 -0500
code
You must sign in to add an answer. If you do not have an account, you can register here