USER MANUALS

Hardware Requirements

This page lists the minimum recommended hardware requirements to run the Denodo Platform.

Note

Running the Denodo Platform in a production environment on a computer that does not meet these requirements is an unsupported configuration.

Minimum Requirements to Run the Denodo Platform On Premise

These are the minimum requirements to run the Denodo Platform on premise, in a production environment:

Processor

For basic use cases: Intel quad-core or similar.

For high-load scenarios or cases with complex calculations: 8 cores or more.

Supported architecture: x64.

Physical memory (RAM)

16 gigabytes of memory so the Virtual DataPort can allocate a runtime heap space of up to 8 gigabytes. The rest is needed for the other components of the Denodo Platform and the operating system.

Disk space

Minimum: 10 gigabytes free

Recommended: 15 gigabytes free

Recommended for scenarios where Denodo will execute very complex queries that cannot be pushed down to the sources: 100 gigabytes free

See below Considerations Regarding the Disk Space Requirements of the Denodo Platform.

The Denodo Platform can be installed on a virtual machine with similar characteristics, provided that equivalent resources are permanently allocated.

Important

Avoid memory overcommitment. That is, when creating the virtual machine, verify that the amount of memory assigned to the virtual machine is backed by physical memory. Otherwise, the host operating system will have to swap to disk parts of the virtual machine. This will lead to a severe decrease of the performance of the Denodo Platform.

For more advice regarding sizing, contact the Denodo Support Team.

Minimum Requirements to Run the Denodo Platform on Amazon AWS

These are the minimum requirements to run the Denodo Platform on AWS, in a production environment:

Instance type

General Purpose instance of type M

On scenarios where Denodo executes very complex queries, the instances of type M provide significant performance improvements over less powerful instances. More powerful instances (e.g. m4.10xlarge, m5.10xlarge) may be beneficial with some workloads but the improvement is usually smaller.

vCPUs and memory (RAM)

4 virtual CPUs with 16 gigabytes of RAM.

For high-load scenarios or with complex calculations: 16 virtual CPUs and 64 gigabytes of RAM.

Disk space

35 gigabytes

Minimum: 5 gigabytes free

Recommended: 10 gigabytes free

Recommended for scenarios where Denodo will execute very complex queries that cannot be pushed down to the sources: 100 gigabytes free

See below Considerations Regarding the Disk Space Requirements of the Denodo Platform.

Minimum Requirements to Run the Denodo Platform on Microsoft Azure

These are the minimum requirements to run the Denodo Platform on Microsoft Azure, in a production environment:

VM type

General Purpose VM size

On scenarios where Denodo executes very complex queries, these instances provide significant performance improvements over less powerful instances. More powerful instances may be beneficial with some workloads but the improvement is usually smaller.

vCPUs and memory (RAM)

4 virtual CPUs with 16 gigabytes of RAM.

For high-load scenarios or with complex calculations: 16 virtual CPUs and 64 gigabytes of RAM.

Disk space

35 gigabytes

Minimum: 5 gigabytes

Recommended: 10 gigabytes free

Recommended for scenarios where Denodo will execute very complex queries that cannot be pushed down to the sources: 100 gigabytes free

See below Considerations Regarding the Disk Space Requirements of the Denodo Platform.

Minimum Hardware Requirements when Installing each Module Separately

In some scenarios, you may want to run each module on a separate computer, Kubernetes pod, cloud instance… That is, installing Virtual DataPort in one host, Data Catalog in another, etc.

If you do this, these are the minimum requirements for running each module separately, in a production environment:

  • Virtual DataPort: the same requirements above and for the other modules, you use these:

  • For each host that runs each of the other modules (Scheduler, Data Catalog ….):

    Processor

    2 cores

    Physical memory (RAM)

    8 gigabytes

    Disk space

    Minimum: 10 gigabytes free

    Recommended: 15 gigabytes free

Considerations Regarding the Disk Space Requirements of the Denodo Platform

The amount of free disk space required depends on the use of the Denodo Platform:

  • A full installation of the Denodo Platform (i.e. installation of all the modules) uses 3.5 gigabytes.

  • The metadata of each module of the Denodo Platform is stored locally (e.g. information about the data sources, views, web services, Scheduler jobs, etc.) and usually does not go over a few hundred megabytes.

  • Space used by updates: Denodo keeps a backup copy of the libraries that are being updated. Each update takes up to 300 megabytes. Considering the number of updates released per each major version, the backup copies end up using around 5 gigabytes.

  • Space used for swapping data: to avoid memory overflows, Virtual DataPort swaps to disk the intermediate results of queries when they do not fit in memory.

    Usually, most of the processing is pushed down to the source so the number of rows processed by Virtual DataPort is low and swapping is not required. However, with very complex queries where Virtual DataPort processes billions of rows, some data is swapped to disk to avoid a memory overflow. This is why, for complex scenarios, we recommend having 100 gigabytes of free disk space.

    The section Memory Management of the Virtual DataPort Administration Guide explains when Virtual DataPort swaps intermediate results to disk.

Running the Denodo Platform on Docker

The Denodo Platform can run on Docker. Denodo distributes a Docker image you can download from the Denodo Support Portal. The Denodo Platform Container Quick Start Guide explains how to use this image.

Requirements for the Virtual DataPort Administration Tool

Any modern computer running Windows or Linux can run the Virtual DataPort Administration Tool.

Processor

Quad-core processor

Physical memory (RAM)

8 gigabytes

Disk space

2 gigabytes free

Operating System

Any of the ones listed in the section Supported Platforms

Add feedback