USER MANUALS

New Features of the Denodo Platform 9

This page lists the enhancements of the Denodo Platform and Solution Manager 9.0 (i.e. version 9 without updates).

Note

The features listed here are exclusive of Denodo 9. The features of 9 that have been backported to the latest update of Denodo 8.0 (8.0u20240306) are not listed here; they are listed in What Is New in Denodo 8.0u20240306)

Virtual DataPort

  • New scalar functions:

    • Datetime functions:

      • ADDMILLIS: adds milliseconds to a datetime value.

      • GETTIMEFROMMILLIS: returns a “timestamp with time zone” that represents the specified number of milliseconds since the standard base time known as the epoch, namely January 1, 1970, 00:00:00 GMT.

    • Text functions:

      • BASE64_TO_HEX: converts a text value encoded in Base64 to a text value encoded in hexadecimal.

      • CONCATLIST: returns a text value with all the values of an array concatenated.

      • DELETESPACES: removes all the spaces of a text value.

      • HEX_TO_BASE64: converts a text value encoded in hexadecimal to a text value encoded in Base64.

      • PRINTF: returns a formatted string using the specified format string and arguments.

      • PROPERCASE: returns the first letter of a text value capitalized, and the rest in lower case.

    • Other functions:

      • PIVOTREGISTER: transforms the provided array values to columns with the provided names.

      • ST_WKBTOWKT: spatial function that transforms a well-known binary (wkb) into a well-known text (wkt).

    These functions are part of the package Denodo XtraFuncs and now, are included in Denodo out-of-the-box.

Virtual DataPort - Data Sources

  • New data source MongoDB, a NoSQL database.

    If you are upgrading from a previous version and you were using the Denodo MongoDB Custom Wrapper, we suggest you begin using the new one because it has introspection (i.e. it is easier to create base views) and it has better push down capabilities so the queries involving to MongoDB will generally run faster.

  • Virtual DataPort now includes the OData 2 and OData 4 custom wrappers. You no longer have to download them from the Support Site. To create one in Design Studio, open the wizard to create a data source and type OData.

  • New JDBC adapter for the database MaxCompute of Alibaba Cloud.

Virtual DataPort - Execution Engine

  • When the execution engine runs a query that uses a window function on top of a subquery that contains a SQL construct that Denodo cannot push down to the underlying database, the execution engine of Denodo moves the data to the Denodo MPP (i.e. a Presto server) to “solve the query”.

  • You can now customize graphically, the DDL commands the Execution Engine runs to create the tables to cache a view, create remote tables and summaries.

  • Several enhancements related to the Denodo MPP:

    • You can now use the Denodo MPP with the format Apache Iceberg, to cache the data of the view and for bulk load operations like storing data in remote tables and summaries.

    • In the Denodo MPP data source, you can introspect graphically the Delta folders of the MPP.

    • The execution plan of the queries that involve the Denodo MPP, now also includes information about the execution of the queries in the MPP itself.

Virtual DataPort - Operations and Security

  • When obtaining the VQL of an element, the result includes the elements located in other databases. This includes when doing an Export database and the database has elements that depend on elements of other database and, when in the pill VQL of an element, the element depends on elements of another database. In the previous version, the result of obtaining the VQL of an element did not include the VQL of its dependencies located on a different database.

  • New stored procedure: GET_GLOBAL_SECURITY_POLICIES_TAGS. It returns information about the tags used by global security policies.

  • Now, the Resource Manager returns an error to the client application when the row limit is reached for the action Stop the query when the maximum number of rows returned has been reached. In previous versions, the query stopped “silently”, without warning the client application.

Virtual DataPort - Version Control System

  • When pulling changes from the remote repository, the process may fail because there are conflicts or errors that prevent these elements from being created or modified. For example, when importing a view that references another view that no longer exists. To make it easier to solve these issues, Denodo 9 has a new wizard to solve them called Unresolved Elements.

  • You can now version users and roles, their privileges and the global security policies.

  • You can now obtain the VQL statements to create the elements that have been added/modified/deleted between two Git commits. There are two ways of doing this:

    1. With the command GET_REVISION.

    2. With the Export Script, which now has the parameter -revision <Git commit id>.

Virtual DataPort - Drivers (JDBC and ODBC)

Virtual DataPort - Web Services Published by Denodo

  • When you deploy or redeploy a REST/SOAP web service, Design Studio and Administration Tool now validate the credentials provided by the user.

Design Studio

  • New welcome page with direct access to the most common tasks, and resources of the Denodo Community, to accelerate the onboarding of new users.

  • New wizard to create data sources:

    • Easier to use and with a more modern look & feel.

    • It includes the Denodo Templates that we are calling Software as a service wizards. For previous versions, we already provide Denodo Templates that include the VQL file that creates the necessary data sources and views to query the REST API of several popular SaaS services (Microsoft Dynamic 365, Marketo, Google Analytics, etc.). Now, you no longer have to download these components; they are included in Design Studio. To use them, click the menu File > New > Data source and then, Software as a Service. Note that these are not data source by themselves, these are just a collection of JSON and XML data sources, and views that are created to query these REST APIs.

  • When a view has cache enabled, the pill OPTIONS of the view displays the Scheduler jobs of type VDPCache that refresh the cache. This enhancement is available in the Design Studio of the Solution Manager, not in the one of the Denodo Platform (see Cache Refresh Jobs of the Virtual DataPort Administration Guide).

  • The SUMMARY pill of the tags now displays more information about the tag like when it was created, last modified, owner, the global security policies that reference the tag, etc.

Data Catalog

  • In Denodo 9, Data Catalog has a new feature called Data preparation aimed at business users without knowledge of SQL, based on the what you see is what you get principle. This makes it possible for non-technical users to query views, add filters, etc. For more information, read the page Data Preparation.

  • It is easier to create fields and transformations because now, Data Catalog provides suggestions based on past activity of the users (see Add a Derived Field using Recommendations).

  • You can now see all the views of a database and their association (see Associations of Databases).

  • The administrator can now audit and log all the user activities like add/modify/delete a tag, category…

  • To gather the usage statistics, the administrator no longer needs to download and install the DenodoConnect component Denodo Incremental Cache Load. In 8.0, you did have to use it.

Solution Manager

  • Revisions are always deployed in a transaction. Consequently, in case of error the rollback is faster.

Scheduler

  • The REST API of Scheduler has new endpoints:

    • New endpoint to obtain information of a job, based on the name of the job.

    • New endpoint to obtain all the jobs of the type VDPCache that load the cache of a certain view.

Enhancements that Apply to Several Modules

  • During the installation of the Denodo Platform and the Solution Manager, the installer creates a unique encryption key that all the modules use to encrypt the passwords of the data sources of Virtual DataPort and other secrets.

    This is important from a security standpoint. However, it has a few consequences. The main one is that all the Denodo Platform and Solution Manager installations of your organization have to use the same encryption key. One of the post-installation tasks of the Installation Guide explains how to do this.

  • The version 9.x of the operating system Red Hat Enterprise Linux (RHEL) is now supported (see Supported Operating Systems).

Installers

The installers of the Denodo Platform and the Solution Manager for Windows are now digitally signed. This ensures file integrity and avoids issues with antivirus software, and other security applications the first time you install the Denodo Platform.


In addition to reading this page, if are upgrading from a previous version also read this:

Add feedback