USER MANUALS

What Is New in Denodo 9.3

This page lists the main enhancements of the update 9.3 of the Denodo Platform and the Solution Manager. We also published these videos that explain the enhancements included in this update:

For the full list of enhancements and bug fixes, read the Release Notes in the Support Site.

Virtual DataPort

  • The Denodo Assistant is a set of features of the Denodo Platform that use artificial intelligence to make it easier to create and use virtual models. This update adds several features:

    • In the VQL Shell, users can now type a query in natural language, and the Assistant will automatically generate the appropriate SQL query and execute it.

    • In the wizard to edit views, the Denodo Assistant now suggests tags to assign to the view and its columns.

Virtual DataPort - Data Sources

  • New JDBC adapters:

    • Amazon RDS for MySQL, Oracle, PostgreSQL and SQL Server (as a data source and as cache database)

    • ClickHouse (as a data source and as cache database)

    • KingbaseES in the modes for Oracle and PostgreSQL.

    • Sybase IQ / SAP IQ, using the driver SQL Anywhere. The existing Sybase IQ / SAP IQ adapter uses jConnect.

Virtual DataPort - Execution Engine

  • Virtual DataPort can now run queries that have a subquery in the HAVING clause.

  • Several improvements in performance. For example, the cost optimizer estimates better the number of rows returned by a subquery in the WHERE clause.

Virtual DataPort - Materialization Engine

  • The adapters Sybase IQ and Sybase Adaptive Server Enterprise (ASE) can now be configured to use the bulk load APIs of Sybase to load data.

  • The cache engine now supports these databases

    • Huawei GaussDB

    • ClickHouse

    • KingbaseES in the modes for Oracle and PostgreSQL

    Full list of databases supported by the Cache Engine).

  • Several improvements in the “materialization” of type “Full” (previously known as “caching”):

    • New features for when the schema of the view changes (e.g. to add a field):

      • Adapt schema: in the tab Materialization of the view > Materialization Schema, select Adapt schema so the next time the schema of the view changes, the materialization engine preserves the will adapt accordingly the schema of the table in which the data is materialized. In the past, the materialized data would be invalidated, and you would have to materialize the view again.

      • You can enable Column cleanup to delete the columns of the table when a field of the view is deleted.

    • You can now customize the name of the table in which the data will be materialized. To do this, open the view, go to OPTIONS > Materialization, enable Custom table name.

Virtual DataPort - Web Services Published by Denodo

  • New features of the RESTful web service (/denodo-restfulws):

    • It can now expose an OpenAPI document. This feature was already available in the REST web services users create, but not in “/denodo-restfulws”.

      This feature is disabled by default; this page explains how to enable it.

    • Added support for the following authentication method: OAuth and Kerberos. By default, the authentication method of this service is still HTTP Basic with VDP. This page explains how to enable the new authentication methods.

Virtual DataPort - Design Studio

  • The VQL Shell of Design Studio and Data Marketplace, now execute the VQL statement in which the mouse cursor is located, instead of all the statements. This prevents accidentally executing all the statement in the editor. To execute all the statements of the editor, click Execute > Execute all or press Ctrl+A followed by Ctrl+Enter.

Virtual DataPort - Operations and Security

  • To limit the paths to which the users have access, you can now use the new feature Edit allowed paths of Role management. This is more convenient than the privilege FILE because FILE needs to be granted to a user/role over all the databases and the allowed paths, only once.

  • In 9.2 and earlier, the FILE privilege does not affect the administrators of a database. Now, there is a feature (disabled by default), so this privilege also affects the administrators of databases. To enable it, go to Server configuration, navigate to Security > Privileges and switch on Enforce FILE privilege restrictions for database administrators.

  • You can now configure JSON data sources with HTTP Data route to obtain the credentials from a vault.

Data Marketplace

  • The Data Catalog has been rebranded to Data Marketplace.

  • Added feature Global Assisted Queries. With this, users can type a query in natural language that involves multiple views (not just one view) and query their content. Powered by AI, this feature automatically identifies the most relevant views and generates a SQL query based on the user’s needs.

    This feature stores the metadata in a vector database, to be able to do similarity-based queries and retrieval-augmented generation (RAG) use cases.

  • Many user experience (UX) improvements. Some of them are:

    • Improved home page, My queries, My Notifications, LLM configuration wizard of Denodo Assistant, External elements, etc.

    • New themes: Dark, High Contrast and Bigger font size.

Scheduler

  • The Administration Tool has a new dependencies graph for DAG jobs that makes it easier to visualize and understand the relationships between your tasks.

  • Improved the responsiveness of the following: the jobs page, the initial data sources page and the job extraction section.

Solution Manager

Enhancements that Apply to Several Modules

  • Starting with the update 9.3, the update replaces the Java Runtime Environment (JRE) included in the Denodo Platform ({<DENODO_HOME>/jre), to a new minor version. This is to address security vulnerabilities in the JRE itself. When doing this, the update preserves these files in case they had been modified:

    • <DENODO_HOME>/jre/lib/security/cacerts

    • <DENODO_HOME>/jre/conf/security/java.security

    The commands to install updates from the command line are now different.

  • The Denodo AI Software Development Kit (SDK) <https://www.denodo.com/en/solutions/by-capability/ai-software-development-kit> included in the installation has been updated to the latest version ({<DENODO_HOME>/samples/ai-sdk).

  • Data Catalog, Design Studio and Scheduler have new internationalization options:

    1. The administrator can now put in place the language files of these applications, from the browser. In 9.2, the administrator had to copy the language files manually, to the computer that runs the Denodo services. The page Language of Data Marketplace, Design Studio and Scheduler explains how to do it.

    2. By default, the applications display their user interface in the language preferred by the user’s web browser (already available in 9.2). In 9.3, after logging in, the users can select the language in which they want to display the application (among the languages the administrator made available).

Information about Deprecated Features

  • With the release of this update, we have deprecated the FILE privilege. To limit the paths to which the users have access, use the new feature Edit allowed paths of Role management.

  • The database adapter Sybase IQ / SAP IQ 16 (jConnect) is now deprecated and you should use the adapter instead. The adapter that uses the driver SQL Anywhere can use the bulk data load features of this database. This implies that inserting data into this database will be much faster. This is specially noticeable when materializing the data of a view that returns a large number of rows.

The page Features Deprecated in Denodo Platform lists all the features that are deprecated.

Add feedback