USER MANUALS

Catalogs

Catalogs in the Denodo Embedded MPP are the equivalent to data sources in Denodo Virtual Dataport.

The Denodo Embedded MPP is shipped with:

You can define new catalogs creating the catalog properties file in presto/conf/catalog/, e.g., presto/conf/catalog/glue_hive.properties. The file name, glue_hive, would be the catalog name. Then you have to add the type of catalog to the connector.name property - hive-hadoop2, delta and iceberg are supported- and any other properties required by the catalog type.

Below there is an example of a Hive catalog properties to read from AWS Glue Data Catalog:

connector.name=hive-hadoop2

hive.metastore=glue

# AWS region of the Glue Catalog
hive.metastore.glue.region=

# The ID of the Glue Catalog in which the metadata database resides
hive.metastore.glue.catalogid=

# Access Key and Secret Key for Glue
# Credentials and core-site.xml are not required when the MPP
# runs in EKS because it will use the IAM Roles for Service Accounts
# or the IAM EC2 instance profile, whichever is configured in EKS
hive.metastore.glue.aws-access-key=
hive.metastore.glue.aws-secret-key=
hive.config.resources=/opt/presto-server/etc/catalog/core-site.xml


# For Bulk Data load
hive.allow-drop-table=true
hive.non-managed-table-writes-enabled=true

hive.parquet.use-column-names=true
Add feedback