Virtual DataPort Administration Guide¶
- Preface
- Introduction
- General Architecture
- Starting Virtual DataPort
- Starting the Virtual DataPort Server
- Starting Design Studio
- Launching the Administration Tool
- Creating Data Sources and Base Views
- JDBC Sources
- Preparing the Connection to the Database
- Importing JDBC Sources
- Database Specific Information
- Connecting to a JDBC Source with Kerberos Authentication
- Connecting to a JDBC Source with OAuth Authentication
- Creating Base Views from a JDBC Data Source
- Importing Graphically Stored Procedures from a Database
- Creating Base Views from SQL Queries
- ODBC Sources
- SOAP Web Service Sources
- Multidimensional Database Sources
- Creating a Base View Over a Multidimensional Data Source, Graphically
- Creating a Base View Over a SAP Bex Query (only for SAP BW)
- Creating a Base View Over a Multidimensional Data Source with an MDX Query
- Multidimensional Data Sources to Oracle Essbase
- Multidimensional Data Sources Push Down Capabilities
- Path Types in Virtual DataPort
- Local Path
- Path From Variable
- HTTP Path
- FTP / SFTP / FTPS Path
- HDFS Path
- S3 Path
- Azure Blob Storage and ADLS Gen2 (ABFS)
- Hadoop-Compatible Storage
- Compressed or Encrypted Data Sources
- Custom Input Filters
- Paths and Other Values with Interpolation Variables
- XML Sources
- JSON Sources
- Delimited File Sources
- Excel Sources
- LDAP Sources
- BAPI Sources
- Salesforce Sources
- MongoDB Sources
- Object Storage Data in Parquet, Delta and Iceberg format
- OData 2 Sources
- OData 4 Sources
- Custom Sources
- Software as a Service Wizards
- Adobe Analytics
- Getting OAuth 2.0 Credentials
- Importing Artifacts
- Campaign Performance
- Query Example
- Content Consumption
- Query Example
- Generic
- Query Example
- Metric and Dimensions
- Query Example
- Marketing Ecommerce
- Query Example
- People Metrics
- Query Example
- Product Retail
- Query Example
- Web Acquisition
- Query Example
- Web Technology
- Query Example
- Appendix I. How to Simplify the Data Range Format in Views
- Dynamics 365 Business Central
- Dynamics 365 Customer Engagement
- Google Analytics 4
- Getting OAuth 2.0 Credentials
- Importing Artifacts
- Real Time Reports
- Query With Real Time View
- Custom Reports
- Query With Custom Report View
- Custom Pivot Reports
- Query With Custom Pivot Report View
- GA4 New Features Predefined Reports
- Query With GA4 Dimension Configurable Reporting Views
- Appendix I. How To Use Google Analytics Data API v1
- Example
- Google Analytics Migration
- Marketo
- Marketo Bulk Extract
- ServiceNow
- SharePoint
- SharePoint For OData
- SharePoint REST API
- Adobe Analytics
- Viewing the Schema of a Base View
- Data Source Configuration Properties
- Source Refresh
- Working with Blob Fields of Base Views
- JDBC Sources
- Creating Derived Views
- Creating Union Views
- Creating Join Views
- Creating Selection Views
- Creating Flatten Views
- Creating Intersection Views
- Creating Minus Views
- Creating Interface Views
- Viewing the Schema of a Derived View
- Tree View
- Data Lineage
- Advanced Configuration of Views
- Materialized Tables
- Temporary Tables
- Querying Views
- Editing / Replacing a View
- Stored Procedures
- Publication of Web Services
- RESTful Architecture
- Primary Keys of Views
- Associations
- RESTful Web Service
- Denodo OData 4.0 Service
- Serving Metadata
- Querying Data: The Basics
- Navigating Associations
- Advanced Querying
- Pagination
- Configuration
- Entity Collection Streaming
- Debug Option
- Privilege Requirements
- Limitations
- Features
- Denodo GraphQL Service
- JMS Listeners
- Kafka Listeners
- Remote Tables
- Server Configuration
- Configuring the Cache
- Limiting the Number of Concurrent Requests
- Credentials Vault
- Configuring the Default Internationalization
- Default Configuration of HTTP Proxy
- Identifiers Charset
- Configuring the Memory Usage and Swapping Policy
- Privileges
- Global Settings of REST Web Services
- Queries Optimization
- Server Authentication
- LDAP Authentication
- Initial Configuration for Enabling LDAP Authentication
- Enabling Global LDAP Authentication for the Virtual DataPort Server
- Enabling LDAP Authentication for a Virtual DataPort Database
- The LDAP Authentication Process
- Configuring a Database with LDAP Authentication and Dynamic Groups
- Enabling the LDAP Roles Cache
- Kerberos Authentication
- SAML Authentication
- OAuth Authentication
- Denodo Security Token Authentication
- LDAP Authentication
- Server Connectivity
- Configuring Runtime Parameters for Stored Procedures
- Threads Pool
- Storing the Metadata on an External Database
- Denodo Assistant
- Memory Management
- Resource Manager
- Exporting and Importing the Server Metadata
- Importing Extensions
- Cache Module
- Cache Modes
- Cache Maintenance Task
- Specific Information about Cache Databases
- Generic Support for Other Databases
- Table Creation Templates Management
- Version Control Systems Integration
- VCS Configuration
- VCS Integration Features
- Scenarios and Recommended Uses
- Best Practices When Using the Integration with a VCS
- Databases, Users and Access Rights in Virtual DataPort
- Databases in Virtual DataPort
- User and Access Rights in Virtual DataPort
- Fine-Grained Privileges at View Level
- Modeling Fine-Grained Role Restrictions on Multiple Roles
- Limit Indirect Access to Views Shared with Other Development Teams
- Administration of Databases, Users, Roles and Their Access Rights
- Privilege Auditing
- Global Security Policies
- Import Tags from External Catalog
- Monitoring the Virtual DataPort Server
- Monitoring with a Java Management Extensions (JMX) Agent
- Using JavaTM VisualVM
- General Information on the Server
- Information on Data Sources
- Information on the Cache
- Information and Events on Catalog Access (DDL Statements)
- Information and Events on the Running of Statements
- Information and Events on Transactions
- Setting the User Agent of an Application
- Setting Cloud Infrastructure Properties
- Denodo Monitor
- FinOps
- Monitoring with a Java Management Extensions (JMX) Agent
- Cluster Architectures / Server Backup
- Data Lake Storage Management
- Bulk Data Load
- AlloyDB for PostgreSQL
- Amazon Athena
- Amazon Aurora MySQL
- Amazon Aurora PostgreSQL
- Amazon Redshift
- DB2
- Databricks
- Denodo Embedded MPP
- BigQuery
- Hive
- Impala
- Kudu
- MySQL
- Oracle
- PostgreSQL
- PrestoDB/Trino
- Snowflake
- Spark
- Microsoft SQL Server and Azure Synapse SQL
- Teradata
- Yellowbrick
- Settings of the Generation of the Temporary Files
- Bulk Data Load on a Distributed Object Storage like HDFS, S3 or ADLS
- Built-in Implementation
- External Hadoop Installation
- Optimizing Queries
- Optimizing DF Data Sources
- Optimizing Join Operations
- Automatic Simplification of Queries
- Cost-Based Optimization
- Enabling the Cost-Based Optimization
- Gathering the Statistics of Views
- Tuning the Cost-Based Optimization Process
- Estimating the Cost of Queries on Data Sources
- Estimating Post-Processing Costs
- Specifying Indexes
- Tuning the Imported Indexes Information for Oracle
- Tuning the Imported Indexes Information for MySQL
- Tuning the Imported Indexes Information for Informix
- Tuning the Imported Indexes Information for Teradata
- Tuning the Imported Indexes Information for Netezza
- Tuning the Imported Indexes Information for Redshift
- Tuning the Imported Indexes Information for Greenplum
- Tuning the Imported Indexes Information for Hive
- Tuning the Imported Indexes Information for Google BigQuery
- Tuning the Imported Indexes Information for Other Data Sources
- Data Source I/O Parameters
- Current Limitations of the Cost-Based Optimization Process
- Data Movement
- Parallel Processing
- Window Functions
- Smart Query Acceleration Using Summaries
- Denodo Embedded MPP
- Import Model
- Appendix
- Avoiding SQL Injections
- Backward Compatibility Between the Virtual DataPort Server and Its Clients
- Configuring the Logging System
- Configuring the Network Interface Restriction in the Denodo Platform
- Considerations When Configuring Data Sources with Pass-Through Credentials
- Data Sources That Support Merge Data
- Using the Databricks API and DBFS for Bulk Loads
- Change Password Script (Design Studio)
- Enable the “Export” Endpoint of the Web Container
- Execution Trace Information
- Configure Export Key Script
- Importing the Certificates of Data Sources (SSL/TLS Connections)
- Installing the Connector for Oracle Essbase
- Installing the JMS Connectors to Create JMS Listeners and Web Services with SOAP Over JMS
- Installing the SAP Java Connector
- JMS Connection Details: JNDI Properties
- Launching Several Virtual DataPort Instances of the Same Installation
- Creating Multidimensional Base Views Over a Multidimensional Data Source
- Mapping Multidimensional Data to a Relational Model
- Mapping the Result of MDX Queries
- OpenAPI 3 Data Sources FAQ
- Resource Manager: Available Fields to Evaluate a Rule
- Restriction of Number of Data Sources
- Single User Mode
- Supported JDBC Data Sources
- Transforming Incoming/Outgoing Soap/Rest Messages with XSLT Stylesheets
- Useful Tools to Debug Issues with Active Directory or Other LDAP Servers
- Values of the Attribute “Access Interface”
- Change Password Script (VDP)