Import Settings and Metadata in to the New Installation¶
Once you installed Denodo 8.0 and Solution Manager 8.0, follow these steps to import the metadata of the previous installation.
If you do not use a module, you do not need to import its metadata and settings.
Important
Do not import metadata nor settings from Denodo 5.5 or earlier. Some VQL statements of 5.5 and previous versions are incompatible with 8.0. The section Upgrading from Denodo Platform 5.5 or Earlier explains how to proceed in this scenario.
Copy the files
resources_denodo.vql
andmetadata_denodo.vql
you obtained from Denodo 7.0, to the to the computer where you installed Denodo 8.0.Connect to the computer where you installed Denodo 8.0, open a command prompt and execute these commands:
On Windows:
cd <DENODO_HOME> cd bin import.bat --file resources_denodo.vql --server "//localhost:9999/admin?<administrator user>@<password>" > import_resources.log 2>&1 import.bat --file metadata_denodo.vql --server "//localhost:9999/admin?<administrator user>@<password>" > import_metadata.log 2>&1
On Linux:
cd <DENODO_HOME> cd bin ./import.sh --file resources_denodo.vql --server '//localhost:9999/admin?<administrator user>@<password>' > import_resources.log 2>&1 ./import.sh --file metadata_denodo.vql --server '//localhost:9999/admin?<administrator user>@<password>' > import_metadata.log 2>&1
In these commands, replace
<administrator user>
and<password>
with the actual values.Note
If you execute this script on Windows and the password contains double quotes (
"
), escape them. If you run this script on Linux, do the same with single quotes ('
).For example, if you are on Windows and the password is
pas"s
, enter this:"//localhost:9999/admin?login@pas""s"
If you are on Linux and the password is
pas's
, enter this:'//localhost:9999/admin?login@pas'"'"'s'
These commands import the resource file and the metadata file and redirect the output of each command to the files “import_resources.log” and “import_metadata.log”.
After executing this, open the file “import_metadata.log”, go to the end of the file and check there were no errors. You should see something like this:
------------------------------------------------------------------------------- [JobStatistics [//localhost:9999/jsmith?my_password] #Errors: 0 #Warnings: 0] --------------------------------------------------------------------------------
If there are any errors, you will find them right above (look for “ERRORS SUMMARY”).
Open the file “import_resources.log” and also check for errors.
If there are errors during this process, check the section below Common Errors when Importing the Metadata of Virtual DataPort 7.0 to 8.0.
Log in to Data Catalog 8.0 with an administrator account and import the file exported from the previous version.
For Scheduler Index, connect to the computer where the Denodo Platform 8.0 is installed, and execute this:
On Windows:
cd <DENODO_HOME>\tools\arn-index import.bat -h localhost -p 9000 -l <user name> -P <password> -f scheduler-index_upgrade.zip
On Linux:
cd <DENODO_HOME>/tools/arn-index ./import.sh -h localhost -p 9000 -l <user name> -P <password> -f scheduler-index_upgrade.zip
In this command, replace
<user name>
and<password>
with the credentials of an administrator user.The file
scheduler-index_upgrade.zip
is the result of exporting Scheduler Index 7.0.Log in to Scheduler 8.0 with an administrator account and import the file exported from the previous version.
Log in to Solution Manager 8.0 with an administrator account and do the following:
Import the file exported from the previous version.
Edit the servers so they point to the new Denodo servers. Note that the Solution Manager of 8.0 can only interact with Denodo servers of the same major version (8.0).
Open the ITPilot Wrapper Generation Tool and import the ITPilot wrappers exported from version 7.0.
Common Errors when Importing the Metadata of Virtual DataPort 7.0 to 8.0¶
If you see an error like this:
1 2 3 4 5 6 7 8 9 10 11 12 13 | CREATE OR REPLACE DATASOURCE CUSTOM cw_denodo_dfs_customwrapper
FOLDER = '/sources/hadoop/hdfs'
CLASSNAME='com.denodo.connect.hadoop.hdfs.wrapper.HDFSDelimitedTextFileWrapper'
JARS 'denodo-dfs-customwrapper'
ERROR:Error creating new data source:
Parameter 'File system URI' is mandatory
Command: CREATE OR REPLACE DATASOURCE CUSTOM cw_denodo_kafka
FOLDER = '/sources/others'
CLASSNAME='com.denodo.connect.kafka.wrapper.KafkaDateRangeConsumerWrapper'
JARS 'denodo-kafka-customwrapper'
ERROR:Error creating new data source:
Parameter 'Connection String *' is mandatory
|
If you get errors like the ones in line #6 and #13 (Parameter … is mandatory), it means that:
This DenodoConnect used to define an input parameter as part of its base views. That version was imported into Virtual DataPort 7.0 at some point.
This applies to any custom wrapper, not just the DenodoConnect ones.
At a later date, this DenodoConnect was replaced in Denodo 7.0 with the current version. In this new version, the parameter has to be set in the data source and it no longer is a parameter of the base view.
Because of this, the VQL generated for this custom wrapper is invalid both for 7.0 and 8.0. At this moment, in version 7.0, the base views created over this custom data source can be queried but if you export the VQL of the custom wrapper and import it again into 7.0, it will also fail. The DenodoConnect components that changed in this way regarding input parameters have post-installation tasks to modify their configuration (i.e. open the ZIP file of the DenodoConnect and look for the post-installation notes in the README file).