Import Settings and Metadata in to the New Installation

Follow these steps to import the metadata of the previous installation to the new one.

If you do not use a module, you do not need to import its metadata and settings.

Important

Do not import metadata nor settings from Denodo 6.0 or earlier. Some VQL statements of 6.0 and previous versions are incompatible with 8.0. The section Upgrading from Denodo Platform 6.0 or Earlier explains how to proceed in this scenario.

  1. Copy the files resources_denodo_70.vql and metadata_denodo_70.vql you obtained from Denodo 7.0, to the to the computer where you installed Denodo 8.0.

  2. Connect to the computer where you installed Denodo 8.0, open a command prompt and execute these commands:

    • On Windows:

    cd <DENODO_HOME>
    cd bin
    
    import.bat --file resources_denodo_70.vql --server "//localhost:9999/admin?<administrator user>@<password>" > import_resources.log 2>&1
    
    import.bat --file metadata_denodo_70.vql --server "//localhost:9999/admin?<administrator user>@<password>" > import_metadata.log 2>&1
    
    • On Linux:

    cd <DENODO_HOME>
    cd bin
    
    ./import.sh --file resources_denodo_70.vql --server "//localhost:9999/admin?<administrator user>@<password>" > import_resources.log 2>&1
    
    ./import.sh --file metadata_denodo_70.vql --server "//localhost:9999/admin?<administrator user>@<password>" > import_metadata.log 2>&1
    

    In these commands, replace <administrator user> and <password> with the actual values.

    These commands import the resource file and the metadata file and redirect the output of each command to the files “import_resources.log” and “import_metadata.log”.

    After executing this, open the file “import_metadata.log”, go to the end of the file and check there were no errors. You should see something like this:

    -------------------------------------------------------------------------------
    [JobStatistics [//localhost:9999/jsmith?my_password] #Errors: 0 #Warnings: 0]
    --------------------------------------------------------------------------------
    

    If there are any errors, you will find them right above (look for “ERRORS SUMMARY”).

    Open the file “import_resources.log” and also check for errors.

    If there are errors during this process, check the section below Common Errors when Importing the Metadata of Virtual DataPort 7.0 to 8.0.

  3. Log in to Data Catalog 8.0 with an administrator account and import the file exported from the previous version.

  4. For Scheduler Index, connect to the computer where the Denodo Platform 8.0 is installed, and execute this:

    • On Windows:

      cd <DENODO_HOME>\tools\arn-index
      
      import.bat -h localhost -p 9000 -l <user name> -P <password> -f scheduler-index_export_70.zip
      
    • On Linux:

      cd <DENODO_HOME>/tools/arn-index
      
      ./import.sh -h localhost -p 9000 -l <user name> -P <password> -f scheduler-index_export_70.zip
      

    In this command, replace <user name> and <password> with the credentials of an administrator user.

    The file scheduler-index_export_70.zip is the result of exporting Scheduler Index 7.0.

  5. Log in to Scheduler 8.0 with an administrator account and import the file exported from the previous version.

    Important

    The Scheduler 8.0 server must be configured to use the same type of metadata database as the one of the version 7.0 used to export the metadata (i.e. if you have exported the metadata from a Scheduler 7.0 server configured to use Derby as metadata database, you should configure the Scheduler 8.0 server to also use Derby). If desired, after importing the metadata, you can configure the Scheduler 8.0 server to use other type of metadata database.

  6. Log in to Solution Manager 8.0 with an administrator account and do the following:

    1. Import the file exported from the previous version.

    2. Edit the servers so they point to the new Denodo servers. Note that the Solution Manager of 8.0 can only interact with Denodo servers of the same major version (8.0).

  7. Open the ITPilot Wrapper Generation Tool and import the ITPilot wrappers exported from version 7.0.

Common Errors when Importing the Metadata of Virtual DataPort 7.0 to 8.0

If you see an error like this:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
CREATE OR REPLACE DATASOURCE CUSTOM cw_denodo_dfs_customwrapper
    FOLDER = '/sources/hadoop/hdfs'
    CLASSNAME='com.denodo.connect.hadoop.hdfs.wrapper.HDFSDelimitedTextFileWrapper'
    JARS 'denodo-dfs-customwrapper'
ERROR:Error creating new data source:
Parameter 'File system URI' is mandatory

Command: CREATE OR REPLACE DATASOURCE CUSTOM cw_denodo_kafka
    FOLDER = '/sources/others'
    CLASSNAME='com.denodo.connect.kafka.wrapper.KafkaDateRangeConsumerWrapper'
    JARS 'denodo-kafka-customwrapper'
ERROR:Error creating new data source:
Parameter 'Connection String *' is mandatory

If you get errors like the ones in line #6 and #13 (Parameter … is mandatory), it means that:

  1. This DenodoConnect used to define an input parameter as part of its base views. That version was imported into Virtual DataPort 7.0 at some point.

    This applies to any custom wrapper, not just the DenodoConnect ones.

  2. At a later date, this DenodoConnect was replaced in Denodo 7.0 with the current version. In this new version, the parameter has to be set in the data source and it no longer is a parameter of the base view.

Because of this, the VQL generated for this custom wrapper is invalid both for 7.0 and 8.0. At this moment, in version 7.0, the base views created over this custom data source can be queried but if you export the VQL of the custom wrapper and import it again into 7.0, it will also fail. The DenodoConnect components that changed in this way regarding input parameters have post-installation tasks to modify their configuration (i.e. open the ZIP file of the DenodoConnect and look for the post-installation notes in the README file).