Home / Q&A / Denodo unable to fetch all the records for an entity which contains different Schemas file extensions for the parquet files from S3
You can translate the question and the replies:

Denodo unable to fetch all the records for an entity which contains different Schemas file extensions for the parquet files from S3

Hello, I tried to create a base with file pattern (.*) for the parquet file entity/table in s3 region. Then, when i excute the count query to fetch all the recodrs in the entity.I could able to get the below mentioned error. Finished with error: Error executing query. Total time 204.111 seconds. ** QUERY [GROUPBY] [ERROR] BV_XXX [BASE] [ERROR] BV_XXX [CUSTOM WRAPPER] [ERROR] Received exception with message 'Error accessing Parquet file: null'** In the S3 region, i could able to see that each enity partitioned into diffrent folders with respective sys_loaded_id's like 'SYS_LOADED_ID=202'. The partial files in the each load id's have extention parquet other partial in a text form. Thanks in advance
DENODO AWS S3 HDFSCustomWrapper; S3 Create Base View custom S3
user
09-02-2021 07:03:56 -0500

3 Answers

Hi, Based on the error message "[CUSTOM WRAPPER][ERROR]", it looks like this error is coming from the custom wrapper. In this case, I will check the following settings: 1. Configuration parameters of the custom wrapper to crate a data source, such as File system URI, Access Key ID etc, is correct or not 2. Wrapper Parameter values for creating Base View from the data source, such as Parquet File path etc, is correct or not And then, execute the count query again and check if there are any error messages. I found the relevant info in the following document. I believe it should be helpful to you. * [How to integrate Amazon S3 with Denodo Distributed File System Custom Wrapper](https://community.denodo.com/kb/view/document/How%20to%20integrate%20Amazon%20S3%20with%20Denodo%20Distributed%20File%20System%20Custom%20Wrapper?category=Data+Sources) If the issue persists and you are a valid support user, you may open a **Support Case** at the [Denodo Support Site](https://support.denodo.com/) and Support Team will help you. Hope this helps!
Denodo Team
10-02-2021 03:40:58 -0500
Hello, Thanks for your kind Information ! The costum wapper looks fine, I think problm is form the source files. I can see the partial of SYS_LOADED_ID folders contains few columns added newly! May be this is the reasons, couldn't able to fetch all the coulumns while quering. Could this can be resolved in any other way ! Please help me if this can be resolved. Denodo version 7.0
user
12-02-2021 05:26:51 -0500
Hi, In order to reflect changes in the underlying data source, I would use **source refresh** option available on the "Edit" tab of the base view in the Virtual DataPort Administration Tool. I found the relevant info in the following manual. I believe this should be helpful to you. * [Source Refresh](https://community.denodo.com/docs/html/browse/7.0/vdp/administration/creating_data_sources_and_base_views/source_refresh/source_refresh) Hope this helps!
Denodo Team
24-02-2021 06:15:56 -0500
You must sign in to add an answer. If you do not have an account, you can register here