Home / Q&A / REST service data source for large amount of data
You can translate the question and the replies:

REST service data source for large amount of data

I have a REST service data source containing a few million product items. How are VSQL query parameters such as ItemId converted to the query parameter on that source REST service? Does Denodo have to pull all 3 million items and then filter the result set?
Data Source REST
user
11-01-2021 09:55:49 -0500

3 Answers

Hi, When I publish the view as RESTful web service, I would make use of "Set as mandatory" option by double clicking on the field in Resources Tab. With this setting, I have to specify the value for the field in the Query. As for filtering the query result, I was able to use $filter parameter for RESTful web service. By using this filter, I don't have to pull all the data and I can just get the data I need. I referred to the following user manuals, I believe it should be helpful to you: * [Resources Tab](https://community.denodo.com/docs/html/browse/8.0/vdp/administration/publication_of_web_services/publishing_rest_web_services/resources_tab) * [Input Parameters of the RESTful Web Service](https://community.denodo.com/docs/html/browse/latest/vdp/administration/restful_architecture/restful_web_service/input_parameters_of_the_restful_web_service) Hope this helps!
Denodo Team
12-01-2021 04:11:44 -0500
My question is about the REST API **data source**. It is a REST API provided by a system external to Denodo. The video/toturial suggest to use a JSON data source with http data route. But it seems Denodo just get all 2 million records from the API and then filter the result based on the query parameter (such as product ID). How do I set up the REST API **data source** in a way so Denodo would invoke the REST API dynnically with the query parameter (product ID in this case)? Thanks.
user
12-01-2021 09:56:10 -0500
Hi, Query parameter is a variable that is added to the end of URL to send information to server and user can retrive any range of data by adding query parameters. In other words, the user does not need to get all the data from data sources. I was able to include query parameters in HTTP request when I created a data source of the type XML, JSON or delimited text file. I found this info in the following manuals. These should be helpful to you. * [Path Types in Virtual DataPort](https://community.denodo.com/docs/html/browse/8.0/vdp/administration/creating_data_sources_and_base_views/path_types_in_virtual_dataport/path_types_in_virtual_dataport) * [HTTP Path](https://community.denodo.com/docs/html/browse/8.0/vdp/administration/creating_data_sources_and_base_views/path_types_in_virtual_dataport/http_path#http-path) Hope this helps!
Denodo Team
29-01-2021 04:31:48 -0500
You must sign in to add an answer. If you do not have an account, you can register here