You can translate the question and the replies:

Iterate Api

Hello, I have 12 number of pages with my API with limit of 1000 and offset of 1000. Now If I obtain a single page of data it consists of 1000 rows of data and I cannot increase the limit to even 2000 becuase of source that provides only 1k data at a time. Now How can I achieve all the data in one go using denodo how can I reitterate the data and get all the data Can I use interpolation variable. the table do have link for the next page and previous page. - changing limit doesnt matter, it
user
29-09-2020 05:14:03 -0400

1 Answer

Hi, In order to handle APIs that return data on multiple pages, Denodo includes built in Pagination functionality for XML, JSON, and Delimited File data sources using an HTTP path. Using this feature, I have been able to gather data from paginated APIs using multiple methods such as paging indices, navigating through links in the response, navigating through links in the headers, and others. For more information about the Pagination functionality built in to Denodo, you can reference the [Pagination](https://community.denodo.com/docs/html/browse/latest/vdp/administration/creating_data_sources_and_base_views/path_types_in_virtual_dataport/http_path#pagination) section of the Virtual DataPort Administration Guide. Additionally, in order to see the requests that Denodo is sending to the data source for troubleshooting or just for more information, you can click on the Data Route objects in the execution trace of your query. I find this to be extremely helpful when I am trying to gather more information about how Denodo is handling the paginated data. I hope this helps!
Denodo Team
29-09-2020 21:09:37 -0400
You must sign in to add an answer. If you do not have an account, you can register here