Values to configure pagination rules in Rest API connector in azure data factory to get data and load into sql database

0
votes

Need values to configure in Rest API connector in Azure data factory recently getting only 1000 records. Need how to setup configuration so that the values can be looped.(Pagination rules to configure continuous token).

1
azureazure-data-factory-2
Were you able to solve the issue? I am trying to find what I need to do here: stackoverflow.com/questions/68186437/… – Java

1 Answers

0
votes

Based on the official document,ADF pagination rules only support below patterns.

enter image description here

I think you could adopt the pattern: Next request’s query parameter = property value in current response body to set the page size, then pass it into next request as parameter.

As mentioned in the rules, the connector will stop iterating when it gets HTTP status code 204 (No Content), or any of the JSONPath expression in "paginationRules" returns null.