1
votes

I access a SOAP webservice which can return results, for example, of 20000 ID's in array form.

I need to then use the same webservice to get more information about each of those 20,000 ID's but making 20,000 API requests is obviously not an option.

The API is limited as you can see. No pagination and no way to get the required additional data in the initial pull.

I also have no database access to store and loop through.

Any other options to paginate this data outside of a massive timeout value that I might have overlooked?

4

4 Answers

2
votes

No database? Surely you have something.. access the filesystem and serialize the results there.

1
votes

How often does the data change? You might have to do the 20k API calls, but you don't want to do so on every request. Maybe you can setup a cronjob which caches the data on your server, for example every hour or every day, depending on how often the data changes.