Apache Ignite Rest API calls. (Any Ideas about Apache Ignite SDK?)

0
votes

We are trying to store data from XML in Apache ignite cache, which is set up in a Kubernates cluster in Azure. We have a spring boot application, added ignite dependency, parsing the XML using jaxb to pojos and storing the data. But the ignite cache put operation is taking a lot of time. ( Because we are dealing with 500K - 1M lines of XML

As an alternative, we trying to use this REST API calls provide by ignite itself in our application. (https://apacheignite.readme.io/docs/rest-api)

My questions:

  1. Does anybody have working example to do this in spring boot? Can it be done using Ignite SDK? (We know we can send get and put request using rest template in spring boot.)

  2. Is it possible to send json response to this rest API? If so, How? Examples please.

Thanks for your response. Will help us a lot.

1
restapispring-bootmicroservicesignite
Is the question "how do i efficiently load 1mm lines of XML" or "how do I use the REST API"? - Stephen Darlington
How to use the Apache Ignite Rest api calls from spring boot? And also how to save 1M lines XML efficiently into Ignite cache? - santhan2594

1 Answers

2
votes

If your underlying problem is loading 1mm records is too slow, using the REST interface is not the solution. Instead, you should consider using the DataStreamer API, which is designed to ingest large amounts of data. You probably also don't need to convert your XML objects into POJO, but that's an optimisation you might not need right now.