1
votes

I have Global State Store attached my topology. Global state store in reading from compacted topic. This global state store stores 100,000 records and these records should be there in state store for correct processing of the topology.

Question: Q. During application restart, kafka streams will start the global state store thread and make sure that the state is fully built before starting streams threads ?

I am trying to find some documentation related to this topic Please point me to code or documentation also.

1
Yes, a global store is loaded completely before processing starts.Matthias J. Sax
@SunilS Could you please share how you initialized a global state store with compacted Kafka topic?prixa

1 Answers

1
votes

It depends if there is still any state remaining in the state.dir local filesystem for your application.id.

If there is, it'll start rebuilding data onto there. Otherwise, the beginning of the topic will have to be consumed to recreate that data