storm-kafka - example application or a git link of a storm topology that maintains the kafka partition level ordering?

Question

I know, storm doesn't guarantee total ordering gurantee for kafka topics, but see in many documents, storm guarantees consumption/processing the messages maintaining the order at partition level.

I am looking for a sample storm topology, that consumes/processes the messages of a kafka topic maintaining the order of messages at a kafka partition level.. NOT Total Order!! ONLY partition level ordering guarantee.

please share if you know any sample application. Thanks a lot!!

Answer 1

Have you looked at Apache Storm examples here? https://github.com/apache/storm/tree/master/external/storm-kafka

You may want to consider standard example and scale it based on your needs. Also, while defining Schema for the KafkaSpuout, you may want to output some key as part of the tuple and later use FieldG rouping.