How to find group.id property of a kafka topic in Amazon MSK?

0
votes

I am trying to consume messages from a Kafka topic in Amazon MSK using Apache NiFi. NiFi ConsumeKafka processor requires group.id property of Kafka.Where or How can I find the group.id property for the MSK cluster?

1
amazon-ec2apache-nifiaws-msk

1 Answers

1
votes

You can set the group.id property to whatever you want - this simply allows you to group multiple consumers (i.e. multiple NiFi nodes) together to consume from a single topic concurrently.

Read up on Kafka Consumer Groups

E.g. https://blog.cloudera.com/scalability-of-kafka-messaging-using-consumer-groups/