I am using multithreaded kafka consumers for a single 60 partitions kafka topic, with each consumer thread mapped to each partiton. After the consumption is complete, each consumer thread is closed using KafkaConsumer.close() method.
During reconsumption with same consumer groupid, (seek to beginning is used per consumer tread), 1 or 2 consumer threads fail to consume from their assigned partitions. If a new consumer group id is provided, this issue does not show up.
So, if the below script is used to delete a consumer group.
bin/kafka-consumer-groups.sh --bootstrap-servers "3 Servers:port" --delete --group group1
Is it a safe way to delete the consumer group metadata and if it also disconnects the active TCP connections from all consumers assigned to this group.
Please share your opinions on this.