Java Spring boot kafka delete message from topic with offset

0
votes

I am trying to create an spring boot app(java) that that must be able to delete a message from a kafka topic by giving its offset number and partition. I have been I have been researching the java or spring boot package classes that can do this, but I only have found something like this: Delete Messages from a Topic in Apache Kafka there is a java kafka client that have a method to delete ALL messages BEFORE an offset, but I just one to delete one. It is that possible?

thanks in advance

1
javaspring-bootapache-kafka
Does this answer your question? Delete single records from a kafka topic It's bare kafka, and not directly available in the Java API. But seeing the answer is most of times "you can't", then it applies to Java as well. – GPI
It must be deleted, I can not just leave the message as null and it also must be done in Java 😣 – Gabriel García Garrido
Who gave you this requirement, and do they understand how kafka works? – OneCricketeer

1 Answers

2
votes

If you only have the offset number and partition, and you could just delete the record at that offset, you can't guarantee that all consumers will have an eventually-consistent view, so that's why it's not a standard operation.

The suggestion: write a new record with the same key and a null body can serve as an event to tell all consumers the record is deleted.

The record with the null body will stay in the topic as configured in the delete retention time. This is usually longer than the normal retention time, to make sure consumers have enough time to delete obsolete records. After the delete retention time expires, both the original record and the null record will be removed by log compaction.