I am working with apache beam. My task is to pull data from kafka topic and process in dataflow.
Does dataflow support kafkaIO ?
Which runners are supported for KafkaIO ?
2
votes
was the answer helpful?
– Pablo
@Pablo, conceptually its ok., but practically i'll need to research more about runner_v2.
– Joseph N
1 Answers
0
votes
Yes. KafkaIO is supported by Dataflow and other major Beam runners.
We have Kafka transforms for both Java and Python SDKs.
Note that Python versions are cross-language transforms and Dataflow requires runner V2.
