kafka connect mongo on kafka MSK

2
votes

I am using Kafka MSK in AWS. So we don't have native kafka connect with all required connectors like on confluent. Actually I work with kakfa mongo connector and I want to find a way to push the kafka mongo connector jar to an on an instance of kafka MSK cluster. The path to which the jar will be pushed is the plugins.path as defined in the properties of the used connector.

ANy way to make it please ?

1
apache-kafkaapache-kafka-connectamazon-msk
Kafka Connect should be deployed externally to the brokers, in any environment – OneCricketeer

1 Answers

4
votes

MSK doesn't give you a hosted Kafka Connect worker. You'd need to provision and run this yourself, e.g. on EC2. This work would then connect to your Kafka cluster (MSK in this case)

To be clear: MSK is only the hosted Kafka brokers (and Zookeeper). It does not include Kafka Connect, which is what you need in order to run connectors.