Apache Kafka alongside Confluent Schema Registry

1
votes

I'm using the Azure HDInsight's managed Apache Kafka solution since unfortunately there's no managed Confluent Kafka solution on Azure. Is it possible to run the Confluent Schema Registry and connect it to the HDInsight Apache Kafka cluster's brokers?

I'm hoping to install just the Schema Registry on a single VM, then using this line in the schema-registry.properties file, point it to the HDInsight cluster's list of brokers:

kafkastore.bootstrap.servers=PLAINTEXT://localhost:9092

Will this work? Or do the brokers need to be Confluent installations and not Apache?

1
apache-kafkaconfluent-schema-registry
Are you able to point me to a resource where you think Confluent Platform is not Apache Kafka? I would really like to get to the bottom of this. – OneCricketeer
@cricket_007 Since HDInsight Kafka doesn't include any of the Confluent features in it, that lead me down the wrong path of thinking that they may be two different set of Kafka implementations. I now realize that Confluent sits on top of Apache Kafka and only adds features to it. – emirhosseini

1 Answers

1
votes

The Apache Kafka brokers in Confluent Platform are Apache Kafka. So yes you can self-host Schema Registry and connect it to Apache Kafka from another distribution.