Use Confluent Hub without Confluent Platform installation

8
votes

I am using these installation instructions for getting confluent hub client https://docs.confluent.io/current/connect/managing/confluent-hub/client.html

But, when I get to the line to install the kafka-connect-elasticsearch connector

confluent-hub install confluentinc/kafka-connect-elasticsearch:latest

I continue to get this error message:

Unable to detect Confluent Platform installation. Specify --component-dir and --worker-configs explicitly.

Error: Invalid options or arguments

I have ElasticSearch and Kafka all installed via Homebrew on my Mac

2
apache-kafkaapache-kafka-connectconfluent-platform

2 Answers

2
votes

Specify --component-dir and --worker-configs explicitly

You'll have to pass both options to include the Homebrew location of Kafka Connect's plugin.path setting (where Confluent Hub would install to) and your connect-distributed.properties (so that the plugin path can be setup if it isn't already)

e.g.

confluent-hub install <name> \
   --component-dir /opt/connectors \
   --worker-configs /etc/kafka/connect-distributed.properties

This command should download and extract the connector zip into /opt/connectors and modify the connect-distributed.properties file to include that path in its plugin.path property

-2
votes

I've got the same using local confluent community edition you should launch installation while being in the directory containing confluent plateform (same level as bin, etc, share ...) manually specifying the config files may make errors.