Configuring kafka connect with multi brokers Configuring kafka connect with multi brokers kubernetes kubernetes

Configuring kafka connect with multi brokers


It appears that you have started all processes in single pods.

You should run Kafka, Zookeeper, and Connect all as separate services in different pods.

I suggest you refer the Confluent or Strimzi sites to find Kafka Kubernetes Helm Charts / Operators


But to answer the question - You could give one or more broker to connect-distributed.properties bootstrap.server value. Then each broker is connected to as part of the Kafka cluster, and will reconnect in the event that one broker is unavailable

"Kakfa servers" (brokers) do not run Connectors

If you want to run a cluster of connect workers, you also need to setup their rest.advertised.listener address so that they can communicate with each other.