Quarkus client unable to connect to remote Kafka in k8s

[vietnguyen1254]

Really hope you could help me out! Thank you in advance!

I installed Kafka via helm chart with the service is "ClusterIP" in namespace "ns1" in a kubernetes cluster.

Then, i create a new namespace "ns2" and install kafka client to test it, everything works perfectly:

kafka-console-producer.sh --bootstrap-server kafka.ns1:9092 --topic test

Then, I install another pod (Quarkus producer for Kafka) in a different namespace "ns2" to connect to that kafka service with this configuration in "application.properties"

kafka.bootstrap.servers='kafka.ns1':9092

It shows this error (really don't understand why localhost is showing here:

2023-07-03 17:40:54,863 INFO  [io.sma.rea.mes.kafka] (smallrye-kafka-producer-thread-0) SRMSG18258: Kafka producer kafka-producer-topic, connected to Kafka brokers ''kafka.ns1':9092', is configured to write records to 'topic'
2023-07-03 17:40:54,945 WARN  [org.apa.kaf.cli.NetworkClient] (kafka-producer-network-thread | kafka-producer-topic) [Producer clientId=kafka-producer-opcua] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available.
2023-07-03 17:40:54,946 WARN  [org.apa.kaf.cli.NetworkClient] (kafka-producer-network-thread | kafka-producer-topic) [Producer clientId=kafka-producer-topic] Bootstrap broker localhost:9092 (id: -1 rack: null) disconnected
2023-07-03 17:40:55,049 WARN  [org.apa.kaf.cli.NetworkClient] (kafka-producer-network-thread | kafka-producer-topic) [Producer clientId=kafka-producer-opcua] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available.
2023-07-03 17:40:55,071 WARN  [org.apa.kaf.cli.NetworkClient] (kafka-producer-network-thread | kafka-producer-topic) [Producer clientId=kafka-producer-topic] Bootstrap broker localhost:9092 (id: -1 rack: null) disconnected

Thank you so much for any help!

[quarkus-bot[bot]]

/cc @Sgitario (kubernetes), @alesj (kafka), @cescoffier (kafka), @geoand (kubernetes), @iocanel (kubernetes), @ozangunalp (kafka)

[cescoffier]

First, can you remove the ´´ around the host name in your bootstrap server.

[cescoffier]

Also, what's the advertised listener address configured on the broker?

[vietnguyen1254]

@cescoffier thank you so much for your replies.

Here is the configraiton: (this is automatically generated from kafka helm chart: https://github.com/bitnami/charts/tree/main/bitnami/kafka)
`

  MY_POD_NAME:                                         kafka-0 (v1:metadata.name)

  KAFKA_CFG_ZOOKEEPER_CONNECT:

  KAFKA_INTER_BROKER_LISTENER_NAME:                    INTERNAL

  KAFKA_CFG_LISTENER_SECURITY_PROTOCOL_MAP:            INTERNAL:PLAINTEXT,CLIENT:PLAINTEXT,CONTROLLER:PLAINTEXT

  KAFKA_CFG_LISTENERS:                                 INTERNAL://:9094,CLIENT://:9092,CONTROLLER://:9093

  KAFKA_CFG_ADVERTISED_LISTENERS:                      INTERNAL://$(MY_POD_NAME).kafka-headless.ns1.svc.cluster.local:9094,CLIENT://$(MY_POD_NAME).kafka-headless.ns1.svc.cluster.local:9092

  ALLOW_PLAINTEXT_LISTENER:                            yes

  KAFKA_ZOOKEEPER_PROTOCOL:                            PLAINTEXT

  KAFKA_VOLUME_DIR:                                    /bitnami/kafka

`
For the '', they were added as for some reasons, when i put the full service name without them, it prints error in Quarkus client as it can not parse it.

[cescoffier]

What's the error when you remove the quotes?

The advertised name looks ok.