Specify username/password for apicurio registry

[edeandrea]

I'm trying to follow the Using Apache Kafka with Schema Registry and Avro guide. How do I connect to a schema registry that requires authentication?

I see there is a mp.messaging.connector.smallrye-kafka.apicurio.registry.url property but I can't find any documentation on whether there is a similar property for credentials?

I see how I might do the configuration when I'm manually creating a producer/consumer, but not sure how I would get that information into the producer/consumer that Quarkus creates.

I'm trying to connect my app to the Red Hat managed service offering.

[cescoffier]

@carlesarnal How is are the credential passed to the serde? Are there specific attributes?

[carlesarnal]

Hi,

Yes, there's a set of configuration properties used for auth. For oauth you must use the following properties:

mp.messaging.connector.smallrye-kafka.apicurio.auth.service.token.endpoint
mp.messaging.connector.smallrye-kafka.apicurio.auth.client.id
mp.messaging.connector.smallrye-kafka.apicurio.auth.client.secret

And for basic auth the following ones:

mp.messaging.connector.smallrye-kafka.apicurio.auth.username
mp.messaging.connector.smallrye-kafka.apicurio.auth.password

As a minor note, if you're using Red Hat managed version of Service Registry and want to use basic auth (although there's no reason to do so) you must use the client id and client secret of your service account as the username password pair.

[edeandrea]

Ok cool I'll try it again once 2.7.1 is out (there's a bug in 2.7.0 that is fixed in 2.7.1 that prevents me from upgrading to 2.7.0)

[edeandrea]

@carlesarnal I can confirm this works with Quarkus 2.7.1. Thanks for the help!

[carlesarnal]

Great! Glad to help.

[edeandrea]

We definitely need all this documented, both on the Quarkus & SmallRye guides/docs.

[arvind-das]

Following the documentation at https://quarkus.io/guides/kafka-schema-registry-avro
and using https://quarkus.io/extensions/io.quarkus/quarkus-confluent-registry-avro/?tab=docs

does not seem to work. Tried both of them one by one but this would not establish connection with confluent's kafka . I am using quarkus 3.0.2.Final

The application starts without fail but I see these messages
<====2023-12-21 22:39:19,912 WARN [org.apa.kaf.cli.pro.ProducerConfig] (smallrye-kafka-producer-thread-0) These configurations '[apicurio.registry.url, devservices.enabled, apicurio.auth.username, apicurio.auth.password]' were supplied but are not used yet.[5s]

and kafka is not connected

[Producer clientId=kafka-producer-payment-update] Bootstrap broker pkc-l7pr2.ap-south-1.aws.confluent.cloud:9092 (id: -1 rack: null) disconnected

Am I missing something ?

Here is the config

    mp:
        messaging:
            connector:
                smallrye-kafka:
                    apicurio:
                        registry:
                            url: https://xxxxx.aws.confluent.cloud
                        auth:
                            username: JXXXXXXXXXXX
                            password: XXXXXXXXXXXXXXXXXXXXXXXXXXXXMXXXXXXX
                            client:
                                id: KXXXXXXXXXXX
                                secret : DXXXXXXXXXXXXXXXXXXXX

            outgoing:
                payment-update:
                    connector: smallrye-kafka