Using External Message Queue (Kafka) simultaneously by two Milvus clusters.

[Wonki4]

Can an external Kafka be used simultaneously by two Milvus clusters?

I’m thinking about the milvus cluster architecture to share milvus clusters with my coworker.
I decided to use my managed kafka cluster in milvus cluster.
I avoid that 1 milvus use 1 kafka cluster because i thought that it could be a resource waste. Instead, I want to share kafka cluster in MULTIPLE MILVUS CLUSTER. I’m also worried that the channel topics in multiple clusters could be affected each other.

Could you give me any idea? Or documentation?

[yhmo]

Two milvus clusters share a kafka, their topics must be different.
In the milvus.yaml, set different names of msgChannel.chanNamePrefix.cluster:

Milvus cluster 1

# This topic introduces the message channel-related configurations of Milvus.
msgChannel:
  chanNamePrefix:
    cluster: by-dev-1

Milvus cluster 2

# This topic introduces the message channel-related configurations of Milvus.
msgChannel:
  chanNamePrefix:
    cluster: by-dev-2

[Wonki4]

Thank you so much, yhmo!

In helm chart, I can add this option like this.

extraConfigFiles:
    user.yaml:
        msgChannel:
          chanNamePrefix:
                 ….

[yhmo]

Thank you so much, yhmo!

In helm chart, I can add this option like this.

extraConfigFiles:
    user.yaml:
        msgChannel:
          chanNamePrefix:
                 ….

Yes, in helm, configurations are configured in values.yaml, under the extraConfigFiles section.