Cruise control communication with brokers and zookeeper

[kspmmitt]

Hello,

Using Strimzi operator based kafka and cruise control, need inputs for below?

1. During rebalancing pauses, producer/consumer connection with broker may fail?

2. Cruise control topics creation is dependent upon property - "auto.create.topics.enable"?

Rgds,
Kamal

[kyguy]

During rebalancing pauses, producer/consumer connection with broker may fail?

What kind of "rebalance" are we talking about? If you mean a consumer group rebalance then yes, a consumer could lose connection to a broker.

Cruise control topics creation is dependent upon property - "auto.create.topics.enable"?

The automatic creation of Cruise Control topics depends on the auto.create.topics.enable property being set to true. If it is disabled, the user must create the topics manually.

[kspmmitt]

Thanks for confirmation. Just one last thing that if these topics created manually then is there any documentation/guideline for no. of partitions/replicas they should be created with etc. OR I can consider same configuration which comes when created automatically?

Below topics taken from strimzi operator kafka cluster-

strimzi.cruisecontrol.metrics - Topic: strimzi.cruisecontrol.metrics Partition: 0 Leader: 0 Replicas: 0 Isr: 0

strimzi.cruisecontrol.partitionmetricsamples - Topic: strimzi.cruisecontrol.modeltrainingsamples TopicId: _TbzfrgNTvGzcqOAYLzM8Q PartitionCount: 32 ReplicationFactor: 2 Configs: cleanup.policy=delete,retention.ms=12000000,message.format.version=3.0-IV1

strimzi.cruisecontrol.modeltrainingsamples - Topic: strimzi.cruisecontrol.partitionmetricsamples TopicId: 0JqcELTyRFGNnXoUbTE5cQ PartitionCount: 32 ReplicationFactor: 2 Configs: cleanup.policy=delete,retention.ms=3600000,message.format.version=3.0-IV1

[kyguy]

Just one last thing that if these topics created manually then is there any documentation/guideline for no. of partitions/replicas they should be created with etc. OR I can consider same configuration which comes when created automatically?

Yes those are the topics. The same configurations as the default will be fine. For information on the Cruise Control topics, checkout the docs here [1]

[1] https://strimzi.io/docs/operators/latest/deploying#proc-cruise-control-auto-created-topics-str