-
Below librdkafka api function is used to produce messages to multiple topics (say single partition topics) using same RdKafka::Producer object with enabled idempotence. Is the message ordering preserved across topics as internal queue of the producer is shared across all topics and partitions? ErrorCode produce (const std::string topic_name, int32_t partition, int msgflags, void *payload, size_t len, const void *key, size_t key_len, int64_t timestamp, RdKafka::Headers *headers, void *msg_opaque) ; Consider below scenario to illustrate the problem. Produce api function is called for below messages.
At any given time, is it possible the kafka cluster to contain messages in Topic B without some of messages in Topic A? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Beta Was this translation helpful? Give feedback.
https://github.com/edenhill/librdkafka/blob/master/INTRODUCTION.md#ordering-and-message-sequence-numbers