impl log partition by trace id #43029
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Co-authored-by: Andrew Wilkins <axwalk@gmail.com>
|
@axw thank you for your help and review! |
axw
approved these changes
Oct 13, 2025
axw
added
ready to merge
|
Thank you for your contribution @OhJuhun! 🎉 We would like to hear from you about your experience contributing to OpenTelemetry by taking a few minutes to fill out this survey. If you are getting started contributing, you can also join the CNCF Slack channel #opentelemetry-new-contributors to ask for guidance and get help. |
|
/easycla |
ChrsMark
pushed a commit
to ChrsMark/opentelemetry-collector-contrib
that referenced
this pull request
Oct 20, 2025
### Description Added log partitioning capability to the Kafka Exporter. When the `partition_logs_by_trace_id` option is enabled, log records are distributed to Kafka partitions based on their TraceID. Records without a TraceID fall back to the default partitioning strategy. If `partition_logs_by_resource_attributes` is also enabled, resource attribute partitioning takes precedence over TraceID partitioning. ### Link to tracking issue Fixes open-telemetry#39146 ### Testing - Added unit tests to validate TraceID-based log partitioning and option precedence logic. - Verified correct partitioning for various combinations of TraceIDs and resource attributes. ### Documentation - Updated `exporter/kafkaexporter/README.md` with usage details and examples for `partition_logs_by_trace_id`. - Included related changelog updates. --------- Co-authored-by: Andrew Wilkins <axwalk@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Added log partitioning capability to the Kafka Exporter. When the
partition_logs_by_trace_idoption is enabled, log records are distributed to Kafka partitions based on their TraceID. Records without a TraceID fall back to the default partitioning strategy. Ifpartition_logs_by_resource_attributesis also enabled, resource attribute partitioning takes precedence over TraceID partitioning.Link to tracking issue
Fixes #39146
Testing
Documentation
exporter/kafkaexporter/README.mdwith usage details and examples forpartition_logs_by_trace_id.