You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, the opentelemetry source in Vector can receive and decode OTLP (protobuf) payloads directly, parsing them into structured Vector events that can be used in transforms and sinks.
However, when using Kafka as a transport or buffer for OTLP data, there is no official otlp_proto (protobuf) decoding codec available for the Kafka source. This means users must rely on custom transforms, Lua/VRL scripts, or build their own plugins to parse OTLP protobuf data from Kafka topics.
In our case, we use Kafka to buffer and transport OTLP logs, metrics, and traces in protobuf format (as sent from OpenTelemetry SDKs and agents). It would be extremely helpful if Vector could natively decode OTLP protobuf payloads directly in the Kafka source, so downstream transforms and sinks could process them seamlessly.
Are there any plans to support OTLP (protobuf) as a native codec in the Kafka source (like codec = "otlp_proto" or similar)?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Question
Currently, the opentelemetry source in Vector can receive and decode OTLP (protobuf) payloads directly, parsing them into structured Vector events that can be used in transforms and sinks.
However, when using Kafka as a transport or buffer for OTLP data, there is no official otlp_proto (protobuf) decoding codec available for the Kafka source. This means users must rely on custom transforms, Lua/VRL scripts, or build their own plugins to parse OTLP protobuf data from Kafka topics.
In our case, we use Kafka to buffer and transport OTLP logs, metrics, and traces in protobuf format (as sent from OpenTelemetry SDKs and agents). It would be extremely helpful if Vector could natively decode OTLP protobuf payloads directly in the Kafka source, so downstream transforms and sinks could process them seamlessly.
Are there any plans to support OTLP (protobuf) as a native codec in the Kafka source (like
codec = "otlp_proto"
or similar)?Vector Config
No response
Vector Logs
No response
Beta Was this translation helpful? Give feedback.
All reactions