Vector Internal Metrics

[satellite-no]

I was just looking at some differences in metrics dashboards being reported and wanted to know the difference between these types component_received_bytes_total and component_received_event_bytes_total. The reported metrics is quite different when I'm looking at a per component dashboard using component_received_event_bytes_total and a per host total using component_received_bytes_total. The description here doesnt clarify it for me either :(.

Example Dashboards Queries.

sum by (Ci) (rate(vector_component_received_event_bytes_total{component_kind="source", job="$job" ,instance=~"$instance"}[1m]))

sum by (Ci) (rate(vector_component_received_bytes_total{component_kind="source", instance=~"$instance"}[1m]))

[pront]

The answer is similar to this question: #22848 (comment)

component_received_bytes_total

• Only sources emit component_sent_bytes_total. This represents the number of bytes (not compressed) received by the component. It is not the raw network bytes.

component_received_event_bytes_total

This represents the estimated JSON size, in bytes, of the events received by the component.

For sources, the value is (assuming the component is properly adhering to the spec) reported after the bytes received have been decoded into a vector Event structure, before enriching the event (for example with Vector metadata).

For transforms, the values are reported by the Vector topology when the input stream receives Events.

[satellite-no]

Hey @pront,
As always thank you for that information! :) this helps clear it up for me.

[pront]

Glad this helps a bit. I also made a note here: #21735 (comment)