Elastic search to send metrics

[uni-pooja-laad]

Hi team,
I am using sink: elasticsearch (https://vector.dev/docs/reference/configuration/sinks/elasticsearch/) to send logs to opensearch and they are working fine using below configuration:

opensearch-dev:
 sink:
        type: elasticsearch
        inputs: [output_opensearch_logs]
        api_version: v7
        compression: none
        doc_type: _doc
        endpoints:
          - https://endpooint:port
        auth:
          strategy: "basic"
          user: ""
          password: ""
        tls:
          verify_certificate: false
        mode: bulk
        bulk:
            index: "vector"
        batch:
          max_bytes: 100
          max_events: 5000
          timeout_secs: 11

I want to send metrics as well to opensearch. Will elasticsearch will be able to do?
Or is there any other way to send metrics?

[jszwedko]

Hey! Yes, the elasticsearch sink can send metric events as well. The docs don't really make this clear.

[uni-pooja-laad]

Hi @jszwedko,
Can you share any example or reference available? How can I achieve this?

[jszwedko]

Just connect a metrics source to the elasticsearch sink 🙂

[rolandjitsu]

I do have a follow up question on this topic. How can one use the auto_routing for data streams if we cannot add/remap the metric events to add the data_stream key?

I was just trying to do that and couldn't understand why the field is not added to the metric event. It seems like vector has a fixed structure for metrics and doesn't allow adding additional fields? If so, then we cannot take advantage of the auto routing feature and we'd have to manually setup the config to route the events to a specific stream.