Unable to use otel source with ClickHouse Sink

[gingerwizard]

I have the following configuration

customConfig:
  data_dir: /vector-data-dir
  api:
    enabled: true
    address: 127.0.0.1:8686
    playground: false
  sources:
    otel:
      type: opentelemetry
      acknowledgements:
        enabled: false
      grpc:
        address: "0.0.0.0:4317"
      http:
        address: "0.0.0.0:4318"
  sinks:
    clickhouse:
      type: clickhouse
      inputs:
        - otel
      database: default
      endpoint: "https://somewhere:8443"
      table: fluent_vector_logs
      compression: gzip
      auth:
        password: blach
        strategy: basic
        user: default
      batch:
        timeout_secs: 5
        max_events: 1000
        max_bytes: 1048576
      skip_unknown_fields: true

using the helm chart for vector.

This results in the following error:

2022-12-28T15:25:14.828011Z  INFO vector::app: Internal log rate limit configured. internal_log_rate_secs=10
2022-12-28T15:25:14.828242Z  INFO vector::app: Log level is enabled. level="vector=info,codec=info,vrl=info,file_source=info,tower_limit=trace,rdkafka=info,buffers=info,lapin=info,kube=info"
2022-12-28T15:25:14.828319Z  INFO vector::app: Loading configs. paths=["/etc/vector"]
2022-12-28T15:25:14.829877Z ERROR vector::cli: Configuration error. error=Input "otel" for sink "clickhouse" doesn't match any components.

Works with other sources. It seems almost like the otel source is recognized but not configured.

[jszwedko]

Hi @gingerwizard !

This is because the opentelemetry source has multiple outputs, one for each data type (though just logs so far). Setting the input to otel.logs should work for you. The error message there could definitely be improved.

[gingerwizard]

nice thanks @jszwedko