KAFKA SINK encoding error #18912
Replies: 2 comments
-
I think you need:
That is, |
Beta Was this translation helpful? Give feedback.
0 replies
-
How silly do I feel. Many thanks |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi All, I am trying to receive logs from syslog and forward to kafka.
Oct 23 18:04:51 xxxvector[594955]: 2023-10-23T17:04:51.247550Z DEBUG vector::app: messaged="Building runtime." worker_threads=80
Oct 23 18:04:51 xxxvector[594955]: 2023-10-23T17:04:51.303469Z INFO vector::app: Loading configs. paths=["/conf/config.json"]
Oct 23 18:04:51 xxxvector[594955]: 2023-10-23T17:04:51.305713Z ERROR vector::cli: Configuration error. error=missing field `encoding'
my configuration:
"sinks": {
"to_kafka": {
"type": "kafka",
"inputs": [
"json_src"
],
"bootstrap_servers": "10.14.22.123:9092,10.14.23.332:9092",
"topic": "test",
"encoding.codec": "raw_message",
"compression": "none",
"key_field": "hostname",
"librdkafka_options": {
"client.id": "xxx",
"ssl.key.location": "config/certs/cxxx.key",
"ssl.certificate.location": "config/certs/xxx.crt",
"ssl.ca.location": "config/certs/truststore.pem"
}
}
}
}
What should the encoding be? i tried encoding.codec json and raw message but it will wants 'encoding' key.
thanks in advance!
Beta Was this translation helpful? Give feedback.
All reactions