Fluentd sending warn logs to elasticsearch which shouldn't be sent as per config #4305
Unanswered
SoodPrerit
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I am facing an issue where fluentd floods a lot of logs when elasticsearch memory utilization is more. Below are the log lines which shouldn't be pushed to elasticsearch but are getting pushed and in millions
[warn]: [elasticsearch] failed to flush the buffer. retry_times=125 next_retry_time=2023-09-05 12:29:07 +0000 chunk="604972dd0d1868f9a5a037f5bbe60c81" error_class=Fluent::Plugin::ElasticsearchOutput::RecoverableRequestFailure error="could not push logs to Elasticsearch cluster ({:host=>"vpc-XXXXXXXXXXXXXXXXXXXXXXXX.eu-XXXXX.es.amazonaws.com", :port=>443, :scheme=>"https", :user=>"xxxxxxxx", :password=>"XXXXXX"}): request timed out"
In my fluentd config I have already excluded the logs for fluentd to be sent to elastcisearch using below config
I am not sure why even after with above config, fluentd is sending these log lines to the elasticsearch index ??? Please help answering this question.
Beta Was this translation helpful? Give feedback.
All reactions