Using v3.1.0 From fluent-bit to es: [ warn] [engine] failed to flush chunk

[aaronNGJ5]

Guy, can I need help on below.

Settings like this, for OUTPUT section:

  [OUTPUT]
        Name            es
        Match           kube.*
        Index           fluent-bit-kube
        Host            https://xyz.com/
        Port            443
        Logstash_Format Off
        Time_Key        @timestamp
        Type            _doc
        Suppress_Type_Name On
        Replace_Dots    On
        Retry_Limit     False
        Trace_Error     On
        Trace_Output    On
        tls             On
        tls.verify      Off

Problems like below, while using elasticSearch+kibana in v8.9

[2024/11/25 11:12:50] [ warn] [engine] failed to flush chunk '1-1732533117.35897480.flb', retry in 101 seconds: task_id=2, input=tail.0 > output=es.0 (out_id=0)
[2024/11/25 11:12:50] [ warn] [engine] failed to flush chunk '1-1732533117.77473553.flb', retry in 67 seconds: task_id=4, input=tail.0 > output=es.0 (out_id=0)
[2024/11/25 11:12:53] [ warn] [net] getaddrinfo(host='https://xyz.com/', err=15): Out of memory
[2024/11/25 11:12:53] [ warn] [engine] failed to flush chunk '1-1732533117.91936940.flb', retry in 72 seconds: task_id=5, input=tail.0 > output=es.0 (out_id=0)
[2024/11/25 11:12:59] [ warn] [net] getaddrinfo(host='https://xyz.com/', err=15): Out of memory
[2024/11/25 11:12:59] [ warn] [net] getaddrinfo(host='https://xyz.com/', err=15): Out of memory
[2024/11/25 11:12:59] [ warn] [engine] failed to flush chunk '1-1732533117.59002362.flb', retry in 41 seconds: task_id=3, input=tail.0 > output=es.0 (out_id=0)
[2024/11/25 11:12:59] [ warn] [net] getaddrinfo(host='https://xyz.com/', err=15): Out of memory
[2024/11/25 11:12:59] [ warn] [engine] failed to flush chunk '1-1732533117.11531044.flb', retry in 60 seconds: task_id=0, input=tail.0 > output=es.0 (out_id=0)
[2024/11/25 11:12:59] [ warn] [engine] failed to flush chunk '1-1732533117.124911847.flb', retry in 60 seconds: task_id=8, input=tail.0 > output=es.0 (out_id=0)
[2024/11/25 11:13:01] [ warn] [net] getaddrinfo(host='https://xyz.com/', err=15): Out of memory
[2024/11/25 11:13:01] [ warn] [engine] failed to flush chunk '1-1732533117.21664614.flb', retry in 45 seconds: task_id=1, input=tail.0 > output=es.0 (out_id=0)
[2024/11/25 11:13:05] [ warn] [net] getaddrinfo(host='https://xyz.com/', err=15): Out of memory

Find-out THIS:
-- https://docs.fluentbit.io/manual/3.1/pipeline/outputs/elasticsearch#faq

Related to this section:

Suppress_Type_Name

When enabled, mapping types is removed and Type option is ignored. If using Elasticsearch 8.0.0 or higher - it no longer supports mapping types, so it shall be set to On.

Question, how I can achieve to solve above Error in my case ?

Please help on this.

[aaronNGJ5]

related to this

#5145

[allewell]

Out of memory

?

[LeDyChen]

@aaronNGJ5 bro,i am wondering if you finish this problem? i meet the same thing as you.