Fluent::Plugin::Parser::ParserError error="pattern not matched with data #4139
Unanswered
KR411-prog
asked this question in
Q&A
Replies: 2 comments
-
Sorry for the delay. |
Beta Was this translation helpful? Give feedback.
0 replies
-
I can parse the following JSON {
"stream":"stdout",
"logtag":"F",
"log":"{\"app\":\"JavaApp\", \"time\":\"2023-02-16T19:21:50.206+00:00\",\"logger\":\"com.example.App\",\"level\":\"INFO\",\"class\":\"org.springframework.boot.StartupInfoLogger\",\"method\":\"logStarted\",\"file\":\"StartupInfoLogger.java\",\"line\":61,\"thread\":\"main\",\"msg\":\"Started App in 7.718 seconds (JVM running for 10.822)\"}"
} by the following config. <source>
@type sample
tag test
sample {
"stream":"stdout",
"logtag":"F",
"log":"{\"app\":\"JavaApp\", \"time\":\"2023-02-16T19:21:50.206+00:00\",\"logger\":\"com.example.App\",\"level\":\"INFO\",\"class\":\"org.springframework.boot.StartupInfoLogger\",\"method\":\"logStarted\",\"file\":\"StartupInfoLogger.java\",\"line\":61,\"thread\":\"main\",\"msg\":\"Started App in 7.718 seconds (JVM running for 10.822)\"}"
}
</source>
<filter test.**>
@type parser
key_name log
<parse>
@type json
time_key time
time_type string
time_format %Y-%m-%dT%H:%M:%S.%N%Z
keep_time_key true
</parse>
</filter>
<match test.**>
@type stdout
</match> Could you replace the input plugin with this and try parsing? <source>
@type sample
tag test
sample {
"stream":"stdout",
"logtag":"F",
"log":"{\"app\":\"JavaApp\", \"time\":\"2023-02-16T19:21:50.206+00:00\",\"logger\":\"com.example.App\",\"level\":\"INFO\",\"class\":\"org.springframework.boot.StartupInfoLogger\",\"method\":\"logStarted\",\"file\":\"StartupInfoLogger.java\",\"line\":61,\"thread\":\"main\",\"msg\":\"Started App in 7.718 seconds (JVM running for 10.822)\"}"
}
</source> |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Describe the bug
Reference bitnami/charts#14930
I am using 1.24 version EKS. I am using the below fluentd config and I am getting below error. I tried with many format combinations but nothing worked.
2023-02-16 21:02:57 +0000 [warn]: #0 dump an error event: error_class=Fluent::Plugin::Parser::ParserError error="pattern not matched with data '{"app":"JavaApp","time":"2023-02-16T19:21:50.206+00:00","logger":"com.example.App","level":"INFO","class":"org.springframework.boot.StartupInfoLogger","method":"logStarted","file":"StartupInfoLogger.java","line":61,"thread":"main","msg":"Started App in 7.718 seconds (JVM running for 10.822)"}'" location=nil tag="kubernetes.var.log.containers.java-app-78b5d9c689-btm25_default_java-app-dc08d83479a29fe04e193b0b3b93b20aa61ad3b8746f11617f7ca5ae3e59d948.log" time=2023-02-16 19:21:50.237968502 +0000 record={"stream"=>"stdout", "logtag"=>"F", "log"=>"{"app":"JavaApp","time":"2023-02-16T19:21:50.206+00:00","logger":"com.example.App","level":"INFO","class":"org.springframework.boot.StartupInfoLogger","method":"logStarted","file":"StartupInfoLogger.java","line":61,"thread":"main","msg":"Started App in 7.718 seconds (JVM running for 10.822)"}"}
2023-02-16 21:02:57 +0000 [warn]: #0 no patterns matched tag="kubernetes.var.log.containers.java-app-78b5d9c689-btm25_default_java-app-dc08d83479a29fe04e193b0b3b93b20aa61ad3b8746f11617f7ca5ae3e59d948.log"
Here is my config,
To Reproduce
I have a java-app pod which is producing logs as ,
INFO","class":"org.apache.juli.logging.DirectJDKLog","method":"log","file":"DirectJDKLog.java","line":173,"thread":"main","msg":"Starting ProtocolHandler ["http-nio-8080"]"}
{"app":"JavaApp","time":"2023-02-24T16:46:13.849+00:00","logger":"com.example.App","level":"INFO","class":"org.springframework.boot.StartupInfoLogger","method":"logStarted","file":"StartupInfoLogger.java","line":61,"thread":"main","msg":"Started App in 5.589 seconds (JVM running for 7.41)"}
Fluentulor shows parsing works

Expected behavior
logs are parsed with the config.
Your Environment
Your Configuration
Your Error Log
2023-02-16 21:02:57 +0000 [warn]: #0 dump an error event: error_class=Fluent::Plugin::Parser::ParserError error="pattern not matched with data '{\"app\":\"JavaApp\",\"time\":\"2023-02-16T19:21:50.206+00:00\",\"logger\":\"com.example.App\",\"level\":\"INFO\",\"class\":\"org.springframework.boot.StartupInfoLogger\",\"method\":\"logStarted\",\"file\":\"StartupInfoLogger.java\",\"line\":61,\"thread\":\"main\",\"msg\":\"Started App in 7.718 seconds (JVM running for 10.822)\"}'" location=nil tag="kubernetes.var.log.containers.java-app-78b5d9c689-btm25_default_java-app-dc08d83479a29fe04e193b0b3b93b20aa61ad3b8746f11617f7ca5ae3e59d948.log" time=2023-02-16 19:21:50.237968502 +0000 record={"stream"=>"stdout", "logtag"=>"F", "log"=>"{\"app\":\"JavaApp\",\"time\":\"2023-02-16T19:21:50.206+00:00\",\"logger\":\"com.example.App\",\"level\":\"INFO\",\"class\":\"org.springframework.boot.StartupInfoLogger\",\"method\":\"logStarted\",\"file\":\"StartupInfoLogger.java\",\"line\":61,\"thread\":\"main\",\"msg\":\"Started App in 7.718 seconds (JVM running for 10.822)\"}"} 2023-02-16 21:02:57 +0000 [warn]: #0 no patterns matched tag="kubernetes.var.log.containers.java-app-78b5d9c689-btm25_default_java-app-dc08d83479a29fe04e193b0b3b93b20aa61ad3b8746f11617f7ca5ae3e59d948.log"
Additional context
No response
Beta Was this translation helpful? Give feedback.
All reactions