Skip to content

Are logs from separate files combined into the same pipeline? re: "reduce" transform #22726

Answered by pront
davidcpell asked this question in Q&A
Discussion options

You must be logged in to vote

Does each file tailed in kubernetes_logs get its own pipeline in memory or are all the logs from the various files mixed together going through the same instances of each component?

That depends on your pipeline but generally there's no implicit pipeline creation. If you define kubernetes_logs source A then all events produced by this source will go to the same stream. So if you later have a reduce transform T that has A as input, it will receive all those events.

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by davidcpell
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants