Are logs from separate files combined into the same pipeline? re: "reduce" transform #22726
-
Hopefully this question makes sense. I want to use "reduce" to combine Go panic logs in our vector agents, but wondering if I can assume whether logs from separate files are kept separate within the vector process with their own copies of the component pipeline. Does each file tailed in kubernetes_logs get its own pipeline in memory or are all the logs from the various files mixed together going through the same instances of each component? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
That depends on your pipeline but generally there's no implicit pipeline creation. If you define |
Beta Was this translation helpful? Give feedback.
That depends on your pipeline but generally there's no implicit pipeline creation. If you define
kubernetes_logs
sourceA
then all events produced by this source will go to the same stream. So if you later have areduce
transformT
that hasA
as input, it will receive all those events.