How to perform vector tap via GraphQL

[nazarovkv]

I'm looking for example of GraphQL query in order to perform vector tap my-component-id via GraphQL

[pront]

Hi @nazarovkv, you can pass these arguments to the command: https://github.com/vectordotdev/vector/blob/master/src/tap/mod.rs#L36-L42

If you wanted to talk to the server directly, I would not advise that since ultimately we want to remove the GraphQL dependency completely.

[pront]

I was thinking of protobufs. But all this is hypothetical at this point. What are you trying to do?

[nazarovkv]

TL;DR

My team is attempting to implement some sort of "vector central management" service. Let's name it VCM.

At the moment we would like VCM to have two key features:

• MultiTap
• ConfigManager

As for ConfigManager you've already replied me in Vector Config Server thread(thank you :-) ), but I'm looking forward to implementing yet another useful/powerful(to my mind) feature/solution -> MultiTap.

Use Case:
Let say I have couple vector "cluster"s.
Each cluster is responsible for different events processing.
Let say I'm connecting new events to one of the "cluster".
Under the hood "cluster" has different balancers on different levels(L3,L7).
On initial connection of new events I would like to "lookup"(or better say tap) components by pattern in order to see how initial events look like in order to perform correct parsing of event.
I have option to do tap on every vector instance...but just imagine - performing vector tap on(let say) on 200+ vector instances is insane.

For that reason I came up to idea that we need some sort of central place(control plane, whatever) for vector "cluster" where we can do tap(multitap).

At the moment my team implementing such "server" where we can control and observe events inside vector "cluster"s. Hence if you remove GraphQL - I need to understand - do we need to rely on similar "API" or such feature will be completely removed from vector(no way...)

[pront]

Thank you for explaining your use case @nazarovkv.

At the moment my team implementing such "server" where we can control and observe events inside vector "cluster"s. Hence if you remove GraphQL - I need to understand - do we need to rely on similar "API" or such feature will be completely removed from vector(no way...)

This API wasn't designed with external consumption in mind and we don't have any RFC in the works. If you find this area interesting, you can create one. As of now, you should be able to use https://github.com/vectordotdev/vector/blob/master/lib/vector-tap/src/lib.rs#L142 to create your own client.

[nazarovkv]

We are implementing PoC on GoLang, at the moment we have positive notes.

If you wish, I can came back once we implement pre-MVP

[pront]

We are implementing PoC on GoLang, at the moment we have positive notes.
If you wish, I can came back once we implement pre-MVP

Sounds good 👍