VLLM inference guide

[devops724]

Hi,
is there any guide how i can inference this model using vllm?

[fernandaspets]

Same question can we load this up with vllm, sglang etc.?

[Arslan-Mehmood1]

yes, same question

how to use this LLM when building agentic apps?