Use vLLM with custom LLM for classification

[power-puff-gg]

Hello,

Is there any way to use vLLM with a custom LLM? It is basically a model modified to add more classification heads as the intention is to use this for a classification task.

[DarkLight1337]

You can register external models to vLLM according to this page