Mqllmengine

[baturgezici]

I am trying to build an application for multiple users with at mos efficiency. I tried to create the application with asyncllmengine but in threads I see that mqllmengine might be a better choice. Right now I am using vllm serve. Is there an example of how to use mqllmengine? Is there a way to run the server in the python code itself rather than running the server externally or with a subprocess?