Open WebUI support

[Sboshoff76]

Hi

I love the idea of this project. Well done on what you've done so far. Would an API (like ollama has) be something that can be incorporated into the root node?

EDIT: Just read the below bit in the medium doc. Will open WebUI connect to the root device on the same "ollama" port?

If you want to run the API service that supports the /v1/chat/completions endpoint, you should build the dllama-api application and run it on the root device instead dllama inference .

[unclemusclez]

it is OpenAI compatible it should work. I believe i have tried this months ago.

dllama-api is a separate executable. dllama is more like llama.cpp than ollama, if thats where you are coming from.