UOS-AI support to use ollama local models

[marcogutama]

It would be great if functionality was added to uos-ai to use local Ollama models. In this way, those people who do not have internet or have the AI pages blocked at work (as is my case) can use AI in Deepin.

[BLumia]

cc @meiyixiang

[c4yg70]

Also, why not use vLLM as it's more efficiency and more hardware-friendly, or support openvino?

[abskvrm]

It would be great if functionality was added to uos-ai to use local Ollama models. In this way, those people who do not have internet or have the AI pages blocked at work (as is my case) can use AI in Deepin.

You definitely can use Ollama with UOS, use the following address http://localhost:11434/v1 I have been using it for months. 🙂