Skip to content

文档:本地大模型部署 #158

Answered by xerrors
Gjt20021214 asked this question in Q&A
Discussion options

You must be logged in to vote

项目本身是和大模型部署解耦的,可以按照目前比较通用的部署方法,比如 OllamavLLM.

Ollama 网上的部署教程很多,比如:https://zhuanlan.zhihu.com/p/690046494 (供参考)

部署完成之后都会产生对应的 url 接口,然后在设置里面添加自定义模型就可以了。

其实,如果是作为个人使用而不是二次开发,且不涉及只是图谱的话,cherrystudio 是个非常优秀的项目,这个用来日常使用的效果还是不错的。

Replies: 2 comments

Comment options

You must be logged in to vote
0 replies
Answer selected by xerrors
Comment options

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants
Converted from issue

This discussion was converted from issue #156 on April 19, 2025 15:07.