eosphoros
Replies: 1 comment
-
|
以vllm启动open ai 风格的 api server 。 然后在db-gbt中像引入openai 一样，引入 proxyllm 即可 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
需求：由于资源有限，在GPU上使用VLLM部署了LLM，提供API供多个部门使用。如何将这个API接入DBGPT中使用？需要在哪些地方进行修改？
Beta Was this translation helpful? Give feedback.
All reactions