New release for localai to use gpt-oss-20b #6011
saravanan30erd
started this conversation in
General
Replies: 1 comment
-
@saravanan30erd a release of LocalAI is planned quite soon, I'm just running some QA against latest changes and was about to cut a release out. However, since LocalAI switched to backends managed via the gallery there is no need to wait of a LocalAI release for you to consume the new backend. Uninstall the old backend and switch to the ones with the |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
@mudler gpt-oss-20b is added to the model gallery already, but its not loading due to invalid type
mxfp4
.llama.cpp
version (supports mxfp4) is upgraded in localaimaster
branch but there is no release yet. When will be next release of localai?Beta Was this translation helpful? Give feedback.
All reactions