-
Notifications
You must be signed in to change notification settings - Fork 494
Open
Labels
type/bugBug in codeBug in code
Description
🐛 Bug
Not able to add LoRA to an LLM on H2O-LLM-Studio
To Reproduce
Customer wanted to apply LoRA to a local LLM to create a genre-specific LLM.
To do this, they prepared CSV training data, and through experimentation, an adapter in .safetensors format was generated.
They tried to apply the created .safetensors to Ollama, but it resulted in an error (sorry, I don't have the error message on hand).
It seems that it was able to confirm the creation of the adapter,
But we are unable to apply that adapter to Ollama or LM Studio or other, or to complete and verify its application to the LLM in H2O LLM Studio.
LLM Studio version
"H2O LLM Studio" v1.14.0-dev
Metadata
Metadata
Assignees
Labels
type/bugBug in codeBug in code