Skip to content

[BUG] Not able to add LoRA to an LLM on H2O-LLM-Studio #894

@PranavM2412

Description

@PranavM2412

🐛 Bug

Not able to add LoRA to an LLM on H2O-LLM-Studio

To Reproduce

Customer wanted to apply LoRA to a local LLM to create a genre-specific LLM.
To do this, they prepared CSV training data, and through experimentation, an adapter in .safetensors format was generated.
They tried to apply the created .safetensors to Ollama, but it resulted in an error (sorry, I don't have the error message on hand).

It seems that it was able to confirm the creation of the adapter,

But we are unable to apply that adapter to Ollama or LM Studio or other, or to complete and verify its application to the LLM in H2O LLM Studio.

LLM Studio version

"H2O LLM Studio" v1.14.0-dev

20250118_H2o_pug_train_en.zip

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions