Skip to content

Qwen 3 / Deepseek GGUF support #214

@ericreator88

Description

@ericreator88

It seems like some new model formats can't load. I've been waiting to run these Qwen 3 GGUFs for a couple months but I'm not sure you support the architecture. Also deepseek?

https://huggingface.co/mradermacher/Josiefied-Qwen3-8B-abliterated-v1-GGUF

https://huggingface.co/mradermacher/DeepSeek-R1-0528-tiny-GGUF

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions