[New Model] Support LLaMA 4 family #657

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

BenasdTW opened this issue Apr 6, 2025 · 2 comments

Contributor

BenasdTW commented Apr 6, 2025

🚀 The feature, motivation and pitch

The Llama 4 models are auto-regressive language models that use a mixture-of-experts (MoE) architecture and incorporate early fusion for native multimodality.
https://huggingface.co/meta-llama/Llama-4-Scout-17B-16E-Instruct

Alternatives

No response

Additional context

No response

vulkomilev commented Apr 15, 2025

I will try to do this

kir152 commented May 2, 2025

is there any progress on this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment