MLX-my-repo - a no-code way to create MLX quants (Q4/ Q8) #1
Vaibhavs10
started this conversation in
Show and tell
Replies: 3 comments
-
Nice - thanks @Vaibhavs10. Helps us upload-speed-poors as well. |
Beta Was this translation helpful? Give feedback.
0 replies
-
@Vaibhavs10, your Space does not use the established naming convention for MLX repos, and this is resulting in repos being uploaded to MLX Community which use a divergent naming convention. Please fix your tool to use the established naming convention like this: Phi-4-mini-instruct-4bit |
Beta Was this translation helpful? Give feedback.
0 replies
-
Thank you @Vaibhavs10! |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi all,
I'm VB, I am a GPU Poor in residence at Hugging Face and a big fan of MLX. Recently we put together a Space that allows you to create MLX quants directly on the Hugging Face Hub without the need to download anything or setup an environment.
The space is available here: https://huggingface.co/spaces/mlx-community/mlx-my-repo 🔥
Note: We don't keep a log of who creates what quants, so it's privacy first and you can even create private model checkpoints too!
This is an initial version with a bit of rough edges, but keen to hear your feedback on this. 🤗
Beta Was this translation helpful? Give feedback.
All reactions