Skip to content

idea: Apple MLX #678

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
freelerobot opened this issue Jun 11, 2024 · 3 comments
Open

idea: Apple MLX #678

freelerobot opened this issue Jun 11, 2024 · 3 comments
Labels
category: engine management Related to engine abstraction P3: nice to have Nice to have feature

Comments

@freelerobot
Copy link
Contributor

freelerobot commented Jun 11, 2024 •
edited
Loading

Problem
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Success Criteria
A clear and concise description of what you want to happen.

Additional context
Add any other context or screenshots about the feature request here.
related: #1103
@freelerobot freelerobot added P3: nice to have Nice to have feature type: feature request A new feature labels Jun 11, 2024
@freelerobot freelerobot mentioned this issue Jun 11, 2024
Closed
@louis-menlo louis-menlo self-assigned this Jul 5, 2024
@louis-menlo louis-menlo moved this to Icebox in Menlo Aug 19, 2024
@louis-menlo louis-menlo moved this from Icebox to Planned in Menlo Aug 19, 2024
@imtuyethan imtuyethan removed P3: nice to have Nice to have feature type: feature request A new feature labels Aug 28, 2024
@imtuyethan imtuyethan moved this from Planned to Icebox in Menlo Aug 28, 2024
@imtuyethan imtuyethan moved this from Icebox to Planning in Menlo Sep 2, 2024
@dan-menlo dan-menlo changed the title feat: support apple MLX feat: support Apple MLX Sep 8, 2024
@dan-menlo dan-menlo changed the title feat: support Apple MLX engine: Apple MLX Sep 8, 2024
@dan-menlo dan-menlo changed the title engine: Apple MLX idea: Apple MLX Sep 8, 2024
@freelerobot freelerobot added the P3: nice to have Nice to have feature label Sep 23, 2024
@dan-menlo dan-menlo moved this from Planning to Icebox in Menlo Sep 29, 2024
@freelerobot freelerobot added category: engine management Related to engine abstraction and removed type: engine request labels Oct 17, 2024
@ChristianWeyer
Copy link

Very important engine, especially with the ever growing offerings from Apple coming out…

@qdrddr
Copy link

qdrddr commented Feb 20, 2025

Would that be of any help the LM Studio has implemented MLX.

@gau-nernst
Copy link
Contributor

Once #2010 lands, MLX backend can be implemented in a similar manner. MLX has an official OpenAI-compatible server https://github.com/ml-explore/mlx-lm/blob/main/mlx_lm/SERVER.md

@gau-nernst gau-nernst moved this from Icebox to Investigating in Menlo Mar 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
category: engine management Related to engine abstraction P3: nice to have Nice to have feature
Projects
Menlo
Status: Investigating
Milestone
No milestone
Development

No branches or pull requests
6 participants
@qdrddr @ChristianWeyer @gau-nernst @freelerobot @imtuyethan @louis-menlo