Skip to content

MLX Runtime Visual Model Multiple Image bug. #151

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
bakana39 opened this issue Apr 26, 2025 · 1 comment
Open

MLX Runtime Visual Model Multiple Image bug. #151

bakana39 opened this issue Apr 26, 2025 · 1 comment
Assignees
@neilmehta24
Labels
bug Something isn't working to-investigate Needs looking into

Comments

@bakana39
Copy link

When using visual models with the MLX backend, an error occurs after sending more than two images, causing the model to incorrectly recognize images. The model used is qwen2.5-vl-32b-instruct-6bit, and this issue also appears on other visual models like mistral-small3.1. The hardware being used is M3 Ultra, and this problem exists in MLX versions 0.14.0 and earlier versions such as 0.13.2.

Image

Image

Image
@bakana39
Copy link
Author

The issue persists in version 0.15.1.

@neilmehta24 neilmehta24 added bug Something isn't working to-investigate Needs looking into labels May 5, 2025
@neilmehta24 neilmehta24 self-assigned this May 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@neilmehta24 neilmehta24

Labels
bug Something isn't working to-investigate Needs looking into
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@bakana39 @neilmehta24