Skip to content

[WIP] Support for Qwen3 models #37

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

orionpapadakis
Copy link
Collaborator

@orionpapadakis orionpapadakis commented Jul 2, 2025

On going work for #19

  • add model support
  • refactor model loaders and inference engines to be modular

Check list:

[x] CPU inference path in a working state
[ ] GPU inference path in a working state

@mikepapadim mikepapadim moved this to In Progress in TornadoVM 1.X (Public) Jul 2, 2025
@mikepapadim mikepapadim added enhancement New feature or request models labels Jul 2, 2025
@mikepapadim mikepapadim changed the title [WIP] Support for Qwen3 model [WIP] Support for Qwen3 models Jul 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request models
Projects
Status: In Progress
Development

Successfully merging this pull request may close these issues.

2 participants