|
1 | 1 | # Supported Models
|
2 | 2 |
|
| 3 | +## Text-only Language Models |
| 4 | + |
| 5 | +### Generative Models |
3 | 6 | | Model | Supported | Note |
|
4 |
| -|---------|-----------|------| |
5 |
| -| DeepSeek v3 | ✅||| |
6 |
| -| DeepSeek R1 | ✅||| |
7 |
| -| DeepSeek Distill (Qwen/LLama) |✅|| |
8 |
| -| Qwen3 | ✅ || |
9 |
| -| Qwen3-Moe | ✅ || |
10 |
| -| Qwen2-VL | ✅ || |
11 |
| -| Qwen2-Audio | ✅ || |
12 |
| -| Qwen2.5 | ✅ || |
13 |
| -| Qwen2.5-VL | ✅ || |
14 |
| -| QwQ-32B | ✅ || |
15 |
| -| MiniCPM |✅| | |
16 |
| -| LLama3.1/3.2 | ✅ || |
17 |
| -| Internlm | ✅ || |
18 |
| -| InternVL2 | ✅ || |
19 |
| -| InternVL2.5 | ✅ || |
20 |
| -| Molomo | ✅ || |
21 |
| -| LLaVA 1.5 | ✅ || |
22 |
| -| LLaVA 1.6 | ✅ |[#553](https://github.com/vllm-project/vllm-ascend/issues/553)| |
23 |
| -| Baichuan | ✅ || |
24 |
| -| Phi-4-mini | ✅ || |
25 |
| -| Gemma-3 | ❌ |[#496](https://github.com/vllm-project/vllm-ascend/issues/496)| |
26 |
| -| ChatGLM | ❌ | [#554](https://github.com/vllm-project/vllm-ascend/issues/554)| |
27 |
| -| LLama4 | ❌ |[#471](https://github.com/vllm-project/vllm-ascend/issues/471)| |
28 |
| -| Mllama | |Need test| |
29 |
| -| LLaVA-Next | |Need test| |
30 |
| -| LLaVA-Next-Video | |Need test| |
31 |
| -| Phi-3-Vison/Phi-3.5-Vison | |Need test| |
32 |
| -| Ultravox | |Need test| |
33 |
| -| Mistral | | Need test | |
| 7 | +|-------|-----------|------| |
| 8 | +| DeepSeek v3 | ✅ | | |
| 9 | +| DeepSeek R1 | ✅ | | |
| 10 | +| DeepSeek Distill (Qwen/LLama) | ✅ | | |
| 11 | +| Qwen3 | ✅ | | |
| 12 | +| Qwen3-Moe | ✅ | | |
| 13 | +| Qwen2.5 | ✅ | | |
| 14 | +| QwQ-32B | ✅ | | |
| 15 | +| LLama3.1/3.2 | ✅ | | |
| 16 | +| Internlm | ✅ | | |
| 17 | +| Baichuan | ✅ | | |
| 18 | +| Phi-4-mini | ✅ | | |
| 19 | +| MiniCPM | ✅ | | |
| 20 | +| MiniCPM3 | ✅ | | |
| 21 | +| Mistral | | Need test | |
34 | 22 | | DeepSeek v2.5 | |Need test |
|
35 |
| -| Gemma-2 | |Need test| |
36 |
| -| GLM-4v | |Need test| |
| 23 | +| Gemma-2 | | Need test | |
| 24 | +| Mllama | |Need test| |
| 25 | +| Gemma-3 | ❌ | [#496](https://github.com/vllm-project/vllm-ascend/issues/496) | |
| 26 | +| ChatGLM | ❌ | [#554](https://github.com/vllm-project/vllm-ascend/issues/554) | |
| 27 | +| LLama4 | ❌ | [#471](https://github.com/vllm-project/vllm-ascend/issues/471) | |
| 28 | + |
| 29 | +### Pooling Models |
| 30 | +| Model | Supported | Note | |
| 31 | +|-------|---------|------| |
| 32 | +| XLM-RoBERTa-based | ✅ | | |
| 33 | +| Molmo | ✅ | | |
| 34 | + |
| 35 | + |
| 36 | +## Multimodal Language Models |
| 37 | + |
| 38 | +### Generative Models |
| 39 | +| Model | Supported | Note | |
| 40 | +|-------|-----------|------| |
| 41 | +| Qwen2-VL | ✅ | | |
| 42 | +| Qwen2.5-VL | ✅ | | |
| 43 | +| LLaVA 1.5 | ✅ | | |
| 44 | +| LLaVA 1.6 | ✅ | [#553](https://github.com/vllm-project/vllm-ascend/issues/553) | |
| 45 | +| InternVL2 | ✅ | | |
| 46 | +| InternVL2.5 | ✅ | | |
| 47 | +| Qwen2-Audio | ✅ | | |
| 48 | +| LLaVA-Next | | Need test | |
| 49 | +| LLaVA-Next-Video | | Need test | |
| 50 | +| Phi-3-Vison/Phi-3.5-Vison | | Need test | |
| 51 | +| GLM-4v | | Need test | |
| 52 | +| Ultravox | | Need test | |
0 commit comments