You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/source/faqs.md
+48Lines changed: 48 additions & 0 deletions
Original file line number
Diff line number
Diff line change
@@ -21,3 +21,51 @@ Below series are NOT supported yet:
21
21
- Ascend 910, Ascend 910 Pro B (Ascend-cann-kernels-910) unplanned yet
22
22
23
23
From a technical view, vllm-ascend support would be possible if the torch-npu is supported. Otherwise, we have to implement it by using custom ops. We are also welcome to join us to improve together.
24
+
25
+
### 2. How to get our docker containers?
26
+
27
+
You can get our containers at `Quay.io`, e.g., [<u>vllm-ascend</u>](https://quay.io/repository/ascend/vllm-ascend?tab=tags) and [<u>cann</u>](https://quay.io/repository/ascend/cann?tab=tags).
28
+
29
+
If you are in China, you can use `daocloud` to accelerate your downloading:
30
+
31
+
1) Open `daemon.json`:
32
+
33
+
```bash
34
+
vi /etc/docker/daemon.json
35
+
```
36
+
37
+
2) Add `https://docker.m.daocloud.io` to `registry-mirrors`:
38
+
39
+
```json
40
+
{
41
+
"registry-mirrors": [
42
+
"https://docker.m.daocloud.io"
43
+
]
44
+
}
45
+
```
46
+
47
+
3) Restart your docker service:
48
+
49
+
```bash
50
+
sudo systemctl daemon-reload
51
+
sudo systemctl restart docker
52
+
```
53
+
54
+
After configuration, you can download our container from `m.daocloud.io/quay.io/ascend/vllm-ascend:v0.7.3rc2`.
55
+
56
+
### 3. What models does vllm-ascend supports?
57
+
58
+
Currently, we have already fully tested and supported `Qwen` / `Deepseek` (V0 only) / `Llama` models, other models we have tested are shown [<u>here</u>](https://vllm-ascend.readthedocs.io/en/latest/user_guide/supported_models.html). Plus, accoding to users' feedback, `gemma3` and `glm4` are not supported yet. Besides, more models need test.
59
+
60
+
### 4. How to get in touch with our community?
61
+
62
+
There are many channels that you can communicate with our community developers / users:
63
+
64
+
- Submit a GitHub [<u>issue</u>](https://github.com/vllm-project/vllm-ascend/issues?page=1).
65
+
- Join our [<u>weekly meeting</u>](https://docs.google.com/document/d/1hCSzRTMZhIB8vRq1_qOOjx4c9uYUxvdQvDsMV2JcSrw/edit?tab=t.0#heading=h.911qu8j8h35z) and share your ideas.
66
+
- Join our [<u>WeChat</u>](https://github.com/vllm-project/vllm-ascend/issues/227) group and ask your quenstions.
67
+
- Join our ascend channel in [<u>vLLM forums</u>](https://discuss.vllm.ai/c/hardware-support/vllm-ascend-support/6) and publish your topics.
68
+
69
+
### 5. What features does vllm-ascend V1 supports?
70
+
71
+
Find more details [<u>here</u>](https://github.com/vllm-project/vllm-ascend/issues/414).
0 commit comments