Skip to content

Commit 11ecbfd

Browse files
[Doc] Update FAQ doc (#504)
### What this PR does / why we need it? Update FAQ doc. --------- Signed-off-by: shen-shanshan <467638484@qq.com>
1 parent 9c7428b commit 11ecbfd

File tree

1 file changed

+48
-0
lines changed

1 file changed

+48
-0
lines changed

docs/source/faqs.md

Lines changed: 48 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -21,3 +21,51 @@ Below series are NOT supported yet:
2121
- Ascend 910, Ascend 910 Pro B (Ascend-cann-kernels-910) unplanned yet
2222

2323
From a technical view, vllm-ascend support would be possible if the torch-npu is supported. Otherwise, we have to implement it by using custom ops. We are also welcome to join us to improve together.
24+
25+
### 2. How to get our docker containers?
26+
27+
You can get our containers at `Quay.io`, e.g., [<u>vllm-ascend</u>](https://quay.io/repository/ascend/vllm-ascend?tab=tags) and [<u>cann</u>](https://quay.io/repository/ascend/cann?tab=tags).
28+
29+
If you are in China, you can use `daocloud` to accelerate your downloading:
30+
31+
1) Open `daemon.json`:
32+
33+
```bash
34+
vi /etc/docker/daemon.json
35+
```
36+
37+
2) Add `https://docker.m.daocloud.io` to `registry-mirrors`:
38+
39+
```json
40+
{
41+
"registry-mirrors": [
42+
"https://docker.m.daocloud.io"
43+
]
44+
}
45+
```
46+
47+
3) Restart your docker service:
48+
49+
```bash
50+
sudo systemctl daemon-reload
51+
sudo systemctl restart docker
52+
```
53+
54+
After configuration, you can download our container from `m.daocloud.io/quay.io/ascend/vllm-ascend:v0.7.3rc2`.
55+
56+
### 3. What models does vllm-ascend supports?
57+
58+
Currently, we have already fully tested and supported `Qwen` / `Deepseek` (V0 only) / `Llama` models, other models we have tested are shown [<u>here</u>](https://vllm-ascend.readthedocs.io/en/latest/user_guide/supported_models.html). Plus, accoding to users' feedback, `gemma3` and `glm4` are not supported yet. Besides, more models need test.
59+
60+
### 4. How to get in touch with our community?
61+
62+
There are many channels that you can communicate with our community developers / users:
63+
64+
- Submit a GitHub [<u>issue</u>](https://github.com/vllm-project/vllm-ascend/issues?page=1).
65+
- Join our [<u>weekly meeting</u>](https://docs.google.com/document/d/1hCSzRTMZhIB8vRq1_qOOjx4c9uYUxvdQvDsMV2JcSrw/edit?tab=t.0#heading=h.911qu8j8h35z) and share your ideas.
66+
- Join our [<u>WeChat</u>](https://github.com/vllm-project/vllm-ascend/issues/227) group and ask your quenstions.
67+
- Join our ascend channel in [<u>vLLM forums</u>](https://discuss.vllm.ai/c/hardware-support/vllm-ascend-support/6) and publish your topics.
68+
69+
### 5. What features does vllm-ascend V1 supports?
70+
71+
Find more details [<u>here</u>](https://github.com/vllm-project/vllm-ascend/issues/414).

0 commit comments

Comments
 (0)