Skip to content

Commit 00de2ee

Browse files
[Doc] update faq about progress bar display issue (#538)
### What this PR does / why we need it? update faq about progress bar display issue Signed-off-by: hfadzxy <starmoon_zhang@163.com>
1 parent fe13cd9 commit 00de2ee

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

docs/source/faqs.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -113,3 +113,7 @@ Currently, running on v0.7.3, we should run w8a8 with vllm + vllm-ascend + mindi
113113
1. Quantize bf16 DeepSeek, e.g. [unsloth/DeepSeek-R1-BF16](https://modelscope.cn/models/unsloth/DeepSeek-R1-BF16), with msModelSlim to get w8a8 DeepSeek. Find more details in [msModelSlim doc](https://gitee.com/ascend/msit/tree/master/msmodelslim/msmodelslim/pytorch/llm_ptq)
114114
2. Copy the content of `quant_model_description_w8a8_dynamic.json` into the `quantization_config` of `config.json` of the quantized model files.
115115
3. Reference with the quantized DeepSeek model.
116+
117+
### 13. There is not output in log when loading models using vllm-ascend, How to solve it?
118+
119+
If you're using vllm 0.7.3 version, this is a known progress bar display issue in VLLM, which has been resolved in [this PR](https://github.com/vllm-project/vllm/pull/12428), please cherry-pick it locally by yourself. Otherwise, please fill up an issue.

0 commit comments

Comments
 (0)