Skip to content

Commit c3c8c93

Browse files
authored
[DOC] add LoRA user guide (#1265)
### What this PR does / why we need it? Add LoRA user guide to DOC. The content refers to [LoRA Adapters](https://docs.vllm.ai/en/latest/features/lora.html). ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? No --------- Signed-off-by: paulyu12 <507435917@qq.com>
1 parent f39365d commit c3c8c93

File tree

2 files changed

+9
-0
lines changed

2 files changed

+9
-0
lines changed

docs/source/index.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -49,6 +49,7 @@ user_guide/env_vars
4949
user_guide/additional_config
5050
user_guide/sleep_mode
5151
user_guide/graph_mode.md
52+
user_guide/lora.md
5253
user_guide/quantization.md
5354
user_guide/release_notes
5455
user_guide/structured_output

docs/source/user_guide/lora.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
# LoRA Adapters
2+
3+
Like vLLM, vllm-scend supports LoRA as well. The usage and more details can be found in [vLLM official document](https://docs.vllm.ai/en/latest/features/lora.html).
4+
5+
You can also refer to [this](https://docs.vllm.ai/en/latest/models/supported_models.html#list-of-text-only-language-models) to find which models support LoRA in vLLM.
6+
7+
## Tips
8+
If you fail to run vllm-ascend with LoRA, you may follow [this instruction](https://vllm-ascend.readthedocs.io/en/latest/user_guide/graph_mode.html#fallback-to-eager-mode) to disable graph mode and try again.

0 commit comments

Comments
 (0)