Skip to content

Commit 8b70b2a

Browse files
22dimensionswangxiaoxin (A)
authored andcommitted
[Doc] fix VLLM_USE_V1 value in graph mode docs (#1226)
os.environ["VLLM_USE_V1"] must be assigned with str, not other type. ![image](https://github.com/user-attachments/assets/9d337ae5-00e5-4179-832e-c6c917dd5798) Signed-off-by: 22dimensions <waitingwind@foxmail.com>
1 parent ada41e7 commit 8b70b2a

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

docs/source/user_guide/graph_mode.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ import os
2323

2424
from vllm import LLM
2525

26-
os.environ["VLLM_USE_V1"] = 1
26+
os.environ["VLLM_USE_V1"] = "1"
2727

2828
model = LLM(model="Qwen/Qwen2-7B-Instruct")
2929
outputs = model.generate("Hello, how are you?")
@@ -45,7 +45,7 @@ offline example:
4545
import os
4646
from vllm import LLM
4747

48-
os.environ["VLLM_USE_V1"] = 1
48+
os.environ["VLLM_USE_V1"] = "1"
4949

5050
# TorchAirGraph is only work without chunked-prefill now
5151
model = LLM(model="deepseek-ai/DeepSeek-R1-0528", additional_config={"torchair_graph_config": {"enabled": True},"ascend_scheduler_config": {"enabled": True,}})
@@ -70,7 +70,7 @@ offline example:
7070
import os
7171
from vllm import LLM
7272

73-
os.environ["VLLM_USE_V1"] = 1
73+
os.environ["VLLM_USE_V1"] = "1"
7474

7575
model = LLM(model="someother_model_weight", enforce_eager=True)
7676
outputs = model.generate("Hello, how are you?")

0 commit comments

Comments
 (0)