Skip to content

Commit 23e1738

Browse files
committed
disable aclgraph in offline e2e
Signed-off-by: MengqingCao <cmq0113@163.com>
1 parent 6f42e61 commit 23e1738

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/singlecard/test_offline_inference.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -53,7 +53,7 @@ def test_models(model: str, dtype: str, max_tokens: int) -> None:
5353
with VllmRunner(model,
5454
max_model_len=8192,
5555
dtype=dtype,
56-
enforce_eager=False,
56+
enforce_eager=True,
5757
gpu_memory_utilization=0.7) as vllm_model:
5858
vllm_model.generate_greedy(example_prompts, max_tokens)
5959

0 commit comments

Comments
 (0)