Skip to content

Commit 71799fd

Browse files
authored
[CI Failure] Fix OOM with test_oot_registration_embedding (#20144)
Signed-off-by: mgoin <mgoin64@gmail.com>
1 parent e9fd658 commit 71799fd

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

tests/models/test_oot_registration.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -53,7 +53,9 @@ def test_oot_registration_embedding(
5353
with monkeypatch.context() as m:
5454
m.setenv("VLLM_PLUGINS", "register_dummy_model")
5555
prompts = ["Hello, my name is", "The text does not matter"]
56-
llm = LLM(model=dummy_gemma2_embedding_path, load_format="dummy")
56+
llm = LLM(model=dummy_gemma2_embedding_path,
57+
load_format="dummy",
58+
max_model_len=2048)
5759
outputs = llm.embed(prompts)
5860

5961
for output in outputs:

0 commit comments

Comments
 (0)