Skip to content

Commit 86a1f84

Browse files
gshtrasminpeter
authored andcommitted
[Bugfix][Model] Attempt to fix eagle in V0. (vllm-project#18978)
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com> Signed-off-by: minpeter <kali2005611@gmail.com>
1 parent 3ccc50c commit 86a1f84

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm/config.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2595,7 +2595,8 @@ def __post_init__(self):
25952595
else:
25962596
eagle_config = EAGLEConfig(
25972597
self.draft_model_config.hf_config,
2598-
method=self.method)
2598+
method=self.method,
2599+
model_type="eagle")
25992600
self.draft_model_config.hf_config = eagle_config
26002601

26012602
if (self.num_speculative_tokens is not None

0 commit comments

Comments
 (0)