Skip to content

Commit 4867831

Browse files
rahul-tuliclaude
andcommitted
fix: Add eagle model_type detection for automatic method setting
- Added check for model_type == "eagle" in SpeculativeConfig auto-detection - This ensures speculators Eagle models are properly detected and method is set to "eagle" - Fixes V1 engine compatibility check for speculators Eagle models Signed-off-by: rtuli@redhat.com 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: Rahul Tuli <rtuli@redhat.com>
1 parent 39033b9 commit 4867831

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

vllm/config.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2712,6 +2712,8 @@ def __post_init__(self):
27122712
elif "eagle-" in self.draft_model_config.model.lower() or \
27132713
"eagle3-" in self.draft_model_config.model.lower():
27142714
self.method = "eagle"
2715+
elif self.draft_model_config.hf_config.model_type == "eagle":
2716+
self.method = "eagle"
27152717
elif self.draft_model_config.hf_config.model_type == "medusa":
27162718
self.method = "medusa"
27172719
elif (self.draft_model_config.hf_config.model_type ==

0 commit comments

Comments
 (0)