Skip to content

Commit b7d286f

Browse files
rahul-tuliclaude
andcommitted
fix: Add eagle model_type detection for automatic method setting
- Added check for model_type == "eagle" in SpeculativeConfig auto-detection - This ensures speculators Eagle models are properly detected and method is set to "eagle" - Fixes V1 engine compatibility check for speculators Eagle models Signed-off-by: rtuli@redhat.com 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: Rahul Tuli <rtuli@redhat.com>
1 parent 31d9af6 commit b7d286f

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

vllm/config.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2770,6 +2770,8 @@ def __post_init__(self):
27702770
elif "eagle-" in self.draft_model_config.model.lower() or \
27712771
"eagle3-" in self.draft_model_config.model.lower():
27722772
self.method = "eagle"
2773+
elif self.draft_model_config.hf_config.model_type == "eagle":
2774+
self.method = "eagle"
27732775
elif self.draft_model_config.hf_config.model_type == "medusa":
27742776
self.method = "medusa"
27752777
elif (self.draft_model_config.hf_config.model_type ==

0 commit comments

Comments
 (0)