Skip to content

Commit 39033b9

Browse files
rahul-tuliclaude
andcommitted
fix: Use speculators_model_type for method field instead of hardcoding
- Changed method field in vllm_config to use speculators_config.get("speculators_model_type", "eagle") - This allows the method to be dynamically set based on the speculators model type - Maintains backward compatibility with default value of "eagle" Signed-off-by: rtuli@redhat.com 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> Signed-off-by: Rahul Tuli <rtuli@redhat.com>
1 parent 23fb111 commit 39033b9

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/transformers_utils/configs/speculators_eagle.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -88,7 +88,7 @@ def _convert_speculators_to_vllm(cls, speculators_config: dict) -> dict:
8888
"model": transformer_config,
8989
"eagle_fc_bias": speculators_config.get("fusion_bias", False),
9090
"truncated_vocab_size": transformer_config.get("vocab_size"),
91-
"method": "eagle", # Required for V1 compatibility
91+
"method": speculators_config.get("speculators_model_type", "eagle"), # Use speculators_model_type
9292
}
9393

9494
# Preserve any additional fields that might be needed

0 commit comments

Comments
 (0)