Skip to content

Commit 1afa994

Browse files
authored
[Llama4] Update attn_temperature_tuning (#19997)
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
1 parent 0d06b53 commit 1afa994

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

vllm/model_executor/models/llama4.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -148,9 +148,8 @@ def __init__(self,
148148
self.q_size = self.num_heads * self.head_dim
149149
self.kv_size = self.num_kv_heads * self.head_dim
150150
self.scaling = self.head_dim**-0.5
151-
# TODO: attn_temperature_tuning should be a bool in huggingface
152151
self.attn_temperature_tuning = self.nope and \
153-
config.attn_temperature_tuning > 0
152+
config.attn_temperature_tuning
154153

155154
self.floor_scale = getattr(config, "floor_scale", 8192.0)
156155
self.attn_scale = getattr(config, "attn_scale", 0.1)

0 commit comments

Comments
 (0)