Skip to content

Commit 80f42d6

Browse files
cleanup
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
1 parent 58e4120 commit 80f42d6

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

vllm/v1/attention/backends/rocm_aiter_fa.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -198,8 +198,8 @@ def build(self,
198198
num_actual_tokens = common_attn_metadata.num_actual_tokens
199199
max_query_len = common_attn_metadata.max_query_len
200200

201-
max_seq_len = int(common_attn_metadata.seq_lens_cpu.max().item())
202-
total_tokens = int(common_attn_metadata.seq_lens_cpu.sum().item())
201+
max_seq_len = int(common_attn_metadata.seq_lens_cpu.max())
202+
total_tokens = int(common_attn_metadata.seq_lens_cpu.sum())
203203
query_start_loc = common_attn_metadata.query_start_loc
204204
query_start_loc_cpu = common_attn_metadata.query_start_loc_cpu
205205
seq_lens = common_attn_metadata.seq_lens

0 commit comments

Comments
 (0)