Skip to content

Commit b8ebf29

Browse files
authored
Fix warmup error when pooling (embedding and clasification) is running (HabanaAI#1442)
by checking if pooling_param is None @czhu15 @yangulei @ranzhejiang
1 parent dc09523 commit b8ebf29

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/model_executor/layers/pooler.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -241,6 +241,7 @@ def forward(self, pooled_data: Union[list[torch.Tensor], torch.Tensor],
241241
dimensions_list = [
242242
pooling_param.dimensions
243243
for _, pooling_param in pooling_metadata.seq_groups
244+
if pooling_param is not None
244245
]
245246
if any(d is not None for d in dimensions_list):
246247
# change the output dimension

0 commit comments

Comments
 (0)