Skip to content

Commit 8013634

Browse files
[Structured Output] Remove redundant check for grammar_bitmask (#1459)
### What this PR does / why we need it? Remove redundant check since we have check this at https://github.com/vllm-project/vllm-ascend/blob/main/vllm_ascend/worker/model_runner_v1.py#L1450. Signed-off-by: shen-shanshan <467638484@qq.com>
1 parent ba577df commit 8013634

File tree

1 file changed

+0
-2
lines changed

1 file changed

+0
-2
lines changed

vllm_ascend/worker/model_runner_v1.py

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1273,8 +1273,6 @@ def apply_grammar_bitmask(
12731273
# Serialization of np.ndarray is much more efficient than a tensor,
12741274
# so we receive it in that format.
12751275
grammar_bitmask = scheduler_output.grammar_bitmask
1276-
if grammar_bitmask is None:
1277-
return
12781276

12791277
# We receive the structured output bitmask from the scheduler, but the
12801278
# indices of the requests in the batch may not match the indices of

0 commit comments

Comments
 (0)