Skip to content

Commit 8985364

Browse files
authored
Use preserve_ordering config field for oldest strategy sequence scheduler (#241)
1 parent 007c263 commit 8985364

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

src/sequence_batch_scheduler.cc

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1809,7 +1809,8 @@ OldestSequenceBatch::OldestSequenceBatch(
18091809
model_instance->Model(), model_instance,
18101810
triton::common::GetCpuNiceLevel(config),
18111811
true /* dynamic_batching_enabled */, config.max_batch_size(),
1812-
enforce_equal_shape_tensors_, true /* preserve_ordering */,
1812+
enforce_equal_shape_tensors_,
1813+
config.sequence_batching().oldest().preserve_ordering(),
18131814
false /* response_cache_enable */, preferred_batch_sizes,
18141815
config.sequence_batching().oldest().max_queue_delay_microseconds(),
18151816
&dynamic_batcher_);

0 commit comments

Comments
 (0)