Skip to content

Commit cf6be69

Browse files
Sequence batcher no longer pads string corrids
1 parent 434e503 commit cf6be69

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

src/sequence_batch_scheduler/sequence_batch_scheduler.cc

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1324,7 +1324,9 @@ SequenceBatch::SetControlTensors(
13241324
if (seq_corr_id->DType() == inference::DataType::TYPE_STRING) {
13251325
// 4 bytes for length of string plus pre-defined max string correlation id
13261326
// length in bytes
1327-
size_p = 4 + triton::core::STRING_CORRELATION_ID_MAX_LENGTH_BYTES;
1327+
std::string correlation_id = corrid.StringValue();
1328+
uint32_t correlation_id_length = correlation_id.length();
1329+
size_p = 4 + correlation_id_length;
13281330
}
13291331

13301332
TRITONSERVER_MemoryType memory_type;

0 commit comments

Comments
 (0)