Skip to content

Commit 816d4ac

Browse files
committed
Add documentation
1 parent db84765 commit 816d4ac

File tree

1 file changed

+17
-1
lines changed

1 file changed

+17
-1
lines changed

README.md

Lines changed: 17 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
<!--
2-
# Copyright 2020-2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2+
# Copyright 2020-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
33
#
44
# Redistribution and use in source and binary forms, with or without
55
# modification, are permitted provided that the following conditions
@@ -54,6 +54,7 @@ any C++ code.
5454
- [`finalize`](#finalize)
5555
- [Model Config File](#model-config-file)
5656
- [Inference Request Parameters](#inference-request-parameters)
57+
- [Inference Response Parameters](#inference-response-parameters)
5758
- [Managing Python Runtime and Libraries](#managing-python-runtime-and-libraries)
5859
- [Building Custom Python Backend Stub](#building-custom-python-backend-stub)
5960
- [Creating Custom Execution Environments](#creating-custom-execution-environments)
@@ -787,6 +788,21 @@ You can read more about the inference request parameters in the [parameters
787788
extension](https://github.com/triton-inference-server/server/blob/main/docs/protocol/extension_parameters.md)
788789
documentation.
789790

791+
## Inference Response Parameters
792+
793+
Inference response parameters may be optionally set during the construction of
794+
an inference response object. The parameters should be a dictionary of key value
795+
pairs, where keys are `str` and values are `bool`, `int` or `str`. For example,
796+
```python
797+
response = pb_utils.InferenceResponse(
798+
output_tensors, parameters={"key": "value"}
799+
)
800+
```
801+
802+
You can read more about the inference response parameters in the [parameters
803+
extension](https://github.com/triton-inference-server/server/blob/main/docs/protocol/extension_parameters.md)
804+
documentation.
805+
790806
## Managing Python Runtime and Libraries
791807

792808
Python backend shipped in the [NVIDIA GPU Cloud](https://ngc.nvidia.com/)

0 commit comments

Comments
 (0)