|
1 | 1 | <!--
|
2 |
| -# Copyright 2020-2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved. |
| 2 | +# Copyright 2020-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved. |
3 | 3 | #
|
4 | 4 | # Redistribution and use in source and binary forms, with or without
|
5 | 5 | # modification, are permitted provided that the following conditions
|
@@ -54,6 +54,7 @@ any C++ code.
|
54 | 54 | - [`finalize`](#finalize)
|
55 | 55 | - [Model Config File](#model-config-file)
|
56 | 56 | - [Inference Request Parameters](#inference-request-parameters)
|
| 57 | + - [Inference Response Parameters](#inference-response-parameters) |
57 | 58 | - [Managing Python Runtime and Libraries](#managing-python-runtime-and-libraries)
|
58 | 59 | - [Building Custom Python Backend Stub](#building-custom-python-backend-stub)
|
59 | 60 | - [Creating Custom Execution Environments](#creating-custom-execution-environments)
|
@@ -787,6 +788,21 @@ You can read more about the inference request parameters in the [parameters
|
787 | 788 | extension](https://github.com/triton-inference-server/server/blob/main/docs/protocol/extension_parameters.md)
|
788 | 789 | documentation.
|
789 | 790 |
|
| 791 | +## Inference Response Parameters |
| 792 | + |
| 793 | +Inference response parameters may be optionally set during the construction of |
| 794 | +an inference response object. The parameters should be a dictionary of key value |
| 795 | +pairs, where keys are `str` and values are `bool`, `int` or `str`. For example, |
| 796 | +```python |
| 797 | +response = pb_utils.InferenceResponse( |
| 798 | + output_tensors, parameters={"key": "value"} |
| 799 | +) |
| 800 | +``` |
| 801 | + |
| 802 | +You can read more about the inference response parameters in the [parameters |
| 803 | +extension](https://github.com/triton-inference-server/server/blob/main/docs/protocol/extension_parameters.md) |
| 804 | +documentation. |
| 805 | + |
790 | 806 | ## Managing Python Runtime and Libraries
|
791 | 807 |
|
792 | 808 | Python backend shipped in the [NVIDIA GPU Cloud](https://ngc.nvidia.com/)
|
|
0 commit comments