Skip to content

Commit 8eef149

Browse files
ziqif-nvkthui
andauthored
Update README.md
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
1 parent 13b07fa commit 8eef149

File tree

1 file changed

+5
-3
lines changed

1 file changed

+5
-3
lines changed

README.md

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -803,9 +803,11 @@ You can read more about the inference response parameters in the [parameters
803803
extension](https://github.com/triton-inference-server/server/blob/main/docs/protocol/extension_parameters.md)
804804
documentation.
805805

806-
Inference response parameters is supported when using BLS as well, i.e. when
807-
using BLS to call another model A, you can access the the optional parameters
808-
if set by A in its response.
806+
The parameters associated with an inference response can be retrieved using the
807+
`inference_response.parameters()` function. This function returns a JSON string
808+
where the keys are the keys of the parameters object and the values are the
809+
values for the parameters field. Note that you need to parse this string using
810+
`json.loads` to convert it to a dictionary.
809811

810812
## Managing Python Runtime and Libraries
811813

0 commit comments

Comments
 (0)