File tree Expand file tree Collapse file tree 1 file changed +5
-3
lines changed Expand file tree Collapse file tree 1 file changed +5
-3
lines changed Original file line number Diff line number Diff line change @@ -803,9 +803,11 @@ You can read more about the inference response parameters in the [parameters
803
803
extension] ( https://github.com/triton-inference-server/server/blob/main/docs/protocol/extension_parameters.md )
804
804
documentation.
805
805
806
- Inference response parameters is supported when using BLS as well, i.e. when
807
- using BLS to call another model A, you can access the the optional parameters
808
- if set by A in its response.
806
+ The parameters associated with an inference response can be retrieved using the
807
+ ` inference_response.parameters() ` function. This function returns a JSON string
808
+ where the keys are the keys of the parameters object and the values are the
809
+ values for the parameters field. Note that you need to parse this string using
810
+ ` json.loads ` to convert it to a dictionary.
809
811
810
812
## Managing Python Runtime and Libraries
811
813
You can’t perform that action at this time.
0 commit comments