Need help to send string/bytes data into the InferenceServerClient

[alexkudryavtsev88]

Hello

I've faced with a following problem:
I try to send some text data using tritonclient.grpc.InferenceServerClient (python), pass this text data as input wrapped with numpy.array and specify some dummy output.

The code:

import tritonclient.grpc as grpcclient
import numpy as np

triton_cli = grpcclient.InferenceServerClient(
    url=url,
    ssl=True,
    root_certificates=my_root_certificates,
)
input_array = np.array(
    [my_text.encode("utf-8")], dtype=np.object_
)

infer_input = grpcclient.InferInput('input', [1], "BYTES")
infer_input.set_data_from_numpy(input_array)
infer_output = grpcclient.InferRequestedOutput('164')

try:
    response = triton_cli.infer("my-text-model", inputs=[infer_input], outputs=[infer_output])
    print(response)
except Exception as exc:
    print("".join(traceback.format_exception(e)))
    sys.exit(1)

My text model has following Metadata:

inputs=[MetadataInputOutput(name='input', datatype='BYTES', shape=[1])], outputs=[MetadataInputOutput(name='predict_proba', datatype='BYTES', shape=[4, 1])]

Then I retrieve the following error:
"inference.GRPCInferenceService/ModelInfer: INTERNAL: <Datatype.BYTES: \'BYTES\'>, grpc_status:13

Also I tried to send data without encoding or as base64-encoded string, the result is the same.

When I try to do the same using grpcurl, I receive successful response.

Could anyone help me with that: what I do wrong in my programmatical variant? Thanks!