File tree Expand file tree Collapse file tree 1 file changed +7
-8
lines changed
doc/source/reference/apis Expand file tree Collapse file tree 1 file changed +7
-8
lines changed Original file line number Diff line number Diff line change 1
- # V2 Inference Protocol
1
+ # Open Inference Protocol
2
2
3
- The V2 Inference Protocol is an industry-wide effort to provide an standardised
3
+ The Open Inference Protocol is an industry-wide effort to provide a standardized
4
4
protocol to communicate with different inference servers (e.g. MLServer,
5
5
Triton, etc.) and orchestrating frameworks (e.g. Seldon Core, KServe, etc.).
6
- The spec of the V2 Inference Protocol defines both the endpoints and payload
6
+ The spec of the Open Inference Protocol defines both the endpoints and payload
7
7
schemas for REST and gRPC interfaces.
8
8
9
- As part of the V2 Protocol definition, you can find dedicated endpoints for:
9
+ As part of the Open Inference Protocol definition, you can find dedicated endpoints for:
10
10
11
- - Health endpoints, to assess liveness and readiness of your model.
12
- - Inference endpoints, to interact with your model.
13
- - Metadata endpoints, to query your model metadata (e.g. expected inputs, expected
11
+ - Model controls: Call model inference, interact with your model, and load and unload models dynamically
12
+ - Health: Assess liveness and readiness of your model.
13
+ - Metadata: Query your model metadata (e.g. expected inputs, expected
14
14
outputs, etc.).
15
- - Model repository endpoints, to load and unload models dynamically.
16
15
17
16
18
17
## REST
You can’t perform that action at this time.
0 commit comments