You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: e2e/inference/README.md
+19-18Lines changed: 19 additions & 18 deletions
Original file line number
Diff line number
Diff line change
@@ -13,47 +13,48 @@ Intel AI inference end-to-end solution with RHOCP is based on the Intel® Data C
13
13
## Install RHOAI
14
14
The Red Hat certified RHOAI operator is published at [Red Hat Ecosystem Catalog](https://catalog.redhat.com/software/container-stacks/detail/63b85b573112fe5a95ee9a3a). You can use the command line interface (CLI) or web console to install it.
15
15
### Install using CLI (To be added)
16
-
### Install using web console
16
+
### Install using Web Console
17
17
1. On the RHOCP web console, click Operators → OperatorHub.
18
-
2. Search RedHat OpenShift AI Operator and click Install. The operator is installed in the namespace redhat-ods-operator.
18
+
2. Search RedHat OpenShift AI Operator and click Install. The operator is installed in the namespace `redhat-ods-operator`.
19
19
### Verification
20
20
1. Navigate to Operators → Installed Operators page.
21
21
2. Ensure that in the redhat-ods-operator namespace, RedHat OpenShift AI status is InstallSucceeded
22
-
3. Click on ```Search -> Routes -> rhods-dashboard``` from the web console and access the RHOAI UI link.
23
-
Note: When installing the operator, the default ```kfdef``` Custom Resource (CR) is created. This CR enables the dashboard for users to browse and launch Jupyter Notebooks projects on an RHOCP cluster. Please refer to this [link](https://github.com/red-hat-data-services/odh-deployer) for more details about kfdef.
24
-
## Install OpenVINO operator
22
+
3. Click on `Search` -> `Routes` -> `rhods-dashboard` from the web console and access the RHOAI UI link.
23
+
**Note:** When installing the operator, the default `kfdef` Custom Resource (CR) is created. This CR enables the dashboard for users to browse and launch Jupyter Notebooks projects on an RHOCP cluster. Please refer to this [link](https://github.com/red-hat-data-services/odh-deployer) for more details about `kfdef`.
24
+
## Install OpenVINO Operator
25
25
The OpenVINO operator is published at [Red Hat Ecosystem Catalog](https://catalog.redhat.com/software/container-stacks/detail/60649a56209af65d24b7ca9e). You can use the CLI or web console to install it.
26
26
### Install using CLI (To be added)
27
-
### Install using web console
28
-
Follow this [link](https://github.com/openvinotoolkit/operator/blob/v1.1.0/docs/operator_installation.md) to install the operator via the web console.
29
-
## Work with interactive mode
27
+
### Install using Web Console
28
+
Follow this [link](https://github.com/openvinotoolkit/operator/blob/v1.1.0/docs/operator_installation.md#operator-instalation) to install the operator via the web console.
29
+
## Work with Interactive Mode
30
30
To enable the interactive mode, the OpenVINO notebook CR needs to be created and integrated with RHOAI.
31
-
1. Click on the ```create Notebook``` option from the web console and follow these [steps](https://github.com/openvinotoolkit/operator/blob/main/docs/notebook_in_rhods.md) to create the notebook CR.
31
+
1. Click on the `create Notebook` option from the web console and follow these [steps](https://github.com/openvinotoolkit/operator/blob/main/docs/notebook_in_rhods.md#integration-with-openshift-data-science-and-open-data-hub) to create the notebook CR.
32
32
2. Enable Intel Data Center GPU on RHOAI Dashboard- **Technical Preview feature**
33
33
34
-
Create AcceleratoProfile in the ```redhat-ods-applications``` namespace
34
+
Create `AcceleratorProfile` in the `redhat-ods-applications` namespace
3. Navigate to ```openvino-notebooks``` ImageStream and add the above created ```AcceleratorProfile``` key to the annotation field, as shown in the image below:
39
+
1. Navigate to `openvino-notebooks` ImageStream and add the above created `AcceleratorProfile` key to the annotation field, as shown in the image below:
4. Navigate to ```Search -> Networking -> Routes``` from the web console and access ```rhods-dashboard``` route in the ```redhat-ods-applications``` namespace, as in the image below. Click on the location link to launch RHOAI dashboard.
43
+
4. Navigate to `Search` -> `Networking` -> `Routes` from the web console and access `rhods-dashboard` route in the `redhat-ods-applications` namespace, as in the image below. Click on the location link to launch RHOAI dashboard.
5. If step 2 is successful, ```Intel® Data Center GPU Flex Series 140 ``` is shown in the accelerator dropdown menu in ```rhods-dashboard```. Users can run OpenVINO notebook image with Intel® Data Center GPU Flex Series 140 card.
Follow the [link](https://github.com/openvinotoolkit/operator/blob/main/docs/notebook_in_rhods.md) for more details on the available Jupyter Notebooks.
51
+
Follow the [link](https://github.com/openvinotoolkit/operator/blob/main/docs/notebook_in_rhods.md#integration-with-openshift-data-science-and-open-data-hub) for more details on the available Jupyter Notebooks.
51
52
52
-
## Work with deployment mode
53
-
1. From the web console, click on the ModelServer option in this [link](https://github.com/openvinotoolkit/operator/blob/v1.1.0/docs/operator_installation.md) and follow the [steps](https://github.com/openvinotoolkit/operator/blob/v1.1.0/docs/modelserver.md) to start the OVMS instance.
53
+
## Work with Deployment Mode
54
+
1. From the web console, click on the ModelServer option in this [link](https://github.com/openvinotoolkit/operator/blob/v1.1.0/docs/operator_installation.md#operator-instalation) and follow the [steps](https://github.com/openvinotoolkit/operator/blob/v1.1.0/docs/modelserver.md#managing-model-servers-via-operator) to start the OVMS instance.
54
55
2. To enable the Intel Data Center GPU, make sure to modify the OVMS instance options according to the screenshot below.
55
56
56
-
* Below images show gpu.intel.com/i915 resource requests and limits for OVMS
57
+
* Below images show `gpu.intel.com/i915` resource requests and limits for OVMS
0 commit comments