Skip to content

Commit 8c660ac

Browse files
committed
e2e: Update readme
Signed-off-by: vbedida79 <veenadhari.bedida@intel.com>
1 parent cbfe9e6 commit 8c660ac

File tree

1 file changed

+12
-14
lines changed

1 file changed

+12
-14
lines changed

e2e/inference/README.md

Lines changed: 12 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,8 @@
11
# Overview
2-
Intel AI inference end-to-end solution with RHOCP is based on the Intel® Data Center GPU Flex Series provisioning, Intel® OpenVINO™, and [Red Hat OpenShift Data Science](https://www.redhat.com/en/technologies/cloud-computing/openshift/openshift-data-science) (RHODS) on RHOCP. There are two AI inference modes verified with Intel® Xeon® processors and Intel Data Center GPU Flex Series with RHOCP.
3-
* Interactive mode – RHODS provides OpenVINO based Jupyter Notebooks for users to interactively debug the inference applications or [optimize the models](https://docs.openvino.ai/2023.0/openvino_docs_MO_DG_Deep_Learning_Model_Optimizer_DevGuide.html) on RHOCP using data center GPU cards or Intel Xeon processors.
2+
Intel AI inference end-to-end solution with RHOCP is based on the Intel® Data Center GPU Flex Series provisioning, Intel® OpenVINO™, and [Red Hat OpenShift AI](https://www.redhat.com/en/technologies/cloud-computing/openshift/openshift-ai) (RHOAI) on RHOCP. There are two AI inference modes verified with Intel® Xeon® processors and Intel Data Center GPU Flex Series with RHOCP.
3+
* Interactive mode – RHOAI provides OpenVINO based Jupyter Notebooks for users to interactively debug the inference applications or [optimize the models](https://docs.openvino.ai/2023.0/openvino_docs_MO_DG_Deep_Learning_Model_Optimizer_DevGuide.html) on RHOCP using data center GPU cards or Intel Xeon processors.
44
* Deployment mode – [OpenVINO Model Sever](https://github.com/openvinotoolkit/model_server) (OVMS) can be used to deploy the inference workloads in data center and edge computing environments on RHOCP.
55

6-
**NOTE**: To ensure the AI inference workloads work properly, please follow the workaround section in the [known SeLinux regression issue](https://github.com/intel/intel-technology-enabling-for-openshift/issues/107).
7-
86
## Prerequisites
97
* Provisioned RHOCP cluster. Follow steps [here](/README.md#provisioning-rhocp-cluster)
108
* Provisioning Intel Data Center GPU Flex Series. Follow steps [here](/README.md#provisioning-intel-hardware-features-on-rhocp)
@@ -13,26 +11,26 @@ Intel AI inference end-to-end solution with RHOCP is based on the Intel® Data C
1311
* Setup out of tree drivers for Intel GPU provisioning. Follow the steps [here](/kmmo/README.md)
1412
* Setup Intel device plugins operator and create Intel GPU device plugin. Follow the steps [here](/device_plugins/README.md)
1513

16-
## Install RHODS
17-
The Red Hat certified RHODS operator is published at [Red Hat Ecosystem Catalog](https://catalog.redhat.com/software/container-stacks/detail/63b85b573112fe5a95ee9a3a). You can use the command line interface (CLI) or web console to install it.
14+
## Install RHOAI
15+
The Red Hat certified RHOAI operator is published at [Red Hat Ecosystem Catalog](https://catalog.redhat.com/software/container-stacks/detail/63b85b573112fe5a95ee9a3a). You can use the command line interface (CLI) or web console to install it.
1816
### Install using CLI (To be added)
1917
### Install using web console
2018
1. On the RHOCP web console, click Operators → OperatorHub.
21-
2. Search RedHat OpenShift Data Science Operator and click Install. The operator is installed in the namespace redhat-ods-operator.
19+
2. Search RedHat OpenShift AI Operator and click Install. The operator is installed in the namespace redhat-ods-operator.
2220
### Verification
2321
1. Navigate to Operators → Installed Operators page.
24-
2. Ensure that in the redhat-ods-operator namespace, RedHat OpenShift Data Science Status is InstallSucceeded
25-
3. Click on ```Search -> Routes -> rhods-dashboard``` from the web console and access the RHODS UI link.
26-
Note: When installing the operator, the default ```kfdef``` Custom Resource (CR) is created. This CR enables the RHODS dashboard for users to browse and launch Jupyter Notebooks projects on an RHOCP cluster. Please refer to this [link](https://github.com/red-hat-data-services/odh-deployer) for more details about kfdef.
22+
2. Ensure that in the redhat-ods-operator namespace, RedHat OpenShift AI status is InstallSucceeded
23+
3. Click on ```Search -> Routes -> rhods-dashboard``` from the web console and access the RHOAI UI link.
24+
Note: When installing the operator, the default ```kfdef``` Custom Resource (CR) is created. This CR enables the dashboard for users to browse and launch Jupyter Notebooks projects on an RHOCP cluster. Please refer to this [link](https://github.com/red-hat-data-services/odh-deployer) for more details about kfdef.
2725
## Install OpenVINO operator
2826
The OpenVINO operator is published at [Red Hat Ecosystem Catalog](https://catalog.redhat.com/software/container-stacks/detail/60649a56209af65d24b7ca9e). You can use the CLI or web console to install it.
2927
### Install using CLI (To be added)
3028
### Install using web console
3129
Follow this [link](https://github.com/openvinotoolkit/operator/blob/v1.1.0/docs/operator_installation.md) to install the operator via the web console.
3230
## Work with interactive mode
33-
To enable the interactive mode, the OpenVINO notebook CR needs to be created and integrated with RHODS.
34-
1. Click on the ```create Notebook``` option in this [link](https://github.com/red-hat-data-services/odh-deployer) from the web console and follow these [steps](https://github.com/openvinotoolkit/operator/blob/main/docs/notebook_in_rhods.md) to create the notebook CR.
35-
2. Enable Intel Data Center GPU on RHODS Dashboard- **Technical Preview feature**
31+
To enable the interactive mode, the OpenVINO notebook CR needs to be created and integrated with RHOAI.
32+
1. Click on the ```create Notebook``` option from the web console and follow these [steps](https://github.com/openvinotoolkit/operator/blob/main/docs/notebook_in_rhods.md) to create the notebook CR.
33+
2. Enable Intel Data Center GPU on RHOAI Dashboard- **Technical Preview feature**
3634

3735
Create AcceleratoProfile in the ```redhat-ods-applications``` namespace
3836

@@ -42,7 +40,7 @@ Create AcceleratoProfile in the ```redhat-ods-applications``` namespace
4240

4341
![Alt text](/docs/images/openvino-accelerator-field.png)
4442

45-
4. Navigate to ```Search -> Networking -> Routes``` from the web console and access ```rhods-dashboard``` route in the ```redhat-ods-applications``` namespace, as in the image below. Click on the location link to launch RHODS dashboard.
43+
4. Navigate to ```Search -> Networking -> Routes``` from the web console and access ```rhods-dashboard``` route in the ```redhat-ods-applications``` namespace, as in the image below. Click on the location link to launch RHOAI dashboard.
4644

4745
![Alt text](/docs/images/rhods-dashboard-route.png)
4846

0 commit comments

Comments
 (0)