Skip to content

Commit 8134ca7

Browse files
committed
e2e_inference: Add rhods accelerator profile for Intel flex GPU
Signed-off-by: vbedida79 <veenadhari.bedida@intel.com>
1 parent 076c5f7 commit 8134ca7

File tree

5 files changed

+32
-3
lines changed

5 files changed

+32
-3
lines changed
66.9 KB
Loading
173 KB
Loading

docs/images/rhods-dashboard-route.png

61.6 KB
Loading

e2e/inference/README.md

Lines changed: 19 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -29,10 +29,26 @@ Follow this [link](https://github.com/openvinotoolkit/operator/blob/v1.1.0/docs/
2929
## Work with interactive mode
3030
To enable the interactive mode, the OpenVINO notebook CR needs to be created and integrated with RHODS.
3131
1. Click on the ```create Notebook``` option in this [link](https://github.com/red-hat-data-services/odh-deployer) from the web console and follow these [steps](https://github.com/openvinotoolkit/operator/blob/main/docs/notebook_in_rhods.md) to create the notebook CR.
32-
2. Enable Intel Data Center GPU
32+
2. Enable Intel Data Center GPU on RHODS Dashboard- **Technical Preview feature**
33+
34+
Create AcceleratoProfile in the ```redhat-ods-applications``` namespace
35+
36+
```$ oc apply -f https://raw.githubusercontent.com/intel/intel-technology-enabling-for-openshift/main/e2e/inference/accelerator_profile.yaml```
37+
38+
3. Navigate to ```openvino-notebooks``` ImageStream and add the above created ```AcceleratorProfile``` key to the annotation field, as shown in the image below:
39+
40+
![Alt text](/docs/images/openvino-accelerator-field.png)
41+
42+
4. Navigate to ```Search -> Networking -> Routes``` from the web console and access ```rhods-dashboard``` route in the ```redhat-ods-applications``` namespace, as in the image below. Click on the location link to launch RHODS dashboard.
43+
44+
![Alt text](/docs/images/rhods-dashboard-route.png)
45+
46+
5. If step 2 is successful, ```Intel® Data Center GPU Flex Series 140 ``` is shown in the accelerator dropdown menu in ```rhods-dashboard```. Users can run OpenVINO notebook image with Intel® Data Center GPU Flex Series 140 card.
47+
48+
![Alt text](/docs/images/accelerator-profile-dropdown.png)
49+
50+
Follow the [link](https://github.com/openvinotoolkit/operator/blob/main/docs/notebook_in_rhods.md) for more details on the available Jupyter Notebooks.
3351

34-
3. Run sample Jupyter Notebooks.
35-
Follow the [link](https://github.com/openvinotoolkit/operator/blob/main/docs/notebook_in_rhods.md) to execute the sample Jupyter Notebook There are 60+ sample notebooks available with this notebook image. For the details on the notebooks with Intel Data Center GPU, please check this [link](https://github.com/openvinotoolkit/openvino_notebooks).
3652
## Work with deployment mode
3753
1. From the web console, click on the ModelServer option in this [link](https://github.com/openvinotoolkit/operator/blob/v1.1.0/docs/operator_installation.md) and follow the [steps](https://github.com/openvinotoolkit/operator/blob/v1.1.0/docs/modelserver.md) to start the OVMS instance.
3854
2. To enable the Intel Data Center GPU, make sure to modify the OVMS instance options according to the screenshot below.
Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
apiVersion: dashboard.opendatahub.io/v1
2+
kind: AcceleratorProfile
3+
metadata:
4+
name: intel-gpu-flex-series-140
5+
spec:
6+
displayName: Intel® Data Center GPU Flex Series 140
7+
description: Intel Data Center GPU for inference
8+
enabled: true
9+
identifier: gpu.intel.com/i915
10+
tolerations:
11+
- effect: NoSchedule
12+
key: gpu.intel.com/flex-140
13+
operator: Exists

0 commit comments

Comments
 (0)