|
2 | 2 | To ensure the whole stack is working as expected and track bugs, a layer based test architecture is needed on OCP. This plan consists of four layers. The first and second layers mentioned below, would be a part of the future automation testing framework on each OCP (x,y,z) release.
|
3 | 3 |
|
4 | 4 | #### L1 First Layer: Host OS and Driver Interfaces
|
5 |
| -This layer's test cases will be executed after the cluster is setup, NFD operator is installed and right before the Intel Device Plugins Operator installation. |
6 |
| -* Test cases for in-tree and OOT tree drivers |
7 |
| -* Any test cases for SELinux and host OS security |
8 |
| -* go-based tests cases for devices on all nodes |
9 |
| -* Dependency- rely on driver teams for any other testing result |
10 |
| -* Future plan to include OOT driver test cases with KMMO CI/CD pipeline- sanity testing. |
11 |
| -* Currently execute as a job. Plan to find an efficient mechanism to deploy and automate on all nodes. |
12 |
| - |
| 5 | +Layer 1 test cases should be executed before deploying [Intel Device Plugins Operator](device_plugins/README.md) and after deploying OOT drivers like [Intel Data Center GPU Driver on OpenShift](https://github.com/intel/intel-data-center-gpu-driver-for-openshift/blob/main/README.md). It includes test cases : |
| 6 | +* to check existence of in-tree and OOT tree drivers |
| 7 | +* for SELinux and host OS security |
| 8 | +* check for devices on all nodes |
| 9 | + |
13 | 10 | #### L2 Second Layer: Device plugin resource provisioning
|
14 |
| -This layer will be executed after the Intel Device Plugins Operator installation and Custom Resource creation. It includes |
| 11 | +L2 test cases are executed after deploying the [Intel Device Plugins Operator](device_plugins/README.md). Refer to [readme](l2/README.md). It includes: |
15 | 12 | * Pod's resource allocation and scheduling
|
16 | 13 | * Simple workloads
|
17 | 14 | * Boundary testing for the resources
|
18 |
| -* Integration and stress testing |
19 |
| -* Future plan to include any OOT driver test cases in KMMO CI/CD pipeline- canary testing |
20 |
| -* Any failure analysis needed during automation, in the future. |
| 15 | +* Future plan for any failure analysis needed during automation. |
21 | 16 |
|
22 | 17 | #### L3 Third Layer: E2E solution
|
23 |
| -This layer consists of the reference workload's/fourth layer's prerequisites and dependencies- after the cluster, operators and resources are accurately deployed. It is custom for each Intel Hero feature's final use case. For example, dGPU smart city workload would have RHODS (Red Hat OpenShift Data Science) and OpenVINO operator as prerequisites included here. |
| 18 | +L3 test cases are executed after the specific device plugin related e2e solution has been deployed in [day 2](README.md#day-2---ocp-platform-is-installed-and-ready-to-begin-providing-services). Please refer to [L3 test cases](l3/README.md) for detail. |
24 | 19 |
|
25 | 20 | #### L4 Fourth Layer: Reference Workloads
|
26 |
| -This layer includes the reference final application/usecase for the user. It integrates the whole stack and is custom for each Intel Hero feature. |
| 21 | +This layer includes the reference final application/usecase for the user. It integrates the whole stack and is custom for each Intel hardware feature and device plugin. This layer is yet to be added in upcoming releases. |
0 commit comments