Skip to content

Commit ba67880

Browse files
Merge pull request #465 from jasonnovichRunAI/v2.14
V2.14 Add MPS and tolerations.
2 parents 5c40e9b + c913ed7 commit ba67880

File tree

2 files changed

+28
-10
lines changed

2 files changed

+28
-10
lines changed

docs/admin/admin-ui-setup/deployments.md

Lines changed: 3 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -8,13 +8,12 @@ The main view shows a list of Deployments:
88

99
![job-list](img/deployment-list.png)
1010

11-
1211
## Submit a Deployment
13-
On the top right, you can choose to Submit a new Deployment.
12+
On the top right, you can choose to Submit a new Deployment.
1413
!!! Note
1514
If [knative is not installed in your cluster](../runai-setup/cluster-setup/cluster-prerequisites.md#inference) the button will be grayed out.
1615

17-
A Deployment form will open:
16+
A Deployment form will open:
1817

1918
![submit-job](img/submit-deployment.png)
2019

@@ -27,5 +26,4 @@ When selecting a single Deployment, a right-pane appears:
2726

2827
![job-properties](img/deployment-properties.png)
2928

30-
This multi-tab view provides information about Deployment details, related Pods, Deployment status history, and various utilization graphs.
31-
29+
This multi-tab view provides information about Deployment details, related Pods, Deployment status history, and various utilization graphs.

docs/home/whats-new-2-14.md

Lines changed: 25 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -8,15 +8,14 @@ August 2023
88

99
#### Release content
1010

11-
This version contains features and fixes from previous versions starting with 2.9. Refer to the prior versions for specific features and fixes. For information about features, functionality, and fixed issues in previous versions see:
11+
This version contains features and fixes from previous versions. Refer to the prior versions for specific features and fixes. For information about features, functionality, and fixed issues in previous versions see:
1212

1313
* [What's new 2.13](whats-new-2-13.md)
1414
* [What's new 2.12](whats-new-2-12.md)
1515
* [What's new 2.10](whats-new-2-10.md)
16-
<!-- RUN-7510/9002 and lots of others -->
1716

1817
##### Role based access control
19-
18+
<!-- RUN-7510/9002 and lots of others -->
2019
Stating in this version, Run:ai had updated the authorization system to Role Based Access Control (RBAC). RBAC is a policy-neutral access control mechanism defined around roles and privileges. For more information, see [Role based access control](../admin/runai-setup/access-control/rbac.md#role-based-access-control).
2120

2221
<!-- When upgrading the system, previous access and authorizations that were configured will be migrated to the new RBAC roles. See the table below for role conversions:
@@ -25,11 +24,11 @@ TODO Add RBAC old--new conversion table here. -->
2524

2625
##### Auto delete jobs
2726
<!-- RUN-8586/RUN-11777 -->
28-
* We are pleased to announce new functionality in our UI and CLI that provides configuration options which automatically delete jobs after a specified amount of time. Auto-deletion provides more efficient use of resources and makes it easier for researchers to manage their jobs. For more configuration options in the UI, see Auto deletion (Step 9) in [Create a new workspace](../Researcher/user-interface/workspaces/create/.workspace-v2.md#create-a-new-workspace). For more information on the CLI flag, see [--auto-deletion-time-after-completion](../Researcher/cli-reference/runai-submit.md#auto-deletion-time-after-completion).
27+
* We are pleased to announce new functionality in our UI and CLI that provides configuration options which automatically delete jobs after a specified amount of time. Auto-deletion provides more efficient use of resources and makes it easier for researchers to manage their jobs. For more configuration options in the UI, see Auto deletion (Step 9) in [Create a new workspace](../Researcher/user-interface/workspaces/create/workspace-v2.md#create-a-new-workspace). For more information on the CLI flag, see [--auto-deletion-time-after-completion](../Researcher/cli-reference/runai-submit.md).
2928

3029
##### Multiple service types
3130
<!-- RUN-10235/RUN-10485 Support multi service types in the CLI submission -->
32-
* We are pleased to announce new functionality in our CLI that allows submitting a workload with multiple service types at the same time in a CSV style format. Both the CLI and the UI now provide the same functionality. For more information see [runai submit ](../Researcher/cli-reference/runai-submit.md#s----service-type-string).
31+
* We are pleased to announce new functionality in our CLI that allows submitting a workload with multiple service types at the same time in a CSV style format. Both the CLI and the UI now provide the same functionality. For more information see [runai submit](../Researcher/cli-reference/runai-submit.md).
3332

3433
<!-- RUN-9808/RUN-9810 Show effective project policy from the UI
3534
* We are pleased to announce an enhancement to the Projects table where users now have the ability to view policies from within a project. For more information, see [Projects](). -->
@@ -54,6 +53,27 @@ TODO Add RBAC old--new conversion table here. -->
5453
<!-- RUN-11421/RUN-11508 Consumption report cost and bugs -->
5554
* We are pleased to announce that we have added an additional table to the Consumption dashboard. This table contains the consumption per department and the cost per department. For more information, see [Consumption dashboard](../admin/admin-ui-setup/dashboard-analysis.md#consumption-dashboard).
5655

56+
##### Deployment improvements
57+
<!-- RUN-11563/RUN-11564 MPS and tolerance -->
58+
* We are pleased to announce improvements to the deployment form which now include support for and *Multi-Process Service (MPS)*. *MPS* is a service which allows the running of parallel processes on the same GPU, which are all run by the same userid. To enable *MPS* support, move the selector switch on the *Deployments* form.
59+
60+
!!! Note
61+
If you do not use the same userid, the processes will run in serial and could possibly degrade performance.
62+
63+
* We are pleased to announce improvements to the deployment form which now include support for *Tolerations*. *Tolerations* guide the system to which node each pod can be
64+
scheduled to or evicted by matching between rules and taints defined for each Kubernetes node.
65+
66+
<!-- Configuration procedure added here because the deployments page has no procedure on it. -->
67+
To configure *Tolerations*:
68+
1. In the left pane menu, press *Deployments*, then press *New deployment*.
69+
2. Complete the required fields in the form, then press *Container definition*.
70+
3. To configure *Tolerations*:
71+
1. In the *Tolerations* pane, press *Add*.
72+
2. Enter the *Key* and select and option from the *Operator* drop down.
73+
3. Select an *Effect* from the drop down.
74+
4. Enter a *Value* and *Toleration seconds* (optional).
75+
4. When your form is complete press *Deploy*.
76+
5777
#### Fixed issues
5878

5979
| Internal ID | Description |

0 commit comments

Comments
 (0)