Skip to content

Commit 30c740d

Browse files
committed
proj-dept
1 parent 903d17e commit 30c740d

File tree

8 files changed

+412
-1
lines changed

8 files changed

+412
-1
lines changed
Lines changed: 177 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,177 @@
1+
2+
This article explains the procedure for managing departments
3+
4+
Departments are a grouping of projects. By grouping projects into a department, you can set quota limitations to a set of projects, create policies that are applied to the department, and create assets that can be scoped to the whole department or a partial group of descendent projects
5+
6+
For example, in an academic environment, a department can be the Physics Department grouping various projects (AI Initiatives) within the department, or grouping projects where each project represents a single student.
7+
8+
## Departments
9+
10+
The Departments table can be found under Departments in the Run:ai platform.
11+
12+
!!! Note
13+
Departments are disabled, by default. If you cannot see Departments in the menu, then it must be enabled by your Administrator, under General Settings → Resources → Departments
14+
15+
The Departments table lists all departments defined for a specific cluster and allows you to manage them. You can switch between clusters by selecting your cluster using the filter at the top.
16+
17+
![](img/department-list.png)
18+
19+
The Departments table consists of the following columns:
20+
21+
| Column | Description |
22+
| :---- | :---- |
23+
| Department | The name of the department |
24+
| Node pool(s) with quota | The node pools associated with this department. By default, all node pools within a cluster are associated with each department. Administrators can change the node pools’ quota parameters for a department. Click the values under this column to view the list of node pools with their parameters (as described below) |
25+
| GPU quota | GPU quota associated with the department |
26+
| Total GPUs for projects | The sum of all projects’ GPU quotas associated with this department |
27+
| Project(s) | List of projects associated with this department |
28+
| Subject(s) | The users, SSO groups, or applications with access to the project. Click the values under this column to view the list of subjects with their parameters (as described below). This column is only viewable if your role in Run:ai platform allows you those permissions. |
29+
| Allocated GPUs | The total number of GPUs allocated by successfully scheduled workloads in projects associated with this department |
30+
| GPU allocation ratio | The ratio of Allocated GPUs to GPU quota. This number reflects how well the department’s GPU quota is utilized by its descendant projects. A number higher than 100% means the department is using over-quota GPUs. A number lower than 100% means not all projects are utilizing their quotas. A quota becomes allocated once a workload is successfully scheduled. |
31+
| Creation time | The timestamp for when the department was created |
32+
| Workload(s) | The list of workloads under projects associated with this department. Click the values under this column to view the list of workloads with their resource parameters (as described below) |
33+
| Cluster | The cluster that the department is associated with |
34+
35+
### Customizing the table view
36+
37+
* Filter - Click ADD FILTER, select the column to filter by, and enter the filter values
38+
* Search - Click SEARCH and type the value to search by
39+
* Sort - Click each column header to sort by
40+
* Column selection - Click COLUMNS and select the columns to display in the table
41+
* Download table - Click MORE and then Click Download as CSV
42+
43+
### Node pools with quota associated with the department
44+
45+
Click one of the values of Node pool(s) with quota column, to view the list of node pools and their parameters
46+
47+
| Column | Description |
48+
| :---- | :---- |
49+
| Node pool | The name of the node pool is given by the administrator during node pool creation. All clusters have a default node pool created automatically by the system and named ‘default’. |
50+
| GPU quota | The amount of GPU quota the administrator dedicated to the department for this node pool (floating number, e.g. 2.3 means 230% of a GPU capacity) |
51+
| CPU (Cores) | The amount of CPU (cores) quota the administrator has dedicated to the department for this node pool (floating number, e.g. 1.3 Cores = 1300 mili-cores). The ‘unlimited’ value means the CPU (Cores) quota is not bound and workloads using this node pool can use as many CPU (Cores) resources as they need (if available) |
52+
| CPU memory | The amount of CPU memory quota the administrator has dedicated to the department for this node pool (floating number, in MB or GB). The ‘unlimited’ value means the CPU memory quota is not bounded and workloads using this node pool can use as much CPU memory resource as they need (if available). |
53+
| Allocated GPUs | The total amount of GPUs allocated by workloads using this node pool under projects associated with this department. The number of allocated GPUs may temporarily surpass the GPU quota of the department if over-quota is used. |
54+
| Allocated CPU (Cores) | The total amount of CPUs (cores) allocated by workloads using this node pool under all projects associated with this department. The number of allocated CPUs (cores) may temporarily surpass the CPUs (Cores) quota of the department if over-quota is used. |
55+
| Allocated CPU memory | The actual amount of CPU memory allocated by workloads using this node pool under all projects associated with this department. The number of Allocated CPU memory may temporarily surpass the CPU memory quota if over-quota is used. |
56+
57+
### Subjects authorized for the project
58+
59+
Click one of the values of the Subject(s) column, to view the list of subjects and their parameters. This column is only viewable if your role in the Run:ai system affords you those permissions.
60+
61+
| Column | Description |
62+
| :---- | :---- |
63+
| Subject | A user, SSO group, or application assigned with a role in the scope of this department |
64+
| Type | The type of subject assigned to the access rule (user, SSO group, or application). |
65+
| Scope | The scope of this department within the organizational tree. Click the name of the scope to view the organizational tree diagram, you can only view the parts of the organizational tree for which you have permission to view. |
66+
| Role | The role assigned to the subject, in this department’s scope |
67+
| Authorized by | The user who granted the access rule |
68+
| Last updated | The last time the access rule was updated |
69+
70+
!!!Note
71+
A role given in a certain scope, means the role applies to this scope and any descendant scopes in the organizational tree.
72+
73+
## Adding a new department
74+
75+
To create a new Department:
76+
77+
1. Click +NEW DEPARTMENT
78+
2. Select a __scope__.
79+
By default, the field contains the scope of the current UI context cluster, viewable at the top left side of your screen. You can change the current UI context cluster by clicking the ‘Cluster: cluster-name’ field and applying another cluster as the UI context. Alternatively, you can choose another cluster within the ‘+ New Department’ form by clicking the organizational tree icon on the right side of the scope field, opening the organizational tree and selecting one of the available clusters.
80+
3. Enter a __name__ for the department. Department names must start with a letter and can only contain lower case latin letters, numbers or a hyphen ('-’).
81+
4. Under __Quota Management__, select a quota for the department. The Quota management section may contain different fields depending on pre-created system configuration. Possible system configurations are:
82+
* Existence of Node Pools
83+
* CPU Quota - Allow setting a quota for CPU resources.
84+
85+
When no node pools are configured, you can set the following quota parameters:
86+
87+
* __GPU Devices__
88+
The number of GPUs you want to allocate for this department (decimal number). This quota is consumed by the department’s subordinated project.
89+
* __CPUs (cores)__ (when CPU quota is set)
90+
The number of CPU cores you want to allocate for this department (decimal number). This quota is consumed by the department’s subordinated projects
91+
* __CPUs memory__ (when CPU quota is set)
92+
The amount of CPU memory you want to allocate for this department (in Megabytes or Gigabytes). This quota is consumed by the department’s subordinated projects
93+
94+
When node pools are enabled, it is possible to set the above quota parameters __for each node-pool separately__.
95+
96+
* In addition, you can decide whether to allow a department to go over-quota. Allowing over-quota at the department level means that one department can receive more resources than its quota when not required by other departments. If the over-quota is disabled, workloads running under subordinated projects are not able to use more resources than the department’s quota, but each project can still go over-quota (if enabled at the project level) up to the department’s quota.
97+
98+
Unlimited CPU(Cores) and CPU memory quotas are an exception - in this case, workloads of subordinated projects can consume available resources up to the physical limitation of the cluster or any of the node pools.
99+
100+
Example of Quota management:
101+
102+
![](img/quota-mgmt.png)
103+
104+
7. Click CREATE DEPARTMENT
105+
106+
## Adding an access rule to a department
107+
108+
To create a new access rule for a department:
109+
110+
1. Select the department you want to add an access rule for
111+
2. Click ACCESS RULES
112+
3. Click +ACCESS RULE
113+
4. Select a subject
114+
5. Select or enter the subject identifier:
115+
* User Email for a local user created in Run:ai or for SSO user as recognized by the IDP
116+
* Group name as recognized by the IDP
117+
* Application name as created in Run:ai
118+
6. Select a role
119+
7. Click SAVE RULE
120+
8. Click CLOSE
121+
122+
## Deleting an access rule from a department
123+
124+
To delete an access rule from a department:
125+
126+
1. Select the department you want to remove an access rule from
127+
2. Click ACCESS RULES
128+
3. Find the access rule you would like to delete
129+
4. Click on the trash icon
130+
5. Click CLOSE
131+
132+
## Editing a department
133+
134+
1. Select the Department you want to edit
135+
2. Click EDIT
136+
3. Update the Department and click SAVE
137+
138+
## Viewing a department’s policy
139+
140+
To view the policy of a department:
141+
142+
1. Select the department for which you want to view its policies.
143+
This option is only active if the department has defined policies in place.
144+
2. Click VIEW POLICY and select the workload type for which you want to view the policies:
145+
a. Workspace workload type policy with its set of rules
146+
b. Training workload type policies with its set of rules
147+
3. In the Policy form, view the workload rules that are enforcing your department for the selected workload type as well as the defaults:
148+
* Parameter - The workload submission parameter that Rule and Default is applied on
149+
* Type (applicable for data sources only) - The data source type (Git, S3, nfs, pvc etc.)
150+
* Default - The default value of the Parameter
151+
* Rule - Set up constraints on workload policy fields
152+
* Source - The origin of the applied policy (cluster, department or project)
153+
154+
155+
!!! Notes
156+
* The policy affecting the department consists of rules and defaults. Some of these rules and defaults may be derived from the policies of a parent cluster (source). You can see the source of each rule in the policy form.
157+
* A policy set for a department affects all subordinated projects and their workloads, according to the policy workload type
158+
159+
## Deleting a department
160+
161+
1. Select the department you want to delete
162+
2. Click DELETE
163+
3. On the dialog, click DELETE to confirm the deletion
164+
165+
!!! Note
166+
Deleting a department permanently deletes its subordinated projects, any assets created in the scope of this department, and any of its subordinated projects such as compute resources, environments, data sources, templates, and credentials. However, workloads running within the department’s subordinated projects, or the policies defined for this department or its subordinated projects - remain intact and running.
167+
168+
## Reviewing a department
169+
170+
1. Select the department you want to review
171+
2. Click REVIEW
172+
3. Review and click CLOSE
173+
174+
## Using API
175+
176+
Go to the [Departments](https://app.run.ai/api/docs#tag/Departments) API reference to view the available actions
177+
Loading
Loading
-2.31 KB
Loading

0 commit comments

Comments
 (0)