Introduction

This repository provides Infrastructure as Code (IaC) resources for the deployment and management of a confidential GPU cluster on Microsoft Azure, specifically tailored for research in confidential artificial intelligence.

Features

• Slurm 23.11 with 2 partitions:
  • Nvidia H100 in confidential mode
  • Nvidia H100 in non-confidential mode
• GPU attestation on cluster creation
• Enroot support
• PyTorch multi-node support
• High-performance shared storage

How-to

The main commands include:

~$ make login     # Login to Azure
~$ make bootstrap # First time setup
~$ make cluster   # Create the cluster
~$ make ssh       # SSH into the login node
# ... work in the cluster: sinfo, srun, sbatch, etc. ...
~$ make destroy   # Destroy the cluster

All commands are documented with:

~$ make help

Note: a Dev Container is provided for convenience.

Requirements

• Azure subscription and a contributor or administrator role to the subscription.
• Quota for the NCC H100 v5 and NC H100 V5 SKUs.