You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Welcome to the **MLPerf Automations and Scripts** repository! This repository provides tools, automations, and scripts to facilitate running MLPerf benchmarks, with a primary focus on **MLPerf Inference benchmarks**.
9
8
10
-
The automations build upon and extend the powerful [Collective Mind (CM) script automations](https://github.com/mlcommons/cm4mlops/tree/main/automation/script) to streamline benchmarking and workflow processes.
9
+
Welcome to the **MLPerf Automations and Scripts** repository! This repository is your go-to resource for tools, automations, and scripts designed to streamline the execution of **MLPerf benchmarks**—with a strong emphasis on **MLPerf Inference benchmarks**.
10
+
11
+
Starting **January 2025**, MLPerf automation scripts are built on the powerful [MLCFlow](https://github.com/mlcommons/mlcflow) automation interface. This modern interface replaces the earlier [Collective Mind (CM)](https://github.com/mlcommons/ck/tree/master/cm), offering a more robust and efficient framework for benchmarking workflows.
11
12
12
13
13
14
---
@@ -16,20 +17,18 @@ The automations build upon and extend the powerful [Collective Mind (CM) script
-**Modular and Extensible** – Easily extend the scripts to support additional benchmarks and configurations.
18
19
-**Seamless Integration** – Compatible with Docker, cloud environments, and local machines.
19
-
-**Collective Mind (CM) Integration** – Utilizes the CM framework to enhance reproducibility and automation.
20
+
-**MLCFlow (MLC) Integration** – Utilizes the MLC framework to enhance reproducibility and automation.
20
21
21
22
---
22
23
23
-
## 🧰 Collective Mind (CM) Automations
24
+
## 🧰 MLCFlow (MLC) Automations
24
25
25
-
The **Collective Mind (CM)** framework is a Python-based package offering both CLI and API support for creating and managing automations. CM automations enhance ML workflows by simplifying complex tasks such as Docker container management and caching.
26
+
Building on the foundation of its predecessor, the **Collective Mind (CM)** framework, MLCFlow takes ML workflows to the next level by streamlining complex tasks like Docker container management and caching. The `mlcflow` package, written in Python, provides seamless support through both a command-line interface (CLI) and an API, making it easy to access and manage automation scripts.
26
27
27
28
### Core Automations
28
29
-**Script Automation** – Automates script execution across different environments.
0 commit comments