Skip to content

Commit a602f0a

Browse files
authored
Fix retinanet github action (#108), added dev timeline
* Fix retinanet github action
1 parent 89fe114 commit a602f0a

File tree

3 files changed

+83
-3
lines changed

3 files changed

+83
-3
lines changed

.github/workflows/test-mlperf-inference-resnet50.yml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,4 @@
1+
# Run MLPerf inference ResNet50
12
name: MLPerf inference ResNet50
23

34
on:
@@ -36,6 +37,7 @@ jobs:
3637
if: matrix.os == 'windows-latest'
3738
run: |
3839
git config --system core.longpaths true
40+
3941
- name: Install cm4mlops on Windows
4042
if: matrix.os == 'windows-latest'
4143
run: |
@@ -44,6 +46,7 @@ jobs:
4446
if: matrix.os != 'windows-latest'
4547
run: |
4648
CM_PULL_DEFAULT_MLOPS_REPO=no pip install cm4mlops
49+
4750
- name: Pull MLOps repo
4851
cm pull repo --url=${{ github.event.pull_request.head.repo.html_url }} --checkout=${{ github.event.pull_request.head.ref }}
4952
- name: Test MLPerf Inference ResNet50 (Windows)

.github/workflows/test-mlperf-inference-retinanet.yml

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,4 @@
1-
# This workflow will install Python dependencies, run tests and lint with a variety of Python versions
2-
# For more information see: https://help.github.com/actions/language-and-framework-guides/using-python-with-github-actions
1+
# Run MLPerf inference Retinanet
32

43
name: MLPerf inference retinanet
54

@@ -39,9 +38,15 @@ jobs:
3938
if: matrix.os == 'windows-latest'
4039
run: |
4140
git config --system core.longpaths true
42-
- name: Install dependencies
41+
- name: Install cm4mlops on Windows
42+
if: matrix.os == 'windows-latest'
43+
run: |
44+
$env:CM_PULL_DEFAULT_MLOPS_REPO = "no"; pip install cm4mlops
45+
- name: Install dependencies on Unix Platforms
46+
if: matrix.os != 'windows-latest'
4347
run: |
4448
CM_PULL_DEFAULT_MLOPS_REPO=no pip install cm4mlops
49+
- name: Pull MLOps repo
4550
cm pull repo --url=${{ github.event.pull_request.head.repo.html_url }} --checkout=${{ github.event.pull_request.head.ref }}
4651
- name: Test MLPerf Inference Retinanet using ${{ matrix.backend }} on ${{ matrix.os }}
4752
if: matrix.os == 'windows-latest'

HISTORY.md

Lines changed: 72 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,72 @@
1+
## Timeline of CM developments
2+
3+
### **🚀 2022: Foundation and Early Developments**
4+
5+
- **March 2022:** Grigori Fursin began developing **CM (Collective Mind)**, also referred to as **CK2**, as a successor to CK [at OctoML](https://github.com/octoml/ck/commits/master/?since=2022-03-01&until=2022-03-31).
6+
- **April 2022:** **Arjun Suresh** joined OctoML and collaborated with Grigori on developing **CM Automation** tools.
7+
- **May 2022:** The **CM CLI** and **Python interface** were successfully [implemented and stabilized](https://github.com/octoml/ck/commits/master/?since=2022-04-01&until=2022-05-31) by Grigori.
8+
9+
---
10+
11+
### **🛠️ July–September 2022: MLPerf Integration and First Submission**
12+
13+
- Arjun completed the development of the **MLPerf Inference Script** within CM.
14+
- OctoML achieved **first MLPerf Inference submission (v2.1)** using **CM Automation** ([progress here](https://github.com/octoml/ck/commits/master/?since=2022-06-01&until=2022-09-30)).
15+
16+
---
17+
18+
### **📊 October 2022 – March 2023: End-to-End Automation**
19+
20+
- End-to-end MLPerf inference automations using CM was successfully [completed in CM](https://github.com/octoml/ck/commits/master/?since=2022-10-01&until=2023-03-31).
21+
- **Additional benchmarks** and **Power Measurement support** were integrated into CM.
22+
- **cTuning** achieved a successful MLPerf Inference **v3.0 submission** using CM Automation.
23+
24+
---
25+
26+
### **🔄 April 2023: Transition and New Funding**
27+
28+
- Arjun and Grigori departed OctoML and resumed **CM development** under funding from **cKnowledge.org** and **cTuning**.
29+
30+
---
31+
32+
### **🚀 April–October 2023: Expanded Support and Milestone Submission**
33+
34+
- MLPerf inference automations were [extended](https://github.com/mlcommons/ck/commits/master?since=2023-04-01&until=2023-10-31) to support **NVIDIA implementations**.
35+
- **cTuning** achieved the **largest-ever MLPerf Inference submission (v3.1)** using CM Automation.
36+
37+
---
38+
39+
### **🤝 November 2023: MLCommons Partnership**
40+
41+
- **MLCommons** began funding CM development to enhance support for **NVIDIA MLPerf inference** and introduce support for **Intel** and **Qualcomm MLPerf inference** implementations.
42+
43+
---
44+
45+
### **🌐 October 2023 – March 2024: Multi-Platform Expansion**
46+
47+
- MLPerf inference automations were [expanded](https://github.com/mlcommons/ck/commits/master?since=2023-10-01&until=2024-03-15) to support **NVIDIA, Intel, and Qualcomm implementations**.
48+
- **cTuning** completed the **MLPerf Inference v4.0 submission** using CM Automation.
49+
50+
---
51+
52+
### **📝 April 2024: Documentation Improvements**
53+
54+
- MLCommons contracted **Arjun Suresh** via **GATEOverflow** to improve **MLPerf inference documentation** and enhance CM Automation on various platforms.
55+
56+
---
57+
58+
### **👥 May 2024: Team Expansion**
59+
60+
- **Anandhu Sooraj** joined MLCommons to collaborate with **Arjun Suresh** on CM development.
61+
62+
---
63+
64+
### **📖 June–December 2024: Enhanced Documentation and Automation**
65+
66+
- **Dedicated documentation site** launched for **MLPerf inference**.
67+
- **CM scripts** were developed for **MLPerf Automotive**.
68+
- **CM Docker support** was stabilized.
69+
- **GitHub Actions workflows** were added for **MLPerf inference reference implementations** and **NVIDIA integrations** ([see updates](https://github.com/mlcommons/mlperf-automations/commits/main?since=2024-06-01&until=2024-12-31)).
70+
71+
---
72+

0 commit comments

Comments
 (0)