Repositories list

• algorithmic-efficiency

  Public
  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvements in both training algorithms and models.

  Python

  •

  Apache License 2.0

  •73•389•29•6•Updated Aug 10, 2025Aug 10, 2025

• dynabench

  Public
  Python

  •

  MIT License

  •18•24•10•5•Updated Aug 9, 2025Aug 9, 2025

• mobile_app_open

  Public
  Mobile App Open

  C++

  •

  Apache License 2.0

  •29•59•38•3•Updated Aug 9, 2025Aug 9, 2025

• mlperf_inference_submissions

  Public template
  Shell

  •

  Apache License 2.0

  •7•0•0•1•Updated Aug 9, 2025Aug 9, 2025

• modelbench

  Public
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.

  Python

  •

  Apache License 2.0

  •24•100•395•6•Updated Aug 8, 2025Aug 8, 2025

• training

  Public
  Reference implementations of MLPerf™ training benchmarks

  benchmarkmachine-learning

  Python

  •

  Apache License 2.0

  •576•1.7k•4•3•Updated Aug 8, 2025Aug 8, 2025

• training_policies

  Public
  Issues related to MLPerf™ training policies, including rules and suggested changes

  Python

  •

  Apache License 2.0

  •67•95•110•1•Updated Aug 8, 2025Aug 8, 2025

• mlperf-automations

  Public
  This repository contains automation scripts designed to run MLPerf Inference benchmarks. Originally developed for the Collective Mind (CM) automation framework, these scripts have been adapted to leverage the MLC automation framework, maintained by the MLCommons Benchmark Infrastructure Working Group.

  automationmlperfmlperf-inference+ 2mlcflowmlperf-automations

  Python

  •

  Apache License 2.0

  •17•8•77•1•Updated Aug 7, 2025Aug 7, 2025

• mlperf_inference_test_submissions_v5.0

  Public
  Mermaid

  •5•0•0•0•Updated Aug 7, 2025Aug 7, 2025

• logging

  Public
  MLPerf™ logging library

  Python

  •

  Apache License 2.0

  •49•36•42•2•Updated Aug 7, 2025Aug 7, 2025

• inference

  Public
  Reference implementations of MLPerf™ inference benchmarks

  benchmarkmachine-learning

  Python

  •

  Apache License 2.0

  •571•1.4k•228•20•Updated Aug 7, 2025Aug 7, 2025

• croissant

  Public
  Croissant is a high-level format for machine learning datasets that brings together four rich layers.

  machine-learningschema-orgjson-ld+ 1datasets

  Jupyter Notebook

  •

  Apache License 2.0

  •78•682•161•32•Updated Aug 6, 2025Aug 6, 2025

• inference_results_visualization_template

  Public template
  JavaScript

  •

  Apache License 2.0

  •8•0•2•1•Updated Aug 5, 2025Aug 5, 2025

• modelplane

  Public
  Python

  •

  Apache License 2.0

  •0•0•9•0•Updated Aug 5, 2025Aug 5, 2025

• storage_results_v2.0

  Public
  This repository contains the results and code for the MLPerf™ Storage v2.0 benchmark.

  benchmarkmachine-learningai+ 2ai-benchmarkml-benchmark

  Python

  •

  Apache License 2.0

  •1•1•0•0•Updated Aug 4, 2025Aug 4, 2025

• mlperf_automotive_submissions

  Public template
  Shell

  •

  Apache License 2.0

  •0•0•0•0•Updated Aug 4, 2025Aug 4, 2025

• automotive_results_visualization_template

  Public template
  JavaScript

  •

  Apache License 2.0

  •0•0•1•0•Updated Aug 1, 2025Aug 1, 2025

• chakra

  Public
  Repository for MLCommons Chakra schema and tools

  Python

  •

  Apache License 2.0

  •55•117•40•8•Updated Aug 1, 2025Aug 1, 2025

• GaNDLF

  Public
  A generalizable application framework for segmentation, regression, and classification using PyTorch

  machine-learningframeworkdeep-learning+ 10regressionpytorchmedical-imagingclassificationsegmentationdata-augmentationbiomedical-image-processing+ 3

  Python

  •

  Apache License 2.0

  •89•183•7•1•Updated Aug 1, 2025Aug 1, 2025

• mlperf_automotive

  Public
  Python

  •

  Apache License 2.0

  •5•3•2•0•Updated Aug 1, 2025Aug 1, 2025

• tiny

  Public
  MLPerf™ Tiny is an ML benchmark suite for extremely low-power systems such as microcontrollers

  C

  •

  Apache License 2.0

  •102•423•14•8•Updated Jul 31, 2025Jul 31, 2025

• mlperf_client

  Public
  MLPerf Client is a benchmark for Windows and macOS, focusing on client form factors in ML inference scenarios.

  benchmarkingmachine-learningml

  C++

  •

  Apache License 2.0

  •2•43•2•0•Updated Jul 30, 2025Jul 30, 2025

• mlcflow

  Public
  MLCFlow: Simplifying MLPerf Automations

  automation-frameworkmlperfmlcflow+ 1mlperf-automations

  Python

  •

  Apache License 2.0

  •12•8•12•1•Updated Jul 30, 2025Jul 30, 2025

• policies

  Public
  General policies for MLPerf™ including submission rules, coding standards, etc.

  Python

  •

  Apache License 2.0

  •60•30•36•41•Updated Jul 29, 2025Jul 29, 2025

• inference_policies

  Public
  Issues related to MLPerf™ Inference policies, including rules and suggested changes

  Apache License 2.0

  •55•63•19•3•Updated Jul 29, 2025Jul 29, 2025

• inference_results_v4.1

  Public
  This repository contains the results and code for the MLPerf™ Inference v4.1 benchmark.

  benchmarkmachine-learning

  Python

  •

  Apache License 2.0

  •2•0•10•0•Updated Jul 24, 2025Jul 24, 2025

• inference_results_v4.0

  Public
  This repository contains the results and code for the MLPerf™ Inference v4.0 benchmark.

  C++

  •

  Apache License 2.0

  •17•10•5•5•Updated Jul 24, 2025Jul 24, 2025

• inference_results_v3.1

  Public
  This repository contains the results and code for the MLPerf™ Inference v3.1 benchmark.

  C++

  •

  Apache License 2.0

  •13•11•9•2•Updated Jul 24, 2025Jul 24, 2025

• inference_results_v3.0

  Public
  This repository contains the results and code for the MLPerf™ Inference v3.0 benchmark.

  C++

  •

  Apache License 2.0

  •15•19•11•3•Updated Jul 24, 2025Jul 24, 2025

• inference_results_v2.1

  Public
  This repository contains the results and code for the MLPerf™ Inference v2.1 benchmark.

  Python

  •

  Apache License 2.0

  •23•18•5•3•Updated Jul 24, 2025Jul 24, 2025