Search results

BaaS: test codegen for python SDK

Status: Open.

#1358 In mlcommons/modelbench;

· rogthefrog opened on Oct 20, 2025

Fix caching

Status: Open.

#1356 In mlcommons/modelbench;

· superdosh opened on Oct 16, 2025

OpenAPI server for BaaS - first pancake

Status: Open.

#1354 In mlcommons/modelbench;

· rogthefrog opened on Oct 16, 2025

Accurately report # errors in consistency check repoort

choreShould do it, but it doesn't directly create valueShould do it, but it doesn't directly create value

Status: Open.

#1353 In mlcommons/modelbench;

· bkorycki opened on Oct 15, 2025

Don't use "official" for prompt sets

choreShould do it, but it doesn't directly create valueShould do it, but it doesn't directly create value

Status: Open.

#1351 In mlcommons/modelbench;

· superdosh opened on Oct 15, 2025

Improve documentation for people creating SUTs

Status: Open.

#1349 In mlcommons/modelbench;

· rogthefrog opened on Oct 14, 2025

Handle invalid annotations

Status: Open.

#1348 In mlcommons/modelbench;

· bkorycki opened on Oct 14, 2025

Remove broken model

choreShould do it, but it doesn't directly create valueShould do it, but it doesn't directly create value

Status: Open.

#1346 In mlcommons/modelbench;

· rogthefrog opened on Oct 14, 2025

Remove AnnotatorSet / EnsembleAnnotatorSet

choreShould do it, but it doesn't directly create valueShould do it, but it doesn't directly create value

Status: Open.

#1340 In mlcommons/modelbench;

· superdosh opened on Oct 9, 2025

PLACEHOLDER: public-facing API for BaaS

Status: Open.

#1339 In mlcommons/modelbench;

· rogthefrog opened on Oct 9, 2025

Update modelbench so v1.1 is used with the benchmark cli

Status: Open.

#1337 In mlcommons/modelbench;

· superdosh opened on Oct 8, 2025

prototype prototype

Status: Open.

#1331 In mlcommons/modelbench;

· wpietri opened on Oct 2, 2025