Skip to content

Commit 43a0456

Browse files
mlcommons-botmlcommons-bot
committed
Updated results summary [skip ci]
1 parent d89dec3 commit 43a0456

File tree

6 files changed

+22
-22
lines changed

6 files changed

+22
-22
lines changed

‎README.md

Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -1,21 +1,21 @@
11
Please download [summary.xlsx](summary.xlsx) to view the most recent results.
22
```
3-
[2025-07-18 11:36:03,198 submission_checker1.py:3483 INFO] Results=32, NoResults=0, Power Results=0
4-
[2025-07-18 11:36:03,198 submission_checker1.py:3490 INFO] ---
5-
[2025-07-18 11:36:03,198 submission_checker1.py:3491 INFO] Closed Results=0, Closed Power Results=0
3+
[2025-07-19 01:51:19,062 submission_checker1.py:3483 INFO] Results=32, NoResults=0, Power Results=0
4+
[2025-07-19 01:51:19,062 submission_checker1.py:3490 INFO] ---
5+
[2025-07-19 01:51:19,062 submission_checker1.py:3491 INFO] Closed Results=0, Closed Power Results=0
66
7-
[2025-07-18 11:36:03,198 submission_checker1.py:3496 INFO] Open Results=32, Open Power Results=0
7+
[2025-07-19 01:51:19,062 submission_checker1.py:3496 INFO] Open Results=32, Open Power Results=0
88
9-
[2025-07-18 11:36:03,198 submission_checker1.py:3501 INFO] Network Results=0, Network Power Results=0
9+
[2025-07-19 01:51:19,062 submission_checker1.py:3501 INFO] Network Results=0, Network Power Results=0
1010
11-
[2025-07-18 11:36:03,198 submission_checker1.py:3506 INFO] ---
12-
[2025-07-18 11:36:03,198 submission_checker1.py:3508 INFO] Systems=25, Power Systems=0
13-
[2025-07-18 11:36:03,198 submission_checker1.py:3512 INFO] Closed Systems=0, Closed Power Systems=0
14-
[2025-07-18 11:36:03,198 submission_checker1.py:3517 INFO] Open Systems=25, Open Power Systems=0
15-
[2025-07-18 11:36:03,198 submission_checker1.py:3522 INFO] Network Systems=0, Network Power Systems=0
16-
[2025-07-18 11:36:03,198 submission_checker1.py:3527 INFO] ---
17-
[2025-07-18 11:36:03,198 submission_checker1.py:3532 INFO] SUMMARY: submission looks OK
18-
[2025-07-18 11:36:04,265 module.py:5340 INFO] - ! call "postprocess" from /home/runner/MLC/repos/mlcommons@mlperf-automations/script/run-mlperf-inference-submission-checker/customize.py
11+
[2025-07-19 01:51:19,062 submission_checker1.py:3506 INFO] ---
12+
[2025-07-19 01:51:19,062 submission_checker1.py:3508 INFO] Systems=25, Power Systems=0
13+
[2025-07-19 01:51:19,062 submission_checker1.py:3512 INFO] Closed Systems=0, Closed Power Systems=0
14+
[2025-07-19 01:51:19,062 submission_checker1.py:3517 INFO] Open Systems=25, Open Power Systems=0
15+
[2025-07-19 01:51:19,062 submission_checker1.py:3522 INFO] Network Systems=0, Network Power Systems=0
16+
[2025-07-19 01:51:19,063 submission_checker1.py:3527 INFO] ---
17+
[2025-07-19 01:51:19,063 submission_checker1.py:3532 INFO] SUMMARY: submission looks OK
18+
[2025-07-19 01:51:20,152 module.py:5341 INFO] - ! call "postprocess" from /home/runner/MLC/repos/mlcommons@mlperf-automations/script/run-mlperf-inference-submission-checker/customize.py
1919
2020
```
2121

@@ -25,7 +25,7 @@ Please download [summary.xlsx](summary.xlsx) to view the most recent results.
2525
| 1 | MLCommons | available | open | edge | gh_ubuntu-latest x86 | gh_ubuntu-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config | resnet50 | resnet | Offline | 23.1621 | acc: 76.000 | 1 | AMD EPYC 7763 64-Core Processor | 1 | 2 | nan | 0 | open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config/resnet50/offline | onnxruntime v1.22.1 | Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
2626
| 2 | MLCommons | available | open | edge | gh_action | gh_action-reference-gpu-pytorch_v2.6.0-cu124 | stable-diffusion-xl | stable-diffusion-xl | Offline | 0.342746 | CLIP_SCORE: 16.368897303938866 FID_SCORE: 237.82578527053812 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/gh_action-reference-gpu-pytorch_v2.6.0-cu124/stable-diffusion-xl/offline | pytorch v2.6.0 | Ubuntu 22.04 (linux-6.8.0-52-generic-glibc2.35) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
2727
| 3 | MLCommons | available | open | edge | gh_ubuntu-latest x86 | gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config | retinanet | retinanet | Offline | 0.413064 | mAP: 76.951 | 1 | AMD EPYC 7763 64-Core Processor | 1 | 2 | nan | 0 | open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline | onnxruntime | Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
28-
| 4 | MLCommons | available | open | edge | gh_ubuntu-latest x86 | gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config | resnet50 | resnet | Offline | 23.2174 | acc: 76.000 | 1 | AMD EPYC 7763 64-Core Processor | 1 | 2 | nan | 0 | open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline | onnxruntime | Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
28+
| 4 | MLCommons | available | open | edge | gh_ubuntu-latest x86 | gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config | resnet50 | resnet | Offline | 23.2986 | acc: 76.000 | 1 | AMD EPYC 7763 64-Core Processor | 1 | 2 | nan | 0 | open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline | onnxruntime | Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
2929
| 5 | MLCommons | available | open | edge | gh_macos-latest x86 | gh_macos-latest_x86-reference-cpu-onnxruntime_v1.22.0-default_config | resnet50 | resnet | Offline | 15.9553 | acc: 76.000 | 1 | undefined | 1 | 3 | nan | 0 | open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.22.0-default_config/resnet50/offline | onnxruntime v1.22.0 | (darwin-23.6.0) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
3030
| 6 | MLCommons | available | open | edge | gh_macos-latest x86 | gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config | resnet50 | resnet | Offline | 9.22842 | acc: 76.000 | 1 | undefined | 1 | 3 | nan | 0 | open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline | onnxruntime | (darwin-23.6.0) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
3131
| 7 | MLCommons | available | open | edge | gh_ubuntu-latest x86 | gh_ubuntu-latest_x86-reference-cpu-tf_v2.18.0-default_config | resnet50 | resnet | Offline | 20.9828 | acc: 76.000 | 1 | AMD EPYC 7763 64-Core Processor | 1 | 2 | nan | 0 | open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-tf_v2.18.0-default_config/resnet50/offline | tf v2.18.0 | Ubuntu 24.04 (linux-6.8.0-1021-azure-glibc2.39) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
@@ -41,7 +41,7 @@ Please download [summary.xlsx](summary.xlsx) to view the most recent results.
4141
| 17 | MLCommons | available | open | edge | gh_ubuntu-latest_x86 | gh_ubuntu-latest_x86-reference-cpu-onnxruntime_v1.21.0-default_config | resnet50 | resnet | Offline | 23.2491 | acc: 76.000 | 1 | AMD EPYC 7763 64-Core Processor | 1 | 2 | nan | 0 | open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-onnxruntime_v1.21.0-default_config/resnet50/offline | onnxruntime v1.21.0 | Ubuntu 24.04 (linux-6.8.0-1021-azure-glibc2.39) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
4242
| 18 | MLCommons | available | open | datacenter | gh_ubuntu-latest_x86 | gh_ubuntu-latest_x86-reference-cpu-pytorch_v2.4.0-default_config | rgat | rgat | Offline | 10.1918 | acc: 76.000 | 1 | AMD EPYC 7763 64-Core Processor | 1 | 2 | nan | 0 | open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-pytorch_v2.4.0-default_config/rgat/offline | pytorch v2.4.0 | Ubuntu 24.04 (linux-6.8.0-1021-azure-glibc2.39) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
4343
| 19 | MLCommons | available | open | edge | gh_ubuntu-latest x86 | gh_ubuntu-latest_x86-reference-cpu-tf_v2.19.0-default_config | resnet50 | resnet | Offline | 21.0375 | acc: 76.000 | 1 | AMD EPYC 7763 64-Core Processor | 1 | 2 | nan | 0 | open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-tf_v2.19.0-default_config/resnet50/offline | tf v2.19.0 | Ubuntu 24.04 (linux-6.11.0-1018-azure-glibc2.39) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
44-
| 20 | MLCommons | available | open | edge | gh_macos-latest x86 | gh_macos-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config | resnet50 | resnet | Offline | 17.4471 | acc: 76.000 | 1 | undefined | 1 | 3 | nan | 0 | open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config/resnet50/offline | onnxruntime v1.22.1 | (darwin-23.6.0) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
44+
| 20 | MLCommons | available | open | edge | gh_macos-latest x86 | gh_macos-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config | resnet50 | resnet | Offline | 20.0789 | acc: 76.000 | 1 | undefined | 1 | 3 | nan | 0 | open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.22.1-default_config/resnet50/offline | onnxruntime v1.22.1 | (darwin-23.6.0) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
4545
| 21 | MLCommons | available | open | edge | gh_macos-latest x86 | gh_macos-latest_x86-reference-cpu-onnxruntime_v1.21.0-default_config | retinanet | retinanet | Offline | 0.384271 | mAP: 76.951 | 1 | undefined | 1 | 3 | nan | 0 | open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.21.0-default_config/retinanet/offline | onnxruntime v1.21.0 | (darwin-23.6.0) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
4646
| 22 | MLCommons | available | open | edge | gh_macos-latest x86 | gh_macos-latest_x86-reference-cpu-onnxruntime_v1.21.0-default_config | resnet50 | resnet | Offline | 19.7056 | acc: 76.000 | 1 | undefined | 1 | 3 | nan | 0 | open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.21.0-default_config/resnet50/offline | onnxruntime v1.21.0 | (darwin-23.6.0) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |
4747
| 23 | MLCommons | available | open | edge | gh_macos-latest x86 | gh_macos-latest_x86-reference-cpu-onnxruntime_v1.21.1-default_config | retinanet | retinanet | Offline | 0.290026 | mAP: 76.951 | 1 | undefined | 1 | 3 | nan | 0 | open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.21.1-default_config/retinanet/offline | onnxruntime v1.21.1 | (darwin-23.6.0) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp32 |

‎dbversion

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
1415
1+
1416

0 commit comments

Comments
 (0)