Skip to content

Commit 4dadb39

Browse files
mlcommons-botmlcommons-bot
committed
Results from R50 GH action on
1 parent 9aba3c7 commit 4dadb39

File tree

8 files changed

+179
-179
lines changed

8 files changed

+179
-179
lines changed

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
22
|-----------|------------|------------|--------------|-------------------|
3-
| retinanet | offline | 49.593 | 0.421 | - |
3+
| retinanet | offline | 49.593 | 0.423 | - |

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ pip install -U mlcflow
1717

1818
mlc rm cache -f
1919

20-
mlc pull repo GATEOverflow@mlperf-automations --checkout=75b3a24b7627069a84227de9efe5310f8377bb8b
20+
mlc pull repo GATEOverflow@mlperf-automations --checkout=d8ac2d52833ead3a77939904d23f747769c0b761
2121

2222

2323
```
@@ -41,4 +41,4 @@ Model Precision: fp32
4141
`mAP`: `49.593`, Required accuracy for closed division `>= 37.1745`
4242

4343
### Performance Results
44-
`Samples per second`: `0.421296`
44+
`Samples per second`: `0.422509`

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/accuracy_console.out

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
1-
User Conf path: /home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/3e3b3db0098d4464a166e09285bd9040.conf
2-
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_db5d5c74
3-
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_db5d5c74/annotations/openimages-mlperf.json
1+
User Conf path: /home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/fb436b86888c40caa76be326ad6a3715.conf
2+
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_a5bafa6e
3+
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_a5bafa6e/annotations/openimages-mlperf.json
44
Scenario: Offline
55
Mode: AccuracyOnly
66
Batch size: 1

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/os_info.json

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -26,8 +26,8 @@
2626
],
2727
"MLC_HOST_PLATFORM_FLAVOR": "x86_64",
2828
"MLC_HOST_PYTHON_BITS": "64",
29-
"MLC_HOST_SYSTEM_NAME": "pkrvmxyh4eaekms",
29+
"MLC_HOST_SYSTEM_NAME": "pkrvmbietmlfzoi",
3030
"+PATH": [
31-
"/home/runner/MLC/repos/local/cache/install-python-src_e1914449/install/bin"
31+
"/home/runner/MLC/repos/local/cache/install-python-src_cf72aa7f/install/bin"
3232
]
3333
}

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/performance_console.out

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
1-
User Conf path: /home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/a87a1a73725246158e03221a180d1635.conf
2-
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_db5d5c74
3-
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_db5d5c74/annotations/openimages-mlperf.json
1+
User Conf path: /home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/ed3fec99020c48828a001493734c2511.conf
2+
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_a5bafa6e
3+
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_a5bafa6e/annotations/openimages-mlperf.json
44
Scenario: Offline
55
Mode: PerformanceOnly
66
Batch size: 1

‎open/MLCommons/results/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/accuracy/mlperf_log_detail.txt

Lines changed: 70 additions & 70 deletions
Large diffs are not rendered by default.

‎open/MLCommons/results/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/performance/run_1/mlperf_log_detail.txt

Lines changed: 88 additions & 88 deletions
Large diffs are not rendered by default.

‎open/MLCommons/results/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/performance/run_1/mlperf_log_summary.txt

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ MLPerf Results Summary
44
SUT name : QueueSUT
55
Scenario : Offline
66
Mode : PerformanceOnly
7-
Samples per second: 0.421296
7+
Samples per second: 0.422509
88
Result is : VALID
99
Min duration satisfied : Yes
1010
Min queries satisfied : Yes
@@ -13,15 +13,15 @@ Result is : VALID
1313
================================================
1414
Additional Stats
1515
================================================
16-
Min latency (ns) : 2380579013
17-
Max latency (ns) : 23736274577
18-
Mean latency (ns) : 13072279956
19-
50.00 percentile latency (ns) : 14284805242
20-
90.00 percentile latency (ns) : 23736274577
21-
95.00 percentile latency (ns) : 23736274577
22-
97.00 percentile latency (ns) : 23736274577
23-
99.00 percentile latency (ns) : 23736274577
24-
99.90 percentile latency (ns) : 23736274577
16+
Min latency (ns) : 2374771971
17+
Max latency (ns) : 23668112882
18+
Mean latency (ns) : 13024419689
19+
50.00 percentile latency (ns) : 14209821452
20+
90.00 percentile latency (ns) : 23668112882
21+
95.00 percentile latency (ns) : 23668112882
22+
97.00 percentile latency (ns) : 23668112882
23+
99.00 percentile latency (ns) : 23668112882
24+
99.90 percentile latency (ns) : 23668112882
2525

2626
================================================
2727
Test Parameters Used

0 commit comments

Comments
 (0)