Skip to content

Commit f436fcf

Browse files
mlcommons-botmlcommons-bot
committed
Results from R50 GH action on
1 parent 974e6bc commit f436fcf

File tree

13 files changed

+223
-254
lines changed

13 files changed

+223
-254
lines changed

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
22
|-----------|------------|------------|--------------|-------------------|
3-
| retinanet | offline | 49.593 | 0.42 | - |
3+
| retinanet | offline | 49.593 | 0.421 | - |

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/README.md

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,9 +2,10 @@
22

33
## Host platform
44

5-
* OS version: Linux-6.11.0-1015-azure-x86_64-with-glibc2.39
5+
* OS version: Linux-6.11.0-1015-azure-x86_64-with-glibc2.34
66
* CPU version: x86_64
7-
* Python version: 3.12.11 (main, Jun 4 2025, 04:14:08) [GCC 13.3.0]
7+
* Python version: 3.8.18 (default, Dec 12 2024, 19:15:30)
8+
[GCC 13.2.0]
89
* MLC version: unknown
910

1011
## CM Run Command
@@ -16,7 +17,7 @@ pip install -U mlcflow
1617

1718
mlc rm cache -f
1819

19-
mlc pull repo GATEOverflow@mlperf-automations --checkout=76268ea998fabd3788a85fb8923c96d0fa19b999
20+
mlc pull repo GATEOverflow@mlperf-automations --checkout=0a367d22f505bc9a8914eb5fd32c15603e92be6a
2021

2122

2223
```
@@ -40,4 +41,4 @@ Model Precision: fp32
4041
`mAP`: `49.593`, Required accuracy for closed division `>= 37.1745`
4142

4243
### Performance Results
43-
`Samples per second`: `0.420001`
44+
`Samples per second`: `0.420662`

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/accuracy_console.out

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
1-
User Conf path: /home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/8eed6fe3dfb74b9eadefb6bd80901d62.conf
2-
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_a33b2e86
3-
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_a33b2e86/annotations/openimages-mlperf.json
1+
User Conf path: /home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/25ad1a25e41d479ebb91f7327934501a.conf
2+
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_4ee943df
3+
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_4ee943df/annotations/openimages-mlperf.json
44
Scenario: Offline
55
Mode: AccuracyOnly
66
Batch size: 1

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/mlc-deps.mmd

Lines changed: 16 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -1,17 +1,14 @@
11
graph TD
2-
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline_) --> detect,os
3-
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline_) --> get,sys-utils-cm
4-
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline_) --> get,python
5-
get-mlperf-inference-src,4b57186581024797 --> detect,os
6-
get-mlperf-inference-src,4b57186581024797 --> get,python3
7-
get-mlperf-inference-src,4b57186581024797 --> get,git,repo,_branch.master,_repo.https://github.com/mlcommons/inference
8-
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline_) --> get,mlcommons,inference,src
2+
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline_) --> detect,os
3+
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline_) --> get,sys-utils-cm
4+
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline_) --> get,python
5+
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline_) --> get,mlcommons,inference,src
96
get-mlperf-inference-utils,e341e5f86d8342e5 --> get,mlperf,inference,src
10-
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline_) --> get,mlperf,inference,utils
11-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_cpu,_retinanet,_offline_) --> detect,os
7+
app-mlperf-inference,d775cac873ee4231_(_cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline_) --> get,mlperf,inference,utils
8+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_onnxruntime,_offline_) --> detect,os
129
detect-cpu,586c8a43320142f7 --> detect,os
13-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_cpu,_retinanet,_offline_) --> detect,cpu
14-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_cpu,_retinanet,_offline_) --> get,sys-utils-cm
10+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_onnxruntime,_offline_) --> detect,cpu
11+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_onnxruntime,_offline_) --> get,sys-utils-cm
1512
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> detect,os
1613
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> get,python3
1714
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> get,mlcommons,inference,src
@@ -43,27 +40,27 @@ graph TD
4340
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
4441
get-generic-python-lib,94b62a682bc44791_(_package.setuptools_) --> get,generic-python-lib,_pip
4542
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> get,generic-python-lib,_package.setuptools
46-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_cpu,_retinanet,_offline_) --> get,loadgen,_wg-inference
47-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_cpu,_retinanet,_offline_) --> get,mlcommons,inference,src
48-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_cpu,_retinanet,_offline_) --> get,lib,onnxruntime,lang-cpp,_cpu
49-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_cpu,_retinanet,_offline_) --> get,dataset,preprocessed,openimages,_validation,_NCHW,_50
50-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_cpu,_retinanet,_offline_) --> get,ml-model,retinanet,_onnx,_fp32
43+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_onnxruntime,_offline_) --> get,loadgen,_wg-inference
44+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_onnxruntime,_offline_) --> get,mlcommons,inference,src
45+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_onnxruntime,_offline_) --> get,lib,onnxruntime,lang-cpp,_cpu
46+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_onnxruntime,_offline_) --> get,dataset,preprocessed,openimages,_validation,_NCHW,_50
47+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_onnxruntime,_offline_) --> get,ml-model,retinanet,_onnx,_fp32
5148
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> detect,os
5249
detect-cpu,586c8a43320142f7 --> detect,os
5350
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> detect,cpu
5451
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> get,python
5552
get-mlperf-inference-sut-configs,c2fbf72009e2445b --> get,cache,dir,_name.mlperf-inference-sut-configs
5653
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> get,sut,configs
5754
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> get,mlcommons,inference,src
58-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_cpu,_retinanet,_offline_) --> generate,user-conf,mlperf,inference,_wg-inference
55+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_onnxruntime,_offline_) --> generate,user-conf,mlperf,inference,_wg-inference
5956
detect-cpu,586c8a43320142f7 --> detect,os
6057
compile-program,c05042ba005a4bfa --> detect,cpu
6158
compile-program,c05042ba005a4bfa --> get,compiler,gcc
6259
detect-cpu,586c8a43320142f7 --> detect,os
6360
get-compiler-flags,31be8b74a69742f8 --> detect,cpu
6461
compile-program,c05042ba005a4bfa --> get,compiler-flags
65-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_cpu,_retinanet,_offline_) --> compile,cpp-program
62+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_onnxruntime,_offline_) --> compile,cpp-program
6663
detect-cpu,586c8a43320142f7 --> detect,os
6764
benchmark-program,19f369ef47084895 --> detect,cpu
6865
benchmark-program-mlperf,cfff0132a8aa4018 --> benchmark-program,program
69-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_onnxruntime,_cpu,_retinanet,_offline_) --> benchmark-mlperf
66+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_retinanet,_cpu,_onnxruntime,_offline_) --> benchmark-mlperf

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/mlc-deps.png

-26 KB
Loading

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/mlc-version-info.json

Lines changed: 22 additions & 52 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,13 @@
11
{
2-
"app-mlperf-inference,d775cac873ee4231:cpp,retinanet,onnxruntime,cpu,test,r5.0-dev_default,offline": [
2+
"app-mlperf-inference,d775cac873ee4231:cpp,retinanet,onnxruntime,cpu,test,r5.1-dev_default,offline": [
33
{
44
"detect,os": {
55
"script_uid": "863735b7db8c44fc",
66
"script_alias": "detect-os",
77
"script_tags": "detect-os,detect,os,info",
88
"script_variations": "",
99
"version": "",
10-
"parent": "app-mlperf-inference,d775cac873ee4231 ( cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline )"
10+
"parent": "app-mlperf-inference,d775cac873ee4231 ( cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline )"
1111
}
1212
},
1313
{
@@ -17,7 +17,7 @@
1717
"script_tags": "get,sys-utils-cm,sys-utils-mlc",
1818
"script_variations": "",
1919
"version": "",
20-
"parent": "app-mlperf-inference,d775cac873ee4231 ( cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline )"
20+
"parent": "app-mlperf-inference,d775cac873ee4231 ( cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline )"
2121
}
2222
},
2323
{
@@ -27,37 +27,7 @@
2727
"script_tags": "get,python,python3,get-python,get-python3",
2828
"script_variations": "",
2929
"version": "3.10.8",
30-
"parent": "app-mlperf-inference,d775cac873ee4231 ( cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline )"
31-
}
32-
},
33-
{
34-
"detect,os": {
35-
"script_uid": "863735b7db8c44fc",
36-
"script_alias": "detect-os",
37-
"script_tags": "detect-os,detect,os,info",
38-
"script_variations": "",
39-
"version": "",
40-
"parent": "get-mlperf-inference-src,4b57186581024797"
41-
}
42-
},
43-
{
44-
"get,python3": {
45-
"script_uid": "d0b5dd74373f4a62",
46-
"script_alias": "get-python3",
47-
"script_tags": "get,python,python3,get-python,get-python3",
48-
"script_variations": "",
49-
"version": "3.10.8",
50-
"parent": "get-mlperf-inference-src,4b57186581024797"
51-
}
52-
},
53-
{
54-
"get,git,repo,_branch.master,_repo.https://github.com/mlcommons/inference": {
55-
"script_uid": "ed603e7292974f10",
56-
"script_alias": "get-git-repo",
57-
"script_tags": "get,git,repo,repository,clone",
58-
"script_variations": "branch.master,repo.https://github.com/mlcommons/inference",
59-
"version": "",
60-
"parent": "get-mlperf-inference-src,4b57186581024797"
30+
"parent": "app-mlperf-inference,d775cac873ee4231 ( cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline )"
6131
}
6232
},
6333
{
@@ -66,8 +36,8 @@
6636
"script_alias": "get-mlperf-inference-src",
6737
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
6838
"script_variations": "",
69-
"version": "r5.0-git-e9830361b6aea32fbd0b7b909ee3e32088f45828",
70-
"parent": "app-mlperf-inference,d775cac873ee4231 ( cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline )"
39+
"version": "master-git-0a3570efb0309b5581f2831d84c05fe5483b5ef7",
40+
"parent": "app-mlperf-inference,d775cac873ee4231 ( cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline )"
7141
}
7242
},
7343
{
@@ -76,7 +46,7 @@
7646
"script_alias": "get-mlperf-inference-src",
7747
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
7848
"script_variations": "",
79-
"version": "r5.0-git-e9830361b6aea32fbd0b7b909ee3e32088f45828",
49+
"version": "master-git-0a3570efb0309b5581f2831d84c05fe5483b5ef7",
8050
"parent": "get-mlperf-inference-utils,e341e5f86d8342e5"
8151
}
8252
},
@@ -87,7 +57,7 @@
8757
"script_tags": "get,mlperf,inference,util,utils,functions",
8858
"script_variations": "",
8959
"version": "",
90-
"parent": "app-mlperf-inference,d775cac873ee4231 ( cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.0-dev_default,_offline )"
60+
"parent": "app-mlperf-inference,d775cac873ee4231 ( cpp,_retinanet,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline )"
9161
}
9262
},
9363
{
@@ -97,7 +67,7 @@
9767
"script_tags": "detect-os,detect,os,info",
9868
"script_variations": "",
9969
"version": "",
100-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_cpu,_retinanet,_offline )"
70+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_onnxruntime,_offline )"
10171
}
10272
},
10373
{
@@ -117,7 +87,7 @@
11787
"script_tags": "detect,cpu,detect-cpu,info",
11888
"script_variations": "",
11989
"version": "",
120-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_cpu,_retinanet,_offline )"
90+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_onnxruntime,_offline )"
12191
}
12292
},
12393
{
@@ -127,7 +97,7 @@
12797
"script_tags": "get,sys-utils-cm,sys-utils-mlc",
12898
"script_variations": "",
12999
"version": "",
130-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_cpu,_retinanet,_offline )"
100+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_onnxruntime,_offline )"
131101
}
132102
},
133103
{
@@ -156,7 +126,7 @@
156126
"script_alias": "get-mlperf-inference-src",
157127
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
158128
"script_variations": "",
159-
"version": "master-git-e9830361b6aea32fbd0b7b909ee3e32088f45828",
129+
"version": "master-git-0a3570efb0309b5581f2831d84c05fe5483b5ef7",
160130
"parent": "get-mlperf-inference-loadgen,64c3d98d0ba04950 ( wg-inference )"
161131
}
162132
},
@@ -447,7 +417,7 @@
447417
"script_tags": "get,loadgen,inference,inference-loadgen,mlperf,mlcommons",
448418
"script_variations": "wg-inference",
449419
"version": "master",
450-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_cpu,_retinanet,_offline )"
420+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_onnxruntime,_offline )"
451421
}
452422
},
453423
{
@@ -456,8 +426,8 @@
456426
"script_alias": "get-mlperf-inference-src",
457427
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
458428
"script_variations": "",
459-
"version": "r5.0-git-e9830361b6aea32fbd0b7b909ee3e32088f45828",
460-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_cpu,_retinanet,_offline )"
429+
"version": "master-git-0a3570efb0309b5581f2831d84c05fe5483b5ef7",
430+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_onnxruntime,_offline )"
461431
}
462432
},
463433
{
@@ -467,7 +437,7 @@
467437
"script_tags": "install,onnxruntime,get,prebuilt,lib,lang-c,lang-cpp",
468438
"script_variations": "cpu",
469439
"version": "",
470-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_cpu,_retinanet,_offline )"
440+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_onnxruntime,_offline )"
471441
}
472442
},
473443
{
@@ -477,7 +447,7 @@
477447
"script_tags": "get,dataset,openimages,open-images,object-detection,preprocessed",
478448
"script_variations": "validation,NCHW,50",
479449
"version": "",
480-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_cpu,_retinanet,_offline )"
450+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_onnxruntime,_offline )"
481451
}
482452
},
483453
{
@@ -487,7 +457,7 @@
487457
"script_tags": "get,ml-model,raw,resnext50,retinanet,object-detection",
488458
"script_variations": "onnx,fp32",
489459
"version": "",
490-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_cpu,_retinanet,_offline )"
460+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_onnxruntime,_offline )"
491461
}
492462
},
493463
{
@@ -556,7 +526,7 @@
556526
"script_alias": "get-mlperf-inference-src",
557527
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
558528
"script_variations": "",
559-
"version": "r5.0-git-e9830361b6aea32fbd0b7b909ee3e32088f45828",
529+
"version": "master-git-0a3570efb0309b5581f2831d84c05fe5483b5ef7",
560530
"parent": "generate-mlperf-inference-user-conf,3af4475745964b93 ( wg-inference )"
561531
}
562532
},
@@ -567,7 +537,7 @@
567537
"script_tags": "generate,mlperf,inference,user-conf,inference-user-conf",
568538
"script_variations": "wg-inference",
569539
"version": "",
570-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_cpu,_retinanet,_offline )"
540+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_onnxruntime,_offline )"
571541
}
572542
},
573543
{
@@ -637,7 +607,7 @@
637607
"script_tags": "compile,program,c-program,cpp-program,compile-program,compile-c-program,compile-cpp-program",
638608
"script_variations": "",
639609
"version": "",
640-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_cpu,_retinanet,_offline )"
610+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_onnxruntime,_offline )"
641611
}
642612
},
643613
{
@@ -677,7 +647,7 @@
677647
"script_tags": "mlperf,benchmark-mlperf",
678648
"script_variations": "",
679649
"version": "",
680-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( onnxruntime,_cpu,_retinanet,_offline )"
650+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( retinanet,_cpu,_onnxruntime,_offline )"
681651
}
682652
}
683653
]

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/os_info.json

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -26,8 +26,8 @@
2626
],
2727
"MLC_HOST_PLATFORM_FLAVOR": "x86_64",
2828
"MLC_HOST_PYTHON_BITS": "64",
29-
"MLC_HOST_SYSTEM_NAME": "fv-az1796-196",
29+
"MLC_HOST_SYSTEM_NAME": "pkrvmbietmlfzoi",
3030
"+PATH": [
31-
"/home/runner/MLC/repos/local/cache/install-python-src_92880d2a/install/bin"
31+
"/home/runner/MLC/repos/local/cache/install-python-src_e790baa1/install/bin"
3232
]
3333
}

‎open/MLCommons/measurements/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/performance_console.out

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
1-
User Conf path: /home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/e9f1bdaafcba4b1ba6904e23508bedfd.conf
2-
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_a33b2e86
3-
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_a33b2e86/annotations/openimages-mlperf.json
1+
User Conf path: /home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/53da0fdfe1624494b66308a7db98d2b3.conf
2+
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_4ee943df
3+
Dataset List filepath: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-openimages_4ee943df/annotations/openimages-mlperf.json
44
Scenario: Offline
55
Mode: PerformanceOnly
66
Batch size: 1

‎open/MLCommons/results/default-mlcommons_cpp-cpu-onnxruntime-default_config/retinanet/offline/accuracy/accuracy.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,4 +29,4 @@ found 10 images
2929
found 0 images with no results
3030
ignored 0 dupes
3131

32-
hash=cb1bf65db8a0d1283a6d4c822731317398434e1c568147840ce8ee40a5a3823b
32+
hash=d1435174746e17d3cf13667d584ce152919eb2153560d2140ec8c218556eb8ea

0 commit comments

Comments
 (0)