Skip to content

Commit bfd8017

Browse files
mlcommons-botmlcommons-bot
committed
Results from R50 GH action on ubuntu-latest
1 parent d153f99 commit bfd8017

File tree

11 files changed

+215
-215
lines changed

11 files changed

+215
-215
lines changed

‎open/MLCommons/measurements/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
22
|----------|------------|------------|--------------|-------------------|
3-
| resnet50 | offline | 76 | 23.217 | - |
3+
| resnet50 | offline | 76 | 23.299 | - |

‎open/MLCommons/measurements/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/README.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -16,16 +16,16 @@ pip install -U mlcflow
1616

1717
mlc rm cache -f
1818

19-
mlc pull repo anandhu-eng@mlperf-automations --checkout=5fbcdbd5af2c8c4ce433ad20b14a0ace02f8f3f0
19+
mlc pull repo GATEOverflow@mlperf-automations --checkout=e7defdfb367d533e27b79f88790dae5be5d37e98
2020

2121

2222
```
2323
*Note that if you want to use the [latest automation recipes](https://docs.mlcommons.org/inference) for MLPerf,
24-
you should simply reload anandhu-eng@mlperf-automations without checkout and clean MLC cache as follows:*
24+
you should simply reload GATEOverflow@mlperf-automations without checkout and clean MLC cache as follows:*
2525

2626
```bash
27-
mlc rm repo anandhu-eng@mlperf-automations
28-
mlc pull repo anandhu-eng@mlperf-automations
27+
mlc rm repo GATEOverflow@mlperf-automations
28+
mlc pull repo GATEOverflow@mlperf-automations
2929
mlc rm cache -f
3030

3131
```
@@ -40,4 +40,4 @@ Model Precision: fp32
4040
`acc`: `76.0`, Required accuracy for closed division `>= 75.6954`
4141

4242
### Performance Results
43-
`Samples per second`: `23.2174`
43+
`Samples per second`: `23.2986`

‎open/MLCommons/measurements/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/accuracy_console.out

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
1-
User Conf path: /home/runner/MLC/repos/anandhu-eng@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/7821b31847064836abb4f03a9e9cd931.conf
2-
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_b479f4a9
1+
User Conf path: /home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/8b0dbbbabda2440785ebb8e041f0ae73.conf
2+
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0c448fa7
33
Dataset List filepath:
44
Scenario: Offline
55
Mode: AccuracyOnly

‎open/MLCommons/measurements/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/mlc-deps.mmd

Lines changed: 14 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -9,13 +9,13 @@ graph TD
99
app-mlperf-inference,d775cac873ee4231_(_cpp,_resnet50,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline_) --> get,mlperf,inference,utils
1010
download-file,9cdc8dc41aae437e_(_wget,_url.https://armi.in/files/caffe_ilsvrc12.tar.gz_) --> detect,os
1111
download-and-extract,c67e81a4ce2649f5_(_extract,_wget,_url.https://armi.in/files/caffe_ilsvrc12.tar.gz_) --> download,file,_wget,_url.https://armi.in/files/caffe_ilsvrc12.tar.gz
12-
extract-file,3f0b76219d004817_(_keep,_path./home/runner/MLC/repos/local/cache/download-file_imagenet-aux-da_b4d0a448/caffe_ilsvrc12.tar.gz_) --> detect,os
13-
download-and-extract,c67e81a4ce2649f5_(_extract,_wget,_url.https://armi.in/files/caffe_ilsvrc12.tar.gz_) --> extract,file,_keep,_path./home/runner/MLC/repos/local/cache/download-file_imagenet-aux-da_b4d0a448/caffe_ilsvrc12.tar.gz
12+
extract-file,3f0b76219d004817_(_keep,_path./home/runner/MLC/repos/local/cache/download-file_imagenet-aux-da_bbc183f4/caffe_ilsvrc12.tar.gz_) --> detect,os
13+
download-and-extract,c67e81a4ce2649f5_(_extract,_wget,_url.https://armi.in/files/caffe_ilsvrc12.tar.gz_) --> extract,file,_keep,_path./home/runner/MLC/repos/local/cache/download-file_imagenet-aux-da_bbc183f4/caffe_ilsvrc12.tar.gz
1414
get-dataset-imagenet-aux,bb2c6dd8c8c64217 --> download-and-extract,_extract,_wget,_url.https://armi.in/files/caffe_ilsvrc12.tar.gz
1515
app-mlperf-inference,d775cac873ee4231_(_cpp,_resnet50,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline_) --> get,dataset-aux,imagenet-aux
16-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_resnet50,_cpu,_offline,_onnxruntime_) --> detect,os
16+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_cpu,_resnet50,_offline,_onnxruntime_) --> detect,os
1717
detect-cpu,586c8a43320142f7 --> detect,os
18-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_resnet50,_cpu,_offline,_onnxruntime_) --> detect,cpu
18+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_cpu,_resnet50,_offline,_onnxruntime_) --> detect,cpu
1919
get-sys-utils-cm,bc90993277e84b8e --> detect,os
2020
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> detect,os
2121
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> get,python3
@@ -50,16 +50,16 @@ graph TD
5050
get-generic-python-lib,94b62a682bc44791_(_pip_) --> get,python3
5151
get-generic-python-lib,94b62a682bc44791_(_package.setuptools_) --> get,generic-python-lib,_pip
5252
get-mlperf-inference-loadgen,64c3d98d0ba04950_(_wg-inference_) --> get,generic-python-lib,_package.setuptools
53-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_resnet50,_cpu,_offline,_onnxruntime_) --> get,loadgen,_wg-inference
54-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_resnet50,_cpu,_offline,_onnxruntime_) --> get,mlcommons,inference,src
53+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_cpu,_resnet50,_offline,_onnxruntime_) --> get,loadgen,_wg-inference
54+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_cpu,_resnet50,_offline,_onnxruntime_) --> get,mlcommons,inference,src
5555
get-onnxruntime-prebuilt,be02c84ff57c4244_(_cpu_) --> detect,os
56-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_resnet50,_cpu,_offline,_onnxruntime_) --> get,lib,onnxruntime,lang-cpp,_cpu
56+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_cpu,_resnet50,_offline,_onnxruntime_) --> get,lib,onnxruntime,lang-cpp,_cpu
5757
get-preprocessed-dataset-imagenet,f259d490bbaf45f5_(_NCHW_) --> get,python3
5858
get-dataset-imagenet-val,7afd58d287fe4f11_(_size.500,_2012_) --> detect,os
5959
download-file,9cdc8dc41aae437e_(_cmutil,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar_) --> detect,os
6060
download-and-extract,c67e81a4ce2649f5_(_extract,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar_) --> download,file,_cmutil,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar
61-
extract-file,3f0b76219d004817_(_keep,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_b9eab151/ILSVRC2012_img_val_500.tar_) --> detect,os
62-
download-and-extract,c67e81a4ce2649f5_(_extract,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar_) --> extract,file,_keep,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_b9eab151/ILSVRC2012_img_val_500.tar
61+
extract-file,3f0b76219d004817_(_keep,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_6415a22c/ILSVRC2012_img_val_500.tar_) --> detect,os
62+
download-and-extract,c67e81a4ce2649f5_(_extract,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar_) --> extract,file,_keep,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_6415a22c/ILSVRC2012_img_val_500.tar
6363
get-dataset-imagenet-val,7afd58d287fe4f11_(_size.500,_2012_) --> download-and-extract,file,_extract,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar
6464
get-preprocessed-dataset-imagenet,f259d490bbaf45f5_(_NCHW_) --> get,dataset,image-classification,original,_size.500,_2012
6565
get-preprocessed-dataset-imagenet,f259d490bbaf45f5_(_NCHW_) --> get,dataset-aux,image-classification,imagenet-aux
@@ -82,27 +82,27 @@ graph TD
8282
get-generic-sys-util,bb0393afa8404a11_(_install,_libgl_) --> detect,os
8383
get-generic-sys-util,bb0393afa8404a11_(_libgl_) --> get,generic-sys-util,_install,_libgl
8484
get-preprocessed-dataset-imagenet,f259d490bbaf45f5_(_NCHW_) --> get,generic-sys-util,_libgl
85-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_resnet50,_cpu,_offline,_onnxruntime_) --> get,dataset,preprocessed,imagenet,_NCHW
85+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_cpu,_resnet50,_offline,_onnxruntime_) --> get,dataset,preprocessed,imagenet,_NCHW
8686
download-file,9cdc8dc41aae437e_(_cmutil,_url.https://armi.in/files/resnet50_v1_op11/resnet50_v1.onnx_) --> detect,os
8787
download-and-extract,c67e81a4ce2649f5_(_url.https://armi.in/files/resnet50_v1_op11/resnet50_v1.onnx_) --> download,file,_cmutil,_url.https://armi.in/files/resnet50_v1_op11/resnet50_v1.onnx
8888
get-ml-model-resnet50,56203e4e998b4bc0_(_onnx_) --> download-and-extract,_url.https://armi.in/files/resnet50_v1_op11/resnet50_v1.onnx
89-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_resnet50,_cpu,_offline,_onnxruntime_) --> get,ml-model,raw,resnet50,_onnx
89+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_cpu,_resnet50,_offline,_onnxruntime_) --> get,ml-model,raw,resnet50,_onnx
9090
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> detect,os
9191
detect-cpu,586c8a43320142f7 --> detect,os
9292
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> detect,cpu
9393
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> get,python
9494
get-mlperf-inference-sut-configs,c2fbf72009e2445b --> get,cache,dir,_name.mlperf-inference-sut-configs
9595
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> get,sut,configs
9696
generate-mlperf-inference-user-conf,3af4475745964b93_(_wg-inference_) --> get,mlcommons,inference,src
97-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_resnet50,_cpu,_offline,_onnxruntime_) --> generate,user-conf,mlperf,inference,_wg-inference
97+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_cpu,_resnet50,_offline,_onnxruntime_) --> generate,user-conf,mlperf,inference,_wg-inference
9898
detect-cpu,586c8a43320142f7 --> detect,os
9999
compile-program,c05042ba005a4bfa --> detect,cpu
100100
compile-program,c05042ba005a4bfa --> get,compiler
101101
detect-cpu,586c8a43320142f7 --> detect,os
102102
get-compiler-flags,31be8b74a69742f8 --> detect,cpu
103103
compile-program,c05042ba005a4bfa --> get,compiler-flags
104-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_resnet50,_cpu,_offline,_onnxruntime_) --> compile,cpp-program
104+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_cpu,_resnet50,_offline,_onnxruntime_) --> compile,cpp-program
105105
detect-cpu,586c8a43320142f7 --> detect,os
106106
benchmark-program,19f369ef47084895 --> detect,cpu
107107
benchmark-program-mlperf,cfff0132a8aa4018 --> benchmark-program,program
108-
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_resnet50,_cpu,_offline,_onnxruntime_) --> benchmark-mlperf
108+
app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf_(_cpu,_resnet50,_offline,_onnxruntime_) --> benchmark-mlperf

‎open/MLCommons/measurements/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/mlc-deps.png

3.73 KB
Loading

‎open/MLCommons/measurements/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/mlc-version-info.json

Lines changed: 22 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,7 @@
3636
"script_alias": "get-mlperf-inference-src",
3737
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
3838
"script_variations": "",
39-
"version": "master-git-5232291860484b747ceeed7a327e56326e3eafe6",
39+
"version": "master-git-1446b3501c172153518b53871edbc1a0df014128",
4040
"parent": "app-mlperf-inference,d775cac873ee4231 ( cpp,_resnet50,_onnxruntime,_cpu,_test,_r5.1-dev_default,_offline )"
4141
}
4242
},
@@ -66,7 +66,7 @@
6666
"script_alias": "get-mlperf-inference-src",
6767
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
6868
"script_variations": "",
69-
"version": "master-git-5232291860484b747ceeed7a327e56326e3eafe6",
69+
"version": "master-git-1446b3501c172153518b53871edbc1a0df014128",
7070
"parent": "get-mlperf-inference-utils,e341e5f86d8342e5"
7171
}
7272
},
@@ -107,15 +107,15 @@
107107
"script_tags": "detect-os,detect,os,info",
108108
"script_variations": "",
109109
"version": "",
110-
"parent": "extract-file,3f0b76219d004817 ( keep,_path./home/runner/MLC/repos/local/cache/download-file_imagenet-aux-da_b4d0a448/caffe_ilsvrc12.tar.gz )"
110+
"parent": "extract-file,3f0b76219d004817 ( keep,_path./home/runner/MLC/repos/local/cache/download-file_imagenet-aux-da_bbc183f4/caffe_ilsvrc12.tar.gz )"
111111
}
112112
},
113113
{
114-
"extract,file,_keep,_path./home/runner/MLC/repos/local/cache/download-file_imagenet-aux-da_b4d0a448/caffe_ilsvrc12.tar.gz": {
114+
"extract,file,_keep,_path./home/runner/MLC/repos/local/cache/download-file_imagenet-aux-da_bbc183f4/caffe_ilsvrc12.tar.gz": {
115115
"script_uid": "3f0b76219d004817",
116116
"script_alias": "extract-file",
117117
"script_tags": "extract,file",
118-
"script_variations": "keep,path./home/runner/MLC/repos/local/cache/download-file_imagenet-aux-da_b4d0a448/caffe_ilsvrc12.tar.gz",
118+
"script_variations": "keep,path./home/runner/MLC/repos/local/cache/download-file_imagenet-aux-da_bbc183f4/caffe_ilsvrc12.tar.gz",
119119
"version": "",
120120
"parent": "download-and-extract,c67e81a4ce2649f5 ( extract,_wget,_url.https://armi.in/files/caffe_ilsvrc12.tar.gz )"
121121
}
@@ -147,7 +147,7 @@
147147
"script_tags": "detect-os,detect,os,info",
148148
"script_variations": "",
149149
"version": "",
150-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( resnet50,_cpu,_offline,_onnxruntime )"
150+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( cpu,_resnet50,_offline,_onnxruntime )"
151151
}
152152
},
153153
{
@@ -167,7 +167,7 @@
167167
"script_tags": "detect,cpu,detect-cpu,info",
168168
"script_variations": "",
169169
"version": "",
170-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( resnet50,_cpu,_offline,_onnxruntime )"
170+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( cpu,_resnet50,_offline,_onnxruntime )"
171171
}
172172
},
173173
{
@@ -206,7 +206,7 @@
206206
"script_alias": "get-mlperf-inference-src",
207207
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
208208
"script_variations": "",
209-
"version": "master-git-5232291860484b747ceeed7a327e56326e3eafe6",
209+
"version": "master-git-1446b3501c172153518b53871edbc1a0df014128",
210210
"parent": "get-mlperf-inference-loadgen,64c3d98d0ba04950 ( wg-inference )"
211211
}
212212
},
@@ -517,7 +517,7 @@
517517
"script_tags": "get,loadgen,inference,inference-loadgen,mlperf,mlcommons",
518518
"script_variations": "wg-inference",
519519
"version": "master",
520-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( resnet50,_cpu,_offline,_onnxruntime )"
520+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( cpu,_resnet50,_offline,_onnxruntime )"
521521
}
522522
},
523523
{
@@ -526,8 +526,8 @@
526526
"script_alias": "get-mlperf-inference-src",
527527
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
528528
"script_variations": "",
529-
"version": "master-git-5232291860484b747ceeed7a327e56326e3eafe6",
530-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( resnet50,_cpu,_offline,_onnxruntime )"
529+
"version": "master-git-1446b3501c172153518b53871edbc1a0df014128",
530+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( cpu,_resnet50,_offline,_onnxruntime )"
531531
}
532532
},
533533
{
@@ -547,7 +547,7 @@
547547
"script_tags": "install,onnxruntime,get,prebuilt,lib,lang-c,lang-cpp",
548548
"script_variations": "cpu",
549549
"version": "1.20.1",
550-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( resnet50,_cpu,_offline,_onnxruntime )"
550+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( cpu,_resnet50,_offline,_onnxruntime )"
551551
}
552552
},
553553
{
@@ -597,15 +597,15 @@
597597
"script_tags": "detect-os,detect,os,info",
598598
"script_variations": "",
599599
"version": "",
600-
"parent": "extract-file,3f0b76219d004817 ( keep,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_b9eab151/ILSVRC2012_img_val_500.tar )"
600+
"parent": "extract-file,3f0b76219d004817 ( keep,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_6415a22c/ILSVRC2012_img_val_500.tar )"
601601
}
602602
},
603603
{
604-
"extract,file,_keep,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_b9eab151/ILSVRC2012_img_val_500.tar": {
604+
"extract,file,_keep,_path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_6415a22c/ILSVRC2012_img_val_500.tar": {
605605
"script_uid": "3f0b76219d004817",
606606
"script_alias": "extract-file",
607607
"script_tags": "extract,file",
608-
"script_variations": "keep,path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_b9eab151/ILSVRC2012_img_val_500.tar",
608+
"script_variations": "keep,path./home/runner/MLC/repos/local/cache/get-dataset-imagenet-val_6415a22c/ILSVRC2012_img_val_500.tar",
609609
"version": "",
610610
"parent": "download-and-extract,c67e81a4ce2649f5 ( extract,_url.http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar )"
611611
}
@@ -786,7 +786,7 @@
786786
"script_alias": "get-mlperf-inference-src",
787787
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
788788
"script_variations": "",
789-
"version": "master-git-5232291860484b747ceeed7a327e56326e3eafe6",
789+
"version": "master-git-1446b3501c172153518b53871edbc1a0df014128",
790790
"parent": "get-preprocessed-dataset-imagenet,f259d490bbaf45f5 ( NCHW )"
791791
}
792792
},
@@ -837,7 +837,7 @@
837837
"script_tags": "get,dataset,imagenet,ILSVRC,image-classification,preprocessed",
838838
"script_variations": "NCHW",
839839
"version": "",
840-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( resnet50,_cpu,_offline,_onnxruntime )"
840+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( cpu,_resnet50,_offline,_onnxruntime )"
841841
}
842842
},
843843
{
@@ -877,7 +877,7 @@
877877
"script_tags": "get,raw,ml-model,resnet50,ml-model-resnet50,image-classification",
878878
"script_variations": "onnx",
879879
"version": "",
880-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( resnet50,_cpu,_offline,_onnxruntime )"
880+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( cpu,_resnet50,_offline,_onnxruntime )"
881881
}
882882
},
883883
{
@@ -946,7 +946,7 @@
946946
"script_alias": "get-mlperf-inference-src",
947947
"script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons",
948948
"script_variations": "",
949-
"version": "master-git-5232291860484b747ceeed7a327e56326e3eafe6",
949+
"version": "master-git-1446b3501c172153518b53871edbc1a0df014128",
950950
"parent": "generate-mlperf-inference-user-conf,3af4475745964b93 ( wg-inference )"
951951
}
952952
},
@@ -957,7 +957,7 @@
957957
"script_tags": "generate,mlperf,inference,user-conf,inference-user-conf",
958958
"script_variations": "wg-inference",
959959
"version": "",
960-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( resnet50,_cpu,_offline,_onnxruntime )"
960+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( cpu,_resnet50,_offline,_onnxruntime )"
961961
}
962962
},
963963
{
@@ -1027,7 +1027,7 @@
10271027
"script_tags": "compile,program,c-program,cpp-program,compile-program,compile-c-program,compile-cpp-program",
10281028
"script_variations": "",
10291029
"version": "",
1030-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( resnet50,_cpu,_offline,_onnxruntime )"
1030+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( cpu,_resnet50,_offline,_onnxruntime )"
10311031
}
10321032
},
10331033
{
@@ -1067,7 +1067,7 @@
10671067
"script_tags": "mlperf,benchmark-mlperf",
10681068
"script_variations": "",
10691069
"version": "",
1070-
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( resnet50,_cpu,_offline,_onnxruntime )"
1070+
"parent": "app-mlperf-inference-mlcommons-cpp,bf62405e6c7a44bf ( cpu,_resnet50,_offline,_onnxruntime )"
10711071
}
10721072
}
10731073
]

‎open/MLCommons/measurements/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/performance_console.out

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
1-
User Conf path: /home/runner/MLC/repos/anandhu-eng@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/6d3eeb6b866e4cff8c1af254f66ec6ea.conf
2-
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_b479f4a9
1+
User Conf path: /home/runner/MLC/repos/GATEOverflow@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/db06f4a80d5949999c4040a39aed24b0.conf
2+
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0c448fa7
33
Dataset List filepath:
44
Scenario: Offline
55
Mode: PerformanceOnly

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/accuracy/accuracy.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
accuracy=76.000%, good=380, total=500
22

3-
hash=fdac50c3f90e27bb97aacadc2f546eb871aeb92655682f8335ac6072381b1ba3
3+
hash=686380c65da25e013622a141d072e966a839536dba54b830c1619c9f2be9233e

0 commit comments

Comments
 (0)