2 x Intel Xeon Platinum 8490H testing with a Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS) and ASPEED on Ubuntu 23.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2302115-NE-OONXSAPPH22
OONX Sapphire Rapids,
"ONNX Runtime 1.14 - Model: yolov4 - Device: CPU - Executor: Standard",
Higher Results Are Better
"ONNX Runtime 1.14",11.5556,11.5054,11.5525
"ONNX Runtime 1.14 - No AMX",11.4515,11.5082,9.91797,11.5567,11.6678,11.4521,10.3191,11.0721,11.3724,11.4916,11.5497,11.3968,11.4524,11.3042,11.4815
"ONNX Runtime 1.14 use_dnnl",11.0835,10.6642,11.2509,11.5093,10.1789,11.3156,11.4483,11.1779,11.4468,10.5037,11.4492,11.4127,11.5328,11.5799,11.4758
"ONNX Runtime 1.14 - Model: yolov4 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"ONNX Runtime 1.14",9.53137,9.2652,9.29696
"ONNX Runtime 1.14 - No AMX",9.3529,9.5257,9.55033
"ONNX Runtime 1.14 use_dnnl",9.55735,9.65748,9.4714
"ONNX Runtime 1.14 - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard",
Higher Results Are Better
"ONNX Runtime 1.14",10.3749,8.6868,10.0498,10.4128,9.66925,10.4567,10.3393,9.45942,8.66649,10.4395,10.4155,10.3612,10.4178,10.3925,10.0076
"ONNX Runtime 1.14 - No AMX",10.6516,10.4322,10.3015
"ONNX Runtime 1.14 use_dnnl",9.88318,9.30665,8.46258,10.3747,10.5512,10.3089,9.593,10.0095,10.4397,10.4744,9.96575,10.4589,10.3367,9.27683,9.57558
"ONNX Runtime 1.14 - Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"ONNX Runtime 1.14",3.07755,2.95167,3.06837
"ONNX Runtime 1.14 - No AMX",2.95947,2.95432,2.96393
"ONNX Runtime 1.14 use_dnnl",3.08477,3.15083,2.81414,3.04272,2.94356,2.91953,2.94642,2.99981,3.12629,3.07427,2.91803,3.13462,3.1004,2.76533,3.07734
"ONNX Runtime 1.14 - Model: super-resolution-10 - Device: CPU - Executor: Standard",
Higher Results Are Better
"ONNX Runtime 1.14",209.097,211.111,208.779
"ONNX Runtime 1.14 - No AMX",209.87,208.904,210.336
"ONNX Runtime 1.14 use_dnnl",210.246,211.8,212.224
"ONNX Runtime 1.14 - Model: super-resolution-10 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"ONNX Runtime 1.14",179.587,180.444,179.654
"ONNX Runtime 1.14 - No AMX",180.331,178.668,182.174
"ONNX Runtime 1.14 use_dnnl",176.813,178.719,180.055
"ONNX Runtime 1.14 - Model: bertsquad-12 - Device: CPU - Executor: Standard",
Higher Results Are Better
"ONNX Runtime 1.14",14.9808,14.6256,15.1999
"ONNX Runtime 1.14 - No AMX",15.0971,15.2159,15.1935
"ONNX Runtime 1.14 use_dnnl",14.9739,16.1138,14.9799,15.1212,15.0675,15.1978,14.9725,15.0999,15.1427
"ONNX Runtime 1.14 - Model: bertsquad-12 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"ONNX Runtime 1.14",15.1548,15.0323,14.8929
"ONNX Runtime 1.14 - No AMX",15.1478,14.9886,14.8497
"ONNX Runtime 1.14 use_dnnl",15.1188,14.7104,15.1646
"ONNX Runtime 1.14 - Model: GPT-2 - Device: CPU - Executor: Standard",
Higher Results Are Better
"ONNX Runtime 1.14",189.729,189.897,190.43
"ONNX Runtime 1.14 - No AMX",191.247,234.519,192.309,193.086,191.791,195.485,194.872,193.278,190.4,190.095,193.093,190.191,190.858,190.868
"ONNX Runtime 1.14 use_dnnl",234.231,189.831,190.339,189.197,189.373,194.399,194.281,192.313,189.88,189.601,192.37,193.73,189.241
"ONNX Runtime 1.14 - Model: GPT-2 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"ONNX Runtime 1.14",151.262,155.749,153.776
"ONNX Runtime 1.14 - No AMX",160.151,158.188,156.576
"ONNX Runtime 1.14 use_dnnl",148.982,150.392,153.207
"ONNX Runtime 1.14 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard",
Higher Results Are Better
"ONNX Runtime 1.14",33.5736,34.3242,34.0012
"ONNX Runtime 1.14 use_dnnl",31.6923,33.1134,33.0218
"ONNX Runtime 1.14 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"ONNX Runtime 1.14",27.302,27.2419,27.1002
"ONNX Runtime 1.14 use_dnnl",26.9139,27.7753,27.5885
"ONNX Runtime 1.14 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard",
Higher Results Are Better
"ONNX Runtime 1.14",178.916,177.917,176.942
"ONNX Runtime 1.14 use_dnnl",175.283,174.956,176.784
"ONNX Runtime 1.14 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"ONNX Runtime 1.14",166.693,161.826,156.886,163.177,163.805
"ONNX Runtime 1.14 use_dnnl",166.771,162.566,165.359
"ONNX Runtime 1.14 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard",
Higher Results Are Better
"ONNX Runtime 1.14",684.559,700.126,667.752
"ONNX Runtime 1.14 use_dnnl",690.649,714.731,681.952
"ONNX Runtime 1.14 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"ONNX Runtime 1.14",584.533,595.389,587.669
"ONNX Runtime 1.14 use_dnnl",597.743,591.259,583.384
"ONNX Runtime 1.14 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard",
Higher Results Are Better
"ONNX Runtime 1.14",39.844,39.525,39.9379
"ONNX Runtime 1.14 use_dnnl",39.5245,40.1845,40.3121
"ONNX Runtime 1.14 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel",
Higher Results Are Better
"ONNX Runtime 1.14",32.3072,32.5887,33.8024
"ONNX Runtime 1.14 use_dnnl",31.5966,32.3006,31.4381
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 - No AMX",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Peak Freq (Highest CPU Core Frequency) Monitor",
Higher Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Power Consumption Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - CPU Temperature Monitor",
Lower Results Are Better
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"CPU Peak Freq (Highest CPU Core Frequency) Monitor - Phoronix Test Suite System Monitoring",
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"CPU Power Consumption Monitor - Phoronix Test Suite System Monitoring",
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"CPU Temperature Monitor - Phoronix Test Suite System Monitoring",
"ONNX Runtime 1.14",
"ONNX Runtime 1.14 use_dnnl",
"ONNX Runtime 1.14 - Model: yolov4 - Device: CPU - Executor: Standard",
Lower Results Are Better
"ONNX Runtime 1.14",86.535,86.9122,86.5577
"ONNX Runtime 1.14 - No AMX",87.3209,86.8904,100.824,86.526,85.7027,87.3152,96.9044,90.3135,87.9287,87.017,86.5783,87.74,87.3149,88.4591,87.0933
"ONNX Runtime 1.14 use_dnnl",90.2212,93.7682,88.8763,86.8831,98.2391,88.3696,87.3457,89.4577,87.3572,95.2016,87.3389,87.6183,86.7059,86.353,87.1363
"ONNX Runtime 1.14 - Model: yolov4 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"ONNX Runtime 1.14",104.913,107.927,107.558
"ONNX Runtime 1.14 - No AMX",106.915,104.975,104.704
"ONNX Runtime 1.14 use_dnnl",104.627,103.542,105.577
"ONNX Runtime 1.14 - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard",
Lower Results Are Better
"ONNX Runtime 1.14",96.3826,115.113,99.4998,96.0319,103.416,95.6286,96.7137,105.711,115.383,95.7862,96.0067,96.5099,95.9851,96.2194,99.9193
"ONNX Runtime 1.14 - No AMX",93.8787,95.8529,97.0689
"ONNX Runtime 1.14 use_dnnl",101.178,107.446,118.162,96.3844,94.7719,96.9999,104.238,99.9012,95.7841,95.4669,100.34,95.6086,96.7387,107.791,104.429
"ONNX Runtime 1.14 - Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"ONNX Runtime 1.14",324.931,338.788,325.903
"ONNX Runtime 1.14 - No AMX",337.895,338.483,337.386
"ONNX Runtime 1.14 use_dnnl",324.17,317.374,355.345,328.65,339.721,342.517,339.391,333.35,319.865,325.277,342.692,319.015,322.537,361.617,324.954
"ONNX Runtime 1.14 - Model: super-resolution-10 - Device: CPU - Executor: Standard",
Lower Results Are Better
"ONNX Runtime 1.14",4.78194,4.73625,4.78916
"ONNX Runtime 1.14 - No AMX",4.76428,4.78625,4.75358
"ONNX Runtime 1.14 use_dnnl",4.75577,4.72089,4.71146
"ONNX Runtime 1.14 - Model: super-resolution-10 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"ONNX Runtime 1.14",5.56694,5.54046,5.56487
"ONNX Runtime 1.14 - No AMX",5.54394,5.59544,5.48781
"ONNX Runtime 1.14 use_dnnl",5.65416,5.594,5.55246
"ONNX Runtime 1.14 - Model: bertsquad-12 - Device: CPU - Executor: Standard",
Lower Results Are Better
"ONNX Runtime 1.14",66.751,68.3717,65.7887
"ONNX Runtime 1.14 - No AMX",66.2369,65.7194,65.8165
"ONNX Runtime 1.14 use_dnnl",66.7818,62.057,66.7549,66.1315,66.3671,65.7978,66.788,66.2245,66.0375
"ONNX Runtime 1.14 - Model: bertsquad-12 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"ONNX Runtime 1.14",65.9828,66.5207,67.1434
"ONNX Runtime 1.14 - No AMX",66.0136,66.7144,67.3384
"ONNX Runtime 1.14 use_dnnl",66.1403,67.9761,65.94
"ONNX Runtime 1.14 - Model: GPT-2 - Device: CPU - Executor: Standard",
Lower Results Are Better
"ONNX Runtime 1.14",5.2686,5.26387,5.24911
"ONNX Runtime 1.14 - No AMX",5.22666,4.26032,5.19772,5.17687,5.21175,5.11298,5.12941,5.17166,5.24991,5.25819,5.17665,5.25538,5.2371,5.2369
"ONNX Runtime 1.14 use_dnnl",4.26615,5.26569,5.25155,5.28334,5.27824,5.14186,5.14502,5.19762,5.26429,5.27201,5.19613,5.1597,5.28216
"ONNX Runtime 1.14 - Model: GPT-2 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"ONNX Runtime 1.14",6.60462,6.41438,6.49682
"ONNX Runtime 1.14 - No AMX",6.23769,6.31545,6.38013
"ONNX Runtime 1.14 use_dnnl",6.70602,6.64264,6.5206
"ONNX Runtime 1.14 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard",
Lower Results Are Better
"ONNX Runtime 1.14",29.7826,29.1311,29.4082
"ONNX Runtime 1.14 use_dnnl",31.5512,30.1968,30.2807
"ONNX Runtime 1.14 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"ONNX Runtime 1.14",36.6253,36.7063,36.8983
"ONNX Runtime 1.14 use_dnnl",37.1535,36.0013,36.2451
"ONNX Runtime 1.14 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard",
Lower Results Are Better
"ONNX Runtime 1.14",5.58823,5.61993,5.6509
"ONNX Runtime 1.14 use_dnnl",5.70435,5.71504,5.65586
"ONNX Runtime 1.14 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"ONNX Runtime 1.14",5.99778,6.1777,6.37271,6.12695,6.10306
"ONNX Runtime 1.14 use_dnnl",5.99472,6.14956,6.04524
"ONNX Runtime 1.14 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard",
Lower Results Are Better
"ONNX Runtime 1.14",1.46011,1.42756,1.49681
"ONNX Runtime 1.14 use_dnnl",1.44714,1.39837,1.46559
"ONNX Runtime 1.14 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"ONNX Runtime 1.14",1.70856,1.67761,1.69935
"ONNX Runtime 1.14 use_dnnl",1.67085,1.68917,1.71199
"ONNX Runtime 1.14 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard",
Lower Results Are Better
"ONNX Runtime 1.14",25.0961,25.2987,25.0372
"ONNX Runtime 1.14 use_dnnl",25.2989,24.8833,24.8045
"ONNX Runtime 1.14 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel",
Lower Results Are Better
"ONNX Runtime 1.14",30.9497,30.6829,29.5811
"ONNX Runtime 1.14 use_dnnl",31.6462,30.9563,31.8057