Microsoft Azure EPYC 7003 HBv3 Benchmarks, "QuantLib 1.21 - ", Higher Results Are Better "Azure HBv3",2306.3,2290.1,2301.4 "Azure HBv2",1726.7,1724.1,1724.9 "Azure HBv1",1251.1,1249,1255.1 "High Performance Conjugate Gradient 3.1 - ", Higher Results Are Better "Azure HBv3",39.0972,39.1354,38.9535 "Azure HBv2",37.3589,37.157,37.29 "Azure HBv1",30.6827,30.5083,30.1033 "NAS Parallel Benchmarks 3.4 - Test / Class: LU.C", Higher Results Are Better "Azure HBv3",56242.21,51213.56,57008.67,57335.89,56791.67,57398.81,57279.65,57324.16,57251.72,57158.86,57067.71,57395.87,56928.27,57162.39 "Azure HBv2",53787.12,53846.31,53854.58 "Azure HBv1",25490.03,25325.69,25096.86 "miniFE 2.2 - Problem Size: Small", Higher Results Are Better "Azure HBv3",12900.7,13301.4,15762,11961.5,13485.3,13139.2,13802.3,12092.1,13779.6,17284.4,14452.9,14277.5,13395.4,15404.7,11739.8 "Azure HBv2",11853.2,13357.3,13207.3,15973.2,15585.1,11602.8,15277,14877.6,11703.5,13543.4,8616.53,12384.2 "Azure HBv1",13137.3,9441.32,14022.2,8786.85,12112.5,11695.1,11284.4,13242.9,11706.2,10559.5,12909.1,14418.4,9323.61,15036.5,12317.6 "CloverLeaf - Lagrangian-Eulerian Hydrodynamics", Lower Results Are Better "Azure HBv3",16.871463060379,13.135488986969,20.225010871887,18.307796001434,19.883114099503,13.629441022873,18.821180820465,16.253103971481,14.286559104919,13.171295166016,15.111573934555,16.664751052856,24.431302785873,15.504137039185,13.662737131119 "Azure HBv2",23.893730163574,25.763584136963,24.65033698082,21.267634868622,22.728707790375,23.36147403717,24.442623138428,26.475800991058,22.1557970047,21.991181850433,23.779581069946,24.853491067886 "Azure HBv1",24.846570968628,25.207854032516,24.934010982513 "Rodinia 3.1 - Test: OpenMP LavaMD", Lower Results Are Better "Azure HBv3",37.919,37.368,38.122 "Azure HBv2",39.397,38.79,39.408 "Azure HBv1",89.43,90.367,90.728 "Rodinia 3.1 - Test: OpenMP HotSpot3D", Lower Results Are Better "Azure HBv3",86.607,82.533,77.225,86.97,79.261,85.208,77.233,83.039,86.563,77.68,82.31,86.817,91.086,77.17,77.633 "Azure HBv2",107.951,109.523,106.455 "Azure HBv1",142.926,146.388,147.392 "Rodinia 3.1 - Test: OpenMP Leukocyte", Lower Results Are Better "Azure HBv3",52.037,49.263,49.902,49.342,47.969,48.816,48.622,48.871 "Azure HBv2",57.967,57.138,56.014 "Azure HBv1",67.078,67.467,67.342 "Rodinia 3.1 - Test: OpenMP CFD Solver", Lower Results Are Better "Azure HBv3",7.252,6.871,7.116,15.465,7.4,11.492,6.632,7.132,6.773,7.579,6.632,11.178 "Azure HBv2",13.561,11.55,14.957,12.081,11.329,10.904,19.763,12.482,15.224,10.793,11.056,12.808 "Azure HBv1",12.124,12.044,12.623,12.968,14.076,11.795,13.076,12.626,11.195,12.523,15.44,14.784 "Rodinia 3.1 - Test: OpenMP Streamcluster", Lower Results Are Better "Azure HBv3",8.968,6.765,7.996,7.152,8.29,6.842,7.054,6.786,6.73,6.848,8.626,6.944,6.952,7.88,6.857 "Azure HBv2",14.189,10.902,13.531,11.631,13.079,10.48,12.849,11.975,10.979,13.099,12.947,15.365,11.199,15.538,15.914 "Azure HBv1",61.654,33.355,47.799,19.201,52.672,60.349,53.969,57.751,28.568,44.467,50.749,57.388,20.941,36.233,35.879 "NAMD 2.14 - ATPase Simulation - 327,506 Atoms", Lower Results Are Better "Azure HBv3",0.275476,0.275313,0.276183 "Azure HBv2",0.299567,0.301593,0.300513 "Azure HBv1",0.716048,0.71287,0.699499 "Pennant 1.0.1 - Test: sedovbig", Lower Results Are Better "Azure HBv3",5.829533,5.841228,5.829496 "Azure HBv2",6.004528,6.026829,6.047989 "Azure HBv1",15.38354,15.52497,15.67845 "Pennant 1.0.1 - Test: leblancbig", Lower Results Are Better "Azure HBv3",3.344725,3.363463,3.303414 "Azure HBv2",3.471605,3.482554,3.50535 "Azure HBv1",10.29589,10.32833,10.38871 "Timed HMMer Search 3.3.1 - Pfam Database Search", Lower Results Are Better "Azure HBv3",173.26,175.937,176.521 "Azure HBv2",208.854,209.043,205.705 "Azure HBv1",209.238,208.74,210.181 "Xcompact3d Incompact3d 2021-03-11 - Input: X3D-benchmarking input.i3d", Lower Results Are Better "Azure HBv3",287.603577,287.305206,287.88974 "Azure HBv2",319.039185,318.810822,318.865021 "Azure HBv1",449.886597,458.666901,458.883636 "Timed MAFFT Alignment 7.471 - Multiple Sequence Alignment - LSU RNA", Lower Results Are Better "Azure HBv3",13.676,15.054,14.672,14.091,14.047,14.465,14.438,14.365,14.719,14.735,14.508,14.192,13.886,14.28,13.76 "Azure HBv2",16.004,15.997,16.191 "Azure HBv1",22.54,21.797,21.863 "LULESH 2.0.3 - ", Higher Results Are Better "Azure HBv3",41408.095,42551.384,40950.331 "Azure HBv2",34743.067,34776.593,34890.958 "Azure HBv1",19112.961,18850.321,19071.092 "GNU GMP GMPbench 6.2.1 - Total Time", Higher Results Are Better "Azure HBv3", "Azure HBv2", "Azure HBv1", "Zstd Compression 1.4.9 - Compression Level: 8 - Compression Speed", Higher Results Are Better "Azure HBv3",3127,3273.2,3152.4 "Azure HBv2",2683.7,2446.8,2850.1,2723.6,2606.1,2612.1,2561.7,2811.9,2455.3,2811.1,2677,2521.2,2795,2614.2,2627.3 "Azure HBv1",911.5,931.8,917 "Zstd Compression 1.4.9 - Compression Level: 19 - Compression Speed", Higher Results Are Better "Azure HBv3",79.3,78.6,75.2,72.9,78.4,80.6,79.3,75.3,83.1,78.4,81.5,77.8,74.4,77.6,79.9 "Azure HBv2",67.7,73.3,61.4,70,69.2,75.7,69.8,70.2,74.9,77.6,68.6,64,69.4,63.3,67.6 "Azure HBv1",51,47.3,44.5,51.1,45.9,53,47.5,48.3,45.7,53.4,41.8,49.1,49.1,51.7,48.5 "Zstd Compression 1.4.9 - Compression Level: 19 - Decompression Speed", Higher Results Are Better "Azure HBv3",3724.1,3718.5,3686.9,3691,3730.5,3747,3704.5,3721.8,3690.6,3736,3699.7,3752,3679.6,3741,3738.6 "Azure HBv2",2625.2,2637.8,2635.2,2633.4,2621.5,2628.7,2629.9,2633.1,2631.8,2632.5,2635.5,2624.1,2634.7,2631.3,2630.4 "Azure HBv1",2009.2,2002.2,2009.2,2003.1,2008.8,2004.3,2004.5,2008.4,2004.8,2006,2002,2005.5,2004.9,2006.1,2002 "Zstd Compression 1.4.9 - Compression Level: 8, Long Mode - Compression Speed", Higher Results Are Better "Azure HBv3",748.6,801.2,781.6,752.9,762.2,775.4,781.5 "Azure HBv2",587.8,586.7,589.5 "Azure HBv1",482.3,450.5,477.4,478.9,476.8,457.4,490.8,457.2,464.8,465,472.9,461,455.6,478.7,463.4 "Zstd Compression 1.4.9 - Compression Level: 8, Long Mode - Decompression Speed", Higher Results Are Better "Azure HBv3",4275.7,4245.2,4268.2,4252,4255.8,4262.2,4238.7 "Azure HBv2",3039.1,3028.9,3044.5 "Azure HBv1",2344.6,2341.1,2337.6,2342.6,2339.4,2337.1,2331.6,2340.7,2337.8,2344.2,2342.7,2339.1,2343.3,2343.4,2328.6 "Zstd Compression 1.4.9 - Compression Level: 19, Long Mode - Compression Speed", Higher Results Are Better "Azure HBv3",37.9,36.9,34.4,35.8,36.6,35.9,37.3,37.2,37,34,38.5,35.8,34.8,35.3,37.6 "Azure HBv2",32.8,34.2,32.1,31.2,34.5,31.7,35.5,33.4,35.4,35,33,32.8,31.4,33.1,35.2 "Azure HBv1",22,23.1,23,26.3,27.6,22.7,27.3,25.3,29.2,24.7,27.1,22.7 "Zstd Compression 1.4.9 - Compression Level: 19, Long Mode - Decompression Speed", Higher Results Are Better "Azure HBv3",3763.4,3740.4,3743.6,3712.4,3565.1,3764.5,3764.3,3717.1,3763.2,3732,3758.3,3712.9,3729.9,3712.6,3733.1 "Azure HBv2",2674.8,2668.5,2672.3,2671.2,2677.8,2675.7,2682.6,2640.1,2684.6,2681.4,2679.1,2678.4,2673,2673.7,2680 "Azure HBv1",2017.8,2017.1,2019.1,2020.1,2020.5,2019.3,2020,2020,2018.3,2019.4,2020.7,2019 "Botan 2.17.3 - Test: KASUMI", Higher Results Are Better "Azure HBv3",87.525,87.407,87.509 "Azure HBv2",73.313,73.129,73.084 "Azure HBv1",57.949,57.95,57.952 "Botan 2.17.3 - Test: KASUMI - Decrypt", Higher Results Are Better "Azure HBv3",84.068,84.026,84.082 "Azure HBv2",71.179,71.082,71.042 "Azure HBv1",55.98,55.974,55.985 "Botan 2.17.3 - Test: AES-256", Higher Results Are Better "Azure HBv3",5417.659,5413.71,5405.025 "Azure HBv2",3935.468,3938.411,3929.323 "Azure HBv1",3110.74,3161.445,3160.754 "Botan 2.17.3 - Test: AES-256 - Decrypt", Higher Results Are Better "Azure HBv3",5420.228,5409.046,5393.158 "Azure HBv2",3941.634,3941.768,3931.929 "Azure HBv1",3153.118,3149.119,3151.446 "Botan 2.17.3 - Test: Twofish", Higher Results Are Better "Azure HBv3",344.125,347.268,347.563 "Azure HBv2",281.196,280.75,280.759 "Azure HBv1",220.278,219.549,209.695,219.726 "Botan 2.17.3 - Test: Twofish - Decrypt", Higher Results Are Better "Azure HBv3",344.232,346.559,346.538 "Azure HBv2",283.6,282.853,283.318 "Azure HBv1",220.812,220.148,210.763,220.414 "Botan 2.17.3 - Test: Blowfish", Higher Results Are Better "Azure HBv3",423.805,425.191,425.218 "Azure HBv2",347.64,349.087,348.548 "Azure HBv1",273.04,272.869,273.207 "Botan 2.17.3 - Test: Blowfish - Decrypt", Higher Results Are Better "Azure HBv3",424.318,425.569,425.588 "Azure HBv2",348.297,350.203,348.94 "Azure HBv1",272.85,272.589,272.759 "Botan 2.17.3 - Test: CAST-256", Higher Results Are Better "Azure HBv3",133.645,133.69,133.737 "Azure HBv2",113.693,113.463,113.644 "Azure HBv1",88.548,88.515,88.572 "Botan 2.17.3 - Test: CAST-256 - Decrypt", Higher Results Are Better "Azure HBv3",133.629,133.681,133.685 "Azure HBv2",113.734,113.708,113.729 "Azure HBv1",88.523,88.587 "Botan 2.17.3 - Test: ChaCha20Poly1305", Higher Results Are Better "Azure HBv3",668.247,667.722,667.326 "Azure HBv2",616.554,614.01,616.82 "Azure HBv1",305.731,300.93,303.067 "Botan 2.17.3 - Test: ChaCha20Poly1305 - Decrypt", Higher Results Are Better "Azure HBv3",658.421,658.436,658.254 "Azure HBv2",612.166,610.938,609.48 "Azure HBv1",302.798,298.151,299.586 "SVT-AV1 0.8 - Encoder Mode: Enc Mode 0 - Input: 1080p", Higher Results Are Better "Azure HBv3",0.161,0.161,0.162 "Azure HBv2",0.123,0.125,0.124 "Azure HBv1",0.076,0.076,0.076 "SVT-AV1 0.8 - Encoder Mode: Enc Mode 4 - Input: 1080p", Higher Results Are Better "Azure HBv3",12.323,12.217,12.285 "Azure HBv2",7.691,10.343,10.174,8.937,10.169,10.3,9.45,9.991,10.386,8.485,8.628,8.672,9.918,10.142,9.393 "Azure HBv1",4.593,4.94,4.515,4.768,4.607,4.685,4.722,4.592,4.67,4.626,4.638 "SVT-AV1 0.8 - Encoder Mode: Enc Mode 8 - Input: 1080p", Higher Results Are Better "Azure HBv3",93.431,94.062,94.591 "Azure HBv2",78.721,78.779,76.812 "Azure HBv1",44.637,36.811,40.14,39.96,41.376,41.37,40.06,40.635,38.699,39.457,39.648,38.958 "SVT-HEVC 1.5.0 - Tuning: 1 - Input: Bosphorus 1080p", Higher Results Are Better "Azure HBv3",44.65,44.95,46.57 "Azure HBv2",36.21,36.3,35.86 "Azure HBv1",21.27,21.2,20.89 "SVT-HEVC 1.5.0 - Tuning: 7 - Input: Bosphorus 1080p", Higher Results Are Better "Azure HBv3",383.39,369.69,380.95 "Azure HBv2",190.72,160.3,175.49,188.92,182.43,149.66,140.35,129.12,157.85,202.77,176.42,148.74 "Azure HBv1",117.12,119.4,121.09 "SVT-HEVC 1.5.0 - Tuning: 10 - Input: Bosphorus 1080p", Higher Results Are Better "Azure HBv3",555.04,557.1,532.86 "Azure HBv2",421.35,388.6,224.05,392.67,420.17,330.21,151.29,393.96,436.68,434.47,387.1,410.96,416.96,460.12,430.11 "Azure HBv1",131.61,148,135.59,147.67,130.01,142.01,138.47,139.86,132.92,143.3,138.86,139.05,154.56,170.99,136.09 "SVT-VP9 0.3 - Tuning: VMAF Optimized - Input: Bosphorus 1080p", Higher Results Are Better "Azure HBv3",106.25,371.05,398.42,372.13,368.95,390.3,375.21,366.53,368.67,367.38,393.09,406.73 "Azure HBv2",97.49,143.35,139.03,131.85,131.81,130.69,132.74,158.85,139.62,134.58,134.91,132.22,162.57,141.55,193.3 "Azure HBv1",67.98,139.02,133.28,147.6,137.28,136.6,142.7,141.75,136.54,137.01,133.45,133.57 "SVT-VP9 0.3 - Tuning: PSNR/SSIM Optimized - Input: Bosphorus 1080p", Higher Results Are Better "Azure HBv3",373.07,425.74,383.98,365.24,377.66,369.96,371.18,372.83,356.6,358.14,368.95,423.36,367.75,367.8,371.38 "Azure HBv2",153.26,146,140.75,169.34,152.71,148.88,260.45,160.63,151.53,151.22,143.91,183.38 "Azure HBv1",140.57,141.06,142.96 "SVT-VP9 0.3 - Tuning: Visual Quality Optimized - Input: Bosphorus 1080p", Higher Results Are Better "Azure HBv3",342.57,329.01,341.56 "Azure HBv2",140.48,140.98,140.32 "Azure HBv1",125.4,132.19,126.99,134.34,127.02,132,128.21,129.34 "Timed Linux Kernel Compilation 5.10.20 - Time To Compile", Lower Results Are Better "Azure HBv3",49.117,41.526,40.776,39.749,41.117,39.429,43.091,42.199,40.609,41.832,42.243,41.976,42.046,43.088,41.323 "Azure HBv2",50.835,43.108,43.383,44.935,43.828,45.232,43.814,43.967,46.131,43.579,44.166,46.736,44.27 "Azure HBv1",64.17,58.175,58.259,58.263,58.437,58.147,58.27,58.064,58.144,58.588,58.404,58.265,58.414 "Timed LLVM Compilation 10.0 - Time To Compile", Lower Results Are Better "Azure HBv3",167.366,160.994,162.919 "Azure HBv2",178.692,172.305,173.232 "Azure HBv1",292.783,280.649,276.756,282.974 "Timed Node.js Compilation 15.11 - Time To Compile", Lower Results Are Better "Azure HBv3",113.504,110.225,110.253 "Azure HBv2",120.624,118.197,118.086 "Azure HBv1",194.701,194.232,194.716 "oneDNN 2.1.2 - Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3",0.879373,0.860934,0.903613 "Azure HBv2",1.09182,1.16668,1.07938,1.0984,1.11509,1.08839,1.23212,1.14159,1.1519,1.18672,1.07194,1.14024,1.09448,1.08498,1.12891 "Azure HBv1",1.83641,1.90189,1.89671 "oneDNN 2.1.2 - Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3",3.17158,3.24547,3.21907 "Azure HBv2",9.52483,12.4174,9.27362,9.24443,9.21297,9.24695,9.12238,9.24582,9.93359,9.24557,12.3601,9.10855,9.09114,9.08112,9.1397 "Azure HBv1",14.0661,10.798,9.50447,11.5674,9.28475,9.20046,14.0031,9.24585,9.28494,9.38223,9.97742,9.14726,9.1914,9.38237,9.30372 "oneDNN 2.1.2 - Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "Azure HBv3",0.380515,0.41422,0.389435,0.467865,0.381699,0.355672,0.367463,0.406611,0.349135,0.356076,0.371947,0.365619 "Azure HBv2",0.437882,0.426687,0.458653,0.448864,0.443872,0.432827,0.438297 "Azure HBv1",1.64985,1.80317,1.53709,1.78273,1.68756,1.47602,1.74441,1.80142,1.69602,1.93925,1.88139,1.89181,1.97107,1.59027,2.00123 "oneDNN 2.1.2 - Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3",0.57268,0.56773,0.585303 "Azure HBv2",0.580939,0.582088,0.582917 "Azure HBv1",6.07697,20.2284,6.00073,5.79796,20.3958,5.99136,6.03029,5.99801,6.01452,6.07906,20.5995,5.95946,6.11158,5.77337,5.95573 "oneDNN 2.1.2 - Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3",9.52489,9.33257,9.65588 "Azure HBv2",11.9164,11.7074,12.3154,12.524,12.0384,12.1288 "Azure HBv1",8.02279,7.81065,7.91363 "oneDNN 2.1.2 - Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3",1.5827,1.5726,1.59017 "Azure HBv2",1.59879,1.61927,1.56865 "Azure HBv1",3.95155,3.94704,3.92372 "oneDNN 2.1.2 - Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "Azure HBv3",0.397697,0.414819,0.407542 "Azure HBv2",1.00146,0.921229,1.19122,0.946217,0.919182,0.928537,1.20754,0.92704,1.19211,1.21399,0.941663,0.932086,1.06955,1.11358,0.973728 "Azure HBv1",2.43958,2.40568,2.28037,2.16977,2.34004,2.7815,2.4694,2.46884,2.46302,2.40873,2.19313,2.44728 "oneDNN 2.1.2 - Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "Azure HBv3",0.452453,0.454122,0.460471 "Azure HBv2",0.736346,0.731871,0.728172 "Azure HBv1",2.74575,2.72637,2.7365 "oneDNN 2.1.2 - Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3",755.33,757.098,844.162,944.036,857.344,904.043,1009.77,901.758,896.373,864.755,762.238,1005.09 "Azure HBv2",1304.81,1353.82,1206.74,1380.72,1371.15,1344.76,1348.45,1182.01,1255.53,1337.02,1419.56,1322.72,1314.44,1286.84,1281.39 "Azure HBv1",5740.28,5464.34,5749.56,5294.73,5809.29,5609.87,5668.75,5238.15,5629.35,5678.66,5595.36,5644.31,4695.81 "oneDNN 2.1.2 - Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3",476.452,548.043,498.896,568.773,559.547,556.295,558.007,482.189,537.672,539.928,573.73,486.102,522.07,503.024,552.748 "Azure HBv2",793.123,776.678,765.115 "Azure HBv1",3791.39,3705.68,3538.91,3354.43,3702.73,3653.64,2911.13,2798.78,3183.36,3100.07,2696.37,3693.18 "oneDNN 2.1.2 - Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "Azure HBv3",1076.16,822.098,1034.28,861.541,741.044,866.123,751.983,927.558,849.255,812.372,944.031,760.096,780.563,2245.6 "Azure HBv2",1345.53,1339.79,1250.01,1207.12,1275.54,1339.2,1222.02,1306.72,1286.81,1232.61,1349.74,1238.14,1289.76,1368.08,1254.32 "Azure HBv1",5795.5,5464.36,5785.94,5775.01,5544.44,5795.86,4586.46,5789.5,5508.98,5725.85,5151.77,5550.05 "oneDNN 2.1.2 - Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "Azure HBv3",549.518,603.272,519.13,576.358,543.905,490.111,535.722,585.047,533.701,573.336,612.81,562.315,597.947,589.599,553.82 "Azure HBv2",814.297,773.038,823.744,778.882,815.022,811.594,783.381,775.155,746.003,766.95,801.108,798.697,802.966,807.928,773.129 "Azure HBv1",3577.2,3243.63,3669.97,2977.64,3576.44,3003.92,3730.18,3502.23,3411.38,2468.9,3626.04,3699.06 "oneDNN 2.1.2 - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3",0.256009,0.255051,0.255442 "Azure HBv2",0.355897,0.337595,0.351461,0.402718,0.349948,0.330789,0.344298,0.329382,0.327859,0.330163,0.370863,0.373189 "Azure HBv1",1.74595,1.77045,1.15532,2.11357,1.12014,1.72665,1.59515,2.06186,1.19019,1.22494,1.10063,1.60388,1.5629,1.58381,1.1352 "oneDNN 2.1.2 - Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU", Lower Results Are Better "Azure HBv3",827.502,778.455,889.492,853.583,743.863,841.372,917.299,928.836,826.296,825.191,781.568,783.725,892.388,860.896,896.074 "Azure HBv2",1294.06,1288.96,1401.9,1327.45,1239.94,1239.95,1257.21,1265.85,1297.63,1258.37,1299.08,1317.43,1311.47,1274.17,1344.54 "Azure HBv1",4515.02,5119.44,5801.52,5654.91,5891.59,4953.2,5824.05,5750.8,4554.2,4991.38,5676.74,5342.13,5578.5,5758.55,4916.59 "oneDNN 2.1.2 - Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU", Lower Results Are Better "Azure HBv3",559.705,568.502,498.662,539.485,480.126,601.185,541.811,517.393,561.351,569.575,551.411,541.715,527.347,540.08,504.559 "Azure HBv2",786.414,756.992,825.607,817.052,822.401,804.745,815.953,825.976,781.476,758.569,776.949,766.419,812.783,788.129,812.775 "Azure HBv1",2754.22,2904.04,3715.83,3592.22,3596.81,3693.64,3646.33,3499.75,3045.81,3116.8,3697.46,3687.35,3674.21,3660.57,3062.26 "oneDNN 2.1.2 - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "Azure HBv3",0.448293,0.43062,0.45139,0.450589 "Azure HBv2",0.5345,0.518266,0.521445 "Azure HBv1",1.14947,1.16111,1.15336 "FinanceBench 2016-07-25 - Benchmark: Repo OpenMP", Lower Results Are Better "Azure HBv3",58815.601562,59167.707031,59606.332031 "Azure HBv2",74919.023438,75476.664062,75067.085938 "Azure HBv1",108924.835938,107956.8125,108937.859375 "FinanceBench 2016-07-25 - Benchmark: Bonds OpenMP", Lower Results Are Better "Azure HBv3",105649.695312,104078.390625,104924.796875 "Azure HBv2",134344.65625,134028.8125,132784.515625 "Azure HBv1",194234.828125,198061.46875,194812.09375 "GROMACS 2020.3 - Water Benchmark", Higher Results Are Better "Azure HBv3",9.06,9.031,9.033 "Azure HBv2",8.445,8.454,8.476 "Azure HBv1",3.559,3.378,3.354,3.341,3.295,3.283,3.295,3.272,3.249,3.227,3.249,3.228,3.219,3.208,3.163 "TensorFlow Lite 2020-08-23 - Model: SqueezeNet", Lower Results Are Better "Azure HBv3",53935.5,75356.6,49429.8,74194.6,72010,76747.5,78669,55279.6,48475.2,51792.5,75654,71572.6,70191.2,73436.4,68061.2 "Azure HBv2",81101.9,70959.7,75224.5,71538.6,71624.2,74464.4,70058.4,74572.8,83330.7,79114.7,82237.4,72251.8,69961.9,73004.2,73835.8 "Azure HBv1",97222.9,91697.2,90344.3,105138,100607,89835.2,96682,91347.1,96645.1,92628.4,94904.3,101363,94877.1,91397.3,93404.7 "Mobile Neural Network 1.1.3 - Model: SqueezeNetV1.0", Lower Results Are Better "Azure HBv3",8.188,8.846,8.474,7.924,8.79,8.401,8.179,8.178,8.14,8.479,8.046,8.541,7.922,8.249,7.009 "Azure HBv2",19.71,13.573,17.422,11.708,13.695,12.223,14.632,13.582,13.416,14.01,12.349,13.313 "Azure HBv1",16.56,17.593,18.029,17.64,17.8,16.715,16.204,17.123,17.586,16.956,16.748,17.368 "Mobile Neural Network 1.1.3 - Model: resnet-v2-50", Lower Results Are Better "Azure HBv3",29.205,28.69,29.123,28.989,27.818,29.122,28.802,28.1,28.456,28.334,30.379,31.321,30.465,28.519,28.969 "Azure HBv2",56.49,56.919,44.919,45.424,55.342,50.446,55.783,55.605,50.762,52.117,54.675,51.913 "Azure HBv1",61.427,64.877,64.535,62.49,55.261,62.768,62.178,56.649,60.932,63.973,68.958,65.309 "Mobile Neural Network 1.1.3 - Model: MobileNetV2_224", Lower Results Are Better "Azure HBv3",4.39,4.79,4.753,5.05,4.986,4.862,4.426,5.069,5.068,4.863,4.331,5.497,4.631,4.682,4.325 "Azure HBv2",10.067,14.676,12.192,16.098,10.073,13.989,10.931,11.012,12.664,15.053,10.933,12.63 "Azure HBv1",8.719,9.07,9.381,11.116,13.001,9.651,9.417,9.007,9.368,9.183,10.203,9.513 "Mobile Neural Network 1.1.3 - Model: mobilenet-v1-1.0", Lower Results Are Better "Azure HBv3",4.614,4.556,4.095,3.892,4.535,4.227,3.018,3.124,4.714,4.085,4.09,3.548,3.317,4.318,3.121 "Azure HBv2",13.375,8.005,7.763,6.879,8.109,7.517,7.426,7.423,7.585,6.913,8.121,7.244 "Azure HBv1",5.807,6.562,5.922,6.07,5.725,5.891,6.015,5.492,6.14,6.662,7.606,6.792 "Mobile Neural Network 1.1.3 - Model: inception-v3", Lower Results Are Better "Azure HBv3",33.506,33.958,34.773,34.441,34.734,34.182,36.068,34.147,33.474,34.669,35.794,36.67,34.187,35.211,34.831 "Azure HBv2",53.464,55.132,58.055,53.552,57.622,57.531,55.357,62.274,55.791,49.997,51.4,54.1 "Azure HBv1",80.965,75,77.423,79.573,75.075,76.939,73.081,73.471,77.443,79.648,81.76,71.207 "NCNN 20201218 - Target: CPU - Model: mobilenet", Lower Results Are Better "Azure HBv3",25.14,22.17,27.73,24.02,26.99,32.38,30.66,38.48,23.29 "Azure HBv2",49.07,52.42,62.9,63.5,46.63,44.59,47.06,44.28,47.82,54.6,66.78,51.07 "Azure HBv1",42.23,45.1,42.67,40.6,45.45,42.69,39.87,43.03,44,47.38,40.93,43.51 "NCNN 20201218 - Target: CPU-v2-v2 - Model: mobilenet-v2", Lower Results Are Better "Azure HBv3",14.66,27.79,37.48,34.79,25.8,12.73,16.48,13.59,25.85 "Azure HBv2",25.01,39.06,34.31,31.15,39.24,52.55,33.21,48.15,40.51,31.68,37.52,34.05 "Azure HBv1",23.34,17.37,17.27,19.04,17.37,17.25,17.39,20.8,20.45,17.42,17.76,16.48 "NCNN 20201218 - Target: CPU - Model: shufflenet-v2", Lower Results Are Better "Azure HBv3",13,10,17.91,13.72,16.19,14.28,15.15,11.11,12.03 "Azure HBv2",31.92,20.02,23.65,19.91,20.24,27.71,15.42,22.16,20.88,19,19.27,16.55 "Azure HBv1",18.31,18.74,19.17,18.81,18.76,21.87,20.15,19.34,17.54,20.17,19.13,19.18 "NCNN 20201218 - Target: CPU - Model: efficientnet-b0", Lower Results Are Better "Azure HBv3",16.46,13.44,15.71,49.11,19.62,18.28,18.69,15.41,22.61 "Azure HBv2",25.07,30.16,35.78,30.48,40.45,38.48,46.08,29.37,34.73,27.09,25.61,25.79 "Azure HBv1",22.2,24.31,22.74,22,22.16,25.24,24.3,23.37,22.81,23.05,24.66,21.22 "NCNN 20201218 - Target: CPU - Model: vgg16", Lower Results Are Better "Azure HBv3",51.38,43.14,47.11,41.22,61.33,44.89,45.07,51.75,43.13 "Azure HBv2",119.03,171.89,139.19,134.79,118.44,180.34,136.42,108.97,128.59,133.42,102.77,131.51 "Azure HBv1",148.28,132.24,155.42,144.44,175.43,157.68,166.24,117.2,150.34,132.1,173.68,121.5 "NCNN 20201218 - Target: CPU - Model: alexnet", Lower Results Are Better "Azure HBv3",11.35,6.03,6.9,6.07,7.08,6.29,6.06,5.94,6.26 "Azure HBv2",10.79,11.94,11.1,11.88,10.84,10.06,10.22,11.62,10.26,10.07,10.95,9.91 "Azure HBv1",25.53,27.51,27.6,27.35,28.03,25.09,25.94,29.01,26.35,25.19,28.45,26.45 "NCNN 20201218 - Target: CPU - Model: resnet50", Lower Results Are Better "Azure HBv3",31.02,26.33,34.39,28.65,30.49,28.22,28.71,33.88,28.54 "Azure HBv2",64.75,66.5,81.5,61.79,59.85,62.35,57.09,63.79,63.65,53.36,69.03,73.89 "Azure HBv1",59.13,63.68,63.53,57.33,65.26,60.63,66.94,65.66,64.9,63.85,64.85,63.22 "TNN 0.2.3 - Target: CPU - Model: SqueezeNet v1.1", Lower Results Are Better "Azure HBv3",272.906,272.465,272.471 "Azure HBv2",323.974,323.525,323.347 "Azure HBv1",420.372,419.924,419.845 "PlaidML - FP16: No - Mode: Inference - Network: VGG16 - Device: CPU", Higher Results Are Better "Azure HBv3",38.42,39.06,37.7 "Azure HBv2",25.41,25.32,25.98 "Azure HBv1",18.51,19.69,21.43,19.25,20.77,20.85,19.16,19.88,19.92,20.08,19.8,20.81,19.15,19.23,19.7 "PlaidML - FP16: No - Mode: Inference - Network: VGG19 - Device: CPU", Higher Results Are Better "Azure HBv3",34.74,33.43,35.48,34.45 "Azure HBv2",21.15,20.74,23.18,24.16,23.49,22.06,25.41,22.34,22.91,24.19,24.11,23.71,23.39,22.74,23.26 "Azure HBv1",14.97,15.59,16.69,16.42,16.24,16.23,15.9,16.1,16.97,15.74,14.37,16.41 "PlaidML - FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU", Higher Results Are Better "Azure HBv3",6.12,7.53,6.01,6.13,6.33,6.02,6.13,6.11,6.07 "Azure HBv2",5.58,5.56,5.65 "Azure HBv1",4.77,4.81,4.83 "Kripke 1.2.4 - ", Higher Results Are Better "Azure HBv3",94657260,81773840,86180270,89492320,78557800,83277170,88305650,78744800,79427260,93926540,69796040,76042060,75101450,83459480,76386030 "Azure HBv2",41751490,47933790,44551770,47636520,42801620,43528940,42796090,40817820,40401240,41730470,41144850,42056440,43879630,45009640,51792940 "Azure HBv1",41301250,33696590,43583890,31699940,32413970,41994370,38888970,38326870,43583830,43098440,31381550,32926940,36979470,51831200,39829170 "Zstd Compression 1.4.9 - Compression Level: 8 - Decompression Speed", Higher Results Are Better "Azure HBv1",2163.2,2163,2163.4 "NCNN 20201218 - Target: CPU-v3-v3 - Model: mobilenet-v3", Lower Results Are Better "Azure HBv1",17.13,16.27,15.81,16.24,22.37,18.71,16.43,16.72,15.11,17.71,16.08,19.61 "NCNN 20201218 - Target: CPU - Model: mnasnet", Lower Results Are Better "Azure HBv1",16.6,17.84,15.82,16.25,17.01,16.7,16.72,19.42,16.46,15.8,15.95,15.6 "NCNN 20201218 - Target: CPU - Model: blazeface", Lower Results Are Better "Azure HBv1",8.02,9.41,7.52,7.77,7.79,7.66,7.92,8.44,8.28,7.65,7.8,7.63 "NCNN 20201218 - Target: CPU - Model: googlenet", Lower Results Are Better "Azure HBv1",40.48,40.61,42.68,38.56,39.74,44.51,43.19,41.24,42.66,40.77,43.48,39.96 "NCNN 20201218 - Target: CPU - Model: resnet18", Lower Results Are Better "Azure HBv1",36.72,38.86,38.49,36.48,40.47,38.07,38.25,42.51,42.52,39.25,41.81,37.45 "NCNN 20201218 - Target: CPU - Model: yolov4-tiny", Lower Results Are Better "Azure HBv1",57.92,56.87,67.56,55.08,66.02,70.5,72.2,57.8,61.58,74.01,61.27,85.02 "NCNN 20201218 - Target: CPU - Model: squeezenet_ssd", Lower Results Are Better "Azure HBv1",42.84,52.72,41.54,41.93,51.08,46.25,43.9,43.52,46.97,50.46,50.05,47.27 "NCNN 20201218 - Target: CPU - Model: regnety_400m", Lower Results Are Better "Azure HBv1",115.26,109.27,107.57,105.86,104.25,105.23,114.31,122.7,114.2,106.75,120.91,106.24