Microsoft Azure EPYC 7003 HBv3 Benchmarks

Azure HBv3 benchmarks against other Microsoft Azure HPC instance types. Benchmarks by Michael Larabel for a future article on phoronix.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2104126-PTS-MSAZURE208
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Timed Code Compilation 3 Tests
C/C++ Compiler Tests 6 Tests
CPU Massive 15 Tests
Creator Workloads 4 Tests
Encoding 3 Tests
Finance 2 Tests
Fortran Tests 4 Tests
HPC - High Performance Computing 15 Tests
Machine Learning 5 Tests
Molecular Dynamics 6 Tests
MPI Benchmarks 5 Tests
Multi-Core 14 Tests
NVIDIA GPU Compute 4 Tests
OpenMPI Tests 8 Tests
Programmer / Developer System Benchmarks 4 Tests
Python Tests 3 Tests
Scientific Computing 7 Tests
Server CPU Tests 10 Tests
Single-Threaded 2 Tests
Video Encoding 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Azure HBv3 - EPYC 7V13
April 09 2021
  7 Hours, 26 Minutes
Azure HBv2 - EPYC 7V12
April 10 2021
  7 Hours, 35 Minutes
Azure HBv1 - EPYC 7551
April 11 2021
  9 Hours, 54 Minutes
Azure HC - Xeon 8168
April 12 2021
  4 Hours, 27 Minutes
Invert Hiding All Results Option
  7 Hours, 20 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Microsoft Azure EPYC 7003 HBv3 Benchmarks, "oneDNN 2.1.2 - Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",0.452453,0.454122,0.460471 "Azure HBv2 - EPYC 7V12",0.736346,0.731871,0.728172 "Azure HBv1 - EPYC 7551",2.74575,2.72637,2.7365 "Azure HC - Xeon 8168",0.649213,0.659797,0.701464,0.700062,0.649182,0.648147,0.648598,0.657244,0.697818,0.652343,0.65244,0.652494,0.698023,0.656263,0.706522 "oneDNN 2.1.2 - Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",9.52489,9.33257,9.65588 "Azure HBv2 - EPYC 7V12",11.9164,11.7074,12.3154,12.524,12.0384,12.1288 "Azure HBv1 - EPYC 7551",8.02279,7.81065,7.91363 "Azure HC - Xeon 8168",2.69577,2.64659,2.69506 "Pennant 1.0.1 - Test: sedovbig", Lower Results Are Better "Azure HBv3 - EPYC 7V13",5.829533,5.841228,5.829496 "Azure HBv2 - EPYC 7V12",6.004528,6.026829,6.047989 "Azure HBv1 - EPYC 7551",15.38354,15.52497,15.67845 "Azure HC - Xeon 8168",23.94,23.77693,23.89684 "Zstd Compression 1.4.9 - Compression Level: 8 - Compression Speed", Higher Results Are Better "Azure HBv3 - EPYC 7V13",3127,3273.2,3152.4 "Azure HBv2 - EPYC 7V12",2683.7,2446.8,2850.1,2723.6,2606.1,2612.1,2561.7,2811.9,2455.3,2811.1,2677,2521.2,2795,2614.2,2627.3 "Azure HBv1 - EPYC 7551",911.5,931.8,917 "Azure HC - Xeon 8168",1174.3,1195.2,1195 "oneDNN 2.1.2 - Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",1.5827,1.5726,1.59017 "Azure HBv2 - EPYC 7V12",1.59879,1.61927,1.56865 "Azure HBv1 - EPYC 7551",3.95155,3.94704,3.92372 "Azure HC - Xeon 8168",1.21369,1.21217,1.20958 "Pennant 1.0.1 - Test: leblancbig", Lower Results Are Better "Azure HBv3 - EPYC 7V13",3.344725,3.363463,3.303414 "Azure HBv2 - EPYC 7V12",3.471605,3.482554,3.50535 "Azure HBv1 - EPYC 7551",10.29589,10.32833,10.38871 "Azure HC - Xeon 8168",10.49727,10.4862,10.60412 "oneDNN 2.1.2 - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",0.448293,0.43062,0.45139,0.450589 "Azure HBv2 - EPYC 7V12",0.5345,0.518266,0.521445 "Azure HBv1 - EPYC 7551",1.14947,1.16111,1.15336 "Azure HC - Xeon 8168",0.390953,0.372847,0.409086,0.417967,0.397638,0.382389,0.392878,0.375924,0.414375,0.417158,0.425221,0.381216,0.417536,0.379279,0.395608 "GROMACS 2020.3 - Water Benchmark", Higher Results Are Better "Azure HBv3 - EPYC 7V13",9.06,9.031,9.033 "Azure HBv2 - EPYC 7V12",8.445,8.454,8.476 "Azure HBv1 - EPYC 7551",3.559,3.378,3.354,3.341,3.295,3.283,3.295,3.272,3.249,3.227,3.249,3.228,3.219,3.208,3.163 "Azure HC - Xeon 8168",4.871,4.867,4.861 "SVT-VP9 0.3 - Tuning: Visual Quality Optimized - Input: Bosphorus 1080p", Higher Results Are Better "Azure HBv3 - EPYC 7V13",342.57,329.01,341.56 "Azure HBv2 - EPYC 7V12",140.48,140.98,140.32 "Azure HBv1 - EPYC 7551",125.4,132.19,126.99,134.34,127.02,132,128.21,129.34 "Azure HC - Xeon 8168",306.61,292.23,301 "NAMD 2.14 - ATPase Simulation - 327,506 Atoms", Lower Results Are Better "Azure HBv3 - EPYC 7V13",0.275476,0.275313,0.276183 "Azure HBv2 - EPYC 7V12",0.299567,0.301593,0.300513 "Azure HBv1 - EPYC 7551",0.716048,0.71287,0.699499 "Azure HC - Xeon 8168",0.528112,0.525075,0.523884 "Rodinia 3.1 - Test: OpenMP LavaMD", Lower Results Are Better "Azure HBv3 - EPYC 7V13",37.919,37.368,38.122 "Azure HBv2 - EPYC 7V12",39.397,38.79,39.408 "Azure HBv1 - EPYC 7551",89.43,90.367,90.728 "Azure HC - Xeon 8168",94.087,94.122,94.149 "SVT-AV1 0.8 - Encoder Mode: Enc Mode 8 - Input: 1080p", Higher Results Are Better "Azure HBv3 - EPYC 7V13",93.431,94.062,94.591 "Azure HBv2 - EPYC 7V12",78.721,78.779,76.812 "Azure HBv1 - EPYC 7551",44.637,36.811,40.14,39.96,41.376,41.37,40.06,40.635,38.699,39.457,39.648,38.958 "Azure HC - Xeon 8168",56.97,57.358,57.803 "NAS Parallel Benchmarks 3.4 - Test / Class: LU.C", Higher Results Are Better "Azure HBv3 - EPYC 7V13",56242.21,51213.56,57008.67,57335.89,56791.67,57398.81,57279.65,57324.16,57251.72,57158.86,57067.71,57395.87,56928.27,57162.39 "Azure HBv2 - EPYC 7V12",53787.12,53846.31,53854.58 "Azure HBv1 - EPYC 7551",25490.03,25325.69,25096.86 "Mobile Neural Network 1.1.3 - Model: inception-v3", Lower Results Are Better "Azure HBv3 - EPYC 7V13",33.506,33.958,34.773,34.441,34.734,34.182,36.068,34.147,33.474,34.669,35.794,36.67,34.187,35.211,34.831 "Azure HBv2 - EPYC 7V12",53.464,55.132,58.055,53.552,57.622,57.531,55.357,62.274,55.791,49.997,51.4,54.1 "Azure HBv1 - EPYC 7551",80.965,75,77.423,79.573,75.075,76.939,73.081,73.471,77.443,79.648,81.76,71.207 "Azure HC - Xeon 8168",36.24,35.641,35.137 "Botan 2.17.3 - Test: ChaCha20Poly1305", Higher Results Are Better "Azure HBv3 - EPYC 7V13",668.247,667.722,667.326 "Azure HBv2 - EPYC 7V12",616.554,614.01,616.82 "Azure HBv1 - EPYC 7551",305.731,300.93,303.067 "Azure HC - Xeon 8168",633.703,632.669,633.28 "Botan 2.17.3 - Test: ChaCha20Poly1305 - Decrypt", Higher Results Are Better "Azure HBv3 - EPYC 7V13",658.421,658.436,658.254 "Azure HBv2 - EPYC 7V12",612.166,610.938,609.48 "Azure HBv1 - EPYC 7551",302.798,298.151,299.586 "Azure HC - Xeon 8168",627.597,625.833,627.328 "LULESH 2.0.3 - ", Higher Results Are Better "Azure HBv3 - EPYC 7V13",41408.095,42551.384,40950.331 "Azure HBv2 - EPYC 7V12",34743.067,34776.593,34890.958 "Azure HBv1 - EPYC 7551",19112.961,18850.321,19071.092 "Azure HC - Xeon 8168",20879.162,20864.286,20796.322 "PlaidML - FP16: No - Mode: Inference - Network: VGG19 - Device: CPU", Higher Results Are Better "Azure HBv3 - EPYC 7V13",34.74,33.43,35.48,34.45 "Azure HBv2 - EPYC 7V12",21.15,20.74,23.18,24.16,23.49,22.06,25.41,22.34,22.91,24.19,24.11,23.71,23.39,22.74,23.26 "Azure HBv1 - EPYC 7551",14.97,15.59,16.69,16.42,16.24,16.23,15.9,16.1,16.97,15.74,14.37,16.41 "Azure HC - Xeon 8168",35.03,34.38,34.56 "SVT-HEVC 1.5.0 - Tuning: 1 - Input: Bosphorus 1080p", Higher Results Are Better "Azure HBv3 - EPYC 7V13",44.65,44.95,46.57 "Azure HBv2 - EPYC 7V12",36.21,36.3,35.86 "Azure HBv1 - EPYC 7551",21.27,21.2,20.89 "Azure HC - Xeon 8168",23.83,23.91,23.88 "oneDNN 2.1.2 - Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",0.879373,0.860934,0.903613 "Azure HBv2 - EPYC 7V12",1.09182,1.16668,1.07938,1.0984,1.11509,1.08839,1.23212,1.14159,1.1519,1.18672,1.07194,1.14024,1.09448,1.08498,1.12891 "Azure HBv1 - EPYC 7551",1.83641,1.90189,1.89671 "Azure HC - Xeon 8168",0.947758,0.920146,0.925316 "SVT-AV1 0.8 - Encoder Mode: Enc Mode 0 - Input: 1080p", Higher Results Are Better "Azure HBv3 - EPYC 7V13",0.161,0.161,0.162 "Azure HBv2 - EPYC 7V12",0.123,0.125,0.124 "Azure HBv1 - EPYC 7551",0.076,0.076,0.076 "Azure HC - Xeon 8168",0.111,0.111,0.111 "PlaidML - FP16: No - Mode: Inference - Network: VGG16 - Device: CPU", Higher Results Are Better "Azure HBv3 - EPYC 7V13",38.42,39.06,37.7 "Azure HBv2 - EPYC 7V12",25.41,25.32,25.98 "Azure HBv1 - EPYC 7551",18.51,19.69,21.43,19.25,20.77,20.85,19.16,19.88,19.92,20.08,19.8,20.81,19.15,19.23,19.7 "Azure HC - Xeon 8168",41.95,41.2,41.48 "Zstd Compression 1.4.9 - Compression Level: 19 - Decompression Speed", Higher Results Are Better "Azure HBv3 - EPYC 7V13",3724.1,3718.5,3686.9,3691,3730.5,3747,3704.5,3721.8,3690.6,3736,3699.7,3752,3679.6,3741,3738.6 "Azure HBv2 - EPYC 7V12",2625.2,2637.8,2635.2,2633.4,2621.5,2628.7,2629.9,2633.1,2631.8,2632.5,2635.5,2624.1,2634.7,2631.3,2630.4 "Azure HBv1 - EPYC 7551",2009.2,2002.2,2009.2,2003.1,2008.8,2004.3,2004.5,2008.4,2004.8,2006,2002,2005.5,2004.9,2006.1,2002 "Azure HC - Xeon 8168",1904.1,1910.9,1913.2,1895.8,1914.3,1889.8,1907.1,1900.7,1908.1,1887.5,1907.4,1911.6,1892.8,1909,1905.7 "Zstd Compression 1.4.9 - Compression Level: 19, Long Mode - Decompression Speed", Higher Results Are Better "Azure HBv3 - EPYC 7V13",3763.4,3740.4,3743.6,3712.4,3565.1,3764.5,3764.3,3717.1,3763.2,3732,3758.3,3712.9,3729.9,3712.6,3733.1 "Azure HBv2 - EPYC 7V12",2674.8,2668.5,2672.3,2671.2,2677.8,2675.7,2682.6,2640.1,2684.6,2681.4,2679.1,2678.4,2673,2673.7,2680 "Azure HBv1 - EPYC 7551",2017.8,2017.1,2019.1,2020.1,2020.5,2019.3,2020,2020,2018.3,2019.4,2020.7,2019 "Azure HC - Xeon 8168",1983.1,1982.9,1978.3,1984.4,2005.4,1983.3,1984.5,1985.6,1993.7,1997.9,1990.9,1992.5,2007.9,2006.9,1992.6 "FinanceBench 2016-07-25 - Benchmark: Bonds OpenMP", Lower Results Are Better "Azure HBv3 - EPYC 7V13",105649.695312,104078.390625,104924.796875 "Azure HBv2 - EPYC 7V12",134344.65625,134028.8125,132784.515625 "Azure HBv1 - EPYC 7551",194234.828125,198061.46875,194812.09375 "Azure HC - Xeon 8168",128740.25,134677.390625,128723.804688,128860.351562 "QuantLib 1.21 - ", Higher Results Are Better "Azure HBv3 - EPYC 7V13",2306.3,2290.1,2301.4 "Azure HBv2 - EPYC 7V12",1726.7,1724.1,1724.9 "Azure HBv1 - EPYC 7551",1251.1,1249,1255.1 "Azure HC - Xeon 8168",1797.3,1821,1820.4 "FinanceBench 2016-07-25 - Benchmark: Repo OpenMP", Lower Results Are Better "Azure HBv3 - EPYC 7V13",58815.601562,59167.707031,59606.332031 "Azure HBv2 - EPYC 7V12",74919.023438,75476.664062,75067.085938 "Azure HBv1 - EPYC 7551",108924.835938,107956.8125,108937.859375 "Azure HC - Xeon 8168",71636.445312,71583.804688,71606.945312 "Zstd Compression 1.4.9 - Compression Level: 8, Long Mode - Decompression Speed", Higher Results Are Better "Azure HBv3 - EPYC 7V13",4275.7,4245.2,4268.2,4252,4255.8,4262.2,4238.7 "Azure HBv2 - EPYC 7V12",3039.1,3028.9,3044.5 "Azure HBv1 - EPYC 7551",2344.6,2341.1,2337.6,2342.6,2339.4,2337.1,2331.6,2340.7,2337.8,2344.2,2342.7,2339.1,2343.3,2343.4,2328.6 "Azure HC - Xeon 8168",2355.2,2348.2,2347.3 "Rodinia 3.1 - Test: OpenMP HotSpot3D", Lower Results Are Better "Azure HBv3 - EPYC 7V13",86.607,82.533,77.225,86.97,79.261,85.208,77.233,83.039,86.563,77.68,82.31,86.817,91.086,77.17,77.633 "Azure HBv2 - EPYC 7V12",107.951,109.523,106.455 "Azure HBv1 - EPYC 7551",142.926,146.388,147.392 "Azure HC - Xeon 8168",115.568,116.238,115.69 "Xcompact3d Incompact3d 2021-03-11 - Input: X3D-benchmarking input.i3d", Lower Results Are Better "Azure HBv3 - EPYC 7V13",287.603577,287.305206,287.88974 "Azure HBv2 - EPYC 7V12",319.039185,318.810822,318.865021 "Azure HBv1 - EPYC 7551",449.886597,458.666901,458.883636 "Azure HC - Xeon 8168",494.703217,507.869629,519.315063 "Timed Node.js Compilation 15.11 - Time To Compile", Lower Results Are Better "Azure HBv3 - EPYC 7V13",113.504,110.225,110.253 "Azure HBv2 - EPYC 7V12",120.624,118.197,118.086 "Azure HBv1 - EPYC 7551",194.701,194.232,194.716 "Azure HC - Xeon 8168",189.891,188.777,188.621 "Timed LLVM Compilation 10.0 - Time To Compile", Lower Results Are Better "Azure HBv3 - EPYC 7V13",167.366,160.994,162.919 "Azure HBv2 - EPYC 7V12",178.692,172.305,173.232 "Azure HBv1 - EPYC 7551",292.783,280.649,276.756,282.974 "Azure HC - Xeon 8168",254.367,247.134,253.73 "Botan 2.17.3 - Test: AES-256", Higher Results Are Better "Azure HBv3 - EPYC 7V13",5417.659,5413.71,5405.025 "Azure HBv2 - EPYC 7V12",3935.468,3938.411,3929.323 "Azure HBv1 - EPYC 7551",3110.74,3161.445,3160.754 "Azure HC - Xeon 8168",3155.194,3155.237,3155.742 "Botan 2.17.3 - Test: AES-256 - Decrypt", Higher Results Are Better "Azure HBv3 - EPYC 7V13",5420.228,5409.046,5393.158 "Azure HBv2 - EPYC 7V12",3941.634,3941.768,3931.929 "Azure HBv1 - EPYC 7551",3153.118,3149.119,3151.446 "Azure HC - Xeon 8168",3159.819,3159.827,3159.911 "Zstd Compression 1.4.9 - Compression Level: 8, Long Mode - Compression Speed", Higher Results Are Better "Azure HBv3 - EPYC 7V13",748.6,801.2,781.6,752.9,762.2,775.4,781.5 "Azure HBv2 - EPYC 7V12",587.8,586.7,589.5 "Azure HBv1 - EPYC 7551",482.3,450.5,477.4,478.9,476.8,457.4,490.8,457.2,464.8,465,472.9,461,455.6,478.7,463.4 "Azure HC - Xeon 8168",661.9,642.4,643.7 "GNU GMP GMPbench 6.2.1 - Total Time", Higher Results Are Better "Azure HBv3 - EPYC 7V13", "Azure HBv2 - EPYC 7V12", "Azure HBv1 - EPYC 7551", "Azure HC - Xeon 8168", "Botan 2.17.3 - Test: Twofish", Higher Results Are Better "Azure HBv3 - EPYC 7V13",344.125,347.268,347.563 "Azure HBv2 - EPYC 7V12",281.196,280.75,280.759 "Azure HBv1 - EPYC 7551",220.278,219.549,209.695,219.726 "Azure HC - Xeon 8168",293.829,293.164,293.66 "Botan 2.17.3 - Test: Twofish - Decrypt", Higher Results Are Better "Azure HBv3 - EPYC 7V13",344.232,346.559,346.538 "Azure HBv2 - EPYC 7V12",283.6,282.853,283.318 "Azure HBv1 - EPYC 7551",220.812,220.148,210.763,220.414 "Azure HC - Xeon 8168",294.563,294.14,294.44 "Botan 2.17.3 - Test: Blowfish - Decrypt", Higher Results Are Better "Azure HBv3 - EPYC 7V13",424.318,425.569,425.588 "Azure HBv2 - EPYC 7V12",348.297,350.203,348.94 "Azure HBv1 - EPYC 7551",272.85,272.589,272.759 "Azure HC - Xeon 8168",365.663,365.3,365.677 "Botan 2.17.3 - Test: Blowfish", Higher Results Are Better "Azure HBv3 - EPYC 7V13",423.805,425.191,425.218 "Azure HBv2 - EPYC 7V12",347.64,349.087,348.548 "Azure HBv1 - EPYC 7551",273.04,272.869,273.207 "Azure HC - Xeon 8168",368.059,367.734,368.034 "TNN 0.2.3 - Target: CPU - Model: SqueezeNet v1.1", Lower Results Are Better "Azure HBv3 - EPYC 7V13",272.906,272.465,272.471 "Azure HBv2 - EPYC 7V12",323.974,323.525,323.347 "Azure HBv1 - EPYC 7551",420.372,419.924,419.845 "Azure HC - Xeon 8168",398.298,398.496,398.419 "Timed MAFFT Alignment 7.471 - Multiple Sequence Alignment - LSU RNA", Lower Results Are Better "Azure HBv3 - EPYC 7V13",13.676,15.054,14.672,14.091,14.047,14.465,14.438,14.365,14.719,14.735,14.508,14.192,13.886,14.28,13.76 "Azure HBv2 - EPYC 7V12",16.004,15.997,16.191 "Azure HBv1 - EPYC 7551",22.54,21.797,21.863 "Azure HC - Xeon 8168",15.696,15.378,15.807 "Botan 2.17.3 - Test: CAST-256", Higher Results Are Better "Azure HBv3 - EPYC 7V13",133.645,133.69,133.737 "Azure HBv2 - EPYC 7V12",113.693,113.463,113.644 "Azure HBv1 - EPYC 7551",88.548,88.515,88.572 "Azure HC - Xeon 8168",116.639,116.617,116.633 "Botan 2.17.3 - Test: KASUMI", Higher Results Are Better "Azure HBv3 - EPYC 7V13",87.525,87.407,87.509 "Azure HBv2 - EPYC 7V12",73.313,73.129,73.084 "Azure HBv1 - EPYC 7551",57.949,57.95,57.952 "Azure HC - Xeon 8168",76.177,76.18,76.09 "Botan 2.17.3 - Test: CAST-256 - Decrypt", Higher Results Are Better "Azure HBv3 - EPYC 7V13",133.629,133.681,133.685 "Azure HBv2 - EPYC 7V12",113.734,113.708,113.729 "Azure HBv1 - EPYC 7551",88.523,88.587 "Azure HC - Xeon 8168",116.578,116.557,116.583 "Botan 2.17.3 - Test: KASUMI - Decrypt", Higher Results Are Better "Azure HBv3 - EPYC 7V13",84.068,84.026,84.082 "Azure HBv2 - EPYC 7V12",71.179,71.082,71.042 "Azure HBv1 - EPYC 7551",55.98,55.974,55.985 "Azure HC - Xeon 8168",74.316,74.315,74.229 "High Performance Conjugate Gradient 3.1 - ", Higher Results Are Better "Azure HBv3 - EPYC 7V13",39.0972,39.1354,38.9535 "Azure HBv2 - EPYC 7V12",37.3589,37.157,37.29 "Azure HBv1 - EPYC 7551",30.6827,30.5083,30.1033 "Azure HC - Xeon 8168",26.0253,26.0217,26.0673 "Timed Linux Kernel Compilation 5.10.20 - Time To Compile", Lower Results Are Better "Azure HBv3 - EPYC 7V13",49.117,41.526,40.776,39.749,41.117,39.429,43.091,42.199,40.609,41.832,42.243,41.976,42.046,43.088,41.323 "Azure HBv2 - EPYC 7V12",50.835,43.108,43.383,44.935,43.828,45.232,43.814,43.967,46.131,43.579,44.166,46.736,44.27 "Azure HBv1 - EPYC 7551",64.17,58.175,58.259,58.263,58.437,58.147,58.27,58.064,58.144,58.588,58.404,58.265,58.414 "Azure HC - Xeon 8168",63.012,55.379,56.372,54.862,53.97,54.789,54.042,55.676,55.972,54.716,55.4,54.937,53.322,52.947,54.47 "PlaidML - FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU", Higher Results Are Better "Azure HBv3 - EPYC 7V13",6.12,7.53,6.01,6.13,6.33,6.02,6.13,6.11,6.07 "Azure HBv2 - EPYC 7V12",5.58,5.56,5.65 "Azure HBv1 - EPYC 7551",4.77,4.81,4.83 "Azure HC - Xeon 8168",4.89,4.91,4.92 "Mobile Neural Network 1.1.3 - Model: resnet-v2-50", Lower Results Are Better "Azure HBv3 - EPYC 7V13",29.205,28.69,29.123,28.989,27.818,29.122,28.802,28.1,28.456,28.334,30.379,31.321,30.465,28.519,28.969 "Azure HBv2 - EPYC 7V12",56.49,56.919,44.919,45.424,55.342,50.446,55.783,55.605,50.762,52.117,54.675,51.913 "Azure HBv1 - EPYC 7551",61.427,64.877,64.535,62.49,55.261,62.768,62.178,56.649,60.932,63.973,68.958,65.309 "Azure HC - Xeon 8168",29.088,28.764,29.166 "Mobile Neural Network 1.1.3 - Model: SqueezeNetV1.0", Lower Results Are Better "Azure HBv3 - EPYC 7V13",8.188,8.846,8.474,7.924,8.79,8.401,8.179,8.178,8.14,8.479,8.046,8.541,7.922,8.249,7.009 "Azure HBv2 - EPYC 7V12",19.71,13.573,17.422,11.708,13.695,12.223,14.632,13.582,13.416,14.01,12.349,13.313 "Azure HBv1 - EPYC 7551",16.56,17.593,18.029,17.64,17.8,16.715,16.204,17.123,17.586,16.956,16.748,17.368 "Azure HC - Xeon 8168",8.117,8.313,8.248 "TensorFlow Lite 2020-08-23 - Model: SqueezeNet", Lower Results Are Better "Azure HBv3 - EPYC 7V13",53935.5,75356.6,49429.8,74194.6,72010,76747.5,78669,55279.6,48475.2,51792.5,75654,71572.6,70191.2,73436.4,68061.2 "Azure HBv2 - EPYC 7V12",81101.9,70959.7,75224.5,71538.6,71624.2,74464.4,70058.4,74572.8,83330.7,79114.7,82237.4,72251.8,69961.9,73004.2,73835.8 "Azure HBv1 - EPYC 7551",97222.9,91697.2,90344.3,105138,100607,89835.2,96682,91347.1,96645.1,92628.4,94904.3,101363,94877.1,91397.3,93404.7 "Azure HC - Xeon 8168",74402.2,74011.7,72138.1 "oneDNN 2.1.2 - Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",559.705,568.502,498.662,539.485,480.126,601.185,541.811,517.393,561.351,569.575,551.411,541.715,527.347,540.08,504.559 "Azure HBv2 - EPYC 7V12",786.414,756.992,825.607,817.052,822.401,804.745,815.953,825.976,781.476,758.569,776.949,766.419,812.783,788.129,812.775 "Azure HBv1 - EPYC 7551",2754.22,2904.04,3715.83,3592.22,3596.81,3693.64,3646.33,3499.75,3045.81,3116.8,3697.46,3687.35,3674.21,3660.57,3062.26 "Azure HC - Xeon 8168",457.729,462.995,453.88 "oneDNN 2.1.2 - Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",827.502,778.455,889.492,853.583,743.863,841.372,917.299,928.836,826.296,825.191,781.568,783.725,892.388,860.896,896.074 "Azure HBv2 - EPYC 7V12",1294.06,1288.96,1401.9,1327.45,1239.94,1239.95,1257.21,1265.85,1297.63,1258.37,1299.08,1317.43,1311.47,1274.17,1344.54 "Azure HBv1 - EPYC 7551",4515.02,5119.44,5801.52,5654.91,5891.59,4953.2,5824.05,5750.8,4554.2,4991.38,5676.74,5342.13,5578.5,5758.55,4916.59 "Azure HC - Xeon 8168",759.066,745.422,755.579 "oneDNN 2.1.2 - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",0.256009,0.255051,0.255442 "Azure HBv2 - EPYC 7V12",0.355897,0.337595,0.351461,0.402718,0.349948,0.330789,0.344298,0.329382,0.327859,0.330163,0.370863,0.373189 "Azure HBv1 - EPYC 7551",1.74595,1.77045,1.15532,2.11357,1.12014,1.72665,1.59515,2.06186,1.19019,1.22494,1.10063,1.60388,1.5629,1.58381,1.1352 "Azure HC - Xeon 8168",0.294255,0.356007,0.375361,0.293766,0.378659,0.391934,0.295604,0.30852,0.380263,0.389655,0.428452,0.295545,0.398495,0.344342,0.351844 "oneDNN 2.1.2 - Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",549.518,603.272,519.13,576.358,543.905,490.111,535.722,585.047,533.701,573.336,612.81,562.315,597.947,589.599,553.82 "Azure HBv2 - EPYC 7V12",814.297,773.038,823.744,778.882,815.022,811.594,783.381,775.155,746.003,766.95,801.108,798.697,802.966,807.928,773.129 "Azure HBv1 - EPYC 7551",3577.2,3243.63,3669.97,2977.64,3576.44,3003.92,3730.18,3502.23,3411.38,2468.9,3626.04,3699.06 "Azure HC - Xeon 8168",458.191,462.618,457.92 "oneDNN 2.1.2 - Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",1076.16,822.098,1034.28,861.541,741.044,866.123,751.983,927.558,849.255,812.372,944.031,760.096,780.563,2245.6 "Azure HBv2 - EPYC 7V12",1345.53,1339.79,1250.01,1207.12,1275.54,1339.2,1222.02,1306.72,1286.81,1232.61,1349.74,1238.14,1289.76,1368.08,1254.32 "Azure HBv1 - EPYC 7551",5795.5,5464.36,5785.94,5775.01,5544.44,5795.86,4586.46,5789.5,5508.98,5725.85,5151.77,5550.05 "Azure HC - Xeon 8168",740.763,752.532,746.096 "oneDNN 2.1.2 - Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",476.452,548.043,498.896,568.773,559.547,556.295,558.007,482.189,537.672,539.928,573.73,486.102,522.07,503.024,552.748 "Azure HBv2 - EPYC 7V12",793.123,776.678,765.115 "Azure HBv1 - EPYC 7551",3791.39,3705.68,3538.91,3354.43,3702.73,3653.64,2911.13,2798.78,3183.36,3100.07,2696.37,3693.18 "Azure HC - Xeon 8168",464.801,465.006,458.759 "oneDNN 2.1.2 - Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",755.33,757.098,844.162,944.036,857.344,904.043,1009.77,901.758,896.373,864.755,762.238,1005.09 "Azure HBv2 - EPYC 7V12",1304.81,1353.82,1206.74,1380.72,1371.15,1344.76,1348.45,1182.01,1255.53,1337.02,1419.56,1322.72,1314.44,1286.84,1281.39 "Azure HBv1 - EPYC 7551",5740.28,5464.34,5749.56,5294.73,5809.29,5609.87,5668.75,5238.15,5629.35,5678.66,5595.36,5644.31,4695.81 "Azure HC - Xeon 8168",753.105,737.536,742.423 "oneDNN 2.1.2 - Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",0.397697,0.414819,0.407542 "Azure HBv2 - EPYC 7V12",1.00146,0.921229,1.19122,0.946217,0.919182,0.928537,1.20754,0.92704,1.19211,1.21399,0.941663,0.932086,1.06955,1.11358,0.973728 "Azure HBv1 - EPYC 7551",2.43958,2.40568,2.28037,2.16977,2.34004,2.7815,2.4694,2.46884,2.46302,2.40873,2.19313,2.44728 "Azure HC - Xeon 8168",0.545101,0.558086,0.551215 "oneDNN 2.1.2 - Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",0.380515,0.41422,0.389435,0.467865,0.381699,0.355672,0.367463,0.406611,0.349135,0.356076,0.371947,0.365619 "Azure HBv2 - EPYC 7V12",0.437882,0.426687,0.458653,0.448864,0.443872,0.432827,0.438297 "Azure HBv1 - EPYC 7551",1.64985,1.80317,1.53709,1.78273,1.68756,1.47602,1.74441,1.80142,1.69602,1.93925,1.88139,1.89181,1.97107,1.59027,2.00123 "Azure HC - Xeon 8168",0.567938,0.562411,0.528614,0.521323,0.43904,0.486335,0.366873,0.440085,0.468698,0.43546,0.421986,0.452966 "oneDNN 2.1.2 - Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU", Lower Results Are Better "Azure HBv3 - EPYC 7V13",3.17158,3.24547,3.21907 "Azure HBv2 - EPYC 7V12",9.52483,12.4174,9.27362,9.24443,9.21297,9.24695,9.12238,9.24582,9.93359,9.24557,12.3601,9.10855,9.09114,9.08112,9.1397 "Azure HBv1 - EPYC 7551",14.0661,10.798,9.50447,11.5674,9.28475,9.20046,14.0031,9.24585,9.28494,9.38223,9.97742,9.14726,9.1914,9.38237,9.30372 "Azure HC - Xeon 8168",3.27557,3.27875,3.29049 "SVT-HEVC 1.5.0 - Tuning: 10 - Input: Bosphorus 1080p", Higher Results Are Better "Azure HBv3 - EPYC 7V13",555.04,557.1,532.86 "Azure HBv2 - EPYC 7V12",421.35,388.6,224.05,392.67,420.17,330.21,151.29,393.96,436.68,434.47,387.1,410.96,416.96,460.12,430.11 "Azure HBv1 - EPYC 7551",131.61,148,135.59,147.67,130.01,142.01,138.47,139.86,132.92,143.3,138.86,139.05,154.56,170.99,136.09 "Azure HC - Xeon 8168",476.57,481.54,484.26 "SVT-HEVC 1.5.0 - Tuning: 7 - Input: Bosphorus 1080p", Higher Results Are Better "Azure HBv3 - EPYC 7V13",383.39,369.69,380.95 "Azure HBv2 - EPYC 7V12",190.72,160.3,175.49,188.92,182.43,149.66,140.35,129.12,157.85,202.77,176.42,148.74 "Azure HBv1 - EPYC 7551",117.12,119.4,121.09 "Azure HC - Xeon 8168",253.06,257.84,257.95 "SVT-AV1 0.8 - Encoder Mode: Enc Mode 4 - Input: 1080p", Higher Results Are Better "Azure HBv3 - EPYC 7V13",12.323,12.217,12.285 "Azure HBv2 - EPYC 7V12",7.691,10.343,10.174,8.937,10.169,10.3,9.45,9.991,10.386,8.485,8.628,8.672,9.918,10.142,9.393 "Azure HBv1 - EPYC 7551",4.593,4.94,4.515,4.768,4.607,4.685,4.722,4.592,4.67,4.626,4.638 "Azure HC - Xeon 8168",7.667,7.589,7.608 "Zstd Compression 1.4.9 - Compression Level: 19 - Compression Speed", Higher Results Are Better "Azure HBv3 - EPYC 7V13",79.3,78.6,75.2,72.9,78.4,80.6,79.3,75.3,83.1,78.4,81.5,77.8,74.4,77.6,79.9 "Azure HBv2 - EPYC 7V12",67.7,73.3,61.4,70,69.2,75.7,69.8,70.2,74.9,77.6,68.6,64,69.4,63.3,67.6 "Azure HBv1 - EPYC 7551",51,47.3,44.5,51.1,45.9,53,47.5,48.3,45.7,53.4,41.8,49.1,49.1,51.7,48.5 "Azure HC - Xeon 8168",68,78.9,77.2,70.2,74.8,81.7,80.2,72.6,80.3,76.3,76.5,76.2,75.8,75,80.8 "CloverLeaf - Lagrangian-Eulerian Hydrodynamics", Lower Results Are Better "Azure HBv3 - EPYC 7V13",16.871463060379,13.135488986969,20.225010871887,18.307796001434,19.883114099503,13.629441022873,18.821180820465,16.253103971481,14.286559104919,13.171295166016,15.111573934555,16.664751052856,24.431302785873,15.504137039185,13.662737131119 "Azure HBv2 - EPYC 7V12",23.893730163574,25.763584136963,24.65033698082,21.267634868622,22.728707790375,23.36147403717,24.442623138428,26.475800991058,22.1557970047,21.991181850433,23.779581069946,24.853491067886 "Azure HBv1 - EPYC 7551",24.846570968628,25.207854032516,24.934010982513 "Azure HC - Xeon 8168",19.675201892853,20.458403110504,20.449098110199