Microsoft Azure EPYC 7003 HPC HBv3 Benchmarks
Azure HBv3 benchmarks against other Microsoft Azure HPC instance types. Benchmarks by Michael Larabel for a future article on phoronix.


Azure HBv3 - EPYC 7V13: 

	Processor: 2 x AMD EPYC 7V13 64-Core (120 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.1 BIOS), Memory: 442GB, Disk: 2 x 960GB Microsoft NVMe Direct Disk + 32GB Virtual Disk + 515GB Virtual Disk, Graphics: hyperv_fb

	OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft

Azure HBv2 - EPYC 7V12: 

	Processor: 2 x AMD EPYC 7V12 64-Core (120 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.0 BIOS), Memory: 450GB, Disk: 960GB Microsoft NVMe Direct Disk + 32GB Virtual Disk + 515GB Virtual Disk, Graphics: hyperv_fb

	OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft

Azure HBv1 - EPYC 7551: 

	Processor: 2 x AMD EPYC 7551 32-Core (60 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.0 BIOS), Memory: 226GB, Disk: 32GB Virtual Disk + 752GB Virtual Disk, Graphics: hyperv_fb

	OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft

Azure HC - Xeon 8168: 

	Processor: 2 x Intel Xeon Platinum 8168 (44 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.0 BIOS), Memory: 348GB, Disk: 32GB Virtual Disk + 752GB Virtual Disk, Graphics: hyperv_fb

	OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft

Azure H - Xeon E5-2667 v3: 

	Processor: 2 x Intel Xeon E5-2667 v3 (16 Cores), Motherboard: Microsoft Virtual Machine v7.0 (090007 BIOS), Chipset: Intel 440BX/ZX/DX, Memory: 222GB, Disk: 32GB Virtual Disk + 2199GB Virtual Disk, Graphics: Microsoft Hyper-V virtual VGA

	OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: Microsoft Hyper-V Server


QuantLib 1.21

MFLOPS > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 2299.3 |===========================================
Azure HBv2 - EPYC 7V12 .... 1725.2 |================================
Azure HBv1 - EPYC 7551 .... 1251.7 |=======================
Azure HC - Xeon 8168 ...... 1812.9 |==================================
Azure H - Xeon E5-2667 v3 . 1505.1 |============================


High Performance Conjugate Gradient 3.1

GFLOP/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 39.06 |============================================
Azure HBv2 - EPYC 7V12 .... 37.27 |==========================================
Azure HBv1 - EPYC 7551 .... 30.43 |==================================
Azure HC - Xeon 8168 ...... 26.04 |=============================
Azure H - Xeon E5-2667 v3 . 10.20 |===========


NAS Parallel Benchmarks 3.4
Test / Class: LU.C
Total Mop/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 56682.82 |=========================================
Azure HBv2 - EPYC 7V12 .... 53829.34 |=======================================
Azure HBv1 - EPYC 7551 .... 25304.19 |==================
Azure H - Xeon E5-2667 v3 . 7870.04  |======


CloverLeaf
Lagrangian-Eulerian Hydrodynamics
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 16.66  |======
Azure HBv2 - EPYC 7V12 .... 23.78  |=========
Azure HBv1 - EPYC 7551 .... 25.00  |==========
Azure HC - Xeon 8168 ...... 20.19  |========
Azure H - Xeon E5-2667 v3 . 111.14 |===========================================


Rodinia 3.1
Test: OpenMP LavaMD
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 37.80  |======
Azure HBv2 - EPYC 7V12 .... 39.20  |======
Azure HBv1 - EPYC 7551 .... 90.18  |==============
Azure HC - Xeon 8168 ...... 94.12  |==============
Azure H - Xeon E5-2667 v3 . 284.19 |===========================================


Rodinia 3.1
Test: OpenMP HotSpot3D
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 82.49  |========================
Azure HBv2 - EPYC 7V12 .... 107.98 |================================
Azure HBv1 - EPYC 7551 .... 145.57 |===========================================
Azure HC - Xeon 8168 ...... 115.83 |==================================
Azure H - Xeon E5-2667 v3 . 126.19 |=====================================


NAMD 2.14
ATPase Simulation - 327,506 Atoms
days/ns < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 0.27566 |=======
Azure HBv2 - EPYC 7V12 .... 0.30056 |=======
Azure HBv1 - EPYC 7551 .... 0.70947 |=================
Azure HC - Xeon 8168 ...... 0.52569 |=============
Azure H - Xeon E5-2667 v3 . 1.71710 |==========================================


Pennant 1.0.1
Test: sedovbig
Hydro Cycle Time - Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 5.833419  |===
Azure HBv2 - EPYC 7V12 .... 6.026449  |===
Azure HBv1 - EPYC 7551 .... 15.528990 |========
Azure HC - Xeon 8168 ...... 23.871260 |============
Azure H - Xeon E5-2667 v3 . 79.648780 |========================================


Pennant 1.0.1
Test: leblancbig
Hydro Cycle Time - Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 3.337201  |===
Azure HBv2 - EPYC 7V12 .... 3.486503  |===
Azure HBv1 - EPYC 7551 .... 10.337640 |=========
Azure HC - Xeon 8168 ...... 10.529200 |=========
Azure H - Xeon E5-2667 v3 . 45.677420 |========================================


Xcompact3d Incompact3d 2021-03-11
Input: X3D-benchmarking input.i3d
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 287.60  |==========
Azure HBv2 - EPYC 7V12 .... 318.91  |============
Azure HBv1 - EPYC 7551 .... 455.81  |=================
Azure HC - Xeon 8168 ...... 507.30  |==================
Azure H - Xeon E5-2667 v3 . 1157.93 |==========================================


LULESH 2.0.3

z/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 41636.60 |=========================================
Azure HBv2 - EPYC 7V12 .... 34803.54 |==================================
Azure HBv1 - EPYC 7551 .... 19011.46 |===================
Azure HC - Xeon 8168 ...... 20846.59 |=====================
Azure H - Xeon E5-2667 v3 . 6444.25  |======


GNU GMP GMPbench 6.2.1
Total Time
GMPbench Score > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 4893.4 |===========================================
Azure HBv2 - EPYC 7V12 .... 4155.5 |=====================================
Azure HBv1 - EPYC 7551 .... 3021.3 |===========================
Azure HC - Xeon 8168 ...... 4196.5 |=====================================
Azure H - Xeon E5-2667 v3 . 3942.7 |===================================


Zstd Compression 1.4.9
Compression Level: 8 - Compression Speed
MB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 3184.2 |===========================================
Azure HBv2 - EPYC 7V12 .... 2653.1 |====================================
Azure HBv1 - EPYC 7551 .... 920.1  |============
Azure HC - Xeon 8168 ...... 1188.2 |================
Azure H - Xeon E5-2667 v3 . 582.7  |========


Zstd Compression 1.4.9
Compression Level: 19 - Compression Speed
MB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 78.2 |=============================================
Azure HBv2 - EPYC 7V12 .... 69.5 |========================================
Azure HBv1 - EPYC 7551 .... 48.5 |============================
Azure HC - Xeon 8168 ...... 76.3 |============================================
Azure H - Xeon E5-2667 v3 . 39.8 |=======================


Zstd Compression 1.4.9
Compression Level: 19 - Decompression Speed
MB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 3717.5 |===========================================
Azure HBv2 - EPYC 7V12 .... 2631.0 |==============================
Azure HBv1 - EPYC 7551 .... 2005.4 |=======================
Azure HC - Xeon 8168 ...... 1903.9 |======================
Azure H - Xeon E5-2667 v3 . 1934.3 |======================


Zstd Compression 1.4.9
Compression Level: 8, Long Mode - Compression Speed
MB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 771.9 |============================================
Azure HBv2 - EPYC 7V12 .... 588.0 |==================================
Azure HBv1 - EPYC 7551 .... 468.8 |===========================
Azure HC - Xeon 8168 ...... 649.3 |=====================================
Azure H - Xeon E5-2667 v3 . 567.4 |================================


Zstd Compression 1.4.9
Compression Level: 8, Long Mode - Decompression Speed
MB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 4256.8 |===========================================
Azure HBv2 - EPYC 7V12 .... 3037.5 |===============================
Azure HBv1 - EPYC 7551 .... 2339.6 |========================
Azure HC - Xeon 8168 ...... 2350.2 |========================
Azure H - Xeon E5-2667 v3 . 2279.8 |=======================


Zstd Compression 1.4.9
Compression Level: 19, Long Mode - Decompression Speed
MB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 3727.5 |===========================================
Azure HBv2 - EPYC 7V12 .... 2674.2 |===============================
Azure HBv1 - EPYC 7551 .... 2019.3 |=======================
Azure HC - Xeon 8168 ...... 1991.3 |=======================
Azure H - Xeon E5-2667 v3 . 2006.3 |=======================


Botan 2.17.3
Test: KASUMI
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 87.48 |============================================
Azure HBv2 - EPYC 7V12 .... 73.18 |=====================================
Azure HBv1 - EPYC 7551 .... 57.95 |=============================
Azure HC - Xeon 8168 ...... 76.15 |======================================
Azure H - Xeon E5-2667 v3 . 70.99 |====================================


Botan 2.17.3
Test: KASUMI - Decrypt
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 84.06 |============================================
Azure HBv2 - EPYC 7V12 .... 71.10 |=====================================
Azure HBv1 - EPYC 7551 .... 55.98 |=============================
Azure HC - Xeon 8168 ...... 74.29 |=======================================
Azure H - Xeon E5-2667 v3 . 68.35 |====================================


Botan 2.17.3
Test: AES-256
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 5412.13 |==========================================
Azure HBv2 - EPYC 7V12 .... 3934.40 |===============================
Azure HBv1 - EPYC 7551 .... 3144.31 |========================
Azure HC - Xeon 8168 ...... 3155.39 |========================
Azure H - Xeon E5-2667 v3 . 2891.85 |======================


Botan 2.17.3
Test: AES-256 - Decrypt
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 5407.48 |==========================================
Azure HBv2 - EPYC 7V12 .... 3938.44 |===============================
Azure HBv1 - EPYC 7551 .... 3151.23 |========================
Azure HC - Xeon 8168 ...... 3159.85 |=========================
Azure H - Xeon E5-2667 v3 . 2892.72 |======================


Botan 2.17.3
Test: Twofish
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 346.32 |===========================================
Azure HBv2 - EPYC 7V12 .... 280.90 |===================================
Azure HBv1 - EPYC 7551 .... 217.31 |===========================
Azure HC - Xeon 8168 ...... 293.55 |====================================
Azure H - Xeon E5-2667 v3 . 270.07 |==================================


Botan 2.17.3
Test: Twofish - Decrypt
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 345.78 |===========================================
Azure HBv2 - EPYC 7V12 .... 283.26 |===================================
Azure HBv1 - EPYC 7551 .... 218.03 |===========================
Azure HC - Xeon 8168 ...... 294.38 |=====================================
Azure H - Xeon E5-2667 v3 . 269.66 |==================================


Botan 2.17.3
Test: Blowfish
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 424.74 |===========================================
Azure HBv2 - EPYC 7V12 .... 348.43 |===================================
Azure HBv1 - EPYC 7551 .... 273.04 |============================
Azure HC - Xeon 8168 ...... 367.94 |=====================================
Azure H - Xeon E5-2667 v3 . 322.92 |=================================


Botan 2.17.3
Test: Blowfish - Decrypt
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 425.16 |===========================================
Azure HBv2 - EPYC 7V12 .... 349.15 |===================================
Azure HBv1 - EPYC 7551 .... 272.73 |============================
Azure HC - Xeon 8168 ...... 365.55 |=====================================
Azure H - Xeon E5-2667 v3 . 327.09 |=================================


Botan 2.17.3
Test: CAST-256
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 133.69 |===========================================
Azure HBv2 - EPYC 7V12 .... 113.60 |=====================================
Azure HBv1 - EPYC 7551 .... 88.55  |============================
Azure HC - Xeon 8168 ...... 116.63 |======================================
Azure H - Xeon E5-2667 v3 . 103.37 |=================================


Botan 2.17.3
Test: CAST-256 - Decrypt
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 133.67 |===========================================
Azure HBv2 - EPYC 7V12 .... 113.72 |=====================================
Azure HBv1 - EPYC 7551 .... 88.56  |============================
Azure HC - Xeon 8168 ...... 116.57 |=====================================
Azure H - Xeon E5-2667 v3 . 103.25 |=================================


Botan 2.17.3
Test: ChaCha20Poly1305
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 667.77 |===========================================
Azure HBv2 - EPYC 7V12 .... 615.80 |========================================
Azure HBv1 - EPYC 7551 .... 303.24 |====================
Azure HC - Xeon 8168 ...... 633.22 |=========================================
Azure H - Xeon E5-2667 v3 . 551.83 |====================================


Botan 2.17.3
Test: ChaCha20Poly1305 - Decrypt
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 658.37 |===========================================
Azure HBv2 - EPYC 7V12 .... 610.86 |========================================
Azure HBv1 - EPYC 7551 .... 300.18 |====================
Azure HC - Xeon 8168 ...... 626.92 |=========================================
Azure H - Xeon E5-2667 v3 . 544.58 |====================================


SVT-AV1 0.8
Encoder Mode: Enc Mode 0 - Input: 1080p
Frames Per Second > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 0.161 |============================================
Azure HBv2 - EPYC 7V12 .... 0.124 |==================================
Azure HBv1 - EPYC 7551 .... 0.076 |=====================
Azure HC - Xeon 8168 ...... 0.111 |==============================
Azure H - Xeon E5-2667 v3 . 0.089 |========================


SVT-AV1 0.8
Encoder Mode: Enc Mode 4 - Input: 1080p
Frames Per Second > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 12.275 |===========================================
Azure HBv2 - EPYC 7V12 .... 9.512  |=================================
Azure HBv1 - EPYC 7551 .... 4.669  |================
Azure HC - Xeon 8168 ...... 7.621  |===========================
Azure H - Xeon E5-2667 v3 . 3.490  |============


SVT-AV1 0.8
Encoder Mode: Enc Mode 8 - Input: 1080p
Frames Per Second > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 94.03 |============================================
Azure HBv2 - EPYC 7V12 .... 78.10 |=====================================
Azure HBv1 - EPYC 7551 .... 40.15 |===================
Azure HC - Xeon 8168 ...... 57.38 |===========================
Azure H - Xeon E5-2667 v3 . 26.84 |=============


SVT-HEVC 1.5.0
Tuning: 1 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 45.39 |============================================
Azure HBv2 - EPYC 7V12 .... 36.12 |===================================
Azure HBv1 - EPYC 7551 .... 21.12 |====================
Azure HC - Xeon 8168 ...... 23.87 |=======================
Azure H - Xeon E5-2667 v3 . 8.12  |========


SVT-HEVC 1.5.0
Tuning: 7 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 378.01 |===========================================
Azure HBv2 - EPYC 7V12 .... 166.90 |===================
Azure HBv1 - EPYC 7551 .... 119.20 |==============
Azure HC - Xeon 8168 ...... 256.28 |=============================
Azure H - Xeon E5-2667 v3 . 95.14  |===========


SVT-HEVC 1.5.0
Tuning: 10 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 548.33 |===========================================
Azure HBv2 - EPYC 7V12 .... 379.91 |==============================
Azure HBv1 - EPYC 7551 .... 141.93 |===========
Azure HC - Xeon 8168 ...... 480.79 |======================================
Azure H - Xeon E5-2667 v3 . 172.16 |==============


SVT-VP9 0.3
Tuning: Visual Quality Optimized - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 337.71 |===========================================
Azure HBv2 - EPYC 7V12 .... 140.59 |==================
Azure HBv1 - EPYC 7551 .... 129.44 |================
Azure HC - Xeon 8168 ...... 299.95 |======================================
Azure H - Xeon E5-2667 v3 . 83.40  |===========


Timed Linux Kernel Compilation 5.10.20
Time To Compile
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 42.01  |=============
Azure HBv2 - EPYC 7V12 .... 44.92  |==============
Azure HBv1 - EPYC 7551 .... 58.74  |===================
Azure HC - Xeon 8168 ...... 55.32  |==================
Azure H - Xeon E5-2667 v3 . 134.74 |===========================================


Timed LLVM Compilation 10.0
Time To Compile
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 163.76 |============
Azure HBv2 - EPYC 7V12 .... 174.74 |=============
Azure HBv1 - EPYC 7551 .... 283.29 |====================
Azure HC - Xeon 8168 ...... 251.74 |==================
Azure H - Xeon E5-2667 v3 . 599.91 |===========================================


Timed Node.js Compilation 15.11
Time To Compile
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 111.33 |==========
Azure HBv2 - EPYC 7V12 .... 118.97 |===========
Azure HBv1 - EPYC 7551 .... 194.55 |==================
Azure HC - Xeon 8168 ...... 189.10 |=================
Azure H - Xeon E5-2667 v3 . 469.94 |===========================================


oneDNN 2.1.2
Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 3.21204  |=============
Azure HBv2 - EPYC 7V12 .... 9.68321  |=======================================
Azure HBv1 - EPYC 7551 .... 10.22263 |=========================================
Azure HC - Xeon 8168 ...... 3.28160  |=============
Azure H - Xeon E5-2667 v3 . 8.70022  |===================================


oneDNN 2.1.2
Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 0.383855 |==
Azure HBv2 - EPYC 7V12 .... 0.441012 |==
Azure HBv1 - EPYC 7551 .... 1.763550 |==========
Azure HC - Xeon 8168 ...... 0.474311 |===
Azure H - Xeon E5-2667 v3 . 7.328620 |=========================================


oneDNN 2.1.2
Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 0.406686 |==
Azure HBv2 - EPYC 7V12 .... 1.031942 |======
Azure HBv1 - EPYC 7551 .... 2.405610 |==============
Azure HC - Xeon 8168 ...... 0.551467 |===
Azure H - Xeon E5-2667 v3 . 6.924710 |=========================================


oneDNN 2.1.2
Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 0.455682 |===
Azure HBv2 - EPYC 7V12 .... 0.732130 |=====
Azure HBv1 - EPYC 7551 .... 2.736210 |===================
Azure HC - Xeon 8168 ...... 0.668641 |=====
Azure H - Xeon E5-2667 v3 . 5.987120 |=========================================


oneDNN 2.1.2
Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 875.17  |=======
Azure HBv2 - EPYC 7V12 .... 1314.00 |==========
Azure HBv1 - EPYC 7551 .... 5524.50 |==========================================
Azure HC - Xeon 8168 ...... 744.36  |======
Azure H - Xeon E5-2667 v3 . 4793.75 |====================================


oneDNN 2.1.2
Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 530.90  |=======
Azure HBv2 - EPYC 7V12 .... 778.31  |==========
Azure HBv1 - EPYC 7551 .... 3344.14 |==========================================
Azure HC - Xeon 8168 ...... 462.86  |======
Azure H - Xeon E5-2667 v3 . 3117.45 |=======================================


oneDNN 2.1.2
Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 962.34  |=======
Azure HBv2 - EPYC 7V12 .... 1287.03 |==========
Azure HBv1 - EPYC 7551 .... 5539.48 |==========================================
Azure HC - Xeon 8168 ...... 746.46  |======
Azure H - Xeon E5-2667 v3 . 4449.57 |==================================


oneDNN 2.1.2
Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 561.77  |=======
Azure HBv2 - EPYC 7V12 .... 791.46  |==========
Azure HBv1 - EPYC 7551 .... 3373.88 |==========================================
Azure HC - Xeon 8168 ...... 459.58  |======
Azure H - Xeon E5-2667 v3 . 3198.07 |========================================


oneDNN 2.1.2
Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 0.255501 |==
Azure HBv2 - EPYC 7V12 .... 0.350347 |===
Azure HBv1 - EPYC 7551 .... 1.512710 |===============
Azure HC - Xeon 8168 ...... 0.352180 |===
Azure H - Xeon E5-2667 v3 . 4.233820 |=========================================


oneDNN 2.1.2
Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 843.10  |=======
Azure HBv2 - EPYC 7V12 .... 1294.53 |==========
Azure HBv1 - EPYC 7551 .... 5355.24 |==========================================
Azure HC - Xeon 8168 ...... 753.36  |======
Azure H - Xeon E5-2667 v3 . 4495.90 |===================================


oneDNN 2.1.2
Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 540.19  |=======
Azure HBv2 - EPYC 7V12 .... 796.82  |==========
Azure HBv1 - EPYC 7551 .... 3423.15 |==========================================
Azure HC - Xeon 8168 ...... 458.20  |======
Azure H - Xeon E5-2667 v3 . 2802.87 |==================================


oneDNN 2.1.2
Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 0.445223 |=====
Azure HBv2 - EPYC 7V12 .... 0.524737 |=====
Azure HBv1 - EPYC 7551 .... 1.154650 |============
Azure HC - Xeon 8168 ...... 0.398005 |====
Azure H - Xeon E5-2667 v3 . 4.013920 |=========================================


FinanceBench 2016-07-25
Benchmark: Repo OpenMP
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 59196.55  |======================
Azure HBv2 - EPYC 7V12 .... 75154.26  |============================
Azure HBv1 - EPYC 7551 .... 108606.50 |========================================
Azure HC - Xeon 8168 ...... 71609.07  |==========================
Azure H - Xeon E5-2667 v3 . 80350.65  |==============================


FinanceBench 2016-07-25
Benchmark: Bonds OpenMP
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 104884.29 |=====================
Azure HBv2 - EPYC 7V12 .... 133719.33 |===========================
Azure HBv1 - EPYC 7551 .... 195702.80 |========================================
Azure HC - Xeon 8168 ...... 130250.45 |===========================
Azure H - Xeon E5-2667 v3 . 147211.24 |==============================


GROMACS 2020.3
Water Benchmark
Ns Per Day > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 9.041 |============================================
Azure HBv2 - EPYC 7V12 .... 8.458 |=========================================
Azure HBv1 - EPYC 7551 .... 3.288 |================
Azure HC - Xeon 8168 ...... 4.866 |========================
Azure H - Xeon E5-2667 v3 . 1.229 |======


TensorFlow Lite 2020-08-23
Model: SqueezeNet
Microseconds < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 66320.4  |===============
Azure HBv2 - EPYC 7V12 .... 74885.4  |=================
Azure HBv1 - EPYC 7551 .... 95206.2  |======================
Azure HC - Xeon 8168 ...... 73517.3  |=================
Azure H - Xeon E5-2667 v3 . 175485.0 |=========================================


Mobile Neural Network 1.1.3
Model: SqueezeNetV1.0
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 8.224  |=====================
Azure HBv2 - EPYC 7V12 .... 14.136 |===================================
Azure HBv1 - EPYC 7551 .... 17.194 |===========================================
Azure HC - Xeon 8168 ...... 8.226  |=====================
Azure H - Xeon E5-2667 v3 . 8.976  |======================


Mobile Neural Network 1.1.3
Model: resnet-v2-50
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 29.09 |====================
Azure HBv2 - EPYC 7V12 .... 52.53 |=====================================
Azure HBv1 - EPYC 7551 .... 62.45 |============================================
Azure HC - Xeon 8168 ...... 29.01 |====================
Azure H - Xeon E5-2667 v3 . 31.50 |======================


Mobile Neural Network 1.1.3
Model: inception-v3
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 34.71 |====================
Azure HBv2 - EPYC 7V12 .... 55.36 |================================
Azure HBv1 - EPYC 7551 .... 76.80 |============================================
Azure HC - Xeon 8168 ...... 35.67 |====================
Azure H - Xeon E5-2667 v3 . 40.59 |=======================


TNN 0.2.3
Target: CPU - Model: SqueezeNet v1.1
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 272.61 |============================
Azure HBv2 - EPYC 7V12 .... 323.62 |=================================
Azure HBv1 - EPYC 7551 .... 420.05 |===========================================
Azure HC - Xeon 8168 ...... 398.40 |=========================================
Azure H - Xeon E5-2667 v3 . 335.41 |==================================


PlaidML
FP16: No - Mode: Inference - Network: VGG16 - Device: CPU
FPS > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 38.39 |=========================================
Azure HBv2 - EPYC 7V12 .... 25.57 |===========================
Azure HBv1 - EPYC 7551 .... 19.88 |=====================
Azure HC - Xeon 8168 ...... 41.54 |============================================
Azure H - Xeon E5-2667 v3 . 18.12 |===================


PlaidML
FP16: No - Mode: Inference - Network: VGG19 - Device: CPU
FPS > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 34.53 |============================================
Azure HBv2 - EPYC 7V12 .... 23.12 |=============================
Azure HBv1 - EPYC 7551 .... 15.97 |====================
Azure HC - Xeon 8168 ...... 34.66 |============================================
Azure H - Xeon E5-2667 v3 . 14.80 |===================


PlaidML
FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU
FPS > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 6.27 |=============================================
Azure HBv2 - EPYC 7V12 .... 5.60 |========================================
Azure HBv1 - EPYC 7551 .... 4.80 |==================================
Azure HC - Xeon 8168 ...... 4.91 |===================================
Azure H - Xeon E5-2667 v3 . 4.48 |================================


Geometric Mean Of All Test Results
Result Composite - Microsoft Azure EPYC 7003 HPC HBv3 Benchmarks
Geometric Mean > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 26.554 |===========================================
Azure HBv2 - EPYC 7V12 .... 20.064 |================================
Azure HBv1 - EPYC 7551 .... 11.329 |==================
Azure HC - Xeon 8168 ...... 19.938 |================================
Azure H - Xeon E5-2667 v3 . 8.870  |==============


QuantLib 1.21
Performance / Cost
MFLOPS Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 638.69 |=============================
Azure HBv2 - EPYC 7V12 .... 638.96 |=============================
Azure HBv1 - EPYC 7551 .... 548.99 |=========================
Azure HC - Xeon 8168 ...... 572.25 |==========================
Azure H - Xeon E5-2667 v3 . 941.28 |===========================================


High Performance Conjugate Gradient 3.1
Performance / Cost
GFLOP/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 10.851 |==================================
Azure HBv2 - EPYC 7V12 .... 13.803 |===========================================
Azure HBv1 - EPYC 7551 .... 13.347 |==========================================
Azure HC - Xeon 8168 ...... 8.219  |==========================
Azure H - Xeon E5-2667 v3 . 6.379  |====================


NAS Parallel Benchmarks 3.4
Performance / Cost - Test / Class: LU.C
Total Mop/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 15745.23 |================================
Azure HBv2 - EPYC 7V12 .... 19936.79 |=========================================
Azure HBv1 - EPYC 7551 .... 11098.33 |=======================
Azure H - Xeon E5-2667 v3 . 4921.85  |==========


CloverLeaf
Performance / Cost - Lagrangian-Eulerian Hydrodynamics
Seconds x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 59.98  |===============
Azure HBv2 - EPYC 7V12 .... 64.21  |================
Azure HBv1 - EPYC 7551 .... 57.00  |==============
Azure HC - Xeon 8168 ...... 63.96  |===============
Azure H - Xeon E5-2667 v3 . 177.71 |===========================================


Rodinia 3.1
Performance / Cost - Test: OpenMP LavaMD
Seconds x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 136.09 |=============
Azure HBv2 - EPYC 7V12 .... 105.84 |==========
Azure HBv1 - EPYC 7551 .... 205.60 |===================
Azure HC - Xeon 8168 ...... 298.17 |============================
Azure H - Xeon E5-2667 v3 . 454.42 |===========================================


Rodinia 3.1
Performance / Cost - Test: OpenMP HotSpot3D
Seconds x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 296.96 |===================================
Azure HBv2 - EPYC 7V12 .... 291.54 |==================================
Azure HBv1 - EPYC 7551 .... 331.90 |=======================================
Azure HC - Xeon 8168 ...... 366.96 |===========================================
Azure H - Xeon E5-2667 v3 . 201.77 |========================


NAMD 2.14
Performance / Cost - ATPase Simulation - 327,506 Atoms
days/ns x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 0.992 |================
Azure HBv2 - EPYC 7V12 .... 0.812 |=============
Azure HBv1 - EPYC 7551 .... 1.618 |==========================
Azure HC - Xeon 8168 ...... 1.665 |===========================
Azure H - Xeon E5-2667 v3 . 2.746 |============================================


Pennant 1.0.1
Performance / Cost - Test: sedovbig
Hydro Cycle Time - Seconds x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 21.00  |=======
Azure HBv2 - EPYC 7V12 .... 16.27  |=====
Azure HBv1 - EPYC 7551 .... 35.41  |============
Azure HC - Xeon 8168 ...... 75.62  |==========================
Azure H - Xeon E5-2667 v3 . 127.36 |===========================================


Pennant 1.0.1
Performance / Cost - Test: leblancbig
Hydro Cycle Time - Seconds x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 12.014 |=======
Azure HBv2 - EPYC 7V12 .... 9.414  |======
Azure HBv1 - EPYC 7551 .... 23.570 |==============
Azure HC - Xeon 8168 ...... 33.357 |====================
Azure H - Xeon E5-2667 v3 . 73.038 |===========================================


Xcompact3d Incompact3d 2021-03-11
Performance / Cost - Input: X3D-benchmarking input.i3d
Seconds x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 1035.36 |=======================
Azure HBv2 - EPYC 7V12 .... 861.04  |====================
Azure HBv1 - EPYC 7551 .... 1039.25 |========================
Azure HC - Xeon 8168 ...... 1607.11 |====================================
Azure H - Xeon E5-2667 v3 . 1851.54 |==========================================


LULESH 2.0.3
Performance / Cost
z/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 11565.72 |=====================================
Azure HBv2 - EPYC 7V12 .... 12890.20 |=========================================
Azure HBv1 - EPYC 7551 .... 8338.36  |===========================
Azure HC - Xeon 8168 ...... 6580.36  |=====================
Azure H - Xeon E5-2667 v3 . 4030.17  |=============


GNU GMP GMPbench 6.2.1
Performance / Cost - Total Time
GMPbench Score Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 1359.28 |=======================
Azure HBv2 - EPYC 7V12 .... 1539.07 |==========================
Azure HBv1 - EPYC 7551 .... 1325.13 |=======================
Azure HC - Xeon 8168 ...... 1324.65 |=======================
Azure H - Xeon E5-2667 v3 . 2465.73 |==========================================


Zstd Compression 1.4.9
Performance / Cost - Compression Level: 8 - Compression Speed
MB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 884.50 |=======================================
Azure HBv2 - EPYC 7V12 .... 982.63 |===========================================
Azure HBv1 - EPYC 7551 .... 403.55 |==================
Azure HC - Xeon 8168 ...... 375.06 |================
Azure H - Xeon E5-2667 v3 . 364.42 |================


Zstd Compression 1.4.9
Performance / Cost - Compression Level: 19 - Compression Speed
MB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 21.72 |=====================================
Azure HBv2 - EPYC 7V12 .... 25.74 |============================================
Azure HBv1 - EPYC 7551 .... 21.27 |====================================
Azure HC - Xeon 8168 ...... 24.09 |=========================================
Azure H - Xeon E5-2667 v3 . 24.89 |===========================================


Zstd Compression 1.4.9
Performance / Cost - Compression Level: 19 - Decompression Speed
MB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 1032.64 |====================================
Azure HBv2 - EPYC 7V12 .... 974.44  |==================================
Azure HBv1 - EPYC 7551 .... 879.56  |===============================
Azure HC - Xeon 8168 ...... 600.98  |=====================
Azure H - Xeon E5-2667 v3 . 1209.69 |==========================================


Zstd Compression 1.4.9
Performance / Cost - Compression Level: 8, Long Mode - Compression Speed
MB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 214.42 |==========================
Azure HBv2 - EPYC 7V12 .... 217.78 |==========================
Azure HBv1 - EPYC 7551 .... 205.61 |=========================
Azure HC - Xeon 8168 ...... 204.96 |=========================
Azure H - Xeon E5-2667 v3 . 354.85 |===========================================


Zstd Compression 1.4.9
Performance / Cost - Compression Level: 8, Long Mode - Decompression Speed
MB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 1182.44 |===================================
Azure HBv2 - EPYC 7V12 .... 1125.00 |=================================
Azure HBv1 - EPYC 7551 .... 1026.14 |==============================
Azure HC - Xeon 8168 ...... 741.86  |======================
Azure H - Xeon E5-2667 v3 . 1425.77 |==========================================


Zstd Compression 1.4.9
Performance / Cost - Compression Level: 19, Long Mode - Decompression Speed
MB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 1035.42 |===================================
Azure HBv2 - EPYC 7V12 .... 990.44  |=================================
Azure HBv1 - EPYC 7551 .... 885.66  |==============================
Azure HC - Xeon 8168 ...... 628.57  |=====================
Azure H - Xeon E5-2667 v3 . 1254.72 |==========================================


Botan 2.17.3
Performance / Cost - Test: KASUMI
MiB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 24.30 |========================
Azure HBv2 - EPYC 7V12 .... 27.10 |===========================
Azure HBv1 - EPYC 7551 .... 25.42 |=========================
Azure HC - Xeon 8168 ...... 24.04 |========================
Azure H - Xeon E5-2667 v3 . 44.39 |============================================


Botan 2.17.3
Performance / Cost - Test: KASUMI - Decrypt
MiB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 23.35 |========================
Azure HBv2 - EPYC 7V12 .... 26.33 |===========================
Azure HBv1 - EPYC 7551 .... 24.55 |=========================
Azure HC - Xeon 8168 ...... 23.45 |========================
Azure H - Xeon E5-2667 v3 . 42.75 |============================================


Botan 2.17.3
Performance / Cost - Test: AES-256
MiB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 1503.37 |===================================
Azure HBv2 - EPYC 7V12 .... 1457.19 |==================================
Azure HBv1 - EPYC 7551 .... 1379.09 |================================
Azure HC - Xeon 8168 ...... 996.02  |=======================
Azure H - Xeon E5-2667 v3 . 1808.53 |==========================================


Botan 2.17.3
Performance / Cost - Test: AES-256 - Decrypt
MiB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 1502.08 |===================================
Azure HBv2 - EPYC 7V12 .... 1458.68 |==================================
Azure HBv1 - EPYC 7551 .... 1382.12 |================================
Azure HC - Xeon 8168 ...... 997.43  |=======================
Azure H - Xeon E5-2667 v3 . 1809.08 |==========================================


Botan 2.17.3
Performance / Cost - Test: Twofish
MiB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 96.20  |========================
Azure HBv2 - EPYC 7V12 .... 104.04 |==========================
Azure HBv1 - EPYC 7551 .... 95.31  |========================
Azure HC - Xeon 8168 ...... 92.66  |========================
Azure H - Xeon E5-2667 v3 . 168.90 |===========================================


Botan 2.17.3
Performance / Cost - Test: Twofish - Decrypt
MiB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 96.05  |========================
Azure HBv2 - EPYC 7V12 .... 104.91 |===========================
Azure HBv1 - EPYC 7551 .... 95.63  |========================
Azure HC - Xeon 8168 ...... 92.92  |========================
Azure H - Xeon E5-2667 v3 . 168.64 |===========================================


Botan 2.17.3
Performance / Cost - Test: Blowfish
MiB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 117.98 |=========================
Azure HBv2 - EPYC 7V12 .... 129.05 |===========================
Azure HBv1 - EPYC 7551 .... 119.75 |=========================
Azure HC - Xeon 8168 ...... 116.14 |=========================
Azure H - Xeon E5-2667 v3 . 201.95 |===========================================


Botan 2.17.3
Performance / Cost - Test: Blowfish - Decrypt
MiB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 118.10 |=========================
Azure HBv2 - EPYC 7V12 .... 129.31 |===========================
Azure HBv1 - EPYC 7551 .... 119.62 |=========================
Azure HC - Xeon 8168 ...... 115.39 |========================
Azure H - Xeon E5-2667 v3 . 204.56 |===========================================


Botan 2.17.3
Performance / Cost - Test: CAST-256
MiB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 37.14 |=========================
Azure HBv2 - EPYC 7V12 .... 42.07 |=============================
Azure HBv1 - EPYC 7551 .... 38.84 |==========================
Azure HC - Xeon 8168 ...... 36.82 |=========================
Azure H - Xeon E5-2667 v3 . 64.65 |============================================


Botan 2.17.3
Performance / Cost - Test: CAST-256 - Decrypt
MiB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 37.13 |=========================
Azure HBv2 - EPYC 7V12 .... 42.12 |=============================
Azure HBv1 - EPYC 7551 .... 38.84 |==========================
Azure HC - Xeon 8168 ...... 36.80 |=========================
Azure H - Xeon E5-2667 v3 . 64.57 |============================================


Botan 2.17.3
Performance / Cost - Test: ChaCha20Poly1305
MiB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 185.49 |=======================
Azure HBv2 - EPYC 7V12 .... 228.07 |============================
Azure HBv1 - EPYC 7551 .... 133.00 |=================
Azure HC - Xeon 8168 ...... 199.88 |=========================
Azure H - Xeon E5-2667 v3 . 345.11 |===========================================


Botan 2.17.3
Performance / Cost - Test: ChaCha20Poly1305 - Decrypt
MiB/s Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 182.88 |=======================
Azure HBv2 - EPYC 7V12 .... 226.25 |=============================
Azure HBv1 - EPYC 7551 .... 131.66 |=================
Azure HC - Xeon 8168 ...... 197.89 |=========================
Azure H - Xeon E5-2667 v3 . 340.58 |===========================================


SVT-AV1 0.8
Performance / Cost - Encoder Mode: Enc Mode 0 - Input: 1080p
Frames Per Second Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 0.04472222 |===============================
Azure HBv2 - EPYC 7V12 .... 0.04592593 |================================
Azure HBv1 - EPYC 7551 .... 0.03333333 |=======================
Azure HC - Xeon 8168 ...... 0.03503788 |=========================
Azure H - Xeon E5-2667 v3 . 0.05565979 |=======================================


SVT-AV1 0.8
Performance / Cost - Encoder Mode: Enc Mode 4 - Input: 1080p
Frames Per Second Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 3.410 |===========================================
Azure HBv2 - EPYC 7V12 .... 3.523 |============================================
Azure HBv1 - EPYC 7551 .... 2.048 |==========================
Azure HC - Xeon 8168 ...... 2.406 |==============================
Azure H - Xeon E5-2667 v3 . 2.183 |===========================


SVT-AV1 0.8
Performance / Cost - Encoder Mode: Enc Mode 8 - Input: 1080p
Frames Per Second Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 26.12 |========================================
Azure HBv2 - EPYC 7V12 .... 28.93 |============================================
Azure HBv1 - EPYC 7551 .... 17.61 |===========================
Azure HC - Xeon 8168 ...... 18.11 |============================
Azure H - Xeon E5-2667 v3 . 16.78 |==========================


SVT-HEVC 1.5.0
Performance / Cost - Tuning: 1 - Input: Bosphorus 1080p
Frames Per Second Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 12.608 |=========================================
Azure HBv2 - EPYC 7V12 .... 13.378 |===========================================
Azure HBv1 - EPYC 7551 .... 9.263  |==============================
Azure HC - Xeon 8168 ...... 7.535  |========================
Azure H - Xeon E5-2667 v3 . 5.078  |================


SVT-HEVC 1.5.0
Performance / Cost - Tuning: 7 - Input: Bosphorus 1080p
Frames Per Second Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 105.00 |===========================================
Azure HBv2 - EPYC 7V12 .... 61.82  |=========================
Azure HBv1 - EPYC 7551 .... 52.28  |=====================
Azure HC - Xeon 8168 ...... 80.90  |=================================
Azure H - Xeon E5-2667 v3 . 59.50  |========================


SVT-HEVC 1.5.0
Performance / Cost - Tuning: 10 - Input: Bosphorus 1080p
Frames Per Second Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 152.31 |===========================================
Azure HBv2 - EPYC 7V12 .... 140.71 |========================================
Azure HBv1 - EPYC 7551 .... 62.25  |==================
Azure HC - Xeon 8168 ...... 151.77 |===========================================
Azure H - Xeon E5-2667 v3 . 107.67 |==============================


SVT-VP9 0.3
Performance / Cost - Tuning: Visual Quality Optimized - Input: Bosphorus 1080p
Frames Per Second Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 93.81 |============================================
Azure HBv2 - EPYC 7V12 .... 52.07 |========================
Azure HBv1 - EPYC 7551 .... 56.77 |==========================
Azure HC - Xeon 8168 ...... 94.68 |============================================
Azure H - Xeon E5-2667 v3 . 52.16 |========================


Timed Linux Kernel Compilation 5.10.20
Performance / Cost - Time To Compile
Seconds x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 151.23 |==============================
Azure HBv2 - EPYC 7V12 .... 121.29 |========================
Azure HBv1 - EPYC 7551 .... 133.92 |===========================
Azure HC - Xeon 8168 ...... 175.27 |===================================
Azure H - Xeon E5-2667 v3 . 215.45 |===========================================


Timed LLVM Compilation 10.0
Performance / Cost - Time To Compile
Seconds x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 589.54 |==========================
Azure HBv2 - EPYC 7V12 .... 471.81 |=====================
Azure HBv1 - EPYC 7551 .... 645.90 |=============================
Azure HC - Xeon 8168 ...... 797.53 |====================================
Azure H - Xeon E5-2667 v3 . 959.26 |===========================================


Timed Node.js Compilation 15.11
Performance / Cost - Time To Compile
Seconds x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 400.78 |=======================
Azure HBv2 - EPYC 7V12 .... 321.22 |==================
Azure HBv1 - EPYC 7551 .... 443.57 |=========================
Azure HC - Xeon 8168 ...... 599.06 |==================================
Azure H - Xeon E5-2667 v3 . 751.44 |===========================================


oneDNN 2.1.2
Performance / Cost - Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 11.56 |===================
Azure HBv2 - EPYC 7V12 .... 26.15 |============================================
Azure HBv1 - EPYC 7551 .... 23.31 |=======================================
Azure HC - Xeon 8168 ...... 10.40 |=================
Azure H - Xeon E5-2667 v3 . 13.91 |=======================


oneDNN 2.1.2
Performance / Cost - Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 1.382  |=====
Azure HBv2 - EPYC 7V12 .... 1.191  |====
Azure HBv1 - EPYC 7551 .... 4.021  |===============
Azure HC - Xeon 8168 ...... 1.503  |======
Azure H - Xeon E5-2667 v3 . 11.718 |===========================================


oneDNN 2.1.2
Performance / Cost - Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 1.464  |======
Azure HBv2 - EPYC 7V12 .... 2.786  |===========
Azure HBv1 - EPYC 7551 .... 5.485  |=====================
Azure HC - Xeon 8168 ...... 1.747  |=======
Azure H - Xeon E5-2667 v3 . 11.073 |===========================================


oneDNN 2.1.2
Performance / Cost - Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 1.640 |========
Azure HBv2 - EPYC 7V12 .... 1.977 |=========
Azure HBv1 - EPYC 7551 .... 6.239 |=============================
Azure HC - Xeon 8168 ...... 2.118 |==========
Azure H - Xeon E5-2667 v3 . 9.573 |============================================


oneDNN 2.1.2
Performance / Cost - Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 3150.60  |==========
Azure HBv2 - EPYC 7V12 .... 3547.80  |============
Azure HBv1 - EPYC 7551 .... 12595.86 |=========================================
Azure HC - Xeon 8168 ...... 2358.12  |========
Azure H - Xeon E5-2667 v3 . 7665.21  |=========================


oneDNN 2.1.2
Performance / Cost - Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 1911.23 |===========
Azure HBv2 - EPYC 7V12 .... 2101.42 |============
Azure HBv1 - EPYC 7551 .... 7624.64 |==========================================
Azure HC - Xeon 8168 ...... 1466.33 |========
Azure H - Xeon E5-2667 v3 . 4984.80 |===========================


oneDNN 2.1.2
Performance / Cost - Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 3464.41  |===========
Azure HBv2 - EPYC 7V12 .... 3474.98  |===========
Azure HBv1 - EPYC 7551 .... 12630.01 |=========================================
Azure HC - Xeon 8168 ...... 2364.80  |========
Azure H - Xeon E5-2667 v3 . 7114.86  |=======================


oneDNN 2.1.2
Performance / Cost - Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 2022.38 |===========
Azure HBv2 - EPYC 7V12 .... 2136.94 |============
Azure HBv1 - EPYC 7551 .... 7692.45 |==========================================
Azure HC - Xeon 8168 ...... 1455.94 |========
Azure H - Xeon E5-2667 v3 . 5113.71 |============================


oneDNN 2.1.2
Performance / Cost - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 0.920 |======
Azure HBv2 - EPYC 7V12 .... 0.946 |======
Azure HBv1 - EPYC 7551 .... 3.449 |======================
Azure HC - Xeon 8168 ...... 1.116 |=======
Azure H - Xeon E5-2667 v3 . 6.770 |============================================


oneDNN 2.1.2
Performance / Cost - Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 3035.17  |==========
Azure HBv2 - EPYC 7V12 .... 3495.23  |============
Azure HBv1 - EPYC 7551 .... 12209.95 |=========================================
Azure HC - Xeon 8168 ...... 2386.63  |========
Azure H - Xeon E5-2667 v3 . 7188.94  |========================


oneDNN 2.1.2
Performance / Cost - Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 1944.70 |==========
Azure HBv2 - EPYC 7V12 .... 2151.40 |============
Azure HBv1 - EPYC 7551 .... 7804.78 |==========================================
Azure HC - Xeon 8168 ...... 1451.58 |========
Azure H - Xeon E5-2667 v3 . 4481.79 |========================


oneDNN 2.1.2
Performance / Cost - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 1.603 |===========
Azure HBv2 - EPYC 7V12 .... 1.417 |==========
Azure HBv1 - EPYC 7551 .... 2.633 |==================
Azure HC - Xeon 8168 ...... 1.261 |=========
Azure H - Xeon E5-2667 v3 . 6.418 |============================================


FinanceBench 2016-07-25
Performance / Cost - Benchmark: Repo OpenMP
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 213107.57 |==================================
Azure HBv2 - EPYC 7V12 .... 202916.50 |=================================
Azure HBv1 - EPYC 7551 .... 247622.83 |========================================
Azure HC - Xeon 8168 ...... 226857.52 |=====================================
Azure H - Xeon E5-2667 v3 . 128480.69 |=====================


FinanceBench 2016-07-25
Performance / Cost - Benchmark: Bonds OpenMP
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 377583.46 |==================================
Azure HBv2 - EPYC 7V12 .... 361042.19 |================================
Azure HBv1 - EPYC 7551 .... 446202.38 |========================================
Azure HC - Xeon 8168 ...... 412633.42 |=====================================
Azure H - Xeon E5-2667 v3 . 235390.77 |=====================


GROMACS 2020.3
Performance / Cost - Water Benchmark
Ns Per Day Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 2.511 |===================================
Azure HBv2 - EPYC 7V12 .... 3.133 |============================================
Azure HBv1 - EPYC 7551 .... 1.442 |====================
Azure HC - Xeon 8168 ...... 1.536 |======================
Azure H - Xeon E5-2667 v3 . 0.769 |===========


TensorFlow Lite 2020-08-23
Performance / Cost - Model: SqueezeNet
Microseconds x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 238753.44 |==================================
Azure HBv2 - EPYC 7V12 .... 202190.58 |=============================
Azure HBv1 - EPYC 7551 .... 217070.14 |===============================
Azure HC - Xeon 8168 ...... 232902.81 |=================================
Azure H - Xeon E5-2667 v3 . 280600.52 |========================================


Mobile Neural Network 1.1.3
Performance / Cost - Model: SqueezeNetV1.0
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 29.61 |=================================
Azure HBv2 - EPYC 7V12 .... 38.17 |===========================================
Azure HBv1 - EPYC 7551 .... 39.20 |============================================
Azure HC - Xeon 8168 ...... 26.06 |=============================
Azure H - Xeon E5-2667 v3 . 14.35 |================


Mobile Neural Network 1.1.3
Performance / Cost - Model: resnet-v2-50
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 104.71 |================================
Azure HBv2 - EPYC 7V12 .... 141.84 |===========================================
Azure HBv1 - EPYC 7551 .... 142.38 |===========================================
Azure HC - Xeon 8168 ...... 91.89  |============================
Azure H - Xeon E5-2667 v3 . 50.38  |===============


Mobile Neural Network 1.1.3
Performance / Cost - Model: inception-v3
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 124.96 |===============================
Azure HBv2 - EPYC 7V12 .... 149.46 |=====================================
Azure HBv1 - EPYC 7551 .... 175.10 |===========================================
Azure HC - Xeon 8168 ...... 113.01 |============================
Azure H - Xeon E5-2667 v3 . 64.90  |================


TNN 0.2.3
Performance / Cost - Target: CPU - Model: SqueezeNet v1.1
ms x Dollar < Lower Is Better
Azure HBv3 - EPYC 7V13 .... 981.41  |=================================
Azure HBv2 - EPYC 7V12 .... 873.76  |=============================
Azure HBv1 - EPYC 7551 .... 957.71  |================================
Azure HC - Xeon 8168 ...... 1262.14 |==========================================
Azure H - Xeon E5-2667 v3 . 536.32  |==================


PlaidML
Performance / Cost - FP16: No - Mode: Inference - Network: VGG16 - Device: CPU
FPS Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 10.664 |===================================
Azure HBv2 - EPYC 7V12 .... 9.470  |===============================
Azure HBv1 - EPYC 7551 .... 8.719  |=============================
Azure HC - Xeon 8168 ...... 13.112 |===========================================
Azure H - Xeon E5-2667 v3 . 11.332 |=====================================


PlaidML
Performance / Cost - FP16: No - Mode: Inference - Network: VGG19 - Device: CPU
FPS Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 9.592  |======================================
Azure HBv2 - EPYC 7V12 .... 8.563  |==================================
Azure HBv1 - EPYC 7551 .... 7.004  |============================
Azure HC - Xeon 8168 ...... 10.941 |===========================================
Azure H - Xeon E5-2667 v3 . 9.256  |====================================


PlaidML
Performance / Cost - FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU
FPS Per Dollar > Higher Is Better
Azure HBv3 - EPYC 7V13 .... 1.742 |===========================
Azure HBv2 - EPYC 7V12 .... 2.074 |=================================
Azure HBv1 - EPYC 7551 .... 2.105 |=================================
Azure HC - Xeon 8168 ...... 1.550 |========================
Azure H - Xeon E5-2667 v3 . 2.802 |============================================