Microsoft Azure EPYC 7003 HBv3 Benchmarks
Azure HBv3 benchmarks against other Microsoft Azure HPC instance types. Benchmarks by Michael Larabel for a future article on phoronix.


Azure HBv3 - EPYC 7V13: 

	Processor: 2 x AMD EPYC 7V13 64-Core (120 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.1 BIOS), Memory: 442GB, Disk: 2 x 960GB Microsoft NVMe Direct Disk + 32GB Virtual Disk + 515GB Virtual Disk, Graphics: hyperv_fb

	OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft

Azure HBv2 - EPYC 7V12: 

	Processor: 2 x AMD EPYC 7V12 64-Core (120 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.0 BIOS), Memory: 450GB, Disk: 960GB Microsoft NVMe Direct Disk + 32GB Virtual Disk + 515GB Virtual Disk, Graphics: hyperv_fb

	OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft

Azure HBv1 - EPYC 7551: 

	Processor: 2 x AMD EPYC 7551 32-Core (60 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.0 BIOS), Memory: 226GB, Disk: 32GB Virtual Disk + 752GB Virtual Disk, Graphics: hyperv_fb

	OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft

Azure HC - Xeon 8168: 

	Processor: 2 x Intel Xeon Platinum 8168 (44 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.0 BIOS), Memory: 348GB, Disk: 32GB Virtual Disk + 752GB Virtual Disk, Graphics: hyperv_fb

	OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft


QuantLib 1.21

MFLOPS > Higher Is Better
Azure HBv3 - EPYC 7V13 . 2299.3 |==============================================
Azure HBv2 - EPYC 7V12 . 1725.2 |===================================
Azure HBv1 - EPYC 7551 . 1251.7 |=========================
Azure HC - Xeon 8168 ... 1812.9 |====================================


High Performance Conjugate Gradient 3.1

GFLOP/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 39.06 |===============================================
Azure HBv2 - EPYC 7V12 . 37.27 |=============================================
Azure HBv1 - EPYC 7551 . 30.43 |=====================================
Azure HC - Xeon 8168 ... 26.04 |===============================


NAS Parallel Benchmarks 3.4
Test / Class: LU.C
Total Mop/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 56682.82 |============================================
Azure HBv2 - EPYC 7V12 . 53829.34 |==========================================
Azure HBv1 - EPYC 7551 . 25304.19 |====================


CloverLeaf
Lagrangian-Eulerian Hydrodynamics
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 . 16.66 |===============================
Azure HBv2 - EPYC 7V12 . 23.78 |=============================================
Azure HBv1 - EPYC 7551 . 25.00 |===============================================
Azure HC - Xeon 8168 ... 20.19 |======================================


Rodinia 3.1
Test: OpenMP LavaMD
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 . 37.80 |===================
Azure HBv2 - EPYC 7V12 . 39.20 |====================
Azure HBv1 - EPYC 7551 . 90.18 |=============================================
Azure HC - Xeon 8168 ... 94.12 |===============================================


Rodinia 3.1
Test: OpenMP HotSpot3D
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 . 82.49  |==========================
Azure HBv2 - EPYC 7V12 . 107.98 |==================================
Azure HBv1 - EPYC 7551 . 145.57 |==============================================
Azure HC - Xeon 8168 ... 115.83 |=====================================


NAMD 2.14
ATPase Simulation - 327,506 Atoms
days/ns < Lower Is Better
Azure HBv3 - EPYC 7V13 . 0.27566 |=================
Azure HBv2 - EPYC 7V12 . 0.30056 |===================
Azure HBv1 - EPYC 7551 . 0.70947 |=============================================
Azure HC - Xeon 8168 ... 0.52569 |=================================


Pennant 1.0.1
Test: sedovbig
Hydro Cycle Time - Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 . 5.833419  |===========
Azure HBv2 - EPYC 7V12 . 6.026449  |===========
Azure HBv1 - EPYC 7551 . 15.528990 |============================
Azure HC - Xeon 8168 ... 23.871260 |===========================================


Pennant 1.0.1
Test: leblancbig
Hydro Cycle Time - Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 . 3.337201  |==============
Azure HBv2 - EPYC 7V12 . 3.486503  |==============
Azure HBv1 - EPYC 7551 . 10.337640 |==========================================
Azure HC - Xeon 8168 ... 10.529200 |===========================================


Xcompact3d Incompact3d 2021-03-11
Input: X3D-benchmarking input.i3d
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 . 287.60 |==========================
Azure HBv2 - EPYC 7V12 . 318.91 |=============================
Azure HBv1 - EPYC 7551 . 455.81 |=========================================
Azure HC - Xeon 8168 ... 507.30 |==============================================


Timed MAFFT Alignment 7.471
Multiple Sequence Alignment - LSU RNA
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 . 14.33 |===============================
Azure HBv2 - EPYC 7V12 . 16.06 |==================================
Azure HBv1 - EPYC 7551 . 22.07 |===============================================
Azure HC - Xeon 8168 ... 15.63 |=================================


LULESH 2.0.3

z/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 41636.60 |============================================
Azure HBv2 - EPYC 7V12 . 34803.54 |=====================================
Azure HBv1 - EPYC 7551 . 19011.46 |====================
Azure HC - Xeon 8168 ... 20846.59 |======================


GNU GMP GMPbench 6.2.1
Total Time
GMPbench Score > Higher Is Better
Azure HBv3 - EPYC 7V13 . 4893.4 |==============================================
Azure HBv2 - EPYC 7V12 . 4155.5 |=======================================
Azure HBv1 - EPYC 7551 . 3021.3 |============================
Azure HC - Xeon 8168 ... 4196.5 |=======================================


Zstd Compression 1.4.9
Compression Level: 8 - Compression Speed
MB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 3184.2 |==============================================
Azure HBv2 - EPYC 7V12 . 2653.1 |======================================
Azure HBv1 - EPYC 7551 . 920.1  |=============
Azure HC - Xeon 8168 ... 1188.2 |=================


Zstd Compression 1.4.9
Compression Level: 19 - Compression Speed
MB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 78.2 |================================================
Azure HBv2 - EPYC 7V12 . 69.5 |===========================================
Azure HBv1 - EPYC 7551 . 48.5 |==============================
Azure HC - Xeon 8168 ... 76.3 |===============================================


Zstd Compression 1.4.9
Compression Level: 19 - Decompression Speed
MB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 3717.5 |==============================================
Azure HBv2 - EPYC 7V12 . 2631.0 |=================================
Azure HBv1 - EPYC 7551 . 2005.4 |=========================
Azure HC - Xeon 8168 ... 1903.9 |========================


Zstd Compression 1.4.9
Compression Level: 8, Long Mode - Compression Speed
MB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 771.9 |===============================================
Azure HBv2 - EPYC 7V12 . 588.0 |====================================
Azure HBv1 - EPYC 7551 . 468.8 |=============================
Azure HC - Xeon 8168 ... 649.3 |========================================


Zstd Compression 1.4.9
Compression Level: 8, Long Mode - Decompression Speed
MB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 4256.8 |==============================================
Azure HBv2 - EPYC 7V12 . 3037.5 |=================================
Azure HBv1 - EPYC 7551 . 2339.6 |=========================
Azure HC - Xeon 8168 ... 2350.2 |=========================


Zstd Compression 1.4.9
Compression Level: 19, Long Mode - Decompression Speed
MB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 3727.5 |==============================================
Azure HBv2 - EPYC 7V12 . 2674.2 |=================================
Azure HBv1 - EPYC 7551 . 2019.3 |=========================
Azure HC - Xeon 8168 ... 1991.3 |=========================


Botan 2.17.3
Test: KASUMI
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 87.48 |===============================================
Azure HBv2 - EPYC 7V12 . 73.18 |=======================================
Azure HBv1 - EPYC 7551 . 57.95 |===============================
Azure HC - Xeon 8168 ... 76.15 |=========================================


Botan 2.17.3
Test: KASUMI - Decrypt
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 84.06 |===============================================
Azure HBv2 - EPYC 7V12 . 71.10 |========================================
Azure HBv1 - EPYC 7551 . 55.98 |===============================
Azure HC - Xeon 8168 ... 74.29 |==========================================


Botan 2.17.3
Test: AES-256
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 5412.13 |=============================================
Azure HBv2 - EPYC 7V12 . 3934.40 |=================================
Azure HBv1 - EPYC 7551 . 3144.31 |==========================
Azure HC - Xeon 8168 ... 3155.39 |==========================


Botan 2.17.3
Test: AES-256 - Decrypt
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 5407.48 |=============================================
Azure HBv2 - EPYC 7V12 . 3938.44 |=================================
Azure HBv1 - EPYC 7551 . 3151.23 |==========================
Azure HC - Xeon 8168 ... 3159.85 |==========================


Botan 2.17.3
Test: Twofish
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 346.32 |==============================================
Azure HBv2 - EPYC 7V12 . 280.90 |=====================================
Azure HBv1 - EPYC 7551 . 217.31 |=============================
Azure HC - Xeon 8168 ... 293.55 |=======================================


Botan 2.17.3
Test: Twofish - Decrypt
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 345.78 |==============================================
Azure HBv2 - EPYC 7V12 . 283.26 |======================================
Azure HBv1 - EPYC 7551 . 218.03 |=============================
Azure HC - Xeon 8168 ... 294.38 |=======================================


Botan 2.17.3
Test: Blowfish
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 424.74 |==============================================
Azure HBv2 - EPYC 7V12 . 348.43 |======================================
Azure HBv1 - EPYC 7551 . 273.04 |==============================
Azure HC - Xeon 8168 ... 367.94 |========================================


Botan 2.17.3
Test: Blowfish - Decrypt
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 425.16 |==============================================
Azure HBv2 - EPYC 7V12 . 349.15 |======================================
Azure HBv1 - EPYC 7551 . 272.73 |==============================
Azure HC - Xeon 8168 ... 365.55 |========================================


Botan 2.17.3
Test: CAST-256
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 133.69 |==============================================
Azure HBv2 - EPYC 7V12 . 113.60 |=======================================
Azure HBv1 - EPYC 7551 . 88.55  |==============================
Azure HC - Xeon 8168 ... 116.63 |========================================


Botan 2.17.3
Test: CAST-256 - Decrypt
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 133.67 |==============================================
Azure HBv2 - EPYC 7V12 . 113.72 |=======================================
Azure HBv1 - EPYC 7551 . 88.56  |==============================
Azure HC - Xeon 8168 ... 116.57 |========================================


Botan 2.17.3
Test: ChaCha20Poly1305
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 667.77 |==============================================
Azure HBv2 - EPYC 7V12 . 615.80 |==========================================
Azure HBv1 - EPYC 7551 . 303.24 |=====================
Azure HC - Xeon 8168 ... 633.22 |============================================


Botan 2.17.3
Test: ChaCha20Poly1305 - Decrypt
MiB/s > Higher Is Better
Azure HBv3 - EPYC 7V13 . 658.37 |==============================================
Azure HBv2 - EPYC 7V12 . 610.86 |===========================================
Azure HBv1 - EPYC 7551 . 300.18 |=====================
Azure HC - Xeon 8168 ... 626.92 |============================================


SVT-AV1 0.8
Encoder Mode: Enc Mode 0 - Input: 1080p
Frames Per Second > Higher Is Better
Azure HBv3 - EPYC 7V13 . 0.161 |===============================================
Azure HBv2 - EPYC 7V12 . 0.124 |====================================
Azure HBv1 - EPYC 7551 . 0.076 |======================
Azure HC - Xeon 8168 ... 0.111 |================================


SVT-AV1 0.8
Encoder Mode: Enc Mode 4 - Input: 1080p
Frames Per Second > Higher Is Better
Azure HBv3 - EPYC 7V13 . 12.275 |==============================================
Azure HBv2 - EPYC 7V12 . 9.512  |====================================
Azure HBv1 - EPYC 7551 . 4.669  |=================
Azure HC - Xeon 8168 ... 7.621  |=============================


SVT-AV1 0.8
Encoder Mode: Enc Mode 8 - Input: 1080p
Frames Per Second > Higher Is Better
Azure HBv3 - EPYC 7V13 . 94.03 |===============================================
Azure HBv2 - EPYC 7V12 . 78.10 |=======================================
Azure HBv1 - EPYC 7551 . 40.15 |====================
Azure HC - Xeon 8168 ... 57.38 |=============================


SVT-HEVC 1.5.0
Tuning: 1 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
Azure HBv3 - EPYC 7V13 . 45.39 |===============================================
Azure HBv2 - EPYC 7V12 . 36.12 |=====================================
Azure HBv1 - EPYC 7551 . 21.12 |======================
Azure HC - Xeon 8168 ... 23.87 |=========================


SVT-HEVC 1.5.0
Tuning: 7 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
Azure HBv3 - EPYC 7V13 . 378.01 |==============================================
Azure HBv2 - EPYC 7V12 . 166.90 |====================
Azure HBv1 - EPYC 7551 . 119.20 |===============
Azure HC - Xeon 8168 ... 256.28 |===============================


SVT-HEVC 1.5.0
Tuning: 10 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
Azure HBv3 - EPYC 7V13 . 548.33 |==============================================
Azure HBv2 - EPYC 7V12 . 379.91 |================================
Azure HBv1 - EPYC 7551 . 141.93 |============
Azure HC - Xeon 8168 ... 480.79 |========================================


SVT-VP9 0.3
Tuning: Visual Quality Optimized - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
Azure HBv3 - EPYC 7V13 . 337.71 |==============================================
Azure HBv2 - EPYC 7V12 . 140.59 |===================
Azure HBv1 - EPYC 7551 . 129.44 |==================
Azure HC - Xeon 8168 ... 299.95 |=========================================


Timed Linux Kernel Compilation 5.10.20
Time To Compile
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 . 42.01 |==================================
Azure HBv2 - EPYC 7V12 . 44.92 |====================================
Azure HBv1 - EPYC 7551 . 58.74 |===============================================
Azure HC - Xeon 8168 ... 55.32 |============================================


Timed LLVM Compilation 10.0
Time To Compile
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 . 163.76 |===========================
Azure HBv2 - EPYC 7V12 . 174.74 |============================
Azure HBv1 - EPYC 7551 . 283.29 |==============================================
Azure HC - Xeon 8168 ... 251.74 |=========================================


Timed Node.js Compilation 15.11
Time To Compile
Seconds < Lower Is Better
Azure HBv3 - EPYC 7V13 . 111.33 |==========================
Azure HBv2 - EPYC 7V12 . 118.97 |============================
Azure HBv1 - EPYC 7551 . 194.55 |==============================================
Azure HC - Xeon 8168 ... 189.10 |=============================================


oneDNN 2.1.2
Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 0.881307 |=====================
Azure HBv2 - EPYC 7V12 . 1.124840 |==========================
Azure HBv1 - EPYC 7551 . 1.878340 |============================================
Azure HC - Xeon 8168 ... 0.931073 |======================


oneDNN 2.1.2
Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 3.21204  |==============
Azure HBv2 - EPYC 7V12 . 9.68321  |==========================================
Azure HBv1 - EPYC 7551 . 10.22263 |============================================
Azure HC - Xeon 8168 ... 3.28160  |==============


oneDNN 2.1.2
Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 0.383855 |==========
Azure HBv2 - EPYC 7V12 . 0.441012 |===========
Azure HBv1 - EPYC 7551 . 1.763550 |============================================
Azure HC - Xeon 8168 ... 0.474311 |============


oneDNN 2.1.2
Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 9.50445  |===================================
Azure HBv2 - EPYC 7V12 . 12.10510 |============================================
Azure HBv1 - EPYC 7551 . 7.91569  |=============================
Azure HC - Xeon 8168 ... 2.67914  |==========


oneDNN 2.1.2
Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 1.58182 |==================
Azure HBv2 - EPYC 7V12 . 1.59557 |==================
Azure HBv1 - EPYC 7551 . 3.94077 |=============================================
Azure HC - Xeon 8168 ... 1.21181 |==============


oneDNN 2.1.2
Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 0.406686 |=======
Azure HBv2 - EPYC 7V12 . 1.031942 |===================
Azure HBv1 - EPYC 7551 . 2.405610 |============================================
Azure HC - Xeon 8168 ... 0.551467 |==========


oneDNN 2.1.2
Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 0.455682 |=======
Azure HBv2 - EPYC 7V12 . 0.732130 |============
Azure HBv1 - EPYC 7551 . 2.736210 |============================================
Azure HC - Xeon 8168 ... 0.668641 |===========


oneDNN 2.1.2
Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 875.17  |=======
Azure HBv2 - EPYC 7V12 . 1314.00 |===========
Azure HBv1 - EPYC 7551 . 5524.50 |=============================================
Azure HC - Xeon 8168 ... 744.36  |======


oneDNN 2.1.2
Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 530.90  |=======
Azure HBv2 - EPYC 7V12 . 778.31  |==========
Azure HBv1 - EPYC 7551 . 3344.14 |=============================================
Azure HC - Xeon 8168 ... 462.86  |======


oneDNN 2.1.2
Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 962.34  |========
Azure HBv2 - EPYC 7V12 . 1287.03 |==========
Azure HBv1 - EPYC 7551 . 5539.48 |=============================================
Azure HC - Xeon 8168 ... 746.46  |======


oneDNN 2.1.2
Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 561.77  |=======
Azure HBv2 - EPYC 7V12 . 791.46  |===========
Azure HBv1 - EPYC 7551 . 3373.88 |=============================================
Azure HC - Xeon 8168 ... 459.58  |======


oneDNN 2.1.2
Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 0.255501 |=======
Azure HBv2 - EPYC 7V12 . 0.350347 |==========
Azure HBv1 - EPYC 7551 . 1.512710 |============================================
Azure HC - Xeon 8168 ... 0.352180 |==========


oneDNN 2.1.2
Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 843.10  |=======
Azure HBv2 - EPYC 7V12 . 1294.53 |===========
Azure HBv1 - EPYC 7551 . 5355.24 |=============================================
Azure HC - Xeon 8168 ... 753.36  |======


oneDNN 2.1.2
Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 540.19  |=======
Azure HBv2 - EPYC 7V12 . 796.82  |==========
Azure HBv1 - EPYC 7551 . 3423.15 |=============================================
Azure HC - Xeon 8168 ... 458.20  |======


oneDNN 2.1.2
Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 0.445223 |=================
Azure HBv2 - EPYC 7V12 . 0.524737 |====================
Azure HBv1 - EPYC 7551 . 1.154650 |============================================
Azure HC - Xeon 8168 ... 0.398005 |===============


FinanceBench 2016-07-25
Benchmark: Repo OpenMP
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 59196.55  |=======================
Azure HBv2 - EPYC 7V12 . 75154.26  |==============================
Azure HBv1 - EPYC 7551 . 108606.50 |===========================================
Azure HC - Xeon 8168 ... 71609.07  |============================


FinanceBench 2016-07-25
Benchmark: Bonds OpenMP
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 104884.29 |=======================
Azure HBv2 - EPYC 7V12 . 133719.33 |=============================
Azure HBv1 - EPYC 7551 . 195702.80 |===========================================
Azure HC - Xeon 8168 ... 130250.45 |=============================


GROMACS 2020.3
Water Benchmark
Ns Per Day > Higher Is Better
Azure HBv3 - EPYC 7V13 . 9.041 |===============================================
Azure HBv2 - EPYC 7V12 . 8.458 |============================================
Azure HBv1 - EPYC 7551 . 3.288 |=================
Azure HC - Xeon 8168 ... 4.866 |=========================


TensorFlow Lite 2020-08-23
Model: SqueezeNet
Microseconds < Lower Is Better
Azure HBv3 - EPYC 7V13 . 66320.4 |===============================
Azure HBv2 - EPYC 7V12 . 74885.4 |===================================
Azure HBv1 - EPYC 7551 . 95206.2 |=============================================
Azure HC - Xeon 8168 ... 73517.3 |===================================


Mobile Neural Network 1.1.3
Model: SqueezeNetV1.0
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 8.224  |======================
Azure HBv2 - EPYC 7V12 . 14.136 |======================================
Azure HBv1 - EPYC 7551 . 17.194 |==============================================
Azure HC - Xeon 8168 ... 8.226  |======================


Mobile Neural Network 1.1.3
Model: resnet-v2-50
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 29.09 |======================
Azure HBv2 - EPYC 7V12 . 52.53 |========================================
Azure HBv1 - EPYC 7551 . 62.45 |===============================================
Azure HC - Xeon 8168 ... 29.01 |======================


Mobile Neural Network 1.1.3
Model: inception-v3
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 34.71 |=====================
Azure HBv2 - EPYC 7V12 . 55.36 |==================================
Azure HBv1 - EPYC 7551 . 76.80 |===============================================
Azure HC - Xeon 8168 ... 35.67 |======================


TNN 0.2.3
Target: CPU - Model: SqueezeNet v1.1
ms < Lower Is Better
Azure HBv3 - EPYC 7V13 . 272.61 |==============================
Azure HBv2 - EPYC 7V12 . 323.62 |===================================
Azure HBv1 - EPYC 7551 . 420.05 |==============================================
Azure HC - Xeon 8168 ... 398.40 |============================================


PlaidML
FP16: No - Mode: Inference - Network: VGG16 - Device: CPU
FPS > Higher Is Better
Azure HBv3 - EPYC 7V13 . 38.39 |===========================================
Azure HBv2 - EPYC 7V12 . 25.57 |=============================
Azure HBv1 - EPYC 7551 . 19.88 |======================
Azure HC - Xeon 8168 ... 41.54 |===============================================


PlaidML
FP16: No - Mode: Inference - Network: VGG19 - Device: CPU
FPS > Higher Is Better
Azure HBv3 - EPYC 7V13 . 34.53 |===============================================
Azure HBv2 - EPYC 7V12 . 23.12 |===============================
Azure HBv1 - EPYC 7551 . 15.97 |======================
Azure HC - Xeon 8168 ... 34.66 |===============================================


PlaidML
FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU
FPS > Higher Is Better
Azure HBv3 - EPYC 7V13 . 6.27 |================================================
Azure HBv2 - EPYC 7V12 . 5.60 |===========================================
Azure HBv1 - EPYC 7551 . 4.80 |=====================================
Azure HC - Xeon 8168 ... 4.91 |======================================