Microsoft Azure EPYC 7003 HBv3 Benchmarks Azure HBv3 vs. Azure HBv2 benchmarks. Azure HBv3: Processor: 2 x AMD EPYC 7V13 64-Core (120 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.1 BIOS), Memory: 442GB, Disk: 2 x 960GB Microsoft NVMe Direct Disk + 32GB Virtual Disk + 515GB Virtual Disk, Graphics: hyperv_fb OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft Azure HBv2: Processor: 2 x AMD EPYC 7V12 64-Core (120 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.0 BIOS), Memory: 450GB, Disk: 960GB Microsoft NVMe Direct Disk + 32GB Virtual Disk + 515GB Virtual Disk, Graphics: hyperv_fb OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft miniFE 2.2 Problem Size: Small CG Mflops > Higher Is Better Azure HBv3 . 13785.30 |======================================================== Azure HBv2 . 13165.09 |===================================================== PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: CPU FPS > Higher Is Better Azure HBv3 . 38.39 |=========================================================== Azure HBv2 . 25.57 |======================================= PlaidML FP16: No - Mode: Inference - Network: VGG19 - Device: CPU FPS > Higher Is Better Azure HBv3 . 34.53 |=========================================================== Azure HBv2 . 23.12 |======================================== PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU FPS > Higher Is Better Azure HBv3 . 6.27 |============================================================ Azure HBv2 . 5.60 |====================================================== SVT-AV1 0.8 Encoder Mode: Enc Mode 0 - Input: 1080p Frames Per Second > Higher Is Better Azure HBv3 . 0.161 |=========================================================== Azure HBv2 . 0.124 |============================================= SVT-AV1 0.8 Encoder Mode: Enc Mode 4 - Input: 1080p Frames Per Second > Higher Is Better Azure HBv3 . 12.275 |========================================================== Azure HBv2 . 9.512 |============================================= SVT-AV1 0.8 Encoder Mode: Enc Mode 8 - Input: 1080p Frames Per Second > Higher Is Better Azure HBv3 . 94.03 |=========================================================== Azure HBv2 . 78.10 |================================================= SVT-HEVC 1.5.0 Tuning: 1 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 . 45.39 |=========================================================== Azure HBv2 . 36.12 |=============================================== SVT-HEVC 1.5.0 Tuning: 7 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 . 378.01 |========================================================== Azure HBv2 . 166.90 |========================== SVT-HEVC 1.5.0 Tuning: 10 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 . 548.33 |========================================================== Azure HBv2 . 379.91 |======================================== SVT-VP9 0.3 Tuning: VMAF Optimized - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 . 357.06 |========================================================== Azure HBv2 . 140.30 |======================= SVT-VP9 0.3 Tuning: PSNR/SSIM Optimized - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 . 376.91 |========================================================== Azure HBv2 . 163.51 |========================= SVT-VP9 0.3 Tuning: Visual Quality Optimized - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 . 337.71 |========================================================== Azure HBv2 . 140.59 |======================== High Performance Conjugate Gradient 3.1 GFLOP/s > Higher Is Better Azure HBv3 . 39.06 |=========================================================== Azure HBv2 . 37.27 |======================================================== GNU GMP GMPbench 6.2.1 Total Time GMPbench Score > Higher Is Better Azure HBv3 . 4893.4 |========================================================== Azure HBv2 . 4155.5 |================================================= Zstd Compression 1.4.9 Compression Level: 8 - Compression Speed MB/s > Higher Is Better Azure HBv3 . 3184.2 |========================================================== Azure HBv2 . 2653.1 |================================================ Zstd Compression 1.4.9 Compression Level: 19 - Compression Speed MB/s > Higher Is Better Azure HBv3 . 78.2 |============================================================ Azure HBv2 . 69.5 |===================================================== Zstd Compression 1.4.9 Compression Level: 19 - Decompression Speed MB/s > Higher Is Better Azure HBv3 . 3717.5 |========================================================== Azure HBv2 . 2631.0 |========================================= Zstd Compression 1.4.9 Compression Level: 8, Long Mode - Compression Speed MB/s > Higher Is Better Azure HBv3 . 771.9 |=========================================================== Azure HBv2 . 588.0 |============================================= Zstd Compression 1.4.9 Compression Level: 8, Long Mode - Decompression Speed MB/s > Higher Is Better Azure HBv3 . 4256.8 |========================================================== Azure HBv2 . 3037.5 |========================================= Zstd Compression 1.4.9 Compression Level: 19, Long Mode - Compression Speed MB/s > Higher Is Better Azure HBv3 . 36.3 |============================================================ Azure HBv2 . 33.4 |======================================================= Zstd Compression 1.4.9 Compression Level: 19, Long Mode - Decompression Speed MB/s > Higher Is Better Azure HBv3 . 3727.5 |========================================================== Azure HBv2 . 2674.2 |========================================== QuantLib 1.21 MFLOPS > Higher Is Better Azure HBv3 . 2299.3 |========================================================== Azure HBv2 . 1725.2 |============================================ Botan 2.17.3 Test: KASUMI MiB/s > Higher Is Better Azure HBv3 . 87.48 |=========================================================== Azure HBv2 . 73.18 |================================================= Botan 2.17.3 Test: KASUMI - Decrypt MiB/s > Higher Is Better Azure HBv3 . 84.06 |=========================================================== Azure HBv2 . 71.10 |================================================== Botan 2.17.3 Test: AES-256 MiB/s > Higher Is Better Azure HBv3 . 5412.13 |========================================================= Azure HBv2 . 3934.40 |========================================= Botan 2.17.3 Test: AES-256 - Decrypt MiB/s > Higher Is Better Azure HBv3 . 5407.48 |========================================================= Azure HBv2 . 3938.44 |========================================== Botan 2.17.3 Test: Twofish MiB/s > Higher Is Better Azure HBv3 . 346.32 |========================================================== Azure HBv2 . 280.90 |=============================================== Botan 2.17.3 Test: Twofish - Decrypt MiB/s > Higher Is Better Azure HBv3 . 345.78 |========================================================== Azure HBv2 . 283.26 |================================================ Botan 2.17.3 Test: Blowfish MiB/s > Higher Is Better Azure HBv3 . 424.74 |========================================================== Azure HBv2 . 348.43 |================================================ Botan 2.17.3 Test: Blowfish - Decrypt MiB/s > Higher Is Better Azure HBv3 . 425.16 |========================================================== Azure HBv2 . 349.15 |================================================ Botan 2.17.3 Test: CAST-256 MiB/s > Higher Is Better Azure HBv3 . 133.69 |========================================================== Azure HBv2 . 113.60 |================================================= Botan 2.17.3 Test: CAST-256 - Decrypt MiB/s > Higher Is Better Azure HBv3 . 133.67 |========================================================== Azure HBv2 . 113.72 |================================================= Botan 2.17.3 Test: ChaCha20Poly1305 MiB/s > Higher Is Better Azure HBv3 . 667.77 |========================================================== Azure HBv2 . 615.80 |===================================================== Botan 2.17.3 Test: ChaCha20Poly1305 - Decrypt MiB/s > Higher Is Better Azure HBv3 . 658.37 |========================================================== Azure HBv2 . 610.86 |====================================================== GROMACS 2020.3 Water Benchmark Ns Per Day > Higher Is Better Azure HBv3 . 9.041 |=========================================================== Azure HBv2 . 8.458 |======================================================= Kripke 1.2.4 Throughput FoM > Higher Is Better Azure HBv3 . 82341865 |======================================================== Azure HBv2 . 43855550 |============================== NAS Parallel Benchmarks 3.4 Test / Class: LU.C Total Mop/s > Higher Is Better Azure HBv3 . 56682.82 |======================================================== Azure HBv2 . 53829.34 |===================================================== LULESH 2.0.3 z/s > Higher Is Better Azure HBv3 . 41636.60 |======================================================== Azure HBv2 . 34803.54 |=============================================== NAMD 2.14 ATPase Simulation - 327,506 Atoms days/ns < Lower Is Better Azure HBv3 . 0.27566 |==================================================== Azure HBv2 . 0.30056 |========================================================= Pennant 1.0.1 Test: sedovbig Hydro Cycle Time - Seconds < Lower Is Better Azure HBv3 . 5.833419 |====================================================== Azure HBv2 . 6.026449 |======================================================== Pennant 1.0.1 Test: leblancbig Hydro Cycle Time - Seconds < Lower Is Better Azure HBv3 . 3.337201 |====================================================== Azure HBv2 . 3.486503 |======================================================== TensorFlow Lite 2020-08-23 Model: SqueezeNet Microseconds < Lower Is Better Azure HBv3 . 66320.4 |================================================== Azure HBv2 . 74885.4 |========================================================= oneDNN 2.1.2 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 0.881307 |============================================ Azure HBv2 . 1.124840 |======================================================== oneDNN 2.1.2 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 3.21204 |=================== Azure HBv2 . 9.68321 |========================================================= oneDNN 2.1.2 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 0.383855 |================================================= Azure HBv2 . 0.441012 |======================================================== oneDNN 2.1.2 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 0.575238 |======================================================= Azure HBv2 . 0.581981 |======================================================== oneDNN 2.1.2 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 9.50445 |============================================ Azure HBv2 . 12.10510 |======================================================== oneDNN 2.1.2 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 1.58182 |========================================================= Azure HBv2 . 1.59557 |========================================================= oneDNN 2.1.2 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 0.406686 |====================== Azure HBv2 . 1.031942 |======================================================== oneDNN 2.1.2 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 0.455682 |=================================== Azure HBv2 . 0.732130 |======================================================== oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 875.17 |====================================== Azure HBv2 . 1314.00 |========================================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 530.90 |======================================== Azure HBv2 . 778.31 |========================================================== oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 962.34 |=========================================== Azure HBv2 . 1287.03 |========================================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 561.77 |========================================= Azure HBv2 . 791.46 |========================================================== oneDNN 2.1.2 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 0.255501 |========================================= Azure HBv2 . 0.350347 |======================================================== oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better Azure HBv3 . 843.10 |===================================== Azure HBv2 . 1294.53 |========================================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better Azure HBv3 . 540.19 |======================================= Azure HBv2 . 796.82 |========================================================== oneDNN 2.1.2 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 0.445223 |================================================ Azure HBv2 . 0.524737 |======================================================== FinanceBench 2016-07-25 Benchmark: Repo OpenMP ms < Lower Is Better Azure HBv3 . 59196.55 |============================================ Azure HBv2 . 75154.26 |======================================================== FinanceBench 2016-07-25 Benchmark: Bonds OpenMP ms < Lower Is Better Azure HBv3 . 104884.29 |=========================================== Azure HBv2 . 133719.33 |======================================================= Mobile Neural Network 1.1.3 Model: SqueezeNetV1.0 ms < Lower Is Better Azure HBv3 . 8.224 |================================== Azure HBv2 . 14.136 |========================================================== Mobile Neural Network 1.1.3 Model: resnet-v2-50 ms < Lower Is Better Azure HBv3 . 29.09 |================================= Azure HBv2 . 52.53 |=========================================================== Mobile Neural Network 1.1.3 Model: MobileNetV2_224 ms < Lower Is Better Azure HBv3 . 4.782 |====================== Azure HBv2 . 12.527 |========================================================== Mobile Neural Network 1.1.3 Model: mobilenet-v1-1.0 ms < Lower Is Better Azure HBv3 . 3.950 |============================= Azure HBv2 . 8.030 |=========================================================== Mobile Neural Network 1.1.3 Model: inception-v3 ms < Lower Is Better Azure HBv3 . 34.71 |===================================== Azure HBv2 . 55.36 |=========================================================== NCNN 20201218 Target: CPU - Model: mobilenet ms < Lower Is Better Azure HBv3 . 27.87 |=============================== Azure HBv2 . 52.56 |=========================================================== NCNN 20201218 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better Azure HBv3 . 23.24 |===================================== Azure HBv2 . 37.20 |=========================================================== NCNN 20201218 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better Azure HBv3 . 13.71 |====================================== Azure HBv2 . 21.39 |=========================================================== NCNN 20201218 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better Azure HBv3 . 21.04 |====================================== Azure HBv2 . 32.42 |=========================================================== NCNN 20201218 Target: CPU - Model: vgg16 ms < Lower Is Better Azure HBv3 . 47.67 |===================== Azure HBv2 . 133.78 |========================================================== NCNN 20201218 Target: CPU - Model: alexnet ms < Lower Is Better Azure HBv3 . 6.89 |====================================== Azure HBv2 . 10.80 |=========================================================== NCNN 20201218 Target: CPU - Model: resnet50 ms < Lower Is Better Azure HBv3 . 30.03 |=========================== Azure HBv2 . 64.80 |=========================================================== TNN 0.2.3 Target: CPU - Model: SqueezeNet v1.1 ms < Lower Is Better Azure HBv3 . 272.61 |================================================= Azure HBv2 . 323.62 |========================================================== CloverLeaf Lagrangian-Eulerian Hydrodynamics Seconds < Lower Is Better Azure HBv3 . 16.66 |========================================= Azure HBv2 . 23.78 |=========================================================== Rodinia 3.1 Test: OpenMP LavaMD Seconds < Lower Is Better Azure HBv3 . 37.80 |========================================================= Azure HBv2 . 39.20 |=========================================================== Rodinia 3.1 Test: OpenMP HotSpot3D Seconds < Lower Is Better Azure HBv3 . 82.49 |============================================ Azure HBv2 . 107.98 |========================================================== Rodinia 3.1 Test: OpenMP Leukocyte Seconds < Lower Is Better Azure HBv3 . 49.35 |=================================================== Azure HBv2 . 57.04 |=========================================================== Rodinia 3.1 Test: OpenMP CFD Solver Seconds < Lower Is Better Azure HBv3 . 8.460 |====================================== Azure HBv2 . 13.042 |========================================================== Rodinia 3.1 Test: OpenMP Streamcluster Seconds < Lower Is Better Azure HBv3 . 7.379 |================================= Azure HBv2 . 12.912 |========================================================== Timed HMMer Search 3.3.1 Pfam Database Search Seconds < Lower Is Better Azure HBv3 . 175.24 |================================================= Azure HBv2 . 207.87 |========================================================== Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d Seconds < Lower Is Better Azure HBv3 . 287.60 |==================================================== Azure HBv2 . 318.91 |========================================================== Timed MAFFT Alignment 7.471 Multiple Sequence Alignment - LSU RNA Seconds < Lower Is Better Azure HBv3 . 14.33 |===================================================== Azure HBv2 . 16.06 |=========================================================== Timed Linux Kernel Compilation 5.10.20 Time To Compile Seconds < Lower Is Better Azure HBv3 . 42.01 |======================================================= Azure HBv2 . 44.92 |=========================================================== Timed LLVM Compilation 10.0 Time To Compile Seconds < Lower Is Better Azure HBv3 . 163.76 |====================================================== Azure HBv2 . 174.74 |========================================================== Timed Node.js Compilation 15.11 Time To Compile Seconds < Lower Is Better Azure HBv3 . 111.33 |====================================================== Azure HBv2 . 118.97 |==========================================================