Microsoft Azure EPYC 7003 HBv3 Benchmarks Azure HBv3 vs. Azure HBv2 benchmarks. Azure HBv3: Processor: 2 x AMD EPYC 7V13 64-Core (120 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.1 BIOS), Memory: 442GB, Disk: 2 x 960GB Microsoft NVMe Direct Disk + 32GB Virtual Disk + 515GB Virtual Disk, Graphics: hyperv_fb OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft Azure HBv2: Processor: 2 x AMD EPYC 7V12 64-Core (120 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.0 BIOS), Memory: 450GB, Disk: 960GB Microsoft NVMe Direct Disk + 32GB Virtual Disk + 515GB Virtual Disk, Graphics: hyperv_fb OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft Azure HBv1: Processor: 2 x AMD EPYC 7551 32-Core (60 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.0 BIOS), Memory: 226GB, Disk: 32GB Virtual Disk + 752GB Virtual Disk, Graphics: hyperv_fb OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft QuantLib 1.21 MFLOPS > Higher Is Better Azure HBv3 . 2299.3 |========================================================== Azure HBv2 . 1725.2 |============================================ Azure HBv1 . 1251.7 |================================ High Performance Conjugate Gradient 3.1 GFLOP/s > Higher Is Better Azure HBv3 . 39.06 |=========================================================== Azure HBv2 . 37.27 |======================================================== Azure HBv1 . 30.43 |============================================== NAS Parallel Benchmarks 3.4 Test / Class: LU.C Total Mop/s > Higher Is Better Azure HBv3 . 56682.82 |======================================================== Azure HBv2 . 53829.34 |===================================================== Azure HBv1 . 25304.19 |========================= miniFE 2.2 Problem Size: Small CG Mflops > Higher Is Better Azure HBv3 . 13785.30 |======================================================== Azure HBv2 . 13165.09 |===================================================== Azure HBv1 . 11999.57 |================================================= CloverLeaf Lagrangian-Eulerian Hydrodynamics Seconds < Lower Is Better Azure HBv3 . 16.66 |======================================= Azure HBv2 . 23.78 |======================================================== Azure HBv1 . 25.00 |=========================================================== Rodinia 3.1 Test: OpenMP LavaMD Seconds < Lower Is Better Azure HBv3 . 37.80 |========================= Azure HBv2 . 39.20 |========================== Azure HBv1 . 90.18 |=========================================================== Rodinia 3.1 Test: OpenMP HotSpot3D Seconds < Lower Is Better Azure HBv3 . 82.49 |================================= Azure HBv2 . 107.98 |=========================================== Azure HBv1 . 145.57 |========================================================== Rodinia 3.1 Test: OpenMP Leukocyte Seconds < Lower Is Better Azure HBv3 . 49.35 |=========================================== Azure HBv2 . 57.04 |================================================== Azure HBv1 . 67.30 |=========================================================== Rodinia 3.1 Test: OpenMP CFD Solver Seconds < Lower Is Better Azure HBv3 . 8.460 |====================================== Azure HBv2 . 13.042 |========================================================== Azure HBv1 . 12.940 |========================================================== Rodinia 3.1 Test: OpenMP Streamcluster Seconds < Lower Is Better Azure HBv3 . 7.379 |========== Azure HBv2 . 12.912 |================= Azure HBv1 . 44.065 |========================================================== NAMD 2.14 ATPase Simulation - 327,506 Atoms days/ns < Lower Is Better Azure HBv3 . 0.27566 |====================== Azure HBv2 . 0.30056 |======================== Azure HBv1 . 0.70947 |========================================================= Pennant 1.0.1 Test: sedovbig Hydro Cycle Time - Seconds < Lower Is Better Azure HBv3 . 5.833419 |===================== Azure HBv2 . 6.026449 |===================== Azure HBv1 . 15.528990 |======================================================= Pennant 1.0.1 Test: leblancbig Hydro Cycle Time - Seconds < Lower Is Better Azure HBv3 . 3.337201 |================== Azure HBv2 . 3.486503 |=================== Azure HBv1 . 10.337640 |======================================================= Timed HMMer Search 3.3.1 Pfam Database Search Seconds < Lower Is Better Azure HBv3 . 175.24 |================================================= Azure HBv2 . 207.87 |========================================================== Azure HBv1 . 209.39 |========================================================== Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d Seconds < Lower Is Better Azure HBv3 . 287.60 |===================================== Azure HBv2 . 318.91 |========================================= Azure HBv1 . 455.81 |========================================================== Timed MAFFT Alignment 7.471 Multiple Sequence Alignment - LSU RNA Seconds < Lower Is Better Azure HBv3 . 14.33 |====================================== Azure HBv2 . 16.06 |=========================================== Azure HBv1 . 22.07 |=========================================================== LULESH 2.0.3 z/s > Higher Is Better Azure HBv3 . 41636.60 |======================================================== Azure HBv2 . 34803.54 |=============================================== Azure HBv1 . 19011.46 |========================== GNU GMP GMPbench 6.2.1 Total Time GMPbench Score > Higher Is Better Azure HBv3 . 4893.4 |========================================================== Azure HBv2 . 4155.5 |================================================= Azure HBv1 . 3021.3 |==================================== Zstd Compression 1.4.9 Compression Level: 8 - Compression Speed MB/s > Higher Is Better Azure HBv3 . 3184.2 |========================================================== Azure HBv2 . 2653.1 |================================================ Azure HBv1 . 920.1 |================= Zstd Compression 1.4.9 Compression Level: 19 - Compression Speed MB/s > Higher Is Better Azure HBv3 . 78.2 |============================================================ Azure HBv2 . 69.5 |===================================================== Azure HBv1 . 48.5 |===================================== Zstd Compression 1.4.9 Compression Level: 19 - Decompression Speed MB/s > Higher Is Better Azure HBv3 . 3717.5 |========================================================== Azure HBv2 . 2631.0 |========================================= Azure HBv1 . 2005.4 |=============================== Zstd Compression 1.4.9 Compression Level: 8, Long Mode - Compression Speed MB/s > Higher Is Better Azure HBv3 . 771.9 |=========================================================== Azure HBv2 . 588.0 |============================================= Azure HBv1 . 468.8 |==================================== Zstd Compression 1.4.9 Compression Level: 8, Long Mode - Decompression Speed MB/s > Higher Is Better Azure HBv3 . 4256.8 |========================================================== Azure HBv2 . 3037.5 |========================================= Azure HBv1 . 2339.6 |================================ Zstd Compression 1.4.9 Compression Level: 19, Long Mode - Compression Speed MB/s > Higher Is Better Azure HBv3 . 36.3 |============================================================ Azure HBv2 . 33.4 |======================================================= Azure HBv1 . 25.1 |========================================= Zstd Compression 1.4.9 Compression Level: 19, Long Mode - Decompression Speed MB/s > Higher Is Better Azure HBv3 . 3727.5 |========================================================== Azure HBv2 . 2674.2 |========================================== Azure HBv1 . 2019.3 |=============================== Botan 2.17.3 Test: KASUMI MiB/s > Higher Is Better Azure HBv3 . 87.48 |=========================================================== Azure HBv2 . 73.18 |================================================= Azure HBv1 . 57.95 |======================================= Botan 2.17.3 Test: KASUMI - Decrypt MiB/s > Higher Is Better Azure HBv3 . 84.06 |=========================================================== Azure HBv2 . 71.10 |================================================== Azure HBv1 . 55.98 |======================================= Botan 2.17.3 Test: AES-256 MiB/s > Higher Is Better Azure HBv3 . 5412.13 |========================================================= Azure HBv2 . 3934.40 |========================================= Azure HBv1 . 3144.31 |================================= Botan 2.17.3 Test: AES-256 - Decrypt MiB/s > Higher Is Better Azure HBv3 . 5407.48 |========================================================= Azure HBv2 . 3938.44 |========================================== Azure HBv1 . 3151.23 |================================= Botan 2.17.3 Test: Twofish MiB/s > Higher Is Better Azure HBv3 . 346.32 |========================================================== Azure HBv2 . 280.90 |=============================================== Azure HBv1 . 217.31 |==================================== Botan 2.17.3 Test: Twofish - Decrypt MiB/s > Higher Is Better Azure HBv3 . 345.78 |========================================================== Azure HBv2 . 283.26 |================================================ Azure HBv1 . 218.03 |===================================== Botan 2.17.3 Test: Blowfish MiB/s > Higher Is Better Azure HBv3 . 424.74 |========================================================== Azure HBv2 . 348.43 |================================================ Azure HBv1 . 273.04 |===================================== Botan 2.17.3 Test: Blowfish - Decrypt MiB/s > Higher Is Better Azure HBv3 . 425.16 |========================================================== Azure HBv2 . 349.15 |================================================ Azure HBv1 . 272.73 |===================================== Botan 2.17.3 Test: CAST-256 MiB/s > Higher Is Better Azure HBv3 . 133.69 |========================================================== Azure HBv2 . 113.60 |================================================= Azure HBv1 . 88.55 |====================================== Botan 2.17.3 Test: CAST-256 - Decrypt MiB/s > Higher Is Better Azure HBv3 . 133.67 |========================================================== Azure HBv2 . 113.72 |================================================= Azure HBv1 . 88.56 |====================================== Botan 2.17.3 Test: ChaCha20Poly1305 MiB/s > Higher Is Better Azure HBv3 . 667.77 |========================================================== Azure HBv2 . 615.80 |===================================================== Azure HBv1 . 303.24 |========================== Botan 2.17.3 Test: ChaCha20Poly1305 - Decrypt MiB/s > Higher Is Better Azure HBv3 . 658.37 |========================================================== Azure HBv2 . 610.86 |====================================================== Azure HBv1 . 300.18 |========================== SVT-AV1 0.8 Encoder Mode: Enc Mode 0 - Input: 1080p Frames Per Second > Higher Is Better Azure HBv3 . 0.161 |=========================================================== Azure HBv2 . 0.124 |============================================= Azure HBv1 . 0.076 |============================ SVT-AV1 0.8 Encoder Mode: Enc Mode 4 - Input: 1080p Frames Per Second > Higher Is Better Azure HBv3 . 12.275 |========================================================== Azure HBv2 . 9.512 |============================================= Azure HBv1 . 4.669 |====================== SVT-AV1 0.8 Encoder Mode: Enc Mode 8 - Input: 1080p Frames Per Second > Higher Is Better Azure HBv3 . 94.03 |=========================================================== Azure HBv2 . 78.10 |================================================= Azure HBv1 . 40.15 |========================= SVT-HEVC 1.5.0 Tuning: 1 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 . 45.39 |=========================================================== Azure HBv2 . 36.12 |=============================================== Azure HBv1 . 21.12 |=========================== SVT-HEVC 1.5.0 Tuning: 7 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 . 378.01 |========================================================== Azure HBv2 . 166.90 |========================== Azure HBv1 . 119.20 |================== SVT-HEVC 1.5.0 Tuning: 10 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 . 548.33 |========================================================== Azure HBv2 . 379.91 |======================================== Azure HBv1 . 141.93 |=============== SVT-VP9 0.3 Tuning: VMAF Optimized - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 . 357.06 |========================================================== Azure HBv2 . 140.30 |======================= Azure HBv1 . 132.23 |===================== SVT-VP9 0.3 Tuning: PSNR/SSIM Optimized - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 . 376.91 |========================================================== Azure HBv2 . 163.51 |========================= Azure HBv1 . 141.53 |====================== SVT-VP9 0.3 Tuning: Visual Quality Optimized - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 . 337.71 |========================================================== Azure HBv2 . 140.59 |======================== Azure HBv1 . 129.44 |====================== Timed Linux Kernel Compilation 5.10.20 Time To Compile Seconds < Lower Is Better Azure HBv3 . 42.01 |========================================== Azure HBv2 . 44.92 |============================================= Azure HBv1 . 58.74 |=========================================================== Timed LLVM Compilation 10.0 Time To Compile Seconds < Lower Is Better Azure HBv3 . 163.76 |================================== Azure HBv2 . 174.74 |==================================== Azure HBv1 . 283.29 |========================================================== Timed Node.js Compilation 15.11 Time To Compile Seconds < Lower Is Better Azure HBv3 . 111.33 |================================= Azure HBv2 . 118.97 |=================================== Azure HBv1 . 194.55 |========================================================== oneDNN 2.1.2 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 0.881307 |========================== Azure HBv2 . 1.124840 |================================== Azure HBv1 . 1.878340 |======================================================== oneDNN 2.1.2 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 3.21204 |================== Azure HBv2 . 9.68321 |===================================================== Azure HBv1 . 10.22263 |======================================================== oneDNN 2.1.2 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 0.383855 |============ Azure HBv2 . 0.441012 |============== Azure HBv1 . 1.763550 |======================================================== oneDNN 2.1.2 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 0.575238 |==== Azure HBv2 . 0.581981 |==== Azure HBv1 . 8.867520 |======================================================== oneDNN 2.1.2 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 9.50445 |============================================ Azure HBv2 . 12.10510 |======================================================== Azure HBv1 . 7.91569 |===================================== oneDNN 2.1.2 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 1.58182 |======================= Azure HBv2 . 1.59557 |======================= Azure HBv1 . 3.94077 |========================================================= oneDNN 2.1.2 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 0.406686 |========= Azure HBv2 . 1.031942 |======================== Azure HBv1 . 2.405610 |======================================================== oneDNN 2.1.2 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 0.455682 |========= Azure HBv2 . 0.732130 |=============== Azure HBv1 . 2.736210 |======================================================== oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 875.17 |========= Azure HBv2 . 1314.00 |============== Azure HBv1 . 5524.50 |========================================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 530.90 |========= Azure HBv2 . 778.31 |============= Azure HBv1 . 3344.14 |========================================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 962.34 |========== Azure HBv2 . 1287.03 |============= Azure HBv1 . 5539.48 |========================================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 561.77 |========= Azure HBv2 . 791.46 |============= Azure HBv1 . 3373.88 |========================================================= oneDNN 2.1.2 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 0.255501 |========= Azure HBv2 . 0.350347 |============= Azure HBv1 . 1.512710 |======================================================== oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better Azure HBv3 . 843.10 |========= Azure HBv2 . 1294.53 |============== Azure HBv1 . 5355.24 |========================================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better Azure HBv3 . 540.19 |========= Azure HBv2 . 796.82 |============= Azure HBv1 . 3423.15 |========================================================= oneDNN 2.1.2 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 . 0.445223 |====================== Azure HBv2 . 0.524737 |========================= Azure HBv1 . 1.154650 |======================================================== FinanceBench 2016-07-25 Benchmark: Repo OpenMP ms < Lower Is Better Azure HBv3 . 59196.55 |============================== Azure HBv2 . 75154.26 |====================================== Azure HBv1 . 108606.50 |======================================================= FinanceBench 2016-07-25 Benchmark: Bonds OpenMP ms < Lower Is Better Azure HBv3 . 104884.29 |============================= Azure HBv2 . 133719.33 |====================================== Azure HBv1 . 195702.80 |======================================================= GROMACS 2020.3 Water Benchmark Ns Per Day > Higher Is Better Azure HBv3 . 9.041 |=========================================================== Azure HBv2 . 8.458 |======================================================= Azure HBv1 . 3.288 |===================== TensorFlow Lite 2020-08-23 Model: SqueezeNet Microseconds < Lower Is Better Azure HBv3 . 66320.4 |======================================== Azure HBv2 . 74885.4 |============================================= Azure HBv1 . 95206.2 |========================================================= Mobile Neural Network 1.1.3 Model: SqueezeNetV1.0 ms < Lower Is Better Azure HBv3 . 8.224 |============================ Azure HBv2 . 14.136 |================================================ Azure HBv1 . 17.194 |========================================================== Mobile Neural Network 1.1.3 Model: resnet-v2-50 ms < Lower Is Better Azure HBv3 . 29.09 |=========================== Azure HBv2 . 52.53 |================================================== Azure HBv1 . 62.45 |=========================================================== Mobile Neural Network 1.1.3 Model: MobileNetV2_224 ms < Lower Is Better Azure HBv3 . 4.782 |====================== Azure HBv2 . 12.527 |========================================================== Azure HBv1 . 9.802 |============================================= Mobile Neural Network 1.1.3 Model: mobilenet-v1-1.0 ms < Lower Is Better Azure HBv3 . 3.950 |============================= Azure HBv2 . 8.030 |=========================================================== Azure HBv1 . 6.224 |============================================== Mobile Neural Network 1.1.3 Model: inception-v3 ms < Lower Is Better Azure HBv3 . 34.71 |=========================== Azure HBv2 . 55.36 |=========================================== Azure HBv1 . 76.80 |=========================================================== NCNN 20201218 Target: CPU - Model: mobilenet ms < Lower Is Better Azure HBv3 . 27.87 |=============================== Azure HBv2 . 52.56 |=========================================================== Azure HBv1 . 43.12 |================================================ NCNN 20201218 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better Azure HBv3 . 23.24 |===================================== Azure HBv2 . 37.20 |=========================================================== Azure HBv1 . 18.50 |============================= NCNN 20201218 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better Azure HBv3 . 13.71 |====================================== Azure HBv2 . 21.39 |=========================================================== Azure HBv1 . 19.26 |===================================================== NCNN 20201218 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better Azure HBv3 . 21.04 |====================================== Azure HBv2 . 32.42 |=========================================================== Azure HBv1 . 23.17 |========================================== NCNN 20201218 Target: CPU - Model: vgg16 ms < Lower Is Better Azure HBv3 . 47.67 |=================== Azure HBv2 . 133.78 |==================================================== Azure HBv1 . 147.88 |========================================================== NCNN 20201218 Target: CPU - Model: alexnet ms < Lower Is Better Azure HBv3 . 6.89 |=============== Azure HBv2 . 10.80 |======================== Azure HBv1 . 26.88 |=========================================================== NCNN 20201218 Target: CPU - Model: resnet50 ms < Lower Is Better Azure HBv3 . 30.03 |=========================== Azure HBv2 . 64.80 |=========================================================== Azure HBv1 . 63.25 |========================================================== TNN 0.2.3 Target: CPU - Model: SqueezeNet v1.1 ms < Lower Is Better Azure HBv3 . 272.61 |====================================== Azure HBv2 . 323.62 |============================================= Azure HBv1 . 420.05 |========================================================== PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: CPU FPS > Higher Is Better Azure HBv3 . 38.39 |=========================================================== Azure HBv2 . 25.57 |======================================= Azure HBv1 . 19.88 |=============================== PlaidML FP16: No - Mode: Inference - Network: VGG19 - Device: CPU FPS > Higher Is Better Azure HBv3 . 34.53 |=========================================================== Azure HBv2 . 23.12 |======================================== Azure HBv1 . 15.97 |=========================== PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU FPS > Higher Is Better Azure HBv3 . 6.27 |============================================================ Azure HBv2 . 5.60 |====================================================== Azure HBv1 . 4.80 |============================================== Kripke 1.2.4 Throughput FoM > Higher Is Better Azure HBv3 . 82341865 |======================================================== Azure HBv2 . 43855550 |============================== Azure HBv1 . 38769097 |========================== Zstd Compression 1.4.9 Compression Level: 8 - Decompression Speed MB/s > Higher Is Better Azure HBv1 . 2163.2 |========================================================== NCNN 20201218 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better Azure HBv1 . 17.35 |=========================================================== NCNN 20201218 Target: CPU - Model: mnasnet ms < Lower Is Better Azure HBv1 . 16.68 |=========================================================== NCNN 20201218 Target: CPU - Model: blazeface ms < Lower Is Better Azure HBv1 . 7.99 |============================================================ NCNN 20201218 Target: CPU - Model: googlenet ms < Lower Is Better Azure HBv1 . 41.49 |=========================================================== NCNN 20201218 Target: CPU - Model: resnet18 ms < Lower Is Better Azure HBv1 . 39.24 |=========================================================== NCNN 20201218 Target: CPU - Model: yolov4-tiny ms < Lower Is Better Azure HBv1 . 65.49 |=========================================================== NCNN 20201218 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better Azure HBv1 . 46.54 |=========================================================== NCNN 20201218 Target: CPU - Model: regnety_400m ms < Lower Is Better Azure HBv1 . 111.05 |==========================================================