Microsoft Azure EPYC 7003 HPC HBv3 Benchmarks Azure HBv3 benchmarks against other Microsoft Azure HPC instance types. Benchmarks by Michael Larabel for a future article on phoronix. Azure HBv3 - EPYC 7V13: Processor: 2 x AMD EPYC 7V13 64-Core (120 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.1 BIOS), Memory: 442GB, Disk: 2 x 960GB Microsoft NVMe Direct Disk + 32GB Virtual Disk + 515GB Virtual Disk, Graphics: hyperv_fb OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft Azure HBv2 - EPYC 7V12: Processor: 2 x AMD EPYC 7V12 64-Core (120 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.0 BIOS), Memory: 450GB, Disk: 960GB Microsoft NVMe Direct Disk + 32GB Virtual Disk + 515GB Virtual Disk, Graphics: hyperv_fb OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft Azure HBv1 - EPYC 7551: Processor: 2 x AMD EPYC 7551 32-Core (60 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.0 BIOS), Memory: 226GB, Disk: 32GB Virtual Disk + 752GB Virtual Disk, Graphics: hyperv_fb OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft Azure HC - Xeon 8168: Processor: 2 x Intel Xeon Platinum 8168 (44 Cores), Motherboard: Microsoft Virtual Machine (Hyper-V UEFI v4.0 BIOS), Memory: 348GB, Disk: 32GB Virtual Disk + 752GB Virtual Disk, Graphics: hyperv_fb OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: microsoft Azure H - Xeon E5-2667 v3: Processor: 2 x Intel Xeon E5-2667 v3 (16 Cores), Motherboard: Microsoft Virtual Machine v7.0 (090007 BIOS), Chipset: Intel 440BX/ZX/DX, Memory: 222GB, Disk: 32GB Virtual Disk + 2199GB Virtual Disk, Graphics: Microsoft Hyper-V virtual VGA OS: CentOS Linux 8, Kernel: 4.18.0-147.8.1.el8_1.x86_64 (x86_64), Compiler: GCC 8.3.1 20190507, File-System: nfs, Screen Resolution: 1152x864, System Layer: Microsoft Hyper-V Server QuantLib 1.21 MFLOPS > Higher Is Better Azure HBv3 - EPYC 7V13 .... 2299.3 |=========================================== Azure HBv2 - EPYC 7V12 .... 1725.2 |================================ Azure HBv1 - EPYC 7551 .... 1251.7 |======================= Azure HC - Xeon 8168 ...... 1812.9 |================================== Azure H - Xeon E5-2667 v3 . 1505.1 |============================ High Performance Conjugate Gradient 3.1 GFLOP/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 39.06 |============================================ Azure HBv2 - EPYC 7V12 .... 37.27 |========================================== Azure HBv1 - EPYC 7551 .... 30.43 |================================== Azure HC - Xeon 8168 ...... 26.04 |============================= Azure H - Xeon E5-2667 v3 . 10.20 |=========== NAS Parallel Benchmarks 3.4 Test / Class: LU.C Total Mop/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 56682.82 |========================================= Azure HBv2 - EPYC 7V12 .... 53829.34 |======================================= Azure HBv1 - EPYC 7551 .... 25304.19 |================== Azure H - Xeon E5-2667 v3 . 7870.04 |====== CloverLeaf Lagrangian-Eulerian Hydrodynamics Seconds < Lower Is Better Azure HBv3 - EPYC 7V13 .... 16.66 |====== Azure HBv2 - EPYC 7V12 .... 23.78 |========= Azure HBv1 - EPYC 7551 .... 25.00 |========== Azure HC - Xeon 8168 ...... 20.19 |======== Azure H - Xeon E5-2667 v3 . 111.14 |=========================================== Rodinia 3.1 Test: OpenMP LavaMD Seconds < Lower Is Better Azure HBv3 - EPYC 7V13 .... 37.80 |====== Azure HBv2 - EPYC 7V12 .... 39.20 |====== Azure HBv1 - EPYC 7551 .... 90.18 |============== Azure HC - Xeon 8168 ...... 94.12 |============== Azure H - Xeon E5-2667 v3 . 284.19 |=========================================== Rodinia 3.1 Test: OpenMP HotSpot3D Seconds < Lower Is Better Azure HBv3 - EPYC 7V13 .... 82.49 |======================== Azure HBv2 - EPYC 7V12 .... 107.98 |================================ Azure HBv1 - EPYC 7551 .... 145.57 |=========================================== Azure HC - Xeon 8168 ...... 115.83 |================================== Azure H - Xeon E5-2667 v3 . 126.19 |===================================== NAMD 2.14 ATPase Simulation - 327,506 Atoms days/ns < Lower Is Better Azure HBv3 - EPYC 7V13 .... 0.27566 |======= Azure HBv2 - EPYC 7V12 .... 0.30056 |======= Azure HBv1 - EPYC 7551 .... 0.70947 |================= Azure HC - Xeon 8168 ...... 0.52569 |============= Azure H - Xeon E5-2667 v3 . 1.71710 |========================================== Pennant 1.0.1 Test: sedovbig Hydro Cycle Time - Seconds < Lower Is Better Azure HBv3 - EPYC 7V13 .... 5.833419 |=== Azure HBv2 - EPYC 7V12 .... 6.026449 |=== Azure HBv1 - EPYC 7551 .... 15.528990 |======== Azure HC - Xeon 8168 ...... 23.871260 |============ Azure H - Xeon E5-2667 v3 . 79.648780 |======================================== Pennant 1.0.1 Test: leblancbig Hydro Cycle Time - Seconds < Lower Is Better Azure HBv3 - EPYC 7V13 .... 3.337201 |=== Azure HBv2 - EPYC 7V12 .... 3.486503 |=== Azure HBv1 - EPYC 7551 .... 10.337640 |========= Azure HC - Xeon 8168 ...... 10.529200 |========= Azure H - Xeon E5-2667 v3 . 45.677420 |======================================== Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d Seconds < Lower Is Better Azure HBv3 - EPYC 7V13 .... 287.60 |========== Azure HBv2 - EPYC 7V12 .... 318.91 |============ Azure HBv1 - EPYC 7551 .... 455.81 |================= Azure HC - Xeon 8168 ...... 507.30 |================== Azure H - Xeon E5-2667 v3 . 1157.93 |========================================== LULESH 2.0.3 z/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 41636.60 |========================================= Azure HBv2 - EPYC 7V12 .... 34803.54 |================================== Azure HBv1 - EPYC 7551 .... 19011.46 |=================== Azure HC - Xeon 8168 ...... 20846.59 |===================== Azure H - Xeon E5-2667 v3 . 6444.25 |====== GNU GMP GMPbench 6.2.1 Total Time GMPbench Score > Higher Is Better Azure HBv3 - EPYC 7V13 .... 4893.4 |=========================================== Azure HBv2 - EPYC 7V12 .... 4155.5 |===================================== Azure HBv1 - EPYC 7551 .... 3021.3 |=========================== Azure HC - Xeon 8168 ...... 4196.5 |===================================== Azure H - Xeon E5-2667 v3 . 3942.7 |=================================== Zstd Compression 1.4.9 Compression Level: 8 - Compression Speed MB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 3184.2 |=========================================== Azure HBv2 - EPYC 7V12 .... 2653.1 |==================================== Azure HBv1 - EPYC 7551 .... 920.1 |============ Azure HC - Xeon 8168 ...... 1188.2 |================ Azure H - Xeon E5-2667 v3 . 582.7 |======== Zstd Compression 1.4.9 Compression Level: 19 - Compression Speed MB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 78.2 |============================================= Azure HBv2 - EPYC 7V12 .... 69.5 |======================================== Azure HBv1 - EPYC 7551 .... 48.5 |============================ Azure HC - Xeon 8168 ...... 76.3 |============================================ Azure H - Xeon E5-2667 v3 . 39.8 |======================= Zstd Compression 1.4.9 Compression Level: 19 - Decompression Speed MB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 3717.5 |=========================================== Azure HBv2 - EPYC 7V12 .... 2631.0 |============================== Azure HBv1 - EPYC 7551 .... 2005.4 |======================= Azure HC - Xeon 8168 ...... 1903.9 |====================== Azure H - Xeon E5-2667 v3 . 1934.3 |====================== Zstd Compression 1.4.9 Compression Level: 8, Long Mode - Compression Speed MB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 771.9 |============================================ Azure HBv2 - EPYC 7V12 .... 588.0 |================================== Azure HBv1 - EPYC 7551 .... 468.8 |=========================== Azure HC - Xeon 8168 ...... 649.3 |===================================== Azure H - Xeon E5-2667 v3 . 567.4 |================================ Zstd Compression 1.4.9 Compression Level: 8, Long Mode - Decompression Speed MB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 4256.8 |=========================================== Azure HBv2 - EPYC 7V12 .... 3037.5 |=============================== Azure HBv1 - EPYC 7551 .... 2339.6 |======================== Azure HC - Xeon 8168 ...... 2350.2 |======================== Azure H - Xeon E5-2667 v3 . 2279.8 |======================= Zstd Compression 1.4.9 Compression Level: 19, Long Mode - Decompression Speed MB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 3727.5 |=========================================== Azure HBv2 - EPYC 7V12 .... 2674.2 |=============================== Azure HBv1 - EPYC 7551 .... 2019.3 |======================= Azure HC - Xeon 8168 ...... 1991.3 |======================= Azure H - Xeon E5-2667 v3 . 2006.3 |======================= Botan 2.17.3 Test: KASUMI MiB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 87.48 |============================================ Azure HBv2 - EPYC 7V12 .... 73.18 |===================================== Azure HBv1 - EPYC 7551 .... 57.95 |============================= Azure HC - Xeon 8168 ...... 76.15 |====================================== Azure H - Xeon E5-2667 v3 . 70.99 |==================================== Botan 2.17.3 Test: KASUMI - Decrypt MiB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 84.06 |============================================ Azure HBv2 - EPYC 7V12 .... 71.10 |===================================== Azure HBv1 - EPYC 7551 .... 55.98 |============================= Azure HC - Xeon 8168 ...... 74.29 |======================================= Azure H - Xeon E5-2667 v3 . 68.35 |==================================== Botan 2.17.3 Test: AES-256 MiB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 5412.13 |========================================== Azure HBv2 - EPYC 7V12 .... 3934.40 |=============================== Azure HBv1 - EPYC 7551 .... 3144.31 |======================== Azure HC - Xeon 8168 ...... 3155.39 |======================== Azure H - Xeon E5-2667 v3 . 2891.85 |====================== Botan 2.17.3 Test: AES-256 - Decrypt MiB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 5407.48 |========================================== Azure HBv2 - EPYC 7V12 .... 3938.44 |=============================== Azure HBv1 - EPYC 7551 .... 3151.23 |======================== Azure HC - Xeon 8168 ...... 3159.85 |========================= Azure H - Xeon E5-2667 v3 . 2892.72 |====================== Botan 2.17.3 Test: Twofish MiB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 346.32 |=========================================== Azure HBv2 - EPYC 7V12 .... 280.90 |=================================== Azure HBv1 - EPYC 7551 .... 217.31 |=========================== Azure HC - Xeon 8168 ...... 293.55 |==================================== Azure H - Xeon E5-2667 v3 . 270.07 |================================== Botan 2.17.3 Test: Twofish - Decrypt MiB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 345.78 |=========================================== Azure HBv2 - EPYC 7V12 .... 283.26 |=================================== Azure HBv1 - EPYC 7551 .... 218.03 |=========================== Azure HC - Xeon 8168 ...... 294.38 |===================================== Azure H - Xeon E5-2667 v3 . 269.66 |================================== Botan 2.17.3 Test: Blowfish MiB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 424.74 |=========================================== Azure HBv2 - EPYC 7V12 .... 348.43 |=================================== Azure HBv1 - EPYC 7551 .... 273.04 |============================ Azure HC - Xeon 8168 ...... 367.94 |===================================== Azure H - Xeon E5-2667 v3 . 322.92 |================================= Botan 2.17.3 Test: Blowfish - Decrypt MiB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 425.16 |=========================================== Azure HBv2 - EPYC 7V12 .... 349.15 |=================================== Azure HBv1 - EPYC 7551 .... 272.73 |============================ Azure HC - Xeon 8168 ...... 365.55 |===================================== Azure H - Xeon E5-2667 v3 . 327.09 |================================= Botan 2.17.3 Test: CAST-256 MiB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 133.69 |=========================================== Azure HBv2 - EPYC 7V12 .... 113.60 |===================================== Azure HBv1 - EPYC 7551 .... 88.55 |============================ Azure HC - Xeon 8168 ...... 116.63 |====================================== Azure H - Xeon E5-2667 v3 . 103.37 |================================= Botan 2.17.3 Test: CAST-256 - Decrypt MiB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 133.67 |=========================================== Azure HBv2 - EPYC 7V12 .... 113.72 |===================================== Azure HBv1 - EPYC 7551 .... 88.56 |============================ Azure HC - Xeon 8168 ...... 116.57 |===================================== Azure H - Xeon E5-2667 v3 . 103.25 |================================= Botan 2.17.3 Test: ChaCha20Poly1305 MiB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 667.77 |=========================================== Azure HBv2 - EPYC 7V12 .... 615.80 |======================================== Azure HBv1 - EPYC 7551 .... 303.24 |==================== Azure HC - Xeon 8168 ...... 633.22 |========================================= Azure H - Xeon E5-2667 v3 . 551.83 |==================================== Botan 2.17.3 Test: ChaCha20Poly1305 - Decrypt MiB/s > Higher Is Better Azure HBv3 - EPYC 7V13 .... 658.37 |=========================================== Azure HBv2 - EPYC 7V12 .... 610.86 |======================================== Azure HBv1 - EPYC 7551 .... 300.18 |==================== Azure HC - Xeon 8168 ...... 626.92 |========================================= Azure H - Xeon E5-2667 v3 . 544.58 |==================================== SVT-AV1 0.8 Encoder Mode: Enc Mode 0 - Input: 1080p Frames Per Second > Higher Is Better Azure HBv3 - EPYC 7V13 .... 0.161 |============================================ Azure HBv2 - EPYC 7V12 .... 0.124 |================================== Azure HBv1 - EPYC 7551 .... 0.076 |===================== Azure HC - Xeon 8168 ...... 0.111 |============================== Azure H - Xeon E5-2667 v3 . 0.089 |======================== SVT-AV1 0.8 Encoder Mode: Enc Mode 4 - Input: 1080p Frames Per Second > Higher Is Better Azure HBv3 - EPYC 7V13 .... 12.275 |=========================================== Azure HBv2 - EPYC 7V12 .... 9.512 |================================= Azure HBv1 - EPYC 7551 .... 4.669 |================ Azure HC - Xeon 8168 ...... 7.621 |=========================== Azure H - Xeon E5-2667 v3 . 3.490 |============ SVT-AV1 0.8 Encoder Mode: Enc Mode 8 - Input: 1080p Frames Per Second > Higher Is Better Azure HBv3 - EPYC 7V13 .... 94.03 |============================================ Azure HBv2 - EPYC 7V12 .... 78.10 |===================================== Azure HBv1 - EPYC 7551 .... 40.15 |=================== Azure HC - Xeon 8168 ...... 57.38 |=========================== Azure H - Xeon E5-2667 v3 . 26.84 |============= SVT-HEVC 1.5.0 Tuning: 1 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 - EPYC 7V13 .... 45.39 |============================================ Azure HBv2 - EPYC 7V12 .... 36.12 |=================================== Azure HBv1 - EPYC 7551 .... 21.12 |==================== Azure HC - Xeon 8168 ...... 23.87 |======================= Azure H - Xeon E5-2667 v3 . 8.12 |======== SVT-HEVC 1.5.0 Tuning: 7 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 - EPYC 7V13 .... 378.01 |=========================================== Azure HBv2 - EPYC 7V12 .... 166.90 |=================== Azure HBv1 - EPYC 7551 .... 119.20 |============== Azure HC - Xeon 8168 ...... 256.28 |============================= Azure H - Xeon E5-2667 v3 . 95.14 |=========== SVT-HEVC 1.5.0 Tuning: 10 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 - EPYC 7V13 .... 548.33 |=========================================== Azure HBv2 - EPYC 7V12 .... 379.91 |============================== Azure HBv1 - EPYC 7551 .... 141.93 |=========== Azure HC - Xeon 8168 ...... 480.79 |====================================== Azure H - Xeon E5-2667 v3 . 172.16 |============== SVT-VP9 0.3 Tuning: Visual Quality Optimized - Input: Bosphorus 1080p Frames Per Second > Higher Is Better Azure HBv3 - EPYC 7V13 .... 337.71 |=========================================== Azure HBv2 - EPYC 7V12 .... 140.59 |================== Azure HBv1 - EPYC 7551 .... 129.44 |================ Azure HC - Xeon 8168 ...... 299.95 |====================================== Azure H - Xeon E5-2667 v3 . 83.40 |=========== Timed Linux Kernel Compilation 5.10.20 Time To Compile Seconds < Lower Is Better Azure HBv3 - EPYC 7V13 .... 42.01 |============= Azure HBv2 - EPYC 7V12 .... 44.92 |============== Azure HBv1 - EPYC 7551 .... 58.74 |=================== Azure HC - Xeon 8168 ...... 55.32 |================== Azure H - Xeon E5-2667 v3 . 134.74 |=========================================== Timed LLVM Compilation 10.0 Time To Compile Seconds < Lower Is Better Azure HBv3 - EPYC 7V13 .... 163.76 |============ Azure HBv2 - EPYC 7V12 .... 174.74 |============= Azure HBv1 - EPYC 7551 .... 283.29 |==================== Azure HC - Xeon 8168 ...... 251.74 |================== Azure H - Xeon E5-2667 v3 . 599.91 |=========================================== Timed Node.js Compilation 15.11 Time To Compile Seconds < Lower Is Better Azure HBv3 - EPYC 7V13 .... 111.33 |========== Azure HBv2 - EPYC 7V12 .... 118.97 |=========== Azure HBv1 - EPYC 7551 .... 194.55 |================== Azure HC - Xeon 8168 ...... 189.10 |================= Azure H - Xeon E5-2667 v3 . 469.94 |=========================================== oneDNN 2.1.2 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 3.21204 |============= Azure HBv2 - EPYC 7V12 .... 9.68321 |======================================= Azure HBv1 - EPYC 7551 .... 10.22263 |========================================= Azure HC - Xeon 8168 ...... 3.28160 |============= Azure H - Xeon E5-2667 v3 . 8.70022 |=================================== oneDNN 2.1.2 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 0.383855 |== Azure HBv2 - EPYC 7V12 .... 0.441012 |== Azure HBv1 - EPYC 7551 .... 1.763550 |========== Azure HC - Xeon 8168 ...... 0.474311 |=== Azure H - Xeon E5-2667 v3 . 7.328620 |========================================= oneDNN 2.1.2 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 0.406686 |== Azure HBv2 - EPYC 7V12 .... 1.031942 |====== Azure HBv1 - EPYC 7551 .... 2.405610 |============== Azure HC - Xeon 8168 ...... 0.551467 |=== Azure H - Xeon E5-2667 v3 . 6.924710 |========================================= oneDNN 2.1.2 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 0.455682 |=== Azure HBv2 - EPYC 7V12 .... 0.732130 |===== Azure HBv1 - EPYC 7551 .... 2.736210 |=================== Azure HC - Xeon 8168 ...... 0.668641 |===== Azure H - Xeon E5-2667 v3 . 5.987120 |========================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 875.17 |======= Azure HBv2 - EPYC 7V12 .... 1314.00 |========== Azure HBv1 - EPYC 7551 .... 5524.50 |========================================== Azure HC - Xeon 8168 ...... 744.36 |====== Azure H - Xeon E5-2667 v3 . 4793.75 |==================================== oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 530.90 |======= Azure HBv2 - EPYC 7V12 .... 778.31 |========== Azure HBv1 - EPYC 7551 .... 3344.14 |========================================== Azure HC - Xeon 8168 ...... 462.86 |====== Azure H - Xeon E5-2667 v3 . 3117.45 |======================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 962.34 |======= Azure HBv2 - EPYC 7V12 .... 1287.03 |========== Azure HBv1 - EPYC 7551 .... 5539.48 |========================================== Azure HC - Xeon 8168 ...... 746.46 |====== Azure H - Xeon E5-2667 v3 . 4449.57 |================================== oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 561.77 |======= Azure HBv2 - EPYC 7V12 .... 791.46 |========== Azure HBv1 - EPYC 7551 .... 3373.88 |========================================== Azure HC - Xeon 8168 ...... 459.58 |====== Azure H - Xeon E5-2667 v3 . 3198.07 |======================================== oneDNN 2.1.2 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 0.255501 |== Azure HBv2 - EPYC 7V12 .... 0.350347 |=== Azure HBv1 - EPYC 7551 .... 1.512710 |=============== Azure HC - Xeon 8168 ...... 0.352180 |=== Azure H - Xeon E5-2667 v3 . 4.233820 |========================================= oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 843.10 |======= Azure HBv2 - EPYC 7V12 .... 1294.53 |========== Azure HBv1 - EPYC 7551 .... 5355.24 |========================================== Azure HC - Xeon 8168 ...... 753.36 |====== Azure H - Xeon E5-2667 v3 . 4495.90 |=================================== oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 540.19 |======= Azure HBv2 - EPYC 7V12 .... 796.82 |========== Azure HBv1 - EPYC 7551 .... 3423.15 |========================================== Azure HC - Xeon 8168 ...... 458.20 |====== Azure H - Xeon E5-2667 v3 . 2802.87 |================================== oneDNN 2.1.2 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 0.445223 |===== Azure HBv2 - EPYC 7V12 .... 0.524737 |===== Azure HBv1 - EPYC 7551 .... 1.154650 |============ Azure HC - Xeon 8168 ...... 0.398005 |==== Azure H - Xeon E5-2667 v3 . 4.013920 |========================================= FinanceBench 2016-07-25 Benchmark: Repo OpenMP ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 59196.55 |====================== Azure HBv2 - EPYC 7V12 .... 75154.26 |============================ Azure HBv1 - EPYC 7551 .... 108606.50 |======================================== Azure HC - Xeon 8168 ...... 71609.07 |========================== Azure H - Xeon E5-2667 v3 . 80350.65 |============================== FinanceBench 2016-07-25 Benchmark: Bonds OpenMP ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 104884.29 |===================== Azure HBv2 - EPYC 7V12 .... 133719.33 |=========================== Azure HBv1 - EPYC 7551 .... 195702.80 |======================================== Azure HC - Xeon 8168 ...... 130250.45 |=========================== Azure H - Xeon E5-2667 v3 . 147211.24 |============================== GROMACS 2020.3 Water Benchmark Ns Per Day > Higher Is Better Azure HBv3 - EPYC 7V13 .... 9.041 |============================================ Azure HBv2 - EPYC 7V12 .... 8.458 |========================================= Azure HBv1 - EPYC 7551 .... 3.288 |================ Azure HC - Xeon 8168 ...... 4.866 |======================== Azure H - Xeon E5-2667 v3 . 1.229 |====== TensorFlow Lite 2020-08-23 Model: SqueezeNet Microseconds < Lower Is Better Azure HBv3 - EPYC 7V13 .... 66320.4 |=============== Azure HBv2 - EPYC 7V12 .... 74885.4 |================= Azure HBv1 - EPYC 7551 .... 95206.2 |====================== Azure HC - Xeon 8168 ...... 73517.3 |================= Azure H - Xeon E5-2667 v3 . 175485.0 |========================================= Mobile Neural Network 1.1.3 Model: SqueezeNetV1.0 ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 8.224 |===================== Azure HBv2 - EPYC 7V12 .... 14.136 |=================================== Azure HBv1 - EPYC 7551 .... 17.194 |=========================================== Azure HC - Xeon 8168 ...... 8.226 |===================== Azure H - Xeon E5-2667 v3 . 8.976 |====================== Mobile Neural Network 1.1.3 Model: resnet-v2-50 ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 29.09 |==================== Azure HBv2 - EPYC 7V12 .... 52.53 |===================================== Azure HBv1 - EPYC 7551 .... 62.45 |============================================ Azure HC - Xeon 8168 ...... 29.01 |==================== Azure H - Xeon E5-2667 v3 . 31.50 |====================== Mobile Neural Network 1.1.3 Model: inception-v3 ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 34.71 |==================== Azure HBv2 - EPYC 7V12 .... 55.36 |================================ Azure HBv1 - EPYC 7551 .... 76.80 |============================================ Azure HC - Xeon 8168 ...... 35.67 |==================== Azure H - Xeon E5-2667 v3 . 40.59 |======================= TNN 0.2.3 Target: CPU - Model: SqueezeNet v1.1 ms < Lower Is Better Azure HBv3 - EPYC 7V13 .... 272.61 |============================ Azure HBv2 - EPYC 7V12 .... 323.62 |================================= Azure HBv1 - EPYC 7551 .... 420.05 |=========================================== Azure HC - Xeon 8168 ...... 398.40 |========================================= Azure H - Xeon E5-2667 v3 . 335.41 |================================== PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: CPU FPS > Higher Is Better Azure HBv3 - EPYC 7V13 .... 38.39 |========================================= Azure HBv2 - EPYC 7V12 .... 25.57 |=========================== Azure HBv1 - EPYC 7551 .... 19.88 |===================== Azure HC - Xeon 8168 ...... 41.54 |============================================ Azure H - Xeon E5-2667 v3 . 18.12 |=================== PlaidML FP16: No - Mode: Inference - Network: VGG19 - Device: CPU FPS > Higher Is Better Azure HBv3 - EPYC 7V13 .... 34.53 |============================================ Azure HBv2 - EPYC 7V12 .... 23.12 |============================= Azure HBv1 - EPYC 7551 .... 15.97 |==================== Azure HC - Xeon 8168 ...... 34.66 |============================================ Azure H - Xeon E5-2667 v3 . 14.80 |=================== PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU FPS > Higher Is Better Azure HBv3 - EPYC 7V13 .... 6.27 |============================================= Azure HBv2 - EPYC 7V12 .... 5.60 |======================================== Azure HBv1 - EPYC 7551 .... 4.80 |================================== Azure HC - Xeon 8168 ...... 4.91 |=================================== Azure H - Xeon E5-2667 v3 . 4.48 |================================