Microsoft Azure EPYC 7003 HPC HBv3 Benchmarks

Azure HBv3 benchmarks against other Microsoft Azure HPC instance types. Benchmarks by Michael Larabel for a future article on phoronix.

HTML result view exported from: https://openbenchmarking.org/result/2104153-PTS-AZUREHPC42&gru&sro.

Microsoft Azure EPYC 7003 HPC HBv3 BenchmarksProcessorMotherboardMemoryDiskGraphicsChipsetOSKernelCompilerFile-SystemScreen ResolutionSystem LayerAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v32 x AMD EPYC 7V13 64-Core (120 Cores)Microsoft Virtual Machine (Hyper-V UEFI v4.1 BIOS)442GB2 x 960GB Microsoft NVMe Direct Disk + 32GB Virtual Disk + 515GB Virtual Diskhyperv_fbCentOS Linux 84.18.0-147.8.1.el8_1.x86_64 (x86_64)GCC 8.3.1 20190507nfs1152x864microsoft2 x AMD EPYC 7V12 64-Core (120 Cores)Microsoft Virtual Machine (Hyper-V UEFI v4.0 BIOS)450GB960GB Microsoft NVMe Direct Disk + 32GB Virtual Disk + 515GB Virtual Disk2 x AMD EPYC 7551 32-Core (60 Cores)226GB32GB Virtual Disk + 752GB Virtual Disk2 x Intel Xeon Platinum 8168 (44 Cores)348GB2 x Intel Xeon E5-2667 v3 (16 Cores)Microsoft Virtual Machine v7.0 (090007 BIOS)Intel 440BX/ZX/DX222GB32GB Virtual Disk + 2199GB Virtual DiskMicrosoft Hyper-V virtual VGAMicrosoft Hyper-V ServerOpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=x86_64-redhat-linux --disable-libmpx --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver Processor Details- CPU Microcode: 0xffffffffPython Details- Python 3.6.8Security Details- Azure HBv3 - EPYC 7V13: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline STIBP: disabled RSB filling + tsx_async_abort: Not affected- Azure HBv2 - EPYC 7V12: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline STIBP: disabled RSB filling + tsx_async_abort: Not affected- Azure HBv1 - EPYC 7551: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline STIBP: disabled RSB filling + tsx_async_abort: Not affected- Azure HC - Xeon 8168: itlb_multihit: vulnerable + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline STIBP: disabled RSB filling + tsx_async_abort: Mitigation of Clear buffers; SMT Host state unknown - Azure H - Xeon E5-2667 v3: itlb_multihit: vulnerable + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline STIBP: disabled RSB filling + tsx_async_abort: Not affected

Microsoft Azure EPYC 7003 HPC HBv3 Benchmarksplaidml: No - Inference - VGG16 - CPUplaidml: No - Inference - VGG19 - CPUplaidml: No - Inference - ResNet 50 - CPUsvt-av1: Enc Mode 0 - 1080psvt-av1: Enc Mode 4 - 1080psvt-av1: Enc Mode 8 - 1080psvt-hevc: 1 - Bosphorus 1080psvt-hevc: 7 - Bosphorus 1080psvt-hevc: 10 - Bosphorus 1080psvt-vp9: Visual Quality Optimized - Bosphorus 1080phpcg: gmpbench: Total Timecompress-zstd: 8 - Compression Speedcompress-zstd: 19 - Compression Speedcompress-zstd: 19 - Decompression Speedcompress-zstd: 8, Long Mode - Compression Speedcompress-zstd: 8, Long Mode - Decompression Speedcompress-zstd: 19, Long Mode - Decompression Speedquantlib: botan: KASUMIbotan: KASUMI - Decryptbotan: AES-256botan: AES-256 - Decryptbotan: Twofishbotan: Twofish - Decryptbotan: Blowfishbotan: Blowfish - Decryptbotan: CAST-256botan: CAST-256 - Decryptbotan: ChaCha20Poly1305botan: ChaCha20Poly1305 - Decryptgromacs: Water Benchmarknpb: LU.Clulesh: namd: ATPase Simulation - 327,506 Atomspennant: sedovbigpennant: leblancbigtensorflow-lite: SqueezeNetonednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUfinancebench: Repo OpenMPfinancebench: Bonds OpenMPmnn: SqueezeNetV1.0mnn: resnet-v2-50mnn: inception-v3tnn: CPU - SqueezeNet v1.1cloverleaf: Lagrangian-Eulerian Hydrodynamicsrodinia: OpenMP LavaMDrodinia: OpenMP HotSpot3Dincompact3d: X3D-benchmarking input.i3dbuild-linux-kernel: Time To Compilebuild-llvm: Time To Compilebuild-nodejs: Time To CompileAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v338.3934.536.270.16112.27594.02845.39378.01548.33337.7139.06204893.43184.278.23717.5771.94256.83727.52299.387.48084.0595412.1315407.477346.319345.776424.738425.158133.691133.665667.765658.3709.04156682.8241636.6030.275665.8334193.33720166320.43.212040.3838550.4066860.455682875.166530.898962.336561.7730.255501843.103540.1940.44522359196.546875104884.2942718.22429.08634.710272.61416.6637.80382.489287.59950842.008163.760111.32725.5723.125.600.1249.51278.10436.12166.90379.91140.5937.26864155.52653.169.52631.0588.03037.52674.21725.273.17571.1013934.4013938.444280.902283.257348.425349.147113.600113.724615.795610.8618.45853829.3434803.5390.300566.0264493.48650374885.49.683210.4410121.0319420.7321301314.00778.3051287.03791.4600.3503471294.53796.8160.52473775154.257813133719.32812514.13652.53355.356323.61523.7839.198107.976318.90500944.922174.743118.96919.8815.974.800.0764.66940.14621.12119.20141.93129.4430.43143021.3920.148.52005.4468.82339.62019.31251.757.95055.9803144.3133151.228217.312218.034273.039272.73388.54588.555303.243300.1783.28825304.1919011.4580.7094715.5289910.3376495206.210.222631.763552.405612.736215524.503344.145539.483373.881.512715355.243423.151.15465108606.502604195702.79687517.19462.44676.799420.04725.0090.175145.569455.81237858.738283.291194.55041.5434.664.910.1117.62157.37723.87256.28480.79299.9526.03814196.51188.276.31903.9649.32350.21991.31812.976.14974.2873155.3913159.852293.551294.381367.942365.547116.630116.573633.217626.9194.86620846.5900.5256923.8712610.5292073517.33.281600.4743110.5514670.668641744.355462.855746.464459.5760.352180753.356458.2010.39800571609.065104130250.4492198.22629.00635.673398.40420.1994.119115.832507.29597055.324251.744189.09618.1214.804.480.0893.49026.8358.1295.14172.1683.4010.199513942.7582.739.81934.3567.42279.82006.31505.170.98568.3492891.8462892.719270.067269.659322.924327.093103.372103.251551.827544.5841.2297870.046444.24631.7171079.6487845.677421754858.700227.328626.924715.987124793.753117.454449.573198.074.233824495.902802.874.0139280350.648438147211.2395838.97631.50440.586335.411111.14284.187126.1851157.93327134.740599.913469.942OpenBenchmarking.org

PlaidML

FP16: No - Mode: Inference - Network: VGG16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168918273645SE +/- 0.03, N = 3SE +/- 0.21, N = 15SE +/- 0.21, N = 3SE +/- 0.39, N = 3SE +/- 0.22, N = 318.1219.8825.5738.3941.54

PlaidML

FP16: No - Mode: Inference - Network: VGG19 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168816243240SE +/- 0.18, N = 4SE +/- 0.21, N = 12SE +/- 0.31, N = 15SE +/- 0.42, N = 4SE +/- 0.19, N = 314.8015.9723.1234.5334.66

PlaidML

FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168246810SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 9SE +/- 0.01, N = 34.484.805.606.274.91

SVT-AV1

Encoder Mode: Enc Mode 0 - Input: 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 0.8Encoder Mode: Enc Mode 0 - Input: 1080pAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81680.03620.07240.10860.14480.181SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.001, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0890.0760.1240.1610.1111. (CXX) g++ options: -O3 -fcommon -fPIE -fPIC -pie

SVT-AV1

Encoder Mode: Enc Mode 4 - Input: 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 0.8Encoder Mode: Enc Mode 4 - Input: 1080pAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81683691215SE +/- 0.022, N = 3SE +/- 0.034, N = 11SE +/- 0.218, N = 15SE +/- 0.031, N = 3SE +/- 0.023, N = 33.4904.6699.51212.2757.6211. (CXX) g++ options: -O3 -fcommon -fPIE -fPIC -pie

SVT-AV1

Encoder Mode: Enc Mode 8 - Input: 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 0.8Encoder Mode: Enc Mode 8 - Input: 1080pAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816820406080100SE +/- 0.35, N = 3SE +/- 0.54, N = 12SE +/- 0.65, N = 3SE +/- 0.34, N = 3SE +/- 0.24, N = 326.8440.1578.1094.0357.381. (CXX) g++ options: -O3 -fcommon -fPIE -fPIC -pie

SVT-HEVC

Tuning: 1 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 1 - Input: Bosphorus 1080pAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81681020304050SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.60, N = 3SE +/- 0.02, N = 38.1221.1236.1245.3923.871. (CC) gcc options: -fPIE -fPIC -O2 -O3 -pie -rdynamic -lpthread -lrt

SVT-HEVC

Tuning: 7 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 7 - Input: Bosphorus 1080pAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816880160240320400SE +/- 1.35, N = 3SE +/- 1.15, N = 3SE +/- 6.53, N = 12SE +/- 4.22, N = 3SE +/- 1.61, N = 395.14119.20166.90378.01256.281. (CC) gcc options: -fPIE -fPIC -O2 -O3 -pie -rdynamic -lpthread -lrt

SVT-HEVC

Tuning: 10 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 10 - Input: Bosphorus 1080pAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168120240360480600SE +/- 1.74, N = 6SE +/- 2.68, N = 15SE +/- 21.86, N = 15SE +/- 7.76, N = 3SE +/- 2.25, N = 3172.16141.93379.91548.33480.791. (CC) gcc options: -fPIE -fPIC -O2 -O3 -pie -rdynamic -lpthread -lrt

SVT-VP9

Tuning: Visual Quality Optimized - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: Visual Quality Optimized - Input: Bosphorus 1080pAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816870140210280350SE +/- 1.28, N = 15SE +/- 1.10, N = 8SE +/- 0.20, N = 3SE +/- 4.36, N = 3SE +/- 4.18, N = 383.40129.44140.59337.71299.951. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -O2 -pie -rdynamic -lpthread -lrt -lm

High Performance Conjugate Gradient

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1Azure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168918273645SE +/- 0.09, N = 8SE +/- 0.17, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 310.2030.4337.2739.0626.041. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -fexceptions -pthread -lmpi_cxx -lmpi

GNU GMP GMPbench

Total Time

OpenBenchmarking.orgGMPbench Score, More Is BetterGNU GMP GMPbench 6.2.1Total TimeAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168100020003000400050003942.73021.34155.54893.44196.51. (CC) gcc options: -O3 -fomit-frame-pointer -lm

Zstd Compression

Compression Level: 8 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.4.9Compression Level: 8 - Compression SpeedAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81687001400210028003500SE +/- 1.83, N = 3SE +/- 6.06, N = 3SE +/- 33.03, N = 15SE +/- 45.10, N = 3SE +/- 6.93, N = 3582.7920.12653.13184.21188.21. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.4.9Compression Level: 19 - Compression SpeedAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816820406080100SE +/- 0.57, N = 3SE +/- 0.83, N = 15SE +/- 1.18, N = 15SE +/- 0.71, N = 15SE +/- 1.01, N = 1539.848.569.578.276.31. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.4.9Compression Level: 19 - Decompression SpeedAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81688001600240032004000SE +/- 2.70, N = 3SE +/- 0.66, N = 15SE +/- 1.17, N = 15SE +/- 6.14, N = 15SE +/- 2.22, N = 151934.32005.42631.03717.51903.91. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 8, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.4.9Compression Level: 8, Long Mode - Compression SpeedAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168170340510680850SE +/- 1.99, N = 3SE +/- 3.02, N = 15SE +/- 0.81, N = 3SE +/- 6.99, N = 7SE +/- 6.29, N = 3567.4468.8588.0771.9649.31. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 8, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.4.9Compression Level: 8, Long Mode - Decompression SpeedAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81689001800270036004500SE +/- 13.10, N = 3SE +/- 1.19, N = 15SE +/- 4.57, N = 3SE +/- 4.89, N = 7SE +/- 2.50, N = 32279.82339.63037.54256.82350.21. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.4.9Compression Level: 19, Long Mode - Decompression SpeedAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81688001600240032004000SE +/- 2.28, N = 5SE +/- 0.32, N = 12SE +/- 2.70, N = 15SE +/- 12.70, N = 15SE +/- 2.46, N = 152006.32019.32674.23727.51991.31. (CC) gcc options: -O3 -pthread -lz -llzma

QuantLib

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.21Azure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81685001000150020002500SE +/- 4.07, N = 3SE +/- 1.79, N = 3SE +/- 0.77, N = 3SE +/- 4.80, N = 3SE +/- 7.80, N = 31505.11251.71725.22299.31812.91. (CXX) g++ options: -O3 -march=native -O2 -rdynamic -lboost_timer -lboost_system -lboost_chrono

Botan

Test: KASUMI

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: KASUMIAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816820406080100SE +/- 0.25, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 370.9957.9573.1887.4876.151. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: KASUMI - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: KASUMI - DecryptAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816820406080100SE +/- 0.16, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 368.3555.9871.1084.0674.291. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: AES-256

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: AES-256Azure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816812002400360048006000SE +/- 4.69, N = 3SE +/- 16.79, N = 3SE +/- 2.68, N = 3SE +/- 3.73, N = 3SE +/- 0.18, N = 32891.853144.313934.405412.133155.391. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: AES-256 - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: AES-256 - DecryptAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816812002400360048006000SE +/- 5.16, N = 3SE +/- 1.16, N = 3SE +/- 3.26, N = 3SE +/- 7.85, N = 3SE +/- 0.03, N = 32892.723151.233938.445407.483159.851. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: Twofish

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: TwofishAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816880160240320400SE +/- 0.46, N = 3SE +/- 2.54, N = 4SE +/- 0.15, N = 3SE +/- 1.10, N = 3SE +/- 0.20, N = 3270.07217.31280.90346.32293.551. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: Twofish - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: Twofish - DecryptAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816880160240320400SE +/- 0.99, N = 3SE +/- 2.43, N = 4SE +/- 0.22, N = 3SE +/- 0.77, N = 3SE +/- 0.13, N = 3269.66218.03283.26345.78294.381. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: Blowfish

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: BlowfishAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816890180270360450SE +/- 0.68, N = 3SE +/- 0.10, N = 3SE +/- 0.42, N = 3SE +/- 0.47, N = 3SE +/- 0.10, N = 3322.92273.04348.43424.74367.941. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: Blowfish - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: Blowfish - DecryptAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816890180270360450SE +/- 0.55, N = 3SE +/- 0.08, N = 3SE +/- 0.56, N = 3SE +/- 0.42, N = 3SE +/- 0.12, N = 3327.09272.73349.15425.16365.551. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: CAST-256

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: CAST-256Azure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168306090120150SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3103.3788.55113.60133.69116.631. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: CAST-256 - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: CAST-256 - DecryptAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168306090120150SE +/- 0.23, N = 3SE +/- 0.03, N = 2SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3103.2588.56113.72133.67116.571. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: ChaCha20Poly1305

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: ChaCha20Poly1305Azure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168140280420560700SE +/- 2.26, N = 3SE +/- 1.39, N = 3SE +/- 0.90, N = 3SE +/- 0.27, N = 3SE +/- 0.30, N = 3551.83303.24615.80667.77633.221. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: ChaCha20Poly1305 - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: ChaCha20Poly1305 - DecryptAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168140280420560700SE +/- 1.38, N = 3SE +/- 1.37, N = 3SE +/- 0.78, N = 3SE +/- 0.06, N = 3SE +/- 0.55, N = 3544.58300.18610.86658.37626.921. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

GROMACS

Water Benchmark

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2020.3Water BenchmarkAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81683691215SE +/- 0.002, N = 3SE +/- 0.025, N = 15SE +/- 0.009, N = 3SE +/- 0.009, N = 3SE +/- 0.003, N = 31.2293.2888.4589.0414.8661. (CXX) g++ options: -O2 -pthread -lrt -lpthread -lm

NAS Parallel Benchmarks

Test / Class: LU.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.CAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V1312K24K36K48K60KSE +/- 33.92, N = 3SE +/- 114.01, N = 3SE +/- 21.24, N = 3SE +/- 428.57, N = 147870.0425304.1953829.3456682.821. (F9X) gfortran options: -O3 -march=native -fexceptions -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi

LULESH

OpenBenchmarking.orgz/s, More Is BetterLULESH 2.0.3Azure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81689K18K27K36K45KSE +/- 28.01, N = 3SE +/- 81.47, N = 3SE +/- 44.77, N = 3SE +/- 476.10, N = 3SE +/- 25.50, N = 36444.2519011.4634803.5441636.6020846.591. (CXX) g++ options: -O3 -fopenmp -lm -fexceptions -pthread -lmpi_cxx -lmpi

NAMD

ATPase Simulation - 327,506 Atoms

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 AtomsAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81680.38630.77261.15891.54521.9315SE +/- 0.05413, N = 15SE +/- 0.00507, N = 3SE +/- 0.00059, N = 3SE +/- 0.00027, N = 3SE +/- 0.00126, N = 31.717100.709470.300560.275660.52569

Pennant

Test: sedovbig

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: sedovbigAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816820406080100SE +/- 0.744226, N = 15SE +/- 0.085157, N = 3SE +/- 0.012548, N = 3SE +/- 0.003905, N = 3SE +/- 0.048781, N = 379.64878015.5289906.0264495.83341923.8712601. (CXX) g++ options: -fopenmp -fexceptions -pthread -lmpi_cxx -lmpi

Pennant

Test: leblancbig

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: leblancbigAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81681020304050SE +/- 0.671685, N = 12SE +/- 0.027196, N = 3SE +/- 0.009939, N = 3SE +/- 0.017738, N = 3SE +/- 0.037598, N = 345.67742010.3376403.4865033.33720110.5292001. (CXX) g++ options: -fopenmp -fexceptions -pthread -lmpi_cxx -lmpi

TensorFlow Lite

Model: SqueezeNet

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: SqueezeNetAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816840K80K120K160K200KSE +/- 987.91, N = 3SE +/- 1151.23, N = 15SE +/- 1151.94, N = 15SE +/- 2854.14, N = 15SE +/- 698.77, N = 3175485.095206.274885.466320.473517.3

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81683691215SE +/- 1.08345, N = 15SE +/- 0.43651, N = 15SE +/- 0.28898, N = 15SE +/- 0.02162, N = 3SE +/- 0.00454, N = 38.7002210.222639.683213.212043.28160MIN: 5.33MIN: 4.1MIN: 5.56MIN: 2.58MIN: 3.21. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168246810SE +/- 2.687031, N = 12SE +/- 0.040927, N = 15SE +/- 0.003995, N = 7SE +/- 0.009558, N = 12SE +/- 0.017521, N = 127.3286201.7635500.4410120.3838550.474311MIN: 1.37MIN: 0.891. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168246810SE +/- 1.264069, N = 15SE +/- 0.045752, N = 12SE +/- 0.030825, N = 15SE +/- 0.004961, N = 3SE +/- 0.003751, N = 36.9247102.4056101.0319420.4066860.551467MIN: 2.2MIN: 1.961. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81681.34712.69424.04135.38846.7355SE +/- 1.017585, N = 15SE +/- 0.005596, N = 3SE +/- 0.002363, N = 3SE +/- 0.002442, N = 3SE +/- 0.006150, N = 155.9871202.7362100.7321300.4556820.668641MIN: 3.17MIN: 2.71. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816812002400360048006000SE +/- 239.22, N = 15SE +/- 83.42, N = 13SE +/- 16.54, N = 15SE +/- 25.25, N = 12SE +/- 4.60, N = 34793.755524.501314.00875.17744.36MIN: 2947.39MIN: 4658.38MIN: 1140.59MIN: 727.381. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81687001400210028003500SE +/- 171.94, N = 12SE +/- 113.65, N = 12SE +/- 8.13, N = 3SE +/- 8.62, N = 15SE +/- 2.05, N = 33117.453344.14778.31530.90462.86MIN: 1801.23MIN: 2662.07MIN: 738.78MIN: 458.961. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816812002400360048006000SE +/- 213.65, N = 12SE +/- 103.35, N = 12SE +/- 13.52, N = 15SE +/- 102.39, N = 14SE +/- 3.40, N = 34449.575539.481287.03962.34746.46MIN: 2983.77MIN: 4475.65MIN: 1149.25MIN: 722.131. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81687001400210028003500SE +/- 215.78, N = 15SE +/- 110.58, N = 12SE +/- 5.73, N = 15SE +/- 8.80, N = 15SE +/- 1.52, N = 33198.073373.88791.46561.77459.58MIN: 1805.4MIN: 2418.62MIN: 718.74MIN: 471.831. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81680.95261.90522.85783.81044.763SE +/- 0.797911, N = 15SE +/- 0.088179, N = 15SE +/- 0.006544, N = 12SE +/- 0.000278, N = 3SE +/- 0.011574, N = 154.2338201.5127100.3503470.2555010.352180MIN: 1.34MIN: 0.571. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816811002200330044005500SE +/- 240.85, N = 12SE +/- 122.64, N = 15SE +/- 11.10, N = 15SE +/- 14.29, N = 15SE +/- 4.09, N = 34495.905355.241294.53843.10753.36MIN: 2965.45MIN: 4475.57MIN: 1179.19MIN: 711.66MIN: 736.051. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81687001400210028003500SE +/- 133.56, N = 15SE +/- 87.86, N = 15SE +/- 6.35, N = 15SE +/- 8.06, N = 15SE +/- 2.64, N = 32802.873423.15796.82540.19458.20MIN: 1783.32MIN: 2651.39MIN: 726.18MIN: 462.71. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPUAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81680.90311.80622.70933.61244.5155SE +/- 0.564166, N = 12SE +/- 0.003421, N = 3SE +/- 0.004967, N = 3SE +/- 0.004912, N = 4SE +/- 0.004555, N = 154.0139201.1546500.5247370.4452230.398005MIN: 2.03MIN: 1.11. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

FinanceBench

Benchmark: Repo OpenMP

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Repo OpenMPAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816820K40K60K80K100KSE +/- 85.66, N = 3SE +/- 324.87, N = 3SE +/- 166.77, N = 3SE +/- 228.72, N = 3SE +/- 15.23, N = 380350.65108606.5075154.2659196.5571609.071. (CXX) g++ options: -O3 -march=native -fopenmp

FinanceBench

Benchmark: Bonds OpenMP

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Bonds OpenMPAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816840K80K120K160K200KSE +/- 150.66, N = 3SE +/- 1191.05, N = 3SE +/- 476.22, N = 3SE +/- 454.05, N = 3SE +/- 1475.96, N = 4147211.24195702.80133719.33104884.29130250.451. (CXX) g++ options: -O3 -march=native -fopenmp

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.1.3Model: SqueezeNetV1.0Azure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816848121620SE +/- 0.246, N = 12SE +/- 0.162, N = 12SE +/- 0.657, N = 12SE +/- 0.113, N = 15SE +/- 0.058, N = 38.97617.19414.1368.2248.226MIN: 6.66 / MAX: 318.77MIN: 15.74 / MAX: 54.06MIN: 10.98 / MAX: 78.48MIN: 5.66 / MAX: 54.17MIN: 7.29 / MAX: 23.891. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.1.3Model: resnet-v2-50Azure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81681428425670SE +/- 0.34, N = 12SE +/- 1.07, N = 12SE +/- 1.18, N = 12SE +/- 0.25, N = 15SE +/- 0.12, N = 331.5062.4552.5329.0929.01MIN: 25.12 / MAX: 279.16MIN: 54.15 / MAX: 188.44MIN: 41.27 / MAX: 326.88MIN: 25.79 / MAX: 252.29MIN: 27.94 / MAX: 76.841. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.1.3Model: inception-v3Azure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816820406080100SE +/- 1.56, N = 12SE +/- 0.96, N = 12SE +/- 0.95, N = 12SE +/- 0.24, N = 15SE +/- 0.32, N = 340.5976.8055.3634.7135.67MIN: 29.94 / MAX: 479.23MIN: 69.85 / MAX: 676.14MIN: 47.56 / MAX: 509.74MIN: 31.09 / MAX: 427.77MIN: 34.52 / MAX: 128.551. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

TNN

Target: CPU - Model: SqueezeNet v1.1

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.1Azure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816890180270360450SE +/- 0.39, N = 3SE +/- 0.16, N = 3SE +/- 0.19, N = 3SE +/- 0.15, N = 3SE +/- 0.06, N = 3335.41420.05323.62272.61398.40MIN: 329.82 / MAX: 368.39MIN: 418.9 / MAX: 430.09MIN: 322.04 / MAX: 326.05MIN: 272.1 / MAX: 273.5MIN: 398 / MAX: 399.031. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O2 -rdynamic -ldl

CloverLeaf

Lagrangian-Eulerian Hydrodynamics

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeafLagrangian-Eulerian HydrodynamicsAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816820406080100SE +/- 1.93, N = 14SE +/- 0.11, N = 3SE +/- 0.45, N = 12SE +/- 0.83, N = 15SE +/- 0.26, N = 3111.1425.0023.7816.6620.191. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP LavaMDAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 816860120180240300SE +/- 3.12, N = 3SE +/- 0.39, N = 3SE +/- 0.20, N = 3SE +/- 0.23, N = 3SE +/- 0.02, N = 3284.1990.1839.2037.8094.121. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP HotSpot3D

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP HotSpot3DAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168306090120150SE +/- 0.43, N = 3SE +/- 1.35, N = 3SE +/- 0.89, N = 3SE +/- 1.18, N = 15SE +/- 0.21, N = 3126.19145.57107.9882.49115.831. (CXX) g++ options: -O2 -lOpenCL

Xcompact3d Incompact3d

Input: X3D-benchmarking input.i3d

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 81682004006008001000SE +/- 12.66, N = 3SE +/- 2.96, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 3SE +/- 7.11, N = 31157.93455.81318.91287.60507.301. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -fexceptions -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.10.20Time To CompileAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168306090120150SE +/- 1.07, N = 12SE +/- 0.45, N = 13SE +/- 0.58, N = 13SE +/- 0.58, N = 15SE +/- 0.60, N = 15134.7458.7444.9242.0155.32

Timed LLVM Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 10.0Time To CompileAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168130260390520650SE +/- 2.26, N = 3SE +/- 3.41, N = 4SE +/- 1.99, N = 3SE +/- 1.89, N = 3SE +/- 2.31, N = 3599.91283.29174.74163.76251.74

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 15.11Time To CompileAzure H - Xeon E5-2667 v3Azure HBv1 - EPYC 7551Azure HBv2 - EPYC 7V12Azure HBv3 - EPYC 7V13Azure HC - Xeon 8168100200300400500SE +/- 0.95, N = 3SE +/- 0.16, N = 3SE +/- 0.83, N = 3SE +/- 1.09, N = 3SE +/- 0.40, N = 3469.94194.55118.97111.33189.10

Phoronix Test Suite v10.8.4