Microsoft Azure EPYC 7003 HPC HBv3 Benchmarks

Azure HBv3 benchmarks against other Microsoft Azure HPC instance types. Benchmarks by Michael Larabel for a future article on phoronix.

HTML result view exported from: https://openbenchmarking.org/result/2104153-PTS-AZUREHPC42&grt&rdt.

Microsoft Azure EPYC 7003 HPC HBv3 BenchmarksProcessorMotherboardMemoryDiskGraphicsChipsetOSKernelCompilerFile-SystemScreen ResolutionSystem LayerAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v32 x AMD EPYC 7V13 64-Core (120 Cores)Microsoft Virtual Machine (Hyper-V UEFI v4.1 BIOS)442GB2 x 960GB Microsoft NVMe Direct Disk + 32GB Virtual Disk + 515GB Virtual Diskhyperv_fbCentOS Linux 84.18.0-147.8.1.el8_1.x86_64 (x86_64)GCC 8.3.1 20190507nfs1152x864microsoft2 x AMD EPYC 7V12 64-Core (120 Cores)Microsoft Virtual Machine (Hyper-V UEFI v4.0 BIOS)450GB960GB Microsoft NVMe Direct Disk + 32GB Virtual Disk + 515GB Virtual Disk2 x AMD EPYC 7551 32-Core (60 Cores)226GB32GB Virtual Disk + 752GB Virtual Disk2 x Intel Xeon Platinum 8168 (44 Cores)348GB2 x Intel Xeon E5-2667 v3 (16 Cores)Microsoft Virtual Machine v7.0 (090007 BIOS)Intel 440BX/ZX/DX222GB32GB Virtual Disk + 2199GB Virtual DiskMicrosoft Hyper-V virtual VGAMicrosoft Hyper-V ServerOpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=x86_64-redhat-linux --disable-libmpx --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver Processor Details- CPU Microcode: 0xffffffffPython Details- Python 3.6.8Security Details- Azure HBv3 - EPYC 7V13: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline STIBP: disabled RSB filling + tsx_async_abort: Not affected- Azure HBv2 - EPYC 7V12: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline STIBP: disabled RSB filling + tsx_async_abort: Not affected- Azure HBv1 - EPYC 7551: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline STIBP: disabled RSB filling + tsx_async_abort: Not affected- Azure HC - Xeon 8168: itlb_multihit: vulnerable + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline STIBP: disabled RSB filling + tsx_async_abort: Mitigation of Clear buffers; SMT Host state unknown - Azure H - Xeon E5-2667 v3: itlb_multihit: vulnerable + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline STIBP: disabled RSB filling + tsx_async_abort: Not affected

Microsoft Azure EPYC 7003 HPC HBv3 Benchmarksbotan: KASUMIbotan: KASUMI - Decryptbotan: AES-256botan: AES-256 - Decryptbotan: Twofishbotan: Twofish - Decryptbotan: Blowfishbotan: Blowfish - Decryptbotan: CAST-256botan: CAST-256 - Decryptbotan: ChaCha20Poly1305botan: ChaCha20Poly1305 - Decryptcloverleaf: Lagrangian-Eulerian Hydrodynamicsfinancebench: Repo OpenMPfinancebench: Bonds OpenMPgmpbench: Total Timegromacs: Water Benchmarkhpcg: lulesh: mnn: SqueezeNetV1.0mnn: resnet-v2-50mnn: inception-v3namd: ATPase Simulation - 327,506 Atomsnpb: LU.Conednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUpennant: sedovbigpennant: leblancbigplaidml: No - Inference - VGG16 - CPUplaidml: No - Inference - VGG19 - CPUplaidml: No - Inference - ResNet 50 - CPUquantlib: rodinia: OpenMP LavaMDrodinia: OpenMP HotSpot3Dsvt-av1: Enc Mode 0 - 1080psvt-av1: Enc Mode 4 - 1080psvt-av1: Enc Mode 8 - 1080psvt-hevc: 1 - Bosphorus 1080psvt-hevc: 7 - Bosphorus 1080psvt-hevc: 10 - Bosphorus 1080psvt-vp9: Visual Quality Optimized - Bosphorus 1080ptensorflow-lite: SqueezeNetbuild-linux-kernel: Time To Compilebuild-llvm: Time To Compilebuild-nodejs: Time To Compiletnn: CPU - SqueezeNet v1.1incompact3d: X3D-benchmarking input.i3dcompress-zstd: 8 - Compression Speedcompress-zstd: 19 - Compression Speedcompress-zstd: 19 - Decompression Speedcompress-zstd: 8, Long Mode - Compression Speedcompress-zstd: 8, Long Mode - Decompression Speedcompress-zstd: 19, Long Mode - Decompression SpeedAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v387.48084.0595412.1315407.477346.319345.776424.738425.158133.691133.665667.765658.37016.6659196.546875104884.2942714893.49.04139.062041636.6038.22429.08634.7100.2756656682.823.212040.3838550.4066860.455682875.166530.898962.336561.7730.255501843.103540.1940.4452235.8334193.33720138.3934.536.272299.337.80382.4890.16112.27594.02845.39378.01548.33337.7166320.442.008163.760111.327272.614287.5995083184.278.23717.5771.94256.83727.573.17571.1013934.4013938.444280.902283.257348.425349.147113.600113.724615.795610.86123.7875154.257813133719.3281254155.58.45837.268634803.53914.13652.53355.3560.3005653829.349.683210.4410121.0319420.7321301314.00778.3051287.03791.4600.3503471294.53796.8160.5247376.0264493.48650325.5723.125.601725.239.198107.9760.1249.51278.10436.12166.90379.91140.5974885.444.922174.743118.969323.615318.9050092653.169.52631.0588.03037.52674.257.95055.9803144.3133151.228217.312218.034273.039272.73388.54588.555303.243300.17825.00108606.502604195702.7968753021.33.28830.431419011.45817.19462.44676.7990.7094725304.1910.222631.763552.405612.736215524.503344.145539.483373.881.512715355.243423.151.1546515.5289910.3376419.8815.974.801251.790.175145.5690.0764.66940.14621.12119.20141.93129.4495206.258.738283.291194.550420.047455.812378920.148.52005.4468.82339.62019.376.14974.2873155.3913159.852293.551294.381367.942365.547116.630116.573633.217626.91920.1971609.065104130250.4492194196.54.86626.038120846.5908.22629.00635.6730.525693.281600.4743110.5514670.668641744.355462.855746.464459.5760.352180753.356458.2010.39800523.8712610.5292041.5434.664.911812.994.119115.8320.1117.62157.37723.87256.28480.79299.9573517.355.324251.744189.096398.404507.2959701188.276.31903.9649.32350.21991.370.98568.3492891.8462892.719270.067269.659322.924327.093103.372103.251551.827544.584111.1480350.648438147211.2395833942.71.22910.199516444.24638.97631.50440.5861.717107870.048.700227.328626.924715.987124793.753117.454449.573198.074.233824495.902802.874.0139279.6487845.6774218.1214.804.481505.1284.187126.1850.0893.49026.8358.1295.14172.1683.40175485134.740599.913469.942335.4111157.93327582.739.81934.3567.42279.82006.3OpenBenchmarking.org

Botan

Test: KASUMI

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: KASUMIAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v320406080100SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.25, N = 387.4873.1857.9576.1570.991. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: KASUMI - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: KASUMI - DecryptAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v320406080100SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 384.0671.1055.9874.2968.351. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: AES-256

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: AES-256Azure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v312002400360048006000SE +/- 3.73, N = 3SE +/- 2.68, N = 3SE +/- 16.79, N = 3SE +/- 0.18, N = 3SE +/- 4.69, N = 35412.133934.403144.313155.392891.851. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: AES-256 - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: AES-256 - DecryptAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v312002400360048006000SE +/- 7.85, N = 3SE +/- 3.26, N = 3SE +/- 1.16, N = 3SE +/- 0.03, N = 3SE +/- 5.16, N = 35407.483938.443151.233159.852892.721. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: Twofish

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: TwofishAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v380160240320400SE +/- 1.10, N = 3SE +/- 0.15, N = 3SE +/- 2.54, N = 4SE +/- 0.20, N = 3SE +/- 0.46, N = 3346.32280.90217.31293.55270.071. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: Twofish - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: Twofish - DecryptAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v380160240320400SE +/- 0.77, N = 3SE +/- 0.22, N = 3SE +/- 2.43, N = 4SE +/- 0.13, N = 3SE +/- 0.99, N = 3345.78283.26218.03294.38269.661. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: Blowfish

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: BlowfishAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v390180270360450SE +/- 0.47, N = 3SE +/- 0.42, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.68, N = 3424.74348.43273.04367.94322.921. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: Blowfish - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: Blowfish - DecryptAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v390180270360450SE +/- 0.42, N = 3SE +/- 0.56, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.55, N = 3425.16349.15272.73365.55327.091. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: CAST-256

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: CAST-256Azure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3306090120150SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.13, N = 3133.69113.6088.55116.63103.371. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: CAST-256 - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: CAST-256 - DecryptAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3306090120150SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 2SE +/- 0.01, N = 3SE +/- 0.23, N = 3133.67113.7288.56116.57103.251. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: ChaCha20Poly1305

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: ChaCha20Poly1305Azure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3140280420560700SE +/- 0.27, N = 3SE +/- 0.90, N = 3SE +/- 1.39, N = 3SE +/- 0.30, N = 3SE +/- 2.26, N = 3667.77615.80303.24633.22551.831. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: ChaCha20Poly1305 - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: ChaCha20Poly1305 - DecryptAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3140280420560700SE +/- 0.06, N = 3SE +/- 0.78, N = 3SE +/- 1.37, N = 3SE +/- 0.55, N = 3SE +/- 1.38, N = 3658.37610.86300.18626.92544.581. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

CloverLeaf

Lagrangian-Eulerian Hydrodynamics

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeafLagrangian-Eulerian HydrodynamicsAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v320406080100SE +/- 0.83, N = 15SE +/- 0.45, N = 12SE +/- 0.11, N = 3SE +/- 0.26, N = 3SE +/- 1.93, N = 1416.6623.7825.0020.19111.141. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

FinanceBench

Benchmark: Repo OpenMP

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Repo OpenMPAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v320K40K60K80K100KSE +/- 228.72, N = 3SE +/- 166.77, N = 3SE +/- 324.87, N = 3SE +/- 15.23, N = 3SE +/- 85.66, N = 359196.5575154.26108606.5071609.0780350.651. (CXX) g++ options: -O3 -march=native -fopenmp

FinanceBench

Benchmark: Bonds OpenMP

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Bonds OpenMPAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v340K80K120K160K200KSE +/- 454.05, N = 3SE +/- 476.22, N = 3SE +/- 1191.05, N = 3SE +/- 1475.96, N = 4SE +/- 150.66, N = 3104884.29133719.33195702.80130250.45147211.241. (CXX) g++ options: -O3 -march=native -fopenmp

GNU GMP GMPbench

Total Time

OpenBenchmarking.orgGMPbench Score, More Is BetterGNU GMP GMPbench 6.2.1Total TimeAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3100020003000400050004893.44155.53021.34196.53942.71. (CC) gcc options: -O3 -fomit-frame-pointer -lm

GROMACS

Water Benchmark

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2020.3Water BenchmarkAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v33691215SE +/- 0.009, N = 3SE +/- 0.009, N = 3SE +/- 0.025, N = 15SE +/- 0.003, N = 3SE +/- 0.002, N = 39.0418.4583.2884.8661.2291. (CXX) g++ options: -O2 -pthread -lrt -lpthread -lm

High Performance Conjugate Gradient

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1Azure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3918273645SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.17, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 839.0637.2730.4326.0410.201. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -fexceptions -pthread -lmpi_cxx -lmpi

LULESH

OpenBenchmarking.orgz/s, More Is BetterLULESH 2.0.3Azure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v39K18K27K36K45KSE +/- 476.10, N = 3SE +/- 44.77, N = 3SE +/- 81.47, N = 3SE +/- 25.50, N = 3SE +/- 28.01, N = 341636.6034803.5419011.4620846.596444.251. (CXX) g++ options: -O3 -fopenmp -lm -fexceptions -pthread -lmpi_cxx -lmpi

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.1.3Model: SqueezeNetV1.0Azure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v348121620SE +/- 0.113, N = 15SE +/- 0.657, N = 12SE +/- 0.162, N = 12SE +/- 0.058, N = 3SE +/- 0.246, N = 128.22414.13617.1948.2268.976MIN: 5.66 / MAX: 54.17MIN: 10.98 / MAX: 78.48MIN: 15.74 / MAX: 54.06MIN: 7.29 / MAX: 23.89MIN: 6.66 / MAX: 318.771. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.1.3Model: resnet-v2-50Azure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v31428425670SE +/- 0.25, N = 15SE +/- 1.18, N = 12SE +/- 1.07, N = 12SE +/- 0.12, N = 3SE +/- 0.34, N = 1229.0952.5362.4529.0131.50MIN: 25.79 / MAX: 252.29MIN: 41.27 / MAX: 326.88MIN: 54.15 / MAX: 188.44MIN: 27.94 / MAX: 76.84MIN: 25.12 / MAX: 279.161. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.1.3Model: inception-v3Azure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v320406080100SE +/- 0.24, N = 15SE +/- 0.95, N = 12SE +/- 0.96, N = 12SE +/- 0.32, N = 3SE +/- 1.56, N = 1234.7155.3676.8035.6740.59MIN: 31.09 / MAX: 427.77MIN: 47.56 / MAX: 509.74MIN: 69.85 / MAX: 676.14MIN: 34.52 / MAX: 128.55MIN: 29.94 / MAX: 479.231. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

NAMD

ATPase Simulation - 327,506 Atoms

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 AtomsAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v30.38630.77261.15891.54521.9315SE +/- 0.00027, N = 3SE +/- 0.00059, N = 3SE +/- 0.00507, N = 3SE +/- 0.00126, N = 3SE +/- 0.05413, N = 150.275660.300560.709470.525691.71710

NAS Parallel Benchmarks

Test / Class: LU.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.CAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure H - Xeon E5-2667 v312K24K36K48K60KSE +/- 428.57, N = 14SE +/- 21.24, N = 3SE +/- 114.01, N = 3SE +/- 33.92, N = 356682.8253829.3425304.197870.041. (F9X) gfortran options: -O3 -march=native -fexceptions -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v33691215SE +/- 0.02162, N = 3SE +/- 0.28898, N = 15SE +/- 0.43651, N = 15SE +/- 0.00454, N = 3SE +/- 1.08345, N = 153.212049.6832110.222633.281608.70022MIN: 2.58MIN: 5.56MIN: 4.1MIN: 3.2MIN: 5.331. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3246810SE +/- 0.009558, N = 12SE +/- 0.003995, N = 7SE +/- 0.040927, N = 15SE +/- 0.017521, N = 12SE +/- 2.687031, N = 120.3838550.4410121.7635500.4743117.328620MIN: 0.89MIN: 1.371. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3246810SE +/- 0.004961, N = 3SE +/- 0.030825, N = 15SE +/- 0.045752, N = 12SE +/- 0.003751, N = 3SE +/- 1.264069, N = 150.4066861.0319422.4056100.5514676.924710MIN: 1.96MIN: 2.21. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v31.34712.69424.04135.38846.7355SE +/- 0.002442, N = 3SE +/- 0.002363, N = 3SE +/- 0.005596, N = 3SE +/- 0.006150, N = 15SE +/- 1.017585, N = 150.4556820.7321302.7362100.6686415.987120MIN: 2.7MIN: 3.171. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v312002400360048006000SE +/- 25.25, N = 12SE +/- 16.54, N = 15SE +/- 83.42, N = 13SE +/- 4.60, N = 3SE +/- 239.22, N = 15875.171314.005524.50744.364793.75MIN: 727.38MIN: 1140.59MIN: 4658.38MIN: 2947.391. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v37001400210028003500SE +/- 8.62, N = 15SE +/- 8.13, N = 3SE +/- 113.65, N = 12SE +/- 2.05, N = 3SE +/- 171.94, N = 12530.90778.313344.14462.863117.45MIN: 458.96MIN: 738.78MIN: 2662.07MIN: 1801.231. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v312002400360048006000SE +/- 102.39, N = 14SE +/- 13.52, N = 15SE +/- 103.35, N = 12SE +/- 3.40, N = 3SE +/- 213.65, N = 12962.341287.035539.48746.464449.57MIN: 722.13MIN: 1149.25MIN: 4475.65MIN: 2983.771. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v37001400210028003500SE +/- 8.80, N = 15SE +/- 5.73, N = 15SE +/- 110.58, N = 12SE +/- 1.52, N = 3SE +/- 215.78, N = 15561.77791.463373.88459.583198.07MIN: 471.83MIN: 718.74MIN: 2418.62MIN: 1805.41. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v30.95261.90522.85783.81044.763SE +/- 0.000278, N = 3SE +/- 0.006544, N = 12SE +/- 0.088179, N = 15SE +/- 0.011574, N = 15SE +/- 0.797911, N = 150.2555010.3503471.5127100.3521804.233820MIN: 0.57MIN: 1.341. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v311002200330044005500SE +/- 14.29, N = 15SE +/- 11.10, N = 15SE +/- 122.64, N = 15SE +/- 4.09, N = 3SE +/- 240.85, N = 12843.101294.535355.24753.364495.90MIN: 711.66MIN: 1179.19MIN: 4475.57MIN: 736.05MIN: 2965.451. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v37001400210028003500SE +/- 8.06, N = 15SE +/- 6.35, N = 15SE +/- 87.86, N = 15SE +/- 2.64, N = 3SE +/- 133.56, N = 15540.19796.823423.15458.202802.87MIN: 462.7MIN: 726.18MIN: 2651.39MIN: 1783.321. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v30.90311.80622.70933.61244.5155SE +/- 0.004912, N = 4SE +/- 0.004967, N = 3SE +/- 0.003421, N = 3SE +/- 0.004555, N = 15SE +/- 0.564166, N = 120.4452230.5247371.1546500.3980054.013920MIN: 1.1MIN: 2.031. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -O2 -pie -lpthread -ldl

Pennant

Test: sedovbig

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: sedovbigAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v320406080100SE +/- 0.003905, N = 3SE +/- 0.012548, N = 3SE +/- 0.085157, N = 3SE +/- 0.048781, N = 3SE +/- 0.744226, N = 155.8334196.02644915.52899023.87126079.6487801. (CXX) g++ options: -fopenmp -fexceptions -pthread -lmpi_cxx -lmpi

Pennant

Test: leblancbig

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: leblancbigAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v31020304050SE +/- 0.017738, N = 3SE +/- 0.009939, N = 3SE +/- 0.027196, N = 3SE +/- 0.037598, N = 3SE +/- 0.671685, N = 123.3372013.48650310.33764010.52920045.6774201. (CXX) g++ options: -fopenmp -fexceptions -pthread -lmpi_cxx -lmpi

PlaidML

FP16: No - Mode: Inference - Network: VGG16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG16 - Device: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3918273645SE +/- 0.39, N = 3SE +/- 0.21, N = 3SE +/- 0.21, N = 15SE +/- 0.22, N = 3SE +/- 0.03, N = 338.3925.5719.8841.5418.12

PlaidML

FP16: No - Mode: Inference - Network: VGG19 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: VGG19 - Device: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3816243240SE +/- 0.42, N = 4SE +/- 0.31, N = 15SE +/- 0.21, N = 12SE +/- 0.19, N = 3SE +/- 0.18, N = 434.5323.1215.9734.6614.80

PlaidML

FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterPlaidMLFP16: No - Mode: Inference - Network: ResNet 50 - Device: CPUAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3246810SE +/- 0.16, N = 9SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.275.604.804.914.48

QuantLib

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.21Azure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v35001000150020002500SE +/- 4.80, N = 3SE +/- 0.77, N = 3SE +/- 1.79, N = 3SE +/- 7.80, N = 3SE +/- 4.07, N = 32299.31725.21251.71812.91505.11. (CXX) g++ options: -O3 -march=native -O2 -rdynamic -lboost_timer -lboost_system -lboost_chrono

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP LavaMDAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v360120180240300SE +/- 0.23, N = 3SE +/- 0.20, N = 3SE +/- 0.39, N = 3SE +/- 0.02, N = 3SE +/- 3.12, N = 337.8039.2090.1894.12284.191. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP HotSpot3D

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP HotSpot3DAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3306090120150SE +/- 1.18, N = 15SE +/- 0.89, N = 3SE +/- 1.35, N = 3SE +/- 0.21, N = 3SE +/- 0.43, N = 382.49107.98145.57115.83126.191. (CXX) g++ options: -O2 -lOpenCL

SVT-AV1

Encoder Mode: Enc Mode 0 - Input: 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 0.8Encoder Mode: Enc Mode 0 - Input: 1080pAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v30.03620.07240.10860.14480.181SE +/- 0.000, N = 3SE +/- 0.001, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.1610.1240.0760.1110.0891. (CXX) g++ options: -O3 -fcommon -fPIE -fPIC -pie

SVT-AV1

Encoder Mode: Enc Mode 4 - Input: 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 0.8Encoder Mode: Enc Mode 4 - Input: 1080pAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v33691215SE +/- 0.031, N = 3SE +/- 0.218, N = 15SE +/- 0.034, N = 11SE +/- 0.023, N = 3SE +/- 0.022, N = 312.2759.5124.6697.6213.4901. (CXX) g++ options: -O3 -fcommon -fPIE -fPIC -pie

SVT-AV1

Encoder Mode: Enc Mode 8 - Input: 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 0.8Encoder Mode: Enc Mode 8 - Input: 1080pAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v320406080100SE +/- 0.34, N = 3SE +/- 0.65, N = 3SE +/- 0.54, N = 12SE +/- 0.24, N = 3SE +/- 0.35, N = 394.0378.1040.1557.3826.841. (CXX) g++ options: -O3 -fcommon -fPIE -fPIC -pie

SVT-HEVC

Tuning: 1 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 1 - Input: Bosphorus 1080pAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v31020304050SE +/- 0.60, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 345.3936.1221.1223.878.121. (CC) gcc options: -fPIE -fPIC -O2 -O3 -pie -rdynamic -lpthread -lrt

SVT-HEVC

Tuning: 7 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 7 - Input: Bosphorus 1080pAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v380160240320400SE +/- 4.22, N = 3SE +/- 6.53, N = 12SE +/- 1.15, N = 3SE +/- 1.61, N = 3SE +/- 1.35, N = 3378.01166.90119.20256.2895.141. (CC) gcc options: -fPIE -fPIC -O2 -O3 -pie -rdynamic -lpthread -lrt

SVT-HEVC

Tuning: 10 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 10 - Input: Bosphorus 1080pAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3120240360480600SE +/- 7.76, N = 3SE +/- 21.86, N = 15SE +/- 2.68, N = 15SE +/- 2.25, N = 3SE +/- 1.74, N = 6548.33379.91141.93480.79172.161. (CC) gcc options: -fPIE -fPIC -O2 -O3 -pie -rdynamic -lpthread -lrt

SVT-VP9

Tuning: Visual Quality Optimized - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: Visual Quality Optimized - Input: Bosphorus 1080pAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v370140210280350SE +/- 4.36, N = 3SE +/- 0.20, N = 3SE +/- 1.10, N = 8SE +/- 4.18, N = 3SE +/- 1.28, N = 15337.71140.59129.44299.9583.401. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -O2 -pie -rdynamic -lpthread -lrt -lm

TensorFlow Lite

Model: SqueezeNet

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: SqueezeNetAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v340K80K120K160K200KSE +/- 2854.14, N = 15SE +/- 1151.94, N = 15SE +/- 1151.23, N = 15SE +/- 698.77, N = 3SE +/- 987.91, N = 366320.474885.495206.273517.3175485.0

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.10.20Time To CompileAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3306090120150SE +/- 0.58, N = 15SE +/- 0.58, N = 13SE +/- 0.45, N = 13SE +/- 0.60, N = 15SE +/- 1.07, N = 1242.0144.9258.7455.32134.74

Timed LLVM Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 10.0Time To CompileAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3130260390520650SE +/- 1.89, N = 3SE +/- 1.99, N = 3SE +/- 3.41, N = 4SE +/- 2.31, N = 3SE +/- 2.26, N = 3163.76174.74283.29251.74599.91

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 15.11Time To CompileAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3100200300400500SE +/- 1.09, N = 3SE +/- 0.83, N = 3SE +/- 0.16, N = 3SE +/- 0.40, N = 3SE +/- 0.95, N = 3111.33118.97194.55189.10469.94

TNN

Target: CPU - Model: SqueezeNet v1.1

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.1Azure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v390180270360450SE +/- 0.15, N = 3SE +/- 0.19, N = 3SE +/- 0.16, N = 3SE +/- 0.06, N = 3SE +/- 0.39, N = 3272.61323.62420.05398.40335.41MIN: 272.1 / MAX: 273.5MIN: 322.04 / MAX: 326.05MIN: 418.9 / MAX: 430.09MIN: 398 / MAX: 399.03MIN: 329.82 / MAX: 368.391. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O2 -rdynamic -ldl

Xcompact3d Incompact3d

Input: X3D-benchmarking input.i3d

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v32004006008001000SE +/- 0.17, N = 3SE +/- 0.07, N = 3SE +/- 2.96, N = 3SE +/- 7.11, N = 3SE +/- 12.66, N = 3287.60318.91455.81507.301157.931. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -fexceptions -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi

Zstd Compression

Compression Level: 8 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.4.9Compression Level: 8 - Compression SpeedAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v37001400210028003500SE +/- 45.10, N = 3SE +/- 33.03, N = 15SE +/- 6.06, N = 3SE +/- 6.93, N = 3SE +/- 1.83, N = 33184.22653.1920.11188.2582.71. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.4.9Compression Level: 19 - Compression SpeedAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v320406080100SE +/- 0.71, N = 15SE +/- 1.18, N = 15SE +/- 0.83, N = 15SE +/- 1.01, N = 15SE +/- 0.57, N = 378.269.548.576.339.81. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.4.9Compression Level: 19 - Decompression SpeedAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v38001600240032004000SE +/- 6.14, N = 15SE +/- 1.17, N = 15SE +/- 0.66, N = 15SE +/- 2.22, N = 15SE +/- 2.70, N = 33717.52631.02005.41903.91934.31. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 8, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.4.9Compression Level: 8, Long Mode - Compression SpeedAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v3170340510680850SE +/- 6.99, N = 7SE +/- 0.81, N = 3SE +/- 3.02, N = 15SE +/- 6.29, N = 3SE +/- 1.99, N = 3771.9588.0468.8649.3567.41. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 8, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.4.9Compression Level: 8, Long Mode - Decompression SpeedAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v39001800270036004500SE +/- 4.89, N = 7SE +/- 4.57, N = 3SE +/- 1.19, N = 15SE +/- 2.50, N = 3SE +/- 13.10, N = 34256.83037.52339.62350.22279.81. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.4.9Compression Level: 19, Long Mode - Decompression SpeedAzure HBv3 - EPYC 7V13Azure HBv2 - EPYC 7V12Azure HBv1 - EPYC 7551Azure HC - Xeon 8168Azure H - Xeon E5-2667 v38001600240032004000SE +/- 12.70, N = 15SE +/- 2.70, N = 15SE +/- 0.32, N = 12SE +/- 2.46, N = 15SE +/- 2.28, N = 53727.52674.22019.31991.32006.31. (CC) gcc options: -O3 -pthread -lz -llzma

Phoronix Test Suite v10.8.4