AMD EPYC 2019 vs. 2017 Linux Performance AMD EPYC 7601 of Ubuntu 17.04 versus Ubuntu 19.04 for seeing how the performance has evolved since AMD EPYC launch. Benchmarks by Michael Larabel for a future article.
HTML result view exported from: https://openbenchmarking.org/result/1906078-HV-AMDEPYC2019 .
AMD EPYC 2019 vs. 2017 Linux Performance Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec AMD EPYC 7601 32-Core @ 2.20GHz (32 Cores / 64 Threads) TYAN B8026T70AE24HR (V1.02.B10 BIOS) AMD Device 1450 129024MB 280GB INTEL SSDPE21D280GA LLVMpipe VE228 2 x Broadcom NetXtreme BCM5720 PCIe Ubuntu 17.04 4.10.0-42-generic (x86_64) Unity 7.5.0 X Server 1.19.3 modesetting 1.19.3 3.3 Mesa 17.0.7 Gallium 0.4 (LLVM 4.0 128 bits) GCC 6.3.0 20170406 ext4 1920x1080 AMD 17h ASPEED Ubuntu 19.04 5.0.0-16-generic (x86_64) GNOME Shell 3.32.1 X Server 1.20.4 modesetting 1.20.4 GCC 8.3.0 5.2.0-999-generic (x86_64) 20190603 OpenBenchmarking.org Environment Details - Ubuntu 17.04: LIBGL_ALWAYS_SOFTWARE=1 Compiler Details - Ubuntu 17.04: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - Ubuntu 19.04: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu 19.04 + Linux 5.2: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu 19.04 + Linux 5.2 + No Spec: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq ondemand Java Details - Ubuntu 17.04: OpenJDK Runtime Environment (build 1.8.0_151-8u151-b12-0ubuntu0.17.04.2-b12) - Ubuntu 19.04: OpenJDK Runtime Environment (build 11.0.3+7-Ubuntu-1ubuntu219.04.1) - Ubuntu 19.04 + Linux 5.2: OpenJDK Runtime Environment (build 11.0.3+7-Ubuntu-1ubuntu219.04.1) - Ubuntu 19.04 + Linux 5.2 + No Spec: OpenJDK Runtime Environment (build 11.0.3+7-Ubuntu-1ubuntu219.04.1) Python Details - Ubuntu 17.04: Python 2.7.13 + Python 3.5.3 - Ubuntu 19.04: Python 2.7.16 + Python 3.7.3 - Ubuntu 19.04 + Linux 5.2: Python 2.7.16 + Python 3.7.3 - Ubuntu 19.04 + Linux 5.2 + No Spec: Python 2.7.16 + Python 3.7.3 Security Details - Ubuntu 19.04: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling - Ubuntu 19.04 + Linux 5.2: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling - Ubuntu 19.04 + Linux 5.2 + No Spec: l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled
AMD EPYC 2019 vs. 2017 Linux Performance npb: EP.C npb: FT.A npb: FT.B parboil: OpenMP CUTCP parboil: OpenMP Stencil rodinia: OpenMP LavaMD rodinia: OpenMP CFD Solver rodinia: OpenMP Streamcluster hpcg: namd: ATPase Simulation - 327,506 Atoms hmmer: Pfam Database Search mafft: Multiple Sequence Alignment numpy: mkl-dnn: Convolution Batch conv_alexnet - f32 mkl-dnn: Deconvolution Batch deconv_all - f32 mkl-dnn: Convolution Batch conv_googlenet_v3 - f32 ttsiod-renderer: Phong Rendering With Soft-Shadow Mapping svt-av1: 1080p 8-bit YUV To AV1 Video Encode svt-hevc: 1080p 8-bit YUV To HEVC Video Encode x264: H.264 Video Encoding himeno: Poisson Pressure Solver stockfish: Total Time asmfish: 1024 Hash Memory, 26 Depth build-gcc: Time To Compile build-linux-kernel: Time To Compile build-llvm: Time To Compile povray: Trace Time cython-bench: perl-benchmark: Pod2html perl-benchmark: Interpreter openssl: RSA 4096-bit Performance mysqlslap: 1 mysqlslap: 64 pgbench: Buffer Test - Normal Load - Read Only pgbench: Buffer Test - Normal Load - Read Write redis: GET redis: SET stress-ng: Crypto stress-ng: Bsearch stress-ng: Forking stress-ng: Semaphores stress-ng: Memory Copying stress-ng: Socket Activity stress-ng: Context Switching stress-ng: Glibc C String Functions stress-ng: Glibc Qsort Data Sorting ctx-clock: Context Switch Time v-ray: CPU blender: BMW27 - CPU-Only blender: Barbershop - CPU-Only mcperf: Get mcperf: Set pybench: Total For Average Test Times apache: Static Web Page Serving phpbench: PHP Benchmark Suite scikit-learn: Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 461 2447 1991 1.87 13.47 30.42 12.30 20.03 0.73 0.91092 8.25 3.34 9217173 328 5748 146 427 36.39 182 106 1007 57376331 63528003 989 41.92 226 23.15 38.52 0.19430801 0.00265858 4576 10170 596 374295 34731 1667825 1155205 5822 16071 42151 1485116 1802 22953 13990904 1409567 361 132 23723 101 486 52387 34687 1993 19655 309890 28.62 851 3237 3409 1.88 9.87 13.06 10.68 17.51 0.76 0.90958 7.23 3.83 8474464 300 4681 131 445 37.04 185 108 1006 57736660 61934696 997 36.96 201 22.34 33.08 0.19089546 0.00222401 4583 10093 630 389965 35065 1948133 1333439 5887 14656 44974 1517588 3832 19810 12189090 1640034 379 132 24577 101 504 50397 24852 1465 16256 393045 12.34 884 4445 4804 1.87 10.13 13.08 10.67 16.11 0.77 0.91657 7.18 3.91 8456027 297 4589 129 446 36.50 183 107 1001 57798263 61166139 999 37.00 195 22.34 32.98 0.19025251 0.00227404 4583 10274 624 387941 35079 1713980 1324367 5885 14621 46811 1518407 3930 18624 14724311 1640928 378 154 24522 101 504 49583 25180 1468 16429 393201 12.49 923 4400 4734 1.93 9.22 12.99 10.76 17.77 0.81 0.90951 7.19 3.80 8655647 295 4522 130 446 36.85 180 109 1002 58368046 61582238 997 36.86 209 22.41 32.83 0.19075409 0.00224459 4590 11236 633 393695 35413 1998041 1347124 5879 14724 47201 1495419 3943 19035 16288573 1643759 382 154 24724 102 503 58305 27802 1466 16829 396305 12.48 OpenBenchmarking.org
NAS Parallel Benchmarks Test / Class: EP.C OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.3.1 Test / Class: EP.C Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 200 400 600 800 1000 SE +/- 0.36, N = 3 SE +/- 8.51, N = 3 SE +/- 10.60, N = 3 SE +/- 9.42, N = 15 461 851 884 923 1. (F9X) gfortran options: -O3 -march=native -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi 2. Open MPI 2.0.2
NAS Parallel Benchmarks Test / Class: FT.A OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.3.1 Test / Class: FT.A Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 1000 2000 3000 4000 5000 SE +/- 120.27, N = 12 SE +/- 8.03, N = 3 SE +/- 6.86, N = 3 SE +/- 7.97, N = 3 2447 3237 4445 4400 1. (F9X) gfortran options: -O3 -march=native -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi 2. Open MPI 2.0.2
NAS Parallel Benchmarks Test / Class: FT.B OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.3.1 Test / Class: FT.B Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 1000 2000 3000 4000 5000 SE +/- 73.99, N = 15 SE +/- 4.71, N = 3 SE +/- 12.41, N = 3 SE +/- 14.86, N = 3 1991 3409 4804 4734 1. (F9X) gfortran options: -O3 -march=native -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi 2. Open MPI 2.0.2
Parboil Test: OpenMP CUTCP OpenBenchmarking.org Seconds, Fewer Is Better Parboil 2.5 Test: OpenMP CUTCP Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 0.4343 0.8686 1.3029 1.7372 2.1715 SE +/- 0.00, N = 3 SE +/- 0.03, N = 4 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 1.87 1.88 1.87 1.93 1. (CXX) g++ options: -lm -lpthread -lgomp -O3 -ffast-math -fopenmp
Parboil Test: OpenMP Stencil OpenBenchmarking.org Seconds, Fewer Is Better Parboil 2.5 Test: OpenMP Stencil Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 3 6 9 12 15 SE +/- 0.61, N = 15 SE +/- 0.45, N = 15 SE +/- 0.53, N = 15 SE +/- 0.24, N = 15 13.47 9.87 10.13 9.22 1. (CXX) g++ options: -lm -lpthread -lgomp -O3 -ffast-math -fopenmp
Rodinia Test: OpenMP LavaMD OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP LavaMD Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 7 14 21 28 35 SE +/- 0.11, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 30.42 13.06 13.08 12.99 1. (CXX) g++ options: -O2 -lOpenCL
Rodinia Test: OpenMP CFD Solver OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP CFD Solver Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 3 6 9 12 15 SE +/- 0.11, N = 3 SE +/- 0.07, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 12.30 10.68 10.67 10.76 1. (CXX) g++ options: -O2 -lOpenCL
Rodinia Test: OpenMP Streamcluster OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP Streamcluster Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 5 10 15 20 25 SE +/- 0.65, N = 12 SE +/- 0.53, N = 15 SE +/- 0.15, N = 3 SE +/- 0.42, N = 12 20.03 17.51 16.11 17.77 1. (CXX) g++ options: -O2 -lOpenCL
High Performance Conjugate Gradient OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.0 Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 0.1823 0.3646 0.5469 0.7292 0.9115 SE +/- 0.01, N = 3 SE +/- 0.02, N = 15 SE +/- 0.01, N = 15 SE +/- 0.02, N = 15 0.73 0.76 0.77 0.81
NAMD ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD 2.13b1 ATPase Simulation - 327,506 Atoms Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 0.2062 0.4124 0.6186 0.8248 1.031 SE +/- 0.00024, N = 3 SE +/- 0.00156, N = 3 SE +/- 0.00548, N = 3 SE +/- 0.00060, N = 3 0.91092 0.90958 0.91657 0.90951
Timed HMMer Search Pfam Database Search OpenBenchmarking.org Seconds, Fewer Is Better Timed HMMer Search 2.3.2 Pfam Database Search Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 2 4 6 8 10 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 4 SE +/- 0.04, N = 3 8.25 7.23 7.18 7.19 1. (CC) gcc options: -O2 -pthread -lhmmer -lsquid -lm
Timed MAFFT Alignment Multiple Sequence Alignment OpenBenchmarking.org Seconds, Fewer Is Better Timed MAFFT Alignment 7.392 Multiple Sequence Alignment Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 0.8798 1.7596 2.6394 3.5192 4.399 SE +/- 0.09, N = 15 SE +/- 0.06, N = 15 SE +/- 0.07, N = 15 SE +/- 0.08, N = 15 3.34 3.83 3.91 3.80 1. (CC) gcc options: -std=c99 -O3 -lm -lpthread
Numpy Benchmark OpenBenchmarking.org Nanoseconds, Fewer Is Better Numpy Benchmark Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 2M 4M 6M 8M 10M 9217173 8474464 8456027 8655647
MKL-DNN Harness: Convolution Batch conv_alexnet - Data Type: f32 OpenBenchmarking.org ms, Fewer Is Better MKL-DNN 2019-04-16 Harness: Convolution Batch conv_alexnet - Data Type: f32 Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 70 140 210 280 350 SE +/- 4.17, N = 3 SE +/- 4.35, N = 3 SE +/- 0.98, N = 3 SE +/- 2.64, N = 3 328 300 297 295 MIN: 288.84 MIN: 284.28 MIN: 287.79 MIN: 286.08 1. (CXX) g++ options: -std=c++11 -march=native -mtune=native -fPIC -fopenmp -O3 -pie -lmklml_intel -ldl
MKL-DNN Harness: Deconvolution Batch deconv_all - Data Type: f32 OpenBenchmarking.org ms, Fewer Is Better MKL-DNN 2019-04-16 Harness: Deconvolution Batch deconv_all - Data Type: f32 Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 1200 2400 3600 4800 6000 SE +/- 81.53, N = 3 SE +/- 8.80, N = 3 SE +/- 51.56, N = 6 SE +/- 40.49, N = 3 5748 4681 4589 4522 MIN: 4893.14 MIN: 4542.68 MIN: 4374.56 MIN: 4367.56 1. (CXX) g++ options: -std=c++11 -march=native -mtune=native -fPIC -fopenmp -O3 -pie -lmklml_intel -ldl
MKL-DNN Harness: Convolution Batch conv_googlenet_v3 - Data Type: f32 OpenBenchmarking.org ms, Fewer Is Better MKL-DNN 2019-04-16 Harness: Convolution Batch conv_googlenet_v3 - Data Type: f32 Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 30 60 90 120 150 SE +/- 1.92, N = 3 SE +/- 0.35, N = 3 SE +/- 0.61, N = 3 SE +/- 1.42, N = 3 146 131 129 130 MIN: 128.19 MIN: 125.04 MIN: 123.45 MIN: 122.74 1. (CXX) g++ options: -std=c++11 -march=native -mtune=native -fPIC -fopenmp -O3 -pie -lmklml_intel -ldl
TTSIOD 3D Renderer Phong Rendering With Soft-Shadow Mapping OpenBenchmarking.org FPS, More Is Better TTSIOD 3D Renderer 2.3b Phong Rendering With Soft-Shadow Mapping Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 100 200 300 400 500 SE +/- 1.65, N = 3 SE +/- 2.03, N = 3 SE +/- 0.98, N = 3 SE +/- 1.57, N = 3 427 445 446 446 1. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -msse -mrecip -mfpmath=sse -msse2 -mssse3 -lSDL -fopenmp -fwhole-program -lstdc++
SVT-AV1 1080p 8-bit YUV To AV1 Video Encode OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 0.5 1080p 8-bit YUV To AV1 Video Encode Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 9 18 27 36 45 SE +/- 0.18, N = 3 SE +/- 0.31, N = 3 SE +/- 0.37, N = 3 SE +/- 0.42, N = 3 36.39 37.04 36.50 36.85 1. (CXX) g++ options: -O3 -pie -lpthread -lm
SVT-HEVC 1080p 8-bit YUV To HEVC Video Encode OpenBenchmarking.org Frames Per Second, More Is Better SVT-HEVC 2019-02-03 1080p 8-bit YUV To HEVC Video Encode Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 40 80 120 160 200 SE +/- 5.63, N = 15 SE +/- 3.81, N = 15 SE +/- 3.45, N = 15 SE +/- 2.93, N = 15 182 185 183 180 1. (CC) gcc options: -fPIE -fPIC -O2 -flto -fvisibility=hidden -march=native -pie -rdynamic -lpthread -lrt
x264 H.264 Video Encoding OpenBenchmarking.org Frames Per Second, More Is Better x264 2018-09-25 H.264 Video Encoding Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 20 40 60 80 100 SE +/- 0.59, N = 3 SE +/- 0.16, N = 3 SE +/- 0.24, N = 3 SE +/- 0.74, N = 3 106 108 107 109 1. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -std=gnu99 -fPIC -fomit-frame-pointer -fno-tree-vectorize
Himeno Benchmark Poisson Pressure Solver OpenBenchmarking.org MFLOPS, More Is Better Himeno Benchmark 3.0 Poisson Pressure Solver Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 200 400 600 800 1000 SE +/- 2.88, N = 3 SE +/- 4.47, N = 3 SE +/- 0.47, N = 3 SE +/- 2.56, N = 3 1007 1006 1001 1002 1. (CC) gcc options: -O3 -mavx2
Stockfish Total Time OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 9 Total Time Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 13M 26M 39M 52M 65M SE +/- 579265.86, N = 3 SE +/- 312086.54, N = 3 SE +/- 513423.92, N = 3 SE +/- 357751.74, N = 3 57376331 57736660 57798263 58368046 1. (CXX) g++ options: -m64 -lpthread -fno-exceptions -std=c++11 -pedantic -O3 -msse -msse3 -mpopcnt -flto
asmFish 1024 Hash Memory, 26 Depth OpenBenchmarking.org Nodes/second, More Is Better asmFish 2018-07-23 1024 Hash Memory, 26 Depth Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 14M 28M 42M 56M 70M SE +/- 638722.99, N = 3 SE +/- 510625.43, N = 3 SE +/- 195549.26, N = 3 SE +/- 219141.26, N = 3 63528003 61934696 61166139 61582238
Timed GCC Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed GCC Compilation 8.2 Time To Compile Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 200 400 600 800 1000 989 997 999 997
Timed Linux Kernel Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 4.18 Time To Compile Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 10 20 30 40 50 SE +/- 0.35, N = 13 SE +/- 0.32, N = 13 SE +/- 0.28, N = 15 SE +/- 0.28, N = 15 41.92 36.96 37.00 36.86
Timed LLVM Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 6.0.1 Time To Compile Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 50 100 150 200 250 226 201 195 209
POV-Ray Trace Time OpenBenchmarking.org Seconds, Fewer Is Better POV-Ray 3.7.0.7 Trace Time Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 6 12 18 24 30 SE +/- 0.09, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.18, N = 3 23.15 22.34 22.34 22.41 1. (CXX) g++ options: -pipe -O3 -ffast-math -march=native -pthread -lSDL -lSM -lICE -lX11 -ltiff -ljpeg -lpng -lz -lrt -lm -lboost_thread -lboost_system
Cython benchmark OpenBenchmarking.org Seconds, Fewer Is Better Cython benchmark 0.27 Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 9 18 27 36 45 SE +/- 0.20, N = 3 SE +/- 0.33, N = 3 SE +/- 0.12, N = 3 SE +/- 0.04, N = 3 38.52 33.08 32.98 32.83
Perl Benchmarks Test: Pod2html OpenBenchmarking.org Seconds, Fewer Is Better Perl Benchmarks Test: Pod2html Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 0.0437 0.0874 0.1311 0.1748 0.2185 SE +/- 0.00059088, N = 3 SE +/- 0.00092862, N = 3 SE +/- 0.00042886, N = 3 SE +/- 0.00010418, N = 3 0.19430801 0.19089546 0.19025251 0.19075409
Perl Benchmarks Test: Interpreter OpenBenchmarking.org Seconds, Fewer Is Better Perl Benchmarks Test: Interpreter Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 0.0006 0.0012 0.0018 0.0024 0.003 SE +/- 0.00000080, N = 3 SE +/- 0.00002062, N = 3 SE +/- 0.00000780, N = 3 SE +/- 0.00001889, N = 3 0.00265858 0.00222401 0.00227404 0.00224459
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.1.1 RSA 4096-bit Performance Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 1000 2000 3000 4000 5000 SE +/- 22.11, N = 3 SE +/- 15.82, N = 3 SE +/- 20.77, N = 3 SE +/- 13.83, N = 3 4576 4583 4583 4590 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
MariaDB Clients: 1 OpenBenchmarking.org Queries Per Second, More Is Better MariaDB 10.3.8 Clients: 1 Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 2K 4K 6K 8K 10K SE +/- 69.42, N = 3 SE +/- 104.49, N = 7 SE +/- 144.76, N = 15 SE +/- 0.00, N = 3 10170 10093 10274 11236 -laio -lpcre -laio -lpcre -laio -lpcre 1. (CXX) g++ options: -pie -fPIC -fstack-protector -fno-rtti -O2 -lpthread -llzma -lbz2 -lnuma -lz -lm -lcrypt -lssl -lcrypto -ldl
MariaDB Clients: 64 OpenBenchmarking.org Queries Per Second, More Is Better MariaDB 10.3.8 Clients: 64 Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 140 280 420 560 700 SE +/- 0.83, N = 3 SE +/- 2.03, N = 3 SE +/- 1.57, N = 3 SE +/- 0.93, N = 3 596 630 624 633 -laio -lpcre -laio -lpcre -laio -lpcre 1. (CXX) g++ options: -pie -fPIC -fstack-protector -fno-rtti -O2 -lpthread -llzma -lbz2 -lnuma -lz -lm -lcrypt -lssl -lcrypto -ldl
PostgreSQL pgbench Scaling: Buffer Test - Test: Normal Load - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 10.3 Scaling: Buffer Test - Test: Normal Load - Mode: Read Only Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 80K 160K 240K 320K 400K SE +/- 1336.66, N = 3 SE +/- 3325.76, N = 3 SE +/- 1977.63, N = 3 SE +/- 2741.64, N = 3 374295 389965 387941 393695 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
PostgreSQL pgbench Scaling: Buffer Test - Test: Normal Load - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 10.3 Scaling: Buffer Test - Test: Normal Load - Mode: Read Write Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 8K 16K 24K 32K 40K SE +/- 67.51, N = 3 SE +/- 64.02, N = 3 SE +/- 60.44, N = 3 SE +/- 18.63, N = 3 34731 35065 35079 35413 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
Redis Test: GET OpenBenchmarking.org Requests Per Second, More Is Better Redis 4.0.8 Test: GET Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 400K 800K 1200K 1600K 2000K SE +/- 27915.23, N = 15 SE +/- 8872.20, N = 3 SE +/- 22708.15, N = 4 SE +/- 26538.58, N = 3 1667825 1948133 1713980 1998041 1. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
Redis Test: SET OpenBenchmarking.org Requests Per Second, More Is Better Redis 4.0.8 Test: SET Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 300K 600K 900K 1200K 1500K SE +/- 3873.52, N = 3 SE +/- 8370.99, N = 3 SE +/- 17246.16, N = 3 SE +/- 3677.04, N = 3 1155205 1333439 1324367 1347124 1. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
Stress-NG Test: Crypto OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Crypto Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 1300 2600 3900 5200 6500 SE +/- 35.92, N = 3 SE +/- 41.17, N = 3 SE +/- 39.66, N = 3 SE +/- 44.50, N = 3 5822 5887 5885 5879 -laio -laio -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: Bsearch OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Bsearch Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 3K 6K 9K 12K 15K SE +/- 124.05, N = 3 SE +/- 148.05, N = 3 SE +/- 91.88, N = 3 SE +/- 212.01, N = 3 16071 14656 14621 14724 -laio -laio -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: Forking OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Forking Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 10K 20K 30K 40K 50K SE +/- 980.75, N = 15 SE +/- 1356.42, N = 15 SE +/- 794.86, N = 15 SE +/- 1057.95, N = 12 42151 44974 46811 47201 -laio -laio -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: Semaphores OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Semaphores Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 300K 600K 900K 1200K 1500K SE +/- 8902.99, N = 3 SE +/- 8820.67, N = 3 SE +/- 3813.97, N = 3 SE +/- 5908.58, N = 3 1485116 1517588 1518407 1495419 -laio -laio -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: Memory Copying OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Memory Copying Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 800 1600 2400 3200 4000 SE +/- 2.15, N = 3 SE +/- 18.35, N = 3 SE +/- 15.48, N = 3 SE +/- 55.55, N = 4 1802 3832 3930 3943 -laio -laio -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: Socket Activity OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Socket Activity Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 5K 10K 15K 20K 25K SE +/- 53.20, N = 3 SE +/- 205.06, N = 3 SE +/- 227.34, N = 5 SE +/- 227.87, N = 6 22953 19810 18624 19035 -laio -laio -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: Context Switching OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Context Switching Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 3M 6M 9M 12M 15M SE +/- 182035.08, N = 3 SE +/- 139919.46, N = 15 SE +/- 439477.63, N = 15 SE +/- 551960.44, N = 15 13990904 12189090 14724311 16288573 -laio -laio -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: Glibc C String Functions OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Glibc C String Functions Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 400K 800K 1200K 1600K 2000K SE +/- 3278.74, N = 3 SE +/- 23170.19, N = 4 SE +/- 23620.75, N = 4 SE +/- 25241.53, N = 15 1409567 1640034 1640928 1643759 -laio -laio -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: Glibc Qsort Data Sorting OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Glibc Qsort Data Sorting Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 80 160 240 320 400 SE +/- 1.69, N = 3 SE +/- 3.86, N = 3 SE +/- 3.22, N = 3 SE +/- 3.60, N = 3 361 379 378 382 -laio -laio -laio 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
ctx_clock Context Switch Time OpenBenchmarking.org Clocks, Fewer Is Better ctx_clock Context Switch Time Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 30 60 90 120 150 132 132 154 154
Chaos Group V-RAY Mode: CPU OpenBenchmarking.org Ksamples, More Is Better Chaos Group V-RAY 4.10.03 Mode: CPU Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 5K 10K 15K 20K 25K SE +/- 225.70, N = 15 SE +/- 367.58, N = 4 SE +/- 295.67, N = 3 SE +/- 376.98, N = 3 23723 24577 24522 24724
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.79a Blend File: BMW27 - Compute: CPU-Only Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 20 40 60 80 100 101 101 101 102
Blender Blend File: Barbershop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.79a Blend File: Barbershop - Compute: CPU-Only Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 110 220 330 440 550 486 504 504 503
Memcached mcperf Method: Get OpenBenchmarking.org Operations Per Second, More Is Better Memcached mcperf 1.5.10 Method: Get Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 12K 24K 36K 48K 60K SE +/- 676.97, N = 3 SE +/- 1936.69, N = 15 SE +/- 288.03, N = 3 SE +/- 1129.17, N = 15 52387 50397 49583 58305 1. (CC) gcc options: -O2 -lm -rdynamic
Memcached mcperf Method: Set OpenBenchmarking.org Operations Per Second, More Is Better Memcached mcperf 1.5.10 Method: Set Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 7K 14K 21K 28K 35K SE +/- 298.45, N = 15 SE +/- 730.39, N = 15 SE +/- 1103.57, N = 15 SE +/- 834.64, N = 15 34687 24852 25180 27802 1. (CC) gcc options: -O2 -lm -rdynamic
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2018-02-16 Total For Average Test Times Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 400 800 1200 1600 2000 SE +/- 1.33, N = 3 SE +/- 2.52, N = 3 SE +/- 7.09, N = 3 SE +/- 2.19, N = 3 1993 1465 1468 1466
Apache Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better Apache Benchmark 2.4.29 Static Web Page Serving Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 4K 8K 12K 16K 20K SE +/- 47.59, N = 3 SE +/- 233.64, N = 3 SE +/- 212.10, N = 15 SE +/- 342.95, N = 15 19655 16256 16429 16829 1. (CC) gcc options: -shared -fPIC -O2 -pthread
PHPBench PHP Benchmark Suite OpenBenchmarking.org Score, More Is Better PHPBench 0.8.1 PHP Benchmark Suite Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 80K 160K 240K 320K 400K SE +/- 501.22, N = 3 SE +/- 130.46, N = 3 SE +/- 202.51, N = 3 SE +/- 1521.00, N = 3 309890 393045 393201 396305
Scikit-Learn OpenBenchmarking.org Seconds, Fewer Is Better Scikit-Learn 0.17.1 Ubuntu 17.04 Ubuntu 19.04 Ubuntu 19.04 + Linux 5.2 Ubuntu 19.04 + Linux 5.2 + No Spec 7 14 21 28 35 SE +/- 0.15, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 28.62 12.34 12.49 12.48
Phoronix Test Suite v10.8.4