Clear Linux 20310 vs. Ubuntu 17.10 Optimization Tests Clear Linux versus Ubuntu with performance governor, FLAGS, and Clear Kconfig configuration tests on Ubuntu 17.10. Tests by Michael Larabel for a future article on Phoronix.com.
HTML result view exported from: https://openbenchmarking.org/result/1801134-FO-CLEARBUNT00&grw&sro .
Clear Linux 20310 vs. Ubuntu 17.10 Optimization Tests Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Vulkan Compiler File-System Screen Resolution Desktop Display Driver OpenGL Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel Intel Core i7-8700K @ 4.70GHz (6 Cores / 12 Threads) ASUS PRIME Z370-A (0606 BIOS) Intel Device 3ec2 2 x 8192 MB DDR4-3000MT/s Samsung SSD 950 PRO 256GB EFI VGA Realtek ALC1220 Intel Connection Clear Linux OS 20310 4.14.13-508.native (x86_64) 1.0.39 GCC 7.2.1 20171126 + Clang 5.0.1 + LLVM 5.0.1 ext4 1024x768 16384MB llvmpipe 16000MB Ubuntu 17.10 4.13.0-25-generic (x86_64) GNOME Shell 3.26.2 modesetting 1.19.5 3.3 Mesa 17.2.2 (LLVM 5.0 256 bits) GCC 7.2.0 4.14.13-clear-config (x86_64) OpenBenchmarking.org Environment Details - Clear Linux 20310: CFFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-malign-data=abi-fno-semantic-interposition-ftree-vectorize-ftree-loop-vectorize-Wl-sort-common CFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common CXXFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common-fvisibility-inlines-hidden FFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-malign-data=abi-fno-semantic-interposition-ftree-vectorize-ftree-loop-vectorize THEANO_FLAGS=floatX=float32 openmp=true gcc.cxxflags="-ftree-vectorize-mavx" - Ubuntu 17.10 - perf + flags: CXXFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common-fvisibility-inlines-hidden CFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common FFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-malign-data=abi-fno-semantic-interposition-ftree-vectorize-ftree-loop-vectorize - Ubuntu 17.10 - perf + flags + kernel: CXXFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common-fvisibility-inlines-hidden CFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common FFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-malign-data=abi-fno-semantic-interposition-ftree-vectorize-ftree-loop-vectorize Compiler Details - Clear Linux 20310: --build=x86_64-generic-linux --disable-libmpx --disable-libunwind-exceptions --disable-multiarch --disable-vtable-verify --enable-__cxa_atexit --enable-bootstrap --enable-clocale=gnu --enable-gnu-indirect-function --enable-languages=c,c++,fortran,go --enable-ld=default --enable-libstdcxx-pch --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --exec-prefix=/usr --includedir=/usr/include --target=x86_64-generic-linux --with-arch=westmere --with-glibc-version=2.19 --with-gnu-ld --with-isl --with-ppl=yes --with-tune=haswell - Ubuntu 17.10: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu 17.10 - perf: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu 17.10 - perf + flags: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu 17.10 - perf + flags + kernel: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Processor Details - Clear Linux 20310: Scaling Governor: intel_pstate performance - Ubuntu 17.10: Scaling Governor: intel_pstate powersave - Ubuntu 17.10 - perf: Scaling Governor: intel_pstate performance - Ubuntu 17.10 - perf + flags: Scaling Governor: intel_pstate performance - Ubuntu 17.10 - perf + flags + kernel: Scaling Governor: intel_pstate performance Python Details - Clear Linux 20310: Python 2.7.12 + Python 3.6.4 - Ubuntu 17.10: Python 2.7.14 + Python 3.6.3 - Ubuntu 17.10 - perf: Python 2.7.14 + Python 3.6.3 - Ubuntu 17.10 - perf + flags: Python 2.7.14 + Python 3.6.3 - Ubuntu 17.10 - perf + flags + kernel: Python 2.7.14 + Python 3.6.3 Disk Details - Ubuntu 17.10, Ubuntu 17.10 - perf, Ubuntu 17.10 - perf + flags, Ubuntu 17.10 - perf + flags + kernel: NONE / data=ordered,errors=remount-ro,relatime,rw Security Details - Ubuntu 17.10, Ubuntu 17.10 - perf, Ubuntu 17.10 - perf + flags, Ubuntu 17.10 - perf + flags + kernel: KPTI Protection
Clear Linux 20310 vs. Ubuntu 17.10 Optimization Tests compilebench: Compile systemd-boot-total: Total stress-ng: Crypto stress-ng: CPU Stress stress-ng: Semaphores stress-ng: Vector Math cython-bench: glibc-bench: tanh encode-flac: WAV To FLAC encode-mp3: WAV To MP3 fs-mark: 1000 Files, 1MB Size fs-mark: 5000 Files, 1MB Size, 4 Threads fs-mark: 4000 Files, 32 Sub Dirs, 1MB Size hmmer: Pfam Database Search himeno: Poisson Pressure Solver tensorflow: Cifar10 scikit-learn: rbenchmark: numpy: parboil: OpenMP LBM parboil: OpenMP CUTCP rodinia: OpenMP LavaMD stockfish: Total Time x264: H.264 Video Encoding phpbench: PHP Benchmark Suite pybench: Total For Average Test Times Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 2375.33 13524 1835.24 3555.36 5058208.64 18005.17 19.87 31.88 4.22 7.53 145.73 343.20 145.87 4.80 3146.11 41.86 10.35 0.1448 3954003 135.49 5.52 45.54 2578 316.95 773141 958 1560.24 38770 1478.50 3243.73 4814082.62 17193.31 20.76 42.96 4.69 7.98 115.10 289.47 114.30 5.57 3116.63 62.71 26.01 0.3454 4157494 145.39 7.08 107.87 2866 312.16 658980 1031 1555.28 38770 1478.58 3244.96 4783133.85 17181.84 20.62 43.51 4.68 8.09 144.47 342.53 143.07 5.54 2879.21 62.73 25.20 0.3459 4215427 143.62 7.10 107.42 2862 314.08 669501 1028 1606.23 38770 1479.20 3095.92 4871548.79 17166.12 21.22 43.10 4.66 8.02 145.37 344.40 142.70 5.34 3032.80 62.67 25.42 0.3463 4256586 142.81 7.09 107.34 2832 314.70 658383 1028 1542.12 23030 1476.45 3200.57 4896467.18 17133.45 20.98 43.47 4.64 7.98 143.83 349.73 145.23 5.37 2903.17 62.29 25.28 0.3443 4113951 143.04 7.09 107.18 2815 317.17 660472 1028 OpenBenchmarking.org
Compile Bench Test: Compile OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Compile Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 500 1000 1500 2000 2500 SE +/- 23.32, N = 3 SE +/- 23.54, N = 3 SE +/- 13.04, N = 3 SE +/- 8.79, N = 3 SE +/- 1.43, N = 3 2375.33 1560.24 1555.28 1606.23 1542.12
Systemd Total Boot Time Test: Total OpenBenchmarking.org ms, Fewer Is Better Systemd Total Boot Time Test: Total Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 8K 16K 24K 32K 40K 13524 38770 38770 38770 23030
Stress-NG Test: Crypto OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Crypto Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 400 800 1200 1600 2000 SE +/- 0.45, N = 3 SE +/- 0.55, N = 3 SE +/- 0.20, N = 3 SE +/- 0.35, N = 3 SE +/- 0.42, N = 3 1835.24 1478.50 1478.58 1479.20 1476.45 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -laio -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: CPU Stress OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: CPU Stress Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 800 1600 2400 3200 4000 SE +/- 3.58, N = 3 SE +/- 12.55, N = 3 SE +/- 10.26, N = 3 SE +/- 9.80, N = 3 SE +/- 10.53, N = 3 3555.36 3243.73 3244.96 3095.92 3200.57 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -laio -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: Semaphores OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Semaphores Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 1.1M 2.2M 3.3M 4.4M 5.5M SE +/- 16586.65, N = 3 SE +/- 20910.94, N = 3 SE +/- 29702.81, N = 3 SE +/- 34956.82, N = 3 SE +/- 32973.49, N = 3 5058208.64 4814082.62 4783133.85 4871548.79 4896467.18 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -laio -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Stress-NG Test: Vector Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Vector Math Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 4K 8K 12K 16K 20K SE +/- 21.99, N = 3 SE +/- 15.66, N = 3 SE +/- 6.38, N = 3 SE +/- 14.65, N = 3 SE +/- 2.57, N = 3 18005.17 17193.31 17181.84 17166.12 17133.45 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -laio -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -lc
Cython benchmark OpenBenchmarking.org Seconds, Fewer Is Better Cython benchmark 0.27 Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 5 10 15 20 25 SE +/- 0.08, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 SE +/- 0.22, N = 3 SE +/- 0.04, N = 3 19.87 20.76 20.62 21.22 20.98
glibc bench Benchmark: tanh OpenBenchmarking.org nanoseconds, Fewer Is Better glibc bench 1.0 Benchmark: tanh Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 10 20 30 40 50 SE +/- 0.01, N = 3 SE +/- 0.14, N = 3 SE +/- 0.39, N = 3 SE +/- 0.34, N = 3 SE +/- 0.28, N = 3 31.88 42.96 43.51 43.10 43.47
FLAC Audio Encoding WAV To FLAC OpenBenchmarking.org Seconds, Fewer Is Better FLAC Audio Encoding 1.3.1 WAV To FLAC Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 1.0553 2.1106 3.1659 4.2212 5.2765 SE +/- 0.02, N = 5 SE +/- 0.02, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 4.22 4.69 4.68 4.66 4.64 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -logg -O2 -O2 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math 1. (CXX) g++ options: -fvisibility=hidden -lm
LAME MP3 Encoding WAV To MP3 OpenBenchmarking.org Seconds, Fewer Is Better LAME MP3 Encoding 3.99.5 WAV To MP3 Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 2 4 6 8 10 SE +/- 0.02, N = 5 SE +/- 0.06, N = 5 SE +/- 0.03, N = 5 SE +/- 0.07, N = 5 SE +/- 0.07, N = 5 7.53 7.98 8.09 8.02 7.98 -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math 1. (CC) gcc options: -O3 -ffast-math -funroll-loops -fschedule-insns2 -fbranch-count-reg -fforce-addr -pipe -lncurses -lm
FS-Mark Test: 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 30 60 90 120 150 SE +/- 0.33, N = 3 SE +/- 0.72, N = 3 SE +/- 0.22, N = 3 SE +/- 0.52, N = 3 SE +/- 0.55, N = 3 145.73 115.10 144.47 145.37 143.83 1. (CC) gcc options: -static
FS-Mark Test: 5000 Files, 1MB Size, 4 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 80 160 240 320 400 SE +/- 0.46, N = 3 SE +/- 3.83, N = 3 SE +/- 0.35, N = 3 SE +/- 0.61, N = 3 SE +/- 0.87, N = 3 343.20 289.47 342.53 344.40 349.73 1. (CC) gcc options: -static
FS-Mark Test: 4000 Files, 32 Sub Dirs, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 30 60 90 120 150 SE +/- 0.53, N = 3 SE +/- 0.20, N = 3 SE +/- 0.15, N = 3 SE +/- 0.21, N = 3 SE +/- 0.24, N = 3 145.87 114.30 143.07 142.70 145.23 1. (CC) gcc options: -static
Timed HMMer Search Pfam Database Search OpenBenchmarking.org Seconds, Fewer Is Better Timed HMMer Search 2.3.2 Pfam Database Search Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 1.2533 2.5066 3.7599 5.0132 6.2665 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 4.80 5.57 5.54 5.34 5.37 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -O2 -O2 -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math 1. (CC) gcc options: -pthread -lhmmer -lsquid -lm
Himeno Benchmark Poisson Pressure Solver OpenBenchmarking.org MFLOPS, More Is Better Himeno Benchmark 3.0 Poisson Pressure Solver Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 700 1400 2100 2800 3500 SE +/- 24.41, N = 3 SE +/- 10.87, N = 3 SE +/- 24.65, N = 3 SE +/- 37.89, N = 3 SE +/- 41.05, N = 3 3146.11 3116.63 2879.21 3032.80 2903.17 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math 1. (CC) gcc options: -O3 -mavx2
Tensorflow Build: Cifar10 OpenBenchmarking.org Seconds, Fewer Is Better Tensorflow 2017-02-03 Build: Cifar10 Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 14 28 42 56 70 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 41.86 62.71 62.73 62.67 62.29
Scikit-Learn OpenBenchmarking.org Seconds, Fewer Is Better Scikit-Learn 0.17.1 Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 6 12 18 24 30 SE +/- 0.04, N = 3 SE +/- 0.43, N = 3 SE +/- 0.10, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 10.35 26.01 25.20 25.42 25.28
R Benchmark OpenBenchmarking.org Seconds, Fewer Is Better R Benchmark Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 0.0779 0.1558 0.2337 0.3116 0.3895 SE +/- 0.0007, N = 3 SE +/- 0.0015, N = 3 SE +/- 0.0037, N = 3 SE +/- 0.0015, N = 3 SE +/- 0.0014, N = 3 0.1448 0.3454 0.3459 0.3463 0.3443 1. Clear Linux 20310: R scripting front-end version 3.4.3 (2017-11-30) 2. Ubuntu 17.10: R scripting front-end version 3.4.2 (2017-09-28) 3. Ubuntu 17.10 - perf: R scripting front-end version 3.4.2 (2017-09-28) 4. Ubuntu 17.10 - perf + flags: R scripting front-end version 3.4.2 (2017-09-28) 5. Ubuntu 17.10 - perf + flags + kernel: R scripting front-end version 3.4.2 (2017-09-28)
Numpy Benchmark OpenBenchmarking.org Nanoseconds, Fewer Is Better Numpy Benchmark Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 900K 1800K 2700K 3600K 4500K 3954003 4157494 4215427 4256586 4113951
Parboil Test: OpenMP LBM OpenBenchmarking.org Seconds, Fewer Is Better Parboil 2.5 Test: OpenMP LBM Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 30 60 90 120 150 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 0.55, N = 3 SE +/- 0.18, N = 3 SE +/- 0.05, N = 3 135.49 145.39 143.62 142.81 143.04 1. (CXX) g++ options: -lm -lpthread -lgomp -ffast-math -fopenmp
Parboil Test: OpenMP CUTCP OpenBenchmarking.org Seconds, Fewer Is Better Parboil 2.5 Test: OpenMP CUTCP Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 5.52 7.08 7.10 7.09 7.09 1. (CXX) g++ options: -lm -lpthread -lgomp -ffast-math -fopenmp
Rodinia Test: OpenMP LavaMD OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP LavaMD Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 20 40 60 80 100 SE +/- 0.01, N = 3 SE +/- 0.43, N = 3 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 SE +/- 0.05, N = 3 45.54 107.87 107.42 107.34 107.18 1. (CXX) g++ options: -O2 -lOpenCL
Stockfish Total Time OpenBenchmarking.org ms, Fewer Is Better Stockfish 2014-11-26 Total Time Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 600 1200 1800 2400 3000 SE +/- 1.45, N = 3 SE +/- 16.74, N = 3 SE +/- 3.48, N = 3 SE +/- 7.06, N = 3 SE +/- 13.22, N = 3 2578 2866 2862 2832 2815 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math 1. (CXX) g++ options: -lpthread -O3 -fno-exceptions -fno-rtti -ansi -pedantic -msse -msse3 -mpopcnt -flto
x264 H.264 Video Encoding OpenBenchmarking.org Frames Per Second, More Is Better x264 2017-09-08 H.264 Video Encoding Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 70 140 210 280 350 SE +/- 4.06, N = 3 SE +/- 3.31, N = 3 SE +/- 1.99, N = 3 SE +/- 3.48, N = 3 SE +/- 2.42, N = 3 316.95 312.16 314.08 314.70 317.17 -pipe -fexceptions -fstack-protector -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -lavformat -lavcodec -lavutil -lswscale -pipe -fexceptions -fstack-protector -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -lavformat -lavcodec -lavutil -lswscale -pipe -fexceptions -fstack-protector -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math 1. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -std=gnu99 -fPIC -fomit-frame-pointer -fno-tree-vectorize
PHPBench PHP Benchmark Suite OpenBenchmarking.org Score, More Is Better PHPBench 0.8.1 PHP Benchmark Suite Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 170K 340K 510K 680K 850K SE +/- 3213.69, N = 3 SE +/- 2667.23, N = 3 SE +/- 7160.88, N = 3 SE +/- 7822.83, N = 3 SE +/- 7604.91, N = 3 773141 658980 669501 658383 660472
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2008-08-14 Total For Average Test Times Clear Linux 20310 Ubuntu 17.10 Ubuntu 17.10 - perf Ubuntu 17.10 - perf + flags Ubuntu 17.10 - perf + flags + kernel 200 400 600 800 1000 SE +/- 0.58, N = 3 SE +/- 0.67, N = 3 SE +/- 1.67, N = 3 958 1031 1028 1028 1028
Phoronix Test Suite v10.8.5