Docker Testing Ubuntu vs. Clear vs. Arch

Tests for future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/1801068-AL-ARCH9589325.

ProcessorMotherboardMemoryDiskGraphicsAudioMonitorChipsetNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem LayerVulkanKPTI OnKPTI Off Ubuntu Clear Linux Ubuntu Clear Linux Arch LinuxIntel Core i7-8700K @ 4.70GHz (6 Cores / 12 Threads)ASUS PRIME Z370-A16384MB525GB Crucial_CT525MX3 + Samsung SSD 950 PRO 256GBnouveaufbRealtek ALC1220DELL P2415QUbuntu 16.04.3 LTS4.15.0-999-generic (x86_64) 20180105GCC 5.4.0 20160609overlayfs3840x2160dockerIntel Device 3ec2NVIDIA GeForce GTX 1080 Ti 11264MBIntel ConnectionClear Linux OS 191501.0.39GCC 7.2.1 20170910 + Clang 5.0.0 + LLVM 5.0.0nouveaufbUbuntu 16.04.3 LTSGCC 5.4.0 20160609dockerIntel Device 3ec2NVIDIA GeForce GTX 1080 Ti 11264MBIntel ConnectionClear Linux OS 191501.0.39GCC 7.2.1 20170910 + Clang 5.0.0 + LLVM 5.0.0nouveaufbArch LinuxGCC 7.2.1 20171128OpenBenchmarking.orgCompiler Details- KPTI On: Ubuntu: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - KPTI On: Clear Linux: --build=x86_64-generic-linux --disable-libmpx --disable-libunwind-exceptions --disable-multiarch --disable-vtable-verify --enable-__cxa_atexit --enable-bootstrap --enable-clocale=gnu --enable-gnu-indirect-function --enable-languages=c,c++,fortran,go --enable-ld=default --enable-libstdcxx-pch --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --exec-prefix=/usr --includedir=/usr/include --target=x86_64-generic-linux --with-arch=westmere --with-glibc-version=2.19 --with-gnu-ld --with-isl --with-ppl=yes --with-tune=haswell - KPTI Off: Ubuntu: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - KPTI Off: Clear Linux: --build=x86_64-generic-linux --disable-libmpx --disable-libunwind-exceptions --disable-multiarch --disable-vtable-verify --enable-__cxa_atexit --enable-bootstrap --enable-clocale=gnu --enable-gnu-indirect-function --enable-languages=c,c++,fortran,go --enable-ld=default --enable-libstdcxx-pch --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --exec-prefix=/usr --includedir=/usr/include --target=x86_64-generic-linux --with-arch=westmere --with-glibc-version=2.19 --with-gnu-ld --with-isl --with-ppl=yes --with-tune=haswell - KPTI Off: Arch Linux: --disable-libssp --disable-libstdcxx-pch --disable-libunwind-exceptions --disable-werror --enable-__cxa_atexit --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-install-libiberty --enable-languages=c,c++,ada,fortran,go,lto,objc,obj-c++ --enable-libmpx --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-isl --with-linker-hash-style=gnu Processor Details- Scaling Governor: intel_pstate powersaveSystem Details- KPTI On: Ubuntu: Python 2.7.12.- KPTI On: Clear Linux: Python 2.7.12.- KPTI Off: Ubuntu: Python 2.7.12.- KPTI Off: Clear Linux: Python 2.7.12.- KPTI Off: Arch Linux: Python 3.6.4.Disk Scheduler Details- KPTI On: Ubuntu, KPTI On: Clear Linux: NONE

himeno: Poisson Pressure Solverstockfish: Total Timeopenssl: RSA 4096-bit Performancecaffe: CPU AlexNetcaffe: CPU Googlenetredis: GETredis: SETpybench: Total For Average Test Timesapache: Static Web Page Servingphpbench: PHP Benchmark Suitescikit-learn: KPTI OnKPTI Off Ubuntu Clear Linux Ubuntu Clear Linux Arch Linux3055.2427481211.173082036097562877172.002054361.42111238847.3557813029.523140.8226981216.53844072083053881151.422674347.0896539104.977730399.902975.9527301218.903032796073182956186.582122759.46110740998.6558588629.223117.0826471216.77843822078803871526.422783559.3196441772.467688139.813094.2928551212.973672714.082575753.50OpenBenchmarking.org

Himeno Benchmark

Poisson Pressure Solver

KPTI OnKPTI OffOpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverUbuntuClear LinuxArch Linux7001400210028003500SE +/- 10.69, N = 3SE +/- 21.76, N = 3SE +/- 16.74, N = 3SE +/- 27.79, N = 3SE +/- 49.82, N = 33055.243140.822975.953117.083094.291. (CC) gcc options: -O3 -mavx2

Stockfish

Total Time

KPTI OnKPTI OffOpenBenchmarking.orgms, Fewer Is BetterStockfish 2014-11-26Total TimeUbuntuClear LinuxArch Linux6001200180024003000SE +/- 4.04, N = 3SE +/- 27.55, N = 3SE +/- 39.15, N = 3SE +/- 8.11, N = 3SE +/- 21.54, N = 3274826982730264728551. (CXX) g++ options: -lpthread -fno-exceptions -fno-rtti -ansi -pedantic -O3 -msse -msse3 -mpopcnt -flto

OpenSSL

RSA 4096-bit Performance

KPTI OnKPTI OffOpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.1gRSA 4096-bit PerformanceUbuntuClear LinuxArch Linux30060090012001500SE +/- 0.43, N = 3SE +/- 1.47, N = 3SE +/- 0.20, N = 3SE +/- 0.23, N = 3SE +/- 0.35, N = 31211.171216.531218.901216.771212.971. (CC) gcc options: -m64 -O3 -lssl -lcrypto -ldl

Caffe

Build: CPU AlexNet

KPTI OnKPTI OffOpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2016-12-29Build: CPU AlexNetUbuntuClear Linux70K140K210K280K350KSE +/- 974.39, N = 3SE +/- 25.58, N = 3SE +/- 285.72, N = 3SE +/- 85.64, N = 330820384407303279843821. (CXX) g++ options: -pthread -fPIC -O2 -lcaffe -lglog -lgflags -lprotobuf -lboost_system -lboost_filesystem -lm -lhdf5_hl -lhdf5 -lleveldb -lsnappy -llmdb -lopencv_core -lopencv_highgui -lopencv_imgproc -lboost_thread -lstdc++

Caffe

Build: CPU Googlenet

KPTI OnKPTI OffOpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2016-12-29Build: CPU GooglenetUbuntuClear Linux130K260K390K520K650KSE +/- 1052.05, N = 3SE +/- 409.41, N = 3SE +/- 767.50, N = 3SE +/- 545.57, N = 36097562083056073182078801. (CXX) g++ options: -pthread -fPIC -O2 -lcaffe -lglog -lgflags -lprotobuf -lboost_system -lboost_filesystem -lm -lhdf5_hl -lhdf5 -lleveldb -lsnappy -llmdb -lopencv_core -lopencv_highgui -lopencv_imgproc -lboost_thread -lstdc++

Redis

Test: GET

KPTI OnKPTI OffOpenBenchmarking.orgRequests Per Second, More Is BetterRedis 3.0.1Test: GETUbuntuClear LinuxArch Linux800K1600K2400K3200K4000KSE +/- 34872.79, N = 3SE +/- 18040.41, N = 3SE +/- 27746.21, N = 3SE +/- 33015.88, N = 3SE +/- 37096.31, N = 32877172.003881151.422956186.583871526.423672714.081. (CC) gcc options: -ggdb -rdynamic -lm -pthread

Redis

Test: SET

KPTI OnKPTI OffOpenBenchmarking.orgRequests Per Second, More Is BetterRedis 3.0.1Test: SETUbuntuClear LinuxArch Linux600K1200K1800K2400K3000KSE +/- 31391.51, N = 3SE +/- 27181.92, N = 3SE +/- 34294.14, N = 3SE +/- 41800.14, N = 4SE +/- 28699.35, N = 32054361.422674347.082122759.462783559.312575753.501. (CC) gcc options: -ggdb -rdynamic -lm -pthread

PyBench

Total For Average Test Times

KPTI OnKPTI OffOpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2008-08-14Total For Average Test TimesUbuntuClear Linux2004006008001000SE +/- 1.86, N = 3SE +/- 3.53, N = 3SE +/- 1.20, N = 3SE +/- 1.20, N = 311129651107964

Apache Benchmark

Static Web Page Serving

KPTI OnKPTI OffOpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.7Static Web Page ServingUbuntuClear Linux9K18K27K36K45KSE +/- 144.25, N = 3SE +/- 220.14, N = 3SE +/- 235.96, N = 3SE +/- 230.01, N = 338847.3539104.9740998.6541772.461. (CC) gcc options: -shared -fPIC -pthread

PHPBench

PHP Benchmark Suite

KPTI OnKPTI OffOpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark SuiteUbuntuClear Linux170K340K510K680K850KSE +/- 7133.32, N = 3SE +/- 1989.83, N = 3SE +/- 2536.56, N = 3SE +/- 4133.71, N = 3578130773039585886768813

Scikit-Learn

KPTI OnKPTI OffOpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 0.17.1UbuntuClear Linux714212835SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 329.529.9029.229.81

Phoronix Test Suite v10.8.4