Docker Testing Ubuntu vs. Clear vs. Arch vs. Fedora

Tests for future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/1801069-AL-FEDORA80945.

ProcessorMotherboardMemoryDiskGraphicsAudioMonitorChipsetNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem LayerVulkanKPTI OnKPTI OffKPTI On Ubuntu Clear Linux Debian Ubuntu Clear Linux Arch Linux Fedora Debian FedoraIntel Core i7-8700K @ 4.70GHz (6 Cores / 12 Threads)ASUS PRIME Z370-A16384MB525GB Crucial_CT525MX3 + Samsung SSD 950 PRO 256GBnouveaufbRealtek ALC1220DELL P2415QUbuntu 16.04.3 LTS4.15.0-999-generic (x86_64) 20180105GCC 5.4.0 20160609overlayfs3840x2160dockerIntel Device 3ec2NVIDIA GeForce GTX 1080 Ti 11264MBIntel ConnectionClear Linux OS 191501.0.39GCC 7.2.1 20170910 + Clang 5.0.0 + LLVM 5.0.0nouveaufbDebian GNU/Linux 9GCC 6.3.0 20170516Ubuntu 16.04.3 LTSGCC 5.4.0 20160609dockerIntel Device 3ec2NVIDIA GeForce GTX 1080 Ti 11264MBIntel ConnectionClear Linux OS 191501.0.39GCC 7.2.1 20170910 + Clang 5.0.0 + LLVM 5.0.0nouveaufbArch LinuxGCC 7.2.1 20171128Fedora 27GCC 7.2.1 20170915Debian GNU/Linux 9GCC 6.3.0 20170516Fedora 27GCC 7.2.1 20170915OpenBenchmarking.orgCompiler Details- KPTI On: Ubuntu: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - KPTI On: Clear Linux: --build=x86_64-generic-linux --disable-libmpx --disable-libunwind-exceptions --disable-multiarch --disable-vtable-verify --enable-__cxa_atexit --enable-bootstrap --enable-clocale=gnu --enable-gnu-indirect-function --enable-languages=c,c++,fortran,go --enable-ld=default --enable-libstdcxx-pch --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --exec-prefix=/usr --includedir=/usr/include --target=x86_64-generic-linux --with-arch=westmere --with-glibc-version=2.19 --with-gnu-ld --with-isl --with-ppl=yes --with-tune=haswell - KPTI On: Debian: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - KPTI Off: Ubuntu: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - KPTI Off: Clear Linux: --build=x86_64-generic-linux --disable-libmpx --disable-libunwind-exceptions --disable-multiarch --disable-vtable-verify --enable-__cxa_atexit --enable-bootstrap --enable-clocale=gnu --enable-gnu-indirect-function --enable-languages=c,c++,fortran,go --enable-ld=default --enable-libstdcxx-pch --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --exec-prefix=/usr --includedir=/usr/include --target=x86_64-generic-linux --with-arch=westmere --with-glibc-version=2.19 --with-gnu-ld --with-isl --with-ppl=yes --with-tune=haswell - KPTI Off: Arch Linux: --disable-libssp --disable-libstdcxx-pch --disable-libunwind-exceptions --disable-werror --enable-__cxa_atexit --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-install-libiberty --enable-languages=c,c++,ada,fortran,go,lto,objc,obj-c++ --enable-libmpx --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-isl --with-linker-hash-style=gnu - KPTI Off: Fedora: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,fortran,ada,go,lto --enable-libmpx --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver - KPTI Off: Debian: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - KPTI On: Fedora: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,fortran,ada,go,lto --enable-libmpx --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver Processor Details- Scaling Governor: intel_pstate powersaveSystem Details- KPTI On: Ubuntu: Python 2.7.12.- KPTI On: Clear Linux: Python 2.7.12.- KPTI On: Debian: Python 2.7.13.- KPTI Off: Ubuntu: Python 2.7.12.- KPTI Off: Clear Linux: Python 2.7.12.- KPTI Off: Arch Linux: Python 3.6.4.- KPTI Off: Fedora: Python 2.7.14.- KPTI Off: Debian: Python 2.7.13.- KPTI On: Fedora: Python 2.7.14.Disk Scheduler Details- KPTI On: Ubuntu, KPTI On: Clear Linux: NONE

himeno: Poisson Pressure Solverstockfish: Total Timeopenssl: RSA 4096-bit Performancecaffe: CPU AlexNetcaffe: CPU Googlenetredis: GETredis: SETpybench: Total For Average Test Timesapache: Static Web Page Servingphpbench: PHP Benchmark Suitescikit-learn: KPTI OnKPTI OffKPTI On Ubuntu Clear Linux Debian Ubuntu Clear Linux Arch Linux Fedora Debian Fedora3055.2427481211.173082036097562877172.002054361.42111238847.3557813029.523140.8226981216.53844072083053881151.422674347.0896539104.977730399.902894.1329821181.332819036456872813287.922068979.29116958293232.962975.9527301218.903032796073182956186.582122759.46110740998.6558588629.223117.0826471216.77843822078803871526.422783559.3196441772.467688139.813094.2928551212.973672714.082575753.5026951215.873682875.212549087.6311626693352880.1830111182.402833446520462940663.802101473.37117657730532.2928471184.633575937.832466389.881209658208OpenBenchmarking.org

Himeno Benchmark

Poisson Pressure Solver

KPTI OnKPTI OffOpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverUbuntuClear LinuxDebianArch Linux7001400210028003500SE +/- 10.69, N = 3SE +/- 21.76, N = 3SE +/- 78.16, N = 6SE +/- 16.74, N = 3SE +/- 27.79, N = 3SE +/- 49.82, N = 3SE +/- 22.80, N = 33055.243140.822894.132975.953117.083094.292880.181. (CC) gcc options: -O3 -mavx2

Stockfish

Total Time

KPTI OnKPTI OffOpenBenchmarking.orgms, Fewer Is BetterStockfish 2014-11-26Total TimeUbuntuClear LinuxDebianArch LinuxFedora6001200180024003000SE +/- 4.04, N = 3SE +/- 27.55, N = 3SE +/- 4.67, N = 3SE +/- 14.29, N = 3SE +/- 39.15, N = 3SE +/- 8.11, N = 3SE +/- 21.54, N = 3SE +/- 11.27, N = 3SE +/- 6.51, N = 32748269829822847273026472855269530111. (CXX) g++ options: -lpthread -fno-exceptions -fno-rtti -ansi -pedantic -O3 -msse -msse3 -mpopcnt -flto

OpenSSL

RSA 4096-bit Performance

KPTI OnKPTI OffOpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.1gRSA 4096-bit PerformanceUbuntuClear LinuxDebianArch LinuxFedora30060090012001500SE +/- 0.43, N = 3SE +/- 1.47, N = 3SE +/- 0.13, N = 3SE +/- 0.73, N = 3SE +/- 0.20, N = 3SE +/- 0.23, N = 3SE +/- 0.35, N = 3SE +/- 0.35, N = 3SE +/- 0.74, N = 31211.171216.531181.331184.631218.901216.771212.971215.871182.401. (CC) gcc options: -m64 -O3 -lssl -lcrypto -ldl

Caffe

Build: CPU AlexNet

KPTI OnKPTI OffOpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2016-12-29Build: CPU AlexNetUbuntuClear LinuxDebian70K140K210K280K350KSE +/- 974.39, N = 3SE +/- 25.58, N = 3SE +/- 492.56, N = 3SE +/- 285.72, N = 3SE +/- 85.64, N = 3SE +/- 124.28, N = 330820384407281903303279843822833441. (CXX) g++ options: -pthread -fPIC -O2 -lcaffe -lglog -lgflags -lprotobuf -lboost_system -lboost_filesystem -lm -lhdf5_hl -lhdf5 -lleveldb -lsnappy -llmdb -lopencv_core -lopencv_highgui -lopencv_imgproc -lboost_thread -lstdc++

Caffe

Build: CPU Googlenet

KPTI OnKPTI OffOpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2016-12-29Build: CPU GooglenetUbuntuClear LinuxDebian140K280K420K560K700KSE +/- 1052.05, N = 3SE +/- 409.41, N = 3SE +/- 131.13, N = 3SE +/- 767.50, N = 3SE +/- 545.57, N = 3SE +/- 457.81, N = 36097562083056456876073182078806520461. (CXX) g++ options: -pthread -fPIC -O2 -lcaffe -lglog -lgflags -lprotobuf -lboost_system -lboost_filesystem -lm -lhdf5_hl -lhdf5 -lleveldb -lsnappy -llmdb -lopencv_core -lopencv_highgui -lopencv_imgproc -lboost_thread -lstdc++

Redis

Test: GET

KPTI OnKPTI OffOpenBenchmarking.orgRequests Per Second, More Is BetterRedis 3.0.1Test: GETUbuntuClear LinuxDebianArch LinuxFedora800K1600K2400K3200K4000KSE +/- 34872.79, N = 3SE +/- 18040.41, N = 3SE +/- 48006.54, N = 3SE +/- 21184.42, N = 3SE +/- 27746.21, N = 3SE +/- 33015.88, N = 3SE +/- 37096.31, N = 3SE +/- 67108.78, N = 6SE +/- 45542.05, N = 52877172.003881151.422813287.923575937.832956186.583871526.423672714.083682875.212940663.801. (CC) gcc options: -ggdb -rdynamic -lm -pthread

Redis

Test: SET

KPTI OnKPTI OffOpenBenchmarking.orgRequests Per Second, More Is BetterRedis 3.0.1Test: SETUbuntuClear LinuxDebianArch LinuxFedora600K1200K1800K2400K3000KSE +/- 31391.51, N = 3SE +/- 27181.92, N = 3SE +/- 3771.51, N = 3SE +/- 33520.35, N = 6SE +/- 34294.14, N = 3SE +/- 41800.14, N = 4SE +/- 28699.35, N = 3SE +/- 58560.23, N = 6SE +/- 25717.36, N = 32054361.422674347.082068979.292466389.882122759.462783559.312575753.502549087.632101473.371. (CC) gcc options: -ggdb -rdynamic -lm -pthread

PyBench

Total For Average Test Times

KPTI OnKPTI OffOpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2008-08-14Total For Average Test TimesUbuntuClear LinuxDebianFedora30060090012001500SE +/- 1.86, N = 3SE +/- 3.53, N = 3SE +/- 0.88, N = 3SE +/- 1.20, N = 3SE +/- 1.20, N = 3SE +/- 1.67, N = 3SE +/- 0.67, N = 3111296511691209110796411621176

Apache Benchmark

Static Web Page Serving

KPTI OnKPTI OffOpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.7Static Web Page ServingUbuntuClear Linux9K18K27K36K45KSE +/- 144.25, N = 3SE +/- 220.14, N = 3SE +/- 235.96, N = 3SE +/- 230.01, N = 338847.3539104.9740998.6541772.461. (CC) gcc options: -shared -fPIC -pthread

PHPBench

PHP Benchmark Suite

KPTI OnKPTI OffOpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark SuiteUbuntuClear LinuxDebianFedora170K340K510K680K850KSE +/- 7133.32, N = 3SE +/- 1989.83, N = 3SE +/- 1255.65, N = 3SE +/- 471.32, N = 3SE +/- 2536.56, N = 3SE +/- 4133.71, N = 3SE +/- 13159.22, N = 3SE +/- 2244.29, N = 3578130773039582932658208585886768813669335577305

Scikit-Learn

KPTI OnKPTI OffOpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 0.17.1UbuntuClear LinuxDebian816243240SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.44, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 329.529.9032.9629.229.8132.29

Phoronix Test Suite v10.8.4