Windows Server 2016 VA vs. Ubuntu 18.04 LTS Mitigations vs. Clear Linux

Spectre and Meltdown mitigation tests on Windows and Linux. Tests for a future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/1803315-AR-MITIGATIO49&sor&grs.

Windows Server 2016 VA vs. Ubuntu 18.04 LTS Mitigations vs. Clear LinuxProcessorMotherboardMemoryDiskGraphicsNetworkChipsetAudioMonitorOSKernelDisplay DriverFile-SystemScreen ResolutionDesktopOpenGLCompilerVulkanWindows Server - No MitigationsWindows Server - VA ShadowUbuntu - MitigatedUbuntu - noptiUbuntu - nopti + spectre_v2=offUbuntu + 4.16Ubuntu + 4.16 - noptiUbuntu + 4.16 - nopti + spectre_v2=offClear LinuxClear Linux - noptiClear Linux - nopti + spectre_v2=offIntel Xeon E3-1280 v5 @ 3.70GHz (4 Cores / 8 Threads)MSI Z170A SLI PLUS (MS-7998)2 x 8192 MB 2133MHz Micron 9ASF1G72AZ-2G3A1238GB TOSHIBA-RD400Microsoft Basic DisplayASIX AX88772B USB2.0 to Fast + Microsoft ISATAPMicrosoft Windows Server 2016 Essentials Build 1439310.0 (x86_64)10.0.14393.0NTFS1024x768Intel Xeon E3-1280 v5 @ 4.00GHz (4 Cores / 8 Threads)MSI Z170A SLI PLUS (MS-7998) v1.0 (2.90 BIOS)Intel Skylake16384MB256GB TOSHIBA-RD400Sapphire AMD Radeon 4096MBRealtek ALC1150Acer B286HKIntel ConnectionUbuntu 18.044.15.0-13-generic (x86_64)GNOME Shell 3.28.0modesetting 1.19.64.5 Mesa 18.0.0-rc5 (LLVM 6.0.0)GCC 7.3.0ext43840x21604.16.0-999-generic (x86_64) 20180328llvmpipe 16000MB3.3 Mesa 18.0.0-rc5 (LLVM 6.0 256 bits)1024x768Sapphire AMD Radeon 4096MBAcer B286HK4.5 Mesa 18.0.0-rc5 (LLVM 6.0.0)3840x2160Intel Xeon E3-1200 v5/E3-15002 x 8192 MB DDR4-2133MT/s16GB Voyager 3.0 + 256GB TOSHIBA-RD400Sapphire AMD Radeon RX 470/480/570/580 4096MBClear Linux OS 215704.15.14-538.native (x86_64)1.0.39GCC 7.3.0 + Clang 6.0.0 + LLVM 6.0.0OpenBenchmarking.orgPython Details- Windows Server - No Mitigations: Python 2.7.14- Windows Server - VA Shadow: Python 2.7.14- Ubuntu - Mitigated: Python 2.7.14+ + Python 3.6.5rc1- Ubuntu - nopti: Python 2.7.14+ + Python 3.6.5rc1- Ubuntu - nopti + spectre_v2=off: Python 2.7.14+ + Python 3.6.5rc1- Ubuntu + 4.16: Python 2.7.14+ + Python 3.6.5rc1- Ubuntu + 4.16 - nopti: Python 2.7.14+ + Python 3.6.5rc1- Ubuntu + 4.16 - nopti + spectre_v2=off: Python 2.7.14+ + Python 3.6.5rc1- Clear Linux: Python 3.6.4- Clear Linux - nopti: Python 3.6.4- Clear Linux - nopti + spectre_v2=off: Python 3.6.4Compiler Details- Ubuntu - Mitigated: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu - nopti: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu - nopti + spectre_v2=off: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu + 4.16: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu + 4.16 - nopti: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu + 4.16 - nopti + spectre_v2=off: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Clear Linux: --build=x86_64-generic-linux --disable-libmpx --disable-libunwind-exceptions --disable-multiarch --disable-vtable-verify --enable-__cxa_atexit --enable-bootstrap --enable-clocale=gnu --enable-gnu-indirect-function --enable-languages=c,c++,fortran,go --enable-ld=default --enable-libstdcxx-pch --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --exec-prefix=/usr --includedir=/usr/include --target=x86_64-generic-linux --with-arch=westmere --with-glibc-version=2.19 --with-gnu-ld --with-isl --with-ppl=yes --with-tune=haswell - Clear Linux - nopti: --build=x86_64-generic-linux --disable-libmpx --disable-libunwind-exceptions --disable-multiarch --disable-vtable-verify --enable-__cxa_atexit --enable-bootstrap --enable-clocale=gnu --enable-gnu-indirect-function --enable-languages=c,c++,fortran,go --enable-ld=default --enable-libstdcxx-pch --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --exec-prefix=/usr --includedir=/usr/include --target=x86_64-generic-linux --with-arch=westmere --with-glibc-version=2.19 --with-gnu-ld --with-isl --with-ppl=yes --with-tune=haswell - Clear Linux - nopti + spectre_v2=off: --build=x86_64-generic-linux --disable-libmpx --disable-libunwind-exceptions --disable-multiarch --disable-vtable-verify --enable-__cxa_atexit --enable-bootstrap --enable-clocale=gnu --enable-gnu-indirect-function --enable-languages=c,c++,fortran,go --enable-ld=default --enable-libstdcxx-pch --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --exec-prefix=/usr --includedir=/usr/include --target=x86_64-generic-linux --with-arch=westmere --with-glibc-version=2.19 --with-gnu-ld --with-isl --with-ppl=yes --with-tune=haswell Disk Details- Ubuntu - Mitigated: NONE / data=ordered,errors=remount-ro,relatime,rw- Ubuntu - nopti: NONE / data=ordered,errors=remount-ro,relatime,rw- Ubuntu - nopti + spectre_v2=off: NONE / data=ordered,errors=remount-ro,relatime,rw- Ubuntu + 4.16: NONE / data=ordered,errors=remount-ro,relatime,rw- Ubuntu + 4.16 - nopti: NONE / data=ordered,errors=remount-ro,relatime,rw- Ubuntu + 4.16 - nopti + spectre_v2=off: NONE / data=ordered,errors=remount-ro,relatime,rw- Clear Linux: KYBER / data=ordered,relatime,rw,stripe=256- Clear Linux - nopti: KYBER / data=ordered,relatime,rw,stripe=256- Clear Linux - nopti + spectre_v2=off: KYBER / data=ordered,relatime,rw,stripe=256Processor Details- Ubuntu - Mitigated: Scaling Governor: intel_pstate powersave- Ubuntu - nopti: Scaling Governor: intel_pstate powersave- Ubuntu - nopti + spectre_v2=off: Scaling Governor: intel_pstate powersave- Ubuntu + 4.16: Scaling Governor: intel_pstate powersave- Ubuntu + 4.16 - nopti: Scaling Governor: intel_pstate powersave- Ubuntu + 4.16 - nopti + spectre_v2=off: Scaling Governor: intel_pstate powersave- Clear Linux: Scaling Governor: intel_pstate performance- Clear Linux - nopti: Scaling Governor: intel_pstate performance- Clear Linux - nopti + spectre_v2=off: Scaling Governor: intel_pstate performanceSecurity Details- Ubuntu - Mitigated: KPTI + __user pointer sanitization + Full generic retpoline Protection- Ubuntu - nopti: __user pointer sanitization + Full generic retpoline Protection- Ubuntu - nopti + spectre_v2=off: __user pointer sanitization Protection- Ubuntu + 4.16: KPTI + __user pointer sanitization + Full generic retpoline Protection- Ubuntu + 4.16 - nopti: __user pointer sanitization + Full generic retpoline Protection- Ubuntu + 4.16 - nopti + spectre_v2=off: __user pointer sanitization Protection- Clear Linux: KPTI + __user pointer sanitization + Full generic retpoline Protection- Clear Linux - nopti: __user pointer sanitization + Full generic retpoline Protection- Clear Linux - nopti + spectre_v2=off: __user pointer sanitization ProtectionEnvironment Details- Clear Linux, Clear Linux - nopti, Clear Linux - nopti + spectre_v2=off: CFFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-malign-data=abi-fno-semantic-interposition-ftree-vectorize-ftree-loop-vectorize-Wl-sort-common CFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common CXXFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common-fvisibility-inlines-hidden FFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-malign-data=abi-fno-semantic-interposition-ftree-vectorize-ftree-loop-vectorize THEANO_FLAGS=floatX=float32 openmp=true gcc.cxxflags="-ftree-vectorize-mavx"

Windows Server 2016 VA vs. Ubuntu 18.04 LTS Mitigations vs. Clear Linuxebizzy: osbench: Create Filesphpbench: PHP Benchmark Suitecachebench: Readosbench: Launch Programsiozone: 4Kb - 8GB - Write Performancesqlite: Timed SQLite Insertionscachebench: Read / Modify / Writepybench: Total For Average Test Timesbuild-llvm: Time To Compileosbench: Memory Allocationsjava-scimark2: Dense LU Matrix Factorizationgimp: resizegimp: unsharp-maskgimp: auto-levelsjava-scimark2: Compositejava-scimark2: Monte Carlojava-scimark2: Sparse Matrix Multiplyjava-scimark2: Jacobi Successive Over-Relaxationjava-scimark2: Fast Fourier Transformcachebench: Writegimp: unsharp-maskgimp: auto-levelsgimp: resizeWindows Server - No MitigationsWindows Server - VA ShadowUbuntu - MitigatedUbuntu - noptiUbuntu - nopti + spectre_v2=offUbuntu + 4.16Ubuntu + 4.16 - noptiUbuntu + 4.16 - nopti + spectre_v2=offClear LinuxClear Linux - noptiClear Linux - nopti + spectre_v2=off5359248.633356347577.06494.21559.59108.3145636.521395929.7175.675942.702469.16981.592286.301546.061589.1528034.5320.6514.5712.494768266.723176117095.36523.81549.44114.0442855.851480934.8483.455351.162247.28895.752098.071415.711475.7026327.8121.3014.8212.3927105113.556457783331.0440.291018.5271.8328912.571289741.0276.305974.442433.57973.042269.931438.301512.1627691.7926093812.806478803347.0937.05796.1566.5729269.201290735.3472.586086.792470.79983.512293.981453.621536.0527992.6025632211.256452933361.6236.61889.2376.2528987.521286734.0072.556050.752.749.935.332428.62969.732136.401443.711542.4927073.3926175313.306400133349.4839.83866.1974.5329447.191287739.7775.096094.483.0610.835.782462.89980.152290.971437.851510.9928015.9425757512.406523063349.2437.24823.6064.2328703.971287736.1072.466130.972.8510.035.402477.61983.512292.721449.411531.4627374.1627638111.036459873370.8536.76905.0163.8529291.521284735.3372.386125.332.759.935.372473.76983.172292.471454.861512.9627660.012573938094303802.661074.5962.1945105.4910566160.122.9611.145.892482.56982.832291.721451.981526.1327488.932639488068733803.181033.7065.6545014.8410556134.612.7610.715.662480.51982.832267.331452.801565.0027907.562531278037833801.891035.2761.5345805.6010586020.552.6910.465.542455.08982.942291.221452.521528.1527912.66OpenBenchmarking.org

ebizzy

OpenBenchmarking.orgRecords/s, More Is Betterebizzy 0.3Ubuntu + 4.16 - nopti + spectre_v2=offUbuntu - MitigatedClear Linux - noptiUbuntu + 4.16Ubuntu - noptiUbuntu + 4.16 - noptiClear LinuxUbuntu - nopti + spectre_v2=offClear Linux - nopti + spectre_v2=offWindows Server - No MitigationsWindows Server - VA Shadow60K120K180K240K300KSE +/- 583.28, N = 3SE +/- 1134.37, N = 3SE +/- 4206.85, N = 6SE +/- 5241.71, N = 6SE +/- 894.59, N = 3SE +/- 7787.30, N = 6SE +/- 4243.73, N = 6SE +/- 8371.52, N = 6SE +/- 5362.31, N = 6SE +/- 56.17, N = 3SE +/- 55.38, N = 327638127105126394826175326093825757525739325632225312753594768-pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math-pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math-pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math1. (CC) gcc options: -pthread -lpthread -O3 -march=native

OSBench

Test: Create Files

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesUbuntu + 4.16 - nopti + spectre_v2=offUbuntu - nopti + spectre_v2=offUbuntu + 4.16 - noptiUbuntu - noptiUbuntu + 4.16Ubuntu - MitigatedWindows Server - No MitigationsWindows Server - VA Shadow60120180240300SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.67, N = 311.0311.2512.4012.8013.3013.55248.63266.721. (CC) gcc options: -lm

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark SuiteClear LinuxClear Linux - noptiClear Linux - nopti + spectre_v2=offUbuntu + 4.16 - noptiUbuntu - noptiUbuntu + 4.16 - nopti + spectre_v2=offUbuntu - MitigatedUbuntu - nopti + spectre_v2=offUbuntu + 4.16Windows Server - No MitigationsWindows Server - VA Shadow200K400K600K800K1000KSE +/- 828.88, N = 3SE +/- 1767.47, N = 3SE +/- 1729.85, N = 3SE +/- 1842.44, N = 3SE +/- 3162.10, N = 3SE +/- 3136.48, N = 3SE +/- 5347.65, N = 3SE +/- 3856.85, N = 3SE +/- 7319.66, N = 3SE +/- 2130.68, N = 3SE +/- 347.52, N = 3809430806873803783652306647880645987645778645293640013335634317611

CacheBench

Test: Read

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: ReadWindows Server - No MitigationsWindows Server - VA ShadowClear Linux - noptiClear LinuxClear Linux - nopti + spectre_v2=offUbuntu + 4.16 - nopti + spectre_v2=offUbuntu - nopti + spectre_v2=offUbuntu + 4.16Ubuntu + 4.16 - noptiUbuntu - noptiUbuntu - Mitigated16003200480064008000SE +/- 0.27, N = 3SE +/- 22.34, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 1.57, N = 3SE +/- 1.11, N = 3SE +/- 3.50, N = 3SE +/- 6.09, N = 3SE +/- 25.23, N = 3SE +/- 24.00, N = 3SE +/- 9.87, N = 37577.067095.363803.183802.663801.893370.853361.623349.483349.243347.093331.041. (CC) gcc options: -lrt

OSBench

Test: Launch Programs

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Launch ProgramsUbuntu - nopti + spectre_v2=offUbuntu + 4.16 - nopti + spectre_v2=offUbuntu - noptiUbuntu + 4.16 - noptiUbuntu + 4.16Ubuntu - MitigatedWindows Server - No MitigationsWindows Server - VA Shadow110220330440550SE +/- 0.29, N = 3SE +/- 0.13, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.12, N = 3SE +/- 0.05, N = 3SE +/- 0.37, N = 3SE +/- 2.00, N = 336.6136.7637.0537.2439.8340.29494.21523.811. (CC) gcc options: -lm

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceClear LinuxClear Linux - nopti + spectre_v2=offClear Linux - noptiUbuntu - MitigatedUbuntu + 4.16 - nopti + spectre_v2=offUbuntu - nopti + spectre_v2=offUbuntu + 4.16Ubuntu + 4.16 - noptiUbuntu - noptiWindows Server - No MitigationsWindows Server - VA Shadow2004006008001000SE +/- 5.63, N = 3SE +/- 6.29, N = 3SE +/- 7.19, N = 3SE +/- 2.90, N = 3SE +/- 0.72, N = 3SE +/- 4.91, N = 3SE +/- 12.00, N = 3SE +/- 1.04, N = 3SE +/- 11.30, N = 3SE +/- 18.71, N = 6SE +/- 9.05, N = 41074.591035.271033.701018.52905.01889.23866.19823.60796.15559.59549.441. (CC) gcc options: -O3

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsClear Linux - nopti + spectre_v2=offClear LinuxUbuntu + 4.16 - nopti + spectre_v2=offUbuntu + 4.16 - noptiClear Linux - noptiUbuntu - noptiUbuntu - MitigatedUbuntu + 4.16Ubuntu - nopti + spectre_v2=offWindows Server - No MitigationsWindows Server - VA Shadow306090120150SE +/- 0.10, N = 3SE +/- 0.22, N = 3SE +/- 0.15, N = 3SE +/- 0.33, N = 3SE +/- 0.18, N = 3SE +/- 0.11, N = 3SE +/- 0.77, N = 3SE +/- 0.07, N = 3SE +/- 0.13, N = 3SE +/- 0.41, N = 3SE +/- 0.26, N = 361.5362.1963.8564.2365.6566.5771.8374.5376.25108.31114.04-O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -lz-O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -lz-O2-O2-O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -lz-O2-O2-O2-O21. (CC) gcc options: -ldl -lpthread

CacheBench

Test: Read / Modify / Write

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: Read / Modify / WriteClear Linux - nopti + spectre_v2=offWindows Server - No MitigationsClear LinuxClear Linux - noptiWindows Server - VA ShadowUbuntu + 4.16Ubuntu + 4.16 - nopti + spectre_v2=offUbuntu - noptiUbuntu - nopti + spectre_v2=offUbuntu - MitigatedUbuntu + 4.16 - nopti10K20K30K40K50KSE +/- 66.23, N = 3SE +/- 5.58, N = 3SE +/- 819.06, N = 3SE +/- 144.35, N = 3SE +/- 7.83, N = 3SE +/- 184.20, N = 3SE +/- 281.73, N = 3SE +/- 248.96, N = 3SE +/- 228.49, N = 3SE +/- 466.25, N = 4SE +/- 272.63, N = 345805.6045636.5245105.4945014.8442855.8529447.1929291.5229269.2028987.5228912.5728703.971. (CC) gcc options: -lrt

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesClear Linux - noptiClear LinuxClear Linux - nopti + spectre_v2=offUbuntu + 4.16 - nopti + spectre_v2=offUbuntu - nopti + spectre_v2=offUbuntu + 4.16Ubuntu + 4.16 - noptiUbuntu - MitigatedUbuntu - noptiWindows Server - No MitigationsWindows Server - VA Shadow30060090012001500SE +/- 3.48, N = 3SE +/- 3.06, N = 3SE +/- 2.40, N = 3SE +/- 1.20, N = 3SE +/- 2.40, N = 3SE +/- 1.00, N = 3SE +/- 2.08, N = 3SE +/- 2.03, N = 3SE +/- 3.71, N = 310551056105812841286128712871289129013951480

Timed LLVM Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 4.0.1Time To CompileUbuntu - nopti + spectre_v2=offUbuntu + 4.16 - nopti + spectre_v2=offUbuntu - noptiUbuntu + 4.16 - noptiUbuntu + 4.16Ubuntu - MitigatedWindows Server - No MitigationsWindows Server - VA Shadow2004006008001000SE +/- 0.17, N = 3SE +/- 0.27, N = 3SE +/- 0.09, N = 3SE +/- 0.42, N = 3SE +/- 0.25, N = 3SE +/- 0.60, N = 3SE +/- 1.73, N = 3SE +/- 1.01, N = 3734.00735.33735.34736.10739.77741.02929.71934.84

OSBench

Test: Memory Allocations

OpenBenchmarking.orgNs Per Event, Fewer Is BetterOSBenchTest: Memory AllocationsUbuntu + 4.16 - nopti + spectre_v2=offUbuntu + 4.16 - noptiUbuntu - nopti + spectre_v2=offUbuntu - noptiUbuntu + 4.16Windows Server - No MitigationsUbuntu - MitigatedWindows Server - VA Shadow20406080100SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.14, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.60, N = 372.3872.4672.5572.5875.0975.6776.3083.451. (CC) gcc options: -lm

Java SciMark

Computational Test: Dense LU Matrix Factorization

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Dense LU Matrix FactorizationClear LinuxClear Linux - noptiUbuntu + 4.16 - noptiUbuntu + 4.16 - nopti + spectre_v2=offUbuntu + 4.16Ubuntu - noptiUbuntu - nopti + spectre_v2=offClear Linux - nopti + spectre_v2=offUbuntu - MitigatedWindows Server - No MitigationsWindows Server - VA Shadow13002600390052006500SE +/- 51.38, N = 4SE +/- 41.91, N = 4SE +/- 36.64, N = 4SE +/- 46.04, N = 4SE +/- 52.51, N = 4SE +/- 42.66, N = 4SE +/- 55.23, N = 4SE +/- 11.32, N = 4SE +/- 10.80, N = 4SE +/- 40.09, N = 4SE +/- 18.47, N = 46160.126134.616130.976125.336094.486086.796050.756020.555974.445942.705351.16

GIMP

Test: resize

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.8.22Test: resizeClear Linux - nopti + spectre_v2=offUbuntu - nopti + spectre_v2=offUbuntu + 4.16 - nopti + spectre_v2=offClear Linux - noptiUbuntu + 4.16 - noptiClear LinuxUbuntu + 4.160.68851.3772.06552.7543.4425SE +/- 0.04, N = 6SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 5SE +/- 0.03, N = 3SE +/- 0.05, N = 4SE +/- 0.04, N = 32.692.742.752.762.852.963.06

GIMP

Test: unsharp-mask

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.8.22Test: unsharp-maskUbuntu - nopti + spectre_v2=offUbuntu + 4.16 - nopti + spectre_v2=offUbuntu + 4.16 - noptiClear Linux - nopti + spectre_v2=offClear Linux - noptiUbuntu + 4.16Clear Linux3691215SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 39.939.9310.0310.4610.7110.8311.14

GIMP

Test: auto-levels

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.8.22Test: auto-levelsUbuntu - nopti + spectre_v2=offUbuntu + 4.16 - nopti + spectre_v2=offUbuntu + 4.16 - noptiClear Linux - nopti + spectre_v2=offClear Linux - noptiUbuntu + 4.16Clear Linux1.32532.65063.97595.30126.6265SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 35.335.375.405.545.665.785.89

Java SciMark

Computational Test: Composite

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: CompositeClear LinuxClear Linux - noptiUbuntu + 4.16 - noptiUbuntu + 4.16 - nopti + spectre_v2=offUbuntu - noptiWindows Server - No MitigationsUbuntu + 4.16Clear Linux - nopti + spectre_v2=offUbuntu - MitigatedUbuntu - nopti + spectre_v2=offWindows Server - VA Shadow5001000150020002500SE +/- 8.94, N = 4SE +/- 5.75, N = 4SE +/- 7.35, N = 4SE +/- 8.13, N = 4SE +/- 12.77, N = 4SE +/- 6.82, N = 4SE +/- 9.65, N = 4SE +/- 3.07, N = 4SE +/- 2.55, N = 4SE +/- 39.48, N = 4SE +/- 2.64, N = 42482.562480.512477.612473.762470.792469.162462.892455.082433.572428.622247.28

Java SciMark

Computational Test: Monte Carlo

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Monte CarloUbuntu + 4.16 - noptiUbuntu - noptiUbuntu + 4.16 - nopti + spectre_v2=offClear Linux - nopti + spectre_v2=offClear Linux - noptiClear LinuxWindows Server - No MitigationsUbuntu + 4.16Ubuntu - MitigatedUbuntu - nopti + spectre_v2=offWindows Server - VA Shadow2004006008001000SE +/- 0.23, N = 4SE +/- 0.13, N = 4SE +/- 0.34, N = 4SE +/- 0.11, N = 4SE +/- 0.18, N = 4SE +/- 0.18, N = 4SE +/- 0.11, N = 4SE +/- 2.11, N = 4SE +/- 1.82, N = 4SE +/- 11.61, N = 4SE +/- 3.23, N = 4983.51983.51983.17982.94982.83982.83981.59980.15973.04969.73895.75

Java SciMark

Computational Test: Sparse Matrix Multiply

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Sparse Matrix MultiplyUbuntu - noptiUbuntu + 4.16 - noptiUbuntu + 4.16 - nopti + spectre_v2=offClear LinuxClear Linux - nopti + spectre_v2=offUbuntu + 4.16Windows Server - No MitigationsUbuntu - MitigatedClear Linux - noptiUbuntu - nopti + spectre_v2=offWindows Server - VA Shadow5001000150020002500SE +/- 0.29, N = 4SE +/- 0.63, N = 4SE +/- 1.73, N = 4SE +/- 0.25, N = 4SE +/- 1.60, N = 4SE +/- 1.26, N = 4SE +/- 7.49, N = 4SE +/- 5.20, N = 4SE +/- 25.48, N = 4SE +/- 145.51, N = 4SE +/- 7.37, N = 42293.982292.722292.472291.722291.222290.972286.302269.932267.332136.402098.07

Java SciMark

Computational Test: Jacobi Successive Over-Relaxation

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Jacobi Successive Over-RelaxationWindows Server - No MitigationsUbuntu + 4.16 - nopti + spectre_v2=offUbuntu - noptiClear Linux - noptiClear Linux - nopti + spectre_v2=offClear LinuxUbuntu + 4.16 - noptiUbuntu - nopti + spectre_v2=offUbuntu - MitigatedUbuntu + 4.16Windows Server - VA Shadow30060090012001500SE +/- 2.78, N = 4SE +/- 0.50, N = 4SE +/- 0.52, N = 4SE +/- 0.41, N = 4SE +/- 0.26, N = 4SE +/- 0.26, N = 4SE +/- 3.80, N = 4SE +/- 3.58, N = 4SE +/- 1.41, N = 4SE +/- 6.71, N = 4SE +/- 1.84, N = 41546.061454.861453.621452.801452.521451.981449.411443.711438.301437.851415.71

Java SciMark

Computational Test: Fast Fourier Transform

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.0Computational Test: Fast Fourier TransformWindows Server - No MitigationsClear Linux - noptiUbuntu - nopti + spectre_v2=offUbuntu - noptiUbuntu + 4.16 - noptiClear Linux - nopti + spectre_v2=offClear LinuxUbuntu + 4.16 - nopti + spectre_v2=offUbuntu - MitigatedUbuntu + 4.16Windows Server - VA Shadow30060090012001500SE +/- 10.97, N = 4SE +/- 15.96, N = 4SE +/- 20.28, N = 4SE +/- 22.48, N = 4SE +/- 6.57, N = 4SE +/- 8.06, N = 4SE +/- 7.54, N = 4SE +/- 9.53, N = 4SE +/- 3.66, N = 4SE +/- 2.27, N = 4SE +/- 3.62, N = 41589.151565.001542.491536.051531.461528.151526.131512.961512.161510.991475.70

CacheBench

Test: Write

OpenBenchmarking.orgMB/s, More Is BetterCacheBenchTest: WriteWindows Server - No MitigationsUbuntu + 4.16Ubuntu - noptiClear Linux - nopti + spectre_v2=offClear Linux - noptiUbuntu - MitigatedUbuntu + 4.16 - nopti + spectre_v2=offClear LinuxUbuntu + 4.16 - noptiUbuntu - nopti + spectre_v2=offWindows Server - VA Shadow6K12K18K24K30KSE +/- 1.50, N = 3SE +/- 268.56, N = 3SE +/- 274.58, N = 3SE +/- 5.50, N = 3SE +/- 14.45, N = 3SE +/- 33.86, N = 3SE +/- 360.65, N = 3SE +/- 421.21, N = 3SE +/- 213.11, N = 3SE +/- 273.21, N = 3SE +/- 11.91, N = 328034.5328015.9427992.6027912.6627907.5627691.7927660.0127488.9327374.1627073.3926327.811. (CC) gcc options: -lrt

GIMP

Test: unsharp-mask

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.9.8Test: unsharp-maskWindows Server - No MitigationsWindows Server - VA Shadow510152025SE +/- 0.06, N = 3SE +/- 0.02, N = 320.6521.30

Redis

Test: LPUSH

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 3.2.1Test: LPUSHWindows Server - No MitigationsWindows Server - VA Shadow200K400K600K800K1000KSE +/- 4531.94, N = 3SE +/- 1204.53, N = 3905651.27880130.04

GIMP

Test: auto-levels

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.9.8Test: auto-levelsWindows Server - No MitigationsWindows Server - VA Shadow48121620SE +/- 0.21, N = 5SE +/- 0.02, N = 314.5714.82

GIMP

Test: resize

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.9.8Test: resizeWindows Server - VA ShadowWindows Server - No Mitigations3691215SE +/- 0.11, N = 3SE +/- 0.18, N = 312.3912.49

WinSAT

Test: Disk

OpenBenchmarking.orgMB/s, More Is BetterWinSATTest: DiskWindows Server - No MitigationsWindows Server - VA Shadow306090120150SE +/- 21.49, N = 6SE +/- 32.92, N = 6114.27111.83MIN: 76.08 / MAX: 208.74MIN: 70.14 / MAX: 275.95

Phoronix Test Suite v10.8.4