Linux 4.16 To Linux 5.4 Kernel Benchmarks

Benchmarks for a future article by Michael Larabel.

HTML result view exported from: https://openbenchmarking.org/result/1911099-HU-COREI979629&sor&grs.

Linux 4.16 To Linux 5.4 Kernel BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4Intel Core i9-7960X @ 4.40GHz (16 Cores / 32 Threads)MSI X299 SLI PLUS (MS-7A93) v1.0 (1.A0 BIOS)Intel Sky Lake-E DMI3 Registers16384MB256GB INTEL SSDPEKKW256G8Gigabyte AMD Radeon 540/540X/550/550X / RX 540X/550/550X 2GB (1206/1750MHz)Realtek ALC1220ASUS VP28UIntel I219-V + Intel I211Ubuntu 19.104.16.0-041600-generic (x86_64)GNOME Shell 3.34.1X Server 1.20.5modesetting 1.20.54.5 Mesa 19.2.1 (LLVM 9.0.0)GCC 9.2.1 20191008ext43840x21604.17.0-041700-generic (x86_64)4.18.0-041800-generic (x86_64)4.19.0-041900-generic (x86_64)5.0.0-050000-generic (x86_64)5.1.0-050100-generic (x86_64)5.2.0-050200-generic (x86_64)5.3.0-050300-generic (x86_64)5.4.0-999-generic (x86_64) 20191030OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- Linux 4.16: NONE / data=ordered,errors=remount-ro,relatime,rw- Linux 4.17: NONE / errors=remount-ro,relatime,rw- Linux 4.18: NONE / errors=remount-ro,relatime,rw- Linux 4.19: NONE / errors=remount-ro,relatime,rw- Linux 5.0: NONE / errors=remount-ro,relatime,rw- Linux 5.1: NONE / errors=remount-ro,relatime,rw- Linux 5.2: NONE / errors=remount-ro,relatime,rw- Linux 5.3: NONE / errors=remount-ro,relatime,rw- Linux 5.4: NONE / errors=remount-ro,relatime,rwProcessor Details- Scaling Governor: intel_pstate powersaveJava Details- OpenJDK Runtime Environment (build 11.0.5-ea+10-post-Ubuntu-0ubuntu1)Python Details- Python 2.7.17rc1 + Python 3.7.5rc1Security Details- Linux 4.16: meltdown: Mitigation of PTI + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB IBRS_FW- Linux 4.17: meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB IBRS_FW- Linux 4.18: meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB IBRS_FW- Linux 4.19: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB IBRS_FW- Linux 5.0: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - Linux 5.1: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - Linux 5.2: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - Linux 5.3: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - Linux 5.4: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling

Linux 4.16 To Linux 5.4 Kernel Benchmarkshackbench: 16 - Processfio: Seq Read - Linux AIO - Yes - No - 2MB - Default Test Directoryctx-clock: Context Switch Timestress-ng: Socket Activityselenium: PSPDFKit WASM - Google Chromestress-ng: Context Switchinghackbench: 8 - Threadsockperf: Throughputselenium: ARES-6 - Google Chromehackbench: 32 - Processstress-ng: System V Message Passingselenium: Jetstream - Google Chromeselenium: Octane - Google Chromet-test1: 1apache: Static Web Page Servingselenium: Speedometer - Google Chromeoctave-benchmark: osbench: Create Threadsmemtier-benchmark: Redisrenaissance: Savina Reactors.IOselenium: CanvasMark - Google Chromeselenium: WebXPRT - Google Chromefio: Rand Read - Linux AIO - Yes - No - 2MB - Default Test Directorynginx: Static Web Page Servingselenium: MotionMark - Google Chromemcperf: Sett-test1: 2mcperf: Addredis: GEThmmer: Pfam Database Searchselenium: StyleBench - Google Chromeosbench: Launch Programsosbench: Create Processespgbench: Buffer Test - Normal Load - Read Onlygraphics-magick: Rotatex265: H.265 1080p Video Encodingstress-ng: Semaphoresmcperf: Getgraphics-magick: HWB Color Spacesqlite-speedtest: Timed Time - Size 1,000stress-ng: Forkingphpbench: PHP Benchmark Suitesockperf: Latency Ping Pongosbench: Create Filesvpxenc: vpxenc VP9 1080p Video Encodehimeno: Poisson Pressure Solverrocksdb: Read While Writingrenaissance: In-Memory Database Shootoutmcperf: Deletepybench: Total For Average Test Timesrenaissance: Akka Unbalanced Cobwebbed Treecompress-xz: Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9build-gcc: Time To Compileredis: SETdacapobench: H2mt-dgemm: Sustained Floating-Point Rategraphics-magick: Resizinggraphics-magick: Noise-Gaussianbuild-linux-kernel: Time To Compilerenaissance: Apache Spark Bayesrenaissance: Apache Spark ALSdacapobench: Jythonselenium: Basemark - Google Chromerocksdb: Seq Fillrocksdb: Rand Fillcassandra: Writeshackbench: 8 - Processhackbench: 16 - Threadebizzy: sqlite: 8sqlite: 1Linux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.424.152102443810735.02157713439936.4620.33961979019.2945.73310081645.26214.894631917.50537290.2811917.73914.7994362453256.7722922.5211974923462843938.70641.6969040.46.66968058.72484557.014.29135.334.84884928.897126445240.16390981260.173150939.77103598.498663.88695905.576694434.22213.187319218.933690.21428936868135527.976105887.5103512262.32319.694715.9452052883.7933176.523778139933347.5093105.8735729.39537651041.10131757574085712938515.27237.059478317118.14329.73625.316102841910572.38181814480654.6720.61763053720.2648.1758061310.83206.134464917.74235832.1511417.61816.2172322887947.2223071.5231890422463343212.56638.2970757.76.57670498.52522179.504.18136.0036.01551129.031038437014.57857180661.213084773.61108356.598462.28093842.197150704.12612.628449216.173888.14379136502865429.304108716.698512310.60019.112717.9372067565.1332696.416937139433347.3363075.9075753.46037371044.92132788142527014123414.39636.81549766451.66713.77126.336102042110056.09183614584272.5821.14261516720.2448.7688186176.60205.574467517.69335752.1711617.53115.8524522393171.9123504.2301909122563142198.44627.9069533.86.52269409.82513584.544.21236.1636.51698429.029846440888.43312280661.203125428.03111488.598662.91491990.127138784.16312.668976213.313895.24759236657665454.390111068.598812593.93819.356721.4182009941.9733176.343789140233347.2433077.6935730.8853731997.33131982142530412955017.07539.64049515854.33912.30625.838103141710255.80180615178230.4720.55858046420.0848.2698163830.70205.154463618.11536235.4411517.73313.3900642543202.9822531.6711919722463742756.69648.8869304.26.47869370.32538300.754.17836.135.219987441523.62309383161.143137571.74109637.498462.58798335.087142634.18212.655862216.263897.52106437051675548.082107442.398312389.11919.277718.62056274.2532786.313804140132947.2413141.3995712.72837421022.05130162845484414187315.51036.07048253055.68712.74126.157107340214936.08249119157911.8623.34146594927.5148.8127863922.43166.193646918.15034227.4897.7117.78613.4296422513890.2926285.8531683519866142363.25568.1066934.36.53467150.42540773.04.15633.2035.68331429.686292432615.93456982961.003119497.22110801.498062.24194606.267139714.03712.728458211.623898.57242635948875634.293110424.898512779.10119.585722.2262062208.9633216.312807139733047.7383159.7645750.6953755872.02130240544631613727818.41542.89547313855.97712.70925.889121140215265.14246918826824.5922.95646687427.5147.6548090485.00167.743646320.58833087.6497.6817.71613.9889722518787.5626333.4061676819870642002.16564.5565598.26.89665161.82594097.173.90333.0735.23349730.167103435672.02014081664.913149098.94109753.797762.37295760.197147134.17312.606977210.993894.77472337006765473.348109869.798312825.73819.843726.5072103801.2932516.311747139833247.5103098.4485713.7143743865.58121077845048313227516.74037.57645529855.33513.17031.659139071910846.48244812918420.7925.22343719827.5260.7029319564.99167.693645221.60431261.8397.221.39814.9095062393265.8626677.5421661019674038510.34565.0262751.77.39062696.12533896.253.87933.037.60099430.497710412471.93557777864.953023293.85107673.892666.18293246.837142894.18712.846319208.903898.18146335927665573.250108012.798412653.41520.082746.8592064719.2132706.334200137532648.3413126.7895796.7443760879.63110664745533912467419.29144.08146117556.26712.90752.22517037199668.18246212922338.0928.50943781827.4764.1329254599.36167.883634522.42530358.9197.221.38615.5933702474750.9126975.5011655419773637408.73561.7562649.97.38762122.72470246.253.89933.0238.14697331.510989408652.96083076464.792923858.94106005.191766.45792274.027131154.22213.387172207.673884.74651836310025728.898105447.698712906.44620.090747.5042045704.7531816.281222136432448.4653122.2465699.3833748858.02110499847737412060727.34053.88945529361.97913.02653.02119897259323.43248612566616.3930.58742135327.6163.0217580952.22167.253598122.04130624.3497.221.03314.9925552497759.1727025.4861647819773637462.17568.5161714.67.41761772.42777878.23.89433.2537.41105431.356017409157.33734779364.993125231.03105324.793166.61892385.027155254.30013.301070206.393893.54063435108185592.437105363.498312807.75920.000749.5192050891.2132306.357456137532548.5373090.7545789.6503782909.07115599350568812556727.27554.594467948150.90148.324OpenBenchmarking.org

Hackbench

Count: 16 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ProcessLinux 4.16Linux 4.17Linux 4.19Linux 5.1Linux 5.0Linux 4.18Linux 5.2Linux 5.3Linux 5.41224364860SE +/- 0.25, N = 15SE +/- 0.25, N = 15SE +/- 0.37, N = 15SE +/- 0.31, N = 15SE +/- 0.15, N = 3SE +/- 0.36, N = 3SE +/- 0.38, N = 15SE +/- 0.06, N = 3SE +/- 0.43, N = 324.1525.3225.8425.8926.1626.3431.6652.2353.021. (CC) gcc options: -lpthread

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.17Linux 4.16Linux 4.18400800120016002000SE +/- 0.58, N = 3SE +/- 0.88, N = 31989170313901211107310311028102410201. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

ctx_clock

Context Switch Time

OpenBenchmarking.orgClocks, Fewer Is Betterctx_clockContext Switch TimeLinux 5.0Linux 5.1Linux 4.19Linux 4.17Linux 4.18Linux 4.16Linux 5.2Linux 5.3Linux 5.4160320480640800SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 1.33, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 4.67, N = 3402402417419421438719719725

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Socket ActivityLinux 5.1Linux 5.0Linux 5.2Linux 4.16Linux 4.17Linux 4.19Linux 4.18Linux 5.3Linux 5.43K6K9K12K15KSE +/- 359.21, N = 12SE +/- 445.87, N = 15SE +/- 63.21, N = 3SE +/- 154.88, N = 3SE +/- 153.13, N = 3SE +/- 133.90, N = 3SE +/- 139.73, N = 3SE +/- 63.97, N = 3SE +/- 99.30, N = 315265.1414936.0810846.4810735.0210572.3810255.8010056.099668.189323.431. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

Selenium

Benchmark: PSPDFKit WASM - Browser: Google Chrome

OpenBenchmarking.orgScore, Fewer Is BetterSeleniumBenchmark: PSPDFKit WASM - Browser: Google ChromeLinux 4.16Linux 4.19Linux 4.17Linux 4.18Linux 5.2Linux 5.3Linux 5.1Linux 5.4Linux 5.05001000150020002500SE +/- 5.21, N = 3SE +/- 13.25, N = 3SE +/- 6.08, N = 3SE +/- 21.17, N = 3SE +/- 20.19, N = 3SE +/- 16.64, N = 3SE +/- 6.39, N = 3SE +/- 3.18, N = 3SE +/- 11.59, N = 31577180618181836244824622469248624911. chrome 78.0.3904.70

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Context SwitchingLinux 5.0Linux 5.1Linux 4.19Linux 4.18Linux 4.17Linux 4.16Linux 5.3Linux 5.2Linux 5.44M8M12M16M20MSE +/- 28459.23, N = 3SE +/- 28932.97, N = 3SE +/- 36379.23, N = 3SE +/- 98671.20, N = 3SE +/- 80071.56, N = 3SE +/- 130204.00, N = 3SE +/- 10222.49, N = 3SE +/- 5232.40, N = 3SE +/- 43063.08, N = 319157911.8618826824.5915178230.4714584272.5814480654.6713439936.4612922338.0912918420.7912566616.391. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

Hackbench

Count: 8 - Type: Thread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 8 - Type: ThreadLinux 4.16Linux 4.19Linux 4.17Linux 4.18Linux 5.1Linux 5.0Linux 5.2Linux 5.3Linux 5.4714212835SE +/- 0.21, N = 8SE +/- 0.27, N = 4SE +/- 0.14, N = 3SE +/- 0.31, N = 3SE +/- 0.24, N = 8SE +/- 0.34, N = 3SE +/- 0.18, N = 3SE +/- 0.34, N = 3SE +/- 0.06, N = 320.3420.5620.6221.1422.9623.3425.2228.5130.591. (CC) gcc options: -lpthread

Sockperf

Test: Throughput

OpenBenchmarking.orgMessages Per Second, More Is BetterSockperf 3.4Test: ThroughputLinux 4.17Linux 4.16Linux 4.18Linux 4.19Linux 5.1Linux 5.0Linux 5.3Linux 5.2Linux 5.4140K280K420K560K700KSE +/- 7822.09, N = 5SE +/- 4306.31, N = 5SE +/- 6920.94, N = 5SE +/- 3113.98, N = 5SE +/- 2431.43, N = 5SE +/- 1619.84, N = 5SE +/- 1654.08, N = 5SE +/- 2501.44, N = 5SE +/- 2930.42, N = 56305376197906151675804644668744659494378184371984213531. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

Selenium

Benchmark: ARES-6 - Browser: Google Chrome

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: Google ChromeLinux 4.16Linux 4.19Linux 4.18Linux 4.17Linux 5.3Linux 5.0Linux 5.1Linux 5.2Linux 5.4612182430SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 319.2920.0820.2420.2627.4727.5127.5127.5227.611. chrome 78.0.3904.70

Hackbench

Count: 32 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 32 - Type: ProcessLinux 4.16Linux 5.1Linux 4.17Linux 4.19Linux 4.18Linux 5.0Linux 5.2Linux 5.4Linux 5.31428425670SE +/- 0.03, N = 3SE +/- 0.29, N = 3SE +/- 0.04, N = 3SE +/- 0.68, N = 3SE +/- 0.81, N = 3SE +/- 0.65, N = 5SE +/- 1.02, N = 3SE +/- 0.06, N = 3SE +/- 1.04, N = 345.7347.6548.1848.2748.7748.8160.7063.0264.131. (CC) gcc options: -lpthread

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: System V Message PassingLinux 4.16Linux 5.2Linux 5.3Linux 4.18Linux 4.19Linux 5.1Linux 4.17Linux 5.0Linux 5.42M4M6M8M10MSE +/- 1708.04, N = 3SE +/- 5503.13, N = 3SE +/- 7511.21, N = 3SE +/- 3568.88, N = 3SE +/- 3522.10, N = 3SE +/- 5560.84, N = 3SE +/- 3528.20, N = 3SE +/- 2540.32, N = 3SE +/- 1433.35, N = 310081645.269319564.999254599.368186176.608163830.708090485.008061310.837863922.437580952.221. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

Selenium

Benchmark: Jetstream - Browser: Google Chrome

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream - Browser: Google ChromeLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.3Linux 5.1Linux 5.2Linux 5.4Linux 5.050100150200250SE +/- 0.33, N = 3SE +/- 0.48, N = 3SE +/- 0.49, N = 3SE +/- 1.25, N = 3SE +/- 0.33, N = 3SE +/- 0.61, N = 3SE +/- 0.32, N = 3SE +/- 0.86, N = 3SE +/- 0.95, N = 3214.89206.13205.57205.15167.88167.74167.69167.25166.191. chrome 78.0.3904.70

Selenium

Benchmark: Octane - Browser: Google Chrome

OpenBenchmarking.orgGeometric Mean, More Is BetterSeleniumBenchmark: Octane - Browser: Google ChromeLinux 4.16Linux 4.18Linux 4.17Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.410K20K30K40K50KSE +/- 83.60, N = 3SE +/- 201.91, N = 3SE +/- 51.26, N = 3SE +/- 35.00, N = 3SE +/- 103.38, N = 3SE +/- 34.53, N = 3SE +/- 27.51, N = 3SE +/- 23.67, N = 3SE +/- 178.01, N = 34631944675446494463636469364633645236345359811. chrome 78.0.3904.70

t-test1

Threads: 1

OpenBenchmarking.orgSeconds, Fewer Is Bettert-test1 2017-01-13Threads: 1Linux 4.16Linux 4.18Linux 4.17Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.4Linux 5.3510152025SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.26, N = 3SE +/- 0.10, N = 3SE +/- 0.35, N = 3SE +/- 0.25, N = 3SE +/- 0.31, N = 4SE +/- 0.17, N = 317.5117.6917.7418.1218.1520.5921.6022.0422.431. (CC) gcc options: -pthread

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingLinux 4.16Linux 4.19Linux 4.17Linux 4.18Linux 5.0Linux 5.1Linux 5.2Linux 5.4Linux 5.38K16K24K32K40KSE +/- 69.73, N = 3SE +/- 57.33, N = 3SE +/- 25.25, N = 3SE +/- 47.84, N = 3SE +/- 121.97, N = 3SE +/- 61.05, N = 3SE +/- 55.71, N = 3SE +/- 17.17, N = 3SE +/- 31.51, N = 337290.2836235.4435832.1535752.1734227.4833087.6431261.8330624.3430358.911. (CC) gcc options: -shared -fPIC -O2 -pthread

Selenium

Benchmark: Speedometer - Browser: Google Chrome

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: Google ChromeLinux 4.16Linux 4.18Linux 4.19Linux 4.17Linux 5.0Linux 5.1Linux 5.4Linux 5.3Linux 5.2306090120150SE +/- 0.33, N = 3SE +/- 0.88, N = 3SE +/- 1.76, N = 3SE +/- 0.88, N = 3SE +/- 0.26, N = 3SE +/- 0.36, N = 3SE +/- 0.23, N = 3SE +/- 0.36, N = 3SE +/- 0.21, N = 3119.00116.00115.00114.0097.7197.6897.2097.2097.201. chrome 78.0.3904.70

GNU Octave Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterGNU Octave Benchmark 4.4.1Linux 4.18Linux 4.17Linux 5.1Linux 4.19Linux 4.16Linux 5.0Linux 5.4Linux 5.3Linux 5.2510152025SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 317.5317.6217.7217.7317.7417.7921.0321.3921.40

OSBench

Test: Create Threads

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create ThreadsLinux 4.19Linux 5.0Linux 5.1Linux 4.16Linux 5.2Linux 5.4Linux 5.3Linux 4.18Linux 4.1748121620SE +/- 0.17, N = 5SE +/- 0.17, N = 5SE +/- 0.13, N = 10SE +/- 0.04, N = 3SE +/- 0.22, N = 4SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.28, N = 313.3913.4313.9914.8014.9114.9915.5915.8516.221. (CC) gcc options: -lm

Memtier_benchmark

Protocol: Redis

OpenBenchmarking.orgOps/sec, More Is BetterMemtier_benchmark 1.2.17Protocol: RedisLinux 4.17Linux 4.19Linux 5.1Linux 5.0Linux 5.4Linux 5.3Linux 4.16Linux 5.2Linux 4.18600K1200K1800K2400K3000KSE +/- 3366.95, N = 3SE +/- 47157.31, N = 15SE +/- 32758.70, N = 15SE +/- 28985.54, N = 15SE +/- 42499.20, N = 12SE +/- 34572.98, N = 15SE +/- 22142.37, N = 15SE +/- 4810.60, N = 3SE +/- 30319.17, N = 52887947.222543202.982518787.562513890.292497759.172474750.912453256.772393265.862393171.911. (CXX) g++ options: -O2 -levent -lpthread -lz -lpcre

Renaissance

Test: Savina Reactors.IO

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: Savina Reactors.IOLinux 4.19Linux 4.16Linux 4.17Linux 4.18Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.46K12K18K24K30KSE +/- 232.77, N = 8SE +/- 122.08, N = 40SE +/- 133.03, N = 8SE +/- 155.78, N = 8SE +/- 81.92, N = 8SE +/- 103.30, N = 8SE +/- 174.44, N = 8SE +/- 265.69, N = 8SE +/- 195.41, N = 822531.6722922.5223071.5223504.2326285.8526333.4126677.5426975.5027025.49

Selenium

Benchmark: CanvasMark - Browser: Google Chrome

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: CanvasMark - Browser: Google ChromeLinux 4.16Linux 4.19Linux 4.18Linux 4.17Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.44K8K12K16K20KSE +/- 114.65, N = 3SE +/- 78.55, N = 3SE +/- 63.49, N = 3SE +/- 98.08, N = 3SE +/- 149.61, N = 3SE +/- 142.61, N = 3SE +/- 76.73, N = 3SE +/- 145.12, N = 3SE +/- 204.14, N = 121974919197190911890416835167681661016554164781. chrome 78.0.3904.70

Selenium

Benchmark: WebXPRT - Browser: Google Chrome

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: WebXPRT - Browser: Google ChromeLinux 4.16Linux 4.18Linux 4.19Linux 4.17Linux 5.1Linux 5.0Linux 5.4Linux 5.3Linux 5.250100150200250SE +/- 0.67, N = 3SE +/- 0.33, N = 32342252242241981981971971961. chrome 78.0.3904.70

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryLinux 5.2Linux 5.4Linux 5.3Linux 5.1Linux 5.0Linux 4.19Linux 4.17Linux 4.18Linux 4.16160320480640800SE +/- 0.88, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 1.20, N = 3SE +/- 1.00, N = 3SE +/- 2.00, N = 37407367367066616376336316281. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

NGINX Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.9.9Static Web Page ServingLinux 4.16Linux 4.17Linux 4.19Linux 5.0Linux 4.18Linux 5.1Linux 5.2Linux 5.4Linux 5.39K18K27K36K45KSE +/- 126.12, N = 3SE +/- 133.58, N = 3SE +/- 305.20, N = 3SE +/- 135.60, N = 3SE +/- 115.49, N = 3SE +/- 108.77, N = 3SE +/- 201.92, N = 3SE +/- 211.54, N = 3SE +/- 116.65, N = 343938.7043212.5642756.6942363.2542198.4442002.1638510.3437462.1737408.731. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native

Selenium

Benchmark: MotionMark - Browser: Google Chrome

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: MotionMark - Browser: Google ChromeLinux 4.19Linux 4.16Linux 4.17Linux 4.18Linux 5.4Linux 5.0Linux 5.2Linux 5.1Linux 5.3140280420560700SE +/- 11.13, N = 3SE +/- 3.61, N = 3SE +/- 8.73, N = 4SE +/- 1.55, N = 3SE +/- 1.57, N = 3SE +/- 1.11, N = 3SE +/- 7.62, N = 4SE +/- 1.57, N = 3SE +/- 1.71, N = 3648.88641.69638.29627.90568.51568.10565.02564.55561.751. chrome 78.0.3904.70

Memcached mcperf

Method: Set

OpenBenchmarking.orgOperations Per Second, More Is BetterMemcached mcperf 1.5.10Method: SetLinux 4.17Linux 4.18Linux 4.19Linux 4.16Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.415K30K45K60K75KSE +/- 123.08, N = 3SE +/- 10.87, N = 3SE +/- 54.19, N = 3SE +/- 279.29, N = 3SE +/- 84.98, N = 3SE +/- 109.08, N = 3SE +/- 134.27, N = 3SE +/- 219.57, N = 3SE +/- 84.95, N = 370757.769533.869304.269040.466934.365598.262751.762649.961714.61. (CC) gcc options: -O2 -lm -rdynamic

t-test1

Threads: 2

OpenBenchmarking.orgSeconds, Fewer Is Bettert-test1 2017-01-13Threads: 2Linux 4.19Linux 4.18Linux 5.0Linux 4.17Linux 4.16Linux 5.1Linux 5.3Linux 5.2Linux 5.4246810SE +/- 0.019, N = 3SE +/- 0.016, N = 3SE +/- 0.005, N = 3SE +/- 0.025, N = 3SE +/- 0.036, N = 3SE +/- 0.023, N = 3SE +/- 0.019, N = 3SE +/- 0.009, N = 3SE +/- 0.022, N = 36.4786.5226.5346.5766.6696.8967.3877.3907.4171. (CC) gcc options: -pthread

Memcached mcperf

Method: Add

OpenBenchmarking.orgOperations Per Second, More Is BetterMemcached mcperf 1.5.10Method: AddLinux 4.17Linux 4.18Linux 4.19Linux 4.16Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.415K30K45K60K75KSE +/- 219.45, N = 3SE +/- 65.64, N = 3SE +/- 201.27, N = 3SE +/- 249.40, N = 3SE +/- 139.67, N = 3SE +/- 47.94, N = 3SE +/- 334.33, N = 3SE +/- 270.87, N = 3SE +/- 118.42, N = 370498.569409.869370.368058.767150.465161.862696.162122.761772.41. (CC) gcc options: -O2 -lm -rdynamic

Redis

Test: GET

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 5.0.5Test: GETLinux 5.4Linux 5.1Linux 5.0Linux 4.19Linux 5.2Linux 4.17Linux 4.18Linux 4.16Linux 5.3600K1200K1800K2400K3000KSE +/- 11829.24, N = 3SE +/- 39304.21, N = 3SE +/- 26570.06, N = 3SE +/- 17107.79, N = 3SE +/- 11965.98, N = 3SE +/- 38652.53, N = 3SE +/- 36408.41, N = 14SE +/- 43487.07, N = 15SE +/- 36804.16, N = 32777878.202594097.172540773.002538300.752533896.252522179.502513584.542484557.012470246.251. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 2.3.2Pfam Database SearchLinux 5.2Linux 5.4Linux 5.3Linux 5.1Linux 5.0Linux 4.19Linux 4.17Linux 4.18Linux 4.160.96551.9312.89653.8624.8275SE +/- 0.021, N = 3SE +/- 0.039, N = 3SE +/- 0.031, N = 3SE +/- 0.016, N = 3SE +/- 0.037, N = 3SE +/- 0.040, N = 3SE +/- 0.037, N = 3SE +/- 0.033, N = 3SE +/- 0.017, N = 33.8793.8943.8993.9034.1564.1784.1814.2124.2911. (CC) gcc options: -O2 -pthread -lhmmer -lsquid -lm

Selenium

Benchmark: StyleBench - Browser: Google Chrome

OpenBenchmarking.orgRuns / Minute, More Is BetterSeleniumBenchmark: StyleBench - Browser: Google ChromeLinux 4.18Linux 4.19Linux 4.17Linux 4.16Linux 5.4Linux 5.0Linux 5.1Linux 5.3Linux 5.2816243240SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.15, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 336.1636.1036.0035.3033.2533.2033.0733.0233.001. chrome 78.0.3904.70

OSBench

Test: Launch Programs

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Launch ProgramsLinux 4.16Linux 4.19Linux 5.1Linux 5.0Linux 4.17Linux 4.18Linux 5.4Linux 5.2Linux 5.3918273645SE +/- 0.31, N = 3SE +/- 0.42, N = 3SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.25, N = 3SE +/- 0.12, N = 3SE +/- 0.24, N = 3SE +/- 0.27, N = 3SE +/- 0.12, N = 334.8535.2235.2335.6836.0236.5237.4137.6038.151. (CC) gcc options: -lm

OSBench

Test: Create Processes

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create ProcessesLinux 4.16Linux 4.18Linux 4.17Linux 5.0Linux 5.1Linux 5.2Linux 5.4Linux 5.3714212835SE +/- 0.27, N = 3SE +/- 0.14, N = 2SE +/- 0.17, N = 3SE +/- 0.15, N = 3SE +/- 0.18, N = 3SE +/- 0.27, N = 3SE +/- 0.21, N = 328.9029.0329.0329.6930.1730.5031.3631.511. (CC) gcc options: -lm

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 12.0Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyLinux 4.16Linux 4.19Linux 4.18Linux 4.17Linux 5.1Linux 5.0Linux 5.2Linux 5.4Linux 5.3100K200K300K400K500KSE +/- 630.18, N = 3SE +/- 224.24, N = 3SE +/- 920.32, N = 3SE +/- 426.98, N = 3SE +/- 604.77, N = 3SE +/- 455.54, N = 3SE +/- 676.48, N = 3SE +/- 479.22, N = 3SE +/- 286.05, N = 3445240.16441523.62440888.43437014.58435672.02432615.93412471.94409157.34408652.961. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

GraphicsMagick

Operation: Rotate

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: RotateLinux 4.19Linux 5.0Linux 5.1Linux 4.16Linux 4.18Linux 4.17Linux 5.4Linux 5.2Linux 5.32004006008001000SE +/- 12.02, N = 4SE +/- 1.76, N = 3SE +/- 7.61, N = 15SE +/- 6.63, N = 15SE +/- 3.84, N = 3SE +/- 11.56, N = 4SE +/- 9.53, N = 6SE +/- 8.93, N = 15SE +/- 7.17, N = 38318298168128068067937787641. (CC) gcc options: -fopenmp -O2 -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lz -lm -lpthread

x265

H.265 1080p Video Encoding

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.1.2H.265 1080p Video EncodingLinux 5.4Linux 5.2Linux 5.1Linux 5.3Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 4.161530456075SE +/- 0.27, N = 3SE +/- 0.25, N = 3SE +/- 0.50, N = 3SE +/- 0.19, N = 3SE +/- 0.32, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 364.9964.9564.9164.7961.2161.2061.1461.0060.171. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: SemaphoresLinux 4.16Linux 5.1Linux 4.19Linux 4.18Linux 5.4Linux 5.0Linux 4.17Linux 5.2Linux 5.3700K1400K2100K2800K3500KSE +/- 39815.37, N = 3SE +/- 48219.45, N = 3SE +/- 40405.86, N = 3SE +/- 12612.37, N = 3SE +/- 21017.87, N = 3SE +/- 26407.83, N = 3SE +/- 10225.28, N = 3SE +/- 46357.86, N = 3SE +/- 41587.07, N = 33150939.773149098.943137571.743125428.033125231.033119497.223084773.613023293.852923858.941. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

Memcached mcperf

Method: Get

OpenBenchmarking.orgOperations Per Second, More Is BetterMemcached mcperf 1.5.10Method: GetLinux 4.18Linux 5.0Linux 5.1Linux 4.19Linux 4.17Linux 5.2Linux 5.3Linux 5.4Linux 4.1620K40K60K80K100KSE +/- 449.43, N = 3SE +/- 537.50, N = 3SE +/- 253.22, N = 3SE +/- 262.53, N = 3SE +/- 401.56, N = 3SE +/- 825.25, N = 3SE +/- 927.89, N = 3SE +/- 517.85, N = 3SE +/- 1174.11, N = 3111488.5110801.4109753.7109637.4108356.5107673.8106005.1105324.7103598.41. (CC) gcc options: -O2 -lm -rdynamic

GraphicsMagick

Operation: HWB Color Space

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: HWB Color SpaceLinux 4.18Linux 4.16Linux 4.19Linux 4.17Linux 5.0Linux 5.1Linux 5.4Linux 5.2Linux 5.32004006008001000SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 1.00, N = 3SE +/- 0.33, N = 3SE +/- 1.67, N = 3SE +/- 3.21, N = 3SE +/- 1.45, N = 39869869849849809779319269171. (CC) gcc options: -fopenmp -O2 -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lz -lm -lpthread

SQLite Speedtest

Timed Time - Size 1,000

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000Linux 5.0Linux 4.17Linux 5.1Linux 4.19Linux 4.18Linux 4.16Linux 5.2Linux 5.3Linux 5.41530456075SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.51, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.01, N = 362.2462.2862.3762.5962.9163.8966.1866.4666.621. (CC) gcc options: -O2 -ldl -lz -lpthread

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: ForkingLinux 4.19Linux 4.16Linux 5.1Linux 5.0Linux 4.17Linux 5.2Linux 5.4Linux 5.3Linux 4.1820K40K60K80K100KSE +/- 248.34, N = 3SE +/- 137.26, N = 3SE +/- 560.02, N = 3SE +/- 241.95, N = 3SE +/- 523.92, N = 3SE +/- 429.24, N = 3SE +/- 199.66, N = 3SE +/- 312.17, N = 3SE +/- 385.38, N = 398335.0895905.5795760.1994606.2693842.1993246.8392385.0292274.0291990.121. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark SuiteLinux 5.4Linux 4.17Linux 5.1Linux 5.2Linux 4.19Linux 5.0Linux 4.18Linux 5.3Linux 4.16150K300K450K600K750KSE +/- 362.09, N = 3SE +/- 950.60, N = 3SE +/- 734.57, N = 3SE +/- 638.75, N = 3SE +/- 1377.42, N = 3SE +/- 1473.20, N = 3SE +/- 536.81, N = 3SE +/- 364.74, N = 3SE +/- 7739.08, N = 3715525715070714713714289714263713971713878713115669443

Sockperf

Test: Latency Ping Pong

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.4Test: Latency Ping PongLinux 5.0Linux 4.17Linux 4.18Linux 5.1Linux 4.19Linux 5.2Linux 4.16Linux 5.3Linux 5.40.96751.9352.90253.874.8375SE +/- 0.051, N = 5SE +/- 0.009, N = 5SE +/- 0.020, N = 5SE +/- 0.029, N = 5SE +/- 0.019, N = 5SE +/- 0.047, N = 5SE +/- 0.026, N = 25SE +/- 0.018, N = 5SE +/- 0.018, N = 54.0374.1264.1634.1734.1824.1874.2224.2224.3001. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

OSBench

Test: Create Files

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesLinux 5.1Linux 4.17Linux 4.19Linux 4.18Linux 5.0Linux 5.2Linux 4.16Linux 5.4Linux 5.33691215SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 312.6112.6312.6612.6712.7312.8513.1913.3013.391. (CC) gcc options: -lm

VP9 libvpx Encoding

vpxenc VP9 1080p Video Encode

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.8.1vpxenc VP9 1080p Video EncodeLinux 4.16Linux 4.19Linux 4.17Linux 4.18Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.450100150200250SE +/- 0.29, N = 3SE +/- 0.40, N = 3SE +/- 0.17, N = 3SE +/- 0.44, N = 3SE +/- 0.33, N = 3SE +/- 0.61, N = 3SE +/- 0.49, N = 3SE +/- 1.04, N = 3SE +/- 0.76, N = 3218.93216.26216.17213.31211.62210.99208.90207.67206.391. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=c++11

Himeno Benchmark

Poisson Pressure Solver

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverLinux 5.0Linux 5.2Linux 4.19Linux 4.18Linux 5.1Linux 5.4Linux 4.17Linux 5.3Linux 4.168001600240032004000SE +/- 1.76, N = 3SE +/- 1.30, N = 3SE +/- 0.18, N = 3SE +/- 5.42, N = 3SE +/- 5.85, N = 3SE +/- 1.99, N = 3SE +/- 1.79, N = 3SE +/- 4.12, N = 3SE +/- 22.35, N = 33898.573898.183897.523895.253894.773893.543888.143884.753690.211. (CC) gcc options: -O3 -mavx2

Facebook RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Read While WritingLinux 4.19Linux 5.1Linux 4.16Linux 4.18Linux 4.17Linux 5.3Linux 5.0Linux 5.2Linux 5.4800K1600K2400K3200K4000KSE +/- 31366.97, N = 12SE +/- 60862.57, N = 3SE +/- 58285.58, N = 13SE +/- 37401.35, N = 15SE +/- 49420.31, N = 4SE +/- 39351.32, N = 3SE +/- 61152.51, N = 3SE +/- 40967.45, N = 15SE +/- 22846.74, N = 33705167370067636868133665766365028636310023594887359276635108181. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Renaissance

Test: In-Memory Database Shootout

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: In-Memory Database ShootoutLinux 4.17Linux 4.18Linux 5.1Linux 4.16Linux 4.19Linux 5.2Linux 5.4Linux 5.0Linux 5.312002400360048006000SE +/- 36.13, N = 8SE +/- 41.79, N = 8SE +/- 38.74, N = 8SE +/- 40.22, N = 16SE +/- 40.54, N = 8SE +/- 43.35, N = 8SE +/- 54.95, N = 8SE +/- 57.27, N = 40SE +/- 72.47, N = 405429.305454.395473.355527.985548.085573.255592.445634.295728.90

Memcached mcperf

Method: Delete

OpenBenchmarking.orgOperations Per Second, More Is BetterMemcached mcperf 1.5.10Method: DeleteLinux 4.18Linux 5.0Linux 5.1Linux 4.17Linux 5.2Linux 4.19Linux 4.16Linux 5.3Linux 5.420K40K60K80K100KSE +/- 826.71, N = 3SE +/- 715.34, N = 3SE +/- 278.53, N = 3SE +/- 216.44, N = 3SE +/- 274.62, N = 3SE +/- 668.17, N = 3SE +/- 1128.91, N = 3SE +/- 919.24, N = 3SE +/- 279.52, N = 3111068.5110424.8109869.7108716.6108012.7107442.3105887.5105447.6105363.41. (CC) gcc options: -O2 -lm -rdynamic

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesLinux 4.19Linux 5.1Linux 5.4Linux 5.2Linux 4.17Linux 5.0Linux 5.3Linux 4.18Linux 4.162004006008001000SE +/- 2.03, N = 3SE +/- 1.20, N = 3SE +/- 2.19, N = 3SE +/- 3.38, N = 39839839839849859859879881035

Renaissance

Test: Akka Unbalanced Cobwebbed Tree

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: Akka Unbalanced Cobwebbed TreeLinux 4.16Linux 4.17Linux 4.19Linux 4.18Linux 5.2Linux 5.0Linux 5.4Linux 5.1Linux 5.33K6K9K12K15KSE +/- 108.56, N = 11SE +/- 78.45, N = 40SE +/- 117.17, N = 9SE +/- 130.10, N = 8SE +/- 121.53, N = 8SE +/- 121.41, N = 9SE +/- 90.36, N = 40SE +/- 93.37, N = 8SE +/- 128.48, N = 812262.3212310.6012389.1212593.9412653.4212779.1012807.7612825.7412906.45

XZ Compression

Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9

OpenBenchmarking.orgSeconds, Fewer Is BetterXZ Compression 5.2.4Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9Linux 4.17Linux 4.19Linux 4.18Linux 5.0Linux 4.16Linux 5.1Linux 5.4Linux 5.2Linux 5.3510152025SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.27, N = 3SE +/- 0.27, N = 3SE +/- 0.29, N = 3SE +/- 0.01, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 319.1119.2819.3619.5919.6919.8420.0020.0820.091. (CC) gcc options: -pthread -fvisibility=hidden -O2

Timed GCC Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 8.2Time To CompileLinux 4.16Linux 4.17Linux 4.19Linux 4.18Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4160320480640800715.95717.94718.60721.42722.23726.51746.86747.50749.52

Redis

Test: SET

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 5.0.5Test: SETLinux 5.1Linux 4.17Linux 5.2Linux 5.0Linux 4.19Linux 4.16Linux 5.4Linux 5.3Linux 4.18500K1000K1500K2000K2500KSE +/- 3899.38, N = 3SE +/- 5128.18, N = 3SE +/- 5133.08, N = 3SE +/- 18999.92, N = 3SE +/- 8564.39, N = 3SE +/- 30387.93, N = 3SE +/- 17771.47, N = 3SE +/- 26865.01, N = 3SE +/- 16461.30, N = 152103801.292067565.132064719.212062208.962056274.252052883.792050891.212045704.752009941.971. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

DaCapo Benchmark

Java Test: H2

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: H2Linux 5.3Linux 5.4Linux 5.1Linux 4.17Linux 5.2Linux 4.19Linux 4.16Linux 4.18Linux 5.07001400210028003500SE +/- 40.86, N = 4SE +/- 28.22, N = 4SE +/- 26.18, N = 4SE +/- 39.41, N = 4SE +/- 28.35, N = 4SE +/- 32.79, N = 4SE +/- 39.92, N = 4SE +/- 27.21, N = 4SE +/- 42.44, N = 5318132303251326932703278331733173321

ACES DGEMM

Sustained Floating-Point Rate

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateLinux 4.16Linux 4.17Linux 5.4Linux 4.18Linux 5.2Linux 4.19Linux 5.0Linux 5.1Linux 5.3246810SE +/- 0.060473, N = 3SE +/- 0.025125, N = 3SE +/- 0.094451, N = 3SE +/- 0.085077, N = 3SE +/- 0.033802, N = 3SE +/- 0.106076, N = 3SE +/- 0.077740, N = 3SE +/- 0.081110, N = 5SE +/- 0.084025, N = 46.5237786.4169376.3574566.3437896.3342006.3138046.3128076.3117476.2812221. (CC) gcc options: -O3 -march=native -fopenmp

GraphicsMagick

Operation: Resizing

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: ResizingLinux 4.18Linux 4.19Linux 4.16Linux 5.1Linux 5.0Linux 4.17Linux 5.4Linux 5.2Linux 5.330060090012001500SE +/- 2.19, N = 3SE +/- 3.61, N = 3SE +/- 2.40, N = 3SE +/- 0.58, N = 3SE +/- 2.19, N = 3SE +/- 2.40, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 31402140113991398139713941375137513641. (CC) gcc options: -fopenmp -O2 -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lz -lm -lpthread

GraphicsMagick

Operation: Noise-Gaussian

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Noise-GaussianLinux 4.18Linux 4.17Linux 4.16Linux 5.1Linux 5.0Linux 4.19Linux 5.2Linux 5.4Linux 5.370140210280350SE +/- 1.20, N = 3SE +/- 0.58, N = 3SE +/- 4.06, N = 123333333333323303293263253241. (CC) gcc options: -fopenmp -O2 -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lz -lm -lpthread

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.4Time To CompileLinux 4.19Linux 4.18Linux 4.17Linux 4.16Linux 5.1Linux 5.0Linux 5.2Linux 5.3Linux 5.41122334455SE +/- 0.46, N = 9SE +/- 0.59, N = 3SE +/- 0.61, N = 3SE +/- 0.77, N = 3SE +/- 0.63, N = 4SE +/- 0.56, N = 3SE +/- 0.65, N = 3SE +/- 0.65, N = 3SE +/- 0.67, N = 347.2447.2447.3447.5147.5147.7448.3448.4748.54

Renaissance

Test: Apache Spark Bayes

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: Apache Spark BayesLinux 4.17Linux 4.18Linux 5.4Linux 5.1Linux 4.16Linux 5.3Linux 5.2Linux 4.19Linux 5.07001400210028003500SE +/- 19.52, N = 40SE +/- 28.49, N = 8SE +/- 27.43, N = 8SE +/- 29.12, N = 8SE +/- 18.00, N = 40SE +/- 16.10, N = 33SE +/- 18.55, N = 8SE +/- 23.40, N = 8SE +/- 24.45, N = 83075.913077.693090.753098.453105.873122.253126.793141.403159.76

Renaissance

Test: Apache Spark ALS

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: Apache Spark ALSLinux 5.3Linux 4.19Linux 5.1Linux 4.16Linux 4.18Linux 5.0Linux 4.17Linux 5.4Linux 5.212002400360048006000SE +/- 47.61, N = 8SE +/- 33.82, N = 8SE +/- 26.95, N = 8SE +/- 22.65, N = 40SE +/- 44.02, N = 8SE +/- 41.80, N = 8SE +/- 26.37, N = 8SE +/- 34.56, N = 8SE +/- 28.85, N = 405699.385712.735713.715729.405730.895750.705753.465789.655796.74

DaCapo Benchmark

Java Test: Jython

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonLinux 4.18Linux 4.17Linux 4.19Linux 5.1Linux 5.3Linux 5.0Linux 5.2Linux 4.16Linux 5.48001600240032004000SE +/- 12.32, N = 4SE +/- 10.69, N = 4SE +/- 19.71, N = 4SE +/- 14.81, N = 4SE +/- 13.69, N = 4SE +/- 2.84, N = 4SE +/- 21.56, N = 4SE +/- 8.46, N = 4SE +/- 13.62, N = 4373137373742374337483755376037653782

Selenium

Benchmark: Basemark - Browser: Google Chrome

OpenBenchmarking.orgOverall Score, More Is BetterSeleniumBenchmark: Basemark - Browser: Google ChromeLinux 4.17Linux 4.16Linux 4.19Linux 4.18Linux 5.4Linux 5.2Linux 5.0Linux 5.1Linux 5.32004006008001000SE +/- 10.68, N = 12SE +/- 15.77, N = 12SE +/- 16.38, N = 3SE +/- 22.60, N = 12SE +/- 5.39, N = 3SE +/- 13.47, N = 3SE +/- 9.66, N = 3SE +/- 17.35, N = 12SE +/- 16.22, N = 121044.921041.101022.05997.33909.07879.63872.02865.58858.021. chrome 78.0.3904.70

Facebook RocksDB

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Sequential FillLinux 4.17Linux 4.18Linux 4.16Linux 5.0Linux 4.19Linux 5.1Linux 5.4Linux 5.2Linux 5.3300K600K900K1200K1500KSE +/- 15062.28, N = 3SE +/- 4139.06, N = 3SE +/- 21908.10, N = 12SE +/- 17272.73, N = 3SE +/- 19361.75, N = 3SE +/- 38189.46, N = 12SE +/- 6996.19, N = 3SE +/- 20849.51, N = 15SE +/- 23445.47, N = 151327881131982113175751302405130162812107781155993110664711049981. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random FillLinux 4.16Linux 5.4Linux 5.3Linux 5.2Linux 4.19Linux 5.1Linux 5.0Linux 4.18Linux 4.17160K320K480K640K800KSE +/- 13748.74, N = 15SE +/- 11661.16, N = 15SE +/- 1864.98, N = 3SE +/- 12690.38, N = 15SE +/- 18787.16, N = 15SE +/- 6380.87, N = 15SE +/- 7251.88, N = 15SE +/- 5762.65, N = 4SE +/- 3699.53, N = 37408575056884773744553394548444504834463164253044252701. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 3.11.4Test: WritesLinux 4.19Linux 4.17Linux 5.0Linux 5.1Linux 4.18Linux 4.16Linux 5.4Linux 5.2Linux 5.330K60K90K120K150KSE +/- 515.04, N = 3SE +/- 859.46, N = 3SE +/- 1792.00, N = 5SE +/- 2916.35, N = 12SE +/- 2812.91, N = 12SE +/- 1921.68, N = 15SE +/- 1616.50, N = 15SE +/- 2296.87, N = 13SE +/- 1785.38, N = 3141873141234137278132275129550129385125567124674120607

Hackbench

Count: 8 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 8 - Type: ProcessLinux 4.17Linux 4.16Linux 4.19Linux 5.1Linux 4.18Linux 5.0Linux 5.2Linux 5.4Linux 5.3612182430SE +/- 0.56, N = 15SE +/- 0.78, N = 15SE +/- 0.69, N = 15SE +/- 0.90, N = 15SE +/- 0.79, N = 15SE +/- 0.85, N = 15SE +/- 0.93, N = 15SE +/- 0.32, N = 3SE +/- 0.16, N = 314.4015.2715.5116.7417.0818.4219.2927.2827.341. (CC) gcc options: -lpthread

Hackbench

Count: 16 - Type: Thread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ThreadLinux 4.19Linux 4.17Linux 4.16Linux 5.1Linux 4.18Linux 5.0Linux 5.2Linux 5.3Linux 5.41224364860SE +/- 1.32, N = 15SE +/- 0.97, N = 15SE +/- 0.41, N = 6SE +/- 1.70, N = 15SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 1.85, N = 15SE +/- 0.24, N = 3SE +/- 0.17, N = 336.0736.8237.0637.5839.6442.9044.0853.8954.591. (CC) gcc options: -lpthread

ebizzy

OpenBenchmarking.orgRecords/s, More Is Betterebizzy 0.3Linux 4.17Linux 4.18Linux 4.19Linux 4.16Linux 5.0Linux 5.4Linux 5.2Linux 5.1Linux 5.3110K220K330K440K550KSE +/- 9585.71, N = 15SE +/- 9689.32, N = 15SE +/- 6169.41, N = 15SE +/- 11213.41, N = 15SE +/- 7551.61, N = 15SE +/- 6238.08, N = 3SE +/- 6922.58, N = 15SE +/- 5767.14, N = 15SE +/- 3047.37, N = 34976644951584825304783174731384679484611754552984552931. (CC) gcc options: -pthread -lpthread -O3 -march=native

SQLite

Threads / Copies: 8

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 8Linux 4.17Linux 4.18Linux 5.1Linux 4.19Linux 5.0Linux 5.2Linux 5.3Linux 4.16Linux 5.4306090120150SE +/- 2.73, N = 15SE +/- 1.22, N = 13SE +/- 0.07, N = 3SE +/- 0.88, N = 3SE +/- 1.31, N = 15SE +/- 1.77, N = 12SE +/- 0.60, N = 12SE +/- 7.92, N = 15SE +/- 0.16, N = 351.6754.3455.3455.6955.9856.2761.98118.14150.901. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

SQLite

Threads / Copies: 1

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 1Linux 4.18Linux 5.0Linux 4.19Linux 5.2Linux 5.3Linux 5.1Linux 4.17Linux 4.16Linux 5.41122334455SE +/- 0.50, N = 15SE +/- 0.54, N = 15SE +/- 0.88, N = 15SE +/- 0.93, N = 15SE +/- 0.53, N = 15SE +/- 1.15, N = 15SE +/- 0.95, N = 15SE +/- 4.43, N = 15SE +/- 0.06, N = 312.3112.7112.7412.9113.0313.1713.7729.7448.321. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

Phoronix Test Suite v10.8.4