Linux 4.16 To Linux 5.4 Kernel Benchmarks

Benchmarks for a future article by Michael Larabel.

HTML result view exported from: https://openbenchmarking.org/result/1911099-HU-COREI979629&gru&rdt.

Linux 4.16 To Linux 5.4 Kernel BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16Intel Core i9-7960X @ 4.40GHz (16 Cores / 32 Threads)MSI X299 SLI PLUS (MS-7A93) v1.0 (1.A0 BIOS)Intel Sky Lake-E DMI3 Registers16384MB256GB INTEL SSDPEKKW256G8Gigabyte AMD Radeon 540/540X/550/550X / RX 540X/550/550X 2GB (1206/1750MHz)Realtek ALC1220ASUS VP28UIntel I219-V + Intel I211Ubuntu 19.105.4.0-999-generic (x86_64) 20191030GNOME Shell 3.34.1X Server 1.20.5modesetting 1.20.54.5 Mesa 19.2.1 (LLVM 9.0.0)GCC 9.2.1 20191008ext43840x21605.3.0-050300-generic (x86_64)5.2.0-050200-generic (x86_64)5.1.0-050100-generic (x86_64)5.0.0-050000-generic (x86_64)4.19.0-041900-generic (x86_64)4.18.0-041800-generic (x86_64)4.17.0-041700-generic (x86_64)4.16.0-041600-generic (x86_64)OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- Linux 5.4: NONE / errors=remount-ro,relatime,rw- Linux 5.3: NONE / errors=remount-ro,relatime,rw- Linux 5.2: NONE / errors=remount-ro,relatime,rw- Linux 5.1: NONE / errors=remount-ro,relatime,rw- Linux 5.0: NONE / errors=remount-ro,relatime,rw- Linux 4.19: NONE / errors=remount-ro,relatime,rw- Linux 4.18: NONE / errors=remount-ro,relatime,rw- Linux 4.17: NONE / errors=remount-ro,relatime,rw- Linux 4.16: NONE / data=ordered,errors=remount-ro,relatime,rwProcessor Details- Scaling Governor: intel_pstate powersaveJava Details- OpenJDK Runtime Environment (build 11.0.5-ea+10-post-Ubuntu-0ubuntu1)Python Details- Python 2.7.17rc1 + Python 3.7.5rc1Security Details- Linux 5.4: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - Linux 5.3: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - Linux 5.2: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - Linux 5.1: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - Linux 5.0: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - Linux 4.19: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB IBRS_FW- Linux 4.18: meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB IBRS_FW- Linux 4.17: meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB IBRS_FW- Linux 4.16: meltdown: Mitigation of PTI + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB IBRS_FW

Linux 4.16 To Linux 5.4 Kernel Benchmarksstress-ng: Forkingstress-ng: Semaphoresstress-ng: Socket Activitystress-ng: Context Switchingstress-ng: System V Message Passingvpxenc: vpxenc VP9 1080p Video Encodex265: H.265 1080p Video Encodingselenium: Octane - Google Chromemt-dgemm: Sustained Floating-Point Rategraphics-magick: Rotategraphics-magick: Resizinggraphics-magick: Noise-Gaussiangraphics-magick: HWB Color Spacefio: Rand Read - Linux AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 2MB - Default Test Directorysockperf: Throughputhimeno: Poisson Pressure Solvercassandra: Writesrocksdb: Rand Fillrocksdb: Seq Fillrocksdb: Read While Writingmcperf: Addmcperf: Getmcperf: Setmcperf: Deletememtier-benchmark: Redisselenium: Basemark - Google Chromeebizzy: redis: GETredis: SETnginx: Static Web Page Servingapache: Static Web Page Servingselenium: StyleBench - Google Chromeselenium: Speedometer - Google Chromephpbench: PHP Benchmark Suiteselenium: WebXPRT - Google Chromeselenium: Jetstream - Google Chromeselenium: CanvasMark - Google Chromeselenium: MotionMark - Google Chromepgbench: Buffer Test - Normal Load - Read Onlyctx-clock: Context Switch Timepybench: Total For Average Test Timesrenaissance: Apache Spark ALSrenaissance: Apache Spark Bayesrenaissance: Savina Reactors.IOrenaissance: In-Memory Database Shootoutrenaissance: Akka Unbalanced Cobwebbed Treeselenium: ARES-6 - Google Chromedacapobench: H2dacapobench: Jythonselenium: PSPDFKit WASM - Google Chromesqlite: 1sqlite: 8t-test1: 1t-test1: 2hmmer: Pfam Database Searchbuild-gcc: Time To Compilebuild-linux-kernel: Time To Compilecompress-xz: Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9hackbench: 8 - Threadhackbench: 16 - Threadhackbench: 8 - Processhackbench: 16 - Processhackbench: 32 - Processsqlite-speedtest: Timed Time - Size 1,000octave-benchmark: osbench: Create Filesosbench: Create Threadsosbench: Launch Programsosbench: Create Processessockperf: Latency Ping PongLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1692385.023125231.039323.4312566616.397580952.22206.3964.99359816.357456793137532593173619894213533893.5406341255675056881155993351081861772.4105324.761714.6105363.42497759.17909.074679482777878.22050891.2137462.1730624.3433.2597.2715525197167.2516478568.51409157.3373477259835789.6503090.75427025.4865592.43712807.75927.6132303782248648.324150.90122.0417.4173.894749.51948.53720.00030.58754.59427.27553.02163.02166.61821.03313.30107014.99255537.41105431.3560174.30092274.022923858.949668.1812922338.099254599.36207.6764.79363456.281222764136432491773617034378183884.7465181206074773741104998363100262122.7106005.162649.9105447.62474750.91858.024552932470246.252045704.7537408.7330358.9133.0297.2713115197167.8816554561.75408652.9608307199875699.3833122.24626975.5015728.89812906.44627.4731813748246213.02661.97922.4257.3873.899747.50448.46520.09028.50953.88927.34052.22564.13266.45721.38613.38717215.59337038.14697331.5109894.22293246.833023293.8510846.4812918420.799319564.99208.9064.95364526.334200778137532692674013904371983898.1814631246744553391106647359276662696.1107673.862751.7108012.72393265.86879.634611752533896.252064719.2138510.3431261.8333.097.2714289196167.6916610565.02412471.9355777199845796.7443126.78926677.5425573.25012653.41527.5232703760244812.90756.26721.6047.3903.879746.85948.34120.08225.22344.08119.29131.65960.70266.18221.39812.84631914.90950637.60099430.4977104.18795760.193149098.9415265.1418826824.598090485.00210.9964.91364636.311747816139833297770612114668743894.7747231322754504831210778370067665161.8109753.765598.2109869.72518787.56865.584552982594097.172103801.2942002.1633087.6433.0797.68714713198167.7416768564.55435672.0201404029835713.7143098.44826333.4065473.34812825.73827.5132513743246913.17055.33520.5886.8963.903726.50747.51019.84322.95637.57616.74025.88947.65462.37217.71612.60697713.98897235.23349730.1671034.17394606.263119497.2214936.0819157911.867863922.43211.6261.00364696.312807829139733098066110734659493898.5724261372784463161302405359488767150.4110801.466934.3110424.82513890.29872.024731382540773.02062208.9642363.2534227.4833.2097.71713971198166.1916835568.10432615.9345694029855750.6953159.76426285.8535634.29312779.10127.5133213755249112.70955.97718.1506.5344.156722.22647.73819.58523.34142.89518.41526.15748.81262.24117.78612.72845813.42964235.68331429.6862924.03798335.083137571.7410255.8015178230.478163830.70216.2661.14446366.313804831140132998463710315804643897.5210641418734548441301628370516769370.3109637.469304.2107442.32543202.981022.054825302538300.752056274.2542756.6936235.4436.1115714263224205.1519197648.88441523.6230934179835712.7283141.39922531.6715548.08212389.11920.0832783742180612.74155.68718.1156.4784.178718.647.24119.27720.55836.07015.51025.83848.26962.58717.73312.65586213.39006435.2199874.18291990.123125428.0310056.0914584272.588186176.60213.3161.20446756.343789806140233398663110206151673895.2475921295504253041319821366576669409.8111488.569533.8111068.52393171.91997.334951582513584.542009941.9742198.4435752.1736.16116713878225205.5719091627.90440888.4331224219885730.8853077.69323504.2305454.39012593.93820.2433173731183612.30654.33917.6936.5224.212721.41847.24319.35621.14239.64017.07526.33648.76862.91417.53112.66897615.85245236.51698429.0298464.16393842.193084773.6110572.3814480654.678061310.83216.1761.21446496.416937806139433398463310286305373888.1437911412344252701327881365028670498.5108356.570757.7108716.62887947.221044.924976642522179.502067565.1343212.5635832.1536.00114715070224206.1318904638.29437014.5785714199855753.4603075.90723071.5235429.30412310.60020.2632693737181813.77151.66717.7426.5764.181717.93747.33619.11220.61736.81514.39625.31648.17562.28017.61812.62844916.21723236.01551129.0310384.12695905.573150939.7710735.0213439936.4610081645.26218.9360.17463196.523778812139933398662810246197903690.2142891293857408571317575368681368058.7103598.469040.4105887.52453256.771041.104783172484557.012052883.7943938.7037290.2835.3119669443234214.8919749641.69445240.16390943810355729.3953105.87322922.5215527.97612262.32319.2933173765157729.736118.14317.5056.6694.291715.94547.50919.69420.33937.05915.27224.15245.73363.88617.73913.18731914.79943634.84884928.8971264.222OpenBenchmarking.org

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: ForkingLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1620K40K60K80K100KSE +/- 199.66, N = 3SE +/- 312.17, N = 3SE +/- 429.24, N = 3SE +/- 560.02, N = 3SE +/- 241.95, N = 3SE +/- 248.34, N = 3SE +/- 385.38, N = 3SE +/- 523.92, N = 3SE +/- 137.26, N = 392385.0292274.0293246.8395760.1994606.2698335.0891990.1293842.1995905.571. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: SemaphoresLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16700K1400K2100K2800K3500KSE +/- 21017.87, N = 3SE +/- 41587.07, N = 3SE +/- 46357.86, N = 3SE +/- 48219.45, N = 3SE +/- 26407.83, N = 3SE +/- 40405.86, N = 3SE +/- 12612.37, N = 3SE +/- 10225.28, N = 3SE +/- 39815.37, N = 33125231.032923858.943023293.853149098.943119497.223137571.743125428.033084773.613150939.771. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Socket ActivityLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.163K6K9K12K15KSE +/- 99.30, N = 3SE +/- 63.97, N = 3SE +/- 63.21, N = 3SE +/- 359.21, N = 12SE +/- 445.87, N = 15SE +/- 133.90, N = 3SE +/- 139.73, N = 3SE +/- 153.13, N = 3SE +/- 154.88, N = 39323.439668.1810846.4815265.1414936.0810255.8010056.0910572.3810735.021. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Context SwitchingLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.164M8M12M16M20MSE +/- 43063.08, N = 3SE +/- 10222.49, N = 3SE +/- 5232.40, N = 3SE +/- 28932.97, N = 3SE +/- 28459.23, N = 3SE +/- 36379.23, N = 3SE +/- 98671.20, N = 3SE +/- 80071.56, N = 3SE +/- 130204.00, N = 312566616.3912922338.0912918420.7918826824.5919157911.8615178230.4714584272.5814480654.6713439936.461. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: System V Message PassingLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.162M4M6M8M10MSE +/- 1433.35, N = 3SE +/- 7511.21, N = 3SE +/- 5503.13, N = 3SE +/- 5560.84, N = 3SE +/- 2540.32, N = 3SE +/- 3522.10, N = 3SE +/- 3568.88, N = 3SE +/- 3528.20, N = 3SE +/- 1708.04, N = 37580952.229254599.369319564.998090485.007863922.438163830.708186176.608061310.8310081645.261. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

VP9 libvpx Encoding

vpxenc VP9 1080p Video Encode

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.8.1vpxenc VP9 1080p Video EncodeLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1650100150200250SE +/- 0.76, N = 3SE +/- 1.04, N = 3SE +/- 0.49, N = 3SE +/- 0.61, N = 3SE +/- 0.33, N = 3SE +/- 0.40, N = 3SE +/- 0.44, N = 3SE +/- 0.17, N = 3SE +/- 0.29, N = 3206.39207.67208.90210.99211.62216.26213.31216.17218.931. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=c++11

x265

H.265 1080p Video Encoding

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.1.2H.265 1080p Video EncodingLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.161530456075SE +/- 0.27, N = 3SE +/- 0.19, N = 3SE +/- 0.25, N = 3SE +/- 0.50, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.32, N = 3SE +/- 0.13, N = 364.9964.7964.9564.9161.0061.1461.2061.2160.171. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Selenium

Benchmark: Octane - Browser: Google Chrome

OpenBenchmarking.orgGeometric Mean, More Is BetterSeleniumBenchmark: Octane - Browser: Google ChromeLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1610K20K30K40K50KSE +/- 178.01, N = 3SE +/- 23.67, N = 3SE +/- 27.51, N = 3SE +/- 34.53, N = 3SE +/- 103.38, N = 3SE +/- 35.00, N = 3SE +/- 201.91, N = 3SE +/- 51.26, N = 3SE +/- 83.60, N = 33598136345364523646336469446364467544649463191. chrome 78.0.3904.70

ACES DGEMM

Sustained Floating-Point Rate

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16246810SE +/- 0.094451, N = 3SE +/- 0.084025, N = 4SE +/- 0.033802, N = 3SE +/- 0.081110, N = 5SE +/- 0.077740, N = 3SE +/- 0.106076, N = 3SE +/- 0.085077, N = 3SE +/- 0.025125, N = 3SE +/- 0.060473, N = 36.3574566.2812226.3342006.3117476.3128076.3138046.3437896.4169376.5237781. (CC) gcc options: -O3 -march=native -fopenmp

GraphicsMagick

Operation: Rotate

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: RotateLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.162004006008001000SE +/- 9.53, N = 6SE +/- 7.17, N = 3SE +/- 8.93, N = 15SE +/- 7.61, N = 15SE +/- 1.76, N = 3SE +/- 12.02, N = 4SE +/- 3.84, N = 3SE +/- 11.56, N = 4SE +/- 6.63, N = 157937647788168298318068068121. (CC) gcc options: -fopenmp -O2 -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lz -lm -lpthread

GraphicsMagick

Operation: Resizing

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: ResizingLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1630060090012001500SE +/- 2.40, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 2.40, N = 3SE +/- 0.58, N = 3SE +/- 2.19, N = 3SE +/- 2.19, N = 3SE +/- 3.61, N = 31375136413751398139714011402139413991. (CC) gcc options: -fopenmp -O2 -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lz -lm -lpthread

GraphicsMagick

Operation: Noise-Gaussian

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Noise-GaussianLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1670140210280350SE +/- 4.06, N = 12SE +/- 1.20, N = 3SE +/- 0.58, N = 33253243263323303293333333331. (CC) gcc options: -fopenmp -O2 -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lz -lm -lpthread

GraphicsMagick

Operation: HWB Color Space

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: HWB Color SpaceLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.162004006008001000SE +/- 1.67, N = 3SE +/- 1.45, N = 3SE +/- 3.21, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 1.00, N = 39319179269779809849869849861. (CC) gcc options: -fopenmp -O2 -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lz -lm -lpthread

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16160320480640800SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 0.67, N = 3SE +/- 1.20, N = 3SE +/- 1.00, N = 3SE +/- 2.00, N = 37367367407066616376316336281. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16400800120016002000SE +/- 0.58, N = 3SE +/- 0.88, N = 31989170313901211107310311020102810241. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Sockperf

Test: Throughput

OpenBenchmarking.orgMessages Per Second, More Is BetterSockperf 3.4Test: ThroughputLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16140K280K420K560K700KSE +/- 2930.42, N = 5SE +/- 1654.08, N = 5SE +/- 2501.44, N = 5SE +/- 2431.43, N = 5SE +/- 1619.84, N = 5SE +/- 3113.98, N = 5SE +/- 6920.94, N = 5SE +/- 7822.09, N = 5SE +/- 4306.31, N = 54213534378184371984668744659495804646151676305376197901. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

Himeno Benchmark

Poisson Pressure Solver

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.168001600240032004000SE +/- 1.99, N = 3SE +/- 4.12, N = 3SE +/- 1.30, N = 3SE +/- 5.85, N = 3SE +/- 1.76, N = 3SE +/- 0.18, N = 3SE +/- 5.42, N = 3SE +/- 1.79, N = 3SE +/- 22.35, N = 33893.543884.753898.183894.773898.573897.523895.253888.143690.211. (CC) gcc options: -O3 -mavx2

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 3.11.4Test: WritesLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1630K60K90K120K150KSE +/- 1616.50, N = 15SE +/- 1785.38, N = 3SE +/- 2296.87, N = 13SE +/- 2916.35, N = 12SE +/- 1792.00, N = 5SE +/- 515.04, N = 3SE +/- 2812.91, N = 12SE +/- 859.46, N = 3SE +/- 1921.68, N = 15125567120607124674132275137278141873129550141234129385

Facebook RocksDB

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random FillLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16160K320K480K640K800KSE +/- 11661.16, N = 15SE +/- 1864.98, N = 3SE +/- 12690.38, N = 15SE +/- 6380.87, N = 15SE +/- 7251.88, N = 15SE +/- 18787.16, N = 15SE +/- 5762.65, N = 4SE +/- 3699.53, N = 3SE +/- 13748.74, N = 155056884773744553394504834463164548444253044252707408571. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Sequential FillLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16300K600K900K1200K1500KSE +/- 6996.19, N = 3SE +/- 23445.47, N = 15SE +/- 20849.51, N = 15SE +/- 38189.46, N = 12SE +/- 17272.73, N = 3SE +/- 19361.75, N = 3SE +/- 4139.06, N = 3SE +/- 15062.28, N = 3SE +/- 21908.10, N = 121155993110499811066471210778130240513016281319821132788113175751. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Read While WritingLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16800K1600K2400K3200K4000KSE +/- 22846.74, N = 3SE +/- 39351.32, N = 3SE +/- 40967.45, N = 15SE +/- 60862.57, N = 3SE +/- 61152.51, N = 3SE +/- 31366.97, N = 12SE +/- 37401.35, N = 15SE +/- 49420.31, N = 4SE +/- 58285.58, N = 133510818363100235927663700676359488737051673665766365028636868131. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Memcached mcperf

Method: Add

OpenBenchmarking.orgOperations Per Second, More Is BetterMemcached mcperf 1.5.10Method: AddLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1615K30K45K60K75KSE +/- 118.42, N = 3SE +/- 270.87, N = 3SE +/- 334.33, N = 3SE +/- 47.94, N = 3SE +/- 139.67, N = 3SE +/- 201.27, N = 3SE +/- 65.64, N = 3SE +/- 219.45, N = 3SE +/- 249.40, N = 361772.462122.762696.165161.867150.469370.369409.870498.568058.71. (CC) gcc options: -O2 -lm -rdynamic

Memcached mcperf

Method: Get

OpenBenchmarking.orgOperations Per Second, More Is BetterMemcached mcperf 1.5.10Method: GetLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1620K40K60K80K100KSE +/- 517.85, N = 3SE +/- 927.89, N = 3SE +/- 825.25, N = 3SE +/- 253.22, N = 3SE +/- 537.50, N = 3SE +/- 262.53, N = 3SE +/- 449.43, N = 3SE +/- 401.56, N = 3SE +/- 1174.11, N = 3105324.7106005.1107673.8109753.7110801.4109637.4111488.5108356.5103598.41. (CC) gcc options: -O2 -lm -rdynamic

Memcached mcperf

Method: Set

OpenBenchmarking.orgOperations Per Second, More Is BetterMemcached mcperf 1.5.10Method: SetLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1615K30K45K60K75KSE +/- 84.95, N = 3SE +/- 219.57, N = 3SE +/- 134.27, N = 3SE +/- 109.08, N = 3SE +/- 84.98, N = 3SE +/- 54.19, N = 3SE +/- 10.87, N = 3SE +/- 123.08, N = 3SE +/- 279.29, N = 361714.662649.962751.765598.266934.369304.269533.870757.769040.41. (CC) gcc options: -O2 -lm -rdynamic

Memcached mcperf

Method: Delete

OpenBenchmarking.orgOperations Per Second, More Is BetterMemcached mcperf 1.5.10Method: DeleteLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1620K40K60K80K100KSE +/- 279.52, N = 3SE +/- 919.24, N = 3SE +/- 274.62, N = 3SE +/- 278.53, N = 3SE +/- 715.34, N = 3SE +/- 668.17, N = 3SE +/- 826.71, N = 3SE +/- 216.44, N = 3SE +/- 1128.91, N = 3105363.4105447.6108012.7109869.7110424.8107442.3111068.5108716.6105887.51. (CC) gcc options: -O2 -lm -rdynamic

Memtier_benchmark

Protocol: Redis

OpenBenchmarking.orgOps/sec, More Is BetterMemtier_benchmark 1.2.17Protocol: RedisLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16600K1200K1800K2400K3000KSE +/- 42499.20, N = 12SE +/- 34572.98, N = 15SE +/- 4810.60, N = 3SE +/- 32758.70, N = 15SE +/- 28985.54, N = 15SE +/- 47157.31, N = 15SE +/- 30319.17, N = 5SE +/- 3366.95, N = 3SE +/- 22142.37, N = 152497759.172474750.912393265.862518787.562513890.292543202.982393171.912887947.222453256.771. (CXX) g++ options: -O2 -levent -lpthread -lz -lpcre

Selenium

Benchmark: Basemark - Browser: Google Chrome

OpenBenchmarking.orgOverall Score, More Is BetterSeleniumBenchmark: Basemark - Browser: Google ChromeLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.162004006008001000SE +/- 5.39, N = 3SE +/- 16.22, N = 12SE +/- 13.47, N = 3SE +/- 17.35, N = 12SE +/- 9.66, N = 3SE +/- 16.38, N = 3SE +/- 22.60, N = 12SE +/- 10.68, N = 12SE +/- 15.77, N = 12909.07858.02879.63865.58872.021022.05997.331044.921041.101. chrome 78.0.3904.70

ebizzy

OpenBenchmarking.orgRecords/s, More Is Betterebizzy 0.3Linux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16110K220K330K440K550KSE +/- 6238.08, N = 3SE +/- 3047.37, N = 3SE +/- 6922.58, N = 15SE +/- 5767.14, N = 15SE +/- 7551.61, N = 15SE +/- 6169.41, N = 15SE +/- 9689.32, N = 15SE +/- 9585.71, N = 15SE +/- 11213.41, N = 154679484552934611754552984731384825304951584976644783171. (CC) gcc options: -pthread -lpthread -O3 -march=native

Redis

Test: GET

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 5.0.5Test: GETLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16600K1200K1800K2400K3000KSE +/- 11829.24, N = 3SE +/- 36804.16, N = 3SE +/- 11965.98, N = 3SE +/- 39304.21, N = 3SE +/- 26570.06, N = 3SE +/- 17107.79, N = 3SE +/- 36408.41, N = 14SE +/- 38652.53, N = 3SE +/- 43487.07, N = 152777878.202470246.252533896.252594097.172540773.002538300.752513584.542522179.502484557.011. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Redis

Test: SET

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 5.0.5Test: SETLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16500K1000K1500K2000K2500KSE +/- 17771.47, N = 3SE +/- 26865.01, N = 3SE +/- 5133.08, N = 3SE +/- 3899.38, N = 3SE +/- 18999.92, N = 3SE +/- 8564.39, N = 3SE +/- 16461.30, N = 15SE +/- 5128.18, N = 3SE +/- 30387.93, N = 32050891.212045704.752064719.212103801.292062208.962056274.252009941.972067565.132052883.791. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

NGINX Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.9.9Static Web Page ServingLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.169K18K27K36K45KSE +/- 211.54, N = 3SE +/- 116.65, N = 3SE +/- 201.92, N = 3SE +/- 108.77, N = 3SE +/- 135.60, N = 3SE +/- 305.20, N = 3SE +/- 115.49, N = 3SE +/- 133.58, N = 3SE +/- 126.12, N = 337462.1737408.7338510.3442002.1642363.2542756.6942198.4443212.5643938.701. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.168K16K24K32K40KSE +/- 17.17, N = 3SE +/- 31.51, N = 3SE +/- 55.71, N = 3SE +/- 61.05, N = 3SE +/- 121.97, N = 3SE +/- 57.33, N = 3SE +/- 47.84, N = 3SE +/- 25.25, N = 3SE +/- 69.73, N = 330624.3430358.9131261.8333087.6434227.4836235.4435752.1735832.1537290.281. (CC) gcc options: -shared -fPIC -O2 -pthread

Selenium

Benchmark: StyleBench - Browser: Google Chrome

OpenBenchmarking.orgRuns / Minute, More Is BetterSeleniumBenchmark: StyleBench - Browser: Google ChromeLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16816243240SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 333.2533.0233.0033.0733.2036.1036.1636.0035.301. chrome 78.0.3904.70

Selenium

Benchmark: Speedometer - Browser: Google Chrome

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: Google ChromeLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16306090120150SE +/- 0.23, N = 3SE +/- 0.36, N = 3SE +/- 0.21, N = 3SE +/- 0.36, N = 3SE +/- 0.26, N = 3SE +/- 1.76, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 397.2097.2097.2097.6897.71115.00116.00114.00119.001. chrome 78.0.3904.70

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark SuiteLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16150K300K450K600K750KSE +/- 362.09, N = 3SE +/- 364.74, N = 3SE +/- 638.75, N = 3SE +/- 734.57, N = 3SE +/- 1473.20, N = 3SE +/- 1377.42, N = 3SE +/- 536.81, N = 3SE +/- 950.60, N = 3SE +/- 7739.08, N = 3715525713115714289714713713971714263713878715070669443

Selenium

Benchmark: WebXPRT - Browser: Google Chrome

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: WebXPRT - Browser: Google ChromeLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1650100150200250SE +/- 0.33, N = 3SE +/- 0.67, N = 31971971961981982242252242341. chrome 78.0.3904.70

Selenium

Benchmark: Jetstream - Browser: Google Chrome

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream - Browser: Google ChromeLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1650100150200250SE +/- 0.86, N = 3SE +/- 0.33, N = 3SE +/- 0.32, N = 3SE +/- 0.61, N = 3SE +/- 0.95, N = 3SE +/- 1.25, N = 3SE +/- 0.49, N = 3SE +/- 0.48, N = 3SE +/- 0.33, N = 3167.25167.88167.69167.74166.19205.15205.57206.13214.891. chrome 78.0.3904.70

Selenium

Benchmark: CanvasMark - Browser: Google Chrome

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: CanvasMark - Browser: Google ChromeLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.164K8K12K16K20KSE +/- 204.14, N = 12SE +/- 145.12, N = 3SE +/- 76.73, N = 3SE +/- 142.61, N = 3SE +/- 149.61, N = 3SE +/- 78.55, N = 3SE +/- 63.49, N = 3SE +/- 98.08, N = 3SE +/- 114.65, N = 31647816554166101676816835191971909118904197491. chrome 78.0.3904.70

Selenium

Benchmark: MotionMark - Browser: Google Chrome

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: MotionMark - Browser: Google ChromeLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16140280420560700SE +/- 1.57, N = 3SE +/- 1.71, N = 3SE +/- 7.62, N = 4SE +/- 1.57, N = 3SE +/- 1.11, N = 3SE +/- 11.13, N = 3SE +/- 1.55, N = 3SE +/- 8.73, N = 4SE +/- 3.61, N = 3568.51561.75565.02564.55568.10648.88627.90638.29641.691. chrome 78.0.3904.70

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 12.0Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16100K200K300K400K500KSE +/- 479.22, N = 3SE +/- 286.05, N = 3SE +/- 676.48, N = 3SE +/- 604.77, N = 3SE +/- 455.54, N = 3SE +/- 224.24, N = 3SE +/- 920.32, N = 3SE +/- 426.98, N = 3SE +/- 630.18, N = 3409157.34408652.96412471.94435672.02432615.93441523.62440888.43437014.58445240.161. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

ctx_clock

Context Switch Time

OpenBenchmarking.orgClocks, Fewer Is Betterctx_clockContext Switch TimeLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16160320480640800SE +/- 4.67, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 1.33, N = 3SE +/- 0.67, N = 3725719719402402417421419438

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.162004006008001000SE +/- 1.20, N = 3SE +/- 2.03, N = 3SE +/- 3.38, N = 3SE +/- 2.19, N = 39839879849839859839889851035

Renaissance

Test: Apache Spark ALS

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: Apache Spark ALSLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1612002400360048006000SE +/- 34.56, N = 8SE +/- 47.61, N = 8SE +/- 28.85, N = 40SE +/- 26.95, N = 8SE +/- 41.80, N = 8SE +/- 33.82, N = 8SE +/- 44.02, N = 8SE +/- 26.37, N = 8SE +/- 22.65, N = 405789.655699.385796.745713.715750.705712.735730.895753.465729.40

Renaissance

Test: Apache Spark Bayes

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: Apache Spark BayesLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.167001400210028003500SE +/- 27.43, N = 8SE +/- 16.10, N = 33SE +/- 18.55, N = 8SE +/- 29.12, N = 8SE +/- 24.45, N = 8SE +/- 23.40, N = 8SE +/- 28.49, N = 8SE +/- 19.52, N = 40SE +/- 18.00, N = 403090.753122.253126.793098.453159.763141.403077.693075.913105.87

Renaissance

Test: Savina Reactors.IO

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: Savina Reactors.IOLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.166K12K18K24K30KSE +/- 195.41, N = 8SE +/- 265.69, N = 8SE +/- 174.44, N = 8SE +/- 103.30, N = 8SE +/- 81.92, N = 8SE +/- 232.77, N = 8SE +/- 155.78, N = 8SE +/- 133.03, N = 8SE +/- 122.08, N = 4027025.4926975.5026677.5426333.4126285.8522531.6723504.2323071.5222922.52

Renaissance

Test: In-Memory Database Shootout

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: In-Memory Database ShootoutLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1612002400360048006000SE +/- 54.95, N = 8SE +/- 72.47, N = 40SE +/- 43.35, N = 8SE +/- 38.74, N = 8SE +/- 57.27, N = 40SE +/- 40.54, N = 8SE +/- 41.79, N = 8SE +/- 36.13, N = 8SE +/- 40.22, N = 165592.445728.905573.255473.355634.295548.085454.395429.305527.98

Renaissance

Test: Akka Unbalanced Cobwebbed Tree

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: Akka Unbalanced Cobwebbed TreeLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.163K6K9K12K15KSE +/- 90.36, N = 40SE +/- 128.48, N = 8SE +/- 121.53, N = 8SE +/- 93.37, N = 8SE +/- 121.41, N = 9SE +/- 117.17, N = 9SE +/- 130.10, N = 8SE +/- 78.45, N = 40SE +/- 108.56, N = 1112807.7612906.4512653.4212825.7412779.1012389.1212593.9412310.6012262.32

Selenium

Benchmark: ARES-6 - Browser: Google Chrome

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: Google ChromeLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16612182430SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 327.6127.4727.5227.5127.5120.0820.2420.2619.291. chrome 78.0.3904.70

DaCapo Benchmark

Java Test: H2

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: H2Linux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.167001400210028003500SE +/- 28.22, N = 4SE +/- 40.86, N = 4SE +/- 28.35, N = 4SE +/- 26.18, N = 4SE +/- 42.44, N = 5SE +/- 32.79, N = 4SE +/- 27.21, N = 4SE +/- 39.41, N = 4SE +/- 39.92, N = 4323031813270325133213278331732693317

DaCapo Benchmark

Java Test: Jython

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.168001600240032004000SE +/- 13.62, N = 4SE +/- 13.69, N = 4SE +/- 21.56, N = 4SE +/- 14.81, N = 4SE +/- 2.84, N = 4SE +/- 19.71, N = 4SE +/- 12.32, N = 4SE +/- 10.69, N = 4SE +/- 8.46, N = 4378237483760374337553742373137373765

Selenium

Benchmark: PSPDFKit WASM - Browser: Google Chrome

OpenBenchmarking.orgScore, Fewer Is BetterSeleniumBenchmark: PSPDFKit WASM - Browser: Google ChromeLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.165001000150020002500SE +/- 3.18, N = 3SE +/- 16.64, N = 3SE +/- 20.19, N = 3SE +/- 6.39, N = 3SE +/- 11.59, N = 3SE +/- 13.25, N = 3SE +/- 21.17, N = 3SE +/- 6.08, N = 3SE +/- 5.21, N = 32486246224482469249118061836181815771. chrome 78.0.3904.70

SQLite

Threads / Copies: 1

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 1Linux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.161122334455SE +/- 0.06, N = 3SE +/- 0.53, N = 15SE +/- 0.93, N = 15SE +/- 1.15, N = 15SE +/- 0.54, N = 15SE +/- 0.88, N = 15SE +/- 0.50, N = 15SE +/- 0.95, N = 15SE +/- 4.43, N = 1548.3213.0312.9113.1712.7112.7412.3113.7729.741. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

SQLite

Threads / Copies: 8

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 8Linux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16306090120150SE +/- 0.16, N = 3SE +/- 0.60, N = 12SE +/- 1.77, N = 12SE +/- 0.07, N = 3SE +/- 1.31, N = 15SE +/- 0.88, N = 3SE +/- 1.22, N = 13SE +/- 2.73, N = 15SE +/- 7.92, N = 15150.9061.9856.2755.3455.9855.6954.3451.67118.141. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

t-test1

Threads: 1

OpenBenchmarking.orgSeconds, Fewer Is Bettert-test1 2017-01-13Threads: 1Linux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16510152025SE +/- 0.31, N = 4SE +/- 0.17, N = 3SE +/- 0.25, N = 3SE +/- 0.35, N = 3SE +/- 0.10, N = 3SE +/- 0.26, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 322.0422.4321.6020.5918.1518.1217.6917.7417.511. (CC) gcc options: -pthread

t-test1

Threads: 2

OpenBenchmarking.orgSeconds, Fewer Is Bettert-test1 2017-01-13Threads: 2Linux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16246810SE +/- 0.022, N = 3SE +/- 0.019, N = 3SE +/- 0.009, N = 3SE +/- 0.023, N = 3SE +/- 0.005, N = 3SE +/- 0.019, N = 3SE +/- 0.016, N = 3SE +/- 0.025, N = 3SE +/- 0.036, N = 37.4177.3877.3906.8966.5346.4786.5226.5766.6691. (CC) gcc options: -pthread

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 2.3.2Pfam Database SearchLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.160.96551.9312.89653.8624.8275SE +/- 0.039, N = 3SE +/- 0.031, N = 3SE +/- 0.021, N = 3SE +/- 0.016, N = 3SE +/- 0.037, N = 3SE +/- 0.040, N = 3SE +/- 0.033, N = 3SE +/- 0.037, N = 3SE +/- 0.017, N = 33.8943.8993.8793.9034.1564.1784.2124.1814.2911. (CC) gcc options: -O2 -pthread -lhmmer -lsquid -lm

Timed GCC Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 8.2Time To CompileLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16160320480640800749.52747.50746.86726.51722.23718.60721.42717.94715.95

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.4Time To CompileLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.161122334455SE +/- 0.67, N = 3SE +/- 0.65, N = 3SE +/- 0.65, N = 3SE +/- 0.63, N = 4SE +/- 0.56, N = 3SE +/- 0.46, N = 9SE +/- 0.59, N = 3SE +/- 0.61, N = 3SE +/- 0.77, N = 348.5448.4748.3447.5147.7447.2447.2447.3447.51

XZ Compression

Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9

OpenBenchmarking.orgSeconds, Fewer Is BetterXZ Compression 5.2.4Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9Linux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16510152025SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.01, N = 3SE +/- 0.27, N = 3SE +/- 0.11, N = 3SE +/- 0.27, N = 3SE +/- 0.06, N = 3SE +/- 0.29, N = 320.0020.0920.0819.8419.5919.2819.3619.1119.691. (CC) gcc options: -pthread -fvisibility=hidden -O2

Hackbench

Count: 8 - Type: Thread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 8 - Type: ThreadLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16714212835SE +/- 0.06, N = 3SE +/- 0.34, N = 3SE +/- 0.18, N = 3SE +/- 0.24, N = 8SE +/- 0.34, N = 3SE +/- 0.27, N = 4SE +/- 0.31, N = 3SE +/- 0.14, N = 3SE +/- 0.21, N = 830.5928.5125.2222.9623.3420.5621.1420.6220.341. (CC) gcc options: -lpthread

Hackbench

Count: 16 - Type: Thread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ThreadLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.161224364860SE +/- 0.17, N = 3SE +/- 0.24, N = 3SE +/- 1.85, N = 15SE +/- 1.70, N = 15SE +/- 0.02, N = 3SE +/- 1.32, N = 15SE +/- 0.16, N = 3SE +/- 0.97, N = 15SE +/- 0.41, N = 654.5953.8944.0837.5842.9036.0739.6436.8237.061. (CC) gcc options: -lpthread

Hackbench

Count: 8 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 8 - Type: ProcessLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16612182430SE +/- 0.32, N = 3SE +/- 0.16, N = 3SE +/- 0.93, N = 15SE +/- 0.90, N = 15SE +/- 0.85, N = 15SE +/- 0.69, N = 15SE +/- 0.79, N = 15SE +/- 0.56, N = 15SE +/- 0.78, N = 1527.2827.3419.2916.7418.4215.5117.0814.4015.271. (CC) gcc options: -lpthread

Hackbench

Count: 16 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ProcessLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.161224364860SE +/- 0.43, N = 3SE +/- 0.06, N = 3SE +/- 0.38, N = 15SE +/- 0.31, N = 15SE +/- 0.15, N = 3SE +/- 0.37, N = 15SE +/- 0.36, N = 3SE +/- 0.25, N = 15SE +/- 0.25, N = 1553.0252.2331.6625.8926.1625.8426.3425.3224.151. (CC) gcc options: -lpthread

Hackbench

Count: 32 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 32 - Type: ProcessLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.161428425670SE +/- 0.06, N = 3SE +/- 1.04, N = 3SE +/- 1.02, N = 3SE +/- 0.29, N = 3SE +/- 0.65, N = 5SE +/- 0.68, N = 3SE +/- 0.81, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 363.0264.1360.7047.6548.8148.2748.7748.1845.731. (CC) gcc options: -lpthread

SQLite Speedtest

Timed Time - Size 1,000

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000Linux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.161530456075SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.51, N = 366.6266.4666.1862.3762.2462.5962.9162.2863.891. (CC) gcc options: -O2 -ldl -lz -lpthread

GNU Octave Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterGNU Octave Benchmark 4.4.1Linux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16510152025SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 321.0321.3921.4017.7217.7917.7317.5317.6217.74

OSBench

Test: Create Files

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.163691215SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 313.3013.3912.8512.6112.7312.6612.6712.6313.191. (CC) gcc options: -lm

OSBench

Test: Create Threads

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create ThreadsLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.1648121620SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.22, N = 4SE +/- 0.13, N = 10SE +/- 0.17, N = 5SE +/- 0.17, N = 5SE +/- 0.10, N = 3SE +/- 0.28, N = 3SE +/- 0.04, N = 314.9915.5914.9113.9913.4313.3915.8516.2214.801. (CC) gcc options: -lm

OSBench

Test: Launch Programs

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Launch ProgramsLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.16918273645SE +/- 0.24, N = 3SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.42, N = 3SE +/- 0.12, N = 3SE +/- 0.25, N = 3SE +/- 0.31, N = 337.4138.1537.6035.2335.6835.2236.5236.0234.851. (CC) gcc options: -lm

OSBench

Test: Create Processes

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create ProcessesLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.18Linux 4.17Linux 4.16714212835SE +/- 0.27, N = 3SE +/- 0.21, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 2SE +/- 0.27, N = 331.3631.5130.5030.1729.6929.0329.0328.901. (CC) gcc options: -lm

Sockperf

Test: Latency Ping Pong

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.4Test: Latency Ping PongLinux 5.4Linux 5.3Linux 5.2Linux 5.1Linux 5.0Linux 4.19Linux 4.18Linux 4.17Linux 4.160.96751.9352.90253.874.8375SE +/- 0.018, N = 5SE +/- 0.018, N = 5SE +/- 0.047, N = 5SE +/- 0.029, N = 5SE +/- 0.051, N = 5SE +/- 0.019, N = 5SE +/- 0.020, N = 5SE +/- 0.009, N = 5SE +/- 0.026, N = 254.3004.2224.1874.1734.0374.1824.1634.1264.2221. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread


Phoronix Test Suite v10.8.4