Linux 4.16 To Linux 5.4 Kernel Benchmarks

Benchmarks for a future article by Michael Larabel.

HTML result view exported from: https://openbenchmarking.org/result/1911099-HU-COREI979629.

Linux 4.16 To Linux 5.4 Kernel BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4Intel Core i9-7960X @ 4.40GHz (16 Cores / 32 Threads)MSI X299 SLI PLUS (MS-7A93) v1.0 (1.A0 BIOS)Intel Sky Lake-E DMI3 Registers16384MB256GB INTEL SSDPEKKW256G8Gigabyte AMD Radeon 540/540X/550/550X / RX 540X/550/550X 2GB (1206/1750MHz)Realtek ALC1220ASUS VP28UIntel I219-V + Intel I211Ubuntu 19.104.16.0-041600-generic (x86_64)GNOME Shell 3.34.1X Server 1.20.5modesetting 1.20.54.5 Mesa 19.2.1 (LLVM 9.0.0)GCC 9.2.1 20191008ext43840x21604.17.0-041700-generic (x86_64)4.18.0-041800-generic (x86_64)4.19.0-041900-generic (x86_64)5.0.0-050000-generic (x86_64)5.1.0-050100-generic (x86_64)5.2.0-050200-generic (x86_64)5.3.0-050300-generic (x86_64)5.4.0-999-generic (x86_64) 20191030OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- Linux 4.16: NONE / data=ordered,errors=remount-ro,relatime,rw- Linux 4.17: NONE / errors=remount-ro,relatime,rw- Linux 4.18: NONE / errors=remount-ro,relatime,rw- Linux 4.19: NONE / errors=remount-ro,relatime,rw- Linux 5.0: NONE / errors=remount-ro,relatime,rw- Linux 5.1: NONE / errors=remount-ro,relatime,rw- Linux 5.2: NONE / errors=remount-ro,relatime,rw- Linux 5.3: NONE / errors=remount-ro,relatime,rw- Linux 5.4: NONE / errors=remount-ro,relatime,rwProcessor Details- Scaling Governor: intel_pstate powersaveJava Details- OpenJDK Runtime Environment (build 11.0.5-ea+10-post-Ubuntu-0ubuntu1)Python Details- Python 2.7.17rc1 + Python 3.7.5rc1Security Details- Linux 4.16: meltdown: Mitigation of PTI + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB IBRS_FW- Linux 4.17: meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB IBRS_FW- Linux 4.18: meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB IBRS_FW- Linux 4.19: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB IBRS_FW- Linux 5.0: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - Linux 5.1: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - Linux 5.2: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - Linux 5.3: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - Linux 5.4: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling

Linux 4.16 To Linux 5.4 Kernel Benchmarkssqlite: 1sqlite: 8fio: Rand Read - Linux AIO - Yes - No - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - Yes - No - 2MB - Default Test Directoryt-test1: 1t-test1: 2sockperf: Throughputsockperf: Latency Ping Ponghmmer: Pfam Database Searchdacapobench: H2dacapobench: Jythonrenaissance: Apache Spark ALSrenaissance: Apache Spark Bayesrenaissance: Savina Reactors.IOrenaissance: In-Memory Database Shootoutrenaissance: Akka Unbalanced Cobwebbed Treegraphics-magick: Rotategraphics-magick: Resizinggraphics-magick: Noise-Gaussiangraphics-magick: HWB Color Spacevpxenc: vpxenc VP9 1080p Video Encodex265: H.265 1080p Video Encodingmt-dgemm: Sustained Floating-Point Ratehimeno: Poisson Pressure Solverebizzy: build-gcc: Time To Compilebuild-linux-kernel: Time To Compilecompress-xz: Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9hackbench: 8 - Threadhackbench: 16 - Threadhackbench: 8 - Processhackbench: 16 - Processhackbench: 32 - Processpgbench: Buffer Test - Normal Load - Read Onlysqlite-speedtest: Timed Time - Size 1,000octave-benchmark: memtier-benchmark: Redisredis: GETredis: SETstress-ng: Forkingstress-ng: Semaphoresstress-ng: Socket Activitystress-ng: Context Switchingstress-ng: System V Message Passingctx-clock: Context Switch Timecassandra: Writesrocksdb: Rand Fillrocksdb: Seq Fillrocksdb: Read While Writingmcperf: Addmcperf: Getmcperf: Setmcperf: Deletepybench: Total For Average Test Timesnginx: Static Web Page Servingapache: Static Web Page Servingphpbench: PHP Benchmark Suiteselenium: ARES-6 - Google Chromeselenium: Octane - Google Chromeselenium: WebXPRT - Google Chromeselenium: Basemark - Google Chromeselenium: Jetstream - Google Chromeselenium: CanvasMark - Google Chromeselenium: MotionMark - Google Chromeselenium: StyleBench - Google Chromeselenium: Speedometer - Google Chromeselenium: PSPDFKit WASM - Google Chromeosbench: Create Filesosbench: Create Threadsosbench: Launch Programsosbench: Create ProcessesLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.429.736118.143628102417.5056.6696197904.2224.291331737655729.3953105.87322922.5215527.97612262.3238121399333986218.9360.176.5237783690.214289478317715.94547.50919.69420.33937.05915.27224.15245.733445240.16390963.88617.7392453256.772484557.012052883.7995905.573150939.7710735.0213439936.4610081645.264381293857408571317575368681368058.7103598.469040.4105887.5103543938.7037290.2866944319.29463192341041.10214.8919749641.6935.3119157713.18731914.79943634.84884928.89712613.77151.667633102817.7426.5766305374.1264.181326937375753.4603075.90723071.5235429.30412310.6008061394333984216.1761.216.4169373888.143791497664717.93747.33619.11220.61736.81514.39625.31648.175437014.57857162.28017.6182887947.222522179.502067565.1393842.193084773.6110572.3814480654.678061310.834191412344252701327881365028670498.5108356.570757.7108716.698543212.5635832.1571507020.26446492241044.92206.1318904638.2936.00114181812.62844916.21723236.01551129.03103812.30654.339631102017.6936.5226151674.1634.212331737315730.8853077.69323504.2305454.39012593.9388061402333986213.3161.206.3437893895.247592495158721.41847.24319.35621.14239.64017.07526.33648.768440888.43312262.91417.5312393171.912513584.542009941.9791990.123125428.0310056.0914584272.588186176.604211295504253041319821366576669409.8111488.569533.8111068.598842198.4435752.1771387820.2444675225997.33205.5719091627.9036.16116183612.66897615.85245236.51698429.02984612.74155.687637103118.1156.4785804644.1824.178327837425712.7283141.39922531.6715548.08212389.1198311401329984216.2661.146.3138043897.521064482530718.647.24119.27720.55836.07015.51025.83848.269441523.62309362.58717.7332543202.982538300.752056274.2598335.083137571.7410255.8015178230.478163830.704171418734548441301628370516769370.3109637.469304.2107442.398342756.6936235.4471426320.08446362241022.05205.1519197648.8836.1115180612.65586213.39006435.21998712.70955.977661107318.1506.5344659494.0374.156332137555750.6953159.76426285.8535634.29312779.1018291397330980211.6261.006.3128073898.572426473138722.22647.73819.58523.34142.89518.41526.15748.812432615.93456962.24117.7862513890.292540773.02062208.9694606.263119497.2214936.0819157911.867863922.434021372784463161302405359488767150.4110801.466934.3110424.898542363.2534227.4871397127.5136469198872.02166.1916835568.1033.2097.71249112.72845813.42964235.68331429.68629213.17055.335706121120.5886.8964668744.1733.903325137435713.7143098.44826333.4065473.34812825.7388161398332977210.9964.916.3117473894.774723455298726.50747.51019.84322.95637.57616.74025.88947.654435672.02014062.37217.7162518787.562594097.172103801.2995760.193149098.9415265.1418826824.598090485.004021322754504831210778370067665161.8109753.765598.2109869.798342002.1633087.6471471327.5136463198865.58167.7416768564.5533.0797.68246912.60697713.98897235.23349730.16710312.90756.267740139021.6047.3904371984.1873.879327037605796.7443126.78926677.5425573.25012653.4157781375326926208.9064.956.3342003898.181463461175746.85948.34120.08225.22344.08119.29131.65960.702412471.93557766.18221.3982393265.862533896.252064719.2193246.833023293.8510846.4812918420.799319564.997191246744553391106647359276662696.1107673.862751.7108012.798438510.3431261.8371428927.5236452196879.63167.6916610565.0233.097.2244812.84631914.90950637.60099430.49771013.02661.979736170322.4257.3874378184.2223.899318137485699.3833122.24626975.5015728.89812906.4467641364324917207.6764.796.2812223884.746518455293747.50448.46520.09028.50953.88927.34052.22564.132408652.96083066.45721.3862474750.912470246.252045704.7592274.022923858.949668.1812922338.099254599.367191206074773741104998363100262122.7106005.162649.9105447.698737408.7330358.9171311527.4736345197858.02167.8816554561.7533.0297.2246213.38717215.59337038.14697331.51098948.324150.901736198922.0417.4174213534.3003.894323037825789.6503090.75427025.4865592.43712807.7597931375325931206.3964.996.3574563893.540634467948749.51948.53720.00030.58754.59427.27553.02163.021409157.33734766.61821.0332497759.172777878.22050891.2192385.023125231.039323.4312566616.397580952.227251255675056881155993351081861772.4105324.761714.6105363.498337462.1730624.3471552527.6135981197909.07167.2516478568.5133.2597.2248613.30107014.99255537.41105431.356017OpenBenchmarking.org

SQLite

Threads / Copies: 1

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 1Linux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.41122334455SE +/- 4.43, N = 15SE +/- 0.95, N = 15SE +/- 0.50, N = 15SE +/- 0.88, N = 15SE +/- 0.54, N = 15SE +/- 1.15, N = 15SE +/- 0.93, N = 15SE +/- 0.53, N = 15SE +/- 0.06, N = 329.7413.7712.3112.7412.7113.1712.9113.0348.321. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

SQLite

Threads / Copies: 8

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 8Linux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4306090120150SE +/- 7.92, N = 15SE +/- 2.73, N = 15SE +/- 1.22, N = 13SE +/- 0.88, N = 3SE +/- 1.31, N = 15SE +/- 0.07, N = 3SE +/- 1.77, N = 12SE +/- 0.60, N = 12SE +/- 0.16, N = 3118.1451.6754.3455.6955.9855.3456.2761.98150.901. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Random Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4160320480640800SE +/- 2.00, N = 3SE +/- 1.00, N = 3SE +/- 1.20, N = 3SE +/- 0.67, N = 3SE +/- 0.88, N = 3SE +/- 0.58, N = 36286336316376617067407367361. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.16Type: Sequential Read - IO Engine: Linux AIO - Buffered: Yes - Direct: No - Block Size: 2MB - Disk Target: Default Test DirectoryLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4400800120016002000SE +/- 0.88, N = 3SE +/- 0.58, N = 31024102810201031107312111390170319891. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -march=native -ll -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

t-test1

Threads: 1

OpenBenchmarking.orgSeconds, Fewer Is Bettert-test1 2017-01-13Threads: 1Linux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4510152025SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.26, N = 3SE +/- 0.10, N = 3SE +/- 0.35, N = 3SE +/- 0.25, N = 3SE +/- 0.17, N = 3SE +/- 0.31, N = 417.5117.7417.6918.1218.1520.5921.6022.4322.041. (CC) gcc options: -pthread

t-test1

Threads: 2

OpenBenchmarking.orgSeconds, Fewer Is Bettert-test1 2017-01-13Threads: 2Linux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4246810SE +/- 0.036, N = 3SE +/- 0.025, N = 3SE +/- 0.016, N = 3SE +/- 0.019, N = 3SE +/- 0.005, N = 3SE +/- 0.023, N = 3SE +/- 0.009, N = 3SE +/- 0.019, N = 3SE +/- 0.022, N = 36.6696.5766.5226.4786.5346.8967.3907.3877.4171. (CC) gcc options: -pthread

Sockperf

Test: Throughput

OpenBenchmarking.orgMessages Per Second, More Is BetterSockperf 3.4Test: ThroughputLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4140K280K420K560K700KSE +/- 4306.31, N = 5SE +/- 7822.09, N = 5SE +/- 6920.94, N = 5SE +/- 3113.98, N = 5SE +/- 1619.84, N = 5SE +/- 2431.43, N = 5SE +/- 2501.44, N = 5SE +/- 1654.08, N = 5SE +/- 2930.42, N = 56197906305376151675804644659494668744371984378184213531. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

Sockperf

Test: Latency Ping Pong

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.4Test: Latency Ping PongLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.40.96751.9352.90253.874.8375SE +/- 0.026, N = 25SE +/- 0.009, N = 5SE +/- 0.020, N = 5SE +/- 0.019, N = 5SE +/- 0.051, N = 5SE +/- 0.029, N = 5SE +/- 0.047, N = 5SE +/- 0.018, N = 5SE +/- 0.018, N = 54.2224.1264.1634.1824.0374.1734.1874.2224.3001. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 2.3.2Pfam Database SearchLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.40.96551.9312.89653.8624.8275SE +/- 0.017, N = 3SE +/- 0.037, N = 3SE +/- 0.033, N = 3SE +/- 0.040, N = 3SE +/- 0.037, N = 3SE +/- 0.016, N = 3SE +/- 0.021, N = 3SE +/- 0.031, N = 3SE +/- 0.039, N = 34.2914.1814.2124.1784.1563.9033.8793.8993.8941. (CC) gcc options: -O2 -pthread -lhmmer -lsquid -lm

DaCapo Benchmark

Java Test: H2

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: H2Linux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.47001400210028003500SE +/- 39.92, N = 4SE +/- 39.41, N = 4SE +/- 27.21, N = 4SE +/- 32.79, N = 4SE +/- 42.44, N = 5SE +/- 26.18, N = 4SE +/- 28.35, N = 4SE +/- 40.86, N = 4SE +/- 28.22, N = 4331732693317327833213251327031813230

DaCapo Benchmark

Java Test: Jython

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.48001600240032004000SE +/- 8.46, N = 4SE +/- 10.69, N = 4SE +/- 12.32, N = 4SE +/- 19.71, N = 4SE +/- 2.84, N = 4SE +/- 14.81, N = 4SE +/- 21.56, N = 4SE +/- 13.69, N = 4SE +/- 13.62, N = 4376537373731374237553743376037483782

Renaissance

Test: Apache Spark ALS

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: Apache Spark ALSLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.412002400360048006000SE +/- 22.65, N = 40SE +/- 26.37, N = 8SE +/- 44.02, N = 8SE +/- 33.82, N = 8SE +/- 41.80, N = 8SE +/- 26.95, N = 8SE +/- 28.85, N = 40SE +/- 47.61, N = 8SE +/- 34.56, N = 85729.405753.465730.895712.735750.705713.715796.745699.385789.65

Renaissance

Test: Apache Spark Bayes

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: Apache Spark BayesLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.47001400210028003500SE +/- 18.00, N = 40SE +/- 19.52, N = 40SE +/- 28.49, N = 8SE +/- 23.40, N = 8SE +/- 24.45, N = 8SE +/- 29.12, N = 8SE +/- 18.55, N = 8SE +/- 16.10, N = 33SE +/- 27.43, N = 83105.873075.913077.693141.403159.763098.453126.793122.253090.75

Renaissance

Test: Savina Reactors.IO

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: Savina Reactors.IOLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.46K12K18K24K30KSE +/- 122.08, N = 40SE +/- 133.03, N = 8SE +/- 155.78, N = 8SE +/- 232.77, N = 8SE +/- 81.92, N = 8SE +/- 103.30, N = 8SE +/- 174.44, N = 8SE +/- 265.69, N = 8SE +/- 195.41, N = 822922.5223071.5223504.2322531.6726285.8526333.4126677.5426975.5027025.49

Renaissance

Test: In-Memory Database Shootout

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: In-Memory Database ShootoutLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.412002400360048006000SE +/- 40.22, N = 16SE +/- 36.13, N = 8SE +/- 41.79, N = 8SE +/- 40.54, N = 8SE +/- 57.27, N = 40SE +/- 38.74, N = 8SE +/- 43.35, N = 8SE +/- 72.47, N = 40SE +/- 54.95, N = 85527.985429.305454.395548.085634.295473.355573.255728.905592.44

Renaissance

Test: Akka Unbalanced Cobwebbed Tree

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.9.0Test: Akka Unbalanced Cobwebbed TreeLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.43K6K9K12K15KSE +/- 108.56, N = 11SE +/- 78.45, N = 40SE +/- 130.10, N = 8SE +/- 117.17, N = 9SE +/- 121.41, N = 9SE +/- 93.37, N = 8SE +/- 121.53, N = 8SE +/- 128.48, N = 8SE +/- 90.36, N = 4012262.3212310.6012593.9412389.1212779.1012825.7412653.4212906.4512807.76

GraphicsMagick

Operation: Rotate

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: RotateLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.42004006008001000SE +/- 6.63, N = 15SE +/- 11.56, N = 4SE +/- 3.84, N = 3SE +/- 12.02, N = 4SE +/- 1.76, N = 3SE +/- 7.61, N = 15SE +/- 8.93, N = 15SE +/- 7.17, N = 3SE +/- 9.53, N = 68128068068318298167787647931. (CC) gcc options: -fopenmp -O2 -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lz -lm -lpthread

GraphicsMagick

Operation: Resizing

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: ResizingLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.430060090012001500SE +/- 3.61, N = 3SE +/- 2.19, N = 3SE +/- 2.19, N = 3SE +/- 0.58, N = 3SE +/- 2.40, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 2.40, N = 31399139414021401139713981375136413751. (CC) gcc options: -fopenmp -O2 -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lz -lm -lpthread

GraphicsMagick

Operation: Noise-Gaussian

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Noise-GaussianLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.470140210280350SE +/- 0.58, N = 3SE +/- 1.20, N = 3SE +/- 4.06, N = 123333333333293303323263243251. (CC) gcc options: -fopenmp -O2 -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lz -lm -lpthread

GraphicsMagick

Operation: HWB Color Space

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: HWB Color SpaceLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.42004006008001000SE +/- 1.00, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 3.21, N = 3SE +/- 1.45, N = 3SE +/- 1.67, N = 39869849869849809779269179311. (CC) gcc options: -fopenmp -O2 -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lz -lm -lpthread

VP9 libvpx Encoding

vpxenc VP9 1080p Video Encode

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.8.1vpxenc VP9 1080p Video EncodeLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.450100150200250SE +/- 0.29, N = 3SE +/- 0.17, N = 3SE +/- 0.44, N = 3SE +/- 0.40, N = 3SE +/- 0.33, N = 3SE +/- 0.61, N = 3SE +/- 0.49, N = 3SE +/- 1.04, N = 3SE +/- 0.76, N = 3218.93216.17213.31216.26211.62210.99208.90207.67206.391. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=c++11

x265

H.265 1080p Video Encoding

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.1.2H.265 1080p Video EncodingLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.41530456075SE +/- 0.13, N = 3SE +/- 0.32, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.50, N = 3SE +/- 0.25, N = 3SE +/- 0.19, N = 3SE +/- 0.27, N = 360.1761.2161.2061.1461.0064.9164.9564.7964.991. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

ACES DGEMM

Sustained Floating-Point Rate

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4246810SE +/- 0.060473, N = 3SE +/- 0.025125, N = 3SE +/- 0.085077, N = 3SE +/- 0.106076, N = 3SE +/- 0.077740, N = 3SE +/- 0.081110, N = 5SE +/- 0.033802, N = 3SE +/- 0.084025, N = 4SE +/- 0.094451, N = 36.5237786.4169376.3437896.3138046.3128076.3117476.3342006.2812226.3574561. (CC) gcc options: -O3 -march=native -fopenmp

Himeno Benchmark

Poisson Pressure Solver

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.48001600240032004000SE +/- 22.35, N = 3SE +/- 1.79, N = 3SE +/- 5.42, N = 3SE +/- 0.18, N = 3SE +/- 1.76, N = 3SE +/- 5.85, N = 3SE +/- 1.30, N = 3SE +/- 4.12, N = 3SE +/- 1.99, N = 33690.213888.143895.253897.523898.573894.773898.183884.753893.541. (CC) gcc options: -O3 -mavx2

ebizzy

OpenBenchmarking.orgRecords/s, More Is Betterebizzy 0.3Linux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4110K220K330K440K550KSE +/- 11213.41, N = 15SE +/- 9585.71, N = 15SE +/- 9689.32, N = 15SE +/- 6169.41, N = 15SE +/- 7551.61, N = 15SE +/- 5767.14, N = 15SE +/- 6922.58, N = 15SE +/- 3047.37, N = 3SE +/- 6238.08, N = 34783174976644951584825304731384552984611754552934679481. (CC) gcc options: -pthread -lpthread -O3 -march=native

Timed GCC Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 8.2Time To CompileLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4160320480640800715.95717.94721.42718.60722.23726.51746.86747.50749.52

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.4Time To CompileLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.41122334455SE +/- 0.77, N = 3SE +/- 0.61, N = 3SE +/- 0.59, N = 3SE +/- 0.46, N = 9SE +/- 0.56, N = 3SE +/- 0.63, N = 4SE +/- 0.65, N = 3SE +/- 0.65, N = 3SE +/- 0.67, N = 347.5147.3447.2447.2447.7447.5148.3448.4748.54

XZ Compression

Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9

OpenBenchmarking.orgSeconds, Fewer Is BetterXZ Compression 5.2.4Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9Linux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4510152025SE +/- 0.29, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 3SE +/- 0.11, N = 3SE +/- 0.27, N = 3SE +/- 0.01, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 319.6919.1119.3619.2819.5919.8420.0820.0920.001. (CC) gcc options: -pthread -fvisibility=hidden -O2

Hackbench

Count: 8 - Type: Thread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 8 - Type: ThreadLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4714212835SE +/- 0.21, N = 8SE +/- 0.14, N = 3SE +/- 0.31, N = 3SE +/- 0.27, N = 4SE +/- 0.34, N = 3SE +/- 0.24, N = 8SE +/- 0.18, N = 3SE +/- 0.34, N = 3SE +/- 0.06, N = 320.3420.6221.1420.5623.3422.9625.2228.5130.591. (CC) gcc options: -lpthread

Hackbench

Count: 16 - Type: Thread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ThreadLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.41224364860SE +/- 0.41, N = 6SE +/- 0.97, N = 15SE +/- 0.16, N = 3SE +/- 1.32, N = 15SE +/- 0.02, N = 3SE +/- 1.70, N = 15SE +/- 1.85, N = 15SE +/- 0.24, N = 3SE +/- 0.17, N = 337.0636.8239.6436.0742.9037.5844.0853.8954.591. (CC) gcc options: -lpthread

Hackbench

Count: 8 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 8 - Type: ProcessLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4612182430SE +/- 0.78, N = 15SE +/- 0.56, N = 15SE +/- 0.79, N = 15SE +/- 0.69, N = 15SE +/- 0.85, N = 15SE +/- 0.90, N = 15SE +/- 0.93, N = 15SE +/- 0.16, N = 3SE +/- 0.32, N = 315.2714.4017.0815.5118.4216.7419.2927.3427.281. (CC) gcc options: -lpthread

Hackbench

Count: 16 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ProcessLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.41224364860SE +/- 0.25, N = 15SE +/- 0.25, N = 15SE +/- 0.36, N = 3SE +/- 0.37, N = 15SE +/- 0.15, N = 3SE +/- 0.31, N = 15SE +/- 0.38, N = 15SE +/- 0.06, N = 3SE +/- 0.43, N = 324.1525.3226.3425.8426.1625.8931.6652.2353.021. (CC) gcc options: -lpthread

Hackbench

Count: 32 - Type: Process

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 32 - Type: ProcessLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.41428425670SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.81, N = 3SE +/- 0.68, N = 3SE +/- 0.65, N = 5SE +/- 0.29, N = 3SE +/- 1.02, N = 3SE +/- 1.04, N = 3SE +/- 0.06, N = 345.7348.1848.7748.2748.8147.6560.7064.1363.021. (CC) gcc options: -lpthread

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 12.0Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4100K200K300K400K500KSE +/- 630.18, N = 3SE +/- 426.98, N = 3SE +/- 920.32, N = 3SE +/- 224.24, N = 3SE +/- 455.54, N = 3SE +/- 604.77, N = 3SE +/- 676.48, N = 3SE +/- 286.05, N = 3SE +/- 479.22, N = 3445240.16437014.58440888.43441523.62432615.93435672.02412471.94408652.96409157.341. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

SQLite Speedtest

Timed Time - Size 1,000

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000Linux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.41530456075SE +/- 0.51, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.01, N = 363.8962.2862.9162.5962.2462.3766.1866.4666.621. (CC) gcc options: -O2 -ldl -lz -lpthread

GNU Octave Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterGNU Octave Benchmark 4.4.1Linux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4510152025SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 317.7417.6217.5317.7317.7917.7221.4021.3921.03

Memtier_benchmark

Protocol: Redis

OpenBenchmarking.orgOps/sec, More Is BetterMemtier_benchmark 1.2.17Protocol: RedisLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4600K1200K1800K2400K3000KSE +/- 22142.37, N = 15SE +/- 3366.95, N = 3SE +/- 30319.17, N = 5SE +/- 47157.31, N = 15SE +/- 28985.54, N = 15SE +/- 32758.70, N = 15SE +/- 4810.60, N = 3SE +/- 34572.98, N = 15SE +/- 42499.20, N = 122453256.772887947.222393171.912543202.982513890.292518787.562393265.862474750.912497759.171. (CXX) g++ options: -O2 -levent -lpthread -lz -lpcre

Redis

Test: GET

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 5.0.5Test: GETLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4600K1200K1800K2400K3000KSE +/- 43487.07, N = 15SE +/- 38652.53, N = 3SE +/- 36408.41, N = 14SE +/- 17107.79, N = 3SE +/- 26570.06, N = 3SE +/- 39304.21, N = 3SE +/- 11965.98, N = 3SE +/- 36804.16, N = 3SE +/- 11829.24, N = 32484557.012522179.502513584.542538300.752540773.002594097.172533896.252470246.252777878.201. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Redis

Test: SET

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 5.0.5Test: SETLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4500K1000K1500K2000K2500KSE +/- 30387.93, N = 3SE +/- 5128.18, N = 3SE +/- 16461.30, N = 15SE +/- 8564.39, N = 3SE +/- 18999.92, N = 3SE +/- 3899.38, N = 3SE +/- 5133.08, N = 3SE +/- 26865.01, N = 3SE +/- 17771.47, N = 32052883.792067565.132009941.972056274.252062208.962103801.292064719.212045704.752050891.211. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: ForkingLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.420K40K60K80K100KSE +/- 137.26, N = 3SE +/- 523.92, N = 3SE +/- 385.38, N = 3SE +/- 248.34, N = 3SE +/- 241.95, N = 3SE +/- 560.02, N = 3SE +/- 429.24, N = 3SE +/- 312.17, N = 3SE +/- 199.66, N = 395905.5793842.1991990.1298335.0894606.2695760.1993246.8392274.0292385.021. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: SemaphoresLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4700K1400K2100K2800K3500KSE +/- 39815.37, N = 3SE +/- 10225.28, N = 3SE +/- 12612.37, N = 3SE +/- 40405.86, N = 3SE +/- 26407.83, N = 3SE +/- 48219.45, N = 3SE +/- 46357.86, N = 3SE +/- 41587.07, N = 3SE +/- 21017.87, N = 33150939.773084773.613125428.033137571.743119497.223149098.943023293.852923858.943125231.031. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Socket ActivityLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.43K6K9K12K15KSE +/- 154.88, N = 3SE +/- 153.13, N = 3SE +/- 139.73, N = 3SE +/- 133.90, N = 3SE +/- 445.87, N = 15SE +/- 359.21, N = 12SE +/- 63.21, N = 3SE +/- 63.97, N = 3SE +/- 99.30, N = 310735.0210572.3810056.0910255.8014936.0815265.1410846.489668.189323.431. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Context SwitchingLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.44M8M12M16M20MSE +/- 130204.00, N = 3SE +/- 80071.56, N = 3SE +/- 98671.20, N = 3SE +/- 36379.23, N = 3SE +/- 28459.23, N = 3SE +/- 28932.97, N = 3SE +/- 5232.40, N = 3SE +/- 10222.49, N = 3SE +/- 43063.08, N = 313439936.4614480654.6714584272.5815178230.4719157911.8618826824.5912918420.7912922338.0912566616.391. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: System V Message PassingLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.42M4M6M8M10MSE +/- 1708.04, N = 3SE +/- 3528.20, N = 3SE +/- 3568.88, N = 3SE +/- 3522.10, N = 3SE +/- 2540.32, N = 3SE +/- 5560.84, N = 3SE +/- 5503.13, N = 3SE +/- 7511.21, N = 3SE +/- 1433.35, N = 310081645.268061310.838186176.608163830.707863922.438090485.009319564.999254599.367580952.221. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

ctx_clock

Context Switch Time

OpenBenchmarking.orgClocks, Fewer Is Betterctx_clockContext Switch TimeLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4160320480640800SE +/- 0.67, N = 3SE +/- 1.33, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 4.67, N = 3438419421417402402719719725

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 3.11.4Test: WritesLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.430K60K90K120K150KSE +/- 1921.68, N = 15SE +/- 859.46, N = 3SE +/- 2812.91, N = 12SE +/- 515.04, N = 3SE +/- 1792.00, N = 5SE +/- 2916.35, N = 12SE +/- 2296.87, N = 13SE +/- 1785.38, N = 3SE +/- 1616.50, N = 15129385141234129550141873137278132275124674120607125567

Facebook RocksDB

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Random FillLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4160K320K480K640K800KSE +/- 13748.74, N = 15SE +/- 3699.53, N = 3SE +/- 5762.65, N = 4SE +/- 18787.16, N = 15SE +/- 7251.88, N = 15SE +/- 6380.87, N = 15SE +/- 12690.38, N = 15SE +/- 1864.98, N = 3SE +/- 11661.16, N = 157408574252704253044548444463164504834553394773745056881. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Sequential FillLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4300K600K900K1200K1500KSE +/- 21908.10, N = 12SE +/- 15062.28, N = 3SE +/- 4139.06, N = 3SE +/- 19361.75, N = 3SE +/- 17272.73, N = 3SE +/- 38189.46, N = 12SE +/- 20849.51, N = 15SE +/- 23445.47, N = 15SE +/- 6996.19, N = 31317575132788113198211301628130240512107781106647110499811559931. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Facebook RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 6.3.6Test: Read While WritingLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4800K1600K2400K3200K4000KSE +/- 58285.58, N = 13SE +/- 49420.31, N = 4SE +/- 37401.35, N = 15SE +/- 31366.97, N = 12SE +/- 61152.51, N = 3SE +/- 60862.57, N = 3SE +/- 40967.45, N = 15SE +/- 39351.32, N = 3SE +/- 22846.74, N = 33686813365028636657663705167359488737006763592766363100235108181. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread

Memcached mcperf

Method: Add

OpenBenchmarking.orgOperations Per Second, More Is BetterMemcached mcperf 1.5.10Method: AddLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.415K30K45K60K75KSE +/- 249.40, N = 3SE +/- 219.45, N = 3SE +/- 65.64, N = 3SE +/- 201.27, N = 3SE +/- 139.67, N = 3SE +/- 47.94, N = 3SE +/- 334.33, N = 3SE +/- 270.87, N = 3SE +/- 118.42, N = 368058.770498.569409.869370.367150.465161.862696.162122.761772.41. (CC) gcc options: -O2 -lm -rdynamic

Memcached mcperf

Method: Get

OpenBenchmarking.orgOperations Per Second, More Is BetterMemcached mcperf 1.5.10Method: GetLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.420K40K60K80K100KSE +/- 1174.11, N = 3SE +/- 401.56, N = 3SE +/- 449.43, N = 3SE +/- 262.53, N = 3SE +/- 537.50, N = 3SE +/- 253.22, N = 3SE +/- 825.25, N = 3SE +/- 927.89, N = 3SE +/- 517.85, N = 3103598.4108356.5111488.5109637.4110801.4109753.7107673.8106005.1105324.71. (CC) gcc options: -O2 -lm -rdynamic

Memcached mcperf

Method: Set

OpenBenchmarking.orgOperations Per Second, More Is BetterMemcached mcperf 1.5.10Method: SetLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.415K30K45K60K75KSE +/- 279.29, N = 3SE +/- 123.08, N = 3SE +/- 10.87, N = 3SE +/- 54.19, N = 3SE +/- 84.98, N = 3SE +/- 109.08, N = 3SE +/- 134.27, N = 3SE +/- 219.57, N = 3SE +/- 84.95, N = 369040.470757.769533.869304.266934.365598.262751.762649.961714.61. (CC) gcc options: -O2 -lm -rdynamic

Memcached mcperf

Method: Delete

OpenBenchmarking.orgOperations Per Second, More Is BetterMemcached mcperf 1.5.10Method: DeleteLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.420K40K60K80K100KSE +/- 1128.91, N = 3SE +/- 216.44, N = 3SE +/- 826.71, N = 3SE +/- 668.17, N = 3SE +/- 715.34, N = 3SE +/- 278.53, N = 3SE +/- 274.62, N = 3SE +/- 919.24, N = 3SE +/- 279.52, N = 3105887.5108716.6111068.5107442.3110424.8109869.7108012.7105447.6105363.41. (CC) gcc options: -O2 -lm -rdynamic

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.42004006008001000SE +/- 2.19, N = 3SE +/- 3.38, N = 3SE +/- 2.03, N = 3SE +/- 1.20, N = 31035985988983985983984987983

NGINX Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.9.9Static Web Page ServingLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.49K18K27K36K45KSE +/- 126.12, N = 3SE +/- 133.58, N = 3SE +/- 115.49, N = 3SE +/- 305.20, N = 3SE +/- 135.60, N = 3SE +/- 108.77, N = 3SE +/- 201.92, N = 3SE +/- 116.65, N = 3SE +/- 211.54, N = 343938.7043212.5642198.4442756.6942363.2542002.1638510.3437408.7337462.171. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.48K16K24K32K40KSE +/- 69.73, N = 3SE +/- 25.25, N = 3SE +/- 47.84, N = 3SE +/- 57.33, N = 3SE +/- 121.97, N = 3SE +/- 61.05, N = 3SE +/- 55.71, N = 3SE +/- 31.51, N = 3SE +/- 17.17, N = 337290.2835832.1535752.1736235.4434227.4833087.6431261.8330358.9130624.341. (CC) gcc options: -shared -fPIC -O2 -pthread

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark SuiteLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4150K300K450K600K750KSE +/- 7739.08, N = 3SE +/- 950.60, N = 3SE +/- 536.81, N = 3SE +/- 1377.42, N = 3SE +/- 1473.20, N = 3SE +/- 734.57, N = 3SE +/- 638.75, N = 3SE +/- 364.74, N = 3SE +/- 362.09, N = 3669443715070713878714263713971714713714289713115715525

Selenium

Benchmark: ARES-6 - Browser: Google Chrome

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: Google ChromeLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4612182430SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 319.2920.2620.2420.0827.5127.5127.5227.4727.611. chrome 78.0.3904.70

Selenium

Benchmark: Octane - Browser: Google Chrome

OpenBenchmarking.orgGeometric Mean, More Is BetterSeleniumBenchmark: Octane - Browser: Google ChromeLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.410K20K30K40K50KSE +/- 83.60, N = 3SE +/- 51.26, N = 3SE +/- 201.91, N = 3SE +/- 35.00, N = 3SE +/- 103.38, N = 3SE +/- 34.53, N = 3SE +/- 27.51, N = 3SE +/- 23.67, N = 3SE +/- 178.01, N = 34631944649446754463636469364633645236345359811. chrome 78.0.3904.70

Selenium

Benchmark: WebXPRT - Browser: Google Chrome

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: WebXPRT - Browser: Google ChromeLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.450100150200250SE +/- 0.67, N = 3SE +/- 0.33, N = 32342242252241981981961971971. chrome 78.0.3904.70

Selenium

Benchmark: Basemark - Browser: Google Chrome

OpenBenchmarking.orgOverall Score, More Is BetterSeleniumBenchmark: Basemark - Browser: Google ChromeLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.42004006008001000SE +/- 15.77, N = 12SE +/- 10.68, N = 12SE +/- 22.60, N = 12SE +/- 16.38, N = 3SE +/- 9.66, N = 3SE +/- 17.35, N = 12SE +/- 13.47, N = 3SE +/- 16.22, N = 12SE +/- 5.39, N = 31041.101044.92997.331022.05872.02865.58879.63858.02909.071. chrome 78.0.3904.70

Selenium

Benchmark: Jetstream - Browser: Google Chrome

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream - Browser: Google ChromeLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.450100150200250SE +/- 0.33, N = 3SE +/- 0.48, N = 3SE +/- 0.49, N = 3SE +/- 1.25, N = 3SE +/- 0.95, N = 3SE +/- 0.61, N = 3SE +/- 0.32, N = 3SE +/- 0.33, N = 3SE +/- 0.86, N = 3214.89206.13205.57205.15166.19167.74167.69167.88167.251. chrome 78.0.3904.70

Selenium

Benchmark: CanvasMark - Browser: Google Chrome

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: CanvasMark - Browser: Google ChromeLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.44K8K12K16K20KSE +/- 114.65, N = 3SE +/- 98.08, N = 3SE +/- 63.49, N = 3SE +/- 78.55, N = 3SE +/- 149.61, N = 3SE +/- 142.61, N = 3SE +/- 76.73, N = 3SE +/- 145.12, N = 3SE +/- 204.14, N = 121974918904190911919716835167681661016554164781. chrome 78.0.3904.70

Selenium

Benchmark: MotionMark - Browser: Google Chrome

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: MotionMark - Browser: Google ChromeLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4140280420560700SE +/- 3.61, N = 3SE +/- 8.73, N = 4SE +/- 1.55, N = 3SE +/- 11.13, N = 3SE +/- 1.11, N = 3SE +/- 1.57, N = 3SE +/- 7.62, N = 4SE +/- 1.71, N = 3SE +/- 1.57, N = 3641.69638.29627.90648.88568.10564.55565.02561.75568.511. chrome 78.0.3904.70

Selenium

Benchmark: StyleBench - Browser: Google Chrome

OpenBenchmarking.orgRuns / Minute, More Is BetterSeleniumBenchmark: StyleBench - Browser: Google ChromeLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4816243240SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 335.3036.0036.1636.1033.2033.0733.0033.0233.251. chrome 78.0.3904.70

Selenium

Benchmark: Speedometer - Browser: Google Chrome

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: Google ChromeLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4306090120150SE +/- 0.33, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 1.76, N = 3SE +/- 0.26, N = 3SE +/- 0.36, N = 3SE +/- 0.21, N = 3SE +/- 0.36, N = 3SE +/- 0.23, N = 3119.00114.00116.00115.0097.7197.6897.2097.2097.201. chrome 78.0.3904.70

Selenium

Benchmark: PSPDFKit WASM - Browser: Google Chrome

OpenBenchmarking.orgScore, Fewer Is BetterSeleniumBenchmark: PSPDFKit WASM - Browser: Google ChromeLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.45001000150020002500SE +/- 5.21, N = 3SE +/- 6.08, N = 3SE +/- 21.17, N = 3SE +/- 13.25, N = 3SE +/- 11.59, N = 3SE +/- 6.39, N = 3SE +/- 20.19, N = 3SE +/- 16.64, N = 3SE +/- 3.18, N = 31577181818361806249124692448246224861. chrome 78.0.3904.70

OSBench

Test: Create Files

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.43691215SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 313.1912.6312.6712.6612.7312.6112.8513.3913.301. (CC) gcc options: -lm

OSBench

Test: Create Threads

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create ThreadsLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.448121620SE +/- 0.04, N = 3SE +/- 0.28, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 5SE +/- 0.17, N = 5SE +/- 0.13, N = 10SE +/- 0.22, N = 4SE +/- 0.10, N = 3SE +/- 0.03, N = 314.8016.2215.8513.3913.4313.9914.9115.5914.991. (CC) gcc options: -lm

OSBench

Test: Launch Programs

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Launch ProgramsLinux 4.16Linux 4.17Linux 4.18Linux 4.19Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4918273645SE +/- 0.31, N = 3SE +/- 0.25, N = 3SE +/- 0.12, N = 3SE +/- 0.42, N = 3SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.27, N = 3SE +/- 0.12, N = 3SE +/- 0.24, N = 334.8536.0236.5235.2235.6835.2337.6038.1537.411. (CC) gcc options: -lm

OSBench

Test: Create Processes

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create ProcessesLinux 4.16Linux 4.17Linux 4.18Linux 5.0Linux 5.1Linux 5.2Linux 5.3Linux 5.4714212835SE +/- 0.27, N = 3SE +/- 0.14, N = 2SE +/- 0.17, N = 3SE +/- 0.15, N = 3SE +/- 0.18, N = 3SE +/- 0.21, N = 3SE +/- 0.27, N = 328.9029.0329.0329.6930.1730.5031.5131.361. (CC) gcc options: -lm

Phoronix Test Suite v10.8.5