Ubuntu 18.04 L1TF Foreshadow VM Testing

Tests done from an Ubuntu 18.04 LTS x86_64 dual Xeon Gold 6138 Tyan server (the one frequently used in other Phoronix benchmarks). Host and VM using the Ubuntu packages including its patched 4.15 based kernel. Mitigation levels/tunables done after reboot each time from the bare metal system. VM was lone resource intensive process on the server and configured to access 80% of the host system's CPU resources, Tests by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1808177-RA-XEONGOLD746
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Timed Code Compilation 2 Tests
C/C++ Compiler Tests 6 Tests
CPU Massive 17 Tests
Creator Workloads 2 Tests
Database Test Suite 4 Tests
Disk Test Suite 4 Tests
Common Kernel Benchmarks 5 Tests
Multi-Core 8 Tests
Programmer / Developer System Benchmarks 4 Tests
Python Tests 2 Tests
Server 9 Tests
Server CPU Tests 11 Tests
Single-Threaded 3 Tests
Common Workstation Benchmarks 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Unmitigated
August 17 2018
  2 Hours, 20 Minutes
Default Mitigation
August 17 2018
  2 Hours, 43 Minutes
Always Flushing
August 17 2018
  2 Hours, 44 Minutes
Full Mitigation
August 17 2018
  3 Hours
Invert Hiding All Results Option
  2 Hours, 42 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Ubuntu 18.04 L1TF Foreshadow VM TestingOpenBenchmarking.orgPhoronix Test Suite64 x Intel Xeon (Skylake IBRS) @ 2.00GHz (64 Cores)QEMU Standard PC (i440FX + PIIX 1996) (1.10.2-1ubuntu1 BIOS)Intel 440FX- 82441FX PMC47104MB162GBllvmpipe 46848MBQEMU GenericRed Hat Virtio deviceUbuntu 18.044.15.0-29-generic (x86_64)4.15.0-32-generic (x86_64)GNOME Shell 3.28.2X Server 1.19.6modesetting 1.19.63.3 Mesa 18.0.5 (LLVM 6.0 256 bits)GCC 7.3.0ext41024x768KVMProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelsDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionSystem LayerUbuntu 18.04 L1TF Foreshadow VM Testing BenchmarksSystem Logs- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - NONE / data=ordered,errors=remount-ro,relatime,rw- Python 2.7.15rc1 + Python 3.6.5- Unmitigated: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW Protection - Default Mitigation: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + PTE Inversion Protection - Always Flushing: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + PTE Inversion Protection - Full Mitigation: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + PTE Inversion Protection

UnmitigatedDefault MitigationAlways FlushingFull MitigationResult OverviewPhoronix Test Suite100%155%210%265%320%TTSIOD 3D RendererHackbenchApache SiegeebizzySysbenchPostgreSQL pgbenchStress-NGTimed Linux Kernel CompilationTimed LLVM CompilationApache BenchmarkRedisSockperfCompile BenchZstd CompressionGIMPFlexible IO TesterMariaDBNGINX BenchmarkOpenSSLIOzoneSQLiteGit

Ubuntu 18.04 L1TF Foreshadow VM Testingcompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treehackbench: 4 - Threadhackbench: 8 - Threadhackbench: 16 - Threadhackbench: 4 - Processhackbench: 8 - Processhackbench: 16 - Processstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Vector Mathstress-ng: Socket Activitystress-ng: Context Switchingstress-ng: System V Message Passingsockperf: Throughputsockperf: Latency Ping Pongsockperf: Latency Under Loadgimp: unsharp-maskgimp: resizegimp: rotategimp: auto-levelsfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 2MB - Default Test Directoryiozone: 1MB - 4GB - Write Performancebuild-llvm: Time To Compilecompress-zstd: Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19build-linux-kernel: Time To Compilesysbench: Memorysysbench: CPUttsiod-renderer: Phong Rendering With Soft-Shadow Mappingnginx: Static Web Page Servingapache: Static Web Page Servingopenssl: RSA 4096-bit Performanceapache-siege: 50redis: LPOPredis: SADDredis: LPUSHredis: GETredis: SETsqlite: Timed SQLite Insertionspgbench: Buffer Test - Normal Load - Read Onlypgbench: Buffer Test - Normal Load - Read Writemysqlslap: 8ebizzy: git: Time To Complete Common Git CommandsUnmitigatedDefault MitigationAlways FlushingFull Mitigation1402.16462.672234.539.4218.8736.979.4920.1137.04557628.55168491.9060351.4313880.5312590168.7412135778.984646977.1445.9454.0111.6124.1125.1219721318121001136710957661242712309.22195.49144.8333.8510438083.9651572.28660.2027495.4124525.217915.9714060.582068611.851878780.171297688.502026228.331463285.4661.99394876.945152.08245486187.351450.63444.942233.489.5119.3038.039.5919.8136.59599437.06169670.3860406.7813163.1212482470.0512276978.984890817.8046.8454.0111.2524.2024.6121531444113111140011158301247737311.44203.77140.3433.7310535022.3951480.55651.5626983.2124714.347879.1313700.331840381.561746629.661431348.011824211.401531909.1963.28387186.235162.44244448357.281408.53451.082237.1210.5821.7643.3610.7824.1943.53581171.78171874.0460504.8412992.8912370237.9812192475.244683628.7049.1456.3511.8324.7725.3221321432107671033311917881203726314.77199.40145.5833.6410510051.3851558.10652.3626388.0822456.197833.3713502.711443664.991669834.001418073.811762582.371421644.6762.71376404.545126.91237530687.271360.12411.132178.7121.7230.3954.1221.9131.9461.49700793.02136088.1045524.0912833.2011050870.697914016.084775776.9053.2855.8212.1725.2826.1720441219105331103311807611259740304.39219.11148.0938.007267419.4036587.25206.3026712.5722023.627607.078015.481397732.791625370.681405706.451789732.771501864.6262.49263895.664859.91235760207.30OpenBenchmarking.org

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileUnmitigatedDefault MitigationAlways FlushingFull Mitigation30060090012001500SE +/- 36.69, N = 6SE +/- 23.36, N = 4SE +/- 24.42, N = 3SE +/- 26.60, N = 31402.161450.631408.531360.12
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileUnmitigatedDefault MitigationAlways FlushingFull Mitigation30060090012001500Min: 1254.24 / Avg: 1402.16 / Max: 1493.42Min: 1380.61 / Avg: 1450.63 / Max: 1475.81Min: 1372.64 / Avg: 1408.53 / Max: 1455.16Min: 1307.18 / Avg: 1360.12 / Max: 1391.06

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateUnmitigatedDefault MitigationAlways FlushingFull Mitigation100200300400500SE +/- 5.89, N = 3SE +/- 1.76, N = 3SE +/- 10.50, N = 3SE +/- 17.84, N = 3462.67444.94451.08411.13
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateUnmitigatedDefault MitigationAlways FlushingFull Mitigation80160240320400Min: 451.39 / Avg: 462.67 / Max: 471.25Min: 443.08 / Avg: 444.94 / Max: 448.45Min: 430.35 / Avg: 451.08 / Max: 464.31Min: 390.3 / Avg: 411.13 / Max: 446.63

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeUnmitigatedDefault MitigationAlways FlushingFull Mitigation5001000150020002500SE +/- 8.33, N = 3SE +/- 40.11, N = 3SE +/- 21.33, N = 3SE +/- 33.25, N = 32234.532233.482237.122178.71
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeUnmitigatedDefault MitigationAlways FlushingFull Mitigation400800120016002000Min: 2221.69 / Avg: 2234.53 / Max: 2250.13Min: 2153.35 / Avg: 2233.48 / Max: 2276.82Min: 2198.97 / Avg: 2237.12 / Max: 2272.72Min: 2112.24 / Avg: 2178.71 / Max: 2213.53

Hackbench

This is a benchmark of Hackbench, a test of the Linux kernel scheduler. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 4 - Type: ThreadUnmitigatedDefault MitigationAlways FlushingFull Mitigation510152025SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.32, N = 39.429.5110.5821.721. (CC) gcc options: -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 4 - Type: ThreadUnmitigatedDefault MitigationAlways FlushingFull Mitigation510152025Min: 9.29 / Avg: 9.42 / Max: 9.52Min: 9.47 / Avg: 9.51 / Max: 9.57Min: 10.49 / Avg: 10.58 / Max: 10.73Min: 21.34 / Avg: 21.72 / Max: 22.361. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 8 - Type: ThreadUnmitigatedDefault MitigationAlways FlushingFull Mitigation714212835SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.19, N = 3SE +/- 0.18, N = 318.8719.3021.7630.391. (CC) gcc options: -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 8 - Type: ThreadUnmitigatedDefault MitigationAlways FlushingFull Mitigation714212835Min: 18.71 / Avg: 18.87 / Max: 19.03Min: 18.94 / Avg: 19.3 / Max: 19.48Min: 21.4 / Avg: 21.76 / Max: 22.03Min: 30.03 / Avg: 30.39 / Max: 30.571. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ThreadUnmitigatedDefault MitigationAlways FlushingFull Mitigation1224364860SE +/- 0.26, N = 3SE +/- 0.25, N = 3SE +/- 0.71, N = 3SE +/- 0.78, N = 436.9738.0343.3654.121. (CC) gcc options: -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ThreadUnmitigatedDefault MitigationAlways FlushingFull Mitigation1122334455Min: 36.45 / Avg: 36.97 / Max: 37.3Min: 37.78 / Avg: 38.03 / Max: 38.53Min: 41.98 / Avg: 43.36 / Max: 44.35Min: 51.96 / Avg: 54.12 / Max: 55.341. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 4 - Type: ProcessUnmitigatedDefault MitigationAlways FlushingFull Mitigation510152025SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 39.499.5910.7821.911. (CC) gcc options: -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 4 - Type: ProcessUnmitigatedDefault MitigationAlways FlushingFull Mitigation510152025Min: 9.32 / Avg: 9.49 / Max: 9.65Min: 9.5 / Avg: 9.59 / Max: 9.75Min: 10.73 / Avg: 10.78 / Max: 10.87Min: 21.7 / Avg: 21.91 / Max: 22.061. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 8 - Type: ProcessUnmitigatedDefault MitigationAlways FlushingFull Mitigation714212835SE +/- 0.07, N = 3SE +/- 0.20, N = 3SE +/- 0.37, N = 4SE +/- 0.22, N = 320.1119.8124.1931.941. (CC) gcc options: -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 8 - Type: ProcessUnmitigatedDefault MitigationAlways FlushingFull Mitigation714212835Min: 20.04 / Avg: 20.11 / Max: 20.25Min: 19.43 / Avg: 19.81 / Max: 20.1Min: 23.25 / Avg: 24.19 / Max: 24.94Min: 31.53 / Avg: 31.94 / Max: 32.31. (CC) gcc options: -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ProcessUnmitigatedDefault MitigationAlways FlushingFull Mitigation1428425670SE +/- 0.27, N = 3SE +/- 0.12, N = 3SE +/- 0.51, N = 3SE +/- 1.05, N = 337.0436.5943.5361.491. (CC) gcc options: -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 16 - Type: ProcessUnmitigatedDefault MitigationAlways FlushingFull Mitigation1224364860Min: 36.5 / Avg: 37.04 / Max: 37.4Min: 36.36 / Avg: 36.59 / Max: 36.75Min: 42.54 / Avg: 43.53 / Max: 44.21Min: 60.21 / Avg: 61.49 / Max: 63.571. (CC) gcc options: -lpthread

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: SemaphoresUnmitigatedDefault MitigationAlways FlushingFull Mitigation150K300K450K600K750KSE +/- 11434.26, N = 6SE +/- 6344.60, N = 3SE +/- 584.43, N = 3SE +/- 10838.51, N = 5557628.55599437.06581171.78700793.021. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: SemaphoresUnmitigatedDefault MitigationAlways FlushingFull Mitigation120K240K360K480K600KMin: 527990.85 / Avg: 557628.55 / Max: 597485.35Min: 586867.75 / Avg: 599437.06 / Max: 607228.79Min: 580015.85 / Avg: 581171.78 / Max: 581899.94Min: 666720.33 / Avg: 700793.02 / Max: 732664.851. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Matrix MathUnmitigatedDefault MitigationAlways FlushingFull Mitigation40K80K120K160K200KSE +/- 2677.89, N = 3SE +/- 1660.13, N = 3SE +/- 1078.42, N = 3SE +/- 982.93, N = 3168491.90169670.38171874.04136088.101. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Matrix MathUnmitigatedDefault MitigationAlways FlushingFull Mitigation30K60K90K120K150KMin: 164825.79 / Avg: 168491.9 / Max: 173706.24Min: 166862.28 / Avg: 169670.38 / Max: 172608.72Min: 169764.5 / Avg: 171874.04 / Max: 173317.88Min: 134843.65 / Avg: 136088.1 / Max: 138028.271. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Vector MathUnmitigatedDefault MitigationAlways FlushingFull Mitigation13K26K39K52K65KSE +/- 186.86, N = 3SE +/- 298.54, N = 3SE +/- 30.21, N = 3SE +/- 137.57, N = 360351.4360406.7860504.8445524.091. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Vector MathUnmitigatedDefault MitigationAlways FlushingFull Mitigation10K20K30K40K50KMin: 60054.15 / Avg: 60351.43 / Max: 60696.21Min: 59814.16 / Avg: 60406.78 / Max: 60766.19Min: 60464.46 / Avg: 60504.84 / Max: 60563.95Min: 45253.73 / Avg: 45524.09 / Max: 45703.541. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Socket ActivityUnmitigatedDefault MitigationAlways FlushingFull Mitigation3K6K9K12K15KSE +/- 90.47, N = 3SE +/- 47.46, N = 3SE +/- 98.54, N = 3SE +/- 40.44, N = 313880.5313163.1212992.8912833.201. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Socket ActivityUnmitigatedDefault MitigationAlways FlushingFull Mitigation2K4K6K8K10KMin: 13742.44 / Avg: 13880.53 / Max: 14050.83Min: 13092.98 / Avg: 13163.12 / Max: 13253.57Min: 12795.95 / Avg: 12992.89 / Max: 13097.95Min: 12766.31 / Avg: 12833.2 / Max: 12906.021. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Context SwitchingUnmitigatedDefault MitigationAlways FlushingFull Mitigation3M6M9M12M15MSE +/- 177083.84, N = 3SE +/- 12082.59, N = 3SE +/- 141287.57, N = 3SE +/- 155557.89, N = 312590168.7412482470.0512370237.9811050870.691. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Context SwitchingUnmitigatedDefault MitigationAlways FlushingFull Mitigation2M4M6M8M10MMin: 12392903.79 / Avg: 12590168.74 / Max: 12943538.27Min: 12470226.57 / Avg: 12482470.05 / Max: 12506634.51Min: 12227051.69 / Avg: 12370237.98 / Max: 12652804.58Min: 10877981.96 / Avg: 11050870.69 / Max: 11361317.031. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: System V Message PassingUnmitigatedDefault MitigationAlways FlushingFull Mitigation3M6M9M12M15MSE +/- 188941.31, N = 3SE +/- 95795.42, N = 3SE +/- 113733.08, N = 3SE +/- 86447.80, N = 312135778.9812276978.9812192475.247914016.081. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: System V Message PassingUnmitigatedDefault MitigationAlways FlushingFull Mitigation2M4M6M8M10MMin: 11791604.31 / Avg: 12135778.98 / Max: 12442974.82Min: 12131871.83 / Avg: 12276978.98 / Max: 12457875.65Min: 11975576.88 / Avg: 12192475.24 / Max: 12360270.55Min: 7804316.14 / Avg: 7914016.08 / Max: 8084598.981. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

Sockperf

This is a network socket API performance benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMessages Per Second, More Is BetterSockperf 3.4Test: ThroughputUnmitigatedDefault MitigationAlways FlushingFull Mitigation100K200K300K400K500KSE +/- 22194.18, N = 10SE +/- 10160.93, N = 20SE +/- 15140.22, N = 15SE +/- 15206.71, N = 204646974890814683624775771. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread
OpenBenchmarking.orgMessages Per Second, More Is BetterSockperf 3.4Test: ThroughputUnmitigatedDefault MitigationAlways FlushingFull Mitigation80K160K240K320K400KMin: 371884 / Avg: 464697.2 / Max: 575496Min: 389774 / Avg: 489081.2 / Max: 564773Min: 325358 / Avg: 468361.87 / Max: 584532Min: 375130 / Avg: 477577.35 / Max: 6082031. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.4Test: Latency Ping PongUnmitigatedDefault MitigationAlways FlushingFull Mitigation246810SE +/- 0.59, N = 10SE +/- 0.34, N = 15SE +/- 0.37, N = 20SE +/- 0.63, N = 157.147.808.706.901. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread
OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.4Test: Latency Ping PongUnmitigatedDefault MitigationAlways FlushingFull Mitigation3691215Min: 3.46 / Avg: 7.14 / Max: 9.21Min: 4.28 / Avg: 7.8 / Max: 9.28Min: 4.27 / Avg: 8.7 / Max: 10.92Min: 2.95 / Avg: 6.9 / Max: 9.671. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.4Test: Latency Under LoadUnmitigatedDefault MitigationAlways FlushingFull Mitigation1224364860SE +/- 3.40, N = 10SE +/- 4.68, N = 15SE +/- 4.00, N = 20SE +/- 3.21, N = 1645.9446.8449.1453.281. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread
OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.4Test: Latency Under LoadUnmitigatedDefault MitigationAlways FlushingFull Mitigation1122334455Min: 16.68 / Avg: 45.94 / Max: 53.11Min: 5.81 / Avg: 46.84 / Max: 61.25Min: 6.03 / Avg: 49.14 / Max: 62.61Min: 6.19 / Avg: 53.28 / Max: 59.951. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

GIMP

GIMP is an open-source image manipulaton program. This test profile will use the system-provided GIMP program otherwise on Windows relys upon a pre-packaged Windows binary from upstream GIMP.org. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.8.22Test: unsharp-maskUnmitigatedDefault MitigationAlways FlushingFull Mitigation1326395265SE +/- 0.35, N = 3SE +/- 0.34, N = 3SE +/- 0.28, N = 3SE +/- 0.49, N = 354.0154.0156.3555.82
OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.8.22Test: unsharp-maskUnmitigatedDefault MitigationAlways FlushingFull Mitigation1122334455Min: 53.44 / Avg: 54.01 / Max: 54.64Min: 53.65 / Avg: 54.01 / Max: 54.68Min: 55.92 / Avg: 56.35 / Max: 56.88Min: 55.18 / Avg: 55.82 / Max: 56.78

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.8.22Test: resizeUnmitigatedDefault MitigationAlways FlushingFull Mitigation3691215SE +/- 0.23, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 311.6111.2511.8312.17
OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.8.22Test: resizeUnmitigatedDefault MitigationAlways FlushingFull Mitigation48121620Min: 11.17 / Avg: 11.61 / Max: 11.93Min: 11.16 / Avg: 11.25 / Max: 11.4Min: 11.7 / Avg: 11.83 / Max: 12.01Min: 12.07 / Avg: 12.17 / Max: 12.24

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.8.22Test: rotateUnmitigatedDefault MitigationAlways FlushingFull Mitigation612182430SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.19, N = 3SE +/- 0.34, N = 324.1124.2024.7725.28
OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.8.22Test: rotateUnmitigatedDefault MitigationAlways FlushingFull Mitigation612182430Min: 23.89 / Avg: 24.11 / Max: 24.42Min: 23.94 / Avg: 24.2 / Max: 24.36Min: 24.41 / Avg: 24.77 / Max: 25.06Min: 24.64 / Avg: 25.28 / Max: 25.8

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.8.22Test: auto-levelsUnmitigatedDefault MitigationAlways FlushingFull Mitigation612182430SE +/- 0.24, N = 3SE +/- 0.29, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 325.1224.6125.3226.17
OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.8.22Test: auto-levelsUnmitigatedDefault MitigationAlways FlushingFull Mitigation612182430Min: 24.69 / Avg: 25.12 / Max: 25.5Min: 24.22 / Avg: 24.61 / Max: 25.19Min: 25.26 / Avg: 25.32 / Max: 25.44Min: 26.07 / Avg: 26.17 / Max: 26.3

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation5001000150020002500SE +/- 38.30, N = 6SE +/- 34.60, N = 9SE +/- 31.73, N = 12SE +/- 4.36, N = 319722153213220441. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation400800120016002000Min: 1874 / Avg: 1972.33 / Max: 2093Min: 2010 / Avg: 2153.22 / Max: 2314Min: 1918 / Avg: 2132.42 / Max: 2297Min: 2037 / Avg: 2044 / Max: 20521. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation30060090012001500SE +/- 53.63, N = 6SE +/- 75.95, N = 9SE +/- 57.61, N = 9SE +/- 11.29, N = 313181444143212191. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation30060090012001500Min: 1124 / Avg: 1318 / Max: 1454Min: 1170 / Avg: 1443.56 / Max: 1779Min: 1229 / Avg: 1432.44 / Max: 1716Min: 1203 / Avg: 1219.33 / Max: 12411. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation3K6K9K12K15KSE +/- 272.03, N = 6SE +/- 246.33, N = 9SE +/- 33.33, N = 3SE +/- 133.33, N = 3121001131110767105331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation2K4K6K8K10KMin: 11500 / Avg: 12100 / Max: 13100Min: 10300 / Avg: 11311.11 / Max: 12700Min: 10700 / Avg: 10766.67 / Max: 10800Min: 10400 / Avg: 10533.33 / Max: 108001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation2K4K6K8K10KSE +/- 176.38, N = 3SE +/- 303.68, N = 9SE +/- 145.30, N = 3SE +/- 133.33, N = 3113671140010333110331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation2K4K6K8K10KMin: 11100 / Avg: 11366.67 / Max: 11700Min: 10600 / Avg: 11400 / Max: 13500Min: 10100 / Avg: 10333.33 / Max: 10600Min: 10900 / Avg: 11033.33 / Max: 113001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation30060090012001500SE +/- 8.37, N = 3SE +/- 17.38, N = 3SE +/- 5.55, N = 3SE +/- 27.55, N = 1210951115119111801. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation2004006008001000Min: 1080 / Avg: 1094.67 / Max: 1109Min: 1081 / Avg: 1114.67 / Max: 1139Min: 1182 / Avg: 1190.67 / Max: 1201Min: 1045 / Avg: 1179.58 / Max: 12991. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation2004006008001000SE +/- 11.97, N = 6SE +/- 8.08, N = 3SE +/- 10.82, N = 3SE +/- 9.93, N = 127668307887611. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation150300450600750Min: 742 / Avg: 766 / Max: 813Min: 814 / Avg: 830 / Max: 840Min: 773 / Avg: 788 / Max: 809Min: 722 / Avg: 761.42 / Max: 8331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation30060090012001500SE +/- 11.57, N = 3SE +/- 35.68, N = 9SE +/- 25.02, N = 12SE +/- 19.30, N = 1212421247120312591. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation2004006008001000Min: 1223 / Avg: 1242.33 / Max: 1263Min: 1109 / Avg: 1247.33 / Max: 1401Min: 1102 / Avg: 1203.08 / Max: 1366Min: 1166 / Avg: 1259.42 / Max: 13761. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation160320480640800SE +/- 11.85, N = 3SE +/- 20.23, N = 9SE +/- 12.34, N = 3SE +/- 8.57, N = 127127377267401. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation130260390520650Min: 691 / Avg: 712 / Max: 732Min: 642 / Avg: 737.33 / Max: 837Min: 709 / Avg: 726 / Max: 750Min: 693 / Avg: 739.92 / Max: 7941. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl

IOzone

The IOzone benchmark tests the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 4GB - Disk Test: Write PerformanceUnmitigatedDefault MitigationAlways FlushingFull Mitigation70140210280350SE +/- 4.67, N = 3SE +/- 1.19, N = 3SE +/- 1.21, N = 3SE +/- 4.45, N = 3309.22311.44314.77304.391. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 4GB - Disk Test: Write PerformanceUnmitigatedDefault MitigationAlways FlushingFull Mitigation60120180240300Min: 303.13 / Avg: 309.22 / Max: 318.39Min: 309.98 / Avg: 311.44 / Max: 313.8Min: 313.41 / Avg: 314.77 / Max: 317.17Min: 295.79 / Avg: 304.39 / Max: 310.661. (CC) gcc options: -O3

Timed LLVM Compilation

This test times how long it takes to build the LLVM compiler. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 6.0.1Time To CompileUnmitigatedDefault MitigationAlways FlushingFull Mitigation50100150200250195.49203.77199.40219.11

Zstd Compression

This test measures the time needed to compress a sample file (an Ubuntu file-system image) using Zstd compression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterZstd Compression 1.3.4Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19UnmitigatedDefault MitigationAlways FlushingFull Mitigation306090120150SE +/- 1.55, N = 3SE +/- 1.05, N = 3SE +/- 1.23, N = 3SE +/- 0.47, N = 3144.83140.34145.58148.091. (CC) gcc options: -O3 -pthread -lz -llzma
OpenBenchmarking.orgSeconds, Fewer Is BetterZstd Compression 1.3.4Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19UnmitigatedDefault MitigationAlways FlushingFull Mitigation306090120150Min: 142.97 / Avg: 144.83 / Max: 147.9Min: 138.84 / Avg: 140.34 / Max: 142.37Min: 143.32 / Avg: 145.58 / Max: 147.56Min: 147.34 / Avg: 148.09 / Max: 148.961. (CC) gcc options: -O3 -pthread -lz -llzma

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 4.13Time To CompileUnmitigatedDefault MitigationAlways FlushingFull Mitigation918273645SE +/- 0.81, N = 6SE +/- 0.53, N = 9SE +/- 0.37, N = 12SE +/- 0.45, N = 1233.8533.7333.6438.00
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 4.13Time To CompileUnmitigatedDefault MitigationAlways FlushingFull Mitigation816243240Min: 32.78 / Avg: 33.85 / Max: 37.88Min: 32.62 / Avg: 33.73 / Max: 37.93Min: 32.9 / Avg: 33.64 / Max: 37.59Min: 37.11 / Avg: 38 / Max: 42.86

Sysbench

This is a benchmark of Sysbench with CPU and memory sub-tests. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgEvents Per Second, More Is BetterSysbench 2018-07-28Test: MemoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation2M4M6M8M10MSE +/- 73702.36, N = 3SE +/- 151324.74, N = 3SE +/- 139686.71, N = 3SE +/- 114162.45, N = 310438083.9610535022.3910510051.387267419.401. (CC) gcc options: -pthread -O3 -funroll-loops -ggdb3 -march=core2 -rdynamic -ldl -laio -lm
OpenBenchmarking.orgEvents Per Second, More Is BetterSysbench 2018-07-28Test: MemoryUnmitigatedDefault MitigationAlways FlushingFull Mitigation2M4M6M8M10MMin: 10294855.24 / Avg: 10438083.96 / Max: 10539868.85Min: 10270739.71 / Avg: 10535022.39 / Max: 10794888.15Min: 10235015.08 / Avg: 10510051.38 / Max: 10690036.02Min: 7039308.58 / Avg: 7267419.4 / Max: 7390035.491. (CC) gcc options: -pthread -O3 -funroll-loops -ggdb3 -march=core2 -rdynamic -ldl -laio -lm

OpenBenchmarking.orgEvents Per Second, More Is BetterSysbench 2018-07-28Test: CPUUnmitigatedDefault MitigationAlways FlushingFull Mitigation11K22K33K44K55KSE +/- 52.27, N = 3SE +/- 24.09, N = 3SE +/- 36.69, N = 3SE +/- 20.94, N = 351572.2851480.5551558.1036587.251. (CC) gcc options: -pthread -O3 -funroll-loops -ggdb3 -march=core2 -rdynamic -ldl -laio -lm
OpenBenchmarking.orgEvents Per Second, More Is BetterSysbench 2018-07-28Test: CPUUnmitigatedDefault MitigationAlways FlushingFull Mitigation9K18K27K36K45KMin: 51470.54 / Avg: 51572.28 / Max: 51643.96Min: 51435.02 / Avg: 51480.55 / Max: 51516.96Min: 51485.42 / Avg: 51558.1 / Max: 51603.24Min: 36558.07 / Avg: 36587.25 / Max: 36627.861. (CC) gcc options: -pthread -O3 -funroll-loops -ggdb3 -march=core2 -rdynamic -ldl -laio -lm

TTSIOD 3D Renderer

A portable GPL 3D software renderer that supports OpenMP and Intel Threading Building Blocks with many different rendering modes. This version does not use OpenGL but is entirely CPU/software based. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterTTSIOD 3D Renderer 2.3bPhong Rendering With Soft-Shadow MappingUnmitigatedDefault MitigationAlways FlushingFull Mitigation140280420560700SE +/- 6.92, N = 3SE +/- 11.07, N = 4SE +/- 10.57, N = 3SE +/- 0.31, N = 3660.20651.56652.36206.301. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -msse -mrecip -mfpmath=sse -msse2 -mssse3 -lSDL -fopenmp -fwhole-program -lstdc++
OpenBenchmarking.orgFPS, More Is BetterTTSIOD 3D Renderer 2.3bPhong Rendering With Soft-Shadow MappingUnmitigatedDefault MitigationAlways FlushingFull Mitigation120240360480600Min: 649.14 / Avg: 660.2 / Max: 672.95Min: 624.84 / Avg: 651.56 / Max: 679.07Min: 641.27 / Avg: 652.36 / Max: 673.49Min: 205.94 / Avg: 206.3 / Max: 206.921. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -msse -mrecip -mfpmath=sse -msse2 -mssse3 -lSDL -fopenmp -fwhole-program -lstdc++

NGINX Benchmark

This is a test of ab, which is the Apache Benchmark program running against nginx. This test profile measures how many requests per second a given system can sustain when carrying out 2,000,000 requests with 500 requests being carried out concurrently. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.9.9Static Web Page ServingUnmitigatedDefault MitigationAlways FlushingFull Mitigation6K12K18K24K30KSE +/- 248.68, N = 3SE +/- 200.40, N = 3SE +/- 411.39, N = 5SE +/- 90.18, N = 327495.4126983.2126388.0826712.571. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native
OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.9.9Static Web Page ServingUnmitigatedDefault MitigationAlways FlushingFull Mitigation5K10K15K20K25KMin: 27102.95 / Avg: 27495.41 / Max: 27956.23Min: 26585.96 / Avg: 26983.21 / Max: 27227.92Min: 25152.16 / Avg: 26388.08 / Max: 27494.22Min: 26595.73 / Avg: 26712.57 / Max: 26889.991. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native

Apache Benchmark

This is a test of ab, which is the Apache benchmark program. This test profile measures how many requests per second a given system can sustain when carrying out 1,000,000 requests with 100 requests being carried out concurrently. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingUnmitigatedDefault MitigationAlways FlushingFull Mitigation5K10K15K20K25KSE +/- 471.64, N = 3SE +/- 361.69, N = 9SE +/- 292.86, N = 7SE +/- 349.24, N = 1224525.2124714.3422456.1922023.621. (CC) gcc options: -shared -fPIC -O2 -pthread
OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingUnmitigatedDefault MitigationAlways FlushingFull Mitigation4K8K12K16K20KMin: 23582.06 / Avg: 24525.21 / Max: 25009.96Min: 22181.51 / Avg: 24714.34 / Max: 26281.24Min: 20972.72 / Avg: 22456.19 / Max: 23186.01Min: 18425.9 / Avg: 22023.62 / Max: 22817.441. (CC) gcc options: -shared -fPIC -O2 -pthread

OpenSSL

OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test measures the RSA 4096-bit performance of OpenSSL. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.1.0fRSA 4096-bit PerformanceUnmitigatedDefault MitigationAlways FlushingFull Mitigation2K4K6K8K10KSE +/- 14.57, N = 3SE +/- 32.73, N = 3SE +/- 31.06, N = 3SE +/- 79.42, N = 37915.977879.137833.377607.071. (CC) gcc options: -O3 -pthread -m64 -lssl -lcrypto -ldl
OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.1.0fRSA 4096-bit PerformanceUnmitigatedDefault MitigationAlways FlushingFull Mitigation14002800420056007000Min: 7897.4 / Avg: 7915.97 / Max: 7944.7Min: 7841.1 / Avg: 7879.13 / Max: 7944.3Min: 7781.6 / Avg: 7833.37 / Max: 7889Min: 7448.5 / Avg: 7607.07 / Max: 7694.31. (CC) gcc options: -O3 -pthread -m64 -lssl -lcrypto -ldl

Apache Siege

This is a test of the Apache web server performance being facilitated by the Siege web serverb enchmark program. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTransactions Per Second, More Is BetterApache Siege 2.4.29Concurrent Users: 50UnmitigatedDefault MitigationAlways FlushingFull Mitigation3K6K9K12K15K14060.5813700.3313502.718015.481. (CC) gcc options: -O2 -lpthread -ldl -lssl -lcrypto

Redis

Redis is an open-source data structure server. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 4.0.8Test: LPOPUnmitigatedDefault MitigationAlways FlushingFull Mitigation400K800K1200K1600K2000KSE +/- 137342.99, N = 6SE +/- 101684.52, N = 12SE +/- 53543.04, N = 10SE +/- 35832.53, N = 122068611.851840381.561443664.991397732.791. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 4.0.8Test: LPOPUnmitigatedDefault MitigationAlways FlushingFull Mitigation400K800K1200K1600K2000KMin: 1600000 / Avg: 2068611.85 / Max: 2398081.5Min: 1317523 / Avg: 1840381.56 / Max: 2386634.75Min: 1210653.75 / Avg: 1443664.99 / Max: 1773049.62Min: 1264222.5 / Avg: 1397732.79 / Max: 1620745.621. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 4.0.8Test: SADDUnmitigatedDefault MitigationAlways FlushingFull Mitigation400K800K1200K1600K2000KSE +/- 85165.61, N = 6SE +/- 69330.61, N = 9SE +/- 61306.24, N = 12SE +/- 49376.90, N = 121878780.171746629.661669834.001625370.681. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 4.0.8Test: SADDUnmitigatedDefault MitigationAlways FlushingFull Mitigation300K600K900K1200K1500KMin: 1538461.62 / Avg: 1878780.17 / Max: 2053388.12Min: 1501501.5 / Avg: 1746629.66 / Max: 2053388.12Min: 1379310.25 / Avg: 1669834 / Max: 1988071.5Min: 1426533.62 / Avg: 1625370.68 / Max: 1937984.621. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 4.0.8Test: LPUSHUnmitigatedDefault MitigationAlways FlushingFull Mitigation300K600K900K1200K1500KSE +/- 20709.64, N = 3SE +/- 39118.19, N = 9SE +/- 53016.95, N = 12SE +/- 41599.43, N = 121297688.501431348.011418073.811405706.451. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 4.0.8Test: LPUSHUnmitigatedDefault MitigationAlways FlushingFull Mitigation200K400K600K800K1000KMin: 1256281.38 / Avg: 1297688.5 / Max: 1319261.12Min: 1257861.62 / Avg: 1431348.01 / Max: 1567398.12Min: 1173708.88 / Avg: 1418073.81 / Max: 1644736.88Min: 1129943.5 / Avg: 1405706.45 / Max: 1626016.251. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 4.0.8Test: GETUnmitigatedDefault MitigationAlways FlushingFull Mitigation400K800K1200K1600K2000KSE +/- 87966.15, N = 6SE +/- 92589.67, N = 9SE +/- 72106.90, N = 12SE +/- 48565.17, N = 122026228.331824211.401762582.371789732.771. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 4.0.8Test: GETUnmitigatedDefault MitigationAlways FlushingFull Mitigation400K800K1200K1600K2000KMin: 1694915.38 / Avg: 2026228.33 / Max: 2277904.25Min: 1464128.75 / Avg: 1824211.4 / Max: 2164502Min: 1322751.38 / Avg: 1762582.37 / Max: 2141327.5Min: 1547987.5 / Avg: 1789732.77 / Max: 20202021. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 4.0.8Test: SETUnmitigatedDefault MitigationAlways FlushingFull Mitigation300K600K900K1200K1500KSE +/- 88955.87, N = 6SE +/- 60083.85, N = 9SE +/- 55957.00, N = 12SE +/- 37254.96, N = 121463285.461531909.191421644.671501864.621. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 4.0.8Test: SETUnmitigatedDefault MitigationAlways FlushingFull Mitigation300K600K900K1200K1500KMin: 1172333 / Avg: 1463285.46 / Max: 1754386Min: 1196172.25 / Avg: 1531909.19 / Max: 1763668.5Min: 1161440.12 / Avg: 1421644.67 / Max: 1748251.62Min: 1251564.38 / Avg: 1501864.62 / Max: 1672240.881. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread

SQLite

This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsUnmitigatedDefault MitigationAlways FlushingFull Mitigation1428425670SE +/- 0.04, N = 3SE +/- 0.78, N = 3SE +/- 1.01, N = 3SE +/- 0.46, N = 361.9963.2862.7162.491. (CC) gcc options: -O2 -lz -ldl -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsUnmitigatedDefault MitigationAlways FlushingFull Mitigation1224364860Min: 61.95 / Avg: 61.99 / Max: 62.07Min: 62.05 / Avg: 63.28 / Max: 64.74Min: 60.7 / Avg: 62.71 / Max: 63.8Min: 61.8 / Avg: 62.49 / Max: 63.361. (CC) gcc options: -O2 -lz -ldl -lpthread

PostgreSQL pgbench

This is a simple benchmark of PostgreSQL using pgbench. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyUnmitigatedDefault MitigationAlways FlushingFull Mitigation80K160K240K320K400KSE +/- 2565.21, N = 3SE +/- 2783.33, N = 3SE +/- 2604.84, N = 3SE +/- 1013.98, N = 3394876.94387186.23376404.54263895.661. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyUnmitigatedDefault MitigationAlways FlushingFull Mitigation70K140K210K280K350KMin: 391264.04 / Avg: 394876.94 / Max: 399837.94Min: 383085.84 / Avg: 387186.23 / Max: 392496.93Min: 372226.58 / Avg: 376404.54 / Max: 381188.71Min: 261954.53 / Avg: 263895.66 / Max: 265374.661. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteUnmitigatedDefault MitigationAlways FlushingFull Mitigation11002200330044005500SE +/- 15.96, N = 3SE +/- 32.52, N = 3SE +/- 3.70, N = 3SE +/- 70.66, N = 35152.085162.445126.914859.911. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteUnmitigatedDefault MitigationAlways FlushingFull Mitigation9001800270036004500Min: 5130.09 / Avg: 5152.08 / Max: 5183.12Min: 5098.88 / Avg: 5162.44 / Max: 5206.15Min: 5119.87 / Avg: 5126.91 / Max: 5132.42Min: 4750.47 / Avg: 4859.91 / Max: 4992.051. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

MariaDB

This is a MariaDB MySQL database server benchmark making use of mysqlslap. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 10.3.8Clients: 8UnmitigatedDefault MitigationAlways FlushingFull Mitigation50100150200250SE +/- 1.89, N = 3SE +/- 5.43, N = 3SE +/- 1.95, N = 3SE +/- 0.82, N = 32452442372351. (CXX) g++ options: -pie -fPIC -fstack-protector -fno-rtti -O2 -lpthread -llzma -laio -lz -lm -lpcre -lcrypt -lssl -lcrypto -ldl
OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 10.3.8Clients: 8UnmitigatedDefault MitigationAlways FlushingFull Mitigation4080120160200Min: 241.84 / Avg: 245.07 / Max: 248.39Min: 234.96 / Avg: 243.55 / Max: 253.61Min: 233.59 / Avg: 237.34 / Max: 240.15Min: 233.75 / Avg: 235.32 / Max: 236.521. (CXX) g++ options: -pie -fPIC -fstack-protector -fno-rtti -O2 -lpthread -llzma -laio -lz -lm -lpcre -lcrypt -lssl -lcrypto -ldl

ebizzy

This is a test of ebizzy, a program to generate workloads resembling web server workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRecords/s, More Is Betterebizzy 0.3UnmitigatedDefault MitigationAlways FlushingFull Mitigation16K32K48K64K80KSE +/- 429.33, N = 3SE +/- 404.70, N = 3SE +/- 1018.90, N = 3SE +/- 1286.76, N = 4486184483553068760201. (CC) gcc options: -pthread -lpthread -O3 -march=native
OpenBenchmarking.orgRecords/s, More Is Betterebizzy 0.3UnmitigatedDefault MitigationAlways FlushingFull Mitigation13K26K39K52K65KMin: 48043 / Avg: 48618.33 / Max: 49458Min: 44087 / Avg: 44834.67 / Max: 45477Min: 51849 / Avg: 53068.33 / Max: 55092Min: 72380 / Avg: 76020 / Max: 781511. (CC) gcc options: -pthread -lpthread -O3 -march=native

Git

This test measures the time needed to carry out some sample Git operations on an example, static repository that happens to be a copy of the GNOME GTK tool-kit repository. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGitTime To Complete Common Git CommandsUnmitigatedDefault MitigationAlways FlushingFull Mitigation246810SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 37.357.287.277.301. git version 2.17.1
OpenBenchmarking.orgSeconds, Fewer Is BetterGitTime To Complete Common Git CommandsUnmitigatedDefault MitigationAlways FlushingFull Mitigation3691215Min: 7.18 / Avg: 7.35 / Max: 7.52Min: 7.16 / Avg: 7.28 / Max: 7.47Min: 7.18 / Avg: 7.27 / Max: 7.38Min: 7.18 / Avg: 7.3 / Max: 7.511. git version 2.17.1