AMD Zen 4 CPU Security Mitigation Benchmarks

AMD Zen 4 CPU mitigation security tests by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2209265-NE-ZEN4MITIG74
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Default
September 24 2022
  14 Hours, 40 Minutes
mitigations=off
September 24 2022
  23 Hours, 26 Minutes
Invert Behavior (Only Show Selected Data)
  19 Hours, 3 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


AMD Zen 4 CPU Security Mitigation BenchmarksOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR X670E HERO (0604 BIOS)AMD Device 14d832GB2000GB Samsung SSD 980 PRO 2TBAMD Radeon RX 6800 XT 16GB (2575/1000MHz)AMD Navi 21 HDMI AudioASUS MG28UIntel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Ubuntu 22.046.0.0-060000rc6daily20220923-generic (x86_64)GNOME Shell 42.2X Server 1.21.1.3 + Wayland4.6 Mesa 22.3.0-devel (git-4685385 2022-08-23 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.48)1.3.224GCC 12.0.1 20220319ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionAMD Zen 4 CPU Security Mitigation Benchmarks PerformanceSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - NONE / errors=remount-ro,relatime,rw / Block Size: 4096- Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- OpenJDK Runtime Environment (build 11.0.16+8-post-Ubuntu-0ubuntu122.04)- Python 3.10.4- Default: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - mitigations=off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Default vs. mitigations=off ComparisonPhoronix Test SuiteBaseline+10.7%+10.7%+21.4%+21.4%+32.1%+32.1%26.6%12.3%12.3%11.8%10%4.5%4.2%4.1%4%4%3.7%3.3%3.3%3.2%2.3%2.1%W.i - Google Chrome42.6%SENDFILE192000 - 51224.1%96000 - 51221.7%Savina Reactors.IO21.4%40000000 - 2000 - C.P.B17.7%Scala Dotty17.5%192000 - 102417.4%40000000 - 100 - C.P.B16.7%10000000 - 2000 - C.P.B16.6%10000000 - 100 - C.P.B16.1%F.B.t.B.F.F14.5%96000 - 102413.8%SET - 5013.3%ARES-6 - Google Chrome12.6%Create FilesLatency Ping PongRead Compiled Tree12.2%480000 - 51212.2%200Rand Forest11.8%ARES-6 - Firefox11.2%G.A.U.J.F10.2%ThroughputJetstream 2 - Firefox9.2%480000 - 10249.1%Default8.7%Apache Spark ALS8.5%Jython8.2%Timed Time - Size 1,0008.2%5007.7%10000000 - 2000 - C.P.B.U.D7.6%Kraken - Firefox7.5%SVG Files To PNG7.4%A.S.P7.3%GET - 10006.9%6.8%10006.8%10000000 - 100 - C.P.B.U.D6.6%40000000 - 100 - C.P.B.U.D6.6%6.6%Speed 8 Realtime - Bosphorus 1080p6.5%10000000 - 2000 - I.J.T.T6.4%Speedometer - Google Chrome6.4%2006.2%Jetstream 2 - Google Chrome6.2%1006%66%Futex5.9%H25.7%W.i - Firefox5.6%Tradebeans5.6%40000000 - 100 - S.5.B.T5.5%Launch Programs5.5%R.B.P.L.O5.5%1.R.W.A.D.T.R5.5%T.B.T5.3%40000000 - 100 - Group By Test Time5.3%Speed 9 Realtime - Bosphorus 4K5.2%Speed 6 Realtime - Bosphorus 4K5.1%I.M.D.S5.1%2.D.T.P5%Speed 8 Realtime - Bosphorus 4K4.9%10000000 - 100 - I.J.T.T4.9%Speedometer - Firefox4.8%Time To Compile4.8%1.R.W.A.D.S.R4.7%204.7%CPU Cache4.6%40000000 - 2000 - C.P.B.U.D4.6%GET - 504.5%10000000 - 2000 - S.5.B.T4.5%Quality 1004.5%Context Switching1.R.W.A.D.F.R.C.C4.4%Speed 10 Realtime - Bosphorus 1080p4.3%50 - 1:54.3%100050 - 5:14.2%1Kraken - Google Chrome4%100SET - 10004%PSPDFKit WASM - Firefox3.9%3.9%Speed 10 Realtime - Bosphorus 4K3.9%Q.1.L3.8%Initial CreatePreset 10 - Bosphorus 4K3.7%203.6%10000000 - 100 - Group By Test Time3.6%10000000 - 2000 - R.T.T3.5%6, Lossless3.4%40000000 - 100 - B.I.J.T.T3.4%Latency Under LoadCreate ThreadsTradesoap3.3%Redis - 50 - 5:13.2%Preset 10 - Bosphorus 1080p3.2%ALS Movie Lens3.2%Malloc200 - 5:13.2%Redis - 500 - 1:103.1%40000000 - 2000 - B.I.J.T.T3.1%Writes3%Redis - 500 - 5:12.9%10000000 - 100 - S.5.B.T2.8%40000000 - 2000 - Group By Test Time2.7%200 - 1:52.6%10000000 - 100 - R.T.T2.6%40000000 - 2000 - I.J.T.T2.5%10000000 - 100 - B.I.J.T.T2.5%Speed 9 Realtime - Bosphorus 1080p2.5%Time To Compile2.5%Preset 8 - Bosphorus 1080p2.4%RANGE - 500 - 1000MEMFD2.2%40000000 - 100 - I.J.T.T2.2%RANGE - 100 - 100012.1%Preset 12 - Bosphorus 1080p2.1%Forking2.1%40000000 - 100 - R.T.T2%10000000 - 2000 - Group By Test Time2%SeleniumStress-NGStargate Digital Audio WorkstationStargate Digital Audio WorkstationRenaissanceApache SparkRenaissanceStargate Digital Audio WorkstationApache SparkApache SparkApache SparkLuaRadioStargate Digital Audio WorkstationRedisSeleniumOSBenchSockperfCompile BenchStargate Digital Audio WorkstationApache HTTP ServerRenaissanceSeleniumRenaissanceSockperfSeleniumStargate Digital Audio WorkstationTimed CPython CompilationRenaissanceDaCapo BenchmarkSQLite SpeedtestnginxApache SparkSeleniumInkscapeRenaissanceRedisGNU Octave BenchmarknginxApache SparkApache SparkNode.js V8 Web Tooling BenchmarkAOM AV1Apache SparkSeleniumnginxSeleniumnginxlibavif avifencStress-NGDaCapo BenchmarkSeleniumDaCapo BenchmarkApache SparkOSBenchTimed CPython CompilationClickHouseRawTherapeeApache SparkAOM AV1AOM AV1RenaissanceLibreOfficeAOM AV1Apache SparkSeleniumTimed Mesa CompilationClickHouseApache HTTP ServerStress-NGApache SparkRedisApache SparkWebP Image EncodeStress-NGClickHouseAOM AV1DragonflydbApache HTTP ServerDragonflydbnginxSeleniumApache HTTP ServerWireGuard + Linux Networking Stack Stress TestRedisSeleniumNode.js Express HTTP Load TestAOM AV1WebP Image EncodeCompile BenchSVT-AV1nginxApache SparkApache Sparklibavif avifencApache SparkSockperfOSBenchDaCapo Benchmarkmemtier_benchmarkSVT-AV1RenaissanceStress-NGDragonflydbmemtier_benchmarkApache SparkApache Cassandramemtier_benchmarkApache SparkApache SparkDragonflydbApache SparkApache SparkApache SparkAOM AV1Timed Godot Game Engine CompilationSVT-AV1etcdStress-NGApache SparketcdApache HTTP ServerSVT-AV1Stress-NGApache SparkApache SparkDefaultmitigations=off

AMD Zen 4 CPU Security Mitigation Benchmarksselenium: Jetstream 2 - Google Chromeluaradio: Complex Phaseluaradio: Hilbert Transformluaradio: FM Deemphasis Filterluaradio: Five Back to Back FIR Filtersselenium: Jetstream 2 - Firefoxspark: 10000000 - 2000 - Broadcast Inner Join Test Timespark: 10000000 - 2000 - Inner Join Test Timespark: 10000000 - 2000 - Repartition Test Timespark: 10000000 - 2000 - Group By Test Timespark: 10000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 2000 - Calculate Pi Benchmarkspark: 10000000 - 2000 - SHA-512 Benchmark Timerenaissance: Apache Spark PageRankclickhouse: 100M Rows Web Analytics Dataset, Third Runclickhouse: 100M Rows Web Analytics Dataset, Second Runclickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cacheselenium: ARES-6 - Firefoxspark: 40000000 - 100 - Broadcast Inner Join Test Timespark: 40000000 - 100 - Inner Join Test Timespark: 40000000 - 100 - Repartition Test Timespark: 40000000 - 100 - Group By Test Timespark: 40000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 100 - Calculate Pi Benchmarkspark: 40000000 - 100 - SHA-512 Benchmark Timeetcd: RANGE - 100 - 100 - Average Latencyetcd: RANGE - 100 - 100etcd: RANGE - 500 - 100 - Average Latencyetcd: RANGE - 500 - 100etcd: RANGE - 50 - 100 - Average Latencyetcd: RANGE - 50 - 100etcd: PUT - 500 - 100 - Average Latencyetcd: PUT - 500 - 100etcd: PUT - 100 - 100 - Average Latencyetcd: PUT - 100 - 100etcd: PUT - 50 - 100 - Average Latencyetcd: PUT - 50 - 100couchdb: 300 - 1000 - 30spark: 40000000 - 2000 - Broadcast Inner Join Test Timespark: 40000000 - 2000 - Inner Join Test Timespark: 40000000 - 2000 - Repartition Test Timespark: 40000000 - 2000 - Group By Test Timespark: 40000000 - 2000 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 2000 - Calculate Pi Benchmarkspark: 40000000 - 2000 - SHA-512 Benchmark Timeselenium: Kraken - Firefoxmemtier-benchmark: Redis - 50 - 5:1apache: 100renaissance: Akka Unbalanced Cobwebbed Treerenaissance: ALS Movie Lensselenium: WASM imageConvolute - Firefoxcouchdb: 100 - 3000 - 30stargate: 192000 - 512stress-ng: Context Switchingstress-ng: Futexwireguard: memtier-benchmark: Redis - 500 - 5:1cassandra: Writessqlite-speedtest: Timed Time - Size 1,000stargate: 96000 - 512spark: 10000000 - 100 - Broadcast Inner Join Test Timespark: 10000000 - 100 - Inner Join Test Timespark: 10000000 - 100 - Repartition Test Timespark: 10000000 - 100 - Group By Test Timespark: 10000000 - 100 - Calculate Pi Benchmark Using Dataframespark: 10000000 - 100 - Calculate Pi Benchmarkspark: 10000000 - 100 - SHA-512 Benchmark Timekeydb: apache: 1000selenium: Speedometer - Firefoxmemtier-benchmark: Redis - 500 - 1:10renaissance: Genetic Algorithm Using Jenetics + Futuresnginx: 100nginx: 1000nginx: 200apache: 500nginx: 500nginx: 1apache: 200nginx: 20stress-ng: Glibc C String Functionsapache: 20apache: 1redis: GET - 1000selenium: PSPDFKit WASM - Firefoxpostmark: Disk Transaction Performanceselenium: WASM collisionDetection - Firefoxstargate: 480000 - 512redis: GET - 50renaissance: Apache Spark ALSmemtier-benchmark: Redis - 50 - 1:10dragonflydb: 200 - 1:5sockperf: Latency Under Loaddragonflydb: 200 - 5:1dragonflydb: 50 - 1:5dragonflydb: 50 - 5:1renaissance: Rand Forestbuild-python: Released Build, PGO + LTO Optimizedstargate: 192000 - 1024renaissance: Savina Reactors.IOcouchdb: 100 - 1000 - 30build-godot: Time To Compilenode-web-tooling: etcd: PUT - 500 - 1000 - Average Latencyetcd: PUT - 500 - 1000etcd: RANGE - 100 - 1000 - Average Latencyetcd: RANGE - 100 - 1000etcd: RANGE - 500 - 1000 - Average Latencyetcd: RANGE - 500 - 1000etcd: PUT - 100 - 1000 - Average Latencyetcd: PUT - 100 - 1000stargate: 480000 - 1024etcd: RANGE - 50 - 1000 - Average Latencyetcd: RANGE - 50 - 1000etcd: PUT - 50 - 1000 - Average Latencyetcd: PUT - 50 - 1000selenium: Kraken - Google Chromerenaissance: Scala Dottyredis: SET - 1000stress-ng: Forkingavifenc: 2renaissance: In-Memory Database Shootoutlibreoffice: 20 Documents To PDFstargate: 96000 - 1024etcpak: Single-Threaded - ETC2rawtherapee: Total Benchmark Timewebp: Quality 100, Losslessrenaissance: Finagle HTTP Requestsselenium: Speedometer - Google Chromeastcenc: Exhaustiveselenium: ARES-6 - Google Chromestress-ng: Mallocstress-ng: NUMAstress-ng: Atomicstress-ng: IO_uringstress-ng: MMAPstress-ng: CPU Cachestress-ng: Memory Copyingstress-ng: Matrix Mathstress-ng: Cryptostress-ng: MEMFDstress-ng: System V Message Passingstress-ng: Glibc Qsort Data Sortingstress-ng: Socket Activitystress-ng: Vector Mathstress-ng: Semaphoresstress-ng: CPU Stressstress-ng: SENDFILEaom-av1: Speed 6 Realtime - Bosphorus 1080pselenium: PSPDFKit WASM - Google Chromerenaissance: Apache Spark Bayesaom-av1: Speed 10 Realtime - Bosphorus 4Kbuild-mesa: Time To Compiledacapobench: Tradesoapaom-av1: Speed 6 Realtime - Bosphorus 4Kavifenc: 6, Losslessselenium: WASM imageConvolute - Google Chromeredis: SET - 50dacapobench: H2astcenc: Thoroughosbench: Create Filesosbench: Memory Allocationsinkscape: SVG Files To PNGosbench: Create Threadssockperf: Latency Ping Pongsockperf: Throughputdacapobench: Jythonaom-av1: Speed 10 Realtime - Bosphorus 1080paom-av1: Speed 9 Realtime - Bosphorus 1080pcompilebench: Compileselenium: WASM collisionDetection - Google Chromeaom-av1: Speed 8 Realtime - Bosphorus 4Kaom-av1: Speed 9 Realtime - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Koctave-benchmark: node-express-loadtest: webp: Quality 100, Highest Compressiondacapobench: Tradebeansastcenc: Mediumaom-av1: Speed 8 Realtime - Bosphorus 1080posbench: Launch Programsosbench: Create Processeswebp: Quality 100svt-av1: Preset 10 - Bosphorus 4Kavifenc: 6build-python: Defaultsvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 1080petcpak: Multi-Threaded - ETC2svt-av1: Preset 10 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 1080pwebp: Defaultcompilebench: Read Compiled Treecompilebench: Initial CreateDefaultmitigations=off317.2011024.6155.8524.32153.9190.8826.226.055.175.003.9461.308.201994.6321.77319.07303.7419.1223.1022.5018.9517.393.9561.4527.786.914542.26146.914568.29866.914547.89206.914582.53146.914602.04096.814584.705521.1122.0518.3513.773.9561.2227.04514.43279563.15123418.899433.78175.117.84.1040488609494.144618271.48145.7223126487.1428039435.4496.2753955.985.915.094.773.9361.088.17910607.57110364.89282.93697260.041012.6424682.85430269.40429260.88113815.06433407.24169849.10125346.58419795.963475407.49102083.6022291.065397659.221229743244.98.3347515299186.21991.53716582.935515158.5510.6935117091.795558979.575070283.80376.0180.4444.4616913913.054.50620.1311.587071.832211.487532.257011.487648.842811.388116.15128.77947611.388697.526111.289196.1565361.3442.24273245.9497123.3439.6752185.24.5636.628849373.43533.5242.212270.63681.70547.5340205432.14699.91209734.396825.93388.43193.945603.53118389.8640878.621432.0310870267.40337.8330459.23139690.543536120.5350863.93499481.4396.392513837.578.5823.131175752.426.15918.064313932.7180517.175010.39918053.09375114.5008.5035961.66511297532309150.78149.683332.95216.3464.8978.8580.3624.505135395.161610142.2585127.6624.78679020.42293616.71145.8584.19612.268204.299209.7076812.168459.811710.4745213.45936.39298.6471016.7155.3523.61881.2174.7226.316.445.355.104.2471.508.572140.1305.09304.61290.9021.2623.8923.0019.3318.314.2171.7129.326.814640.36466.814633.04046.814688.50806.814670.66566.814643.69976.814698.2044275.34121.7622.6118.5914.144.1372.0727.18552.83177445.46128378.219497.68436.918.8178.4033.3059988996769.014361845.48140.0943037465.1027220038.3465.1545646.136.205.224.944.1970.908.40919167.97115043.372703585844.881115.7400478.08402984.03404114.42112654.69402257.45176792.21140186.92405215.153528137.9597470.0721833.555051291.822059854242.67.4310315069012.272160.03660165.375377398.1810.3504960019.225332063.704865733.35420.3190.3473.8002464752.358.43655.87218.8911.388761.795111.289366.780711.289621.865511.189610.96418.04912811.189807.527011.189645.5253375.9519.54108606.2595164.2840.1422296.04.7895.823556369.78435.3172.132264.93461.69928.4841479769.35711.73209049.746865.56387.00185.395566.58118258.6340881.481400.7811002040.14338.1930491.44139254.753547350.6151643.49632415.4795.542546845.975.6524.230181549.876.37025.753808391.3190717.07859.26119952.15218915.5748.2317991.48312424762498144.52146.023325.55215.9061.8374.9479.3604.811130305.171700139.7409119.8226.15610820.21630615.99140.6924.44613.33202.022204.7526736.040445.536695.89827.134646.37971.09OpenBenchmarking.org

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream 2 - Browser: Google ChromeDefaultmitigations=off70140210280350SE +/- 1.68, N = 3SE +/- 3.27, N = 12317.20298.651. chrome 104.0.5112.101

LuaRadio

LuaRadio is a lightweight software-defined radio (SDR) framework built atop LuaJIT. LuaRadio provides a suite of source, sink, and processing blocks, with a simple API for defining flow graphs, running flow graphs, creating blocks, and creating data types. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterLuaRadio 0.9.1Test: Complex PhaseDefaultmitigations=off2004006008001000SE +/- 4.34, N = 3SE +/- 2.70, N = 91024.61016.7

OpenBenchmarking.orgMiB/s, More Is BetterLuaRadio 0.9.1Test: Hilbert TransformDefaultmitigations=off306090120150SE +/- 0.44, N = 3SE +/- 0.30, N = 9155.8155.3

OpenBenchmarking.orgMiB/s, More Is BetterLuaRadio 0.9.1Test: FM Deemphasis FilterDefaultmitigations=off110220330440550SE +/- 0.41, N = 3SE +/- 1.09, N = 9524.3523.6

OpenBenchmarking.orgMiB/s, More Is BetterLuaRadio 0.9.1Test: Five Back to Back FIR FiltersDefaultmitigations=off5001000150020002500SE +/- 11.81, N = 3SE +/- 21.48, N = 92153.91881.2

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream 2 - Browser: FirefoxDefaultmitigations=off4080120160200SE +/- 1.91, N = 3SE +/- 1.37, N = 12190.88174.721. firefox 103.0.2

Apache Spark

This is a benchmark of Apache Spark with its PySpark interface. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmars the Apache Spark in a single-system configuration using spark-submit. The test makes use of DIYBigData's pyspark-benchmark (https://github.com/DIYBigData/pyspark-benchmark/) for generating of test data and various Apache Spark operations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Broadcast Inner Join Test TimeDefaultmitigations=off246810SE +/- 0.06, N = 3SE +/- 0.04, N = 156.226.31

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Inner Join Test TimeDefaultmitigations=off246810SE +/- 0.02, N = 3SE +/- 0.04, N = 156.056.44

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Repartition Test TimeDefaultmitigations=off1.20382.40763.61144.81526.019SE +/- 0.01, N = 3SE +/- 0.03, N = 155.175.35

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Group By Test TimeDefaultmitigations=off1.14752.2953.44254.595.7375SE +/- 0.08, N = 3SE +/- 0.04, N = 155.005.10

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeDefaultmitigations=off0.9541.9082.8623.8164.77SE +/- 0.02, N = 3SE +/- 0.03, N = 153.944.24

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - Calculate Pi BenchmarkDefaultmitigations=off1632486480SE +/- 0.33, N = 3SE +/- 0.15, N = 1561.3071.50

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 2000 - SHA-512 Benchmark TimeDefaultmitigations=off246810SE +/- 0.01, N = 3SE +/- 0.08, N = 158.208.57

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Apache Spark PageRankDefaultmitigations=off5001000150020002500SE +/- 13.14, N = 14SE +/- 19.68, N = 151994.62140.1MIN: 1784.01 / MAX: 2135.6MIN: 1776.57 / MAX: 2436.19

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all queries performed. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Third RunDefaultmitigations=off70140210280350SE +/- 1.47, N = 14SE +/- 1.67, N = 15321.77305.09MIN: 20.53 / MAX: 60000MIN: 20.51 / MAX: 600001. ClickHouse server version 22.5.4.19 (official build).

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Second RunDefaultmitigations=off70140210280350SE +/- 1.52, N = 14SE +/- 2.28, N = 15319.07304.61MIN: 20.95 / MAX: 60000MIN: 20.76 / MAX: 600001. ClickHouse server version 22.5.4.19 (official build).

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, First Run / Cold CacheDefaultmitigations=off70140210280350SE +/- 2.08, N = 14SE +/- 1.95, N = 15303.74290.90MIN: 17.71 / MAX: 30000MIN: 18.39 / MAX: 300001. ClickHouse server version 22.5.4.19 (official build).

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: FirefoxDefaultmitigations=off510152025SE +/- 0.06, N = 3SE +/- 0.46, N = 919.1221.261. firefox 103.0.2

Apache Spark

This is a benchmark of Apache Spark with its PySpark interface. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmars the Apache Spark in a single-system configuration using spark-submit. The test makes use of DIYBigData's pyspark-benchmark (https://github.com/DIYBigData/pyspark-benchmark/) for generating of test data and various Apache Spark operations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Broadcast Inner Join Test TimeDefaultmitigations=off612182430SE +/- 0.20, N = 3SE +/- 0.20, N = 623.1023.89

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Inner Join Test TimeDefaultmitigations=off612182430SE +/- 0.09, N = 3SE +/- 0.19, N = 622.5023.00

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Repartition Test TimeDefaultmitigations=off510152025SE +/- 0.23, N = 3SE +/- 0.12, N = 618.9519.33

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Group By Test TimeDefaultmitigations=off510152025SE +/- 0.11, N = 3SE +/- 0.10, N = 617.3918.31

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeDefaultmitigations=off0.94731.89462.84193.78924.7365SE +/- 0.02, N = 3SE +/- 0.05, N = 63.954.21

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - Calculate Pi BenchmarkDefaultmitigations=off1632486480SE +/- 0.44, N = 3SE +/- 0.21, N = 661.4571.71

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 100 - SHA-512 Benchmark TimeDefaultmitigations=off714212835SE +/- 0.19, N = 3SE +/- 0.28, N = 627.7829.32

etcd

Etcd is a distributed, reliable key-value store intended for critical data of a distributed system. Etcd is written in Golang and part of the Cloud Native Computing Foundation (CNCF) and used by Kubernetes, Rook, CoreDNS, and other open-source software. This test profile uses Etcd's built-in benchmark to stress the PUT and RANGE performance of a single node / local system. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 100 - Average Latencymitigations=offDefault246810SE +/- 0.00, N = 3SE +/- 0.03, N = 36.86.9

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 100mitigations=offDefault3K6K9K12K15KSE +/- 21.07, N = 3SE +/- 39.44, N = 314640.3614542.26

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 100 - Average Latencymitigations=offDefault246810SE +/- 0.03, N = 3SE +/- 0.03, N = 36.86.9

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 100mitigations=offDefault3K6K9K12K15KSE +/- 30.24, N = 3SE +/- 37.35, N = 314633.0414568.30

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 50 - Clients: 100 - Average Latencymitigations=offDefault246810SE +/- 0.00, N = 3SE +/- 0.03, N = 36.86.9

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 50 - Clients: 100mitigations=offDefault3K6K9K12K15KSE +/- 6.63, N = 3SE +/- 38.39, N = 314688.5114547.89

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 100 - Average Latencymitigations=offDefault246810SE +/- 0.00, N = 3SE +/- 0.03, N = 36.86.9

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 100mitigations=offDefault3K6K9K12K15KSE +/- 24.92, N = 3SE +/- 22.11, N = 314670.6714582.53

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 100 - Average Latencymitigations=offDefault246810SE +/- 0.00, N = 3SE +/- 0.03, N = 36.86.9

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 100mitigations=offDefault3K6K9K12K15KSE +/- 5.59, N = 3SE +/- 23.60, N = 314643.7014602.04

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 50 - Clients: 100 - Average LatencyDefaultmitigations=off246810SE +/- 0.03, N = 3SE +/- 0.00, N = 36.86.8

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 50 - Clients: 100mitigations=offDefault3K6K9K12K15KSE +/- 6.43, N = 3SE +/- 25.48, N = 314698.2014584.71

Apache CouchDB

This is a bulk insertion benchmark of Apache CouchDB. CouchDB is a document-oriented NoSQL database implemented in Erlang. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.2.2Bulk Size: 300 - Inserts: 1000 - Rounds: 30mitigations=off60120180240300SE +/- 1.74, N = 3275.341. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Apache Spark

This is a benchmark of Apache Spark with its PySpark interface. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmars the Apache Spark in a single-system configuration using spark-submit. The test makes use of DIYBigData's pyspark-benchmark (https://github.com/DIYBigData/pyspark-benchmark/) for generating of test data and various Apache Spark operations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Broadcast Inner Join Test TimeDefaultmitigations=off510152025SE +/- 0.07, N = 6SE +/- 0.10, N = 321.1121.76

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Inner Join Test TimeDefaultmitigations=off510152025SE +/- 0.17, N = 6SE +/- 0.10, N = 322.0522.61

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Repartition Test TimeDefaultmitigations=off510152025SE +/- 0.08, N = 6SE +/- 0.03, N = 318.3518.59

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Group By Test TimeDefaultmitigations=off48121620SE +/- 0.12, N = 6SE +/- 0.18, N = 313.7714.14

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Calculate Pi Benchmark Using DataframeDefaultmitigations=off0.92931.85862.78793.71724.6465SE +/- 0.01, N = 6SE +/- 0.01, N = 33.954.13

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - Calculate Pi BenchmarkDefaultmitigations=off1632486480SE +/- 0.22, N = 6SE +/- 0.37, N = 361.2272.07

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 2000 - SHA-512 Benchmark TimeDefaultmitigations=off612182430SE +/- 0.27, N = 6SE +/- 0.28, N = 327.0427.18

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: FirefoxDefaultmitigations=off120240360480600SE +/- 1.69, N = 3SE +/- 9.72, N = 15514.4552.81. firefox 103.0.2

memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 5:1Defaultmitigations=off700K1400K2100K2800K3500KSE +/- 26331.46, N = 9SE +/- 24377.79, N = 103279563.153177445.461. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Apache HTTP Server

This is a test of the Apache HTTPD web server. This Apache HTTPD web server benchmark test profile makes use of the Golang "Bombardier" program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 100mitigations=offDefault30K60K90K120K150KSE +/- 1410.86, N = 5SE +/- 975.13, N = 9128378.21123418.891. (CC) gcc options: -shared -fPIC -O2

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Akka Unbalanced Cobwebbed TreeDefaultmitigations=off2K4K6K8K10KSE +/- 134.48, N = 3SE +/- 44.45, N = 39433.79497.6MIN: 6975.05 / MAX: 9691.08MIN: 7104 / MAX: 9582.77

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: ALS Movie LensDefaultmitigations=off2K4K6K8K10KSE +/- 29.54, N = 3SE +/- 18.71, N = 38175.18436.9MIN: 8137.63 / MAX: 8971.05MIN: 8407.35 / MAX: 9192.26

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM imageConvolute - Browser: FirefoxDefaultmitigations=off510152025SE +/- 0.06, N = 3SE +/- 0.35, N = 1517.818.81. firefox 103.0.2

Apache CouchDB

This is a bulk insertion benchmark of Apache CouchDB. CouchDB is a document-oriented NoSQL database implemented in Erlang. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.2.2Bulk Size: 100 - Inserts: 3000 - Rounds: 30mitigations=off4080120160200SE +/- 0.49, N = 3178.401. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Stargate Digital Audio Workstation

Stargate is an open-source, cross-platform digital audio workstation (DAW) software package with "a unique and carefully curated experience" with scalability from old systems up through modern multi-core systems. Stargate is GPLv3 licensed and makes use of Qt5 (PyQt5) for its user-interface. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 21.10.9Sample Rate: 192000 - Buffer Size: 512Defaultmitigations=off0.92341.84682.77023.69364.617SE +/- 0.015230, N = 3SE +/- 0.040051, N = 154.1040483.3059981. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Context Switchingmitigations=offDefault2M4M6M8M10MSE +/- 281917.42, N = 15SE +/- 147900.24, N = 158996769.018609494.141. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: FutexDefaultmitigations=off1000K2000K3000K4000K5000KSE +/- 30447.18, N = 14SE +/- 45471.57, N = 154618271.484361845.481. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

WireGuard + Linux Networking Stack Stress Test

This is a benchmark of the WireGuard secure VPN tunnel and Linux networking stack stress test. The test runs on the local host but does require root permissions to run. The way it works is it creates three namespaces. ns0 has a loopback device. ns1 and ns2 each have wireguard devices. Those two wireguard devices send traffic through the loopback device of ns0. The end result of this is that tests wind up testing encryption and decryption at the same time -- a pretty CPU and scheduler-heavy workflow. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterWireGuard + Linux Networking Stack Stress Testmitigations=offDefault306090120150SE +/- 0.68, N = 3SE +/- 0.95, N = 3140.09145.72

memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 5:1Defaultmitigations=off700K1400K2100K2800K3500KSE +/- 3950.72, N = 2SE +/- 51258.35, N = 23126487.143037465.101. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Apache Cassandra

This is a benchmark of the Apache Cassandra NoSQL database management system making use of cassandra-stress. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.0Test: WritesDefaultmitigations=off60K120K180K240K300KSE +/- 1661.01, N = 3SE +/- 1172.13, N = 3280394272200

SQLite Speedtest

This is a benchmark of SQLite's speedtest1 benchmark program with an increased problem size of 1,000. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000Defaultmitigations=off918273645SE +/- 0.15, N = 3SE +/- 0.63, N = 1535.4538.351. (CC) gcc options: -O3 -march=native -lz

Stargate Digital Audio Workstation

Stargate is an open-source, cross-platform digital audio workstation (DAW) software package with "a unique and carefully curated experience" with scalability from old systems up through modern multi-core systems. Stargate is GPLv3 licensed and makes use of Qt5 (PyQt5) for its user-interface. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 21.10.9Sample Rate: 96000 - Buffer Size: 512Defaultmitigations=off246810SE +/- 0.020298, N = 3SE +/- 0.047140, N = 156.2753955.1545641. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Apache Spark

This is a benchmark of Apache Spark with its PySpark interface. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmars the Apache Spark in a single-system configuration using spark-submit. The test makes use of DIYBigData's pyspark-benchmark (https://github.com/DIYBigData/pyspark-benchmark/) for generating of test data and various Apache Spark operations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Broadcast Inner Join Test TimeDefaultmitigations=off246810SE +/- 0.08, N = 3SE +/- 0.11, N = 35.986.13

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Inner Join Test TimeDefaultmitigations=off246810SE +/- 0.04, N = 3SE +/- 0.22, N = 35.916.20

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Repartition Test TimeDefaultmitigations=off1.17452.3493.52354.6985.8725SE +/- 0.04, N = 3SE +/- 0.03, N = 35.095.22

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Group By Test TimeDefaultmitigations=off1.11152.2233.33454.4465.5575SE +/- 0.04, N = 3SE +/- 0.03, N = 34.774.94

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeDefaultmitigations=off0.94281.88562.82843.77124.714SE +/- 0.01, N = 3SE +/- 0.07, N = 33.934.19

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - Calculate Pi BenchmarkDefaultmitigations=off1632486480SE +/- 0.12, N = 3SE +/- 0.35, N = 361.0870.90

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 10000000 - Partitions: 100 - SHA-512 Benchmark TimeDefaultmitigations=off246810SE +/- 0.03, N = 3SE +/- 0.08, N = 38.178.40

KeyDB

A benchmark of KeyDB as a multi-threaded fork of the Redis server. The KeyDB benchmark is conducted using memtier-benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterKeyDB 6.2.0mitigations=offDefault200K400K600K800K1000KSE +/- 1238.56, N = 3SE +/- 3502.42, N = 3919167.97910607.571. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Apache HTTP Server

This is a test of the Apache HTTPD web server. This Apache HTTPD web server benchmark test profile makes use of the Golang "Bombardier" program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 1000mitigations=offDefault20K40K60K80K100KSE +/- 256.55, N = 3SE +/- 856.60, N = 3115043.37110364.891. (CC) gcc options: -shared -fPIC -O2

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: FirefoxDefaultmitigations=off60120180240300SE +/- 2.23, N = 3SE +/- 2.85, N = 3282.9270.01. firefox 103.0.2

memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:10Defaultmitigations=off800K1600K2400K3200K4000KSE +/- 31377.63, N = 33697260.043585844.881. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Genetic Algorithm Using Jenetics + FuturesDefaultmitigations=off2004006008001000SE +/- 1.29, N = 3SE +/- 10.39, N = 71012.61115.7MIN: 955.46 / MAX: 1061.51MIN: 1001.52 / MAX: 1224.17

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the Golang "Bombardier" program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 100Defaultmitigations=off90K180K270K360K450KSE +/- 844.43, N = 3SE +/- 549.01, N = 3424682.85400478.081. (CC) gcc options: -lcrypt -lz -O3 -march=native

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 1000Defaultmitigations=off90K180K270K360K450KSE +/- 617.27, N = 3SE +/- 1022.93, N = 3430269.40402984.031. (CC) gcc options: -lcrypt -lz -O3 -march=native

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 200Defaultmitigations=off90K180K270K360K450KSE +/- 976.29, N = 3SE +/- 1340.19, N = 3429260.88404114.421. (CC) gcc options: -lcrypt -lz -O3 -march=native

Apache HTTP Server

This is a test of the Apache HTTPD web server. This Apache HTTPD web server benchmark test profile makes use of the Golang "Bombardier" program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 500Defaultmitigations=off20K40K60K80K100KSE +/- 1138.19, N = 3SE +/- 1089.69, N = 3113815.06112654.691. (CC) gcc options: -shared -fPIC -O2

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the Golang "Bombardier" program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 500Defaultmitigations=off90K180K270K360K450KSE +/- 901.08, N = 3SE +/- 188.11, N = 3433407.24402257.451. (CC) gcc options: -lcrypt -lz -O3 -march=native

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 1mitigations=offDefault40K80K120K160K200KSE +/- 356.79, N = 3SE +/- 267.57, N = 3176792.21169849.101. (CC) gcc options: -lcrypt -lz -O3 -march=native

Apache HTTP Server

This is a test of the Apache HTTPD web server. This Apache HTTPD web server benchmark test profile makes use of the Golang "Bombardier" program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 200mitigations=offDefault30K60K90K120K150KSE +/- 241.92, N = 3SE +/- 255.30, N = 3140186.92125346.581. (CC) gcc options: -shared -fPIC -O2

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the Golang "Bombardier" program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 20Defaultmitigations=off90K180K270K360K450KSE +/- 662.20, N = 3SE +/- 1000.16, N = 3419795.96405215.151. (CC) gcc options: -lcrypt -lz -O3 -march=native

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Glibc C String Functionsmitigations=offDefault800K1600K2400K3200K4000KSE +/- 42395.40, N = 3SE +/- 72394.51, N = 153528137.953475407.491. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

Apache HTTP Server

This is a test of the Apache HTTPD web server. This Apache HTTPD web server benchmark test profile makes use of the Golang "Bombardier" program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 20Defaultmitigations=off20K40K60K80K100KSE +/- 207.37, N = 3SE +/- 210.36, N = 3102083.6097470.071. (CC) gcc options: -shared -fPIC -O2

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 1Defaultmitigations=off5K10K15K20K25KSE +/- 210.47, N = 3SE +/- 135.56, N = 322291.0621833.551. (CC) gcc options: -shared -fPIC -O2

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 1000Defaultmitigations=off1.2M2.4M3.6M4.8M6MSE +/- 97289.02, N = 15SE +/- 99784.12, N = 155397659.25051291.81. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3 -march=native -mno-avx512f

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, Fewer Is BetterSeleniumBenchmark: PSPDFKit WASM - Browser: FirefoxDefaultmitigations=off5001000150020002500SE +/- 5.78, N = 3SE +/- 26.81, N = 3212222051. firefox 103.0.2

PostMark

This is a test of NetApp's PostMark benchmark designed to simulate small-file testing similar to the tasks endured by web and mail servers. This test profile will set PostMark to perform 25,000 transactions with 500 files simultaneously with the file sizes ranging between 5 and 512 kilobytes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction Performancemitigations=offDefault2K4K6K8K10KSE +/- 90.43, N = 15SE +/- 128.33, N = 3985497431. (CC) gcc options: -O3

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: Firefoxmitigations=offDefault50100150200250SE +/- 2.87, N = 3SE +/- 0.68, N = 3242.6244.91. firefox 103.0.2

Stargate Digital Audio Workstation

Stargate is an open-source, cross-platform digital audio workstation (DAW) software package with "a unique and carefully curated experience" with scalability from old systems up through modern multi-core systems. Stargate is GPLv3 licensed and makes use of Qt5 (PyQt5) for its user-interface. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 21.10.9Sample Rate: 480000 - Buffer Size: 512Defaultmitigations=off246810SE +/- 0.095553, N = 3SE +/- 0.070345, N = 158.3347517.4310311. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 50Defaultmitigations=off1.1M2.2M3.3M4.4M5.5MSE +/- 78465.95, N = 15SE +/- 101294.99, N = 125299186.205069012.271. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3 -march=native -mno-avx512f

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Apache Spark ALSDefaultmitigations=off5001000150020002500SE +/- 12.03, N = 3SE +/- 1.48, N = 31991.52160.0MIN: 1891.06 / MAX: 2108.64MIN: 2079.25 / MAX: 2293.34

memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10Defaultmitigations=off800K1600K2400K3200K4000KSE +/- 24092.80, N = 3SE +/- 23947.78, N = 33716582.933660165.371. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Dragonfly is an open-source database server that is a "modern Redis replacement" that aims to be the fastest memory store while being compliant with the Redis and Memcached protocols. For benchmarking Dragonfly, Memtier_benchmark is used as a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:5Defaultmitigations=off1.2M2.4M3.6M4.8M6MSE +/- 24798.42, N = 3SE +/- 11508.95, N = 35515158.555377398.181. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Sockperf

This is a network socket API performance benchmark developed by Mellanox. This test profile runs both the client and server on the local host for evaluating individual system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.7Test: Latency Under Loadmitigations=offDefault3691215SE +/- 0.20, N = 25SE +/- 0.11, N = 2510.3510.691. (CXX) g++ options: --param -O3 -rdynamic

Dragonflydb

Dragonfly is an open-source database server that is a "modern Redis replacement" that aims to be the fastest memory store while being compliant with the Redis and Memcached protocols. For benchmarking Dragonfly, Memtier_benchmark is used as a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 5:1Defaultmitigations=off1.1M2.2M3.3M4.4M5.5MSE +/- 8181.85, N = 3SE +/- 8153.62, N = 35117091.794960019.221. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:5Defaultmitigations=off1.2M2.4M3.6M4.8M6MSE +/- 4321.86, N = 3SE +/- 17198.62, N = 35558979.575332063.701. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 5:1Defaultmitigations=off1.1M2.2M3.3M4.4M5.5MSE +/- 8314.52, N = 3SE +/- 19999.86, N = 35070283.804865733.351. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Random ForestDefaultmitigations=off90180270360450SE +/- 1.64, N = 3SE +/- 3.53, N = 15376.0420.3MIN: 350.32 / MAX: 454.49MIN: 351.41 / MAX: 559.21

Timed CPython Compilation

This test times how long it takes to build the reference Python implementation, CPython, with optimizations and LTO enabled for a release build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration: Released Build, PGO + LTO OptimizedDefaultmitigations=off4080120160200180.44190.35

Stargate Digital Audio Workstation

Stargate is an open-source, cross-platform digital audio workstation (DAW) software package with "a unique and carefully curated experience" with scalability from old systems up through modern multi-core systems. Stargate is GPLv3 licensed and makes use of Qt5 (PyQt5) for its user-interface. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 21.10.9Sample Rate: 192000 - Buffer Size: 1024Defaultmitigations=off1.00392.00783.01174.01565.0195SE +/- 0.019248, N = 3SE +/- 0.044343, N = 44.4616913.8002461. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

Benchmark: StyleBench - Browser: Firefox

Default: The test quit with a non-zero exit status. E: ERROR: test_untitled_test_case (__main__.UntitledTestCase)

mitigations=off: The test quit with a non-zero exit status. E: ERROR: test_untitled_test_case (__main__.UntitledTestCase)

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Savina Reactors.IODefaultmitigations=off10002000300040005000SE +/- 11.23, N = 3SE +/- 31.38, N = 33913.04752.3MIN: 3898.09 / MAX: 5382.47MIN: 4716.25 / MAX: 7467.29

Apache CouchDB

This is a bulk insertion benchmark of Apache CouchDB. CouchDB is a document-oriented NoSQL database implemented in Erlang. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.2.2Bulk Size: 100 - Inserts: 1000 - Rounds: 30mitigations=off1326395265SE +/- 0.32, N = 358.441. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To CompileDefaultmitigations=off1326395265SE +/- 0.05, N = 3SE +/- 0.39, N = 354.5155.87

Node.js V8 Web Tooling Benchmark

Running the V8 project's Web-Tooling-Benchmark under Node.js. The Web-Tooling-Benchmark stresses JavaScript-related workloads common to web developers like Babel and TypeScript and Babylon. This test profile can test the system's JavaScript performance with Node.js. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgruns/s, More Is BetterNode.js V8 Web Tooling BenchmarkDefaultmitigations=off510152025SE +/- 0.23, N = 3SE +/- 0.13, N = 320.1318.89

etcd

Etcd is a distributed, reliable key-value store intended for critical data of a distributed system. Etcd is written in Golang and part of the Cloud Native Computing Foundation (CNCF) and used by Kubernetes, Rook, CoreDNS, and other open-source software. This test profile uses Etcd's built-in benchmark to stress the PUT and RANGE performance of a single node / local system. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 1000 - Average Latencymitigations=offDefault3691215SE +/- 0.07, N = 3SE +/- 0.06, N = 311.311.5

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 1000mitigations=offDefault20K40K60K80K100KSE +/- 460.91, N = 3SE +/- 401.22, N = 388761.8087071.83

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 1000 - Average Latencymitigations=offDefault3691215SE +/- 0.00, N = 3SE +/- 0.06, N = 311.211.4

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 1000mitigations=offDefault20K40K60K80K100KSE +/- 76.47, N = 3SE +/- 488.77, N = 389366.7887532.26

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 1000 - Average Latencymitigations=offDefault3691215SE +/- 0.03, N = 3SE +/- 0.06, N = 311.211.4

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 1000mitigations=offDefault20K40K60K80K100KSE +/- 293.36, N = 3SE +/- 485.80, N = 389621.8787648.84

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 1000 - Average Latencymitigations=offDefault3691215SE +/- 0.03, N = 3SE +/- 0.07, N = 311.111.3

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 1000mitigations=offDefault20K40K60K80K100KSE +/- 264.02, N = 3SE +/- 530.54, N = 389610.9688116.15

Stargate Digital Audio Workstation

Stargate is an open-source, cross-platform digital audio workstation (DAW) software package with "a unique and carefully curated experience" with scalability from old systems up through modern multi-core systems. Stargate is GPLv3 licensed and makes use of Qt5 (PyQt5) for its user-interface. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 21.10.9Sample Rate: 480000 - Buffer Size: 1024Defaultmitigations=off246810SE +/- 0.017950, N = 3SE +/- 0.058951, N = 118.7794768.0491281. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

etcd

Etcd is a distributed, reliable key-value store intended for critical data of a distributed system. Etcd is written in Golang and part of the Cloud Native Computing Foundation (CNCF) and used by Kubernetes, Rook, CoreDNS, and other open-source software. This test profile uses Etcd's built-in benchmark to stress the PUT and RANGE performance of a single node / local system. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 50 - Clients: 1000 - Average Latencymitigations=offDefault3691215SE +/- 0.03, N = 3SE +/- 0.03, N = 311.111.3

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 50 - Clients: 1000mitigations=offDefault20K40K60K80K100KSE +/- 198.87, N = 3SE +/- 336.01, N = 389807.5388697.53

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 50 - Clients: 1000 - Average Latencymitigations=offDefault3691215SE +/- 0.03, N = 3SE +/- 0.06, N = 311.111.2

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 50 - Clients: 1000mitigations=offDefault20K40K60K80K100KSE +/- 391.70, N = 3SE +/- 306.00, N = 389645.5389196.16

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: Google ChromeDefaultmitigations=off80160240320400SE +/- 0.48, N = 3SE +/- 2.76, N = 15361.3375.91. chrome 104.0.5112.101

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Scala DottyDefaultmitigations=off110220330440550SE +/- 2.69, N = 3SE +/- 5.26, N = 5442.2519.5MIN: 372.16 / MAX: 760.85MIN: 365.75 / MAX: 817.55

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 1000Defaultmitigations=off900K1800K2700K3600K4500KSE +/- 75184.71, N = 12SE +/- 36192.49, N = 34273245.944108606.251. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3 -march=native -mno-avx512f

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: ForkingDefaultmitigations=off20K40K60K80K100KSE +/- 966.75, N = 5SE +/- 943.06, N = 397123.3495164.281. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.10Encoder Speed: 2Defaultmitigations=off918273645SE +/- 0.03, N = 3SE +/- 0.08, N = 339.6840.141. (CXX) g++ options: -O3 -fPIC -lm

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: In-Memory Database ShootoutDefaultmitigations=off5001000150020002500SE +/- 30.21, N = 3SE +/- 29.23, N = 32185.22296.0MIN: 1929.28 / MAX: 2521.14MIN: 2067.93 / MAX: 2567.45

LibreOffice

Various benchmarking operations with the LibreOffice open-source office suite. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterLibreOfficeTest: 20 Documents To PDFDefaultmitigations=off1.07752.1553.23254.315.3875SE +/- 0.022, N = 25SE +/- 0.051, N = 254.5634.7891. LibreOffice 7.3.5.2 30(Build:2)

Stargate Digital Audio Workstation

Stargate is an open-source, cross-platform digital audio workstation (DAW) software package with "a unique and carefully curated experience" with scalability from old systems up through modern multi-core systems. Stargate is GPLv3 licensed and makes use of Qt5 (PyQt5) for its user-interface. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 21.10.9Sample Rate: 96000 - Buffer Size: 1024Defaultmitigations=off246810SE +/- 0.011340, N = 3SE +/- 0.066742, N = 46.6288495.8235561. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Etcpak

Etcpack is the self-proclaimed "fastest ETC compressor on the planet" with focused on providing open-source, very fast ETC and S3 texture compression support. The test profile uses a 8K x 8K game texture as a sample input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMpx/s, More Is BetterEtcpak 1.0Benchmark: Single-Threaded - Configuration: ETC2Defaultmitigations=off80160240320400SE +/- 0.22, N = 3SE +/- 3.08, N = 3373.44369.781. (CXX) g++ options: -O3 -march=native -std=c++11 -lpthread

RawTherapee

RawTherapee is a cross-platform, open-source multi-threaded RAW image processing program. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRawTherapeeTotal Benchmark TimeDefaultmitigations=off816243240SE +/- 0.03, N = 3SE +/- 0.08, N = 333.5235.321. RawTherapee, version 5.8, command line.

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, LosslessDefaultmitigations=off0.49730.99461.49191.98922.4865SE +/- 0.01, N = 3SE +/- 0.05, N = 152.212.131. (CC) gcc options: -fvisibility=hidden -O2 -lm

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Finagle HTTP Requestsmitigations=offDefault5001000150020002500SE +/- 25.99, N = 4SE +/- 18.17, N = 32264.92270.6MIN: 2076.9 / MAX: 2395.21MIN: 2124.82 / MAX: 2379.35

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: Google ChromeDefaultmitigations=off80160240320400SE +/- 0.88, N = 3SE +/- 4.06, N = 33683461. chrome 104.0.5112.101

ASTC Encoder

ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ExhaustiveDefaultmitigations=off0.38370.76741.15111.53481.9185SE +/- 0.0031, N = 3SE +/- 0.0029, N = 31.70541.69921. (CXX) g++ options: -O3 -flto -pthread

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: Google ChromeDefaultmitigations=off246810SE +/- 0.06, N = 3SE +/- 0.09, N = 37.538.481. chrome 104.0.5112.101

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Mallocmitigations=offDefault9M18M27M36M45MSE +/- 143135.77, N = 3SE +/- 232062.83, N = 341479769.3540205432.141. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: NUMAmitigations=offDefault150300450600750SE +/- 1.42, N = 3SE +/- 2.75, N = 3711.73699.911. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: AtomicDefaultmitigations=off40K80K120K160K200KSE +/- 120.43, N = 3SE +/- 195.42, N = 3209734.39209049.741. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: IO_uringmitigations=offDefault15003000450060007500SE +/- 8.12, N = 3SE +/- 47.07, N = 36865.566825.931. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: MMAPDefaultmitigations=off80160240320400SE +/- 0.80, N = 3SE +/- 0.46, N = 3388.43387.001. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: CPU CacheDefaultmitigations=off4080120160200SE +/- 1.84, N = 3SE +/- 2.59, N = 3193.94185.391. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Memory CopyingDefaultmitigations=off12002400360048006000SE +/- 17.02, N = 3SE +/- 10.11, N = 35603.535566.581. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Matrix MathDefaultmitigations=off30K60K90K120K150KSE +/- 160.67, N = 3SE +/- 283.59, N = 3118389.86118258.631. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Cryptomitigations=offDefault9K18K27K36K45KSE +/- 56.24, N = 3SE +/- 70.59, N = 340881.4840878.621. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: MEMFDDefaultmitigations=off30060090012001500SE +/- 0.98, N = 3SE +/- 0.99, N = 31432.031400.781. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: System V Message Passingmitigations=offDefault2M4M6M8M10MSE +/- 6894.37, N = 3SE +/- 33464.67, N = 311002040.1410870267.401. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Glibc Qsort Data Sortingmitigations=offDefault70140210280350SE +/- 2.60, N = 3SE +/- 4.60, N = 3338.19337.831. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Socket Activitymitigations=offDefault7K14K21K28K35KSE +/- 155.68, N = 3SE +/- 170.24, N = 330491.4430459.231. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Vector MathDefaultmitigations=off30K60K90K120K150KSE +/- 61.84, N = 3SE +/- 123.38, N = 3139690.54139254.751. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Semaphoresmitigations=offDefault800K1600K2400K3200K4000KSE +/- 378.45, N = 3SE +/- 1841.28, N = 33547350.613536120.531. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: CPU Stressmitigations=offDefault11K22K33K44K55KSE +/- 577.94, N = 3SE +/- 540.81, N = 351643.4950863.931. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: SENDFILEmitigations=offDefault140K280K420K560K700KSE +/- 2275.80, N = 3SE +/- 1502.57, N = 3632415.47499481.431. (CC) gcc options: -O3 -march=native -O2 -std=gnu99 -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lsctp -lz -pthread

AOM AV1

This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 6 Realtime - Input: Bosphorus 1080pDefaultmitigations=off20406080100SE +/- 1.96, N = 12SE +/- 2.01, N = 1596.3995.541. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, Fewer Is BetterSeleniumBenchmark: PSPDFKit WASM - Browser: Google ChromeDefaultmitigations=off5001000150020002500SE +/- 4.58, N = 3SE +/- 11.46, N = 3251325461. chrome 104.0.5112.101

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Apache Spark BayesDefaultmitigations=off2004006008001000SE +/- 1.45, N = 3SE +/- 2.93, N = 3837.5845.9MIN: 621.16 / MAX: 840.4MIN: 620.11 / MAX: 850.27

AOM AV1

This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4KDefaultmitigations=off20406080100SE +/- 0.33, N = 3SE +/- 0.66, N = 1578.5875.651. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

Timed Mesa Compilation

This test profile times how long it takes to compile Mesa with Meson/Ninja. For minimizing build dependencies and avoid versioning conflicts, test this is just the core Mesa build without LLVM or the extra Gallium3D/Mesa drivers enabled. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 21.0Time To CompileDefaultmitigations=off612182430SE +/- 0.02, N = 3SE +/- 0.10, N = 323.1324.23

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradesoapDefaultmitigations=off400800120016002000SE +/- 12.40, N = 20SE +/- 6.80, N = 417571815

AOM AV1

This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4KDefaultmitigations=off1224364860SE +/- 0.62, N = 4SE +/- 0.54, N = 552.4249.871. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.10Encoder Speed: 6, LosslessDefaultmitigations=off246810SE +/- 0.044, N = 3SE +/- 0.054, N = 156.1596.3701. (CXX) g++ options: -O3 -fPIC -lm

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM imageConvolute - Browser: Google ChromeDefaultmitigations=off612182430SE +/- 0.05, N = 3SE +/- 1.26, N = 1518.0625.751. chrome 104.0.5112.101

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 50Defaultmitigations=off900K1800K2700K3600K4500KSE +/- 38150.18, N = 3SE +/- 52423.93, N = 34313932.73808391.31. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3 -march=native -mno-avx512f

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: H2Defaultmitigations=off400800120016002000SE +/- 18.05, N = 6SE +/- 21.66, N = 2018051907

ASTC Encoder

ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ThoroughDefaultmitigations=off48121620SE +/- 0.13, N = 3SE +/- 0.04, N = 317.1817.081. (CXX) g++ options: -O3 -flto -pthread

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create Filesmitigations=offDefault3691215SE +/- 0.074526, N = 15SE +/- 0.009125, N = 39.26119910.3991801. (CC) gcc options: -lm

OpenBenchmarking.orgNs Per Event, Fewer Is BetterOSBenchTest: Memory Allocationsmitigations=offDefault1224364860SE +/- 0.81, N = 15SE +/- 0.10, N = 352.1553.091. (CC) gcc options: -lm

Inkscape

Inkscape is an open-source vector graphics editor. This test profile times how long it takes to complete various operations by Inkscape. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterInkscapeOperation: SVG Files To PNGDefaultmitigations=off48121620SE +/- 0.06, N = 3SE +/- 0.05, N = 314.5015.571. Inkscape 1.1.2 (0a00cf5339, 2022-02-04)

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create Threadsmitigations=offDefault246810SE +/- 0.112448, N = 15SE +/- 0.063265, N = 38.2317998.5035961. (CC) gcc options: -lm

Sockperf

This is a network socket API performance benchmark developed by Mellanox. This test profile runs both the client and server on the local host for evaluating individual system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.7Test: Latency Ping Pongmitigations=offDefault0.37460.74921.12381.49841.873SE +/- 0.015, N = 5SE +/- 0.005, N = 51.4831.6651. (CXX) g++ options: --param -O3 -rdynamic

OpenBenchmarking.orgMessages Per Second, More Is BetterSockperf 3.7Test: Throughputmitigations=offDefault300K600K900K1200K1500KSE +/- 4084.34, N = 5SE +/- 3708.79, N = 5124247611297531. (CXX) g++ options: --param -O3 -rdynamic

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonDefaultmitigations=off5001000150020002500SE +/- 8.85, N = 4SE +/- 31.83, N = 2023092498

AOM AV1

This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 10 Realtime - Input: Bosphorus 1080pDefaultmitigations=off306090120150SE +/- 0.25, N = 3SE +/- 1.60, N = 15150.78144.521. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 9 Realtime - Input: Bosphorus 1080pDefaultmitigations=off306090120150SE +/- 0.94, N = 3SE +/- 1.34, N = 15149.68146.021. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileDefaultmitigations=off7001400210028003500SE +/- 14.29, N = 3SE +/- 24.38, N = 33332.953325.55

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: Google Chromemitigations=offDefault50100150200250SE +/- 0.49, N = 3SE +/- 2.24, N = 3215.90216.341. chrome 104.0.5112.101

AOM AV1

This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4KDefaultmitigations=off1428425670SE +/- 0.10, N = 3SE +/- 0.26, N = 364.8961.831. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4KDefaultmitigations=off20406080100SE +/- 0.39, N = 3SE +/- 0.98, N = 378.8574.941. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 8 - Input: Bosphorus 4KDefaultmitigations=off20406080100SE +/- 0.53, N = 3SE +/- 0.72, N = 380.3679.361. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

GNU Octave Benchmark

This test profile measures how long it takes to complete several reference GNU Octave files via octave-benchmark. GNU Octave is used for numerical computations and is an open-source alternative to MATLAB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGNU Octave Benchmark 6.4.0Defaultmitigations=off1.08252.1653.24754.335.4125SE +/- 0.040, N = 5SE +/- 0.034, N = 54.5054.811

Node.js Express HTTP Load Test

A Node.js Express server with a Node-based loadtest client for facilitating HTTP benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterNode.js Express HTTP Load TestDefaultmitigations=off3K6K9K12K15KSE +/- 30.90, N = 3SE +/- 103.18, N = 31353913030

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest Compressionmitigations=offDefault1.16332.32663.48994.65325.8165SE +/- 0.05, N = 6SE +/- 0.01, N = 35.175.161. (CC) gcc options: -fvisibility=hidden -O2 -lm

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradebeansDefaultmitigations=off400800120016002000SE +/- 6.17, N = 4SE +/- 12.96, N = 416101700

ASTC Encoder

ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: MediumDefaultmitigations=off306090120150SE +/- 0.43, N = 3SE +/- 0.17, N = 3142.26139.741. (CXX) g++ options: -O3 -flto -pthread

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

Benchmark: StyleBench - Browser: Google Chrome

Default: The test quit with a non-zero exit status. E: selenium.common.exceptions.WebDriverException: Message: unknown error: net::ERR_NAME_NOT_RESOLVED

mitigations=off: The test quit with a non-zero exit status. E: selenium.common.exceptions.WebDriverException: Message: unknown error: net::ERR_NAME_NOT_RESOLVED

AOM AV1

This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 8 Realtime - Input: Bosphorus 1080pDefaultmitigations=off306090120150SE +/- 0.35, N = 3SE +/- 1.56, N = 3127.66119.821. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Launch ProgramsDefaultmitigations=off612182430SE +/- 0.14, N = 3SE +/- 0.19, N = 324.7926.161. (CC) gcc options: -lm

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create Processesmitigations=offDefault510152025SE +/- 0.13, N = 3SE +/- 0.20, N = 320.2220.421. (CC) gcc options: -lm

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100Defaultmitigations=off48121620SE +/- 0.11, N = 3SE +/- 0.23, N = 1516.7115.991. (CC) gcc options: -fvisibility=hidden -O2 -lm

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 10 - Input: Bosphorus 4KDefaultmitigations=off306090120150SE +/- 0.25, N = 3SE +/- 0.51, N = 3145.86140.691. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.10Encoder Speed: 6Defaultmitigations=off1.00042.00083.00124.00165.002SE +/- 0.022, N = 3SE +/- 0.039, N = 34.1964.4461. (CXX) g++ options: -O3 -fPIC -lm

Timed CPython Compilation

This test times how long it takes to build the reference Python implementation, CPython, with optimizations and LTO enabled for a release build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration: DefaultDefaultmitigations=off369121512.2713.33

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 12 - Input: Bosphorus 4KDefaultmitigations=off4080120160200SE +/- 0.27, N = 3SE +/- 0.23, N = 3204.30202.021. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 8 - Input: Bosphorus 1080pDefaultmitigations=off50100150200250SE +/- 0.62, N = 3SE +/- 0.36, N = 3209.71204.751. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Etcpak

Etcpack is the self-proclaimed "fastest ETC compressor on the planet" with focused on providing open-source, very fast ETC and S3 texture compression support. The test profile uses a 8K x 8K game texture as a sample input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMpx/s, More Is BetterEtcpak 1.0Benchmark: Multi-Threaded - Configuration: ETC2Defaultmitigations=off15003000450060007500SE +/- 5.06, N = 3SE +/- 4.52, N = 36812.176736.041. (CXX) g++ options: -O3 -march=native -std=c++11 -lpthread

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 10 - Input: Bosphorus 1080pDefaultmitigations=off100200300400500SE +/- 1.13, N = 3SE +/- 0.38, N = 3459.81445.541. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 12 - Input: Bosphorus 1080pDefaultmitigations=off150300450600750SE +/- 0.96, N = 3SE +/- 0.26, N = 3710.47695.901. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Defaultmitigations=off612182430SE +/- 0.38, N = 327.131. (CC) gcc options: -fvisibility=hidden -O2 -lm

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

Java Test: Eclipse

Default: The test quit with a non-zero exit status.

mitigations=off: The test quit with a non-zero exit status.

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

Test: x86_64 RdRand

Default: The test run did not produce a result. E: stress-ng: error: [1609865] No stress workers invoked (one or more were unsupported)

mitigations=off: The test run did not produce a result. E: stress-ng: error: [2440282] No stress workers invoked (one or more were unsupported)

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeDefaultmitigations=off11002200330044005500SE +/- 0.00, N = 3SE +/- 70.46, N = 35213.454646.37

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createmitigations=offDefault2004006008001000SE +/- 19.94, N = 3SE +/- 5.58, N = 3971.09936.39

194 Results Shown

Selenium
LuaRadio:
  Complex Phase
  Hilbert Transform
  FM Deemphasis Filter
  Five Back to Back FIR Filters
Selenium
Apache Spark:
  10000000 - 2000 - Broadcast Inner Join Test Time
  10000000 - 2000 - Inner Join Test Time
  10000000 - 2000 - Repartition Test Time
  10000000 - 2000 - Group By Test Time
  10000000 - 2000 - Calculate Pi Benchmark Using Dataframe
  10000000 - 2000 - Calculate Pi Benchmark
  10000000 - 2000 - SHA-512 Benchmark Time
Renaissance
ClickHouse:
  100M Rows Web Analytics Dataset, Third Run
  100M Rows Web Analytics Dataset, Second Run
  100M Rows Web Analytics Dataset, First Run / Cold Cache
Selenium
Apache Spark:
  40000000 - 100 - Broadcast Inner Join Test Time
  40000000 - 100 - Inner Join Test Time
  40000000 - 100 - Repartition Test Time
  40000000 - 100 - Group By Test Time
  40000000 - 100 - Calculate Pi Benchmark Using Dataframe
  40000000 - 100 - Calculate Pi Benchmark
  40000000 - 100 - SHA-512 Benchmark Time
etcd:
  RANGE - 100 - 100 - Average Latency
  RANGE - 100 - 100
  RANGE - 500 - 100 - Average Latency
  RANGE - 500 - 100
  RANGE - 50 - 100 - Average Latency
  RANGE - 50 - 100
  PUT - 500 - 100 - Average Latency
  PUT - 500 - 100
  PUT - 100 - 100 - Average Latency
  PUT - 100 - 100
  PUT - 50 - 100 - Average Latency
  PUT - 50 - 100
Apache CouchDB
Apache Spark:
  40000000 - 2000 - Broadcast Inner Join Test Time
  40000000 - 2000 - Inner Join Test Time
  40000000 - 2000 - Repartition Test Time
  40000000 - 2000 - Group By Test Time
  40000000 - 2000 - Calculate Pi Benchmark Using Dataframe
  40000000 - 2000 - Calculate Pi Benchmark
  40000000 - 2000 - SHA-512 Benchmark Time
Selenium
memtier_benchmark
Apache HTTP Server
Renaissance:
  Akka Unbalanced Cobwebbed Tree
  ALS Movie Lens
Selenium
Apache CouchDB
Stargate Digital Audio Workstation
Stress-NG:
  Context Switching
  Futex
WireGuard + Linux Networking Stack Stress Test
memtier_benchmark
Apache Cassandra
SQLite Speedtest
Stargate Digital Audio Workstation
Apache Spark:
  10000000 - 100 - Broadcast Inner Join Test Time
  10000000 - 100 - Inner Join Test Time
  10000000 - 100 - Repartition Test Time
  10000000 - 100 - Group By Test Time
  10000000 - 100 - Calculate Pi Benchmark Using Dataframe
  10000000 - 100 - Calculate Pi Benchmark
  10000000 - 100 - SHA-512 Benchmark Time
KeyDB
Apache HTTP Server
Selenium
memtier_benchmark
Renaissance
nginx:
  100
  1000
  200
Apache HTTP Server
nginx:
  500
  1
Apache HTTP Server
nginx
Stress-NG
Apache HTTP Server:
  20
  1
Redis
Selenium
PostMark
Selenium
Stargate Digital Audio Workstation
Redis
Renaissance
memtier_benchmark
Dragonflydb
Sockperf
Dragonflydb:
  200 - 5:1
  50 - 1:5
  50 - 5:1
Renaissance
Timed CPython Compilation
Stargate Digital Audio Workstation
Renaissance
Apache CouchDB
Timed Godot Game Engine Compilation
Node.js V8 Web Tooling Benchmark
etcd:
  PUT - 500 - 1000 - Average Latency
  PUT - 500 - 1000
  RANGE - 100 - 1000 - Average Latency
  RANGE - 100 - 1000
  RANGE - 500 - 1000 - Average Latency
  RANGE - 500 - 1000
  PUT - 100 - 1000 - Average Latency
  PUT - 100 - 1000
Stargate Digital Audio Workstation
etcd:
  RANGE - 50 - 1000 - Average Latency
  RANGE - 50 - 1000
  PUT - 50 - 1000 - Average Latency
  PUT - 50 - 1000
Selenium
Renaissance
Redis
Stress-NG
libavif avifenc
Renaissance
LibreOffice
Stargate Digital Audio Workstation
Etcpak
RawTherapee
WebP Image Encode
Renaissance
Selenium
ASTC Encoder
Selenium
Stress-NG:
  Malloc
  NUMA
  Atomic
  IO_uring
  MMAP
  CPU Cache
  Memory Copying
  Matrix Math
  Crypto
  MEMFD
  System V Message Passing
  Glibc Qsort Data Sorting
  Socket Activity
  Vector Math
  Semaphores
  CPU Stress
  SENDFILE
AOM AV1
Selenium
Renaissance
AOM AV1
Timed Mesa Compilation
DaCapo Benchmark
AOM AV1
libavif avifenc
Selenium
Redis
DaCapo Benchmark
ASTC Encoder
OSBench:
  Create Files
  Memory Allocations
Inkscape
OSBench
Sockperf:
  Latency Ping Pong
  Throughput
DaCapo Benchmark
AOM AV1:
  Speed 10 Realtime - Bosphorus 1080p
  Speed 9 Realtime - Bosphorus 1080p
Compile Bench
Selenium
AOM AV1:
  Speed 8 Realtime - Bosphorus 4K
  Speed 9 Realtime - Bosphorus 4K
SVT-AV1
GNU Octave Benchmark
Node.js Express HTTP Load Test
WebP Image Encode
DaCapo Benchmark
ASTC Encoder
AOM AV1
OSBench:
  Launch Programs
  Create Processes
WebP Image Encode
SVT-AV1
libavif avifenc
Timed CPython Compilation
SVT-AV1:
  Preset 12 - Bosphorus 4K
  Preset 8 - Bosphorus 1080p
Etcpak
SVT-AV1:
  Preset 10 - Bosphorus 1080p
  Preset 12 - Bosphorus 1080p
WebP Image Encode
Compile Bench:
  Read Compiled Tree
  Initial Create