AMD Zen 4 Auto IBRS Performance

Initial performance tests of Auto IBRS set for Linux 6.3 compared to prior Retpoline implementation... Benchmarks by Michael Larabel for a future article. More to come.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2301191-NE-AMDZEN4AU67
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Web Browsers 1 Tests
Timed Code Compilation 3 Tests
C/C++ Compiler Tests 5 Tests
CPU Massive 14 Tests
Creator Workloads 3 Tests
Database Test Suite 11 Tests
Disk Test Suite 2 Tests
Java 2 Tests
Common Kernel Benchmarks 8 Tests
Multi-Core 4 Tests
Programmer / Developer System Benchmarks 5 Tests
Python Tests 5 Tests
Server 13 Tests
Server CPU Tests 7 Tests
Single-Threaded 4 Tests
Common Workstation Benchmarks 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Auto IBRS
January 18 2023
  5 Hours, 28 Minutes
Linux 6.2 Git
January 18 2023
  5 Hours, 39 Minutes
Invert Hiding All Results Option
  5 Hours, 34 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


AMD Zen 4 Auto IBRS PerformanceOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 7950X 16-Core @ 4.50GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR X670E HERO (0805 BIOS)AMD Device 14d832GBWestern Digital WD_BLACK SN850X 1000GB + 2000GBAMD Radeon RX 6800 XT 16GB (2575/1000MHz)AMD Navi 21/23ASUS MG28UIntel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Ubuntu 22.106.2.0-rc3-phx-tip-x86-cpu (x86_64)6.2.0-060200rc4daily20230118-generic (x86_64)GNOME Shell 43.1X Server + Wayland4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.49)1.3.224GCC 12.2.0 + Clang 15.0.2-1ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelsDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionAMD Zen 4 Auto IBRS Performance BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - NONE / errors=remount-ro,relatime,rw / Block Size: 4096- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa601203 - OpenJDK Runtime Environment (build 18.0.2-ea+9-Ubuntu-2)- Python 3.10.7- Auto IBRS: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Linux 6.2 Git: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Auto IBRS vs. Linux 6.2 Git ComparisonPhoronix Test SuiteBaseline+5.4%+5.4%+10.8%+10.8%+16.2%+16.2%+21.6%+21.6%GET - 5021.7%Throughput14.6%IO_uring10.3%Redis - 50 - 1:110.2%Compile8.8%Redis - 100 - 1:18.7%Scala Dotty8.3%Initial Create7.3%Mutex6.1%Latency Ping Pong5.8%Context Switching4.8%D.T.P4.3%100 - 1000 - Read Only - Average Latency4.3%100 - 1000 - Read Only4.2%5004%2003.7%200 - 5:13.6%F.H.R3.6%10003.5%NUMA3.5%Create Files3.4%1002.6%KV, 50% Reads - 5122.5%Redis - 50 - 10:12.5%Latency Under Load2.5%1 - 1000 - Read Only - Average Latency2.4%1 - 1000 - Read Only2.4%1 - 800 - Read Only2.3%1 - 800 - Read Only - Average Latency2.3%Create Processes2.1%ARES-6 - Firefox2.1%GET - 5002.1%2.1%W.c - Firefox2%RedisSockperfStress-NGmemtier_benchmarkCompile Benchmemtier_benchmarkRenaissanceCompile BenchStress-NGSockperfStress-NGPostMarkPostgreSQLPostgreSQLnginxnginxDragonflydbRenaissancenginxStress-NGOSBenchnginxCockroachDBmemtier_benchmarkSockperfPostgreSQLPostgreSQLPostgreSQLPostgreSQLOSBenchSeleniumRedisWireGuard + Linux Networking Stack Stress TestSeleniumAuto IBRSLinux 6.2 Git

AMD Zen 4 Auto IBRS Performancesockperf: Throughputstress-ng: IO_uringmemtier-benchmark: Redis - 50 - 1:1compilebench: Compilememtier-benchmark: Redis - 100 - 1:1compilebench: Initial Createsockperf: Latency Ping Pongstress-ng: Context Switchingpostmark: Disk Transaction Performancepgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlynginx: 500nginx: 200dragonflydb: 200 - 5:1renaissance: Finagle HTTP Requestsnginx: 1000stress-ng: NUMAosbench: Create Filesnginx: 100cockroach: KV, 50% Reads - 512memtier-benchmark: Redis - 50 - 10:1sockperf: Latency Under Loadpgbench: 1 - 1000 - Read Only - Average Latencypgbench: 1 - 1000 - Read Onlypgbench: 1 - 800 - Read Onlypgbench: 1 - 800 - Read Only - Average Latencyosbench: Create Processesselenium: ARES-6 - Firefoxredis: GET - 500wireguard: selenium: WASM collisionDetection - Firefoxselenium: ARES-6 - Google Chromepgbench: 100 - 800 - Read Onlyredis: SET - 500selenium: Speedometer - Firefoxdragonflydb: 200 - 1:5stress-ng: Semaphorespgbench: 100 - 800 - Read Only - Average Latencyspark: 1000000 - 100 - SHA-512 Benchmark Timerenaissance: Genetic Algorithm Using Jenetics + Futuresselenium: WASM collisionDetection - Google Chromebrl-cad: VGR Performance Metricnode-express-loadtest: cockroach: KV, 50% Reads - 128memtier-benchmark: Redis - 50 - 1:10cockroach: KV, 10% Reads - 128rocksdb: Read While Writingselenium: PSPDFKit WASM - Google Chromeselenium: Jetstream 2 - Firefoxspark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframepgbench: 100 - 1000 - Read Write - Average Latencycockroach: KV, 10% Reads - 512pgbench: 100 - 1000 - Read Writememtier-benchmark: Redis - 100 - 1:10selenium: Kraken - Google Chromegit: Time To Complete Common Git Commandsbuild-linux-kernel: defconfigrocksdb: Rand Fill Syncosbench: Create Threadskeydb: cockroach: MoVR - 512cockroach: MoVR - 128stress-ng: MMAProcksdb: Update Randselenium: Kraken - Firefoxdarktable: Masskrug - CPU-onlyrocksdb: Seq Fillspark: 1000000 - 100 - Calculate Pi Benchmarkrocksdb: Read Rand Write Randinfluxdb: 64 - 10000 - 2,5000,1 - 10000build-godot: Time To Compilerocksdb: Rand Readrocksdb: Rand Fillsqlite-speedtest: Timed Time - Size 1,000selenium: Speedometer - Google Chromebuild-linux-kernel: allmodconfigbuild-llvm: Ninjadacapobench: Jythondarktable: Boat - CPU-onlyselenium: PSPDFKit WASM - Firefoxinfluxdb: 4 - 10000 - 2,5000,1 - 10000selenium: WASM imageConvolute - Firefoxctx-clock: Context Switch Timehbase: 10000 - Rand Write - 32stress-ng: Mutexredis: GET - 50renaissance: Scala DottyAuto IBRSLinux 6.2 Git126660932691.973960450.203675.163947399.461017.491.59811114905.04104810.5371863778179505.24199332.305408933.471849.1154199.72614.559.686768200874.5893448.83396653.689.6880.496201529220305670.39425.34310017.605331656.2137.679240.36.818804734344015.0297.15764962.903524027.400.4261.74957.6215.174325311190398611.63939082.0978351.443471552432207.7672.7623.10076297.1432943956141.90346.631.27146.755399209.973049927313.071248.21248.7390.871019843475.42.634149261856.0333796522739091.651.360156376252145638435.312374527.722256.85421322.33821002499344.117.918044304814819410.505829734.5437.9110546429637.523593245.833377.303632272.71948.051.69010603604.01100500.5601787889172610.31192280.905221293.141914.8148948.26593.7210.017125195874.7191139.83314366.229.9270.508196864019845510.40325.87954217.975223331.8140.522245.16.6818558794289025.5300.85694104.513481253.230.4311.76968.4217.594278391177997655.53901210.7277695.143835982452206.2072.7823.26075773.2429973930034.99348.931.46447.0353969710.027091922807.851242.21242.8389.031015269477.52.645148644655.8333693152747445.251.204156849249145208135.409375529.023256.25521282.33421022498029.117.918043730413964278.584791960.8474.3OpenBenchmarking.org

Sockperf

This is a network socket API performance benchmark developed by Mellanox. This test profile runs both the client and server on the local host for evaluating individual system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMessages Per Second, More Is BetterSockperf 3.7Test: ThroughputLinux 6.2 GitAuto IBRS300K600K900K1200K1500KSE +/- 5004.81, N = 5SE +/- 5863.99, N = 5110546412666091. (CXX) g++ options: --param -O3 -rdynamic
OpenBenchmarking.orgMessages Per Second, More Is BetterSockperf 3.7Test: ThroughputLinux 6.2 GitAuto IBRS200K400K600K800K1000KMin: 1094399 / Avg: 1105464.2 / Max: 1123052Min: 1250864 / Avg: 1266608.8 / Max: 12870531. (CXX) g++ options: --param -O3 -rdynamic

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: IO_uringLinux 6.2 GitAuto IBRS7K14K21K28K35KSE +/- 347.68, N = 4SE +/- 361.53, N = 1529637.5232691.971. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread
OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: IO_uringLinux 6.2 GitAuto IBRS6K12K18K24K30KMin: 28967.31 / Avg: 29637.52 / Max: 30502.6Min: 29366.97 / Avg: 32691.97 / Max: 36245.791. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:1Linux 6.2 GitAuto IBRS800K1600K2400K3200K4000KSE +/- 33274.79, N = 6SE +/- 36099.95, N = 33593245.833960450.201. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:1Linux 6.2 GitAuto IBRS700K1400K2100K2800K3500KMin: 3455088.28 / Avg: 3593245.83 / Max: 3691005.81Min: 3922557.34 / Avg: 3960450.2 / Max: 4032619.91. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileLinux 6.2 GitAuto IBRS8001600240032004000SE +/- 15.37, N = 3SE +/- 6.63, N = 33377.303675.16
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileLinux 6.2 GitAuto IBRS6001200180024003000Min: 3354.55 / Avg: 3377.3 / Max: 3406.58Min: 3661.89 / Avg: 3675.16 / Max: 3681.79

memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:1Linux 6.2 GitAuto IBRS800K1600K2400K3200K4000KSE +/- 28049.24, N = 3SE +/- 44405.62, N = 43632272.713947399.461. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:1Linux 6.2 GitAuto IBRS700K1400K2100K2800K3500KMin: 3576251.43 / Avg: 3632272.71 / Max: 3662831.31Min: 3875565.98 / Avg: 3947399.46 / Max: 4073229.21. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateLinux 6.2 GitAuto IBRS2004006008001000SE +/- 9.40, N = 3SE +/- 1.47, N = 3948.051017.49
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateLinux 6.2 GitAuto IBRS2004006008001000Min: 930.59 / Avg: 948.05 / Max: 962.82Min: 1016.02 / Avg: 1017.49 / Max: 1020.42

Sockperf

This is a network socket API performance benchmark developed by Mellanox. This test profile runs both the client and server on the local host for evaluating individual system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.7Test: Latency Ping PongLinux 6.2 GitAuto IBRS0.38030.76061.14091.52121.9015SE +/- 0.004, N = 5SE +/- 0.006, N = 51.6901.5981. (CXX) g++ options: --param -O3 -rdynamic
OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.7Test: Latency Ping PongLinux 6.2 GitAuto IBRS246810Min: 1.68 / Avg: 1.69 / Max: 1.7Min: 1.58 / Avg: 1.6 / Max: 1.611. (CXX) g++ options: --param -O3 -rdynamic

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Context SwitchingLinux 6.2 GitAuto IBRS2M4M6M8M10MSE +/- 115542.49, N = 5SE +/- 121682.79, N = 310603604.0111114905.041. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread
OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Context SwitchingLinux 6.2 GitAuto IBRS2M4M6M8M10MMin: 10287601.32 / Avg: 10603604.01 / Max: 10831727.53Min: 10898247.33 / Avg: 11114905.04 / Max: 11319227.031. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

PostMark

This is a test of NetApp's PostMark benchmark designed to simulate small-file testing similar to the tasks endured by web and mail servers. This test profile will set PostMark to perform 25,000 transactions with 500 files simultaneously with the file sizes ranging between 5 and 512 kilobytes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceLinux 6.2 GitAuto IBRS2K4K6K8K10KSE +/- 80.98, N = 9SE +/- 72.47, N = 1510050104811. (CC) gcc options: -O3
OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceLinux 6.2 GitAuto IBRS2K4K6K8K10KMin: 9615 / Avg: 10049.67 / Max: 10416Min: 10000 / Avg: 10481.33 / Max: 108691. (CC) gcc options: -O3

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyLinux 6.2 GitAuto IBRS0.1260.2520.3780.5040.63SE +/- 0.004, N = 10SE +/- 0.004, N = 30.5600.5371. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyLinux 6.2 GitAuto IBRS246810Min: 0.54 / Avg: 0.56 / Max: 0.58Min: 0.53 / Avg: 0.54 / Max: 0.541. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyLinux 6.2 GitAuto IBRS400K800K1200K1600K2000KSE +/- 14125.73, N = 10SE +/- 15499.39, N = 3178788918637781. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyLinux 6.2 GitAuto IBRS300K600K900K1200K1500KMin: 1726902.54 / Avg: 1787889.37 / Max: 1863196.09Min: 1842221.95 / Avg: 1863777.51 / Max: 1893848.091. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500Linux 6.2 GitAuto IBRS40K80K120K160K200KSE +/- 307.50, N = 3SE +/- 51.96, N = 3172610.31179505.241. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500Linux 6.2 GitAuto IBRS30K60K90K120K150KMin: 172243.88 / Avg: 172610.31 / Max: 173221.27Min: 179430.64 / Avg: 179505.24 / Max: 179605.191. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 200Linux 6.2 GitAuto IBRS40K80K120K160K200KSE +/- 449.71, N = 3SE +/- 110.51, N = 3192280.90199332.301. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 200Linux 6.2 GitAuto IBRS30K60K90K120K150KMin: 191396.31 / Avg: 192280.9 / Max: 192864.08Min: 199114.48 / Avg: 199332.3 / Max: 199473.661. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Dragonflydb

Dragonfly is an open-source database server that is a "modern Redis replacement" that aims to be the fastest memory store while being compliant with the Redis and Memcached protocols. For benchmarking Dragonfly, Memtier_benchmark is used as a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 5:1Linux 6.2 GitAuto IBRS1.2M2.4M3.6M4.8M6MSE +/- 39853.40, N = 3SE +/- 25693.70, N = 35221293.145408933.471. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 5:1Linux 6.2 GitAuto IBRS900K1800K2700K3600K4500KMin: 5152378.92 / Avg: 5221293.14 / Max: 5290434.6Min: 5371148.45 / Avg: 5408933.47 / Max: 5457987.51. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Finagle HTTP RequestsLinux 6.2 GitAuto IBRS400800120016002000SE +/- 16.07, N = 3SE +/- 20.35, N = 31914.81849.1MIN: 1773.42 / MAX: 1939MIN: 1692.3 / MAX: 1870.64
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Finagle HTTP RequestsLinux 6.2 GitAuto IBRS30060090012001500Min: 1884.39 / Avg: 1914.82 / Max: 1939Min: 1808.41 / Avg: 1849.08 / Max: 1870.64

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000Linux 6.2 GitAuto IBRS30K60K90K120K150KSE +/- 360.71, N = 3SE +/- 195.40, N = 3148948.26154199.721. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000Linux 6.2 GitAuto IBRS30K60K90K120K150KMin: 148247.18 / Avg: 148948.26 / Max: 149446.08Min: 153810.16 / Avg: 154199.72 / Max: 154421.451. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: NUMALinux 6.2 GitAuto IBRS130260390520650SE +/- 1.70, N = 3SE +/- 0.70, N = 3593.72614.551. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread
OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: NUMALinux 6.2 GitAuto IBRS110220330440550Min: 590.37 / Avg: 593.72 / Max: 595.86Min: 613.16 / Avg: 614.55 / Max: 615.291. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesLinux 6.2 GitAuto IBRS3691215SE +/- 0.024100, N = 3SE +/- 0.013312, N = 310.0171259.6867681. (CC) gcc options: -lm
OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesLinux 6.2 GitAuto IBRS3691215Min: 9.98 / Avg: 10.02 / Max: 10.06Min: 9.67 / Avg: 9.69 / Max: 9.711. (CC) gcc options: -lm

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 100Linux 6.2 GitAuto IBRS40K80K120K160K200KSE +/- 398.86, N = 3SE +/- 336.57, N = 3195874.71200874.581. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 100Linux 6.2 GitAuto IBRS30K60K90K120K150KMin: 195381.64 / Avg: 195874.71 / Max: 196664.32Min: 200370.41 / Avg: 200874.58 / Max: 201512.931. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 512Linux 6.2 GitAuto IBRS20K40K60K80K100KSE +/- 88.42, N = 3SE +/- 1007.53, N = 391139.893448.8
OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 512Linux 6.2 GitAuto IBRS16K32K48K64K80KMin: 91030.8 / Avg: 91139.8 / Max: 91314.9Min: 92259.4 / Avg: 93448.83 / Max: 95452.2

memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 10:1Linux 6.2 GitAuto IBRS700K1400K2100K2800K3500KSE +/- 28131.12, N = 3SE +/- 21454.45, N = 33314366.223396653.681. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 10:1Linux 6.2 GitAuto IBRS600K1200K1800K2400K3000KMin: 3278619.33 / Avg: 3314366.22 / Max: 3369865.44Min: 3359304.18 / Avg: 3396653.68 / Max: 3433621.631. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Sockperf

This is a network socket API performance benchmark developed by Mellanox. This test profile runs both the client and server on the local host for evaluating individual system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.7Test: Latency Under LoadLinux 6.2 GitAuto IBRS3691215SE +/- 0.116, N = 25SE +/- 0.085, N = 59.9279.6881. (CXX) g++ options: --param -O3 -rdynamic
OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.7Test: Latency Under LoadLinux 6.2 GitAuto IBRS3691215Min: 9.04 / Avg: 9.93 / Max: 12.32Min: 9.43 / Avg: 9.69 / Max: 9.861. (CXX) g++ options: --param -O3 -rdynamic

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 1 - Clients: 1000 - Mode: Read Only - Average LatencyLinux 6.2 GitAuto IBRS0.11430.22860.34290.45720.5715SE +/- 0.003, N = 3SE +/- 0.005, N = 30.5080.4961. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 1 - Clients: 1000 - Mode: Read Only - Average LatencyLinux 6.2 GitAuto IBRS246810Min: 0.5 / Avg: 0.51 / Max: 0.51Min: 0.49 / Avg: 0.5 / Max: 0.51. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 1 - Clients: 1000 - Mode: Read OnlyLinux 6.2 GitAuto IBRS400K800K1200K1600K2000KSE +/- 10622.83, N = 3SE +/- 21370.27, N = 3196864020152921. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 1 - Clients: 1000 - Mode: Read OnlyLinux 6.2 GitAuto IBRS300K600K900K1200K1500KMin: 1950594.51 / Avg: 1968639.88 / Max: 1987373.74Min: 1986625.58 / Avg: 2015291.7 / Max: 2057079.371. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 1 - Clients: 800 - Mode: Read OnlyLinux 6.2 GitAuto IBRS400K800K1200K1600K2000KSE +/- 16388.51, N = 3SE +/- 29002.25, N = 3198455120305671. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 1 - Clients: 800 - Mode: Read OnlyLinux 6.2 GitAuto IBRS400K800K1200K1600K2000KMin: 1958464.01 / Avg: 1984550.75 / Max: 2014780.21Min: 1997855.09 / Avg: 2030567.31 / Max: 2088406.251. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 1 - Clients: 800 - Mode: Read Only - Average LatencyLinux 6.2 GitAuto IBRS0.09070.18140.27210.36280.4535SE +/- 0.003, N = 3SE +/- 0.006, N = 30.4030.3941. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 1 - Clients: 800 - Mode: Read Only - Average LatencyLinux 6.2 GitAuto IBRS12345Min: 0.4 / Avg: 0.4 / Max: 0.41Min: 0.38 / Avg: 0.39 / Max: 0.41. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create ProcessesLinux 6.2 GitAuto IBRS612182430SE +/- 0.15, N = 3SE +/- 0.25, N = 325.8825.341. (CC) gcc options: -lm
OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create ProcessesLinux 6.2 GitAuto IBRS612182430Min: 25.62 / Avg: 25.88 / Max: 26.14Min: 24.93 / Avg: 25.34 / Max: 25.781. (CC) gcc options: -lm

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: FirefoxLinux 6.2 GitAuto IBRS48121620SE +/- 0.04, N = 3SE +/- 0.04, N = 317.9717.601. firefox 109.0
OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: FirefoxLinux 6.2 GitAuto IBRS510152025Min: 17.92 / Avg: 17.97 / Max: 18.04Min: 17.52 / Avg: 17.6 / Max: 17.671. firefox 109.0

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 500Linux 6.2 GitAuto IBRS1.1M2.2M3.3M4.4M5.5MSE +/- 80377.64, N = 15SE +/- 18088.97, N = 35223331.85331656.21. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3
OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 500Linux 6.2 GitAuto IBRS900K1800K2700K3600K4500KMin: 4555060 / Avg: 5223331.8 / Max: 5490380.5Min: 5297266 / Avg: 5331656.17 / Max: 5358578.51. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

WireGuard + Linux Networking Stack Stress Test

This is a benchmark of the WireGuard secure VPN tunnel and Linux networking stack stress test. The test runs on the local host but does require root permissions to run. The way it works is it creates three namespaces. ns0 has a loopback device. ns1 and ns2 each have wireguard devices. Those two wireguard devices send traffic through the loopback device of ns0. The end result of this is that tests wind up testing encryption and decryption at the same time -- a pretty CPU and scheduler-heavy workflow. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterWireGuard + Linux Networking Stack Stress TestLinux 6.2 GitAuto IBRS306090120150SE +/- 0.87, N = 3SE +/- 1.22, N = 3140.52137.68
OpenBenchmarking.orgSeconds, Fewer Is BetterWireGuard + Linux Networking Stack Stress TestLinux 6.2 GitAuto IBRS306090120150Min: 139.61 / Avg: 140.52 / Max: 142.27Min: 135.42 / Avg: 137.68 / Max: 139.62

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: FirefoxLinux 6.2 GitAuto IBRS50100150200250SE +/- 1.56, N = 3SE +/- 1.83, N = 3245.1240.31. firefox 109.0
OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: FirefoxLinux 6.2 GitAuto IBRS4080120160200Min: 243.1 / Avg: 245.13 / Max: 248.2Min: 238.4 / Avg: 240.33 / Max: 2441. firefox 109.0

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: Google ChromeLinux 6.2 GitAuto IBRS246810SE +/- 0.01, N = 3SE +/- 0.07, N = 36.686.801. chrome 109.0.5414.74
OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: Google ChromeLinux 6.2 GitAuto IBRS3691215Min: 6.67 / Avg: 6.68 / Max: 6.7Min: 6.7 / Avg: 6.77 / Max: 6.91. chrome 109.0.5414.74

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read OnlyLinux 6.2 GitAuto IBRS400K800K1200K1600K2000KSE +/- 13559.13, N = 3SE +/- 9553.61, N = 3185587918804731. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read OnlyLinux 6.2 GitAuto IBRS300K600K900K1200K1500KMin: 1829317.79 / Avg: 1855878.99 / Max: 1873895.34Min: 1861636.58 / Avg: 1880472.69 / Max: 1892668.371. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 500Linux 6.2 GitAuto IBRS900K1800K2700K3600K4500KSE +/- 19184.12, N = 3SE +/- 8397.44, N = 34289025.54344015.01. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3
OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 500Linux 6.2 GitAuto IBRS800K1600K2400K3200K4000KMin: 4264468.5 / Avg: 4289025.5 / Max: 4326834.5Min: 4329831.5 / Avg: 4344015 / Max: 43588961. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: FirefoxLinux 6.2 GitAuto IBRS70140210280350SE +/- 1.25, N = 3SE +/- 1.95, N = 3300.8297.11. firefox 109.0
OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: FirefoxLinux 6.2 GitAuto IBRS50100150200250Min: 299.2 / Avg: 300.83 / Max: 303.3Min: 295.1 / Avg: 297.1 / Max: 3011. firefox 109.0

Dragonflydb

Dragonfly is an open-source database server that is a "modern Redis replacement" that aims to be the fastest memory store while being compliant with the Redis and Memcached protocols. For benchmarking Dragonfly, Memtier_benchmark is used as a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:5Linux 6.2 GitAuto IBRS1.2M2.4M3.6M4.8M6MSE +/- 54495.49, N = 3SE +/- 31841.88, N = 35694104.515764962.901. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:5Linux 6.2 GitAuto IBRS1000K2000K3000K4000K5000KMin: 5621778.33 / Avg: 5694104.51 / Max: 5800878.98Min: 5707278.48 / Avg: 5764962.9 / Max: 5817173.811. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SemaphoresLinux 6.2 GitAuto IBRS800K1600K2400K3200K4000KSE +/- 17099.65, N = 3SE +/- 1088.41, N = 33481253.233524027.401. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread
OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SemaphoresLinux 6.2 GitAuto IBRS600K1200K1800K2400K3000KMin: 3461715.72 / Avg: 3481253.23 / Max: 3515330.59Min: 3521890.07 / Avg: 3524027.4 / Max: 3525453.561. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average LatencyLinux 6.2 GitAuto IBRS0.0970.1940.2910.3880.485SE +/- 0.003, N = 3SE +/- 0.002, N = 30.4310.4261. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average LatencyLinux 6.2 GitAuto IBRS12345Min: 0.43 / Avg: 0.43 / Max: 0.44Min: 0.42 / Avg: 0.43 / Max: 0.431. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Apache Spark

This is a benchmark of Apache Spark with its PySpark interface. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmars the Apache Spark in a single-system configuration using spark-submit. The test makes use of DIYBigData's pyspark-benchmark (https://github.com/DIYBigData/pyspark-benchmark/) for generating of test data and various Apache Spark operations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark TimeLinux 6.2 GitAuto IBRS0.3960.7921.1881.5841.98SE +/- 0.01, N = 3SE +/- 0.02, N = 61.761.74
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark TimeLinux 6.2 GitAuto IBRS246810Min: 1.74 / Avg: 1.76 / Max: 1.78Min: 1.69 / Avg: 1.74 / Max: 1.79

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Genetic Algorithm Using Jenetics + FuturesLinux 6.2 GitAuto IBRS2004006008001000SE +/- 8.53, N = 3SE +/- 6.07, N = 3968.4957.6MIN: 931.14 / MAX: 997.79MIN: 899.95 / MAX: 995.27
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Genetic Algorithm Using Jenetics + FuturesLinux 6.2 GitAuto IBRS2004006008001000Min: 957.59 / Avg: 968.39 / Max: 985.23Min: 945.93 / Avg: 957.59 / Max: 966.33

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: Google ChromeLinux 6.2 GitAuto IBRS50100150200250SE +/- 0.33, N = 3SE +/- 2.35, N = 3217.59215.171. chrome 109.0.5414.74
OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: Google ChromeLinux 6.2 GitAuto IBRS4080120160200Min: 216.93 / Avg: 217.59 / Max: 217.98Min: 210.51 / Avg: 215.17 / Max: 218.021. chrome 109.0.5414.74

BRL-CAD

BRL-CAD is a cross-platform, open-source solid modeling system with built-in benchmark mode. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.34VGR Performance MetricLinux 6.2 GitAuto IBRS90K180K270K360K450K4278394325311. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Node.js Express HTTP Load Test

A Node.js Express server with a Node-based loadtest client for facilitating HTTP benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterNode.js Express HTTP Load TestLinux 6.2 GitAuto IBRS3K6K9K12K15KSE +/- 35.97, N = 3SE +/- 79.93, N = 31177911903
OpenBenchmarking.orgRequests Per Second, More Is BetterNode.js Express HTTP Load TestLinux 6.2 GitAuto IBRS2K4K6K8K10KMin: 11707 / Avg: 11778.67 / Max: 11820Min: 11748 / Avg: 11902.67 / Max: 12015

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 128Linux 6.2 GitAuto IBRS20K40K60K80K100KSE +/- 605.18, N = 3SE +/- 828.91, N = 397655.598611.6
OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 128Linux 6.2 GitAuto IBRS20K40K60K80K100KMin: 96931.3 / Avg: 97655.53 / Max: 98857.5Min: 97639.7 / Avg: 98611.63 / Max: 100260.7

memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10Linux 6.2 GitAuto IBRS800K1600K2400K3200K4000KSE +/- 50455.65, N = 3SE +/- 16843.77, N = 33901210.723939082.091. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10Linux 6.2 GitAuto IBRS700K1400K2100K2800K3500KMin: 3829136.76 / Avg: 3901210.72 / Max: 3998414.08Min: 3905527.82 / Avg: 3939082.09 / Max: 3958451.751. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 128Linux 6.2 GitAuto IBRS20K40K60K80K100KSE +/- 597.83, N = 3SE +/- 561.86, N = 377695.178351.4
OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 128Linux 6.2 GitAuto IBRS14K28K42K56K70KMin: 76884 / Avg: 77695.07 / Max: 78861.4Min: 77729.1 / Avg: 78351.43 / Max: 79472.9

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read While WritingLinux 6.2 GitAuto IBRS900K1800K2700K3600K4500KSE +/- 23415.21, N = 3SE +/- 9993.64, N = 3438359843471551. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read While WritingLinux 6.2 GitAuto IBRS800K1600K2400K3200K4000KMin: 4337395 / Avg: 4383598 / Max: 4413316Min: 4328419 / Avg: 4347155.33 / Max: 43625511. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, Fewer Is BetterSeleniumBenchmark: PSPDFKit WASM - Browser: Google ChromeLinux 6.2 GitAuto IBRS5001000150020002500SE +/- 16.48, N = 3SE +/- 5.51, N = 3245224321. chrome 109.0.5414.74
OpenBenchmarking.orgScore, Fewer Is BetterSeleniumBenchmark: PSPDFKit WASM - Browser: Google ChromeLinux 6.2 GitAuto IBRS400800120016002000Min: 2423 / Avg: 2452.33 / Max: 2480Min: 2422 / Avg: 2432 / Max: 24411. chrome 109.0.5414.74

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream 2 - Browser: FirefoxLinux 6.2 GitAuto IBRS50100150200250SE +/- 1.86, N = 3206.21207.771. firefox 109.0
OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream 2 - Browser: FirefoxLinux 6.2 GitAuto IBRS4080120160200Min: 203.05 / Avg: 206.21 / Max: 209.51. firefox 109.0

Apache Spark

This is a benchmark of Apache Spark with its PySpark interface. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmars the Apache Spark in a single-system configuration using spark-submit. The test makes use of DIYBigData's pyspark-benchmark (https://github.com/DIYBigData/pyspark-benchmark/) for generating of test data and various Apache Spark operations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeLinux 6.2 GitAuto IBRS0.62551.2511.87652.5023.1275SE +/- 0.03, N = 3SE +/- 0.01, N = 62.782.76
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using DataframeLinux 6.2 GitAuto IBRS246810Min: 2.72 / Avg: 2.78 / Max: 2.84Min: 2.74 / Avg: 2.76 / Max: 2.81

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyLinux 6.2 GitAuto IBRS612182430SE +/- 0.17, N = 3SE +/- 0.14, N = 323.2623.101. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyLinux 6.2 GitAuto IBRS510152025Min: 23.09 / Avg: 23.26 / Max: 23.61Min: 22.82 / Avg: 23.1 / Max: 23.281. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 512Linux 6.2 GitAuto IBRS16K32K48K64K80KSE +/- 162.67, N = 3SE +/- 258.53, N = 375773.276297.1
OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 512Linux 6.2 GitAuto IBRS13K26K39K52K65KMin: 75448.6 / Avg: 75773.17 / Max: 75954.9Min: 75942.2 / Avg: 76297.1 / Max: 76800.2

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteLinux 6.2 GitAuto IBRS9K18K27K36K45KSE +/- 316.61, N = 3SE +/- 268.00, N = 342997432941. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteLinux 6.2 GitAuto IBRS8K16K24K32K40KMin: 42363.51 / Avg: 42996.73 / Max: 43316.19Min: 42947.66 / Avg: 43293.84 / Max: 43821.321. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

memtier_benchmark

Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10Linux 6.2 GitAuto IBRS800K1600K2400K3200K4000KSE +/- 44656.72, N = 4SE +/- 47120.15, N = 43930034.993956141.901. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10Linux 6.2 GitAuto IBRS700K1400K2100K2800K3500KMin: 3820833.54 / Avg: 3930034.99 / Max: 4035286.34Min: 3818689.4 / Avg: 3956141.9 / Max: 4030412.521. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: Google ChromeLinux 6.2 GitAuto IBRS80160240320400SE +/- 0.94, N = 3SE +/- 0.20, N = 3348.9346.61. chrome 109.0.5414.74
OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: Google ChromeLinux 6.2 GitAuto IBRS60120180240300Min: 347.1 / Avg: 348.87 / Max: 350.3Min: 346.3 / Avg: 346.63 / Max: 3471. chrome 109.0.5414.74

Git

This test measures the time needed to carry out some sample Git operations on an example, static repository that happens to be a copy of the GNOME GTK tool-kit repository. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGitTime To Complete Common Git CommandsLinux 6.2 GitAuto IBRS714212835SE +/- 0.32, N = 3SE +/- 0.29, N = 331.4631.271. git version 2.37.2
OpenBenchmarking.orgSeconds, Fewer Is BetterGitTime To Complete Common Git CommandsLinux 6.2 GitAuto IBRS714212835Min: 30.84 / Avg: 31.46 / Max: 31.9Min: 30.78 / Avg: 31.27 / Max: 31.781. git version 2.37.2

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigLinux 6.2 GitAuto IBRS1122334455SE +/- 0.33, N = 3SE +/- 0.29, N = 347.0446.76
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigLinux 6.2 GitAuto IBRS1020304050Min: 46.67 / Avg: 47.04 / Max: 47.7Min: 46.47 / Avg: 46.75 / Max: 47.33

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Fill SyncLinux 6.2 GitAuto IBRS9K18K27K36K45KSE +/- 33.49, N = 3SE +/- 26.01, N = 339697399201. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Fill SyncLinux 6.2 GitAuto IBRS7K14K21K28K35KMin: 39639 / Avg: 39697.33 / Max: 39755Min: 39874 / Avg: 39920.33 / Max: 399641. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create ThreadsLinux 6.2 GitAuto IBRS3691215SE +/- 0.013857, N = 3SE +/- 0.093146, N = 310.0270919.9730491. (CC) gcc options: -lm
OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create ThreadsLinux 6.2 GitAuto IBRS3691215Min: 10 / Avg: 10.03 / Max: 10.05Min: 9.87 / Avg: 9.97 / Max: 10.161. (CC) gcc options: -lm

KeyDB

A benchmark of KeyDB as a multi-threaded fork of the Redis server. The KeyDB benchmark is conducted using memtier-benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterKeyDB 6.2.0Linux 6.2 GitAuto IBRS200K400K600K800K1000KSE +/- 1966.20, N = 3SE +/- 2161.80, N = 3922807.85927313.071. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterKeyDB 6.2.0Linux 6.2 GitAuto IBRS160K320K480K640K800KMin: 919602.4 / Avg: 922807.85 / Max: 926383.29Min: 924618.67 / Avg: 927313.07 / Max: 931588.641. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 512Linux 6.2 GitAuto IBRS30060090012001500SE +/- 1.40, N = 3SE +/- 1.00, N = 31242.21248.2
OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 512Linux 6.2 GitAuto IBRS2004006008001000Min: 1239.6 / Avg: 1242.17 / Max: 1244.4Min: 1246.2 / Avg: 1248.2 / Max: 1249.2

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 128Linux 6.2 GitAuto IBRS30060090012001500SE +/- 0.78, N = 3SE +/- 1.95, N = 31242.81248.7
OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 128Linux 6.2 GitAuto IBRS2004006008001000Min: 1241.5 / Avg: 1242.8 / Max: 1244.2Min: 1244.9 / Avg: 1248.67 / Max: 1251.4

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MMAPLinux 6.2 GitAuto IBRS80160240320400SE +/- 1.47, N = 3SE +/- 0.29, N = 3389.03390.871. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread
OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MMAPLinux 6.2 GitAuto IBRS70140210280350Min: 386.1 / Avg: 389.03 / Max: 390.67Min: 390.29 / Avg: 390.87 / Max: 391.241. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Update RandomLinux 6.2 GitAuto IBRS200K400K600K800K1000KSE +/- 1241.80, N = 3SE +/- 3021.46, N = 3101526910198431. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Update RandomLinux 6.2 GitAuto IBRS200K400K600K800K1000KMin: 1012787 / Avg: 1015269 / Max: 1016587Min: 1014059 / Avg: 1019843.33 / Max: 10242501. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: FirefoxLinux 6.2 GitAuto IBRS100200300400500SE +/- 1.24, N = 3SE +/- 1.47, N = 3477.5475.41. firefox 109.0
OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: FirefoxLinux 6.2 GitAuto IBRS80160240320400Min: 475.4 / Avg: 477.47 / Max: 479.7Min: 473.5 / Avg: 475.4 / Max: 478.31. firefox 109.0

Darktable

Darktable is an open-source photography / workflow application this will use any system-installed Darktable program or on Windows will automatically download the pre-built binary from the project. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 4.0.0Test: Masskrug - Acceleration: CPU-onlyLinux 6.2 GitAuto IBRS0.59511.19021.78532.38042.9755SE +/- 0.009, N = 3SE +/- 0.003, N = 32.6452.634
OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 4.0.0Test: Masskrug - Acceleration: CPU-onlyLinux 6.2 GitAuto IBRS246810Min: 2.63 / Avg: 2.64 / Max: 2.66Min: 2.63 / Avg: 2.63 / Max: 2.64

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Sequential FillLinux 6.2 GitAuto IBRS300K600K900K1200K1500KSE +/- 5032.31, N = 3SE +/- 3927.45, N = 3148644614926181. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Sequential FillLinux 6.2 GitAuto IBRS300K600K900K1200K1500KMin: 1480175 / Avg: 1486446 / Max: 1496399Min: 1484776 / Avg: 1492618.33 / Max: 14969241. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Apache Spark

This is a benchmark of Apache Spark with its PySpark interface. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmars the Apache Spark in a single-system configuration using spark-submit. The test makes use of DIYBigData's pyspark-benchmark (https://github.com/DIYBigData/pyspark-benchmark/) for generating of test data and various Apache Spark operations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi BenchmarkLinux 6.2 GitAuto IBRS1326395265SE +/- 0.19, N = 3SE +/- 0.31, N = 655.8356.03
OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 1000000 - Partitions: 100 - Calculate Pi BenchmarkLinux 6.2 GitAuto IBRS1122334455Min: 55.6 / Avg: 55.83 / Max: 56.19Min: 55.17 / Avg: 56.03 / Max: 57.13

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read Random Write RandomLinux 6.2 GitAuto IBRS700K1400K2100K2800K3500KSE +/- 7285.88, N = 3SE +/- 2704.70, N = 3336931533796521. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read Random Write RandomLinux 6.2 GitAuto IBRS600K1200K1800K2400K3000KMin: 3356810 / Avg: 3369315 / Max: 3382046Min: 3375156 / Avg: 3379652.33 / Max: 33845051. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

InfluxDB

This is a benchmark of the InfluxDB open-source time-series database optimized for fast, high-availability storage for IoT and other use-cases. The InfluxDB test profile makes use of InfluxDB Inch for facilitating the benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgval/sec, More Is BetterInfluxDB 1.8.2Concurrent Streams: 64 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000Linux 6.2 GitAuto IBRS600K1200K1800K2400K3000KSE +/- 10682.61, N = 3SE +/- 5526.60, N = 32747445.22739091.6
OpenBenchmarking.orgval/sec, More Is BetterInfluxDB 1.8.2Concurrent Streams: 64 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000Linux 6.2 GitAuto IBRS500K1000K1500K2000K2500KMin: 2726515 / Avg: 2747445.17 / Max: 2761625.2Min: 2729703 / Avg: 2739091.6 / Max: 2748837.7

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To CompileLinux 6.2 GitAuto IBRS1224364860SE +/- 0.14, N = 3SE +/- 0.12, N = 351.2051.36
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To CompileLinux 6.2 GitAuto IBRS1020304050Min: 51.01 / Avg: 51.2 / Max: 51.46Min: 51.17 / Avg: 51.36 / Max: 51.58

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random ReadLinux 6.2 GitAuto IBRS30M60M90M120M150MSE +/- 742538.53, N = 3SE +/- 417674.12, N = 31568492491563762521. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random ReadLinux 6.2 GitAuto IBRS30M60M90M120M150MMin: 155761488 / Avg: 156849249.33 / Max: 158268728Min: 155865250 / Avg: 156376251.67 / Max: 1572040401. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random FillLinux 6.2 GitAuto IBRS300K600K900K1200K1500KSE +/- 1973.97, N = 3SE +/- 4987.59, N = 3145208114563841. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random FillLinux 6.2 GitAuto IBRS300K600K900K1200K1500KMin: 1448956 / Avg: 1452081.33 / Max: 1455733Min: 1447367 / Avg: 1456383.67 / Max: 14645871. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

SQLite Speedtest

This is a benchmark of SQLite's speedtest1 benchmark program with an increased problem size of 1,000. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000Linux 6.2 GitAuto IBRS816243240SE +/- 0.06, N = 3SE +/- 0.08, N = 335.4135.311. (CC) gcc options: -O2 -lz
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000Linux 6.2 GitAuto IBRS816243240Min: 35.3 / Avg: 35.41 / Max: 35.52Min: 35.17 / Avg: 35.31 / Max: 35.451. (CC) gcc options: -O2 -lz

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: Google ChromeLinux 6.2 GitAuto IBRS80160240320400SE +/- 2.03, N = 3SE +/- 2.96, N = 33753741. chrome 109.0.5414.74
OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: Google ChromeLinux 6.2 GitAuto IBRS70140210280350Min: 372 / Avg: 375.33 / Max: 379Min: 370 / Avg: 374.33 / Max: 3801. chrome 109.0.5414.74

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigLinux 6.2 GitAuto IBRS110220330440550SE +/- 0.55, N = 3SE +/- 1.07, N = 3529.02527.72
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigLinux 6.2 GitAuto IBRS90180270360450Min: 528.42 / Avg: 529.02 / Max: 530.12Min: 525.63 / Avg: 527.72 / Max: 529.17

Timed LLVM Compilation

This test times how long it takes to build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 13.0Build System: NinjaLinux 6.2 GitAuto IBRS60120180240300SE +/- 0.15, N = 3SE +/- 0.25, N = 3256.26256.85
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 13.0Build System: NinjaLinux 6.2 GitAuto IBRS50100150200250Min: 255.95 / Avg: 256.26 / Max: 256.45Min: 256.51 / Avg: 256.85 / Max: 257.33

DaCapo Benchmark

This test runs the DaCapo Benchmarks written in Java and intended to test system/CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonLinux 6.2 GitAuto IBRS5001000150020002500SE +/- 15.71, N = 4SE +/- 9.91, N = 421282132
OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonLinux 6.2 GitAuto IBRS400800120016002000Min: 2103 / Avg: 2127.75 / Max: 2172Min: 2117 / Avg: 2132 / Max: 2160

Darktable

Darktable is an open-source photography / workflow application this will use any system-installed Darktable program or on Windows will automatically download the pre-built binary from the project. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 4.0.0Test: Boat - Acceleration: CPU-onlyLinux 6.2 GitAuto IBRS0.52611.05221.57832.10442.6305SE +/- 0.011, N = 3SE +/- 0.005, N = 32.3342.338
OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 4.0.0Test: Boat - Acceleration: CPU-onlyLinux 6.2 GitAuto IBRS246810Min: 2.31 / Avg: 2.33 / Max: 2.35Min: 2.33 / Avg: 2.34 / Max: 2.34

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, Fewer Is BetterSeleniumBenchmark: PSPDFKit WASM - Browser: FirefoxLinux 6.2 GitAuto IBRS5001000150020002500SE +/- 4.37, N = 3SE +/- 5.81, N = 3210221001. firefox 109.0
OpenBenchmarking.orgScore, Fewer Is BetterSeleniumBenchmark: PSPDFKit WASM - Browser: FirefoxLinux 6.2 GitAuto IBRS400800120016002000Min: 2097 / Avg: 2102.33 / Max: 2111Min: 2089 / Avg: 2099.67 / Max: 21091. firefox 109.0

InfluxDB

This is a benchmark of the InfluxDB open-source time-series database optimized for fast, high-availability storage for IoT and other use-cases. The InfluxDB test profile makes use of InfluxDB Inch for facilitating the benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgval/sec, More Is BetterInfluxDB 1.8.2Concurrent Streams: 4 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000Linux 6.2 GitAuto IBRS500K1000K1500K2000K2500KSE +/- 4064.43, N = 3SE +/- 7750.93, N = 32498029.12499344.1
OpenBenchmarking.orgval/sec, More Is BetterInfluxDB 1.8.2Concurrent Streams: 4 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000Linux 6.2 GitAuto IBRS400K800K1200K1600K2000KMin: 2490135.7 / Avg: 2498029.07 / Max: 2503658Min: 2484137.4 / Avg: 2499344.1 / Max: 2509554.7

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM imageConvolute - Browser: FirefoxLinux 6.2 GitAuto IBRS48121620SE +/- 0.13, N = 3SE +/- 0.09, N = 317.917.91. firefox 109.0
OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM imageConvolute - Browser: FirefoxLinux 6.2 GitAuto IBRS510152025Min: 17.6 / Avg: 17.87 / Max: 18Min: 17.8 / Avg: 17.93 / Max: 18.11. firefox 109.0

ctx_clock

Ctx_clock is a simple test program to measure the context switch time in clock cycles. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgClocks, Fewer Is Betterctx_clockContext Switch TimeLinux 6.2 GitAuto IBRS4080120160200SE +/- 0.00, N = 3SE +/- 0.00, N = 3180180
OpenBenchmarking.orgClocks, Fewer Is Betterctx_clockContext Switch TimeLinux 6.2 GitAuto IBRS306090120150Min: 180 / Avg: 180 / Max: 180Min: 180 / Avg: 180 / Max: 180

Apache HBase

This is a benchmark of the Apache HBase non-relational distributed database system inspired from Google's Bigtable. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.5.0Rows: 10000 - Test: Random Write - Clients: 32Linux 6.2 GitAuto IBRS90K180K270K360K450KSE +/- 12894.69, N = 15SE +/- 12140.09, N = 15437304443048
OpenBenchmarking.orgRows Per Second, More Is BetterApache HBase 2.5.0Rows: 10000 - Test: Random Write - Clients: 32Linux 6.2 GitAuto IBRS80K160K240K320K400KMin: 305994 / Avg: 437303.87 / Max: 499548Min: 311359 / Avg: 443048 / Max: 494957

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MutexLinux 6.2 GitAuto IBRS3M6M9M12M15MSE +/- 78291.25, N = 3SE +/- 378248.33, N = 1513964278.5814819410.501. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread
OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MutexLinux 6.2 GitAuto IBRS3M6M9M12M15MMin: 13822594.45 / Avg: 13964278.58 / Max: 14092850.74Min: 14207079.34 / Avg: 14819410.5 / Max: 20086210.441. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 50Linux 6.2 GitAuto IBRS1.2M2.4M3.6M4.8M6MSE +/- 87118.74, N = 15SE +/- 81129.32, N = 154791960.85829734.51. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3
OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 50Linux 6.2 GitAuto IBRS1000K2000K3000K4000K5000KMin: 4201756 / Avg: 4791960.77 / Max: 5314083.5Min: 5296120 / Avg: 5829734.5 / Max: 6160780.51. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Renaissance

Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Scala DottyLinux 6.2 GitAuto IBRS100200300400500SE +/- 4.22, N = 3SE +/- 8.70, N = 15474.3437.9MIN: 339.98 / MAX: 623.77MIN: 329.62 / MAX: 645.18
OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Scala DottyLinux 6.2 GitAuto IBRS80160240320400Min: 466.33 / Avg: 474.32 / Max: 480.68Min: 394.69 / Avg: 437.86 / Max: 482.8